2023-10-09T06:07:39.704 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-09T06:07:39.705 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --name vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --archive /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375 -- /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375/orig.config.yaml 2023-10-09T06:07:39.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:07:39.840 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: vshankar@redhat.com first_in_suite: false job_id: '7418375' kernel: client: sha1: distro flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231009.053123 sha1: 62a27f0d8453e2104f759ed08ba781e24c5ed056 owner: scheduled_vshankar@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8174 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-vshankar-testing-20231009.053123 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_62a27f0d8453e2104f759ed08ba781e24c5ed056/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: 62a27f0d8453e2104f759ed08ba781e24c5ed056 targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLRVEBuuJ0RS8zz7zUdHUzUyE4iRsUi8Q7TmoPhC/I+TVBoPFh9toqiAnTZ8slMoPqgsB5hXgx0Es0rVLn5ZbU8= smithi158.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLn7tkOtY9ygveFVe4QbRCNfjDA5rUZ2yFg1618DNqnkk5IleuNdVsjJgMw7gayzjYXz9/+xc9CfCsQUg6YiIrk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-09_05:36:44 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-09T06:07:39.841 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_62a27f0d8453e2104f759ed08ba781e24c5ed056/qa; will attempt to use it 2023-10-09T06:07:39.841 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_62a27f0d8453e2104f759ed08ba781e24c5ed056/qa/tasks 2023-10-09T06:07:39.842 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-09T06:07:39.843 INFO:teuthology.task.internal:Checking packages... 2023-10-09T06:07:39.864 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-09T06:07:39.864 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-09T06:07:39.864 INFO:teuthology.packaging:ref: None 2023-10-09T06:07:39.864 INFO:teuthology.packaging:tag: None 2023-10-09T06:07:39.864 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-09T06:07:39.865 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T06:07:39.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-09T06:07:40.085 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320.g08cac018 2023-10-09T06:07:40.086 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-09T06:07:40.092 INFO:teuthology.task.internal:no buildpackages task found 2023-10-09T06:07:40.092 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-09T06:07:40.114 INFO:teuthology.task.internal:Saving configuration 2023-10-09T06:07:40.131 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-09T06:07:40.137 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T06:07:40.162 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 06:02:05.255947', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLRVEBuuJ0RS8zz7zUdHUzUyE4iRsUi8Q7TmoPhC/I+TVBoPFh9toqiAnTZ8slMoPqgsB5hXgx0Es0rVLn5ZbU8='} 2023-10-09T06:07:40.183 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 06:02:05.257331', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLn7tkOtY9ygveFVe4QbRCNfjDA5rUZ2yFg1618DNqnkk5IleuNdVsjJgMw7gayzjYXz9/+xc9CfCsQUg6YiIrk='} 2023-10-09T06:07:40.183 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-09T06:07:40.189 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-09T06:07:40.189 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-09T06:07:40.189 INFO:teuthology.run_tasks:Running task console_log... 2023-10-09T06:07:40.254 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe7bf312b80>, signals=[15]) 2023-10-09T06:07:40.255 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-09T06:07:40.261 INFO:teuthology.task.internal:Opening connections... 2023-10-09T06:07:40.261 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:07:40.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:07:40.331 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:07:40.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:07:40.398 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-09T06:07:40.404 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-10-09T06:07:40.423 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-10-09T06:07:40.424 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-10-09T06:07:40.481 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux" 2023-10-09T06:07:40.481 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.4 (Ootpa)" 2023-10-09T06:07:40.481 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel" 2023-10-09T06:07:40.481 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora" 2023-10-09T06:07:40.481 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.4" 2023-10-09T06:07:40.481 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-10-09T06:07:40.481 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-09T06:07:40.482 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-10-09T06:07:40.482 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-09T06:07:40.482 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/" 2023-10-09T06:07:40.482 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-09T06:07:40.482 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T06:07:40.482 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:07:40.482 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T06:07:40.482 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-09T06:07:40.482 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-09T06:07:40.482 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-09T06:07:40.483 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-10-09T06:07:40.505 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-10-09T06:07:40.521 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-10-09T06:07:40.522 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-10-09T06:07:40.578 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux" 2023-10-09T06:07:40.578 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.4 (Ootpa)" 2023-10-09T06:07:40.578 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel" 2023-10-09T06:07:40.578 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora" 2023-10-09T06:07:40.579 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.4" 2023-10-09T06:07:40.579 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-10-09T06:07:40.579 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-09T06:07:40.579 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-10-09T06:07:40.579 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-09T06:07:40.579 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/" 2023-10-09T06:07:40.579 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-09T06:07:40.579 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T06:07:40.579 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:07:40.579 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T06:07:40.580 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-09T06:07:40.580 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-09T06:07:40.580 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-09T06:07:40.580 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-10-09T06:07:40.605 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-09T06:07:40.614 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-09T06:07:40.620 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-09T06:07:40.620 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2023-10-09T06:07:40.624 DEBUG:teuthology.orchestra.run.smithi158:> test '!' -e /home/ubuntu/cephtest 2023-10-09T06:07:40.640 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-09T06:07:40.645 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-09T06:07:40.646 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2023-10-09T06:07:40.679 DEBUG:teuthology.orchestra.run.smithi158:> test -z $(ls -A /var/lib/ceph) 2023-10-09T06:07:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-09T06:07:40.697 INFO:teuthology.orchestra.run.smithi158.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-09T06:07:40.697 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-09T06:07:40.750 INFO:teuthology.run_tasks:Running task kernel... 2023-10-09T06:07:40.765 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-10-09T06:07:40.765 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-09T06:07:40.765 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-09T06:07:40.765 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-09T06:07:40.766 DEBUG:teuthology.orchestra.run.smithi158:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-09T06:07:40.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:07:40.782 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2023-10-09T06:07:40.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:07:40.783 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-10-09T06:07:40.838 INFO:teuthology.orchestra.run.smithi031.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-09T06:07:40.838 INFO:teuthology.task.kernel:Running kernel on smithi031: 4.18.0-305.25.1.el8_4.x86_64 2023-10-09T06:07:40.839 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum install -y kernel 2023-10-09T06:07:40.840 INFO:teuthology.orchestra.run.smithi158.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-09T06:07:40.840 INFO:teuthology.task.kernel:Running kernel on smithi158: 4.18.0-305.25.1.el8_4.x86_64 2023-10-09T06:07:40.840 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum install -y kernel 2023-10-09T06:07:42.329 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-09T06:07:42.329 INFO:teuthology.orchestra.run.smithi158.stdout:Unable to read consumer identity 2023-10-09T06:07:42.424 INFO:teuthology.orchestra.run.smithi031.stdout:Updating Subscription Management repositories. 2023-10-09T06:07:42.425 INFO:teuthology.orchestra.run.smithi031.stdout:Unable to read consumer identity 2023-10-09T06:07:43.828 INFO:teuthology.orchestra.run.smithi158.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-10-09T06:07:44.024 INFO:teuthology.orchestra.run.smithi031.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-09T06:07:44.983 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-09T06:07:45.485 INFO:teuthology.orchestra.run.smithi158.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 16 MB 00:01 2023-10-09T06:07:48.562 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 1.7 MB/s | 24 kB 00:00 2023-10-09T06:07:48.808 INFO:teuthology.orchestra.run.smithi158.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2023-10-09T06:07:49.321 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-09T06:07:49.321 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-09T06:07:49.321 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-09T06:07:49.477 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2023-10-09T06:07:49.478 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2023-10-09T06:07:49.478 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2023-10-09T06:07:49.571 INFO:teuthology.orchestra.run.smithi158.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-09T06:07:49.571 INFO:teuthology.orchestra.run.smithi158.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-09T06:07:49.572 INFO:teuthology.orchestra.run.smithi158.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-09T06:07:49.609 DEBUG:teuthology.orchestra.run.smithi031:> echo no | sudo yum reinstall kernel || true 2023-10-09T06:07:49.738 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-09T06:07:49.739 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-09T06:07:49.739 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-09T06:07:49.861 DEBUG:teuthology.orchestra.run.smithi158:> echo no | sudo yum reinstall kernel || true 2023-10-09T06:07:49.975 INFO:teuthology.orchestra.run.smithi031.stdout:Updating Subscription Management repositories. 2023-10-09T06:07:49.976 INFO:teuthology.orchestra.run.smithi031.stdout:Unable to read consumer identity 2023-10-09T06:07:50.206 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-09T06:07:50.206 INFO:teuthology.orchestra.run.smithi158.stdout:Unable to read consumer identity 2023-10-09T06:07:50.283 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:02 ago on Mon 09 Oct 2023 06:07:48 AM UTC. 2023-10-09T06:07:50.498 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:00:02 ago on Mon 09 Oct 2023 06:07:48 AM UTC. 2023-10-09T06:07:50.563 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T06:07:50.563 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T06:07:50.563 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T06:07:50.595 INFO:teuthology.orchestra.run.smithi031.stderr:Error: No packages marked for reinstall. 2023-10-09T06:07:50.626 INFO:teuthology.orchestra.run.smithi158.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T06:07:50.626 INFO:teuthology.orchestra.run.smithi158.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T06:07:50.626 INFO:teuthology.orchestra.run.smithi158.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T06:07:50.648 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum reinstall -y kernel || true 2023-10-09T06:07:50.648 INFO:teuthology.orchestra.run.smithi158.stderr:Error: No packages marked for reinstall. 2023-10-09T06:07:50.698 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum reinstall -y kernel || true 2023-10-09T06:07:51.011 INFO:teuthology.orchestra.run.smithi031.stdout:Updating Subscription Management repositories. 2023-10-09T06:07:51.012 INFO:teuthology.orchestra.run.smithi031.stdout:Unable to read consumer identity 2023-10-09T06:07:51.043 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-09T06:07:51.043 INFO:teuthology.orchestra.run.smithi158.stdout:Unable to read consumer identity 2023-10-09T06:07:51.309 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:03 ago on Mon 09 Oct 2023 06:07:48 AM UTC. 2023-10-09T06:07:51.333 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:00:03 ago on Mon 09 Oct 2023 06:07:48 AM UTC. 2023-10-09T06:07:51.445 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T06:07:51.446 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T06:07:51.446 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T06:07:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:Error: No packages marked for reinstall. 2023-10-09T06:07:51.466 INFO:teuthology.orchestra.run.smithi158.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T06:07:51.466 INFO:teuthology.orchestra.run.smithi158.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T06:07:51.467 INFO:teuthology.orchestra.run.smithi158.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T06:07:51.480 INFO:teuthology.orchestra.run.smithi158.stderr:Error: No packages marked for reinstall. 2023-10-09T06:07:51.511 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T06:07:51.536 DEBUG:teuthology.orchestra.run.smithi158:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T06:07:51.640 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:51.640 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:51.641 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:51.641 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-09T06:07:51.641 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-09T06:07:51.641 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-09T06:07:51.641 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi031.front.sepia.ceph.com, path=None, version=distro) 2023-10-09T06:07:51.641 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T06:07:51.660 INFO:teuthology.orchestra.run.smithi158.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:51.660 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:51.660 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:51.661 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-09T06:07:51.661 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-09T06:07:51.661 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-09T06:07:51.661 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi158.front.sepia.ceph.com, path=None, version=distro) 2023-10-09T06:07:51.661 DEBUG:teuthology.orchestra.run.smithi158:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T06:07:51.771 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:51.771 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:51.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo rpm -qi grub2-tools 2023-10-09T06:07:51.786 INFO:teuthology.orchestra.run.smithi158.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:51.786 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:51.786 DEBUG:teuthology.orchestra.run.smithi158:> sudo rpm -qi grub2-tools 2023-10-09T06:07:51.799 INFO:teuthology.orchestra.run.smithi031.stdout:Name : grub2-tools 2023-10-09T06:07:51.800 INFO:teuthology.orchestra.run.smithi031.stdout:Epoch : 1 2023-10-09T06:07:51.800 INFO:teuthology.orchestra.run.smithi031.stdout:Version : 2.02 2023-10-09T06:07:51.800 INFO:teuthology.orchestra.run.smithi031.stdout:Release : 99.el8_4.1 2023-10-09T06:07:51.800 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: x86_64 2023-10-09T06:07:51.800 INFO:teuthology.orchestra.run.smithi031.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-09T06:07:51.800 INFO:teuthology.orchestra.run.smithi031.stdout:Group : System Environment/Base 2023-10-09T06:07:51.800 INFO:teuthology.orchestra.run.smithi031.stdout:Size : 9264631 2023-10-09T06:07:51.800 INFO:teuthology.orchestra.run.smithi031.stdout:License : GPLv3+ 2023-10-09T06:07:51.800 INFO:teuthology.orchestra.run.smithi031.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-09T06:07:51.800 INFO:teuthology.orchestra.run.smithi031.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-09T06:07:51.800 INFO:teuthology.orchestra.run.smithi031.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-09T06:07:51.800 INFO:teuthology.orchestra.run.smithi031.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-09T06:07:51.801 INFO:teuthology.orchestra.run.smithi031.stdout:Relocations : (not relocatable) 2023-10-09T06:07:51.801 INFO:teuthology.orchestra.run.smithi031.stdout:Packager : Red Hat, Inc. 2023-10-09T06:07:51.801 INFO:teuthology.orchestra.run.smithi031.stdout:Vendor : Red Hat, Inc. 2023-10-09T06:07:51.801 INFO:teuthology.orchestra.run.smithi031.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-09T06:07:51.801 INFO:teuthology.orchestra.run.smithi031.stdout:Summary : Support tools for GRUB. 2023-10-09T06:07:51.801 INFO:teuthology.orchestra.run.smithi031.stdout:Description : 2023-10-09T06:07:51.801 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:07:51.801 INFO:teuthology.orchestra.run.smithi031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-09T06:07:51.801 INFO:teuthology.orchestra.run.smithi031.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-09T06:07:51.801 INFO:teuthology.orchestra.run.smithi031.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-09T06:07:51.801 INFO:teuthology.orchestra.run.smithi031.stdout:hardware devices. 2023-10-09T06:07:51.801 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:07:51.802 INFO:teuthology.orchestra.run.smithi031.stdout:This subpackage provides tools for support of all platforms. 2023-10-09T06:07:51.802 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-09T06:07:51.802 INFO:teuthology.task.kernel:Updating grub on smithi031 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:51.803 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-09T06:07:51.813 INFO:teuthology.orchestra.run.smithi158.stdout:Name : grub2-tools 2023-10-09T06:07:51.813 INFO:teuthology.orchestra.run.smithi158.stdout:Epoch : 1 2023-10-09T06:07:51.813 INFO:teuthology.orchestra.run.smithi158.stdout:Version : 2.02 2023-10-09T06:07:51.814 INFO:teuthology.orchestra.run.smithi158.stdout:Release : 99.el8_4.1 2023-10-09T06:07:51.814 INFO:teuthology.orchestra.run.smithi158.stdout:Architecture: x86_64 2023-10-09T06:07:51.814 INFO:teuthology.orchestra.run.smithi158.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-09T06:07:51.814 INFO:teuthology.orchestra.run.smithi158.stdout:Group : System Environment/Base 2023-10-09T06:07:51.814 INFO:teuthology.orchestra.run.smithi158.stdout:Size : 9264631 2023-10-09T06:07:51.814 INFO:teuthology.orchestra.run.smithi158.stdout:License : GPLv3+ 2023-10-09T06:07:51.814 INFO:teuthology.orchestra.run.smithi158.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-09T06:07:51.814 INFO:teuthology.orchestra.run.smithi158.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-09T06:07:51.814 INFO:teuthology.orchestra.run.smithi158.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-09T06:07:51.814 INFO:teuthology.orchestra.run.smithi158.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-09T06:07:51.814 INFO:teuthology.orchestra.run.smithi158.stdout:Relocations : (not relocatable) 2023-10-09T06:07:51.814 INFO:teuthology.orchestra.run.smithi158.stdout:Packager : Red Hat, Inc. 2023-10-09T06:07:51.815 INFO:teuthology.orchestra.run.smithi158.stdout:Vendor : Red Hat, Inc. 2023-10-09T06:07:51.815 INFO:teuthology.orchestra.run.smithi158.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-09T06:07:51.815 INFO:teuthology.orchestra.run.smithi158.stdout:Summary : Support tools for GRUB. 2023-10-09T06:07:51.815 INFO:teuthology.orchestra.run.smithi158.stdout:Description : 2023-10-09T06:07:51.815 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:07:51.815 INFO:teuthology.orchestra.run.smithi158.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-09T06:07:51.815 INFO:teuthology.orchestra.run.smithi158.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-09T06:07:51.815 INFO:teuthology.orchestra.run.smithi158.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-09T06:07:51.815 INFO:teuthology.orchestra.run.smithi158.stdout:hardware devices. 2023-10-09T06:07:51.815 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:07:51.815 INFO:teuthology.orchestra.run.smithi158.stdout:This subpackage provides tools for support of all platforms. 2023-10-09T06:07:51.816 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-09T06:07:51.816 INFO:teuthology.task.kernel:Updating grub on smithi158 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:51.816 DEBUG:teuthology.orchestra.run.smithi158:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-09T06:07:53.091 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2023-10-09T06:07:53.249 INFO:teuthology.orchestra.run.smithi158.stderr:Generating grub configuration file ... 2023-10-09T06:07:54.954 INFO:teuthology.orchestra.run.smithi031.stderr:done 2023-10-09T06:07:54.955 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2023-10-09T06:07:54.959 INFO:teuthology.orchestra.run.smithi158.stderr:done 2023-10-09T06:07:54.960 DEBUG:teuthology.orchestra.run.smithi158:> mktemp 2023-10-09T06:07:54.970 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.8dvBd5z6RG 2023-10-09T06:07:54.970 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8dvBd5z6RG 2023-10-09T06:07:55.014 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.8xS9K3hTGF 2023-10-09T06:07:55.015 DEBUG:teuthology.orchestra.run.smithi158:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8xS9K3hTGF 2023-10-09T06:07:55.050 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.8dvBd5z6RG 2023-10-09T06:07:55.097 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.8xS9K3hTGF 2023-10-09T06:07:55.216 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.8dvBd5z6RG is 6KB 2023-10-09T06:07:55.248 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.8xS9K3hTGF is 6KB 2023-10-09T06:07:55.265 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.8dvBd5z6RG 2023-10-09T06:07:55.279 DEBUG:teuthology.orchestra.run.smithi031:> sudo /bin/ls /boot/loader/entries || true 2023-10-09T06:07:55.295 DEBUG:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.8xS9K3hTGF 2023-10-09T06:07:55.308 DEBUG:teuthology.orchestra.run.smithi158:> sudo /bin/ls /boot/loader/entries || true 2023-10-09T06:07:55.351 INFO:teuthology.orchestra.run.smithi031.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-09T06:07:55.351 INFO:teuthology.orchestra.run.smithi031.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-09T06:07:55.352 INFO:teuthology.orchestra.run.smithi031.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-09T06:07:55.352 INFO:teuthology.orchestra.run.smithi031.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-09T06:07:55.352 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:55.382 INFO:teuthology.orchestra.run.smithi158.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-09T06:07:55.382 INFO:teuthology.orchestra.run.smithi158.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-09T06:07:55.382 INFO:teuthology.orchestra.run.smithi158.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-09T06:07:55.382 INFO:teuthology.orchestra.run.smithi158.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-09T06:07:55.383 DEBUG:teuthology.orchestra.run.smithi158:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-09T06:07:55.526 DEBUG:teuthology.orchestra.run.smithi158:> sudo shutdown -r now 2023-10-09T06:07:55.542 DEBUG:teuthology.orchestra.run.smithi031:> sudo shutdown -r now 2023-10-09T06:08:25.550 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-09T06:08:25.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-09T06:08:25.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:08:25.554 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-09T06:08:25.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-09T06:08:25.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:08:43.898 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-09T06:08:43.899 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-09T06:08:52.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-09T06:08:52.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:08:52.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-09T06:08:52.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:08:55.966 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-09T06:09:07.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-09T06:09:07.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:09:11.034 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-09T06:09:11.290 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-09T06:09:23.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-09T06:09:23.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:09:26.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-09T06:09:26.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:09:26.143 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-10-09T06:09:26.375 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-09T06:09:26.375 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-09T06:09:26.375 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2023-10-09T06:09:26.432 INFO:teuthology.orchestra.run.smithi031.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-09T06:09:26.432 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-09T06:09:26.432 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-09T06:09:26.432 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-09T06:09:27.434 DEBUG:teuthology.parallel:result is None 2023-10-09T06:09:44.570 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-09T06:10:02.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-09T06:10:02.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:10:03.831 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-10-09T06:10:04.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-09T06:10:04.563 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-09T06:10:04.563 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-10-09T06:10:04.577 INFO:teuthology.orchestra.run.smithi158.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-09T06:10:04.577 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-09T06:10:04.577 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-09T06:10:04.577 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-09T06:10:05.578 DEBUG:teuthology.parallel:result is None 2023-10-09T06:10:05.579 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-09T06:10:05.586 INFO:teuthology.task.internal:Creating test directory... 2023-10-09T06:10:05.586 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-09T06:10:05.590 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-09T06:10:05.607 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-09T06:10:05.613 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-09T06:10:05.622 INFO:teuthology.task.internal:Creating archive directory... 2023-10-09T06:10:05.622 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-09T06:10:05.649 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-09T06:10:05.688 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-09T06:10:05.695 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-09T06:10:05.695 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-09T06:10:05.720 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-09T06:10:05.803 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T06:10:05.817 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T06:10:05.841 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T06:10:05.859 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T06:10:05.860 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-09T06:10:05.867 INFO:teuthology.task.internal:Configuring sudo... 2023-10-09T06:10:05.868 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-09T06:10:05.870 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-09T06:10:05.895 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-09T06:10:05.904 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-09T06:10:05.904 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-09T06:10:05.937 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-09T06:10:05.952 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T06:10:06.035 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T06:10:06.097 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T06:10:06.139 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T06:10:06.179 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:10:06.179 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-09T06:10:06.244 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T06:10:06.286 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T06:10:06.328 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T06:10:06.410 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T06:10:06.449 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:10:06.449 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-09T06:10:06.513 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2023-10-09T06:10:06.515 DEBUG:teuthology.orchestra.run.smithi158:> sudo service rsyslog restart 2023-10-09T06:10:06.571 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T06:10:06.615 INFO:teuthology.orchestra.run.smithi158.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T06:10:06.950 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-09T06:10:06.957 INFO:teuthology.task.internal:Starting timer... 2023-10-09T06:10:06.958 INFO:teuthology.run_tasks:Running task pcp... 2023-10-09T06:10:06.967 INFO:teuthology.run_tasks:Running task selinux... 2023-10-09T06:10:06.975 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-09T06:10:06.975 DEBUG:teuthology.orchestra.run.smithi031:> sudo service auditd rotate 2023-10-09T06:10:07.031 INFO:teuthology.orchestra.run.smithi031.stdout:Rotating logs: [ OK ] 2023-10-09T06:10:07.033 DEBUG:teuthology.orchestra.run.smithi158:> sudo service auditd rotate 2023-10-09T06:10:07.087 INFO:teuthology.orchestra.run.smithi158.stdout:Rotating logs: [ OK ] 2023-10-09T06:10:07.089 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-09T06:10:07.089 DEBUG:teuthology.orchestra.run.smithi031:> /usr/sbin/getenforce 2023-10-09T06:10:07.107 INFO:teuthology.orchestra.run.smithi031.stdout:Permissive 2023-10-09T06:10:07.107 DEBUG:teuthology.orchestra.run.smithi158:> /usr/sbin/getenforce 2023-10-09T06:10:07.127 INFO:teuthology.orchestra.run.smithi158.stdout:Permissive 2023-10-09T06:10:07.127 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi031.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi158.front.sepia.ceph.com': 'permissive'} 2023-10-09T06:10:07.127 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T06:10:07.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:10:07.174 DEBUG:teuthology.orchestra.run.smithi158:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T06:10:07.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:10:07.198 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-09T06:10:07.199 DEBUG:teuthology.orchestra.run.smithi031:> sudo /usr/sbin/setenforce permissive 2023-10-09T06:10:07.240 DEBUG:teuthology.orchestra.run.smithi158:> sudo /usr/sbin/setenforce permissive 2023-10-09T06:10:07.264 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-09T06:10:07.276 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-09T06:10:07.280 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-09T06:10:07.392 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-09T06:10:07.407 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-09T06:10:07.408 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi158.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-09T06:18:21.030 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi158.front.sepia.ceph.com')] 2023-10-09T06:18:21.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-09T06:18:21.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:18:21.101 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-10-09T06:18:21.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-09T06:18:21.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-09T06:18:21.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:18:21.235 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-10-09T06:18:21.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-09T06:18:21.301 INFO:teuthology.run_tasks:Running task clock... 2023-10-09T06:18:21.312 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-09T06:18:21.313 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-09T06:18:21.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T06:18:21.316 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-09T06:18:21.316 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T06:18:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-09T06:18:21.358 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-09T06:18:21.369 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-09T06:18:21.384 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-09T06:18:21.400 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: ntpd: command not found 2023-10-09T06:18:21.411 INFO:teuthology.orchestra.run.smithi031.stdout:506 Cannot talk to daemon 2023-10-09T06:18:21.426 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-09T06:18:21.429 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: ntpd: command not found 2023-10-09T06:18:21.439 INFO:teuthology.orchestra.run.smithi158.stdout:506 Cannot talk to daemon 2023-10-09T06:18:21.440 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-09T06:18:21.453 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-09T06:18:21.467 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-09T06:18:21.513 INFO:teuthology.orchestra.run.smithi031.stderr:bash: ntpq: command not found 2023-10-09T06:18:21.515 INFO:teuthology.orchestra.run.smithi031.stdout:210 Number of sources = 4 2023-10-09T06:18:21.515 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T06:18:21.515 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2023-10-09T06:18:21.515 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:18:21.516 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:18:21.516 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:18:21.516 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:18:21.534 INFO:teuthology.orchestra.run.smithi158.stderr:bash: ntpq: command not found 2023-10-09T06:18:21.537 INFO:teuthology.orchestra.run.smithi158.stdout:210 Number of sources = 4 2023-10-09T06:18:21.537 INFO:teuthology.orchestra.run.smithi158.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T06:18:21.537 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================== 2023-10-09T06:18:21.537 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:18:21.537 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:18:21.537 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:18:21.537 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:18:21.538 INFO:teuthology.run_tasks:Running task install... 2023-10-09T06:18:21.546 DEBUG:teuthology.task.install:project ceph 2023-10-09T06:18:21.546 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-09T06:18:21.546 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-09T06:18:21.546 INFO:teuthology.task.install:Using flavor: default 2023-10-09T06:18:21.552 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-09T06:18:21.552 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-09T06:18:21.552 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-09T06:18:21.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T06:18:21.555 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-09T06:18:21.555 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T06:18:21.787 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-09T06:18:21.787 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-09T06:18:21.801 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-09T06:18:21.801 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-09T06:18:21.908 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-09T06:18:21.909 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:18:21.909 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-09T06:18:21.919 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-09T06:18:21.919 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:18:21.919 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-09T06:18:21.934 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-09T06:18:21.934 DEBUG:teuthology.orchestra.run.smithi158:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-09T06:18:21.945 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-09T06:18:21.945 DEBUG:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-09T06:18:21.999 DEBUG:teuthology.orchestra.run.smithi158:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-09T06:18:22.012 DEBUG:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-09T06:18:22.073 DEBUG:teuthology.orchestra.run.smithi158:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-09T06:18:22.087 DEBUG:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-09T06:18:22.136 INFO:teuthology.orchestra.run.smithi158.stdout:check_obsoletes = 1 2023-10-09T06:18:22.138 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum clean all 2023-10-09T06:18:22.151 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2023-10-09T06:18:22.153 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum clean all 2023-10-09T06:18:22.527 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-09T06:18:22.566 INFO:teuthology.orchestra.run.smithi031.stdout:Updating Subscription Management repositories. 2023-10-09T06:18:22.827 INFO:teuthology.orchestra.run.smithi158.stdout:44 files removed 2023-10-09T06:18:22.870 INFO:teuthology.orchestra.run.smithi031.stdout:44 files removed 2023-10-09T06:18:22.878 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-09T06:18:22.921 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-09T06:18:23.228 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-09T06:18:23.292 INFO:teuthology.orchestra.run.smithi031.stdout:Updating Subscription Management repositories. 2023-10-09T06:18:23.871 INFO:teuthology.orchestra.run.smithi158.stdout:ceph packages for x86_64 353 kB/s | 78 kB 00:00 2023-10-09T06:18:24.045 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 251 kB/s | 78 kB 00:00 2023-10-09T06:18:24.153 INFO:teuthology.orchestra.run.smithi158.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-10-09T06:18:24.274 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 49 kB/s | 9.2 kB 00:00 2023-10-09T06:18:24.483 INFO:teuthology.orchestra.run.smithi158.stdout:ceph source packages 4.9 kB/s | 1.5 kB 00:00 2023-10-09T06:18:24.551 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 6.0 kB/s | 1.5 kB 00:00 2023-10-09T06:18:24.607 INFO:teuthology.orchestra.run.smithi158.stdout:Copr repo for python3-asyncssh owned by ceph 36 kB/s | 3.5 kB 00:00 2023-10-09T06:18:24.660 INFO:teuthology.orchestra.run.smithi031.stdout:Copr repo for python3-asyncssh owned by ceph 44 kB/s | 3.5 kB 00:00 2023-10-09T06:18:24.999 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 52 MB/s | 16 MB 00:00 2023-10-09T06:18:25.273 INFO:teuthology.orchestra.run.smithi158.stdout:Extra Packages for Enterprise Linux 25 MB/s | 16 MB 00:00 2023-10-09T06:18:28.571 INFO:teuthology.orchestra.run.smithi158.stdout:lab-extras 2.3 MB/s | 24 kB 00:00 2023-10-09T06:18:28.572 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 1.7 MB/s | 24 kB 00:00 2023-10-09T06:18:28.976 INFO:teuthology.orchestra.run.smithi158.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 118 MB/s | 38 MB 00:00 2023-10-09T06:18:29.001 INFO:teuthology.orchestra.run.smithi031.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 112 MB/s | 38 MB 00:00 2023-10-09T06:18:34.576 INFO:teuthology.orchestra.run.smithi158.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 115 MB/s | 33 MB 00:00 2023-10-09T06:18:35.023 INFO:teuthology.orchestra.run.smithi031.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 108 MB/s | 33 MB 00:00 2023-10-09T06:18:42.531 INFO:teuthology.orchestra.run.smithi158.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T06:18:42.532 INFO:teuthology.orchestra.run.smithi158.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T06:18:42.543 INFO:teuthology.orchestra.run.smithi158.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-09T06:18:42.543 INFO:teuthology.orchestra.run.smithi158.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-09T06:18:42.544 INFO:teuthology.orchestra.run.smithi158.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-09T06:18:42.545 INFO:teuthology.orchestra.run.smithi158.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-09T06:18:42.547 INFO:teuthology.orchestra.run.smithi158.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-09T06:18:42.549 INFO:teuthology.orchestra.run.smithi158.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-09T06:18:42.550 INFO:teuthology.orchestra.run.smithi158.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-09T06:18:43.036 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-09T06:18:43.047 INFO:teuthology.orchestra.run.smithi158.stdout:====================================================================================================================== 2023-10-09T06:18:43.047 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-09T06:18:43.047 INFO:teuthology.orchestra.run.smithi158.stdout:====================================================================================================================== 2023-10-09T06:18:43.047 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-09T06:18:43.047 INFO:teuthology.orchestra.run.smithi158.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-09T06:18:43.047 INFO:teuthology.orchestra.run.smithi158.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-09T06:18:43.047 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-09T06:18:43.047 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-09T06:18:43.048 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-09T06:18:43.048 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-09T06:18:43.048 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-09T06:18:43.048 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-09T06:18:43.048 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-09T06:18:43.048 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-09T06:18:43.048 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T06:18:43.048 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-09T06:18:43.048 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-09T06:18:43.048 INFO:teuthology.orchestra.run.smithi158.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-09T06:18:43.048 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-09T06:18:43.048 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-09T06:18:43.049 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-09T06:18:43.049 INFO:teuthology.orchestra.run.smithi158.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-09T06:18:43.049 INFO:teuthology.orchestra.run.smithi158.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-09T06:18:43.049 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-09T06:18:43.049 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-09T06:18:43.049 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-09T06:18:43.049 INFO:teuthology.orchestra.run.smithi158.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-09T06:18:43.049 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-09T06:18:43.049 INFO:teuthology.orchestra.run.smithi158.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-09T06:18:43.049 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-09T06:18:43.049 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-09T06:18:43.050 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-09T06:18:43.050 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-09T06:18:43.050 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-09T06:18:43.050 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T06:18:43.050 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-09T06:18:43.050 INFO:teuthology.orchestra.run.smithi158.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-09T06:18:43.050 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrading: 2023-10-09T06:18:43.050 INFO:teuthology.orchestra.run.smithi158.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T06:18:43.050 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-09T06:18:43.050 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-10-09T06:18:43.050 INFO:teuthology.orchestra.run.smithi158.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-09T06:18:43.051 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-09T06:18:43.051 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-09T06:18:43.051 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-09T06:18:43.051 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-09T06:18:43.051 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-09T06:18:43.051 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T06:18:43.051 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-09T06:18:43.051 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-09T06:18:43.051 INFO:teuthology.orchestra.run.smithi158.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-09T06:18:43.051 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-09T06:18:43.051 INFO:teuthology.orchestra.run.smithi158.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-09T06:18:43.051 INFO:teuthology.orchestra.run.smithi158.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-09T06:18:43.052 INFO:teuthology.orchestra.run.smithi158.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-09T06:18:43.052 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-09T06:18:43.052 INFO:teuthology.orchestra.run.smithi158.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-09T06:18:43.052 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-09T06:18:43.052 INFO:teuthology.orchestra.run.smithi158.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-09T06:18:43.052 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-09T06:18:43.052 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-09T06:18:43.052 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-09T06:18:43.052 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-09T06:18:43.052 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-09T06:18:43.052 INFO:teuthology.orchestra.run.smithi158.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-09T06:18:43.052 INFO:teuthology.orchestra.run.smithi158.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-09T06:18:43.053 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-09T06:18:43.053 INFO:teuthology.orchestra.run.smithi158.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-09T06:18:43.053 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-09T06:18:43.053 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-09T06:18:43.053 INFO:teuthology.orchestra.run.smithi158.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-09T06:18:43.053 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-09T06:18:43.053 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-09T06:18:43.053 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-09T06:18:43.053 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-09T06:18:43.053 INFO:teuthology.orchestra.run.smithi158.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-09T06:18:43.053 INFO:teuthology.orchestra.run.smithi158.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-09T06:18:43.054 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-09T06:18:43.054 INFO:teuthology.orchestra.run.smithi158.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-09T06:18:43.054 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-09T06:18:43.054 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-09T06:18:43.054 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-09T06:18:43.054 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-09T06:18:43.054 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-09T06:18:43.054 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-09T06:18:43.054 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-09T06:18:43.054 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-09T06:18:43.054 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-09T06:18:43.055 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-09T06:18:43.055 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-09T06:18:43.055 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-09T06:18:43.055 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T06:18:43.055 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-09T06:18:43.055 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-09T06:18:43.055 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-09T06:18:43.055 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-09T06:18:43.055 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-09T06:18:43.055 INFO:teuthology.orchestra.run.smithi158.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-09T06:18:43.055 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-09T06:18:43.055 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-09T06:18:43.055 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-09T06:18:43.056 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-09T06:18:43.056 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-09T06:18:43.056 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-09T06:18:43.056 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-09T06:18:43.056 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-09T06:18:43.056 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-09T06:18:43.056 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-09T06:18:43.056 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T06:18:43.056 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-09T06:18:43.056 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-09T06:18:43.056 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-09T06:18:43.057 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-09T06:18:43.057 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-09T06:18:43.057 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-09T06:18:43.057 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-09T06:18:43.057 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-09T06:18:43.057 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-09T06:18:43.057 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-09T06:18:43.057 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-09T06:18:43.057 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-09T06:18:43.057 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-09T06:18:43.057 INFO:teuthology.orchestra.run.smithi158.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-09T06:18:43.057 INFO:teuthology.orchestra.run.smithi158.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-09T06:18:43.058 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-09T06:18:43.058 INFO:teuthology.orchestra.run.smithi158.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-09T06:18:43.058 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:18:43.058 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-09T06:18:43.058 INFO:teuthology.orchestra.run.smithi158.stdout:====================================================================================================================== 2023-10-09T06:18:43.058 INFO:teuthology.orchestra.run.smithi158.stdout:Install 118 Packages 2023-10-09T06:18:43.058 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrade 2 Packages 2023-10-09T06:18:43.058 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:18:43.059 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 202 M 2023-10-09T06:18:43.059 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-09T06:18:43.568 INFO:teuthology.orchestra.run.smithi158.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 40 kB/s | 6.4 kB 00:00 2023-10-09T06:18:43.904 INFO:teuthology.orchestra.run.smithi158.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 2.5 MB/s | 876 kB 00:00 2023-10-09T06:18:43.985 INFO:teuthology.orchestra.run.smithi158.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 2.0 MB/s | 162 kB 00:00 2023-10-09T06:18:44.064 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T06:18:44.064 INFO:teuthology.orchestra.run.smithi031.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T06:18:44.072 INFO:teuthology.orchestra.run.smithi158.stdout:(4/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 7.8 MB/s | 5.2 MB 00:00 2023-10-09T06:18:44.076 INFO:teuthology.orchestra.run.smithi031.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-09T06:18:44.076 INFO:teuthology.orchestra.run.smithi031.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-09T06:18:44.077 INFO:teuthology.orchestra.run.smithi031.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-09T06:18:44.078 INFO:teuthology.orchestra.run.smithi031.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-09T06:18:44.080 INFO:teuthology.orchestra.run.smithi031.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-09T06:18:44.082 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-09T06:18:44.083 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-09T06:18:44.224 INFO:teuthology.orchestra.run.smithi158.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 10 MB/s | 1.6 MB 00:00 2023-10-09T06:18:44.560 INFO:teuthology.orchestra.run.smithi158.stdout:(6/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 12 MB/s | 3.9 MB 00:00 2023-10-09T06:18:44.585 INFO:teuthology.orchestra.run.smithi158.stdout:(7/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 3.8 MB/s | 2.3 MB 00:00 2023-10-09T06:18:44.609 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2023-10-09T06:18:44.621 INFO:teuthology.orchestra.run.smithi031.stdout:====================================================================================================================== 2023-10-09T06:18:44.621 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2023-10-09T06:18:44.622 INFO:teuthology.orchestra.run.smithi031.stdout:====================================================================================================================== 2023-10-09T06:18:44.622 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2023-10-09T06:18:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-09T06:18:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-09T06:18:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-09T06:18:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-09T06:18:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-09T06:18:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-09T06:18:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-09T06:18:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-09T06:18:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-09T06:18:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-09T06:18:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T06:18:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-09T06:18:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-09T06:18:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-09T06:18:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-09T06:18:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-09T06:18:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-09T06:18:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-09T06:18:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-09T06:18:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-09T06:18:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-09T06:18:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-09T06:18:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-09T06:18:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-09T06:18:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-09T06:18:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-09T06:18:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-09T06:18:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-09T06:18:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-09T06:18:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-09T06:18:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T06:18:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-09T06:18:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-09T06:18:44.624 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2023-10-09T06:18:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T06:18:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-09T06:18:44.625 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2023-10-09T06:18:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-09T06:18:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-09T06:18:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-09T06:18:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-09T06:18:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-09T06:18:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-09T06:18:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T06:18:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-09T06:18:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-09T06:18:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-09T06:18:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-09T06:18:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-09T06:18:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-09T06:18:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-09T06:18:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-09T06:18:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-09T06:18:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-09T06:18:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-09T06:18:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-09T06:18:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-09T06:18:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-09T06:18:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-09T06:18:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-09T06:18:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-09T06:18:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-09T06:18:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-09T06:18:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-09T06:18:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-09T06:18:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-09T06:18:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-09T06:18:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-09T06:18:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-09T06:18:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-09T06:18:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-09T06:18:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-09T06:18:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-09T06:18:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-09T06:18:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-09T06:18:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-09T06:18:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-09T06:18:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-09T06:18:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-09T06:18:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-09T06:18:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-09T06:18:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-09T06:18:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-09T06:18:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-09T06:18:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-09T06:18:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-09T06:18:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-09T06:18:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T06:18:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-09T06:18:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-09T06:18:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-09T06:18:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-09T06:18:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-09T06:18:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-09T06:18:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-09T06:18:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-09T06:18:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-09T06:18:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-09T06:18:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-09T06:18:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-09T06:18:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-09T06:18:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-09T06:18:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-09T06:18:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-09T06:18:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T06:18:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-09T06:18:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-09T06:18:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-09T06:18:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-09T06:18:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-09T06:18:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-09T06:18:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-09T06:18:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-09T06:18:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-09T06:18:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-09T06:18:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-09T06:18:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-09T06:18:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-09T06:18:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-09T06:18:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-09T06:18:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-09T06:18:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-09T06:18:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:18:44.632 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2023-10-09T06:18:44.632 INFO:teuthology.orchestra.run.smithi031.stdout:====================================================================================================================== 2023-10-09T06:18:44.632 INFO:teuthology.orchestra.run.smithi031.stdout:Install 118 Packages 2023-10-09T06:18:44.632 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 2 Packages 2023-10-09T06:18:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:18:44.633 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 202 M 2023-10-09T06:18:44.633 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2023-10-09T06:18:45.329 INFO:teuthology.orchestra.run.smithi031.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2023-10-09T06:18:45.806 INFO:teuthology.orchestra.run.smithi158.stdout:(8/120): ceph-common-17.2.6-1320.g08cac018.el8. 9.8 MB/s | 23 MB 00:02 2023-10-09T06:18:45.852 INFO:teuthology.orchestra.run.smithi158.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 535 kB/s | 24 kB 00:00 2023-10-09T06:18:46.084 INFO:teuthology.orchestra.run.smithi158.stdout:(10/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 11 MB/s | 17 MB 00:01 2023-10-09T06:18:46.151 INFO:teuthology.orchestra.run.smithi158.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 3.7 MB/s | 255 kB 00:00 2023-10-09T06:18:46.203 INFO:teuthology.orchestra.run.smithi158.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 477 kB/s | 25 kB 00:00 2023-10-09T06:18:46.330 INFO:teuthology.orchestra.run.smithi158.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 6.2 MB/s | 797 kB 00:00 2023-10-09T06:18:46.389 INFO:teuthology.orchestra.run.smithi158.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 2.9 MB/s | 174 kB 00:00 2023-10-09T06:18:46.444 INFO:teuthology.orchestra.run.smithi158.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 2.3 MB/s | 130 kB 00:00 2023-10-09T06:18:46.517 INFO:teuthology.orchestra.run.smithi158.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 6.8 MB/s | 507 kB 00:00 2023-10-09T06:18:47.092 INFO:teuthology.orchestra.run.smithi031.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 497 kB/s | 876 kB 00:01 2023-10-09T06:18:47.167 INFO:teuthology.orchestra.run.smithi158.stdout:(17/120): ceph-radosgw-17.2.6-1320.g08cac018.el 6.5 MB/s | 17 MB 00:02 2023-10-09T06:18:47.187 INFO:teuthology.orchestra.run.smithi158.stdout:(18/120): librgw2-17.2.6-1320.g08cac018.el8.x86 8.3 MB/s | 5.6 MB 00:00 2023-10-09T06:18:47.220 INFO:teuthology.orchestra.run.smithi158.stdout:(19/120): python3-ceph-argparse-17.2.6-1320.g08 845 kB/s | 45 kB 00:00 2023-10-09T06:18:47.229 INFO:teuthology.orchestra.run.smithi158.stdout:(20/120): python3-ceph-common-17.2.6-1320.g08ca 2.7 MB/s | 115 kB 00:00 2023-10-09T06:18:47.235 INFO:teuthology.orchestra.run.smithi031.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 1.1 MB/s | 162 kB 00:00 2023-10-09T06:18:47.270 INFO:teuthology.orchestra.run.smithi158.stdout:(21/120): python3-cephfs-17.2.6-1320.g08cac018. 3.8 MB/s | 190 kB 00:00 2023-10-09T06:18:47.283 INFO:teuthology.orchestra.run.smithi158.stdout:(22/120): python3-rados-17.2.6-1320.g08cac018.e 6.7 MB/s | 371 kB 00:00 2023-10-09T06:18:47.332 INFO:teuthology.orchestra.run.smithi158.stdout:(23/120): python3-rbd-17.2.6-1320.g08cac018.el8 5.7 MB/s | 358 kB 00:00 2023-10-09T06:18:47.337 INFO:teuthology.orchestra.run.smithi158.stdout:(24/120): python3-rgw-17.2.6-1320.g08cac018.el8 1.9 MB/s | 107 kB 00:00 2023-10-09T06:18:47.375 INFO:teuthology.orchestra.run.smithi158.stdout:(25/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 2.1 MB/s | 90 kB 00:00 2023-10-09T06:18:47.445 INFO:teuthology.orchestra.run.smithi158.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 2.4 MB/s | 173 kB 00:00 2023-10-09T06:18:47.510 INFO:teuthology.orchestra.run.smithi158.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 356 kB/s | 23 kB 00:00 2023-10-09T06:18:47.580 INFO:teuthology.orchestra.run.smithi158.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 1.7 MB/s | 121 kB 00:00 2023-10-09T06:18:47.680 INFO:teuthology.orchestra.run.smithi158.stdout:(29/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 10 MB/s | 3.5 MB 00:00 2023-10-09T06:18:47.882 INFO:teuthology.orchestra.run.smithi158.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 5.6 MB/s | 1.7 MB 00:00 2023-10-09T06:18:47.956 INFO:teuthology.orchestra.run.smithi158.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 3.1 MB/s | 238 kB 00:00 2023-10-09T06:18:48.024 INFO:teuthology.orchestra.run.smithi158.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 695 kB/s | 47 kB 00:00 2023-10-09T06:18:48.093 INFO:teuthology.orchestra.run.smithi158.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 213 kB/s | 14 kB 00:00 2023-10-09T06:18:48.169 INFO:teuthology.orchestra.run.smithi158.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 3.4 MB/s | 267 kB 00:00 2023-10-09T06:18:48.238 INFO:teuthology.orchestra.run.smithi158.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.1 MB/s | 80 kB 00:00 2023-10-09T06:18:48.306 INFO:teuthology.orchestra.run.smithi158.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 267 kB/s | 18 kB 00:00 2023-10-09T06:18:48.394 INFO:teuthology.orchestra.run.smithi158.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 10 MB/s | 7.4 MB 00:00 2023-10-09T06:18:48.686 INFO:teuthology.orchestra.run.smithi158.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 202 kB/s | 59 kB 00:00 2023-10-09T06:18:48.758 INFO:teuthology.orchestra.run.smithi158.stdout:(39/120): gperftools-libs-2.7-9.el8.x86_64.rpm 678 kB/s | 306 kB 00:00 2023-10-09T06:18:48.834 INFO:teuthology.orchestra.run.smithi158.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 509 kB/s | 75 kB 00:00 2023-10-09T06:18:48.906 INFO:teuthology.orchestra.run.smithi158.stdout:(41/120): python3-asyncssh-2.7.0-2.el8.noarch.r 3.1 MB/s | 476 kB 00:00 2023-10-09T06:18:48.908 INFO:teuthology.orchestra.run.smithi158.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 591 kB/s | 44 kB 00:00 2023-10-09T06:18:48.981 INFO:teuthology.orchestra.run.smithi158.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2023-10-09T06:18:48.981 INFO:teuthology.orchestra.run.smithi158.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 449 kB/s | 33 kB 00:00 2023-10-09T06:18:49.054 INFO:teuthology.orchestra.run.smithi158.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 223 kB/s | 16 kB 00:00 2023-10-09T06:18:49.129 INFO:teuthology.orchestra.run.smithi158.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-10-09T06:18:49.131 INFO:teuthology.orchestra.run.smithi158.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 4.8 MB/s | 384 kB 00:00 2023-10-09T06:18:49.206 INFO:teuthology.orchestra.run.smithi158.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 1.0 MB/s | 81 kB 00:00 2023-10-09T06:18:49.206 INFO:teuthology.orchestra.run.smithi158.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 149 kB/s | 11 kB 00:00 2023-10-09T06:18:49.282 INFO:teuthology.orchestra.run.smithi158.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 231 kB/s | 18 kB 00:00 2023-10-09T06:18:49.337 INFO:teuthology.orchestra.run.smithi031.stdout:(4/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 1.2 MB/s | 5.2 MB 00:04 2023-10-09T06:18:49.357 INFO:teuthology.orchestra.run.smithi158.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 656 kB/s | 49 kB 00:00 2023-10-09T06:18:49.359 INFO:teuthology.orchestra.run.smithi031.stdout:(5/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 1.1 MB/s | 2.3 MB 00:02 2023-10-09T06:18:49.434 INFO:teuthology.orchestra.run.smithi158.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 5.1 MB/s | 1.2 MB 00:00 2023-10-09T06:18:49.434 INFO:teuthology.orchestra.run.smithi158.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 766 kB/s | 59 kB 00:00 2023-10-09T06:18:49.508 INFO:teuthology.orchestra.run.smithi158.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 819 kB/s | 60 kB 00:00 2023-10-09T06:18:49.510 INFO:teuthology.orchestra.run.smithi158.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.6 MB/s | 283 kB 00:00 2023-10-09T06:18:49.926 INFO:teuthology.orchestra.run.smithi158.stdout:(56/120): ceph-test-17.2.6-1320.g08cac018.el8.x 13 MB/s | 52 MB 00:04 2023-10-09T06:18:49.927 INFO:teuthology.orchestra.run.smithi158.stdout:(57/120): python3-portend-2.6-1.el8.noarch.rpm 37 kB/s | 16 kB 00:00 2023-10-09T06:18:49.927 INFO:teuthology.orchestra.run.smithi158.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 81 kB/s | 34 kB 00:00 2023-10-09T06:18:49.937 INFO:teuthology.orchestra.run.smithi031.stdout:(6/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 2.6 MB/s | 1.6 MB 00:00 2023-10-09T06:18:50.002 INFO:teuthology.orchestra.run.smithi158.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2023-10-09T06:18:50.002 INFO:teuthology.orchestra.run.smithi158.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 250 kB/s | 19 kB 00:00 2023-10-09T06:18:50.077 INFO:teuthology.orchestra.run.smithi158.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 324 kB/s | 24 kB 00:00 2023-10-09T06:18:50.078 INFO:teuthology.orchestra.run.smithi158.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 394 kB/s | 29 kB 00:00 2023-10-09T06:18:50.150 INFO:teuthology.orchestra.run.smithi158.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 375 kB/s | 27 kB 00:00 2023-10-09T06:18:50.154 INFO:teuthology.orchestra.run.smithi158.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2023-10-09T06:18:50.222 INFO:teuthology.orchestra.run.smithi158.stdout:(65/120): python3-rsa-4.9-2.el8.noarch.rpm 218 kB/s | 64 kB 00:00 2023-10-09T06:18:50.226 INFO:teuthology.orchestra.run.smithi158.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 3.2 MB/s | 251 kB 00:00 2023-10-09T06:18:50.228 INFO:teuthology.orchestra.run.smithi158.stdout:(67/120): python3-websocket-client-0.56.0-5.el8 828 kB/s | 61 kB 00:00 2023-10-09T06:18:50.300 INFO:teuthology.orchestra.run.smithi158.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 311 kB/s | 23 kB 00:00 2023-10-09T06:18:50.304 INFO:teuthology.orchestra.run.smithi158.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 17 MB/s | 70 kB 00:00 2023-10-09T06:18:50.348 INFO:teuthology.orchestra.run.smithi158.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 425 kB/s | 19 kB 00:00 2023-10-09T06:18:50.370 INFO:teuthology.orchestra.run.smithi158.stdout:(71/120): python3-webtest-2.0.33-1.el8.noarch.r 580 kB/s | 85 kB 00:00 2023-10-09T06:18:50.376 INFO:teuthology.orchestra.run.smithi158.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.5 MB/s | 43 kB 00:00 2023-10-09T06:18:50.390 INFO:teuthology.orchestra.run.smithi158.stdout:(73/120): thrift-0.13.0-2.el8.x86_64.rpm 11 MB/s | 1.7 MB 00:00 2023-10-09T06:18:50.408 INFO:teuthology.orchestra.run.smithi158.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 6.8 MB/s | 220 kB 00:00 2023-10-09T06:18:50.415 INFO:teuthology.orchestra.run.smithi158.stdout:(75/120): python3-oauthlib-2.1.0-1.el8.noarch.r 3.3 MB/s | 155 kB 00:00 2023-10-09T06:18:50.433 INFO:teuthology.orchestra.run.smithi158.stdout:(76/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-10-09T06:18:50.439 INFO:teuthology.orchestra.run.smithi158.stdout:(77/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 7.4 MB/s | 229 kB 00:00 2023-10-09T06:18:50.443 INFO:teuthology.orchestra.run.smithi158.stdout:(78/120): python3-requests-oauthlib-1.0.0-1.el8 1.5 MB/s | 43 kB 00:00 2023-10-09T06:18:50.467 INFO:teuthology.orchestra.run.smithi158.stdout:(79/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 652 kB/s | 18 kB 00:00 2023-10-09T06:18:50.480 INFO:teuthology.orchestra.run.smithi158.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 16 MB/s | 605 kB 00:00 2023-10-09T06:18:50.495 INFO:teuthology.orchestra.run.smithi158.stdout:(81/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 37 MB/s | 2.3 MB 00:00 2023-10-09T06:18:50.496 INFO:teuthology.orchestra.run.smithi158.stdout:(82/120): fuse-2.9.7-12.el8.x86_64.rpm 2.7 MB/s | 83 kB 00:00 2023-10-09T06:18:50.513 INFO:teuthology.orchestra.run.smithi158.stdout:(83/120): elfutils-libelf-devel-0.182-3.el8.x86 1.7 MB/s | 59 kB 00:00 2023-10-09T06:18:50.523 INFO:teuthology.orchestra.run.smithi158.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 1.4 MB/s | 38 kB 00:00 2023-10-09T06:18:50.524 INFO:teuthology.orchestra.run.smithi158.stdout:(85/120): libquadmath-8.4.1-1.el8.x86_64.rpm 5.6 MB/s | 169 kB 00:00 2023-10-09T06:18:50.541 INFO:teuthology.orchestra.run.smithi158.stdout:(86/120): libsepol-devel-2.9-2.el8.x86_64.rpm 3.1 MB/s | 86 kB 00:00 2023-10-09T06:18:50.548 INFO:teuthology.orchestra.run.smithi158.stdout:(87/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.2 MB/s | 58 kB 00:00 2023-10-09T06:18:50.549 INFO:teuthology.orchestra.run.smithi158.stdout:(88/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.9 MB/s | 47 kB 00:00 2023-10-09T06:18:50.575 INFO:teuthology.orchestra.run.smithi158.stdout:(89/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 16 MB/s | 559 kB 00:00 2023-10-09T06:18:50.576 INFO:teuthology.orchestra.run.smithi158.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 2.5 MB/s | 70 kB 00:00 2023-10-09T06:18:50.584 INFO:teuthology.orchestra.run.smithi158.stdout:(91/120): libgfortran-8.4.1-1.el8.x86_64.rpm 18 MB/s | 639 kB 00:00 2023-10-09T06:18:50.603 INFO:teuthology.orchestra.run.smithi158.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 7.1 MB/s | 200 kB 00:00 2023-10-09T06:18:50.610 INFO:teuthology.orchestra.run.smithi158.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 2.9 MB/s | 97 kB 00:00 2023-10-09T06:18:50.630 INFO:teuthology.orchestra.run.smithi158.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 1.6 MB/s | 44 kB 00:00 2023-10-09T06:18:50.635 INFO:teuthology.orchestra.run.smithi158.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.0 MB/s | 27 kB 00:00 2023-10-09T06:18:50.659 INFO:teuthology.orchestra.run.smithi158.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 5.5 MB/s | 161 kB 00:00 2023-10-09T06:18:50.665 INFO:teuthology.orchestra.run.smithi158.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 11 MB/s | 320 kB 00:00 2023-10-09T06:18:50.683 INFO:teuthology.orchestra.run.smithi031.stdout:(7/120): ceph-common-17.2.6-1320.g08cac018.el8. 4.1 MB/s | 23 MB 00:05 2023-10-09T06:18:50.689 INFO:teuthology.orchestra.run.smithi158.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 15 MB/s | 457 kB 00:00 2023-10-09T06:18:50.714 INFO:teuthology.orchestra.run.smithi158.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 1.6 MB/s | 39 kB 00:00 2023-10-09T06:18:50.748 INFO:teuthology.orchestra.run.smithi158.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 20 MB/s | 688 kB 00:00 2023-10-09T06:18:50.763 INFO:teuthology.orchestra.run.smithi158.stdout:(101/120): python3-babel-2.5.1-5.el8.noarch.rpm 49 MB/s | 4.8 MB 00:00 2023-10-09T06:18:50.774 INFO:teuthology.orchestra.run.smithi158.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 9.8 MB/s | 259 kB 00:00 2023-10-09T06:18:50.886 INFO:teuthology.orchestra.run.smithi158.stdout:(103/120): python3-scipy-1.0.0-20.module+el8.1. 48 MB/s | 15 MB 00:00 2023-10-09T06:18:50.888 INFO:teuthology.orchestra.run.smithi158.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.1 MB/s | 126 kB 00:00 2023-10-09T06:18:50.890 INFO:teuthology.orchestra.run.smithi158.stdout:(105/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 1.7 MB/s | 225 kB 00:00 2023-10-09T06:18:50.918 INFO:teuthology.orchestra.run.smithi158.stdout:(106/120): oniguruma-6.8.2-2.el8.x86_64.rpm 6.1 MB/s | 187 kB 00:00 2023-10-09T06:18:50.926 INFO:teuthology.orchestra.run.smithi158.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 15 MB/s | 538 kB 00:00 2023-10-09T06:18:50.958 INFO:teuthology.orchestra.run.smithi158.stdout:(108/120): python3-numpy-1.14.3-9.el8.x86_64.rp 52 MB/s | 3.7 MB 00:00 2023-10-09T06:18:50.961 INFO:teuthology.orchestra.run.smithi158.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 4.4 MB/s | 157 kB 00:00 2023-10-09T06:18:50.963 INFO:teuthology.orchestra.run.smithi158.stdout:(110/120): socat-1.7.3.3-2.el8.x86_64.rpm 6.7 MB/s | 302 kB 00:00 2023-10-09T06:18:50.987 INFO:teuthology.orchestra.run.smithi158.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 3.7 MB/s | 110 kB 00:00 2023-10-09T06:18:50.988 INFO:teuthology.orchestra.run.smithi158.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 13 MB/s | 353 kB 00:00 2023-10-09T06:18:50.991 INFO:teuthology.orchestra.run.smithi158.stdout:(113/120): python3-jsonpointer-1.10-11.el8.noar 713 kB/s | 20 kB 00:00 2023-10-09T06:18:51.019 INFO:teuthology.orchestra.run.smithi158.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 1.7 MB/s | 54 kB 00:00 2023-10-09T06:18:51.027 INFO:teuthology.orchestra.run.smithi158.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 17 MB/s | 709 kB 00:00 2023-10-09T06:18:51.066 INFO:teuthology.orchestra.run.smithi158.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2023-10-09T06:18:51.081 INFO:teuthology.orchestra.run.smithi158.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 53 MB/s | 4.7 MB 00:00 2023-10-09T06:18:51.083 INFO:teuthology.orchestra.run.smithi031.stdout:(8/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 2.3 MB/s | 3.9 MB 00:01 2023-10-09T06:18:51.118 INFO:teuthology.orchestra.run.smithi158.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 47 MB/s | 4.6 MB 00:00 2023-10-09T06:18:51.123 INFO:teuthology.orchestra.run.smithi031.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 614 kB/s | 24 kB 00:00 2023-10-09T06:18:51.565 INFO:teuthology.orchestra.run.smithi158.stdout:(119/120): librbd1-17.2.6-1320.g08cac018.el8.x8 7.4 MB/s | 3.6 MB 00:00 2023-10-09T06:18:51.590 INFO:teuthology.orchestra.run.smithi158.stdout:(120/120): librados2-17.2.6-1320.g08cac018.el8. 6.6 MB/s | 3.5 MB 00:00 2023-10-09T06:18:51.593 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-09T06:18:51.593 INFO:teuthology.orchestra.run.smithi158.stdout:Total 24 MB/s | 202 MB 00:08 2023-10-09T06:18:51.640 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-09T06:18:51.756 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-09T06:18:51.756 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-09T06:18:52.508 INFO:teuthology.orchestra.run.smithi031.stdout:(10/120): ceph-radosgw-17.2.6-1320.g08cac018.el 9.2 MB/s | 17 MB 00:01 2023-10-09T06:18:52.534 INFO:teuthology.orchestra.run.smithi031.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 9.8 MB/s | 255 kB 00:00 2023-10-09T06:18:52.555 INFO:teuthology.orchestra.run.smithi031.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 1.1 MB/s | 25 kB 00:00 2023-10-09T06:18:52.641 INFO:teuthology.orchestra.run.smithi031.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 9.1 MB/s | 797 kB 00:00 2023-10-09T06:18:52.664 INFO:teuthology.orchestra.run.smithi031.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 7.5 MB/s | 174 kB 00:00 2023-10-09T06:18:52.686 INFO:teuthology.orchestra.run.smithi031.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 5.7 MB/s | 130 kB 00:00 2023-10-09T06:18:52.731 INFO:teuthology.orchestra.run.smithi031.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 11 MB/s | 507 kB 00:00 2023-10-09T06:18:53.203 INFO:teuthology.orchestra.run.smithi031.stdout:(17/120): librgw2-17.2.6-1320.g08cac018.el8.x86 12 MB/s | 5.6 MB 00:00 2023-10-09T06:18:53.225 INFO:teuthology.orchestra.run.smithi031.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 2.0 MB/s | 45 kB 00:00 2023-10-09T06:18:53.247 INFO:teuthology.orchestra.run.smithi031.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 5.1 MB/s | 115 kB 00:00 2023-10-09T06:18:53.270 INFO:teuthology.orchestra.run.smithi031.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 8.2 MB/s | 190 kB 00:00 2023-10-09T06:18:53.314 INFO:teuthology.orchestra.run.smithi031.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 8.4 MB/s | 371 kB 00:00 2023-10-09T06:18:53.357 INFO:teuthology.orchestra.run.smithi031.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 8.1 MB/s | 358 kB 00:00 2023-10-09T06:18:53.379 INFO:teuthology.orchestra.run.smithi031.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 4.8 MB/s | 107 kB 00:00 2023-10-09T06:18:53.402 INFO:teuthology.orchestra.run.smithi031.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 4.1 MB/s | 90 kB 00:00 2023-10-09T06:18:53.450 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-09T06:18:53.454 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-09T06:18:53.681 INFO:teuthology.orchestra.run.smithi031.stdout:(25/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 12 MB/s | 3.5 MB 00:00 2023-10-09T06:18:53.706 INFO:teuthology.orchestra.run.smithi031.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 6.7 MB/s | 173 kB 00:00 2023-10-09T06:18:53.728 INFO:teuthology.orchestra.run.smithi031.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 1.1 MB/s | 23 kB 00:00 2023-10-09T06:18:53.750 INFO:teuthology.orchestra.run.smithi031.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 5.3 MB/s | 121 kB 00:00 2023-10-09T06:18:53.883 INFO:teuthology.orchestra.run.smithi031.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 13 MB/s | 1.7 MB 00:00 2023-10-09T06:18:54.395 INFO:teuthology.orchestra.run.smithi031.stdout:(30/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 3.8 MB/s | 17 MB 00:04 2023-10-09T06:18:54.467 INFO:teuthology.orchestra.run.smithi031.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 3.2 MB/s | 238 kB 00:00 2023-10-09T06:18:54.520 INFO:teuthology.orchestra.run.smithi031.stdout:(32/120): ceph-mgr-diskprediction-local-17.2.6- 12 MB/s | 7.4 MB 00:00 2023-10-09T06:18:54.521 INFO:teuthology.orchestra.run.smithi031.stdout:(33/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 882 kB/s | 47 kB 00:00 2023-10-09T06:18:54.541 INFO:teuthology.orchestra.run.smithi031.stdout:(34/120): ceph-prometheus-alerts-17.2.6-1320.g0 686 kB/s | 14 kB 00:00 2023-10-09T06:18:54.563 INFO:teuthology.orchestra.run.smithi031.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 3.6 MB/s | 80 kB 00:00 2023-10-09T06:18:54.585 INFO:teuthology.orchestra.run.smithi031.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 849 kB/s | 18 kB 00:00 2023-10-09T06:18:54.593 INFO:teuthology.orchestra.run.smithi031.stdout:(37/120): ceph-volume-17.2.6-1320.g08cac018.el8 3.6 MB/s | 267 kB 00:00 2023-10-09T06:18:54.725 INFO:teuthology.orchestra.run.smithi031.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 445 kB/s | 59 kB 00:00 2023-10-09T06:18:54.797 INFO:teuthology.orchestra.run.smithi031.stdout:(39/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-10-09T06:18:54.799 INFO:teuthology.orchestra.run.smithi031.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2023-10-09T06:18:54.834 INFO:teuthology.orchestra.run.smithi031.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.2 MB/s | 44 kB 00:00 2023-10-09T06:18:54.867 INFO:teuthology.orchestra.run.smithi031.stdout:(42/120): python3-asyncssh-2.7.0-2.el8.noarch.r 6.7 MB/s | 476 kB 00:00 2023-10-09T06:18:54.895 INFO:teuthology.orchestra.run.smithi031.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 3.0 MB/s | 185 kB 00:00 2023-10-09T06:18:54.898 INFO:teuthology.orchestra.run.smithi031.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 1.1 MB/s | 33 kB 00:00 2023-10-09T06:18:54.925 INFO:teuthology.orchestra.run.smithi031.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 544 kB/s | 16 kB 00:00 2023-10-09T06:18:54.933 INFO:teuthology.orchestra.run.smithi031.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 4.8 MB/s | 173 kB 00:00 2023-10-09T06:18:54.965 INFO:teuthology.orchestra.run.smithi031.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 2.5 MB/s | 81 kB 00:00 2023-10-09T06:18:54.989 INFO:teuthology.orchestra.run.smithi031.stdout:(48/120): python3-cherrypy-18.4.0-1.el8.noarch. 5.9 MB/s | 384 kB 00:00 2023-10-09T06:18:54.995 INFO:teuthology.orchestra.run.smithi031.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 374 kB/s | 11 kB 00:00 2023-10-09T06:18:55.019 INFO:teuthology.orchestra.run.smithi031.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 583 kB/s | 18 kB 00:00 2023-10-09T06:18:55.050 INFO:teuthology.orchestra.run.smithi031.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 1.6 MB/s | 49 kB 00:00 2023-10-09T06:18:55.064 INFO:teuthology.orchestra.run.smithi031.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 17 MB/s | 1.2 MB 00:00 2023-10-09T06:18:55.080 INFO:teuthology.orchestra.run.smithi031.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.9 MB/s | 59 kB 00:00 2023-10-09T06:18:55.094 INFO:teuthology.orchestra.run.smithi031.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 2.0 MB/s | 60 kB 00:00 2023-10-09T06:18:55.120 INFO:teuthology.orchestra.run.smithi031.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 7.1 MB/s | 283 kB 00:00 2023-10-09T06:18:55.124 INFO:teuthology.orchestra.run.smithi031.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 524 kB/s | 16 kB 00:00 2023-10-09T06:18:55.150 INFO:teuthology.orchestra.run.smithi031.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.1 MB/s | 34 kB 00:00 2023-10-09T06:18:55.156 INFO:teuthology.orchestra.run.smithi031.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 6.1 MB/s | 196 kB 00:00 2023-10-09T06:18:55.181 INFO:teuthology.orchestra.run.smithi031.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 2.0 MB/s | 64 kB 00:00 2023-10-09T06:18:55.186 INFO:teuthology.orchestra.run.smithi031.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 626 kB/s | 19 kB 00:00 2023-10-09T06:18:55.212 INFO:teuthology.orchestra.run.smithi031.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 797 kB/s | 24 kB 00:00 2023-10-09T06:18:55.217 INFO:teuthology.orchestra.run.smithi031.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 972 kB/s | 29 kB 00:00 2023-10-09T06:18:55.242 INFO:teuthology.orchestra.run.smithi031.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 916 kB/s | 27 kB 00:00 2023-10-09T06:18:55.250 INFO:teuthology.orchestra.run.smithi031.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 7.6 MB/s | 255 kB 00:00 2023-10-09T06:18:55.280 INFO:teuthology.orchestra.run.smithi031.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 6.5 MB/s | 251 kB 00:00 2023-10-09T06:18:55.281 INFO:teuthology.orchestra.run.smithi031.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.9 MB/s | 61 kB 00:00 2023-10-09T06:18:55.311 INFO:teuthology.orchestra.run.smithi031.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 773 kB/s | 23 kB 00:00 2023-10-09T06:18:55.312 INFO:teuthology.orchestra.run.smithi031.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 2.7 MB/s | 85 kB 00:00 2023-10-09T06:18:55.316 INFO:teuthology.orchestra.run.smithi031.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-09T06:18:55.348 INFO:teuthology.orchestra.run.smithi031.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 601 kB/s | 19 kB 00:00 2023-10-09T06:18:55.360 INFO:teuthology.orchestra.run.smithi031.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.5 MB/s | 43 kB 00:00 2023-10-09T06:18:55.373 INFO:teuthology.orchestra.run.smithi031.stdout:(72/120): thrift-0.13.0-2.el8.x86_64.rpm 28 MB/s | 1.7 MB 00:00 2023-10-09T06:18:55.377 INFO:teuthology.orchestra.run.smithi031.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.2 MB/s | 155 kB 00:00 2023-10-09T06:18:55.390 INFO:teuthology.orchestra.run.smithi031.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.5 MB/s | 48 kB 00:00 2023-10-09T06:18:55.405 INFO:teuthology.orchestra.run.smithi031.stdout:(75/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 6.9 MB/s | 220 kB 00:00 2023-10-09T06:18:55.407 INFO:teuthology.orchestra.run.smithi031.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 14 MB/s | 229 kB 00:00 2023-10-09T06:18:55.417 INFO:teuthology.orchestra.run.smithi031.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 3.5 MB/s | 43 kB 00:00 2023-10-09T06:18:55.429 INFO:teuthology.orchestra.run.smithi031.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.5 MB/s | 18 kB 00:00 2023-10-09T06:18:55.455 INFO:teuthology.orchestra.run.smithi031.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 48 MB/s | 2.3 MB 00:00 2023-10-09T06:18:55.458 INFO:teuthology.orchestra.run.smithi031.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 21 MB/s | 605 kB 00:00 2023-10-09T06:18:55.469 INFO:teuthology.orchestra.run.smithi031.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 6.2 MB/s | 83 kB 00:00 2023-10-09T06:18:55.471 INFO:teuthology.orchestra.run.smithi031.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 4.3 MB/s | 59 kB 00:00 2023-10-09T06:18:55.483 INFO:teuthology.orchestra.run.smithi031.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-09T06:18:55.484 INFO:teuthology.orchestra.run.smithi031.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.9 MB/s | 38 kB 00:00 2023-10-09T06:18:55.500 INFO:teuthology.orchestra.run.smithi031.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.4 MB/s | 86 kB 00:00 2023-10-09T06:18:55.500 INFO:teuthology.orchestra.run.smithi031.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.7 MB/s | 58 kB 00:00 2023-10-09T06:18:55.516 INFO:teuthology.orchestra.run.smithi031.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.8 MB/s | 47 kB 00:00 2023-10-09T06:18:55.523 INFO:teuthology.orchestra.run.smithi031.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 23 MB/s | 559 kB 00:00 2023-10-09T06:18:55.536 INFO:teuthology.orchestra.run.smithi031.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 32 MB/s | 639 kB 00:00 2023-10-09T06:18:55.538 INFO:teuthology.orchestra.run.smithi031.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.9 MB/s | 70 kB 00:00 2023-10-09T06:18:55.557 INFO:teuthology.orchestra.run.smithi031.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 9.4 MB/s | 200 kB 00:00 2023-10-09T06:18:55.559 INFO:teuthology.orchestra.run.smithi031.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 4.4 MB/s | 97 kB 00:00 2023-10-09T06:18:55.574 INFO:teuthology.orchestra.run.smithi031.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 2.9 MB/s | 44 kB 00:00 2023-10-09T06:18:55.586 INFO:teuthology.orchestra.run.smithi031.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.1 MB/s | 27 kB 00:00 2023-10-09T06:18:55.600 INFO:teuthology.orchestra.run.smithi031.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 12 MB/s | 161 kB 00:00 2023-10-09T06:18:55.617 INFO:teuthology.orchestra.run.smithi031.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 19 MB/s | 320 kB 00:00 2023-10-09T06:18:55.636 INFO:teuthology.orchestra.run.smithi031.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 24 MB/s | 457 kB 00:00 2023-10-09T06:18:55.726 INFO:teuthology.orchestra.run.smithi031.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 54 MB/s | 4.8 MB 00:00 2023-10-09T06:18:55.739 INFO:teuthology.orchestra.run.smithi031.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.9 MB/s | 39 kB 00:00 2023-10-09T06:18:55.964 INFO:teuthology.orchestra.run.smithi031.stdout:(100/120): python3-scipy-1.0.0-20.module+el8.1. 36 MB/s | 15 MB 00:00 2023-10-09T06:18:55.965 INFO:teuthology.orchestra.run.smithi031.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 3.0 MB/s | 688 kB 00:00 2023-10-09T06:18:55.983 INFO:teuthology.orchestra.run.smithi031.stdout:(102/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 13 MB/s | 225 kB 00:00 2023-10-09T06:18:55.984 INFO:teuthology.orchestra.run.smithi031.stdout:(103/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 14 MB/s | 259 kB 00:00 2023-10-09T06:18:55.997 INFO:teuthology.orchestra.run.smithi031.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 8.7 MB/s | 126 kB 00:00 2023-10-09T06:18:56.012 INFO:teuthology.orchestra.run.smithi031.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-09T06:18:56.032 INFO:teuthology.orchestra.run.smithi031.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 27 MB/s | 538 kB 00:00 2023-10-09T06:18:56.050 INFO:teuthology.orchestra.run.smithi031.stdout:(107/120): python3-numpy-1.14.3-9.el8.x86_64.rp 58 MB/s | 3.7 MB 00:00 2023-10-09T06:18:56.053 INFO:teuthology.orchestra.run.smithi031.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 14 MB/s | 302 kB 00:00 2023-10-09T06:18:56.064 INFO:teuthology.orchestra.run.smithi031.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 11 MB/s | 157 kB 00:00 2023-10-09T06:18:56.069 INFO:teuthology.orchestra.run.smithi031.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 7.2 MB/s | 110 kB 00:00 2023-10-09T06:18:56.081 INFO:teuthology.orchestra.run.smithi031.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 20 MB/s | 353 kB 00:00 2023-10-09T06:18:56.082 INFO:teuthology.orchestra.run.smithi031.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.5 MB/s | 20 kB 00:00 2023-10-09T06:18:56.096 INFO:teuthology.orchestra.run.smithi031.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.8 MB/s | 54 kB 00:00 2023-10-09T06:18:56.104 INFO:teuthology.orchestra.run.smithi031.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 30 MB/s | 709 kB 00:00 2023-10-09T06:18:56.181 INFO:teuthology.orchestra.run.smithi031.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 56 MB/s | 4.7 MB 00:00 2023-10-09T06:18:56.201 INFO:teuthology.orchestra.run.smithi031.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 47 MB/s | 4.6 MB 00:00 2023-10-09T06:18:56.211 INFO:teuthology.orchestra.run.smithi031.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 23 MB/s | 713 kB 00:00 2023-10-09T06:18:56.554 INFO:teuthology.orchestra.run.smithi031.stdout:(118/120): librbd1-17.2.6-1320.g08cac018.el8.x8 10 MB/s | 3.6 MB 00:00 2023-10-09T06:18:56.969 INFO:teuthology.orchestra.run.smithi031.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 4.5 MB/s | 3.5 MB 00:00 2023-10-09T06:18:57.966 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-09T06:18:58.202 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-09T06:18:58.395 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T06:18:58.517 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T06:18:58.744 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T06:18:59.110 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T06:18:59.357 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T06:18:59.522 INFO:teuthology.orchestra.run.smithi031.stdout:(120/120): ceph-test-17.2.6-1320.g08cac018.el8. 6.1 MB/s | 52 MB 00:08 2023-10-09T06:18:59.526 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2023-10-09T06:18:59.527 INFO:teuthology.orchestra.run.smithi031.stdout:Total 14 MB/s | 202 MB 00:14 2023-10-09T06:18:59.586 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2023-10-09T06:18:59.715 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2023-10-09T06:18:59.715 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2023-10-09T06:18:59.782 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T06:19:00.011 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T06:19:00.143 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T06:19:00.327 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T06:19:00.429 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T06:19:00.658 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T06:19:00.991 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-09T06:19:01.439 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2023-10-09T06:19:01.444 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2023-10-09T06:19:01.662 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-09T06:19:01.835 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T06:19:01.936 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T06:19:02.147 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-09T06:19:02.317 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-09T06:19:02.519 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T06:19:02.645 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T06:19:02.810 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T06:19:02.882 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T06:19:03.064 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-09T06:19:03.359 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-09T06:19:03.550 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-09T06:19:03.704 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-09T06:19:03.877 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T06:19:04.011 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T06:19:04.168 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T06:19:04.712 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T06:19:05.068 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T06:19:05.618 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T06:19:05.826 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T06:19:06.057 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2023-10-09T06:19:06.281 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-09T06:19:06.487 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T06:19:06.531 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T06:19:06.618 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T06:19:06.787 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T06:19:06.796 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-09T06:19:07.036 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-09T06:19:07.205 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T06:19:07.263 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-09T06:19:07.379 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T06:19:07.424 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-09T06:19:07.561 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-09T06:19:07.795 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T06:19:07.870 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-09T06:19:07.986 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T06:19:08.107 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-09T06:19:08.136 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T06:19:08.320 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T06:19:08.409 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-09T06:19:08.447 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T06:19:08.626 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T06:19:08.630 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T06:19:08.989 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-09T06:19:09.673 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-09T06:19:10.036 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T06:19:10.160 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T06:19:10.375 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-09T06:19:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-09T06:19:10.704 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T06:19:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T06:19:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T06:19:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T06:19:11.036 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T06:19:11.058 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-09T06:19:11.193 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-09T06:19:11.437 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-09T06:19:11.660 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-09T06:19:11.802 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-09T06:19:11.936 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T06:19:12.073 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-09T06:19:12.086 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T06:19:12.269 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T06:19:12.430 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-09T06:19:12.687 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-09T06:19:12.852 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T06:19:12.957 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-09T06:19:13.019 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T06:19:13.145 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-09T06:19:13.352 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-09T06:19:13.556 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-09T06:19:13.566 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T06:19:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T06:19:13.811 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-09T06:19:14.041 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-09T06:19:14.257 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-09T06:19:14.463 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-09T06:19:14.525 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T06:19:14.662 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-09T06:19:14.842 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-09T06:19:14.858 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T06:19:14.940 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T06:19:15.085 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-09T06:19:15.116 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-09T06:19:15.282 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-09T06:19:15.302 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-09T06:19:15.474 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-09T06:19:15.476 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-09T06:19:15.614 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-09T06:19:15.629 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-09T06:19:15.808 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-09T06:19:15.869 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-09T06:19:15.969 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-09T06:19:16.110 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-09T06:19:16.161 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-09T06:19:16.364 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-09T06:19:16.365 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-09T06:19:16.536 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-09T06:19:16.552 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T06:19:16.872 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-09T06:19:17.137 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-09T06:19:17.419 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-09T06:19:17.693 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-09T06:19:17.858 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-09T06:19:18.063 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-09T06:19:18.322 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-09T06:19:18.533 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-09T06:19:18.773 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T06:19:18.773 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-09T06:19:18.925 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-09T06:19:19.076 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-09T06:19:19.130 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-09T06:19:19.308 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-09T06:19:19.528 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-09T06:19:19.743 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-09T06:19:19.960 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-09T06:19:20.138 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-09T06:19:20.169 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-09T06:19:20.370 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-09T06:19:20.515 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-09T06:19:20.627 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-09T06:19:20.741 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-09T06:19:20.831 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-09T06:19:20.951 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-09T06:19:21.103 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-09T06:19:21.181 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-09T06:19:21.357 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-09T06:19:21.364 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-09T06:19:21.541 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-09T06:19:21.555 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-09T06:19:21.798 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-09T06:19:21.821 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-09T06:19:22.026 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-09T06:19:22.184 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-09T06:19:22.367 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-09T06:19:22.531 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-09T06:19:22.726 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T06:19:22.806 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T06:19:22.943 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-09T06:19:22.971 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-09T06:19:23.121 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-09T06:19:23.279 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-09T06:19:23.286 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-09T06:19:23.481 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-09T06:19:23.517 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-09T06:19:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-09T06:19:23.770 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-09T06:19:23.883 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-09T06:19:23.899 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-09T06:19:24.080 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-09T06:19:24.134 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-09T06:19:24.273 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-09T06:19:24.488 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-09T06:19:24.590 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-09T06:19:24.700 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-09T06:19:24.827 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-09T06:19:24.899 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-09T06:19:25.094 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-09T06:19:25.149 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-09T06:19:25.360 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-09T06:19:25.501 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-09T06:19:25.657 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-09T06:19:25.911 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-09T06:19:26.101 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-09T06:19:26.258 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-09T06:19:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-09T06:19:26.579 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-09T06:19:26.763 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-09T06:19:26.965 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-09T06:19:27.181 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-09T06:19:27.404 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-09T06:19:27.574 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-09T06:19:27.805 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-09T06:19:28.032 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-09T06:19:28.233 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-09T06:19:28.498 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-09T06:19:28.726 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-09T06:19:28.944 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-09T06:19:29.178 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-09T06:19:30.267 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T06:19:30.377 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-09T06:19:30.473 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T06:19:30.659 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-09T06:19:30.861 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-09T06:19:31.045 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T06:19:31.193 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-09T06:19:31.455 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-09T06:19:31.789 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-09T06:19:31.910 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T06:19:32.011 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-09T06:19:32.048 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T06:19:32.180 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T06:19:32.194 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-09T06:19:32.416 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-09T06:19:37.771 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T06:19:37.974 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T06:19:38.579 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T06:19:38.840 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T06:19:38.932 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T06:19:39.065 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T06:19:49.985 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T06:19:49.985 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /sys 2023-10-09T06:19:49.985 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /proc 2023-10-09T06:19:49.986 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-10-09T06:19:49.986 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /run 2023-10-09T06:19:49.986 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /mnt 2023-10-09T06:19:49.986 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /var/tmp 2023-10-09T06:19:49.986 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /home 2023-10-09T06:19:49.986 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /tmp 2023-10-09T06:19:49.986 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-10-09T06:19:49.986 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:19:50.394 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T06:19:51.885 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T06:19:52.048 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T06:19:52.271 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T06:19:52.439 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T06:19:52.829 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T06:19:52.985 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T06:19:53.003 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T06:19:55.810 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T06:19:55.958 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T06:19:56.191 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-09T06:19:56.378 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-09T06:19:56.559 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T06:19:56.775 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T06:19:56.980 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T06:19:57.411 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T06:19:57.411 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /sys 2023-10-09T06:19:57.411 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /proc 2023-10-09T06:19:57.411 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /dev 2023-10-09T06:19:57.411 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /run 2023-10-09T06:19:57.411 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /mnt 2023-10-09T06:19:57.411 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /var/tmp 2023-10-09T06:19:57.411 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /home 2023-10-09T06:19:57.411 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /tmp 2023-10-09T06:19:57.412 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /dev 2023-10-09T06:19:57.412 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:19:57.795 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T06:19:57.949 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T06:19:58.134 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T06:19:58.233 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T06:19:58.602 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-09T06:19:58.797 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T06:19:58.834 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T06:19:59.017 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T06:19:59.029 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T06:19:59.373 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T06:19:59.520 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T06:19:59.755 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T06:19:59.932 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T06:20:00.345 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T06:20:00.495 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T06:20:00.516 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T06:20:00.636 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-09T06:20:00.847 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T06:20:00.944 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T06:20:01.092 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T06:20:01.137 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T06:20:01.326 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T06:20:01.673 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T06:20:01.868 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T06:20:03.476 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T06:20:03.657 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T06:20:03.818 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-09T06:20:03.993 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-09T06:20:04.194 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T06:20:04.425 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T06:20:04.629 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T06:20:05.659 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T06:20:05.852 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T06:20:05.955 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T06:20:06.317 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-09T06:20:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T06:20:06.558 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T06:20:06.710 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T06:20:06.722 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T06:20:06.788 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T06:20:07.750 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-09T06:20:08.092 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-09T06:20:08.302 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-09T06:20:08.412 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-09T06:20:08.541 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-09T06:20:08.669 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T06:20:08.690 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T06:20:08.702 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T06:20:08.748 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T06:20:08.886 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T06:20:08.912 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-09T06:20:08.930 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T06:20:09.079 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-09T06:20:09.085 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T06:20:09.232 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-09T06:20:09.407 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-09T06:20:09.454 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T06:20:09.618 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T06:20:09.682 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-09T06:20:09.857 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T06:20:09.921 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T06:20:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T06:20:10.124 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T06:20:10.251 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-09T06:20:10.251 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T06:20:10.460 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T06:20:10.460 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T06:20:11.332 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T06:20:11.332 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-09T06:20:11.332 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-09T06:20:11.332 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-09T06:20:11.332 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T06:20:11.332 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-09T06:20:11.332 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T06:20:11.332 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T06:20:11.333 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T06:20:11.333 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-09T06:20:11.333 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T06:20:11.333 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-09T06:20:11.333 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-09T06:20:11.333 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T06:20:11.333 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-09T06:20:11.333 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-09T06:20:11.333 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-09T06:20:11.333 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-09T06:20:11.334 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-09T06:20:11.334 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-09T06:20:11.334 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-09T06:20:11.334 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-09T06:20:11.334 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-09T06:20:11.334 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-09T06:20:11.334 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-09T06:20:11.334 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-09T06:20:11.334 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-09T06:20:11.335 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-09T06:20:11.335 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-09T06:20:11.335 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-09T06:20:11.335 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-09T06:20:11.335 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-09T06:20:11.342 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-09T06:20:11.343 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-09T06:20:11.343 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-09T06:20:11.343 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-09T06:20:11.343 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-09T06:20:11.343 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-09T06:20:11.343 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-09T06:20:11.343 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-09T06:20:11.343 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-09T06:20:11.343 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-09T06:20:11.343 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-09T06:20:11.343 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-09T06:20:11.344 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-09T06:20:11.344 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-09T06:20:11.344 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-09T06:20:11.344 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-09T06:20:11.344 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-09T06:20:11.344 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-09T06:20:11.344 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-09T06:20:11.344 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-09T06:20:11.344 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-09T06:20:11.344 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-09T06:20:11.344 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-09T06:20:11.344 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-09T06:20:11.345 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-09T06:20:11.345 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-09T06:20:11.345 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-09T06:20:11.345 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-09T06:20:11.345 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-09T06:20:11.345 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-09T06:20:11.345 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-09T06:20:11.345 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-09T06:20:11.345 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-09T06:20:11.345 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-09T06:20:11.345 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-09T06:20:11.345 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-09T06:20:11.346 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-09T06:20:11.346 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-09T06:20:11.346 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-09T06:20:11.346 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-09T06:20:11.346 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-09T06:20:11.346 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-09T06:20:11.346 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-09T06:20:11.346 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-09T06:20:11.346 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-09T06:20:11.346 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-09T06:20:11.346 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-09T06:20:11.347 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-09T06:20:11.347 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-09T06:20:11.347 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-09T06:20:11.347 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-09T06:20:11.347 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-09T06:20:11.347 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-09T06:20:11.347 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-09T06:20:11.347 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-09T06:20:11.347 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-09T06:20:11.347 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-09T06:20:11.347 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-09T06:20:11.348 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-09T06:20:11.348 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-09T06:20:11.348 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-09T06:20:11.348 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-09T06:20:11.348 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-09T06:20:11.348 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-09T06:20:11.348 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-09T06:20:11.348 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-09T06:20:11.348 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-09T06:20:11.348 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-09T06:20:11.348 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-09T06:20:11.348 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-09T06:20:11.349 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-09T06:20:11.349 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-09T06:20:11.349 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-09T06:20:11.349 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-09T06:20:11.349 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-09T06:20:11.349 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-09T06:20:11.349 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-09T06:20:11.349 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-09T06:20:11.349 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-09T06:20:11.349 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-09T06:20:11.349 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-09T06:20:11.349 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-09T06:20:11.350 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-09T06:20:11.350 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-09T06:20:11.350 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-09T06:20:11.350 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-09T06:20:11.350 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-09T06:20:11.350 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-09T06:20:11.350 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-09T06:20:11.350 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-09T06:20:13.482 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T06:20:13.483 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:01:39 ago on Mon 09 Oct 2023 06:18:34 AM UTC. 2023-10-09T06:20:14.859 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T06:20:15.584 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-09T06:20:15.727 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:15.727 INFO:teuthology.orchestra.run.smithi158.stdout:Upgraded: 2023-10-09T06:20:15.727 INFO:teuthology.orchestra.run.smithi158.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.728 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.728 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-09T06:20:15.728 INFO:teuthology.orchestra.run.smithi158.stdout: automake-1.16.1-7.el8.noarch 2023-10-09T06:20:15.728 INFO:teuthology.orchestra.run.smithi158.stdout: bison-3.0.4-10.el8.x86_64 2023-10-09T06:20:15.728 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.728 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.728 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.728 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.728 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:15.728 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.729 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.729 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.729 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:15.729 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:15.729 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:15.729 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:15.729 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:15.729 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.729 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.729 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:15.729 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.730 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.730 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.730 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:15.730 INFO:teuthology.orchestra.run.smithi158.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:15.730 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.730 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:15.730 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-09T06:20:15.730 INFO:teuthology.orchestra.run.smithi158.stdout: flex-2.6.1-9.el8.x86_64 2023-10-09T06:20:15.730 INFO:teuthology.orchestra.run.smithi158.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-09T06:20:15.730 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-09T06:20:15.730 INFO:teuthology.orchestra.run.smithi158.stdout: jq-1.5-12.el8.x86_64 2023-10-09T06:20:15.731 INFO:teuthology.orchestra.run.smithi158.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-09T06:20:15.731 INFO:teuthology.orchestra.run.smithi158.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-09T06:20:15.731 INFO:teuthology.orchestra.run.smithi158.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-09T06:20:15.731 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.731 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.731 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.731 INFO:teuthology.orchestra.run.smithi158.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-09T06:20:15.731 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-09T06:20:15.731 INFO:teuthology.orchestra.run.smithi158.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-09T06:20:15.731 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-09T06:20:15.731 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-09T06:20:15.732 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.732 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.732 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-09T06:20:15.732 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.732 INFO:teuthology.orchestra.run.smithi158.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-09T06:20:15.732 INFO:teuthology.orchestra.run.smithi158.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-09T06:20:15.732 INFO:teuthology.orchestra.run.smithi158.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-09T06:20:15.732 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-09T06:20:15.732 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-09T06:20:15.732 INFO:teuthology.orchestra.run.smithi158.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-09T06:20:15.732 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-09T06:20:15.732 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-09T06:20:15.733 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-09T06:20:15.733 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-09T06:20:15.733 INFO:teuthology.orchestra.run.smithi158.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-09T06:20:15.733 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-09T06:20:15.733 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-09T06:20:15.733 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-09T06:20:15.733 INFO:teuthology.orchestra.run.smithi158.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-09T06:20:15.733 INFO:teuthology.orchestra.run.smithi158.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-09T06:20:15.733 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-09T06:20:15.733 INFO:teuthology.orchestra.run.smithi158.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-09T06:20:15.733 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-09T06:20:15.733 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.734 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.734 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.734 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-09T06:20:15.734 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-09T06:20:15.734 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-09T06:20:15.734 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-09T06:20:15.734 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-09T06:20:15.734 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-09T06:20:15.734 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-09T06:20:15.734 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-09T06:20:15.734 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-09T06:20:15.735 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-09T06:20:15.735 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-09T06:20:15.735 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-09T06:20:15.735 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-09T06:20:15.735 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-09T06:20:15.735 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-09T06:20:15.735 INFO:teuthology.orchestra.run.smithi158.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-09T06:20:15.735 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-09T06:20:15.735 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-09T06:20:15.735 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-09T06:20:15.735 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-09T06:20:15.736 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend-2.6-1.el8.noarch 2023-10-09T06:20:15.736 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-09T06:20:15.736 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-09T06:20:15.736 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-09T06:20:15.736 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-09T06:20:15.736 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.736 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.736 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-09T06:20:15.736 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-09T06:20:15.736 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.737 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-09T06:20:15.737 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-09T06:20:15.737 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-09T06:20:15.737 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-09T06:20:15.737 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-09T06:20:15.737 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-09T06:20:15.737 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-09T06:20:15.737 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-09T06:20:15.737 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-09T06:20:15.737 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-09T06:20:15.737 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-09T06:20:15.738 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-09T06:20:15.738 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-09T06:20:15.738 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.738 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.738 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:15.738 INFO:teuthology.orchestra.run.smithi158.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-09T06:20:15.738 INFO:teuthology.orchestra.run.smithi158.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-09T06:20:15.738 INFO:teuthology.orchestra.run.smithi158.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-09T06:20:15.738 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-09T06:20:15.739 INFO:teuthology.orchestra.run.smithi158.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-09T06:20:15.739 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:15.739 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-09T06:20:15.851 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-09T06:20:16.041 DEBUG:teuthology.parallel:result is None 2023-10-09T06:20:16.215 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-09T06:20:16.381 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-09T06:20:16.626 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-09T06:20:16.775 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T06:20:16.787 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T06:20:16.930 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-09T06:20:17.064 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-09T06:20:17.201 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-09T06:20:17.393 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-09T06:20:17.634 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-09T06:20:17.800 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T06:20:17.858 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T06:20:18.034 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T06:20:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T06:20:18.186 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-09T06:20:18.186 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T06:20:18.362 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T06:20:18.362 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T06:20:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T06:20:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-09T06:20:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-09T06:20:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-09T06:20:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T06:20:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-09T06:20:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T06:20:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T06:20:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T06:20:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-09T06:20:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T06:20:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-09T06:20:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-09T06:20:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T06:20:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-09T06:20:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-09T06:20:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-09T06:20:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-09T06:20:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-09T06:20:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-09T06:20:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-09T06:20:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-09T06:20:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-09T06:20:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-09T06:20:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-09T06:20:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-09T06:20:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-09T06:20:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-09T06:20:19.242 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-09T06:20:19.242 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-09T06:20:19.242 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-09T06:20:19.242 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-09T06:20:19.242 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-09T06:20:19.243 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-09T06:20:19.243 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-09T06:20:19.243 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-09T06:20:19.243 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-09T06:20:19.243 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-09T06:20:19.243 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-09T06:20:19.243 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-09T06:20:19.243 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-09T06:20:19.243 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-09T06:20:19.243 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-09T06:20:19.243 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-09T06:20:19.243 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-09T06:20:19.244 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-09T06:20:19.244 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-09T06:20:19.244 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-09T06:20:19.244 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-09T06:20:19.244 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-09T06:20:19.244 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-09T06:20:19.244 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-09T06:20:19.244 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-09T06:20:19.244 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-09T06:20:19.244 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-09T06:20:19.244 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-09T06:20:19.244 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-09T06:20:19.245 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-09T06:20:19.245 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-09T06:20:19.245 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-09T06:20:19.245 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-09T06:20:19.245 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-09T06:20:19.245 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-09T06:20:19.245 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-09T06:20:19.245 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-09T06:20:19.245 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-09T06:20:19.245 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-09T06:20:19.245 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-09T06:20:19.245 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-09T06:20:19.246 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-09T06:20:19.246 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-09T06:20:19.246 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-09T06:20:19.246 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-09T06:20:19.246 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-09T06:20:19.246 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-09T06:20:19.246 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-09T06:20:19.246 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-09T06:20:19.246 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-09T06:20:19.246 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-09T06:20:19.246 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-09T06:20:19.246 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-09T06:20:19.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-09T06:20:19.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-09T06:20:19.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-09T06:20:19.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-09T06:20:19.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-09T06:20:19.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-09T06:20:19.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-09T06:20:19.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-09T06:20:19.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-09T06:20:19.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-09T06:20:19.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-09T06:20:19.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-09T06:20:19.248 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-09T06:20:19.248 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-09T06:20:19.248 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-09T06:20:19.248 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-09T06:20:19.248 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-09T06:20:19.248 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-09T06:20:19.248 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-09T06:20:19.248 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-09T06:20:19.248 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-09T06:20:19.248 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-09T06:20:19.248 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-09T06:20:19.248 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-09T06:20:19.249 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-09T06:20:19.249 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-09T06:20:19.249 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-09T06:20:19.249 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-09T06:20:19.249 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-09T06:20:19.249 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-09T06:20:19.249 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-09T06:20:19.249 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-09T06:20:19.249 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-09T06:20:19.249 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-09T06:20:19.249 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-09T06:20:19.249 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-09T06:20:19.250 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-09T06:20:19.250 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-09T06:20:19.250 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-09T06:20:19.250 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-09T06:20:19.250 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-09T06:20:21.344 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T06:20:21.345 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:47 ago on Mon 09 Oct 2023 06:18:34 AM UTC. 2023-10-09T06:20:23.405 INFO:teuthology.orchestra.run.smithi031.stdout:Installed products updated. 2023-10-09T06:20:23.561 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:23.562 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2023-10-09T06:20:23.562 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.562 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.562 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2023-10-09T06:20:23.562 INFO:teuthology.orchestra.run.smithi031.stdout: automake-1.16.1-7.el8.noarch 2023-10-09T06:20:23.562 INFO:teuthology.orchestra.run.smithi031.stdout: bison-3.0.4-10.el8.x86_64 2023-10-09T06:20:23.562 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.563 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.563 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.563 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.563 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:23.563 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.563 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.563 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.564 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:23.564 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:23.564 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:23.564 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:23.564 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:23.564 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.564 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.564 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:23.565 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.565 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.565 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.565 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:23.565 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:23.565 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.565 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:20:23.566 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-09T06:20:23.566 INFO:teuthology.orchestra.run.smithi031.stdout: flex-2.6.1-9.el8.x86_64 2023-10-09T06:20:23.566 INFO:teuthology.orchestra.run.smithi031.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-09T06:20:23.566 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-09T06:20:23.566 INFO:teuthology.orchestra.run.smithi031.stdout: jq-1.5-12.el8.x86_64 2023-10-09T06:20:23.566 INFO:teuthology.orchestra.run.smithi031.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-09T06:20:23.566 INFO:teuthology.orchestra.run.smithi031.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-09T06:20:23.567 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-09T06:20:23.567 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.567 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.567 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.567 INFO:teuthology.orchestra.run.smithi031.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-09T06:20:23.567 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-09T06:20:23.567 INFO:teuthology.orchestra.run.smithi031.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-09T06:20:23.567 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-09T06:20:23.568 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-09T06:20:23.568 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.568 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.568 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-09T06:20:23.568 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.568 INFO:teuthology.orchestra.run.smithi031.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-09T06:20:23.568 INFO:teuthology.orchestra.run.smithi031.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-09T06:20:23.569 INFO:teuthology.orchestra.run.smithi031.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-09T06:20:23.569 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-09T06:20:23.569 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-09T06:20:23.569 INFO:teuthology.orchestra.run.smithi031.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-09T06:20:23.569 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-09T06:20:23.569 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-09T06:20:23.569 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-09T06:20:23.569 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-09T06:20:23.569 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-09T06:20:23.570 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-09T06:20:23.570 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-09T06:20:23.570 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-09T06:20:23.570 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-09T06:20:23.570 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-09T06:20:23.570 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-09T06:20:23.570 INFO:teuthology.orchestra.run.smithi031.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-09T06:20:23.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-09T06:20:23.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-09T06:20:23.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-09T06:20:23.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-09T06:20:23.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-09T06:20:23.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-09T06:20:23.572 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-09T06:20:23.572 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-09T06:20:23.572 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-09T06:20:23.572 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-09T06:20:23.572 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-09T06:20:23.572 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-09T06:20:23.572 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-09T06:20:23.572 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-09T06:20:23.573 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-09T06:20:23.573 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-09T06:20:23.573 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-09T06:20:23.573 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-09T06:20:23.574 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-09T06:20:23.574 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-09T06:20:23.574 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-09T06:20:23.574 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend-2.6-1.el8.noarch 2023-10-09T06:20:23.574 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-09T06:20:23.574 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-09T06:20:23.574 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-09T06:20:23.574 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-09T06:20:23.575 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.575 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.575 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-09T06:20:23.575 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-09T06:20:23.575 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.575 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-09T06:20:23.575 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-09T06:20:23.576 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-09T06:20:23.576 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-09T06:20:23.576 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-09T06:20:23.576 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-09T06:20:23.576 INFO:teuthology.orchestra.run.smithi031.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-09T06:20:23.576 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-09T06:20:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-09T06:20:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-09T06:20:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-09T06:20:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-09T06:20:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-09T06:20:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:20:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-09T06:20:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-09T06:20:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-09T06:20:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-09T06:20:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-09T06:20:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:23.579 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2023-10-09T06:20:23.790 DEBUG:teuthology.parallel:result is None 2023-10-09T06:20:23.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T06:20:24.015 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-09T06:20:24.037 INFO:teuthology.orchestra.run.smithi031.stdout:17.2.6-1320.g08cac018.el8 2023-10-09T06:20:24.038 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-09T06:20:24.038 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-09T06:20:24.038 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T06:20:24.177 DEBUG:teuthology.orchestra.run.smithi158:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-09T06:20:24.201 INFO:teuthology.orchestra.run.smithi158.stdout:17.2.6-1320.g08cac018.el8 2023-10-09T06:20:24.201 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-09T06:20:24.201 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-09T06:20:24.201 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-09T06:20:24.202 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:24.202 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-09T06:20:24.244 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:24.351 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-09T06:20:24.392 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-09T06:20:24.393 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:24.393 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2023-10-09T06:20:24.420 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-09T06:20:24.488 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:24.488 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/daemon-helper 2023-10-09T06:20:24.514 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-09T06:20:24.579 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-09T06:20:24.579 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:24.579 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-09T06:20:24.605 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-09T06:20:24.671 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:24.671 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-09T06:20:24.695 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-09T06:20:24.759 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-09T06:20:24.759 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:24.759 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2023-10-09T06:20:24.785 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-09T06:20:24.851 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:24.851 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/stdin-killer 2023-10-09T06:20:24.875 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-09T06:20:24.940 INFO:teuthology.run_tasks:Running task ceph... 2023-10-09T06:20:25.003 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-09T06:20:25.003 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2023-10-09T06:20:25.006 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 777 /var/log/ceph 2023-10-09T06:20:25.030 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-09T06:20:25.030 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-09T06:20:25.072 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-09T06:20:25.096 INFO:tasks.ceph:Creating extra log directories... 2023-10-09T06:20:25.096 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-09T06:20:25.138 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-09T06:20:25.171 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-09T06:20:25.171 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-09T06:20:25.171 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-09T06:20:25.171 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:25.171 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-09T06:20:25.216 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-09T06:20:25.328 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-09T06:20:25.354 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:25.354 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-09T06:20:25.368 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-09T06:20:25.474 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-09T06:20:25.504 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-09T06:20:25.504 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-09T06:20:25.504 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7418375', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231009.053123', 'sha1': '62a27f0d8453e2104f759ed08ba781e24c5ed056'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 30, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8174, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231009.053123', 'suite_path': '/home/teuthworker/src/github.com_vshankar_ceph_62a27f0d8453e2104f759ed08ba781e24c5ed056/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/vshankar/ceph.git', 'suite_sha1': '62a27f0d8453e2104f759ed08ba781e24c5ed056', 'targets': {'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLRVEBuuJ0RS8zz7zUdHUzUyE4iRsUi8Q7TmoPhC/I+TVBoPFh9toqiAnTZ8slMoPqgsB5hXgx0Es0rVLn5ZbU8=', 'smithi158.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLn7tkOtY9ygveFVe4QbRCNfjDA5rUZ2yFg1618DNqnkk5IleuNdVsjJgMw7gayzjYXz9/+xc9CfCsQUg6YiIrk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-09_05:36:44', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-09T06:20:25.505 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-09T06:20:25.507 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-09T06:20:25.565 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2023-10-09T06:20:25.567 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/run/ceph 2023-10-09T06:20:25.630 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:25.631 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2023-10-09T06:20:25.646 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-09T06:20:25.646 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2023-10-09T06:20:25.702 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-09T06:20:25.702 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:20:25.702 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 220709 Links: 1 2023-10-09T06:20:25.702 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:20:25.702 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:20:25.702 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-10-09 06:20:18.800088201 +0000 2023-10-09T06:20:25.703 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-10-09 06:17:52.749017108 +0000 2023-10-09T06:20:25.703 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-10-09 06:17:52.749017108 +0000 2023-10-09T06:20:25.703 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-10-09T06:20:25.703 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-09T06:20:25.766 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-10-09T06:20:25.766 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-10-09T06:20:25.766 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000230922 s, 2.2 MB/s 2023-10-09T06:20:25.767 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-09T06:20:25.824 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2023-10-09T06:20:25.880 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-09T06:20:25.880 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:20:25.880 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 217030 Links: 1 2023-10-09T06:20:25.880 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:20:25.880 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:20:25.880 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-10-09 06:20:18.800088201 +0000 2023-10-09T06:20:25.880 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-10-09 06:17:53.248008684 +0000 2023-10-09T06:20:25.880 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-10-09 06:17:53.248008684 +0000 2023-10-09T06:20:25.881 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-10-09T06:20:25.881 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-09T06:20:25.944 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-10-09T06:20:25.944 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-10-09T06:20:25.944 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000225857 s, 2.3 MB/s 2023-10-09T06:20:25.945 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-09T06:20:26.002 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2023-10-09T06:20:26.057 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-09T06:20:26.058 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:20:26.058 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 221518 Links: 1 2023-10-09T06:20:26.058 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:20:26.058 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:20:26.058 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-10-09 06:20:18.800088201 +0000 2023-10-09T06:20:26.058 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-10-09 06:17:53.742000344 +0000 2023-10-09T06:20:26.058 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-10-09 06:17:53.742000344 +0000 2023-10-09T06:20:26.058 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-10-09T06:20:26.059 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-09T06:20:26.121 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-10-09T06:20:26.121 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-10-09T06:20:26.122 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000202038 s, 2.5 MB/s 2023-10-09T06:20:26.122 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-09T06:20:26.178 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2023-10-09T06:20:26.234 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-09T06:20:26.234 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:20:26.234 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 218858 Links: 1 2023-10-09T06:20:26.234 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:20:26.234 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:20:26.234 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-10-09 06:20:18.800088201 +0000 2023-10-09T06:20:26.234 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-10-09 06:17:54.255991667 +0000 2023-10-09T06:20:26.235 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-10-09 06:17:54.255991667 +0000 2023-10-09T06:20:26.235 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-10-09T06:20:26.235 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-09T06:20:26.298 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-10-09T06:20:26.298 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-10-09T06:20:26.298 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000224406 s, 2.3 MB/s 2023-10-09T06:20:26.299 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-09T06:20:26.355 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T06:20:26.355 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:26.356 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/scratch_devs of=/dev/stdout 2023-10-09T06:20:26.371 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-09T06:20:26.393 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_1 2023-10-09T06:20:26.427 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-09T06:20:26.427 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:20:26.427 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 220501 Links: 1 2023-10-09T06:20:26.427 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:20:26.428 INFO:teuthology.orchestra.run.smithi158.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:20:26.428 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-09 06:20:10.934895766 +0000 2023-10-09T06:20:26.428 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-09 06:17:41.111170348 +0000 2023-10-09T06:20:26.428 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-09 06:17:41.111170348 +0000 2023-10-09T06:20:26.428 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2023-10-09T06:20:26.429 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-09T06:20:26.490 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-09T06:20:26.491 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-09T06:20:26.491 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000125961 s, 4.1 MB/s 2023-10-09T06:20:26.492 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-09T06:20:26.548 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_2 2023-10-09T06:20:26.603 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-09T06:20:26.604 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:20:26.604 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 216782 Links: 1 2023-10-09T06:20:26.604 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:20:26.604 INFO:teuthology.orchestra.run.smithi158.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:20:26.604 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-09 06:20:10.934895766 +0000 2023-10-09T06:20:26.604 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-09 06:17:41.594165222 +0000 2023-10-09T06:20:26.605 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-09 06:17:41.594165222 +0000 2023-10-09T06:20:26.605 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2023-10-09T06:20:26.605 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-09T06:20:26.667 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-09T06:20:26.667 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-09T06:20:26.667 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000117115 s, 4.4 MB/s 2023-10-09T06:20:26.668 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-09T06:20:26.724 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_3 2023-10-09T06:20:26.779 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-09T06:20:26.779 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:20:26.779 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 222552 Links: 1 2023-10-09T06:20:26.779 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:20:26.779 INFO:teuthology.orchestra.run.smithi158.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:20:26.779 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-09 06:20:10.934895766 +0000 2023-10-09T06:20:26.779 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-09 06:17:42.079160073 +0000 2023-10-09T06:20:26.779 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-09 06:17:42.079160073 +0000 2023-10-09T06:20:26.780 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2023-10-09T06:20:26.780 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-09T06:20:26.841 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-09T06:20:26.841 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-09T06:20:26.842 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000117525 s, 4.4 MB/s 2023-10-09T06:20:26.842 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-09T06:20:26.898 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_4 2023-10-09T06:20:26.952 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-09T06:20:26.952 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:20:26.953 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 213899 Links: 1 2023-10-09T06:20:26.953 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:20:26.953 INFO:teuthology.orchestra.run.smithi158.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:20:26.953 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-09 06:20:10.934895766 +0000 2023-10-09T06:20:26.953 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-09 06:17:42.571154851 +0000 2023-10-09T06:20:26.953 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-09 06:17:42.571154851 +0000 2023-10-09T06:20:26.953 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2023-10-09T06:20:26.953 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-09T06:20:27.015 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-09T06:20:27.016 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-09T06:20:27.016 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000117058 s, 4.4 MB/s 2023-10-09T06:20:27.017 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-09T06:20:27.072 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T06:20:27.072 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi158.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-09T06:20:27.072 INFO:tasks.ceph:Generating config... 2023-10-09T06:20:27.074 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-09T06:20:27.074 INFO:tasks.ceph:[client] debug client = 20 2023-10-09T06:20:27.074 INFO:tasks.ceph:[client] debug ms = 1 2023-10-09T06:20:27.074 INFO:tasks.ceph:[client] pid file = 2023-10-09T06:20:27.074 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-09T06:20:27.074 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-09T06:20:27.074 INFO:tasks.ceph:[client.0] debug client = 20 2023-10-09T06:20:27.075 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-10-09T06:20:27.075 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-10-09T06:20:27.075 INFO:tasks.ceph:[client.1] debug client = 20 2023-10-09T06:20:27.075 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-10-09T06:20:27.075 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-10-09T06:20:27.075 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-09T06:20:27.075 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-09T06:20:27.075 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-09T06:20:27.075 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-09T06:20:27.075 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-09T06:20:27.076 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-09T06:20:27.076 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-09T06:20:27.076 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-09T06:20:27.076 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-09T06:20:27.076 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-09T06:20:27.076 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-09T06:20:27.076 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-09T06:20:27.076 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-09T06:20:27.076 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-09T06:20:27.076 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-09T06:20:27.077 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-09T06:20:27.077 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-10-09T06:20:27.077 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-10-09T06:20:27.077 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-10-09T06:20:27.077 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-09T06:20:27.077 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-09T06:20:27.077 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-09T06:20:27.077 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-09T06:20:27.077 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-09T06:20:27.077 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-09T06:20:27.077 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-09T06:20:27.078 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-09T06:20:27.078 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-09T06:20:27.078 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-09T06:20:27.078 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-10-09T06:20:27.078 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-09T06:20:27.078 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-09T06:20:27.078 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-09T06:20:27.078 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-10-09T06:20:27.078 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-10-09T06:20:27.078 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-10-09T06:20:27.079 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-09T06:20:27.079 INFO:tasks.ceph:Setting up mon.a... 2023-10-09T06:20:27.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-09T06:20:27.133 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.keyring 2023-10-09T06:20:27.136 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-09T06:20:27.179 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T06:20:27.245 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.31'), ('mon.b', '172.21.15.158'), ('mon.c', '[v2:172.21.15.158:3301,v1:172.21.15.158:6790]')] 2023-10-09T06:20:27.246 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.31,172.21.15.158,[v2:172.21.15.158:3301,v1:172.21.15.158:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-09T06:20:27.247 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:27.247 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-09T06:20:27.300 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.31 --add b 172.21.15.158 --addv c '[v2:172.21.15.158:3301,v1:172.21.15.158:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:27.384 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:27.384 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: generated fsid e30ef3ca-dd5e-445c-bd11-d2bec76d42c9 2023-10-09T06:20:27.384 INFO:teuthology.orchestra.run.smithi031.stdout:setting min_mon_release = octopus 2023-10-09T06:20:27.384 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 0 2023-10-09T06:20:27.384 INFO:teuthology.orchestra.run.smithi031.stdout:fsid e30ef3ca-dd5e-445c-bd11-d2bec76d42c9 2023-10-09T06:20:27.384 INFO:teuthology.orchestra.run.smithi031.stdout:last_changed 2023-10-09T06:20:27.384721+0000 2023-10-09T06:20:27.384 INFO:teuthology.orchestra.run.smithi031.stdout:created 2023-10-09T06:20:27.384721+0000 2023-10-09T06:20:27.384 INFO:teuthology.orchestra.run.smithi031.stdout:min_mon_release 15 (octopus) 2023-10-09T06:20:27.385 INFO:teuthology.orchestra.run.smithi031.stdout:election_strategy: 1 2023-10-09T06:20:27.385 INFO:teuthology.orchestra.run.smithi031.stdout:0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2023-10-09T06:20:27.385 INFO:teuthology.orchestra.run.smithi031.stdout:1: [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] mon.b 2023-10-09T06:20:27.385 INFO:teuthology.orchestra.run.smithi031.stdout:2: [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] mon.c 2023-10-09T06:20:27.385 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-09T06:20:27.386 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-09T06:20:27.400 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e30ef3ca-dd5e-445c-bd11-d2bec76d42c9... 2023-10-09T06:20:27.402 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-09T06:20:27.443 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-09T06:20:27.485 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2023-10-09T06:20:27.485 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2023-10-09T06:20:27.485 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-09T06:20:27.485 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2023-10-09T06:20:27.485 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.485 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2023-10-09T06:20:27.485 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.485 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2023-10-09T06:20:27.485 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.486 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2023-10-09T06:20:27.486 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2023-10-09T06:20:27.486 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.486 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2023-10-09T06:20:27.486 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2023-10-09T06:20:27.486 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.486 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-09T06:20:27.486 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2023-10-09T06:20:27.486 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.486 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2023-10-09T06:20:27.487 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-09T06:20:27.487 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.487 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2023-10-09T06:20:27.487 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.487 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2023-10-09T06:20:27.487 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2023-10-09T06:20:27.487 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2023-10-09T06:20:27.487 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2023-10-09T06:20:27.487 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2023-10-09T06:20:27.487 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2023-10-09T06:20:27.487 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2023-10-09T06:20:27.487 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-09T06:20:27.488 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-09T06:20:27.488 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2023-10-09T06:20:27.488 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.488 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-09T06:20:27.488 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.488 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2023-10-09T06:20:27.488 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.488 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2023-10-09T06:20:27.488 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.488 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2023-10-09T06:20:27.488 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2023-10-09T06:20:27.489 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2023-10-09T06:20:27.489 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,172.21.15.158,[v2:172.21.15.158:3301,v1:172.21.15.158:6790]" 2023-10-09T06:20:27.489 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on skipped message = False 2023-10-09T06:20:27.489 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = e30ef3ca-dd5e-445c-bd11-d2bec76d42c9 2023-10-09T06:20:27.489 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.489 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2023-10-09T06:20:27.489 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2023-10-09T06:20:27.489 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.489 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2023-10-09T06:20:27.489 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2023-10-09T06:20:27.489 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2023-10-09T06:20:27.490 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.490 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2023-10-09T06:20:27.490 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2023-10-09T06:20:27.490 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.490 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2023-10-09T06:20:27.490 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2023-10-09T06:20:27.490 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2023-10-09T06:20:27.490 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.490 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2023-10-09T06:20:27.490 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2023-10-09T06:20:27.490 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.491 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2023-10-09T06:20:27.491 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.491 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2023-10-09T06:20:27.491 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.491 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2023-10-09T06:20:27.491 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.491 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2023-10-09T06:20:27.491 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2023-10-09T06:20:27.491 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.491 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2023-10-09T06:20:27.491 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2023-10-09T06:20:27.492 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2023-10-09T06:20:27.492 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2023-10-09T06:20:27.492 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = bitmap 2023-10-09T06:20:27.492 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2023-10-09T06:20:27.492 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2023-10-09T06:20:27.492 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2023-10-09T06:20:27.492 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2023-10-09T06:20:27.492 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-10-09T06:20:27.492 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2023-10-09T06:20:27.492 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2023-10-09T06:20:27.492 INFO:teuthology.orchestra.run.smithi031.stdout: memstore device bytes = 200000000 2023-10-09T06:20:27.493 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2023-10-09T06:20:27.493 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2023-10-09T06:20:27.493 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2023-10-09T06:20:27.493 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 1.0 2023-10-09T06:20:27.493 INFO:teuthology.orchestra.run.smithi031.stdout: osd mon report interval = 5 2023-10-09T06:20:27.493 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = memstore 2023-10-09T06:20:27.493 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2023-10-09T06:20:27.493 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.493 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2023-10-09T06:20:27.493 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-10-09T06:20:27.493 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2023-10-09T06:20:27.494 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-10-09T06:20:27.494 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-10-09T06:20:27.494 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-10-09T06:20:27.494 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-10-09T06:20:27.494 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2023-10-09T06:20:27.494 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.494 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2023-10-09T06:20:27.494 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-10-09T06:20:27.494 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-10-09T06:20:27.494 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2023-10-09T06:20:27.494 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-10-09T06:20:27.495 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2023-10-09T06:20:27.495 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2023-10-09T06:20:27.495 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-10-09T06:20:27.495 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2023-10-09T06:20:27.495 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2023-10-09T06:20:27.495 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-10-09T06:20:27.495 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.495 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-09T06:20:27.495 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2023-10-09T06:20:27.495 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2023-10-09T06:20:27.495 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.495 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2023-10-09T06:20:27.496 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-09T06:20:27.496 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-09T06:20:27.496 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.496 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2023-10-09T06:20:27.496 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2023-10-09T06:20:27.496 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.496 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2023-10-09T06:20:27.496 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2023-10-09T06:20:27.496 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull ratio = 0.6 2023-10-09T06:20:27.496 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.7 2023-10-09T06:20:27.496 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.6 2023-10-09T06:20:27.497 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:27.497 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2023-10-09T06:20:27.497 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2023-10-09T06:20:27.497 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2023-10-09T06:20:27.497 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2023-10-09T06:20:27.497 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-09T06:20:27.497 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-09T06:20:27.497 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2023-10-09T06:20:27.497 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2023-10-09T06:20:27.497 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-10-09T06:20:27.497 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = "" 2023-10-09T06:20:27.497 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2023-10-09T06:20:27.498 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2023-10-09T06:20:27.498 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2023-10-09T06:20:27.498 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2023-10-09T06:20:27.498 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2023-10-09T06:20:27.498 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2023-10-09T06:20:27.498 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2023-10-09T06:20:27.498 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2023-10-09T06:20:27.498 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2023-10-09T06:20:27.498 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2023-10-09T06:20:27.498 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2023-10-09T06:20:27.498 INFO:teuthology.orchestra.run.smithi031.stdout: debug objectcacher = 20 2023-10-09T06:20:27.499 INFO:teuthology.orchestra.run.smithi031.stdout: debug objecter = 20 2023-10-09T06:20:27.499 INFO:teuthology.orchestra.run.smithi031.stdout:[client.1] 2023-10-09T06:20:27.499 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2023-10-09T06:20:27.499 INFO:teuthology.orchestra.run.smithi031.stdout: debug objectcacher = 20 2023-10-09T06:20:27.499 INFO:teuthology.orchestra.run.smithi031.stdout: debug objecter = 20 2023-10-09T06:20:27.499 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2023-10-09T06:20:27.499 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2023-10-09T06:20:27.499 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-10-09T06:20:27.499 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2023-10-09T06:20:27.499 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2023-10-09T06:20:27.499 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2023-10-09T06:20:27.499 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2023-10-09T06:20:27.500 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2023-10-09T06:20:27.500 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2023-10-09T06:20:27.500 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2023-10-09T06:20:27.500 INFO:teuthology.orchestra.run.smithi158.stdout:[global] 2023-10-09T06:20:27.500 INFO:teuthology.orchestra.run.smithi158.stdout: chdir = "" 2023-10-09T06:20:27.500 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-09T06:20:27.500 INFO:teuthology.orchestra.run.smithi158.stdout: auth supported = cephx 2023-10-09T06:20:27.500 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.500 INFO:teuthology.orchestra.run.smithi158.stdout: filestore xattr use omap = true 2023-10-09T06:20:27.500 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.500 INFO:teuthology.orchestra.run.smithi158.stdout: mon clock drift allowed = 1.000 2023-10-09T06:20:27.501 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.501 INFO:teuthology.orchestra.run.smithi158.stdout: osd crush chooseleaf type = 0 2023-10-09T06:20:27.501 INFO:teuthology.orchestra.run.smithi158.stdout: auth debug = true 2023-10-09T06:20:27.501 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.501 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on old message = true 2023-10-09T06:20:27.501 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on bug = true 2023-10-09T06:20:27.501 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.501 INFO:teuthology.orchestra.run.smithi158.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-09T06:20:27.501 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn max object skew = 0 2023-10-09T06:20:27.501 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.501 INFO:teuthology.orchestra.run.smithi158.stdout: # disable pg_autoscaler by default for new pools 2023-10-09T06:20:27.501 INFO:teuthology.orchestra.run.smithi158.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-09T06:20:27.502 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.502 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default size = 2 2023-10-09T06:20:27.502 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.502 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow primary affinity = true 2023-10-09T06:20:27.502 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow pg remap = true 2023-10-09T06:20:27.502 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on legacy crush tunables = false 2023-10-09T06:20:27.502 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on crush straw calc version zero = false 2023-10-09T06:20:27.502 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on no sortbitwise = false 2023-10-09T06:20:27.502 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on osd down out interval zero = false 2023-10-09T06:20:27.502 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on too few osds = false 2023-10-09T06:20:27.502 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-09T06:20:27.502 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-09T06:20:27.503 INFO:teuthology.orchestra.run.smithi158.stdout: mon_allow_pool_size_one = true 2023-10-09T06:20:27.503 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.503 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-09T06:20:27.503 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.503 INFO:teuthology.orchestra.run.smithi158.stdout: osd default data pool replay window = 5 2023-10-09T06:20:27.503 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.503 INFO:teuthology.orchestra.run.smithi158.stdout: mon allow pool delete = true 2023-10-09T06:20:27.503 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.503 INFO:teuthology.orchestra.run.smithi158.stdout: mon cluster log file level = debug 2023-10-09T06:20:27.503 INFO:teuthology.orchestra.run.smithi158.stdout: debug asserts on shutdown = true 2023-10-09T06:20:27.503 INFO:teuthology.orchestra.run.smithi158.stdout: mon health detail to clog = false 2023-10-09T06:20:27.504 INFO:teuthology.orchestra.run.smithi158.stdout: mon host = "172.21.15.31,172.21.15.158,[v2:172.21.15.158:3301,v1:172.21.15.158:6790]" 2023-10-09T06:20:27.504 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on skipped message = False 2023-10-09T06:20:27.504 INFO:teuthology.orchestra.run.smithi158.stdout: fsid = e30ef3ca-dd5e-445c-bd11-d2bec76d42c9 2023-10-09T06:20:27.504 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.504 INFO:teuthology.orchestra.run.smithi158.stdout:[osd] 2023-10-09T06:20:27.504 INFO:teuthology.orchestra.run.smithi158.stdout: osd journal size = 100 2023-10-09T06:20:27.504 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.504 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub load threshold = 5.0 2023-10-09T06:20:27.504 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub max interval = 600 2023-10-09T06:20:27.504 INFO:teuthology.orchestra.run.smithi158.stdout: osd mclock profile = high_recovery_ops 2023-10-09T06:20:27.504 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.504 INFO:teuthology.orchestra.run.smithi158.stdout: osd recover clone overlap = true 2023-10-09T06:20:27.505 INFO:teuthology.orchestra.run.smithi158.stdout: osd recovery max chunk = 1048576 2023-10-09T06:20:27.505 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.505 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug shutdown = true 2023-10-09T06:20:27.505 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug op order = true 2023-10-09T06:20:27.505 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug verify stray on activate = true 2023-10-09T06:20:27.505 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.505 INFO:teuthology.orchestra.run.smithi158.stdout: osd open classes on start = true 2023-10-09T06:20:27.505 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug pg log writeout = true 2023-10-09T06:20:27.505 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.505 INFO:teuthology.orchestra.run.smithi158.stdout: osd deep scrub update digest min age = 30 2023-10-09T06:20:27.505 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.505 INFO:teuthology.orchestra.run.smithi158.stdout: osd map max advance = 10 2023-10-09T06:20:27.506 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.506 INFO:teuthology.orchestra.run.smithi158.stdout: journal zero on create = true 2023-10-09T06:20:27.506 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.506 INFO:teuthology.orchestra.run.smithi158.stdout: filestore ondisk finisher threads = 3 2023-10-09T06:20:27.506 INFO:teuthology.orchestra.run.smithi158.stdout: filestore apply finisher threads = 3 2023-10-09T06:20:27.506 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.506 INFO:teuthology.orchestra.run.smithi158.stdout: bdev debug aio = true 2023-10-09T06:20:27.506 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug misdirected ops = true 2023-10-09T06:20:27.506 INFO:teuthology.orchestra.run.smithi158.stdout: bdev async discard = True 2023-10-09T06:20:27.506 INFO:teuthology.orchestra.run.smithi158.stdout: bdev enable discard = True 2023-10-09T06:20:27.506 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore allocator = bitmap 2023-10-09T06:20:27.506 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore block size = 96636764160 2023-10-09T06:20:27.507 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore fsck on mount = True 2023-10-09T06:20:27.507 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluefs = 1/20 2023-10-09T06:20:27.507 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluestore = 1/20 2023-10-09T06:20:27.507 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-09T06:20:27.507 INFO:teuthology.orchestra.run.smithi158.stdout: debug osd = 20 2023-10-09T06:20:27.507 INFO:teuthology.orchestra.run.smithi158.stdout: debug rocksdb = 4/10 2023-10-09T06:20:27.507 INFO:teuthology.orchestra.run.smithi158.stdout: memstore device bytes = 200000000 2023-10-09T06:20:27.507 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd backfillfull_ratio = 0.85 2023-10-09T06:20:27.507 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd full ratio = 0.9 2023-10-09T06:20:27.507 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd nearfull ratio = 0.8 2023-10-09T06:20:27.507 INFO:teuthology.orchestra.run.smithi158.stdout: osd failsafe full ratio = 1.0 2023-10-09T06:20:27.507 INFO:teuthology.orchestra.run.smithi158.stdout: osd mon report interval = 5 2023-10-09T06:20:27.508 INFO:teuthology.orchestra.run.smithi158.stdout: osd objectstore = memstore 2023-10-09T06:20:27.508 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2023-10-09T06:20:27.508 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.508 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr] 2023-10-09T06:20:27.508 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-09T06:20:27.508 INFO:teuthology.orchestra.run.smithi158.stdout: debug mgr = 20 2023-10-09T06:20:27.508 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-10-09T06:20:27.508 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-10-09T06:20:27.508 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-10-09T06:20:27.508 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-10-09T06:20:27.508 INFO:teuthology.orchestra.run.smithi158.stdout: mgr/telemetry/nag = false 2023-10-09T06:20:27.508 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.509 INFO:teuthology.orchestra.run.smithi158.stdout:[mon] 2023-10-09T06:20:27.509 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-09T06:20:27.509 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-10-09T06:20:27.509 INFO:teuthology.orchestra.run.smithi158.stdout: debug paxos = 20 2023-10-09T06:20:27.509 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-10-09T06:20:27.509 INFO:teuthology.orchestra.run.smithi158.stdout: mon data avail warn = 5 2023-10-09T06:20:27.509 INFO:teuthology.orchestra.run.smithi158.stdout: mon mgr mkfs grace = 240 2023-10-09T06:20:27.509 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-10-09T06:20:27.509 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd reporter subtree level = osd 2023-10-09T06:20:27.509 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd prime pg temp = true 2023-10-09T06:20:27.509 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-10-09T06:20:27.509 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.510 INFO:teuthology.orchestra.run.smithi158.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-09T06:20:27.510 INFO:teuthology.orchestra.run.smithi158.stdout: auth mon ticket ttl = 660 # 11m 2023-10-09T06:20:27.510 INFO:teuthology.orchestra.run.smithi158.stdout: auth service ticket ttl = 240 # 4m 2023-10-09T06:20:27.510 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.510 INFO:teuthology.orchestra.run.smithi158.stdout: # don't complain about insecure global_id in the test suite 2023-10-09T06:20:27.510 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-09T06:20:27.510 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-09T06:20:27.510 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.510 INFO:teuthology.orchestra.run.smithi158.stdout: # 1m isn't quite enough 2023-10-09T06:20:27.510 INFO:teuthology.orchestra.run.smithi158.stdout: mon_down_mkfs_grace = 2m 2023-10-09T06:20:27.510 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.510 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_filestore_osds = false 2023-10-09T06:20:27.511 INFO:teuthology.orchestra.run.smithi158.stdout: mon op complaint time = 120 2023-10-09T06:20:27.511 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd backfillfull ratio = 0.6 2023-10-09T06:20:27.511 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd full ratio = 0.7 2023-10-09T06:20:27.511 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd nearfull ratio = 0.6 2023-10-09T06:20:27.511 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-09T06:20:27.511 INFO:teuthology.orchestra.run.smithi158.stdout:[client] 2023-10-09T06:20:27.511 INFO:teuthology.orchestra.run.smithi158.stdout: rgw cache enabled = true 2023-10-09T06:20:27.511 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable ops log = true 2023-10-09T06:20:27.511 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable usage log = true 2023-10-09T06:20:27.511 INFO:teuthology.orchestra.run.smithi158.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-09T06:20:27.511 INFO:teuthology.orchestra.run.smithi158.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-09T06:20:27.511 INFO:teuthology.orchestra.run.smithi158.stdout: client mount timeout = 600 2023-10-09T06:20:27.512 INFO:teuthology.orchestra.run.smithi158.stdout: debug client = 20 2023-10-09T06:20:27.512 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-09T06:20:27.512 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = "" 2023-10-09T06:20:27.512 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 900 2023-10-09T06:20:27.512 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 900 2023-10-09T06:20:27.512 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.a] 2023-10-09T06:20:27.512 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.b] 2023-10-09T06:20:27.512 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.c] 2023-10-09T06:20:27.512 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2023-10-09T06:20:27.512 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.c] 2023-10-09T06:20:27.512 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.b] 2023-10-09T06:20:27.512 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.d] 2023-10-09T06:20:27.513 INFO:teuthology.orchestra.run.smithi158.stdout:[client.0] 2023-10-09T06:20:27.513 INFO:teuthology.orchestra.run.smithi158.stdout: debug client = 20 2023-10-09T06:20:27.513 INFO:teuthology.orchestra.run.smithi158.stdout: debug objectcacher = 20 2023-10-09T06:20:27.513 INFO:teuthology.orchestra.run.smithi158.stdout: debug objecter = 20 2023-10-09T06:20:27.513 INFO:teuthology.orchestra.run.smithi158.stdout:[client.1] 2023-10-09T06:20:27.513 INFO:teuthology.orchestra.run.smithi158.stdout: debug client = 20 2023-10-09T06:20:27.513 INFO:teuthology.orchestra.run.smithi158.stdout: debug objectcacher = 20 2023-10-09T06:20:27.513 INFO:teuthology.orchestra.run.smithi158.stdout: debug objecter = 20 2023-10-09T06:20:27.513 INFO:teuthology.orchestra.run.smithi158.stdout:[mds] 2023-10-09T06:20:27.513 INFO:teuthology.orchestra.run.smithi158.stdout: debug mds = 20 2023-10-09T06:20:27.513 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-09T06:20:27.513 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug frag = True 2023-10-09T06:20:27.514 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug scatterstat = True 2023-10-09T06:20:27.514 INFO:teuthology.orchestra.run.smithi158.stdout: mds op complaint time = 180 2023-10-09T06:20:27.514 INFO:teuthology.orchestra.run.smithi158.stdout: mds verify scatter = True 2023-10-09T06:20:27.514 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2023-10-09T06:20:27.514 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 900 2023-10-09T06:20:27.514 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 900 2023-10-09T06:20:27.515 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-09T06:20:27.516 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-09T06:20:27.608 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-09T06:20:27.608 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:27.608 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-09T06:20:27.623 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:27.623 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-09T06:20:27.678 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:20:27.678 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:27.678 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-09T06:20:27.679 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T06:20:27.753 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:27.753 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:27.808 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:20:27.808 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:27.808 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-09T06:20:27.809 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T06:20:27.843 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:27.843 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:27.897 INFO:tasks.ceph:Setting up mon nodes... 2023-10-09T06:20:27.898 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-09T06:20:27.898 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-09T06:20:27.946 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-09T06:20:27.949 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-09T06:20:28.005 INFO:teuthology.orchestra.run.smithi158.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-09T06:20:28.008 INFO:tasks.ceph:Setting up mds nodes... 2023-10-09T06:20:28.008 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-09T06:20:28.058 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-09T06:20:28.060 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-09T06:20:28.085 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-09T06:20:28.174 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-09T06:20:28.178 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-09T06:20:28.203 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-09T06:20:28.251 INFO:teuthology.orchestra.run.smithi158.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-09T06:20:28.253 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-09T06:20:28.277 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-09T06:20:28.364 INFO:teuthology.orchestra.run.smithi158.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-09T06:20:28.367 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-09T06:20:28.391 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-09T06:20:28.391 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-09T06:20:28.430 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-09T06:20:28.443 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-09T06:20:28.522 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-09T06:20:28.535 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-09T06:20:28.572 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-09T06:20:28.585 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-09T06:20:28.662 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-09T06:20:28.675 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-09T06:20:28.675 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi158.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-09T06:20:28.675 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-09T06:20:28.700 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T06:20:28.700 INFO:tasks.ceph:role: osd.0 2023-10-09T06:20:28.700 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:20:28.700 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-09T06:20:28.772 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:20:28.772 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:20:28.772 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:20:28.772 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2023-10-09T06:20:28.773 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:20:28.773 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:20:28.773 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:20:28.773 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:20:28.773 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:20:28.773 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:20:29.214 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-10-09T06:20:29.215 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-10-09T06:20:29.215 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-09T06:20:29.376 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-09T06:20:29.411 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-09T06:20:29.477 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T06:20:29.477 INFO:tasks.ceph:role: osd.1 2023-10-09T06:20:29.477 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:20:29.477 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-09T06:20:29.550 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:20:29.550 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:20:29.550 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:20:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2023-10-09T06:20:29.551 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:20:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:20:29.551 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:20:29.551 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:20:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:20:29.551 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:20:29.974 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-10-09T06:20:29.976 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-10-09T06:20:29.976 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-09T06:20:30.084 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-09T06:20:30.114 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-09T06:20:30.181 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T06:20:30.181 INFO:tasks.ceph:role: osd.2 2023-10-09T06:20:30.181 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:20:30.181 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-09T06:20:30.255 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:20:30.255 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:20:30.255 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:20:30.255 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2023-10-09T06:20:30.255 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:20:30.255 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:20:30.256 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:20:30.256 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:20:30.256 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:20:30.256 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:20:30.700 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-10-09T06:20:30.702 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-10-09T06:20:30.702 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-09T06:20:30.883 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-09T06:20:30.916 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-09T06:20:30.985 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T06:20:30.985 INFO:tasks.ceph:role: osd.3 2023-10-09T06:20:30.985 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:20:30.985 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-09T06:20:31.060 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:20:31.060 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:20:31.060 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:20:31.060 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2023-10-09T06:20:31.060 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:20:31.060 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:20:31.061 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:20:31.061 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:20:31.061 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:20:31.061 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:20:31.493 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-10-09T06:20:31.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-10-09T06:20:31.495 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-09T06:20:31.660 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-09T06:20:31.696 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:31.795+0000 7facacbad540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-09T06:20:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:31.795+0000 7facacbad540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-09T06:20:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:31.796+0000 7facacbad540 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-10-09T06:20:31.806 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-09T06:20:31.833 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:31.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:31.914+0000 7f3147f66540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-09T06:20:31.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:31.914+0000 7f3147f66540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-09T06:20:31.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:31.915+0000 7f3147f66540 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-10-09T06:20:31.921 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-09T06:20:31.986 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:32.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:32.067+0000 7fac28e30540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-09T06:20:32.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:32.067+0000 7fac28e30540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-09T06:20:32.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:32.068+0000 7fac28e30540 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-10-09T06:20:32.078 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-09T06:20:32.142 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:32.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:32.233+0000 7f3995cee540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-09T06:20:32.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:32.233+0000 7f3995cee540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-09T06:20:32.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:32.233+0000 7f3995cee540 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-10-09T06:20:32.239 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-09T06:20:32.264 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-09T06:20:32.294 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T06:20:32.294 INFO:tasks.ceph:role: osd.4 2023-10-09T06:20:32.295 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:20:32.295 DEBUG:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-09T06:20:32.363 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:20:32.363 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:20:32.363 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:20:32.363 INFO:teuthology.orchestra.run.smithi158.stdout: = reflink=1 2023-10-09T06:20:32.363 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:20:32.363 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:20:32.364 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:20:32.364 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:20:32.364 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:20:32.364 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:20:32.385 INFO:teuthology.orchestra.run.smithi158.stdout:Discarding blocks...Done. 2023-10-09T06:20:32.387 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2023-10-09T06:20:32.387 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-09T06:20:32.469 DEBUG:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-09T06:20:32.540 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-09T06:20:32.605 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T06:20:32.606 INFO:tasks.ceph:role: osd.5 2023-10-09T06:20:32.606 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:20:32.606 DEBUG:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-09T06:20:32.670 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:20:32.670 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:20:32.670 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:20:32.671 INFO:teuthology.orchestra.run.smithi158.stdout: = reflink=1 2023-10-09T06:20:32.671 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:20:32.671 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:20:32.671 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:20:32.671 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:20:32.671 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:20:32.671 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:20:32.695 INFO:teuthology.orchestra.run.smithi158.stdout:Discarding blocks...Done. 2023-10-09T06:20:32.697 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2023-10-09T06:20:32.697 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-09T06:20:32.775 DEBUG:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-09T06:20:32.843 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-09T06:20:32.907 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T06:20:32.907 INFO:tasks.ceph:role: osd.6 2023-10-09T06:20:32.907 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:20:32.907 DEBUG:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-09T06:20:32.970 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:20:32.970 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:20:32.970 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:20:32.971 INFO:teuthology.orchestra.run.smithi158.stdout: = reflink=1 2023-10-09T06:20:32.971 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:20:32.971 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:20:32.971 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:20:32.971 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:20:32.971 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:20:32.971 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:20:32.993 INFO:teuthology.orchestra.run.smithi158.stdout:Discarding blocks...Done. 2023-10-09T06:20:32.995 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2023-10-09T06:20:32.995 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-09T06:20:33.071 DEBUG:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-09T06:20:33.139 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-09T06:20:33.203 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T06:20:33.204 INFO:tasks.ceph:role: osd.7 2023-10-09T06:20:33.204 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:20:33.204 DEBUG:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-09T06:20:33.268 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:20:33.268 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:20:33.268 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:20:33.268 INFO:teuthology.orchestra.run.smithi158.stdout: = reflink=1 2023-10-09T06:20:33.268 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:20:33.268 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:20:33.268 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:20:33.268 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:20:33.268 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:20:33.269 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:20:33.291 INFO:teuthology.orchestra.run.smithi158.stdout:Discarding blocks...Done. 2023-10-09T06:20:33.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2023-10-09T06:20:33.293 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-09T06:20:33.369 DEBUG:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-09T06:20:33.438 DEBUG:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:33.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:33.539+0000 7fb231586540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-09T06:20:33.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:33.539+0000 7fb231586540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-09T06:20:33.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:33.540+0000 7fb231586540 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-10-09T06:20:33.545 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-09T06:20:33.569 DEBUG:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:33.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:33.648+0000 7f5b94cdc540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-09T06:20:33.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:33.648+0000 7f5b94cdc540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-09T06:20:33.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:33.649+0000 7f5b94cdc540 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-10-09T06:20:33.654 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-09T06:20:33.719 DEBUG:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:33.800 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:33.799+0000 7ff14cb38540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-09T06:20:33.800 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:33.799+0000 7ff14cb38540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-09T06:20:33.800 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:33.800+0000 7ff14cb38540 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-10-09T06:20:33.805 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-09T06:20:33.869 DEBUG:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:33.948 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:33.948+0000 7f31812e3540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-09T06:20:33.948 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:33.948+0000 7f31812e3540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-09T06:20:33.949 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:33.948+0000 7f31812e3540 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-10-09T06:20:33.954 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-09T06:20:34.018 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-09T06:20:34.018 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:34.018 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-09T06:20:34.047 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:34.047 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-09T06:20:34.114 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:34.114 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-09T06:20:34.181 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:34.181 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-09T06:20:34.247 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:34.248 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-09T06:20:34.313 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:34.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-09T06:20:34.379 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:34.379 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-09T06:20:34.444 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:34.445 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-09T06:20:34.469 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:34.469 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-09T06:20:34.533 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:34.533 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-09T06:20:34.597 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:34.597 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-09T06:20:34.661 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:34.661 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-09T06:20:34.725 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:34.725 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-09T06:20:34.788 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:34.789 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-09T06:20:34.853 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:34.853 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-09T06:20:34.868 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:34.869 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-09T06:20:34.924 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:34.924 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-09T06:20:34.938 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:34.938 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-09T06:20:34.992 INFO:tasks.ceph:Adding keys to all mons... 2023-10-09T06:20:34.992 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-09T06:20:34.994 DEBUG:teuthology.orchestra.run.smithi158:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-09T06:20:35.035 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2023-10-09T06:20:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCrmyNlhol5OBAAZSZ+PbojVwsOJtLlTl6wAA== 2023-10-09T06:20:35.035 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2023-10-09T06:20:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCsmyNl/nWKAxAA1kcqjt4lPGPkmDivDpIVjQ== 2023-10-09T06:20:35.035 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2023-10-09T06:20:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCsmyNlJOp0ChAADGiI4SX7ZLvDrtjDtU905A== 2023-10-09T06:20:35.035 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2023-10-09T06:20:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCvmyNloyZ+LxAApAHpPxV7R1OVE2wlIaU+PA== 2023-10-09T06:20:35.035 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2023-10-09T06:20:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCvmyNlvHeUNhAAXblIEmmsc5eTo5VcZVirfA== 2023-10-09T06:20:35.036 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2023-10-09T06:20:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCwmyNlxfIaBBAAE8WbXh4Q4SxaW2k7MkSTHg== 2023-10-09T06:20:35.036 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2023-10-09T06:20:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCwmyNlUtX3DRAA5NEq+lFMzqhu1GF1ZWT2ag== 2023-10-09T06:20:35.036 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2023-10-09T06:20:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCsmyNlEE9eABAAHbJ1yvlmOUNo6n2uAhPrnw== 2023-10-09T06:20:35.036 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2023-10-09T06:20:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCsmyNl9xYEDxAAQJeaqz7lkrArv45vLGb34g== 2023-10-09T06:20:35.036 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2023-10-09T06:20:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCsmyNlbnnJFRAAO+XoxRQDaHv0ZicyggniLQ== 2023-10-09T06:20:35.036 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.4] 2023-10-09T06:20:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCxmyNlcWc5IBAA5e62AwhIuHdw4dTjnNS8hQ== 2023-10-09T06:20:35.037 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.5] 2023-10-09T06:20:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCxmyNlX5S6JhAAzvzO2YEqEtq2fJ3FW9Fddg== 2023-10-09T06:20:35.037 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.6] 2023-10-09T06:20:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCxmyNl9jy5LxAAxgMslSN6ayxB2MFRf2dwNQ== 2023-10-09T06:20:35.037 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.7] 2023-10-09T06:20:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCxmyNl8M+TOBAARhk2wEaXO9Pi4TP9d+L5Gg== 2023-10-09T06:20:35.037 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2023-10-09T06:20:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCsmyNlfsC2GRAAlm37QI8DkNclcBpD5ZBR7A== 2023-10-09T06:20:35.037 INFO:teuthology.orchestra.run.smithi031.stdout:[client.2] 2023-10-09T06:20:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCsmyNlEZYuHxAA7WEH0vXmAEH5Wki8ESrDBg== 2023-10-09T06:20:35.037 INFO:teuthology.orchestra.run.smithi031.stdout:[client.1] 2023-10-09T06:20:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCsmyNlapIxIhAAiBZUkpnf6tyFHwySGKhRpQ== 2023-10-09T06:20:35.038 INFO:teuthology.orchestra.run.smithi031.stdout:[client.3] 2023-10-09T06:20:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCsmyNlFvuIJxAAGuTp4gsXrvUzDd1B7d5vcg== 2023-10-09T06:20:35.054 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr.y] 2023-10-09T06:20:35.054 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCrmyNlhol5OBAAZSZ+PbojVwsOJtLlTl6wAA== 2023-10-09T06:20:35.055 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2023-10-09T06:20:35.055 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCsmyNl/nWKAxAA1kcqjt4lPGPkmDivDpIVjQ== 2023-10-09T06:20:35.055 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.c] 2023-10-09T06:20:35.055 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCsmyNlJOp0ChAADGiI4SX7ZLvDrtjDtU905A== 2023-10-09T06:20:35.055 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.0] 2023-10-09T06:20:35.055 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCvmyNloyZ+LxAApAHpPxV7R1OVE2wlIaU+PA== 2023-10-09T06:20:35.055 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.1] 2023-10-09T06:20:35.055 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCvmyNlvHeUNhAAXblIEmmsc5eTo5VcZVirfA== 2023-10-09T06:20:35.056 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.2] 2023-10-09T06:20:35.056 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCwmyNlxfIaBBAAE8WbXh4Q4SxaW2k7MkSTHg== 2023-10-09T06:20:35.056 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.3] 2023-10-09T06:20:35.056 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCwmyNlUtX3DRAA5NEq+lFMzqhu1GF1ZWT2ag== 2023-10-09T06:20:35.056 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr.x] 2023-10-09T06:20:35.056 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCsmyNlEE9eABAAHbJ1yvlmOUNo6n2uAhPrnw== 2023-10-09T06:20:35.056 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.b] 2023-10-09T06:20:35.056 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCsmyNl9xYEDxAAQJeaqz7lkrArv45vLGb34g== 2023-10-09T06:20:35.056 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.d] 2023-10-09T06:20:35.056 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCsmyNlbnnJFRAAO+XoxRQDaHv0ZicyggniLQ== 2023-10-09T06:20:35.056 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.4] 2023-10-09T06:20:35.056 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCxmyNlcWc5IBAA5e62AwhIuHdw4dTjnNS8hQ== 2023-10-09T06:20:35.057 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.5] 2023-10-09T06:20:35.057 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCxmyNlX5S6JhAAzvzO2YEqEtq2fJ3FW9Fddg== 2023-10-09T06:20:35.057 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.6] 2023-10-09T06:20:35.057 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCxmyNl9jy5LxAAxgMslSN6ayxB2MFRf2dwNQ== 2023-10-09T06:20:35.057 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.7] 2023-10-09T06:20:35.057 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCxmyNl8M+TOBAARhk2wEaXO9Pi4TP9d+L5Gg== 2023-10-09T06:20:35.057 INFO:teuthology.orchestra.run.smithi158.stdout:[client.0] 2023-10-09T06:20:35.057 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCsmyNlfsC2GRAAlm37QI8DkNclcBpD5ZBR7A== 2023-10-09T06:20:35.057 INFO:teuthology.orchestra.run.smithi158.stdout:[client.2] 2023-10-09T06:20:35.057 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCsmyNlEZYuHxAA7WEH0vXmAEH5Wki8ESrDBg== 2023-10-09T06:20:35.057 INFO:teuthology.orchestra.run.smithi158.stdout:[client.1] 2023-10-09T06:20:35.057 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCsmyNlapIxIhAAiBZUkpnf6tyFHwySGKhRpQ== 2023-10-09T06:20:35.058 INFO:teuthology.orchestra.run.smithi158.stdout:[client.3] 2023-10-09T06:20:35.058 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCsmyNlFvuIJxAAGuTp4gsXrvUzDd1B7d5vcg== 2023-10-09T06:20:35.058 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T06:20:35.080 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T06:20:35.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:20:35.148 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:20:35.198 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:20:35.200 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:20:35.251 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.253 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.303 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.349 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.351 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.398 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.400 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.448 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T06:20:35.450 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T06:20:35.497 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:20:35.499 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:20:35.549 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:20:35.551 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:20:35.602 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.604 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.651 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.654 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.702 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.704 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.751 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.753 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:20:35.800 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:20:35.802 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:20:35.891 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:20:35.893 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:20:35.943 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:20:35.945 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:20:35.995 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:20:35.998 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:20:36.048 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-09T06:20:36.048 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-09T06:20:36.073 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T06:20:36.166 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-09T06:20:36.191 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-09T06:20:36.216 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T06:20:36.308 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-09T06:20:36.331 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-09T06:20:36.396 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T06:20:36.487 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-09T06:20:36.511 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:36.513 DEBUG:teuthology.orchestra.run.smithi158:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:20:36.565 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-09T06:20:36.566 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-09T06:20:36.567 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-09T06:20:36.569 INFO:tasks.ceph.mon.a:Started 2023-10-09T06:20:36.569 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-09T06:20:36.569 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-09T06:20:36.608 INFO:tasks.ceph.mon.b:Started 2023-10-09T06:20:36.608 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-09T06:20:36.608 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-09T06:20:36.610 INFO:tasks.ceph.mon.c:Started 2023-10-09T06:20:36.610 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-09T06:20:36.611 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-09T06:20:36.611 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-09T06:20:36.613 INFO:tasks.ceph.mgr.y:Started 2023-10-09T06:20:36.613 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-09T06:20:36.613 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-09T06:20:36.615 INFO:tasks.ceph.mgr.x:Started 2023-10-09T06:20:36.615 INFO:tasks.ceph:Setting crush tunables to default 2023-10-09T06:20:36.615 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd crush tunables default 2023-10-09T06:20:36.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.736+0000 7fc41ccaa700 1 Processor -- start 2023-10-09T06:20:36.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.736+0000 7fc41ccaa700 1 -- start start 2023-10-09T06:20:36.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc41ccaa700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc418159ec0 0x7fc4180af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:36.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc41ccaa700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc41815a290 0x7fc4180afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:36.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc41ccaa700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4180b0790 con 0x7fc41806a5a0 2023-10-09T06:20:36.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc41ccaa700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4180ce1f0 con 0x7fc418159ec0 2023-10-09T06:20:36.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc41ccaa700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4180b0b20 con 0x7fc41815a290 2023-10-09T06:20:36.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc41659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc418159ec0 0x7fc4180af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:36.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc416d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc41806a5a0 0x7fc41815db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57036/0 (socket says 172.21.15.31:57036) 2023-10-09T06:20:36.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc41659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc418159ec0 0x7fc4180af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43862/0 (socket says 172.21.15.31:43862) 2023-10-09T06:20:36.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc416d9d700 1 -- 172.21.15.31:0/634313291 learned_addr learned my addr 172.21.15.31:0/634313291 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:36.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc41659c700 1 -- 172.21.15.31:0/634313291 >> v2:172.21.15.31:3300/0 conn(0x7fc418159ec0 msgr2=0x7fc4180af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-09T06:20:36.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc41659c700 1 -- 172.21.15.31:0/634313291 >> v2:172.21.15.31:3300/0 conn(0x7fc418159ec0 msgr2=0x7fc4180af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:20:36.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc41659c700 1 --2- 172.21.15.31:0/634313291 >> v2:172.21.15.31:3300/0 conn(0x7fc418159ec0 0x7fc4180af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:20:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc41659c700 1 --2- 172.21.15.31:0/634313291 >> v2:172.21.15.31:3300/0 conn(0x7fc418159ec0 0x7fc4180af940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:20:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc415d9b700 1 --2- 172.21.15.31:0/634313291 >> v2:172.21.15.158:3300/0 conn(0x7fc41815a290 0x7fc4180afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc415d9b700 1 -- 172.21.15.31:0/634313291 >> v2:172.21.15.158:3300/0 conn(0x7fc41815a290 msgr2=0x7fc4180afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-09T06:20:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc415d9b700 1 -- 172.21.15.31:0/634313291 >> v2:172.21.15.158:3300/0 conn(0x7fc41815a290 msgr2=0x7fc4180afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:20:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc415d9b700 1 --2- 172.21.15.31:0/634313291 >> v2:172.21.15.158:3300/0 conn(0x7fc41815a290 0x7fc4180afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:20:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.737+0000 7fc415d9b700 1 --2- 172.21.15.31:0/634313291 >> v2:172.21.15.158:3300/0 conn(0x7fc41815a290 0x7fc4180afe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:20:36.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.930+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241192168 0 0) 0x7fc4180b0790 con 0x7fc41806a5a0 2023-10-09T06:20:36.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.930+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc400003570 con 0x7fc41806a5a0 2023-10-09T06:20:36.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.930+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1988488501 0 0) 0x7fc400003570 con 0x7fc41806a5a0 2023-10-09T06:20:36.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.930+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 >> v2:172.21.15.158:3300/0 conn(0x7fc41815a290 msgr2=0x7fc4180afe80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:20:36.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.930+0000 7fc41559a700 1 --2- 172.21.15.31:0/634313291 >> v2:172.21.15.158:3300/0 conn(0x7fc41815a290 0x7fc4180afe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:36.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.930+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 >> v2:172.21.15.31:3300/0 conn(0x7fc418159ec0 msgr2=0x7fc4180af940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:20:36.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.930+0000 7fc41559a700 1 --2- 172.21.15.31:0/634313291 >> v2:172.21.15.31:3300/0 conn(0x7fc418159ec0 0x7fc4180af940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:36.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4180b04b0 con 0x7fc41806a5a0 2023-10-09T06:20:36.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fc4100017f0 con 0x7fc41806a5a0 2023-10-09T06:20:36.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 >> v1:172.21.15.31:6789/0 conn(0x7fc41806a5a0 legacy=0x7fc41815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:36.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41559a700 1 --2- 172.21.15.31:0/634313291 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc400003a60 0x7fc400003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:36.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41559a700 1 --2- 172.21.15.31:0/634313291 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc400004810 0x7fc400004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:36.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41559a700 1 --2- 172.21.15.31:0/634313291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4000051c0 0x7fc40000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:36.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180ce1f0 con 0x7fc4000051c0 2023-10-09T06:20:36.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180b0b20 con 0x7fc400003a60 2023-10-09T06:20:36.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40000c160 con 0x7fc400004810 2023-10-09T06:20:36.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41659c700 1 --2- 172.21.15.31:0/634313291 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc400003a60 0x7fc400003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:36.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc415d9b700 1 --2- 172.21.15.31:0/634313291 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc400004810 0x7fc400004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:36.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc416d9d700 1 --2- 172.21.15.31:0/634313291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4000051c0 0x7fc40000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:36.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41659c700 1 -- 172.21.15.31:0/634313291 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc400004810 msgr2=0x7fc400004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:36.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41659c700 1 --2- 172.21.15.31:0/634313291 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc400004810 0x7fc400004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:36.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41659c700 1 -- 172.21.15.31:0/634313291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4000051c0 msgr2=0x7fc40000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:36.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41659c700 1 --2- 172.21.15.31:0/634313291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4000051c0 0x7fc40000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:36.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41659c700 1 -- 172.21.15.31:0/634313291 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4180b04b0 con 0x7fc400003a60 2023-10-09T06:20:36.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc416d9d700 1 --2- 172.21.15.31:0/634313291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4000051c0 0x7fc40000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:20:36.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc416d9d700 1 -- 172.21.15.31:0/634313291 reap_dead start 2023-10-09T06:20:36.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.931+0000 7fc41659c700 1 --2- 172.21.15.31:0/634313291 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc400003a60 0x7fc400003e70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc40800bb40 tx=0x7fc408008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f5bcf366b9527d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:36.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.932+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc408018070 con 0x7fc400003a60 2023-10-09T06:20:36.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.932+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40800d5d0 con 0x7fc400003a60 2023-10-09T06:20:36.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.932+0000 7fc41559a700 1 -- 172.21.15.31:0/634313291 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40800d990 con 0x7fc400003a60 2023-10-09T06:20:36.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.933+0000 7fc41ccaa700 1 -- 172.21.15.31:0/634313291 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc400003a60 msgr2=0x7fc400003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:36.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.933+0000 7fc41ccaa700 1 --2- 172.21.15.31:0/634313291 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc400003a60 0x7fc400003e70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc40800bb40 tx=0x7fc408008040 comp rx=0 tx=0).stop 2023-10-09T06:20:36.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.933+0000 7fc41ccaa700 1 -- 172.21.15.31:0/634313291 shutdown_connections 2023-10-09T06:20:36.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.933+0000 7fc41ccaa700 1 --2- 172.21.15.31:0/634313291 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc400003a60 0x7fc400003e70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:36.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.933+0000 7fc41ccaa700 1 -- 172.21.15.31:0/634313291 >> 172.21.15.31:0/634313291 conn(0x7fc4180d1880 msgr2=0x7fc4180cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:36.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.933+0000 7fc41ccaa700 1 -- 172.21.15.31:0/634313291 shutdown_connections 2023-10-09T06:20:36.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.933+0000 7fc41ccaa700 1 -- 172.21.15.31:0/634313291 wait complete. 2023-10-09T06:20:36.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.934+0000 7fc41ccaa700 1 Processor -- start 2023-10-09T06:20:36.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.934+0000 7fc41ccaa700 1 -- start start 2023-10-09T06:20:36.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.935+0000 7fc41ccaa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc400003a60 0x7fc4180b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:36.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.935+0000 7fc41ccaa700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc418151870 0x7fc418152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:36.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.935+0000 7fc41ccaa700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc418153100 0x7fc4180b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:36.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.935+0000 7fc41ccaa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc418153680 con 0x7fc400003a60 2023-10-09T06:20:36.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.935+0000 7fc41ccaa700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180c8040 con 0x7fc418151870 2023-10-09T06:20:36.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.935+0000 7fc41ccaa700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41815bad0 con 0x7fc418153100 2023-10-09T06:20:36.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.935+0000 7fc41659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc400003a60 0x7fc4180b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:36.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.935+0000 7fc41659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc400003a60 0x7fc4180b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43886/0 (socket says 172.21.15.31:43886) 2023-10-09T06:20:36.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.935+0000 7fc41659c700 1 -- 172.21.15.31:0/2330051840 learned_addr learned my addr 172.21.15.31:0/2330051840 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:36.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.935+0000 7fc416d9d700 1 --2- 172.21.15.31:0/2330051840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc418153100 0x7fc4180b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:36.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.935+0000 7fc415d9b700 1 --2- 172.21.15.31:0/2330051840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc418151870 0x7fc418152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:36.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.936+0000 7fc41659c700 1 -- 172.21.15.31:0/2330051840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc418153100 msgr2=0x7fc4180b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:36.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.936+0000 7fc41659c700 1 --2- 172.21.15.31:0/2330051840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc418153100 0x7fc4180b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:36.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.936+0000 7fc41659c700 1 -- 172.21.15.31:0/2330051840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc418151870 msgr2=0x7fc418152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:36.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.936+0000 7fc41659c700 1 --2- 172.21.15.31:0/2330051840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc418151870 0x7fc418152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:36.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.936+0000 7fc41659c700 1 -- 172.21.15.31:0/2330051840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41815bdb0 con 0x7fc400003a60 2023-10-09T06:20:36.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.936+0000 7fc41659c700 1 --2- 172.21.15.31:0/2330051840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc400003a60 0x7fc4180b3b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc40800d440 tx=0x7fc40801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:36.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.937+0000 7fc4067fc700 1 -- 172.21.15.31:0/2330051840 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40801f710 con 0x7fc400003a60 2023-10-09T06:20:36.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.937+0000 7fc4067fc700 1 -- 172.21.15.31:0/2330051840 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40801f870 con 0x7fc400003a60 2023-10-09T06:20:36.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.937+0000 7fc41ccaa700 1 -- 172.21.15.31:0/2330051840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41815c090 con 0x7fc400003a60 2023-10-09T06:20:36.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.937+0000 7fc4067fc700 1 -- 172.21.15.31:0/2330051840 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40801fc30 con 0x7fc400003a60 2023-10-09T06:20:36.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.937+0000 7fc41ccaa700 1 -- 172.21.15.31:0/2330051840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc418151ce0 con 0x7fc400003a60 2023-10-09T06:20:36.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.937+0000 7fc4067fc700 1 -- 172.21.15.31:0/2330051840 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc4080288f0 con 0x7fc400003a60 2023-10-09T06:20:36.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.937+0000 7fc4067fc700 1 -- 172.21.15.31:0/2330051840 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc408014780 con 0x7fc400003a60 2023-10-09T06:20:36.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.938+0000 7fc41ccaa700 1 -- 172.21.15.31:0/2330051840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41815c530 con 0x7fc400003a60 2023-10-09T06:20:36.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:36.940+0000 7fc4067fc700 1 -- 172.21.15.31:0/2330051840 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc4080496d0 con 0x7fc400003a60 2023-10-09T06:20:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:37.016+0000 7fc41ccaa700 1 -- 172.21.15.31:0/2330051840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc41815c6e0 con 0x7fc400003a60 2023-10-09T06:20:37.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:37.019+0000 7fc4067fc700 1 -- 172.21.15.31:0/2330051840 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc408038070 con 0x7fc400003a60 2023-10-09T06:20:37.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:37.020+0000 7fc41ccaa700 1 -- 172.21.15.31:0/2330051840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc400003a60 msgr2=0x7fc4180b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:37.020+0000 7fc41ccaa700 1 --2- 172.21.15.31:0/2330051840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc400003a60 0x7fc4180b3b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc40800d440 tx=0x7fc40801a000 comp rx=0 tx=0).stop 2023-10-09T06:20:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:37.020+0000 7fc41ccaa700 1 -- 172.21.15.31:0/2330051840 shutdown_connections 2023-10-09T06:20:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:37.020+0000 7fc41ccaa700 1 --2- 172.21.15.31:0/2330051840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc418153100 0x7fc4180b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:37.020+0000 7fc41ccaa700 1 --2- 172.21.15.31:0/2330051840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc400003a60 0x7fc4180b3b50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:37.020+0000 7fc41ccaa700 1 --2- 172.21.15.31:0/2330051840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc418151870 0x7fc418152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:37.020+0000 7fc41ccaa700 1 -- 172.21.15.31:0/2330051840 >> 172.21.15.31:0/2330051840 conn(0x7fc4180d1880 msgr2=0x7fc4180b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:37.020+0000 7fc41ccaa700 1 -- 172.21.15.31:0/2330051840 shutdown_connections 2023-10-09T06:20:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:37.020+0000 7fc41ccaa700 1 -- 172.21.15.31:0/2330051840 wait complete. 2023-10-09T06:20:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2023-10-09T06:20:37.033 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-09T06:20:37.033 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:37.033 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-09T06:20:37.058 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:37.058 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-09T06:20:37.123 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:37.124 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-09T06:20:37.190 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-09T06:20:37.191 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-09T06:20:37.255 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:37.255 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-09T06:20:37.279 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:37.280 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-09T06:20:37.345 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:37.345 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-09T06:20:37.409 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-09T06:20:37.410 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-09T06:20:37.474 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-10-09T06:20:37.630 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.630+0000 7f9a92301700 1 Processor -- start 2023-10-09T06:20:37.630 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.630+0000 7f9a92301700 1 -- start start 2023-10-09T06:20:37.632 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.630+0000 7f9a92301700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a8c0cd900 0x7f9a8c15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:37.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.630+0000 7f9a92301700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9a8c15ba30 0x7f9a8c0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:37.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.630+0000 7f9a92301700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8c15b260 con 0x7f9a8c15dcc0 2023-10-09T06:20:37.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.630+0000 7f9a92301700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a8c09af70 con 0x7f9a8c15ba30 2023-10-09T06:20:37.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.630+0000 7f9a92301700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c0c7830 con 0x7f9a8c0cd900 2023-10-09T06:20:37.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a8b7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a8c0cd900 0x7f9a8c15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:37.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a8bfff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f9a8c15dcc0 0x7f9a8c15e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:43332/0 (socket says 172.21.15.158:43332) 2023-10-09T06:20:37.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a8bfff700 1 -- 172.21.15.158:0/3820844535 learned_addr learned my addr 172.21.15.158:0/3820844535 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-09T06:20:37.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a9089e700 1 --2- 172.21.15.158:0/3820844535 >> v2:172.21.15.31:3300/0 conn(0x7f9a8c15ba30 0x7f9a8c0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:37.634 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a8affd700 1 -- 172.21.15.158:0/3820844535 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374299364 0 0) 0x7f9a8c15b260 con 0x7f9a8c15dcc0 2023-10-09T06:20:37.634 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a8affd700 1 -- 172.21.15.158:0/3820844535 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a74003570 con 0x7f9a8c15dcc0 2023-10-09T06:20:37.634 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a8b7fe700 1 -- 172.21.15.158:0/3820844535 >> v2:172.21.15.31:3300/0 conn(0x7f9a8c15ba30 msgr2=0x7f9a8c0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:37.634 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a8b7fe700 1 --2- 172.21.15.158:0/3820844535 >> v2:172.21.15.31:3300/0 conn(0x7f9a8c15ba30 0x7f9a8c0c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.634 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a8b7fe700 1 -- 172.21.15.158:0/3820844535 >> v1:172.21.15.158:6789/0 conn(0x7f9a8c15dcc0 legacy=0x7f9a8c15e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:37.634 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a8b7fe700 1 -- 172.21.15.158:0/3820844535 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c0c7b10 con 0x7f9a8c0cd900 2023-10-09T06:20:37.634 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a8b7fe700 1 --2- 172.21.15.158:0/3820844535 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a8c0cd900 0x7f9a8c15b4f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a800098e0 tx=0x7f9a800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=493f57c4963a3e08 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:37.634 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a8affd700 1 -- 172.21.15.158:0/3820844535 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80011630 con 0x7f9a8c0cd900 2023-10-09T06:20:37.634 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a8affd700 1 -- 172.21.15.158:0/3820844535 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a80011790 con 0x7f9a8c0cd900 2023-10-09T06:20:37.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.631+0000 7f9a8affd700 1 -- 172.21.15.158:0/3820844535 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80011b30 con 0x7f9a8c0cd900 2023-10-09T06:20:37.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.632+0000 7f9a92301700 1 -- 172.21.15.158:0/3820844535 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a8c0cd900 msgr2=0x7f9a8c15b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:37.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.632+0000 7f9a92301700 1 --2- 172.21.15.158:0/3820844535 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a8c0cd900 0x7f9a8c15b4f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a800098e0 tx=0x7f9a800091a0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.632+0000 7f9a92301700 1 -- 172.21.15.158:0/3820844535 shutdown_connections 2023-10-09T06:20:37.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.632+0000 7f9a92301700 1 --2- 172.21.15.158:0/3820844535 >> v2:172.21.15.31:3300/0 conn(0x7f9a8c15ba30 0x7f9a8c0c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.632+0000 7f9a92301700 1 --2- 172.21.15.158:0/3820844535 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a8c0cd900 0x7f9a8c15b4f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.632+0000 7f9a92301700 1 -- 172.21.15.158:0/3820844535 >> 172.21.15.158:0/3820844535 conn(0x7f9a8c068170 msgr2=0x7f9a8c0cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:37.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.632+0000 7f9a92301700 1 -- 172.21.15.158:0/3820844535 shutdown_connections 2023-10-09T06:20:37.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.632+0000 7f9a92301700 1 -- 172.21.15.158:0/3820844535 wait complete. 2023-10-09T06:20:37.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.633+0000 7f9a92301700 1 Processor -- start 2023-10-09T06:20:37.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.633+0000 7f9a92301700 1 -- start start 2023-10-09T06:20:37.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a92301700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a8c0cd900 0x7f9a8c157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:37.638 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a92301700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a8c15ba30 0x7f9a8c0cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:37.638 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a92301700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a8c15dcc0 0x7f9a8c0ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:37.638 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a92301700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c0c5b20 con 0x7f9a8c15dcc0 2023-10-09T06:20:37.638 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a92301700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c0c5180 con 0x7f9a8c0cd900 2023-10-09T06:20:37.638 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a92301700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c158010 con 0x7f9a8c15ba30 2023-10-09T06:20:37.638 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a8bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a8c0cd900 0x7f9a8c157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:37.638 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a8b7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a8c15ba30 0x7f9a8c0cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:37.638 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a8bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a8c0cd900 0x7f9a8c157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35340/0 (socket says 172.21.15.158:35340) 2023-10-09T06:20:37.638 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a8b7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a8c15ba30 0x7f9a8c0cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:39766/0 (socket says 172.21.15.158:39766) 2023-10-09T06:20:37.638 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a8bfff700 1 -- 172.21.15.158:0/1640599450 learned_addr learned my addr 172.21.15.158:0/1640599450 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-09T06:20:37.639 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a9089e700 1 --2- 172.21.15.158:0/1640599450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a8c15dcc0 0x7f9a8c0ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:37.639 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a8bfff700 1 -- 172.21.15.158:0/1640599450 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a8c15ba30 msgr2=0x7f9a8c0cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:37.639 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a8bfff700 1 --2- 172.21.15.158:0/1640599450 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a8c15ba30 0x7f9a8c0cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.639 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a8bfff700 1 -- 172.21.15.158:0/1640599450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a8c15dcc0 msgr2=0x7f9a8c0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:37.639 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a8bfff700 1 --2- 172.21.15.158:0/1640599450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a8c15dcc0 0x7f9a8c0ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.639 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.634+0000 7f9a8bfff700 1 -- 172.21.15.158:0/1640599450 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80009420 con 0x7f9a8c0cd900 2023-10-09T06:20:37.639 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.635+0000 7f9a8bfff700 1 --2- 172.21.15.158:0/1640599450 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a8c0cd900 0x7f9a8c157ad0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00c590 tx=0x7f9a7c007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:37.639 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.635+0000 7f9a73fff700 1 -- 172.21.15.158:0/1640599450 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c005b30 con 0x7f9a8c0cd900 2023-10-09T06:20:37.639 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.635+0000 7f9a73fff700 1 -- 172.21.15.158:0/1640599450 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7c005cb0 con 0x7f9a8c0cd900 2023-10-09T06:20:37.639 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.635+0000 7f9a92301700 1 -- 172.21.15.158:0/1640599450 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8c0c4ea0 con 0x7f9a8c0cd900 2023-10-09T06:20:37.639 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.635+0000 7f9a73fff700 1 -- 172.21.15.158:0/1640599450 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c007320 con 0x7f9a8c0cd900 2023-10-09T06:20:37.640 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.635+0000 7f9a92301700 1 -- 172.21.15.158:0/1640599450 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8c0c57b0 con 0x7f9a8c0cd900 2023-10-09T06:20:37.640 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.635+0000 7f9a73fff700 1 -- 172.21.15.158:0/1640599450 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9a7c01c6c0 con 0x7f9a8c0cd900 2023-10-09T06:20:37.640 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.635+0000 7f9a73fff700 1 -- 172.21.15.158:0/1640599450 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9a7c012750 con 0x7f9a8c0cd900 2023-10-09T06:20:37.640 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.636+0000 7f9a92301700 1 -- 172.21.15.158:0/1640599450 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8c04c3c0 con 0x7f9a8c0cd900 2023-10-09T06:20:37.640 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.638+0000 7f9a73fff700 1 -- 172.21.15.158:0/1640599450 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9a7c017070 con 0x7f9a8c0cd900 2023-10-09T06:20:37.722 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.722+0000 7f9a92301700 1 -- 172.21.15.158:0/1640599450 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f9a8c0c7df0 con 0x7f9a8c0cd900 2023-10-09T06:20:37.725 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.725+0000 7f9a73fff700 1 -- 172.21.15.158:0/1640599450 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9a7c007710 con 0x7f9a8c0cd900 2023-10-09T06:20:37.726 INFO:teuthology.orchestra.run.smithi158.stdout:0 2023-10-09T06:20:37.727 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.726+0000 7f9a92301700 1 -- 172.21.15.158:0/1640599450 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a8c0cd900 msgr2=0x7f9a8c157ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:37.727 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.726+0000 7f9a92301700 1 --2- 172.21.15.158:0/1640599450 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a8c0cd900 0x7f9a8c157ad0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00c590 tx=0x7f9a7c007e00 comp rx=0 tx=0).stop 2023-10-09T06:20:37.727 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.726+0000 7f9a92301700 1 -- 172.21.15.158:0/1640599450 shutdown_connections 2023-10-09T06:20:37.727 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.726+0000 7f9a92301700 1 --2- 172.21.15.158:0/1640599450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a8c15dcc0 0x7f9a8c0ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.727 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.726+0000 7f9a92301700 1 --2- 172.21.15.158:0/1640599450 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a8c0cd900 0x7f9a8c157ad0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.726+0000 7f9a92301700 1 --2- 172.21.15.158:0/1640599450 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a8c15ba30 0x7f9a8c0cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.726+0000 7f9a92301700 1 -- 172.21.15.158:0/1640599450 >> 172.21.15.158:0/1640599450 conn(0x7f9a8c068170 msgr2=0x7f9a8c063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:37.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.727+0000 7f9a92301700 1 -- 172.21.15.158:0/1640599450 shutdown_connections 2023-10-09T06:20:37.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.727+0000 7f9a92301700 1 -- 172.21.15.158:0/1640599450 wait complete. 2023-10-09T06:20:37.740 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-10-09T06:20:37.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.856+0000 7f53c5688700 1 Processor -- start 2023-10-09T06:20:37.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.856+0000 7f53c5688700 1 -- start start 2023-10-09T06:20:37.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53c5688700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f53c015a300 0x7f53c015a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:37.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53c5688700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015cec0 0x7f53c00cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:37.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53c5688700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c00cc760 con 0x7f53c015ac10 2023-10-09T06:20:37.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53c5688700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c015b460 con 0x7f53c015a300 2023-10-09T06:20:37.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53c5688700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c015ba20 con 0x7f53c015cec0 2023-10-09T06:20:37.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53bffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f53c015a300 0x7f53c015a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:37.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53c4e87700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015cec0 0x7f53c00cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:37.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53bffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f53c015a300 0x7f53c015a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35354/0 (socket says 172.21.15.158:35354) 2023-10-09T06:20:37.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53c4e87700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015cec0 0x7f53c00cbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:39778/0 (socket says 172.21.15.158:39778) 2023-10-09T06:20:37.861 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53bffff700 1 -- 172.21.15.158:0/2014097165 learned_addr learned my addr 172.21.15.158:0/2014097165 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-09T06:20:37.861 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53c4e87700 1 -- 172.21.15.158:0/2014097165 >> v2:172.21.15.158:3300/0 conn(0x7f53c015a300 msgr2=0x7f53c015a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:37.861 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53c4e87700 1 --2- 172.21.15.158:0/2014097165 >> v2:172.21.15.158:3300/0 conn(0x7f53c015a300 0x7f53c015a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.861 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53c4e87700 1 -- 172.21.15.158:0/2014097165 >> v1:172.21.15.31:6789/0 conn(0x7f53c015ac10 legacy=0x7f53c00cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:37.862 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53c4e87700 1 -- 172.21.15.158:0/2014097165 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c00cc1a0 con 0x7f53c015cec0 2023-10-09T06:20:37.862 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.857+0000 7f53bffff700 1 --2- 172.21.15.158:0/2014097165 >> v2:172.21.15.158:3300/0 conn(0x7f53c015a300 0x7f53c015a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:20:37.862 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.858+0000 7f53c4e87700 1 --2- 172.21.15.158:0/2014097165 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015cec0 0x7f53c00cbb40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009e60 tx=0x7f53b8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a12d65635203aa22 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:37.862 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.858+0000 7f53beffd700 1 -- 172.21.15.158:0/2014097165 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b800e070 con 0x7f53c015cec0 2023-10-09T06:20:37.862 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.858+0000 7f53beffd700 1 -- 172.21.15.158:0/2014097165 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b800bb60 con 0x7f53c015cec0 2023-10-09T06:20:37.862 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.858+0000 7f53beffd700 1 -- 172.21.15.158:0/2014097165 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8012430 con 0x7f53c015cec0 2023-10-09T06:20:37.862 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.858+0000 7f53c5688700 1 -- 172.21.15.158:0/2014097165 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015cec0 msgr2=0x7f53c00cbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:37.862 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.858+0000 7f53c5688700 1 --2- 172.21.15.158:0/2014097165 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015cec0 0x7f53c00cbb40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009e60 tx=0x7f53b8009780 comp rx=0 tx=0).stop 2023-10-09T06:20:37.863 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.858+0000 7f53c5688700 1 -- 172.21.15.158:0/2014097165 shutdown_connections 2023-10-09T06:20:37.863 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.858+0000 7f53c5688700 1 --2- 172.21.15.158:0/2014097165 >> v2:172.21.15.158:3300/0 conn(0x7f53c015a300 0x7f53c015a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.863 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.858+0000 7f53c5688700 1 --2- 172.21.15.158:0/2014097165 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015cec0 0x7f53c00cbb40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.863 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.858+0000 7f53c5688700 1 -- 172.21.15.158:0/2014097165 >> 172.21.15.158:0/2014097165 conn(0x7f53c0099f50 msgr2=0x7f53c0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:37.863 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.858+0000 7f53c5688700 1 -- 172.21.15.158:0/2014097165 shutdown_connections 2023-10-09T06:20:37.863 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.858+0000 7f53c5688700 1 -- 172.21.15.158:0/2014097165 wait complete. 2023-10-09T06:20:37.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.859+0000 7f53c5688700 1 Processor -- start 2023-10-09T06:20:37.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.860+0000 7f53c5688700 1 -- start start 2023-10-09T06:20:37.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.860+0000 7f53c5688700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015a300 0x7f53c014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:37.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.860+0000 7f53c5688700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c015ac10 0x7f53c00c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:37.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.860+0000 7f53c5688700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f53c015cec0 0x7f53c00b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:37.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.860+0000 7f53c5688700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c00c9430 con 0x7f53c015ac10 2023-10-09T06:20:37.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.860+0000 7f53c5688700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c00c9d90 con 0x7f53c015cec0 2023-10-09T06:20:37.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.860+0000 7f53c5688700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c00ca070 con 0x7f53c015a300 2023-10-09T06:20:37.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.860+0000 7f53c4e87700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f53c015cec0 0x7f53c00b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:37.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.860+0000 7f53bffff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015a300 0x7f53c014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:37.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.860+0000 7f53bffff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015a300 0x7f53c014fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:39794/0 (socket says 172.21.15.158:39794) 2023-10-09T06:20:37.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.860+0000 7f53bffff700 1 -- 172.21.15.158:0/1580279054 learned_addr learned my addr 172.21.15.158:0/1580279054 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-09T06:20:37.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.860+0000 7f53c4e87700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f53c015cec0 0x7f53c00b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35370/0 (socket says 172.21.15.158:35370) 2023-10-09T06:20:37.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53bf7fe700 1 --2- 172.21.15.158:0/1580279054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c015ac10 0x7f53c00c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:37.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53c4e87700 1 -- 172.21.15.158:0/1580279054 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015a300 msgr2=0x7f53c014fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:37.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53c4e87700 1 --2- 172.21.15.158:0/1580279054 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015a300 0x7f53c014fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53c4e87700 1 -- 172.21.15.158:0/1580279054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c015ac10 msgr2=0x7f53c00c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:37.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53c4e87700 1 --2- 172.21.15.158:0/1580279054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c015ac10 0x7f53c00c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53c4e87700 1 -- 172.21.15.158:0/1580279054 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b4009480 con 0x7f53c015cec0 2023-10-09T06:20:37.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53bffff700 1 --2- 172.21.15.158:0/1580279054 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015a300 0x7f53c014fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:20:37.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53c4e87700 1 --2- 172.21.15.158:0/1580279054 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f53c015cec0 0x7f53c00b5110 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f53b8016000 tx=0x7f53b8019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:37.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53a7fff700 1 -- 172.21.15.158:0/1580279054 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8012ea0 con 0x7f53c015cec0 2023-10-09T06:20:37.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53a7fff700 1 -- 172.21.15.158:0/1580279054 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b8027470 con 0x7f53c015cec0 2023-10-09T06:20:37.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53a7fff700 1 -- 172.21.15.158:0/1580279054 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8027850 con 0x7f53c015cec0 2023-10-09T06:20:37.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53c5688700 1 -- 172.21.15.158:0/1580279054 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b8009a20 con 0x7f53c015cec0 2023-10-09T06:20:37.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53c5688700 1 -- 172.21.15.158:0/1580279054 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c00ca630 con 0x7f53c015cec0 2023-10-09T06:20:37.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53a7fff700 1 -- 172.21.15.158:0/1580279054 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f53b8024070 con 0x7f53c015cec0 2023-10-09T06:20:37.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.861+0000 7f53a7fff700 1 -- 172.21.15.158:0/1580279054 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f53b801d9a0 con 0x7f53c015cec0 2023-10-09T06:20:37.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.862+0000 7f53c5688700 1 -- 172.21.15.158:0/1580279054 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c006ada0 con 0x7f53c015cec0 2023-10-09T06:20:37.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.865+0000 7f53a7fff700 1 -- 172.21.15.158:0/1580279054 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f53b80476d0 con 0x7f53c015cec0 2023-10-09T06:20:37.948 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.948+0000 7f53c5688700 1 -- 172.21.15.158:0/1580279054 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f53c00cc480 con 0x7f53c015cec0 2023-10-09T06:20:37.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.952+0000 7f53a7fff700 1 -- 172.21.15.158:0/1580279054 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f53b8036030 con 0x7f53c015cec0 2023-10-09T06:20:37.952 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-09T06:20:37.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.953+0000 7f53c5688700 1 -- 172.21.15.158:0/1580279054 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f53c015cec0 msgr2=0x7f53c00b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:37.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.953+0000 7f53c5688700 1 --2- 172.21.15.158:0/1580279054 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f53c015cec0 0x7f53c00b5110 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f53b8016000 tx=0x7f53b8019000 comp rx=0 tx=0).stop 2023-10-09T06:20:37.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.953+0000 7f53c5688700 1 -- 172.21.15.158:0/1580279054 shutdown_connections 2023-10-09T06:20:37.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.953+0000 7f53c5688700 1 --2- 172.21.15.158:0/1580279054 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f53c015a300 0x7f53c014fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.953+0000 7f53c5688700 1 --2- 172.21.15.158:0/1580279054 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f53c015cec0 0x7f53c00b5110 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.953+0000 7f53c5688700 1 --2- 172.21.15.158:0/1580279054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c015ac10 0x7f53c00c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:37.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.953+0000 7f53c5688700 1 -- 172.21.15.158:0/1580279054 >> 172.21.15.158:0/1580279054 conn(0x7f53c0099f50 msgr2=0x7f53c006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:37.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.953+0000 7f53c5688700 1 -- 172.21.15.158:0/1580279054 shutdown_connections 2023-10-09T06:20:37.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:37.953+0000 7f53c5688700 1 -- 172.21.15.158:0/1580279054 wait complete. 2023-10-09T06:20:37.970 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-10-09T06:20:38.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.086+0000 7f315f189700 1 Processor -- start 2023-10-09T06:20:38.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.086+0000 7f315f189700 1 -- start start 2023-10-09T06:20:38.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f315f189700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f315815b9a0 0x7f31580caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f315f189700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 0x7f315806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f315f189700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315815c8d0 con 0x7f3158152300 2023-10-09T06:20:38.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f315f189700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31580b1400 con 0x7f315815b9a0 2023-10-09T06:20:38.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f315f189700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315815be20 con 0x7f315806d370 2023-10-09T06:20:38.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f315d726700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 0x7f315806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f315d726700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 0x7f315806d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:39798/0 (socket says 172.21.15.158:39798) 2023-10-09T06:20:38.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f315d726700 1 -- 172.21.15.158:0/787080099 learned_addr learned my addr 172.21.15.158:0/787080099 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-09T06:20:38.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f3157fff700 1 --2- 172.21.15.158:0/787080099 >> v2:172.21.15.31:3300/0 conn(0x7f315815b9a0 0x7f31580caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f315d726700 1 -- 172.21.15.158:0/787080099 >> v2:172.21.15.31:3300/0 conn(0x7f315815b9a0 msgr2=0x7f31580caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:38.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f315d726700 1 --2- 172.21.15.158:0/787080099 >> v2:172.21.15.31:3300/0 conn(0x7f315815b9a0 0x7f31580caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f315d726700 1 -- 172.21.15.158:0/787080099 >> v1:172.21.15.31:6789/0 conn(0x7f3158152300 legacy=0x7f3158158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f315d726700 1 -- 172.21.15.158:0/787080099 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31580c9370 con 0x7f315806d370 2023-10-09T06:20:38.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.087+0000 7f315d726700 1 --2- 172.21.15.158:0/787080099 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 0x7f315806d790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3150009f20 tx=0x7f3150009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2528061e38b44b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:38.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.088+0000 7f31577fe700 1 -- 172.21.15.158:0/787080099 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000e070 con 0x7f315806d370 2023-10-09T06:20:38.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.088+0000 7f31577fe700 1 -- 172.21.15.158:0/787080099 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315000b9d0 con 0x7f315806d370 2023-10-09T06:20:38.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.088+0000 7f31577fe700 1 -- 172.21.15.158:0/787080099 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31500092e0 con 0x7f315806d370 2023-10-09T06:20:38.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.088+0000 7f315f189700 1 -- 172.21.15.158:0/787080099 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 msgr2=0x7f315806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.088+0000 7f315f189700 1 --2- 172.21.15.158:0/787080099 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 0x7f315806d790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3150009f20 tx=0x7f3150009840 comp rx=0 tx=0).stop 2023-10-09T06:20:38.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.088+0000 7f315f189700 1 -- 172.21.15.158:0/787080099 shutdown_connections 2023-10-09T06:20:38.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.088+0000 7f315f189700 1 --2- 172.21.15.158:0/787080099 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 0x7f315806d790 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.088+0000 7f315f189700 1 --2- 172.21.15.158:0/787080099 >> v2:172.21.15.31:3300/0 conn(0x7f315815b9a0 0x7f31580caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.088+0000 7f315f189700 1 -- 172.21.15.158:0/787080099 >> 172.21.15.158:0/787080099 conn(0x7f3158069870 msgr2=0x7f3158069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:38.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.088+0000 7f315f189700 1 -- 172.21.15.158:0/787080099 shutdown_connections 2023-10-09T06:20:38.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.089+0000 7f315f189700 1 -- 172.21.15.158:0/787080099 wait complete. 2023-10-09T06:20:38.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.090+0000 7f315f189700 1 Processor -- start 2023-10-09T06:20:38.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.090+0000 7f315f189700 1 -- start start 2023-10-09T06:20:38.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.090+0000 7f315f189700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 0x7f31581503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.090+0000 7f315f189700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3158152300 0x7f3158152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f315f189700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f315815b9a0 0x7f3158152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f315f189700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31580b4640 con 0x7f315815b9a0 2023-10-09T06:20:38.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f315f189700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31580b3a30 con 0x7f3158152300 2023-10-09T06:20:38.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f315f189700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31580b3d10 con 0x7f315806d370 2023-10-09T06:20:38.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f315cf25700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 0x7f31581503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f3157fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3158152300 0x7f3158152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f315cf25700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 0x7f31581503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:39810/0 (socket says 172.21.15.158:39810) 2023-10-09T06:20:38.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f3157fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3158152300 0x7f3158152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35372/0 (socket says 172.21.15.158:35372) 2023-10-09T06:20:38.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f315cf25700 1 -- 172.21.15.158:0/2238941391 learned_addr learned my addr 172.21.15.158:0/2238941391 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-09T06:20:38.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f315d726700 1 --2- 172.21.15.158:0/2238941391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f315815b9a0 0x7f3158152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f3157fff700 1 -- 172.21.15.158:0/2238941391 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 msgr2=0x7f31581503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f3157fff700 1 --2- 172.21.15.158:0/2238941391 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 0x7f31581503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f3157fff700 1 -- 172.21.15.158:0/2238941391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f315815b9a0 msgr2=0x7f3158152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f3157fff700 1 --2- 172.21.15.158:0/2238941391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f315815b9a0 0x7f3158152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f3157fff700 1 -- 172.21.15.158:0/2238941391 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150009ae0 con 0x7f3158152300 2023-10-09T06:20:38.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f315cf25700 1 --2- 172.21.15.158:0/2238941391 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 0x7f31581503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:20:38.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f3157fff700 1 --2- 172.21.15.158:0/2238941391 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3158152300 0x7f3158152980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f314400e900 tx=0x7f31440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:38.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f3154ff9700 1 -- 172.21.15.158:0/2238941391 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144013680 con 0x7f3158152300 2023-10-09T06:20:38.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f3154ff9700 1 -- 172.21.15.158:0/2238941391 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31440137e0 con 0x7f3158152300 2023-10-09T06:20:38.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f315f189700 1 -- 172.21.15.158:0/2238941391 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31580b3ff0 con 0x7f3158152300 2023-10-09T06:20:38.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f3154ff9700 1 -- 172.21.15.158:0/2238941391 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144013ba0 con 0x7f3158152300 2023-10-09T06:20:38.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.091+0000 7f315f189700 1 -- 172.21.15.158:0/2238941391 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3158150930 con 0x7f3158152300 2023-10-09T06:20:38.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.092+0000 7f3154ff9700 1 -- 172.21.15.158:0/2238941391 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3144005c80 con 0x7f3158152300 2023-10-09T06:20:38.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.092+0000 7f3154ff9700 1 -- 172.21.15.158:0/2238941391 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f31440123d0 con 0x7f3158152300 2023-10-09T06:20:38.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.092+0000 7f315f189700 1 -- 172.21.15.158:0/2238941391 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31580b47f0 con 0x7f3158152300 2023-10-09T06:20:38.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.095+0000 7f3154ff9700 1 -- 172.21.15.158:0/2238941391 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f31580b47f0 con 0x7f3158152300 2023-10-09T06:20:38.141 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:38.140+0000 7f56f5cf8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:20:38.141 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:38.140+0000 7fc661379180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:20:38.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.176+0000 7f315f189700 1 -- 172.21.15.158:0/2238941391 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f315804c3c0 con 0x7f3158152300 2023-10-09T06:20:38.179 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.179+0000 7f3154ff9700 1 -- 172.21.15.158:0/2238941391 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3144021060 con 0x7f3158152300 2023-10-09T06:20:38.180 INFO:teuthology.orchestra.run.smithi158.stdout:2 2023-10-09T06:20:38.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.180+0000 7f315f189700 1 -- 172.21.15.158:0/2238941391 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3158152300 msgr2=0x7f3158152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.180+0000 7f315f189700 1 --2- 172.21.15.158:0/2238941391 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3158152300 0x7f3158152980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f314400e900 tx=0x7f31440091a0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.180+0000 7f315f189700 1 -- 172.21.15.158:0/2238941391 shutdown_connections 2023-10-09T06:20:38.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.180+0000 7f315f189700 1 --2- 172.21.15.158:0/2238941391 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f315806d370 0x7f31581503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.180+0000 7f315f189700 1 --2- 172.21.15.158:0/2238941391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f315815b9a0 0x7f3158152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.180+0000 7f315f189700 1 --2- 172.21.15.158:0/2238941391 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3158152300 0x7f3158152980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.182 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.180+0000 7f315f189700 1 -- 172.21.15.158:0/2238941391 >> 172.21.15.158:0/2238941391 conn(0x7f3158069870 msgr2=0x7f31580ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:38.182 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.180+0000 7f315f189700 1 -- 172.21.15.158:0/2238941391 shutdown_connections 2023-10-09T06:20:38.182 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.180+0000 7f315f189700 1 -- 172.21.15.158:0/2238941391 wait complete. 2023-10-09T06:20:38.192 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-10-09T06:20:38.279 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:38.278+0000 7fc661379180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:20:38.279 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:38.279+0000 7f56f5cf8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:20:38.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.307+0000 7f4875437700 1 Processor -- start 2023-10-09T06:20:38.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.307+0000 7f4875437700 1 -- start start 2023-10-09T06:20:38.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.307+0000 7f4875437700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4870159e60 0x7f487015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.307+0000 7f4875437700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f487015a230 0x7f48700690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.307+0000 7f4875437700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487015ea90 con 0x7f48700695f0 2023-10-09T06:20:38.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.307+0000 7f4875437700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700d1cf0 con 0x7f487015a230 2023-10-09T06:20:38.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.307+0000 7f4875437700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4870069a90 con 0x7f4870159e60 2023-10-09T06:20:38.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.307+0000 7f486effd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4870159e60 0x7f487015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.308+0000 7f486effd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4870159e60 0x7f487015e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:39814/0 (socket says 172.21.15.158:39814) 2023-10-09T06:20:38.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.308+0000 7f486effd700 1 -- 172.21.15.158:0/2058518290 learned_addr learned my addr 172.21.15.158:0/2058518290 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-09T06:20:38.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.308+0000 7f486e7fc700 1 --2- 172.21.15.158:0/2058518290 >> v2:172.21.15.31:3300/0 conn(0x7f487015a230 0x7f48700690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.308+0000 7f486effd700 1 -- 172.21.15.158:0/2058518290 >> v2:172.21.15.31:3300/0 conn(0x7f487015a230 msgr2=0x7f48700690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:38.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.308+0000 7f486effd700 1 --2- 172.21.15.158:0/2058518290 >> v2:172.21.15.31:3300/0 conn(0x7f487015a230 0x7f48700690b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.308+0000 7f486effd700 1 -- 172.21.15.158:0/2058518290 >> v1:172.21.15.31:6789/0 conn(0x7f48700695f0 legacy=0x7f48700af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.308+0000 7f486effd700 1 -- 172.21.15.158:0/2058518290 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48700b3100 con 0x7f4870159e60 2023-10-09T06:20:38.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.308+0000 7f486effd700 1 --2- 172.21.15.158:0/2058518290 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4870159e60 0x7f487015e550 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f48640099b0 tx=0x7f4864009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6d9b9dc450e57fd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:38.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.308+0000 7f486dffb700 1 -- 172.21.15.158:0/2058518290 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864009ea0 con 0x7f4870159e60 2023-10-09T06:20:38.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.308+0000 7f486dffb700 1 -- 172.21.15.158:0/2058518290 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486400b860 con 0x7f4870159e60 2023-10-09T06:20:38.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.308+0000 7f486dffb700 1 -- 172.21.15.158:0/2058518290 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486400bc00 con 0x7f4870159e60 2023-10-09T06:20:38.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.309+0000 7f4875437700 1 -- 172.21.15.158:0/2058518290 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4870159e60 msgr2=0x7f487015e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.309+0000 7f4875437700 1 --2- 172.21.15.158:0/2058518290 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4870159e60 0x7f487015e550 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f48640099b0 tx=0x7f4864009250 comp rx=0 tx=0).stop 2023-10-09T06:20:38.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.309+0000 7f4875437700 1 -- 172.21.15.158:0/2058518290 shutdown_connections 2023-10-09T06:20:38.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.309+0000 7f4875437700 1 --2- 172.21.15.158:0/2058518290 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4870159e60 0x7f487015e550 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.309+0000 7f4875437700 1 --2- 172.21.15.158:0/2058518290 >> v2:172.21.15.31:3300/0 conn(0x7f487015a230 0x7f48700690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.309+0000 7f4875437700 1 -- 172.21.15.158:0/2058518290 >> 172.21.15.158:0/2058518290 conn(0x7f4870070700 msgr2=0x7f4870070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:38.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.309+0000 7f4875437700 1 -- 172.21.15.158:0/2058518290 shutdown_connections 2023-10-09T06:20:38.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.309+0000 7f4875437700 1 -- 172.21.15.158:0/2058518290 wait complete. 2023-10-09T06:20:38.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.310+0000 7f4875437700 1 Processor -- start 2023-10-09T06:20:38.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.310+0000 7f4875437700 1 -- start start 2023-10-09T06:20:38.317 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f4875437700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48700695f0 0x7f4870145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.317 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f4875437700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4870159e60 0x7f487016d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.317 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f4875437700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f487015a230 0x7f487016b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.318 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f4875437700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4870146040 con 0x7f487015a230 2023-10-09T06:20:38.318 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f4875437700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487016c1a0 con 0x7f4870159e60 2023-10-09T06:20:38.318 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f4875437700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487016c480 con 0x7f48700695f0 2023-10-09T06:20:38.318 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f486effd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48700695f0 0x7f4870145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.318 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f486effd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48700695f0 0x7f4870145b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:39816/0 (socket says 172.21.15.158:39816) 2023-10-09T06:20:38.318 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f486effd700 1 -- 172.21.15.158:0/2633216354 learned_addr learned my addr 172.21.15.158:0/2633216354 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-09T06:20:38.318 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f486e7fc700 1 --2- 172.21.15.158:0/2633216354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4870159e60 0x7f487016d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f486f7fe700 1 --2- 172.21.15.158:0/2633216354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f487015a230 0x7f487016b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f486effd700 1 -- 172.21.15.158:0/2633216354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4870159e60 msgr2=0x7f487016d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f486effd700 1 --2- 172.21.15.158:0/2633216354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4870159e60 0x7f487016d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f486effd700 1 -- 172.21.15.158:0/2633216354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f487015a230 msgr2=0x7f487016b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f486effd700 1 --2- 172.21.15.158:0/2633216354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f487015a230 0x7f487016b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f486effd700 1 -- 172.21.15.158:0/2633216354 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48640094f0 con 0x7f48700695f0 2023-10-09T06:20:38.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f486e7fc700 1 --2- 172.21.15.158:0/2633216354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4870159e60 0x7f487016d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:20:38.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f486effd700 1 --2- 172.21.15.158:0/2633216354 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48700695f0 0x7f4870145b00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f487015ec20 tx=0x7f4864017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:38.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f4856ffd700 1 -- 172.21.15.158:0/2633216354 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486400b9d0 con 0x7f48700695f0 2023-10-09T06:20:38.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f4856ffd700 1 -- 172.21.15.158:0/2633216354 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486400bb50 con 0x7f48700695f0 2023-10-09T06:20:38.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f4875437700 1 -- 172.21.15.158:0/2633216354 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487016c760 con 0x7f48700695f0 2023-10-09T06:20:38.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f4856ffd700 1 -- 172.21.15.158:0/2633216354 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864025670 con 0x7f48700695f0 2023-10-09T06:20:38.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.311+0000 7f4875437700 1 -- 172.21.15.158:0/2633216354 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487016cd20 con 0x7f48700695f0 2023-10-09T06:20:38.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.312+0000 7f4856ffd700 1 -- 172.21.15.158:0/2633216354 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4864023070 con 0x7f48700695f0 2023-10-09T06:20:38.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.312+0000 7f4856ffd700 1 -- 172.21.15.158:0/2633216354 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f48640118c0 con 0x7f48700695f0 2023-10-09T06:20:38.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.313+0000 7f4875437700 1 -- 172.21.15.158:0/2633216354 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487016cf40 con 0x7f48700695f0 2023-10-09T06:20:38.321 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.315+0000 7f4856ffd700 1 -- 172.21.15.158:0/2633216354 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f486402a070 con 0x7f48700695f0 2023-10-09T06:20:38.357 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:38.357+0000 7fc661379180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:20:38.358 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:38.358+0000 7f56f5cf8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:20:38.397 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.397+0000 7f4875437700 1 -- 172.21.15.158:0/2633216354 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7f487004c3c0 con 0x7f48700695f0 2023-10-09T06:20:38.400 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.400+0000 7f4856ffd700 1 -- 172.21.15.158:0/2633216354 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4864015020 con 0x7f48700695f0 2023-10-09T06:20:38.401 INFO:teuthology.orchestra.run.smithi158.stdout:3 2023-10-09T06:20:38.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.401+0000 7f4875437700 1 -- 172.21.15.158:0/2633216354 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48700695f0 msgr2=0x7f4870145b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.401+0000 7f4875437700 1 --2- 172.21.15.158:0/2633216354 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48700695f0 0x7f4870145b00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f487015ec20 tx=0x7f4864017000 comp rx=0 tx=0).stop 2023-10-09T06:20:38.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.401+0000 7f4875437700 1 -- 172.21.15.158:0/2633216354 shutdown_connections 2023-10-09T06:20:38.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.401+0000 7f4875437700 1 --2- 172.21.15.158:0/2633216354 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48700695f0 0x7f4870145b00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.401+0000 7f4875437700 1 --2- 172.21.15.158:0/2633216354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f487015a230 0x7f487016b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.401+0000 7f4875437700 1 --2- 172.21.15.158:0/2633216354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4870159e60 0x7f487016d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.401+0000 7f4875437700 1 -- 172.21.15.158:0/2633216354 >> 172.21.15.158:0/2633216354 conn(0x7f4870070700 msgr2=0x7f48700afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:38.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.401+0000 7f4875437700 1 -- 172.21.15.158:0/2633216354 shutdown_connections 2023-10-09T06:20:38.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.401+0000 7f4875437700 1 -- 172.21.15.158:0/2633216354 wait complete. 2023-10-09T06:20:38.414 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-10-09T06:20:38.530 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.529+0000 7fd1cbdd9700 1 Processor -- start 2023-10-09T06:20:38.530 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.530+0000 7fd1cbdd9700 1 -- start start 2023-10-09T06:20:38.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.530+0000 7fd1cbdd9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd1c40b4860 0x7fd1c40b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.530+0000 7fd1cbdd9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c40b14f0 con 0x7fd1c40b3570 2023-10-09T06:20:38.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.531+0000 7fd1cbdd9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c40b17d0 con 0x7fd1c40b4c30 2023-10-09T06:20:38.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.531+0000 7fd1cbdd9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c40b1ab0 con 0x7fd1c40b4860 2023-10-09T06:20:38.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.531+0000 7fd1c9b75700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd1c40b4860 0x7fd1c40b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.531+0000 7fd1c9b75700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd1c40b4860 0x7fd1c40b6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35384/0 (socket says 172.21.15.158:35384) 2023-10-09T06:20:38.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.531+0000 7fd1c9374700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fd1c40b4c30 0x7fd1c4159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:43338/0 (socket says 172.21.15.158:43338) 2023-10-09T06:20:38.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.531+0000 7fd1c9b75700 1 -- 172.21.15.158:0/1783623035 learned_addr learned my addr 172.21.15.158:0/1783623035 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-09T06:20:38.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.531+0000 7fd1c9b75700 1 -- 172.21.15.158:0/1783623035 >> v1:172.21.15.158:6789/0 conn(0x7fd1c40b4c30 legacy=0x7fd1c4159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.531+0000 7fd1c9b75700 1 -- 172.21.15.158:0/1783623035 >> v1:172.21.15.31:6789/0 conn(0x7fd1c40b3570 legacy=0x7fd1c40cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.531+0000 7fd1c9b75700 1 -- 172.21.15.158:0/1783623035 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c40b1d90 con 0x7fd1c40b4860 2023-10-09T06:20:38.533 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.531+0000 7fd1c9b75700 1 --2- 172.21.15.158:0/1783623035 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1c40b4860 0x7fd1c40b6700 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009990 tx=0x7fd1b4009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a056677a8ff04a91 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:38.533 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.531+0000 7fd1c8b73700 1 -- 172.21.15.158:0/1783623035 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4005c10 con 0x7fd1c40b4860 2023-10-09T06:20:38.533 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.531+0000 7fd1c8b73700 1 -- 172.21.15.158:0/1783623035 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b4005d70 con 0x7fd1c40b4860 2023-10-09T06:20:38.533 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.531+0000 7fd1c8b73700 1 -- 172.21.15.158:0/1783623035 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400b8f0 con 0x7fd1c40b4860 2023-10-09T06:20:38.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.532+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/1783623035 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1c40b4860 msgr2=0x7fd1c40b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.532+0000 7fd1cbdd9700 1 --2- 172.21.15.158:0/1783623035 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1c40b4860 0x7fd1c40b6700 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009990 tx=0x7fd1b4009220 comp rx=0 tx=0).stop 2023-10-09T06:20:38.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.532+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/1783623035 shutdown_connections 2023-10-09T06:20:38.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.532+0000 7fd1cbdd9700 1 --2- 172.21.15.158:0/1783623035 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1c40b4860 0x7fd1c40b6700 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.532+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/1783623035 >> 172.21.15.158:0/1783623035 conn(0x7fd1c409a0f0 msgr2=0x7fd1c4067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:38.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.532+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/1783623035 shutdown_connections 2023-10-09T06:20:38.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.532+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/1783623035 wait complete. 2023-10-09T06:20:38.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.533+0000 7fd1cbdd9700 1 Processor -- start 2023-10-09T06:20:38.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.533+0000 7fd1cbdd9700 1 -- start start 2023-10-09T06:20:38.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1cbdd9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1c40b3570 0x7fd1c4156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1cbdd9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1c40b4860 0x7fd1c409b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1cbdd9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1c40b4c30 0x7fd1c409d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1cbdd9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40ac2c0 con 0x7fd1c40b3570 2023-10-09T06:20:38.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1cbdd9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4160830 con 0x7fd1c40b4c30 2023-10-09T06:20:38.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1cbdd9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4156aa0 con 0x7fd1c40b4860 2023-10-09T06:20:38.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1ca376700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1c40b4c30 0x7fd1c409d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1c9374700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1c40b4860 0x7fd1c409b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1ca376700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1c40b4c30 0x7fd1c409d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35398/0 (socket says 172.21.15.158:35398) 2023-10-09T06:20:38.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1c9b75700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1c40b3570 0x7fd1c4156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1c9374700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1c40b4860 0x7fd1c409b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:39832/0 (socket says 172.21.15.158:39832) 2023-10-09T06:20:38.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1ca376700 1 -- 172.21.15.158:0/3184541056 learned_addr learned my addr 172.21.15.158:0/3184541056 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-09T06:20:38.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1ca376700 1 -- 172.21.15.158:0/3184541056 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1c40b4860 msgr2=0x7fd1c409b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1ca376700 1 --2- 172.21.15.158:0/3184541056 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1c40b4860 0x7fd1c409b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1ca376700 1 -- 172.21.15.158:0/3184541056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1c40b3570 msgr2=0x7fd1c4156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1ca376700 1 --2- 172.21.15.158:0/3184541056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1c40b3570 0x7fd1c4156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1ca376700 1 -- 172.21.15.158:0/3184541056 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4009480 con 0x7fd1c40b4c30 2023-10-09T06:20:38.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.534+0000 7fd1ca376700 1 --2- 172.21.15.158:0/3184541056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1c40b4c30 0x7fd1c409d7d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00c8e0 tx=0x7fd1bc001710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:38.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.535+0000 7fd1b9ffb700 1 -- 172.21.15.158:0/3184541056 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc012630 con 0x7fd1c40b4c30 2023-10-09T06:20:38.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.535+0000 7fd1b9ffb700 1 -- 172.21.15.158:0/3184541056 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc012790 con 0x7fd1c40b4c30 2023-10-09T06:20:38.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.535+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/3184541056 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c415fc20 con 0x7fd1c40b4c30 2023-10-09T06:20:38.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.535+0000 7fd1b9ffb700 1 -- 172.21.15.158:0/3184541056 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc012b50 con 0x7fd1c40b4c30 2023-10-09T06:20:38.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.535+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/3184541056 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c41601e0 con 0x7fd1c40b4c30 2023-10-09T06:20:38.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.535+0000 7fd1b9ffb700 1 -- 172.21.15.158:0/3184541056 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd1bc01b400 con 0x7fd1c40b4c30 2023-10-09T06:20:38.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.535+0000 7fd1b9ffb700 1 -- 172.21.15.158:0/3184541056 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fd1bc01a8b0 con 0x7fd1c40b4c30 2023-10-09T06:20:38.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.536+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/3184541056 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c404c3c0 con 0x7fd1c40b4c30 2023-10-09T06:20:38.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.538+0000 7fd1b9ffb700 1 -- 172.21.15.158:0/3184541056 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd1bc01b840 con 0x7fd1c40b4c30 2023-10-09T06:20:38.549 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:38.549+0000 7fc661379180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:20:38.554 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:38.553+0000 7f56f5cf8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:20:38.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.619+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/3184541056 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7fd1c40b2070 con 0x7fd1c40b4c30 2023-10-09T06:20:38.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.623+0000 7fd1b9ffb700 1 -- 172.21.15.158:0/3184541056 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd1bc01b9e0 con 0x7fd1c40b4c30 2023-10-09T06:20:38.623 INFO:teuthology.orchestra.run.smithi158.stdout:4 2023-10-09T06:20:38.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.624+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/3184541056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1c40b4c30 msgr2=0x7fd1c409d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.624+0000 7fd1cbdd9700 1 --2- 172.21.15.158:0/3184541056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1c40b4c30 0x7fd1c409d7d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00c8e0 tx=0x7fd1bc001710 comp rx=0 tx=0).stop 2023-10-09T06:20:38.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.624+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/3184541056 shutdown_connections 2023-10-09T06:20:38.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.624+0000 7fd1cbdd9700 1 --2- 172.21.15.158:0/3184541056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1c40b4c30 0x7fd1c409d7d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.624+0000 7fd1cbdd9700 1 --2- 172.21.15.158:0/3184541056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1c40b3570 0x7fd1c4156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.624+0000 7fd1cbdd9700 1 --2- 172.21.15.158:0/3184541056 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1c40b4860 0x7fd1c409b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.624+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/3184541056 >> 172.21.15.158:0/3184541056 conn(0x7fd1c409a0f0 msgr2=0x7fd1c415cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:38.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.624+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/3184541056 shutdown_connections 2023-10-09T06:20:38.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.624+0000 7fd1cbdd9700 1 -- 172.21.15.158:0/3184541056 wait complete. 2023-10-09T06:20:38.636 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-10-09T06:20:38.730 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:38.729+0000 7fc661379180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:20:38.738 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:38.738+0000 7f56f5cf8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:20:38.753 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.753+0000 7faa0afb2700 1 Processor -- start 2023-10-09T06:20:38.753 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.753+0000 7faa0afb2700 1 -- start start 2023-10-09T06:20:38.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa0afb2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa04159ec0 0x7faa040af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa0afb2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa0415a290 0x7faa040afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa0afb2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faa0406a5a0 0x7faa0406aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa0afb2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0406af60 con 0x7faa04159ec0 2023-10-09T06:20:38.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa0afb2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa040b0790 con 0x7faa0406a5a0 2023-10-09T06:20:38.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa0afb2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa040ce1f0 con 0x7faa0415a290 2023-10-09T06:20:38.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa03fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa0415a290 0x7faa040afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa0954f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faa0406a5a0 0x7faa0406aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa03fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa0415a290 0x7faa040afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:39842/0 (socket says 172.21.15.158:39842) 2023-10-09T06:20:38.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa03fff700 1 -- 172.21.15.158:0/3508544819 learned_addr learned my addr 172.21.15.158:0/3508544819 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-09T06:20:38.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa08d4e700 1 --2- 172.21.15.158:0/3508544819 >> v2:172.21.15.31:3300/0 conn(0x7faa04159ec0 0x7faa040af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa03fff700 1 -- 172.21.15.158:0/3508544819 >> v2:172.21.15.158:3300/0 conn(0x7faa0406a5a0 msgr2=0x7faa0406aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:38.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa03fff700 1 --2- 172.21.15.158:0/3508544819 >> v2:172.21.15.158:3300/0 conn(0x7faa0406a5a0 0x7faa0406aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa03fff700 1 -- 172.21.15.158:0/3508544819 >> v2:172.21.15.31:3300/0 conn(0x7faa04159ec0 msgr2=0x7faa040af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:38.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa03fff700 1 --2- 172.21.15.158:0/3508544819 >> v2:172.21.15.31:3300/0 conn(0x7faa04159ec0 0x7faa040af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa03fff700 1 -- 172.21.15.158:0/3508544819 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa040b0b20 con 0x7faa0415a290 2023-10-09T06:20:38.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa0954f700 1 --2- 172.21.15.158:0/3508544819 >> v2:172.21.15.158:3300/0 conn(0x7faa0406a5a0 0x7faa0406aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:20:38.757 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa03fff700 1 --2- 172.21.15.158:0/3508544819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa0415a290 0x7faa040afe80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faa040b03c0 tx=0x7fa9f0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a227ea694c92245 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:38.757 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.754+0000 7faa037fe700 1 -- 172.21.15.158:0/3508544819 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f000b640 con 0x7faa0415a290 2023-10-09T06:20:38.757 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.755+0000 7faa037fe700 1 -- 172.21.15.158:0/3508544819 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f000b7a0 con 0x7faa0415a290 2023-10-09T06:20:38.757 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.755+0000 7faa037fe700 1 -- 172.21.15.158:0/3508544819 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f000bb60 con 0x7faa0415a290 2023-10-09T06:20:38.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.755+0000 7faa0afb2700 1 -- 172.21.15.158:0/3508544819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa0415a290 msgr2=0x7faa040afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.755+0000 7faa0afb2700 1 --2- 172.21.15.158:0/3508544819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa0415a290 0x7faa040afe80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faa040b03c0 tx=0x7fa9f0009250 comp rx=0 tx=0).stop 2023-10-09T06:20:38.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.755+0000 7faa0afb2700 1 -- 172.21.15.158:0/3508544819 shutdown_connections 2023-10-09T06:20:38.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.755+0000 7faa0afb2700 1 --2- 172.21.15.158:0/3508544819 >> v2:172.21.15.158:3300/0 conn(0x7faa0406a5a0 0x7faa0406aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.755+0000 7faa0afb2700 1 --2- 172.21.15.158:0/3508544819 >> v2:172.21.15.31:3300/0 conn(0x7faa04159ec0 0x7faa040af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.755+0000 7faa0afb2700 1 --2- 172.21.15.158:0/3508544819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa0415a290 0x7faa040afe80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.755+0000 7faa0afb2700 1 -- 172.21.15.158:0/3508544819 >> 172.21.15.158:0/3508544819 conn(0x7faa040d1880 msgr2=0x7faa040cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:38.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.755+0000 7faa0afb2700 1 -- 172.21.15.158:0/3508544819 shutdown_connections 2023-10-09T06:20:38.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.755+0000 7faa0afb2700 1 -- 172.21.15.158:0/3508544819 wait complete. 2023-10-09T06:20:38.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.756+0000 7faa0afb2700 1 Processor -- start 2023-10-09T06:20:38.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.756+0000 7faa0afb2700 1 -- start start 2023-10-09T06:20:38.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.757+0000 7faa0afb2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa0406a5a0 0x7faa0415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.757+0000 7faa0afb2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa04159ec0 0x7faa040cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.757+0000 7faa0afb2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa0415a290 0x7faa0414dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.757+0000 7faa0afb2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa040b4110 con 0x7faa0406a5a0 2023-10-09T06:20:38.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.757+0000 7faa0afb2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0415d3b0 con 0x7faa04159ec0 2023-10-09T06:20:38.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.757+0000 7faa0afb2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0415d690 con 0x7faa0415a290 2023-10-09T06:20:38.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.757+0000 7faa03fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa04159ec0 0x7faa040cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.757+0000 7faa0954f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa0415a290 0x7faa0414dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.757+0000 7faa03fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa04159ec0 0x7faa040cf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35428/0 (socket says 172.21.15.158:35428) 2023-10-09T06:20:38.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.757+0000 7faa03fff700 1 -- 172.21.15.158:0/181571884 learned_addr learned my addr 172.21.15.158:0/181571884 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-09T06:20:38.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.757+0000 7faa08d4e700 1 --2- 172.21.15.158:0/181571884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa0406a5a0 0x7faa0415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa0954f700 1 -- 172.21.15.158:0/181571884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa04159ec0 msgr2=0x7faa040cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa0954f700 1 --2- 172.21.15.158:0/181571884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa04159ec0 0x7faa040cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa0954f700 1 -- 172.21.15.158:0/181571884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa0406a5a0 msgr2=0x7faa0415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa0954f700 1 --2- 172.21.15.158:0/181571884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa0406a5a0 0x7faa0415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa0954f700 1 -- 172.21.15.158:0/181571884 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc009a20 con 0x7faa0415a290 2023-10-09T06:20:38.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa03fff700 1 --2- 172.21.15.158:0/181571884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa04159ec0 0x7faa040cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:20:38.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa0954f700 1 --2- 172.21.15.158:0/181571884 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa0415a290 0x7faa0414dfd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009f10 tx=0x7fa9fc00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:38.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa00ff9700 1 -- 172.21.15.158:0/181571884 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc00cb70 con 0x7faa0415a290 2023-10-09T06:20:38.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa00ff9700 1 -- 172.21.15.158:0/181571884 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc00f040 con 0x7faa0415a290 2023-10-09T06:20:38.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa00ff9700 1 -- 172.21.15.158:0/181571884 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc014480 con 0x7faa0415a290 2023-10-09T06:20:38.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa0afb2700 1 -- 172.21.15.158:0/181571884 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f00094f0 con 0x7faa0415a290 2023-10-09T06:20:38.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa0afb2700 1 -- 172.21.15.158:0/181571884 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0415d0c0 con 0x7faa0415a290 2023-10-09T06:20:38.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa00ff9700 1 -- 172.21.15.158:0/181571884 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa9fc003020 con 0x7faa0415a290 2023-10-09T06:20:38.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.758+0000 7faa00ff9700 1 -- 172.21.15.158:0/181571884 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fa9fc013960 con 0x7faa0415a290 2023-10-09T06:20:38.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.759+0000 7faa0afb2700 1 -- 172.21.15.158:0/181571884 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa040b3c00 con 0x7faa0415a290 2023-10-09T06:20:38.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.761+0000 7faa00ff9700 1 -- 172.21.15.158:0/181571884 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7faa040b3c00 con 0x7faa0415a290 2023-10-09T06:20:38.810 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:38.809+0000 7fc661379180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:20:38.819 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:38.819+0000 7f56f5cf8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:20:38.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.844+0000 7faa0afb2700 1 -- 172.21.15.158:0/181571884 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7faa040b4280 con 0x7faa0415a290 2023-10-09T06:20:38.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.848+0000 7faa00ff9700 1 -- 172.21.15.158:0/181571884 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa9fc018030 con 0x7faa0415a290 2023-10-09T06:20:38.849 INFO:teuthology.orchestra.run.smithi158.stdout:5 2023-10-09T06:20:38.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.849+0000 7faa0afb2700 1 -- 172.21.15.158:0/181571884 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa0415a290 msgr2=0x7faa0414dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.849+0000 7faa0afb2700 1 --2- 172.21.15.158:0/181571884 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa0415a290 0x7faa0414dfd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009f10 tx=0x7fa9fc00b040 comp rx=0 tx=0).stop 2023-10-09T06:20:38.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.849+0000 7faa0afb2700 1 -- 172.21.15.158:0/181571884 shutdown_connections 2023-10-09T06:20:38.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.849+0000 7faa0afb2700 1 --2- 172.21.15.158:0/181571884 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa0415a290 0x7faa0414dfd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.849+0000 7faa0afb2700 1 --2- 172.21.15.158:0/181571884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa0406a5a0 0x7faa0415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.849+0000 7faa0afb2700 1 --2- 172.21.15.158:0/181571884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa04159ec0 0x7faa040cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.849+0000 7faa0afb2700 1 -- 172.21.15.158:0/181571884 >> 172.21.15.158:0/181571884 conn(0x7faa040d1880 msgr2=0x7faa040cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:38.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.849+0000 7faa0afb2700 1 -- 172.21.15.158:0/181571884 shutdown_connections 2023-10-09T06:20:38.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.849+0000 7faa0afb2700 1 -- 172.21.15.158:0/181571884 wait complete. 2023-10-09T06:20:38.863 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-10-09T06:20:38.950 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:38.950+0000 7fc661379180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:20:38.963 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:38.963+0000 7f56f5cf8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:20:38.983 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.983+0000 7ff6d359e700 1 Processor -- start 2023-10-09T06:20:38.984 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.983+0000 7ff6d359e700 1 -- start start 2023-10-09T06:20:38.986 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.984+0000 7ff6d359e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6d415a300 0x7ff6d415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.986 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.984+0000 7ff6d359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d40cc760 con 0x7ff6d415cec0 2023-10-09T06:20:38.986 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.984+0000 7ff6d359e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d415b460 con 0x7ff6d415ac10 2023-10-09T06:20:38.986 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.984+0000 7ff6d359e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d415ba20 con 0x7ff6d415a300 2023-10-09T06:20:38.986 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.984+0000 7ff6d259c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6d415a300 0x7ff6d415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.984+0000 7ff6d1d9b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7ff6d415ac10 0x7ff6d40cb430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:43350/0 (socket says 172.21.15.158:43350) 2023-10-09T06:20:38.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.984+0000 7ff6d1d9b700 1 -- 172.21.15.158:0/4230205790 learned_addr learned my addr 172.21.15.158:0/4230205790 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-09T06:20:38.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.984+0000 7ff6d159a700 1 -- 172.21.15.158:0/4230205790 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428643392 0 0) 0x7ff6d415b460 con 0x7ff6d415ac10 2023-10-09T06:20:38.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.984+0000 7ff6d159a700 1 -- 172.21.15.158:0/4230205790 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6bc003570 con 0x7ff6d415ac10 2023-10-09T06:20:38.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.984+0000 7ff6d259c700 1 -- 172.21.15.158:0/4230205790 >> v1:172.21.15.158:6789/0 conn(0x7ff6d415ac10 legacy=0x7ff6d40cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.984+0000 7ff6d259c700 1 -- 172.21.15.158:0/4230205790 >> v1:172.21.15.31:6789/0 conn(0x7ff6d415cec0 legacy=0x7ff6d41638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.984+0000 7ff6d259c700 1 -- 172.21.15.158:0/4230205790 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d40cc1a0 con 0x7ff6d415a300 2023-10-09T06:20:38.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.985+0000 7ff6d259c700 1 --2- 172.21.15.158:0/4230205790 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6d415a300 0x7ff6d415a6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009900 tx=0x7ff6c8009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dff3ac5b6da61b28 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:38.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.985+0000 7ff6d159a700 1 -- 172.21.15.158:0/4230205790 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8005c10 con 0x7ff6d415a300 2023-10-09T06:20:38.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.985+0000 7ff6d159a700 1 -- 172.21.15.158:0/4230205790 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c8005d70 con 0x7ff6d415a300 2023-10-09T06:20:38.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.985+0000 7ff6d159a700 1 -- 172.21.15.158:0/4230205790 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8006260 con 0x7ff6d415a300 2023-10-09T06:20:38.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.985+0000 7ff6d359e700 1 -- 172.21.15.158:0/4230205790 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6d415a300 msgr2=0x7ff6d415a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.985+0000 7ff6d359e700 1 --2- 172.21.15.158:0/4230205790 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6d415a300 0x7ff6d415a6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009900 tx=0x7ff6c8009120 comp rx=0 tx=0).stop 2023-10-09T06:20:38.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.985+0000 7ff6d359e700 1 -- 172.21.15.158:0/4230205790 shutdown_connections 2023-10-09T06:20:38.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.985+0000 7ff6d359e700 1 --2- 172.21.15.158:0/4230205790 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6d415a300 0x7ff6d415a6d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.985+0000 7ff6d359e700 1 -- 172.21.15.158:0/4230205790 >> 172.21.15.158:0/4230205790 conn(0x7ff6d4099f50 msgr2=0x7ff6d4067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:38.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.986+0000 7ff6d359e700 1 -- 172.21.15.158:0/4230205790 shutdown_connections 2023-10-09T06:20:38.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.986+0000 7ff6d359e700 1 -- 172.21.15.158:0/4230205790 wait complete. 2023-10-09T06:20:38.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.987+0000 7ff6d359e700 1 Processor -- start 2023-10-09T06:20:38.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.987+0000 7ff6d359e700 1 -- start start 2023-10-09T06:20:38.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.987+0000 7ff6d359e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6d415a300 0x7ff6d4169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.987+0000 7ff6d359e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6d415ac10 0x7ff6d40c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.987+0000 7ff6d359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6d415cec0 0x7ff6d40c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:38.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.987+0000 7ff6d359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40b1d70 con 0x7ff6d415cec0 2023-10-09T06:20:38.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.987+0000 7ff6d359e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40b2d20 con 0x7ff6d415ac10 2023-10-09T06:20:38.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.987+0000 7ff6d359e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40c72a0 con 0x7ff6d415a300 2023-10-09T06:20:38.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d1d9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6d415ac10 0x7ff6d40c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d259c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6d415a300 0x7ff6d4169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d259c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6d415a300 0x7ff6d4169d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.158:39880/0 (socket says 172.21.15.158:39880) 2023-10-09T06:20:38.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d259c700 1 -- 172.21.15.158:0/3896737740 learned_addr learned my addr 172.21.15.158:0/3896737740 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-09T06:20:38.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d1d9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6d415ac10 0x7ff6d40c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35438/0 (socket says 172.21.15.158:35438) 2023-10-09T06:20:38.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d2d9d700 1 --2- 172.21.15.158:0/3896737740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6d415cec0 0x7ff6d40c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:38.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d259c700 1 -- 172.21.15.158:0/3896737740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6d415ac10 msgr2=0x7ff6d40c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d259c700 1 --2- 172.21.15.158:0/3896737740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6d415ac10 0x7ff6d40c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d259c700 1 -- 172.21.15.158:0/3896737740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6d415cec0 msgr2=0x7ff6d40c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:38.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d259c700 1 --2- 172.21.15.158:0/3896737740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6d415cec0 0x7ff6d40c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:38.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d259c700 1 -- 172.21.15.158:0/3896737740 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c80093c0 con 0x7ff6d415a300 2023-10-09T06:20:38.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d2d9d700 1 --2- 172.21.15.158:0/3896737740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6d415cec0 0x7ff6d40c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:20:38.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d259c700 1 --2- 172.21.15.158:0/3896737740 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6d415a300 0x7ff6d4169d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009fa0 tx=0x7ff6c8016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:38.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6c27fc700 1 -- 172.21.15.158:0/3896737740 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c800b920 con 0x7ff6d415a300 2023-10-09T06:20:38.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6c27fc700 1 -- 172.21.15.158:0/3896737740 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c800ba80 con 0x7ff6d415a300 2023-10-09T06:20:38.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d359e700 1 -- 172.21.15.158:0/3896737740 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d40c53b0 con 0x7ff6d415a300 2023-10-09T06:20:38.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6c27fc700 1 -- 172.21.15.158:0/3896737740 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c800be20 con 0x7ff6d415a300 2023-10-09T06:20:38.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6d359e700 1 -- 172.21.15.158:0/3896737740 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d40b2010 con 0x7ff6d415a300 2023-10-09T06:20:38.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6c27fc700 1 -- 172.21.15.158:0/3896737740 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff6c801a8b0 con 0x7ff6d415a300 2023-10-09T06:20:38.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.988+0000 7ff6c27fc700 1 -- 172.21.15.158:0/3896737740 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7ff6c8026a30 con 0x7ff6d415a300 2023-10-09T06:20:38.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.989+0000 7ff6d359e700 1 -- 172.21.15.158:0/3896737740 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d406ada0 con 0x7ff6d415a300 2023-10-09T06:20:38.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:38.991+0000 7ff6c27fc700 1 -- 172.21.15.158:0/3896737740 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff6c802b060 con 0x7ff6d415a300 2023-10-09T06:20:39.049 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:39.049+0000 7fc661379180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:20:39.063 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:39.063+0000 7f56f5cf8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:20:39.074 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.074+0000 7ff6d359e700 1 -- 172.21.15.158:0/3896737740 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7ff6d40cc480 con 0x7ff6d415a300 2023-10-09T06:20:39.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.080+0000 7ff6c27fc700 1 -- 172.21.15.158:0/3896737740 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff6c801acf0 con 0x7ff6d415a300 2023-10-09T06:20:39.080 INFO:teuthology.orchestra.run.smithi158.stdout:6 2023-10-09T06:20:39.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.080+0000 7ff6d359e700 1 -- 172.21.15.158:0/3896737740 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6d415a300 msgr2=0x7ff6d4169d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:39.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.080+0000 7ff6d359e700 1 --2- 172.21.15.158:0/3896737740 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6d415a300 0x7ff6d4169d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009fa0 tx=0x7ff6c8016000 comp rx=0 tx=0).stop 2023-10-09T06:20:39.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.081+0000 7ff6d359e700 1 -- 172.21.15.158:0/3896737740 shutdown_connections 2023-10-09T06:20:39.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.081+0000 7ff6d359e700 1 --2- 172.21.15.158:0/3896737740 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6d415a300 0x7ff6d4169d60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.081+0000 7ff6d359e700 1 --2- 172.21.15.158:0/3896737740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6d415cec0 0x7ff6d40c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.081+0000 7ff6d359e700 1 --2- 172.21.15.158:0/3896737740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6d415ac10 0x7ff6d40c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.081+0000 7ff6d359e700 1 -- 172.21.15.158:0/3896737740 >> 172.21.15.158:0/3896737740 conn(0x7ff6d4099f50 msgr2=0x7ff6d40caec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:39.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.081+0000 7ff6d359e700 1 -- 172.21.15.158:0/3896737740 shutdown_connections 2023-10-09T06:20:39.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.081+0000 7ff6d359e700 1 -- 172.21.15.158:0/3896737740 wait complete. 2023-10-09T06:20:39.092 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-10-09T06:20:39.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.208+0000 7f757e062700 1 Processor -- start 2023-10-09T06:20:39.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.208+0000 7f757e062700 1 -- start start 2023-10-09T06:20:39.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f757e062700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7578159de0 0x7f75780cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f757e062700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f75780cc680 0x7f757815da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f757e062700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75780cd790 con 0x7f757815df70 2023-10-09T06:20:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f757e062700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75780ce160 con 0x7f7578159de0 2023-10-09T06:20:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f757e062700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75780cb440 con 0x7f75780cc680 2023-10-09T06:20:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f7576ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f75780cc680 0x7f757815da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f7577fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f757815df70 0x7f75780b1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:43356/0 (socket says 172.21.15.158:43356) 2023-10-09T06:20:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f7577fff700 1 -- 172.21.15.158:0/290698641 learned_addr learned my addr 172.21.15.158:0/290698641 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-09T06:20:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f75777fe700 1 --2- 172.21.15.158:0/290698641 >> v2:172.21.15.31:3300/0 conn(0x7f7578159de0 0x7f75780cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f7576ffd700 1 -- 172.21.15.158:0/290698641 >> v2:172.21.15.31:3300/0 conn(0x7f7578159de0 msgr2=0x7f75780cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f7576ffd700 1 --2- 172.21.15.158:0/290698641 >> v2:172.21.15.31:3300/0 conn(0x7f7578159de0 0x7f75780cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f7576ffd700 1 -- 172.21.15.158:0/290698641 >> v1:172.21.15.158:6789/0 conn(0x7f757815df70 legacy=0x7f75780b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:39.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f75767fc700 1 -- 172.21.15.158:0/290698641 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841008334 0 0) 0x7f75780cd790 con 0x7f757815df70 2023-10-09T06:20:39.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f7576ffd700 1 -- 172.21.15.158:0/290698641 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757815e390 con 0x7f75780cc680 2023-10-09T06:20:39.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f7576ffd700 1 --2- 172.21.15.158:0/290698641 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75780cc680 0x7f757815da30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f757806f100 tx=0x7f75680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb00371aca45dde0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:39.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f75767fc700 1 -- 172.21.15.158:0/290698641 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568011630 con 0x7f75780cc680 2023-10-09T06:20:39.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f75767fc700 1 -- 172.21.15.158:0/290698641 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7568011790 con 0x7f75780cc680 2023-10-09T06:20:39.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.209+0000 7f75767fc700 1 -- 172.21.15.158:0/290698641 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568011b30 con 0x7f75780cc680 2023-10-09T06:20:39.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.210+0000 7f757e062700 1 -- 172.21.15.158:0/290698641 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75780cc680 msgr2=0x7f757815da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:39.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.210+0000 7f757e062700 1 --2- 172.21.15.158:0/290698641 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75780cc680 0x7f757815da30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f757806f100 tx=0x7f75680091a0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.210+0000 7f757e062700 1 -- 172.21.15.158:0/290698641 shutdown_connections 2023-10-09T06:20:39.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.210+0000 7f757e062700 1 --2- 172.21.15.158:0/290698641 >> v2:172.21.15.31:3300/0 conn(0x7f7578159de0 0x7f75780cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.210+0000 7f757e062700 1 --2- 172.21.15.158:0/290698641 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75780cc680 0x7f757815da30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.210+0000 7f757e062700 1 -- 172.21.15.158:0/290698641 >> 172.21.15.158:0/290698641 conn(0x7f75780cb5c0 msgr2=0x7f75780cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:39.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.210+0000 7f757e062700 1 -- 172.21.15.158:0/290698641 shutdown_connections 2023-10-09T06:20:39.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.210+0000 7f757e062700 1 -- 172.21.15.158:0/290698641 wait complete. 2023-10-09T06:20:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.211+0000 7f757e062700 1 Processor -- start 2023-10-09T06:20:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.211+0000 7f757e062700 1 -- start start 2023-10-09T06:20:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f757e062700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75780cc680 0x7f757815c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f757e062700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7578159de0 0x7f75780c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f757e062700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f757815df70 0x7f75780ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f757e062700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757816b4a0 con 0x7f75780cc680 2023-10-09T06:20:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f757e062700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757816b780 con 0x7f7578159de0 2023-10-09T06:20:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f757e062700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757816ba60 con 0x7f757815df70 2023-10-09T06:20:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f7576ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7578159de0 0x7f75780c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f7577fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f757815df70 0x7f75780ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f7576ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7578159de0 0x7f75780c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35460/0 (socket says 172.21.15.158:35460) 2023-10-09T06:20:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f7576ffd700 1 -- 172.21.15.158:0/3733207214 learned_addr learned my addr 172.21.15.158:0/3733207214 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-09T06:20:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f75777fe700 1 --2- 172.21.15.158:0/3733207214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75780cc680 0x7f757815c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f7576ffd700 1 -- 172.21.15.158:0/3733207214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f757815df70 msgr2=0x7f75780ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f7576ffd700 1 --2- 172.21.15.158:0/3733207214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f757815df70 0x7f75780ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f7576ffd700 1 -- 172.21.15.158:0/3733207214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75780cc680 msgr2=0x7f757815c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f7576ffd700 1 --2- 172.21.15.158:0/3733207214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75780cc680 0x7f757815c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f7576ffd700 1 -- 172.21.15.158:0/3733207214 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7568009420 con 0x7f7578159de0 2023-10-09T06:20:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.212+0000 7f7576ffd700 1 --2- 172.21.15.158:0/3733207214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7578159de0 0x7f75780c7670 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7568013000 tx=0x7f7568017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.213+0000 7f755f7fe700 1 -- 172.21.15.158:0/3733207214 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568000d10 con 0x7f7578159de0 2023-10-09T06:20:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.213+0000 7f755f7fe700 1 -- 172.21.15.158:0/3733207214 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7568011900 con 0x7f7578159de0 2023-10-09T06:20:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.213+0000 7f755f7fe700 1 -- 172.21.15.158:0/3733207214 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568025420 con 0x7f7578159de0 2023-10-09T06:20:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.213+0000 7f757e062700 1 -- 172.21.15.158:0/3733207214 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757816bd40 con 0x7f7578159de0 2023-10-09T06:20:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.213+0000 7f757e062700 1 -- 172.21.15.158:0/3733207214 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757816c300 con 0x7f7578159de0 2023-10-09T06:20:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.213+0000 7f755f7fe700 1 -- 172.21.15.158:0/3733207214 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7568023070 con 0x7f7578159de0 2023-10-09T06:20:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.213+0000 7f755f7fe700 1 -- 172.21.15.158:0/3733207214 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f7568019a20 con 0x7f7578159de0 2023-10-09T06:20:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.214+0000 7f757e062700 1 -- 172.21.15.158:0/3733207214 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757816c4f0 con 0x7f7578159de0 2023-10-09T06:20:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.216+0000 7f755f7fe700 1 -- 172.21.15.158:0/3733207214 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f756802a070 con 0x7f7578159de0 2023-10-09T06:20:39.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.303+0000 7f757e062700 1 -- 172.21.15.158:0/3733207214 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f757804c3c0 con 0x7f7578159de0 2023-10-09T06:20:39.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.309+0000 7f755f7fe700 1 -- 172.21.15.158:0/3733207214 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7568015020 con 0x7f7578159de0 2023-10-09T06:20:39.309 INFO:teuthology.orchestra.run.smithi158.stdout:7 2023-10-09T06:20:39.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.310+0000 7f757e062700 1 -- 172.21.15.158:0/3733207214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7578159de0 msgr2=0x7f75780c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:39.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.310+0000 7f757e062700 1 --2- 172.21.15.158:0/3733207214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7578159de0 0x7f75780c7670 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7568013000 tx=0x7f7568017000 comp rx=0 tx=0).stop 2023-10-09T06:20:39.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.310+0000 7f757e062700 1 -- 172.21.15.158:0/3733207214 shutdown_connections 2023-10-09T06:20:39.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.310+0000 7f757e062700 1 --2- 172.21.15.158:0/3733207214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f757815df70 0x7f75780ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.310+0000 7f757e062700 1 --2- 172.21.15.158:0/3733207214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75780cc680 0x7f757815c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.310+0000 7f757e062700 1 --2- 172.21.15.158:0/3733207214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7578159de0 0x7f75780c7670 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.310+0000 7f757e062700 1 -- 172.21.15.158:0/3733207214 >> 172.21.15.158:0/3733207214 conn(0x7f75780cb5c0 msgr2=0x7f7578159040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:39.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.310+0000 7f757e062700 1 -- 172.21.15.158:0/3733207214 shutdown_connections 2023-10-09T06:20:39.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-09T06:20:39.310+0000 7f757e062700 1 -- 172.21.15.158:0/3733207214 wait complete. 2023-10-09T06:20:39.322 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-09T06:20:39.322 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-09T06:20:39.324 INFO:tasks.ceph.osd.0:Started 2023-10-09T06:20:39.324 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-09T06:20:39.325 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-09T06:20:39.326 INFO:tasks.ceph.osd.1:Started 2023-10-09T06:20:39.326 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-09T06:20:39.327 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-09T06:20:39.328 INFO:tasks.ceph.osd.2:Started 2023-10-09T06:20:39.329 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-09T06:20:39.329 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-09T06:20:39.331 INFO:tasks.ceph.osd.3:Started 2023-10-09T06:20:39.331 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-09T06:20:39.331 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-09T06:20:39.333 INFO:tasks.ceph.osd.4:Started 2023-10-09T06:20:39.333 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-09T06:20:39.333 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-09T06:20:39.335 INFO:tasks.ceph.osd.5:Started 2023-10-09T06:20:39.335 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-09T06:20:39.335 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-09T06:20:39.337 INFO:tasks.ceph.osd.6:Started 2023-10-09T06:20:39.337 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-09T06:20:39.338 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-09T06:20:39.339 INFO:tasks.ceph.osd.7:Started 2023-10-09T06:20:39.340 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:20:39.406 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-10-09T06:20:39.405+0000 7ff1e6670540 -1 Falling back to public interface 2023-10-09T06:20:39.414 INFO:tasks.ceph.osd.5.smithi158.stderr:2023-10-09T06:20:39.413+0000 7f9f22d34540 -1 Falling back to public interface 2023-10-09T06:20:39.414 INFO:tasks.ceph.osd.6.smithi158.stderr:2023-10-09T06:20:39.413+0000 7f04e9ddc540 -1 Falling back to public interface 2023-10-09T06:20:39.414 INFO:tasks.ceph.osd.5.smithi158.stderr:2023-10-09T06:20:39.413+0000 7f9f1d15d700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-10-09T06:20:39.415 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-10-09T06:20:39.413+0000 7fea7af10540 -1 Falling back to public interface 2023-10-09T06:20:39.420 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-10-09T06:20:39.420+0000 7ff1e6670540 -1 osd.0 0 log_to_monitors true 2023-10-09T06:20:39.429 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-10-09T06:20:39.428+0000 7fa8821f7540 -1 Falling back to public interface 2023-10-09T06:20:39.429 INFO:tasks.ceph.osd.5.smithi158.stderr:2023-10-09T06:20:39.429+0000 7f9f22d34540 -1 osd.5 0 log_to_monitors true 2023-10-09T06:20:39.430 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-10-09T06:20:39.429+0000 7f703944a540 -1 Falling back to public interface 2023-10-09T06:20:39.430 INFO:tasks.ceph.osd.6.smithi158.stderr:2023-10-09T06:20:39.430+0000 7f04e9ddc540 -1 osd.6 0 log_to_monitors true 2023-10-09T06:20:39.432 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-10-09T06:20:39.432+0000 7fea7af10540 -1 osd.3 0 log_to_monitors true 2023-10-09T06:20:39.436 INFO:tasks.ceph.osd.4.smithi158.stderr:2023-10-09T06:20:39.436+0000 7fd4b1077540 -1 Falling back to public interface 2023-10-09T06:20:39.442 INFO:tasks.ceph.osd.7.smithi158.stderr:2023-10-09T06:20:39.441+0000 7efe9fdd5540 -1 Falling back to public interface 2023-10-09T06:20:39.444 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-10-09T06:20:39.444+0000 7fa8821f7540 -1 osd.1 0 log_to_monitors true 2023-10-09T06:20:39.446 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-10-09T06:20:39.445+0000 7f703944a540 -1 osd.2 0 log_to_monitors true 2023-10-09T06:20:39.449 INFO:tasks.ceph.osd.4.smithi158.stderr:2023-10-09T06:20:39.449+0000 7fd4b1077540 -1 osd.4 0 log_to_monitors true 2023-10-09T06:20:39.457 INFO:tasks.ceph.osd.7.smithi158.stderr:2023-10-09T06:20:39.457+0000 7efe9fdd5540 -1 osd.7 0 log_to_monitors true 2023-10-09T06:20:39.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.479+0000 7f210174e700 1 Processor -- start 2023-10-09T06:20:39.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.479+0000 7f210174e700 1 -- start start 2023-10-09T06:20:39.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.480+0000 7f210174e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20fc0a7df0 0x7f20fc0b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:39.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.480+0000 7f210174e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f20fc1572a0 0x7f20fc157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:39.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.480+0000 7f210174e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20fc0ae760 con 0x7f20fc0a7a20 2023-10-09T06:20:39.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.480+0000 7f210174e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20fc0aea40 con 0x7f20fc1572a0 2023-10-09T06:20:39.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.480+0000 7f210174e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0aed20 con 0x7f20fc0a7df0 2023-10-09T06:20:39.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.480+0000 7f20fb7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f20fc1572a0 0x7f20fc157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:39.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.480+0000 7f20faffd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f20fc0a7a20 0x7f20fc0af520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:51500/0 (socket says 172.21.15.31:51500) 2023-10-09T06:20:39.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.480+0000 7f20faffd700 1 -- 172.21.15.31:0/1215416440 learned_addr learned my addr 172.21.15.31:0/1215416440 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.480+0000 7f20fa7fc700 1 --2- 172.21.15.31:0/1215416440 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20fc0a7df0 0x7f20fc0b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.481+0000 7f20fb7fe700 1 -- 172.21.15.31:0/1215416440 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20fc0a7df0 msgr2=0x7f20fc0b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.481+0000 7f20fb7fe700 1 --2- 172.21.15.31:0/1215416440 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20fc0a7df0 0x7f20fc0b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.481+0000 7f20f9ffb700 1 -- 172.21.15.31:0/1215416440 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746785475 0 0) 0x7f20fc0ae760 con 0x7f20fc0a7a20 2023-10-09T06:20:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.481+0000 7f20fb7fe700 1 -- 172.21.15.31:0/1215416440 >> v1:172.21.15.158:6789/0 conn(0x7f20fc0a7a20 legacy=0x7f20fc0af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.481+0000 7f20fb7fe700 1 -- 172.21.15.31:0/1215416440 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc0af000 con 0x7f20fc1572a0 2023-10-09T06:20:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.481+0000 7f20fb7fe700 1 --2- 172.21.15.31:0/1215416440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc1572a0 0x7f20fc157740 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20f40098e0 tx=0x7f20f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3487f51cc1f3d54 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.481+0000 7f20f9ffb700 1 -- 172.21.15.31:0/1215416440 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f400b6d0 con 0x7f20fc1572a0 2023-10-09T06:20:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.481+0000 7f20f9ffb700 1 -- 172.21.15.31:0/1215416440 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f400b830 con 0x7f20fc1572a0 2023-10-09T06:20:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.481+0000 7f20f9ffb700 1 -- 172.21.15.31:0/1215416440 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f400bbd0 con 0x7f20fc1572a0 2023-10-09T06:20:39.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.482+0000 7f210174e700 1 -- 172.21.15.31:0/1215416440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc1572a0 msgr2=0x7f20fc157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:39.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.482+0000 7f210174e700 1 --2- 172.21.15.31:0/1215416440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc1572a0 0x7f20fc157740 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20f40098e0 tx=0x7f20f40091a0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.482+0000 7f210174e700 1 -- 172.21.15.31:0/1215416440 shutdown_connections 2023-10-09T06:20:39.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.482+0000 7f210174e700 1 --2- 172.21.15.31:0/1215416440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc1572a0 0x7f20fc157740 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.482+0000 7f210174e700 1 --2- 172.21.15.31:0/1215416440 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20fc0a7df0 0x7f20fc0b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.482+0000 7f210174e700 1 -- 172.21.15.31:0/1215416440 >> 172.21.15.31:0/1215416440 conn(0x7f20fc0cd1e0 msgr2=0x7f20fc0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:39.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.482+0000 7f210174e700 1 -- 172.21.15.31:0/1215416440 shutdown_connections 2023-10-09T06:20:39.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.482+0000 7f210174e700 1 -- 172.21.15.31:0/1215416440 wait complete. 2023-10-09T06:20:39.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.483+0000 7f210174e700 1 Processor -- start 2023-10-09T06:20:39.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.483+0000 7f210174e700 1 -- start start 2023-10-09T06:20:39.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f210174e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20fc0a7a20 0x7f20fc1447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:39.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f210174e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc0a7df0 0x7f20fc1495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:39.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f210174e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20fc1572a0 0x7f20fc1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:39.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f210174e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0986b0 con 0x7f20fc0a7df0 2023-10-09T06:20:39.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f210174e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc149b30 con 0x7f20fc0a7a20 2023-10-09T06:20:39.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f210174e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc097aa0 con 0x7f20fc1572a0 2023-10-09T06:20:39.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20fa7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc0a7df0 0x7f20fc1495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:39.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20fa7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc0a7df0 0x7f20fc1495f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43946/0 (socket says 172.21.15.31:43946) 2023-10-09T06:20:39.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20fa7fc700 1 -- 172.21.15.31:0/253745471 learned_addr learned my addr 172.21.15.31:0/253745471 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:39.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20faffd700 1 --2- 172.21.15.31:0/253745471 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20fc0a7a20 0x7f20fc1447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:39.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20fb7fe700 1 --2- 172.21.15.31:0/253745471 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20fc1572a0 0x7f20fc1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:39.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20fa7fc700 1 -- 172.21.15.31:0/253745471 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20fc1572a0 msgr2=0x7f20fc1510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:39.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20fa7fc700 1 --2- 172.21.15.31:0/253745471 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20fc1572a0 0x7f20fc1510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20fa7fc700 1 -- 172.21.15.31:0/253745471 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20fc0a7a20 msgr2=0x7f20fc1447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:39.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20fa7fc700 1 --2- 172.21.15.31:0/253745471 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20fc0a7a20 0x7f20fc1447b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20fa7fc700 1 -- 172.21.15.31:0/253745471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f4009420 con 0x7f20fc0a7df0 2023-10-09T06:20:39.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20faffd700 1 --2- 172.21.15.31:0/253745471 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20fc0a7a20 0x7f20fc1447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:20:39.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20fa7fc700 1 --2- 172.21.15.31:0/253745471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc0a7df0 0x7f20fc1495f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f20e400ec80 tx=0x7f20e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:39.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20f2ffd700 1 -- 172.21.15.31:0/253745471 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e400c850 con 0x7f20fc0a7df0 2023-10-09T06:20:39.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f20f2ffd700 1 -- 172.21.15.31:0/253745471 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e400c9b0 con 0x7f20fc0a7df0 2023-10-09T06:20:39.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.484+0000 7f210174e700 1 -- 172.21.15.31:0/253745471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20fc097d80 con 0x7f20fc0a7df0 2023-10-09T06:20:39.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.485+0000 7f20f2ffd700 1 -- 172.21.15.31:0/253745471 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e400cd50 con 0x7f20fc0a7df0 2023-10-09T06:20:39.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.485+0000 7f210174e700 1 -- 172.21.15.31:0/253745471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20fc098340 con 0x7f20fc0a7df0 2023-10-09T06:20:39.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.485+0000 7f20f2ffd700 1 -- 172.21.15.31:0/253745471 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f20e4005c80 con 0x7f20fc0a7df0 2023-10-09T06:20:39.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.485+0000 7f20f2ffd700 1 -- 172.21.15.31:0/253745471 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f20e4006700 con 0x7f20fc0a7df0 2023-10-09T06:20:39.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.486+0000 7f210174e700 1 -- 172.21.15.31:0/253745471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20fc098860 con 0x7f20fc0a7df0 2023-10-09T06:20:39.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.488+0000 7f20f2ffd700 1 -- 172.21.15.31:0/253745471 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f20fc098860 con 0x7f20fc0a7df0 2023-10-09T06:20:39.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.557+0000 7f210174e700 1 -- 172.21.15.31:0/253745471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20fc04c3c0 con 0x7f20fc0a7df0 2023-10-09T06:20:39.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.558+0000 7f20f2ffd700 1 -- 172.21.15.31:0/253745471 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f20e4021060 con 0x7f20fc0a7df0 2023-10-09T06:20:39.559 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:39.559 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:39.305553+0000","last_up_change":"0.000000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:20:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.559+0000 7f210174e700 1 -- 172.21.15.31:0/253745471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc0a7df0 msgr2=0x7f20fc1495f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.559+0000 7f210174e700 1 --2- 172.21.15.31:0/253745471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc0a7df0 0x7f20fc1495f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f20e400ec80 tx=0x7f20e40091a0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.559+0000 7f210174e700 1 -- 172.21.15.31:0/253745471 shutdown_connections 2023-10-09T06:20:39.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.559+0000 7f210174e700 1 --2- 172.21.15.31:0/253745471 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20fc1572a0 0x7f20fc1510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.559+0000 7f210174e700 1 --2- 172.21.15.31:0/253745471 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20fc0a7a20 0x7f20fc1447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.559+0000 7f210174e700 1 --2- 172.21.15.31:0/253745471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc0a7df0 0x7f20fc1495f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:39.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.559+0000 7f210174e700 1 -- 172.21.15.31:0/253745471 >> 172.21.15.31:0/253745471 conn(0x7f20fc0cd1e0 msgr2=0x7f20fc06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:39.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.559+0000 7f210174e700 1 -- 172.21.15.31:0/253745471 shutdown_connections 2023-10-09T06:20:39.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:39.559+0000 7f210174e700 1 -- 172.21.15.31:0/253745471 wait complete. 2023-10-09T06:20:39.572 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-09T06:20:39.572 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-09T06:20:39.615 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:39.615+0000 7f56f5cf8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:20:39.692 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:39.691+0000 7f56f5cf8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:20:39.769 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:39.769+0000 7f56f5cf8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:20:39.824 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:39.823+0000 7fc661379180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:20:39.904 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:39.904+0000 7fc661379180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:20:39.985 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:39.985+0000 7fc661379180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:20:40.355 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:40.354+0000 7f56f5cf8180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:20:40.378 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T06:20:40.493 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:40.493+0000 7f56f5cf8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:20:40.530 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.529+0000 7fb1834c7700 1 Processor -- start 2023-10-09T06:20:40.530 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.529+0000 7fb1834c7700 1 -- start start 2023-10-09T06:20:40.533 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.530+0000 7fb1834c7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb17c0af1e0 0x7fb17c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:40.533 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.530+0000 7fb1834c7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb17c0af5b0 0x7fb17c0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:40.533 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.530+0000 7fb1834c7700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c0b2890 con 0x7fb17c06f470 2023-10-09T06:20:40.533 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.530+0000 7fb1834c7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c0b1c80 con 0x7fb17c0af5b0 2023-10-09T06:20:40.533 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.530+0000 7fb1834c7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c0b1f60 con 0x7fb17c0af1e0 2023-10-09T06:20:40.533 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.530+0000 7fb180a62700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb17c0af5b0 0x7fb17c0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:40.533 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.530+0000 7fb180a62700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb17c0af5b0 0x7fb17c0b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47170/0 (socket says 172.21.15.31:47170) 2023-10-09T06:20:40.534 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.530+0000 7fb180a62700 1 -- 172.21.15.31:0/610121962 learned_addr learned my addr 172.21.15.31:0/610121962 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:40.534 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.530+0000 7fb181263700 1 --2- 172.21.15.31:0/610121962 >> v2:172.21.15.158:3300/0 conn(0x7fb17c0af1e0 0x7fb17c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:40.534 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.531+0000 7fb180a62700 1 -- 172.21.15.31:0/610121962 >> v2:172.21.15.158:3300/0 conn(0x7fb17c0af1e0 msgr2=0x7fb17c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:40.534 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.531+0000 7fb180a62700 1 --2- 172.21.15.31:0/610121962 >> v2:172.21.15.158:3300/0 conn(0x7fb17c0af1e0 0x7fb17c0b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:40.534 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.531+0000 7fb180a62700 1 -- 172.21.15.31:0/610121962 >> v1:172.21.15.158:6789/0 conn(0x7fb17c06f470 legacy=0x7fb17c159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:40.534 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.531+0000 7fb180a62700 1 -- 172.21.15.31:0/610121962 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0b2240 con 0x7fb17c0af5b0 2023-10-09T06:20:40.534 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.531+0000 7fb180a62700 1 --2- 172.21.15.31:0/610121962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17c0af5b0 0x7fb17c0b1680 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0afca0 tx=0x7fb170009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f194d6de7efdc1c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:40.534 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.531+0000 7fb17bfff700 1 -- 172.21.15.31:0/610121962 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170009e70 con 0x7fb17c0af5b0 2023-10-09T06:20:40.534 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.531+0000 7fb17bfff700 1 -- 172.21.15.31:0/610121962 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17000b860 con 0x7fb17c0af5b0 2023-10-09T06:20:40.534 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.531+0000 7fb17bfff700 1 -- 172.21.15.31:0/610121962 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17000bc00 con 0x7fb17c0af5b0 2023-10-09T06:20:40.534 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.532+0000 7fb1834c7700 1 -- 172.21.15.31:0/610121962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17c0af5b0 msgr2=0x7fb17c0b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:40.534 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.532+0000 7fb1834c7700 1 --2- 172.21.15.31:0/610121962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17c0af5b0 0x7fb17c0b1680 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0afca0 tx=0x7fb170009250 comp rx=0 tx=0).stop 2023-10-09T06:20:40.535 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.532+0000 7fb1834c7700 1 -- 172.21.15.31:0/610121962 shutdown_connections 2023-10-09T06:20:40.535 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.532+0000 7fb1834c7700 1 --2- 172.21.15.31:0/610121962 >> v2:172.21.15.158:3300/0 conn(0x7fb17c0af1e0 0x7fb17c0b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:40.535 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.532+0000 7fb1834c7700 1 --2- 172.21.15.31:0/610121962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17c0af5b0 0x7fb17c0b1680 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:40.535 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.532+0000 7fb1834c7700 1 -- 172.21.15.31:0/610121962 >> 172.21.15.31:0/610121962 conn(0x7fb17c0cd1e0 msgr2=0x7fb17c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:40.535 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.532+0000 7fb1834c7700 1 -- 172.21.15.31:0/610121962 shutdown_connections 2023-10-09T06:20:40.535 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.532+0000 7fb1834c7700 1 -- 172.21.15.31:0/610121962 wait complete. 2023-10-09T06:20:40.537 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.533+0000 7fb1834c7700 1 Processor -- start 2023-10-09T06:20:40.537 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.533+0000 7fb1834c7700 1 -- start start 2023-10-09T06:20:40.537 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb1834c7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb17c06f470 0x7fb17c16a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:40.537 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb1834c7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb17c0af1e0 0x7fb17c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:40.537 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb1834c7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17c0af5b0 0x7fb17c16d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:40.538 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb1834c7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c098280 con 0x7fb17c0af5b0 2023-10-09T06:20:40.538 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb1834c7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c097c70 con 0x7fb17c06f470 2023-10-09T06:20:40.538 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb1834c7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c15cbe0 con 0x7fb17c0af1e0 2023-10-09T06:20:40.538 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb181a64700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17c0af5b0 0x7fb17c16d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:40.538 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb181263700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb17c06f470 0x7fb17c16a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:40.538 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb181a64700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17c0af5b0 0x7fb17c16d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47180/0 (socket says 172.21.15.31:47180) 2023-10-09T06:20:40.538 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb181263700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb17c06f470 0x7fb17c16a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:43406/0 (socket says 172.21.15.31:43406) 2023-10-09T06:20:40.538 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb181263700 1 -- 172.21.15.31:0/3024644503 learned_addr learned my addr 172.21.15.31:0/3024644503 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:40.538 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb180a62700 1 --2- 172.21.15.31:0/3024644503 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb17c0af1e0 0x7fb17c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:40.538 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb181263700 1 -- 172.21.15.31:0/3024644503 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb17c0af1e0 msgr2=0x7fb17c15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:40.539 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb181263700 1 --2- 172.21.15.31:0/3024644503 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb17c0af1e0 0x7fb17c15c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:40.539 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb181263700 1 -- 172.21.15.31:0/3024644503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17c0af5b0 msgr2=0x7fb17c16d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:40.539 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb181263700 1 --2- 172.21.15.31:0/3024644503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17c0af5b0 0x7fb17c16d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:40.539 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb181263700 1 -- 172.21.15.31:0/3024644503 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700094f0 con 0x7fb17c06f470 2023-10-09T06:20:40.539 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.534+0000 7fb181a64700 1 --2- 172.21.15.31:0/3024644503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17c0af5b0 0x7fb17c16d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:20:40.539 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.535+0000 7fb181263700 1 --2- 172.21.15.31:0/3024644503 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb17c06f470 0x7fb17c16a350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009ef0 tx=0x7fb16c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:40.539 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.535+0000 7fb1797fa700 1 -- 172.21.15.31:0/3024644503 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c00cb70 con 0x7fb17c06f470 2023-10-09T06:20:40.539 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.535+0000 7fb1797fa700 1 -- 172.21.15.31:0/3024644503 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c00f040 con 0x7fb17c06f470 2023-10-09T06:20:40.539 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.535+0000 7fb1834c7700 1 -- 172.21.15.31:0/3024644503 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c15c900 con 0x7fb17c06f470 2023-10-09T06:20:40.539 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.535+0000 7fb1797fa700 1 -- 172.21.15.31:0/3024644503 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c014480 con 0x7fb17c06f470 2023-10-09T06:20:40.539 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.535+0000 7fb1834c7700 1 -- 172.21.15.31:0/3024644503 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c15c5c0 con 0x7fb17c06f470 2023-10-09T06:20:40.540 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.535+0000 7fb1797fa700 1 -- 172.21.15.31:0/3024644503 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb16c0147f0 con 0x7fb17c06f470 2023-10-09T06:20:40.540 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.535+0000 7fb1797fa700 1 -- 172.21.15.31:0/3024644503 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1879+0+0 (secure 0 0 0) 0x7fb16c013bb0 con 0x7fb17c06f470 2023-10-09T06:20:40.540 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.536+0000 7fb1834c7700 1 -- 172.21.15.31:0/3024644503 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c097ad0 con 0x7fb17c06f470 2023-10-09T06:20:40.540 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.538+0000 7fb1797fa700 1 -- 172.21.15.31:0/3024644503 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb17c097ad0 con 0x7fb17c06f470 2023-10-09T06:20:40.588 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:40.588+0000 7f56f5cf8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:20:40.608 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.608+0000 7fb1834c7700 1 -- 172.21.15.31:0/3024644503 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb17c0b0a00 con 0x7fb17c06f470 2023-10-09T06:20:40.609 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.608+0000 7fb1797fa700 1 -- 172.21.15.31:0/3024644503 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fb16c018020 con 0x7fb17c06f470 2023-10-09T06:20:40.609 INFO:teuthology.misc.health.smithi031.stdout: 2023-10-09T06:20:40.609 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":11,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:40.308824+0000","last_up_change":"0.000000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:20:40.610 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.609+0000 7fb1834c7700 1 -- 172.21.15.31:0/3024644503 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb17c06f470 msgr2=0x7fb17c16a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:40.610 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.609+0000 7fb1834c7700 1 --2- 172.21.15.31:0/3024644503 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb17c06f470 0x7fb17c16a350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009ef0 tx=0x7fb16c00b040 comp rx=0 tx=0).stop 2023-10-09T06:20:40.610 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.609+0000 7fb1834c7700 1 -- 172.21.15.31:0/3024644503 shutdown_connections 2023-10-09T06:20:40.610 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.609+0000 7fb1834c7700 1 --2- 172.21.15.31:0/3024644503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17c0af5b0 0x7fb17c16d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:40.610 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.609+0000 7fb1834c7700 1 --2- 172.21.15.31:0/3024644503 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb17c06f470 0x7fb17c16a350 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:40.611 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.609+0000 7fb1834c7700 1 --2- 172.21.15.31:0/3024644503 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb17c0af1e0 0x7fb17c15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:40.611 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.609+0000 7fb1834c7700 1 -- 172.21.15.31:0/3024644503 >> 172.21.15.31:0/3024644503 conn(0x7fb17c0cd1e0 msgr2=0x7fb17c154b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:40.611 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.609+0000 7fb1834c7700 1 -- 172.21.15.31:0/3024644503 shutdown_connections 2023-10-09T06:20:40.611 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:40.609+0000 7fb1834c7700 1 -- 172.21.15.31:0/3024644503 wait complete. 2023-10-09T06:20:40.621 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-09T06:20:40.624 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:40.623+0000 7fc661379180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:20:40.767 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:40.766+0000 7fc661379180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:20:40.836 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:40.836+0000 7f56f5cf8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:20:40.859 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:40.858+0000 7fc661379180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:20:40.912 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:40.912+0000 7f56f5cf8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:20:41.116 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:41.116+0000 7fc661379180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:20:41.196 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:41.196+0000 7fc661379180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:20:41.328 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-10-09T06:20:41.327+0000 7fea72333700 -1 osd.3 0 waiting for initial osdmap 2023-10-09T06:20:41.328 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-10-09T06:20:41.328+0000 7ff1dda93700 -1 osd.0 0 waiting for initial osdmap 2023-10-09T06:20:41.329 INFO:tasks.ceph.osd.4.smithi158.stderr:2023-10-09T06:20:41.328+0000 7fd4a849a700 -1 osd.4 0 waiting for initial osdmap 2023-10-09T06:20:41.329 INFO:tasks.ceph.osd.5.smithi158.stderr:2023-10-09T06:20:41.328+0000 7f9f1a157700 -1 osd.5 0 waiting for initial osdmap 2023-10-09T06:20:41.329 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-10-09T06:20:41.329+0000 7fea6c12c700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:20:41.330 INFO:tasks.ceph.osd.4.smithi158.stderr:2023-10-09T06:20:41.330+0000 7fd4a2293700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:20:41.330 INFO:tasks.ceph.osd.5.smithi158.stderr:2023-10-09T06:20:41.330+0000 7f9f13f50700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:20:41.331 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-10-09T06:20:41.330+0000 7ff1d788c700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:20:41.336 INFO:tasks.ceph.osd.6.smithi158.stderr:2023-10-09T06:20:41.336+0000 7f04e11ff700 -1 osd.6 0 waiting for initial osdmap 2023-10-09T06:20:41.337 INFO:tasks.ceph.osd.7.smithi158.stderr:2023-10-09T06:20:41.337+0000 7efe971f8700 -1 osd.7 0 waiting for initial osdmap 2023-10-09T06:20:41.337 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-10-09T06:20:41.337+0000 7fa879e1b700 -1 osd.1 0 waiting for initial osdmap 2023-10-09T06:20:41.337 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-10-09T06:20:41.337+0000 7f703086d700 -1 osd.2 0 waiting for initial osdmap 2023-10-09T06:20:41.338 INFO:tasks.ceph.osd.6.smithi158.stderr:2023-10-09T06:20:41.338+0000 7f04daff8700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:20:41.338 INFO:tasks.ceph.osd.7.smithi158.stderr:2023-10-09T06:20:41.338+0000 7efe90ff1700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:20:41.339 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-10-09T06:20:41.338+0000 7f702a666700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:20:41.339 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-10-09T06:20:41.338+0000 7fa873413700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:20:41.739 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:41.739+0000 7f56f5cf8180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:20:41.813 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:41.812+0000 7f56f5cf8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:20:41.886 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:41.886+0000 7f56f5cf8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:20:42.018 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:42.018+0000 7f56f5cf8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:20:42.056 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:42.055+0000 7fc661379180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:20:42.105 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:42.102+0000 7f56f5cf8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:20:42.132 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:42.131+0000 7fc661379180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:20:42.211 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:42.209+0000 7fc661379180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:20:42.254 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:42.253+0000 7f56f5cf8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:20:42.334 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:42.334+0000 7f56f5cf8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:20:42.354 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:42.353+0000 7fc661379180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:20:42.413 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:42.412+0000 7f56f5cf8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:20:42.443 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:42.442+0000 7fc661379180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:20:42.501 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:42.489+0000 7f56f5cf8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:20:42.606 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:42.604+0000 7fc661379180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:20:42.684 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:42.683+0000 7fc661379180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:20:42.762 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:42.761+0000 7fc661379180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:20:42.839 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-10-09T06:20:42.838+0000 7fc661379180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:20:43.518 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:43.518+0000 7f56af0f9700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-09T06:20:43.518 INFO:tasks.ceph.mgr.x.smithi158.stderr:2023-10-09T06:20:43.518+0000 7f56af0f9700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-09T06:20:47.427 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T06:20:47.548 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.547+0000 7fb9eadd9700 1 Processor -- start 2023-10-09T06:20:47.548 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.547+0000 7fb9eadd9700 1 -- start start 2023-10-09T06:20:47.551 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.548+0000 7fb9eadd9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb9e40b0e50 0x7fb9e40c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:47.551 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.548+0000 7fb9eadd9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb9e40b1220 0x7fb9e406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:47.551 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.548+0000 7fb9eadd9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e415de60 con 0x7fb9e406dad0 2023-10-09T06:20:47.551 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.548+0000 7fb9eadd9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e415e140 con 0x7fb9e40b0e50 2023-10-09T06:20:47.551 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.548+0000 7fb9eadd9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e415e420 con 0x7fb9e40b1220 2023-10-09T06:20:47.551 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.548+0000 7fb9e9376700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb9e406dad0 0x7fb9e40cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50180/0 (socket says 172.21.15.31:50180) 2023-10-09T06:20:47.551 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.548+0000 7fb9e9376700 1 -- 172.21.15.31:0/2292105430 learned_addr learned my addr 172.21.15.31:0/2292105430 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:47.551 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.548+0000 7fb9e3fff700 1 --2- 172.21.15.31:0/2292105430 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb9e40b1220 0x7fb9e406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:47.552 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.548+0000 7fb9e8b75700 1 --2- 172.21.15.31:0/2292105430 >> v2:172.21.15.158:3300/0 conn(0x7fb9e40b0e50 0x7fb9e40c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:47.552 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.549+0000 7fb9e37fe700 1 -- 172.21.15.31:0/2292105430 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875636214 0 0) 0x7fb9e415de60 con 0x7fb9e406dad0 2023-10-09T06:20:47.552 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.549+0000 7fb9e37fe700 1 -- 172.21.15.31:0/2292105430 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d0003570 con 0x7fb9e406dad0 2023-10-09T06:20:47.552 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.549+0000 7fb9e3fff700 1 -- 172.21.15.31:0/2292105430 >> v2:172.21.15.158:3300/0 conn(0x7fb9e40b0e50 msgr2=0x7fb9e40c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:47.552 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.549+0000 7fb9e3fff700 1 --2- 172.21.15.31:0/2292105430 >> v2:172.21.15.158:3300/0 conn(0x7fb9e40b0e50 0x7fb9e40c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.552 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.549+0000 7fb9e3fff700 1 -- 172.21.15.31:0/2292105430 >> v1:172.21.15.31:6789/0 conn(0x7fb9e406dad0 legacy=0x7fb9e40cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:47.552 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.549+0000 7fb9e3fff700 1 -- 172.21.15.31:0/2292105430 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e415e700 con 0x7fb9e40b1220 2023-10-09T06:20:47.552 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.549+0000 7fb9e8b75700 1 --2- 172.21.15.31:0/2292105430 >> v2:172.21.15.158:3300/0 conn(0x7fb9e40b0e50 0x7fb9e40c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:20:47.552 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.549+0000 7fb9e3fff700 1 --2- 172.21.15.31:0/2292105430 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb9e40b1220 0x7fb9e406d590 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009910 tx=0x7fb9d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c58af19c33d00636 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:47.552 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.549+0000 7fb9e37fe700 1 -- 172.21.15.31:0/2292105430 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4011630 con 0x7fb9e40b1220 2023-10-09T06:20:47.552 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.549+0000 7fb9e37fe700 1 -- 172.21.15.31:0/2292105430 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d4011790 con 0x7fb9e40b1220 2023-10-09T06:20:47.553 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.549+0000 7fb9e37fe700 1 -- 172.21.15.31:0/2292105430 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4011b30 con 0x7fb9e40b1220 2023-10-09T06:20:47.553 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.550+0000 7fb9eadd9700 1 -- 172.21.15.31:0/2292105430 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb9e40b1220 msgr2=0x7fb9e406d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:47.553 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.550+0000 7fb9eadd9700 1 --2- 172.21.15.31:0/2292105430 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb9e40b1220 0x7fb9e406d590 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009910 tx=0x7fb9d40091a0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.553 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.550+0000 7fb9eadd9700 1 -- 172.21.15.31:0/2292105430 shutdown_connections 2023-10-09T06:20:47.553 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.550+0000 7fb9eadd9700 1 --2- 172.21.15.31:0/2292105430 >> v2:172.21.15.158:3300/0 conn(0x7fb9e40b0e50 0x7fb9e40c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.553 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.550+0000 7fb9eadd9700 1 --2- 172.21.15.31:0/2292105430 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb9e40b1220 0x7fb9e406d590 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.553 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.550+0000 7fb9eadd9700 1 -- 172.21.15.31:0/2292105430 >> 172.21.15.31:0/2292105430 conn(0x7fb9e4069870 msgr2=0x7fb9e4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:47.553 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.550+0000 7fb9eadd9700 1 -- 172.21.15.31:0/2292105430 shutdown_connections 2023-10-09T06:20:47.553 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.550+0000 7fb9eadd9700 1 -- 172.21.15.31:0/2292105430 wait complete. 2023-10-09T06:20:47.556 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.551+0000 7fb9eadd9700 1 Processor -- start 2023-10-09T06:20:47.556 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.551+0000 7fb9eadd9700 1 -- start start 2023-10-09T06:20:47.556 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9eadd9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb9e406dad0 0x7fb9e4146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:47.556 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9eadd9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9e40b0e50 0x7fb9e415aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:47.556 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9eadd9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9e40b1220 0x7fb9e415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:47.556 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9eadd9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40b22f0 con 0x7fb9e40b1220 2023-10-09T06:20:47.556 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9eadd9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40b25d0 con 0x7fb9e40b0e50 2023-10-09T06:20:47.556 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9eadd9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40b28b0 con 0x7fb9e406dad0 2023-10-09T06:20:47.556 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9e9376700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9e40b1220 0x7fb9e415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:47.557 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9e9376700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9e40b1220 0x7fb9e415b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47190/0 (socket says 172.21.15.31:47190) 2023-10-09T06:20:47.557 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9e9376700 1 -- 172.21.15.31:0/872959079 learned_addr learned my addr 172.21.15.31:0/872959079 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:47.557 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9e8b75700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb9e406dad0 0x7fb9e4146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:47.557 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9e3fff700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9e40b0e50 0x7fb9e415aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:47.557 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9e9376700 1 -- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb9e406dad0 msgr2=0x7fb9e4146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:47.557 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9e9376700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb9e406dad0 0x7fb9e4146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.557 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9e9376700 1 -- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9e40b0e50 msgr2=0x7fb9e415aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:47.557 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9e9376700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9e40b0e50 0x7fb9e415aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.557 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9e9376700 1 -- 172.21.15.31:0/872959079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc009a20 con 0x7fb9e40b1220 2023-10-09T06:20:47.557 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.552+0000 7fb9e9376700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9e40b1220 0x7fb9e415b3e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0010e0 tx=0x7fb9cc007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:47.557 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.553+0000 7fb9e0ff9700 1 -- 172.21.15.31:0/872959079 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc005c00 con 0x7fb9e40b1220 2023-10-09T06:20:47.558 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.553+0000 7fb9e0ff9700 1 -- 172.21.15.31:0/872959079 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc005d60 con 0x7fb9e40b1220 2023-10-09T06:20:47.558 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.553+0000 7fb9eadd9700 1 -- 172.21.15.31:0/872959079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d4009420 con 0x7fb9e40b1220 2023-10-09T06:20:47.558 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.553+0000 7fb9e0ff9700 1 -- 172.21.15.31:0/872959079 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0072e0 con 0x7fb9e40b1220 2023-10-09T06:20:47.558 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.553+0000 7fb9eadd9700 1 -- 172.21.15.31:0/872959079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e40b2e70 con 0x7fb9e40b1220 2023-10-09T06:20:47.558 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.554+0000 7fb9eadd9700 1 -- 172.21.15.31:0/872959079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e40b3000 con 0x7fb9e40b1220 2023-10-09T06:20:47.558 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.554+0000 7fb9e0ff9700 1 -- 172.21.15.31:0/872959079 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9cc01b3b0 con 0x7fb9e40b1220 2023-10-09T06:20:47.558 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.554+0000 7fb9e0ff9700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb9c4066f30 0x7fb9c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:47.558 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.554+0000 7fb9e0ff9700 1 -- 172.21.15.31:0/872959079 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb9cc083650 con 0x7fb9e40b1220 2023-10-09T06:20:47.558 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.555+0000 7fb9e8b75700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb9c4066f30 0x7fb9c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:47.558 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.555+0000 7fb9e8b75700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb9c4066f30 0x7fb9c40693e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0099f0 tx=0x7fb9dc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:47.560 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.559+0000 7fb9e0ff9700 1 -- 172.21.15.31:0/872959079 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9cc04b5a0 con 0x7fb9e40b1220 2023-10-09T06:20:47.756 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.756+0000 7fb9eadd9700 1 -- 172.21.15.31:0/872959079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9e404c3c0 con 0x7fb9e40b1220 2023-10-09T06:20:47.757 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.757+0000 7fb9e0ff9700 1 -- 172.21.15.31:0/872959079 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7fb9cc06ae60 con 0x7fb9e40b1220 2023-10-09T06:20:47.758 INFO:teuthology.misc.health.smithi031.stdout: 2023-10-09T06:20:47.758 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":16,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:45.335796+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:20:47.759 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.759+0000 7fb9eadd9700 1 -- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb9c4066f30 msgr2=0x7fb9c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:47.760 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.759+0000 7fb9eadd9700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb9c4066f30 0x7fb9c40693e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0099f0 tx=0x7fb9dc00b040 comp rx=0 tx=0).stop 2023-10-09T06:20:47.760 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.759+0000 7fb9eadd9700 1 -- 172.21.15.31:0/872959079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9e40b1220 msgr2=0x7fb9e415b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:47.760 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.759+0000 7fb9eadd9700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9e40b1220 0x7fb9e415b3e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0010e0 tx=0x7fb9cc007d70 comp rx=0 tx=0).stop 2023-10-09T06:20:47.760 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.759+0000 7fb9eadd9700 1 -- 172.21.15.31:0/872959079 shutdown_connections 2023-10-09T06:20:47.760 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.759+0000 7fb9eadd9700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb9c4066f30 0x7fb9c40693e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.760 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.759+0000 7fb9eadd9700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb9e406dad0 0x7fb9e4146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.760 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.759+0000 7fb9eadd9700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9e40b1220 0x7fb9e415b3e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.760 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.759+0000 7fb9eadd9700 1 --2- 172.21.15.31:0/872959079 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9e40b0e50 0x7fb9e415aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.760 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.759+0000 7fb9eadd9700 1 -- 172.21.15.31:0/872959079 >> 172.21.15.31:0/872959079 conn(0x7fb9e4069870 msgr2=0x7fb9e40679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:47.760 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.759+0000 7fb9eadd9700 1 -- 172.21.15.31:0/872959079 shutdown_connections 2023-10-09T06:20:47.761 INFO:teuthology.misc.health.smithi031.stderr:2023-10-09T06:20:47.759+0000 7fb9eadd9700 1 -- 172.21.15.31:0/872959079 wait complete. 2023-10-09T06:20:47.770 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-09T06:20:47.770 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-09T06:20:47.771 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:20:47.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:20:47.773 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:20:47.773 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:20:47.773 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:20:47.775 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:20:47.775 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:20:47.776 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:20:47.779 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:20:47.779 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:20:47.779 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:20:47.781 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:20:47.781 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-09T06:20:47.782 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:20:47.848 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:20:47.848 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-10-09T06:20:47.865 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:20:47.865 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-09T06:20:47.866 INFO:tasks.ceph.mds.b.smithi158.stderr:2023-10-09T06:20:47.866+0000 7f5e485b5700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-09T06:20:47.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.906+0000 7f59ead2a700 1 Processor -- start 2023-10-09T06:20:47.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.906+0000 7f59ead2a700 1 -- start start 2023-10-09T06:20:47.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59ead2a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59e4159e10 0x7f59e40b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:47.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59ead2a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f59e40cde50 0x7f59e40b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:47.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59ead2a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e415db80 con 0x7f59e415a1e0 2023-10-09T06:20:47.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59ead2a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e415e800 con 0x7f59e4159e10 2023-10-09T06:20:47.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59ead2a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e415de60 con 0x7f59e40cde50 2023-10-09T06:20:47.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59e8ac6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59e4159e10 0x7f59e40b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:47.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59e8ac6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59e4159e10 0x7f59e40b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47238/0 (socket says 172.21.15.31:47238) 2023-10-09T06:20:47.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59e8ac6700 1 -- 172.21.15.31:0/198930032 learned_addr learned my addr 172.21.15.31:0/198930032 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:47.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59e92c7700 1 --2- 172.21.15.31:0/198930032 >> v2:172.21.15.158:3300/0 conn(0x7f59e40cde50 0x7f59e40b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:47.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59e8ac6700 1 -- 172.21.15.31:0/198930032 >> v2:172.21.15.158:3300/0 conn(0x7f59e40cde50 msgr2=0x7f59e40b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:47.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59e8ac6700 1 --2- 172.21.15.31:0/198930032 >> v2:172.21.15.158:3300/0 conn(0x7f59e40cde50 0x7f59e40b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59e8ac6700 1 -- 172.21.15.31:0/198930032 >> v1:172.21.15.158:6789/0 conn(0x7f59e415a1e0 legacy=0x7f59e40cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:47.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59e8ac6700 1 -- 172.21.15.31:0/198930032 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e415e140 con 0x7f59e4159e10 2023-10-09T06:20:47.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59e92c7700 1 --2- 172.21.15.31:0/198930032 >> v2:172.21.15.158:3300/0 conn(0x7f59e40cde50 0x7f59e40b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:20:47.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59e8ac6700 1 --2- 172.21.15.31:0/198930032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59e4159e10 0x7f59e40b2d20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f59e40685b0 tx=0x7f59d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5eec07ba3967a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:47.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59e37fe700 1 -- 172.21.15.31:0/198930032 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d400b820 con 0x7f59e4159e10 2023-10-09T06:20:47.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59e37fe700 1 -- 172.21.15.31:0/198930032 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d400b980 con 0x7f59e4159e10 2023-10-09T06:20:47.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.907+0000 7f59e37fe700 1 -- 172.21.15.31:0/198930032 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d400bd20 con 0x7f59e4159e10 2023-10-09T06:20:47.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.908+0000 7f59ead2a700 1 -- 172.21.15.31:0/198930032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59e4159e10 msgr2=0x7f59e40b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:47.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.908+0000 7f59ead2a700 1 --2- 172.21.15.31:0/198930032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59e4159e10 0x7f59e40b2d20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f59e40685b0 tx=0x7f59d4009250 comp rx=0 tx=0).stop 2023-10-09T06:20:47.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.908+0000 7f59ead2a700 1 -- 172.21.15.31:0/198930032 shutdown_connections 2023-10-09T06:20:47.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.908+0000 7f59ead2a700 1 --2- 172.21.15.31:0/198930032 >> v2:172.21.15.158:3300/0 conn(0x7f59e40cde50 0x7f59e40b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.908+0000 7f59ead2a700 1 --2- 172.21.15.31:0/198930032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59e4159e10 0x7f59e40b2d20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.908+0000 7f59ead2a700 1 -- 172.21.15.31:0/198930032 >> 172.21.15.31:0/198930032 conn(0x7f59e4067660 msgr2=0x7f59e4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:47.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.908+0000 7f59ead2a700 1 -- 172.21.15.31:0/198930032 shutdown_connections 2023-10-09T06:20:47.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.908+0000 7f59ead2a700 1 -- 172.21.15.31:0/198930032 wait complete. 2023-10-09T06:20:47.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.909+0000 7f59ead2a700 1 Processor -- start 2023-10-09T06:20:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.909+0000 7f59ead2a700 1 -- start start 2023-10-09T06:20:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59ead2a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59e40cde50 0x7f59e414d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59ead2a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59e4159e10 0x7f59e416e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59ead2a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59e415a1e0 0x7f59e416a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59ead2a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e416b160 con 0x7f59e40cde50 2023-10-09T06:20:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59ead2a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e414d770 con 0x7f59e415a1e0 2023-10-09T06:20:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59ead2a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e416dcd0 con 0x7f59e4159e10 2023-10-09T06:20:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59e8ac6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59e40cde50 0x7f59e414d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59e8ac6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59e40cde50 0x7f59e414d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47240/0 (socket says 172.21.15.31:47240) 2023-10-09T06:20:47.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59e8ac6700 1 -- 172.21.15.31:0/837510766 learned_addr learned my addr 172.21.15.31:0/837510766 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:47.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59e3fff700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59e4159e10 0x7f59e416e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:47.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59e92c7700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59e415a1e0 0x7f59e416a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:47.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59e8ac6700 1 -- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59e4159e10 msgr2=0x7f59e416e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:47.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59e8ac6700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59e4159e10 0x7f59e416e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59e8ac6700 1 -- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59e415a1e0 msgr2=0x7f59e416a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:47.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59e8ac6700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59e415a1e0 0x7f59e416a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:47.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59e8ac6700 1 -- 172.21.15.31:0/837510766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d40094f0 con 0x7f59e40cde50 2023-10-09T06:20:47.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59e3fff700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59e4159e10 0x7f59e416e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:20:47.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.910+0000 7f59e8ac6700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59e40cde50 0x7f59e414d230 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009290 tx=0x7f59d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:47.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.911+0000 7f59e0ff9700 1 -- 172.21.15.31:0/837510766 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4011e20 con 0x7f59e40cde50 2023-10-09T06:20:47.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.911+0000 7f59e0ff9700 1 -- 172.21.15.31:0/837510766 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d4020070 con 0x7f59e40cde50 2023-10-09T06:20:47.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.911+0000 7f59e0ff9700 1 -- 172.21.15.31:0/837510766 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d401b6a0 con 0x7f59e40cde50 2023-10-09T06:20:47.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.911+0000 7f59ead2a700 1 -- 172.21.15.31:0/837510766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e416e6a0 con 0x7f59e40cde50 2023-10-09T06:20:47.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.911+0000 7f59ead2a700 1 -- 172.21.15.31:0/837510766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e416ae80 con 0x7f59e40cde50 2023-10-09T06:20:47.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.912+0000 7f59ead2a700 1 -- 172.21.15.31:0/837510766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e4067a30 con 0x7f59e40cde50 2023-10-09T06:20:47.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.912+0000 7f59e0ff9700 1 -- 172.21.15.31:0/837510766 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59d4022030 con 0x7f59e40cde50 2023-10-09T06:20:47.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.912+0000 7f59e0ff9700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f59d0066f30 0x7f59d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:47.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.912+0000 7f59e0ff9700 1 -- 172.21.15.31:0/837510766 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f59d4086180 con 0x7f59e40cde50 2023-10-09T06:20:47.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.912+0000 7f59e3fff700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f59d0066f30 0x7f59d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:47.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.913+0000 7f59e3fff700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f59d0066f30 0x7f59d00693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f59d8006fd0 tx=0x7f59d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:47.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:47.917+0000 7f59e0ff9700 1 -- 172.21.15.31:0/837510766 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59d4053740 con 0x7f59e40cde50 2023-10-09T06:20:48.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.109+0000 7f59ead2a700 1 -- 172.21.15.31:0/837510766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59e4067a30 con 0x7f59e40cde50 2023-10-09T06:20:48.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.110+0000 7f59e0ff9700 1 -- 172.21.15.31:0/837510766 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f59d4056d60 con 0x7f59e40cde50 2023-10-09T06:20:48.111 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:45.335796+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:20:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.112+0000 7f59ead2a700 1 -- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f59d0066f30 msgr2=0x7f59d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.112+0000 7f59ead2a700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f59d0066f30 0x7f59d00693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f59d8006fd0 tx=0x7f59d8008040 comp rx=0 tx=0).stop 2023-10-09T06:20:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.112+0000 7f59ead2a700 1 -- 172.21.15.31:0/837510766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59e40cde50 msgr2=0x7f59e414d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.112+0000 7f59ead2a700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59e40cde50 0x7f59e414d230 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009290 tx=0x7f59d4016000 comp rx=0 tx=0).stop 2023-10-09T06:20:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.112+0000 7f59ead2a700 1 -- 172.21.15.31:0/837510766 shutdown_connections 2023-10-09T06:20:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.112+0000 7f59ead2a700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f59d0066f30 0x7f59d00693e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.112+0000 7f59ead2a700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59e415a1e0 0x7f59e416a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.112+0000 7f59ead2a700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59e40cde50 0x7f59e414d230 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.112+0000 7f59ead2a700 1 --2- 172.21.15.31:0/837510766 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f59e4159e10 0x7f59e416e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.112+0000 7f59ead2a700 1 -- 172.21.15.31:0/837510766 >> 172.21.15.31:0/837510766 conn(0x7f59e4067660 msgr2=0x7f59e4159080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.112+0000 7f59ead2a700 1 -- 172.21.15.31:0/837510766 shutdown_connections 2023-10-09T06:20:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.112+0000 7f59ead2a700 1 -- 172.21.15.31:0/837510766 wait complete. 2023-10-09T06:20:48.125 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:20:48.125 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:20:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.246+0000 7f7c0a533700 1 Processor -- start 2023-10-09T06:20:48.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.246+0000 7f7c0a533700 1 -- start start 2023-10-09T06:20:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.246+0000 7f7c0a533700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c0415a290 0x7f7c0406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c0a533700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c040b0790 con 0x7f7c0406aae0 2023-10-09T06:20:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c0a533700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c040ce1f0 con 0x7f7c04159ec0 2023-10-09T06:20:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c0a533700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0406af60 con 0x7f7c0415a290 2023-10-09T06:20:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c08ad0700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7c0406aae0 0x7f7c040cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50198/0 (socket says 172.21.15.31:50198) 2023-10-09T06:20:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c08ad0700 1 -- 172.21.15.31:0/3506945144 learned_addr learned my addr 172.21.15.31:0/3506945144 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c037fe700 1 --2- 172.21.15.31:0/3506945144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c0415a290 0x7f7c0406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631932345 0 0) 0x7f7c040b0790 con 0x7f7c0406aae0 2023-10-09T06:20:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bec003570 con 0x7f7c0406aae0 2023-10-09T06:20:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3699963553 0 0) 0x7f7bec003570 con 0x7f7c0406aae0 2023-10-09T06:20:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c0415a290 msgr2=0x7f7c0406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 --2- 172.21.15.31:0/3506945144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c0415a290 0x7f7c0406a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 >> v1:172.21.15.158:6789/0 conn(0x7f7c04159ec0 legacy=0x7f7c040af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040b0b20 con 0x7f7c0406aae0 2023-10-09T06:20:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f7bfc0017f0 con 0x7f7c0406aae0 2023-10-09T06:20:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 >> v1:172.21.15.31:6789/0 conn(0x7f7c0406aae0 legacy=0x7f7c040cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 --2- 172.21.15.31:0/3506945144 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bec003a90 0x7f7bec003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 --2- 172.21.15.31:0/3506945144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bec004810 0x7f7bec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 --2- 172.21.15.31:0/3506945144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c0415a290 0x7f7bec0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0406af60 con 0x7f7bec004810 2023-10-09T06:20:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec00bb60 con 0x7f7bec003a90 2023-10-09T06:20:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec00bd20 con 0x7f7c0415a290 2023-10-09T06:20:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c037fe700 1 --2- 172.21.15.31:0/3506945144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bec004810 0x7f7bec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c03fff700 1 --2- 172.21.15.31:0/3506945144 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bec003a90 0x7f7bec003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.247+0000 7f7c08ad0700 1 --2- 172.21.15.31:0/3506945144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c0415a290 0x7f7bec0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.248+0000 7f7c037fe700 1 -- 172.21.15.31:0/3506945144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c0415a290 msgr2=0x7f7bec0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.248+0000 7f7c037fe700 1 --2- 172.21.15.31:0/3506945144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c0415a290 0x7f7bec0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.248+0000 7f7c037fe700 1 -- 172.21.15.31:0/3506945144 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bec003a90 msgr2=0x7f7bec003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.248+0000 7f7c037fe700 1 --2- 172.21.15.31:0/3506945144 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bec003a90 0x7f7bec003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.248+0000 7f7c037fe700 1 -- 172.21.15.31:0/3506945144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec003570 con 0x7f7bec004810 2023-10-09T06:20:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.248+0000 7f7c037fe700 1 --2- 172.21.15.31:0/3506945144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bec004810 0x7f7bec004c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009c00 tx=0x7f7bf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135fe386ab25ede7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.248+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf800e710 con 0x7f7bec004810 2023-10-09T06:20:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.248+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf800e870 con 0x7f7bec004810 2023-10-09T06:20:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.248+0000 7f7c02ffd700 1 -- 172.21.15.31:0/3506945144 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf800ec30 con 0x7f7bec004810 2023-10-09T06:20:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.248+0000 7f7c0a533700 1 -- 172.21.15.31:0/3506945144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bec004810 msgr2=0x7f7bec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.248+0000 7f7c0a533700 1 --2- 172.21.15.31:0/3506945144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bec004810 0x7f7bec004c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009c00 tx=0x7f7bf80091a0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.248+0000 7f7c08ad0700 1 -- 172.21.15.31:0/3506945144 reap_dead start 2023-10-09T06:20:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.249+0000 7f7c0a533700 1 -- 172.21.15.31:0/3506945144 shutdown_connections 2023-10-09T06:20:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.249+0000 7f7c0a533700 1 -- 172.21.15.31:0/3506945144 >> 172.21.15.31:0/3506945144 conn(0x7f7c040d1880 msgr2=0x7f7c040cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.249+0000 7f7c0a533700 1 -- 172.21.15.31:0/3506945144 shutdown_connections 2023-10-09T06:20:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.249+0000 7f7c0a533700 1 -- 172.21.15.31:0/3506945144 wait complete. 2023-10-09T06:20:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.250+0000 7f7c0a533700 1 Processor -- start 2023-10-09T06:20:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.250+0000 7f7c0a533700 1 -- start start 2023-10-09T06:20:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.250+0000 7f7c0a533700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bec004810 0x7f7c0415c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c0a533700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c04157650 0x7f7c04158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c0a533700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04157ac0 0x7f7c040af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c0a533700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c04158bc0 con 0x7f7c04157ac0 2023-10-09T06:20:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c0a533700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0415b630 con 0x7f7bec004810 2023-10-09T06:20:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c0a533700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0415b910 con 0x7f7c04157650 2023-10-09T06:20:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c08ad0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04157ac0 0x7f7c040af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c08ad0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04157ac0 0x7f7c040af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47248/0 (socket says 172.21.15.31:47248) 2023-10-09T06:20:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c08ad0700 1 -- 172.21.15.31:0/350447741 learned_addr learned my addr 172.21.15.31:0/350447741 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c03fff700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bec004810 0x7f7c0415c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c037fe700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c04157650 0x7f7c04158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c08ad0700 1 -- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c04157650 msgr2=0x7f7c04158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c08ad0700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c04157650 0x7f7c04158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c08ad0700 1 -- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bec004810 msgr2=0x7f7c0415c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c08ad0700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bec004810 0x7f7c0415c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c08ad0700 1 -- 172.21.15.31:0/350447741 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0415bbf0 con 0x7f7c04157ac0 2023-10-09T06:20:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c037fe700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c04157650 0x7f7c04158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:20:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c08ad0700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04157ac0 0x7f7c040af7d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc000f80 tx=0x7f7bfc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:48.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7bebfff700 1 -- 172.21.15.31:0/350447741 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00ad40 con 0x7f7c04157ac0 2023-10-09T06:20:48.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7bebfff700 1 -- 172.21.15.31:0/350447741 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc0133f0 con 0x7f7c04157ac0 2023-10-09T06:20:48.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c0a533700 1 -- 172.21.15.31:0/350447741 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0415bed0 con 0x7f7c04157ac0 2023-10-09T06:20:48.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7bebfff700 1 -- 172.21.15.31:0/350447741 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0137b0 con 0x7f7c04157ac0 2023-10-09T06:20:48.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.251+0000 7f7c0a533700 1 -- 172.21.15.31:0/350447741 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c041586b0 con 0x7f7c04157ac0 2023-10-09T06:20:48.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.252+0000 7f7c0a533700 1 -- 172.21.15.31:0/350447741 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0415c0c0 con 0x7f7c04157ac0 2023-10-09T06:20:48.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.253+0000 7f7bebfff700 1 -- 172.21.15.31:0/350447741 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bfc013be0 con 0x7f7c04157ac0 2023-10-09T06:20:48.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.253+0000 7f7bebfff700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7bf0066f30 0x7f7bf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:48.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.253+0000 7f7bebfff700 1 -- 172.21.15.31:0/350447741 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7bfc084b90 con 0x7f7c04157ac0 2023-10-09T06:20:48.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.253+0000 7f7c03fff700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7bf0066f30 0x7f7bf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:48.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.254+0000 7f7c03fff700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7bf0066f30 0x7f7bf00693e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4000f60 tx=0x7f7bf4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:48.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.257+0000 7f7bebfff700 1 -- 172.21.15.31:0/350447741 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bfc052150 con 0x7f7c04157ac0 2023-10-09T06:20:48.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.447+0000 7f7c0a533700 1 -- 172.21.15.31:0/350447741 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c0404c3c0 con 0x7f7c04157ac0 2023-10-09T06:20:48.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.447+0000 7f7bebfff700 1 -- 172.21.15.31:0/350447741 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7bfc055770 con 0x7f7c04157ac0 2023-10-09T06:20:48.448 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:20:48.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.449+0000 7f7c0a533700 1 -- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7bf0066f30 msgr2=0x7f7bf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.449+0000 7f7c0a533700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7bf0066f30 0x7f7bf00693e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4000f60 tx=0x7f7bf4009040 comp rx=0 tx=0).stop 2023-10-09T06:20:48.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.449+0000 7f7c0a533700 1 -- 172.21.15.31:0/350447741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04157ac0 msgr2=0x7f7c040af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.449+0000 7f7c0a533700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04157ac0 0x7f7c040af7d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc000f80 tx=0x7f7bfc0021d0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.449+0000 7f7c0a533700 1 -- 172.21.15.31:0/350447741 shutdown_connections 2023-10-09T06:20:48.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.449+0000 7f7c0a533700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7bf0066f30 0x7f7bf00693e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.449+0000 7f7c0a533700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04157ac0 0x7f7c040af7d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.449+0000 7f7c0a533700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bec004810 0x7f7c0415c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.449+0000 7f7c0a533700 1 --2- 172.21.15.31:0/350447741 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c04157650 0x7f7c04158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.449+0000 7f7c0a533700 1 -- 172.21.15.31:0/350447741 >> 172.21.15.31:0/350447741 conn(0x7f7c040d1880 msgr2=0x7f7c040b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:48.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.449+0000 7f7c0a533700 1 -- 172.21.15.31:0/350447741 shutdown_connections 2023-10-09T06:20:48.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.449+0000 7f7c0a533700 1 -- 172.21.15.31:0/350447741 wait complete. 2023-10-09T06:20:48.462 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:20:48.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.579+0000 7f52e0685700 1 Processor -- start 2023-10-09T06:20:48.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.579+0000 7f52e0685700 1 -- start start 2023-10-09T06:20:48.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.580+0000 7f52e0685700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f52d815a620 0x7f52d815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:48.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.580+0000 7f52e0685700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d815cbb0 con 0x7f52d815d580 2023-10-09T06:20:48.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.580+0000 7f52e0685700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d815bfa0 con 0x7f52d8157870 2023-10-09T06:20:48.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.580+0000 7f52e0685700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d815bdb0 con 0x7f52d815a620 2023-10-09T06:20:48.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.580+0000 7f52dec22700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f52d815d580 0x7f52d8158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50202/0 (socket says 172.21.15.31:50202) 2023-10-09T06:20:48.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.580+0000 7f52dec22700 1 -- 172.21.15.31:0/1722189891 learned_addr learned my addr 172.21.15.31:0/1722189891 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:48.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.581+0000 7f52ddc20700 1 --2- 172.21.15.31:0/1722189891 >> v2:172.21.15.158:3300/0 conn(0x7f52d815a620 0x7f52d815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:48.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.581+0000 7f52dd41f700 1 -- 172.21.15.31:0/1722189891 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518631425 0 0) 0x7f52d815cbb0 con 0x7f52d815d580 2023-10-09T06:20:48.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.581+0000 7f52dd41f700 1 -- 172.21.15.31:0/1722189891 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c0003570 con 0x7f52d815d580 2023-10-09T06:20:48.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.581+0000 7f52dd41f700 1 -- 172.21.15.31:0/1722189891 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951112098 0 0) 0x7f52d815bfa0 con 0x7f52d8157870 2023-10-09T06:20:48.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.581+0000 7f52dd41f700 1 -- 172.21.15.31:0/1722189891 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d815cbb0 con 0x7f52d8157870 2023-10-09T06:20:48.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.581+0000 7f52dd41f700 1 -- 172.21.15.31:0/1722189891 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1835504118 0 0) 0x7f52c0003570 con 0x7f52d815d580 2023-10-09T06:20:48.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.581+0000 7f52ddc20700 1 -- 172.21.15.31:0/1722189891 >> v1:172.21.15.158:6789/0 conn(0x7f52d8157870 legacy=0x7f52d815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.581+0000 7f52ddc20700 1 -- 172.21.15.31:0/1722189891 >> v1:172.21.15.31:6789/0 conn(0x7f52d815d580 legacy=0x7f52d8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.581+0000 7f52ddc20700 1 -- 172.21.15.31:0/1722189891 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d815c280 con 0x7f52d815a620 2023-10-09T06:20:48.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.581+0000 7f52ddc20700 1 --2- 172.21.15.31:0/1722189891 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d815a620 0x7f52d815d040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0098e0 tx=0x7f52cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=590aa3f32efa60d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:48.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.581+0000 7f52dd41f700 1 -- 172.21.15.31:0/1722189891 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0001470 con 0x7f52d815a620 2023-10-09T06:20:48.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.581+0000 7f52dd41f700 1 -- 172.21.15.31:0/1722189891 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc011420 con 0x7f52d815a620 2023-10-09T06:20:48.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.581+0000 7f52dd41f700 1 -- 172.21.15.31:0/1722189891 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc0117c0 con 0x7f52d815a620 2023-10-09T06:20:48.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.582+0000 7f52e0685700 1 -- 172.21.15.31:0/1722189891 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d815a620 msgr2=0x7f52d815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.582+0000 7f52e0685700 1 --2- 172.21.15.31:0/1722189891 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d815a620 0x7f52d815d040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0098e0 tx=0x7f52cc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.582+0000 7f52e0685700 1 -- 172.21.15.31:0/1722189891 shutdown_connections 2023-10-09T06:20:48.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.582+0000 7f52e0685700 1 --2- 172.21.15.31:0/1722189891 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d815a620 0x7f52d815d040 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.582+0000 7f52e0685700 1 -- 172.21.15.31:0/1722189891 >> 172.21.15.31:0/1722189891 conn(0x7f52d8068ce0 msgr2=0x7f52d80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:48.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.582+0000 7f52e0685700 1 -- 172.21.15.31:0/1722189891 shutdown_connections 2023-10-09T06:20:48.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.582+0000 7f52e0685700 1 -- 172.21.15.31:0/1722189891 wait complete. 2023-10-09T06:20:48.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.583+0000 7f52e0685700 1 Processor -- start 2023-10-09T06:20:48.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.583+0000 7f52e0685700 1 -- start start 2023-10-09T06:20:48.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52e0685700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d8157870 0x7f52d814ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:48.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52e0685700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d815a620 0x7f52d80cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:48.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52e0685700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d815d580 0x7f52d80b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:48.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52e0685700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d814b240 con 0x7f52d815d580 2023-10-09T06:20:48.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52e0685700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80b1be0 con 0x7f52d8157870 2023-10-09T06:20:48.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52e0685700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80cfd70 con 0x7f52d815a620 2023-10-09T06:20:48.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52dec22700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d815d580 0x7f52d80b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:48.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52dec22700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d815d580 0x7f52d80b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47258/0 (socket says 172.21.15.31:47258) 2023-10-09T06:20:48.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52dec22700 1 -- 172.21.15.31:0/2487700060 learned_addr learned my addr 172.21.15.31:0/2487700060 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:48.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52ddc20700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d815a620 0x7f52d80cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:48.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52de421700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d8157870 0x7f52d814ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:48.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52dec22700 1 -- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d815a620 msgr2=0x7f52d80cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52dec22700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d815a620 0x7f52d80cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52dec22700 1 -- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d8157870 msgr2=0x7f52d814ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52dec22700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d8157870 0x7f52d814ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52dec22700 1 -- 172.21.15.31:0/2487700060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc009420 con 0x7f52d815d580 2023-10-09T06:20:48.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52de421700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d8157870 0x7f52d814ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:20:48.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.584+0000 7f52dec22700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d815d580 0x7f52d80b5260 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f52d000c7c0 tx=0x7f52d0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:48.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.585+0000 7f52d67fc700 1 -- 172.21.15.31:0/2487700060 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0007360 con 0x7f52d815d580 2023-10-09T06:20:48.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.585+0000 7f52d67fc700 1 -- 172.21.15.31:0/2487700060 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d00074e0 con 0x7f52d815d580 2023-10-09T06:20:48.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.585+0000 7f52e0685700 1 -- 172.21.15.31:0/2487700060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d80d0050 con 0x7f52d815d580 2023-10-09T06:20:48.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.585+0000 7f52d67fc700 1 -- 172.21.15.31:0/2487700060 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0004830 con 0x7f52d815d580 2023-10-09T06:20:48.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.585+0000 7f52e0685700 1 -- 172.21.15.31:0/2487700060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d80b1800 con 0x7f52d815d580 2023-10-09T06:20:48.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.585+0000 7f52e0685700 1 -- 172.21.15.31:0/2487700060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d80b1d50 con 0x7f52d815d580 2023-10-09T06:20:48.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.586+0000 7f52d67fc700 1 -- 172.21.15.31:0/2487700060 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52d0004be0 con 0x7f52d815d580 2023-10-09T06:20:48.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.586+0000 7f52d67fc700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52c4066f30 0x7f52c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:48.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.586+0000 7f52d67fc700 1 -- 172.21.15.31:0/2487700060 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f52d0083790 con 0x7f52d815d580 2023-10-09T06:20:48.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.586+0000 7f52de421700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52c4066f30 0x7f52c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:48.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.587+0000 7f52de421700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52c4066f30 0x7f52c40693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f52c8004040 tx=0x7f52c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:48.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.590+0000 7f52d67fc700 1 -- 172.21.15.31:0/2487700060 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52d0050dd0 con 0x7f52d815d580 2023-10-09T06:20:48.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.829+0000 7f52e0685700 1 -- 172.21.15.31:0/2487700060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52d804c3c0 con 0x7f52d815d580 2023-10-09T06:20:48.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.830+0000 7f52d67fc700 1 -- 172.21.15.31:0/2487700060 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f52d0018090 con 0x7f52d815d580 2023-10-09T06:20:48.830 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:48.830 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2894447386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2894447386},{"type":"v1","addr":"172.21.15.31:6834","nonce":2894447386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-09T06:20:48.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.832+0000 7f52e0685700 1 -- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52c4066f30 msgr2=0x7f52c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.832+0000 7f52e0685700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52c4066f30 0x7f52c40693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f52c8004040 tx=0x7f52c8009040 comp rx=0 tx=0).stop 2023-10-09T06:20:48.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.832+0000 7f52e0685700 1 -- 172.21.15.31:0/2487700060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d815d580 msgr2=0x7f52d80b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:48.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.832+0000 7f52e0685700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d815d580 0x7f52d80b5260 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f52d000c7c0 tx=0x7f52d0001a30 comp rx=0 tx=0).stop 2023-10-09T06:20:48.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.832+0000 7f52e0685700 1 -- 172.21.15.31:0/2487700060 shutdown_connections 2023-10-09T06:20:48.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.832+0000 7f52e0685700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52c4066f30 0x7f52c40693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.832+0000 7f52e0685700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d815d580 0x7f52d80b5260 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.832+0000 7f52e0685700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d8157870 0x7f52d814ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.832+0000 7f52e0685700 1 --2- 172.21.15.31:0/2487700060 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d815a620 0x7f52d80cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:48.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.832+0000 7f52e0685700 1 -- 172.21.15.31:0/2487700060 >> 172.21.15.31:0/2487700060 conn(0x7f52d8068ce0 msgr2=0x7f52d8159a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:48.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.832+0000 7f52e0685700 1 -- 172.21.15.31:0/2487700060 shutdown_connections 2023-10-09T06:20:48.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:48.832+0000 7f52e0685700 1 -- 172.21.15.31:0/2487700060 wait complete. 2023-10-09T06:20:48.834 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 2 2023-10-09T06:20:50.845 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:20:50.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.978+0000 7fe199e4b700 1 Processor -- start 2023-10-09T06:20:50.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.978+0000 7fe199e4b700 1 -- start start 2023-10-09T06:20:50.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.979+0000 7fe199e4b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe194157c40 0x7fe194158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:50.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.979+0000 7fe1937fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe194157870 0x7fe19415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50258/0 (socket says 172.21.15.31:50258) 2023-10-09T06:20:50.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.979+0000 7fe199e4b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19415cbb0 con 0x7fe194157870 2023-10-09T06:20:50.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.979+0000 7fe1937fe700 1 -- 172.21.15.31:0/712107976 learned_addr learned my addr 172.21.15.31:0/712107976 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:50.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.979+0000 7fe199e4b700 1 -- 172.21.15.31:0/712107976 --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19415bfa0 con 0x7fe19415a620 2023-10-09T06:20:50.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.979+0000 7fe199e4b700 1 -- 172.21.15.31:0/712107976 --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19415bdb0 con 0x7fe194157c40 2023-10-09T06:20:50.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.979+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203028832 0 0) 0x7fe19415cbb0 con 0x7fe194157870 2023-10-09T06:20:50.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.979+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe17c003570 con 0x7fe194157870 2023-10-09T06:20:50.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.979+0000 7fe193fff700 1 --2- 172.21.15.31:0/712107976 >> v2:172.21.15.158:3300/0 conn(0x7fe194157c40 0x7fe194158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:50.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3303183994 0 0) 0x7fe17c003570 con 0x7fe194157870 2023-10-09T06:20:50.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 >> v2:172.21.15.158:3300/0 conn(0x7fe194157c40 msgr2=0x7fe194158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:50.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 --2- 172.21.15.31:0/712107976 >> v2:172.21.15.158:3300/0 conn(0x7fe194157c40 0x7fe194158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:50.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 >> v1:172.21.15.158:6789/0 conn(0x7fe19415a620 legacy=0x7fe19415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:50.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19415c280 con 0x7fe194157870 2023-10-09T06:20:50.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fe184001470 con 0x7fe194157870 2023-10-09T06:20:50.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 >> v1:172.21.15.31:6789/0 conn(0x7fe194157870 legacy=0x7fe19415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:50.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 --2- 172.21.15.31:0/712107976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c003a60 0x7fe17c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:50.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 --2- 172.21.15.31:0/712107976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe17c004810 0x7fe17c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:50.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 --2- 172.21.15.31:0/712107976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe17c0051c0 0x7fe17c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:50.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c00c130 con 0x7fe17c003a60 2023-10-09T06:20:50.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c00c2a0 con 0x7fe17c004810 2023-10-09T06:20:50.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c00c460 con 0x7fe17c0051c0 2023-10-09T06:20:50.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1937fe700 1 --2- 172.21.15.31:0/712107976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c003a60 0x7fe17c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:50.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe192ffd700 1 --2- 172.21.15.31:0/712107976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe17c004810 0x7fe17c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:50.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe193fff700 1 --2- 172.21.15.31:0/712107976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe17c0051c0 0x7fe17c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:50.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1937fe700 1 -- 172.21.15.31:0/712107976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe17c0051c0 msgr2=0x7fe17c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:50.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1937fe700 1 --2- 172.21.15.31:0/712107976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe17c0051c0 0x7fe17c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:50.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1937fe700 1 -- 172.21.15.31:0/712107976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe17c004810 msgr2=0x7fe17c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:50.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1937fe700 1 --2- 172.21.15.31:0/712107976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe17c004810 0x7fe17c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1937fe700 1 -- 172.21.15.31:0/712107976 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c003570 con 0x7fe17c003a60 2023-10-09T06:20:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe193fff700 1 --2- 172.21.15.31:0/712107976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe17c0051c0 0x7fe17c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:20:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe193fff700 1 -- 172.21.15.31:0/712107976 reap_dead start 2023-10-09T06:20:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1937fe700 1 --2- 172.21.15.31:0/712107976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c003a60 0x7fe17c003e70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c3c0 tx=0x7fe184001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626d6fa4f3c52041 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18400cc90 con 0x7fe17c003a60 2023-10-09T06:20:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18400cdf0 con 0x7fe17c003a60 2023-10-09T06:20:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.980+0000 7fe1927fc700 1 -- 172.21.15.31:0/712107976 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184005b50 con 0x7fe17c003a60 2023-10-09T06:20:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.981+0000 7fe199e4b700 1 -- 172.21.15.31:0/712107976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c003a60 msgr2=0x7fe17c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.981+0000 7fe199e4b700 1 --2- 172.21.15.31:0/712107976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c003a60 0x7fe17c003e70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c3c0 tx=0x7fe184001e50 comp rx=0 tx=0).stop 2023-10-09T06:20:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.981+0000 7fe199e4b700 1 -- 172.21.15.31:0/712107976 shutdown_connections 2023-10-09T06:20:50.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.981+0000 7fe199e4b700 1 --2- 172.21.15.31:0/712107976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c003a60 0x7fe17c003e70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:50.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.981+0000 7fe199e4b700 1 -- 172.21.15.31:0/712107976 >> 172.21.15.31:0/712107976 conn(0x7fe194068ce0 msgr2=0x7fe1940690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:50.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.981+0000 7fe199e4b700 1 -- 172.21.15.31:0/712107976 shutdown_connections 2023-10-09T06:20:50.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.981+0000 7fe199e4b700 1 -- 172.21.15.31:0/712107976 wait complete. 2023-10-09T06:20:50.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.982+0000 7fe199e4b700 1 Processor -- start 2023-10-09T06:20:50.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.982+0000 7fe199e4b700 1 -- start start 2023-10-09T06:20:50.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.983+0000 7fe199e4b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe17c003a60 0x7fe19414fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:50.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.983+0000 7fe199e4b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe19413c2b0 0x7fe19413c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:50.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.983+0000 7fe199e4b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19416a920 0x7fe19416ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:50.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.983+0000 7fe199e4b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19416b7f0 con 0x7fe19416a920 2023-10-09T06:20:50.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.983+0000 7fe199e4b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe194150860 con 0x7fe19413c2b0 2023-10-09T06:20:50.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.983+0000 7fe199e4b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19413cc60 con 0x7fe17c003a60 2023-10-09T06:20:50.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.983+0000 7fe193fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19416a920 0x7fe19416ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:50.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.983+0000 7fe193fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19416a920 0x7fe19416ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56436/0 (socket says 172.21.15.31:56436) 2023-10-09T06:20:50.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.983+0000 7fe193fff700 1 -- 172.21.15.31:0/1245377445 learned_addr learned my addr 172.21.15.31:0/1245377445 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:50.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.983+0000 7fe1937fe700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe17c003a60 0x7fe19414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:50.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.983+0000 7fe192ffd700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe19413c2b0 0x7fe19413c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:50.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.984+0000 7fe193fff700 1 -- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe17c003a60 msgr2=0x7fe19414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:50.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.984+0000 7fe193fff700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe17c003a60 0x7fe19414fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:50.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.984+0000 7fe193fff700 1 -- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe19413c2b0 msgr2=0x7fe19413c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:50.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.984+0000 7fe193fff700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe19413c2b0 0x7fe19413c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:50.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.984+0000 7fe193fff700 1 -- 172.21.15.31:0/1245377445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1941502a0 con 0x7fe19416a920 2023-10-09T06:20:50.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.984+0000 7fe193fff700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19416a920 0x7fe19416ad80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe1940b3830 tx=0x7fe18c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:50.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.984+0000 7fe17b7fe700 1 -- 172.21.15.31:0/1245377445 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c00e030 con 0x7fe19416a920 2023-10-09T06:20:50.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.984+0000 7fe17b7fe700 1 -- 172.21.15.31:0/1245377445 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c011b80 con 0x7fe19416a920 2023-10-09T06:20:50.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.984+0000 7fe199e4b700 1 -- 172.21.15.31:0/1245377445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe194150580 con 0x7fe19416a920 2023-10-09T06:20:50.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.984+0000 7fe17b7fe700 1 -- 172.21.15.31:0/1245377445 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c016470 con 0x7fe19416a920 2023-10-09T06:20:50.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.984+0000 7fe199e4b700 1 -- 172.21.15.31:0/1245377445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1940b0e10 con 0x7fe19416a920 2023-10-09T06:20:50.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.985+0000 7fe199e4b700 1 -- 172.21.15.31:0/1245377445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19404c3c0 con 0x7fe19416a920 2023-10-09T06:20:50.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.985+0000 7fe17b7fe700 1 -- 172.21.15.31:0/1245377445 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe18c016860 con 0x7fe19416a920 2023-10-09T06:20:50.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.986+0000 7fe17b7fe700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe180066f30 0x7fe1800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:50.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.986+0000 7fe17b7fe700 1 -- 172.21.15.31:0/1245377445 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe18c00f070 con 0x7fe19416a920 2023-10-09T06:20:50.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.986+0000 7fe1937fe700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe180066f30 0x7fe1800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:50.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.986+0000 7fe1937fe700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe180066f30 0x7fe1800693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe184007cd0 tx=0x7fe184015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:50.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:50.990+0000 7fe17b7fe700 1 -- 172.21.15.31:0/1245377445 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe18c051f60 con 0x7fe19416a920 2023-10-09T06:20:51.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.230+0000 7fe199e4b700 1 -- 172.21.15.31:0/1245377445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe19415c560 con 0x7fe19416a920 2023-10-09T06:20:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.230+0000 7fe17b7fe700 1 -- 172.21.15.31:0/1245377445 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7fe18c055580 con 0x7fe19416a920 2023-10-09T06:20:51.232 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:51.232 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3437172994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3437172994},{"type":"v1","addr":"172.21.15.158:6836","nonce":3437172994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2894447386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2894447386},{"type":"v1","addr":"172.21.15.31:6834","nonce":2894447386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1034055293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1034055293},{"type":"v1","addr":"172.21.15.31:6835","nonce":1034055293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1189249944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1189249944},{"type":"v1","addr":"172.21.15.158:6837","nonce":1189249944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-09T06:20:51.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.232+0000 7fe199e4b700 1 -- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe180066f30 msgr2=0x7fe1800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.232+0000 7fe199e4b700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe180066f30 0x7fe1800693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe184007cd0 tx=0x7fe184015000 comp rx=0 tx=0).stop 2023-10-09T06:20:51.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.232+0000 7fe199e4b700 1 -- 172.21.15.31:0/1245377445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19416a920 msgr2=0x7fe19416ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.232+0000 7fe199e4b700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19416a920 0x7fe19416ad80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe1940b3830 tx=0x7fe18c00b040 comp rx=0 tx=0).stop 2023-10-09T06:20:51.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.233+0000 7fe199e4b700 1 -- 172.21.15.31:0/1245377445 shutdown_connections 2023-10-09T06:20:51.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.233+0000 7fe199e4b700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe180066f30 0x7fe1800693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.233+0000 7fe199e4b700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe17c003a60 0x7fe19414fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.233+0000 7fe199e4b700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19416a920 0x7fe19416ad80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.233+0000 7fe199e4b700 1 --2- 172.21.15.31:0/1245377445 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe19413c2b0 0x7fe19413c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.233+0000 7fe199e4b700 1 -- 172.21.15.31:0/1245377445 >> 172.21.15.31:0/1245377445 conn(0x7fe194068ce0 msgr2=0x7fe1940690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:51.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.233+0000 7fe199e4b700 1 -- 172.21.15.31:0/1245377445 shutdown_connections 2023-10-09T06:20:51.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.233+0000 7fe199e4b700 1 -- 172.21.15.31:0/1245377445 wait complete. 2023-10-09T06:20:51.235 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 3 2023-10-09T06:20:51.245 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:20:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.362+0000 7f967720c700 1 Processor -- start 2023-10-09T06:20:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.362+0000 7f967720c700 1 -- start start 2023-10-09T06:20:51.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.363+0000 7f967720c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96700b0cd0 0x7f96700cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.363+0000 7f967720c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96700c9450 con 0x7f967015b820 2023-10-09T06:20:51.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.363+0000 7f967720c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96700cc520 con 0x7f96700b10a0 2023-10-09T06:20:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.363+0000 7f967720c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700ce960 con 0x7f96700b0cd0 2023-10-09T06:20:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.363+0000 7f96757a9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f967015b820 0x7f96700ca930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50266/0 (socket says 172.21.15.31:50266) 2023-10-09T06:20:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.363+0000 7f96757a9700 1 -- 172.21.15.31:0/4045966964 learned_addr learned my addr 172.21.15.31:0/4045966964 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f9674fa8700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96700b0cd0 0x7f96700cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280564317 0 0) 0x7f96700c9450 con 0x7f967015b820 2023-10-09T06:20:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f965c003570 con 0x7f967015b820 2023-10-09T06:20:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508142984 0 0) 0x7f96700cc520 con 0x7f96700b10a0 2023-10-09T06:20:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96700c9450 con 0x7f96700b10a0 2023-10-09T06:20:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 220280055 0 0) 0x7f965c003570 con 0x7f967015b820 2023-10-09T06:20:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96700b0cd0 msgr2=0x7f96700cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96700b0cd0 0x7f96700cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 >> v1:172.21.15.158:6789/0 conn(0x7f96700b10a0 legacy=0x7f96700ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96700cc910 con 0x7f967015b820 2023-10-09T06:20:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f9658001470 con 0x7f967015b820 2023-10-09T06:20:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f9674fa8700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96700b0cd0 0x7f96700cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:20:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 >> v1:172.21.15.31:6789/0 conn(0x7f967015b820 legacy=0x7f96700ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c003c20 0x7f965c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c004810 0x7f965c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96700b0cd0 0x7f965c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96700ce960 con 0x7f965c003c20 2023-10-09T06:20:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c00bbb0 con 0x7f965c004810 2023-10-09T06:20:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965c00bd70 con 0x7f96700b0cd0 2023-10-09T06:20:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f9674fa8700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c003c20 0x7f965c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f96757a9700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96700b0cd0 0x7f965c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966ffff700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c004810 0x7f965c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f9674fa8700 1 -- 172.21.15.31:0/4045966964 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96700b0cd0 msgr2=0x7f965c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f9674fa8700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96700b0cd0 0x7f965c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f9674fa8700 1 -- 172.21.15.31:0/4045966964 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c004810 msgr2=0x7f965c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f9674fa8700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c004810 0x7f965c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f9674fa8700 1 -- 172.21.15.31:0/4045966964 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9668009420 con 0x7f965c003c20 2023-10-09T06:20:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.364+0000 7f966ffff700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c004810 0x7f965c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:20:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.365+0000 7f9674fa8700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c003c20 0x7f965c004010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9668009df0 tx=0x7f96680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f40ee6ea2ce73a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.365+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668009740 con 0x7f965c003c20 2023-10-09T06:20:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.365+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966800e920 con 0x7f965c003c20 2023-10-09T06:20:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.365+0000 7f966f7fe700 1 -- 172.21.15.31:0/4045966964 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800ece0 con 0x7f965c003c20 2023-10-09T06:20:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.365+0000 7f967720c700 1 -- 172.21.15.31:0/4045966964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c003c20 msgr2=0x7f965c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.365+0000 7f967720c700 1 --2- 172.21.15.31:0/4045966964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c003c20 0x7f965c004010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9668009df0 tx=0x7f96680091a0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.365+0000 7f96757a9700 1 -- 172.21.15.31:0/4045966964 reap_dead start 2023-10-09T06:20:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.365+0000 7f967720c700 1 -- 172.21.15.31:0/4045966964 shutdown_connections 2023-10-09T06:20:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.365+0000 7f967720c700 1 -- 172.21.15.31:0/4045966964 >> 172.21.15.31:0/4045966964 conn(0x7f967006fdc0 msgr2=0x7f967006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.365+0000 7f967720c700 1 -- 172.21.15.31:0/4045966964 shutdown_connections 2023-10-09T06:20:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.365+0000 7f967720c700 1 -- 172.21.15.31:0/4045966964 wait complete. 2023-10-09T06:20:51.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.366+0000 7f967720c700 1 Processor -- start 2023-10-09T06:20:51.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.367+0000 7f967720c700 1 -- start start 2023-10-09T06:20:51.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.367+0000 7f967720c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c003c20 0x7f967014d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.367+0000 7f967720c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9670159350 0x7f96700c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.367+0000 7f967720c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96700b3140 0x7f96700b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.367+0000 7f967720c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967015a4d0 con 0x7f965c003c20 2023-10-09T06:20:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.367+0000 7f967720c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967014dc40 con 0x7f96700b3140 2023-10-09T06:20:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.367+0000 7f967720c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700c6e90 con 0x7f9670159350 2023-10-09T06:20:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.367+0000 7f9674fa8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c003c20 0x7f967014d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.367+0000 7f9674fa8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c003c20 0x7f967014d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56444/0 (socket says 172.21.15.31:56444) 2023-10-09T06:20:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.367+0000 7f9674fa8700 1 -- 172.21.15.31:0/813548048 learned_addr learned my addr 172.21.15.31:0/813548048 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.367+0000 7f966ffff700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9670159350 0x7f96700c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.367+0000 7f96757a9700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96700b3140 0x7f96700b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.368+0000 7f9674fa8700 1 -- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9670159350 msgr2=0x7f96700c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.368+0000 7f9674fa8700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9670159350 0x7f96700c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.368+0000 7f9674fa8700 1 -- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96700b3140 msgr2=0x7f96700b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.368+0000 7f9674fa8700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96700b3140 0x7f96700b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.368+0000 7f9674fa8700 1 -- 172.21.15.31:0/813548048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96701598c0 con 0x7f965c003c20 2023-10-09T06:20:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.368+0000 7f9674fa8700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c003c20 0x7f967014d700 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f96680091e0 tx=0x7f966801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.368+0000 7f966cff9700 1 -- 172.21.15.31:0/813548048 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668022070 con 0x7f965c003c20 2023-10-09T06:20:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.368+0000 7f966cff9700 1 -- 172.21.15.31:0/813548048 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9668013b30 con 0x7f965c003c20 2023-10-09T06:20:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.368+0000 7f967720c700 1 -- 172.21.15.31:0/813548048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9670159ba0 con 0x7f965c003c20 2023-10-09T06:20:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.368+0000 7f966cff9700 1 -- 172.21.15.31:0/813548048 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966801c450 con 0x7f965c003c20 2023-10-09T06:20:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.368+0000 7f967720c700 1 -- 172.21.15.31:0/813548048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967015a160 con 0x7f965c003c20 2023-10-09T06:20:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.369+0000 7f967720c700 1 -- 172.21.15.31:0/813548048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967004c3c0 con 0x7f965c003c20 2023-10-09T06:20:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.370+0000 7f966cff9700 1 -- 172.21.15.31:0/813548048 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9668026070 con 0x7f965c003c20 2023-10-09T06:20:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.370+0000 7f966cff9700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9650066f30 0x7f96500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.370+0000 7f966cff9700 1 -- 172.21.15.31:0/813548048 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f96680859a0 con 0x7f965c003c20 2023-10-09T06:20:51.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.370+0000 7f966ffff700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9650066f30 0x7f96500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.371+0000 7f966ffff700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9650066f30 0x7f96500693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9660001460 tx=0x7f9660009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:51.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.374+0000 7f966cff9700 1 -- 172.21.15.31:0/813548048 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9668053060 con 0x7f965c003c20 2023-10-09T06:20:51.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.567+0000 7f967720c700 1 -- 172.21.15.31:0/813548048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96700cbc80 con 0x7f965c003c20 2023-10-09T06:20:51.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.567+0000 7f966cff9700 1 -- 172.21.15.31:0/813548048 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f966802d090 con 0x7f965c003c20 2023-10-09T06:20:51.568 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:51.568 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:45.335796+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:20:51.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.569+0000 7f967720c700 1 -- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9650066f30 msgr2=0x7f96500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.569+0000 7f967720c700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9650066f30 0x7f96500693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9660001460 tx=0x7f9660009040 comp rx=0 tx=0).stop 2023-10-09T06:20:51.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.569+0000 7f967720c700 1 -- 172.21.15.31:0/813548048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c003c20 msgr2=0x7f967014d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.569+0000 7f967720c700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c003c20 0x7f967014d700 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f96680091e0 tx=0x7f966801a000 comp rx=0 tx=0).stop 2023-10-09T06:20:51.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.569+0000 7f967720c700 1 -- 172.21.15.31:0/813548048 shutdown_connections 2023-10-09T06:20:51.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.569+0000 7f967720c700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9650066f30 0x7f96500693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.569+0000 7f967720c700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96700b3140 0x7f96700b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.569+0000 7f967720c700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c003c20 0x7f967014d700 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.569+0000 7f967720c700 1 --2- 172.21.15.31:0/813548048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9670159350 0x7f96700c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.569+0000 7f967720c700 1 -- 172.21.15.31:0/813548048 >> 172.21.15.31:0/813548048 conn(0x7f967006fdc0 msgr2=0x7f96700cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:51.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.570+0000 7f967720c700 1 -- 172.21.15.31:0/813548048 shutdown_connections 2023-10-09T06:20:51.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.570+0000 7f967720c700 1 -- 172.21.15.31:0/813548048 wait complete. 2023-10-09T06:20:51.582 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:20:51.582 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:20:51.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.704+0000 7f60058f9700 1 Processor -- start 2023-10-09T06:20:51.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.704+0000 7f60058f9700 1 -- start start 2023-10-09T06:20:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.704+0000 7f60058f9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6000159ec0 0x7f60000af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.704+0000 7f60058f9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f600006acb0 0x7f60000afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.704+0000 7f60058f9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60000b0790 con 0x7f600015a290 2023-10-09T06:20:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.704+0000 7f60058f9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60000ce1f0 con 0x7f6000159ec0 2023-10-09T06:20:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.704+0000 7f60058f9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60000b0b20 con 0x7f600006acb0 2023-10-09T06:20:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffe7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f600015a290 0x7f600006a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50268/0 (socket says 172.21.15.31:50268) 2023-10-09T06:20:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffe7fc700 1 -- 172.21.15.31:0/2574145886 learned_addr learned my addr 172.21.15.31:0/2574145886 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5fff7fe700 1 --2- 172.21.15.31:0/2574145886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f600006acb0 0x7f60000afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffeffd700 1 --2- 172.21.15.31:0/2574145886 >> v2:172.21.15.158:3300/0 conn(0x7f6000159ec0 0x7f60000af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360764319 0 0) 0x7f60000b0790 con 0x7f600015a290 2023-10-09T06:20:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fec003570 con 0x7f600015a290 2023-10-09T06:20:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 532035978 0 0) 0x7f5fec003570 con 0x7f600015a290 2023-10-09T06:20:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f600006acb0 msgr2=0x7f60000afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 --2- 172.21.15.31:0/2574145886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f600006acb0 0x7f60000afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 >> v2:172.21.15.158:3300/0 conn(0x7f6000159ec0 msgr2=0x7f60000af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 --2- 172.21.15.31:0/2574145886 >> v2:172.21.15.158:3300/0 conn(0x7f6000159ec0 0x7f60000af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60000b04b0 con 0x7f600015a290 2023-10-09T06:20:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f5fe8001470 con 0x7f600015a290 2023-10-09T06:20:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 >> v1:172.21.15.31:6789/0 conn(0x7f600015a290 legacy=0x7f600006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 --2- 172.21.15.31:0/2574145886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fec003a60 0x7f5fec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 --2- 172.21.15.31:0/2574145886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f600006acb0 0x7f5fec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 --2- 172.21.15.31:0/2574145886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fec004d50 0x7f5fec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60000ce1f0 con 0x7f5fec003a60 2023-10-09T06:20:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60000b0b20 con 0x7f5fec004d50 2023-10-09T06:20:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec00ba60 con 0x7f600006acb0 2023-10-09T06:20:51.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffeffd700 1 --2- 172.21.15.31:0/2574145886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fec003a60 0x7f5fec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5ffe7fc700 1 --2- 172.21.15.31:0/2574145886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f600006acb0 0x7f5fec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.705+0000 7f5fff7fe700 1 --2- 172.21.15.31:0/2574145886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fec004d50 0x7f5fec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f5ffeffd700 1 -- 172.21.15.31:0/2574145886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f600006acb0 msgr2=0x7f5fec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:51.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f5ffeffd700 1 --2- 172.21.15.31:0/2574145886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f600006acb0 0x7f5fec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f5ffeffd700 1 -- 172.21.15.31:0/2574145886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fec004d50 msgr2=0x7f5fec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:51.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f5ffeffd700 1 --2- 172.21.15.31:0/2574145886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fec004d50 0x7f5fec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f5ffeffd700 1 -- 172.21.15.31:0/2574145886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec003570 con 0x7f5fec003a60 2023-10-09T06:20:51.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f5ffeffd700 1 --2- 172.21.15.31:0/2574145886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fec003a60 0x7f5fec003e70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000e210 tx=0x7f5ff000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e928941129834136 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:51.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000ea60 con 0x7f5fec003a60 2023-10-09T06:20:51.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff000f040 con 0x7f5fec003a60 2023-10-09T06:20:51.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f5ffdffb700 1 -- 172.21.15.31:0/2574145886 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000ee10 con 0x7f5fec003a60 2023-10-09T06:20:51.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f60058f9700 1 -- 172.21.15.31:0/2574145886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fec003a60 msgr2=0x7f5fec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f60058f9700 1 --2- 172.21.15.31:0/2574145886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fec003a60 0x7f5fec003e70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000e210 tx=0x7f5ff000b040 comp rx=0 tx=0).stop 2023-10-09T06:20:51.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f5fff7fe700 1 -- 172.21.15.31:0/2574145886 reap_dead start 2023-10-09T06:20:51.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f60058f9700 1 -- 172.21.15.31:0/2574145886 shutdown_connections 2023-10-09T06:20:51.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f60058f9700 1 -- 172.21.15.31:0/2574145886 >> 172.21.15.31:0/2574145886 conn(0x7f60000d1880 msgr2=0x7f60000cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:51.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f60058f9700 1 -- 172.21.15.31:0/2574145886 shutdown_connections 2023-10-09T06:20:51.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.706+0000 7f60058f9700 1 -- 172.21.15.31:0/2574145886 wait complete. 2023-10-09T06:20:51.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.708+0000 7f60058f9700 1 Processor -- start 2023-10-09T06:20:51.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.708+0000 7f60058f9700 1 -- start start 2023-10-09T06:20:51.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.708+0000 7f60058f9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fec003a60 0x7f6000155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.708+0000 7f60058f9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60000c6c50 0x7f60000c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.708+0000 7f60058f9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60001561c0 0x7f6000156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.708+0000 7f60058f9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600015d7a0 con 0x7f60000c6c50 2023-10-09T06:20:51.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.708+0000 7f60058f9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60000c8cc0 con 0x7f5fec003a60 2023-10-09T06:20:51.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.708+0000 7f60058f9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60000c7600 con 0x7f60001561c0 2023-10-09T06:20:51.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ffe7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60000c6c50 0x7f60000c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ffe7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60000c6c50 0x7f60000c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56462/0 (socket says 172.21.15.31:56462) 2023-10-09T06:20:51.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ffe7fc700 1 -- 172.21.15.31:0/25761321 learned_addr learned my addr 172.21.15.31:0/25761321 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:51.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ffeffd700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fec003a60 0x7f6000155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5fff7fe700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60001561c0 0x7f6000156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ffe7fc700 1 -- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60001561c0 msgr2=0x7f6000156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ffe7fc700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60001561c0 0x7f6000156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ffe7fc700 1 -- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fec003a60 msgr2=0x7f6000155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ffe7fc700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fec003a60 0x7f6000155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ffe7fc700 1 -- 172.21.15.31:0/25761321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6000156b80 con 0x7f60000c6c50 2023-10-09T06:20:51.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ffeffd700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fec003a60 0x7f6000155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:20:51.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ffe7fc700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60000c6c50 0x7f60000c70c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8001120 tx=0x7f5fe8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:51.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ff6ffd700 1 -- 172.21.15.31:0/25761321 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8018030 con 0x7f60000c6c50 2023-10-09T06:20:51.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ff6ffd700 1 -- 172.21.15.31:0/25761321 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe800f8a0 con 0x7f60000c6c50 2023-10-09T06:20:51.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f60058f9700 1 -- 172.21.15.31:0/25761321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6000156e10 con 0x7f60000c6c50 2023-10-09T06:20:51.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f5ff6ffd700 1 -- 172.21.15.31:0/25761321 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800fc40 con 0x7f60000c6c50 2023-10-09T06:20:51.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.709+0000 7f60058f9700 1 -- 172.21.15.31:0/25761321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60001573d0 con 0x7f60000c6c50 2023-10-09T06:20:51.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.710+0000 7f60058f9700 1 -- 172.21.15.31:0/25761321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60000c8a90 con 0x7f60000c6c50 2023-10-09T06:20:51.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.711+0000 7f5ff6ffd700 1 -- 172.21.15.31:0/25761321 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fe801b070 con 0x7f60000c6c50 2023-10-09T06:20:51.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.711+0000 7f5ff6ffd700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5fe0066f30 0x7f5fe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:51.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.711+0000 7f5ff6ffd700 1 -- 172.21.15.31:0/25761321 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5fe8019070 con 0x7f60000c6c50 2023-10-09T06:20:51.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.711+0000 7f5ffeffd700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5fe0066f30 0x7f5fe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:51.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.712+0000 7f5ffeffd700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5fe0066f30 0x7f5fe00693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000afd0 tx=0x7f5ff001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:51.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.715+0000 7f5ff6ffd700 1 -- 172.21.15.31:0/25761321 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60000c8a90 con 0x7f60000c6c50 2023-10-09T06:20:51.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.909+0000 7f60058f9700 1 -- 172.21.15.31:0/25761321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60000c8a90 con 0x7f60000c6c50 2023-10-09T06:20:51.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.909+0000 7f5ff6ffd700 1 -- 172.21.15.31:0/25761321 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f60000c8a90 con 0x7f60000c6c50 2023-10-09T06:20:51.910 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:20:51.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.912+0000 7f60058f9700 1 -- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5fe0066f30 msgr2=0x7f5fe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.912+0000 7f60058f9700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5fe0066f30 0x7f5fe00693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000afd0 tx=0x7f5ff001a000 comp rx=0 tx=0).stop 2023-10-09T06:20:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.912+0000 7f60058f9700 1 -- 172.21.15.31:0/25761321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60000c6c50 msgr2=0x7f60000c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.912+0000 7f60058f9700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60000c6c50 0x7f60000c70c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8001120 tx=0x7f5fe8001e90 comp rx=0 tx=0).stop 2023-10-09T06:20:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.912+0000 7f60058f9700 1 -- 172.21.15.31:0/25761321 shutdown_connections 2023-10-09T06:20:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.912+0000 7f60058f9700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5fe0066f30 0x7f5fe00693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.912+0000 7f60058f9700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60001561c0 0x7f6000156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.912+0000 7f60058f9700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fec003a60 0x7f6000155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.912+0000 7f60058f9700 1 --2- 172.21.15.31:0/25761321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60000c6c50 0x7f60000c70c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:51.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.912+0000 7f60058f9700 1 -- 172.21.15.31:0/25761321 >> 172.21.15.31:0/25761321 conn(0x7f60000d1880 msgr2=0x7f60000b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:51.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.912+0000 7f60058f9700 1 -- 172.21.15.31:0/25761321 shutdown_connections 2023-10-09T06:20:51.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:51.912+0000 7f60058f9700 1 -- 172.21.15.31:0/25761321 wait complete. 2023-10-09T06:20:51.926 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:20:52.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.043+0000 7f6b420f9700 1 Processor -- start 2023-10-09T06:20:52.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.044+0000 7f6b420f9700 1 -- start start 2023-10-09T06:20:52.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.044+0000 7f6b420f9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6b3c0c87a0 0x7f6b3c161a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.044+0000 7f6b420f9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c067ba0 con 0x7f6b3c06a530 2023-10-09T06:20:52.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.044+0000 7f6b420f9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c067870 con 0x7f6b3c1568d0 2023-10-09T06:20:52.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.044+0000 7f6b420f9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3c15aa90 con 0x7f6b3c0c87a0 2023-10-09T06:20:52.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.044+0000 7f6b3affd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6b3c06a530 0x7f6b3c0c8090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50282/0 (socket says 172.21.15.31:50282) 2023-10-09T06:20:52.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.045+0000 7f6b3affd700 1 -- 172.21.15.31:0/271312770 learned_addr learned my addr 172.21.15.31:0/271312770 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:52.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.045+0000 7f6b3bfff700 1 --2- 172.21.15.31:0/271312770 >> v2:172.21.15.158:3300/0 conn(0x7f6b3c0c87a0 0x7f6b3c161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.045+0000 7f6b3a7fc700 1 -- 172.21.15.31:0/271312770 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374325357 0 0) 0x7f6b3c067ba0 con 0x7f6b3c06a530 2023-10-09T06:20:52.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.045+0000 7f6b3a7fc700 1 -- 172.21.15.31:0/271312770 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b24003570 con 0x7f6b3c06a530 2023-10-09T06:20:52.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.045+0000 7f6b3a7fc700 1 -- 172.21.15.31:0/271312770 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144176351 0 0) 0x7f6b3c067870 con 0x7f6b3c1568d0 2023-10-09T06:20:52.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.045+0000 7f6b3a7fc700 1 -- 172.21.15.31:0/271312770 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b3c067ba0 con 0x7f6b3c1568d0 2023-10-09T06:20:52.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.045+0000 7f6b3bfff700 1 -- 172.21.15.31:0/271312770 >> v1:172.21.15.158:6789/0 conn(0x7f6b3c1568d0 legacy=0x7f6b3c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.045+0000 7f6b3bfff700 1 -- 172.21.15.31:0/271312770 >> v1:172.21.15.31:6789/0 conn(0x7f6b3c06a530 legacy=0x7f6b3c0c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.045+0000 7f6b3bfff700 1 -- 172.21.15.31:0/271312770 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c0c8ca0 con 0x7f6b3c0c87a0 2023-10-09T06:20:52.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.045+0000 7f6b3bfff700 1 --2- 172.21.15.31:0/271312770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b3c0c87a0 0x7f6b3c161a80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009e60 tx=0x7f6b34009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=523bd86265084eec server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:52.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.045+0000 7f6b3a7fc700 1 -- 172.21.15.31:0/271312770 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400e070 con 0x7f6b3c0c87a0 2023-10-09T06:20:52.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.045+0000 7f6b3a7fc700 1 -- 172.21.15.31:0/271312770 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3400bab0 con 0x7f6b3c0c87a0 2023-10-09T06:20:52.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.045+0000 7f6b3a7fc700 1 -- 172.21.15.31:0/271312770 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400be70 con 0x7f6b3c0c87a0 2023-10-09T06:20:52.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.046+0000 7f6b420f9700 1 -- 172.21.15.31:0/271312770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b3c0c87a0 msgr2=0x7f6b3c161a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.046+0000 7f6b420f9700 1 --2- 172.21.15.31:0/271312770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b3c0c87a0 0x7f6b3c161a80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009e60 tx=0x7f6b34009780 comp rx=0 tx=0).stop 2023-10-09T06:20:52.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.046+0000 7f6b420f9700 1 -- 172.21.15.31:0/271312770 shutdown_connections 2023-10-09T06:20:52.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.046+0000 7f6b420f9700 1 --2- 172.21.15.31:0/271312770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b3c0c87a0 0x7f6b3c161a80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.046+0000 7f6b420f9700 1 -- 172.21.15.31:0/271312770 >> 172.21.15.31:0/271312770 conn(0x7f6b3c0cda50 msgr2=0x7f6b3c0cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:52.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.046+0000 7f6b420f9700 1 -- 172.21.15.31:0/271312770 shutdown_connections 2023-10-09T06:20:52.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.046+0000 7f6b420f9700 1 -- 172.21.15.31:0/271312770 wait complete. 2023-10-09T06:20:52.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.047+0000 7f6b420f9700 1 Processor -- start 2023-10-09T06:20:52.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.047+0000 7f6b420f9700 1 -- start start 2023-10-09T06:20:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b420f9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b3c06a530 0x7f6b3c0b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b420f9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b3c0c87a0 0x7f6b3c1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b420f9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b3c1568d0 0x7f6b3c158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b420f9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c167860 con 0x7f6b3c1568d0 2023-10-09T06:20:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b420f9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c159b50 con 0x7f6b3c06a530 2023-10-09T06:20:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b420f9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c16b1e0 con 0x7f6b3c0c87a0 2023-10-09T06:20:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b3bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b3c1568d0 0x7f6b3c158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b3bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b3c1568d0 0x7f6b3c158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56478/0 (socket says 172.21.15.31:56478) 2023-10-09T06:20:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b3bfff700 1 -- 172.21.15.31:0/3034399636 learned_addr learned my addr 172.21.15.31:0/3034399636 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b3affd700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b3c0c87a0 0x7f6b3c1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b3b7fe700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b3c06a530 0x7f6b3c0b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b3bfff700 1 -- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b3c0c87a0 msgr2=0x7f6b3c1582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b3bfff700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b3c0c87a0 0x7f6b3c1582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b3bfff700 1 -- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b3c06a530 msgr2=0x7f6b3c0b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b3bfff700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b3c06a530 0x7f6b3c0b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b3bfff700 1 -- 172.21.15.31:0/3034399636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34009a20 con 0x7f6b3c1568d0 2023-10-09T06:20:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b3b7fe700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b3c06a530 0x7f6b3c0b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:20:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.048+0000 7f6b3bfff700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b3c1568d0 0x7f6b3c158830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400b610 tx=0x7f6b34019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.049+0000 7f6b237fe700 1 -- 172.21.15.31:0/3034399636 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b34026480 con 0x7f6b3c1568d0 2023-10-09T06:20:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.049+0000 7f6b237fe700 1 -- 172.21.15.31:0/3034399636 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b340265e0 con 0x7f6b3c1568d0 2023-10-09T06:20:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.049+0000 7f6b420f9700 1 -- 172.21.15.31:0/3034399636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3c158f40 con 0x7f6b3c1568d0 2023-10-09T06:20:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.049+0000 7f6b237fe700 1 -- 172.21.15.31:0/3034399636 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b340269a0 con 0x7f6b3c1568d0 2023-10-09T06:20:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.049+0000 7f6b420f9700 1 -- 172.21.15.31:0/3034399636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c159500 con 0x7f6b3c1568d0 2023-10-09T06:20:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.050+0000 7f6b420f9700 1 -- 172.21.15.31:0/3034399636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3c04c3c0 con 0x7f6b3c1568d0 2023-10-09T06:20:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.050+0000 7f6b237fe700 1 -- 172.21.15.31:0/3034399636 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b3401c400 con 0x7f6b3c1568d0 2023-10-09T06:20:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.050+0000 7f6b237fe700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b28066f30 0x7f6b280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.051+0000 7f6b237fe700 1 -- 172.21.15.31:0/3034399636 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6b34086590 con 0x7f6b3c1568d0 2023-10-09T06:20:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.051+0000 7f6b3b7fe700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b28066f30 0x7f6b280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.051+0000 7f6b3b7fe700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b28066f30 0x7f6b280693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c003990 tx=0x7f6b2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:52.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.055+0000 7f6b237fe700 1 -- 172.21.15.31:0/3034399636 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b34053b50 con 0x7f6b3c1568d0 2023-10-09T06:20:52.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.252+0000 7f6b420f9700 1 -- 172.21.15.31:0/3034399636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6b3c06f8f0 con 0x7f6b3c1568d0 2023-10-09T06:20:52.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.252+0000 7f6b237fe700 1 -- 172.21.15.31:0/3034399636 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6b34057170 con 0x7f6b3c1568d0 2023-10-09T06:20:52.253 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:52.253 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-10-09T06:20:52.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:20:52.253 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-10-09T06:20:52.254 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-10-09T06:20:52.254 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:20:52.254 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-10-09T06:20:52.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.254+0000 7f6b420f9700 1 -- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b28066f30 msgr2=0x7f6b280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.254+0000 7f6b420f9700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b28066f30 0x7f6b280693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c003990 tx=0x7f6b2c009040 comp rx=0 tx=0).stop 2023-10-09T06:20:52.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.254+0000 7f6b420f9700 1 -- 172.21.15.31:0/3034399636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b3c1568d0 msgr2=0x7f6b3c158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.254+0000 7f6b420f9700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b3c1568d0 0x7f6b3c158830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400b610 tx=0x7f6b34019000 comp rx=0 tx=0).stop 2023-10-09T06:20:52.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.254+0000 7f6b420f9700 1 -- 172.21.15.31:0/3034399636 shutdown_connections 2023-10-09T06:20:52.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.254+0000 7f6b420f9700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b28066f30 0x7f6b280693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.254+0000 7f6b420f9700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b3c1568d0 0x7f6b3c158830 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.254+0000 7f6b420f9700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b3c06a530 0x7f6b3c0b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.254+0000 7f6b420f9700 1 --2- 172.21.15.31:0/3034399636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b3c0c87a0 0x7f6b3c1582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.254+0000 7f6b420f9700 1 -- 172.21.15.31:0/3034399636 >> 172.21.15.31:0/3034399636 conn(0x7f6b3c0cda50 msgr2=0x7f6b3c0ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:52.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.254+0000 7f6b420f9700 1 -- 172.21.15.31:0/3034399636 shutdown_connections 2023-10-09T06:20:52.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.254+0000 7f6b420f9700 1 -- 172.21.15.31:0/3034399636 wait complete. 2023-10-09T06:20:52.267 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:20:52.267 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:20:52.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.388+0000 7f45149d4700 1 Processor -- start 2023-10-09T06:20:52.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.388+0000 7f45149d4700 1 -- start start 2023-10-09T06:20:52.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f45149d4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4510159ef0 0x7f451015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f45149d4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45100b6a10 0x7f45100b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f45149d4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f45100b15e0 0x7f45100b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f45149d4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45100b1a60 con 0x7f45100b15e0 2023-10-09T06:20:52.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f45149d4700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45100b1d40 con 0x7f4510159ef0 2023-10-09T06:20:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f45149d4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45100b2020 con 0x7f45100b6a10 2023-10-09T06:20:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f450ed9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f45100b15e0 0x7f45100b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f450ed9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f45100b15e0 0x7f45100b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56486/0 (socket says 172.21.15.31:56486) 2023-10-09T06:20:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f450ed9d700 1 -- 172.21.15.31:0/955901971 learned_addr learned my addr 172.21.15.31:0/955901971 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f450dd9b700 1 --2- 172.21.15.31:0/955901971 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45100b6a10 0x7f45100b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f450e59c700 1 --2- 172.21.15.31:0/955901971 >> v2:172.21.15.158:3300/0 conn(0x7f4510159ef0 0x7f451015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f450ed9d700 1 -- 172.21.15.31:0/955901971 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45100b6a10 msgr2=0x7f45100b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f450ed9d700 1 --2- 172.21.15.31:0/955901971 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45100b6a10 0x7f45100b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f450ed9d700 1 -- 172.21.15.31:0/955901971 >> v2:172.21.15.158:3300/0 conn(0x7f4510159ef0 msgr2=0x7f451015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f450ed9d700 1 --2- 172.21.15.31:0/955901971 >> v2:172.21.15.158:3300/0 conn(0x7f4510159ef0 0x7f451015a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f450ed9d700 1 -- 172.21.15.31:0/955901971 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100b2300 con 0x7f45100b15e0 2023-10-09T06:20:52.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.389+0000 7f450ed9d700 1 --2- 172.21.15.31:0/955901971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45100b15e0 0x7f45100b46f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f451008a710 tx=0x7f4500009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e95064a3969e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:52.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.390+0000 7f450d59a700 1 -- 172.21.15.31:0/955901971 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450000e070 con 0x7f45100b15e0 2023-10-09T06:20:52.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.390+0000 7f450d59a700 1 -- 172.21.15.31:0/955901971 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450000ba50 con 0x7f45100b15e0 2023-10-09T06:20:52.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.390+0000 7f450d59a700 1 -- 172.21.15.31:0/955901971 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45000092e0 con 0x7f45100b15e0 2023-10-09T06:20:52.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.390+0000 7f45149d4700 1 -- 172.21.15.31:0/955901971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45100b15e0 msgr2=0x7f45100b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.390+0000 7f45149d4700 1 --2- 172.21.15.31:0/955901971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45100b15e0 0x7f45100b46f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f451008a710 tx=0x7f4500009840 comp rx=0 tx=0).stop 2023-10-09T06:20:52.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.390+0000 7f45149d4700 1 -- 172.21.15.31:0/955901971 shutdown_connections 2023-10-09T06:20:52.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.390+0000 7f45149d4700 1 --2- 172.21.15.31:0/955901971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45100b15e0 0x7f45100b46f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.390+0000 7f45149d4700 1 --2- 172.21.15.31:0/955901971 >> v2:172.21.15.158:3300/0 conn(0x7f4510159ef0 0x7f451015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.390+0000 7f45149d4700 1 --2- 172.21.15.31:0/955901971 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f45100b6a10 0x7f45100b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.390+0000 7f45149d4700 1 -- 172.21.15.31:0/955901971 >> 172.21.15.31:0/955901971 conn(0x7f451009a0a0 msgr2=0x7f4510067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:52.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.390+0000 7f45149d4700 1 -- 172.21.15.31:0/955901971 shutdown_connections 2023-10-09T06:20:52.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.390+0000 7f45149d4700 1 -- 172.21.15.31:0/955901971 wait complete. 2023-10-09T06:20:52.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.391+0000 7f45149d4700 1 Processor -- start 2023-10-09T06:20:52.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.391+0000 7f45149d4700 1 -- start start 2023-10-09T06:20:52.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f45149d4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45100b6a10 0x7f451016ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f45149d4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4510159ef0 0x7f451016c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f45149d4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4510151db0 0x7f4510152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f45149d4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4510152770 con 0x7f45100b6a10 2023-10-09T06:20:52.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f45149d4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451016cd30 con 0x7f4510159ef0 2023-10-09T06:20:52.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f45149d4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451016a8a0 con 0x7f4510151db0 2023-10-09T06:20:52.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f450e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45100b6a10 0x7f451016ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f450e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45100b6a10 0x7f451016ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56502/0 (socket says 172.21.15.31:56502) 2023-10-09T06:20:52.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f450e59c700 1 -- 172.21.15.31:0/1000894644 learned_addr learned my addr 172.21.15.31:0/1000894644 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:52.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f450ed9d700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4510151db0 0x7f4510152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f450dd9b700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4510159ef0 0x7f451016c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f450e59c700 1 -- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4510151db0 msgr2=0x7f4510152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f450e59c700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4510151db0 0x7f4510152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f450e59c700 1 -- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4510159ef0 msgr2=0x7f451016c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f450e59c700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4510159ef0 0x7f451016c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.392+0000 7f450e59c700 1 -- 172.21.15.31:0/1000894644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4500009ae0 con 0x7f45100b6a10 2023-10-09T06:20:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.393+0000 7f450e59c700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45100b6a10 0x7f451016ab10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f450800c8b0 tx=0x7f4508008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.393+0000 7f45067fc700 1 -- 172.21.15.31:0/1000894644 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508011600 con 0x7f45100b6a10 2023-10-09T06:20:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.393+0000 7f45067fc700 1 -- 172.21.15.31:0/1000894644 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4508011780 con 0x7f45100b6a10 2023-10-09T06:20:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.393+0000 7f45149d4700 1 -- 172.21.15.31:0/1000894644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451014f750 con 0x7f45100b6a10 2023-10-09T06:20:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.393+0000 7f45067fc700 1 -- 172.21.15.31:0/1000894644 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508011b40 con 0x7f45100b6a10 2023-10-09T06:20:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.393+0000 7f45149d4700 1 -- 172.21.15.31:0/1000894644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451014fd10 con 0x7f45100b6a10 2023-10-09T06:20:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.394+0000 7f45149d4700 1 -- 172.21.15.31:0/1000894644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451004c3c0 con 0x7f45100b6a10 2023-10-09T06:20:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.394+0000 7f45067fc700 1 -- 172.21.15.31:0/1000894644 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4508021350 con 0x7f45100b6a10 2023-10-09T06:20:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.395+0000 7f45067fc700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f44f0066f30 0x7f44f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.395+0000 7f45067fc700 1 -- 172.21.15.31:0/1000894644 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4508083d00 con 0x7f45100b6a10 2023-10-09T06:20:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.395+0000 7f450dd9b700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f44f0066f30 0x7f44f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.395+0000 7f450dd9b700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f44f0066f30 0x7f44f00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f45100b5ca0 tx=0x7f44f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:52.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.399+0000 7f45067fc700 1 -- 172.21.15.31:0/1000894644 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4508054d50 con 0x7f45100b6a10 2023-10-09T06:20:52.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.591+0000 7f45149d4700 1 -- 172.21.15.31:0/1000894644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f451015bd70 con 0x7f45100b6a10 2023-10-09T06:20:52.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.676+0000 7f45067fc700 1 -- 172.21.15.31:0/1000894644 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f45080548e0 con 0x7f45100b6a10 2023-10-09T06:20:52.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.679+0000 7f45149d4700 1 -- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f44f0066f30 msgr2=0x7f44f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.679+0000 7f45149d4700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f44f0066f30 0x7f44f00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f45100b5ca0 tx=0x7f44f8008040 comp rx=0 tx=0).stop 2023-10-09T06:20:52.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.679+0000 7f45149d4700 1 -- 172.21.15.31:0/1000894644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45100b6a10 msgr2=0x7f451016ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.679+0000 7f45149d4700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45100b6a10 0x7f451016ab10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f450800c8b0 tx=0x7f4508008040 comp rx=0 tx=0).stop 2023-10-09T06:20:52.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.679+0000 7f45149d4700 1 -- 172.21.15.31:0/1000894644 shutdown_connections 2023-10-09T06:20:52.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.679+0000 7f45149d4700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f44f0066f30 0x7f44f00693e0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f45100b5ca0 tx=0x7f44f8008040 comp rx=0 tx=0).stop 2023-10-09T06:20:52.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.679+0000 7f45149d4700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4510151db0 0x7f4510152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.679+0000 7f45149d4700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45100b6a10 0x7f451016ab10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.679+0000 7f45149d4700 1 --2- 172.21.15.31:0/1000894644 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4510159ef0 0x7f451016c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.679+0000 7f45149d4700 1 -- 172.21.15.31:0/1000894644 >> 172.21.15.31:0/1000894644 conn(0x7f451009a0a0 msgr2=0x7f451014eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:52.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.680+0000 7f45149d4700 1 -- 172.21.15.31:0/1000894644 shutdown_connections 2023-10-09T06:20:52.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.680+0000 7f45149d4700 1 -- 172.21.15.31:0/1000894644 wait complete. 2023-10-09T06:20:52.682 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-10-09T06:20:52.693 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:20:52.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.818+0000 7f9f65888700 1 Processor -- start 2023-10-09T06:20:52.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.818+0000 7f9f65888700 1 -- start start 2023-10-09T06:20:52.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f65888700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9f601542a0 0x7f9f600b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f65888700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f600cd630 0x7f9f6006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f65888700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f6006a830 0x7f9f6015d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f65888700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6015b2e0 con 0x7f9f600cd630 2023-10-09T06:20:52.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f65888700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6006b0a0 con 0x7f9f601542a0 2023-10-09T06:20:52.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f65888700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6006ac30 con 0x7f9f6006a830 2023-10-09T06:20:52.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f5ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f600cd630 0x7f9f6006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f5ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f600cd630 0x7f9f6006a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56518/0 (socket says 172.21.15.31:56518) 2023-10-09T06:20:52.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f5ffff700 1 -- 172.21.15.31:0/4103615862 learned_addr learned my addr 172.21.15.31:0/4103615862 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:52.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f65087700 1 --2- 172.21.15.31:0/4103615862 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f6006a830 0x7f9f6015d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f64886700 1 --2- 172.21.15.31:0/4103615862 >> v2:172.21.15.158:3300/0 conn(0x7f9f601542a0 0x7f9f600b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f5ffff700 1 -- 172.21.15.31:0/4103615862 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f6006a830 msgr2=0x7f9f6015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:52.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f5ffff700 1 --2- 172.21.15.31:0/4103615862 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f6006a830 0x7f9f6015d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f5ffff700 1 -- 172.21.15.31:0/4103615862 >> v2:172.21.15.158:3300/0 conn(0x7f9f601542a0 msgr2=0x7f9f600b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:52.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f5ffff700 1 --2- 172.21.15.31:0/4103615862 >> v2:172.21.15.158:3300/0 conn(0x7f9f601542a0 0x7f9f600b65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f5ffff700 1 -- 172.21.15.31:0/4103615862 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6015ad20 con 0x7f9f600cd630 2023-10-09T06:20:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.819+0000 7f9f5ffff700 1 --2- 172.21.15.31:0/4103615862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f600cd630 0x7f9f6006a2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9f600d1c50 tx=0x7f9f4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84d4a361357148 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.820+0000 7f9f5f7fe700 1 -- 172.21.15.31:0/4103615862 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00b860 con 0x7f9f600cd630 2023-10-09T06:20:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.820+0000 7f9f5f7fe700 1 -- 172.21.15.31:0/4103615862 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00b9c0 con 0x7f9f600cd630 2023-10-09T06:20:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.820+0000 7f9f5f7fe700 1 -- 172.21.15.31:0/4103615862 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00bd60 con 0x7f9f600cd630 2023-10-09T06:20:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.820+0000 7f9f65888700 1 -- 172.21.15.31:0/4103615862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f600cd630 msgr2=0x7f9f6006a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.820+0000 7f9f65888700 1 --2- 172.21.15.31:0/4103615862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f600cd630 0x7f9f6006a2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9f600d1c50 tx=0x7f9f4c009250 comp rx=0 tx=0).stop 2023-10-09T06:20:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.820+0000 7f9f65888700 1 -- 172.21.15.31:0/4103615862 shutdown_connections 2023-10-09T06:20:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.820+0000 7f9f65888700 1 --2- 172.21.15.31:0/4103615862 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f6006a830 0x7f9f6015d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.820+0000 7f9f65888700 1 --2- 172.21.15.31:0/4103615862 >> v2:172.21.15.158:3300/0 conn(0x7f9f601542a0 0x7f9f600b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.820+0000 7f9f65888700 1 --2- 172.21.15.31:0/4103615862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f600cd630 0x7f9f6006a2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.820+0000 7f9f65888700 1 -- 172.21.15.31:0/4103615862 >> 172.21.15.31:0/4103615862 conn(0x7f9f60068cb0 msgr2=0x7f9f600690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:52.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.820+0000 7f9f65888700 1 -- 172.21.15.31:0/4103615862 shutdown_connections 2023-10-09T06:20:52.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.820+0000 7f9f65888700 1 -- 172.21.15.31:0/4103615862 wait complete. 2023-10-09T06:20:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.821+0000 7f9f65888700 1 Processor -- start 2023-10-09T06:20:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.822+0000 7f9f65888700 1 -- start start 2023-10-09T06:20:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.822+0000 7f9f65888700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6006a830 0x7f9f60152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.822+0000 7f9f65888700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f600cd630 0x7f9f600d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.822+0000 7f9f65888700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f601542a0 0x7f9f600d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.822+0000 7f9f65888700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f60158440 con 0x7f9f6006a830 2023-10-09T06:20:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.822+0000 7f9f65888700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600c6080 con 0x7f9f600cd630 2023-10-09T06:20:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.822+0000 7f9f65888700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600c5a70 con 0x7f9f601542a0 2023-10-09T06:20:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.822+0000 7f9f64886700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6006a830 0x7f9f60152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.822+0000 7f9f64886700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6006a830 0x7f9f60152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56526/0 (socket says 172.21.15.31:56526) 2023-10-09T06:20:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.822+0000 7f9f64886700 1 -- 172.21.15.31:0/2656607314 learned_addr learned my addr 172.21.15.31:0/2656607314 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.822+0000 7f9f65087700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f601542a0 0x7f9f600d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.822+0000 7f9f5ffff700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f600cd630 0x7f9f600d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.823+0000 7f9f64886700 1 -- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f601542a0 msgr2=0x7f9f600d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.823+0000 7f9f64886700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f601542a0 0x7f9f600d07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.823+0000 7f9f64886700 1 -- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f600cd630 msgr2=0x7f9f600d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:52.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.823+0000 7f9f64886700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f600cd630 0x7f9f600d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:52.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.823+0000 7f9f64886700 1 -- 172.21.15.31:0/2656607314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c0094f0 con 0x7f9f6006a830 2023-10-09T06:20:52.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.823+0000 7f9f64886700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6006a830 0x7f9f60152890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400c880 tx=0x7f9f54008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:52.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.823+0000 7f9f5cff9700 1 -- 172.21.15.31:0/2656607314 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f54011600 con 0x7f9f6006a830 2023-10-09T06:20:52.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.823+0000 7f9f5cff9700 1 -- 172.21.15.31:0/2656607314 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f54011760 con 0x7f9f6006a830 2023-10-09T06:20:52.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.823+0000 7f9f65888700 1 -- 172.21.15.31:0/2656607314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6016ac70 con 0x7f9f6006a830 2023-10-09T06:20:52.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.823+0000 7f9f5cff9700 1 -- 172.21.15.31:0/2656607314 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f54011b00 con 0x7f9f6006a830 2023-10-09T06:20:52.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.823+0000 7f9f65888700 1 -- 172.21.15.31:0/2656607314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6016af50 con 0x7f9f6006a830 2023-10-09T06:20:52.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.824+0000 7f9f65888700 1 -- 172.21.15.31:0/2656607314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f60089550 con 0x7f9f6006a830 2023-10-09T06:20:52.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.825+0000 7f9f5cff9700 1 -- 172.21.15.31:0/2656607314 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f54018360 con 0x7f9f6006a830 2023-10-09T06:20:52.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.825+0000 7f9f5cff9700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f44066f30 0x7f9f440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:52.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.825+0000 7f9f5cff9700 1 -- 172.21.15.31:0/2656607314 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f9f540841e0 con 0x7f9f6006a830 2023-10-09T06:20:52.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.825+0000 7f9f5ffff700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f44066f30 0x7f9f440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:52.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.826+0000 7f9f5ffff700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f44066f30 0x7f9f440693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9f600d1c50 tx=0x7f9f4c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:52.830+0000 7f9f5cff9700 1 -- 172.21.15.31:0/2656607314 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f540550c0 con 0x7f9f6006a830 2023-10-09T06:20:53.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.023+0000 7f9f65888700 1 -- 172.21.15.31:0/2656607314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9f6015d610 con 0x7f9f6006a830 2023-10-09T06:20:53.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.680+0000 7f9f5cff9700 1 -- 172.21.15.31:0/2656607314 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9f54054c50 con 0x7f9f6006a830 2023-10-09T06:20:53.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.689+0000 7f9f65888700 1 -- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f44066f30 msgr2=0x7f9f440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:53.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.689+0000 7f9f65888700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f44066f30 0x7f9f440693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9f600d1c50 tx=0x7f9f4c017000 comp rx=0 tx=0).stop 2023-10-09T06:20:53.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.689+0000 7f9f65888700 1 -- 172.21.15.31:0/2656607314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6006a830 msgr2=0x7f9f60152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:53.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.689+0000 7f9f65888700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6006a830 0x7f9f60152890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400c880 tx=0x7f9f54008040 comp rx=0 tx=0).stop 2023-10-09T06:20:53.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.690+0000 7f9f65888700 1 -- 172.21.15.31:0/2656607314 shutdown_connections 2023-10-09T06:20:53.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.690+0000 7f9f65888700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f44066f30 0x7f9f440693e0 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9f600d1c50 tx=0x7f9f4c017000 comp rx=0 tx=0).stop 2023-10-09T06:20:53.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.690+0000 7f9f65888700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f601542a0 0x7f9f600d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:53.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.690+0000 7f9f65888700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6006a830 0x7f9f60152890 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400c880 tx=0x7f9f54008040 comp rx=0 tx=0).stop 2023-10-09T06:20:53.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.690+0000 7f9f65888700 1 --2- 172.21.15.31:0/2656607314 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f600cd630 0x7f9f600d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:53.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.690+0000 7f9f65888700 1 -- 172.21.15.31:0/2656607314 >> 172.21.15.31:0/2656607314 conn(0x7f9f60068cb0 msgr2=0x7f9f600cef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:53.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.690+0000 7f9f65888700 1 -- 172.21.15.31:0/2656607314 shutdown_connections 2023-10-09T06:20:53.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.690+0000 7f9f65888700 1 -- 172.21.15.31:0/2656607314 wait complete. 2023-10-09T06:20:53.694 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-10-09T06:20:53.706 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:20:53.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.829+0000 7f4f8f01c700 1 Processor -- start 2023-10-09T06:20:53.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.829+0000 7f4f8f01c700 1 -- start start 2023-10-09T06:20:53.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.830+0000 7f4f8f01c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f881413b0 0x7f4f88068a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:53.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.830+0000 7f4f8f01c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f88141780 0x7f4f88070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:53.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.830+0000 7f4f8f01c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4f8806e2e0 0x7f4f88070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:53.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.830+0000 7f4f8f01c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8806e8a0 con 0x7f4f88141780 2023-10-09T06:20:53.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.830+0000 7f4f8f01c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8806eb80 con 0x7f4f8806e2e0 2023-10-09T06:20:53.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.830+0000 7f4f8f01c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8806ee60 con 0x7f4f881413b0 2023-10-09T06:20:53.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.830+0000 7f4f87fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f88141780 0x7f4f88070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:53.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.830+0000 7f4f87fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f88141780 0x7f4f88070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56532/0 (socket says 172.21.15.31:56532) 2023-10-09T06:20:53.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.830+0000 7f4f87fff700 1 -- 172.21.15.31:0/4280240123 learned_addr learned my addr 172.21.15.31:0/4280240123 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:53.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f8d5b9700 1 --2- 172.21.15.31:0/4280240123 >> v2:172.21.15.158:3300/0 conn(0x7f4f8806e2e0 0x7f4f88070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:53.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f8cdb8700 1 --2- 172.21.15.31:0/4280240123 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f881413b0 0x7f4f88068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:53.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f87fff700 1 -- 172.21.15.31:0/4280240123 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f881413b0 msgr2=0x7f4f88068a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:53.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f87fff700 1 --2- 172.21.15.31:0/4280240123 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f881413b0 0x7f4f88068a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:53.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f87fff700 1 -- 172.21.15.31:0/4280240123 >> v2:172.21.15.158:3300/0 conn(0x7f4f8806e2e0 msgr2=0x7f4f88070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:53.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f87fff700 1 --2- 172.21.15.31:0/4280240123 >> v2:172.21.15.158:3300/0 conn(0x7f4f8806e2e0 0x7f4f88070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:53.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f87fff700 1 -- 172.21.15.31:0/4280240123 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8806f140 con 0x7f4f88141780 2023-10-09T06:20:53.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f8cdb8700 1 --2- 172.21.15.31:0/4280240123 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f881413b0 0x7f4f88068a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:20:53.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f87fff700 1 --2- 172.21.15.31:0/4280240123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f88141780 0x7f4f88070700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f880cd960 tx=0x7f4f7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f615ca1e48c0eab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:53.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f877fe700 1 -- 172.21.15.31:0/4280240123 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c00b860 con 0x7f4f88141780 2023-10-09T06:20:53.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f877fe700 1 -- 172.21.15.31:0/4280240123 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c00b9c0 con 0x7f4f88141780 2023-10-09T06:20:53.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f877fe700 1 -- 172.21.15.31:0/4280240123 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c00bd60 con 0x7f4f88141780 2023-10-09T06:20:53.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4280240123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f88141780 msgr2=0x7f4f88070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:53.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f8f01c700 1 --2- 172.21.15.31:0/4280240123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f88141780 0x7f4f88070700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f880cd960 tx=0x7f4f7c009250 comp rx=0 tx=0).stop 2023-10-09T06:20:53.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4280240123 shutdown_connections 2023-10-09T06:20:53.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f8f01c700 1 --2- 172.21.15.31:0/4280240123 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f881413b0 0x7f4f88068a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:53.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f8f01c700 1 --2- 172.21.15.31:0/4280240123 >> v2:172.21.15.158:3300/0 conn(0x7f4f8806e2e0 0x7f4f88070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:53.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f8f01c700 1 --2- 172.21.15.31:0/4280240123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f88141780 0x7f4f88070700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:53.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4280240123 >> 172.21.15.31:0/4280240123 conn(0x7f4f880ce570 msgr2=0x7f4f880ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:53.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.831+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4280240123 shutdown_connections 2023-10-09T06:20:53.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.832+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4280240123 wait complete. 2023-10-09T06:20:53.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.833+0000 7f4f8f01c700 1 Processor -- start 2023-10-09T06:20:53.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.833+0000 7f4f8f01c700 1 -- start start 2023-10-09T06:20:53.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.833+0000 7f4f8f01c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f8806e2e0 0x7f4f880c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:53.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.833+0000 7f4f8f01c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f881413b0 0x7f4f881392c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:53.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.833+0000 7f4f8f01c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f88141780 0x7f4f88168810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:53.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.833+0000 7f4f8f01c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88168330 con 0x7f4f88141780 2023-10-09T06:20:53.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.833+0000 7f4f8f01c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8816bdc0 con 0x7f4f881413b0 2023-10-09T06:20:53.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.833+0000 7f4f8f01c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8816c0a0 con 0x7f4f8806e2e0 2023-10-09T06:20:53.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f8d5b9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f88141780 0x7f4f88168810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:53.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f8d5b9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f88141780 0x7f4f88168810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56546/0 (socket says 172.21.15.31:56546) 2023-10-09T06:20:53.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f8d5b9700 1 -- 172.21.15.31:0/4079929250 learned_addr learned my addr 172.21.15.31:0/4079929250 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:53.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f87fff700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f881413b0 0x7f4f881392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:53.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f8cdb8700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f8806e2e0 0x7f4f880c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:53.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f8d5b9700 1 -- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f8806e2e0 msgr2=0x7f4f880c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f8d5b9700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f8806e2e0 0x7f4f880c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f8d5b9700 1 -- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f881413b0 msgr2=0x7f4f881392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f8d5b9700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f881413b0 0x7f4f881392c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f8d5b9700 1 -- 172.21.15.31:0/4079929250 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c0094f0 con 0x7f4f88141780 2023-10-09T06:20:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f8d5b9700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f88141780 0x7f4f88168810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800d890 tx=0x7f4f78008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f84ff9700 1 -- 172.21.15.31:0/4079929250 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f780125f0 con 0x7f4f88141780 2023-10-09T06:20:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f84ff9700 1 -- 172.21.15.31:0/4079929250 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f78012770 con 0x7f4f88141780 2023-10-09T06:20:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4079929250 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8816c380 con 0x7f4f88141780 2023-10-09T06:20:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f84ff9700 1 -- 172.21.15.31:0/4079929250 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78012b30 con 0x7f4f88141780 2023-10-09T06:20:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.834+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4079929250 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f880c71f0 con 0x7f4f88141780 2023-10-09T06:20:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.835+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4079929250 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f880b3760 con 0x7f4f88141780 2023-10-09T06:20:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.836+0000 7f4f84ff9700 1 -- 172.21.15.31:0/4079929250 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f7801e460 con 0x7f4f88141780 2023-10-09T06:20:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.836+0000 7f4f84ff9700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4f74066f30 0x7f4f740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.836+0000 7f4f84ff9700 1 -- 172.21.15.31:0/4079929250 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f4f78084a00 con 0x7f4f88141780 2023-10-09T06:20:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.836+0000 7f4f8cdb8700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4f74066f30 0x7f4f740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.837+0000 7f4f8cdb8700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4f74066f30 0x7f4f740693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000d6e0 tx=0x7f4f80007850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:53.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:53.841+0000 7f4f84ff9700 1 -- 172.21.15.31:0/4079929250 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f78055760 con 0x7f4f88141780 2023-10-09T06:20:54.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.078+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4079929250 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4f8804c430 con 0x7f4f88141780 2023-10-09T06:20:54.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.706+0000 7f4f84ff9700 1 -- 172.21.15.31:0/4079929250 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4f8804c430 con 0x7f4f88141780 2023-10-09T06:20:54.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.708+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4f74066f30 msgr2=0x7f4f740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:54.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.708+0000 7f4f8f01c700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4f74066f30 0x7f4f740693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000d6e0 tx=0x7f4f80007850 comp rx=0 tx=0).stop 2023-10-09T06:20:54.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.708+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4079929250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f88141780 msgr2=0x7f4f88168810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:54.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.708+0000 7f4f8f01c700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f88141780 0x7f4f88168810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800d890 tx=0x7f4f78008040 comp rx=0 tx=0).stop 2023-10-09T06:20:54.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.709+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4079929250 shutdown_connections 2023-10-09T06:20:54.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.709+0000 7f4f8f01c700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4f74066f30 0x7f4f740693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:54.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.709+0000 7f4f8f01c700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f8806e2e0 0x7f4f880c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:54.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.709+0000 7f4f8f01c700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f88141780 0x7f4f88168810 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:54.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.709+0000 7f4f8f01c700 1 --2- 172.21.15.31:0/4079929250 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f881413b0 0x7f4f881392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:54.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.709+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4079929250 >> 172.21.15.31:0/4079929250 conn(0x7f4f880ce570 msgr2=0x7f4f88140340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:54.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.709+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4079929250 shutdown_connections 2023-10-09T06:20:54.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.709+0000 7f4f8f01c700 1 -- 172.21.15.31:0/4079929250 wait complete. 2023-10-09T06:20:54.711 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 2 and data pool 3 2023-10-09T06:20:54.725 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:20:54.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.844+0000 7f513a069700 1 Processor -- start 2023-10-09T06:20:54.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.844+0000 7f513a069700 1 -- start start 2023-10-09T06:20:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f513a069700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f51340cf1c0 0x7f513415e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f513a069700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f513415a0c0 0x7f5134068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f513a069700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51340cca20 con 0x7f5134159cf0 2023-10-09T06:20:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f513a069700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513415ea40 con 0x7f513415a0c0 2023-10-09T06:20:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f513a069700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5134067660 con 0x7f51340cf1c0 2023-10-09T06:20:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f5133fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f513415a0c0 0x7f5134068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f5133fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f513415a0c0 0x7f5134068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56548/0 (socket says 172.21.15.31:56548) 2023-10-09T06:20:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f5133fff700 1 -- 172.21.15.31:0/1193133244 learned_addr learned my addr 172.21.15.31:0/1193133244 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:54.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f5132ffd700 1 --2- 172.21.15.31:0/1193133244 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f51340cf1c0 0x7f513415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f5133fff700 1 -- 172.21.15.31:0/1193133244 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f51340cf1c0 msgr2=0x7f513415e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f5133fff700 1 --2- 172.21.15.31:0/1193133244 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f51340cf1c0 0x7f513415e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f5133fff700 1 -- 172.21.15.31:0/1193133244 >> v1:172.21.15.158:6789/0 conn(0x7f5134159cf0 legacy=0x7f51340ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f5133fff700 1 -- 172.21.15.31:0/1193133244 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5134067f00 con 0x7f513415a0c0 2023-10-09T06:20:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f5133fff700 1 --2- 172.21.15.31:0/1193133244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f513415a0c0 0x7f5134068390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f512c009f20 tx=0x7f512c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eff86c257d57e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f51327fc700 1 -- 172.21.15.31:0/1193133244 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c00e070 con 0x7f513415a0c0 2023-10-09T06:20:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f51327fc700 1 -- 172.21.15.31:0/1193133244 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c00ba80 con 0x7f513415a0c0 2023-10-09T06:20:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.845+0000 7f51327fc700 1 -- 172.21.15.31:0/1193133244 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0092e0 con 0x7f513415a0c0 2023-10-09T06:20:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.846+0000 7f513a069700 1 -- 172.21.15.31:0/1193133244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f513415a0c0 msgr2=0x7f5134068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:54.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.846+0000 7f513a069700 1 --2- 172.21.15.31:0/1193133244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f513415a0c0 0x7f5134068390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f512c009f20 tx=0x7f512c009840 comp rx=0 tx=0).stop 2023-10-09T06:20:54.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.846+0000 7f513a069700 1 -- 172.21.15.31:0/1193133244 shutdown_connections 2023-10-09T06:20:54.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.846+0000 7f513a069700 1 --2- 172.21.15.31:0/1193133244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f513415a0c0 0x7f5134068390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:54.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.846+0000 7f513a069700 1 --2- 172.21.15.31:0/1193133244 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f51340cf1c0 0x7f513415e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:54.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.846+0000 7f513a069700 1 -- 172.21.15.31:0/1193133244 >> 172.21.15.31:0/1193133244 conn(0x7f513406c6e0 msgr2=0x7f5134069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:54.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.846+0000 7f513a069700 1 -- 172.21.15.31:0/1193133244 shutdown_connections 2023-10-09T06:20:54.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.846+0000 7f513a069700 1 -- 172.21.15.31:0/1193133244 wait complete. 2023-10-09T06:20:54.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.847+0000 7f513a069700 1 Processor -- start 2023-10-09T06:20:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.847+0000 7f513a069700 1 -- start start 2023-10-09T06:20:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f513a069700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f51340cf1c0 0x7f51340c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f513a069700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5134159cf0 0x7f51340abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f513a069700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f513415a0c0 0x7f51341551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f513a069700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51340b1cd0 con 0x7f5134159cf0 2023-10-09T06:20:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f513a069700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51340b1fb0 con 0x7f513415a0c0 2023-10-09T06:20:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f513a069700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51340b2290 con 0x7f51340cf1c0 2023-10-09T06:20:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f5132ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5134159cf0 0x7f51340abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f5132ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5134159cf0 0x7f51340abbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56556/0 (socket says 172.21.15.31:56556) 2023-10-09T06:20:54.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f5132ffd700 1 -- 172.21.15.31:0/3309549265 learned_addr learned my addr 172.21.15.31:0/3309549265 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f51337fe700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f51340cf1c0 0x7f51340c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f5133fff700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f513415a0c0 0x7f51341551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f5132ffd700 1 -- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f51340cf1c0 msgr2=0x7f51340c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f5132ffd700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f51340cf1c0 0x7f51340c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f5132ffd700 1 -- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f513415a0c0 msgr2=0x7f51341551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f5132ffd700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f513415a0c0 0x7f51341551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.848+0000 7f5132ffd700 1 -- 172.21.15.31:0/3309549265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c009ae0 con 0x7f5134159cf0 2023-10-09T06:20:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.849+0000 7f5132ffd700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5134159cf0 0x7f51340abbc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f512400d860 tx=0x7f5124008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.849+0000 7f511b7fe700 1 -- 172.21.15.31:0/3309549265 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51240125f0 con 0x7f5134159cf0 2023-10-09T06:20:54.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.849+0000 7f511b7fe700 1 -- 172.21.15.31:0/3309549265 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5124012750 con 0x7f5134159cf0 2023-10-09T06:20:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.849+0000 7f511b7fe700 1 -- 172.21.15.31:0/3309549265 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5124012af0 con 0x7f5134159cf0 2023-10-09T06:20:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.849+0000 7f513a069700 1 -- 172.21.15.31:0/3309549265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51340b2570 con 0x7f5134159cf0 2023-10-09T06:20:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.849+0000 7f513a069700 1 -- 172.21.15.31:0/3309549265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51340c84e0 con 0x7f5134159cf0 2023-10-09T06:20:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.850+0000 7f513a069700 1 -- 172.21.15.31:0/3309549265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51340c8700 con 0x7f5134159cf0 2023-10-09T06:20:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.850+0000 7f511b7fe700 1 -- 172.21.15.31:0/3309549265 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5124013480 con 0x7f5134159cf0 2023-10-09T06:20:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.850+0000 7f511b7fe700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5120066f30 0x7f51200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.851+0000 7f511b7fe700 1 -- 172.21.15.31:0/3309549265 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f51240848b0 con 0x7f5134159cf0 2023-10-09T06:20:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.851+0000 7f51337fe700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5120066f30 0x7f51200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:54.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.851+0000 7f51337fe700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5120066f30 0x7f51200693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5128003a80 tx=0x7f5128007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:54.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:54.855+0000 7f511b7fe700 1 -- 172.21.15.31:0/3309549265 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51240555b0 con 0x7f5134159cf0 2023-10-09T06:20:55.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.047+0000 7f513a069700 1 -- 172.21.15.31:0/3309549265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f513404c3c0 con 0x7f5134159cf0 2023-10-09T06:20:55.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.048+0000 7f511b7fe700 1 -- 172.21.15.31:0/3309549265 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f5124055140 con 0x7f5134159cf0 2023-10-09T06:20:55.048 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:55.049 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:54.080474+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:20:55.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.050+0000 7f513a069700 1 -- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5120066f30 msgr2=0x7f51200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:55.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.050+0000 7f513a069700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5120066f30 0x7f51200693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5128003a80 tx=0x7f5128007ec0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.050+0000 7f513a069700 1 -- 172.21.15.31:0/3309549265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5134159cf0 msgr2=0x7f51340abbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:55.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.050+0000 7f513a069700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5134159cf0 0x7f51340abbc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f512400d860 tx=0x7f5124008040 comp rx=0 tx=0).stop 2023-10-09T06:20:55.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.050+0000 7f513a069700 1 -- 172.21.15.31:0/3309549265 shutdown_connections 2023-10-09T06:20:55.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.050+0000 7f513a069700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5120066f30 0x7f51200693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.050+0000 7f513a069700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f51340cf1c0 0x7f51340c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.050+0000 7f513a069700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f513415a0c0 0x7f51341551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.050+0000 7f513a069700 1 --2- 172.21.15.31:0/3309549265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5134159cf0 0x7f51340abbc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.050+0000 7f513a069700 1 -- 172.21.15.31:0/3309549265 >> 172.21.15.31:0/3309549265 conn(0x7f513406c6e0 msgr2=0x7f51340c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:55.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.050+0000 7f513a069700 1 -- 172.21.15.31:0/3309549265 shutdown_connections 2023-10-09T06:20:55.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.050+0000 7f513a069700 1 -- 172.21.15.31:0/3309549265 wait complete. 2023-10-09T06:20:55.063 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:20:55.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.183+0000 7fada6618700 1 Processor -- start 2023-10-09T06:20:55.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.183+0000 7fada6618700 1 -- start start 2023-10-09T06:20:55.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.184+0000 7fada6618700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fada0157870 0x7fada015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:55.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.184+0000 7fada6618700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fada015a620 0x7fada015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:55.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.184+0000 7fada6618700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada015cbb0 con 0x7fada015d580 2023-10-09T06:20:55.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.184+0000 7fada6618700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada015bfa0 con 0x7fada015a620 2023-10-09T06:20:55.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.184+0000 7fada6618700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada015c280 con 0x7fada0157870 2023-10-09T06:20:55.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.184+0000 7fad9ffff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fada0157870 0x7fada015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:55.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.184+0000 7fad9f7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fada015a620 0x7fada015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:55.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.184+0000 7fad9ffff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fada0157870 0x7fada015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:38008/0 (socket says 172.21.15.31:38008) 2023-10-09T06:20:55.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.184+0000 7fad9ffff700 1 -- 172.21.15.31:0/1884107986 learned_addr learned my addr 172.21.15.31:0/1884107986 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.184+0000 7fada4bb5700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fada015d580 0x7fada0158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:55542/0 (socket says 172.21.15.31:55542) 2023-10-09T06:20:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.185+0000 7fad9ffff700 1 -- 172.21.15.31:0/1884107986 >> v2:172.21.15.158:3300/0 conn(0x7fada015a620 msgr2=0x7fada015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.185+0000 7fad9ffff700 1 --2- 172.21.15.31:0/1884107986 >> v2:172.21.15.158:3300/0 conn(0x7fada015a620 0x7fada015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.185+0000 7fad9ffff700 1 -- 172.21.15.31:0/1884107986 >> v1:172.21.15.158:6789/0 conn(0x7fada015d580 legacy=0x7fada0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.185+0000 7fad9ffff700 1 -- 172.21.15.31:0/1884107986 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada015c560 con 0x7fada0157870 2023-10-09T06:20:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.185+0000 7fad9ffff700 1 --2- 172.21.15.31:0/1884107986 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fada0157870 0x7fada015b6a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fad900099b0 tx=0x7fad90009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=990988021d5d00bf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.185+0000 7fad9effd700 1 -- 172.21.15.31:0/1884107986 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90009ea0 con 0x7fada0157870 2023-10-09T06:20:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.185+0000 7fad9effd700 1 -- 172.21.15.31:0/1884107986 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9000b860 con 0x7fada0157870 2023-10-09T06:20:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.185+0000 7fad9effd700 1 -- 172.21.15.31:0/1884107986 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9000bc00 con 0x7fada0157870 2023-10-09T06:20:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.186+0000 7fada6618700 1 -- 172.21.15.31:0/1884107986 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fada0157870 msgr2=0x7fada015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.186+0000 7fada6618700 1 --2- 172.21.15.31:0/1884107986 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fada0157870 0x7fada015b6a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fad900099b0 tx=0x7fad90009250 comp rx=0 tx=0).stop 2023-10-09T06:20:55.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.186+0000 7fada6618700 1 -- 172.21.15.31:0/1884107986 shutdown_connections 2023-10-09T06:20:55.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.186+0000 7fada6618700 1 --2- 172.21.15.31:0/1884107986 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fada0157870 0x7fada015b6a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.186+0000 7fada6618700 1 --2- 172.21.15.31:0/1884107986 >> v2:172.21.15.158:3300/0 conn(0x7fada015a620 0x7fada015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.186+0000 7fada6618700 1 -- 172.21.15.31:0/1884107986 >> 172.21.15.31:0/1884107986 conn(0x7fada0068ce0 msgr2=0x7fada00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:55.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.186+0000 7fada6618700 1 -- 172.21.15.31:0/1884107986 shutdown_connections 2023-10-09T06:20:55.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.186+0000 7fada6618700 1 -- 172.21.15.31:0/1884107986 wait complete. 2023-10-09T06:20:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.187+0000 7fada6618700 1 Processor -- start 2023-10-09T06:20:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.187+0000 7fada6618700 1 -- start start 2023-10-09T06:20:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fada6618700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fada0157870 0x7fada01536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fada6618700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fada015a620 0x7fada016df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fada6618700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fada015d580 0x7fada016e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fada6618700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada014e970 con 0x7fada015a620 2023-10-09T06:20:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fada6618700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada014eb00 con 0x7fada015d580 2023-10-09T06:20:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fada6618700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada0153be0 con 0x7fada0157870 2023-10-09T06:20:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fad9f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fada015a620 0x7fada016df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:55.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fad9f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fada015a620 0x7fada016df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56562/0 (socket says 172.21.15.31:56562) 2023-10-09T06:20:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fad9f7fe700 1 -- 172.21.15.31:0/3641954977 learned_addr learned my addr 172.21.15.31:0/3641954977 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fada4bb5700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fada015d580 0x7fada016e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fad9ffff700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fada0157870 0x7fada01536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fad9f7fe700 1 -- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fada0157870 msgr2=0x7fada01536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fad9f7fe700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fada0157870 0x7fada01536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fad9f7fe700 1 -- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fada015d580 msgr2=0x7fada016e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fad9f7fe700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fada015d580 0x7fada016e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fad9f7fe700 1 -- 172.21.15.31:0/3641954977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad900094f0 con 0x7fada015a620 2023-10-09T06:20:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fad9f7fe700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fada015a620 0x7fada016df30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fad8800ecb0 tx=0x7fad880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fad97fff700 1 -- 172.21.15.31:0/3641954977 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8800c9d0 con 0x7fada015a620 2023-10-09T06:20:55.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fad97fff700 1 -- 172.21.15.31:0/3641954977 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8800cb30 con 0x7fada015a620 2023-10-09T06:20:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fada6618700 1 -- 172.21.15.31:0/3641954977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada00b1ab0 con 0x7fada015a620 2023-10-09T06:20:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fad97fff700 1 -- 172.21.15.31:0/3641954977 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8800ced0 con 0x7fada015a620 2023-10-09T06:20:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.188+0000 7fada6618700 1 -- 172.21.15.31:0/3641954977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada00b2070 con 0x7fada015a620 2023-10-09T06:20:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.189+0000 7fada6618700 1 -- 172.21.15.31:0/3641954977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada014ecb0 con 0x7fada015a620 2023-10-09T06:20:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.190+0000 7fad97fff700 1 -- 172.21.15.31:0/3641954977 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad88013680 con 0x7fada015a620 2023-10-09T06:20:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.190+0000 7fad97fff700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad80066f30 0x7fad800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.190+0000 7fad97fff700 1 -- 172.21.15.31:0/3641954977 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad88084940 con 0x7fada015a620 2023-10-09T06:20:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.191+0000 7fad9ffff700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad80066f30 0x7fad800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:55.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.191+0000 7fad9ffff700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad80066f30 0x7fad800693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fad900099b0 tx=0x7fad90017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:55.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.195+0000 7fad97fff700 1 -- 172.21.15.31:0/3641954977 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fada014ecb0 con 0x7fada015a620 2023-10-09T06:20:55.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.388+0000 7fada6618700 1 -- 172.21.15.31:0/3641954977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fada014ecb0 con 0x7fada015a620 2023-10-09T06:20:55.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.389+0000 7fad97fff700 1 -- 172.21.15.31:0/3641954977 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fada014ecb0 con 0x7fada015a620 2023-10-09T06:20:55.390 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:55.390 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:54.080474+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:20:55.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.391+0000 7fada6618700 1 -- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad80066f30 msgr2=0x7fad800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:55.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.391+0000 7fada6618700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad80066f30 0x7fad800693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fad900099b0 tx=0x7fad90017000 comp rx=0 tx=0).stop 2023-10-09T06:20:55.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.391+0000 7fada6618700 1 -- 172.21.15.31:0/3641954977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fada015a620 msgr2=0x7fada016df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:55.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.391+0000 7fada6618700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fada015a620 0x7fada016df30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fad8800ecb0 tx=0x7fad880091a0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.391+0000 7fada6618700 1 -- 172.21.15.31:0/3641954977 shutdown_connections 2023-10-09T06:20:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.391+0000 7fada6618700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad80066f30 0x7fad800693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.391+0000 7fada6618700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fada0157870 0x7fada01536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.391+0000 7fada6618700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fada015d580 0x7fada016e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.391+0000 7fada6618700 1 --2- 172.21.15.31:0/3641954977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fada015a620 0x7fada016df30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.391+0000 7fada6618700 1 -- 172.21.15.31:0/3641954977 >> 172.21.15.31:0/3641954977 conn(0x7fada0068ce0 msgr2=0x7fada00690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.391+0000 7fada6618700 1 -- 172.21.15.31:0/3641954977 shutdown_connections 2023-10-09T06:20:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.392+0000 7fada6618700 1 -- 172.21.15.31:0/3641954977 wait complete. 2023-10-09T06:20:55.404 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:20:55.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:20:55.508 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:20:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.525+0000 7fd90e79d700 1 Processor -- start 2023-10-09T06:20:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.526+0000 7fd90e79d700 1 -- start start 2023-10-09T06:20:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.526+0000 7fd90e79d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd90806f060 0x7fd90815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.526+0000 7fd90e79d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9080ca250 0x7fd90815b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.526+0000 7fd90e79d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9080c7710 con 0x7fd90815b9a0 2023-10-09T06:20:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.526+0000 7fd90e79d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90806fcb0 con 0x7fd90806f060 2023-10-09T06:20:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.526+0000 7fd90e79d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080c79f0 con 0x7fd9080ca250 2023-10-09T06:20:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.526+0000 7fd90df9c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd90815b9a0 0x7fd9080c87b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50298/0 (socket says 172.21.15.31:50298) 2023-10-09T06:20:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd90df9c700 1 -- 172.21.15.31:0/565659602 learned_addr learned my addr 172.21.15.31:0/565659602 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd90d79b700 1 --2- 172.21.15.31:0/565659602 >> v2:172.21.15.158:3300/0 conn(0x7fd90806f060 0x7fd90815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd90cf9a700 1 --2- 172.21.15.31:0/565659602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9080ca250 0x7fd90815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd8fbfff700 1 -- 172.21.15.31:0/565659602 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493225957 0 0) 0x7fd9080c7710 con 0x7fd90815b9a0 2023-10-09T06:20:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd8fbfff700 1 -- 172.21.15.31:0/565659602 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f4003570 con 0x7fd90815b9a0 2023-10-09T06:20:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd90d79b700 1 -- 172.21.15.31:0/565659602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9080ca250 msgr2=0x7fd90815b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd90d79b700 1 --2- 172.21.15.31:0/565659602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9080ca250 0x7fd90815b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd90d79b700 1 -- 172.21.15.31:0/565659602 >> v1:172.21.15.31:6789/0 conn(0x7fd90815b9a0 legacy=0x7fd9080c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd90d79b700 1 -- 172.21.15.31:0/565659602 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9080c7cd0 con 0x7fd90806f060 2023-10-09T06:20:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd90cf9a700 1 --2- 172.21.15.31:0/565659602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9080ca250 0x7fd90815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:20:55.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd90d79b700 1 --2- 172.21.15.31:0/565659602 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd90806f060 0x7fd90815ac30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd9040098e0 tx=0x7fd9040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54d87f794fd16340 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:55.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd8fbfff700 1 -- 172.21.15.31:0/565659602 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904011630 con 0x7fd90806f060 2023-10-09T06:20:55.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd8fbfff700 1 -- 172.21.15.31:0/565659602 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd904011790 con 0x7fd90806f060 2023-10-09T06:20:55.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.527+0000 7fd8fbfff700 1 -- 172.21.15.31:0/565659602 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904011b10 con 0x7fd90806f060 2023-10-09T06:20:55.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.528+0000 7fd90e79d700 1 -- 172.21.15.31:0/565659602 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd90806f060 msgr2=0x7fd90815ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:55.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.528+0000 7fd90e79d700 1 --2- 172.21.15.31:0/565659602 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd90806f060 0x7fd90815ac30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd9040098e0 tx=0x7fd9040091a0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.528+0000 7fd90e79d700 1 -- 172.21.15.31:0/565659602 shutdown_connections 2023-10-09T06:20:55.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.528+0000 7fd90e79d700 1 --2- 172.21.15.31:0/565659602 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd90806f060 0x7fd90815ac30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.528+0000 7fd90e79d700 1 --2- 172.21.15.31:0/565659602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9080ca250 0x7fd90815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.528+0000 7fd90e79d700 1 -- 172.21.15.31:0/565659602 >> 172.21.15.31:0/565659602 conn(0x7fd9080cdba0 msgr2=0x7fd9080c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:55.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.528+0000 7fd90e79d700 1 -- 172.21.15.31:0/565659602 shutdown_connections 2023-10-09T06:20:55.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.528+0000 7fd90e79d700 1 -- 172.21.15.31:0/565659602 wait complete. 2023-10-09T06:20:55.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.530+0000 7fd90e79d700 1 Processor -- start 2023-10-09T06:20:55.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.530+0000 7fd90e79d700 1 -- start start 2023-10-09T06:20:55.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.530+0000 7fd90e79d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd90806f060 0x7fd908159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:55.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90e79d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9080ca250 0x7fd9080b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:55.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90e79d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd90815b9a0 0x7fd9080b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:55.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90e79d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080b05a0 con 0x7fd90815b9a0 2023-10-09T06:20:55.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90e79d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90809a9a0 con 0x7fd9080ca250 2023-10-09T06:20:55.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90e79d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080b25d0 con 0x7fd90806f060 2023-10-09T06:20:55.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90df9c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd90815b9a0 0x7fd9080b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:55.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90df9c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd90815b9a0 0x7fd9080b0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56566/0 (socket says 172.21.15.31:56566) 2023-10-09T06:20:55.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90df9c700 1 -- 172.21.15.31:0/4292938094 learned_addr learned my addr 172.21.15.31:0/4292938094 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:55.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90cf9a700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9080ca250 0x7fd9080b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:55.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90d79b700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd90806f060 0x7fd908159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:55.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90df9c700 1 -- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd90806f060 msgr2=0x7fd908159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:55.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90df9c700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd90806f060 0x7fd908159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90df9c700 1 -- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9080ca250 msgr2=0x7fd9080b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:55.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90df9c700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9080ca250 0x7fd9080b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:55.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90df9c700 1 -- 172.21.15.31:0/4292938094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc009420 con 0x7fd90815b9a0 2023-10-09T06:20:55.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90df9c700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd90815b9a0 0x7fd9080b0890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd90000cc40 tx=0x7fd900001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:55.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd8f97fa700 1 -- 172.21.15.31:0/4292938094 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90000a830 con 0x7fd90815b9a0 2023-10-09T06:20:55.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd8f97fa700 1 -- 172.21.15.31:0/4292938094 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90000a990 con 0x7fd90815b9a0 2023-10-09T06:20:55.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd8f97fa700 1 -- 172.21.15.31:0/4292938094 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90000ad10 con 0x7fd90815b9a0 2023-10-09T06:20:55.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90e79d700 1 -- 172.21.15.31:0/4292938094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd904009420 con 0x7fd90815b9a0 2023-10-09T06:20:55.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.531+0000 7fd90e79d700 1 -- 172.21.15.31:0/4292938094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9080b0020 con 0x7fd90815b9a0 2023-10-09T06:20:55.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.532+0000 7fd90e79d700 1 -- 172.21.15.31:0/4292938094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90806cb50 con 0x7fd90815b9a0 2023-10-09T06:20:55.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.533+0000 7fd8f97fa700 1 -- 172.21.15.31:0/4292938094 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd900007300 con 0x7fd90815b9a0 2023-10-09T06:20:55.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.533+0000 7fd8f97fa700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd8ec066f30 0x7fd8ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:55.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.533+0000 7fd8f97fa700 1 -- 172.21.15.31:0/4292938094 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd9000847c0 con 0x7fd90815b9a0 2023-10-09T06:20:55.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.533+0000 7fd90d79b700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd8ec066f30 0x7fd8ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:55.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.534+0000 7fd90d79b700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd8ec066f30 0x7fd8ec0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd9040091e0 tx=0x7fd904017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:55.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.537+0000 7fd8f97fa700 1 -- 172.21.15.31:0/4292938094 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd900051ab0 con 0x7fd90815b9a0 2023-10-09T06:20:55.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:55.777+0000 7fd90e79d700 1 -- 172.21.15.31:0/4292938094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd9080b2710 con 0x7fd90815b9a0 2023-10-09T06:20:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.714+0000 7fd8f97fa700 1 -- 172.21.15.31:0/4292938094 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd9000550d0 con 0x7fd90815b9a0 2023-10-09T06:20:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.717+0000 7fd90e79d700 1 -- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd8ec066f30 msgr2=0x7fd8ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.717+0000 7fd90e79d700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd8ec066f30 0x7fd8ec0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd9040091e0 tx=0x7fd904017000 comp rx=0 tx=0).stop 2023-10-09T06:20:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.717+0000 7fd90e79d700 1 -- 172.21.15.31:0/4292938094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd90815b9a0 msgr2=0x7fd9080b0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.717+0000 7fd90e79d700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd90815b9a0 0x7fd9080b0890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd90000cc40 tx=0x7fd900001a40 comp rx=0 tx=0).stop 2023-10-09T06:20:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.717+0000 7fd90e79d700 1 -- 172.21.15.31:0/4292938094 shutdown_connections 2023-10-09T06:20:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.717+0000 7fd90e79d700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd8ec066f30 0x7fd8ec0693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.717+0000 7fd90e79d700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd90806f060 0x7fd908159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.717+0000 7fd90e79d700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd90815b9a0 0x7fd9080b0890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.717+0000 7fd90e79d700 1 --2- 172.21.15.31:0/4292938094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9080ca250 0x7fd9080b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.717+0000 7fd90e79d700 1 -- 172.21.15.31:0/4292938094 >> 172.21.15.31:0/4292938094 conn(0x7fd9080cdba0 msgr2=0x7fd90815e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.717+0000 7fd90e79d700 1 -- 172.21.15.31:0/4292938094 shutdown_connections 2023-10-09T06:20:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.717+0000 7fd90e79d700 1 -- 172.21.15.31:0/4292938094 wait complete. 2023-10-09T06:20:56.733 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:20:56.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.861+0000 7f1ef59b5700 1 Processor -- start 2023-10-09T06:20:56.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.861+0000 7f1ef59b5700 1 -- start start 2023-10-09T06:20:56.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.862+0000 7f1ef59b5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c9390 0x7f1ef0164f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:56.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.862+0000 7f1ef59b5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef015e9a0 con 0x7f1ef00cbf10 2023-10-09T06:20:56.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.862+0000 7f1ef59b5700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef00cae70 con 0x7f1ef00678b0 2023-10-09T06:20:56.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.862+0000 7f1ef59b5700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00cb150 con 0x7f1ef00c9390 2023-10-09T06:20:56.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.862+0000 7f1eee7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1ef00cbf10 0x7f1ef015e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50304/0 (socket says 172.21.15.31:50304) 2023-10-09T06:20:56.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.862+0000 7f1eee7fc700 1 -- 172.21.15.31:0/525647665 learned_addr learned my addr 172.21.15.31:0/525647665 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:56.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.862+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386409961 0 0) 0x7f1ef015e9a0 con 0x7f1ef00cbf10 2023-10-09T06:20:56.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.862+0000 7f1eef7fe700 1 --2- 172.21.15.31:0/525647665 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c9390 0x7f1ef0164f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:56.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.862+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1edc003570 con 0x7f1ef00cbf10 2023-10-09T06:20:56.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.862+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3244309257 0 0) 0x7f1edc003570 con 0x7f1ef00cbf10 2023-10-09T06:20:56.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.862+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c9390 msgr2=0x7f1ef0164f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:56.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.862+0000 7f1eedffb700 1 --2- 172.21.15.31:0/525647665 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c9390 0x7f1ef0164f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:56.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 >> v1:172.21.15.158:6789/0 conn(0x7f1ef00678b0 legacy=0x7f1ef015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:56.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef00cb430 con 0x7f1ef00cbf10 2023-10-09T06:20:56.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f1ed8001470 con 0x7f1ef00cbf10 2023-10-09T06:20:56.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 >> v1:172.21.15.31:6789/0 conn(0x7f1ef00cbf10 legacy=0x7f1ef015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:56.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eedffb700 1 --2- 172.21.15.31:0/525647665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc003a90 0x7f1edc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:56.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eedffb700 1 --2- 172.21.15.31:0/525647665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1edc004810 0x7f1edc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:56.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eedffb700 1 --2- 172.21.15.31:0/525647665 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c9390 0x7f1edc005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:56.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00cb150 con 0x7f1edc003a90 2023-10-09T06:20:56.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc00bc50 con 0x7f1edc004810 2023-10-09T06:20:56.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc00be10 con 0x7f1ef00c9390 2023-10-09T06:20:56.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eeeffd700 1 --2- 172.21.15.31:0/525647665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc003a90 0x7f1edc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:56.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eee7fc700 1 --2- 172.21.15.31:0/525647665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1edc004810 0x7f1edc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:56.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eef7fe700 1 --2- 172.21.15.31:0/525647665 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c9390 0x7f1edc005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:56.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eeeffd700 1 -- 172.21.15.31:0/525647665 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c9390 msgr2=0x7f1edc005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:56.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eeeffd700 1 --2- 172.21.15.31:0/525647665 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c9390 0x7f1edc005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:56.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eeeffd700 1 -- 172.21.15.31:0/525647665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1edc004810 msgr2=0x7f1edc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:56.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eeeffd700 1 --2- 172.21.15.31:0/525647665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1edc004810 0x7f1edc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eeeffd700 1 -- 172.21.15.31:0/525647665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc003570 con 0x7f1edc003a90 2023-10-09T06:20:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eeeffd700 1 --2- 172.21.15.31:0/525647665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc003a90 0x7f1edc003ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8001880 tx=0x7f1ee8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf631b5989a7c786 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8012420 con 0x7f1edc003a90 2023-10-09T06:20:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee8012580 con 0x7f1edc003a90 2023-10-09T06:20:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.863+0000 7f1eedffb700 1 -- 172.21.15.31:0/525647665 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8012920 con 0x7f1edc003a90 2023-10-09T06:20:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.864+0000 7f1ef59b5700 1 -- 172.21.15.31:0/525647665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc003a90 msgr2=0x7f1edc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.864+0000 7f1ef59b5700 1 --2- 172.21.15.31:0/525647665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc003a90 0x7f1edc003ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8001880 tx=0x7f1ee8007d30 comp rx=0 tx=0).stop 2023-10-09T06:20:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.864+0000 7f1eef7fe700 1 -- 172.21.15.31:0/525647665 reap_dead start 2023-10-09T06:20:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.864+0000 7f1ef59b5700 1 -- 172.21.15.31:0/525647665 shutdown_connections 2023-10-09T06:20:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.864+0000 7f1ef59b5700 1 -- 172.21.15.31:0/525647665 >> 172.21.15.31:0/525647665 conn(0x7f1ef0069870 msgr2=0x7f1ef0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:56.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.864+0000 7f1ef59b5700 1 -- 172.21.15.31:0/525647665 shutdown_connections 2023-10-09T06:20:56.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.864+0000 7f1ef59b5700 1 -- 172.21.15.31:0/525647665 wait complete. 2023-10-09T06:20:56.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.865+0000 7f1ef59b5700 1 Processor -- start 2023-10-09T06:20:56.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.865+0000 7f1ef59b5700 1 -- start start 2023-10-09T06:20:56.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1ef59b5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc003a90 0x7f1ef0151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:56.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1ef59b5700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ef00ce160 0x7f1ef016acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:56.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1ef59b5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c3fb0 0x7f1ef00c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:56.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1ef59b5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef0151d90 con 0x7f1edc003a90 2023-10-09T06:20:56.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1ef59b5700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00c4970 con 0x7f1ef00ce160 2023-10-09T06:20:56.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1ef59b5700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00ce5d0 con 0x7f1ef00c3fb0 2023-10-09T06:20:56.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1eeeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc003a90 0x7f1ef0151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:56.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1eeeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc003a90 0x7f1ef0151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56584/0 (socket says 172.21.15.31:56584) 2023-10-09T06:20:56.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1eeeffd700 1 -- 172.21.15.31:0/2065306640 learned_addr learned my addr 172.21.15.31:0/2065306640 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:56.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1eef7fe700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c3fb0 0x7f1ef00c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:56.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1eee7fc700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ef00ce160 0x7f1ef016acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:56.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1eeeffd700 1 -- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c3fb0 msgr2=0x7f1ef00c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:56.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1eeeffd700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c3fb0 0x7f1ef00c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:56.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1eeeffd700 1 -- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ef00ce160 msgr2=0x7f1ef016acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:56.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1eeeffd700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ef00ce160 0x7f1ef016acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:56.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1eeeffd700 1 -- 172.21.15.31:0/2065306640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef00ce8b0 con 0x7f1edc003a90 2023-10-09T06:20:56.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1eef7fe700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c3fb0 0x7f1ef00c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:20:56.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1eee7fc700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ef00ce160 0x7f1ef016acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:20:56.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.866+0000 7f1eeeffd700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc003a90 0x7f1ef0151850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8011e80 tx=0x7f1ee8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:56.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.867+0000 7f1ee6ffd700 1 -- 172.21.15.31:0/2065306640 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8012ea0 con 0x7f1edc003a90 2023-10-09T06:20:56.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.867+0000 7f1ee6ffd700 1 -- 172.21.15.31:0/2065306640 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee8001200 con 0x7f1edc003a90 2023-10-09T06:20:56.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.867+0000 7f1ef59b5700 1 -- 172.21.15.31:0/2065306640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef00ceb90 con 0x7f1edc003a90 2023-10-09T06:20:56.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.867+0000 7f1ee6ffd700 1 -- 172.21.15.31:0/2065306640 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8006820 con 0x7f1edc003a90 2023-10-09T06:20:56.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.867+0000 7f1ef59b5700 1 -- 172.21.15.31:0/2065306640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef00cf150 con 0x7f1edc003a90 2023-10-09T06:20:56.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.868+0000 7f1ef59b5700 1 -- 172.21.15.31:0/2065306640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef00cf370 con 0x7f1edc003a90 2023-10-09T06:20:56.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.868+0000 7f1ee6ffd700 1 -- 172.21.15.31:0/2065306640 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ee8019070 con 0x7f1edc003a90 2023-10-09T06:20:56.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.868+0000 7f1ee6ffd700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ed0066f30 0x7f1ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:56.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.869+0000 7f1ee6ffd700 1 -- 172.21.15.31:0/2065306640 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ee8085370 con 0x7f1edc003a90 2023-10-09T06:20:56.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.869+0000 7f1eee7fc700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ed0066f30 0x7f1ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:56.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.869+0000 7f1eee7fc700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ed0066f30 0x7f1ed00693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00c9190 tx=0x7f1ed8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:56.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:56.873+0000 7f1ee6ffd700 1 -- 172.21.15.31:0/2065306640 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ee80525e0 con 0x7f1edc003a90 2023-10-09T06:20:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.114+0000 7f1ef59b5700 1 -- 172.21.15.31:0/2065306640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1ef004c3c0 con 0x7f1edc003a90 2023-10-09T06:20:57.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.715+0000 7f1ee6ffd700 1 -- 172.21.15.31:0/2065306640 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1ee8055c00 con 0x7f1edc003a90 2023-10-09T06:20:57.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.717+0000 7f1ef59b5700 1 -- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ed0066f30 msgr2=0x7f1ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:57.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.717+0000 7f1ef59b5700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ed0066f30 0x7f1ed00693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00c9190 tx=0x7f1ed8009040 comp rx=0 tx=0).stop 2023-10-09T06:20:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.717+0000 7f1ef59b5700 1 -- 172.21.15.31:0/2065306640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc003a90 msgr2=0x7f1ef0151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.717+0000 7f1ef59b5700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc003a90 0x7f1ef0151850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8011e80 tx=0x7f1ee8015000 comp rx=0 tx=0).stop 2023-10-09T06:20:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.717+0000 7f1ef59b5700 1 -- 172.21.15.31:0/2065306640 shutdown_connections 2023-10-09T06:20:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.717+0000 7f1ef59b5700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ed0066f30 0x7f1ed00693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.717+0000 7f1ef59b5700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ef00c3fb0 0x7f1ef00c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.717+0000 7f1ef59b5700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc003a90 0x7f1ef0151850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.717+0000 7f1ef59b5700 1 --2- 172.21.15.31:0/2065306640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ef00ce160 0x7f1ef016acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.717+0000 7f1ef59b5700 1 -- 172.21.15.31:0/2065306640 >> 172.21.15.31:0/2065306640 conn(0x7f1ef0069870 msgr2=0x7f1ef00b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.718+0000 7f1ef59b5700 1 -- 172.21.15.31:0/2065306640 shutdown_connections 2023-10-09T06:20:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.718+0000 7f1ef59b5700 1 -- 172.21.15.31:0/2065306640 wait complete. 2023-10-09T06:20:57.731 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:20:57.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.852+0000 7f82c0ca3700 1 Processor -- start 2023-10-09T06:20:57.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.852+0000 7f82c0ca3700 1 -- start start 2023-10-09T06:20:57.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82c0ca3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f82bc15a2b0 0x7f82bc0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:57.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82c0ca3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82bc0d1c30 0x7f82bc0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:57.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82c0ca3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc0c5d80 con 0x7f82bc15a680 2023-10-09T06:20:57.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82c0ca3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82bc068470 con 0x7f82bc15a2b0 2023-10-09T06:20:57.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82c0ca3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0c6060 con 0x7f82bc0d1c30 2023-10-09T06:20:57.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82ba59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f82bc15a2b0 0x7f82bc0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:57.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82ba59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f82bc15a2b0 0x7f82bc0b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56586/0 (socket says 172.21.15.31:56586) 2023-10-09T06:20:57.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82ba59c700 1 -- 172.21.15.31:0/2137270977 learned_addr learned my addr 172.21.15.31:0/2137270977 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:57.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82b9d9b700 1 --2- 172.21.15.31:0/2137270977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82bc0d1c30 0x7f82bc0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:57.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82ba59c700 1 -- 172.21.15.31:0/2137270977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82bc0d1c30 msgr2=0x7f82bc0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:57.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82ba59c700 1 --2- 172.21.15.31:0/2137270977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82bc0d1c30 0x7f82bc0cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:57.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82ba59c700 1 -- 172.21.15.31:0/2137270977 >> v1:172.21.15.158:6789/0 conn(0x7f82bc15a680 legacy=0x7f82bc0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:57.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82ba59c700 1 -- 172.21.15.31:0/2137270977 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0c6340 con 0x7f82bc15a2b0 2023-10-09T06:20:57.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82ba59c700 1 --2- 172.21.15.31:0/2137270977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82bc15a2b0 0x7f82bc0b3da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009f70 tx=0x7f82ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3427efa38679a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:57.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82b959a700 1 -- 172.21.15.31:0/2137270977 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac00e070 con 0x7f82bc15a2b0 2023-10-09T06:20:57.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82b959a700 1 -- 172.21.15.31:0/2137270977 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac00ba90 con 0x7f82bc15a2b0 2023-10-09T06:20:57.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.853+0000 7f82b959a700 1 -- 172.21.15.31:0/2137270977 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0092e0 con 0x7f82bc15a2b0 2023-10-09T06:20:57.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.854+0000 7f82c0ca3700 1 -- 172.21.15.31:0/2137270977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82bc15a2b0 msgr2=0x7f82bc0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:57.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.854+0000 7f82c0ca3700 1 --2- 172.21.15.31:0/2137270977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82bc15a2b0 0x7f82bc0b3da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009f70 tx=0x7f82ac009840 comp rx=0 tx=0).stop 2023-10-09T06:20:57.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.854+0000 7f82c0ca3700 1 -- 172.21.15.31:0/2137270977 shutdown_connections 2023-10-09T06:20:57.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.854+0000 7f82c0ca3700 1 --2- 172.21.15.31:0/2137270977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82bc15a2b0 0x7f82bc0b3da0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:57.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.854+0000 7f82c0ca3700 1 --2- 172.21.15.31:0/2137270977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82bc0d1c30 0x7f82bc0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:57.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.854+0000 7f82c0ca3700 1 -- 172.21.15.31:0/2137270977 >> 172.21.15.31:0/2137270977 conn(0x7f82bc067e40 msgr2=0x7f82bc0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:57.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.854+0000 7f82c0ca3700 1 -- 172.21.15.31:0/2137270977 shutdown_connections 2023-10-09T06:20:57.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.854+0000 7f82c0ca3700 1 -- 172.21.15.31:0/2137270977 wait complete. 2023-10-09T06:20:57.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.855+0000 7f82c0ca3700 1 Processor -- start 2023-10-09T06:20:57.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.855+0000 7f82c0ca3700 1 -- start start 2023-10-09T06:20:57.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82c0ca3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82bc0d1c30 0x7f82bc155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:57.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82c0ca3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82bc15a2b0 0x7f82bc0b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:57.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82c0ca3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82bc15a680 0x7f82bc0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:57.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82c0ca3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0c9ce0 con 0x7f82bc0d1c30 2023-10-09T06:20:57.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82c0ca3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc15c380 con 0x7f82bc15a680 2023-10-09T06:20:57.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82c0ca3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc15c810 con 0x7f82bc15a2b0 2023-10-09T06:20:57.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82ba59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82bc0d1c30 0x7f82bc155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:57.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82ba59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82bc0d1c30 0x7f82bc155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56594/0 (socket says 172.21.15.31:56594) 2023-10-09T06:20:57.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82ba59c700 1 -- 172.21.15.31:0/4042680725 learned_addr learned my addr 172.21.15.31:0/4042680725 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:57.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82ba59c700 1 -- 172.21.15.31:0/4042680725 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82bc15a2b0 msgr2=0x7f82bc0b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:57.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82ba59c700 1 --2- 172.21.15.31:0/4042680725 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82bc15a2b0 0x7f82bc0b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:57.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82ba59c700 1 -- 172.21.15.31:0/4042680725 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82bc15a680 msgr2=0x7f82bc0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:57.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82ba59c700 1 --2- 172.21.15.31:0/4042680725 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82bc15a680 0x7f82bc0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:57.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82ba59c700 1 -- 172.21.15.31:0/4042680725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac009ae0 con 0x7f82bc0d1c30 2023-10-09T06:20:57.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.856+0000 7f82ba59c700 1 --2- 172.21.15.31:0/4042680725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82bc0d1c30 0x7f82bc155f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009880 tx=0x7f82ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:57.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.857+0000 7f82b27fc700 1 -- 172.21.15.31:0/4042680725 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac012b90 con 0x7f82bc0d1c30 2023-10-09T06:20:57.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.857+0000 7f82b27fc700 1 -- 172.21.15.31:0/4042680725 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac012d10 con 0x7f82bc0d1c30 2023-10-09T06:20:57.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.857+0000 7f82c0ca3700 1 -- 172.21.15.31:0/4042680725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc15b770 con 0x7f82bc0d1c30 2023-10-09T06:20:57.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.857+0000 7f82b27fc700 1 -- 172.21.15.31:0/4042680725 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac01e680 con 0x7f82bc0d1c30 2023-10-09T06:20:57.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.857+0000 7f82c0ca3700 1 -- 172.21.15.31:0/4042680725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82bc15bd30 con 0x7f82bc0d1c30 2023-10-09T06:20:57.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.858+0000 7f82c0ca3700 1 -- 172.21.15.31:0/4042680725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82bc04c3c0 con 0x7f82bc0d1c30 2023-10-09T06:20:57.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.858+0000 7f82b27fc700 1 -- 172.21.15.31:0/4042680725 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82ac01eab0 con 0x7f82bc0d1c30 2023-10-09T06:20:57.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.859+0000 7f82b27fc700 1 --2- 172.21.15.31:0/4042680725 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f829c066f30 0x7f829c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:57.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.859+0000 7f82b27fc700 1 -- 172.21.15.31:0/4042680725 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82ac086110 con 0x7f82bc0d1c30 2023-10-09T06:20:57.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.859+0000 7f82b9d9b700 1 --2- 172.21.15.31:0/4042680725 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f829c066f30 0x7f829c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:57.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.859+0000 7f82b9d9b700 1 --2- 172.21.15.31:0/4042680725 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f829c066f30 0x7f829c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f82bc15df90 tx=0x7f82a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:57.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:57.863+0000 7f82b27fc700 1 -- 172.21.15.31:0/4042680725 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82ac053380 con 0x7f82bc0d1c30 2023-10-09T06:20:58.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.101+0000 7f82c0ca3700 1 -- 172.21.15.31:0/4042680725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82bc064a00 con 0x7f82bc0d1c30 2023-10-09T06:20:58.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.101+0000 7f82b27fc700 1 -- 172.21.15.31:0/4042680725 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f82ac0569a0 con 0x7f82bc0d1c30 2023-10-09T06:20:58.102 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:58.102 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3437172994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3437172994},{"type":"v1","addr":"172.21.15.158:6836","nonce":3437172994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2894447386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2894447386},{"type":"v1","addr":"172.21.15.31:6834","nonce":2894447386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1034055293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1034055293},{"type":"v1","addr":"172.21.15.31:6835","nonce":1034055293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:20:54.080779+0000","modified":"2023-10-09T06:20:57.714511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1189249944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1189249944},{"type":"v1","addr":"172.21.15.158:6837","nonce":1189249944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:20:58.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.103+0000 7f82c0ca3700 1 -- 172.21.15.31:0/4042680725 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f829c066f30 msgr2=0x7f829c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.103+0000 7f82c0ca3700 1 --2- 172.21.15.31:0/4042680725 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f829c066f30 0x7f829c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f82bc15df90 tx=0x7f82a4008040 comp rx=0 tx=0).stop 2023-10-09T06:20:58.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.103+0000 7f82c0ca3700 1 -- 172.21.15.31:0/4042680725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82bc0d1c30 msgr2=0x7f82bc155f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.103+0000 7f82c0ca3700 1 --2- 172.21.15.31:0/4042680725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82bc0d1c30 0x7f82bc155f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009880 tx=0x7f82ac017000 comp rx=0 tx=0).stop 2023-10-09T06:20:58.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.103+0000 7f82c0ca3700 1 -- 172.21.15.31:0/4042680725 shutdown_connections 2023-10-09T06:20:58.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.103+0000 7f82c0ca3700 1 --2- 172.21.15.31:0/4042680725 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f829c066f30 0x7f829c0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.103+0000 7f82c0ca3700 1 --2- 172.21.15.31:0/4042680725 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82bc15a680 0x7f82bc0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.103+0000 7f82c0ca3700 1 --2- 172.21.15.31:0/4042680725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82bc0d1c30 0x7f82bc155f70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.103+0000 7f82c0ca3700 1 --2- 172.21.15.31:0/4042680725 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82bc15a2b0 0x7f82bc0b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.103+0000 7f82c0ca3700 1 -- 172.21.15.31:0/4042680725 >> 172.21.15.31:0/4042680725 conn(0x7f82bc067e40 msgr2=0x7f82bc158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:58.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.103+0000 7f82c0ca3700 1 -- 172.21.15.31:0/4042680725 shutdown_connections 2023-10-09T06:20:58.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.103+0000 7f82c0ca3700 1 -- 172.21.15.31:0/4042680725 wait complete. 2023-10-09T06:20:58.105 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2023-10-09T06:20:58.116 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:20:58.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.233+0000 7f9b1fe35700 1 Processor -- start 2023-10-09T06:20:58.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.234+0000 7f9b1fe35700 1 -- start start 2023-10-09T06:20:58.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.234+0000 7f9b1fe35700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9b18157870 0x7f9b1815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.234+0000 7f9b1fe35700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9b18157c40 0x7f9b18158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.234+0000 7f9b1fe35700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1815cbb0 con 0x7f9b1815a620 2023-10-09T06:20:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.234+0000 7f9b1fe35700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1815bfa0 con 0x7f9b18157c40 2023-10-09T06:20:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.234+0000 7f9b1fe35700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1815c280 con 0x7f9b18157870 2023-10-09T06:20:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1e3d2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9b18157c40 0x7f9b18158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1d3d0700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9b1815a620 0x7f9b1815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50314/0 (socket says 172.21.15.31:50314) 2023-10-09T06:20:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1d3d0700 1 -- 172.21.15.31:0/1899535585 learned_addr learned my addr 172.21.15.31:0/1899535585 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1dbd1700 1 --2- 172.21.15.31:0/1899535585 >> v2:172.21.15.158:3300/0 conn(0x7f9b18157870 0x7f9b1815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1e3d2700 1 -- 172.21.15.31:0/1899535585 >> v2:172.21.15.158:3300/0 conn(0x7f9b18157870 msgr2=0x7f9b1815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1e3d2700 1 --2- 172.21.15.31:0/1899535585 >> v2:172.21.15.158:3300/0 conn(0x7f9b18157870 0x7f9b1815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1e3d2700 1 -- 172.21.15.31:0/1899535585 >> v1:172.21.15.31:6789/0 conn(0x7f9b1815a620 legacy=0x7f9b1815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1cbcf700 1 -- 172.21.15.31:0/1899535585 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466024754 0 0) 0x7f9b1815cbb0 con 0x7f9b1815a620 2023-10-09T06:20:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1e3d2700 1 -- 172.21.15.31:0/1899535585 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1815c560 con 0x7f9b18157c40 2023-10-09T06:20:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1dbd1700 1 --2- 172.21.15.31:0/1899535585 >> v2:172.21.15.158:3300/0 conn(0x7f9b18157870 0x7f9b1815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:20:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1e3d2700 1 --2- 172.21.15.31:0/1899535585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b18157c40 0x7f9b18158110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9b18069d80 tx=0x7f9b100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc2d5a523a7ef18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1cbcf700 1 -- 172.21.15.31:0/1899535585 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1000b6b0 con 0x7f9b18157c40 2023-10-09T06:20:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1cbcf700 1 -- 172.21.15.31:0/1899535585 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1000b810 con 0x7f9b18157c40 2023-10-09T06:20:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.235+0000 7f9b1cbcf700 1 -- 172.21.15.31:0/1899535585 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1000bbb0 con 0x7f9b18157c40 2023-10-09T06:20:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.236+0000 7f9b1fe35700 1 -- 172.21.15.31:0/1899535585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b18157c40 msgr2=0x7f9b18158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.236+0000 7f9b1fe35700 1 --2- 172.21.15.31:0/1899535585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b18157c40 0x7f9b18158110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9b18069d80 tx=0x7f9b100091a0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.236+0000 7f9b1fe35700 1 -- 172.21.15.31:0/1899535585 shutdown_connections 2023-10-09T06:20:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.236+0000 7f9b1fe35700 1 --2- 172.21.15.31:0/1899535585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b18157c40 0x7f9b18158110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.236+0000 7f9b1fe35700 1 --2- 172.21.15.31:0/1899535585 >> v2:172.21.15.158:3300/0 conn(0x7f9b18157870 0x7f9b1815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.236+0000 7f9b1fe35700 1 -- 172.21.15.31:0/1899535585 >> 172.21.15.31:0/1899535585 conn(0x7f9b18068ce0 msgr2=0x7f9b180690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.236+0000 7f9b1fe35700 1 -- 172.21.15.31:0/1899535585 shutdown_connections 2023-10-09T06:20:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.236+0000 7f9b1fe35700 1 -- 172.21.15.31:0/1899535585 wait complete. 2023-10-09T06:20:58.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.237+0000 7f9b1fe35700 1 Processor -- start 2023-10-09T06:20:58.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.237+0000 7f9b1fe35700 1 -- start start 2023-10-09T06:20:58.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1fe35700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b18157870 0x7f9b180cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:58.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1fe35700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b18157c40 0x7f9b1816daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:58.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1fe35700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b1815a620 0x7f9b180b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:58.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1fe35700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180b1730 con 0x7f9b18157c40 2023-10-09T06:20:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1fe35700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180b19d0 con 0x7f9b18157870 2023-10-09T06:20:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1fe35700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180b1cb0 con 0x7f9b1815a620 2023-10-09T06:20:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1d3d0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b18157c40 0x7f9b1816daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1d3d0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b18157c40 0x7f9b1816daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56608/0 (socket says 172.21.15.31:56608) 2023-10-09T06:20:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1d3d0700 1 -- 172.21.15.31:0/2558134049 learned_addr learned my addr 172.21.15.31:0/2558134049 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1dbd1700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b18157870 0x7f9b180cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1e3d2700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b1815a620 0x7f9b180b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1d3d0700 1 -- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b1815a620 msgr2=0x7f9b180b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1d3d0700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b1815a620 0x7f9b180b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1d3d0700 1 -- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b18157870 msgr2=0x7f9b180cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1d3d0700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b18157870 0x7f9b180cab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1d3d0700 1 -- 172.21.15.31:0/2558134049 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b10009420 con 0x7f9b18157c40 2023-10-09T06:20:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1d3d0700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b18157c40 0x7f9b1816daa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00c5e0 tx=0x7f9b0c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b15ffb700 1 -- 172.21.15.31:0/2558134049 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c005b30 con 0x7f9b18157c40 2023-10-09T06:20:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b15ffb700 1 -- 172.21.15.31:0/2558134049 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c005c90 con 0x7f9b18157c40 2023-10-09T06:20:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b15ffb700 1 -- 172.21.15.31:0/2558134049 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c007300 con 0x7f9b18157c40 2023-10-09T06:20:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.238+0000 7f9b1fe35700 1 -- 172.21.15.31:0/2558134049 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b180b1f90 con 0x7f9b18157c40 2023-10-09T06:20:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.239+0000 7f9b1fe35700 1 -- 172.21.15.31:0/2558134049 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b180cb140 con 0x7f9b18157c40 2023-10-09T06:20:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.239+0000 7f9b1fe35700 1 -- 172.21.15.31:0/2558134049 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b180b24b0 con 0x7f9b18157c40 2023-10-09T06:20:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.240+0000 7f9b15ffb700 1 -- 172.21.15.31:0/2558134049 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b0c01b3b0 con 0x7f9b18157c40 2023-10-09T06:20:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.240+0000 7f9b15ffb700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9b04066f30 0x7f9b040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.240+0000 7f9b15ffb700 1 -- 172.21.15.31:0/2558134049 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b0c083930 con 0x7f9b18157c40 2023-10-09T06:20:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.241+0000 7f9b1dbd1700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9b04066f30 0x7f9b040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:58.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.241+0000 7f9b1dbd1700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9b04066f30 0x7f9b040693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800d6e0 tx=0x7f9b08007850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:58.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.245+0000 7f9b15ffb700 1 -- 172.21.15.31:0/2558134049 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b180b24b0 con 0x7f9b18157c40 2023-10-09T06:20:58.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.437+0000 7f9b1fe35700 1 -- 172.21.15.31:0/2558134049 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b180b24b0 con 0x7f9b18157c40 2023-10-09T06:20:58.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.438+0000 7f9b15ffb700 1 -- 172.21.15.31:0/2558134049 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f9b180b24b0 con 0x7f9b18157c40 2023-10-09T06:20:58.439 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:58.439 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:55.693313+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:20:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.440+0000 7f9b1fe35700 1 -- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9b04066f30 msgr2=0x7f9b040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.440+0000 7f9b1fe35700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9b04066f30 0x7f9b040693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800d6e0 tx=0x7f9b08007850 comp rx=0 tx=0).stop 2023-10-09T06:20:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.440+0000 7f9b1fe35700 1 -- 172.21.15.31:0/2558134049 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b18157c40 msgr2=0x7f9b1816daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.440+0000 7f9b1fe35700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b18157c40 0x7f9b1816daa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00c5e0 tx=0x7f9b0c000fe0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.440+0000 7f9b1fe35700 1 -- 172.21.15.31:0/2558134049 shutdown_connections 2023-10-09T06:20:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.440+0000 7f9b1fe35700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9b04066f30 0x7f9b040693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.440+0000 7f9b1fe35700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9b1815a620 0x7f9b180b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.440+0000 7f9b1fe35700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9b18157870 0x7f9b180cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.440+0000 7f9b1fe35700 1 --2- 172.21.15.31:0/2558134049 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b18157c40 0x7f9b1816daa0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.440+0000 7f9b1fe35700 1 -- 172.21.15.31:0/2558134049 >> 172.21.15.31:0/2558134049 conn(0x7f9b18068ce0 msgr2=0x7f9b180b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:58.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.440+0000 7f9b1fe35700 1 -- 172.21.15.31:0/2558134049 shutdown_connections 2023-10-09T06:20:58.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.440+0000 7f9b1fe35700 1 -- 172.21.15.31:0/2558134049 wait complete. 2023-10-09T06:20:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:20:58.453 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:20:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.571+0000 7f752a131700 1 Processor -- start 2023-10-09T06:20:58.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.571+0000 7f752a131700 1 -- start start 2023-10-09T06:20:58.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.571+0000 7f752a131700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f752415a620 0x7f752415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:58.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.571+0000 7f752a131700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752415cbb0 con 0x7f752415d580 2023-10-09T06:20:58.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.571+0000 7f752a131700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752415bfa0 con 0x7f7524157870 2023-10-09T06:20:58.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.571+0000 7f752a131700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752415bdb0 con 0x7f752415a620 2023-10-09T06:20:58.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.572+0000 7f7523fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f752415d580 0x7f7524158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50330/0 (socket says 172.21.15.31:50330) 2023-10-09T06:20:58.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.572+0000 7f7523fff700 1 -- 172.21.15.31:0/2273322752 learned_addr learned my addr 172.21.15.31:0/2273322752 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:58.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.572+0000 7f7522ffd700 1 --2- 172.21.15.31:0/2273322752 >> v2:172.21.15.158:3300/0 conn(0x7f752415a620 0x7f752415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:58.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.572+0000 7f75227fc700 1 -- 172.21.15.31:0/2273322752 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253462007 0 0) 0x7f752415cbb0 con 0x7f752415d580 2023-10-09T06:20:58.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.572+0000 7f75227fc700 1 -- 172.21.15.31:0/2273322752 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7510003570 con 0x7f752415d580 2023-10-09T06:20:58.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.572+0000 7f7522ffd700 1 -- 172.21.15.31:0/2273322752 >> v1:172.21.15.158:6789/0 conn(0x7f7524157870 legacy=0x7f752415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.572+0000 7f7522ffd700 1 -- 172.21.15.31:0/2273322752 >> v1:172.21.15.31:6789/0 conn(0x7f752415d580 legacy=0x7f7524158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.572+0000 7f7522ffd700 1 -- 172.21.15.31:0/2273322752 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752415c280 con 0x7f752415a620 2023-10-09T06:20:58.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.572+0000 7f7522ffd700 1 --2- 172.21.15.31:0/2273322752 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f752415a620 0x7f752415d040 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f750c0098e0 tx=0x7f750c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=862125fcbc07859d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:58.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.572+0000 7f75227fc700 1 -- 172.21.15.31:0/2273322752 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00b640 con 0x7f752415a620 2023-10-09T06:20:58.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.573+0000 7f75227fc700 1 -- 172.21.15.31:0/2273322752 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c00b7a0 con 0x7f752415a620 2023-10-09T06:20:58.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.573+0000 7f75227fc700 1 -- 172.21.15.31:0/2273322752 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00bb40 con 0x7f752415a620 2023-10-09T06:20:58.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.573+0000 7f752a131700 1 -- 172.21.15.31:0/2273322752 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f752415a620 msgr2=0x7f752415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.573+0000 7f752a131700 1 --2- 172.21.15.31:0/2273322752 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f752415a620 0x7f752415d040 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f750c0098e0 tx=0x7f750c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.573+0000 7f752a131700 1 -- 172.21.15.31:0/2273322752 shutdown_connections 2023-10-09T06:20:58.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.573+0000 7f752a131700 1 --2- 172.21.15.31:0/2273322752 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f752415a620 0x7f752415d040 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.573+0000 7f752a131700 1 -- 172.21.15.31:0/2273322752 >> 172.21.15.31:0/2273322752 conn(0x7f7524068ce0 msgr2=0x7f75240690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:58.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.573+0000 7f752a131700 1 -- 172.21.15.31:0/2273322752 shutdown_connections 2023-10-09T06:20:58.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.573+0000 7f752a131700 1 -- 172.21.15.31:0/2273322752 wait complete. 2023-10-09T06:20:58.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.574+0000 7f752a131700 1 Processor -- start 2023-10-09T06:20:58.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.574+0000 7f752a131700 1 -- start start 2023-10-09T06:20:58.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f752a131700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7524157870 0x7f752416df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:58.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f752a131700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f752415a620 0x7f75240b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:58.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f752a131700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f752415d580 0x7f7524158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:58.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f752a131700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752416a950 con 0x7f752415a620 2023-10-09T06:20:58.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f752a131700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752416e690 con 0x7f752415d580 2023-10-09T06:20:58.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f752a131700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752416e970 con 0x7f7524157870 2023-10-09T06:20:58.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f7522ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f752415a620 0x7f75240b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:58.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f7522ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f752415a620 0x7f75240b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56616/0 (socket says 172.21.15.31:56616) 2023-10-09T06:20:58.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f7522ffd700 1 -- 172.21.15.31:0/2076721869 learned_addr learned my addr 172.21.15.31:0/2076721869 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:58.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f7523fff700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f752415d580 0x7f7524158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:58.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f75237fe700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7524157870 0x7f752416df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:58.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f7522ffd700 1 -- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7524157870 msgr2=0x7f752416df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f7522ffd700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7524157870 0x7f752416df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f7522ffd700 1 -- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f752415d580 msgr2=0x7f7524158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f7522ffd700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f752415d580 0x7f7524158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.575+0000 7f7522ffd700 1 -- 172.21.15.31:0/2076721869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c009420 con 0x7f752415a620 2023-10-09T06:20:58.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.576+0000 7f7522ffd700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f752415a620 0x7f75240b3090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f750c013000 tx=0x7f750c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:58.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.576+0000 7f751b7fe700 1 -- 172.21.15.31:0/2076721869 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00bb20 con 0x7f752415a620 2023-10-09T06:20:58.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.576+0000 7f751b7fe700 1 -- 172.21.15.31:0/2076721869 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c011420 con 0x7f752415a620 2023-10-09T06:20:58.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.576+0000 7f752a131700 1 -- 172.21.15.31:0/2076721869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752416ec50 con 0x7f752415a620 2023-10-09T06:20:58.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.576+0000 7f751b7fe700 1 -- 172.21.15.31:0/2076721869 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0117c0 con 0x7f752415a620 2023-10-09T06:20:58.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.576+0000 7f752a131700 1 -- 172.21.15.31:0/2076721869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75241594c0 con 0x7f752415a620 2023-10-09T06:20:58.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.577+0000 7f752a131700 1 -- 172.21.15.31:0/2076721869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752416ade0 con 0x7f752415a620 2023-10-09T06:20:58.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.577+0000 7f751b7fe700 1 -- 172.21.15.31:0/2076721869 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f750c011b70 con 0x7f752415a620 2023-10-09T06:20:58.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.577+0000 7f751b7fe700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7504066f30 0x7f75040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:58.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.578+0000 7f751b7fe700 1 -- 172.21.15.31:0/2076721869 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f750c085c30 con 0x7f752415a620 2023-10-09T06:20:58.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.578+0000 7f75237fe700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7504066f30 0x7f75040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:58.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.578+0000 7f75237fe700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7504066f30 0x7f75040693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7514007fd0 tx=0x7f7514009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:58.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.582+0000 7f751b7fe700 1 -- 172.21.15.31:0/2076721869 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f752416ade0 con 0x7f752415a620 2023-10-09T06:20:58.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.768+0000 7f752a131700 1 -- 172.21.15.31:0/2076721869 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f752416ade0 con 0x7f7504066f30 2023-10-09T06:20:58.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.776+0000 7f751b7fe700 1 -- 172.21.15.31:0/2076721869 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251315 (secure 0 0 0) 0x7f752416ade0 con 0x7f7504066f30 2023-10-09T06:20:58.780 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.779+0000 7f752a131700 1 -- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7504066f30 msgr2=0x7f75040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.779+0000 7f752a131700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7504066f30 0x7f75040693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7514007fd0 tx=0x7f7514009040 comp rx=0 tx=0).stop 2023-10-09T06:20:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.779+0000 7f752a131700 1 -- 172.21.15.31:0/2076721869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f752415a620 msgr2=0x7f75240b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.779+0000 7f752a131700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f752415a620 0x7f75240b3090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f750c013000 tx=0x7f750c017000 comp rx=0 tx=0).stop 2023-10-09T06:20:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.779+0000 7f752a131700 1 -- 172.21.15.31:0/2076721869 shutdown_connections 2023-10-09T06:20:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.779+0000 7f752a131700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7504066f30 0x7f75040693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.779+0000 7f752a131700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7524157870 0x7f752416df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.779+0000 7f752a131700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f752415d580 0x7f7524158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.779+0000 7f752a131700 1 --2- 172.21.15.31:0/2076721869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f752415a620 0x7f75240b3090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:58.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.779+0000 7f752a131700 1 -- 172.21.15.31:0/2076721869 >> 172.21.15.31:0/2076721869 conn(0x7f7524068ce0 msgr2=0x7f7524159a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:58.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.779+0000 7f752a131700 1 -- 172.21.15.31:0/2076721869 shutdown_connections 2023-10-09T06:20:58.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.779+0000 7f752a131700 1 -- 172.21.15.31:0/2076721869 wait complete. 2023-10-09T06:20:58.783 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:20:58.791 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-09T06:20:58.512592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560964,"statfs":{"total":1600000000,"available":1598427239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.835496"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681531+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:54.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680234+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678431+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680355+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681044+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680081+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680615+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680644+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679620+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681498+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680564+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679172+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681921+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680608+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678522+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.683089+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678293+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:54.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680123+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681031+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.682487+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681322+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-09T06:20:45.833631+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:20:45.833631+0000","last_peered":"2023-10-09T06:20:45.833631+0000","last_clean":"2023-10-09T06:20:45.833631+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:20:45.833631+0000","last_undegraded":"2023-10-09T06:20:45.833631+0000","last_fullsized":"2023-10-09T06:20:45.833631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678736+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679118+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680119+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678085+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679908+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680593+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679838+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678427+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.682467+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679955+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:54.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.682455+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":620,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364257,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]}],"pool_statfs":[]}} 2023-10-09T06:20:58.797 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:20:58.869 INFO:tasks.ceph.mds.b.smithi158.stderr:2023-10-09T06:20:58.869+0000 7f5e425a9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:20:58.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.949+0000 7fe4ab198700 1 Processor -- start 2023-10-09T06:20:59.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.949+0000 7fe4ab198700 1 -- start start 2023-10-09T06:20:59.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.950+0000 7fe4ab198700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4a41523e0 0x7fe4a406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:59.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.950+0000 7fe4ab198700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe4a4158e50 0x7fe4a40cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:59.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.950+0000 7fe4ab198700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a406c010 con 0x7fe4a4152010 2023-10-09T06:20:59.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.950+0000 7fe4ab198700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a406bd10 con 0x7fe4a41523e0 2023-10-09T06:20:59.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.950+0000 7fe4ab198700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a415c060 con 0x7fe4a4158e50 2023-10-09T06:20:59.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.950+0000 7fe4a3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4a41523e0 0x7fe4a406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:59.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.950+0000 7fe4a3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4a41523e0 0x7fe4a406c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56622/0 (socket says 172.21.15.31:56622) 2023-10-09T06:20:59.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.950+0000 7fe4a3fff700 1 -- 172.21.15.31:0/2892906819 learned_addr learned my addr 172.21.15.31:0/2892906819 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:59.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.950+0000 7fe4a9735700 1 --2- 172.21.15.31:0/2892906819 >> v2:172.21.15.158:3300/0 conn(0x7fe4a4158e50 0x7fe4a40cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:59.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.951+0000 7fe4a3fff700 1 -- 172.21.15.31:0/2892906819 >> v2:172.21.15.158:3300/0 conn(0x7fe4a4158e50 msgr2=0x7fe4a40cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:59.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.951+0000 7fe4a3fff700 1 --2- 172.21.15.31:0/2892906819 >> v2:172.21.15.158:3300/0 conn(0x7fe4a4158e50 0x7fe4a40cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.951+0000 7fe4a3fff700 1 -- 172.21.15.31:0/2892906819 >> v1:172.21.15.158:6789/0 conn(0x7fe4a4152010 legacy=0x7fe4a415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:59.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.951+0000 7fe4a3fff700 1 -- 172.21.15.31:0/2892906819 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a415c340 con 0x7fe4a41523e0 2023-10-09T06:20:59.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.951+0000 7fe4a3fff700 1 --2- 172.21.15.31:0/2892906819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a41523e0 0x7fe4a406c4a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe4a406f170 tx=0x7fe490009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f15c811c1b676e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:59.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.951+0000 7fe4a37fe700 1 -- 172.21.15.31:0/2892906819 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe490009e70 con 0x7fe4a41523e0 2023-10-09T06:20:59.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.951+0000 7fe4a37fe700 1 -- 172.21.15.31:0/2892906819 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49000b860 con 0x7fe4a41523e0 2023-10-09T06:20:59.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.951+0000 7fe4a37fe700 1 -- 172.21.15.31:0/2892906819 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49000bc00 con 0x7fe4a41523e0 2023-10-09T06:20:59.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.952+0000 7fe4ab198700 1 -- 172.21.15.31:0/2892906819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a41523e0 msgr2=0x7fe4a406c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:59.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.952+0000 7fe4ab198700 1 --2- 172.21.15.31:0/2892906819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a41523e0 0x7fe4a406c4a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe4a406f170 tx=0x7fe490009250 comp rx=0 tx=0).stop 2023-10-09T06:20:59.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.952+0000 7fe4ab198700 1 -- 172.21.15.31:0/2892906819 shutdown_connections 2023-10-09T06:20:59.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.952+0000 7fe4ab198700 1 --2- 172.21.15.31:0/2892906819 >> v2:172.21.15.158:3300/0 conn(0x7fe4a4158e50 0x7fe4a40cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.952+0000 7fe4ab198700 1 --2- 172.21.15.31:0/2892906819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a41523e0 0x7fe4a406c4a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.952+0000 7fe4ab198700 1 -- 172.21.15.31:0/2892906819 >> 172.21.15.31:0/2892906819 conn(0x7fe4a4069870 msgr2=0x7fe4a4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:59.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.952+0000 7fe4ab198700 1 -- 172.21.15.31:0/2892906819 shutdown_connections 2023-10-09T06:20:59.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.952+0000 7fe4ab198700 1 -- 172.21.15.31:0/2892906819 wait complete. 2023-10-09T06:20:59.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.953+0000 7fe4ab198700 1 Processor -- start 2023-10-09T06:20:59.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.953+0000 7fe4ab198700 1 -- start start 2023-10-09T06:20:59.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4ab198700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4a4152010 0x7fe4a414fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:59.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4ab198700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4a41523e0 0x7fe4a4068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:59.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4ab198700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a4158e50 0x7fe4a4068d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:59.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4ab198700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40c68b0 con 0x7fe4a4158e50 2023-10-09T06:20:59.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4ab198700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40b3760 con 0x7fe4a4152010 2023-10-09T06:20:59.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4ab198700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40b4250 con 0x7fe4a41523e0 2023-10-09T06:20:59.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a9735700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a4158e50 0x7fe4a4068d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:59.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a9735700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a4158e50 0x7fe4a4068d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56628/0 (socket says 172.21.15.31:56628) 2023-10-09T06:20:59.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a9735700 1 -- 172.21.15.31:0/1635236685 learned_addr learned my addr 172.21.15.31:0/1635236685 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:59.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a8f34700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4a4152010 0x7fe4a414fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:59.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a3fff700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4a41523e0 0x7fe4a4068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:59.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a9735700 1 -- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4a41523e0 msgr2=0x7fe4a4068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:59.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a9735700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4a41523e0 0x7fe4a4068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a9735700 1 -- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4a4152010 msgr2=0x7fe4a414fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:59.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a9735700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4a4152010 0x7fe4a414fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a9735700 1 -- 172.21.15.31:0/1635236685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4900094f0 con 0x7fe4a4158e50 2023-10-09T06:20:59.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a9735700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a4158e50 0x7fe4a4068d60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009e90 tx=0x7fe49c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:59.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a0ff9700 1 -- 172.21.15.31:0/1635236685 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c00cc20 con 0x7fe4a4158e50 2023-10-09T06:20:59.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a0ff9700 1 -- 172.21.15.31:0/1635236685 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c00f040 con 0x7fe4a4158e50 2023-10-09T06:20:59.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4a0ff9700 1 -- 172.21.15.31:0/1635236685 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c014480 con 0x7fe4a4158e50 2023-10-09T06:20:59.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.954+0000 7fe4ab198700 1 -- 172.21.15.31:0/1635236685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a40c6b70 con 0x7fe4a4158e50 2023-10-09T06:20:59.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.955+0000 7fe4ab198700 1 -- 172.21.15.31:0/1635236685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a40b3c90 con 0x7fe4a4158e50 2023-10-09T06:20:59.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.955+0000 7fe4ab198700 1 -- 172.21.15.31:0/1635236685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a404c3c0 con 0x7fe4a4158e50 2023-10-09T06:20:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.956+0000 7fe4a0ff9700 1 -- 172.21.15.31:0/1635236685 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe49c0147f0 con 0x7fe4a4158e50 2023-10-09T06:20:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.956+0000 7fe4a0ff9700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe488066f30 0x7fe4880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.956+0000 7fe4a0ff9700 1 -- 172.21.15.31:0/1635236685 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe49c085300 con 0x7fe4a4158e50 2023-10-09T06:20:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.956+0000 7fe4a8f34700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe488066f30 0x7fe4880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.957+0000 7fe4a8f34700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe488066f30 0x7fe4880693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe4980037a0 tx=0x7fe498009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:58.960+0000 7fe4a0ff9700 1 -- 172.21.15.31:0/1635236685 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe49c055f60 con 0x7fe4a4158e50 2023-10-09T06:20:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.149+0000 7fe4ab198700 1 -- 172.21.15.31:0/1635236685 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4a406d1b0 con 0x7fe488066f30 2023-10-09T06:20:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.157+0000 7fe4a0ff9700 1 -- 172.21.15.31:0/1635236685 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251315 (secure 0 0 0) 0x7fe4a406d1b0 con 0x7fe488066f30 2023-10-09T06:20:59.161 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.159+0000 7fe4ab198700 1 -- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe488066f30 msgr2=0x7fe4880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.159+0000 7fe4ab198700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe488066f30 0x7fe4880693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe4980037a0 tx=0x7fe498009040 comp rx=0 tx=0).stop 2023-10-09T06:20:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.159+0000 7fe4ab198700 1 -- 172.21.15.31:0/1635236685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a4158e50 msgr2=0x7fe4a4068d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.159+0000 7fe4ab198700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a4158e50 0x7fe4a4068d60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009e90 tx=0x7fe49c00b040 comp rx=0 tx=0).stop 2023-10-09T06:20:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.160+0000 7fe4ab198700 1 -- 172.21.15.31:0/1635236685 shutdown_connections 2023-10-09T06:20:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.160+0000 7fe4ab198700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe488066f30 0x7fe4880693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.160+0000 7fe4ab198700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a4158e50 0x7fe4a4068d60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.160+0000 7fe4ab198700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4a4152010 0x7fe4a414fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.160+0000 7fe4ab198700 1 --2- 172.21.15.31:0/1635236685 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe4a41523e0 0x7fe4a4068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.160+0000 7fe4ab198700 1 -- 172.21.15.31:0/1635236685 >> 172.21.15.31:0/1635236685 conn(0x7fe4a4069870 msgr2=0x7fe4a4150860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:59.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.160+0000 7fe4ab198700 1 -- 172.21.15.31:0/1635236685 shutdown_connections 2023-10-09T06:20:59.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.160+0000 7fe4ab198700 1 -- 172.21.15.31:0/1635236685 wait complete. 2023-10-09T06:20:59.164 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:20:59.172 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-09T06:20:58.512592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560964,"statfs":{"total":1600000000,"available":1598427239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.835496"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681531+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:54.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680234+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678431+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680355+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681044+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680081+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680615+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680644+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679620+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681498+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680564+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679172+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681921+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680608+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678522+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.683089+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678293+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:54.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680123+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681031+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.682487+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681322+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-09T06:20:45.833631+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:20:45.833631+0000","last_peered":"2023-10-09T06:20:45.833631+0000","last_clean":"2023-10-09T06:20:45.833631+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:20:45.833631+0000","last_undegraded":"2023-10-09T06:20:45.833631+0000","last_fullsized":"2023-10-09T06:20:45.833631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678736+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679118+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680119+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678085+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679908+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680593+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679838+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678427+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.682467+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679955+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:54.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.682455+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":620,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364257,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]}],"pool_statfs":[]}} 2023-10-09T06:20:59.317 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:20:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.436+0000 7f94ee7b7700 1 Processor -- start 2023-10-09T06:20:59.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.436+0000 7f94ee7b7700 1 -- start start 2023-10-09T06:20:59.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.436+0000 7f94ee7b7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f94e815a2b0 0x7f94e80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:59.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.436+0000 7f94ee7b7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94e80d1c30 0x7f94e80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:59.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.436+0000 7f94ee7b7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e80c5d80 con 0x7f94e815a680 2023-10-09T06:20:59.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.436+0000 7f94ee7b7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e8068470 con 0x7f94e815a2b0 2023-10-09T06:20:59.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.436+0000 7f94ee7b7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e80c6060 con 0x7f94e80d1c30 2023-10-09T06:20:59.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.437+0000 7f94e7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f94e815a2b0 0x7f94e80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:59.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.437+0000 7f94ecd54700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f94e815a680 0x7f94e80c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50346/0 (socket says 172.21.15.31:50346) 2023-10-09T06:20:59.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.437+0000 7f94ecd54700 1 -- 172.21.15.31:0/527843278 learned_addr learned my addr 172.21.15.31:0/527843278 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:20:59.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.437+0000 7f94e77fe700 1 --2- 172.21.15.31:0/527843278 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94e80d1c30 0x7f94e80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:59.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.437+0000 7f94e7fff700 1 -- 172.21.15.31:0/527843278 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94e80d1c30 msgr2=0x7f94e80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:20:59.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.437+0000 7f94e7fff700 1 --2- 172.21.15.31:0/527843278 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94e80d1c30 0x7f94e80cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.437+0000 7f94e7fff700 1 -- 172.21.15.31:0/527843278 >> v1:172.21.15.31:6789/0 conn(0x7f94e815a680 legacy=0x7f94e80c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:59.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.437+0000 7f94e7fff700 1 -- 172.21.15.31:0/527843278 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e80c6340 con 0x7f94e815a2b0 2023-10-09T06:20:59.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.437+0000 7f94e6ffd700 1 -- 172.21.15.31:0/527843278 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123718771 0 0) 0x7f94e80c5d80 con 0x7f94e815a680 2023-10-09T06:20:59.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.437+0000 7f94e7fff700 1 --2- 172.21.15.31:0/527843278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e815a2b0 0x7f94e80b3da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94d00098d0 tx=0x7f94d0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652e0113c9dafa2a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:59.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.437+0000 7f94e6ffd700 1 -- 172.21.15.31:0/527843278 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0005c10 con 0x7f94e815a2b0 2023-10-09T06:20:59.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.437+0000 7f94e6ffd700 1 -- 172.21.15.31:0/527843278 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d0005d70 con 0x7f94e815a2b0 2023-10-09T06:20:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.437+0000 7f94e6ffd700 1 -- 172.21.15.31:0/527843278 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0006260 con 0x7f94e815a2b0 2023-10-09T06:20:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.438+0000 7f94ee7b7700 1 -- 172.21.15.31:0/527843278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e815a2b0 msgr2=0x7f94e80b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.438+0000 7f94ee7b7700 1 --2- 172.21.15.31:0/527843278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e815a2b0 0x7f94e80b3da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94d00098d0 tx=0x7f94d0009120 comp rx=0 tx=0).stop 2023-10-09T06:20:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.438+0000 7f94ee7b7700 1 -- 172.21.15.31:0/527843278 shutdown_connections 2023-10-09T06:20:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.438+0000 7f94ee7b7700 1 --2- 172.21.15.31:0/527843278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e815a2b0 0x7f94e80b3da0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.438+0000 7f94ee7b7700 1 --2- 172.21.15.31:0/527843278 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94e80d1c30 0x7f94e80cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.438+0000 7f94ee7b7700 1 -- 172.21.15.31:0/527843278 >> 172.21.15.31:0/527843278 conn(0x7f94e8067e40 msgr2=0x7f94e80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.438+0000 7f94ee7b7700 1 -- 172.21.15.31:0/527843278 shutdown_connections 2023-10-09T06:20:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.438+0000 7f94ee7b7700 1 -- 172.21.15.31:0/527843278 wait complete. 2023-10-09T06:20:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.439+0000 7f94ee7b7700 1 Processor -- start 2023-10-09T06:20:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.439+0000 7f94ee7b7700 1 -- start start 2023-10-09T06:20:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ee7b7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94e80d1c30 0x7f94e815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ee7b7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94e815a2b0 0x7f94e8169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ee7b7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e815a680 0x7f94e816a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ee7b7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e815b240 con 0x7f94e815a680 2023-10-09T06:20:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ee7b7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e80c9340 con 0x7f94e815a2b0 2023-10-09T06:20:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ee7b7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e815be40 con 0x7f94e80d1c30 2023-10-09T06:20:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ecd54700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e815a680 0x7f94e816a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ecd54700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e815a680 0x7f94e816a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56648/0 (socket says 172.21.15.31:56648) 2023-10-09T06:20:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ecd54700 1 -- 172.21.15.31:0/1305757163 learned_addr learned my addr 172.21.15.31:0/1305757163 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:20:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94e77fe700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94e815a2b0 0x7f94e8169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94e7fff700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94e80d1c30 0x7f94e815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ecd54700 1 -- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94e80d1c30 msgr2=0x7f94e815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ecd54700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94e80d1c30 0x7f94e815d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ecd54700 1 -- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94e815a2b0 msgr2=0x7f94e8169cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ecd54700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94e815a2b0 0x7f94e8169cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ecd54700 1 -- 172.21.15.31:0/1305757163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d00093c0 con 0x7f94e815a680 2023-10-09T06:20:59.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94ecd54700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e815a680 0x7f94e816a200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f94e000cbf0 tx=0x7f94e00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:59.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.440+0000 7f94dffff700 1 -- 172.21.15.31:0/1305757163 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e000a9c0 con 0x7f94e815a680 2023-10-09T06:20:59.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.441+0000 7f94dffff700 1 -- 172.21.15.31:0/1305757163 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e000ab20 con 0x7f94e815a680 2023-10-09T06:20:59.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.441+0000 7f94ee7b7700 1 -- 172.21.15.31:0/1305757163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e815c960 con 0x7f94e815a680 2023-10-09T06:20:59.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.441+0000 7f94dffff700 1 -- 172.21.15.31:0/1305757163 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00070f0 con 0x7f94e815a680 2023-10-09T06:20:59.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.441+0000 7f94ee7b7700 1 -- 172.21.15.31:0/1305757163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e815c3a0 con 0x7f94e815a680 2023-10-09T06:20:59.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.442+0000 7f94ee7b7700 1 -- 172.21.15.31:0/1305757163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e80c94b0 con 0x7f94e815a680 2023-10-09T06:20:59.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.442+0000 7f94dffff700 1 -- 172.21.15.31:0/1305757163 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f94e00074e0 con 0x7f94e815a680 2023-10-09T06:20:59.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.442+0000 7f94dffff700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f94c8066f30 0x7f94c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:20:59.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.442+0000 7f94dffff700 1 -- 172.21.15.31:0/1305757163 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f94e0084980 con 0x7f94e815a680 2023-10-09T06:20:59.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.442+0000 7f94e7fff700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f94c8066f30 0x7f94c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:20:59.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.443+0000 7f94e7fff700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f94c8066f30 0x7f94c80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009160 tx=0x7f94d0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:20:59.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.446+0000 7f94dffff700 1 -- 172.21.15.31:0/1305757163 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94e0051c70 con 0x7f94e815a680 2023-10-09T06:20:59.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.633+0000 7f94ee7b7700 1 -- 172.21.15.31:0/1305757163 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94e804c3c0 con 0x7f94c8066f30 2023-10-09T06:20:59.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.640+0000 7f94dffff700 1 -- 172.21.15.31:0/1305757163 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251315 (secure 0 0 0) 0x7f94e804c3c0 con 0x7f94c8066f30 2023-10-09T06:20:59.644 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:20:59.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.643+0000 7f94ee7b7700 1 -- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f94c8066f30 msgr2=0x7f94c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:59.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.643+0000 7f94ee7b7700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f94c8066f30 0x7f94c80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009160 tx=0x7f94d0016000 comp rx=0 tx=0).stop 2023-10-09T06:20:59.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.643+0000 7f94ee7b7700 1 -- 172.21.15.31:0/1305757163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e815a680 msgr2=0x7f94e816a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:20:59.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.643+0000 7f94ee7b7700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e815a680 0x7f94e816a200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f94e000cbf0 tx=0x7f94e00019b0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.644+0000 7f94ee7b7700 1 -- 172.21.15.31:0/1305757163 shutdown_connections 2023-10-09T06:20:59.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.644+0000 7f94ee7b7700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f94c8066f30 0x7f94c80693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.644+0000 7f94ee7b7700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94e80d1c30 0x7f94e815d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.644+0000 7f94ee7b7700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e815a680 0x7f94e816a200 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.644+0000 7f94ee7b7700 1 --2- 172.21.15.31:0/1305757163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94e815a2b0 0x7f94e8169cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:20:59.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.644+0000 7f94ee7b7700 1 -- 172.21.15.31:0/1305757163 >> 172.21.15.31:0/1305757163 conn(0x7f94e8067e40 msgr2=0x7f94e806a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:20:59.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.644+0000 7f94ee7b7700 1 -- 172.21.15.31:0/1305757163 shutdown_connections 2023-10-09T06:20:59.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:20:59.644+0000 7f94ee7b7700 1 -- 172.21.15.31:0/1305757163 wait complete. 2023-10-09T06:20:59.647 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:20:59.656 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-09T06:20:58.512592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560964,"statfs":{"total":1600000000,"available":1598427239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.835496"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681531+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:54.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680234+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678431+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680355+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681044+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680081+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680615+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680644+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679620+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681498+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680564+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679172+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681921+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680608+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678522+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.683089+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678293+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:54.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680123+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681031+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.682487+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.681322+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-09T06:20:45.833631+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:20:45.833631+0000","last_peered":"2023-10-09T06:20:45.833631+0000","last_clean":"2023-10-09T06:20:45.833631+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:20:45.833631+0000","last_undegraded":"2023-10-09T06:20:45.833631+0000","last_fullsized":"2023-10-09T06:20:45.833631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678736+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679118+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680119+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678085+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679908+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.680593+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679838+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.678427+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.682467+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.679955+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:54.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:20:52.670256+0000","last_change":"2023-10-09T06:20:52.682455+0000","last_active":"2023-10-09T06:20:52.670256+0000","last_peered":"2023-10-09T06:20:52.670256+0000","last_clean":"2023-10-09T06:20:52.670256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:52.670256+0000","last_undegraded":"2023-10-09T06:20:52.670256+0000","last_fullsized":"2023-10-09T06:20:52.670256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:20:53.676459+0000","last_change":"2023-10-09T06:20:53.676459+0000","last_active":"2023-10-09T06:20:53.676459+0000","last_peered":"2023-10-09T06:20:53.676459+0000","last_clean":"2023-10-09T06:20:53.676459+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:20:53.676459+0000","last_undegraded":"2023-10-09T06:20:53.676459+0000","last_fullsized":"2023-10-09T06:20:53.676459+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":620,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364257,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]}],"pool_statfs":[]}} 2023-10-09T06:20:59.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-10-09T06:20:59.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2023-10-09T06:20:59.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2023-10-09T06:20:59.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-10-09T06:20:59.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-10-09T06:20:59.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-10-09T06:20:59.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-10-09T06:20:59.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2023-10-09T06:20:59.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-10-09T06:20:59.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-10-09T06:20:59.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-10-09T06:20:59.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-10-09T06:20:59.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2023-10-09T06:20:59.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2023-10-09T06:20:59.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-10-09T06:20:59.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-10-09T06:20:59.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-10-09T06:20:59.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-10-09T06:20:59.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-10-09T06:20:59.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2023-10-09T06:20:59.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.681531+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:34:54.212658+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T06:20:59.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-09T06:20:59.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2023-10-09T06:20:59.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.680234+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:20:59.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-10-09T06:20:59.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2023-10-09T06:20:59.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.678431+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:20:59.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-09T06:20:59.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2023-10-09T06:20:59.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.680355+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:20:59.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-09T06:20:59.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2023-10-09T06:20:59.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.681044+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:20:59.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-10-09T06:20:59.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2023-10-09T06:20:59.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.680081+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:20:59.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-10-09T06:20:59.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2023-10-09T06:20:59.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.680615+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:20:59.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-09T06:20:59.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2023-10-09T06:20:59.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.680644+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:20:59.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-09T06:20:59.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2023-10-09T06:20:59.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.679620+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:20:59.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-10-09T06:20:59.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2023-10-09T06:20:59.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.681498+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:20:59.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-10-09T06:20:59.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2023-10-09T06:20:59.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.680564+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:20:59.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-09T06:20:59.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2023-10-09T06:20:59.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.679172+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:20:59.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-09T06:20:59.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2023-10-09T06:20:59.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.681921+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T06:20:59.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-10-09T06:20:59.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2023-10-09T06:20:59.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.680608+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:20:59.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-09T06:20:59.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2023-10-09T06:20:59.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.678522+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:20:59.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-09T06:20:59.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2023-10-09T06:20:59.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.683089+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:20:59.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-09T06:20:59.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2023-10-09T06:20:59.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.678293+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:34:54.212658+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:20:59.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-09T06:20:59.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2023-10-09T06:20:59.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.680123+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:20:59.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-09T06:20:59.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2023-10-09T06:20:59.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.681031+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:20:59.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-09T06:20:59.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-09T06:20:59.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2023-10-09T06:20:59.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.682487+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:20:59.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-09T06:20:59.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2023-10-09T06:20:59.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.681322+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:20:59.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-10-09T06:20:59.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2023-10-09T06:20:59.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.678736+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:20:59.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2023-10-09T06:20:59.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.679118+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:20:59.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-09T06:20:59.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:20:59.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2023-10-09T06:20:59.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.680119+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:21:00.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-09T06:21:00.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2023-10-09T06:21:00.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.678085+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:21:00.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-10-09T06:21:00.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2023-10-09T06:21:00.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.679908+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:21:00.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-09T06:21:00.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2023-10-09T06:21:00.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.680593+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:21:00.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-09T06:21:00.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2023-10-09T06:21:00.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.679838+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:21:00.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-09T06:21:00.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2023-10-09T06:21:00.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.678427+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:21:00.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-09T06:21:00.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2023-10-09T06:21:00.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.682467+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:21:00.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-09T06:21:00.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2023-10-09T06:21:00.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.679955+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:34:54.212658+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:21:00.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-09T06:21:00.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2023-10-09T06:21:00.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:20:52.670256+0000', 'last_change': '2023-10-09T06:20:52.682455+0000', 'last_active': '2023-10-09T06:20:52.670256+0000', 'last_peered': '2023-10-09T06:20:52.670256+0000', 'last_clean': '2023-10-09T06:20:52.670256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:52.670256+0000', 'last_undegraded': '2023-10-09T06:20:52.670256+0000', 'last_fullsized': '2023-10-09T06:20:52.670256+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:52.670256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:21:00.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-09T06:21:00.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-10-09T06:21:00.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-10-09T06:21:00.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-10-09T06:21:00.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2023-10-09T06:21:00.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2023-10-09T06:21:00.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2023-10-09T06:21:00.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-10-09T06:21:00.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2023-10-09T06:21:00.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-10-09T06:21:00.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2023-10-09T06:21:00.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-10-09T06:21:00.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2023-10-09T06:21:00.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-10-09T06:21:00.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:20:53.676459+0000', 'last_change': '2023-10-09T06:20:53.676459+0000', 'last_active': '2023-10-09T06:20:53.676459+0000', 'last_peered': '2023-10-09T06:20:53.676459+0000', 'last_clean': '2023-10-09T06:20:53.676459+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:20:53.676459+0000', 'last_undegraded': '2023-10-09T06:20:53.676459+0000', 'last_fullsized': '2023-10-09T06:20:53.676459+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'last_clean_scrub_stamp': '2023-10-09T06:20:53.676459+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:21:00.113 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T06:21:00.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.235+0000 7f6d54ef9700 1 Processor -- start 2023-10-09T06:21:00.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.235+0000 7f6d54ef9700 1 -- start start 2023-10-09T06:21:00.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.236+0000 7f6d54ef9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d500b0f30 0x7f6d500cc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:00.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.236+0000 7f6d54ef9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6d500b1300 0x7f6d5015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:00.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.236+0000 7f6d54ef9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d500cb8b0 con 0x7f6d500cbd40 2023-10-09T06:21:00.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.236+0000 7f6d54ef9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d50068f80 con 0x7f6d500b1300 2023-10-09T06:21:00.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.236+0000 7f6d54ef9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50069260 con 0x7f6d500b0f30 2023-10-09T06:21:00.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.236+0000 7f6d4dd9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6d500b1300 0x7f6d5015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:00.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.236+0000 7f6d4ed9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6d500cbd40 0x7f6d50067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60568/0 (socket says 172.21.15.31:60568) 2023-10-09T06:21:00.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.236+0000 7f6d4ed9d700 1 -- 172.21.15.31:0/2731081429 learned_addr learned my addr 172.21.15.31:0/2731081429 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:00.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.236+0000 7f6d4e59c700 1 --2- 172.21.15.31:0/2731081429 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d500b0f30 0x7f6d500cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:00.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.237+0000 7f6d4dd9b700 1 -- 172.21.15.31:0/2731081429 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d500b0f30 msgr2=0x7f6d500cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:00.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.237+0000 7f6d4dd9b700 1 --2- 172.21.15.31:0/2731081429 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d500b0f30 0x7f6d500cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.237+0000 7f6d4dd9b700 1 -- 172.21.15.31:0/2731081429 >> v1:172.21.15.31:6789/0 conn(0x7f6d500cbd40 legacy=0x7f6d50067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:00.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.237+0000 7f6d4dd9b700 1 -- 172.21.15.31:0/2731081429 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50069540 con 0x7f6d500b1300 2023-10-09T06:21:00.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.237+0000 7f6d4d59a700 1 -- 172.21.15.31:0/2731081429 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408546127 0 0) 0x7f6d500cb8b0 con 0x7f6d500cbd40 2023-10-09T06:21:00.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.237+0000 7f6d4dd9b700 1 --2- 172.21.15.31:0/2731081429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d500b1300 0x7f6d5015aea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d380098e0 tx=0x7f6d380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be899e71ffdef396 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:00.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.237+0000 7f6d4d59a700 1 -- 172.21.15.31:0/2731081429 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3800b640 con 0x7f6d500b1300 2023-10-09T06:21:00.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.237+0000 7f6d4d59a700 1 -- 172.21.15.31:0/2731081429 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3800b7a0 con 0x7f6d500b1300 2023-10-09T06:21:00.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.237+0000 7f6d4d59a700 1 -- 172.21.15.31:0/2731081429 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3800bb40 con 0x7f6d500b1300 2023-10-09T06:21:00.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.238+0000 7f6d54ef9700 1 -- 172.21.15.31:0/2731081429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d500b1300 msgr2=0x7f6d5015aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:00.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.238+0000 7f6d54ef9700 1 --2- 172.21.15.31:0/2731081429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d500b1300 0x7f6d5015aea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d380098e0 tx=0x7f6d380091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.238+0000 7f6d54ef9700 1 -- 172.21.15.31:0/2731081429 shutdown_connections 2023-10-09T06:21:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.238+0000 7f6d54ef9700 1 --2- 172.21.15.31:0/2731081429 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d500b0f30 0x7f6d500cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.238+0000 7f6d54ef9700 1 --2- 172.21.15.31:0/2731081429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d500b1300 0x7f6d5015aea0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.238+0000 7f6d54ef9700 1 -- 172.21.15.31:0/2731081429 >> 172.21.15.31:0/2731081429 conn(0x7f6d5006fdc0 msgr2=0x7f6d5006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.238+0000 7f6d54ef9700 1 -- 172.21.15.31:0/2731081429 shutdown_connections 2023-10-09T06:21:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.238+0000 7f6d54ef9700 1 -- 172.21.15.31:0/2731081429 wait complete. 2023-10-09T06:21:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.239+0000 7f6d54ef9700 1 Processor -- start 2023-10-09T06:21:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.239+0000 7f6d54ef9700 1 -- start start 2023-10-09T06:21:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d54ef9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d500b0f30 0x7f6d500b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d54ef9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d500b1300 0x7f6d50158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d54ef9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d500cbd40 0x7f6d500c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d54ef9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50156a30 con 0x7f6d500b1300 2023-10-09T06:21:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d54ef9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5016b280 con 0x7f6d500b0f30 2023-10-09T06:21:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d54ef9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5016a3a0 con 0x7f6d500cbd40 2023-10-09T06:21:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d4dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d500b1300 0x7f6d50158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d4dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d500b1300 0x7f6d50158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58068/0 (socket says 172.21.15.31:58068) 2023-10-09T06:21:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d4dd9b700 1 -- 172.21.15.31:0/1790144084 learned_addr learned my addr 172.21.15.31:0/1790144084 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d4e59c700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d500b0f30 0x7f6d500b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d4ed9d700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d500cbd40 0x7f6d500c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d4dd9b700 1 -- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d500cbd40 msgr2=0x7f6d500c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d4dd9b700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d500cbd40 0x7f6d500c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d4dd9b700 1 -- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d500b0f30 msgr2=0x7f6d500b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d4dd9b700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d500b0f30 0x7f6d500b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d4dd9b700 1 -- 172.21.15.31:0/1790144084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d38009420 con 0x7f6d500b1300 2023-10-09T06:21:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d4dd9b700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d500b1300 0x7f6d50158790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d50064060 tx=0x7f6d38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d467fc700 1 -- 172.21.15.31:0/1790144084 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3800bb20 con 0x7f6d500b1300 2023-10-09T06:21:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d467fc700 1 -- 172.21.15.31:0/1790144084 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d38011420 con 0x7f6d500b1300 2023-10-09T06:21:00.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d467fc700 1 -- 172.21.15.31:0/1790144084 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d380117a0 con 0x7f6d500b1300 2023-10-09T06:21:00.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d54ef9700 1 -- 172.21.15.31:0/1790144084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5016a670 con 0x7f6d500b1300 2023-10-09T06:21:00.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.240+0000 7f6d54ef9700 1 -- 172.21.15.31:0/1790144084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5016ac30 con 0x7f6d500b1300 2023-10-09T06:21:00.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.241+0000 7f6d54ef9700 1 -- 172.21.15.31:0/1790144084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5004c3c0 con 0x7f6d500b1300 2023-10-09T06:21:00.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.242+0000 7f6d467fc700 1 -- 172.21.15.31:0/1790144084 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d38011b10 con 0x7f6d500b1300 2023-10-09T06:21:00.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.242+0000 7f6d467fc700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6d30066f30 0x7f6d300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:00.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.242+0000 7f6d467fc700 1 -- 172.21.15.31:0/1790144084 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d38085c30 con 0x7f6d500b1300 2023-10-09T06:21:00.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.242+0000 7f6d4e59c700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6d30066f30 0x7f6d300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:00.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.243+0000 7f6d4e59c700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6d30066f30 0x7f6d300693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009ca0 tx=0x7f6d48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:00.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.246+0000 7f6d467fc700 1 -- 172.21.15.31:0/1790144084 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d38052ea0 con 0x7f6d500b1300 2023-10-09T06:21:00.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.520+0000 7f6d54ef9700 1 -- 172.21.15.31:0/1790144084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6d500b0d10 con 0x7f6d500b1300 2023-10-09T06:21:00.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.521+0000 7f6d467fc700 1 -- 172.21.15.31:0/1790144084 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1102 (secure 0 0 0) 0x7f6d380564c0 con 0x7f6d500b1300 2023-10-09T06:21:00.533 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:00.534 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1696832442,"num_in_osds":8,"osd_in_since":1696832439,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":1572761,"bytes_avail":1598427239,"bytes_total":1600000000,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4273}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-09T06:20:36.915109+0000","services":{}},"progress_events":{}} 2023-10-09T06:21:00.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.523+0000 7f6d54ef9700 1 -- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6d30066f30 msgr2=0x7f6d300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:00.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.523+0000 7f6d54ef9700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6d30066f30 0x7f6d300693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009ca0 tx=0x7f6d48008040 comp rx=0 tx=0).stop 2023-10-09T06:21:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.523+0000 7f6d54ef9700 1 -- 172.21.15.31:0/1790144084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d500b1300 msgr2=0x7f6d50158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.523+0000 7f6d54ef9700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d500b1300 0x7f6d50158790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d50064060 tx=0x7f6d38017000 comp rx=0 tx=0).stop 2023-10-09T06:21:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.523+0000 7f6d54ef9700 1 -- 172.21.15.31:0/1790144084 shutdown_connections 2023-10-09T06:21:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.523+0000 7f6d54ef9700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6d30066f30 0x7f6d300693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.523+0000 7f6d54ef9700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d500cbd40 0x7f6d500c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.523+0000 7f6d54ef9700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d500b0f30 0x7f6d500b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.523+0000 7f6d54ef9700 1 --2- 172.21.15.31:0/1790144084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d500b1300 0x7f6d50158790 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.523+0000 7f6d54ef9700 1 -- 172.21.15.31:0/1790144084 >> 172.21.15.31:0/1790144084 conn(0x7f6d5006fdc0 msgr2=0x7f6d500ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.523+0000 7f6d54ef9700 1 -- 172.21.15.31:0/1790144084 shutdown_connections 2023-10-09T06:21:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.523+0000 7f6d54ef9700 1 -- 172.21.15.31:0/1790144084 wait complete. 2023-10-09T06:21:00.536 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T06:21:00.536 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:21:00.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.654+0000 7f6edf59e700 1 Processor -- start 2023-10-09T06:21:00.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.654+0000 7f6edf59e700 1 -- start start 2023-10-09T06:21:00.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.655+0000 7f6edf59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6ee00cdab0 0x7f6ee015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:00.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.655+0000 7f6edf59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee00cb7c0 con 0x7f6ee00cd6e0 2023-10-09T06:21:00.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.655+0000 7f6edf59e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee015e290 con 0x7f6ee015dda0 2023-10-09T06:21:00.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.655+0000 7f6edf59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee015e850 con 0x7f6ee00cdab0 2023-10-09T06:21:00.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.655+0000 7f6eddd9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6ee00cdab0 0x7f6ee015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:00.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.655+0000 7f6ede59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6ee00cd6e0 0x7f6ee00cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60574/0 (socket says 172.21.15.31:60574) 2023-10-09T06:21:00.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.655+0000 7f6ede59c700 1 -- 172.21.15.31:0/901002584 learned_addr learned my addr 172.21.15.31:0/901002584 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:00.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.655+0000 7f6eddd9b700 1 -- 172.21.15.31:0/901002584 >> v1:172.21.15.158:6789/0 conn(0x7f6ee015dda0 legacy=0x7f6ee015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:00.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.655+0000 7f6eddd9b700 1 -- 172.21.15.31:0/901002584 >> v1:172.21.15.31:6789/0 conn(0x7f6ee00cd6e0 legacy=0x7f6ee00cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:00.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.655+0000 7f6eddd9b700 1 -- 172.21.15.31:0/901002584 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee015e570 con 0x7f6ee00cdab0 2023-10-09T06:21:00.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.655+0000 7f6eddd9b700 1 --2- 172.21.15.31:0/901002584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ee00cdab0 0x7f6ee015d860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40098e0 tx=0x7f6ed40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2d8ae0913e1955 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:00.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.655+0000 7f6edd59a700 1 -- 172.21.15.31:0/901002584 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4009e80 con 0x7f6ee00cdab0 2023-10-09T06:21:00.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.656+0000 7f6edd59a700 1 -- 172.21.15.31:0/901002584 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed400b860 con 0x7f6ee00cdab0 2023-10-09T06:21:00.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.656+0000 7f6edd59a700 1 -- 172.21.15.31:0/901002584 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400bbe0 con 0x7f6ee00cdab0 2023-10-09T06:21:00.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.656+0000 7f6edf59e700 1 -- 172.21.15.31:0/901002584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ee00cdab0 msgr2=0x7f6ee015d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:00.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.656+0000 7f6edf59e700 1 --2- 172.21.15.31:0/901002584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ee00cdab0 0x7f6ee015d860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40098e0 tx=0x7f6ed40091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.656+0000 7f6edf59e700 1 -- 172.21.15.31:0/901002584 shutdown_connections 2023-10-09T06:21:00.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.656+0000 7f6edf59e700 1 --2- 172.21.15.31:0/901002584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ee00cdab0 0x7f6ee015d860 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.656+0000 7f6edf59e700 1 -- 172.21.15.31:0/901002584 >> 172.21.15.31:0/901002584 conn(0x7f6ee0067660 msgr2=0x7f6ee0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:00.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.656+0000 7f6edf59e700 1 -- 172.21.15.31:0/901002584 shutdown_connections 2023-10-09T06:21:00.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.656+0000 7f6edf59e700 1 -- 172.21.15.31:0/901002584 wait complete. 2023-10-09T06:21:00.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.657+0000 7f6edf59e700 1 Processor -- start 2023-10-09T06:21:00.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.657+0000 7f6edf59e700 1 -- start start 2023-10-09T06:21:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6edf59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ee00cd6e0 0x7f6ee014d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6edf59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6ee00cdab0 0x7f6ee00b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6edf59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ee015dda0 0x7f6ee00b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6edf59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00cc360 con 0x7f6ee015dda0 2023-10-09T06:21:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6edf59e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee0160c30 con 0x7f6ee00cdab0 2023-10-09T06:21:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6edf59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00cabd0 con 0x7f6ee00cd6e0 2023-10-09T06:21:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6eded9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ee015dda0 0x7f6ee00b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6eded9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ee015dda0 0x7f6ee00b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58086/0 (socket says 172.21.15.31:58086) 2023-10-09T06:21:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6eded9d700 1 -- 172.21.15.31:0/2059454646 learned_addr learned my addr 172.21.15.31:0/2059454646 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6ede59c700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ee00cd6e0 0x7f6ee014d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6eddd9b700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6ee00cdab0 0x7f6ee00b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6eded9d700 1 -- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ee00cd6e0 msgr2=0x7f6ee014d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6eded9d700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ee00cd6e0 0x7f6ee014d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6eded9d700 1 -- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6ee00cdab0 msgr2=0x7f6ee00b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6eded9d700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6ee00cdab0 0x7f6ee00b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6eded9d700 1 -- 172.21.15.31:0/2059454646 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed4009420 con 0x7f6ee015dda0 2023-10-09T06:21:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.658+0000 7f6eded9d700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ee015dda0 0x7f6ee00b2490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800c810 tx=0x7f6ed8001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.659+0000 7f6ece7fc700 1 -- 172.21.15.31:0/2059454646 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8012630 con 0x7f6ee015dda0 2023-10-09T06:21:00.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.659+0000 7f6ece7fc700 1 -- 172.21.15.31:0/2059454646 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed80127b0 con 0x7f6ee015dda0 2023-10-09T06:21:00.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.659+0000 7f6edf59e700 1 -- 172.21.15.31:0/2059454646 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee00c9fc0 con 0x7f6ee015dda0 2023-10-09T06:21:00.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.659+0000 7f6ece7fc700 1 -- 172.21.15.31:0/2059454646 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8012b70 con 0x7f6ee015dda0 2023-10-09T06:21:00.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.659+0000 7f6edf59e700 1 -- 172.21.15.31:0/2059454646 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee00ca580 con 0x7f6ee015dda0 2023-10-09T06:21:00.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.659+0000 7f6edf59e700 1 -- 172.21.15.31:0/2059454646 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee00b3a10 con 0x7f6ee015dda0 2023-10-09T06:21:00.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.660+0000 7f6ece7fc700 1 -- 172.21.15.31:0/2059454646 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ed8003030 con 0x7f6ee015dda0 2023-10-09T06:21:00.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.660+0000 7f6ece7fc700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ec0066f30 0x7f6ec00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:00.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.660+0000 7f6ece7fc700 1 -- 172.21.15.31:0/2059454646 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ed8084490 con 0x7f6ee015dda0 2023-10-09T06:21:00.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.660+0000 7f6ede59c700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ec0066f30 0x7f6ec00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:00.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.661+0000 7f6ede59c700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ec0066f30 0x7f6ec00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0007fd0 tx=0x7f6ed0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:00.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.665+0000 7f6ece7fc700 1 -- 172.21.15.31:0/2059454646 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ee00b3a10 con 0x7f6ee015dda0 2023-10-09T06:21:00.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.853+0000 7f6edf59e700 1 -- 172.21.15.31:0/2059454646 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ee00b3a10 con 0x7f6ec0066f30 2023-10-09T06:21:00.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.861+0000 7f6ece7fc700 1 -- 172.21.15.31:0/2059454646 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260133 (secure 0 0 0) 0x7f6ee00b3a10 con 0x7f6ec0066f30 2023-10-09T06:21:00.864 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:00.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.864+0000 7f6edf59e700 1 -- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ec0066f30 msgr2=0x7f6ec00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:00.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.864+0000 7f6edf59e700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ec0066f30 0x7f6ec00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0007fd0 tx=0x7f6ed0009040 comp rx=0 tx=0).stop 2023-10-09T06:21:00.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.864+0000 7f6edf59e700 1 -- 172.21.15.31:0/2059454646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ee015dda0 msgr2=0x7f6ee00b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:00.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.864+0000 7f6edf59e700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ee015dda0 0x7f6ee00b2490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800c810 tx=0x7f6ed8001650 comp rx=0 tx=0).stop 2023-10-09T06:21:00.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.864+0000 7f6edf59e700 1 -- 172.21.15.31:0/2059454646 shutdown_connections 2023-10-09T06:21:00.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.864+0000 7f6edf59e700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ec0066f30 0x7f6ec00693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.864+0000 7f6edf59e700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6ee00cd6e0 0x7f6ee014d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.864+0000 7f6edf59e700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ee015dda0 0x7f6ee00b2490 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.864+0000 7f6edf59e700 1 --2- 172.21.15.31:0/2059454646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6ee00cdab0 0x7f6ee00b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:00.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.864+0000 7f6edf59e700 1 -- 172.21.15.31:0/2059454646 >> 172.21.15.31:0/2059454646 conn(0x7f6ee0067660 msgr2=0x7f6ee00d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:00.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.864+0000 7f6edf59e700 1 -- 172.21.15.31:0/2059454646 shutdown_connections 2023-10-09T06:21:00.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:00.864+0000 7f6edf59e700 1 -- 172.21.15.31:0/2059454646 wait complete. 2023-10-09T06:21:00.868 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:21:00.876 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-09T06:21:00.513183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1708,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560791,"statfs":{"total":1600000000,"available":1598250700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.833855"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701803+0000","last_change":"2023-10-09T06:20:54.699452+0000","last_active":"2023-10-09T06:20:54.701803+0000","last_peered":"2023-10-09T06:20:54.701803+0000","last_clean":"2023-10-09T06:20:54.701803+0000","last_became_active":"2023-10-09T06:20:54.699233+0000","last_became_peered":"2023-10-09T06:20:54.699233+0000","last_unstale":"2023-10-09T06:20:54.701803+0000","last_undegraded":"2023-10-09T06:20:54.701803+0000","last_fullsized":"2023-10-09T06:20:54.701803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:22.187237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704394+0000","last_change":"2023-10-09T06:20:54.703624+0000","last_active":"2023-10-09T06:20:54.704394+0000","last_peered":"2023-10-09T06:20:54.704394+0000","last_clean":"2023-10-09T06:20:54.704394+0000","last_became_active":"2023-10-09T06:20:54.703378+0000","last_became_peered":"2023-10-09T06:20:54.703378+0000","last_unstale":"2023-10-09T06:20:54.704394+0000","last_undegraded":"2023-10-09T06:20:54.704394+0000","last_fullsized":"2023-10-09T06:20:54.704394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.698154+0000","last_change":"2023-10-09T06:20:54.698072+0000","last_active":"2023-10-09T06:20:54.698154+0000","last_peered":"2023-10-09T06:20:54.698154+0000","last_clean":"2023-10-09T06:20:54.698154+0000","last_became_active":"2023-10-09T06:20:54.697793+0000","last_became_peered":"2023-10-09T06:20:54.697793+0000","last_unstale":"2023-10-09T06:20:54.698154+0000","last_undegraded":"2023-10-09T06:20:54.698154+0000","last_fullsized":"2023-10-09T06:20:54.698154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:13:00.912045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710137+0000","last_change":"2023-10-09T06:20:54.710027+0000","last_active":"2023-10-09T06:20:54.710137+0000","last_peered":"2023-10-09T06:20:54.710137+0000","last_clean":"2023-10-09T06:20:54.710137+0000","last_became_active":"2023-10-09T06:20:54.709311+0000","last_became_peered":"2023-10-09T06:20:54.709311+0000","last_unstale":"2023-10-09T06:20:54.710137+0000","last_undegraded":"2023-10-09T06:20:54.710137+0000","last_fullsized":"2023-10-09T06:20:54.710137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:14.974632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701768+0000","last_change":"2023-10-09T06:20:54.698108+0000","last_active":"2023-10-09T06:20:54.701768+0000","last_peered":"2023-10-09T06:20:54.701768+0000","last_clean":"2023-10-09T06:20:54.701768+0000","last_became_active":"2023-10-09T06:20:54.697253+0000","last_became_peered":"2023-10-09T06:20:54.697253+0000","last_unstale":"2023-10-09T06:20:54.701768+0000","last_undegraded":"2023-10-09T06:20:54.701768+0000","last_fullsized":"2023-10-09T06:20:54.701768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:25.482181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.714409+0000","last_change":"2023-10-09T06:20:54.714338+0000","last_active":"2023-10-09T06:20:54.714409+0000","last_peered":"2023-10-09T06:20:54.714409+0000","last_clean":"2023-10-09T06:20:54.714409+0000","last_became_active":"2023-10-09T06:20:54.710317+0000","last_became_peered":"2023-10-09T06:20:54.710317+0000","last_unstale":"2023-10-09T06:20:54.714409+0000","last_undegraded":"2023-10-09T06:20:54.714409+0000","last_fullsized":"2023-10-09T06:20:54.714409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:41:46.658358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701791+0000","last_change":"2023-10-09T06:20:54.699210+0000","last_active":"2023-10-09T06:20:54.701791+0000","last_peered":"2023-10-09T06:20:54.701791+0000","last_clean":"2023-10-09T06:20:54.701791+0000","last_became_active":"2023-10-09T06:20:54.698983+0000","last_became_peered":"2023-10-09T06:20:54.698983+0000","last_unstale":"2023-10-09T06:20:54.701791+0000","last_undegraded":"2023-10-09T06:20:54.701791+0000","last_fullsized":"2023-10-09T06:20:54.701791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:36.680555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707224+0000","last_change":"2023-10-09T06:20:54.706806+0000","last_active":"2023-10-09T06:20:54.707224+0000","last_peered":"2023-10-09T06:20:54.707224+0000","last_clean":"2023-10-09T06:20:54.707224+0000","last_became_active":"2023-10-09T06:20:54.706576+0000","last_became_peered":"2023-10-09T06:20:54.706576+0000","last_unstale":"2023-10-09T06:20:54.707224+0000","last_undegraded":"2023-10-09T06:20:54.707224+0000","last_fullsized":"2023-10-09T06:20:54.707224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708515+0000","last_change":"2023-10-09T06:20:54.708381+0000","last_active":"2023-10-09T06:20:54.708515+0000","last_peered":"2023-10-09T06:20:54.708515+0000","last_clean":"2023-10-09T06:20:54.708515+0000","last_became_active":"2023-10-09T06:20:54.708151+0000","last_became_peered":"2023-10-09T06:20:54.708151+0000","last_unstale":"2023-10-09T06:20:54.708515+0000","last_undegraded":"2023-10-09T06:20:54.708515+0000","last_fullsized":"2023-10-09T06:20:54.708515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:09.107980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707948+0000","last_change":"2023-10-09T06:20:54.707785+0000","last_active":"2023-10-09T06:20:54.707948+0000","last_peered":"2023-10-09T06:20:54.707948+0000","last_clean":"2023-10-09T06:20:54.707948+0000","last_became_active":"2023-10-09T06:20:54.707546+0000","last_became_peered":"2023-10-09T06:20:54.707546+0000","last_unstale":"2023-10-09T06:20:54.707948+0000","last_undegraded":"2023-10-09T06:20:54.707948+0000","last_fullsized":"2023-10-09T06:20:54.707948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.714127+0000","last_change":"2023-10-09T06:20:54.714014+0000","last_active":"2023-10-09T06:20:54.714127+0000","last_peered":"2023-10-09T06:20:54.714127+0000","last_clean":"2023-10-09T06:20:54.714127+0000","last_became_active":"2023-10-09T06:20:54.713717+0000","last_became_peered":"2023-10-09T06:20:54.713717+0000","last_unstale":"2023-10-09T06:20:54.714127+0000","last_undegraded":"2023-10-09T06:20:54.714127+0000","last_fullsized":"2023-10-09T06:20:54.714127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704060+0000","last_change":"2023-10-09T06:20:54.703797+0000","last_active":"2023-10-09T06:20:54.704060+0000","last_peered":"2023-10-09T06:20:54.704060+0000","last_clean":"2023-10-09T06:20:54.704060+0000","last_became_active":"2023-10-09T06:20:54.703569+0000","last_became_peered":"2023-10-09T06:20:54.703569+0000","last_unstale":"2023-10-09T06:20:54.704060+0000","last_undegraded":"2023-10-09T06:20:54.704060+0000","last_fullsized":"2023-10-09T06:20:54.704060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:20.426721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704373+0000","last_change":"2023-10-09T06:20:54.704118+0000","last_active":"2023-10-09T06:20:54.704373+0000","last_peered":"2023-10-09T06:20:54.704373+0000","last_clean":"2023-10-09T06:20:54.704373+0000","last_became_active":"2023-10-09T06:20:54.703694+0000","last_became_peered":"2023-10-09T06:20:54.703694+0000","last_unstale":"2023-10-09T06:20:54.704373+0000","last_undegraded":"2023-10-09T06:20:54.704373+0000","last_fullsized":"2023-10-09T06:20:54.704373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701375+0000","last_change":"2023-10-09T06:20:54.701294+0000","last_active":"2023-10-09T06:20:54.701375+0000","last_peered":"2023-10-09T06:20:54.701375+0000","last_clean":"2023-10-09T06:20:54.701375+0000","last_became_active":"2023-10-09T06:20:54.701078+0000","last_became_peered":"2023-10-09T06:20:54.701078+0000","last_unstale":"2023-10-09T06:20:54.701375+0000","last_undegraded":"2023-10-09T06:20:54.701375+0000","last_fullsized":"2023-10-09T06:20:54.701375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707239+0000","last_change":"2023-10-09T06:20:54.707148+0000","last_active":"2023-10-09T06:20:54.707239+0000","last_peered":"2023-10-09T06:20:54.707239+0000","last_clean":"2023-10-09T06:20:54.707239+0000","last_became_active":"2023-10-09T06:20:54.706930+0000","last_became_peered":"2023-10-09T06:20:54.706930+0000","last_unstale":"2023-10-09T06:20:54.707239+0000","last_undegraded":"2023-10-09T06:20:54.707239+0000","last_fullsized":"2023-10-09T06:20:54.707239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:41.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.714191+0000","last_change":"2023-10-09T06:20:54.714117+0000","last_active":"2023-10-09T06:20:54.714191+0000","last_peered":"2023-10-09T06:20:54.714191+0000","last_clean":"2023-10-09T06:20:54.714191+0000","last_became_active":"2023-10-09T06:20:54.709963+0000","last_became_peered":"2023-10-09T06:20:54.709963+0000","last_unstale":"2023-10-09T06:20:54.714191+0000","last_undegraded":"2023-10-09T06:20:54.714191+0000","last_fullsized":"2023-10-09T06:20:54.714191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:41.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711538+0000","last_change":"2023-10-09T06:20:54.710872+0000","last_active":"2023-10-09T06:20:54.711538+0000","last_peered":"2023-10-09T06:20:54.711538+0000","last_clean":"2023-10-09T06:20:54.711538+0000","last_became_active":"2023-10-09T06:20:54.710340+0000","last_became_peered":"2023-10-09T06:20:54.710340+0000","last_unstale":"2023-10-09T06:20:54.711538+0000","last_undegraded":"2023-10-09T06:20:54.711538+0000","last_fullsized":"2023-10-09T06:20:54.711538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:22.187237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702470+0000","last_change":"2023-10-09T06:20:54.702406+0000","last_active":"2023-10-09T06:20:54.702470+0000","last_peered":"2023-10-09T06:20:54.702470+0000","last_clean":"2023-10-09T06:20:54.702470+0000","last_became_active":"2023-10-09T06:20:54.702186+0000","last_became_peered":"2023-10-09T06:20:54.702186+0000","last_unstale":"2023-10-09T06:20:54.702470+0000","last_undegraded":"2023-10-09T06:20:54.702470+0000","last_fullsized":"2023-10-09T06:20:54.702470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:25.746263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703219+0000","last_change":"2023-10-09T06:20:54.702948+0000","last_active":"2023-10-09T06:20:54.703219+0000","last_peered":"2023-10-09T06:20:54.703219+0000","last_clean":"2023-10-09T06:20:54.703219+0000","last_became_active":"2023-10-09T06:20:54.702021+0000","last_became_peered":"2023-10-09T06:20:54.702021+0000","last_unstale":"2023-10-09T06:20:54.703219+0000","last_undegraded":"2023-10-09T06:20:54.703219+0000","last_fullsized":"2023-10-09T06:20:54.703219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:22:23.939760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718359+0000","last_change":"2023-10-09T06:20:53.692487+0000","last_active":"2023-10-09T06:20:54.718359+0000","last_peered":"2023-10-09T06:20:54.718359+0000","last_clean":"2023-10-09T06:20:54.718359+0000","last_became_active":"2023-10-09T06:20:53.692243+0000","last_became_peered":"2023-10-09T06:20:53.692243+0000","last_unstale":"2023-10-09T06:20:54.718359+0000","last_undegraded":"2023-10-09T06:20:54.718359+0000","last_fullsized":"2023-10-09T06:20:54.718359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703546+0000","last_change":"2023-10-09T06:20:54.703384+0000","last_active":"2023-10-09T06:20:54.703546+0000","last_peered":"2023-10-09T06:20:54.703546+0000","last_clean":"2023-10-09T06:20:54.703546+0000","last_became_active":"2023-10-09T06:20:54.703039+0000","last_became_peered":"2023-10-09T06:20:54.703039+0000","last_unstale":"2023-10-09T06:20:54.703546+0000","last_undegraded":"2023-10-09T06:20:54.703546+0000","last_fullsized":"2023-10-09T06:20:54.703546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:41:46.658358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.720817+0000","last_change":"2023-10-09T06:20:53.691165+0000","last_active":"2023-10-09T06:20:54.720817+0000","last_peered":"2023-10-09T06:20:54.720817+0000","last_clean":"2023-10-09T06:20:54.720817+0000","last_became_active":"2023-10-09T06:20:53.690550+0000","last_became_peered":"2023-10-09T06:20:53.690550+0000","last_unstale":"2023-10-09T06:20:54.720817+0000","last_undegraded":"2023-10-09T06:20:54.720817+0000","last_fullsized":"2023-10-09T06:20:54.720817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706226+0000","last_change":"2023-10-09T06:20:54.705731+0000","last_active":"2023-10-09T06:20:54.706226+0000","last_peered":"2023-10-09T06:20:54.706226+0000","last_clean":"2023-10-09T06:20:54.706226+0000","last_became_active":"2023-10-09T06:20:54.705514+0000","last_became_peered":"2023-10-09T06:20:54.705514+0000","last_unstale":"2023-10-09T06:20:54.706226+0000","last_undegraded":"2023-10-09T06:20:54.706226+0000","last_fullsized":"2023-10-09T06:20:54.706226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:08.261543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718196+0000","last_change":"2023-10-09T06:20:53.688123+0000","last_active":"2023-10-09T06:20:54.718196+0000","last_peered":"2023-10-09T06:20:54.718196+0000","last_clean":"2023-10-09T06:20:54.718196+0000","last_became_active":"2023-10-09T06:20:53.687892+0000","last_became_peered":"2023-10-09T06:20:53.687892+0000","last_unstale":"2023-10-09T06:20:54.718196+0000","last_undegraded":"2023-10-09T06:20:54.718196+0000","last_fullsized":"2023-10-09T06:20:54.718196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711524+0000","last_change":"2023-10-09T06:20:54.710847+0000","last_active":"2023-10-09T06:20:54.711524+0000","last_peered":"2023-10-09T06:20:54.711524+0000","last_clean":"2023-10-09T06:20:54.711524+0000","last_became_active":"2023-10-09T06:20:54.709608+0000","last_became_peered":"2023-10-09T06:20:54.709608+0000","last_unstale":"2023-10-09T06:20:54.711524+0000","last_undegraded":"2023-10-09T06:20:54.711524+0000","last_fullsized":"2023-10-09T06:20:54.711524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718036+0000","last_change":"2023-10-09T06:20:53.692698+0000","last_active":"2023-10-09T06:20:54.718036+0000","last_peered":"2023-10-09T06:20:54.718036+0000","last_clean":"2023-10-09T06:20:54.718036+0000","last_became_active":"2023-10-09T06:20:53.692506+0000","last_became_peered":"2023-10-09T06:20:53.692506+0000","last_unstale":"2023-10-09T06:20:54.718036+0000","last_undegraded":"2023-10-09T06:20:54.718036+0000","last_fullsized":"2023-10-09T06:20:54.718036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:24.740060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708977+0000","last_change":"2023-10-09T06:20:54.706985+0000","last_active":"2023-10-09T06:20:54.708977+0000","last_peered":"2023-10-09T06:20:54.708977+0000","last_clean":"2023-10-09T06:20:54.708977+0000","last_became_active":"2023-10-09T06:20:54.706350+0000","last_became_peered":"2023-10-09T06:20:54.706350+0000","last_unstale":"2023-10-09T06:20:54.708977+0000","last_undegraded":"2023-10-09T06:20:54.708977+0000","last_fullsized":"2023-10-09T06:20:54.708977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.717497+0000","last_change":"2023-10-09T06:20:53.688426+0000","last_active":"2023-10-09T06:20:54.717497+0000","last_peered":"2023-10-09T06:20:54.717497+0000","last_clean":"2023-10-09T06:20:54.717497+0000","last_became_active":"2023-10-09T06:20:53.688186+0000","last_became_peered":"2023-10-09T06:20:53.688186+0000","last_unstale":"2023-10-09T06:20:54.717497+0000","last_undegraded":"2023-10-09T06:20:54.717497+0000","last_fullsized":"2023-10-09T06:20:54.717497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703715+0000","last_change":"2023-10-09T06:20:54.703174+0000","last_active":"2023-10-09T06:20:54.703715+0000","last_peered":"2023-10-09T06:20:54.703715+0000","last_clean":"2023-10-09T06:20:54.703715+0000","last_became_active":"2023-10-09T06:20:54.702079+0000","last_became_peered":"2023-10-09T06:20:54.702079+0000","last_unstale":"2023-10-09T06:20:54.703715+0000","last_undegraded":"2023-10-09T06:20:54.703715+0000","last_fullsized":"2023-10-09T06:20:54.703715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:16.997567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.716826+0000","last_change":"2023-10-09T06:20:53.685459+0000","last_active":"2023-10-09T06:20:54.716826+0000","last_peered":"2023-10-09T06:20:54.716826+0000","last_clean":"2023-10-09T06:20:54.716826+0000","last_became_active":"2023-10-09T06:20:53.685232+0000","last_became_peered":"2023-10-09T06:20:53.685232+0000","last_unstale":"2023-10-09T06:20:54.716826+0000","last_undegraded":"2023-10-09T06:20:54.716826+0000","last_fullsized":"2023-10-09T06:20:54.716826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702623+0000","last_change":"2023-10-09T06:20:54.702532+0000","last_active":"2023-10-09T06:20:54.702623+0000","last_peered":"2023-10-09T06:20:54.702623+0000","last_clean":"2023-10-09T06:20:54.702623+0000","last_became_active":"2023-10-09T06:20:54.702245+0000","last_became_peered":"2023-10-09T06:20:54.702245+0000","last_unstale":"2023-10-09T06:20:54.702623+0000","last_undegraded":"2023-10-09T06:20:54.702623+0000","last_fullsized":"2023-10-09T06:20:54.702623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:41.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.698863+0000","last_change":"2023-10-09T06:20:53.686387+0000","last_active":"2023-10-09T06:20:54.698863+0000","last_peered":"2023-10-09T06:20:54.698863+0000","last_clean":"2023-10-09T06:20:54.698863+0000","last_became_active":"2023-10-09T06:20:53.686072+0000","last_became_peered":"2023-10-09T06:20:53.686072+0000","last_unstale":"2023-10-09T06:20:54.698863+0000","last_undegraded":"2023-10-09T06:20:54.698863+0000","last_fullsized":"2023-10-09T06:20:54.698863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702605+0000","last_change":"2023-10-09T06:20:54.702542+0000","last_active":"2023-10-09T06:20:54.702605+0000","last_peered":"2023-10-09T06:20:54.702605+0000","last_clean":"2023-10-09T06:20:54.702605+0000","last_became_active":"2023-10-09T06:20:54.702307+0000","last_became_peered":"2023-10-09T06:20:54.702307+0000","last_unstale":"2023-10-09T06:20:54.702605+0000","last_undegraded":"2023-10-09T06:20:54.702605+0000","last_fullsized":"2023-10-09T06:20:54.702605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:41.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701363+0000","last_change":"2023-10-09T06:20:53.692511+0000","last_active":"2023-10-09T06:20:54.701363+0000","last_peered":"2023-10-09T06:20:54.701363+0000","last_clean":"2023-10-09T06:20:54.701363+0000","last_became_active":"2023-10-09T06:20:53.689704+0000","last_became_peered":"2023-10-09T06:20:53.689704+0000","last_unstale":"2023-10-09T06:20:54.701363+0000","last_undegraded":"2023-10-09T06:20:54.701363+0000","last_fullsized":"2023-10-09T06:20:54.701363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704634+0000","last_change":"2023-10-09T06:20:54.704450+0000","last_active":"2023-10-09T06:20:54.704634+0000","last_peered":"2023-10-09T06:20:54.704634+0000","last_clean":"2023-10-09T06:20:54.704634+0000","last_became_active":"2023-10-09T06:20:54.704220+0000","last_became_peered":"2023-10-09T06:20:54.704220+0000","last_unstale":"2023-10-09T06:20:54.704634+0000","last_undegraded":"2023-10-09T06:20:54.704634+0000","last_fullsized":"2023-10-09T06:20:54.704634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.695920+0000","last_change":"2023-10-09T06:20:53.691307+0000","last_active":"2023-10-09T06:20:54.695920+0000","last_peered":"2023-10-09T06:20:54.695920+0000","last_clean":"2023-10-09T06:20:54.695920+0000","last_became_active":"2023-10-09T06:20:53.691063+0000","last_became_peered":"2023-10-09T06:20:53.691063+0000","last_unstale":"2023-10-09T06:20:54.695920+0000","last_undegraded":"2023-10-09T06:20:54.695920+0000","last_fullsized":"2023-10-09T06:20:54.695920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711494+0000","last_change":"2023-10-09T06:20:54.710553+0000","last_active":"2023-10-09T06:20:54.711494+0000","last_peered":"2023-10-09T06:20:54.711494+0000","last_clean":"2023-10-09T06:20:54.711494+0000","last_became_active":"2023-10-09T06:20:54.709556+0000","last_became_peered":"2023-10-09T06:20:54.709556+0000","last_unstale":"2023-10-09T06:20:54.711494+0000","last_undegraded":"2023-10-09T06:20:54.711494+0000","last_fullsized":"2023-10-09T06:20:54.711494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:46.203108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706958+0000","last_change":"2023-10-09T06:20:53.692986+0000","last_active":"2023-10-09T06:20:54.706958+0000","last_peered":"2023-10-09T06:20:54.706958+0000","last_clean":"2023-10-09T06:20:54.706958+0000","last_became_active":"2023-10-09T06:20:53.692570+0000","last_became_peered":"2023-10-09T06:20:53.692570+0000","last_unstale":"2023-10-09T06:20:54.706958+0000","last_undegraded":"2023-10-09T06:20:54.706958+0000","last_fullsized":"2023-10-09T06:20:54.706958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711428+0000","last_change":"2023-10-09T06:20:54.711358+0000","last_active":"2023-10-09T06:20:54.711428+0000","last_peered":"2023-10-09T06:20:54.711428+0000","last_clean":"2023-10-09T06:20:54.711428+0000","last_became_active":"2023-10-09T06:20:54.711114+0000","last_became_peered":"2023-10-09T06:20:54.711114+0000","last_unstale":"2023-10-09T06:20:54.711428+0000","last_undegraded":"2023-10-09T06:20:54.711428+0000","last_fullsized":"2023-10-09T06:20:54.711428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:31.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.722498+0000","last_change":"2023-10-09T06:20:53.694922+0000","last_active":"2023-10-09T06:20:54.722498+0000","last_peered":"2023-10-09T06:20:54.722498+0000","last_clean":"2023-10-09T06:20:54.722498+0000","last_became_active":"2023-10-09T06:20:53.694642+0000","last_became_peered":"2023-10-09T06:20:53.694642+0000","last_unstale":"2023-10-09T06:20:54.722498+0000","last_undegraded":"2023-10-09T06:20:54.722498+0000","last_fullsized":"2023-10-09T06:20:54.722498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:52.168522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704185+0000","last_change":"2023-10-09T06:20:54.704143+0000","last_active":"2023-10-09T06:20:54.704185+0000","last_peered":"2023-10-09T06:20:54.704185+0000","last_clean":"2023-10-09T06:20:54.704185+0000","last_became_active":"2023-10-09T06:20:54.703957+0000","last_became_peered":"2023-10-09T06:20:54.703957+0000","last_unstale":"2023-10-09T06:20:54.704185+0000","last_undegraded":"2023-10-09T06:20:54.704185+0000","last_fullsized":"2023-10-09T06:20:54.704185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:30.717922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.721464+0000","last_change":"2023-10-09T06:20:53.688682+0000","last_active":"2023-10-09T06:20:54.721464+0000","last_peered":"2023-10-09T06:20:54.721464+0000","last_clean":"2023-10-09T06:20:54.721464+0000","last_became_active":"2023-10-09T06:20:53.688399+0000","last_became_peered":"2023-10-09T06:20:53.688399+0000","last_unstale":"2023-10-09T06:20:54.721464+0000","last_undegraded":"2023-10-09T06:20:54.721464+0000","last_fullsized":"2023-10-09T06:20:54.721464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703190+0000","last_change":"2023-10-09T06:20:54.702039+0000","last_active":"2023-10-09T06:20:54.703190+0000","last_peered":"2023-10-09T06:20:54.703190+0000","last_clean":"2023-10-09T06:20:54.703190+0000","last_became_active":"2023-10-09T06:20:54.701760+0000","last_became_peered":"2023-10-09T06:20:54.701760+0000","last_unstale":"2023-10-09T06:20:54.703190+0000","last_undegraded":"2023-10-09T06:20:54.703190+0000","last_fullsized":"2023-10-09T06:20:54.703190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:41:46.658358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.719418+0000","last_change":"2023-10-09T06:20:53.690779+0000","last_active":"2023-10-09T06:20:54.719418+0000","last_peered":"2023-10-09T06:20:54.719418+0000","last_clean":"2023-10-09T06:20:54.719418+0000","last_became_active":"2023-10-09T06:20:53.690585+0000","last_became_peered":"2023-10-09T06:20:53.690585+0000","last_unstale":"2023-10-09T06:20:54.719418+0000","last_undegraded":"2023-10-09T06:20:54.719418+0000","last_fullsized":"2023-10-09T06:20:54.719418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703490+0000","last_change":"2023-10-09T06:20:54.703248+0000","last_active":"2023-10-09T06:20:54.703490+0000","last_peered":"2023-10-09T06:20:54.703490+0000","last_clean":"2023-10-09T06:20:54.703490+0000","last_became_active":"2023-10-09T06:20:54.701451+0000","last_became_peered":"2023-10-09T06:20:54.701451+0000","last_unstale":"2023-10-09T06:20:54.703490+0000","last_undegraded":"2023-10-09T06:20:54.703490+0000","last_fullsized":"2023-10-09T06:20:54.703490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:05:24.245558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707243+0000","last_change":"2023-10-09T06:20:53.691221+0000","last_active":"2023-10-09T06:20:54.707243+0000","last_peered":"2023-10-09T06:20:54.707243+0000","last_clean":"2023-10-09T06:20:54.707243+0000","last_became_active":"2023-10-09T06:20:53.690265+0000","last_became_peered":"2023-10-09T06:20:53.690265+0000","last_unstale":"2023-10-09T06:20:54.707243+0000","last_undegraded":"2023-10-09T06:20:54.707243+0000","last_fullsized":"2023-10-09T06:20:54.707243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703782+0000","last_change":"2023-10-09T06:20:54.703628+0000","last_active":"2023-10-09T06:20:54.703782+0000","last_peered":"2023-10-09T06:20:54.703782+0000","last_clean":"2023-10-09T06:20:54.703782+0000","last_became_active":"2023-10-09T06:20:54.703234+0000","last_became_peered":"2023-10-09T06:20:54.703234+0000","last_unstale":"2023-10-09T06:20:54.703782+0000","last_undegraded":"2023-10-09T06:20:54.703782+0000","last_fullsized":"2023-10-09T06:20:54.703782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:10:16.498873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699009+0000","last_change":"2023-10-09T06:20:53.684515+0000","last_active":"2023-10-09T06:20:54.699009+0000","last_peered":"2023-10-09T06:20:54.699009+0000","last_clean":"2023-10-09T06:20:54.699009+0000","last_became_active":"2023-10-09T06:20:53.684265+0000","last_became_peered":"2023-10-09T06:20:53.684265+0000","last_unstale":"2023-10-09T06:20:54.699009+0000","last_undegraded":"2023-10-09T06:20:54.699009+0000","last_fullsized":"2023-10-09T06:20:54.699009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699396+0000","last_change":"2023-10-09T06:20:54.699332+0000","last_active":"2023-10-09T06:20:54.699396+0000","last_peered":"2023-10-09T06:20:54.699396+0000","last_clean":"2023-10-09T06:20:54.699396+0000","last_became_active":"2023-10-09T06:20:54.698991+0000","last_became_peered":"2023-10-09T06:20:54.698991+0000","last_unstale":"2023-10-09T06:20:54.699396+0000","last_undegraded":"2023-10-09T06:20:54.699396+0000","last_fullsized":"2023-10-09T06:20:54.699396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:41.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.721075+0000","last_change":"2023-10-09T06:20:53.694124+0000","last_active":"2023-10-09T06:20:54.721075+0000","last_peered":"2023-10-09T06:20:54.721075+0000","last_clean":"2023-10-09T06:20:54.721075+0000","last_became_active":"2023-10-09T06:20:53.693903+0000","last_became_peered":"2023-10-09T06:20:53.693903+0000","last_unstale":"2023-10-09T06:20:54.721075+0000","last_undegraded":"2023-10-09T06:20:54.721075+0000","last_fullsized":"2023-10-09T06:20:54.721075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704529+0000","last_change":"2023-10-09T06:20:54.704310+0000","last_active":"2023-10-09T06:20:54.704529+0000","last_peered":"2023-10-09T06:20:54.704529+0000","last_clean":"2023-10-09T06:20:54.704529+0000","last_became_active":"2023-10-09T06:20:54.703990+0000","last_became_peered":"2023-10-09T06:20:54.703990+0000","last_unstale":"2023-10-09T06:20:54.704529+0000","last_undegraded":"2023-10-09T06:20:54.704529+0000","last_fullsized":"2023-10-09T06:20:54.704529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:14.974632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.719608+0000","last_change":"2023-10-09T06:20:53.692436+0000","last_active":"2023-10-09T06:20:54.719608+0000","last_peered":"2023-10-09T06:20:54.719608+0000","last_clean":"2023-10-09T06:20:54.719608+0000","last_became_active":"2023-10-09T06:20:53.692191+0000","last_became_peered":"2023-10-09T06:20:53.692191+0000","last_unstale":"2023-10-09T06:20:54.719608+0000","last_undegraded":"2023-10-09T06:20:54.719608+0000","last_fullsized":"2023-10-09T06:20:54.719608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703765+0000","last_change":"2023-10-09T06:20:54.703474+0000","last_active":"2023-10-09T06:20:54.703765+0000","last_peered":"2023-10-09T06:20:54.703765+0000","last_clean":"2023-10-09T06:20:54.703765+0000","last_became_active":"2023-10-09T06:20:54.702986+0000","last_became_peered":"2023-10-09T06:20:54.702986+0000","last_unstale":"2023-10-09T06:20:54.703765+0000","last_undegraded":"2023-10-09T06:20:54.703765+0000","last_fullsized":"2023-10-09T06:20:54.703765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:46.203108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699329+0000","last_change":"2023-10-09T06:20:53.692601+0000","last_active":"2023-10-09T06:20:54.699329+0000","last_peered":"2023-10-09T06:20:54.699329+0000","last_clean":"2023-10-09T06:20:54.699329+0000","last_became_active":"2023-10-09T06:20:53.692249+0000","last_became_peered":"2023-10-09T06:20:53.692249+0000","last_unstale":"2023-10-09T06:20:54.699329+0000","last_undegraded":"2023-10-09T06:20:54.699329+0000","last_fullsized":"2023-10-09T06:20:54.699329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710118+0000","last_change":"2023-10-09T06:20:54.709870+0000","last_active":"2023-10-09T06:20:54.710118+0000","last_peered":"2023-10-09T06:20:54.710118+0000","last_clean":"2023-10-09T06:20:54.710118+0000","last_became_active":"2023-10-09T06:20:54.709017+0000","last_became_peered":"2023-10-09T06:20:54.709017+0000","last_unstale":"2023-10-09T06:20:54.710118+0000","last_undegraded":"2023-10-09T06:20:54.710118+0000","last_fullsized":"2023-10-09T06:20:54.710118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:48.043711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707068+0000","last_change":"2023-10-09T06:20:53.694336+0000","last_active":"2023-10-09T06:20:54.707068+0000","last_peered":"2023-10-09T06:20:54.707068+0000","last_clean":"2023-10-09T06:20:54.707068+0000","last_became_active":"2023-10-09T06:20:53.694107+0000","last_became_peered":"2023-10-09T06:20:53.694107+0000","last_unstale":"2023-10-09T06:20:54.707068+0000","last_undegraded":"2023-10-09T06:20:54.707068+0000","last_fullsized":"2023-10-09T06:20:54.707068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.705770+0000","last_change":"2023-10-09T06:20:54.705708+0000","last_active":"2023-10-09T06:20:54.705770+0000","last_peered":"2023-10-09T06:20:54.705770+0000","last_clean":"2023-10-09T06:20:54.705770+0000","last_became_active":"2023-10-09T06:20:54.705487+0000","last_became_peered":"2023-10-09T06:20:54.705487+0000","last_unstale":"2023-10-09T06:20:54.705770+0000","last_undegraded":"2023-10-09T06:20:54.705770+0000","last_fullsized":"2023-10-09T06:20:54.705770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:20.728264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701105+0000","last_change":"2023-10-09T06:20:54.700944+0000","last_active":"2023-10-09T06:20:54.701105+0000","last_peered":"2023-10-09T06:20:54.701105+0000","last_clean":"2023-10-09T06:20:54.701105+0000","last_became_active":"2023-10-09T06:20:54.700732+0000","last_became_peered":"2023-10-09T06:20:54.700732+0000","last_unstale":"2023-10-09T06:20:54.701105+0000","last_undegraded":"2023-10-09T06:20:54.701105+0000","last_fullsized":"2023-10-09T06:20:54.701105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.697278+0000","last_change":"2023-10-09T06:20:53.688729+0000","last_active":"2023-10-09T06:20:54.697278+0000","last_peered":"2023-10-09T06:20:54.697278+0000","last_clean":"2023-10-09T06:20:54.697278+0000","last_became_active":"2023-10-09T06:20:53.688468+0000","last_became_peered":"2023-10-09T06:20:53.688468+0000","last_unstale":"2023-10-09T06:20:54.697278+0000","last_undegraded":"2023-10-09T06:20:54.697278+0000","last_fullsized":"2023-10-09T06:20:54.697278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710841+0000","last_change":"2023-10-09T06:20:54.710794+0000","last_active":"2023-10-09T06:20:54.710841+0000","last_peered":"2023-10-09T06:20:54.710841+0000","last_clean":"2023-10-09T06:20:54.710841+0000","last_became_active":"2023-10-09T06:20:54.710597+0000","last_became_peered":"2023-10-09T06:20:54.710597+0000","last_unstale":"2023-10-09T06:20:54.710841+0000","last_undegraded":"2023-10-09T06:20:54.710841+0000","last_fullsized":"2023-10-09T06:20:54.710841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:46.203108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707347+0000","last_change":"2023-10-09T06:20:53.691840+0000","last_active":"2023-10-09T06:20:54.707347+0000","last_peered":"2023-10-09T06:20:54.707347+0000","last_clean":"2023-10-09T06:20:54.707347+0000","last_became_active":"2023-10-09T06:20:53.691004+0000","last_became_peered":"2023-10-09T06:20:53.691004+0000","last_unstale":"2023-10-09T06:20:54.707347+0000","last_undegraded":"2023-10-09T06:20:54.707347+0000","last_fullsized":"2023-10-09T06:20:54.707347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696667+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:20:54.696667+0000","last_peered":"2023-10-09T06:20:54.696667+0000","last_clean":"2023-10-09T06:20:54.696667+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:20:54.696667+0000","last_undegraded":"2023-10-09T06:20:54.696667+0000","last_fullsized":"2023-10-09T06:20:54.696667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702605+0000","last_change":"2023-10-09T06:20:54.702399+0000","last_active":"2023-10-09T06:20:54.702605+0000","last_peered":"2023-10-09T06:20:54.702605+0000","last_clean":"2023-10-09T06:20:54.702605+0000","last_became_active":"2023-10-09T06:20:54.701799+0000","last_became_peered":"2023-10-09T06:20:54.701799+0000","last_unstale":"2023-10-09T06:20:54.702605+0000","last_undegraded":"2023-10-09T06:20:54.702605+0000","last_fullsized":"2023-10-09T06:20:54.702605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696279+0000","last_change":"2023-10-09T06:20:53.694796+0000","last_active":"2023-10-09T06:20:54.696279+0000","last_peered":"2023-10-09T06:20:54.696279+0000","last_clean":"2023-10-09T06:20:54.696279+0000","last_became_active":"2023-10-09T06:20:53.694541+0000","last_became_peered":"2023-10-09T06:20:53.694541+0000","last_unstale":"2023-10-09T06:20:54.696279+0000","last_undegraded":"2023-10-09T06:20:54.696279+0000","last_fullsized":"2023-10-09T06:20:54.696279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696773+0000","last_change":"2023-10-09T06:20:53.690652+0000","last_active":"2023-10-09T06:20:54.696773+0000","last_peered":"2023-10-09T06:20:54.696773+0000","last_clean":"2023-10-09T06:20:54.696773+0000","last_became_active":"2023-10-09T06:20:53.690426+0000","last_became_peered":"2023-10-09T06:20:53.690426+0000","last_unstale":"2023-10-09T06:20:54.696773+0000","last_undegraded":"2023-10-09T06:20:54.696773+0000","last_fullsized":"2023-10-09T06:20:54.696773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704374+0000","last_change":"2023-10-09T06:20:54.703240+0000","last_active":"2023-10-09T06:20:54.704374+0000","last_peered":"2023-10-09T06:20:54.704374+0000","last_clean":"2023-10-09T06:20:54.704374+0000","last_became_active":"2023-10-09T06:20:54.703000+0000","last_became_peered":"2023-10-09T06:20:54.703000+0000","last_unstale":"2023-10-09T06:20:54.704374+0000","last_undegraded":"2023-10-09T06:20:54.704374+0000","last_fullsized":"2023-10-09T06:20:54.704374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T06:20:55.695702+0000","last_change":"2023-10-09T06:20:53.693463+0000","last_active":"2023-10-09T06:20:55.695702+0000","last_peered":"2023-10-09T06:20:55.695702+0000","last_clean":"2023-10-09T06:20:55.695702+0000","last_became_active":"2023-10-09T06:20:53.693223+0000","last_became_peered":"2023-10-09T06:20:53.693223+0000","last_unstale":"2023-10-09T06:20:55.695702+0000","last_undegraded":"2023-10-09T06:20:55.695702+0000","last_fullsized":"2023-10-09T06:20:55.695702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.705276+0000","last_change":"2023-10-09T06:20:54.705213+0000","last_active":"2023-10-09T06:20:54.705276+0000","last_peered":"2023-10-09T06:20:54.705276+0000","last_clean":"2023-10-09T06:20:54.705276+0000","last_became_active":"2023-10-09T06:20:54.704911+0000","last_became_peered":"2023-10-09T06:20:54.704911+0000","last_unstale":"2023-10-09T06:20:54.705276+0000","last_undegraded":"2023-10-09T06:20:54.705276+0000","last_fullsized":"2023-10-09T06:20:54.705276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:22:23.939760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718435+0000","last_change":"2023-10-09T06:20:53.689939+0000","last_active":"2023-10-09T06:20:54.718435+0000","last_peered":"2023-10-09T06:20:54.718435+0000","last_clean":"2023-10-09T06:20:54.718435+0000","last_became_active":"2023-10-09T06:20:53.689710+0000","last_became_peered":"2023-10-09T06:20:53.689710+0000","last_unstale":"2023-10-09T06:20:54.718435+0000","last_undegraded":"2023-10-09T06:20:54.718435+0000","last_fullsized":"2023-10-09T06:20:54.718435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.698754+0000","last_change":"2023-10-09T06:20:54.698648+0000","last_active":"2023-10-09T06:20:54.698754+0000","last_peered":"2023-10-09T06:20:54.698754+0000","last_clean":"2023-10-09T06:20:54.698754+0000","last_became_active":"2023-10-09T06:20:54.698423+0000","last_became_peered":"2023-10-09T06:20:54.698423+0000","last_unstale":"2023-10-09T06:20:54.698754+0000","last_undegraded":"2023-10-09T06:20:54.698754+0000","last_fullsized":"2023-10-09T06:20:54.698754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.694880+0000","last_change":"2023-10-09T06:20:53.691357+0000","last_active":"2023-10-09T06:20:54.694880+0000","last_peered":"2023-10-09T06:20:54.694880+0000","last_clean":"2023-10-09T06:20:54.694880+0000","last_became_active":"2023-10-09T06:20:53.690961+0000","last_became_peered":"2023-10-09T06:20:53.690961+0000","last_unstale":"2023-10-09T06:20:54.694880+0000","last_undegraded":"2023-10-09T06:20:54.694880+0000","last_fullsized":"2023-10-09T06:20:54.694880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:19.722061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706057+0000","last_change":"2023-10-09T06:20:54.705990+0000","last_active":"2023-10-09T06:20:54.706057+0000","last_peered":"2023-10-09T06:20:54.706057+0000","last_clean":"2023-10-09T06:20:54.706057+0000","last_became_active":"2023-10-09T06:20:54.705793+0000","last_became_peered":"2023-10-09T06:20:54.705793+0000","last_unstale":"2023-10-09T06:20:54.706057+0000","last_undegraded":"2023-10-09T06:20:54.706057+0000","last_fullsized":"2023-10-09T06:20:54.706057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:53.174725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699422+0000","last_change":"2023-10-09T06:20:53.693042+0000","last_active":"2023-10-09T06:20:54.699422+0000","last_peered":"2023-10-09T06:20:54.699422+0000","last_clean":"2023-10-09T06:20:54.699422+0000","last_became_active":"2023-10-09T06:20:53.692818+0000","last_became_peered":"2023-10-09T06:20:53.692818+0000","last_unstale":"2023-10-09T06:20:54.699422+0000","last_undegraded":"2023-10-09T06:20:54.699422+0000","last_fullsized":"2023-10-09T06:20:54.699422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702969+0000","last_change":"2023-10-09T06:20:54.702866+0000","last_active":"2023-10-09T06:20:54.702969+0000","last_peered":"2023-10-09T06:20:54.702969+0000","last_clean":"2023-10-09T06:20:54.702969+0000","last_became_active":"2023-10-09T06:20:54.702652+0000","last_became_peered":"2023-10-09T06:20:54.702652+0000","last_unstale":"2023-10-09T06:20:54.702969+0000","last_undegraded":"2023-10-09T06:20:54.702969+0000","last_fullsized":"2023-10-09T06:20:54.702969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:08.261543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699122+0000","last_change":"2023-10-09T06:20:53.692859+0000","last_active":"2023-10-09T06:20:54.699122+0000","last_peered":"2023-10-09T06:20:54.699122+0000","last_clean":"2023-10-09T06:20:54.699122+0000","last_became_active":"2023-10-09T06:20:53.687193+0000","last_became_peered":"2023-10-09T06:20:53.687193+0000","last_unstale":"2023-10-09T06:20:54.699122+0000","last_undegraded":"2023-10-09T06:20:54.699122+0000","last_fullsized":"2023-10-09T06:20:54.699122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706025+0000","last_change":"2023-10-09T06:20:54.705836+0000","last_active":"2023-10-09T06:20:54.706025+0000","last_peered":"2023-10-09T06:20:54.706025+0000","last_clean":"2023-10-09T06:20:54.706025+0000","last_became_active":"2023-10-09T06:20:54.705607+0000","last_became_peered":"2023-10-09T06:20:54.705607+0000","last_unstale":"2023-10-09T06:20:54.706025+0000","last_undegraded":"2023-10-09T06:20:54.706025+0000","last_fullsized":"2023-10-09T06:20:54.706025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:17.435271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718723+0000","last_change":"2023-10-09T06:20:53.688523+0000","last_active":"2023-10-09T06:20:54.718723+0000","last_peered":"2023-10-09T06:20:54.718723+0000","last_clean":"2023-10-09T06:20:54.718723+0000","last_became_active":"2023-10-09T06:20:53.688245+0000","last_became_peered":"2023-10-09T06:20:53.688245+0000","last_unstale":"2023-10-09T06:20:54.718723+0000","last_undegraded":"2023-10-09T06:20:54.718723+0000","last_fullsized":"2023-10-09T06:20:54.718723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:52.168522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704441+0000","last_change":"2023-10-09T06:20:54.704343+0000","last_active":"2023-10-09T06:20:54.704441+0000","last_peered":"2023-10-09T06:20:54.704441+0000","last_clean":"2023-10-09T06:20:54.704441+0000","last_became_active":"2023-10-09T06:20:54.704076+0000","last_became_peered":"2023-10-09T06:20:54.704076+0000","last_unstale":"2023-10-09T06:20:54.704441+0000","last_undegraded":"2023-10-09T06:20:54.704441+0000","last_fullsized":"2023-10-09T06:20:54.704441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:41.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696258+0000","last_change":"2023-10-09T06:20:53.693147+0000","last_active":"2023-10-09T06:20:54.696258+0000","last_peered":"2023-10-09T06:20:54.696258+0000","last_clean":"2023-10-09T06:20:54.696258+0000","last_became_active":"2023-10-09T06:20:53.692925+0000","last_became_peered":"2023-10-09T06:20:53.692925+0000","last_unstale":"2023-10-09T06:20:54.696258+0000","last_undegraded":"2023-10-09T06:20:54.696258+0000","last_fullsized":"2023-10-09T06:20:54.696258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710381+0000","last_change":"2023-10-09T06:20:54.710313+0000","last_active":"2023-10-09T06:20:54.710381+0000","last_peered":"2023-10-09T06:20:54.710381+0000","last_clean":"2023-10-09T06:20:54.710381+0000","last_became_active":"2023-10-09T06:20:54.710082+0000","last_became_peered":"2023-10-09T06:20:54.710082+0000","last_unstale":"2023-10-09T06:20:54.710381+0000","last_undegraded":"2023-10-09T06:20:54.710381+0000","last_fullsized":"2023-10-09T06:20:54.710381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:45.285681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.720656+0000","last_change":"2023-10-09T06:20:53.692399+0000","last_active":"2023-10-09T06:20:54.720656+0000","last_peered":"2023-10-09T06:20:54.720656+0000","last_clean":"2023-10-09T06:20:54.720656+0000","last_became_active":"2023-10-09T06:20:53.692157+0000","last_became_peered":"2023-10-09T06:20:53.692157+0000","last_unstale":"2023-10-09T06:20:54.720656+0000","last_undegraded":"2023-10-09T06:20:54.720656+0000","last_fullsized":"2023-10-09T06:20:54.720656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711476+0000","last_change":"2023-10-09T06:20:54.710127+0000","last_active":"2023-10-09T06:20:54.711476+0000","last_peered":"2023-10-09T06:20:54.711476+0000","last_clean":"2023-10-09T06:20:54.711476+0000","last_became_active":"2023-10-09T06:20:54.709293+0000","last_became_peered":"2023-10-09T06:20:54.709293+0000","last_unstale":"2023-10-09T06:20:54.711476+0000","last_undegraded":"2023-10-09T06:20:54.711476+0000","last_fullsized":"2023-10-09T06:20:54.711476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:22:23.939760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718472+0000","last_change":"2023-10-09T06:20:53.687221+0000","last_active":"2023-10-09T06:20:54.718472+0000","last_peered":"2023-10-09T06:20:54.718472+0000","last_clean":"2023-10-09T06:20:54.718472+0000","last_became_active":"2023-10-09T06:20:53.686998+0000","last_became_peered":"2023-10-09T06:20:53.686998+0000","last_unstale":"2023-10-09T06:20:54.718472+0000","last_undegraded":"2023-10-09T06:20:54.718472+0000","last_fullsized":"2023-10-09T06:20:54.718472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703747+0000","last_change":"2023-10-09T06:20:54.703089+0000","last_active":"2023-10-09T06:20:54.703747+0000","last_peered":"2023-10-09T06:20:54.703747+0000","last_clean":"2023-10-09T06:20:54.703747+0000","last_became_active":"2023-10-09T06:20:54.702720+0000","last_became_peered":"2023-10-09T06:20:54.702720+0000","last_unstale":"2023-10-09T06:20:54.703747+0000","last_undegraded":"2023-10-09T06:20:54.703747+0000","last_fullsized":"2023-10-09T06:20:54.703747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:48.043711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.700469+0000","last_change":"2023-10-09T06:20:54.700400+0000","last_active":"2023-10-09T06:20:54.700469+0000","last_peered":"2023-10-09T06:20:54.700469+0000","last_clean":"2023-10-09T06:20:54.700469+0000","last_became_active":"2023-10-09T06:20:54.700120+0000","last_became_peered":"2023-10-09T06:20:54.700120+0000","last_unstale":"2023-10-09T06:20:54.700469+0000","last_undegraded":"2023-10-09T06:20:54.700469+0000","last_fullsized":"2023-10-09T06:20:54.700469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711227+0000","last_change":"2023-10-09T06:20:54.711172+0000","last_active":"2023-10-09T06:20:54.711227+0000","last_peered":"2023-10-09T06:20:54.711227+0000","last_clean":"2023-10-09T06:20:54.711227+0000","last_became_active":"2023-10-09T06:20:54.710983+0000","last_became_peered":"2023-10-09T06:20:54.710983+0000","last_unstale":"2023-10-09T06:20:54.711227+0000","last_undegraded":"2023-10-09T06:20:54.711227+0000","last_fullsized":"2023-10-09T06:20:54.711227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:20.728264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.709159+0000","last_change":"2023-10-09T06:20:54.707142+0000","last_active":"2023-10-09T06:20:54.709159+0000","last_peered":"2023-10-09T06:20:54.709159+0000","last_clean":"2023-10-09T06:20:54.709159+0000","last_became_active":"2023-10-09T06:20:54.706670+0000","last_became_peered":"2023-10-09T06:20:54.706670+0000","last_unstale":"2023-10-09T06:20:54.709159+0000","last_undegraded":"2023-10-09T06:20:54.709159+0000","last_fullsized":"2023-10-09T06:20:54.709159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:09.107980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701930+0000","last_change":"2023-10-09T06:20:54.701836+0000","last_active":"2023-10-09T06:20:54.701930+0000","last_peered":"2023-10-09T06:20:54.701930+0000","last_clean":"2023-10-09T06:20:54.701930+0000","last_became_active":"2023-10-09T06:20:54.701556+0000","last_became_peered":"2023-10-09T06:20:54.701556+0000","last_unstale":"2023-10-09T06:20:54.701930+0000","last_undegraded":"2023-10-09T06:20:54.701930+0000","last_fullsized":"2023-10-09T06:20:54.701930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708330+0000","last_change":"2023-10-09T06:20:54.708268+0000","last_active":"2023-10-09T06:20:54.708330+0000","last_peered":"2023-10-09T06:20:54.708330+0000","last_clean":"2023-10-09T06:20:54.708330+0000","last_became_active":"2023-10-09T06:20:54.707751+0000","last_became_peered":"2023-10-09T06:20:54.707751+0000","last_unstale":"2023-10-09T06:20:54.708330+0000","last_undegraded":"2023-10-09T06:20:54.708330+0000","last_fullsized":"2023-10-09T06:20:54.708330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704996+0000","last_change":"2023-10-09T06:20:54.704931+0000","last_active":"2023-10-09T06:20:54.704996+0000","last_peered":"2023-10-09T06:20:54.704996+0000","last_clean":"2023-10-09T06:20:54.704996+0000","last_became_active":"2023-10-09T06:20:54.704697+0000","last_became_peered":"2023-10-09T06:20:54.704697+0000","last_unstale":"2023-10-09T06:20:54.704996+0000","last_undegraded":"2023-10-09T06:20:54.704996+0000","last_fullsized":"2023-10-09T06:20:54.704996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702925+0000","last_change":"2023-10-09T06:20:54.702684+0000","last_active":"2023-10-09T06:20:54.702925+0000","last_peered":"2023-10-09T06:20:54.702925+0000","last_clean":"2023-10-09T06:20:54.702925+0000","last_became_active":"2023-10-09T06:20:54.702422+0000","last_became_peered":"2023-10-09T06:20:54.702422+0000","last_unstale":"2023-10-09T06:20:54.702925+0000","last_undegraded":"2023-10-09T06:20:54.702925+0000","last_fullsized":"2023-10-09T06:20:54.702925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708093+0000","last_change":"2023-10-09T06:20:54.708004+0000","last_active":"2023-10-09T06:20:54.708093+0000","last_peered":"2023-10-09T06:20:54.708093+0000","last_clean":"2023-10-09T06:20:54.708093+0000","last_became_active":"2023-10-09T06:20:54.707760+0000","last_became_peered":"2023-10-09T06:20:54.707760+0000","last_unstale":"2023-10-09T06:20:54.708093+0000","last_undegraded":"2023-10-09T06:20:54.708093+0000","last_fullsized":"2023-10-09T06:20:54.708093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.709600+0000","last_change":"2023-10-09T06:20:54.709536+0000","last_active":"2023-10-09T06:20:54.709600+0000","last_peered":"2023-10-09T06:20:54.709600+0000","last_clean":"2023-10-09T06:20:54.709600+0000","last_became_active":"2023-10-09T06:20:54.707797+0000","last_became_peered":"2023-10-09T06:20:54.707797+0000","last_unstale":"2023-10-09T06:20:54.709600+0000","last_undegraded":"2023-10-09T06:20:54.709600+0000","last_fullsized":"2023-10-09T06:20:54.709600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:10:16.498873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708462+0000","last_change":"2023-10-09T06:20:54.708406+0000","last_active":"2023-10-09T06:20:54.708462+0000","last_peered":"2023-10-09T06:20:54.708462+0000","last_clean":"2023-10-09T06:20:54.708462+0000","last_became_active":"2023-10-09T06:20:54.708045+0000","last_became_peered":"2023-10-09T06:20:54.708045+0000","last_unstale":"2023-10-09T06:20:54.708462+0000","last_undegraded":"2023-10-09T06:20:54.708462+0000","last_fullsized":"2023-10-09T06:20:54.708462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711509+0000","last_change":"2023-10-09T06:20:54.710694+0000","last_active":"2023-10-09T06:20:54.711509+0000","last_peered":"2023-10-09T06:20:54.711509+0000","last_clean":"2023-10-09T06:20:54.711509+0000","last_became_active":"2023-10-09T06:20:54.709873+0000","last_became_peered":"2023-10-09T06:20:54.709873+0000","last_unstale":"2023-10-09T06:20:54.711509+0000","last_undegraded":"2023-10-09T06:20:54.711509+0000","last_fullsized":"2023-10-09T06:20:54.711509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:25.482181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703512+0000","last_change":"2023-10-09T06:20:54.703439+0000","last_active":"2023-10-09T06:20:54.703512+0000","last_peered":"2023-10-09T06:20:54.703512+0000","last_clean":"2023-10-09T06:20:54.703512+0000","last_became_active":"2023-10-09T06:20:54.702617+0000","last_became_peered":"2023-10-09T06:20:54.702617+0000","last_unstale":"2023-10-09T06:20:54.703512+0000","last_undegraded":"2023-10-09T06:20:54.703512+0000","last_fullsized":"2023-10-09T06:20:54.703512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704333+0000","last_change":"2023-10-09T06:20:54.704167+0000","last_active":"2023-10-09T06:20:54.704333+0000","last_peered":"2023-10-09T06:20:54.704333+0000","last_clean":"2023-10-09T06:20:54.704333+0000","last_became_active":"2023-10-09T06:20:54.703924+0000","last_became_peered":"2023-10-09T06:20:54.703924+0000","last_unstale":"2023-10-09T06:20:54.704333+0000","last_undegraded":"2023-10-09T06:20:54.704333+0000","last_fullsized":"2023-10-09T06:20:54.704333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]}],"pool_statfs":[]}} 2023-10-09T06:21:03.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:21:04.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.068+0000 7faa90a8b700 1 Processor -- start 2023-10-09T06:21:04.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.068+0000 7faa90a8b700 1 -- start start 2023-10-09T06:21:04.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.069+0000 7faa90a8b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa8c152010 0x7faa8c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.069+0000 7faa90a8b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faa8c1523e0 0x7faa8c06c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.069+0000 7faa90a8b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c06c010 con 0x7faa8c158e50 2023-10-09T06:21:04.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.069+0000 7faa90a8b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c06bd10 con 0x7faa8c152010 2023-10-09T06:21:04.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.069+0000 7faa90a8b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c15c060 con 0x7faa8c1523e0 2023-10-09T06:21:04.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.070+0000 7faa8a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa8c152010 0x7faa8c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.070+0000 7faa8a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa8c152010 0x7faa8c15b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58098/0 (socket says 172.21.15.31:58098) 2023-10-09T06:21:04.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.070+0000 7faa8a59c700 1 -- 172.21.15.31:0/3739045351 learned_addr learned my addr 172.21.15.31:0/3739045351 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:04.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.070+0000 7faa89d9b700 1 --2- 172.21.15.31:0/3739045351 >> v2:172.21.15.158:3300/0 conn(0x7faa8c1523e0 0x7faa8c06c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.070+0000 7faa8a59c700 1 -- 172.21.15.31:0/3739045351 >> v2:172.21.15.158:3300/0 conn(0x7faa8c1523e0 msgr2=0x7faa8c06c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:04.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.070+0000 7faa8a59c700 1 --2- 172.21.15.31:0/3739045351 >> v2:172.21.15.158:3300/0 conn(0x7faa8c1523e0 0x7faa8c06c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.070+0000 7faa8a59c700 1 -- 172.21.15.31:0/3739045351 >> v1:172.21.15.158:6789/0 conn(0x7faa8c158e50 legacy=0x7faa8c0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.070+0000 7faa8a59c700 1 -- 172.21.15.31:0/3739045351 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c15c340 con 0x7faa8c152010 2023-10-09T06:21:04.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.070+0000 7faa8a59c700 1 --2- 172.21.15.31:0/3739045351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c152010 0x7faa8c15b810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0ceae0 tx=0x7faa84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d67778d72186467 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:04.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.070+0000 7faa8959a700 1 -- 172.21.15.31:0/3739045351 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8400e070 con 0x7faa8c152010 2023-10-09T06:21:04.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.070+0000 7faa8959a700 1 -- 172.21.15.31:0/3739045351 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8400ba20 con 0x7faa8c152010 2023-10-09T06:21:04.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.070+0000 7faa8959a700 1 -- 172.21.15.31:0/3739045351 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840092e0 con 0x7faa8c152010 2023-10-09T06:21:04.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.071+0000 7faa90a8b700 1 -- 172.21.15.31:0/3739045351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c152010 msgr2=0x7faa8c15b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.071+0000 7faa90a8b700 1 --2- 172.21.15.31:0/3739045351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c152010 0x7faa8c15b810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0ceae0 tx=0x7faa84009840 comp rx=0 tx=0).stop 2023-10-09T06:21:04.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.071+0000 7faa90a8b700 1 -- 172.21.15.31:0/3739045351 shutdown_connections 2023-10-09T06:21:04.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.071+0000 7faa90a8b700 1 --2- 172.21.15.31:0/3739045351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c152010 0x7faa8c15b810 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.071+0000 7faa90a8b700 1 --2- 172.21.15.31:0/3739045351 >> v2:172.21.15.158:3300/0 conn(0x7faa8c1523e0 0x7faa8c06c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.071+0000 7faa90a8b700 1 -- 172.21.15.31:0/3739045351 >> 172.21.15.31:0/3739045351 conn(0x7faa8c069870 msgr2=0x7faa8c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:04.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.071+0000 7faa90a8b700 1 -- 172.21.15.31:0/3739045351 shutdown_connections 2023-10-09T06:21:04.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.071+0000 7faa90a8b700 1 -- 172.21.15.31:0/3739045351 wait complete. 2023-10-09T06:21:04.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.072+0000 7faa90a8b700 1 Processor -- start 2023-10-09T06:21:04.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.072+0000 7faa90a8b700 1 -- start start 2023-10-09T06:21:04.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa90a8b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c152010 0x7faa8c068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa90a8b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa8c1523e0 0x7faa8c14d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa90a8b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa8c158e50 0x7faa8c15a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa90a8b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c16a460 con 0x7faa8c152010 2023-10-09T06:21:04.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa90a8b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c16a740 con 0x7faa8c1523e0 2023-10-09T06:21:04.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa90a8b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c16aa20 con 0x7faa8c158e50 2023-10-09T06:21:04.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa8a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c152010 0x7faa8c068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa8a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c152010 0x7faa8c068820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58108/0 (socket says 172.21.15.31:58108) 2023-10-09T06:21:04.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa8a59c700 1 -- 172.21.15.31:0/2264545019 learned_addr learned my addr 172.21.15.31:0/2264545019 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:04.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa89d9b700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa8c1523e0 0x7faa8c14d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa8ad9d700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa8c158e50 0x7faa8c15a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa8a59c700 1 -- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa8c158e50 msgr2=0x7faa8c15a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa8a59c700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa8c158e50 0x7faa8c15a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa8a59c700 1 -- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa8c1523e0 msgr2=0x7faa8c14d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa8a59c700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa8c1523e0 0x7faa8c14d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa8a59c700 1 -- 172.21.15.31:0/2264545019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa84009ae0 con 0x7faa8c152010 2023-10-09T06:21:04.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa8ad9d700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa8c158e50 0x7faa8c15a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:04.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.073+0000 7faa8a59c700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c152010 0x7faa8c068820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0c59e0 tx=0x7faa84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:04.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.074+0000 7faa827fc700 1 -- 172.21.15.31:0/2264545019 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84008980 con 0x7faa8c152010 2023-10-09T06:21:04.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.074+0000 7faa827fc700 1 -- 172.21.15.31:0/2264545019 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa84008b00 con 0x7faa8c152010 2023-10-09T06:21:04.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.074+0000 7faa90a8b700 1 -- 172.21.15.31:0/2264545019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c16ad00 con 0x7faa8c152010 2023-10-09T06:21:04.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.074+0000 7faa827fc700 1 -- 172.21.15.31:0/2264545019 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84025460 con 0x7faa8c152010 2023-10-09T06:21:04.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.074+0000 7faa90a8b700 1 -- 172.21.15.31:0/2264545019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c16b220 con 0x7faa8c152010 2023-10-09T06:21:04.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.074+0000 7faa90a8b700 1 -- 172.21.15.31:0/2264545019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c16a5a0 con 0x7faa8c152010 2023-10-09T06:21:04.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.075+0000 7faa827fc700 1 -- 172.21.15.31:0/2264545019 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa84003040 con 0x7faa8c152010 2023-10-09T06:21:04.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.075+0000 7faa827fc700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faa6c066f30 0x7faa6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.075+0000 7faa827fc700 1 -- 172.21.15.31:0/2264545019 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa84085e90 con 0x7faa8c152010 2023-10-09T06:21:04.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.075+0000 7faa89d9b700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faa6c066f30 0x7faa6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.076+0000 7faa89d9b700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faa6c066f30 0x7faa6c0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa8c155d40 tx=0x7faa740091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:04.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.080+0000 7faa827fc700 1 -- 172.21.15.31:0/2264545019 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa8c16a5a0 con 0x7faa8c152010 2023-10-09T06:21:04.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.267+0000 7faa90a8b700 1 -- 172.21.15.31:0/2264545019 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa8c16a5a0 con 0x7faa6c066f30 2023-10-09T06:21:04.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.275+0000 7faa827fc700 1 -- 172.21.15.31:0/2264545019 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260133 (secure 0 0 0) 0x7faa8c16a5a0 con 0x7faa6c066f30 2023-10-09T06:21:04.279 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:04.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.278+0000 7faa90a8b700 1 -- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faa6c066f30 msgr2=0x7faa6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.278+0000 7faa90a8b700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faa6c066f30 0x7faa6c0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa8c155d40 tx=0x7faa740091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.278+0000 7faa90a8b700 1 -- 172.21.15.31:0/2264545019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c152010 msgr2=0x7faa8c068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.278+0000 7faa90a8b700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c152010 0x7faa8c068820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0c59e0 tx=0x7faa84018000 comp rx=0 tx=0).stop 2023-10-09T06:21:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.278+0000 7faa90a8b700 1 -- 172.21.15.31:0/2264545019 shutdown_connections 2023-10-09T06:21:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.278+0000 7faa90a8b700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faa6c066f30 0x7faa6c0693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.278+0000 7faa90a8b700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa8c158e50 0x7faa8c15a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.278+0000 7faa90a8b700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c152010 0x7faa8c068820 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.278+0000 7faa90a8b700 1 --2- 172.21.15.31:0/2264545019 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa8c1523e0 0x7faa8c14d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.278+0000 7faa90a8b700 1 -- 172.21.15.31:0/2264545019 >> 172.21.15.31:0/2264545019 conn(0x7faa8c069870 msgr2=0x7faa8c0cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.278+0000 7faa90a8b700 1 -- 172.21.15.31:0/2264545019 shutdown_connections 2023-10-09T06:21:04.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.278+0000 7faa90a8b700 1 -- 172.21.15.31:0/2264545019 wait complete. 2023-10-09T06:21:04.283 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:21:04.291 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-09T06:21:02.513733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1708,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560791,"statfs":{"total":1600000000,"available":1598250700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002132"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701803+0000","last_change":"2023-10-09T06:20:54.699452+0000","last_active":"2023-10-09T06:20:54.701803+0000","last_peered":"2023-10-09T06:20:54.701803+0000","last_clean":"2023-10-09T06:20:54.701803+0000","last_became_active":"2023-10-09T06:20:54.699233+0000","last_became_peered":"2023-10-09T06:20:54.699233+0000","last_unstale":"2023-10-09T06:20:54.701803+0000","last_undegraded":"2023-10-09T06:20:54.701803+0000","last_fullsized":"2023-10-09T06:20:54.701803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:22.187237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704394+0000","last_change":"2023-10-09T06:20:54.703624+0000","last_active":"2023-10-09T06:20:54.704394+0000","last_peered":"2023-10-09T06:20:54.704394+0000","last_clean":"2023-10-09T06:20:54.704394+0000","last_became_active":"2023-10-09T06:20:54.703378+0000","last_became_peered":"2023-10-09T06:20:54.703378+0000","last_unstale":"2023-10-09T06:20:54.704394+0000","last_undegraded":"2023-10-09T06:20:54.704394+0000","last_fullsized":"2023-10-09T06:20:54.704394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.698154+0000","last_change":"2023-10-09T06:20:54.698072+0000","last_active":"2023-10-09T06:20:54.698154+0000","last_peered":"2023-10-09T06:20:54.698154+0000","last_clean":"2023-10-09T06:20:54.698154+0000","last_became_active":"2023-10-09T06:20:54.697793+0000","last_became_peered":"2023-10-09T06:20:54.697793+0000","last_unstale":"2023-10-09T06:20:54.698154+0000","last_undegraded":"2023-10-09T06:20:54.698154+0000","last_fullsized":"2023-10-09T06:20:54.698154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:13:00.912045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710137+0000","last_change":"2023-10-09T06:20:54.710027+0000","last_active":"2023-10-09T06:20:54.710137+0000","last_peered":"2023-10-09T06:20:54.710137+0000","last_clean":"2023-10-09T06:20:54.710137+0000","last_became_active":"2023-10-09T06:20:54.709311+0000","last_became_peered":"2023-10-09T06:20:54.709311+0000","last_unstale":"2023-10-09T06:20:54.710137+0000","last_undegraded":"2023-10-09T06:20:54.710137+0000","last_fullsized":"2023-10-09T06:20:54.710137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:14.974632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701768+0000","last_change":"2023-10-09T06:20:54.698108+0000","last_active":"2023-10-09T06:20:54.701768+0000","last_peered":"2023-10-09T06:20:54.701768+0000","last_clean":"2023-10-09T06:20:54.701768+0000","last_became_active":"2023-10-09T06:20:54.697253+0000","last_became_peered":"2023-10-09T06:20:54.697253+0000","last_unstale":"2023-10-09T06:20:54.701768+0000","last_undegraded":"2023-10-09T06:20:54.701768+0000","last_fullsized":"2023-10-09T06:20:54.701768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:25.482181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.714409+0000","last_change":"2023-10-09T06:20:54.714338+0000","last_active":"2023-10-09T06:20:54.714409+0000","last_peered":"2023-10-09T06:20:54.714409+0000","last_clean":"2023-10-09T06:20:54.714409+0000","last_became_active":"2023-10-09T06:20:54.710317+0000","last_became_peered":"2023-10-09T06:20:54.710317+0000","last_unstale":"2023-10-09T06:20:54.714409+0000","last_undegraded":"2023-10-09T06:20:54.714409+0000","last_fullsized":"2023-10-09T06:20:54.714409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:41:46.658358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701791+0000","last_change":"2023-10-09T06:20:54.699210+0000","last_active":"2023-10-09T06:20:54.701791+0000","last_peered":"2023-10-09T06:20:54.701791+0000","last_clean":"2023-10-09T06:20:54.701791+0000","last_became_active":"2023-10-09T06:20:54.698983+0000","last_became_peered":"2023-10-09T06:20:54.698983+0000","last_unstale":"2023-10-09T06:20:54.701791+0000","last_undegraded":"2023-10-09T06:20:54.701791+0000","last_fullsized":"2023-10-09T06:20:54.701791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:36.680555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707224+0000","last_change":"2023-10-09T06:20:54.706806+0000","last_active":"2023-10-09T06:20:54.707224+0000","last_peered":"2023-10-09T06:20:54.707224+0000","last_clean":"2023-10-09T06:20:54.707224+0000","last_became_active":"2023-10-09T06:20:54.706576+0000","last_became_peered":"2023-10-09T06:20:54.706576+0000","last_unstale":"2023-10-09T06:20:54.707224+0000","last_undegraded":"2023-10-09T06:20:54.707224+0000","last_fullsized":"2023-10-09T06:20:54.707224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708515+0000","last_change":"2023-10-09T06:20:54.708381+0000","last_active":"2023-10-09T06:20:54.708515+0000","last_peered":"2023-10-09T06:20:54.708515+0000","last_clean":"2023-10-09T06:20:54.708515+0000","last_became_active":"2023-10-09T06:20:54.708151+0000","last_became_peered":"2023-10-09T06:20:54.708151+0000","last_unstale":"2023-10-09T06:20:54.708515+0000","last_undegraded":"2023-10-09T06:20:54.708515+0000","last_fullsized":"2023-10-09T06:20:54.708515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:09.107980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707948+0000","last_change":"2023-10-09T06:20:54.707785+0000","last_active":"2023-10-09T06:20:54.707948+0000","last_peered":"2023-10-09T06:20:54.707948+0000","last_clean":"2023-10-09T06:20:54.707948+0000","last_became_active":"2023-10-09T06:20:54.707546+0000","last_became_peered":"2023-10-09T06:20:54.707546+0000","last_unstale":"2023-10-09T06:20:54.707948+0000","last_undegraded":"2023-10-09T06:20:54.707948+0000","last_fullsized":"2023-10-09T06:20:54.707948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.714127+0000","last_change":"2023-10-09T06:20:54.714014+0000","last_active":"2023-10-09T06:20:54.714127+0000","last_peered":"2023-10-09T06:20:54.714127+0000","last_clean":"2023-10-09T06:20:54.714127+0000","last_became_active":"2023-10-09T06:20:54.713717+0000","last_became_peered":"2023-10-09T06:20:54.713717+0000","last_unstale":"2023-10-09T06:20:54.714127+0000","last_undegraded":"2023-10-09T06:20:54.714127+0000","last_fullsized":"2023-10-09T06:20:54.714127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704060+0000","last_change":"2023-10-09T06:20:54.703797+0000","last_active":"2023-10-09T06:20:54.704060+0000","last_peered":"2023-10-09T06:20:54.704060+0000","last_clean":"2023-10-09T06:20:54.704060+0000","last_became_active":"2023-10-09T06:20:54.703569+0000","last_became_peered":"2023-10-09T06:20:54.703569+0000","last_unstale":"2023-10-09T06:20:54.704060+0000","last_undegraded":"2023-10-09T06:20:54.704060+0000","last_fullsized":"2023-10-09T06:20:54.704060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:20.426721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704373+0000","last_change":"2023-10-09T06:20:54.704118+0000","last_active":"2023-10-09T06:20:54.704373+0000","last_peered":"2023-10-09T06:20:54.704373+0000","last_clean":"2023-10-09T06:20:54.704373+0000","last_became_active":"2023-10-09T06:20:54.703694+0000","last_became_peered":"2023-10-09T06:20:54.703694+0000","last_unstale":"2023-10-09T06:20:54.704373+0000","last_undegraded":"2023-10-09T06:20:54.704373+0000","last_fullsized":"2023-10-09T06:20:54.704373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701375+0000","last_change":"2023-10-09T06:20:54.701294+0000","last_active":"2023-10-09T06:20:54.701375+0000","last_peered":"2023-10-09T06:20:54.701375+0000","last_clean":"2023-10-09T06:20:54.701375+0000","last_became_active":"2023-10-09T06:20:54.701078+0000","last_became_peered":"2023-10-09T06:20:54.701078+0000","last_unstale":"2023-10-09T06:20:54.701375+0000","last_undegraded":"2023-10-09T06:20:54.701375+0000","last_fullsized":"2023-10-09T06:20:54.701375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707239+0000","last_change":"2023-10-09T06:20:54.707148+0000","last_active":"2023-10-09T06:20:54.707239+0000","last_peered":"2023-10-09T06:20:54.707239+0000","last_clean":"2023-10-09T06:20:54.707239+0000","last_became_active":"2023-10-09T06:20:54.706930+0000","last_became_peered":"2023-10-09T06:20:54.706930+0000","last_unstale":"2023-10-09T06:20:54.707239+0000","last_undegraded":"2023-10-09T06:20:54.707239+0000","last_fullsized":"2023-10-09T06:20:54.707239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:41.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.714191+0000","last_change":"2023-10-09T06:20:54.714117+0000","last_active":"2023-10-09T06:20:54.714191+0000","last_peered":"2023-10-09T06:20:54.714191+0000","last_clean":"2023-10-09T06:20:54.714191+0000","last_became_active":"2023-10-09T06:20:54.709963+0000","last_became_peered":"2023-10-09T06:20:54.709963+0000","last_unstale":"2023-10-09T06:20:54.714191+0000","last_undegraded":"2023-10-09T06:20:54.714191+0000","last_fullsized":"2023-10-09T06:20:54.714191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:41.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711538+0000","last_change":"2023-10-09T06:20:54.710872+0000","last_active":"2023-10-09T06:20:54.711538+0000","last_peered":"2023-10-09T06:20:54.711538+0000","last_clean":"2023-10-09T06:20:54.711538+0000","last_became_active":"2023-10-09T06:20:54.710340+0000","last_became_peered":"2023-10-09T06:20:54.710340+0000","last_unstale":"2023-10-09T06:20:54.711538+0000","last_undegraded":"2023-10-09T06:20:54.711538+0000","last_fullsized":"2023-10-09T06:20:54.711538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:22.187237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702470+0000","last_change":"2023-10-09T06:20:54.702406+0000","last_active":"2023-10-09T06:20:54.702470+0000","last_peered":"2023-10-09T06:20:54.702470+0000","last_clean":"2023-10-09T06:20:54.702470+0000","last_became_active":"2023-10-09T06:20:54.702186+0000","last_became_peered":"2023-10-09T06:20:54.702186+0000","last_unstale":"2023-10-09T06:20:54.702470+0000","last_undegraded":"2023-10-09T06:20:54.702470+0000","last_fullsized":"2023-10-09T06:20:54.702470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:25.746263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703219+0000","last_change":"2023-10-09T06:20:54.702948+0000","last_active":"2023-10-09T06:20:54.703219+0000","last_peered":"2023-10-09T06:20:54.703219+0000","last_clean":"2023-10-09T06:20:54.703219+0000","last_became_active":"2023-10-09T06:20:54.702021+0000","last_became_peered":"2023-10-09T06:20:54.702021+0000","last_unstale":"2023-10-09T06:20:54.703219+0000","last_undegraded":"2023-10-09T06:20:54.703219+0000","last_fullsized":"2023-10-09T06:20:54.703219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:22:23.939760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718359+0000","last_change":"2023-10-09T06:20:53.692487+0000","last_active":"2023-10-09T06:20:54.718359+0000","last_peered":"2023-10-09T06:20:54.718359+0000","last_clean":"2023-10-09T06:20:54.718359+0000","last_became_active":"2023-10-09T06:20:53.692243+0000","last_became_peered":"2023-10-09T06:20:53.692243+0000","last_unstale":"2023-10-09T06:20:54.718359+0000","last_undegraded":"2023-10-09T06:20:54.718359+0000","last_fullsized":"2023-10-09T06:20:54.718359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703546+0000","last_change":"2023-10-09T06:20:54.703384+0000","last_active":"2023-10-09T06:20:54.703546+0000","last_peered":"2023-10-09T06:20:54.703546+0000","last_clean":"2023-10-09T06:20:54.703546+0000","last_became_active":"2023-10-09T06:20:54.703039+0000","last_became_peered":"2023-10-09T06:20:54.703039+0000","last_unstale":"2023-10-09T06:20:54.703546+0000","last_undegraded":"2023-10-09T06:20:54.703546+0000","last_fullsized":"2023-10-09T06:20:54.703546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:41:46.658358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.720817+0000","last_change":"2023-10-09T06:20:53.691165+0000","last_active":"2023-10-09T06:20:54.720817+0000","last_peered":"2023-10-09T06:20:54.720817+0000","last_clean":"2023-10-09T06:20:54.720817+0000","last_became_active":"2023-10-09T06:20:53.690550+0000","last_became_peered":"2023-10-09T06:20:53.690550+0000","last_unstale":"2023-10-09T06:20:54.720817+0000","last_undegraded":"2023-10-09T06:20:54.720817+0000","last_fullsized":"2023-10-09T06:20:54.720817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706226+0000","last_change":"2023-10-09T06:20:54.705731+0000","last_active":"2023-10-09T06:20:54.706226+0000","last_peered":"2023-10-09T06:20:54.706226+0000","last_clean":"2023-10-09T06:20:54.706226+0000","last_became_active":"2023-10-09T06:20:54.705514+0000","last_became_peered":"2023-10-09T06:20:54.705514+0000","last_unstale":"2023-10-09T06:20:54.706226+0000","last_undegraded":"2023-10-09T06:20:54.706226+0000","last_fullsized":"2023-10-09T06:20:54.706226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:08.261543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718196+0000","last_change":"2023-10-09T06:20:53.688123+0000","last_active":"2023-10-09T06:20:54.718196+0000","last_peered":"2023-10-09T06:20:54.718196+0000","last_clean":"2023-10-09T06:20:54.718196+0000","last_became_active":"2023-10-09T06:20:53.687892+0000","last_became_peered":"2023-10-09T06:20:53.687892+0000","last_unstale":"2023-10-09T06:20:54.718196+0000","last_undegraded":"2023-10-09T06:20:54.718196+0000","last_fullsized":"2023-10-09T06:20:54.718196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711524+0000","last_change":"2023-10-09T06:20:54.710847+0000","last_active":"2023-10-09T06:20:54.711524+0000","last_peered":"2023-10-09T06:20:54.711524+0000","last_clean":"2023-10-09T06:20:54.711524+0000","last_became_active":"2023-10-09T06:20:54.709608+0000","last_became_peered":"2023-10-09T06:20:54.709608+0000","last_unstale":"2023-10-09T06:20:54.711524+0000","last_undegraded":"2023-10-09T06:20:54.711524+0000","last_fullsized":"2023-10-09T06:20:54.711524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718036+0000","last_change":"2023-10-09T06:20:53.692698+0000","last_active":"2023-10-09T06:20:54.718036+0000","last_peered":"2023-10-09T06:20:54.718036+0000","last_clean":"2023-10-09T06:20:54.718036+0000","last_became_active":"2023-10-09T06:20:53.692506+0000","last_became_peered":"2023-10-09T06:20:53.692506+0000","last_unstale":"2023-10-09T06:20:54.718036+0000","last_undegraded":"2023-10-09T06:20:54.718036+0000","last_fullsized":"2023-10-09T06:20:54.718036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:24.740060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708977+0000","last_change":"2023-10-09T06:20:54.706985+0000","last_active":"2023-10-09T06:20:54.708977+0000","last_peered":"2023-10-09T06:20:54.708977+0000","last_clean":"2023-10-09T06:20:54.708977+0000","last_became_active":"2023-10-09T06:20:54.706350+0000","last_became_peered":"2023-10-09T06:20:54.706350+0000","last_unstale":"2023-10-09T06:20:54.708977+0000","last_undegraded":"2023-10-09T06:20:54.708977+0000","last_fullsized":"2023-10-09T06:20:54.708977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.717497+0000","last_change":"2023-10-09T06:20:53.688426+0000","last_active":"2023-10-09T06:20:54.717497+0000","last_peered":"2023-10-09T06:20:54.717497+0000","last_clean":"2023-10-09T06:20:54.717497+0000","last_became_active":"2023-10-09T06:20:53.688186+0000","last_became_peered":"2023-10-09T06:20:53.688186+0000","last_unstale":"2023-10-09T06:20:54.717497+0000","last_undegraded":"2023-10-09T06:20:54.717497+0000","last_fullsized":"2023-10-09T06:20:54.717497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703715+0000","last_change":"2023-10-09T06:20:54.703174+0000","last_active":"2023-10-09T06:20:54.703715+0000","last_peered":"2023-10-09T06:20:54.703715+0000","last_clean":"2023-10-09T06:20:54.703715+0000","last_became_active":"2023-10-09T06:20:54.702079+0000","last_became_peered":"2023-10-09T06:20:54.702079+0000","last_unstale":"2023-10-09T06:20:54.703715+0000","last_undegraded":"2023-10-09T06:20:54.703715+0000","last_fullsized":"2023-10-09T06:20:54.703715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:16.997567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.716826+0000","last_change":"2023-10-09T06:20:53.685459+0000","last_active":"2023-10-09T06:20:54.716826+0000","last_peered":"2023-10-09T06:20:54.716826+0000","last_clean":"2023-10-09T06:20:54.716826+0000","last_became_active":"2023-10-09T06:20:53.685232+0000","last_became_peered":"2023-10-09T06:20:53.685232+0000","last_unstale":"2023-10-09T06:20:54.716826+0000","last_undegraded":"2023-10-09T06:20:54.716826+0000","last_fullsized":"2023-10-09T06:20:54.716826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702623+0000","last_change":"2023-10-09T06:20:54.702532+0000","last_active":"2023-10-09T06:20:54.702623+0000","last_peered":"2023-10-09T06:20:54.702623+0000","last_clean":"2023-10-09T06:20:54.702623+0000","last_became_active":"2023-10-09T06:20:54.702245+0000","last_became_peered":"2023-10-09T06:20:54.702245+0000","last_unstale":"2023-10-09T06:20:54.702623+0000","last_undegraded":"2023-10-09T06:20:54.702623+0000","last_fullsized":"2023-10-09T06:20:54.702623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:41.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.698863+0000","last_change":"2023-10-09T06:20:53.686387+0000","last_active":"2023-10-09T06:20:54.698863+0000","last_peered":"2023-10-09T06:20:54.698863+0000","last_clean":"2023-10-09T06:20:54.698863+0000","last_became_active":"2023-10-09T06:20:53.686072+0000","last_became_peered":"2023-10-09T06:20:53.686072+0000","last_unstale":"2023-10-09T06:20:54.698863+0000","last_undegraded":"2023-10-09T06:20:54.698863+0000","last_fullsized":"2023-10-09T06:20:54.698863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702605+0000","last_change":"2023-10-09T06:20:54.702542+0000","last_active":"2023-10-09T06:20:54.702605+0000","last_peered":"2023-10-09T06:20:54.702605+0000","last_clean":"2023-10-09T06:20:54.702605+0000","last_became_active":"2023-10-09T06:20:54.702307+0000","last_became_peered":"2023-10-09T06:20:54.702307+0000","last_unstale":"2023-10-09T06:20:54.702605+0000","last_undegraded":"2023-10-09T06:20:54.702605+0000","last_fullsized":"2023-10-09T06:20:54.702605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:41.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701363+0000","last_change":"2023-10-09T06:20:53.692511+0000","last_active":"2023-10-09T06:20:54.701363+0000","last_peered":"2023-10-09T06:20:54.701363+0000","last_clean":"2023-10-09T06:20:54.701363+0000","last_became_active":"2023-10-09T06:20:53.689704+0000","last_became_peered":"2023-10-09T06:20:53.689704+0000","last_unstale":"2023-10-09T06:20:54.701363+0000","last_undegraded":"2023-10-09T06:20:54.701363+0000","last_fullsized":"2023-10-09T06:20:54.701363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704634+0000","last_change":"2023-10-09T06:20:54.704450+0000","last_active":"2023-10-09T06:20:54.704634+0000","last_peered":"2023-10-09T06:20:54.704634+0000","last_clean":"2023-10-09T06:20:54.704634+0000","last_became_active":"2023-10-09T06:20:54.704220+0000","last_became_peered":"2023-10-09T06:20:54.704220+0000","last_unstale":"2023-10-09T06:20:54.704634+0000","last_undegraded":"2023-10-09T06:20:54.704634+0000","last_fullsized":"2023-10-09T06:20:54.704634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.695920+0000","last_change":"2023-10-09T06:20:53.691307+0000","last_active":"2023-10-09T06:20:54.695920+0000","last_peered":"2023-10-09T06:20:54.695920+0000","last_clean":"2023-10-09T06:20:54.695920+0000","last_became_active":"2023-10-09T06:20:53.691063+0000","last_became_peered":"2023-10-09T06:20:53.691063+0000","last_unstale":"2023-10-09T06:20:54.695920+0000","last_undegraded":"2023-10-09T06:20:54.695920+0000","last_fullsized":"2023-10-09T06:20:54.695920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711494+0000","last_change":"2023-10-09T06:20:54.710553+0000","last_active":"2023-10-09T06:20:54.711494+0000","last_peered":"2023-10-09T06:20:54.711494+0000","last_clean":"2023-10-09T06:20:54.711494+0000","last_became_active":"2023-10-09T06:20:54.709556+0000","last_became_peered":"2023-10-09T06:20:54.709556+0000","last_unstale":"2023-10-09T06:20:54.711494+0000","last_undegraded":"2023-10-09T06:20:54.711494+0000","last_fullsized":"2023-10-09T06:20:54.711494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:46.203108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706958+0000","last_change":"2023-10-09T06:20:53.692986+0000","last_active":"2023-10-09T06:20:54.706958+0000","last_peered":"2023-10-09T06:20:54.706958+0000","last_clean":"2023-10-09T06:20:54.706958+0000","last_became_active":"2023-10-09T06:20:53.692570+0000","last_became_peered":"2023-10-09T06:20:53.692570+0000","last_unstale":"2023-10-09T06:20:54.706958+0000","last_undegraded":"2023-10-09T06:20:54.706958+0000","last_fullsized":"2023-10-09T06:20:54.706958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711428+0000","last_change":"2023-10-09T06:20:54.711358+0000","last_active":"2023-10-09T06:20:54.711428+0000","last_peered":"2023-10-09T06:20:54.711428+0000","last_clean":"2023-10-09T06:20:54.711428+0000","last_became_active":"2023-10-09T06:20:54.711114+0000","last_became_peered":"2023-10-09T06:20:54.711114+0000","last_unstale":"2023-10-09T06:20:54.711428+0000","last_undegraded":"2023-10-09T06:20:54.711428+0000","last_fullsized":"2023-10-09T06:20:54.711428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:31.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.722498+0000","last_change":"2023-10-09T06:20:53.694922+0000","last_active":"2023-10-09T06:20:54.722498+0000","last_peered":"2023-10-09T06:20:54.722498+0000","last_clean":"2023-10-09T06:20:54.722498+0000","last_became_active":"2023-10-09T06:20:53.694642+0000","last_became_peered":"2023-10-09T06:20:53.694642+0000","last_unstale":"2023-10-09T06:20:54.722498+0000","last_undegraded":"2023-10-09T06:20:54.722498+0000","last_fullsized":"2023-10-09T06:20:54.722498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:52.168522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704185+0000","last_change":"2023-10-09T06:20:54.704143+0000","last_active":"2023-10-09T06:20:54.704185+0000","last_peered":"2023-10-09T06:20:54.704185+0000","last_clean":"2023-10-09T06:20:54.704185+0000","last_became_active":"2023-10-09T06:20:54.703957+0000","last_became_peered":"2023-10-09T06:20:54.703957+0000","last_unstale":"2023-10-09T06:20:54.704185+0000","last_undegraded":"2023-10-09T06:20:54.704185+0000","last_fullsized":"2023-10-09T06:20:54.704185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:30.717922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.721464+0000","last_change":"2023-10-09T06:20:53.688682+0000","last_active":"2023-10-09T06:20:54.721464+0000","last_peered":"2023-10-09T06:20:54.721464+0000","last_clean":"2023-10-09T06:20:54.721464+0000","last_became_active":"2023-10-09T06:20:53.688399+0000","last_became_peered":"2023-10-09T06:20:53.688399+0000","last_unstale":"2023-10-09T06:20:54.721464+0000","last_undegraded":"2023-10-09T06:20:54.721464+0000","last_fullsized":"2023-10-09T06:20:54.721464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703190+0000","last_change":"2023-10-09T06:20:54.702039+0000","last_active":"2023-10-09T06:20:54.703190+0000","last_peered":"2023-10-09T06:20:54.703190+0000","last_clean":"2023-10-09T06:20:54.703190+0000","last_became_active":"2023-10-09T06:20:54.701760+0000","last_became_peered":"2023-10-09T06:20:54.701760+0000","last_unstale":"2023-10-09T06:20:54.703190+0000","last_undegraded":"2023-10-09T06:20:54.703190+0000","last_fullsized":"2023-10-09T06:20:54.703190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:41:46.658358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.719418+0000","last_change":"2023-10-09T06:20:53.690779+0000","last_active":"2023-10-09T06:20:54.719418+0000","last_peered":"2023-10-09T06:20:54.719418+0000","last_clean":"2023-10-09T06:20:54.719418+0000","last_became_active":"2023-10-09T06:20:53.690585+0000","last_became_peered":"2023-10-09T06:20:53.690585+0000","last_unstale":"2023-10-09T06:20:54.719418+0000","last_undegraded":"2023-10-09T06:20:54.719418+0000","last_fullsized":"2023-10-09T06:20:54.719418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703490+0000","last_change":"2023-10-09T06:20:54.703248+0000","last_active":"2023-10-09T06:20:54.703490+0000","last_peered":"2023-10-09T06:20:54.703490+0000","last_clean":"2023-10-09T06:20:54.703490+0000","last_became_active":"2023-10-09T06:20:54.701451+0000","last_became_peered":"2023-10-09T06:20:54.701451+0000","last_unstale":"2023-10-09T06:20:54.703490+0000","last_undegraded":"2023-10-09T06:20:54.703490+0000","last_fullsized":"2023-10-09T06:20:54.703490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:05:24.245558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707243+0000","last_change":"2023-10-09T06:20:53.691221+0000","last_active":"2023-10-09T06:20:54.707243+0000","last_peered":"2023-10-09T06:20:54.707243+0000","last_clean":"2023-10-09T06:20:54.707243+0000","last_became_active":"2023-10-09T06:20:53.690265+0000","last_became_peered":"2023-10-09T06:20:53.690265+0000","last_unstale":"2023-10-09T06:20:54.707243+0000","last_undegraded":"2023-10-09T06:20:54.707243+0000","last_fullsized":"2023-10-09T06:20:54.707243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703782+0000","last_change":"2023-10-09T06:20:54.703628+0000","last_active":"2023-10-09T06:20:54.703782+0000","last_peered":"2023-10-09T06:20:54.703782+0000","last_clean":"2023-10-09T06:20:54.703782+0000","last_became_active":"2023-10-09T06:20:54.703234+0000","last_became_peered":"2023-10-09T06:20:54.703234+0000","last_unstale":"2023-10-09T06:20:54.703782+0000","last_undegraded":"2023-10-09T06:20:54.703782+0000","last_fullsized":"2023-10-09T06:20:54.703782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:10:16.498873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699009+0000","last_change":"2023-10-09T06:20:53.684515+0000","last_active":"2023-10-09T06:20:54.699009+0000","last_peered":"2023-10-09T06:20:54.699009+0000","last_clean":"2023-10-09T06:20:54.699009+0000","last_became_active":"2023-10-09T06:20:53.684265+0000","last_became_peered":"2023-10-09T06:20:53.684265+0000","last_unstale":"2023-10-09T06:20:54.699009+0000","last_undegraded":"2023-10-09T06:20:54.699009+0000","last_fullsized":"2023-10-09T06:20:54.699009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699396+0000","last_change":"2023-10-09T06:20:54.699332+0000","last_active":"2023-10-09T06:20:54.699396+0000","last_peered":"2023-10-09T06:20:54.699396+0000","last_clean":"2023-10-09T06:20:54.699396+0000","last_became_active":"2023-10-09T06:20:54.698991+0000","last_became_peered":"2023-10-09T06:20:54.698991+0000","last_unstale":"2023-10-09T06:20:54.699396+0000","last_undegraded":"2023-10-09T06:20:54.699396+0000","last_fullsized":"2023-10-09T06:20:54.699396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:41.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.721075+0000","last_change":"2023-10-09T06:20:53.694124+0000","last_active":"2023-10-09T06:20:54.721075+0000","last_peered":"2023-10-09T06:20:54.721075+0000","last_clean":"2023-10-09T06:20:54.721075+0000","last_became_active":"2023-10-09T06:20:53.693903+0000","last_became_peered":"2023-10-09T06:20:53.693903+0000","last_unstale":"2023-10-09T06:20:54.721075+0000","last_undegraded":"2023-10-09T06:20:54.721075+0000","last_fullsized":"2023-10-09T06:20:54.721075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704529+0000","last_change":"2023-10-09T06:20:54.704310+0000","last_active":"2023-10-09T06:20:54.704529+0000","last_peered":"2023-10-09T06:20:54.704529+0000","last_clean":"2023-10-09T06:20:54.704529+0000","last_became_active":"2023-10-09T06:20:54.703990+0000","last_became_peered":"2023-10-09T06:20:54.703990+0000","last_unstale":"2023-10-09T06:20:54.704529+0000","last_undegraded":"2023-10-09T06:20:54.704529+0000","last_fullsized":"2023-10-09T06:20:54.704529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:14.974632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.719608+0000","last_change":"2023-10-09T06:20:53.692436+0000","last_active":"2023-10-09T06:20:54.719608+0000","last_peered":"2023-10-09T06:20:54.719608+0000","last_clean":"2023-10-09T06:20:54.719608+0000","last_became_active":"2023-10-09T06:20:53.692191+0000","last_became_peered":"2023-10-09T06:20:53.692191+0000","last_unstale":"2023-10-09T06:20:54.719608+0000","last_undegraded":"2023-10-09T06:20:54.719608+0000","last_fullsized":"2023-10-09T06:20:54.719608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703765+0000","last_change":"2023-10-09T06:20:54.703474+0000","last_active":"2023-10-09T06:20:54.703765+0000","last_peered":"2023-10-09T06:20:54.703765+0000","last_clean":"2023-10-09T06:20:54.703765+0000","last_became_active":"2023-10-09T06:20:54.702986+0000","last_became_peered":"2023-10-09T06:20:54.702986+0000","last_unstale":"2023-10-09T06:20:54.703765+0000","last_undegraded":"2023-10-09T06:20:54.703765+0000","last_fullsized":"2023-10-09T06:20:54.703765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:46.203108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699329+0000","last_change":"2023-10-09T06:20:53.692601+0000","last_active":"2023-10-09T06:20:54.699329+0000","last_peered":"2023-10-09T06:20:54.699329+0000","last_clean":"2023-10-09T06:20:54.699329+0000","last_became_active":"2023-10-09T06:20:53.692249+0000","last_became_peered":"2023-10-09T06:20:53.692249+0000","last_unstale":"2023-10-09T06:20:54.699329+0000","last_undegraded":"2023-10-09T06:20:54.699329+0000","last_fullsized":"2023-10-09T06:20:54.699329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710118+0000","last_change":"2023-10-09T06:20:54.709870+0000","last_active":"2023-10-09T06:20:54.710118+0000","last_peered":"2023-10-09T06:20:54.710118+0000","last_clean":"2023-10-09T06:20:54.710118+0000","last_became_active":"2023-10-09T06:20:54.709017+0000","last_became_peered":"2023-10-09T06:20:54.709017+0000","last_unstale":"2023-10-09T06:20:54.710118+0000","last_undegraded":"2023-10-09T06:20:54.710118+0000","last_fullsized":"2023-10-09T06:20:54.710118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:48.043711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707068+0000","last_change":"2023-10-09T06:20:53.694336+0000","last_active":"2023-10-09T06:20:54.707068+0000","last_peered":"2023-10-09T06:20:54.707068+0000","last_clean":"2023-10-09T06:20:54.707068+0000","last_became_active":"2023-10-09T06:20:53.694107+0000","last_became_peered":"2023-10-09T06:20:53.694107+0000","last_unstale":"2023-10-09T06:20:54.707068+0000","last_undegraded":"2023-10-09T06:20:54.707068+0000","last_fullsized":"2023-10-09T06:20:54.707068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.705770+0000","last_change":"2023-10-09T06:20:54.705708+0000","last_active":"2023-10-09T06:20:54.705770+0000","last_peered":"2023-10-09T06:20:54.705770+0000","last_clean":"2023-10-09T06:20:54.705770+0000","last_became_active":"2023-10-09T06:20:54.705487+0000","last_became_peered":"2023-10-09T06:20:54.705487+0000","last_unstale":"2023-10-09T06:20:54.705770+0000","last_undegraded":"2023-10-09T06:20:54.705770+0000","last_fullsized":"2023-10-09T06:20:54.705770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:20.728264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701105+0000","last_change":"2023-10-09T06:20:54.700944+0000","last_active":"2023-10-09T06:20:54.701105+0000","last_peered":"2023-10-09T06:20:54.701105+0000","last_clean":"2023-10-09T06:20:54.701105+0000","last_became_active":"2023-10-09T06:20:54.700732+0000","last_became_peered":"2023-10-09T06:20:54.700732+0000","last_unstale":"2023-10-09T06:20:54.701105+0000","last_undegraded":"2023-10-09T06:20:54.701105+0000","last_fullsized":"2023-10-09T06:20:54.701105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.697278+0000","last_change":"2023-10-09T06:20:53.688729+0000","last_active":"2023-10-09T06:20:54.697278+0000","last_peered":"2023-10-09T06:20:54.697278+0000","last_clean":"2023-10-09T06:20:54.697278+0000","last_became_active":"2023-10-09T06:20:53.688468+0000","last_became_peered":"2023-10-09T06:20:53.688468+0000","last_unstale":"2023-10-09T06:20:54.697278+0000","last_undegraded":"2023-10-09T06:20:54.697278+0000","last_fullsized":"2023-10-09T06:20:54.697278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710841+0000","last_change":"2023-10-09T06:20:54.710794+0000","last_active":"2023-10-09T06:20:54.710841+0000","last_peered":"2023-10-09T06:20:54.710841+0000","last_clean":"2023-10-09T06:20:54.710841+0000","last_became_active":"2023-10-09T06:20:54.710597+0000","last_became_peered":"2023-10-09T06:20:54.710597+0000","last_unstale":"2023-10-09T06:20:54.710841+0000","last_undegraded":"2023-10-09T06:20:54.710841+0000","last_fullsized":"2023-10-09T06:20:54.710841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:46.203108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707347+0000","last_change":"2023-10-09T06:20:53.691840+0000","last_active":"2023-10-09T06:20:54.707347+0000","last_peered":"2023-10-09T06:20:54.707347+0000","last_clean":"2023-10-09T06:20:54.707347+0000","last_became_active":"2023-10-09T06:20:53.691004+0000","last_became_peered":"2023-10-09T06:20:53.691004+0000","last_unstale":"2023-10-09T06:20:54.707347+0000","last_undegraded":"2023-10-09T06:20:54.707347+0000","last_fullsized":"2023-10-09T06:20:54.707347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696667+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:20:54.696667+0000","last_peered":"2023-10-09T06:20:54.696667+0000","last_clean":"2023-10-09T06:20:54.696667+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:20:54.696667+0000","last_undegraded":"2023-10-09T06:20:54.696667+0000","last_fullsized":"2023-10-09T06:20:54.696667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702605+0000","last_change":"2023-10-09T06:20:54.702399+0000","last_active":"2023-10-09T06:20:54.702605+0000","last_peered":"2023-10-09T06:20:54.702605+0000","last_clean":"2023-10-09T06:20:54.702605+0000","last_became_active":"2023-10-09T06:20:54.701799+0000","last_became_peered":"2023-10-09T06:20:54.701799+0000","last_unstale":"2023-10-09T06:20:54.702605+0000","last_undegraded":"2023-10-09T06:20:54.702605+0000","last_fullsized":"2023-10-09T06:20:54.702605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696279+0000","last_change":"2023-10-09T06:20:53.694796+0000","last_active":"2023-10-09T06:20:54.696279+0000","last_peered":"2023-10-09T06:20:54.696279+0000","last_clean":"2023-10-09T06:20:54.696279+0000","last_became_active":"2023-10-09T06:20:53.694541+0000","last_became_peered":"2023-10-09T06:20:53.694541+0000","last_unstale":"2023-10-09T06:20:54.696279+0000","last_undegraded":"2023-10-09T06:20:54.696279+0000","last_fullsized":"2023-10-09T06:20:54.696279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696773+0000","last_change":"2023-10-09T06:20:53.690652+0000","last_active":"2023-10-09T06:20:54.696773+0000","last_peered":"2023-10-09T06:20:54.696773+0000","last_clean":"2023-10-09T06:20:54.696773+0000","last_became_active":"2023-10-09T06:20:53.690426+0000","last_became_peered":"2023-10-09T06:20:53.690426+0000","last_unstale":"2023-10-09T06:20:54.696773+0000","last_undegraded":"2023-10-09T06:20:54.696773+0000","last_fullsized":"2023-10-09T06:20:54.696773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704374+0000","last_change":"2023-10-09T06:20:54.703240+0000","last_active":"2023-10-09T06:20:54.704374+0000","last_peered":"2023-10-09T06:20:54.704374+0000","last_clean":"2023-10-09T06:20:54.704374+0000","last_became_active":"2023-10-09T06:20:54.703000+0000","last_became_peered":"2023-10-09T06:20:54.703000+0000","last_unstale":"2023-10-09T06:20:54.704374+0000","last_undegraded":"2023-10-09T06:20:54.704374+0000","last_fullsized":"2023-10-09T06:20:54.704374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T06:20:55.695702+0000","last_change":"2023-10-09T06:20:53.693463+0000","last_active":"2023-10-09T06:20:55.695702+0000","last_peered":"2023-10-09T06:20:55.695702+0000","last_clean":"2023-10-09T06:20:55.695702+0000","last_became_active":"2023-10-09T06:20:53.693223+0000","last_became_peered":"2023-10-09T06:20:53.693223+0000","last_unstale":"2023-10-09T06:20:55.695702+0000","last_undegraded":"2023-10-09T06:20:55.695702+0000","last_fullsized":"2023-10-09T06:20:55.695702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.705276+0000","last_change":"2023-10-09T06:20:54.705213+0000","last_active":"2023-10-09T06:20:54.705276+0000","last_peered":"2023-10-09T06:20:54.705276+0000","last_clean":"2023-10-09T06:20:54.705276+0000","last_became_active":"2023-10-09T06:20:54.704911+0000","last_became_peered":"2023-10-09T06:20:54.704911+0000","last_unstale":"2023-10-09T06:20:54.705276+0000","last_undegraded":"2023-10-09T06:20:54.705276+0000","last_fullsized":"2023-10-09T06:20:54.705276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:22:23.939760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718435+0000","last_change":"2023-10-09T06:20:53.689939+0000","last_active":"2023-10-09T06:20:54.718435+0000","last_peered":"2023-10-09T06:20:54.718435+0000","last_clean":"2023-10-09T06:20:54.718435+0000","last_became_active":"2023-10-09T06:20:53.689710+0000","last_became_peered":"2023-10-09T06:20:53.689710+0000","last_unstale":"2023-10-09T06:20:54.718435+0000","last_undegraded":"2023-10-09T06:20:54.718435+0000","last_fullsized":"2023-10-09T06:20:54.718435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.698754+0000","last_change":"2023-10-09T06:20:54.698648+0000","last_active":"2023-10-09T06:20:54.698754+0000","last_peered":"2023-10-09T06:20:54.698754+0000","last_clean":"2023-10-09T06:20:54.698754+0000","last_became_active":"2023-10-09T06:20:54.698423+0000","last_became_peered":"2023-10-09T06:20:54.698423+0000","last_unstale":"2023-10-09T06:20:54.698754+0000","last_undegraded":"2023-10-09T06:20:54.698754+0000","last_fullsized":"2023-10-09T06:20:54.698754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.694880+0000","last_change":"2023-10-09T06:20:53.691357+0000","last_active":"2023-10-09T06:20:54.694880+0000","last_peered":"2023-10-09T06:20:54.694880+0000","last_clean":"2023-10-09T06:20:54.694880+0000","last_became_active":"2023-10-09T06:20:53.690961+0000","last_became_peered":"2023-10-09T06:20:53.690961+0000","last_unstale":"2023-10-09T06:20:54.694880+0000","last_undegraded":"2023-10-09T06:20:54.694880+0000","last_fullsized":"2023-10-09T06:20:54.694880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:19.722061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706057+0000","last_change":"2023-10-09T06:20:54.705990+0000","last_active":"2023-10-09T06:20:54.706057+0000","last_peered":"2023-10-09T06:20:54.706057+0000","last_clean":"2023-10-09T06:20:54.706057+0000","last_became_active":"2023-10-09T06:20:54.705793+0000","last_became_peered":"2023-10-09T06:20:54.705793+0000","last_unstale":"2023-10-09T06:20:54.706057+0000","last_undegraded":"2023-10-09T06:20:54.706057+0000","last_fullsized":"2023-10-09T06:20:54.706057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:53.174725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699422+0000","last_change":"2023-10-09T06:20:53.693042+0000","last_active":"2023-10-09T06:20:54.699422+0000","last_peered":"2023-10-09T06:20:54.699422+0000","last_clean":"2023-10-09T06:20:54.699422+0000","last_became_active":"2023-10-09T06:20:53.692818+0000","last_became_peered":"2023-10-09T06:20:53.692818+0000","last_unstale":"2023-10-09T06:20:54.699422+0000","last_undegraded":"2023-10-09T06:20:54.699422+0000","last_fullsized":"2023-10-09T06:20:54.699422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702969+0000","last_change":"2023-10-09T06:20:54.702866+0000","last_active":"2023-10-09T06:20:54.702969+0000","last_peered":"2023-10-09T06:20:54.702969+0000","last_clean":"2023-10-09T06:20:54.702969+0000","last_became_active":"2023-10-09T06:20:54.702652+0000","last_became_peered":"2023-10-09T06:20:54.702652+0000","last_unstale":"2023-10-09T06:20:54.702969+0000","last_undegraded":"2023-10-09T06:20:54.702969+0000","last_fullsized":"2023-10-09T06:20:54.702969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:08.261543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699122+0000","last_change":"2023-10-09T06:20:53.692859+0000","last_active":"2023-10-09T06:20:54.699122+0000","last_peered":"2023-10-09T06:20:54.699122+0000","last_clean":"2023-10-09T06:20:54.699122+0000","last_became_active":"2023-10-09T06:20:53.687193+0000","last_became_peered":"2023-10-09T06:20:53.687193+0000","last_unstale":"2023-10-09T06:20:54.699122+0000","last_undegraded":"2023-10-09T06:20:54.699122+0000","last_fullsized":"2023-10-09T06:20:54.699122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706025+0000","last_change":"2023-10-09T06:20:54.705836+0000","last_active":"2023-10-09T06:20:54.706025+0000","last_peered":"2023-10-09T06:20:54.706025+0000","last_clean":"2023-10-09T06:20:54.706025+0000","last_became_active":"2023-10-09T06:20:54.705607+0000","last_became_peered":"2023-10-09T06:20:54.705607+0000","last_unstale":"2023-10-09T06:20:54.706025+0000","last_undegraded":"2023-10-09T06:20:54.706025+0000","last_fullsized":"2023-10-09T06:20:54.706025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:17.435271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718723+0000","last_change":"2023-10-09T06:20:53.688523+0000","last_active":"2023-10-09T06:20:54.718723+0000","last_peered":"2023-10-09T06:20:54.718723+0000","last_clean":"2023-10-09T06:20:54.718723+0000","last_became_active":"2023-10-09T06:20:53.688245+0000","last_became_peered":"2023-10-09T06:20:53.688245+0000","last_unstale":"2023-10-09T06:20:54.718723+0000","last_undegraded":"2023-10-09T06:20:54.718723+0000","last_fullsized":"2023-10-09T06:20:54.718723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:52.168522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704441+0000","last_change":"2023-10-09T06:20:54.704343+0000","last_active":"2023-10-09T06:20:54.704441+0000","last_peered":"2023-10-09T06:20:54.704441+0000","last_clean":"2023-10-09T06:20:54.704441+0000","last_became_active":"2023-10-09T06:20:54.704076+0000","last_became_peered":"2023-10-09T06:20:54.704076+0000","last_unstale":"2023-10-09T06:20:54.704441+0000","last_undegraded":"2023-10-09T06:20:54.704441+0000","last_fullsized":"2023-10-09T06:20:54.704441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:41.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696258+0000","last_change":"2023-10-09T06:20:53.693147+0000","last_active":"2023-10-09T06:20:54.696258+0000","last_peered":"2023-10-09T06:20:54.696258+0000","last_clean":"2023-10-09T06:20:54.696258+0000","last_became_active":"2023-10-09T06:20:53.692925+0000","last_became_peered":"2023-10-09T06:20:53.692925+0000","last_unstale":"2023-10-09T06:20:54.696258+0000","last_undegraded":"2023-10-09T06:20:54.696258+0000","last_fullsized":"2023-10-09T06:20:54.696258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710381+0000","last_change":"2023-10-09T06:20:54.710313+0000","last_active":"2023-10-09T06:20:54.710381+0000","last_peered":"2023-10-09T06:20:54.710381+0000","last_clean":"2023-10-09T06:20:54.710381+0000","last_became_active":"2023-10-09T06:20:54.710082+0000","last_became_peered":"2023-10-09T06:20:54.710082+0000","last_unstale":"2023-10-09T06:20:54.710381+0000","last_undegraded":"2023-10-09T06:20:54.710381+0000","last_fullsized":"2023-10-09T06:20:54.710381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:45.285681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.720656+0000","last_change":"2023-10-09T06:20:53.692399+0000","last_active":"2023-10-09T06:20:54.720656+0000","last_peered":"2023-10-09T06:20:54.720656+0000","last_clean":"2023-10-09T06:20:54.720656+0000","last_became_active":"2023-10-09T06:20:53.692157+0000","last_became_peered":"2023-10-09T06:20:53.692157+0000","last_unstale":"2023-10-09T06:20:54.720656+0000","last_undegraded":"2023-10-09T06:20:54.720656+0000","last_fullsized":"2023-10-09T06:20:54.720656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711476+0000","last_change":"2023-10-09T06:20:54.710127+0000","last_active":"2023-10-09T06:20:54.711476+0000","last_peered":"2023-10-09T06:20:54.711476+0000","last_clean":"2023-10-09T06:20:54.711476+0000","last_became_active":"2023-10-09T06:20:54.709293+0000","last_became_peered":"2023-10-09T06:20:54.709293+0000","last_unstale":"2023-10-09T06:20:54.711476+0000","last_undegraded":"2023-10-09T06:20:54.711476+0000","last_fullsized":"2023-10-09T06:20:54.711476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:22:23.939760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718472+0000","last_change":"2023-10-09T06:20:53.687221+0000","last_active":"2023-10-09T06:20:54.718472+0000","last_peered":"2023-10-09T06:20:54.718472+0000","last_clean":"2023-10-09T06:20:54.718472+0000","last_became_active":"2023-10-09T06:20:53.686998+0000","last_became_peered":"2023-10-09T06:20:53.686998+0000","last_unstale":"2023-10-09T06:20:54.718472+0000","last_undegraded":"2023-10-09T06:20:54.718472+0000","last_fullsized":"2023-10-09T06:20:54.718472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703747+0000","last_change":"2023-10-09T06:20:54.703089+0000","last_active":"2023-10-09T06:20:54.703747+0000","last_peered":"2023-10-09T06:20:54.703747+0000","last_clean":"2023-10-09T06:20:54.703747+0000","last_became_active":"2023-10-09T06:20:54.702720+0000","last_became_peered":"2023-10-09T06:20:54.702720+0000","last_unstale":"2023-10-09T06:20:54.703747+0000","last_undegraded":"2023-10-09T06:20:54.703747+0000","last_fullsized":"2023-10-09T06:20:54.703747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:48.043711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.700469+0000","last_change":"2023-10-09T06:20:54.700400+0000","last_active":"2023-10-09T06:20:54.700469+0000","last_peered":"2023-10-09T06:20:54.700469+0000","last_clean":"2023-10-09T06:20:54.700469+0000","last_became_active":"2023-10-09T06:20:54.700120+0000","last_became_peered":"2023-10-09T06:20:54.700120+0000","last_unstale":"2023-10-09T06:20:54.700469+0000","last_undegraded":"2023-10-09T06:20:54.700469+0000","last_fullsized":"2023-10-09T06:20:54.700469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711227+0000","last_change":"2023-10-09T06:20:54.711172+0000","last_active":"2023-10-09T06:20:54.711227+0000","last_peered":"2023-10-09T06:20:54.711227+0000","last_clean":"2023-10-09T06:20:54.711227+0000","last_became_active":"2023-10-09T06:20:54.710983+0000","last_became_peered":"2023-10-09T06:20:54.710983+0000","last_unstale":"2023-10-09T06:20:54.711227+0000","last_undegraded":"2023-10-09T06:20:54.711227+0000","last_fullsized":"2023-10-09T06:20:54.711227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:20.728264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.709159+0000","last_change":"2023-10-09T06:20:54.707142+0000","last_active":"2023-10-09T06:20:54.709159+0000","last_peered":"2023-10-09T06:20:54.709159+0000","last_clean":"2023-10-09T06:20:54.709159+0000","last_became_active":"2023-10-09T06:20:54.706670+0000","last_became_peered":"2023-10-09T06:20:54.706670+0000","last_unstale":"2023-10-09T06:20:54.709159+0000","last_undegraded":"2023-10-09T06:20:54.709159+0000","last_fullsized":"2023-10-09T06:20:54.709159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:09.107980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701930+0000","last_change":"2023-10-09T06:20:54.701836+0000","last_active":"2023-10-09T06:20:54.701930+0000","last_peered":"2023-10-09T06:20:54.701930+0000","last_clean":"2023-10-09T06:20:54.701930+0000","last_became_active":"2023-10-09T06:20:54.701556+0000","last_became_peered":"2023-10-09T06:20:54.701556+0000","last_unstale":"2023-10-09T06:20:54.701930+0000","last_undegraded":"2023-10-09T06:20:54.701930+0000","last_fullsized":"2023-10-09T06:20:54.701930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708330+0000","last_change":"2023-10-09T06:20:54.708268+0000","last_active":"2023-10-09T06:20:54.708330+0000","last_peered":"2023-10-09T06:20:54.708330+0000","last_clean":"2023-10-09T06:20:54.708330+0000","last_became_active":"2023-10-09T06:20:54.707751+0000","last_became_peered":"2023-10-09T06:20:54.707751+0000","last_unstale":"2023-10-09T06:20:54.708330+0000","last_undegraded":"2023-10-09T06:20:54.708330+0000","last_fullsized":"2023-10-09T06:20:54.708330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704996+0000","last_change":"2023-10-09T06:20:54.704931+0000","last_active":"2023-10-09T06:20:54.704996+0000","last_peered":"2023-10-09T06:20:54.704996+0000","last_clean":"2023-10-09T06:20:54.704996+0000","last_became_active":"2023-10-09T06:20:54.704697+0000","last_became_peered":"2023-10-09T06:20:54.704697+0000","last_unstale":"2023-10-09T06:20:54.704996+0000","last_undegraded":"2023-10-09T06:20:54.704996+0000","last_fullsized":"2023-10-09T06:20:54.704996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702925+0000","last_change":"2023-10-09T06:20:54.702684+0000","last_active":"2023-10-09T06:20:54.702925+0000","last_peered":"2023-10-09T06:20:54.702925+0000","last_clean":"2023-10-09T06:20:54.702925+0000","last_became_active":"2023-10-09T06:20:54.702422+0000","last_became_peered":"2023-10-09T06:20:54.702422+0000","last_unstale":"2023-10-09T06:20:54.702925+0000","last_undegraded":"2023-10-09T06:20:54.702925+0000","last_fullsized":"2023-10-09T06:20:54.702925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708093+0000","last_change":"2023-10-09T06:20:54.708004+0000","last_active":"2023-10-09T06:20:54.708093+0000","last_peered":"2023-10-09T06:20:54.708093+0000","last_clean":"2023-10-09T06:20:54.708093+0000","last_became_active":"2023-10-09T06:20:54.707760+0000","last_became_peered":"2023-10-09T06:20:54.707760+0000","last_unstale":"2023-10-09T06:20:54.708093+0000","last_undegraded":"2023-10-09T06:20:54.708093+0000","last_fullsized":"2023-10-09T06:20:54.708093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.709600+0000","last_change":"2023-10-09T06:20:54.709536+0000","last_active":"2023-10-09T06:20:54.709600+0000","last_peered":"2023-10-09T06:20:54.709600+0000","last_clean":"2023-10-09T06:20:54.709600+0000","last_became_active":"2023-10-09T06:20:54.707797+0000","last_became_peered":"2023-10-09T06:20:54.707797+0000","last_unstale":"2023-10-09T06:20:54.709600+0000","last_undegraded":"2023-10-09T06:20:54.709600+0000","last_fullsized":"2023-10-09T06:20:54.709600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:10:16.498873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708462+0000","last_change":"2023-10-09T06:20:54.708406+0000","last_active":"2023-10-09T06:20:54.708462+0000","last_peered":"2023-10-09T06:20:54.708462+0000","last_clean":"2023-10-09T06:20:54.708462+0000","last_became_active":"2023-10-09T06:20:54.708045+0000","last_became_peered":"2023-10-09T06:20:54.708045+0000","last_unstale":"2023-10-09T06:20:54.708462+0000","last_undegraded":"2023-10-09T06:20:54.708462+0000","last_fullsized":"2023-10-09T06:20:54.708462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711509+0000","last_change":"2023-10-09T06:20:54.710694+0000","last_active":"2023-10-09T06:20:54.711509+0000","last_peered":"2023-10-09T06:20:54.711509+0000","last_clean":"2023-10-09T06:20:54.711509+0000","last_became_active":"2023-10-09T06:20:54.709873+0000","last_became_peered":"2023-10-09T06:20:54.709873+0000","last_unstale":"2023-10-09T06:20:54.711509+0000","last_undegraded":"2023-10-09T06:20:54.711509+0000","last_fullsized":"2023-10-09T06:20:54.711509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:25.482181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703512+0000","last_change":"2023-10-09T06:20:54.703439+0000","last_active":"2023-10-09T06:20:54.703512+0000","last_peered":"2023-10-09T06:20:54.703512+0000","last_clean":"2023-10-09T06:20:54.703512+0000","last_became_active":"2023-10-09T06:20:54.702617+0000","last_became_peered":"2023-10-09T06:20:54.702617+0000","last_unstale":"2023-10-09T06:20:54.703512+0000","last_undegraded":"2023-10-09T06:20:54.703512+0000","last_fullsized":"2023-10-09T06:20:54.703512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704333+0000","last_change":"2023-10-09T06:20:54.704167+0000","last_active":"2023-10-09T06:20:54.704333+0000","last_peered":"2023-10-09T06:20:54.704333+0000","last_clean":"2023-10-09T06:20:54.704333+0000","last_became_active":"2023-10-09T06:20:54.703924+0000","last_became_peered":"2023-10-09T06:20:54.703924+0000","last_unstale":"2023-10-09T06:20:54.704333+0000","last_undegraded":"2023-10-09T06:20:54.704333+0000","last_fullsized":"2023-10-09T06:20:54.704333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]}],"pool_statfs":[]}} 2023-10-09T06:21:04.296 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:21:04.297 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-09T06:21:04.297 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-09T06:21:04.297 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-09T06:21:04.297 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-09T06:21:04.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.450+0000 7f10774b5700 1 Processor -- start 2023-10-09T06:21:04.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.450+0000 7f10774b5700 1 -- start start 2023-10-09T06:21:04.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.451+0000 7f10774b5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1070157520 0x7f1070067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.451+0000 7f10774b5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10701578f0 0x7f1070070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.451+0000 7f10774b5700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107015b050 con 0x7f1070070c40 2023-10-09T06:21:04.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.451+0000 7f10774b5700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107015a270 con 0x7f1070157520 2023-10-09T06:21:04.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.451+0000 7f10774b5700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1070071080 con 0x7f10701578f0 2023-10-09T06:21:04.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.451+0000 7f10764b3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1070157520 0x7f1070067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.451+0000 7f1075cb2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10701578f0 0x7f1070070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.451+0000 7f10764b3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1070157520 0x7f1070067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:52318/0 (socket says 172.21.15.31:52318) 2023-10-09T06:21:04.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.451+0000 7f10764b3700 1 -- 172.21.15.31:0/4207219940 learned_addr learned my addr 172.21.15.31:0/4207219940 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:04.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.452+0000 7f10764b3700 1 -- 172.21.15.31:0/4207219940 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10701578f0 msgr2=0x7f1070070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:04.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.452+0000 7f10764b3700 1 --2- 172.21.15.31:0/4207219940 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10701578f0 0x7f1070070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.452+0000 7f10764b3700 1 -- 172.21.15.31:0/4207219940 >> v1:172.21.15.158:6789/0 conn(0x7f1070070c40 legacy=0x7f10700ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.452+0000 7f10764b3700 1 -- 172.21.15.31:0/4207219940 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107015a480 con 0x7f1070157520 2023-10-09T06:21:04.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.452+0000 7f10764b3700 1 --2- 172.21.15.31:0/4207219940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1070157520 0x7f1070067660 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1060009f20 tx=0x7f1060009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc98a31c9f99cc07 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.452+0000 7f10754b1700 1 -- 172.21.15.31:0/4207219940 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000e070 con 0x7f1070157520 2023-10-09T06:21:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.452+0000 7f10754b1700 1 -- 172.21.15.31:0/4207219940 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106000b9d0 con 0x7f1070157520 2023-10-09T06:21:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.452+0000 7f10754b1700 1 -- 172.21.15.31:0/4207219940 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10600092e0 con 0x7f1070157520 2023-10-09T06:21:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.453+0000 7f10774b5700 1 -- 172.21.15.31:0/4207219940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1070157520 msgr2=0x7f1070067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.453+0000 7f10774b5700 1 --2- 172.21.15.31:0/4207219940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1070157520 0x7f1070067660 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1060009f20 tx=0x7f1060009840 comp rx=0 tx=0).stop 2023-10-09T06:21:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.453+0000 7f10774b5700 1 -- 172.21.15.31:0/4207219940 shutdown_connections 2023-10-09T06:21:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.453+0000 7f10774b5700 1 --2- 172.21.15.31:0/4207219940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1070157520 0x7f1070067660 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.453+0000 7f10774b5700 1 --2- 172.21.15.31:0/4207219940 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10701578f0 0x7f1070070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.453+0000 7f10774b5700 1 -- 172.21.15.31:0/4207219940 >> 172.21.15.31:0/4207219940 conn(0x7f10700cd8f0 msgr2=0x7f10700cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.453+0000 7f10774b5700 1 -- 172.21.15.31:0/4207219940 shutdown_connections 2023-10-09T06:21:04.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.453+0000 7f10774b5700 1 -- 172.21.15.31:0/4207219940 wait complete. 2023-10-09T06:21:04.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.454+0000 7f10774b5700 1 Processor -- start 2023-10-09T06:21:04.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.454+0000 7f10774b5700 1 -- start start 2023-10-09T06:21:04.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f10774b5700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1070070c40 0x7f10700ab620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f10774b5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1070157520 0x7f10700af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f10774b5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10701578f0 0x7f1070154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f10774b5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10700aee10 con 0x7f10701578f0 2023-10-09T06:21:04.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f10774b5700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070154a40 con 0x7f1070070c40 2023-10-09T06:21:04.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f10774b5700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10700ae200 con 0x7f1070157520 2023-10-09T06:21:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f1076cb4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10701578f0 0x7f1070154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f1076cb4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10701578f0 0x7f1070154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58110/0 (socket says 172.21.15.31:58110) 2023-10-09T06:21:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f1076cb4700 1 -- 172.21.15.31:0/2960832894 learned_addr learned my addr 172.21.15.31:0/2960832894 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f10764b3700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1070070c40 0x7f10700ab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f1075cb2700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1070157520 0x7f10700af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f1076cb4700 1 -- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1070157520 msgr2=0x7f10700af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f1076cb4700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1070157520 0x7f10700af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f1076cb4700 1 -- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1070070c40 msgr2=0x7f10700ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f1076cb4700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1070070c40 0x7f10700ab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f1076cb4700 1 -- 172.21.15.31:0/2960832894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060009ae0 con 0x7f10701578f0 2023-10-09T06:21:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f1075cb2700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1070157520 0x7f10700af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:04.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f1076cb4700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10701578f0 0x7f1070154500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f106800c560 tx=0x7f1068007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:04.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f106e7fc700 1 -- 172.21.15.31:0/2960832894 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068011590 con 0x7f10701578f0 2023-10-09T06:21:04.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f106e7fc700 1 -- 172.21.15.31:0/2960832894 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10680116f0 con 0x7f10701578f0 2023-10-09T06:21:04.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f10774b5700 1 -- 172.21.15.31:0/2960832894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10700ae4e0 con 0x7f10701578f0 2023-10-09T06:21:04.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f106e7fc700 1 -- 172.21.15.31:0/2960832894 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068011ab0 con 0x7f10701578f0 2023-10-09T06:21:04.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.455+0000 7f10774b5700 1 -- 172.21.15.31:0/2960832894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10700aeaa0 con 0x7f10701578f0 2023-10-09T06:21:04.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.456+0000 7f10774b5700 1 -- 172.21.15.31:0/2960832894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10700aef80 con 0x7f10701578f0 2023-10-09T06:21:04.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.457+0000 7f106e7fc700 1 -- 172.21.15.31:0/2960832894 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f106801b3b0 con 0x7f10701578f0 2023-10-09T06:21:04.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.457+0000 7f106e7fc700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f105c066f30 0x7f105c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.457+0000 7f106e7fc700 1 -- 172.21.15.31:0/2960832894 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1068083a10 con 0x7f10701578f0 2023-10-09T06:21:04.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.457+0000 7f10764b3700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f105c066f30 0x7f105c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.458+0000 7f10764b3700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f105c066f30 0x7f105c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1060009880 tx=0x7f1060018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:04.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.461+0000 7f106e7fc700 1 -- 172.21.15.31:0/2960832894 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1068050c80 con 0x7f10701578f0 2023-10-09T06:21:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.708+0000 7f10774b5700 1 -- 172.21.15.31:0/2960832894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f10700c29d0 con 0x7f10701578f0 2023-10-09T06:21:04.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.711+0000 7f106e7fc700 1 -- 172.21.15.31:0/2960832894 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+163706 (secure 0 0 0) 0x7f1068017070 con 0x7f10701578f0 2023-10-09T06:21:04.714 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:04.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.714+0000 7f10774b5700 1 -- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f105c066f30 msgr2=0x7f105c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.714+0000 7f10774b5700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f105c066f30 0x7f105c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1060009880 tx=0x7f1060018000 comp rx=0 tx=0).stop 2023-10-09T06:21:04.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.714+0000 7f10774b5700 1 -- 172.21.15.31:0/2960832894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10701578f0 msgr2=0x7f1070154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.714+0000 7f10774b5700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10701578f0 0x7f1070154500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f106800c560 tx=0x7f1068007eb0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.714+0000 7f10774b5700 1 -- 172.21.15.31:0/2960832894 shutdown_connections 2023-10-09T06:21:04.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.714+0000 7f10774b5700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f105c066f30 0x7f105c0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.714+0000 7f10774b5700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10701578f0 0x7f1070154500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.714+0000 7f10774b5700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1070070c40 0x7f10700ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.714+0000 7f10774b5700 1 --2- 172.21.15.31:0/2960832894 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1070157520 0x7f10700af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.714+0000 7f10774b5700 1 -- 172.21.15.31:0/2960832894 >> 172.21.15.31:0/2960832894 conn(0x7f10700cd8f0 msgr2=0x7f10700c2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:04.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.714+0000 7f10774b5700 1 -- 172.21.15.31:0/2960832894 shutdown_connections 2023-10-09T06:21:04.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.714+0000 7f10774b5700 1 -- 172.21.15.31:0/2960832894 wait complete. 2023-10-09T06:21:04.726 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":4,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":85962},{"type":"v1","addr":"172.21.15.158:6833","nonce":85962}]},"active_addr":"172.21.15.158:6833/85962","active_change":"2023-10-09T06:20:42.503515+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.158:0","nonce":1688283055}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.158:0","nonce":1763520237}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.158:0","nonce":2364835715}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.158:0","nonce":2789860877}]}]} 2023-10-09T06:21:04.730 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-09T06:21:04.730 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-09T06:21:04.730 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:04.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.848+0000 7f2d400d7700 1 Processor -- start 2023-10-09T06:21:04.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.848+0000 7f2d400d7700 1 -- start start 2023-10-09T06:21:04.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.849+0000 7f2d400d7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d380b0e50 0x7f2d380c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.849+0000 7f2d400d7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2d380b1220 0x7f2d3806d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.849+0000 7f2d400d7700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3815de60 con 0x7f2d3806dad0 2023-10-09T06:21:04.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.849+0000 7f2d400d7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3815e140 con 0x7f2d380b1220 2023-10-09T06:21:04.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.849+0000 7f2d400d7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3815e420 con 0x7f2d380b0e50 2023-10-09T06:21:04.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.849+0000 7f2d3d672700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2d380b1220 0x7f2d3806d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.849+0000 7f2d3de73700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d380b0e50 0x7f2d380c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.849+0000 7f2d3e674700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f2d3806dad0 0x7f2d380cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:45272/0 (socket says 172.21.15.31:45272) 2023-10-09T06:21:04.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.850+0000 7f2d3e674700 1 -- 172.21.15.31:0/3350570021 learned_addr learned my addr 172.21.15.31:0/3350570021 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:04.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.850+0000 7f2d3d672700 1 -- 172.21.15.31:0/3350570021 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d380b0e50 msgr2=0x7f2d380c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:04.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.850+0000 7f2d3d672700 1 --2- 172.21.15.31:0/3350570021 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d380b0e50 0x7f2d380c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.850+0000 7f2d3d672700 1 -- 172.21.15.31:0/3350570021 >> v1:172.21.15.158:6789/0 conn(0x7f2d3806dad0 legacy=0x7f2d380cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.850+0000 7f2d3d672700 1 -- 172.21.15.31:0/3350570021 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3815e700 con 0x7f2d380b1220 2023-10-09T06:21:04.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.850+0000 7f2d3ce71700 1 -- 172.21.15.31:0/3350570021 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941172238 0 0) 0x7f2d3815de60 con 0x7f2d3806dad0 2023-10-09T06:21:04.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.850+0000 7f2d3de73700 1 --2- 172.21.15.31:0/3350570021 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d380b0e50 0x7f2d380c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:04.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.850+0000 7f2d3d672700 1 --2- 172.21.15.31:0/3350570021 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d380b1220 0x7f2d3806d590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009910 tx=0x7f2d2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae1e8b37f614a5fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:04.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.850+0000 7f2d3ce71700 1 -- 172.21.15.31:0/3350570021 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00b640 con 0x7f2d380b1220 2023-10-09T06:21:04.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.850+0000 7f2d3ce71700 1 -- 172.21.15.31:0/3350570021 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c00b7a0 con 0x7f2d380b1220 2023-10-09T06:21:04.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.850+0000 7f2d3ce71700 1 -- 172.21.15.31:0/3350570021 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00bb60 con 0x7f2d380b1220 2023-10-09T06:21:04.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.851+0000 7f2d400d7700 1 -- 172.21.15.31:0/3350570021 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d380b1220 msgr2=0x7f2d3806d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.851+0000 7f2d400d7700 1 --2- 172.21.15.31:0/3350570021 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d380b1220 0x7f2d3806d590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009910 tx=0x7f2d2c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.851+0000 7f2d400d7700 1 -- 172.21.15.31:0/3350570021 shutdown_connections 2023-10-09T06:21:04.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.851+0000 7f2d400d7700 1 --2- 172.21.15.31:0/3350570021 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d380b0e50 0x7f2d380c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.851+0000 7f2d400d7700 1 --2- 172.21.15.31:0/3350570021 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d380b1220 0x7f2d3806d590 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.851+0000 7f2d400d7700 1 -- 172.21.15.31:0/3350570021 >> 172.21.15.31:0/3350570021 conn(0x7f2d38069870 msgr2=0x7f2d38069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:04.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.851+0000 7f2d400d7700 1 -- 172.21.15.31:0/3350570021 shutdown_connections 2023-10-09T06:21:04.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.851+0000 7f2d400d7700 1 -- 172.21.15.31:0/3350570021 wait complete. 2023-10-09T06:21:04.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.852+0000 7f2d400d7700 1 Processor -- start 2023-10-09T06:21:04.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.852+0000 7f2d400d7700 1 -- start start 2023-10-09T06:21:04.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d400d7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d3806dad0 0x7f2d3815a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d400d7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d380b0e50 0x7f2d380c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d400d7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d380b1220 0x7f2d38141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d400d7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380c6130 con 0x7f2d3806dad0 2023-10-09T06:21:04.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d400d7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d381591a0 con 0x7f2d380b0e50 2023-10-09T06:21:04.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d400d7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d38158900 con 0x7f2d380b1220 2023-10-09T06:21:04.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d3de73700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d3806dad0 0x7f2d3815a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d3de73700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d3806dad0 0x7f2d3815a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58112/0 (socket says 172.21.15.31:58112) 2023-10-09T06:21:04.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d3de73700 1 -- 172.21.15.31:0/2598201101 learned_addr learned my addr 172.21.15.31:0/2598201101 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:04.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d3e674700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d380b1220 0x7f2d38141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d3d672700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d380b0e50 0x7f2d380c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d3de73700 1 -- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d380b1220 msgr2=0x7f2d38141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d3de73700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d380b1220 0x7f2d38141f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d3de73700 1 -- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d380b0e50 msgr2=0x7f2d380c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:04.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d3de73700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d380b0e50 0x7f2d380c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:04.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d3de73700 1 -- 172.21.15.31:0/2598201101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d30009420 con 0x7f2d3806dad0 2023-10-09T06:21:04.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.853+0000 7f2d3de73700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d3806dad0 0x7f2d3815a460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000ec80 tx=0x7f2d300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:04.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.854+0000 7f2d35ffb700 1 -- 172.21.15.31:0/2598201101 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3000c9d0 con 0x7f2d3806dad0 2023-10-09T06:21:04.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.854+0000 7f2d400d7700 1 -- 172.21.15.31:0/2598201101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c009420 con 0x7f2d3806dad0 2023-10-09T06:21:04.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.854+0000 7f2d35ffb700 1 -- 172.21.15.31:0/2598201101 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3000cb30 con 0x7f2d3806dad0 2023-10-09T06:21:04.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.854+0000 7f2d35ffb700 1 -- 172.21.15.31:0/2598201101 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3000ceb0 con 0x7f2d3806dad0 2023-10-09T06:21:04.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.854+0000 7f2d400d7700 1 -- 172.21.15.31:0/2598201101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d380c6500 con 0x7f2d3806dad0 2023-10-09T06:21:04.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.855+0000 7f2d400d7700 1 -- 172.21.15.31:0/2598201101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d380c6350 con 0x7f2d3806dad0 2023-10-09T06:21:04.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.855+0000 7f2d35ffb700 1 -- 172.21.15.31:0/2598201101 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d30013680 con 0x7f2d3806dad0 2023-10-09T06:21:04.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.855+0000 7f2d35ffb700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d24066f30 0x7f2d240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:04.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.856+0000 7f2d35ffb700 1 -- 172.21.15.31:0/2598201101 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d300849b0 con 0x7f2d3806dad0 2023-10-09T06:21:04.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.856+0000 7f2d3d672700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d24066f30 0x7f2d240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:04.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.856+0000 7f2d3d672700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d24066f30 0x7f2d240693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d38159c00 tx=0x7f2d2c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:04.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:04.860+0000 7f2d35ffb700 1 -- 172.21.15.31:0/2598201101 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d30051c20 con 0x7f2d3806dad0 2023-10-09T06:21:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.054+0000 7f2d400d7700 1 -- 172.21.15.31:0/2598201101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d3804c3c0 con 0x7f2d3806dad0 2023-10-09T06:21:05.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.055+0000 7f2d35ffb700 1 -- 172.21.15.31:0/2598201101 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f2d30017090 con 0x7f2d3806dad0 2023-10-09T06:21:05.056 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:05.056 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:55.693313+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:05.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.057+0000 7f2d400d7700 1 -- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d24066f30 msgr2=0x7f2d240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.057+0000 7f2d400d7700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d24066f30 0x7f2d240693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d38159c00 tx=0x7f2d2c017000 comp rx=0 tx=0).stop 2023-10-09T06:21:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.057+0000 7f2d400d7700 1 -- 172.21.15.31:0/2598201101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d3806dad0 msgr2=0x7f2d3815a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.057+0000 7f2d400d7700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d3806dad0 0x7f2d3815a460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000ec80 tx=0x7f2d300091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.057+0000 7f2d400d7700 1 -- 172.21.15.31:0/2598201101 shutdown_connections 2023-10-09T06:21:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.057+0000 7f2d400d7700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d24066f30 0x7f2d240693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.057+0000 7f2d400d7700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d380b1220 0x7f2d38141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.057+0000 7f2d400d7700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d3806dad0 0x7f2d3815a460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.057+0000 7f2d400d7700 1 --2- 172.21.15.31:0/2598201101 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d380b0e50 0x7f2d380c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.057+0000 7f2d400d7700 1 -- 172.21.15.31:0/2598201101 >> 172.21.15.31:0/2598201101 conn(0x7f2d38069870 msgr2=0x7f2d380cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.058+0000 7f2d400d7700 1 -- 172.21.15.31:0/2598201101 shutdown_connections 2023-10-09T06:21:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.058+0000 7f2d400d7700 1 -- 172.21.15.31:0/2598201101 wait complete. 2023-10-09T06:21:05.071 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-09T06:21:05.071 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.189+0000 7efcce3e3700 1 Processor -- start 2023-10-09T06:21:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.189+0000 7efcce3e3700 1 -- start start 2023-10-09T06:21:05.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.190+0000 7efcce3e3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc8157870 0x7efcc815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.190+0000 7efcce3e3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc815cbb0 con 0x7efcc8157c40 2023-10-09T06:21:05.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.190+0000 7efcce3e3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc815bfa0 con 0x7efcc815a620 2023-10-09T06:21:05.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.190+0000 7efcce3e3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc815c280 con 0x7efcc8157870 2023-10-09T06:21:05.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.190+0000 7efccc980700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efcc8157c40 0x7efcc8158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60580/0 (socket says 172.21.15.31:60580) 2023-10-09T06:21:05.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.190+0000 7efccc980700 1 -- 172.21.15.31:0/3009150707 learned_addr learned my addr 172.21.15.31:0/3009150707 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.190+0000 7efcc7fff700 1 --2- 172.21.15.31:0/3009150707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc8157870 0x7efcc815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.190+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125084755 0 0) 0x7efcc815cbb0 con 0x7efcc8157c40 2023-10-09T06:21:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcb4003570 con 0x7efcc8157c40 2023-10-09T06:21:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811659081 0 0) 0x7efcc815bfa0 con 0x7efcc815a620 2023-10-09T06:21:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc815cbb0 con 0x7efcc815a620 2023-10-09T06:21:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2967228601 0 0) 0x7efcb4003570 con 0x7efcc8157c40 2023-10-09T06:21:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc8157870 msgr2=0x7efcc815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 --2- 172.21.15.31:0/3009150707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc8157870 0x7efcc815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 >> v1:172.21.15.158:6789/0 conn(0x7efcc815a620 legacy=0x7efcc815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc815c560 con 0x7efcc8157c40 2023-10-09T06:21:05.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7efcc00017f0 con 0x7efcc8157c40 2023-10-09T06:21:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc7fff700 1 --2- 172.21.15.31:0/3009150707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc8157870 0x7efcc815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 >> v1:172.21.15.31:6789/0 conn(0x7efcc8157c40 legacy=0x7efcc8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 --2- 172.21.15.31:0/3009150707 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efcb4003c20 0x7efcb4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 --2- 172.21.15.31:0/3009150707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc8157870 0x7efcb4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 --2- 172.21.15.31:0/3009150707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcb4004d50 0x7efcb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc815c280 con 0x7efcb4004d50 2023-10-09T06:21:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb400bb10 con 0x7efcb4003c20 2023-10-09T06:21:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb400bcd0 con 0x7efcc8157870 2023-10-09T06:21:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efccc980700 1 --2- 172.21.15.31:0/3009150707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcb4004d50 0x7efcb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc77fe700 1 --2- 172.21.15.31:0/3009150707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc8157870 0x7efcb4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efcc7fff700 1 --2- 172.21.15.31:0/3009150707 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efcb4003c20 0x7efcb4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efccc980700 1 -- 172.21.15.31:0/3009150707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc8157870 msgr2=0x7efcb4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efccc980700 1 --2- 172.21.15.31:0/3009150707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc8157870 0x7efcb4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efccc980700 1 -- 172.21.15.31:0/3009150707 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efcb4003c20 msgr2=0x7efcb4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efccc980700 1 --2- 172.21.15.31:0/3009150707 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efcb4003c20 0x7efcb4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efccc980700 1 -- 172.21.15.31:0/3009150707 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0009420 con 0x7efcb4004d50 2023-10-09T06:21:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.191+0000 7efccc980700 1 --2- 172.21.15.31:0/3009150707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcb4004d50 0x7efcb40051c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efcc000a8d0 tx=0x7efcc0002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd3195c45001ae5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.192+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc00070d0 con 0x7efcb4004d50 2023-10-09T06:21:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.192+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc0007230 con 0x7efcb4004d50 2023-10-09T06:21:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.192+0000 7efcc6ffd700 1 -- 172.21.15.31:0/3009150707 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc00075f0 con 0x7efcb4004d50 2023-10-09T06:21:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.192+0000 7efcce3e3700 1 -- 172.21.15.31:0/3009150707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcb4004d50 msgr2=0x7efcb40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.192+0000 7efcce3e3700 1 --2- 172.21.15.31:0/3009150707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcb4004d50 0x7efcb40051c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efcc000a8d0 tx=0x7efcc0002190 comp rx=0 tx=0).stop 2023-10-09T06:21:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.192+0000 7efccc980700 1 -- 172.21.15.31:0/3009150707 reap_dead start 2023-10-09T06:21:05.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.192+0000 7efcce3e3700 1 -- 172.21.15.31:0/3009150707 shutdown_connections 2023-10-09T06:21:05.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.192+0000 7efcce3e3700 1 -- 172.21.15.31:0/3009150707 >> 172.21.15.31:0/3009150707 conn(0x7efcc8068ce0 msgr2=0x7efcc80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.192+0000 7efcce3e3700 1 -- 172.21.15.31:0/3009150707 shutdown_connections 2023-10-09T06:21:05.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.192+0000 7efcce3e3700 1 -- 172.21.15.31:0/3009150707 wait complete. 2023-10-09T06:21:05.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.193+0000 7efcce3e3700 1 Processor -- start 2023-10-09T06:21:05.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.193+0000 7efcce3e3700 1 -- start start 2023-10-09T06:21:05.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcce3e3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efcb4004d50 0x7efcc813f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcce3e3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcc81510f0 0x7efcc8151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcce3e3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc80b1f10 0x7efcc80b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcce3e3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc813ff50 con 0x7efcc81510f0 2023-10-09T06:21:05.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcce3e3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc8151aa0 con 0x7efcb4004d50 2023-10-09T06:21:05.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcce3e3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc814ee40 con 0x7efcc80b1f10 2023-10-09T06:21:05.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcc77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcc81510f0 0x7efcc8151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcc77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcc81510f0 0x7efcc8151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58126/0 (socket says 172.21.15.31:58126) 2023-10-09T06:21:05.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcc77fe700 1 -- 172.21.15.31:0/2018836083 learned_addr learned my addr 172.21.15.31:0/2018836083 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:05.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcc7fff700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efcb4004d50 0x7efcc813f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efccc980700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc80b1f10 0x7efcc80b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcc77fe700 1 -- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc80b1f10 msgr2=0x7efcc80b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcc77fe700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc80b1f10 0x7efcc80b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcc77fe700 1 -- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efcb4004d50 msgr2=0x7efcc813f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcc77fe700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efcb4004d50 0x7efcc813f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efcc77fe700 1 -- 172.21.15.31:0/2018836083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc80b2c00 con 0x7efcc81510f0 2023-10-09T06:21:05.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.194+0000 7efccc980700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc80b1f10 0x7efcc80b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:05.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.195+0000 7efcc77fe700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcc81510f0 0x7efcc8151560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efcb8002b20 tx=0x7efcb8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.195+0000 7efcbffff700 1 -- 172.21.15.31:0/2018836083 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb800f9a0 con 0x7efcc81510f0 2023-10-09T06:21:05.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.195+0000 7efcbffff700 1 -- 172.21.15.31:0/2018836083 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb800fb20 con 0x7efcc81510f0 2023-10-09T06:21:05.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.195+0000 7efcce3e3700 1 -- 172.21.15.31:0/2018836083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc80b2ee0 con 0x7efcc81510f0 2023-10-09T06:21:05.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.195+0000 7efcbffff700 1 -- 172.21.15.31:0/2018836083 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb800fee0 con 0x7efcc81510f0 2023-10-09T06:21:05.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.195+0000 7efcce3e3700 1 -- 172.21.15.31:0/2018836083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc814ead0 con 0x7efcc81510f0 2023-10-09T06:21:05.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.196+0000 7efcce3e3700 1 -- 172.21.15.31:0/2018836083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc814eff0 con 0x7efcc81510f0 2023-10-09T06:21:05.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.196+0000 7efcbffff700 1 -- 172.21.15.31:0/2018836083 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efcb8013600 con 0x7efcc81510f0 2023-10-09T06:21:05.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.197+0000 7efcbffff700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efca8066f30 0x7efca80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.197+0000 7efcbffff700 1 -- 172.21.15.31:0/2018836083 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efcb8084bf0 con 0x7efcc81510f0 2023-10-09T06:21:05.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.197+0000 7efcc7fff700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efca8066f30 0x7efca80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.197+0000 7efcc7fff700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efca8066f30 0x7efca80693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efcb0006f00 tx=0x7efcb00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.201+0000 7efcbffff700 1 -- 172.21.15.31:0/2018836083 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcc814eff0 con 0x7efcc81510f0 2023-10-09T06:21:05.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.396+0000 7efcce3e3700 1 -- 172.21.15.31:0/2018836083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcc80b2990 con 0x7efcc81510f0 2023-10-09T06:21:05.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.397+0000 7efcbffff700 1 -- 172.21.15.31:0/2018836083 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7efcb8017090 con 0x7efcc81510f0 2023-10-09T06:21:05.398 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:05.398 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:55.693313+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:05.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.399+0000 7efcce3e3700 1 -- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efca8066f30 msgr2=0x7efca80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.399+0000 7efcce3e3700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efca8066f30 0x7efca80693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efcb0006f00 tx=0x7efcb00091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.399+0000 7efcce3e3700 1 -- 172.21.15.31:0/2018836083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcc81510f0 msgr2=0x7efcc8151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.399+0000 7efcce3e3700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcc81510f0 0x7efcc8151560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efcb8002b20 tx=0x7efcb8007d30 comp rx=0 tx=0).stop 2023-10-09T06:21:05.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.399+0000 7efcce3e3700 1 -- 172.21.15.31:0/2018836083 shutdown_connections 2023-10-09T06:21:05.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.399+0000 7efcce3e3700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efca8066f30 0x7efca80693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.399+0000 7efcce3e3700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efcc80b1f10 0x7efcc80b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.400+0000 7efcce3e3700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efcb4004d50 0x7efcc813f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.400+0000 7efcce3e3700 1 --2- 172.21.15.31:0/2018836083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcc81510f0 0x7efcc8151560 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.400+0000 7efcce3e3700 1 -- 172.21.15.31:0/2018836083 >> 172.21.15.31:0/2018836083 conn(0x7efcc8068ce0 msgr2=0x7efcc815aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.400+0000 7efcce3e3700 1 -- 172.21.15.31:0/2018836083 shutdown_connections 2023-10-09T06:21:05.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.400+0000 7efcce3e3700 1 -- 172.21.15.31:0/2018836083 wait complete. 2023-10-09T06:21:05.413 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-09T06:21:05.414 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-09T06:21:05.414 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-09T06:21:05.414 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-09T06:21:05.415 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-09T06:21:05.415 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-09T06:21:05.416 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-09T06:21:05.416 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-09T06:21:05.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.619+0000 7f3df1f67700 1 Processor -- start 2023-10-09T06:21:05.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.619+0000 7f3df1f67700 1 -- start start 2023-10-09T06:21:05.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.620+0000 7f3df1f67700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3dec0c75c0 0x7f3dec155b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.620+0000 7f3df1f67700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3dec06d6b0 0x7f3dec1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.620+0000 7f3df1f67700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec1565e0 con 0x7f3dec06d2e0 2023-10-09T06:21:05.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.620+0000 7f3df1f67700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec0c8760 con 0x7f3dec06d6b0 2023-10-09T06:21:05.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.620+0000 7f3df1f67700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec0af6e0 con 0x7f3dec0c75c0 2023-10-09T06:21:05.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.620+0000 7f3deb7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f3dec06d2e0 0x7f3dec0c6eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:45286/0 (socket says 172.21.15.31:45286) 2023-10-09T06:21:05.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.620+0000 7f3deb7fe700 1 -- 172.21.15.31:0/2205861663 learned_addr learned my addr 172.21.15.31:0/2205861663 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:05.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.620+0000 7f3deaffd700 1 --2- 172.21.15.31:0/2205861663 >> v2:172.21.15.158:3300/0 conn(0x7f3dec0c75c0 0x7f3dec155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.621+0000 7f3dea7fc700 1 -- 172.21.15.31:0/2205861663 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271213570 0 0) 0x7f3de4001490 con 0x7f3dec06d2e0 2023-10-09T06:21:05.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.621+0000 7f3dea7fc700 1 -- 172.21.15.31:0/2205861663 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dd4005780 con 0x7f3dec06d2e0 2023-10-09T06:21:05.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.621+0000 7f3debfff700 1 --2- 172.21.15.31:0/2205861663 >> v2:172.21.15.31:3300/0 conn(0x7f3dec06d6b0 0x7f3dec1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.621+0000 7f3deaffd700 1 -- 172.21.15.31:0/2205861663 >> v2:172.21.15.31:3300/0 conn(0x7f3dec06d6b0 msgr2=0x7f3dec1560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.621+0000 7f3deaffd700 1 --2- 172.21.15.31:0/2205861663 >> v2:172.21.15.31:3300/0 conn(0x7f3dec06d6b0 0x7f3dec1560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.621+0000 7f3deaffd700 1 -- 172.21.15.31:0/2205861663 >> v1:172.21.15.158:6789/0 conn(0x7f3dec06d2e0 legacy=0x7f3dec0c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.621+0000 7f3deaffd700 1 -- 172.21.15.31:0/2205861663 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0c7b50 con 0x7f3dec0c75c0 2023-10-09T06:21:05.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.621+0000 7f3deaffd700 1 --2- 172.21.15.31:0/2205861663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3dec0c75c0 0x7f3dec155b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0c3890 tx=0x7f3ddc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ed2fe9ee14999f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.621+0000 7f3dea7fc700 1 -- 172.21.15.31:0/2205861663 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc010630 con 0x7f3dec0c75c0 2023-10-09T06:21:05.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.621+0000 7f3dea7fc700 1 -- 172.21.15.31:0/2205861663 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc0107b0 con 0x7f3dec0c75c0 2023-10-09T06:21:05.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.621+0000 7f3dea7fc700 1 -- 172.21.15.31:0/2205861663 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc010b70 con 0x7f3dec0c75c0 2023-10-09T06:21:05.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.623+0000 7f120f882700 1 Processor -- start 2023-10-09T06:21:05.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.623+0000 7f3df1f67700 1 -- 172.21.15.31:0/2205861663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3dec0c75c0 msgr2=0x7f3dec155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.623+0000 7f3df1f67700 1 --2- 172.21.15.31:0/2205861663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3dec0c75c0 0x7f3dec155b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0c3890 tx=0x7f3ddc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.623+0000 7fc51f5d9700 1 Processor -- start 2023-10-09T06:21:05.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.623+0000 7f3df1f67700 1 -- 172.21.15.31:0/2205861663 shutdown_connections 2023-10-09T06:21:05.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.623+0000 7f3df1f67700 1 --2- 172.21.15.31:0/2205861663 >> v2:172.21.15.31:3300/0 conn(0x7f3dec06d6b0 0x7f3dec1560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.623+0000 7f3df1f67700 1 --2- 172.21.15.31:0/2205861663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3dec0c75c0 0x7f3dec155b60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.623+0000 7f3df1f67700 1 -- 172.21.15.31:0/2205861663 >> 172.21.15.31:0/2205861663 conn(0x7f3dec070700 msgr2=0x7f3dec070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.623+0000 7f120f882700 1 -- start start 2023-10-09T06:21:05.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.623+0000 7f14db668700 1 Processor -- start 2023-10-09T06:21:05.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.623+0000 7fc51f5d9700 1 -- start start 2023-10-09T06:21:05.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.624+0000 7fc51f5d9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5180c9a10 0x7fc5180bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.624+0000 7fc51f5d9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5180c7960 con 0x7fc51806d4c0 2023-10-09T06:21:05.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.624+0000 7fc51f5d9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5180c7c40 con 0x7fc5180bf970 2023-10-09T06:21:05.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.624+0000 7fc51f5d9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5180c7f20 con 0x7fc5180c9a10 2023-10-09T06:21:05.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.624+0000 7f14db668700 1 -- start start 2023-10-09T06:21:05.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.624+0000 7fc51db76700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5180c9a10 0x7fc5180bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.624+0000 7fc51db76700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5180c9a10 0x7fc5180bfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58148/0 (socket says 172.21.15.31:58148) 2023-10-09T06:21:05.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.624+0000 7fc51d375700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fc5180bf970 0x7fc51806ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:45302/0 (socket says 172.21.15.31:45302) 2023-10-09T06:21:05.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.624+0000 7fc51db76700 1 -- 172.21.15.31:0/587667124 learned_addr learned my addr 172.21.15.31:0/587667124 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:05.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.624+0000 7f120f882700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12080c75c0 0x7f12080c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.624+0000 7f120f882700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12080c9cb0 con 0x7f12080abae0 2023-10-09T06:21:05.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.624+0000 7f120f882700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12080c90a0 con 0x7f12080abeb0 2023-10-09T06:21:05.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.624+0000 7f120f882700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12080c9380 con 0x7f12080c75c0 2023-10-09T06:21:05.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f3df1f67700 1 -- 172.21.15.31:0/2205861663 shutdown_connections 2023-10-09T06:21:05.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f120de1f700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f12080abeb0 0x7f1208068fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:45316/0 (socket says 172.21.15.31:45316) 2023-10-09T06:21:05.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f120de1f700 1 -- 172.21.15.31:0/3445066862 learned_addr learned my addr 172.21.15.31:0/3445066862 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:05.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f120ce1d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12080c75c0 0x7f12080c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7fc51db76700 1 -- 172.21.15.31:0/587667124 >> v1:172.21.15.158:6789/0 conn(0x7fc5180bf970 legacy=0x7fc51806ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7fc51db76700 1 -- 172.21.15.31:0/587667124 >> v1:172.21.15.31:6789/0 conn(0x7fc51806d4c0 legacy=0x7fc5180ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7fc51db76700 1 -- 172.21.15.31:0/587667124 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5180c8200 con 0x7fc5180c9a10 2023-10-09T06:21:05.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f120ce1d700 1 -- 172.21.15.31:0/3445066862 >> v1:172.21.15.158:6789/0 conn(0x7f12080abeb0 legacy=0x7f1208068fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f120ce1d700 1 -- 172.21.15.31:0/3445066862 >> v1:172.21.15.31:6789/0 conn(0x7f12080abae0 legacy=0x7f12080c6eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:21:05.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f120ce1d700 1 -- 172.21.15.31:0/3445066862 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12080c9660 con 0x7f12080c75c0 2023-10-09T06:21:05.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7fc51db76700 1 --2- 172.21.15.31:0/587667124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5180c9a10 0x7fc5180bfd40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc510009ed0 tx=0x7fc510009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef11db6b3e74b3b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f3df1f67700 1 -- 172.21.15.31:0/2205861663 wait complete. 2023-10-09T06:21:05.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f120ce1d700 1 --2- 172.21.15.31:0/3445066862 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12080c75c0 0x7f12080c8400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009910 tx=0x7f11f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4c6178e5f54256f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f14db668700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f14d406d4c0 0x7f14d40bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f14db668700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d40c7960 con 0x7f14d40bf970 2023-10-09T06:21:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f14db668700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d40c7c40 con 0x7f14d40ac1a0 2023-10-09T06:21:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f14db668700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d40c7f20 con 0x7f14d406d4c0 2023-10-09T06:21:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7fc50ffff700 1 -- 172.21.15.31:0/587667124 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51000e070 con 0x7fc5180c9a10 2023-10-09T06:21:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7fc50ffff700 1 -- 172.21.15.31:0/587667124 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51000ba00 con 0x7fc5180c9a10 2023-10-09T06:21:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7fc50ffff700 1 -- 172.21.15.31:0/587667124 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5100092e0 con 0x7fc5180c9a10 2023-10-09T06:21:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7fb744ec5700 1 Processor -- start 2023-10-09T06:21:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f14d9c05700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f14d40ac1a0 0x7f14d40ac600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:45330/0 (socket says 172.21.15.31:45330) 2023-10-09T06:21:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7f14d9c05700 1 -- 172.21.15.31:0/4109405555 learned_addr learned my addr 172.21.15.31:0/4109405555 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7fb744ec5700 1 -- start start 2023-10-09T06:21:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f11fffff700 1 -- 172.21.15.31:0/3445066862 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800b7e0 con 0x7f12080c75c0 2023-10-09T06:21:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f11fffff700 1 -- 172.21.15.31:0/3445066862 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f800b940 con 0x7f12080c75c0 2023-10-09T06:21:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f11fffff700 1 -- 172.21.15.31:0/3445066862 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800bce0 con 0x7f12080c75c0 2023-10-09T06:21:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.625+0000 7fa74da2f700 1 Processor -- start 2023-10-09T06:21:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7fa74da2f700 1 -- start start 2023-10-09T06:21:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14d8c03700 1 --2- 172.21.15.31:0/4109405555 >> v2:172.21.15.158:3300/0 conn(0x7f14d406d4c0 0x7f14d40bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866384155 0 0) 0x7f14d40c7c40 con 0x7f14d40ac1a0 2023-10-09T06:21:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14c0003570 con 0x7f14d40ac1a0 2023-10-09T06:21:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1964592102 0 0) 0x7f14c0003570 con 0x7f14d40ac1a0 2023-10-09T06:21:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 >> v2:172.21.15.158:3300/0 conn(0x7f14d406d4c0 msgr2=0x7f14d40bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 --2- 172.21.15.31:0/4109405555 >> v2:172.21.15.158:3300/0 conn(0x7f14d406d4c0 0x7f14d40bfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 >> v1:172.21.15.31:6789/0 conn(0x7f14d40bf970 legacy=0x7f14d406ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d40c8200 con 0x7f14d40ac1a0 2023-10-09T06:21:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f14cc0017f0 con 0x7f14d40ac1a0 2023-10-09T06:21:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 >> v1:172.21.15.158:6789/0 conn(0x7f14d40ac1a0 legacy=0x7f14d40ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 --2- 172.21.15.31:0/4109405555 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f14c0003ae0 0x7f14c0003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 --2- 172.21.15.31:0/4109405555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f14c0004810 0x7f14c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 --2- 172.21.15.31:0/4109405555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14c0005210 0x7f14c000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40c7f20 con 0x7f14c0005210 2023-10-09T06:21:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c000c130 con 0x7f14c0004810 2023-10-09T06:21:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c000c2f0 con 0x7f14c0003ae0 2023-10-09T06:21:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7fc51f5d9700 1 -- 172.21.15.31:0/587667124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5180c9a10 msgr2=0x7fc5180bfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.626+0000 7fc51f5d9700 1 --2- 172.21.15.31:0/587667124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5180c9a10 0x7fc5180bfd40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc510009ed0 tx=0x7fc510009840 comp rx=0 tx=0).stop 2023-10-09T06:21:05.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f14d8c03700 1 --2- 172.21.15.31:0/4109405555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f14c0004810 0x7f14c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f3df1f67700 1 Processor -- start 2023-10-09T06:21:05.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f3df1f67700 1 -- start start 2023-10-09T06:21:05.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f120f882700 1 -- 172.21.15.31:0/3445066862 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12080c75c0 msgr2=0x7f12080c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f120f882700 1 --2- 172.21.15.31:0/3445066862 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12080c75c0 0x7f12080c8400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009910 tx=0x7f11f80091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7fc51f5d9700 1 -- 172.21.15.31:0/587667124 shutdown_connections 2023-10-09T06:21:05.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7fc51f5d9700 1 --2- 172.21.15.31:0/587667124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5180c9a10 0x7fc5180bfd40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7fc51f5d9700 1 -- 172.21.15.31:0/587667124 >> 172.21.15.31:0/587667124 conn(0x7fc518067660 msgr2=0x7fc518067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f14d9404700 1 --2- 172.21.15.31:0/4109405555 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f14c0003ae0 0x7f14c0003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f14d9c05700 1 --2- 172.21.15.31:0/4109405555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14c0005210 0x7f14c000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f14d8c03700 1 -- 172.21.15.31:0/4109405555 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f14c0003ae0 msgr2=0x7f14c0003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f14d8c03700 1 --2- 172.21.15.31:0/4109405555 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f14c0003ae0 0x7f14c0003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f14d8c03700 1 -- 172.21.15.31:0/4109405555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14c0005210 msgr2=0x7f14c000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f14d8c03700 1 --2- 172.21.15.31:0/4109405555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14c0005210 0x7f14c000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f14d8c03700 1 -- 172.21.15.31:0/4109405555 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d40c8200 con 0x7f14c0004810 2023-10-09T06:21:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f14d9c05700 1 -- 172.21.15.31:0/4109405555 reap_dead start 2023-10-09T06:21:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7fb744ec5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb7400bf970 0x7fb7400bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7fb744ec5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7400acb20 con 0x7fb7400ac730 2023-10-09T06:21:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7fb744ec5700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7400acd50 con 0x7fb7400cc880 2023-10-09T06:21:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7fb744ec5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74015ec10 con 0x7fb7400bf970 2023-10-09T06:21:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f120f882700 1 -- 172.21.15.31:0/3445066862 shutdown_connections 2023-10-09T06:21:05.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f120f882700 1 --2- 172.21.15.31:0/3445066862 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12080c75c0 0x7f12080c8400 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f120f882700 1 -- 172.21.15.31:0/3445066862 >> 172.21.15.31:0/3445066862 conn(0x7f1208067660 msgr2=0x7f1208067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7fc51f5d9700 1 -- 172.21.15.31:0/587667124 shutdown_connections 2023-10-09T06:21:05.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7fb73dd9b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fb7400cc880 0x7fb7400ac020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:45332/0 (socket says 172.21.15.31:45332) 2023-10-09T06:21:05.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7fb73dd9b700 1 -- 172.21.15.31:0/1696330193 learned_addr learned my addr 172.21.15.31:0/1696330193 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:05.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7fb73e59c700 1 --2- 172.21.15.31:0/1696330193 >> v2:172.21.15.31:3300/0 conn(0x7fb7400bf970 0x7fb7400bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f120f882700 1 -- 172.21.15.31:0/3445066862 shutdown_connections 2023-10-09T06:21:05.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f14d8c03700 1 --2- 172.21.15.31:0/4109405555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f14c0004810 0x7f14c0004c80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14c4006f00 tx=0x7f14c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb217bbcba034f5e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7fb73d59a700 1 -- 172.21.15.31:0/1696330193 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328891693 0 0) 0x7fb7400acd50 con 0x7fb7400cc880 2023-10-09T06:21:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fb73d59a700 1 -- 172.21.15.31:0/1696330193 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb728003570 con 0x7fb7400cc880 2023-10-09T06:21:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f179f60a700 1 Processor -- start 2023-10-09T06:21:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f3df1f67700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06d2e0 0x7f3dec0c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f3df1f67700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec06d6b0 0x7f3dec0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f3df1f67700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3dec0c75c0 0x7f3dec154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f3df1f67700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0b0860 con 0x7f3dec06d6b0 2023-10-09T06:21:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f3df1f67700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0b0b30 con 0x7f3dec0c75c0 2023-10-09T06:21:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f3df1f67700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0b0e10 con 0x7f3dec06d2e0 2023-10-09T06:21:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f3deaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec06d6b0 0x7f3dec0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f3deaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec06d6b0 0x7f3dec0b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58182/0 (socket says 172.21.15.31:58182) 2023-10-09T06:21:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f3deb7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06d2e0 0x7f3dec0c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f3deaffd700 1 -- 172.21.15.31:0/691427120 learned_addr learned my addr 172.21.15.31:0/691427120 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f3debfff700 1 --2- 172.21.15.31:0/691427120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3dec0c75c0 0x7f3dec154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fb73e59c700 1 -- 172.21.15.31:0/1696330193 >> v1:172.21.15.158:6789/0 conn(0x7fb7400cc880 legacy=0x7fb7400ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fb73e59c700 1 -- 172.21.15.31:0/1696330193 >> v1:172.21.15.31:6789/0 conn(0x7fb7400ac730 legacy=0x7fb7400addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fb73e59c700 1 -- 172.21.15.31:0/1696330193 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7400ad030 con 0x7fb7400bf970 2023-10-09T06:21:05.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fb73e59c700 1 --2- 172.21.15.31:0/1696330193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7400bf970 0x7fb7400bfd40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb738009e60 tx=0x7fb738009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915dee8f163c82fd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7fb73d59a700 1 -- 172.21.15.31:0/1696330193 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73800e070 con 0x7fb7400bf970 2023-10-09T06:21:05.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f179f60a700 1 -- start start 2023-10-09T06:21:05.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fa74da2f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa74814ed60 0x7fa7480cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fa74da2f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa74814f130 0x7fa74806d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fa74da2f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7480c9b30 con 0x7fa7480c9fc0 2023-10-09T06:21:05.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fa74da2f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7480c9240 con 0x7fa74814f130 2023-10-09T06:21:05.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fa74da2f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74806dea0 con 0x7fa74814ed60 2023-10-09T06:21:05.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fa746ffd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa74814ed60 0x7fa7480cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fa7477fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa74814f130 0x7fa74806d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fa746ffd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa74814ed60 0x7fa7480cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51322/0 (socket says 172.21.15.31:51322) 2023-10-09T06:21:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fa746ffd700 1 -- 172.21.15.31:0/595352902 learned_addr learned my addr 172.21.15.31:0/595352902 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fa7477fe700 1 -- 172.21.15.31:0/595352902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa74814ed60 msgr2=0x7fa7480cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fa7477fe700 1 --2- 172.21.15.31:0/595352902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa74814ed60 0x7fa7480cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fa7477fe700 1 -- 172.21.15.31:0/595352902 >> v1:172.21.15.31:6789/0 conn(0x7fa7480c9fc0 legacy=0x7fa74806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7fa7477fe700 1 -- 172.21.15.31:0/595352902 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7480c94e0 con 0x7fa74814f130 2023-10-09T06:21:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7fa7477fe700 1 --2- 172.21.15.31:0/595352902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa74814f130 0x7fa74806d880 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa7380098e0 tx=0x7fa7380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a82d1d25b3df6b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c400e710 con 0x7f14c0004810 2023-10-09T06:21:05.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c400e870 con 0x7f14c0004810 2023-10-09T06:21:05.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.628+0000 7f14cbfff700 1 -- 172.21.15.31:0/4109405555 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c400ec30 con 0x7f14c0004810 2023-10-09T06:21:05.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f14db668700 1 -- 172.21.15.31:0/4109405555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f14c0004810 msgr2=0x7f14c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f14db668700 1 --2- 172.21.15.31:0/4109405555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f14c0004810 0x7f14c0004c80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14c4006f00 tx=0x7f14c40091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f14db668700 1 -- 172.21.15.31:0/4109405555 shutdown_connections 2023-10-09T06:21:05.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f14db668700 1 --2- 172.21.15.31:0/4109405555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f14c0004810 0x7f14c0004c80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f14db668700 1 -- 172.21.15.31:0/4109405555 >> 172.21.15.31:0/4109405555 conn(0x7f14d4067660 msgr2=0x7f14d4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7fb73d59a700 1 -- 172.21.15.31:0/1696330193 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73800bbf0 con 0x7fb7400bf970 2023-10-09T06:21:05.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7fb73d59a700 1 -- 172.21.15.31:0/1696330193 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738012430 con 0x7fb7400bf970 2023-10-09T06:21:05.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f3deb7fe700 1 -- 172.21.15.31:0/691427120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3dec0c75c0 msgr2=0x7f3dec154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f3deb7fe700 1 --2- 172.21.15.31:0/691427120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3dec0c75c0 0x7f3dec154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f3deb7fe700 1 -- 172.21.15.31:0/691427120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec06d6b0 msgr2=0x7f3dec0b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f3deb7fe700 1 --2- 172.21.15.31:0/691427120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec06d6b0 0x7f3dec0b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f3deb7fe700 1 -- 172.21.15.31:0/691427120 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc009420 con 0x7f3dec06d2e0 2023-10-09T06:21:05.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f179f60a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f179815e080 0x7f17980b6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f179f60a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f179815e450 0x7f17980afd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f179f60a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17980b6cc0 con 0x7f17980b5b60 2023-10-09T06:21:05.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f179f60a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17980b56d0 con 0x7f179815e080 2023-10-09T06:21:05.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f179f60a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17980b4da0 con 0x7f179815e450 2023-10-09T06:21:05.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f3deb7fe700 1 --2- 172.21.15.31:0/691427120 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06d2e0 0x7f3dec0c5c20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3de4001a10 tx=0x7f3de4005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f14db668700 1 -- 172.21.15.31:0/4109405555 shutdown_connections 2023-10-09T06:21:05.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f179dba7700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f17980b5b60 0x7f179806a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:45340/0 (socket says 172.21.15.31:45340) 2023-10-09T06:21:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f179dba7700 1 -- 172.21.15.31:0/3987572806 learned_addr learned my addr 172.21.15.31:0/3987572806 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f14db668700 1 -- 172.21.15.31:0/4109405555 wait complete. 2023-10-09T06:21:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7fa745ffb700 1 -- 172.21.15.31:0/595352902 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa738009e80 con 0x7fa74814f130 2023-10-09T06:21:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7fa745ffb700 1 -- 172.21.15.31:0/595352902 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73800b820 con 0x7fa74814f130 2023-10-09T06:21:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7fa745ffb700 1 -- 172.21.15.31:0/595352902 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73800bbc0 con 0x7fa74814f130 2023-10-09T06:21:05.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f3dd37fe700 1 -- 172.21.15.31:0/691427120 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4008320 con 0x7f3dec06d2e0 2023-10-09T06:21:05.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7f3dd37fe700 1 -- 172.21.15.31:0/691427120 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de4006510 con 0x7f3dec06d2e0 2023-10-09T06:21:05.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7f3dd37fe700 1 -- 172.21.15.31:0/691427120 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de40068d0 con 0x7f3dec06d2e0 2023-10-09T06:21:05.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7f179d3a6700 1 --2- 172.21.15.31:0/3987572806 >> v2:172.21.15.158:3300/0 conn(0x7f179815e080 0x7f17980b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7f3df1f67700 1 -- 172.21.15.31:0/691427120 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec0b10f0 con 0x7f3dec06d2e0 2023-10-09T06:21:05.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7f3df1f67700 1 -- 172.21.15.31:0/691427120 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec0b16b0 con 0x7f3dec06d2e0 2023-10-09T06:21:05.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7f179cba5700 1 --2- 172.21.15.31:0/3987572806 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f179815e450 0x7f17980afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7fb744ec5700 1 -- 172.21.15.31:0/1696330193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7400bf970 msgr2=0x7fb7400bfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7fb744ec5700 1 --2- 172.21.15.31:0/1696330193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7400bf970 0x7fb7400bfd40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb738009e60 tx=0x7fb738009780 comp rx=0 tx=0).stop 2023-10-09T06:21:05.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7fb744ec5700 1 -- 172.21.15.31:0/1696330193 shutdown_connections 2023-10-09T06:21:05.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7fb744ec5700 1 --2- 172.21.15.31:0/1696330193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7400bf970 0x7fb7400bfd40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7fb744ec5700 1 -- 172.21.15.31:0/1696330193 >> 172.21.15.31:0/1696330193 conn(0x7fb740070700 msgr2=0x7fb740070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7fb744ec5700 1 -- 172.21.15.31:0/1696330193 shutdown_connections 2023-10-09T06:21:05.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7fb744ec5700 1 -- 172.21.15.31:0/1696330193 wait complete. 2023-10-09T06:21:05.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7fa74da2f700 1 -- 172.21.15.31:0/595352902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa74814f130 msgr2=0x7fa74806d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7fa74da2f700 1 --2- 172.21.15.31:0/595352902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa74814f130 0x7fa74806d880 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa7380098e0 tx=0x7fa7380091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7fa74da2f700 1 -- 172.21.15.31:0/595352902 shutdown_connections 2023-10-09T06:21:05.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7fa74da2f700 1 --2- 172.21.15.31:0/595352902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa74814f130 0x7fa74806d880 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7fa74da2f700 1 --2- 172.21.15.31:0/595352902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa74814ed60 0x7fa7480cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.630+0000 7fa74da2f700 1 -- 172.21.15.31:0/595352902 >> 172.21.15.31:0/595352902 conn(0x7fa748070700 msgr2=0x7fa748070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.627+0000 7f120f882700 1 -- 172.21.15.31:0/3445066862 wait complete. 2023-10-09T06:21:05.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7f120f882700 1 Processor -- start 2023-10-09T06:21:05.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.629+0000 7fc51f5d9700 1 -- 172.21.15.31:0/587667124 wait complete. 2023-10-09T06:21:05.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.631+0000 7fc51f5d9700 1 Processor -- start 2023-10-09T06:21:05.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.631+0000 7fc51f5d9700 1 -- start start 2023-10-09T06:21:05.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.631+0000 7f14db668700 1 Processor -- start 2023-10-09T06:21:05.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.631+0000 7f14db668700 1 -- start start 2023-10-09T06:21:05.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.631+0000 7f120f882700 1 -- start start 2023-10-09T06:21:05.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f120f882700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12080abae0 0x7f120814d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.631+0000 7f178ffff700 1 -- 172.21.15.31:0/3987572806 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820373260 0 0) 0x7f17980b6cc0 con 0x7f17980b5b60 2023-10-09T06:21:05.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.631+0000 7f178ffff700 1 -- 172.21.15.31:0/3987572806 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1784003570 con 0x7f17980b5b60 2023-10-09T06:21:05.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f120f882700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12080abeb0 0x7f12080cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f120f882700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12080c75c0 0x7f12080c0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f120f882700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12080b0370 con 0x7f12080abeb0 2023-10-09T06:21:05.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f120f882700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12080af760 con 0x7f12080c75c0 2023-10-09T06:21:05.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f120f882700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12080afa40 con 0x7f12080abae0 2023-10-09T06:21:05.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7fb744ec5700 1 Processor -- start 2023-10-09T06:21:05.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f3dd37fe700 1 -- 172.21.15.31:0/691427120 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3de4006cc0 con 0x7f3dec06d2e0 2023-10-09T06:21:05.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f179d3a6700 1 -- 172.21.15.31:0/3987572806 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f179815e450 msgr2=0x7f17980afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f179d3a6700 1 --2- 172.21.15.31:0/3987572806 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f179815e450 0x7f17980afd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f179d3a6700 1 -- 172.21.15.31:0/3987572806 >> v1:172.21.15.158:6789/0 conn(0x7f17980b5b60 legacy=0x7f179806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f179d3a6700 1 -- 172.21.15.31:0/3987572806 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17980b5080 con 0x7f179815e080 2023-10-09T06:21:05.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7fb744ec5700 1 -- start start 2023-10-09T06:21:05.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7fa74da2f700 1 -- 172.21.15.31:0/595352902 shutdown_connections 2023-10-09T06:21:05.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7fa74da2f700 1 -- 172.21.15.31:0/595352902 wait complete. 2023-10-09T06:21:05.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f3df1f67700 1 -- 172.21.15.31:0/691427120 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3dcc000fd0 con 0x7f3dec06d2e0 2023-10-09T06:21:05.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f3dd37fe700 1 --2- 172.21.15.31:0/691427120 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3dd8067080 0x7f3dd8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f179d3a6700 1 --2- 172.21.15.31:0/3987572806 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f179815e080 0x7f17980b6630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f17940098e0 tx=0x7f17940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe303b2e283dbdd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f3dd37fe700 1 -- 172.21.15.31:0/691427120 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3de40843f0 con 0x7f3dec06d2e0 2023-10-09T06:21:05.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f120d61e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12080abae0 0x7f120814d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f14db668700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f14c0004810 0x7f14d415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7f14db668700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f14d416f870 0x7f14d40c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f14db668700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14d4068fc0 0x7f14d4069440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f14db668700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40c2f00 con 0x7f14d4068fc0 2023-10-09T06:21:05.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f14db668700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d415d730 con 0x7f14c0004810 2023-10-09T06:21:05.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f14db668700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d4069980 con 0x7f14d416f870 2023-10-09T06:21:05.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f120d61e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12080abae0 0x7f120814d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51350/0 (socket says 172.21.15.31:51350) 2023-10-09T06:21:05.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f120d61e700 1 -- 172.21.15.31:0/2100509819 learned_addr learned my addr 172.21.15.31:0/2100509819 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:05.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f178ffff700 1 -- 172.21.15.31:0/3987572806 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794011630 con 0x7f179815e080 2023-10-09T06:21:05.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f178ffff700 1 -- 172.21.15.31:0/3987572806 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1794011790 con 0x7f179815e080 2023-10-09T06:21:05.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f178ffff700 1 -- 172.21.15.31:0/3987572806 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794011b10 con 0x7f179815e080 2023-10-09T06:21:05.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f14d9404700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f14c0004810 0x7f14d415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f14d8c03700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f14d416f870 0x7f14d40c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f14d9404700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f14c0004810 0x7f14d415d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:52390/0 (socket says 172.21.15.31:52390) 2023-10-09T06:21:05.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f14d9404700 1 -- 172.21.15.31:0/844848091 learned_addr learned my addr 172.21.15.31:0/844848091 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:05.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f3deaffd700 1 --2- 172.21.15.31:0/691427120 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3dd8067080 0x7f3dd8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f3dd37fe700 1 --2- 172.21.15.31:0/691427120 >> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] conn(0x7f3dd806f210 0x7f3dd8071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f3dd37fe700 1 -- 172.21.15.31:0/691427120 --> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3dd8071cd0 con 0x7f3dd806f210 2023-10-09T06:21:05.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f3dd37fe700 1 -- 172.21.15.31:0/691427120 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3de40515c0 con 0x7f3dec06d2e0 2023-10-09T06:21:05.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f120de1f700 1 --2- 172.21.15.31:0/2100509819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12080c75c0 0x7f12080c0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7fc51f5d9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc51806d4c0 0x7fc51815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7fc51f5d9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5180bf970 0x7fc5180c0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7fc51f5d9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5180c9a10 0x7fc5180ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7fc51f5d9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51815c2c0 con 0x7fc5180c9a10 2023-10-09T06:21:05.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7fc51f5d9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5180c0bd0 con 0x7fc5180bf970 2023-10-09T06:21:05.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.632+0000 7fc51f5d9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5180c0eb0 con 0x7fc51806d4c0 2023-10-09T06:21:05.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7fc51d375700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc51806d4c0 0x7fc51815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7fc51d375700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc51806d4c0 0x7fc51815bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51368/0 (socket says 172.21.15.31:51368) 2023-10-09T06:21:05.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7fc51d375700 1 -- 172.21.15.31:0/133654885 learned_addr learned my addr 172.21.15.31:0/133654885 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:05.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7fc51cb74700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5180bf970 0x7fc5180c0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7fb744ec5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb7400ac730 0x7fb7400bc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7fb744ec5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7400bf970 0x7fb7400c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7fb744ec5700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7400cc880 0x7fb74015bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7fb744ec5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400bf130 con 0x7fb7400bf970 2023-10-09T06:21:05.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7fb744ec5700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400be520 con 0x7fb7400cc880 2023-10-09T06:21:05.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7fb744ec5700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400be800 con 0x7fb7400ac730 2023-10-09T06:21:05.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f120d61e700 1 -- 172.21.15.31:0/2100509819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12080c75c0 msgr2=0x7f12080c0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f120d61e700 1 --2- 172.21.15.31:0/2100509819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12080c75c0 0x7f12080c0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f120d61e700 1 -- 172.21.15.31:0/2100509819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12080abeb0 msgr2=0x7f12080cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f120d61e700 1 --2- 172.21.15.31:0/2100509819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12080abeb0 0x7f12080cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f120d61e700 1 -- 172.21.15.31:0/2100509819 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f8009420 con 0x7f12080abae0 2023-10-09T06:21:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7fc51db76700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5180c9a10 0x7fc5180ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7fb73e59c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb7400ac730 0x7fb7400bc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f14d9404700 1 -- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f14d416f870 msgr2=0x7f14d40c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f14d9404700 1 --2- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f14d416f870 0x7f14d40c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f14d9404700 1 -- 172.21.15.31:0/844848091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14d4068fc0 msgr2=0x7f14d4069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f14d9404700 1 --2- 172.21.15.31:0/844848091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14d4068fc0 0x7f14d4069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.633+0000 7f14d9404700 1 -- 172.21.15.31:0/844848091 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d40c3ae0 con 0x7f14c0004810 2023-10-09T06:21:05.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fb73e59c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb7400ac730 0x7fb7400bc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51372/0 (socket says 172.21.15.31:51372) 2023-10-09T06:21:05.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fb73e59c700 1 -- 172.21.15.31:0/1496469834 learned_addr learned my addr 172.21.15.31:0/1496469834 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:05.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7f14d8c03700 1 --2- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f14d416f870 0x7f14d40c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:05.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fc51d375700 1 -- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5180bf970 msgr2=0x7fc5180c0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fc51d375700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5180bf970 0x7fc5180c0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fc51d375700 1 -- 172.21.15.31:0/133654885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5180c9a10 msgr2=0x7fc5180ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fc51d375700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5180c9a10 0x7fc5180ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fc51d375700 1 -- 172.21.15.31:0/133654885 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc510009ae0 con 0x7fc51806d4c0 2023-10-09T06:21:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fb73ed9d700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7400cc880 0x7fb74015bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fb73dd9b700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7400bf970 0x7fb7400c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7f3deaffd700 1 --2- 172.21.15.31:0/691427120 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3dd8067080 0x7f3dd8069530 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0c5820 tx=0x7f3ddc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7f120d61e700 1 --2- 172.21.15.31:0/2100509819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12080abae0 0x7f120814d4f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f120400b600 tx=0x7f12040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7f14d9404700 1 --2- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f14c0004810 0x7f14d415d1f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14d000e510 tx=0x7f14d0009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fc51d375700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc51806d4c0 0x7fc51815bd80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc50800c810 tx=0x7fc508007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7f3debfff700 1 --2- 172.21.15.31:0/691427120 >> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] conn(0x7f3dd806f210 0x7f3dd8071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fb73e59c700 1 -- 172.21.15.31:0/1496469834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7400cc880 msgr2=0x7fb74015bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fb73e59c700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7400cc880 0x7fb74015bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fb73e59c700 1 -- 172.21.15.31:0/1496469834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7400bf970 msgr2=0x7fb7400c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fb73e59c700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7400bf970 0x7fb7400c26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fb73e59c700 1 -- 172.21.15.31:0/1496469834 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb738009a20 con 0x7fb7400ac730 2023-10-09T06:21:05.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fa74da2f700 1 Processor -- start 2023-10-09T06:21:05.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fa74da2f700 1 -- start start 2023-10-09T06:21:05.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fb73e59c700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb7400ac730 0x7fb7400bc380 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb738012560 tx=0x7fb738019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7f11fd7fa700 1 -- 172.21.15.31:0/2100509819 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120400f510 con 0x7f12080abae0 2023-10-09T06:21:05.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7f11fd7fa700 1 -- 172.21.15.31:0/2100509819 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120400f690 con 0x7f12080abae0 2023-10-09T06:21:05.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7f11fd7fa700 1 -- 172.21.15.31:0/2100509819 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120400fa50 con 0x7f12080abae0 2023-10-09T06:21:05.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7fb72e7fc700 1 -- 172.21.15.31:0/1496469834 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738012d00 con 0x7fb7400ac730 2023-10-09T06:21:05.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7fb72e7fc700 1 -- 172.21.15.31:0/1496469834 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb738012e80 con 0x7fb7400ac730 2023-10-09T06:21:05.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7fb744ec5700 1 -- 172.21.15.31:0/1496469834 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7400beae0 con 0x7fb7400ac730 2023-10-09T06:21:05.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7fb72e7fc700 1 -- 172.21.15.31:0/1496469834 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7380276c0 con 0x7fb7400ac730 2023-10-09T06:21:05.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7f179f60a700 1 -- 172.21.15.31:0/3987572806 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f179815e080 msgr2=0x7f17980b6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7f179f60a700 1 --2- 172.21.15.31:0/3987572806 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f179815e080 0x7f17980b6630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f17940098e0 tx=0x7f17940091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fc50d7fa700 1 -- 172.21.15.31:0/133654885 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508007300 con 0x7fc51806d4c0 2023-10-09T06:21:05.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fc50d7fa700 1 -- 172.21.15.31:0/133654885 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc508007480 con 0x7fc51806d4c0 2023-10-09T06:21:05.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.634+0000 7fc50d7fa700 1 -- 172.21.15.31:0/133654885 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508004830 con 0x7fc51806d4c0 2023-10-09T06:21:05.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7fb744ec5700 1 -- 172.21.15.31:0/1496469834 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7400bc8c0 con 0x7fb7400ac730 2023-10-09T06:21:05.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7fa74da2f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7480c9fc0 0x7fa748150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7fa74da2f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa74814ed60 0x7fa74814bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7fa74da2f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa74814f130 0x7fa7480c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7fa74da2f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74814ff40 con 0x7fa7480c9fc0 2023-10-09T06:21:05.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7fa74da2f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7481501e0 con 0x7fa74814f130 2023-10-09T06:21:05.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7fa74da2f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7481504c0 con 0x7fa74814ed60 2023-10-09T06:21:05.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7fc51f5d9700 1 -- 172.21.15.31:0/133654885 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5180c1190 con 0x7fc51806d4c0 2023-10-09T06:21:05.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7fc51f5d9700 1 -- 172.21.15.31:0/133654885 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5180c08c0 con 0x7fc51806d4c0 2023-10-09T06:21:05.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7fa7467fc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa74814ed60 0x7fa74814bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7fa7467fc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa74814ed60 0x7fa74814bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51374/0 (socket says 172.21.15.31:51374) 2023-10-09T06:21:05.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7fa7467fc700 1 -- 172.21.15.31:0/3773093403 learned_addr learned my addr 172.21.15.31:0/3773093403 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:05.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7f3debfff700 1 --2- 172.21.15.31:0/691427120 >> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] conn(0x7f3dd806f210 0x7f3dd8071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7f3dd37fe700 1 -- 172.21.15.31:0/691427120 <== osd.0 v2:172.21.15.31:6800/86352 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f3dd8071cd0 con 0x7f3dd806f210 2023-10-09T06:21:05.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7f14c97fa700 1 -- 172.21.15.31:0/844848091 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0012590 con 0x7f14c0004810 2023-10-09T06:21:05.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7f14c97fa700 1 -- 172.21.15.31:0/844848091 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d0012730 con 0x7f14c0004810 2023-10-09T06:21:05.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7f14c97fa700 1 -- 172.21.15.31:0/844848091 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0012af0 con 0x7f14c0004810 2023-10-09T06:21:05.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7f14db668700 1 -- 172.21.15.31:0/844848091 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d40c2660 con 0x7f14c0004810 2023-10-09T06:21:05.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7f14db668700 1 -- 172.21.15.31:0/844848091 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d40c2c20 con 0x7f14c0004810 2023-10-09T06:21:05.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7f179f60a700 1 -- 172.21.15.31:0/3987572806 shutdown_connections 2023-10-09T06:21:05.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7f179f60a700 1 --2- 172.21.15.31:0/3987572806 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f179815e080 0x7f17980b6630 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7f179f60a700 1 --2- 172.21.15.31:0/3987572806 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f179815e450 0x7f17980afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7f179f60a700 1 -- 172.21.15.31:0/3987572806 >> 172.21.15.31:0/3987572806 conn(0x7f1798068ce0 msgr2=0x7f17980690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7fc51f5d9700 1 -- 172.21.15.31:0/133654885 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc51804c3c0 con 0x7fc51806d4c0 2023-10-09T06:21:05.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.636+0000 7fa746ffd700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7480c9fc0 0x7fa748150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.637+0000 7fa7467fc700 1 -- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa74814f130 msgr2=0x7fa7480c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.637+0000 7fa7467fc700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa74814f130 0x7fa7480c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.637+0000 7fa7467fc700 1 -- 172.21.15.31:0/3773093403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7480c9fc0 msgr2=0x7fa748150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.637+0000 7fa7467fc700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7480c9fc0 0x7fa748150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.637+0000 7fa7467fc700 1 -- 172.21.15.31:0/3773093403 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa738009420 con 0x7fa74814ed60 2023-10-09T06:21:05.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.637+0000 7fa746ffd700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7480c9fc0 0x7fa748150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:05.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7f120f882700 1 -- 172.21.15.31:0/2100509819 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12080afd20 con 0x7f12080abae0 2023-10-09T06:21:05.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.635+0000 7f120f882700 1 -- 172.21.15.31:0/2100509819 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120814da30 con 0x7f12080abae0 2023-10-09T06:21:05.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.637+0000 7f120f882700 1 -- 172.21.15.31:0/2100509819 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12080ab6d0 con 0x7f12080abae0 2023-10-09T06:21:05.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.637+0000 7fa7467fc700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa74814ed60 0x7fa74814bc70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00b600 tx=0x7fa73c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.637+0000 7fb72e7fc700 1 -- 172.21.15.31:0/1496469834 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb738024070 con 0x7fb7400ac730 2023-10-09T06:21:05.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.637+0000 7fb744ec5700 1 -- 172.21.15.31:0/1496469834 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb74004c3c0 con 0x7fb7400ac730 2023-10-09T06:21:05.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.637+0000 7f14db668700 1 -- 172.21.15.31:0/844848091 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14d404c3c0 con 0x7f14c0004810 2023-10-09T06:21:05.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.637+0000 7fb72e7fc700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb720067000 0x7fb7200694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.637+0000 7fb72e7fc700 1 -- 172.21.15.31:0/1496469834 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb738086000 con 0x7fb7400ac730 2023-10-09T06:21:05.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.638+0000 7fb73dd9b700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb720067000 0x7fb7200694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.638+0000 7fb72e7fc700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] conn(0x7fb72006f210 0x7fb720071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.638+0000 7fb72e7fc700 1 -- 172.21.15.31:0/1496469834 --> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb720071cd0 con 0x7fb72006f210 2023-10-09T06:21:05.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.638+0000 7fb72e7fc700 1 -- 172.21.15.31:0/1496469834 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb738086340 con 0x7fb7400ac730 2023-10-09T06:21:05.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.638+0000 7f11fd7fa700 1 -- 172.21.15.31:0/2100509819 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f120401a400 con 0x7f12080abae0 2023-10-09T06:21:05.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.638+0000 7fb73dd9b700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb720067000 0x7fb7200694b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb7400ae9c0 tx=0x7fb730009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.638+0000 7fc50d7fa700 1 -- 172.21.15.31:0/133654885 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc508004ba0 con 0x7fc51806d4c0 2023-10-09T06:21:05.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.638+0000 7fa72effd700 1 -- 172.21.15.31:0/3773093403 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0108a0 con 0x7fa74814ed60 2023-10-09T06:21:05.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.638+0000 7fa72effd700 1 -- 172.21.15.31:0/3773093403 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c010a20 con 0x7fa74814ed60 2023-10-09T06:21:05.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.638+0000 7fa72effd700 1 -- 172.21.15.31:0/3773093403 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c010de0 con 0x7fa74814ed60 2023-10-09T06:21:05.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.638+0000 7f11fd7fa700 1 --2- 172.21.15.31:0/2100509819 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f11ec066f30 0x7f11ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.638+0000 7f11fd7fa700 1 -- 172.21.15.31:0/2100509819 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1204084010 con 0x7f12080abae0 2023-10-09T06:21:05.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7fb73ed9d700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] conn(0x7fb72006f210 0x7fb720071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7f179f60a700 1 -- 172.21.15.31:0/3987572806 shutdown_connections 2023-10-09T06:21:05.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7fa74da2f700 1 -- 172.21.15.31:0/3773093403 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7481507a0 con 0x7fa74814ed60 2023-10-09T06:21:05.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7fa74da2f700 1 -- 172.21.15.31:0/3773093403 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7481514e0 con 0x7fa74814ed60 2023-10-09T06:21:05.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7f11fd7fa700 1 --2- 172.21.15.31:0/2100509819 >> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] conn(0x7f11ec06f140 0x7f11ec071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7f11fd7fa700 1 -- 172.21.15.31:0/2100509819 --> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11ec071c00 con 0x7f11ec06f140 2023-10-09T06:21:05.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7f11fd7fa700 1 -- 172.21.15.31:0/2100509819 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1204086650 con 0x7f12080abae0 2023-10-09T06:21:05.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7f120ce1d700 1 --2- 172.21.15.31:0/2100509819 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f11ec066f30 0x7f11ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7f14c97fa700 1 -- 172.21.15.31:0/844848091 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14d0013420 con 0x7f14c0004810 2023-10-09T06:21:05.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7fc50d7fa700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc4fc067000 0x7fc4fc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7fc50d7fa700 1 -- 172.21.15.31:0/133654885 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5080840f0 con 0x7fc51806d4c0 2023-10-09T06:21:05.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7fc50d7fa700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] conn(0x7fc4fc06f210 0x7fc4fc071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7fc50d7fa700 1 -- 172.21.15.31:0/133654885 --> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4fc071cd0 con 0x7fc4fc06f210 2023-10-09T06:21:05.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7fc50d7fa700 1 -- 172.21.15.31:0/133654885 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc508084510 con 0x7fc51806d4c0 2023-10-09T06:21:05.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7fc51cb74700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc4fc067000 0x7fc4fc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7fc51db76700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] conn(0x7fc4fc06f210 0x7fc4fc071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.639+0000 7fb73ed9d700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] conn(0x7fb72006f210 0x7fb720071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7f120ce1d700 1 --2- 172.21.15.31:0/2100509819 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f11ec066f30 0x7f11ec0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f12080ae500 tx=0x7f11f8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7f14c97fa700 1 --2- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f14b8067080 0x7f14b8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7fc51db76700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] conn(0x7fc4fc06f210 0x7fc4fc071620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7fa74da2f700 1 -- 172.21.15.31:0/3773093403 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa74804c3c0 con 0x7fa74814ed60 2023-10-09T06:21:05.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7f14c97fa700 1 -- 172.21.15.31:0/844848091 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14d0084c50 con 0x7f14c0004810 2023-10-09T06:21:05.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7fc51cb74700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc4fc067000 0x7fc4fc0694b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc5181718b0 tx=0x7fc514009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7f14c97fa700 1 --2- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] conn(0x7f14b806f290 0x7f14b80716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7f14c97fa700 1 -- 172.21.15.31:0/844848091 --> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14b8071d50 con 0x7f14b806f290 2023-10-09T06:21:05.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7f14c97fa700 1 -- 172.21.15.31:0/844848091 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14d0084f80 con 0x7f14c0004810 2023-10-09T06:21:05.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7f179f60a700 1 -- 172.21.15.31:0/3987572806 wait complete. 2023-10-09T06:21:05.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7fb72e7fc700 1 -- 172.21.15.31:0/1496469834 <== osd.1 v2:172.21.15.31:6816/86369 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fb720071cd0 con 0x7fb72006f210 2023-10-09T06:21:05.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7f120de1f700 1 --2- 172.21.15.31:0/2100509819 >> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] conn(0x7f11ec06f140 0x7f11ec071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7f14d8c03700 1 --2- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f14b8067080 0x7f14b8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7f14d9c05700 1 --2- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] conn(0x7f14b806f290 0x7f14b80716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.640+0000 7fc50d7fa700 1 -- 172.21.15.31:0/133654885 <== osd.7 v2:172.21.15.158:6824/86602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fc4fc071cd0 con 0x7fc4fc06f210 2023-10-09T06:21:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.641+0000 7f120de1f700 1 --2- 172.21.15.31:0/2100509819 >> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] conn(0x7f11ec06f140 0x7f11ec071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.641+0000 7f14d9c05700 1 --2- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] conn(0x7f14b806f290 0x7f14b80716a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.641+0000 7f14d8c03700 1 --2- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f14b8067080 0x7f14b8069530 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f14c4009720 tx=0x7f14c401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.641+0000 7f14c97fa700 1 -- 172.21.15.31:0/844848091 <== osd.5 v2:172.21.15.158:6802/86547 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f14b8071d50 con 0x7f14b806f290 2023-10-09T06:21:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.642+0000 7f179f60a700 1 Processor -- start 2023-10-09T06:21:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.642+0000 7f179f60a700 1 -- start start 2023-10-09T06:21:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.642+0000 7fa72effd700 1 -- 172.21.15.31:0/3773093403 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa73c016070 con 0x7fa74814ed60 2023-10-09T06:21:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.642+0000 7f11fd7fa700 1 -- 172.21.15.31:0/2100509819 <== osd.2 v2:172.21.15.31:6819/86376 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f11ec071c00 con 0x7f11ec06f140 2023-10-09T06:21:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.642+0000 7fa72effd700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa734067000 0x7fa7340694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.642+0000 7fa72effd700 1 -- 172.21.15.31:0/3773093403 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa73c087ff0 con 0x7fa74814ed60 2023-10-09T06:21:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7fa746ffd700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa734067000 0x7fa7340694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7fa72effd700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] conn(0x7fa73406f210 0x7fa734071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7fa72effd700 1 -- 172.21.15.31:0/3773093403 --> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa734071cd0 con 0x7fa73406f210 2023-10-09T06:21:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7fa72effd700 1 -- 172.21.15.31:0/3773093403 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa73c088410 con 0x7fa74814ed60 2023-10-09T06:21:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7fa7477fe700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] conn(0x7fa73406f210 0x7fa734071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7fa746ffd700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa734067000 0x7fa7340694b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa740009450 tx=0x7fa7400091d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7f179f60a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17980b5b60 0x7f179814c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7f179f60a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179815e080 0x7f179815cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7f179f60a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f179815e450 0x7f179815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7f179f60a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1798172380 con 0x7f179815e080 2023-10-09T06:21:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7f179f60a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179816f200 con 0x7f17980b5b60 2023-10-09T06:21:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7f179f60a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1798171a50 con 0x7f179815e450 2023-10-09T06:21:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7f179cba5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179815e080 0x7f179815cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7f179d3a6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17980b5b60 0x7f179814c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7f179d3a6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17980b5b60 0x7f179814c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:52434/0 (socket says 172.21.15.31:52434) 2023-10-09T06:21:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.643+0000 7f179d3a6700 1 -- 172.21.15.31:0/1260501521 learned_addr learned my addr 172.21.15.31:0/1260501521 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.644+0000 7f179d3a6700 1 -- 172.21.15.31:0/1260501521 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f179815e450 msgr2=0x7f179815d0a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T06:21:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.644+0000 7f179d3a6700 1 --2- 172.21.15.31:0/1260501521 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f179815e450 0x7f179815d0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.644+0000 7f179d3a6700 1 -- 172.21.15.31:0/1260501521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179815e080 msgr2=0x7f179815cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.644+0000 7f179d3a6700 1 --2- 172.21.15.31:0/1260501521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179815e080 0x7f179815cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.644+0000 7f179d3a6700 1 -- 172.21.15.31:0/1260501521 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1794009420 con 0x7f17980b5b60 2023-10-09T06:21:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.644+0000 7f179cba5700 1 --2- 172.21.15.31:0/1260501521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179815e080 0x7f179815cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.644+0000 7f179d3a6700 1 --2- 172.21.15.31:0/1260501521 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17980b5b60 0x7f179814c190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f17980899e0 tx=0x7f1794017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.645+0000 7fa7477fe700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] conn(0x7fa73406f210 0x7fa734071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.646+0000 7fa72effd700 1 -- 172.21.15.31:0/3773093403 <== osd.4 v2:172.21.15.158:6816/86569 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fa734071cd0 con 0x7fa73406f210 2023-10-09T06:21:05.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.646+0000 7fb8a944d700 1 Processor -- start 2023-10-09T06:21:05.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.646+0000 7fb8a944d700 1 -- start start 2023-10-09T06:21:05.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.647+0000 7fb8a944d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb8a406f1c0 0x7fb8a40b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.647+0000 7fb8a944d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8a4063cf0 0x7fb8a4099530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.647+0000 7fb8a944d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a4064170 con 0x7fb8a40a7b20 2023-10-09T06:21:05.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.647+0000 7fb8a944d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a40990a0 con 0x7fb8a406f1c0 2023-10-09T06:21:05.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.647+0000 7fb8a944d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40984b0 con 0x7fb8a4063cf0 2023-10-09T06:21:05.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.647+0000 7fb8a2ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb8a40a7b20 0x7fb8a406eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60626/0 (socket says 172.21.15.31:60626) 2023-10-09T06:21:05.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.647+0000 7fb8a2ffd700 1 -- 172.21.15.31:0/2570854424 learned_addr learned my addr 172.21.15.31:0/2570854424 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:05.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.647+0000 7fb8a27fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb8a406f1c0 0x7fb8a40b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.648+0000 7fb8a27fc700 1 -- 172.21.15.31:0/2570854424 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8a4063cf0 msgr2=0x7fb8a4099530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.648+0000 7fb8a27fc700 1 --2- 172.21.15.31:0/2570854424 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8a4063cf0 0x7fb8a4099530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.648+0000 7fb8a27fc700 1 -- 172.21.15.31:0/2570854424 >> v1:172.21.15.31:6789/0 conn(0x7fb8a40a7b20 legacy=0x7fb8a406eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.648+0000 7fb8a1ffb700 1 -- 172.21.15.31:0/2570854424 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631712098 0 0) 0x7fb894001110 con 0x7fb8a40a7b20 2023-10-09T06:21:05.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.648+0000 7fb8a27fc700 1 -- 172.21.15.31:0/2570854424 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a4098770 con 0x7fb8a406f1c0 2023-10-09T06:21:05.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.648+0000 7fb8a27fc700 1 --2- 172.21.15.31:0/2570854424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a406f1c0 0x7fb8a40b2ce0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0098e0 tx=0x7fb88c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e300d192897e46d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.648+0000 7fb8a1ffb700 1 -- 172.21.15.31:0/2570854424 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c009e80 con 0x7fb8a406f1c0 2023-10-09T06:21:05.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.648+0000 7fb8a1ffb700 1 -- 172.21.15.31:0/2570854424 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c00b860 con 0x7fb8a406f1c0 2023-10-09T06:21:05.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.648+0000 7fb8a1ffb700 1 -- 172.21.15.31:0/2570854424 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00bc20 con 0x7fb8a406f1c0 2023-10-09T06:21:05.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.649+0000 7f178d7fa700 1 -- 172.21.15.31:0/1260501521 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179401f070 con 0x7f17980b5b60 2023-10-09T06:21:05.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.649+0000 7f178d7fa700 1 -- 172.21.15.31:0/1260501521 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1794000be0 con 0x7f17980b5b60 2023-10-09T06:21:05.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.649+0000 7f178d7fa700 1 -- 172.21.15.31:0/1260501521 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794025420 con 0x7f17980b5b60 2023-10-09T06:21:05.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.649+0000 7fb8a944d700 1 -- 172.21.15.31:0/2570854424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a406f1c0 msgr2=0x7fb8a40b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.649+0000 7fb8a944d700 1 --2- 172.21.15.31:0/2570854424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a406f1c0 0x7fb8a40b2ce0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0098e0 tx=0x7fb88c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.651+0000 7fb8a944d700 1 -- 172.21.15.31:0/2570854424 shutdown_connections 2023-10-09T06:21:05.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.651+0000 7fb8a944d700 1 --2- 172.21.15.31:0/2570854424 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8a4063cf0 0x7fb8a4099530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.651+0000 7fb8a944d700 1 --2- 172.21.15.31:0/2570854424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a406f1c0 0x7fb8a40b2ce0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.651+0000 7fb8a944d700 1 -- 172.21.15.31:0/2570854424 >> 172.21.15.31:0/2570854424 conn(0x7fb8a40cd1e0 msgr2=0x7fb8a40cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.655+0000 7f179f60a700 1 -- 172.21.15.31:0/1260501521 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1798171d30 con 0x7f17980b5b60 2023-10-09T06:21:05.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.656+0000 7f179f60a700 1 -- 172.21.15.31:0/1260501521 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179814c6d0 con 0x7f17980b5b60 2023-10-09T06:21:05.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.658+0000 7f178d7fa700 1 -- 172.21.15.31:0/1260501521 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1794023070 con 0x7f17980b5b60 2023-10-09T06:21:05.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.658+0000 7f178d7fa700 1 --2- 172.21.15.31:0/1260501521 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f177c067000 0x7f177c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.658+0000 7f178d7fa700 1 -- 172.21.15.31:0/1260501521 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1794085630 con 0x7f17980b5b60 2023-10-09T06:21:05.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.659+0000 7f179cba5700 1 --2- 172.21.15.31:0/1260501521 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f177c067000 0x7f177c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.659+0000 7f179cba5700 1 --2- 172.21.15.31:0/1260501521 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f177c067000 0x7f177c0694b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17980d02d0 tx=0x7f179000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.661+0000 7f120f882700 1 -- 172.21.15.31:0/2100509819 --> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f120804c3c0 con 0x7f11ec06f140 2023-10-09T06:21:05.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.661+0000 7f11fd7fa700 1 -- 172.21.15.31:0/2100509819 <== osd.2 v2:172.21.15.31:6819/86376 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f120804c3c0 con 0x7f11ec06f140 2023-10-09T06:21:05.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.662+0000 7f179f60a700 1 --2- 172.21.15.31:0/1260501521 >> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] conn(0x7f17980690b0 0x7f179816e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.662+0000 7f179f60a700 1 -- 172.21.15.31:0/1260501521 --> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17980008d0 con 0x7f17980690b0 2023-10-09T06:21:05.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.662+0000 7fb8a944d700 1 -- 172.21.15.31:0/2570854424 shutdown_connections 2023-10-09T06:21:05.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.662+0000 7f179dba7700 1 --2- 172.21.15.31:0/1260501521 >> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] conn(0x7f17980690b0 0x7f179816e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.662+0000 7f120f882700 1 -- 172.21.15.31:0/2100509819 >> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] conn(0x7f11ec06f140 msgr2=0x7f11ec071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.662+0000 7f120f882700 1 --2- 172.21.15.31:0/2100509819 >> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] conn(0x7f11ec06f140 0x7f11ec071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.662+0000 7f120f882700 1 -- 172.21.15.31:0/2100509819 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f11ec066f30 msgr2=0x7f11ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.662+0000 7f120f882700 1 --2- 172.21.15.31:0/2100509819 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f11ec066f30 0x7f11ec0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f12080ae500 tx=0x7f11f8016000 comp rx=0 tx=0).stop 2023-10-09T06:21:05.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.662+0000 7f120f882700 1 -- 172.21.15.31:0/2100509819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12080abae0 msgr2=0x7f120814d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.662+0000 7f120f882700 1 --2- 172.21.15.31:0/2100509819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12080abae0 0x7f120814d4f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f120400b600 tx=0x7f12040091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.662+0000 7f120de1f700 1 -- 172.21.15.31:0/2100509819 reap_dead start 2023-10-09T06:21:05.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.662+0000 7f179dba7700 1 --2- 172.21.15.31:0/1260501521 >> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] conn(0x7f17980690b0 0x7f179816e4b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.663+0000 7f178d7fa700 1 -- 172.21.15.31:0/1260501521 <== osd.3 v2:172.21.15.31:6808/86353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f17980008d0 con 0x7f17980690b0 2023-10-09T06:21:05.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.664+0000 7fb8a944d700 1 -- 172.21.15.31:0/2570854424 wait complete. 2023-10-09T06:21:05.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.664+0000 7f120f882700 1 -- 172.21.15.31:0/2100509819 shutdown_connections 2023-10-09T06:21:05.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.664+0000 7f120f882700 1 -- 172.21.15.31:0/2100509819 >> 172.21.15.31:0/2100509819 conn(0x7f1208067660 msgr2=0x7f120806d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.665+0000 7fb8a944d700 1 Processor -- start 2023-10-09T06:21:05.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.665+0000 7fb8a944d700 1 -- start start 2023-10-09T06:21:05.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.666+0000 7fa74da2f700 1 -- 172.21.15.31:0/3773093403 --> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa748150600 con 0x7fa73406f210 2023-10-09T06:21:05.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.666+0000 7fb8a944d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8a4063cf0 0x7fb8a40a8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.666+0000 7fb8a944d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a406f1c0 0x7fb8a4158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.666+0000 7fb8a944d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8a40a7b20 0x7fb8a40a9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.666+0000 7fb8a944d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40a9c50 con 0x7fb8a406f1c0 2023-10-09T06:21:05.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.666+0000 7fb8a944d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40a9f30 con 0x7fb8a4063cf0 2023-10-09T06:21:05.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.666+0000 7fb8a944d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40a82f0 con 0x7fb8a40a7b20 2023-10-09T06:21:05.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.666+0000 7fa72effd700 1 -- 172.21.15.31:0/3773093403 <== osd.4 v2:172.21.15.158:6816/86569 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa748150600 con 0x7fa73406f210 2023-10-09T06:21:05.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.666+0000 7fb8a2ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8a4063cf0 0x7fb8a40a8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb8a2ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8a4063cf0 0x7fb8a40a8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:52446/0 (socket says 172.21.15.31:52446) 2023-10-09T06:21:05.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb8a2ffd700 1 -- 172.21.15.31:0/110354936 learned_addr learned my addr 172.21.15.31:0/110354936 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:05.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb8a37fe700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8a40a7b20 0x7fb8a40a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fa74da2f700 1 -- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] conn(0x7fa73406f210 msgr2=0x7fa734071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fa74da2f700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] conn(0x7fa73406f210 0x7fa734071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fa74da2f700 1 -- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa734067000 msgr2=0x7fa7340694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fa74da2f700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa734067000 0x7fa7340694b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa740009450 tx=0x7fa7400091d0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fa74da2f700 1 -- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa74814ed60 msgr2=0x7fa74814bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fa74da2f700 1 --2- 172.21.15.31:0/3773093403 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa74814ed60 0x7fa74814bc70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00b600 tx=0x7fa73c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fa7477fe700 1 -- 172.21.15.31:0/3773093403 reap_dead start 2023-10-09T06:21:05.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb8a2ffd700 1 -- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8a40a7b20 msgr2=0x7fb8a40a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb8a2ffd700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8a40a7b20 0x7fb8a40a9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb8a2ffd700 1 -- 172.21.15.31:0/110354936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a406f1c0 msgr2=0x7fb8a4158b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:21:05.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb8a2ffd700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a406f1c0 0x7fb8a4158b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb8a2ffd700 1 -- 172.21.15.31:0/110354936 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c009420 con 0x7fb8a4063cf0 2023-10-09T06:21:05.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb8a37fe700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8a40a7b20 0x7fb8a40a9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:05.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fa74da2f700 1 -- 172.21.15.31:0/3773093403 shutdown_connections 2023-10-09T06:21:05.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fa74da2f700 1 -- 172.21.15.31:0/3773093403 >> 172.21.15.31:0/3773093403 conn(0x7fa748070700 msgr2=0x7fa74806e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb8a2ffd700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8a4063cf0 0x7fb8a40a8dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb89400c5b0 tx=0x7fb894001070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fa74da2f700 1 -- 172.21.15.31:0/3773093403 shutdown_connections 2023-10-09T06:21:05.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fa74da2f700 1 -- 172.21.15.31:0/3773093403 wait complete. 2023-10-09T06:21:05.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb89affd700 1 -- 172.21.15.31:0/110354936 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894005b30 con 0x7fb8a4063cf0 2023-10-09T06:21:05.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb89affd700 1 -- 172.21.15.31:0/110354936 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb894005c90 con 0x7fb8a4063cf0 2023-10-09T06:21:05.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb89affd700 1 -- 172.21.15.31:0/110354936 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894007300 con 0x7fb8a4063cf0 2023-10-09T06:21:05.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb8a944d700 1 -- 172.21.15.31:0/110354936 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a40a85d0 con 0x7fb8a4063cf0 2023-10-09T06:21:05.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.667+0000 7fb8a944d700 1 -- 172.21.15.31:0/110354936 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a41590d0 con 0x7fb8a4063cf0 2023-10-09T06:21:05.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.668+0000 7fb8a944d700 1 -- 172.21.15.31:0/110354936 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8a40a8150 con 0x7fb8a4063cf0 2023-10-09T06:21:05.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.669+0000 7fb744ec5700 1 -- 172.21.15.31:0/1496469834 --> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb7400ad310 con 0x7fb72006f210 2023-10-09T06:21:05.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.669+0000 7fb72e7fc700 1 -- 172.21.15.31:0/1496469834 <== osd.1 v2:172.21.15.31:6816/86369 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb7400ad310 con 0x7fb72006f210 2023-10-09T06:21:05.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.669+0000 7fb744ec5700 1 -- 172.21.15.31:0/1496469834 >> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] conn(0x7fb72006f210 msgr2=0x7fb720071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.669+0000 7fb744ec5700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] conn(0x7fb72006f210 0x7fb720071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.670+0000 7fb744ec5700 1 -- 172.21.15.31:0/1496469834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb720067000 msgr2=0x7fb7200694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.670+0000 7fb744ec5700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb720067000 0x7fb7200694b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb7400ae9c0 tx=0x7fb730009040 comp rx=0 tx=0).stop 2023-10-09T06:21:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.670+0000 7fb744ec5700 1 -- 172.21.15.31:0/1496469834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb7400ac730 msgr2=0x7fb7400bc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.670+0000 7fb744ec5700 1 --2- 172.21.15.31:0/1496469834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb7400ac730 0x7fb7400bc380 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb738012560 tx=0x7fb738019000 comp rx=0 tx=0).stop 2023-10-09T06:21:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.670+0000 7fb73ed9d700 1 -- 172.21.15.31:0/1496469834 reap_dead start 2023-10-09T06:21:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.670+0000 7fb744ec5700 1 -- 172.21.15.31:0/1496469834 shutdown_connections 2023-10-09T06:21:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.670+0000 7fb744ec5700 1 -- 172.21.15.31:0/1496469834 >> 172.21.15.31:0/1496469834 conn(0x7fb740070700 msgr2=0x7fb74015cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.670+0000 7fb744ec5700 1 -- 172.21.15.31:0/1496469834 shutdown_connections 2023-10-09T06:21:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.670+0000 7fb744ec5700 1 -- 172.21.15.31:0/1496469834 wait complete. 2023-10-09T06:21:05.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.670+0000 7fc51f5d9700 1 -- 172.21.15.31:0/133654885 --> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc5180c0ff0 con 0x7fc4fc06f210 2023-10-09T06:21:05.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.670+0000 7fc50d7fa700 1 -- 172.21.15.31:0/133654885 <== osd.7 v2:172.21.15.158:6824/86602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc5180c0ff0 con 0x7fc4fc06f210 2023-10-09T06:21:05.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.671+0000 7fb89affd700 1 -- 172.21.15.31:0/110354936 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb89401b3b0 con 0x7fb8a4063cf0 2023-10-09T06:21:05.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.671+0000 7fb89affd700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb884066f30 0x7fb8840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.671+0000 7fb89affd700 1 -- 172.21.15.31:0/110354936 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb894083fe0 con 0x7fb8a4063cf0 2023-10-09T06:21:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.671+0000 7fb89affd700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] conn(0x7fb88406f140 0x7fb884071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.671+0000 7fb89affd700 1 -- 172.21.15.31:0/110354936 --> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb884071c00 con 0x7fb88406f140 2023-10-09T06:21:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.671+0000 7fb89affd700 1 -- 172.21.15.31:0/110354936 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8940843b0 con 0x7fb8a4063cf0 2023-10-09T06:21:05.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.671+0000 7fc51f5d9700 1 -- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] conn(0x7fc4fc06f210 msgr2=0x7fc4fc071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.671+0000 7fc51f5d9700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] conn(0x7fc4fc06f210 0x7fc4fc071620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.671+0000 7fb8a37fe700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] conn(0x7fb88406f140 0x7fb884071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7f3df1f67700 1 -- 172.21.15.31:0/691427120 --> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3dcc002d00 con 0x7f3dd806f210 2023-10-09T06:21:05.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7fc51f5d9700 1 -- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc4fc067000 msgr2=0x7fc4fc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7fc51f5d9700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc4fc067000 0x7fc4fc0694b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc5181718b0 tx=0x7fc514009040 comp rx=0 tx=0).stop 2023-10-09T06:21:05.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7fc51f5d9700 1 -- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc51806d4c0 msgr2=0x7fc51815bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7fc51f5d9700 1 --2- 172.21.15.31:0/133654885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc51806d4c0 0x7fc51815bd80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc50800c810 tx=0x7fc508007f30 comp rx=0 tx=0).stop 2023-10-09T06:21:05.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7fc51db76700 1 -- 172.21.15.31:0/133654885 reap_dead start 2023-10-09T06:21:05.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7fc51f5d9700 1 -- 172.21.15.31:0/133654885 shutdown_connections 2023-10-09T06:21:05.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7fc51f5d9700 1 -- 172.21.15.31:0/133654885 >> 172.21.15.31:0/133654885 conn(0x7fc518067660 msgr2=0x7fc5180cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7f14db668700 1 -- 172.21.15.31:0/844848091 --> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14d40c84e0 con 0x7f14b806f290 2023-10-09T06:21:05.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7fb8a37fe700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] conn(0x7fb88406f140 0x7fb884071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7f120f882700 1 -- 172.21.15.31:0/2100509819 shutdown_connections 2023-10-09T06:21:05.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7f120f882700 1 -- 172.21.15.31:0/2100509819 wait complete. 2023-10-09T06:21:05.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7fc51f5d9700 1 -- 172.21.15.31:0/133654885 shutdown_connections 2023-10-09T06:21:05.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7fc51f5d9700 1 -- 172.21.15.31:0/133654885 wait complete. 2023-10-09T06:21:05.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7fb8a27fc700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb884066f30 0x7fb8840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.672+0000 7f14c97fa700 1 -- 172.21.15.31:0/844848091 <== osd.5 v2:172.21.15.158:6802/86547 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f14d40c84e0 con 0x7f14b806f290 2023-10-09T06:21:05.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.673+0000 7fb8a27fc700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb884066f30 0x7fb8840693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0098e0 tx=0x7fb88c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.673+0000 7fb89affd700 1 -- 172.21.15.31:0/110354936 <== osd.6 v2:172.21.15.158:6800/86548 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fb884071c00 con 0x7fb88406f140 2023-10-09T06:21:05.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.673+0000 7f3dd37fe700 1 -- 172.21.15.31:0/691427120 <== osd.0 v2:172.21.15.31:6800/86352 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3dcc002d00 con 0x7f3dd806f210 2023-10-09T06:21:05.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.673+0000 7f14db668700 1 -- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] conn(0x7f14b806f290 msgr2=0x7f14b80716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.673+0000 7f14db668700 1 --2- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] conn(0x7f14b806f290 0x7f14b80716a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.673+0000 7f14db668700 1 -- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f14b8067080 msgr2=0x7f14b8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.673+0000 7f14db668700 1 --2- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f14b8067080 0x7f14b8069530 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f14c4009720 tx=0x7f14c401a000 comp rx=0 tx=0).stop 2023-10-09T06:21:05.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.673+0000 7f14db668700 1 -- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f14c0004810 msgr2=0x7f14d415d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.673+0000 7f14db668700 1 --2- 172.21.15.31:0/844848091 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f14c0004810 0x7f14d415d1f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14d000e510 tx=0x7f14d0009040 comp rx=0 tx=0).stop 2023-10-09T06:21:05.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.673+0000 7f14d9c05700 1 -- 172.21.15.31:0/844848091 reap_dead start 2023-10-09T06:21:05.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.673+0000 7f3df1f67700 1 -- 172.21.15.31:0/691427120 >> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] conn(0x7f3dd806f210 msgr2=0x7f3dd8071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.673+0000 7f3df1f67700 1 --2- 172.21.15.31:0/691427120 >> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] conn(0x7f3dd806f210 0x7f3dd8071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.674+0000 7f3df1f67700 1 -- 172.21.15.31:0/691427120 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3dd8067080 msgr2=0x7f3dd8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.674+0000 7f3df1f67700 1 --2- 172.21.15.31:0/691427120 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3dd8067080 0x7f3dd8069530 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0c5820 tx=0x7f3ddc017000 comp rx=0 tx=0).stop 2023-10-09T06:21:05.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.674+0000 7f3df1f67700 1 -- 172.21.15.31:0/691427120 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06d2e0 msgr2=0x7f3dec0c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.674+0000 7f3df1f67700 1 --2- 172.21.15.31:0/691427120 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06d2e0 0x7f3dec0c5c20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3de4001a10 tx=0x7f3de4005fa0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.674+0000 7f14db668700 1 -- 172.21.15.31:0/844848091 shutdown_connections 2023-10-09T06:21:05.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.674+0000 7f14db668700 1 -- 172.21.15.31:0/844848091 >> 172.21.15.31:0/844848091 conn(0x7f14d4067660 msgr2=0x7f14d40c8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.674+0000 7f3debfff700 1 -- 172.21.15.31:0/691427120 reap_dead start 2023-10-09T06:21:05.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.674+0000 7f3df1f67700 1 -- 172.21.15.31:0/691427120 shutdown_connections 2023-10-09T06:21:05.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.674+0000 7f3df1f67700 1 -- 172.21.15.31:0/691427120 >> 172.21.15.31:0/691427120 conn(0x7f3dec070700 msgr2=0x7f3dec15ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.674+0000 7f14db668700 1 -- 172.21.15.31:0/844848091 shutdown_connections 2023-10-09T06:21:05.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.674+0000 7f14db668700 1 -- 172.21.15.31:0/844848091 wait complete. 2023-10-09T06:21:05.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.677+0000 7f3df1f67700 1 -- 172.21.15.31:0/691427120 shutdown_connections 2023-10-09T06:21:05.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.681+0000 7f3df1f67700 1 -- 172.21.15.31:0/691427120 wait complete. 2023-10-09T06:21:05.745 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:05.745 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-09T06:21:05.746 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:05.746 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-09T06:21:05.747 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:05.748 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-09T06:21:05.748 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:05.749 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-09T06:21:05.749 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:05.750 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-09T06:21:05.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.700+0000 7f179f60a700 1 -- 172.21.15.31:0/1260501521 --> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f179816e9f0 con 0x7f17980690b0 2023-10-09T06:21:05.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.700+0000 7f178d7fa700 1 -- 172.21.15.31:0/1260501521 <== osd.3 v2:172.21.15.31:6808/86353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f179816e9f0 con 0x7f17980690b0 2023-10-09T06:21:05.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.701+0000 7fb8a944d700 1 -- 172.21.15.31:0/110354936 --> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb8a4064170 con 0x7fb88406f140 2023-10-09T06:21:05.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.701+0000 7f179f60a700 1 -- 172.21.15.31:0/1260501521 >> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] conn(0x7f17980690b0 msgr2=0x7f179816e4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.701+0000 7f179f60a700 1 --2- 172.21.15.31:0/1260501521 >> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] conn(0x7f17980690b0 0x7f179816e4b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.701+0000 7f179f60a700 1 -- 172.21.15.31:0/1260501521 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f177c067000 msgr2=0x7f177c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.701+0000 7f179f60a700 1 --2- 172.21.15.31:0/1260501521 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f177c067000 0x7f177c0694b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17980d02d0 tx=0x7f179000b040 comp rx=0 tx=0).stop 2023-10-09T06:21:05.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.701+0000 7f179f60a700 1 -- 172.21.15.31:0/1260501521 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17980b5b60 msgr2=0x7f179814c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.701+0000 7f179f60a700 1 --2- 172.21.15.31:0/1260501521 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17980b5b60 0x7f179814c190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f17980899e0 tx=0x7f1794017000 comp rx=0 tx=0).stop 2023-10-09T06:21:05.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.701+0000 7f179dba7700 1 -- 172.21.15.31:0/1260501521 reap_dead start 2023-10-09T06:21:05.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.701+0000 7f179f60a700 1 -- 172.21.15.31:0/1260501521 shutdown_connections 2023-10-09T06:21:05.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.701+0000 7f179f60a700 1 -- 172.21.15.31:0/1260501521 >> 172.21.15.31:0/1260501521 conn(0x7f1798068ce0 msgr2=0x7f17980b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.701+0000 7f179f60a700 1 -- 172.21.15.31:0/1260501521 shutdown_connections 2023-10-09T06:21:05.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.701+0000 7f179f60a700 1 -- 172.21.15.31:0/1260501521 wait complete. 2023-10-09T06:21:05.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.701+0000 7fb89affd700 1 -- 172.21.15.31:0/110354936 <== osd.6 v2:172.21.15.158:6800/86548 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb8a4064170 con 0x7fb88406f140 2023-10-09T06:21:05.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.702+0000 7fb8a944d700 1 -- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] conn(0x7fb88406f140 msgr2=0x7fb884071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.702+0000 7fb8a944d700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] conn(0x7fb88406f140 0x7fb884071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.702+0000 7fb8a944d700 1 -- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb884066f30 msgr2=0x7fb8840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.702+0000 7fb8a944d700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb884066f30 0x7fb8840693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0098e0 tx=0x7fb88c017000 comp rx=0 tx=0).stop 2023-10-09T06:21:05.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.702+0000 7fb8a944d700 1 -- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8a4063cf0 msgr2=0x7fb8a40a8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.702+0000 7fb8a944d700 1 --2- 172.21.15.31:0/110354936 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8a4063cf0 0x7fb8a40a8dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb89400c5b0 tx=0x7fb894001070 comp rx=0 tx=0).stop 2023-10-09T06:21:05.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.702+0000 7fb8a37fe700 1 -- 172.21.15.31:0/110354936 reap_dead start 2023-10-09T06:21:05.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.702+0000 7fb8a944d700 1 -- 172.21.15.31:0/110354936 shutdown_connections 2023-10-09T06:21:05.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.702+0000 7fb8a944d700 1 -- 172.21.15.31:0/110354936 >> 172.21.15.31:0/110354936 conn(0x7fb8a40cd1e0 msgr2=0x7fb8a406e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.702+0000 7fb8a944d700 1 -- 172.21.15.31:0/110354936 shutdown_connections 2023-10-09T06:21:05.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.702+0000 7fb8a944d700 1 -- 172.21.15.31:0/110354936 wait complete. 2023-10-09T06:21:05.756 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:05.756 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-09T06:21:05.757 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:05.758 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-09T06:21:05.758 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:05.759 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-09T06:21:05.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.985+0000 7efee1f5c700 1 Processor -- start 2023-10-09T06:21:05.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.985+0000 7efee1f5c700 1 -- start start 2023-10-09T06:21:05.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.986+0000 7efee1f5c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efedc156410 0x7efedc157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.986+0000 7efee1f5c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efedc06d9b0 0x7efedc0c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.986+0000 7efee1f5c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efedc0c97d0 0x7efedc0c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.986+0000 7efee1f5c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efedc0c9c30 con 0x7efedc06d9b0 2023-10-09T06:21:05.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.986+0000 7efee1f5c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efedc0c6eb0 con 0x7efedc0c97d0 2023-10-09T06:21:05.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.986+0000 7efee1f5c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efedc0c7100 con 0x7efedc156410 2023-10-09T06:21:05.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.987+0000 7efedb7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efedc156410 0x7efedc157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.987+0000 7efedb7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efedc156410 0x7efedc157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51428/0 (socket says 172.21.15.31:51428) 2023-10-09T06:21:05.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.987+0000 7efedb7fe700 1 -- 172.21.15.31:0/1115528108 learned_addr learned my addr 172.21.15.31:0/1115528108 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:05.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.987+0000 7efedb7fe700 1 -- 172.21.15.31:0/1115528108 >> v2:172.21.15.158:3300/0 conn(0x7efedc0c97d0 msgr2=0x7efedc0c81a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T06:21:05.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.987+0000 7efedb7fe700 1 --2- 172.21.15.31:0/1115528108 >> v2:172.21.15.158:3300/0 conn(0x7efedc0c97d0 0x7efedc0c81a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.987+0000 7efedb7fe700 1 -- 172.21.15.31:0/1115528108 >> v2:172.21.15.31:3300/0 conn(0x7efedc06d9b0 msgr2=0x7efedc0c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.987+0000 7efedb7fe700 1 --2- 172.21.15.31:0/1115528108 >> v2:172.21.15.31:3300/0 conn(0x7efedc06d9b0 0x7efedc0c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.987+0000 7efedb7fe700 1 -- 172.21.15.31:0/1115528108 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc0c73e0 con 0x7efedc156410 2023-10-09T06:21:05.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.987+0000 7efedb7fe700 1 --2- 172.21.15.31:0/1115528108 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efedc156410 0x7efedc157cc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efedc06a450 tx=0x7efed400ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=733fb93fec390af6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:05.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.988+0000 7efeda7fc700 1 -- 172.21.15.31:0/1115528108 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4010070 con 0x7efedc156410 2023-10-09T06:21:05.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.988+0000 7efeda7fc700 1 -- 172.21.15.31:0/1115528108 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed400dc80 con 0x7efedc156410 2023-10-09T06:21:05.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.988+0000 7efeda7fc700 1 -- 172.21.15.31:0/1115528108 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4016400 con 0x7efedc156410 2023-10-09T06:21:05.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.989+0000 7efee1f5c700 1 -- 172.21.15.31:0/1115528108 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efedc156410 msgr2=0x7efedc157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.989+0000 7efee1f5c700 1 --2- 172.21.15.31:0/1115528108 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efedc156410 0x7efedc157cc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efedc06a450 tx=0x7efed400ba50 comp rx=0 tx=0).stop 2023-10-09T06:21:05.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.990+0000 7efee1f5c700 1 -- 172.21.15.31:0/1115528108 shutdown_connections 2023-10-09T06:21:05.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.990+0000 7efee1f5c700 1 --2- 172.21.15.31:0/1115528108 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efedc156410 0x7efedc157cc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.990+0000 7efee1f5c700 1 --2- 172.21.15.31:0/1115528108 >> v2:172.21.15.158:3300/0 conn(0x7efedc0c97d0 0x7efedc0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.990+0000 7efee1f5c700 1 --2- 172.21.15.31:0/1115528108 >> v2:172.21.15.31:3300/0 conn(0x7efedc06d9b0 0x7efedc0c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.990+0000 7efee1f5c700 1 -- 172.21.15.31:0/1115528108 >> 172.21.15.31:0/1115528108 conn(0x7efedc070700 msgr2=0x7efedc070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:05.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.990+0000 7f6e34729700 1 Processor -- start 2023-10-09T06:21:05.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.990+0000 7f6e34729700 1 -- start start 2023-10-09T06:21:05.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.991+0000 7fa386218700 1 Processor -- start 2023-10-09T06:21:05.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.991+0000 7fa386218700 1 -- start start 2023-10-09T06:21:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.991+0000 7f6e34729700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e2c0af4c0 0x7f6e2c0a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.991+0000 7f6e34729700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c0b0790 con 0x7f6e2c0c9320 2023-10-09T06:21:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.991+0000 7f6e34729700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c0a7b10 con 0x7f6e2c0b0c20 2023-10-09T06:21:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.991+0000 7f6e34729700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0a7df0 con 0x7f6e2c0af4c0 2023-10-09T06:21:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e324c5700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6e2c0c9320 0x7f6e2c15c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60640/0 (socket says 172.21.15.31:60640) 2023-10-09T06:21:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e324c5700 1 -- 172.21.15.31:0/2957057281 learned_addr learned my addr 172.21.15.31:0/2957057281 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e32cc6700 1 --2- 172.21.15.31:0/2957057281 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e2c0af4c0 0x7f6e2c0a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823486339 0 0) 0x7f6e2c0b0790 con 0x7f6e2c0c9320 2023-10-09T06:21:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e18003570 con 0x7f6e2c0c9320 2023-10-09T06:21:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440168503 0 0) 0x7f6e2c0a7b10 con 0x7f6e2c0b0c20 2023-10-09T06:21:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e2c0b0790 con 0x7f6e2c0b0c20 2023-10-09T06:21:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7fa386218700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3800b0f30 0x7fa3800cc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7fa386218700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa38015aea0 0x7fa380067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7fa386218700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3800cb8b0 con 0x7fa3800b1300 2023-10-09T06:21:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7fa386218700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa380068f80 con 0x7fa38015aea0 2023-10-09T06:21:05.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7fa386218700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa380069260 con 0x7fa3800b0f30 2023-10-09T06:21:05.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2600065714 0 0) 0x7f6e2c0b0790 con 0x7f6e2c0b0c20 2023-10-09T06:21:05.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e2c0af4c0 msgr2=0x7f6e2c0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 --2- 172.21.15.31:0/2957057281 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e2c0af4c0 0x7f6e2c0a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 >> v1:172.21.15.31:6789/0 conn(0x7f6e2c0c9320 legacy=0x7f6e2c15c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c0aebc0 con 0x7f6e2c0b0c20 2023-10-09T06:21:05.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f6e28001470 con 0x7f6e2c0b0c20 2023-10-09T06:21:05.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 >> v1:172.21.15.158:6789/0 conn(0x7f6e2c0b0c20 legacy=0x7f6e2c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 --2- 172.21.15.31:0/2957057281 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e18004c80 0x7f6e18005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 --2- 172.21.15.31:0/2957057281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e180037b0 0x7f6e18003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7f6e314c3700 1 --2- 172.21.15.31:0/2957057281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e18004160 0x7f6e1800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:05.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c001230 con 0x7f6e180037b0 2023-10-09T06:21:05.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1800c000 con 0x7f6e18004160 2023-10-09T06:21:05.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1800c1c0 con 0x7f6e18004c80 2023-10-09T06:21:05.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7f6e324c5700 1 --2- 172.21.15.31:0/2957057281 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e18004c80 0x7f6e18005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7fa37ffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa38015aea0 0x7fa380067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.992+0000 7fa37effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa3800b1300 0x7fa3800cbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60654/0 (socket says 172.21.15.31:60654) 2023-10-09T06:21:05.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7fa37effd700 1 -- 172.21.15.31:0/2707772233 learned_addr learned my addr 172.21.15.31:0/2707772233 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:05.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7fa37e7fc700 1 -- 172.21.15.31:0/2707772233 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666968048 0 0) 0x7fa3800cb8b0 con 0x7fa3800b1300 2023-10-09T06:21:05.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7fa37e7fc700 1 -- 172.21.15.31:0/2707772233 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa368003570 con 0x7fa3800b1300 2023-10-09T06:21:05.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7f6e32cc6700 1 --2- 172.21.15.31:0/2957057281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e18004160 0x7f6e1800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7f6e31cc4700 1 --2- 172.21.15.31:0/2957057281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e180037b0 0x7f6e18003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7f6e324c5700 1 -- 172.21.15.31:0/2957057281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e18004160 msgr2=0x7f6e1800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7f6e324c5700 1 --2- 172.21.15.31:0/2957057281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e18004160 0x7f6e1800ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7f6e324c5700 1 -- 172.21.15.31:0/2957057281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e180037b0 msgr2=0x7f6e18003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7f6e324c5700 1 --2- 172.21.15.31:0/2957057281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e180037b0 0x7f6e18003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7f6e324c5700 1 -- 172.21.15.31:0/2957057281 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c0b0790 con 0x7f6e18004c80 2023-10-09T06:21:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7fa37f7fe700 1 --2- 172.21.15.31:0/2707772233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3800b0f30 0x7fa3800cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:05.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7fe600684700 1 Processor -- start 2023-10-09T06:21:05.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7fa37ffff700 1 -- 172.21.15.31:0/2707772233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3800b0f30 msgr2=0x7fa3800cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:05.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7fa37ffff700 1 --2- 172.21.15.31:0/2707772233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3800b0f30 0x7fa3800cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:05.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7fa37ffff700 1 -- 172.21.15.31:0/2707772233 >> v1:172.21.15.31:6789/0 conn(0x7fa3800b1300 legacy=0x7fa3800cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:05.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7fa37ffff700 1 -- 172.21.15.31:0/2707772233 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa380069540 con 0x7fa38015aea0 2023-10-09T06:21:05.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7f6e324c5700 1 --2- 172.21.15.31:0/2957057281 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e18004c80 0x7f6e18005050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c007fd0 tx=0x7f6e1c001d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5f01c42d5e0ea1f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7fa37f7fe700 1 --2- 172.21.15.31:0/2707772233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3800b0f30 0x7fa3800cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:06.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7fa37ffff700 1 --2- 172.21.15.31:0/2707772233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa38015aea0 0x7fa380067660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa378009e60 tx=0x7fa378009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84f333f8e1e7833f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c007a10 con 0x7f6e18004c80 2023-10-09T06:21:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c00caf0 con 0x7f6e18004c80 2023-10-09T06:21:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7f6e314c3700 1 -- 172.21.15.31:0/2957057281 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0048f0 con 0x7f6e18004c80 2023-10-09T06:21:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7fa37e7fc700 1 -- 172.21.15.31:0/2707772233 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37800e070 con 0x7fa38015aea0 2023-10-09T06:21:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7fa37e7fc700 1 -- 172.21.15.31:0/2707772233 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37800bb60 con 0x7fa38015aea0 2023-10-09T06:21:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7fa37e7fc700 1 -- 172.21.15.31:0/2707772233 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa378012430 con 0x7fa38015aea0 2023-10-09T06:21:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7fa386218700 1 -- 172.21.15.31:0/2707772233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa38015aea0 msgr2=0x7fa380067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7fa386218700 1 --2- 172.21.15.31:0/2707772233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa38015aea0 0x7fa380067660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa378009e60 tx=0x7fa378009780 comp rx=0 tx=0).stop 2023-10-09T06:21:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7fa386218700 1 -- 172.21.15.31:0/2707772233 shutdown_connections 2023-10-09T06:21:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7fa386218700 1 --2- 172.21.15.31:0/2707772233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa38015aea0 0x7fa380067660 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7fa386218700 1 --2- 172.21.15.31:0/2707772233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3800b0f30 0x7fa3800cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7fa386218700 1 -- 172.21.15.31:0/2707772233 >> 172.21.15.31:0/2707772233 conn(0x7fa38006fdc0 msgr2=0x7fa38006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7f6e34729700 1 -- 172.21.15.31:0/2957057281 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e18004c80 msgr2=0x7f6e18005050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.994+0000 7f6e34729700 1 --2- 172.21.15.31:0/2957057281 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e18004c80 0x7f6e18005050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c007fd0 tx=0x7f6e1c001d20 comp rx=0 tx=0).stop 2023-10-09T06:21:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7f6e32cc6700 1 -- 172.21.15.31:0/2957057281 reap_dead start 2023-10-09T06:21:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7f6e34729700 1 -- 172.21.15.31:0/2957057281 shutdown_connections 2023-10-09T06:21:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7f6e34729700 1 -- 172.21.15.31:0/2957057281 >> 172.21.15.31:0/2957057281 conn(0x7f6e2c0cd1e0 msgr2=0x7f6e2c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.993+0000 7fe600684700 1 -- start start 2023-10-09T06:21:06.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7fa386218700 1 -- 172.21.15.31:0/2707772233 shutdown_connections 2023-10-09T06:21:06.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7fe600684700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe5f80c87a0 0x7fe5f8161a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7fe600684700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f8067ba0 con 0x7fe5f81568d0 2023-10-09T06:21:06.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7fe600684700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f8067870 con 0x7fe5f806a530 2023-10-09T06:21:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7fe600684700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f815aa90 con 0x7fe5f80c87a0 2023-10-09T06:21:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7fe5fec21700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe5f80c87a0 0x7fe5f8161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7fe5fec21700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe5f80c87a0 0x7fe5f8161a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:52486/0 (socket says 172.21.15.31:52486) 2023-10-09T06:21:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7fe5fec21700 1 -- 172.21.15.31:0/2905441657 learned_addr learned my addr 172.21.15.31:0/2905441657 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7efee1f5c700 1 -- 172.21.15.31:0/1115528108 shutdown_connections 2023-10-09T06:21:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7efee1f5c700 1 -- 172.21.15.31:0/1115528108 wait complete. 2023-10-09T06:21:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7fe5fec21700 1 -- 172.21.15.31:0/2905441657 >> v1:172.21.15.158:6789/0 conn(0x7fe5f806a530 legacy=0x7fe5f80c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7fe5fec21700 1 -- 172.21.15.31:0/2905441657 >> v1:172.21.15.31:6789/0 conn(0x7fe5f81568d0 legacy=0x7fe5f8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7fe5fec21700 1 -- 172.21.15.31:0/2905441657 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f80c8ca0 con 0x7fe5f80c87a0 2023-10-09T06:21:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7f6e34729700 1 -- 172.21.15.31:0/2957057281 shutdown_connections 2023-10-09T06:21:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7fa386218700 1 -- 172.21.15.31:0/2707772233 wait complete. 2023-10-09T06:21:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.995+0000 7fe5fec21700 1 --2- 172.21.15.31:0/2905441657 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5f80c87a0 0x7fe5f8161a80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009f20 tx=0x7fe5f0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0a5d2e3eadd6ae3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.996+0000 7fe5fd41e700 1 -- 172.21.15.31:0/2905441657 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f000e070 con 0x7fe5f80c87a0 2023-10-09T06:21:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.996+0000 7fe5fd41e700 1 -- 172.21.15.31:0/2905441657 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f000ba40 con 0x7fe5f80c87a0 2023-10-09T06:21:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.996+0000 7fe5fd41e700 1 -- 172.21.15.31:0/2905441657 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f00092e0 con 0x7fe5f80c87a0 2023-10-09T06:21:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.997+0000 7fa386218700 1 Processor -- start 2023-10-09T06:21:06.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.997+0000 7efee1f5c700 1 Processor -- start 2023-10-09T06:21:06.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.996+0000 7f6e34729700 1 -- 172.21.15.31:0/2957057281 wait complete. 2023-10-09T06:21:06.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.997+0000 7f6e34729700 1 Processor -- start 2023-10-09T06:21:06.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.997+0000 7fe600684700 1 -- 172.21.15.31:0/2905441657 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5f80c87a0 msgr2=0x7fe5f8161a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.997+0000 7fe600684700 1 --2- 172.21.15.31:0/2905441657 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5f80c87a0 0x7fe5f8161a80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009f20 tx=0x7fe5f0009840 comp rx=0 tx=0).stop 2023-10-09T06:21:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.997+0000 7fe600684700 1 -- 172.21.15.31:0/2905441657 shutdown_connections 2023-10-09T06:21:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.997+0000 7fe600684700 1 --2- 172.21.15.31:0/2905441657 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5f80c87a0 0x7fe5f8161a80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.997+0000 7fe600684700 1 -- 172.21.15.31:0/2905441657 >> 172.21.15.31:0/2905441657 conn(0x7fe5f80cda50 msgr2=0x7fe5f80cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.997+0000 7f6e34729700 1 -- start start 2023-10-09T06:21:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.997+0000 7fa386218700 1 -- start start 2023-10-09T06:21:06.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7f493632e700 1 Processor -- start 2023-10-09T06:21:06.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.997+0000 7efee1f5c700 1 -- start start 2023-10-09T06:21:06.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7f86d0a79700 1 Processor -- start 2023-10-09T06:21:06.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7f493632e700 1 -- start start 2023-10-09T06:21:06.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7fa386218700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3800b0f30 0x7fa380158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7f9787fff700 1 Processor -- start 2023-10-09T06:21:06.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7fa386218700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3800b1300 0x7fa38015dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7fa386218700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa38015aea0 0x7fa38016ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7fa386218700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800c87f0 con 0x7fa3800b1300 2023-10-09T06:21:06.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7fa386218700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38016f120 con 0x7fa3800b0f30 2023-10-09T06:21:06.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7fa386218700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38015e2e0 con 0x7fa38015aea0 2023-10-09T06:21:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7f6e34729700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e18004c80 0x7f6e2c154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7f6e34729700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e2c1585c0 0x7f6e2c158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7f6e34729700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e2c098d40 0x7f6e2c099170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7f6e34729700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c158f70 con 0x7f6e2c1585c0 2023-10-09T06:21:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7f6e34729700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c155540 con 0x7f6e2c098d40 2023-10-09T06:21:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7f6e34729700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c099a70 con 0x7f6e18004c80 2023-10-09T06:21:06.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7fa37ffff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa38015aea0 0x7fa38016ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7f86d0a79700 1 -- start start 2023-10-09T06:21:06.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.998+0000 7fa37f7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3800b0f30 0x7fa380158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7fa37f7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3800b0f30 0x7fa380158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:52492/0 (socket says 172.21.15.31:52492) 2023-10-09T06:21:06.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7fa37f7fe700 1 -- 172.21.15.31:0/1694618478 learned_addr learned my addr 172.21.15.31:0/1694618478 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:06.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f9787fff700 1 -- start start 2023-10-09T06:21:06.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f6e324c5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e18004c80 0x7f6e2c154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f6e324c5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e18004c80 0x7f6e2c154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51470/0 (socket says 172.21.15.31:51470) 2023-10-09T06:21:06.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f6e324c5700 1 -- 172.21.15.31:0/2775317548 learned_addr learned my addr 172.21.15.31:0/2775317548 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:06.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efee1f5c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efedc06d9b0 0x7efedc171b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efee1f5c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efedc0c97d0 0x7efedc152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efee1f5c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efedc156410 0x7efedc0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efee1f5c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc0ad180 con 0x7efedc06d9b0 2023-10-09T06:21:06.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efee1f5c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc1723a0 con 0x7efedc0c97d0 2023-10-09T06:21:06.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efee1f5c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efedc172680 con 0x7efedc156410 2023-10-09T06:21:06.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f6e32cc6700 1 --2- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e2c098d40 0x7f6e2c099170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7fa37f7fe700 1 -- 172.21.15.31:0/1694618478 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa38015aea0 msgr2=0x7fa38016ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7fa37f7fe700 1 --2- 172.21.15.31:0/1694618478 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa38015aea0 0x7fa38016ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7fa37f7fe700 1 -- 172.21.15.31:0/1694618478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3800b1300 msgr2=0x7fa38015dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7fa37f7fe700 1 --2- 172.21.15.31:0/1694618478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3800b1300 0x7fa38015dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efedaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efedc0c97d0 0x7efedc152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efedaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efedc0c97d0 0x7efedc152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:52510/0 (socket says 172.21.15.31:52510) 2023-10-09T06:21:06.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efedaffd700 1 -- 172.21.15.31:0/4095042156 learned_addr learned my addr 172.21.15.31:0/4095042156 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:06.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7fa37f7fe700 1 -- 172.21.15.31:0/1694618478 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa378009a20 con 0x7fa3800b0f30 2023-10-09T06:21:06.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f493632e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f493006d2e0 0x7f49300c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efedbfff700 1 --2- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efedc156410 0x7efedc0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f6e324c5700 1 -- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e2c098d40 msgr2=0x7f6e2c099170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f6e324c5700 1 --2- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e2c098d40 0x7f6e2c099170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f6e324c5700 1 -- 172.21.15.31:0/2775317548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e2c1585c0 msgr2=0x7f6e2c158a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:21:06.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f6e324c5700 1 --2- 172.21.15.31:0/2775317548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e2c1585c0 0x7f6e2c158a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f6e324c5700 1 -- 172.21.15.31:0/2775317548 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c099d50 con 0x7f6e18004c80 2023-10-09T06:21:06.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f493632e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49300c8760 con 0x7f4930156270 2023-10-09T06:21:06.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f493632e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49300af6e0 con 0x7f493006d6b0 2023-10-09T06:21:06.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f493632e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49300c7b50 con 0x7f493006d2e0 2023-10-09T06:21:06.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f492ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f493006d2e0 0x7f49300c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f492ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f493006d2e0 0x7f49300c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58274/0 (socket says 172.21.15.31:58274) 2023-10-09T06:21:06.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f492ffff700 1 -- 172.21.15.31:0/1938576048 learned_addr learned my addr 172.21.15.31:0/1938576048 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:06.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7f492f7fe700 1 --1- 172.21.15.31:0/1938576048 >> v1:172.21.15.158:6789/0 conn(0x7f493006d6b0 0x7f4930155b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:45358/0 (socket says 172.21.15.31:45358) 2023-10-09T06:21:06.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efedaffd700 1 -- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efedc156410 msgr2=0x7efedc0c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efedaffd700 1 --2- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efedc156410 0x7efedc0c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efedaffd700 1 -- 172.21.15.31:0/4095042156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efedc06d9b0 msgr2=0x7efedc171b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:21:06.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f6e324c5700 1 --2- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e18004c80 0x7f6e2c154550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e18014b60 tx=0x7f6e1c015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:05.999+0000 7efedaffd700 1 --2- 172.21.15.31:0/4095042156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efedc06d9b0 0x7efedc171b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7efedaffd700 1 -- 172.21.15.31:0/4095042156 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed400bcf0 con 0x7efedc0c97d0 2023-10-09T06:21:06.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f86d0a79700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86cc0cc450 0x7f86cc155b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f86d0a79700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86cc0c75c0 0x7f86cc1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f86d0a79700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86cc1565e0 con 0x7f86cc06d2e0 2023-10-09T06:21:06.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f86d0a79700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86cc0c8760 con 0x7f86cc0cc450 2023-10-09T06:21:06.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f86d0a79700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc0af6e0 con 0x7f86cc0c75c0 2023-10-09T06:21:06.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7fa37f7fe700 1 --2- 172.21.15.31:0/1694618478 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3800b0f30 0x7fa380158840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa37400c850 tx=0x7fa374008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f492ffff700 1 -- 172.21.15.31:0/1938576048 >> v1:172.21.15.158:6789/0 conn(0x7f493006d6b0 legacy=0x7f4930155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f492ffff700 1 -- 172.21.15.31:0/1938576048 >> v1:172.21.15.31:6789/0 conn(0x7f4930156270 legacy=0x7f49300c8bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:21:06.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f492ffff700 1 -- 172.21.15.31:0/1938576048 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49300c7e30 con 0x7f493006d2e0 2023-10-09T06:21:06.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7efedaffd700 1 --2- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efedc0c97d0 0x7efedc152d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efed000b810 tx=0x7efed0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f86cad9d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86cc0c75c0 0x7f86cc1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f86cad9d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86cc0c75c0 0x7f86cc1560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51486/0 (socket says 172.21.15.31:51486) 2023-10-09T06:21:06.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f86cad9d700 1 -- 172.21.15.31:0/2250103600 learned_addr learned my addr 172.21.15.31:0/2250103600 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f6e227fc700 1 -- 172.21.15.31:0/2775317548 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c007150 con 0x7f6e18004c80 2023-10-09T06:21:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f6e227fc700 1 -- 172.21.15.31:0/2775317548 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0072d0 con 0x7f6e18004c80 2023-10-09T06:21:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f6e227fc700 1 -- 172.21.15.31:0/2775317548 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c007690 con 0x7f6e18004c80 2023-10-09T06:21:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f6e34729700 1 -- 172.21.15.31:0/2775317548 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c09a030 con 0x7f6e18004c80 2023-10-09T06:21:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f6e34729700 1 -- 172.21.15.31:0/2775317548 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c154a90 con 0x7f6e18004c80 2023-10-09T06:21:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f492ffff700 1 --2- 172.21.15.31:0/1938576048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f493006d2e0 0x7f49300c6eb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f492400bbc0 tx=0x7f492400b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8094579313eafb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f86cad9d700 1 -- 172.21.15.31:0/2250103600 >> v2:172.21.15.31:3300/0 conn(0x7f86cc0cc450 msgr2=0x7f86cc155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f86cad9d700 1 --2- 172.21.15.31:0/2250103600 >> v2:172.21.15.31:3300/0 conn(0x7f86cc0cc450 0x7f86cc155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f86cad9d700 1 -- 172.21.15.31:0/2250103600 >> v1:172.21.15.31:6789/0 conn(0x7f86cc06d2e0 legacy=0x7f86cc0c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f86cad9d700 1 -- 172.21.15.31:0/2250103600 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc0c7b50 con 0x7f86cc0c75c0 2023-10-09T06:21:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.001+0000 7f86cad9d700 1 --2- 172.21.15.31:0/2250103600 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86cc0c75c0 0x7f86cc1560a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0099b0 tx=0x7f86bc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4a6afdd642fa2f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.001+0000 7f86c959a700 1 -- 172.21.15.31:0/2250103600 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc00b860 con 0x7f86cc0c75c0 2023-10-09T06:21:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.001+0000 7f86c959a700 1 -- 172.21.15.31:0/2250103600 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc00b9c0 con 0x7f86cc0c75c0 2023-10-09T06:21:06.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.001+0000 7f86c959a700 1 -- 172.21.15.31:0/2250103600 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc00bd40 con 0x7f86cc0c75c0 2023-10-09T06:21:06.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f9787fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f97880aaf80 0x7f97880caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f9787fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9788159e10 0x7f97880cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f9787fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978806eee0 con 0x7f9788159a40 2023-10-09T06:21:06.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f9787fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978806e2d0 con 0x7f97880aaf80 2023-10-09T06:21:06.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f9787fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978806e5b0 con 0x7f9788159e10 2023-10-09T06:21:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f97877fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9788159e10 0x7f97880cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f97877fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9788159e10 0x7f97880cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51498/0 (socket says 172.21.15.31:51498) 2023-10-09T06:21:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7f97877fe700 1 -- 172.21.15.31:0/2696472791 learned_addr learned my addr 172.21.15.31:0/2696472791 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.001+0000 7f97867fc700 1 --2- 172.21.15.31:0/2696472791 >> v2:172.21.15.31:3300/0 conn(0x7f97880aaf80 0x7f97880caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.001+0000 7f9785ffb700 1 -- 172.21.15.31:0/2696472791 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451285776 0 0) 0x7f978806eee0 con 0x7f9788159a40 2023-10-09T06:21:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.001+0000 7f9785ffb700 1 -- 172.21.15.31:0/2696472791 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9770003570 con 0x7f9788159a40 2023-10-09T06:21:06.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7fa3677fe700 1 -- 172.21.15.31:0/1694618478 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374011600 con 0x7fa3800b0f30 2023-10-09T06:21:06.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7fa3677fe700 1 -- 172.21.15.31:0/1694618478 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa374011760 con 0x7fa3800b0f30 2023-10-09T06:21:06.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7fa3677fe700 1 -- 172.21.15.31:0/1694618478 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374011b00 con 0x7fa3800b0f30 2023-10-09T06:21:06.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7fa386218700 1 -- 172.21.15.31:0/1694618478 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38015e5c0 con 0x7fa3800b0f30 2023-10-09T06:21:06.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7fa386218700 1 -- 172.21.15.31:0/1694618478 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38015eb80 con 0x7fa3800b0f30 2023-10-09T06:21:06.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7efec37fe700 1 -- 172.21.15.31:0/4095042156 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed000f510 con 0x7efedc0c97d0 2023-10-09T06:21:06.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7efec37fe700 1 -- 172.21.15.31:0/4095042156 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed000f670 con 0x7efedc0c97d0 2023-10-09T06:21:06.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.000+0000 7efec37fe700 1 -- 172.21.15.31:0/4095042156 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed000fa30 con 0x7efedc0c97d0 2023-10-09T06:21:06.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.001+0000 7f6e34729700 1 -- 172.21.15.31:0/2775317548 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c155820 con 0x7f6e18004c80 2023-10-09T06:21:06.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.002+0000 7f97877fe700 1 -- 172.21.15.31:0/2696472791 >> v2:172.21.15.31:3300/0 conn(0x7f97880aaf80 msgr2=0x7f97880caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:06.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.002+0000 7f97877fe700 1 --2- 172.21.15.31:0/2696472791 >> v2:172.21.15.31:3300/0 conn(0x7f97880aaf80 0x7f97880caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.002+0000 7f97877fe700 1 -- 172.21.15.31:0/2696472791 >> v1:172.21.15.31:6789/0 conn(0x7f9788159a40 legacy=0x7f97880aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.002+0000 7f97877fe700 1 -- 172.21.15.31:0/2696472791 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978806e890 con 0x7f9788159e10 2023-10-09T06:21:06.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.002+0000 7efee1f5c700 1 -- 172.21.15.31:0/4095042156 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efedc172960 con 0x7efedc0c97d0 2023-10-09T06:21:06.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.002+0000 7efee1f5c700 1 -- 172.21.15.31:0/4095042156 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efedc1532c0 con 0x7efedc0c97d0 2023-10-09T06:21:06.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.002+0000 7f492effd700 1 -- 172.21.15.31:0/1938576048 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492400dc50 con 0x7f493006d2e0 2023-10-09T06:21:06.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.002+0000 7f492effd700 1 -- 172.21.15.31:0/1938576048 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492400ddb0 con 0x7f493006d2e0 2023-10-09T06:21:06.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.002+0000 7f492effd700 1 -- 172.21.15.31:0/1938576048 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924017620 con 0x7f493006d2e0 2023-10-09T06:21:06.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.002+0000 7f6e227fc700 1 -- 172.21.15.31:0/2775317548 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e1c01b070 con 0x7f6e18004c80 2023-10-09T06:21:06.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.002+0000 7fa386218700 1 -- 172.21.15.31:0/1694618478 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38004c3c0 con 0x7fa3800b0f30 2023-10-09T06:21:06.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.003+0000 7f6e227fc700 1 --2- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6e10066f30 0x7f6e100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.003+0000 7fe600684700 1 -- 172.21.15.31:0/2905441657 shutdown_connections 2023-10-09T06:21:06.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.003+0000 7f493632e700 1 -- 172.21.15.31:0/1938576048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f493006d2e0 msgr2=0x7f49300c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.003+0000 7f493632e700 1 --2- 172.21.15.31:0/1938576048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f493006d2e0 0x7f49300c6eb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f492400bbc0 tx=0x7f492400b4e0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.003+0000 7f6e227fc700 1 -- 172.21.15.31:0/2775317548 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6e1c085f20 con 0x7f6e18004c80 2023-10-09T06:21:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.003+0000 7f6e31cc4700 1 --2- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6e10066f30 0x7f6e100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.003+0000 7efee1f5c700 1 -- 172.21.15.31:0/4095042156 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efedc04c3c0 con 0x7efedc0c97d0 2023-10-09T06:21:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.003+0000 7f86d0a79700 1 -- 172.21.15.31:0/2250103600 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86cc0c75c0 msgr2=0x7f86cc1560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.003+0000 7f86d0a79700 1 --2- 172.21.15.31:0/2250103600 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86cc0c75c0 0x7f86cc1560a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0099b0 tx=0x7f86bc009250 comp rx=0 tx=0).stop 2023-10-09T06:21:06.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.003+0000 7fa3677fe700 1 -- 172.21.15.31:0/1694618478 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa374023480 con 0x7fa3800b0f30 2023-10-09T06:21:06.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.003+0000 7f6e31cc4700 1 --2- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6e10066f30 0x7f6e100693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6e28003f10 tx=0x7f6e28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.003+0000 7fe600684700 1 -- 172.21.15.31:0/2905441657 wait complete. 2023-10-09T06:21:06.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7fa3677fe700 1 --2- 172.21.15.31:0/1694618478 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa36c067000 0x7fa36c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7f97877fe700 1 --2- 172.21.15.31:0/2696472791 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9788159e10 0x7f97880cb420 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f977800ffd0 tx=0x7f977800fa80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e75ccf26ded85415 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7fa3677fe700 1 -- 172.21.15.31:0/1694618478 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa3740848c0 con 0x7fa3800b0f30 2023-10-09T06:21:06.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7fa37effd700 1 --2- 172.21.15.31:0/1694618478 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa36c067000 0x7fa36c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7efec37fe700 1 -- 172.21.15.31:0/4095042156 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efed001a400 con 0x7efedc0c97d0 2023-10-09T06:21:06.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7f86d0a79700 1 -- 172.21.15.31:0/2250103600 shutdown_connections 2023-10-09T06:21:06.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7f86d0a79700 1 --2- 172.21.15.31:0/2250103600 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86cc0c75c0 0x7f86cc1560a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7f86d0a79700 1 --2- 172.21.15.31:0/2250103600 >> v2:172.21.15.31:3300/0 conn(0x7f86cc0cc450 0x7f86cc155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7f86d0a79700 1 -- 172.21.15.31:0/2250103600 >> 172.21.15.31:0/2250103600 conn(0x7f86cc070700 msgr2=0x7f86cc070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7f493632e700 1 -- 172.21.15.31:0/1938576048 shutdown_connections 2023-10-09T06:21:06.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7f493632e700 1 --2- 172.21.15.31:0/1938576048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f493006d2e0 0x7f49300c6eb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7f493632e700 1 -- 172.21.15.31:0/1938576048 >> 172.21.15.31:0/1938576048 conn(0x7f4930070700 msgr2=0x7f4930070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7fe600684700 1 Processor -- start 2023-10-09T06:21:06.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7f86d0a79700 1 -- 172.21.15.31:0/2250103600 shutdown_connections 2023-10-09T06:21:06.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7f493632e700 1 -- 172.21.15.31:0/1938576048 shutdown_connections 2023-10-09T06:21:06.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7f493632e700 1 -- 172.21.15.31:0/1938576048 wait complete. 2023-10-09T06:21:06.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7efec37fe700 1 --2- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efec8066f30 0x7efec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7fa37effd700 1 --2- 172.21.15.31:0/1694618478 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa36c067000 0x7fa36c0694b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa3700058d0 tx=0x7fa3700079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7efec37fe700 1 -- 172.21.15.31:0/4095042156 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efed0084090 con 0x7efedc0c97d0 2023-10-09T06:21:06.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7efedb7fe700 1 --2- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efec8066f30 0x7efec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7fe600684700 1 -- start start 2023-10-09T06:21:06.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7fe600684700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5f806a530 0x7fe5f80c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7fe600684700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80c87a0 0x7fe5f80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7fe600684700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5f81568d0 0x7fe5f8171e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7fe600684700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80b38f0 con 0x7fe5f80c87a0 2023-10-09T06:21:06.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7fe600684700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80c28a0 con 0x7fe5f81568d0 2023-10-09T06:21:06.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7fe600684700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80c2b80 con 0x7fe5f806a530 2023-10-09T06:21:06.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7efedb7fe700 1 --2- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efec8066f30 0x7efec80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efedc06a450 tx=0x7efed401c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7fe5fdc1f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80c87a0 0x7fe5f80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7fe5fe420700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5f806a530 0x7fe5f80c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7fe5fdc1f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80c87a0 0x7fe5f80b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58304/0 (socket says 172.21.15.31:58304) 2023-10-09T06:21:06.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.005+0000 7fe5fdc1f700 1 -- 172.21.15.31:0/2299132016 learned_addr learned my addr 172.21.15.31:0/2299132016 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:06.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7fe5fdc1f700 1 -- 172.21.15.31:0/2299132016 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5f806a530 msgr2=0x7fe5f80c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7fe5fdc1f700 1 --2- 172.21.15.31:0/2299132016 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5f806a530 0x7fe5f80c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7fe5fdc1f700 1 -- 172.21.15.31:0/2299132016 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5f81568d0 msgr2=0x7fe5f8171e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7fe5fdc1f700 1 --2- 172.21.15.31:0/2299132016 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5f81568d0 0x7fe5f8171e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7fe5fdc1f700 1 -- 172.21.15.31:0/2299132016 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f0009ae0 con 0x7fe5f80c87a0 2023-10-09T06:21:06.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7fe5fe420700 1 --2- 172.21.15.31:0/2299132016 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5f806a530 0x7fe5f80c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:06.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7fe5fdc1f700 1 --2- 172.21.15.31:0/2299132016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80c87a0 0x7fe5f80b33b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400b5e0 tx=0x7fe5f40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.004+0000 7f86d0a79700 1 -- 172.21.15.31:0/2250103600 wait complete. 2023-10-09T06:21:06.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7fe5ee7fc700 1 -- 172.21.15.31:0/2299132016 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f400f510 con 0x7fe5f80c87a0 2023-10-09T06:21:06.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7fe5ee7fc700 1 -- 172.21.15.31:0/2299132016 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f400f670 con 0x7fe5f80c87a0 2023-10-09T06:21:06.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7f493632e700 1 Processor -- start 2023-10-09T06:21:06.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7fe600684700 1 -- 172.21.15.31:0/2299132016 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f80c2e60 con 0x7fe5f80c87a0 2023-10-09T06:21:06.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7fe5ee7fc700 1 -- 172.21.15.31:0/2299132016 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f400fa30 con 0x7fe5f80c87a0 2023-10-09T06:21:06.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7f86d0a79700 1 Processor -- start 2023-10-09T06:21:06.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7fe600684700 1 -- 172.21.15.31:0/2299132016 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f8152490 con 0x7fe5f80c87a0 2023-10-09T06:21:06.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7f86d0a79700 1 -- start start 2023-10-09T06:21:06.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.006+0000 7f493632e700 1 -- start start 2023-10-09T06:21:06.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.007+0000 7f86d0a79700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc06d2e0 0x7f86cc155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.007+0000 7f86d0a79700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86cc0c75c0 0x7f86cc14eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.007+0000 7f86d0a79700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86cc0cc450 0x7f86cc0c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.007+0000 7f86d0a79700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc0b04c0 con 0x7f86cc06d2e0 2023-10-09T06:21:06.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.007+0000 7f86d0a79700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc0afc20 con 0x7f86cc0cc450 2023-10-09T06:21:06.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.007+0000 7f86d0a79700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc0adfb0 con 0x7f86cc0c75c0 2023-10-09T06:21:06.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.007+0000 7f86ca59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc06d2e0 0x7f86cc155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.007+0000 7f86ca59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc06d2e0 0x7f86cc155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58312/0 (socket says 172.21.15.31:58312) 2023-10-09T06:21:06.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.007+0000 7f86ca59c700 1 -- 172.21.15.31:0/2970803544 learned_addr learned my addr 172.21.15.31:0/2970803544 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:06.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.007+0000 7f86c9d9b700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86cc0c75c0 0x7f86cc14eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f86cad9d700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86cc0cc450 0x7f86cc0c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f493632e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f493006d2e0 0x7f4930165750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f493632e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f493006d6b0 0x7f49300c0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f493632e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4930156270 0x7f4930158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f493632e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4930143540 con 0x7f493006d2e0 2023-10-09T06:21:06.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f493632e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49300c0c50 con 0x7f493006d6b0 2023-10-09T06:21:06.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f493632e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49300c0f30 con 0x7f4930156270 2023-10-09T06:21:06.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7fe600684700 1 -- 172.21.15.31:0/2299132016 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f80699c0 con 0x7fe5f80c87a0 2023-10-09T06:21:06.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f9785ffb700 1 -- 172.21.15.31:0/2696472791 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778015700 con 0x7f9788159e10 2023-10-09T06:21:06.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f9785ffb700 1 -- 172.21.15.31:0/2696472791 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9778015860 con 0x7f9788159e10 2023-10-09T06:21:06.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f9785ffb700 1 -- 172.21.15.31:0/2696472791 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778015c00 con 0x7f9788159e10 2023-10-09T06:21:06.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f86c9d9b700 1 -- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86cc0cc450 msgr2=0x7f86cc0c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f86c9d9b700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86cc0cc450 0x7f86cc0c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f86c9d9b700 1 -- 172.21.15.31:0/2970803544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc06d2e0 msgr2=0x7f86cc155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f86c9d9b700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc06d2e0 0x7f86cc155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f86c9d9b700 1 -- 172.21.15.31:0/2970803544 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc0094f0 con 0x7f86cc0c75c0 2023-10-09T06:21:06.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f492ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f493006d2e0 0x7f4930165750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f492ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f493006d2e0 0x7f4930165750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58322/0 (socket says 172.21.15.31:58322) 2023-10-09T06:21:06.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f492ffff700 1 -- 172.21.15.31:0/3672860779 learned_addr learned my addr 172.21.15.31:0/3672860779 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:06.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f86c9d9b700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86cc0c75c0 0x7f86cc14eb10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86c000b600 tx=0x7f86c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f86ba7fc700 1 -- 172.21.15.31:0/2970803544 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c000f510 con 0x7f86cc0c75c0 2023-10-09T06:21:06.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f492ffff700 1 -- 172.21.15.31:0/3672860779 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4930156270 msgr2=0x7f4930158690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:21:06.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f492ffff700 1 --2- 172.21.15.31:0/3672860779 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4930156270 0x7f4930158690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f492ffff700 1 -- 172.21.15.31:0/3672860779 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f493006d6b0 msgr2=0x7f49300c0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f492ffff700 1 --2- 172.21.15.31:0/3672860779 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f493006d6b0 0x7f49300c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f492ffff700 1 -- 172.21.15.31:0/3672860779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492400b780 con 0x7f493006d2e0 2023-10-09T06:21:06.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f86ba7fc700 1 -- 172.21.15.31:0/2970803544 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c000f670 con 0x7f86cc0c75c0 2023-10-09T06:21:06.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.008+0000 7f86ba7fc700 1 -- 172.21.15.31:0/2970803544 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c000fa30 con 0x7f86cc0c75c0 2023-10-09T06:21:06.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7f492ffff700 1 --2- 172.21.15.31:0/3672860779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f493006d2e0 0x7f4930165750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f492400d780 tx=0x7f4924018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7f9787fff700 1 -- 172.21.15.31:0/2696472791 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9788159e10 msgr2=0x7f97880cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7f9787fff700 1 --2- 172.21.15.31:0/2696472791 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9788159e10 0x7f97880cb420 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f977800ffd0 tx=0x7f977800fa80 comp rx=0 tx=0).stop 2023-10-09T06:21:06.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7f9787fff700 1 -- 172.21.15.31:0/2696472791 shutdown_connections 2023-10-09T06:21:06.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7f9787fff700 1 --2- 172.21.15.31:0/2696472791 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9788159e10 0x7f97880cb420 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7f9787fff700 1 --2- 172.21.15.31:0/2696472791 >> v2:172.21.15.31:3300/0 conn(0x7f97880aaf80 0x7f97880caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7f9787fff700 1 -- 172.21.15.31:0/2696472791 >> 172.21.15.31:0/2696472791 conn(0x7f9788068100 msgr2=0x7f97880cc720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7f4917fff700 1 -- 172.21.15.31:0/3672860779 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924017d30 con 0x7f493006d2e0 2023-10-09T06:21:06.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7f4917fff700 1 -- 172.21.15.31:0/3672860779 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4924017e90 con 0x7f493006d2e0 2023-10-09T06:21:06.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7f4917fff700 1 -- 172.21.15.31:0/3672860779 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924020650 con 0x7f493006d2e0 2023-10-09T06:21:06.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7f6e227fc700 1 -- 172.21.15.31:0/2775317548 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e1c053250 con 0x7f6e18004c80 2023-10-09T06:21:06.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7fe5ee7fc700 1 -- 172.21.15.31:0/2299132016 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5f401a400 con 0x7fe5f80c87a0 2023-10-09T06:21:06.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7f9787fff700 1 -- 172.21.15.31:0/2696472791 shutdown_connections 2023-10-09T06:21:06.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7fa3677fe700 1 -- 172.21.15.31:0/1694618478 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa374051c90 con 0x7fa3800b0f30 2023-10-09T06:21:06.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.010+0000 7fe5ee7fc700 1 --2- 172.21.15.31:0/2299132016 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe5dc066f30 0x7fe5dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.010+0000 7fe5ee7fc700 1 -- 172.21.15.31:0/2299132016 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5f4083fd0 con 0x7fe5f80c87a0 2023-10-09T06:21:06.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.010+0000 7f493632e700 1 -- 172.21.15.31:0/3672860779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49300c1210 con 0x7f493006d2e0 2023-10-09T06:21:06.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.010+0000 7f493632e700 1 -- 172.21.15.31:0/3672860779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49300c08b0 con 0x7f493006d2e0 2023-10-09T06:21:06.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.010+0000 7fe5fe420700 1 --2- 172.21.15.31:0/2299132016 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe5dc066f30 0x7fe5dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.009+0000 7f9787fff700 1 -- 172.21.15.31:0/2696472791 wait complete. 2023-10-09T06:21:06.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.011+0000 7f9787fff700 1 Processor -- start 2023-10-09T06:21:06.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.011+0000 7f493632e700 1 -- 172.21.15.31:0/3672860779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49300c08b0 con 0x7f493006d2e0 2023-10-09T06:21:06.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.011+0000 7f9787fff700 1 -- start start 2023-10-09T06:21:06.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.012+0000 7f9787fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97880aaf80 0x7f97880c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.012+0000 7f9787fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9788159a40 0x7f97880b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.012+0000 7f9787fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788159e10 0x7f9788150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.012+0000 7f9787fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880afe40 con 0x7f9788159e10 2023-10-09T06:21:06.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.012+0000 7f9787fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9788165f80 con 0x7f9788159a40 2023-10-09T06:21:06.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.012+0000 7f9787fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97881667e0 con 0x7f97880aaf80 2023-10-09T06:21:06.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.012+0000 7f97877fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788159e10 0x7f9788150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.012+0000 7f97877fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788159e10 0x7f9788150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58338/0 (socket says 172.21.15.31:58338) 2023-10-09T06:21:06.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.012+0000 7f97877fe700 1 -- 172.21.15.31:0/3794344899 learned_addr learned my addr 172.21.15.31:0/3794344899 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:06.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.012+0000 7f9786ffd700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97880aaf80 0x7f97880c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.013+0000 7f97877fe700 1 -- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97880aaf80 msgr2=0x7f97880c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.013+0000 7f97877fe700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97880aaf80 0x7f97880c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.013+0000 7f97877fe700 1 -- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9788159a40 msgr2=0x7f97880b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.013+0000 7f97877fe700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9788159a40 0x7f97880b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.013+0000 7f97877fe700 1 -- 172.21.15.31:0/3794344899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977800fd20 con 0x7f9788159e10 2023-10-09T06:21:06.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.013+0000 7f9786ffd700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97880aaf80 0x7f97880c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:06.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.013+0000 7f97877fe700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788159e10 0x7f9788150e20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f977800fcf0 tx=0x7f977801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.014+0000 7efec37fe700 1 -- 172.21.15.31:0/4095042156 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efed0051380 con 0x7efedc0c97d0 2023-10-09T06:21:06.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.015+0000 7fe5ee7fc700 1 -- 172.21.15.31:0/2299132016 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5f4051220 con 0x7fe5f80c87a0 2023-10-09T06:21:06.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.016+0000 7f976effd700 1 -- 172.21.15.31:0/3794344899 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778002f90 con 0x7f9788159e10 2023-10-09T06:21:06.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.016+0000 7f9787fff700 1 -- 172.21.15.31:0/3794344899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97880b2500 con 0x7f9788159e10 2023-10-09T06:21:06.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.016+0000 7f976effd700 1 -- 172.21.15.31:0/3794344899 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9778015be0 con 0x7f9788159e10 2023-10-09T06:21:06.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.016+0000 7f976effd700 1 -- 172.21.15.31:0/3794344899 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778028660 con 0x7f9788159e10 2023-10-09T06:21:06.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.016+0000 7f9787fff700 1 -- 172.21.15.31:0/3794344899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9788166190 con 0x7f9788159e10 2023-10-09T06:21:06.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.011+0000 7f86d0a79700 1 -- 172.21.15.31:0/2970803544 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86cc0ae290 con 0x7f86cc0c75c0 2023-10-09T06:21:06.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.011+0000 7f86d0a79700 1 -- 172.21.15.31:0/2970803544 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86cc14f050 con 0x7f86cc0c75c0 2023-10-09T06:21:06.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.012+0000 7f86d0a79700 1 -- 172.21.15.31:0/2970803544 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86cc0b0670 con 0x7f86cc0c75c0 2023-10-09T06:21:06.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.013+0000 7f86ba7fc700 1 -- 172.21.15.31:0/2970803544 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86c001a400 con 0x7f86cc0c75c0 2023-10-09T06:21:06.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.013+0000 7f86ba7fc700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f86ac066f30 0x7f86ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.013+0000 7f86ba7fc700 1 -- 172.21.15.31:0/2970803544 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f86c0083fe0 con 0x7f86cc0c75c0 2023-10-09T06:21:06.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.013+0000 7f86ca59c700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f86ac066f30 0x7f86ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.014+0000 7f86ca59c700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f86ac066f30 0x7f86ac0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f86c4007fd0 tx=0x7f86c4001710 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.017+0000 7f86ba7fc700 1 -- 172.21.15.31:0/2970803544 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86cc0b0670 con 0x7f86cc0c75c0 2023-10-09T06:21:06.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.023+0000 7f4917fff700 1 -- 172.21.15.31:0/3672860779 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4924020a40 con 0x7f493006d2e0 2023-10-09T06:21:06.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.023+0000 7f4917fff700 1 --2- 172.21.15.31:0/3672860779 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f491c066fb0 0x7f491c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.023+0000 7f4917fff700 1 -- 172.21.15.31:0/3672860779 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4924087af0 con 0x7f493006d2e0 2023-10-09T06:21:06.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.025+0000 7f4917fff700 1 -- 172.21.15.31:0/3672860779 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4924054dc0 con 0x7f493006d2e0 2023-10-09T06:21:06.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.018+0000 7fe5fe420700 1 --2- 172.21.15.31:0/2299132016 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe5dc066f30 0x7fe5dc0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8001d20 tx=0x7fe5e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.027+0000 7f976effd700 1 -- 172.21.15.31:0/3794344899 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9778028a50 con 0x7f9788159e10 2023-10-09T06:21:06.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.027+0000 7f976effd700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9774066f60 0x7f9774069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.028+0000 7f976effd700 1 -- 172.21.15.31:0/3794344899 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f977808f730 con 0x7f9788159e10 2023-10-09T06:21:06.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.028+0000 7f9786ffd700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9774066f60 0x7f9774069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.028+0000 7f9786ffd700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9774066f60 0x7f9774069410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f978000f3c0 tx=0x7f9780007f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.029+0000 7f9787fff700 1 -- 172.21.15.31:0/3794344899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9788166950 con 0x7f9788159e10 2023-10-09T06:21:06.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.030+0000 7fe12d66d700 1 Processor -- start 2023-10-09T06:21:06.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.030+0000 7fe12d66d700 1 -- start start 2023-10-09T06:21:06.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.031+0000 7fe12d66d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe12815a6e0 0x7fe128068950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.032+0000 7fe12d66d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe12806f630 0x7fe12815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.032+0000 7fe12d66d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe128067660 con 0x7fe12815aff0 2023-10-09T06:21:06.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.032+0000 7fe12d66d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12815b460 con 0x7fe12815a6e0 2023-10-09T06:21:06.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.032+0000 7fe12d66d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280684c0 con 0x7fe12806f630 2023-10-09T06:21:06.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.032+0000 7fe1277fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fe12815aff0 0x7fe128070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:45370/0 (socket says 172.21.15.31:45370) 2023-10-09T06:21:06.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.032+0000 7fe1277fe700 1 -- 172.21.15.31:0/1402316184 learned_addr learned my addr 172.21.15.31:0/1402316184 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:06.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.032+0000 7fe1267fc700 1 --2- 172.21.15.31:0/1402316184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe12806f630 0x7fe12815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.032+0000 7fe1267fc700 1 -- 172.21.15.31:0/1402316184 >> v2:172.21.15.31:3300/0 conn(0x7fe12815a6e0 msgr2=0x7fe128068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:06.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.032+0000 7fe1267fc700 1 --2- 172.21.15.31:0/1402316184 >> v2:172.21.15.31:3300/0 conn(0x7fe12815a6e0 0x7fe128068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.032+0000 7fe1267fc700 1 -- 172.21.15.31:0/1402316184 >> v1:172.21.15.158:6789/0 conn(0x7fe12815aff0 legacy=0x7fe128070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.032+0000 7fe1267fc700 1 -- 172.21.15.31:0/1402316184 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1280678b0 con 0x7fe12806f630 2023-10-09T06:21:06.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.033+0000 7fe1267fc700 1 --2- 172.21.15.31:0/1402316184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe12806f630 0x7fe12815aab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0098e0 tx=0x7fe11c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=837cefc970d37d84 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.033+0000 7fe125ffb700 1 -- 172.21.15.31:0/1402316184 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c009e80 con 0x7fe12806f630 2023-10-09T06:21:06.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.033+0000 7fe125ffb700 1 -- 172.21.15.31:0/1402316184 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c00b760 con 0x7fe12806f630 2023-10-09T06:21:06.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.033+0000 7fe125ffb700 1 -- 172.21.15.31:0/1402316184 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c00bae0 con 0x7fe12806f630 2023-10-09T06:21:06.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.034+0000 7fe12d66d700 1 -- 172.21.15.31:0/1402316184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe12806f630 msgr2=0x7fe12815aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.034+0000 7fe12d66d700 1 --2- 172.21.15.31:0/1402316184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe12806f630 0x7fe12815aab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0098e0 tx=0x7fe11c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.034+0000 7fe12d66d700 1 -- 172.21.15.31:0/1402316184 shutdown_connections 2023-10-09T06:21:06.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.034+0000 7fe12d66d700 1 --2- 172.21.15.31:0/1402316184 >> v2:172.21.15.31:3300/0 conn(0x7fe12815a6e0 0x7fe128068950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.034+0000 7fe12d66d700 1 --2- 172.21.15.31:0/1402316184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe12806f630 0x7fe12815aab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.034+0000 7fe12d66d700 1 -- 172.21.15.31:0/1402316184 >> 172.21.15.31:0/1402316184 conn(0x7fe12806a250 msgr2=0x7fe12806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.034+0000 7fe12d66d700 1 -- 172.21.15.31:0/1402316184 shutdown_connections 2023-10-09T06:21:06.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.034+0000 7fe12d66d700 1 -- 172.21.15.31:0/1402316184 wait complete. 2023-10-09T06:21:06.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.035+0000 7f976effd700 1 -- 172.21.15.31:0/3794344899 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f977805c980 con 0x7f9788159e10 2023-10-09T06:21:06.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.035+0000 7f492f7fe700 1 --2- 172.21.15.31:0/3672860779 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f491c066fb0 0x7f491c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.036+0000 7fe12d66d700 1 Processor -- start 2023-10-09T06:21:06.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.037+0000 7fe12d66d700 1 -- start start 2023-10-09T06:21:06.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.038+0000 7fe12d66d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe12806f630 0x7fe128152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.038+0000 7fe12d66d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe12815a6e0 0x7fe1280aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.038+0000 7fe12d66d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe12815aff0 0x7fe1280af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.038+0000 7fe12d66d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280b02c0 con 0x7fe12806f630 2023-10-09T06:21:06.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.038+0000 7fe12d66d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280b0b30 con 0x7fe12815a6e0 2023-10-09T06:21:06.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.038+0000 7fe12d66d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280ad730 con 0x7fe12815aff0 2023-10-09T06:21:06.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.038+0000 7fe1267fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe12815a6e0 0x7fe1280aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.038+0000 7fe1277fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe12815aff0 0x7fe1280af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.038+0000 7fe1277fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe12815aff0 0x7fe1280af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51550/0 (socket says 172.21.15.31:51550) 2023-10-09T06:21:06.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.038+0000 7fe1277fe700 1 -- 172.21.15.31:0/3643312672 learned_addr learned my addr 172.21.15.31:0/3643312672 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:06.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.039+0000 7fe1277fe700 1 -- 172.21.15.31:0/3643312672 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe12815a6e0 msgr2=0x7fe1280aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.039+0000 7fe1277fe700 1 --2- 172.21.15.31:0/3643312672 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe12815a6e0 0x7fe1280aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.039+0000 7fe1277fe700 1 -- 172.21.15.31:0/3643312672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe12806f630 msgr2=0x7fe128152f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:21:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.039+0000 7fe1277fe700 1 --2- 172.21.15.31:0/3643312672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe12806f630 0x7fe128152f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.039+0000 7fe1277fe700 1 -- 172.21.15.31:0/3643312672 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c009420 con 0x7fe12815aff0 2023-10-09T06:21:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.039+0000 7fe1277fe700 1 --2- 172.21.15.31:0/3643312672 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe12815aff0 0x7fe1280af3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe120002230 tx=0x7fe120001b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.041+0000 7fe10effd700 1 -- 172.21.15.31:0/3643312672 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12000ab30 con 0x7fe12815aff0 2023-10-09T06:21:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.041+0000 7fe10effd700 1 -- 172.21.15.31:0/3643312672 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12000ac90 con 0x7fe12815aff0 2023-10-09T06:21:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.041+0000 7fe10effd700 1 -- 172.21.15.31:0/3643312672 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe120007340 con 0x7fe12815aff0 2023-10-09T06:21:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.041+0000 7fe12d66d700 1 -- 172.21.15.31:0/3643312672 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1280afa20 con 0x7fe12815aff0 2023-10-09T06:21:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.041+0000 7fe12d66d700 1 -- 172.21.15.31:0/3643312672 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1280affe0 con 0x7fe12815aff0 2023-10-09T06:21:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.043+0000 7fe10effd700 1 -- 172.21.15.31:0/3643312672 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1200076b0 con 0x7fe12815aff0 2023-10-09T06:21:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.044+0000 7fe10effd700 1 --2- 172.21.15.31:0/3643312672 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe114067080 0x7fe114069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.044+0000 7fe10effd700 1 -- 172.21.15.31:0/3643312672 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe120084ab0 con 0x7fe12815aff0 2023-10-09T06:21:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.046+0000 7fe126ffd700 1 --2- 172.21.15.31:0/3643312672 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe114067080 0x7fe114069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.046+0000 7fe126ffd700 1 --2- 172.21.15.31:0/3643312672 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe114067080 0x7fe114069530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe118009760 tx=0x7fe118006c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.047+0000 7fe12d66d700 1 -- 172.21.15.31:0/3643312672 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1080052b0 con 0x7fe12815aff0 2023-10-09T06:21:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.052+0000 7fe10effd700 1 -- 172.21.15.31:0/3643312672 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe120051d80 con 0x7fe12815aff0 2023-10-09T06:21:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.068+0000 7f492f7fe700 1 --2- 172.21.15.31:0/3672860779 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f491c066fb0 0x7f491c069460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f49301541d0 tx=0x7f4920007af0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.400+0000 7f6e34729700 1 -- 172.21.15.31:0/2775317548 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6e2c04c3c0 con 0x7f6e18004c80 2023-10-09T06:21:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.401+0000 7f6e227fc700 1 -- 172.21.15.31:0/2775317548 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e1c056870 con 0x7f6e18004c80 2023-10-09T06:21:06.404 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2023-10-09T06:21:06.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.404+0000 7f6e34729700 1 -- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6e10066f30 msgr2=0x7f6e100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.404+0000 7f6e34729700 1 --2- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6e10066f30 0x7f6e100693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6e28003f10 tx=0x7f6e28009040 comp rx=0 tx=0).stop 2023-10-09T06:21:06.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.404+0000 7f6e34729700 1 -- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e18004c80 msgr2=0x7f6e2c154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.404+0000 7f6e34729700 1 --2- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e18004c80 0x7f6e2c154550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e18014b60 tx=0x7f6e1c015000 comp rx=0 tx=0).stop 2023-10-09T06:21:06.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.404+0000 7f6e34729700 1 -- 172.21.15.31:0/2775317548 shutdown_connections 2023-10-09T06:21:06.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.404+0000 7f6e34729700 1 --2- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6e10066f30 0x7f6e100693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.404+0000 7f6e34729700 1 --2- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e18004c80 0x7f6e2c154550 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.404+0000 7f6e34729700 1 --2- 172.21.15.31:0/2775317548 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e2c098d40 0x7f6e2c099170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.404+0000 7f6e34729700 1 --2- 172.21.15.31:0/2775317548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e2c1585c0 0x7f6e2c158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.404+0000 7f6e34729700 1 -- 172.21.15.31:0/2775317548 >> 172.21.15.31:0/2775317548 conn(0x7f6e2c0cd1e0 msgr2=0x7f6e2c0cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.404+0000 7f6e34729700 1 -- 172.21.15.31:0/2775317548 shutdown_connections 2023-10-09T06:21:06.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.404+0000 7f6e34729700 1 -- 172.21.15.31:0/2775317548 wait complete. 2023-10-09T06:21:06.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.414+0000 7efee1f5c700 1 -- 172.21.15.31:0/4095042156 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efedc0c76c0 con 0x7efedc0c97d0 2023-10-09T06:21:06.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.415+0000 7efec37fe700 1 -- 172.21.15.31:0/4095042156 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efed00549a0 con 0x7efedc0c97d0 2023-10-09T06:21:06.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.416+0000 7f86d0a79700 1 -- 172.21.15.31:0/2970803544 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f86cc0b0280 con 0x7f86cc0c75c0 2023-10-09T06:21:06.417 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2023-10-09T06:21:06.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.416+0000 7f86ba7fc700 1 -- 172.21.15.31:0/2970803544 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86c00512d0 con 0x7f86cc0c75c0 2023-10-09T06:21:06.421 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2023-10-09T06:21:06.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.420+0000 7fa386218700 1 -- 172.21.15.31:0/1694618478 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa3800cb540 con 0x7fa3800b0f30 2023-10-09T06:21:06.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7efee1f5c700 1 -- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efec8066f30 msgr2=0x7efec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7efee1f5c700 1 --2- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efec8066f30 0x7efec80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efedc06a450 tx=0x7efed401c000 comp rx=0 tx=0).stop 2023-10-09T06:21:06.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7efee1f5c700 1 -- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efedc0c97d0 msgr2=0x7efedc152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7efee1f5c700 1 --2- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efedc0c97d0 0x7efedc152d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efed000b810 tx=0x7efed0009250 comp rx=0 tx=0).stop 2023-10-09T06:21:06.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7efee1f5c700 1 -- 172.21.15.31:0/4095042156 shutdown_connections 2023-10-09T06:21:06.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7efee1f5c700 1 --2- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efec8066f30 0x7efec80693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7efee1f5c700 1 --2- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efedc156410 0x7efedc0c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7efee1f5c700 1 --2- 172.21.15.31:0/4095042156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efedc06d9b0 0x7efedc171b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7efee1f5c700 1 --2- 172.21.15.31:0/4095042156 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efedc0c97d0 0x7efedc152d80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7efee1f5c700 1 -- 172.21.15.31:0/4095042156 >> 172.21.15.31:0/4095042156 conn(0x7efedc070700 msgr2=0x7efedc0cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7f86d0a79700 1 -- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f86ac066f30 msgr2=0x7f86ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7f86d0a79700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f86ac066f30 0x7f86ac0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f86c4007fd0 tx=0x7f86c4001710 comp rx=0 tx=0).stop 2023-10-09T06:21:06.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7f86d0a79700 1 -- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86cc0c75c0 msgr2=0x7f86cc14eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7fa3677fe700 1 -- 172.21.15.31:0/1694618478 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa3740552b0 con 0x7fa3800b0f30 2023-10-09T06:21:06.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7f86d0a79700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86cc0c75c0 0x7f86cc14eb10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86c000b600 tx=0x7f86c00091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.424 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2023-10-09T06:21:06.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7efee1f5c700 1 -- 172.21.15.31:0/4095042156 shutdown_connections 2023-10-09T06:21:06.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.421+0000 7efee1f5c700 1 -- 172.21.15.31:0/4095042156 wait complete. 2023-10-09T06:21:06.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.423+0000 7f86d0a79700 1 -- 172.21.15.31:0/2970803544 shutdown_connections 2023-10-09T06:21:06.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.423+0000 7f86d0a79700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f86ac066f30 0x7f86ac0693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.423+0000 7f86d0a79700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86cc0cc450 0x7f86cc0c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.423+0000 7f86d0a79700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc06d2e0 0x7f86cc155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.423+0000 7f86d0a79700 1 --2- 172.21.15.31:0/2970803544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86cc0c75c0 0x7f86cc14eb10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.423+0000 7f86d0a79700 1 -- 172.21.15.31:0/2970803544 >> 172.21.15.31:0/2970803544 conn(0x7f86cc070700 msgr2=0x7f86cc158790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-09T06:21:06.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.423+0000 7f86d0a79700 1 -- 172.21.15.31:0/2970803544 shutdown_connections 2023-10-09T06:21:06.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.423+0000 7f86d0a79700 1 -- 172.21.15.31:0/2970803544 wait complete. 2023-10-09T06:21:06.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.425+0000 7fa386218700 1 -- 172.21.15.31:0/1694618478 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa36c067000 msgr2=0x7fa36c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.425+0000 7fa386218700 1 --2- 172.21.15.31:0/1694618478 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa36c067000 0x7fa36c0694b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa3700058d0 tx=0x7fa3700079d0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.425+0000 7fa386218700 1 -- 172.21.15.31:0/1694618478 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3800b0f30 msgr2=0x7fa380158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.425+0000 7fa386218700 1 --2- 172.21.15.31:0/1694618478 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3800b0f30 0x7fa380158840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa37400c850 tx=0x7fa374008040 comp rx=0 tx=0).stop 2023-10-09T06:21:06.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.426+0000 7fa386218700 1 -- 172.21.15.31:0/1694618478 shutdown_connections 2023-10-09T06:21:06.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.426+0000 7fa386218700 1 --2- 172.21.15.31:0/1694618478 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa36c067000 0x7fa36c0694b0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa3700058d0 tx=0x7fa3700079d0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.426+0000 7fa386218700 1 --2- 172.21.15.31:0/1694618478 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa38015aea0 0x7fa38016ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.426+0000 7fa386218700 1 --2- 172.21.15.31:0/1694618478 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3800b0f30 0x7fa380158840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.426+0000 7fa386218700 1 --2- 172.21.15.31:0/1694618478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3800b1300 0x7fa38015dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.426+0000 7fa386218700 1 -- 172.21.15.31:0/1694618478 >> 172.21.15.31:0/1694618478 conn(0x7fa38006fdc0 msgr2=0x7fa3800c9960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.427+0000 7fa386218700 1 -- 172.21.15.31:0/1694618478 shutdown_connections 2023-10-09T06:21:06.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.427+0000 7fe600684700 1 -- 172.21.15.31:0/2299132016 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe5f804bb80 con 0x7fe5f80c87a0 2023-10-09T06:21:06.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.427+0000 7fe5ee7fc700 1 -- 172.21.15.31:0/2299132016 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5f4054840 con 0x7fe5f80c87a0 2023-10-09T06:21:06.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.428+0000 7fa386218700 1 -- 172.21.15.31:0/1694618478 wait complete. 2023-10-09T06:21:06.429 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2023-10-09T06:21:06.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.431+0000 7fe600684700 1 -- 172.21.15.31:0/2299132016 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe5dc066f30 msgr2=0x7fe5dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.431+0000 7fe600684700 1 --2- 172.21.15.31:0/2299132016 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe5dc066f30 0x7fe5dc0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8001d20 tx=0x7fe5e8009040 comp rx=0 tx=0).stop 2023-10-09T06:21:06.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.431+0000 7fe600684700 1 -- 172.21.15.31:0/2299132016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80c87a0 msgr2=0x7fe5f80b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.431+0000 7fe600684700 1 --2- 172.21.15.31:0/2299132016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80c87a0 0x7fe5f80b33b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400b5e0 tx=0x7fe5f40090f0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.436+0000 7fe600684700 1 -- 172.21.15.31:0/2299132016 shutdown_connections 2023-10-09T06:21:06.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.436+0000 7fe600684700 1 --2- 172.21.15.31:0/2299132016 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe5dc066f30 0x7fe5dc0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.436+0000 7fe600684700 1 --2- 172.21.15.31:0/2299132016 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe5f806a530 0x7fe5f80c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.436+0000 7fe600684700 1 --2- 172.21.15.31:0/2299132016 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5f81568d0 0x7fe5f8171e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.436+0000 7fe600684700 1 --2- 172.21.15.31:0/2299132016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80c87a0 0x7fe5f80b33b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.436+0000 7fe600684700 1 -- 172.21.15.31:0/2299132016 >> 172.21.15.31:0/2299132016 conn(0x7fe5f80cda50 msgr2=0x7fe5f80afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.437+0000 7fe600684700 1 -- 172.21.15.31:0/2299132016 shutdown_connections 2023-10-09T06:21:06.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.437+0000 7fe600684700 1 -- 172.21.15.31:0/2299132016 wait complete. 2023-10-09T06:21:06.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.438+0000 7f493632e700 1 -- 172.21.15.31:0/3672860779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f49300c08b0 con 0x7f493006d2e0 2023-10-09T06:21:06.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.439+0000 7f4917fff700 1 -- 172.21.15.31:0/3672860779 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49240583e0 con 0x7f493006d2e0 2023-10-09T06:21:06.440 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2023-10-09T06:21:06.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.442+0000 7f9787fff700 1 -- 172.21.15.31:0/3794344899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9788064c50 con 0x7f9788159e10 2023-10-09T06:21:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.442+0000 7f493632e700 1 -- 172.21.15.31:0/3672860779 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f491c066fb0 msgr2=0x7f491c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.442+0000 7f493632e700 1 --2- 172.21.15.31:0/3672860779 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f491c066fb0 0x7f491c069460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f49301541d0 tx=0x7f4920007af0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.442+0000 7f493632e700 1 -- 172.21.15.31:0/3672860779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f493006d2e0 msgr2=0x7f4930165750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.442+0000 7f493632e700 1 --2- 172.21.15.31:0/3672860779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f493006d2e0 0x7f4930165750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f492400d780 tx=0x7f4924018000 comp rx=0 tx=0).stop 2023-10-09T06:21:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.444+0000 7f493632e700 1 -- 172.21.15.31:0/3672860779 shutdown_connections 2023-10-09T06:21:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.444+0000 7f493632e700 1 --2- 172.21.15.31:0/3672860779 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f491c066fb0 0x7f491c069460 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.444+0000 7f493632e700 1 --2- 172.21.15.31:0/3672860779 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4930156270 0x7f4930158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.444+0000 7f493632e700 1 --2- 172.21.15.31:0/3672860779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f493006d2e0 0x7f4930165750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.444+0000 7f493632e700 1 --2- 172.21.15.31:0/3672860779 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f493006d6b0 0x7f49300c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.444+0000 7f493632e700 1 -- 172.21.15.31:0/3672860779 >> 172.21.15.31:0/3672860779 conn(0x7f4930070700 msgr2=0x7f49300c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.444+0000 7f493632e700 1 -- 172.21.15.31:0/3672860779 shutdown_connections 2023-10-09T06:21:06.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.444+0000 7f493632e700 1 -- 172.21.15.31:0/3672860779 wait complete. 2023-10-09T06:21:06.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.444+0000 7f976effd700 1 -- 172.21.15.31:0/3794344899 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9778035020 con 0x7f9788159e10 2023-10-09T06:21:06.447 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2023-10-09T06:21:06.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-09T06:21:06.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-09T06:21:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.446+0000 7fe12d66d700 1 -- 172.21.15.31:0/3643312672 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe108005560 con 0x7fe12815aff0 2023-10-09T06:21:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.447+0000 7fe10effd700 1 -- 172.21.15.31:0/3643312672 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1200553a0 con 0x7fe12815aff0 2023-10-09T06:21:06.449 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2023-10-09T06:21:06.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-09T06:21:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.447+0000 7f9787fff700 1 -- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9774066f60 msgr2=0x7f9774069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.447+0000 7f9787fff700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9774066f60 0x7f9774069410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f978000f3c0 tx=0x7f9780007f90 comp rx=0 tx=0).stop 2023-10-09T06:21:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.447+0000 7f9787fff700 1 -- 172.21.15.31:0/3794344899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788159e10 msgr2=0x7f9788150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.447+0000 7f9787fff700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788159e10 0x7f9788150e20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f977800fcf0 tx=0x7f977801f000 comp rx=0 tx=0).stop 2023-10-09T06:21:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.447+0000 7f9787fff700 1 -- 172.21.15.31:0/3794344899 shutdown_connections 2023-10-09T06:21:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.447+0000 7f9787fff700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9774066f60 0x7f9774069410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.447+0000 7f9787fff700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97880aaf80 0x7f97880c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.447+0000 7f9787fff700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788159e10 0x7f9788150e20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.447+0000 7f9787fff700 1 --2- 172.21.15.31:0/3794344899 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9788159a40 0x7f97880b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.447+0000 7f9787fff700 1 -- 172.21.15.31:0/3794344899 >> 172.21.15.31:0/3794344899 conn(0x7f9788068100 msgr2=0x7f97880c27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.447+0000 7f9787fff700 1 -- 172.21.15.31:0/3794344899 shutdown_connections 2023-10-09T06:21:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.447+0000 7f9787fff700 1 -- 172.21.15.31:0/3794344899 wait complete. 2023-10-09T06:21:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.450+0000 7fe12d66d700 1 -- 172.21.15.31:0/3643312672 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe114067080 msgr2=0x7fe114069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.450+0000 7fe12d66d700 1 --2- 172.21.15.31:0/3643312672 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe114067080 0x7fe114069530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe118009760 tx=0x7fe118006c90 comp rx=0 tx=0).stop 2023-10-09T06:21:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.450+0000 7fe12d66d700 1 -- 172.21.15.31:0/3643312672 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe12815aff0 msgr2=0x7fe1280af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.450+0000 7fe12d66d700 1 --2- 172.21.15.31:0/3643312672 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe12815aff0 0x7fe1280af3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe120002230 tx=0x7fe120001b90 comp rx=0 tx=0).stop 2023-10-09T06:21:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.451+0000 7fe12d66d700 1 -- 172.21.15.31:0/3643312672 shutdown_connections 2023-10-09T06:21:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.451+0000 7fe12d66d700 1 --2- 172.21.15.31:0/3643312672 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe114067080 0x7fe114069530 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe118009760 tx=0x7fe118006c90 comp rx=0 tx=0).stop 2023-10-09T06:21:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.451+0000 7fe12d66d700 1 --2- 172.21.15.31:0/3643312672 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe12815aff0 0x7fe1280af3f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.451+0000 7fe12d66d700 1 --2- 172.21.15.31:0/3643312672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe12806f630 0x7fe128152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.451+0000 7fe12d66d700 1 --2- 172.21.15.31:0/3643312672 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe12815a6e0 0x7fe1280aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:06.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.451+0000 7fe12d66d700 1 -- 172.21.15.31:0/3643312672 >> 172.21.15.31:0/3643312672 conn(0x7fe12806a250 msgr2=0x7fe12815d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:06.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.454+0000 7fe12d66d700 1 -- 172.21.15.31:0/3643312672 shutdown_connections 2023-10-09T06:21:06.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:06.454+0000 7fe12d66d700 1 -- 172.21.15.31:0/3643312672 wait complete. 2023-10-09T06:21:06.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-09T06:21:06.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-09T06:21:06.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-09T06:21:06.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-09T06:21:07.427 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-09T06:21:07.449 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-09T06:21:07.449 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-09T06:21:07.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-09T06:21:07.457 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-09T06:21:07.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-09T06:21:07.467 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-09T06:21:07.471 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-09T06:21:07.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.624+0000 7f7cfc54a700 1 Processor -- start 2023-10-09T06:21:07.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.624+0000 7f7cfc54a700 1 -- start start 2023-10-09T06:21:07.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.625+0000 7f7cfc54a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cf40ccec0 0x7f7cf40b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.625+0000 7f7cfc54a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40c6eb0 con 0x7f7cf4088ac0 2023-10-09T06:21:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.626+0000 7f7cfc54a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40b1270 con 0x7f7cf40ccaf0 2023-10-09T06:21:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.626+0000 7f7cfc54a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40b0660 con 0x7f7cf40ccec0 2023-10-09T06:21:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.626+0000 7f7cfa2e6700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f7cf40ccaf0 0x7f7cf40883b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:45372/0 (socket says 172.21.15.31:45372) 2023-10-09T06:21:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.626+0000 7f7cfa2e6700 1 -- 172.21.15.31:0/74911171 learned_addr learned my addr 172.21.15.31:0/74911171 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.626+0000 7f7cfaae7700 1 --2- 172.21.15.31:0/74911171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cf40ccec0 0x7f7cf40b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071219194 0 0) 0x7f7cf40b1270 con 0x7f7cf40ccaf0 2023-10-09T06:21:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce0003570 con 0x7f7cf40ccaf0 2023-10-09T06:21:07.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1875771258 0 0) 0x7f7ce0003570 con 0x7f7cf40ccaf0 2023-10-09T06:21:07.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cf40ccec0 msgr2=0x7f7cf40b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 --2- 172.21.15.31:0/74911171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cf40ccec0 0x7f7cf40b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 >> v1:172.21.15.31:6789/0 conn(0x7f7cf4088ac0 legacy=0x7f7cf40af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40b0940 con 0x7f7cf40ccaf0 2023-10-09T06:21:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f7cec0017f0 con 0x7f7cf40ccaf0 2023-10-09T06:21:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 >> v1:172.21.15.158:6789/0 conn(0x7f7cf40ccaf0 legacy=0x7f7cf40883b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 --2- 172.21.15.31:0/74911171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7ce0003ae0 0x7f7ce0003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 --2- 172.21.15.31:0/74911171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7ce0004810 0x7f7ce0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 --2- 172.21.15.31:0/74911171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ce0009a50 0x7f7ce00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40b0660 con 0x7f7ce0009a50 2023-10-09T06:21:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce0014870 con 0x7f7ce0003ae0 2023-10-09T06:21:07.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce0014a30 con 0x7f7ce0004810 2023-10-09T06:21:07.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.627+0000 7f7cf9ae5700 1 --2- 172.21.15.31:0/74911171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7ce0004810 0x7f7ce0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.628+0000 7f7cfa2e6700 1 --2- 172.21.15.31:0/74911171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7ce0003ae0 0x7f7ce0003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.628+0000 7f7cf9ae5700 1 -- 172.21.15.31:0/74911171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7ce0003ae0 msgr2=0x7f7ce0003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:07.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.628+0000 7f7cf9ae5700 1 --2- 172.21.15.31:0/74911171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7ce0003ae0 0x7f7ce0003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.628+0000 7f7cf9ae5700 1 -- 172.21.15.31:0/74911171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ce0009a50 msgr2=0x7f7ce00051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:07.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.628+0000 7f7cf9ae5700 1 --2- 172.21.15.31:0/74911171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ce0009a50 0x7f7ce00051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.628+0000 7f7cf9ae5700 1 -- 172.21.15.31:0/74911171 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40b0940 con 0x7f7ce0004810 2023-10-09T06:21:07.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.629+0000 7f7cf9ae5700 1 --2- 172.21.15.31:0/74911171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7ce0004810 0x7f7ce0004c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0001790 tx=0x7f7cf0007d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cb167ead3760c7c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.629+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0012400 con 0x7f7ce0004810 2023-10-09T06:21:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.629+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf0012560 con 0x7f7ce0004810 2023-10-09T06:21:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.629+0000 7f7cf92e4700 1 -- 172.21.15.31:0/74911171 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0012920 con 0x7f7ce0004810 2023-10-09T06:21:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.630+0000 7f7cfc54a700 1 -- 172.21.15.31:0/74911171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7ce0004810 msgr2=0x7f7ce0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.630+0000 7f7cfc54a700 1 --2- 172.21.15.31:0/74911171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7ce0004810 0x7f7ce0004c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0001790 tx=0x7f7cf0007d10 comp rx=0 tx=0).stop 2023-10-09T06:21:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.630+0000 7f7cfaae7700 1 -- 172.21.15.31:0/74911171 reap_dead start 2023-10-09T06:21:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.630+0000 7f7cfc54a700 1 -- 172.21.15.31:0/74911171 shutdown_connections 2023-10-09T06:21:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.630+0000 7f7cfc54a700 1 -- 172.21.15.31:0/74911171 >> 172.21.15.31:0/74911171 conn(0x7f7cf4070700 msgr2=0x7f7cf4070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.630+0000 7f7cfc54a700 1 -- 172.21.15.31:0/74911171 shutdown_connections 2023-10-09T06:21:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.630+0000 7f7cfc54a700 1 -- 172.21.15.31:0/74911171 wait complete. 2023-10-09T06:21:07.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.632+0000 7f7cfc54a700 1 Processor -- start 2023-10-09T06:21:07.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.632+0000 7f7cfc54a700 1 -- start start 2023-10-09T06:21:07.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.633+0000 7f7cfc54a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ce0004810 0x7f7cf40a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.634+0000 7f7cfc54a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cf417a400 0x7f7cf417a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.634+0000 7f7cfc54a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cf40a9680 0x7f7cf40a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.634+0000 7f7cfc54a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf417a210 con 0x7f7ce0004810 2023-10-09T06:21:07.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.634+0000 7f7cfc54a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf417adb0 con 0x7f7cf40a9680 2023-10-09T06:21:07.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.634+0000 7f7cfc54a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4178100 con 0x7f7cf417a400 2023-10-09T06:21:07.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.634+0000 7f7cfa2e6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ce0004810 0x7f7cf40a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.634+0000 7f7cfa2e6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ce0004810 0x7f7cf40a6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58382/0 (socket says 172.21.15.31:58382) 2023-10-09T06:21:07.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.634+0000 7f7cfa2e6700 1 -- 172.21.15.31:0/4269737769 learned_addr learned my addr 172.21.15.31:0/4269737769 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:07.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.634+0000 7f7cfa2e6700 1 -- 172.21.15.31:0/4269737769 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cf417a400 msgr2=0x7f7cf417a870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:21:07.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.635+0000 7f7cfa2e6700 1 --2- 172.21.15.31:0/4269737769 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cf417a400 0x7f7cf417a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.635+0000 7f7cfa2e6700 1 -- 172.21.15.31:0/4269737769 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cf40a9680 msgr2=0x7f7cf40a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.635+0000 7f7cfaae7700 1 --2- 172.21.15.31:0/4269737769 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cf40a9680 0x7f7cf40a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.635+0000 7f7cfa2e6700 1 --2- 172.21.15.31:0/4269737769 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cf40a9680 0x7f7cf40a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.635+0000 7f7cfa2e6700 1 -- 172.21.15.31:0/4269737769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40a73d0 con 0x7f7ce0004810 2023-10-09T06:21:07.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.636+0000 7f7cfa2e6700 1 --2- 172.21.15.31:0/4269737769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ce0004810 0x7f7cf40a6e90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00e540 tx=0x7f7cec0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.645+0000 7f7cea7fc700 1 -- 172.21.15.31:0/4269737769 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec00eea0 con 0x7f7ce0004810 2023-10-09T06:21:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.645+0000 7f7cea7fc700 1 -- 172.21.15.31:0/4269737769 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec012590 con 0x7f7ce0004810 2023-10-09T06:21:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.645+0000 7f7cea7fc700 1 -- 172.21.15.31:0/4269737769 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec012970 con 0x7f7ce0004810 2023-10-09T06:21:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.645+0000 7f7cfc54a700 1 -- 172.21.15.31:0/4269737769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf40c8aa0 con 0x7f7ce0004810 2023-10-09T06:21:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.645+0000 7f7cfc54a700 1 -- 172.21.15.31:0/4269737769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf40c9060 con 0x7f7ce0004810 2023-10-09T06:21:07.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.648+0000 7f7cea7fc700 1 -- 172.21.15.31:0/4269737769 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cec012ce0 con 0x7f7ce0004810 2023-10-09T06:21:07.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.648+0000 7f7cea7fc700 1 --2- 172.21.15.31:0/4269737769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7cd8067080 0x7f7cd8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.648+0000 7f7cea7fc700 1 -- 172.21.15.31:0/4269737769 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7cec084f80 con 0x7f7ce0004810 2023-10-09T06:21:07.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.649+0000 7f7cfc54a700 1 -- 172.21.15.31:0/4269737769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cdc0052b0 con 0x7f7ce0004810 2023-10-09T06:21:07.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.651+0000 7f7cf9ae5700 1 --2- 172.21.15.31:0/4269737769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7cd8067080 0x7f7cd8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.658+0000 7f7cea7fc700 1 -- 172.21.15.31:0/4269737769 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cec0521d0 con 0x7f7ce0004810 2023-10-09T06:21:07.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.665+0000 7f7cf9ae5700 1 --2- 172.21.15.31:0/4269737769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7cd8067080 0x7f7cd8069530 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0001790 tx=0x7f7cf0015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.680+0000 7fa95633c700 1 Processor -- start 2023-10-09T06:21:07.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.680+0000 7fa95633c700 1 -- start start 2023-10-09T06:21:07.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.680+0000 7fa95633c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa95006eab0 0x7fa95015a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.680+0000 7fa95633c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9500accd0 con 0x7fa9500af6a0 2023-10-09T06:21:07.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.680+0000 7fa95633c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9500ae150 con 0x7fa9500adcd0 2023-10-09T06:21:07.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.680+0000 7fa95633c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa95015afe0 con 0x7fa95006eab0 2023-10-09T06:21:07.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.681+0000 7fa9548d9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa9500af6a0 0x7fa9500ad160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60696/0 (socket says 172.21.15.31:60696) 2023-10-09T06:21:07.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.681+0000 7fa9548d9700 1 -- 172.21.15.31:0/1110349655 learned_addr learned my addr 172.21.15.31:0/1110349655 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:07.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.681+0000 7fa94ffff700 1 --2- 172.21.15.31:0/1110349655 >> v2:172.21.15.31:3300/0 conn(0x7fa95006eab0 0x7fa95015a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.681+0000 7fa94ffff700 1 -- 172.21.15.31:0/1110349655 >> v1:172.21.15.158:6789/0 conn(0x7fa9500adcd0 legacy=0x7fa95006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.681+0000 7fa94ffff700 1 -- 172.21.15.31:0/1110349655 >> v1:172.21.15.31:6789/0 conn(0x7fa9500af6a0 legacy=0x7fa9500ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.681+0000 7fa94ffff700 1 -- 172.21.15.31:0/1110349655 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9500ae400 con 0x7fa95006eab0 2023-10-09T06:21:07.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.682+0000 7fa94ffff700 1 --2- 172.21.15.31:0/1110349655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa95006eab0 0x7fa95015a080 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa94800ae00 tx=0x7fa94800a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69cc20b409f6674 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.682+0000 7fa94effd700 1 -- 172.21.15.31:0/1110349655 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800ce20 con 0x7fa95006eab0 2023-10-09T06:21:07.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.682+0000 7fa94effd700 1 -- 172.21.15.31:0/1110349655 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94800d640 con 0x7fa95006eab0 2023-10-09T06:21:07.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.682+0000 7fa94effd700 1 -- 172.21.15.31:0/1110349655 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800da00 con 0x7fa95006eab0 2023-10-09T06:21:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.683+0000 7fa95633c700 1 -- 172.21.15.31:0/1110349655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa95006eab0 msgr2=0x7fa95015a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.683+0000 7fa95633c700 1 --2- 172.21.15.31:0/1110349655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa95006eab0 0x7fa95015a080 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa94800ae00 tx=0x7fa94800a6a0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.686+0000 7fa95633c700 1 -- 172.21.15.31:0/1110349655 shutdown_connections 2023-10-09T06:21:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.686+0000 7fa95633c700 1 --2- 172.21.15.31:0/1110349655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa95006eab0 0x7fa95015a080 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.686+0000 7fa95633c700 1 -- 172.21.15.31:0/1110349655 >> 172.21.15.31:0/1110349655 conn(0x7fa9500cd1e0 msgr2=0x7fa9500cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:07.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.686+0000 7fa95633c700 1 -- 172.21.15.31:0/1110349655 shutdown_connections 2023-10-09T06:21:07.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.686+0000 7fa95633c700 1 -- 172.21.15.31:0/1110349655 wait complete. 2023-10-09T06:21:07.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.688+0000 7fa95633c700 1 Processor -- start 2023-10-09T06:21:07.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.688+0000 7fe0a303a700 1 Processor -- start 2023-10-09T06:21:07.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.687+0000 7f2e96f52700 1 Processor -- start 2023-10-09T06:21:07.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.687+0000 7f2e96f52700 1 -- start start 2023-10-09T06:21:07.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.688+0000 7fe0a303a700 1 -- start start 2023-10-09T06:21:07.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.688+0000 7f05f15bb700 1 Processor -- start 2023-10-09T06:21:07.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.688+0000 7fa95633c700 1 -- start start 2023-10-09T06:21:07.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7fa95633c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa95006eab0 0x7fa9500a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7fa95633c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9500adcd0 0x7fa9500a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7fa95633c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9500af6a0 0x7fa9500a6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7fa95633c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9500a6ae0 con 0x7fa9500af6a0 2023-10-09T06:21:07.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7fa95633c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9500a5ed0 con 0x7fa9500adcd0 2023-10-09T06:21:07.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7fa95633c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9500a61b0 con 0x7fa95006eab0 2023-10-09T06:21:07.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7f05f15bb700 1 -- start start 2023-10-09T06:21:07.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7fe0a303a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe09c0c9560 0x7fe09c157a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7fe0a303a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe09c069de0 0x7fe09c157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7fe0a303a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c069060 con 0x7fe09c0c9930 2023-10-09T06:21:07.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7fe0a303a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c069300 con 0x7fe09c069de0 2023-10-09T06:21:07.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7fe0a303a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0695e0 con 0x7fe09c0c9560 2023-10-09T06:21:07.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7f2e96f52700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e90156570 0x7f2e9006d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7f2e96f52700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2e9015a330 0x7f2e9006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7f2e96f52700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e90156940 0x7f2e90156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7f2e96f52700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e90157c30 con 0x7f2e90156570 2023-10-09T06:21:07.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7f2e96f52700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e901584f0 con 0x7f2e9015a330 2023-10-09T06:21:07.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7f2e96f52700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e90157670 con 0x7f2e90156940 2023-10-09T06:21:07.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7f2e94cee700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e90156570 0x7f2e9006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7f2e94cee700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e90156570 0x7f2e9006d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58412/0 (socket says 172.21.15.31:58412) 2023-10-09T06:21:07.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7f2e94cee700 1 -- 172.21.15.31:0/4183961646 learned_addr learned my addr 172.21.15.31:0/4183961646 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:07.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fa94f7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9500adcd0 0x7fa9500a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fe0a0dd6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe09c0c9560 0x7fe09c157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fe0a0dd6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe09c0c9560 0x7fe09c157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51590/0 (socket says 172.21.15.31:51590) 2023-10-09T06:21:07.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fe0a0dd6700 1 -- 172.21.15.31:0/1223837237 learned_addr learned my addr 172.21.15.31:0/1223837237 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:07.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fa94f7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9500adcd0 0x7fa9500a3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:52590/0 (socket says 172.21.15.31:52590) 2023-10-09T06:21:07.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fa94f7fe700 1 -- 172.21.15.31:0/1711896363 learned_addr learned my addr 172.21.15.31:0/1711896363 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:07.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fe09bfff700 1 --2- 172.21.15.31:0/1223837237 >> v2:172.21.15.158:3300/0 conn(0x7fe09c069de0 0x7fe09c157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fa9548d9700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9500af6a0 0x7fa9500a6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fa94ffff700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa95006eab0 0x7fa9500a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7f2e954ef700 1 --2- 172.21.15.31:0/4183961646 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e90156940 0x7f2e90156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7f2e94cee700 1 -- 172.21.15.31:0/4183961646 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e90156940 msgr2=0x7f2e90156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:07.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.689+0000 7f2e94cee700 1 --2- 172.21.15.31:0/4183961646 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e90156940 0x7f2e90156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7f2e94cee700 1 -- 172.21.15.31:0/4183961646 >> v2:172.21.15.158:3300/0 conn(0x7f2e9015a330 msgr2=0x7f2e9006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:07.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7f2e94cee700 1 --2- 172.21.15.31:0/4183961646 >> v2:172.21.15.158:3300/0 conn(0x7f2e9015a330 0x7f2e9006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7f2e94cee700 1 -- 172.21.15.31:0/4183961646 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e90157950 con 0x7f2e90156570 2023-10-09T06:21:07.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fa94f7fe700 1 -- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa95006eab0 msgr2=0x7fa9500a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fa94f7fe700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa95006eab0 0x7fa9500a5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fa94f7fe700 1 -- 172.21.15.31:0/1711896363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9500af6a0 msgr2=0x7fa9500a6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fa94f7fe700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9500af6a0 0x7fa9500a6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fa94f7fe700 1 -- 172.21.15.31:0/1711896363 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94800a940 con 0x7fa9500adcd0 2023-10-09T06:21:07.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7f3df3bb9700 1 Processor -- start 2023-10-09T06:21:07.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7f05f15bb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f05ec157cc0 0x7f05ec0c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7f05f15bb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec158110 con 0x7f05ec156410 2023-10-09T06:21:07.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7f05f15bb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec0c6eb0 con 0x7f05ec0c97d0 2023-10-09T06:21:07.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7f05f15bb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec0c9bc0 con 0x7f05ec157cc0 2023-10-09T06:21:07.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7f2e94cee700 1 --2- 172.21.15.31:0/4183961646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e90156570 0x7f2e9006d380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2e9006cd60 tx=0x7f2e7c00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f83420506bbb122 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fe09bfff700 1 -- 172.21.15.31:0/1223837237 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe09c0c9560 msgr2=0x7fe09c157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:07.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fe09bfff700 1 --2- 172.21.15.31:0/1223837237 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe09c0c9560 0x7fe09c157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fe09bfff700 1 -- 172.21.15.31:0/1223837237 >> v1:172.21.15.158:6789/0 conn(0x7fe09c0c9930 legacy=0x7fe09c15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fe09bfff700 1 -- 172.21.15.31:0/1223837237 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0698c0 con 0x7fe09c069de0 2023-10-09T06:21:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7f05ea7fc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f05ec157cc0 0x7f05ec0c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7f05eb7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f05ec0c97d0 0x7f05ec0c81a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:45402/0 (socket says 172.21.15.31:45402) 2023-10-09T06:21:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7f05eb7fe700 1 -- 172.21.15.31:0/3822934813 learned_addr learned my addr 172.21.15.31:0/3822934813 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7fa94f7fe700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9500adcd0 0x7fa9500a3d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa93800c790 tx=0x7fa938007f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7fe09bfff700 1 --2- 172.21.15.31:0/1223837237 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe09c069de0 0x7fe09c157f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe0900098e0 tx=0x7fe0900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdafc8e748a25fc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.690+0000 7f3df3bb9700 1 -- start start 2023-10-09T06:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7fa947fff700 1 -- 172.21.15.31:0/1711896363 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938011590 con 0x7fa9500adcd0 2023-10-09T06:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7fa947fff700 1 -- 172.21.15.31:0/1711896363 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa938011710 con 0x7fa9500adcd0 2023-10-09T06:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7fa947fff700 1 -- 172.21.15.31:0/1711896363 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938011ad0 con 0x7fa9500adcd0 2023-10-09T06:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7f2e8f7fe700 1 -- 172.21.15.31:0/4183961646 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c00dc50 con 0x7f2e90156570 2023-10-09T06:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7f2e8f7fe700 1 -- 172.21.15.31:0/4183961646 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c00ddb0 con 0x7f2e90156570 2023-10-09T06:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7f2e8f7fe700 1 -- 172.21.15.31:0/4183961646 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c012680 con 0x7f2e90156570 2023-10-09T06:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7fa95633c700 1 -- 172.21.15.31:0/1711896363 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9500a6490 con 0x7fa9500adcd0 2023-10-09T06:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7fa95633c700 1 -- 172.21.15.31:0/1711896363 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9500a42c0 con 0x7fa9500adcd0 2023-10-09T06:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7f05ea7fc700 1 -- 172.21.15.31:0/3822934813 >> v1:172.21.15.158:6789/0 conn(0x7f05ec0c97d0 legacy=0x7f05ec0c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7f05ea7fc700 1 -- 172.21.15.31:0/3822934813 >> v1:172.21.15.31:6789/0 conn(0x7f05ec156410 legacy=0x7f05ec06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7f05ea7fc700 1 -- 172.21.15.31:0/3822934813 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec0c7100 con 0x7f05ec157cc0 2023-10-09T06:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f3df3bb9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06f3b0 0x7f3dec06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f3df3bb9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3dec06f820 0x7f3dec06e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f3df3bb9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec0c42b0 con 0x7f3dec0c30c0 2023-10-09T06:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f3df3bb9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec0c3490 con 0x7f3dec06f820 2023-10-09T06:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f3df3bb9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0c36a0 con 0x7f3dec06f3b0 2023-10-09T06:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f2e96f52700 1 -- 172.21.15.31:0/4183961646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e90156570 msgr2=0x7f2e9006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f2e96f52700 1 --2- 172.21.15.31:0/4183961646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e90156570 0x7f2e9006d380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2e9006cd60 tx=0x7f2e7c00b4e0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7fe09b7fe700 1 -- 172.21.15.31:0/1223837237 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09000b640 con 0x7fe09c069de0 2023-10-09T06:21:07.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7fe09b7fe700 1 -- 172.21.15.31:0/1223837237 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09000b7a0 con 0x7fe09c069de0 2023-10-09T06:21:07.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.691+0000 7fe09b7fe700 1 -- 172.21.15.31:0/1223837237 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09000bb40 con 0x7fe09c069de0 2023-10-09T06:21:07.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7fe0a303a700 1 -- 172.21.15.31:0/1223837237 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe09c069de0 msgr2=0x7fe09c157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7fe0a303a700 1 --2- 172.21.15.31:0/1223837237 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe09c069de0 0x7fe09c157f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe0900098e0 tx=0x7fe0900091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7fe0a303a700 1 -- 172.21.15.31:0/1223837237 shutdown_connections 2023-10-09T06:21:07.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7fe0a303a700 1 --2- 172.21.15.31:0/1223837237 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe09c0c9560 0x7fe09c157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7fe0a303a700 1 --2- 172.21.15.31:0/1223837237 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe09c069de0 0x7fe09c157f90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7fe0a303a700 1 -- 172.21.15.31:0/1223837237 >> 172.21.15.31:0/1223837237 conn(0x7fe09c067660 msgr2=0x7fe09c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:07.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f05ea7fc700 1 --2- 172.21.15.31:0/3822934813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05ec157cc0 0x7f05ec0c9290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0098e0 tx=0x7f05dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9dce6c7a3f8182 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7fc02a735700 1 Processor -- start 2023-10-09T06:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7fe0a303a700 1 -- 172.21.15.31:0/1223837237 shutdown_connections 2023-10-09T06:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f3df2156700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3dec06f820 0x7f3dec06e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7fe0a303a700 1 -- 172.21.15.31:0/1223837237 wait complete. 2023-10-09T06:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f2e96f52700 1 -- 172.21.15.31:0/4183961646 shutdown_connections 2023-10-09T06:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f2e96f52700 1 --2- 172.21.15.31:0/4183961646 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e90156940 0x7f2e90156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f2e96f52700 1 --2- 172.21.15.31:0/4183961646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e90156570 0x7f2e9006d380 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f2e96f52700 1 --2- 172.21.15.31:0/4183961646 >> v2:172.21.15.158:3300/0 conn(0x7f2e9015a330 0x7f2e9006d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f2e96f52700 1 -- 172.21.15.31:0/4183961646 >> 172.21.15.31:0/4183961646 conn(0x7f2e90067660 msgr2=0x7f2e90067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f3df2156700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3dec06f820 0x7f3dec06e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58420/0 (socket says 172.21.15.31:58420) 2023-10-09T06:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f3df2156700 1 -- 172.21.15.31:0/1383040958 learned_addr learned my addr 172.21.15.31:0/1383040958 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f2e96f52700 1 -- 172.21.15.31:0/4183961646 shutdown_connections 2023-10-09T06:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7f2e96f52700 1 -- 172.21.15.31:0/4183961646 wait complete. 2023-10-09T06:21:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.693+0000 7f3df1154700 1 --2- 172.21.15.31:0/1383040958 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06f3b0 0x7f3dec06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.693+0000 7f3df2156700 1 -- 172.21.15.31:0/1383040958 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06f3b0 msgr2=0x7f3dec06e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.693+0000 7f3df2156700 1 --2- 172.21.15.31:0/1383040958 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06f3b0 0x7f3dec06e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.693+0000 7f3df2156700 1 -- 172.21.15.31:0/1383040958 >> v1:172.21.15.31:6789/0 conn(0x7f3dec0c30c0 legacy=0x7f3dec156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.693+0000 7f3df2156700 1 -- 172.21.15.31:0/1383040958 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0c3980 con 0x7f3dec06f820 2023-10-09T06:21:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.693+0000 7fa947fff700 1 -- 172.21.15.31:0/1711896363 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa93801b3b0 con 0x7fa9500adcd0 2023-10-09T06:21:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.693+0000 7f3df2156700 1 --2- 172.21.15.31:0/1383040958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec06f820 0x7f3dec06e7f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009f20 tx=0x7f3de4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbb165de887b86 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.693+0000 7fa947fff700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa930067080 0x7fa930069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.692+0000 7fc02a735700 1 -- start start 2023-10-09T06:21:07.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc02a735700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc0241565b0 0x7fc0240a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc02a735700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 0x7fc0240c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc02a735700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0240c2770 con 0x7fc0241561e0 2023-10-09T06:21:07.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc02a735700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0240ccb90 con 0x7fc0241565b0 2023-10-09T06:21:07.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc02a735700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240ccdf0 con 0x7fc02415ac10 2023-10-09T06:21:07.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fa947fff700 1 -- 172.21.15.31:0/1711896363 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa938083a10 con 0x7fa9500adcd0 2023-10-09T06:21:07.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fa94ffff700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa930067080 0x7fa930069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7f05e9ffb700 1 -- 172.21.15.31:0/3822934813 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc009e20 con 0x7f05ec157cc0 2023-10-09T06:21:07.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7f05e9ffb700 1 -- 172.21.15.31:0/3822934813 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc00b820 con 0x7f05ec157cc0 2023-10-09T06:21:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fe0a303a700 1 Processor -- start 2023-10-09T06:21:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc028cd2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 0x7fc0240c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc028cd2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 0x7fc0240c7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51610/0 (socket says 172.21.15.31:51610) 2023-10-09T06:21:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc028cd2700 1 -- 172.21.15.31:0/2567014668 learned_addr learned my addr 172.21.15.31:0/2567014668 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc023fff700 1 --1- 172.21.15.31:0/2567014668 >> v1:172.21.15.158:6789/0 conn(0x7fc0241561e0 0x7fc0240cc480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:45408/0 (socket says 172.21.15.31:45408) 2023-10-09T06:21:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc0237fe700 1 --2- 172.21.15.31:0/2567014668 >> v2:172.21.15.158:3300/0 conn(0x7fc0241565b0 0x7fc0240a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7f05e9ffb700 1 -- 172.21.15.31:0/3822934813 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc00bbc0 con 0x7f05ec157cc0 2023-10-09T06:21:07.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7f2e96f52700 1 Processor -- start 2023-10-09T06:21:07.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fa94ffff700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa930067080 0x7fa930069530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa94800a910 tx=0x7fa948018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc028cd2700 1 -- 172.21.15.31:0/2567014668 >> v2:172.21.15.158:3300/0 conn(0x7fc0241565b0 msgr2=0x7fc0240a9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc028cd2700 1 --2- 172.21.15.31:0/2567014668 >> v2:172.21.15.158:3300/0 conn(0x7fc0241565b0 0x7fc0240a9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc028cd2700 1 -- 172.21.15.31:0/2567014668 >> v1:172.21.15.158:6789/0 conn(0x7fc0241561e0 legacy=0x7fc0240cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc028cd2700 1 -- 172.21.15.31:0/2567014668 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0240c2120 con 0x7fc02415ac10 2023-10-09T06:21:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fc0237fe700 1 --2- 172.21.15.31:0/2567014668 >> v2:172.21.15.158:3300/0 conn(0x7fc0241565b0 0x7fc0240a9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7fc028cd2700 1 --2- 172.21.15.31:0/2567014668 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 0x7fc0240c7820 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009f20 tx=0x7fc01c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6be45a8d0a5a0aac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7f05f15bb700 1 -- 172.21.15.31:0/3822934813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05ec157cc0 msgr2=0x7f05ec0c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7f05f15bb700 1 --2- 172.21.15.31:0/3822934813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05ec157cc0 0x7f05ec0c9290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0098e0 tx=0x7f05dc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7fc022ffd700 1 -- 172.21.15.31:0/2567014668 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00e070 con 0x7fc02415ac10 2023-10-09T06:21:07.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7f3df0953700 1 -- 172.21.15.31:0/1383040958 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400e070 con 0x7f3dec06f820 2023-10-09T06:21:07.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7f3df0953700 1 -- 172.21.15.31:0/1383040958 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de400ba40 con 0x7f3dec06f820 2023-10-09T06:21:07.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7f3df0953700 1 -- 172.21.15.31:0/1383040958 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de40092e0 con 0x7f3dec06f820 2023-10-09T06:21:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7fe0a303a700 1 -- start start 2023-10-09T06:21:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7fe0a303a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe09c069de0 0x7fe09c0c1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7fe0a303a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe09c0c9560 0x7fe09c171a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7fe0a303a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe09c0c9930 0x7fe09c1470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7fe0a303a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0c31b0 con 0x7fe09c0c9560 2023-10-09T06:21:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7fe0a303a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0c2530 con 0x7fe09c069de0 2023-10-09T06:21:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7fe0a303a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0c2810 con 0x7fe09c0c9930 2023-10-09T06:21:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7fe0a0dd6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe09c069de0 0x7fe09c0c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7fe0a15d7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe09c0c9930 0x7fe09c1470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7fe09bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe09c0c9560 0x7fe09c171a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7fe0a15d7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe09c0c9930 0x7fe09c1470e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51616/0 (socket says 172.21.15.31:51616) 2023-10-09T06:21:07.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7fe0a15d7700 1 -- 172.21.15.31:0/4197890422 learned_addr learned my addr 172.21.15.31:0/4197890422 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:07.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.694+0000 7f2e96f52700 1 -- start start 2023-10-09T06:21:07.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e96f52700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e90156570 0x7f2e900c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e96f52700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e90156940 0x7f2e9014dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e96f52700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e9015a330 0x7f2e900b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e96f52700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e900b18e0 con 0x7f2e90156570 2023-10-09T06:21:07.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e96f52700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e900c59d0 con 0x7f2e9015a330 2023-10-09T06:21:07.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e96f52700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e900c63a0 con 0x7f2e90156940 2023-10-09T06:21:07.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e94cee700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e90156570 0x7f2e900c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e94cee700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e90156570 0x7f2e900c5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58448/0 (socket says 172.21.15.31:58448) 2023-10-09T06:21:07.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e94cee700 1 -- 172.21.15.31:0/3195039923 learned_addr learned my addr 172.21.15.31:0/3195039923 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:07.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e954ef700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e9015a330 0x7f2e900b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e8ffff700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e90156940 0x7f2e9014dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f3df3bb9700 1 -- 172.21.15.31:0/1383040958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec06f820 msgr2=0x7f3dec06e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f3df3bb9700 1 --2- 172.21.15.31:0/1383040958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec06f820 0x7f3dec06e7f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009f20 tx=0x7f3de4009840 comp rx=0 tx=0).stop 2023-10-09T06:21:07.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7fc022ffd700 1 -- 172.21.15.31:0/2567014668 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c009020 con 0x7fc02415ac10 2023-10-09T06:21:07.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.695+0000 7fc022ffd700 1 -- 172.21.15.31:0/2567014668 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00b9d0 con 0x7fc02415ac10 2023-10-09T06:21:07.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7fc02a735700 1 -- 172.21.15.31:0/2567014668 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 msgr2=0x7fc0240c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7fe09bfff700 1 -- 172.21.15.31:0/4197890422 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe09c0c9930 msgr2=0x7fe09c1470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7fe09bfff700 1 --2- 172.21.15.31:0/4197890422 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe09c0c9930 0x7fe09c1470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7fe09bfff700 1 -- 172.21.15.31:0/4197890422 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe09c069de0 msgr2=0x7fe09c0c1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7fe09bfff700 1 --2- 172.21.15.31:0/4197890422 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe09c069de0 0x7fe09c0c1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7fe09bfff700 1 -- 172.21.15.31:0/4197890422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe090009420 con 0x7fe09c0c9560 2023-10-09T06:21:07.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e94cee700 1 -- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e90156940 msgr2=0x7f2e9014dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e94cee700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e90156940 0x7f2e9014dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e94cee700 1 -- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e9015a330 msgr2=0x7f2e900b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e94cee700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e9015a330 0x7f2e900b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e94cee700 1 -- 172.21.15.31:0/3195039923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c00b780 con 0x7f2e90156570 2023-10-09T06:21:07.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7f2e954ef700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e9015a330 0x7f2e900b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:07.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.696+0000 7fc02a735700 1 --2- 172.21.15.31:0/2567014668 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 0x7fc0240c7820 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009f20 tx=0x7fc01c009840 comp rx=0 tx=0).stop 2023-10-09T06:21:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f3df3bb9700 1 -- 172.21.15.31:0/1383040958 shutdown_connections 2023-10-09T06:21:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f3df3bb9700 1 --2- 172.21.15.31:0/1383040958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec06f820 0x7f3dec06e7f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f3df3bb9700 1 --2- 172.21.15.31:0/1383040958 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06f3b0 0x7f3dec06e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f3df3bb9700 1 -- 172.21.15.31:0/1383040958 >> 172.21.15.31:0/1383040958 conn(0x7f3dec0ca4f0 msgr2=0x7f3dec0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f2e94cee700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e90156570 0x7f2e900c5e60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2e9006ba00 tx=0x7f2e7c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f05f15bb700 1 -- 172.21.15.31:0/3822934813 shutdown_connections 2023-10-09T06:21:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f05f15bb700 1 --2- 172.21.15.31:0/3822934813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05ec157cc0 0x7f05ec0c9290 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f05f15bb700 1 -- 172.21.15.31:0/3822934813 >> 172.21.15.31:0/3822934813 conn(0x7f05ec070700 msgr2=0x7f05ec070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7fe09bfff700 1 --2- 172.21.15.31:0/4197890422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe09c0c9560 0x7fe09c171a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe090016000 tx=0x7fe090017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7fc02a735700 1 -- 172.21.15.31:0/2567014668 shutdown_connections 2023-10-09T06:21:07.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7fc02a735700 1 --2- 172.21.15.31:0/2567014668 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 0x7fc0240c7820 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7fc02a735700 1 --2- 172.21.15.31:0/2567014668 >> v2:172.21.15.158:3300/0 conn(0x7fc0241565b0 0x7fc0240a9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7fc02a735700 1 -- 172.21.15.31:0/2567014668 >> 172.21.15.31:0/2567014668 conn(0x7fc0240cd1e0 msgr2=0x7fc0240cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:07.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7fa95633c700 1 -- 172.21.15.31:0/1711896363 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9500a6c50 con 0x7fa9500adcd0 2023-10-09T06:21:07.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7fe098ff9700 1 -- 172.21.15.31:0/4197890422 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09001bb60 con 0x7fe09c0c9560 2023-10-09T06:21:07.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7fc02a735700 1 -- 172.21.15.31:0/2567014668 shutdown_connections 2023-10-09T06:21:07.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7fe098ff9700 1 -- 172.21.15.31:0/4197890422 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09001bd00 con 0x7fe09c0c9560 2023-10-09T06:21:07.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7fe098ff9700 1 -- 172.21.15.31:0/4197890422 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0900266d0 con 0x7fe09c0c9560 2023-10-09T06:21:07.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7fc02a735700 1 -- 172.21.15.31:0/2567014668 wait complete. 2023-10-09T06:21:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7fe0a303a700 1 -- 172.21.15.31:0/4197890422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c0c2af0 con 0x7fe09c0c9560 2023-10-09T06:21:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7fe0a303a700 1 -- 172.21.15.31:0/4197890422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c14c930 con 0x7fe09c0c9560 2023-10-09T06:21:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f2e8cff9700 1 -- 172.21.15.31:0/3195039923 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c00dc50 con 0x7f2e90156570 2023-10-09T06:21:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f2e8cff9700 1 -- 172.21.15.31:0/3195039923 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c00b4e0 con 0x7f2e90156570 2023-10-09T06:21:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f2e8cff9700 1 -- 172.21.15.31:0/3195039923 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0126b0 con 0x7f2e90156570 2023-10-09T06:21:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f2e96f52700 1 -- 172.21.15.31:0/3195039923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e900c4dc0 con 0x7f2e90156570 2023-10-09T06:21:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f2e96f52700 1 -- 172.21.15.31:0/3195039923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e900c5380 con 0x7f2e90156570 2023-10-09T06:21:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.697+0000 7f3df3bb9700 1 -- 172.21.15.31:0/1383040958 shutdown_connections 2023-10-09T06:21:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.698+0000 7fc02a735700 1 Processor -- start 2023-10-09T06:21:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.699+0000 7f2e8cff9700 1 -- 172.21.15.31:0/3195039923 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e7c01daf0 con 0x7f2e90156570 2023-10-09T06:21:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.699+0000 7f05f15bb700 1 -- 172.21.15.31:0/3822934813 shutdown_connections 2023-10-09T06:21:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.699+0000 7f05f15bb700 1 -- 172.21.15.31:0/3822934813 wait complete. 2023-10-09T06:21:07.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.699+0000 7fc02a735700 1 -- start start 2023-10-09T06:21:07.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.699+0000 7fc02a735700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0241561e0 0x7fc02414a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.699+0000 7fc02a735700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0241565b0 0x7fc02414bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.699+0000 7fc02a735700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 0x7fc024165120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.699+0000 7fc02a735700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02414c230 con 0x7fc0241561e0 2023-10-09T06:21:07.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.699+0000 7fc02a735700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02414b320 con 0x7fc0241565b0 2023-10-09T06:21:07.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.699+0000 7fc02a735700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0241720f0 con 0x7fc02415ac10 2023-10-09T06:21:07.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7f2e96f52700 1 -- 172.21.15.31:0/3195039923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e700052b0 con 0x7f2e90156570 2023-10-09T06:21:07.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.698+0000 7fe0a303a700 1 -- 172.21.15.31:0/4197890422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c0c2f90 con 0x7fe09c0c9560 2023-10-09T06:21:07.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7fe098ff9700 1 -- 172.21.15.31:0/4197890422 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe090023030 con 0x7fe09c0c9560 2023-10-09T06:21:07.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7fc028cd2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 0x7fc024165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7fc028cd2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 0x7fc024165120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51640/0 (socket says 172.21.15.31:51640) 2023-10-09T06:21:07.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7fc028cd2700 1 -- 172.21.15.31:0/582172009 learned_addr learned my addr 172.21.15.31:0/582172009 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:07.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7fc023fff700 1 --2- 172.21.15.31:0/582172009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0241561e0 0x7fc02414a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7f2e8cff9700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2e74067000 0x7f2e740694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7f2e8cff9700 1 -- 172.21.15.31:0/3195039923 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e7c021070 con 0x7f2e90156570 2023-10-09T06:21:07.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7f3df3bb9700 1 -- 172.21.15.31:0/1383040958 wait complete. 2023-10-09T06:21:07.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7fc028cd2700 1 -- 172.21.15.31:0/582172009 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0241565b0 msgr2=0x7fc02414bcf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T06:21:07.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7fc028cd2700 1 --2- 172.21.15.31:0/582172009 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0241565b0 0x7fc02414bcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7fc028cd2700 1 -- 172.21.15.31:0/582172009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0241561e0 msgr2=0x7fc02414a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7fc028cd2700 1 --2- 172.21.15.31:0/582172009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0241561e0 0x7fc02414a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7fc028cd2700 1 -- 172.21.15.31:0/582172009 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc014009420 con 0x7fc02415ac10 2023-10-09T06:21:07.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7fe098ff9700 1 --2- 172.21.15.31:0/4197890422 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe088066f30 0x7fe0880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.700+0000 7fe098ff9700 1 -- 172.21.15.31:0/4197890422 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe090085cd0 con 0x7fe09c0c9560 2023-10-09T06:21:07.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.701+0000 7fe0a0dd6700 1 --2- 172.21.15.31:0/4197890422 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe088066f30 0x7fe0880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.701+0000 7f05f15bb700 1 Processor -- start 2023-10-09T06:21:07.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.701+0000 7f05f15bb700 1 -- start start 2023-10-09T06:21:07.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.701+0000 7f2e8ffff700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2e74067000 0x7f2e740694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.701+0000 7fc028cd2700 1 --2- 172.21.15.31:0/582172009 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 0x7fc024165120 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0240ccf30 tx=0x7fc01c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.701+0000 7fc00bfff700 1 -- 172.21.15.31:0/582172009 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0148a0 con 0x7fc02415ac10 2023-10-09T06:21:07.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.701+0000 7fc00bfff700 1 -- 172.21.15.31:0/582172009 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c014a20 con 0x7fc02415ac10 2023-10-09T06:21:07.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.701+0000 7fc00bfff700 1 -- 172.21.15.31:0/582172009 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c014de0 con 0x7fc02415ac10 2023-10-09T06:21:07.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.701+0000 7f326abad700 1 Processor -- start 2023-10-09T06:21:07.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.701+0000 7fe0a0dd6700 1 --2- 172.21.15.31:0/4197890422 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe088066f30 0x7fe0880693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe09400f570 tx=0x7fe09400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7f2e8ffff700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2e74067000 0x7f2e740694b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2e900c33f0 tx=0x7f2e840091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7fa947fff700 1 -- 172.21.15.31:0/1711896363 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa938017080 con 0x7fa9500adcd0 2023-10-09T06:21:07.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7f3df3bb9700 1 Processor -- start 2023-10-09T06:21:07.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7f3df3bb9700 1 -- start start 2023-10-09T06:21:07.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.701+0000 7fc02a735700 1 -- 172.21.15.31:0/582172009 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c009ae0 con 0x7fc02415ac10 2023-10-09T06:21:07.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7fc02a735700 1 -- 172.21.15.31:0/582172009 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02414ad60 con 0x7fc02415ac10 2023-10-09T06:21:07.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.701+0000 7f326abad700 1 -- start start 2023-10-09T06:21:07.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f326abad700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f326415e450 0x7f32640b6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f326abad700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f32640afd90 0x7f326406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f326abad700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32640b6cc0 con 0x7f326415e080 2023-10-09T06:21:07.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f326abad700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640b56d0 con 0x7f32640afd90 2023-10-09T06:21:07.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f326abad700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32640b0210 con 0x7f326415e450 2023-10-09T06:21:07.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f3268949700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f326415e080 0x7f32640b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:45410/0 (socket says 172.21.15.31:45410) 2023-10-09T06:21:07.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f3268949700 1 -- 172.21.15.31:0/2966426301 learned_addr learned my addr 172.21.15.31:0/2966426301 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:07.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f3263fff700 1 --2- 172.21.15.31:0/2966426301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f326415e450 0x7f32640b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f326914a700 1 --2- 172.21.15.31:0/2966426301 >> v2:172.21.15.31:3300/0 conn(0x7f32640afd90 0x7f326406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7fc00bfff700 1 -- 172.21.15.31:0/582172009 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc01c003020 con 0x7fc02415ac10 2023-10-09T06:21:07.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f3263fff700 1 -- 172.21.15.31:0/2966426301 >> v2:172.21.15.31:3300/0 conn(0x7f32640afd90 msgr2=0x7f326406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:07.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f3263fff700 1 --2- 172.21.15.31:0/2966426301 >> v2:172.21.15.31:3300/0 conn(0x7f32640afd90 0x7f326406a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f3263fff700 1 -- 172.21.15.31:0/2966426301 >> v1:172.21.15.158:6789/0 conn(0x7f326415e080 legacy=0x7f32640b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:07.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f3263fff700 1 -- 172.21.15.31:0/2966426301 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640b4da0 con 0x7f326415e450 2023-10-09T06:21:07.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3263fff700 1 --2- 172.21.15.31:0/2966426301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f326415e450 0x7f32640b6630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32500098e0 tx=0x7f32500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d9d4c01ed5f5b62 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f32637fe700 1 -- 172.21.15.31:0/2966426301 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011630 con 0x7f326415e450 2023-10-09T06:21:07.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f32637fe700 1 -- 172.21.15.31:0/2966426301 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250011790 con 0x7f326415e450 2023-10-09T06:21:07.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f32637fe700 1 -- 172.21.15.31:0/2966426301 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011b30 con 0x7f326415e450 2023-10-09T06:21:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df3bb9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06f820 0x7f3dec152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df3bb9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec0c30c0 0x7f3dec14f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df3bb9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3dec14d8b0 0x7f3dec16f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df3bb9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec16f060 con 0x7f3dec0c30c0 2023-10-09T06:21:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df3bb9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec14f9e0 con 0x7f3dec14d8b0 2023-10-09T06:21:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df3bb9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec14e0c0 con 0x7f3dec06f820 2023-10-09T06:21:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df1154700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec0c30c0 0x7f3dec14f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df1955700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06f820 0x7f3dec152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df1154700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec0c30c0 0x7f3dec14f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58484/0 (socket says 172.21.15.31:58484) 2023-10-09T06:21:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df1154700 1 -- 172.21.15.31:0/3984974238 learned_addr learned my addr 172.21.15.31:0/3984974238 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df1154700 1 -- 172.21.15.31:0/3984974238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06f820 msgr2=0x7f3dec152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df1154700 1 --2- 172.21.15.31:0/3984974238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06f820 0x7f3dec152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df1154700 1 -- 172.21.15.31:0/3984974238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3dec14d8b0 msgr2=0x7f3dec16f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df1154700 1 --2- 172.21.15.31:0/3984974238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3dec14d8b0 0x7f3dec16f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df1154700 1 -- 172.21.15.31:0/3984974238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de4009ae0 con 0x7f3dec0c30c0 2023-10-09T06:21:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f3df1154700 1 --2- 172.21.15.31:0/3984974238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec0c30c0 0x7f3dec14f4a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00d840 tx=0x7f3ddc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.705+0000 7fc00bfff700 1 --2- 172.21.15.31:0/582172009 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc010066f30 0x7fc0100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.705+0000 7fc00bfff700 1 -- 172.21.15.31:0/582172009 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc01c0860d0 con 0x7fc02415ac10 2023-10-09T06:21:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.705+0000 7fc023fff700 1 --2- 172.21.15.31:0/582172009 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc010066f30 0x7fc0100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.705+0000 7f326abad700 1 -- 172.21.15.31:0/2966426301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f326415e450 msgr2=0x7f32640b6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.705+0000 7f326abad700 1 --2- 172.21.15.31:0/2966426301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f326415e450 0x7f32640b6630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32500098e0 tx=0x7f32500091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.705+0000 7f326abad700 1 -- 172.21.15.31:0/2966426301 shutdown_connections 2023-10-09T06:21:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.705+0000 7f326abad700 1 --2- 172.21.15.31:0/2966426301 >> v2:172.21.15.31:3300/0 conn(0x7f32640afd90 0x7f326406a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.705+0000 7f326abad700 1 --2- 172.21.15.31:0/2966426301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f326415e450 0x7f32640b6630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.705+0000 7f326abad700 1 -- 172.21.15.31:0/2966426301 >> 172.21.15.31:0/2966426301 conn(0x7f3264068ce0 msgr2=0x7f32640690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:07.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.705+0000 7f326abad700 1 -- 172.21.15.31:0/2966426301 shutdown_connections 2023-10-09T06:21:07.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.705+0000 7f326abad700 1 -- 172.21.15.31:0/2966426301 wait complete. 2023-10-09T06:21:07.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7f05f15bb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05ec0c97d0 0x7f05ec0c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7f05f15bb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05ec156410 0x7f05ec176fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7f05f15bb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05ec157cc0 0x7f05ec1781f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7f05f15bb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0c3920 con 0x7f05ec157cc0 2023-10-09T06:21:07.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7f05f15bb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0c3c00 con 0x7f05ec0c97d0 2023-10-09T06:21:07.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7f05f15bb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0c5a80 con 0x7f05ec156410 2023-10-09T06:21:07.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7f05eaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05ec0c97d0 0x7f05ec0c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7f05eaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05ec0c97d0 0x7f05ec0c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:52686/0 (socket says 172.21.15.31:52686) 2023-10-09T06:21:07.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.702+0000 7f05eaffd700 1 -- 172.21.15.31:0/1660851544 learned_addr learned my addr 172.21.15.31:0/1660851544 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:07.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f05ea7fc700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05ec156410 0x7f05ec176fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f05eb7fe700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05ec157cc0 0x7f05ec1781f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f05eaffd700 1 -- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05ec156410 msgr2=0x7f05ec176fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f05eaffd700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05ec156410 0x7f05ec176fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f05eaffd700 1 -- 172.21.15.31:0/1660851544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05ec157cc0 msgr2=0x7f05ec1781f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f05eaffd700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05ec157cc0 0x7f05ec1781f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f05eaffd700 1 -- 172.21.15.31:0/1660851544 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc009420 con 0x7f05ec0c97d0 2023-10-09T06:21:07.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f05eb7fe700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05ec157cc0 0x7f05ec1781f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:07.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.703+0000 7f05eaffd700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05ec0c97d0 0x7f05ec0c5540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c790 tx=0x7f05d4007f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f05e2ffd700 1 -- 172.21.15.31:0/1660851544 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4011590 con 0x7f05ec0c97d0 2023-10-09T06:21:07.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f05e2ffd700 1 -- 172.21.15.31:0/1660851544 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d40116f0 con 0x7f05ec0c97d0 2023-10-09T06:21:07.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f05e2ffd700 1 -- 172.21.15.31:0/1660851544 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4011ab0 con 0x7f05ec0c97d0 2023-10-09T06:21:07.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.704+0000 7f05f15bb700 1 -- 172.21.15.31:0/1660851544 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ec1778c0 con 0x7f05ec0c97d0 2023-10-09T06:21:07.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.705+0000 7f05f15bb700 1 -- 172.21.15.31:0/1660851544 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ec177e80 con 0x7f05ec0c97d0 2023-10-09T06:21:07.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.706+0000 7f05e2ffd700 1 -- 172.21.15.31:0/1660851544 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05d401b3b0 con 0x7f05ec0c97d0 2023-10-09T06:21:07.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.707+0000 7f326abad700 1 Processor -- start 2023-10-09T06:21:07.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.707+0000 7f326abad700 1 -- start start 2023-10-09T06:21:07.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.707+0000 7f05e2ffd700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f05cc067000 0x7f05cc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.707+0000 7f05e2ffd700 1 -- 172.21.15.31:0/1660851544 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05d40837f0 con 0x7f05ec0c97d0 2023-10-09T06:21:07.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.707+0000 7f05ea7fc700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f05cc067000 0x7f05cc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f326abad700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32640afd90 0x7f326414baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7fc02a735700 1 -- 172.21.15.31:0/582172009 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc024172280 con 0x7fc02415ac10 2023-10-09T06:21:07.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f05ea7fc700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f05cc067000 0x7f05cc0694b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0030c0 tx=0x7f05dc018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f326abad700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f326415e080 0x7f326415b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f326abad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f326415e450 0x7f326415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f326abad700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264170830 con 0x7f326415e450 2023-10-09T06:21:07.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f326abad700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264170b10 con 0x7f326415e080 2023-10-09T06:21:07.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f326abad700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264170df0 con 0x7f32640afd90 2023-10-09T06:21:07.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f326914a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f326415e450 0x7f326415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f3263fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f326415e080 0x7f326415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f3263fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f326415e080 0x7f326415b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:52708/0 (socket says 172.21.15.31:52708) 2023-10-09T06:21:07.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f3263fff700 1 -- 172.21.15.31:0/1290306500 learned_addr learned my addr 172.21.15.31:0/1290306500 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:07.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f3268949700 1 --2- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32640afd90 0x7f326414baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f326914a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f326415e450 0x7f326415bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58490/0 (socket says 172.21.15.31:58490) 2023-10-09T06:21:07.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f3263fff700 1 -- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32640afd90 msgr2=0x7f326414baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f3263fff700 1 --2- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32640afd90 0x7f326414baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f3263fff700 1 -- 172.21.15.31:0/1290306500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f326415e450 msgr2=0x7f326415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:07.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f3263fff700 1 --2- 172.21.15.31:0/1290306500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f326415e450 0x7f326415bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:07.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.708+0000 7f3263fff700 1 -- 172.21.15.31:0/1290306500 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3250009420 con 0x7f326415e080 2023-10-09T06:21:07.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.709+0000 7f3263fff700 1 --2- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f326415e080 0x7f326415b890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f32500093f0 tx=0x7f3250016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.709+0000 7f05f15bb700 1 -- 172.21.15.31:0/1660851544 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ec158110 con 0x7f05ec0c97d0 2023-10-09T06:21:07.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.709+0000 7f3260ff9700 1 -- 172.21.15.31:0/1290306500 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325001bdf0 con 0x7f326415e080 2023-10-09T06:21:07.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.709+0000 7f3260ff9700 1 -- 172.21.15.31:0/1290306500 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250020070 con 0x7f326415e080 2023-10-09T06:21:07.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.709+0000 7f3260ff9700 1 -- 172.21.15.31:0/1290306500 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32500276b0 con 0x7f326415e080 2023-10-09T06:21:07.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.709+0000 7f326abad700 1 -- 172.21.15.31:0/1290306500 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32641710d0 con 0x7f326415e080 2023-10-09T06:21:07.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.709+0000 7f326abad700 1 -- 172.21.15.31:0/1290306500 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326414c030 con 0x7f326415e080 2023-10-09T06:21:07.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.710+0000 7fc023fff700 1 --2- 172.21.15.31:0/582172009 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc010066f30 0x7fc0100693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0180069f0 tx=0x7fc018007f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.710+0000 7f2e8cff9700 1 -- 172.21.15.31:0/3195039923 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e7c053050 con 0x7f2e90156570 2023-10-09T06:21:07.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.710+0000 7f326abad700 1 -- 172.21.15.31:0/1290306500 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32641715f0 con 0x7f326415e080 2023-10-09T06:21:07.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.712+0000 7f3de1ffb700 1 -- 172.21.15.31:0/3984974238 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0125f0 con 0x7f3dec0c30c0 2023-10-09T06:21:07.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.712+0000 7f3de1ffb700 1 -- 172.21.15.31:0/3984974238 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc012750 con 0x7f3dec0c30c0 2023-10-09T06:21:07.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.712+0000 7f3de1ffb700 1 -- 172.21.15.31:0/3984974238 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc012af0 con 0x7f3dec0c30c0 2023-10-09T06:21:07.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.712+0000 7f3df3bb9700 1 -- 172.21.15.31:0/3984974238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec14e3a0 con 0x7f3dec0c30c0 2023-10-09T06:21:07.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.713+0000 7f3df3bb9700 1 -- 172.21.15.31:0/3984974238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec16ec20 con 0x7f3dec0c30c0 2023-10-09T06:21:07.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.712+0000 7fe098ff9700 1 -- 172.21.15.31:0/4197890422 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe090052f40 con 0x7fe09c0c9560 2023-10-09T06:21:07.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.714+0000 7f3df3bb9700 1 -- 172.21.15.31:0/3984974238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec16f1a0 con 0x7f3dec0c30c0 2023-10-09T06:21:07.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.714+0000 7f3de1ffb700 1 -- 172.21.15.31:0/3984974238 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ddc013480 con 0x7f3dec0c30c0 2023-10-09T06:21:07.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.714+0000 7f3de1ffb700 1 --2- 172.21.15.31:0/3984974238 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3dd0066f30 0x7f3dd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.714+0000 7f3de1ffb700 1 -- 172.21.15.31:0/3984974238 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ddc084870 con 0x7f3dec0c30c0 2023-10-09T06:21:07.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.715+0000 7f3df1955700 1 --2- 172.21.15.31:0/3984974238 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3dd0066f30 0x7f3dd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.715+0000 7f3df1955700 1 --2- 172.21.15.31:0/3984974238 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3dd0066f30 0x7f3dd00693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009ab0 tx=0x7f3de8009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.716+0000 7fc00bfff700 1 -- 172.21.15.31:0/582172009 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc01c053340 con 0x7fc02415ac10 2023-10-09T06:21:07.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.717+0000 7f05e2ffd700 1 -- 172.21.15.31:0/1660851544 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05ec158110 con 0x7f05ec0c97d0 2023-10-09T06:21:07.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.718+0000 7f3260ff9700 1 -- 172.21.15.31:0/1290306500 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f325001c450 con 0x7f326415e080 2023-10-09T06:21:07.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.719+0000 7f3260ff9700 1 --2- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3248066f30 0x7f32480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:07.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.719+0000 7f3260ff9700 1 -- 172.21.15.31:0/1290306500 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3250022070 con 0x7f326415e080 2023-10-09T06:21:07.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.719+0000 7f3268949700 1 --2- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3248066f30 0x7f32480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:07.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.720+0000 7f3268949700 1 --2- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3248066f30 0x7f32480693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32640cd900 tx=0x7f3258009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:07.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.720+0000 7f3de1ffb700 1 -- 172.21.15.31:0/3984974238 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3dec16f1a0 con 0x7f3dec0c30c0 2023-10-09T06:21:07.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:07.721+0000 7f3260ff9700 1 -- 172.21.15.31:0/1290306500 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3250053850 con 0x7f326415e080 2023-10-09T06:21:08.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.067+0000 7f7cfc54a700 1 -- 172.21.15.31:0/4269737769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7cdc005560 con 0x7f7ce0004810 2023-10-09T06:21:08.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.067+0000 7f7cea7fc700 1 -- 172.21.15.31:0/4269737769 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7cec0557f0 con 0x7f7ce0004810 2023-10-09T06:21:08.071 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:08.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.071+0000 7f7cfc54a700 1 -- 172.21.15.31:0/4269737769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7cd8067080 msgr2=0x7f7cd8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.071+0000 7f7cfc54a700 1 --2- 172.21.15.31:0/4269737769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7cd8067080 0x7f7cd8069530 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0001790 tx=0x7f7cf0015000 comp rx=0 tx=0).stop 2023-10-09T06:21:08.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.071+0000 7f7cfc54a700 1 -- 172.21.15.31:0/4269737769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ce0004810 msgr2=0x7f7cf40a6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.071+0000 7f7cfc54a700 1 --2- 172.21.15.31:0/4269737769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ce0004810 0x7f7cf40a6e90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00e540 tx=0x7f7cec0021d0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.071+0000 7f7cfc54a700 1 -- 172.21.15.31:0/4269737769 shutdown_connections 2023-10-09T06:21:08.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.071+0000 7f7cfc54a700 1 --2- 172.21.15.31:0/4269737769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7cd8067080 0x7f7cd8069530 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.071+0000 7f7cfc54a700 1 --2- 172.21.15.31:0/4269737769 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cf40a9680 0x7f7cf40a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.071+0000 7f7cfc54a700 1 --2- 172.21.15.31:0/4269737769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ce0004810 0x7f7cf40a6e90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.071+0000 7f7cfc54a700 1 --2- 172.21.15.31:0/4269737769 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cf417a400 0x7f7cf417a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.071+0000 7f7cfc54a700 1 -- 172.21.15.31:0/4269737769 >> 172.21.15.31:0/4269737769 conn(0x7f7cf4070700 msgr2=0x7f7cf40c3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:08.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.071+0000 7f7cfc54a700 1 -- 172.21.15.31:0/4269737769 shutdown_connections 2023-10-09T06:21:08.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.072+0000 7f7cfc54a700 1 -- 172.21.15.31:0/4269737769 wait complete. 2023-10-09T06:21:08.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-09T06:21:08.090 DEBUG:teuthology.parallel:result is None 2023-10-09T06:21:08.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.105+0000 7fe0a303a700 1 -- 172.21.15.31:0/4197890422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe09c0c2950 con 0x7fe09c0c9560 2023-10-09T06:21:08.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.105+0000 7fe098ff9700 1 -- 172.21.15.31:0/4197890422 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe09002b020 con 0x7fe09c0c9560 2023-10-09T06:21:08.106 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:08.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.106+0000 7f326abad700 1 -- 172.21.15.31:0/1290306500 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f32641715f0 con 0x7f326415e080 2023-10-09T06:21:08.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.107+0000 7f3260ff9700 1 -- 172.21.15.31:0/1290306500 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f32641715f0 con 0x7f326415e080 2023-10-09T06:21:08.108 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.109+0000 7fa95633c700 1 -- 172.21.15.31:0/1711896363 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa95004c3c0 con 0x7fa9500adcd0 2023-10-09T06:21:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.109+0000 7fe0a303a700 1 -- 172.21.15.31:0/4197890422 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe088066f30 msgr2=0x7fe0880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.109+0000 7fe0a303a700 1 --2- 172.21.15.31:0/4197890422 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe088066f30 0x7fe0880693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe09400f570 tx=0x7fe09400b040 comp rx=0 tx=0).stop 2023-10-09T06:21:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.109+0000 7fe0a303a700 1 -- 172.21.15.31:0/4197890422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe09c0c9560 msgr2=0x7fe09c171a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.109+0000 7fe0a303a700 1 --2- 172.21.15.31:0/4197890422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe09c0c9560 0x7fe09c171a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe090016000 tx=0x7fe090017000 comp rx=0 tx=0).stop 2023-10-09T06:21:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.109+0000 7fe0a303a700 1 -- 172.21.15.31:0/4197890422 shutdown_connections 2023-10-09T06:21:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.109+0000 7fe0a303a700 1 --2- 172.21.15.31:0/4197890422 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe088066f30 0x7fe0880693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.109+0000 7fe0a303a700 1 --2- 172.21.15.31:0/4197890422 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe09c0c9930 0x7fe09c1470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.109+0000 7fe0a303a700 1 --2- 172.21.15.31:0/4197890422 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe09c069de0 0x7fe09c0c1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.109+0000 7fe0a303a700 1 --2- 172.21.15.31:0/4197890422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe09c0c9560 0x7fe09c171a40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.109+0000 7fe0a303a700 1 -- 172.21.15.31:0/4197890422 >> 172.21.15.31:0/4197890422 conn(0x7fe09c067660 msgr2=0x7fe09c06e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:08.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.109+0000 7fa947fff700 1 -- 172.21.15.31:0/1711896363 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa938050c60 con 0x7fa9500adcd0 2023-10-09T06:21:08.113 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:08.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.110+0000 7fe0a303a700 1 -- 172.21.15.31:0/4197890422 shutdown_connections 2023-10-09T06:21:08.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.110+0000 7fe0a303a700 1 -- 172.21.15.31:0/4197890422 wait complete. 2023-10-09T06:21:08.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7fa95633c700 1 -- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa930067080 msgr2=0x7fa930069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7fa95633c700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa930067080 0x7fa930069530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa94800a910 tx=0x7fa948018000 comp rx=0 tx=0).stop 2023-10-09T06:21:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7f2e96f52700 1 -- 172.21.15.31:0/3195039923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e70005830 con 0x7f2e90156570 2023-10-09T06:21:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7fa95633c700 1 -- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9500adcd0 msgr2=0x7fa9500a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7fa95633c700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9500adcd0 0x7fa9500a3d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa93800c790 tx=0x7fa938007f60 comp rx=0 tx=0).stop 2023-10-09T06:21:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7fa95633c700 1 -- 172.21.15.31:0/1711896363 shutdown_connections 2023-10-09T06:21:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7fa95633c700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa930067080 0x7fa930069530 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7fa95633c700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa95006eab0 0x7fa9500a5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7fa95633c700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9500af6a0 0x7fa9500a6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7fa95633c700 1 --2- 172.21.15.31:0/1711896363 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9500adcd0 0x7fa9500a3d80 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa93800c790 tx=0x7fa938007f60 comp rx=0 tx=0).stop 2023-10-09T06:21:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7fa95633c700 1 -- 172.21.15.31:0/1711896363 >> 172.21.15.31:0/1711896363 conn(0x7fa9500cd1e0 msgr2=0x7fa9500b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7f326abad700 1 -- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3248066f30 msgr2=0x7f32480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7f326abad700 1 --2- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3248066f30 0x7f32480693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32640cd900 tx=0x7f3258009040 comp rx=0 tx=0).stop 2023-10-09T06:21:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7f326abad700 1 -- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f326415e080 msgr2=0x7f326415b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.112+0000 7f326abad700 1 --2- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f326415e080 0x7f326415b890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f32500093f0 tx=0x7f3250016000 comp rx=0 tx=0).stop 2023-10-09T06:21:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.113+0000 7fa95633c700 1 -- 172.21.15.31:0/1711896363 shutdown_connections 2023-10-09T06:21:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.113+0000 7fa95633c700 1 -- 172.21.15.31:0/1711896363 wait complete. 2023-10-09T06:21:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.114+0000 7f326abad700 1 -- 172.21.15.31:0/1290306500 shutdown_connections 2023-10-09T06:21:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.114+0000 7f326abad700 1 --2- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3248066f30 0x7f32480693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.114+0000 7f326abad700 1 --2- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32640afd90 0x7f326414baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.114+0000 7f326abad700 1 --2- 172.21.15.31:0/1290306500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f326415e450 0x7f326415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.114+0000 7f326abad700 1 --2- 172.21.15.31:0/1290306500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f326415e080 0x7f326415b890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.114+0000 7f326abad700 1 -- 172.21.15.31:0/1290306500 >> 172.21.15.31:0/1290306500 conn(0x7f3264068ce0 msgr2=0x7f32640b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.114+0000 7f326abad700 1 -- 172.21.15.31:0/1290306500 shutdown_connections 2023-10-09T06:21:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.114+0000 7f326abad700 1 -- 172.21.15.31:0/1290306500 wait complete. 2023-10-09T06:21:08.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.115+0000 7f2e8cff9700 1 -- 172.21.15.31:0/3195039923 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e7c056670 con 0x7f2e90156570 2023-10-09T06:21:08.118 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:08.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.119+0000 7f2e96f52700 1 -- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2e74067000 msgr2=0x7f2e740694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.119+0000 7f2e96f52700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2e74067000 0x7f2e740694b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2e900c33f0 tx=0x7f2e840091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.119+0000 7f2e96f52700 1 -- 172.21.15.31:0/3195039923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e90156570 msgr2=0x7f2e900c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.119+0000 7f2e96f52700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e90156570 0x7f2e900c5e60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2e9006ba00 tx=0x7f2e7c01e000 comp rx=0 tx=0).stop 2023-10-09T06:21:08.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.120+0000 7f2e96f52700 1 -- 172.21.15.31:0/3195039923 shutdown_connections 2023-10-09T06:21:08.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.120+0000 7f2e96f52700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2e74067000 0x7f2e740694b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.120+0000 7f2e96f52700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e9015a330 0x7f2e900b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.120+0000 7f2e96f52700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e90156570 0x7f2e900c5e60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.120+0000 7f2e96f52700 1 --2- 172.21.15.31:0/3195039923 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e90156940 0x7f2e9014dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.120+0000 7f2e96f52700 1 -- 172.21.15.31:0/3195039923 >> 172.21.15.31:0/3195039923 conn(0x7f2e90067660 msgr2=0x7f2e9006a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:08.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.125+0000 7f05f15bb700 1 -- 172.21.15.31:0/1660851544 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f05ec158110 con 0x7f05ec0c97d0 2023-10-09T06:21:08.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.120+0000 7f2e96f52700 1 -- 172.21.15.31:0/3195039923 shutdown_connections 2023-10-09T06:21:08.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.125+0000 7f2e96f52700 1 -- 172.21.15.31:0/3195039923 wait complete. 2023-10-09T06:21:08.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.125+0000 7f05e2ffd700 1 -- 172.21.15.31:0/1660851544 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05ec158110 con 0x7f05ec0c97d0 2023-10-09T06:21:08.126 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:08.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-10-09T06:21:08.128 DEBUG:teuthology.parallel:result is None 2023-10-09T06:21:08.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.128+0000 7fc02a735700 1 -- 172.21.15.31:0/582172009 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc02404c3c0 con 0x7fc02415ac10 2023-10-09T06:21:08.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.129+0000 7f05f15bb700 1 -- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f05cc067000 msgr2=0x7f05cc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.129+0000 7f05f15bb700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f05cc067000 0x7f05cc0694b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0030c0 tx=0x7f05dc018000 comp rx=0 tx=0).stop 2023-10-09T06:21:08.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.129+0000 7f05f15bb700 1 -- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05ec0c97d0 msgr2=0x7f05ec0c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.129+0000 7f05f15bb700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05ec0c97d0 0x7f05ec0c5540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c790 tx=0x7f05d4007f40 comp rx=0 tx=0).stop 2023-10-09T06:21:08.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.129+0000 7fc00bfff700 1 -- 172.21.15.31:0/582172009 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc01c023090 con 0x7fc02415ac10 2023-10-09T06:21:08.130 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:08.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.130+0000 7f3df3bb9700 1 -- 172.21.15.31:0/3984974238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3dec16f1a0 con 0x7f3dec0c30c0 2023-10-09T06:21:08.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.130+0000 7f3de1ffb700 1 -- 172.21.15.31:0/3984974238 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3dec16f1a0 con 0x7f3dec0c30c0 2023-10-09T06:21:08.131 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-10-09T06:21:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.131+0000 7fc02a735700 1 -- 172.21.15.31:0/582172009 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc010066f30 msgr2=0x7fc0100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.131+0000 7fc02a735700 1 --2- 172.21.15.31:0/582172009 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc010066f30 0x7fc0100693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0180069f0 tx=0x7fc018007f90 comp rx=0 tx=0).stop 2023-10-09T06:21:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.131+0000 7fc02a735700 1 -- 172.21.15.31:0/582172009 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 msgr2=0x7fc024165120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.131+0000 7fc02a735700 1 --2- 172.21.15.31:0/582172009 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 0x7fc024165120 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0240ccf30 tx=0x7fc01c019000 comp rx=0 tx=0).stop 2023-10-09T06:21:08.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-09T06:21:08.133 DEBUG:teuthology.parallel:result is None 2023-10-09T06:21:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.134+0000 7f3df3bb9700 1 -- 172.21.15.31:0/3984974238 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3dd0066f30 msgr2=0x7f3dd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.134+0000 7f3df3bb9700 1 --2- 172.21.15.31:0/3984974238 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3dd0066f30 0x7f3dd00693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009ab0 tx=0x7f3de8009060 comp rx=0 tx=0).stop 2023-10-09T06:21:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.134+0000 7f3df3bb9700 1 -- 172.21.15.31:0/3984974238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec0c30c0 msgr2=0x7f3dec14f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.134+0000 7f3df3bb9700 1 --2- 172.21.15.31:0/3984974238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec0c30c0 0x7f3dec14f4a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00d840 tx=0x7f3ddc008040 comp rx=0 tx=0).stop 2023-10-09T06:21:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.134+0000 7f3df3bb9700 1 -- 172.21.15.31:0/3984974238 shutdown_connections 2023-10-09T06:21:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.134+0000 7f3df3bb9700 1 --2- 172.21.15.31:0/3984974238 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3dd0066f30 0x7f3dd00693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.134+0000 7f3df3bb9700 1 --2- 172.21.15.31:0/3984974238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3dec06f820 0x7f3dec152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.134+0000 7f3df3bb9700 1 --2- 172.21.15.31:0/3984974238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3dec14d8b0 0x7f3dec16f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.134+0000 7f3df3bb9700 1 --2- 172.21.15.31:0/3984974238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dec0c30c0 0x7f3dec14f4a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.134+0000 7f3df3bb9700 1 -- 172.21.15.31:0/3984974238 >> 172.21.15.31:0/3984974238 conn(0x7f3dec0ca4f0 msgr2=0x7f3dec153f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.134+0000 7f3df3bb9700 1 -- 172.21.15.31:0/3984974238 shutdown_connections 2023-10-09T06:21:08.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.134+0000 7f3df3bb9700 1 -- 172.21.15.31:0/3984974238 wait complete. 2023-10-09T06:21:08.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.135+0000 7f05f15bb700 1 -- 172.21.15.31:0/1660851544 shutdown_connections 2023-10-09T06:21:08.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.135+0000 7f05f15bb700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f05cc067000 0x7f05cc0694b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.135+0000 7f05f15bb700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05ec157cc0 0x7f05ec1781f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.135+0000 7f05f15bb700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05ec0c97d0 0x7f05ec0c5540 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.135+0000 7f05f15bb700 1 --2- 172.21.15.31:0/1660851544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f05ec156410 0x7f05ec176fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.135+0000 7f05f15bb700 1 -- 172.21.15.31:0/1660851544 >> 172.21.15.31:0/1660851544 conn(0x7f05ec070700 msgr2=0x7f05ec0c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:08.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.135+0000 7f05f15bb700 1 -- 172.21.15.31:0/1660851544 shutdown_connections 2023-10-09T06:21:08.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.135+0000 7f05f15bb700 1 -- 172.21.15.31:0/1660851544 wait complete. 2023-10-09T06:21:08.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.137+0000 7fc02a735700 1 -- 172.21.15.31:0/582172009 shutdown_connections 2023-10-09T06:21:08.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.137+0000 7fc02a735700 1 --2- 172.21.15.31:0/582172009 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc010066f30 0x7fc0100693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.137+0000 7fc02a735700 1 --2- 172.21.15.31:0/582172009 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc02415ac10 0x7fc024165120 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.137+0000 7fc02a735700 1 --2- 172.21.15.31:0/582172009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0241561e0 0x7fc02414a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.137+0000 7fc02a735700 1 --2- 172.21.15.31:0/582172009 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0241565b0 0x7fc02414bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.137+0000 7fc02a735700 1 -- 172.21.15.31:0/582172009 >> 172.21.15.31:0/582172009 conn(0x7fc0240cd1e0 msgr2=0x7fc024150570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.137+0000 7fc02a735700 1 -- 172.21.15.31:0/582172009 shutdown_connections 2023-10-09T06:21:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.137+0000 7fc02a735700 1 -- 172.21.15.31:0/582172009 wait complete. 2023-10-09T06:21:08.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-09T06:21:08.140 DEBUG:teuthology.parallel:result is None 2023-10-09T06:21:08.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-10-09T06:21:08.149 DEBUG:teuthology.parallel:result is None 2023-10-09T06:21:08.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-09T06:21:08.152 DEBUG:teuthology.parallel:result is None 2023-10-09T06:21:08.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-09T06:21:08.153 DEBUG:teuthology.parallel:result is None 2023-10-09T06:21:08.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-09T06:21:08.155 DEBUG:teuthology.parallel:result is None 2023-10-09T06:21:08.155 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-09T06:21:08.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:21:08.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.313+0000 7f41088fd700 1 Processor -- start 2023-10-09T06:21:08.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.313+0000 7f41088fd700 1 -- start start 2023-10-09T06:21:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41088fd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41040cd6e0 0x7f41040cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41088fd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41040cdab0 0x7f410415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41088fd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f410415dda0 0x7f410415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41088fd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410415e850 con 0x7f41040cd6e0 2023-10-09T06:21:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41088fd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41040cd030 con 0x7f410415dda0 2023-10-09T06:21:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41088fd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41040cb7c0 con 0x7f41040cdab0 2023-10-09T06:21:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41037fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41040cd6e0 0x7f41040cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41037fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41040cd6e0 0x7f41040cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58492/0 (socket says 172.21.15.31:58492) 2023-10-09T06:21:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41037fe700 1 -- 172.21.15.31:0/243224012 learned_addr learned my addr 172.21.15.31:0/243224012 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f4102ffd700 1 --2- 172.21.15.31:0/243224012 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41040cdab0 0x7f410415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f4103fff700 1 --2- 172.21.15.31:0/243224012 >> v2:172.21.15.158:3300/0 conn(0x7f410415dda0 0x7f410415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41037fe700 1 -- 172.21.15.31:0/243224012 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41040cdab0 msgr2=0x7f410415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41037fe700 1 --2- 172.21.15.31:0/243224012 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41040cdab0 0x7f410415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41037fe700 1 -- 172.21.15.31:0/243224012 >> v2:172.21.15.158:3300/0 conn(0x7f410415dda0 msgr2=0x7f410415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41037fe700 1 --2- 172.21.15.31:0/243224012 >> v2:172.21.15.158:3300/0 conn(0x7f410415dda0 0x7f410415cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.314+0000 7f41037fe700 1 -- 172.21.15.31:0/243224012 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410415e290 con 0x7f41040cd6e0 2023-10-09T06:21:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.315+0000 7f41037fe700 1 --2- 172.21.15.31:0/243224012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41040cd6e0 0x7f41040cbc50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4104089ac0 tx=0x7f40f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da828b0a76e60129 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.315+0000 7f41027fc700 1 -- 172.21.15.31:0/243224012 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f400b860 con 0x7f41040cd6e0 2023-10-09T06:21:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.315+0000 7f41027fc700 1 -- 172.21.15.31:0/243224012 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f400b9c0 con 0x7f41040cd6e0 2023-10-09T06:21:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.315+0000 7f41027fc700 1 -- 172.21.15.31:0/243224012 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f400bd60 con 0x7f41040cd6e0 2023-10-09T06:21:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.315+0000 7f41088fd700 1 -- 172.21.15.31:0/243224012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41040cd6e0 msgr2=0x7f41040cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.315+0000 7f41088fd700 1 --2- 172.21.15.31:0/243224012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41040cd6e0 0x7f41040cbc50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4104089ac0 tx=0x7f40f4009250 comp rx=0 tx=0).stop 2023-10-09T06:21:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.315+0000 7f41088fd700 1 -- 172.21.15.31:0/243224012 shutdown_connections 2023-10-09T06:21:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.315+0000 7f41088fd700 1 --2- 172.21.15.31:0/243224012 >> v2:172.21.15.158:3300/0 conn(0x7f410415dda0 0x7f410415cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.315+0000 7f41088fd700 1 --2- 172.21.15.31:0/243224012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41040cd6e0 0x7f41040cbc50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.315+0000 7f41088fd700 1 --2- 172.21.15.31:0/243224012 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41040cdab0 0x7f410415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.315+0000 7f41088fd700 1 -- 172.21.15.31:0/243224012 >> 172.21.15.31:0/243224012 conn(0x7f4104067660 msgr2=0x7f4104067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:08.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.315+0000 7f41088fd700 1 -- 172.21.15.31:0/243224012 shutdown_connections 2023-10-09T06:21:08.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.315+0000 7f41088fd700 1 -- 172.21.15.31:0/243224012 wait complete. 2023-10-09T06:21:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.317+0000 7f41088fd700 1 Processor -- start 2023-10-09T06:21:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.317+0000 7f41088fd700 1 -- start start 2023-10-09T06:21:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.317+0000 7f41088fd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41040cd6e0 0x7f410414d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.317+0000 7f41088fd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41040cdab0 0x7f410416da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.317+0000 7f41088fd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f410415dda0 0x7f410416ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.317+0000 7f41088fd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41040b68e0 con 0x7f41040cd6e0 2023-10-09T06:21:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.317+0000 7f41088fd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41040c7ec0 con 0x7f410415dda0 2023-10-09T06:21:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.317+0000 7f41088fd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410414d840 con 0x7f41040cdab0 2023-10-09T06:21:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.317+0000 7f41037fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41040cd6e0 0x7f410414d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.317+0000 7f41037fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41040cd6e0 0x7f410414d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58504/0 (socket says 172.21.15.31:58504) 2023-10-09T06:21:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.317+0000 7f41037fe700 1 -- 172.21.15.31:0/2426569420 learned_addr learned my addr 172.21.15.31:0/2426569420 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.317+0000 7f4103fff700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f410415dda0 0x7f410416ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.317+0000 7f4102ffd700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41040cdab0 0x7f410416da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.318+0000 7f41037fe700 1 -- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41040cdab0 msgr2=0x7f410416da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.318+0000 7f41037fe700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41040cdab0 0x7f410416da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.318+0000 7f41037fe700 1 -- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f410415dda0 msgr2=0x7f410416ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.318+0000 7f41037fe700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f410415dda0 0x7f410416ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.318+0000 7f41037fe700 1 -- 172.21.15.31:0/2426569420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f40094f0 con 0x7f41040cd6e0 2023-10-09T06:21:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.318+0000 7f41037fe700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41040cd6e0 0x7f410414d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f40f4006fd0 tx=0x7f40f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.318+0000 7f40eb7fe700 1 -- 172.21.15.31:0/2426569420 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f400bd40 con 0x7f41040cd6e0 2023-10-09T06:21:08.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.318+0000 7f40eb7fe700 1 -- 172.21.15.31:0/2426569420 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f401a420 con 0x7f41040cd6e0 2023-10-09T06:21:08.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.318+0000 7f41088fd700 1 -- 172.21.15.31:0/2426569420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410416a880 con 0x7f41040cd6e0 2023-10-09T06:21:08.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.318+0000 7f40eb7fe700 1 -- 172.21.15.31:0/2426569420 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f401a7a0 con 0x7f41040cd6e0 2023-10-09T06:21:08.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.318+0000 7f41088fd700 1 -- 172.21.15.31:0/2426569420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410416e810 con 0x7f41040cd6e0 2023-10-09T06:21:08.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.319+0000 7f41088fd700 1 -- 172.21.15.31:0/2426569420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4104089280 con 0x7f41040cd6e0 2023-10-09T06:21:08.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.319+0000 7f40eb7fe700 1 -- 172.21.15.31:0/2426569420 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40f401ab10 con 0x7f41040cd6e0 2023-10-09T06:21:08.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.320+0000 7f40eb7fe700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f40f0066f30 0x7f40f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.320+0000 7f40eb7fe700 1 -- 172.21.15.31:0/2426569420 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40f4085f70 con 0x7f41040cd6e0 2023-10-09T06:21:08.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.320+0000 7f4102ffd700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f40f0066f30 0x7f40f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.320+0000 7f4102ffd700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f40f0066f30 0x7f40f00693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f410416ea70 tx=0x7f40f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:08.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.324+0000 7f40eb7fe700 1 -- 172.21.15.31:0/2426569420 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40f4053140 con 0x7f41040cd6e0 2023-10-09T06:21:08.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.512+0000 7f41088fd700 1 -- 172.21.15.31:0/2426569420 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f410415e570 con 0x7f40f0066f30 2023-10-09T06:21:08.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.521+0000 7f40eb7fe700 1 -- 172.21.15.31:0/2426569420 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260091 (secure 0 0 0) 0x7f410415e570 con 0x7f40f0066f30 2023-10-09T06:21:08.524 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.524+0000 7f41088fd700 1 -- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f40f0066f30 msgr2=0x7f40f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.524+0000 7f41088fd700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f40f0066f30 0x7f40f00693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f410416ea70 tx=0x7f40f8008040 comp rx=0 tx=0).stop 2023-10-09T06:21:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.524+0000 7f41088fd700 1 -- 172.21.15.31:0/2426569420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41040cd6e0 msgr2=0x7f410414d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.524+0000 7f41088fd700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41040cd6e0 0x7f410414d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f40f4006fd0 tx=0x7f40f4017000 comp rx=0 tx=0).stop 2023-10-09T06:21:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.524+0000 7f41088fd700 1 -- 172.21.15.31:0/2426569420 shutdown_connections 2023-10-09T06:21:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.524+0000 7f41088fd700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f40f0066f30 0x7f40f00693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.524+0000 7f41088fd700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f410415dda0 0x7f410416ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.524+0000 7f41088fd700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41040cd6e0 0x7f410414d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.524+0000 7f41088fd700 1 --2- 172.21.15.31:0/2426569420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f41040cdab0 0x7f410416da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.524+0000 7f41088fd700 1 -- 172.21.15.31:0/2426569420 >> 172.21.15.31:0/2426569420 conn(0x7f4104067660 msgr2=0x7f4104157070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.524+0000 7f41088fd700 1 -- 172.21.15.31:0/2426569420 shutdown_connections 2023-10-09T06:21:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.524+0000 7f41088fd700 1 -- 172.21.15.31:0/2426569420 wait complete. 2023-10-09T06:21:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:21:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T06:21:06.514585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1708,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560791,"statfs":{"total":1600000000,"available":1598250700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.819121"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701803+0000","last_change":"2023-10-09T06:20:54.699452+0000","last_active":"2023-10-09T06:20:54.701803+0000","last_peered":"2023-10-09T06:20:54.701803+0000","last_clean":"2023-10-09T06:20:54.701803+0000","last_became_active":"2023-10-09T06:20:54.699233+0000","last_became_peered":"2023-10-09T06:20:54.699233+0000","last_unstale":"2023-10-09T06:20:54.701803+0000","last_undegraded":"2023-10-09T06:20:54.701803+0000","last_fullsized":"2023-10-09T06:20:54.701803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:22.187237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704394+0000","last_change":"2023-10-09T06:20:54.703624+0000","last_active":"2023-10-09T06:20:54.704394+0000","last_peered":"2023-10-09T06:20:54.704394+0000","last_clean":"2023-10-09T06:20:54.704394+0000","last_became_active":"2023-10-09T06:20:54.703378+0000","last_became_peered":"2023-10-09T06:20:54.703378+0000","last_unstale":"2023-10-09T06:20:54.704394+0000","last_undegraded":"2023-10-09T06:20:54.704394+0000","last_fullsized":"2023-10-09T06:20:54.704394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.698154+0000","last_change":"2023-10-09T06:20:54.698072+0000","last_active":"2023-10-09T06:20:54.698154+0000","last_peered":"2023-10-09T06:20:54.698154+0000","last_clean":"2023-10-09T06:20:54.698154+0000","last_became_active":"2023-10-09T06:20:54.697793+0000","last_became_peered":"2023-10-09T06:20:54.697793+0000","last_unstale":"2023-10-09T06:20:54.698154+0000","last_undegraded":"2023-10-09T06:20:54.698154+0000","last_fullsized":"2023-10-09T06:20:54.698154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:13:00.912045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710137+0000","last_change":"2023-10-09T06:20:54.710027+0000","last_active":"2023-10-09T06:20:54.710137+0000","last_peered":"2023-10-09T06:20:54.710137+0000","last_clean":"2023-10-09T06:20:54.710137+0000","last_became_active":"2023-10-09T06:20:54.709311+0000","last_became_peered":"2023-10-09T06:20:54.709311+0000","last_unstale":"2023-10-09T06:20:54.710137+0000","last_undegraded":"2023-10-09T06:20:54.710137+0000","last_fullsized":"2023-10-09T06:20:54.710137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:14.974632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701768+0000","last_change":"2023-10-09T06:20:54.698108+0000","last_active":"2023-10-09T06:20:54.701768+0000","last_peered":"2023-10-09T06:20:54.701768+0000","last_clean":"2023-10-09T06:20:54.701768+0000","last_became_active":"2023-10-09T06:20:54.697253+0000","last_became_peered":"2023-10-09T06:20:54.697253+0000","last_unstale":"2023-10-09T06:20:54.701768+0000","last_undegraded":"2023-10-09T06:20:54.701768+0000","last_fullsized":"2023-10-09T06:20:54.701768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:25.482181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.714409+0000","last_change":"2023-10-09T06:20:54.714338+0000","last_active":"2023-10-09T06:20:54.714409+0000","last_peered":"2023-10-09T06:20:54.714409+0000","last_clean":"2023-10-09T06:20:54.714409+0000","last_became_active":"2023-10-09T06:20:54.710317+0000","last_became_peered":"2023-10-09T06:20:54.710317+0000","last_unstale":"2023-10-09T06:20:54.714409+0000","last_undegraded":"2023-10-09T06:20:54.714409+0000","last_fullsized":"2023-10-09T06:20:54.714409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:41:46.658358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701791+0000","last_change":"2023-10-09T06:20:54.699210+0000","last_active":"2023-10-09T06:20:54.701791+0000","last_peered":"2023-10-09T06:20:54.701791+0000","last_clean":"2023-10-09T06:20:54.701791+0000","last_became_active":"2023-10-09T06:20:54.698983+0000","last_became_peered":"2023-10-09T06:20:54.698983+0000","last_unstale":"2023-10-09T06:20:54.701791+0000","last_undegraded":"2023-10-09T06:20:54.701791+0000","last_fullsized":"2023-10-09T06:20:54.701791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:36.680555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707224+0000","last_change":"2023-10-09T06:20:54.706806+0000","last_active":"2023-10-09T06:20:54.707224+0000","last_peered":"2023-10-09T06:20:54.707224+0000","last_clean":"2023-10-09T06:20:54.707224+0000","last_became_active":"2023-10-09T06:20:54.706576+0000","last_became_peered":"2023-10-09T06:20:54.706576+0000","last_unstale":"2023-10-09T06:20:54.707224+0000","last_undegraded":"2023-10-09T06:20:54.707224+0000","last_fullsized":"2023-10-09T06:20:54.707224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708515+0000","last_change":"2023-10-09T06:20:54.708381+0000","last_active":"2023-10-09T06:20:54.708515+0000","last_peered":"2023-10-09T06:20:54.708515+0000","last_clean":"2023-10-09T06:20:54.708515+0000","last_became_active":"2023-10-09T06:20:54.708151+0000","last_became_peered":"2023-10-09T06:20:54.708151+0000","last_unstale":"2023-10-09T06:20:54.708515+0000","last_undegraded":"2023-10-09T06:20:54.708515+0000","last_fullsized":"2023-10-09T06:20:54.708515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:09.107980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707948+0000","last_change":"2023-10-09T06:20:54.707785+0000","last_active":"2023-10-09T06:20:54.707948+0000","last_peered":"2023-10-09T06:20:54.707948+0000","last_clean":"2023-10-09T06:20:54.707948+0000","last_became_active":"2023-10-09T06:20:54.707546+0000","last_became_peered":"2023-10-09T06:20:54.707546+0000","last_unstale":"2023-10-09T06:20:54.707948+0000","last_undegraded":"2023-10-09T06:20:54.707948+0000","last_fullsized":"2023-10-09T06:20:54.707948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.714127+0000","last_change":"2023-10-09T06:20:54.714014+0000","last_active":"2023-10-09T06:20:54.714127+0000","last_peered":"2023-10-09T06:20:54.714127+0000","last_clean":"2023-10-09T06:20:54.714127+0000","last_became_active":"2023-10-09T06:20:54.713717+0000","last_became_peered":"2023-10-09T06:20:54.713717+0000","last_unstale":"2023-10-09T06:20:54.714127+0000","last_undegraded":"2023-10-09T06:20:54.714127+0000","last_fullsized":"2023-10-09T06:20:54.714127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704060+0000","last_change":"2023-10-09T06:20:54.703797+0000","last_active":"2023-10-09T06:20:54.704060+0000","last_peered":"2023-10-09T06:20:54.704060+0000","last_clean":"2023-10-09T06:20:54.704060+0000","last_became_active":"2023-10-09T06:20:54.703569+0000","last_became_peered":"2023-10-09T06:20:54.703569+0000","last_unstale":"2023-10-09T06:20:54.704060+0000","last_undegraded":"2023-10-09T06:20:54.704060+0000","last_fullsized":"2023-10-09T06:20:54.704060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:20.426721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704373+0000","last_change":"2023-10-09T06:20:54.704118+0000","last_active":"2023-10-09T06:20:54.704373+0000","last_peered":"2023-10-09T06:20:54.704373+0000","last_clean":"2023-10-09T06:20:54.704373+0000","last_became_active":"2023-10-09T06:20:54.703694+0000","last_became_peered":"2023-10-09T06:20:54.703694+0000","last_unstale":"2023-10-09T06:20:54.704373+0000","last_undegraded":"2023-10-09T06:20:54.704373+0000","last_fullsized":"2023-10-09T06:20:54.704373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701375+0000","last_change":"2023-10-09T06:20:54.701294+0000","last_active":"2023-10-09T06:20:54.701375+0000","last_peered":"2023-10-09T06:20:54.701375+0000","last_clean":"2023-10-09T06:20:54.701375+0000","last_became_active":"2023-10-09T06:20:54.701078+0000","last_became_peered":"2023-10-09T06:20:54.701078+0000","last_unstale":"2023-10-09T06:20:54.701375+0000","last_undegraded":"2023-10-09T06:20:54.701375+0000","last_fullsized":"2023-10-09T06:20:54.701375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707239+0000","last_change":"2023-10-09T06:20:54.707148+0000","last_active":"2023-10-09T06:20:54.707239+0000","last_peered":"2023-10-09T06:20:54.707239+0000","last_clean":"2023-10-09T06:20:54.707239+0000","last_became_active":"2023-10-09T06:20:54.706930+0000","last_became_peered":"2023-10-09T06:20:54.706930+0000","last_unstale":"2023-10-09T06:20:54.707239+0000","last_undegraded":"2023-10-09T06:20:54.707239+0000","last_fullsized":"2023-10-09T06:20:54.707239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:41.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.714191+0000","last_change":"2023-10-09T06:20:54.714117+0000","last_active":"2023-10-09T06:20:54.714191+0000","last_peered":"2023-10-09T06:20:54.714191+0000","last_clean":"2023-10-09T06:20:54.714191+0000","last_became_active":"2023-10-09T06:20:54.709963+0000","last_became_peered":"2023-10-09T06:20:54.709963+0000","last_unstale":"2023-10-09T06:20:54.714191+0000","last_undegraded":"2023-10-09T06:20:54.714191+0000","last_fullsized":"2023-10-09T06:20:54.714191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:41.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711538+0000","last_change":"2023-10-09T06:20:54.710872+0000","last_active":"2023-10-09T06:20:54.711538+0000","last_peered":"2023-10-09T06:20:54.711538+0000","last_clean":"2023-10-09T06:20:54.711538+0000","last_became_active":"2023-10-09T06:20:54.710340+0000","last_became_peered":"2023-10-09T06:20:54.710340+0000","last_unstale":"2023-10-09T06:20:54.711538+0000","last_undegraded":"2023-10-09T06:20:54.711538+0000","last_fullsized":"2023-10-09T06:20:54.711538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:22.187237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702470+0000","last_change":"2023-10-09T06:20:54.702406+0000","last_active":"2023-10-09T06:20:54.702470+0000","last_peered":"2023-10-09T06:20:54.702470+0000","last_clean":"2023-10-09T06:20:54.702470+0000","last_became_active":"2023-10-09T06:20:54.702186+0000","last_became_peered":"2023-10-09T06:20:54.702186+0000","last_unstale":"2023-10-09T06:20:54.702470+0000","last_undegraded":"2023-10-09T06:20:54.702470+0000","last_fullsized":"2023-10-09T06:20:54.702470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:25.746263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703219+0000","last_change":"2023-10-09T06:20:54.702948+0000","last_active":"2023-10-09T06:20:54.703219+0000","last_peered":"2023-10-09T06:20:54.703219+0000","last_clean":"2023-10-09T06:20:54.703219+0000","last_became_active":"2023-10-09T06:20:54.702021+0000","last_became_peered":"2023-10-09T06:20:54.702021+0000","last_unstale":"2023-10-09T06:20:54.703219+0000","last_undegraded":"2023-10-09T06:20:54.703219+0000","last_fullsized":"2023-10-09T06:20:54.703219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:22:23.939760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718359+0000","last_change":"2023-10-09T06:20:53.692487+0000","last_active":"2023-10-09T06:20:54.718359+0000","last_peered":"2023-10-09T06:20:54.718359+0000","last_clean":"2023-10-09T06:20:54.718359+0000","last_became_active":"2023-10-09T06:20:53.692243+0000","last_became_peered":"2023-10-09T06:20:53.692243+0000","last_unstale":"2023-10-09T06:20:54.718359+0000","last_undegraded":"2023-10-09T06:20:54.718359+0000","last_fullsized":"2023-10-09T06:20:54.718359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703546+0000","last_change":"2023-10-09T06:20:54.703384+0000","last_active":"2023-10-09T06:20:54.703546+0000","last_peered":"2023-10-09T06:20:54.703546+0000","last_clean":"2023-10-09T06:20:54.703546+0000","last_became_active":"2023-10-09T06:20:54.703039+0000","last_became_peered":"2023-10-09T06:20:54.703039+0000","last_unstale":"2023-10-09T06:20:54.703546+0000","last_undegraded":"2023-10-09T06:20:54.703546+0000","last_fullsized":"2023-10-09T06:20:54.703546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:41:46.658358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.720817+0000","last_change":"2023-10-09T06:20:53.691165+0000","last_active":"2023-10-09T06:20:54.720817+0000","last_peered":"2023-10-09T06:20:54.720817+0000","last_clean":"2023-10-09T06:20:54.720817+0000","last_became_active":"2023-10-09T06:20:53.690550+0000","last_became_peered":"2023-10-09T06:20:53.690550+0000","last_unstale":"2023-10-09T06:20:54.720817+0000","last_undegraded":"2023-10-09T06:20:54.720817+0000","last_fullsized":"2023-10-09T06:20:54.720817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706226+0000","last_change":"2023-10-09T06:20:54.705731+0000","last_active":"2023-10-09T06:20:54.706226+0000","last_peered":"2023-10-09T06:20:54.706226+0000","last_clean":"2023-10-09T06:20:54.706226+0000","last_became_active":"2023-10-09T06:20:54.705514+0000","last_became_peered":"2023-10-09T06:20:54.705514+0000","last_unstale":"2023-10-09T06:20:54.706226+0000","last_undegraded":"2023-10-09T06:20:54.706226+0000","last_fullsized":"2023-10-09T06:20:54.706226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:08.261543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718196+0000","last_change":"2023-10-09T06:20:53.688123+0000","last_active":"2023-10-09T06:20:54.718196+0000","last_peered":"2023-10-09T06:20:54.718196+0000","last_clean":"2023-10-09T06:20:54.718196+0000","last_became_active":"2023-10-09T06:20:53.687892+0000","last_became_peered":"2023-10-09T06:20:53.687892+0000","last_unstale":"2023-10-09T06:20:54.718196+0000","last_undegraded":"2023-10-09T06:20:54.718196+0000","last_fullsized":"2023-10-09T06:20:54.718196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711524+0000","last_change":"2023-10-09T06:20:54.710847+0000","last_active":"2023-10-09T06:20:54.711524+0000","last_peered":"2023-10-09T06:20:54.711524+0000","last_clean":"2023-10-09T06:20:54.711524+0000","last_became_active":"2023-10-09T06:20:54.709608+0000","last_became_peered":"2023-10-09T06:20:54.709608+0000","last_unstale":"2023-10-09T06:20:54.711524+0000","last_undegraded":"2023-10-09T06:20:54.711524+0000","last_fullsized":"2023-10-09T06:20:54.711524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718036+0000","last_change":"2023-10-09T06:20:53.692698+0000","last_active":"2023-10-09T06:20:54.718036+0000","last_peered":"2023-10-09T06:20:54.718036+0000","last_clean":"2023-10-09T06:20:54.718036+0000","last_became_active":"2023-10-09T06:20:53.692506+0000","last_became_peered":"2023-10-09T06:20:53.692506+0000","last_unstale":"2023-10-09T06:20:54.718036+0000","last_undegraded":"2023-10-09T06:20:54.718036+0000","last_fullsized":"2023-10-09T06:20:54.718036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:24.740060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708977+0000","last_change":"2023-10-09T06:20:54.706985+0000","last_active":"2023-10-09T06:20:54.708977+0000","last_peered":"2023-10-09T06:20:54.708977+0000","last_clean":"2023-10-09T06:20:54.708977+0000","last_became_active":"2023-10-09T06:20:54.706350+0000","last_became_peered":"2023-10-09T06:20:54.706350+0000","last_unstale":"2023-10-09T06:20:54.708977+0000","last_undegraded":"2023-10-09T06:20:54.708977+0000","last_fullsized":"2023-10-09T06:20:54.708977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.717497+0000","last_change":"2023-10-09T06:20:53.688426+0000","last_active":"2023-10-09T06:20:54.717497+0000","last_peered":"2023-10-09T06:20:54.717497+0000","last_clean":"2023-10-09T06:20:54.717497+0000","last_became_active":"2023-10-09T06:20:53.688186+0000","last_became_peered":"2023-10-09T06:20:53.688186+0000","last_unstale":"2023-10-09T06:20:54.717497+0000","last_undegraded":"2023-10-09T06:20:54.717497+0000","last_fullsized":"2023-10-09T06:20:54.717497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703715+0000","last_change":"2023-10-09T06:20:54.703174+0000","last_active":"2023-10-09T06:20:54.703715+0000","last_peered":"2023-10-09T06:20:54.703715+0000","last_clean":"2023-10-09T06:20:54.703715+0000","last_became_active":"2023-10-09T06:20:54.702079+0000","last_became_peered":"2023-10-09T06:20:54.702079+0000","last_unstale":"2023-10-09T06:20:54.703715+0000","last_undegraded":"2023-10-09T06:20:54.703715+0000","last_fullsized":"2023-10-09T06:20:54.703715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:16.997567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.716826+0000","last_change":"2023-10-09T06:20:53.685459+0000","last_active":"2023-10-09T06:20:54.716826+0000","last_peered":"2023-10-09T06:20:54.716826+0000","last_clean":"2023-10-09T06:20:54.716826+0000","last_became_active":"2023-10-09T06:20:53.685232+0000","last_became_peered":"2023-10-09T06:20:53.685232+0000","last_unstale":"2023-10-09T06:20:54.716826+0000","last_undegraded":"2023-10-09T06:20:54.716826+0000","last_fullsized":"2023-10-09T06:20:54.716826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702623+0000","last_change":"2023-10-09T06:20:54.702532+0000","last_active":"2023-10-09T06:20:54.702623+0000","last_peered":"2023-10-09T06:20:54.702623+0000","last_clean":"2023-10-09T06:20:54.702623+0000","last_became_active":"2023-10-09T06:20:54.702245+0000","last_became_peered":"2023-10-09T06:20:54.702245+0000","last_unstale":"2023-10-09T06:20:54.702623+0000","last_undegraded":"2023-10-09T06:20:54.702623+0000","last_fullsized":"2023-10-09T06:20:54.702623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:41.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.698863+0000","last_change":"2023-10-09T06:20:53.686387+0000","last_active":"2023-10-09T06:20:54.698863+0000","last_peered":"2023-10-09T06:20:54.698863+0000","last_clean":"2023-10-09T06:20:54.698863+0000","last_became_active":"2023-10-09T06:20:53.686072+0000","last_became_peered":"2023-10-09T06:20:53.686072+0000","last_unstale":"2023-10-09T06:20:54.698863+0000","last_undegraded":"2023-10-09T06:20:54.698863+0000","last_fullsized":"2023-10-09T06:20:54.698863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702605+0000","last_change":"2023-10-09T06:20:54.702542+0000","last_active":"2023-10-09T06:20:54.702605+0000","last_peered":"2023-10-09T06:20:54.702605+0000","last_clean":"2023-10-09T06:20:54.702605+0000","last_became_active":"2023-10-09T06:20:54.702307+0000","last_became_peered":"2023-10-09T06:20:54.702307+0000","last_unstale":"2023-10-09T06:20:54.702605+0000","last_undegraded":"2023-10-09T06:20:54.702605+0000","last_fullsized":"2023-10-09T06:20:54.702605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:41.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701363+0000","last_change":"2023-10-09T06:20:53.692511+0000","last_active":"2023-10-09T06:20:54.701363+0000","last_peered":"2023-10-09T06:20:54.701363+0000","last_clean":"2023-10-09T06:20:54.701363+0000","last_became_active":"2023-10-09T06:20:53.689704+0000","last_became_peered":"2023-10-09T06:20:53.689704+0000","last_unstale":"2023-10-09T06:20:54.701363+0000","last_undegraded":"2023-10-09T06:20:54.701363+0000","last_fullsized":"2023-10-09T06:20:54.701363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704634+0000","last_change":"2023-10-09T06:20:54.704450+0000","last_active":"2023-10-09T06:20:54.704634+0000","last_peered":"2023-10-09T06:20:54.704634+0000","last_clean":"2023-10-09T06:20:54.704634+0000","last_became_active":"2023-10-09T06:20:54.704220+0000","last_became_peered":"2023-10-09T06:20:54.704220+0000","last_unstale":"2023-10-09T06:20:54.704634+0000","last_undegraded":"2023-10-09T06:20:54.704634+0000","last_fullsized":"2023-10-09T06:20:54.704634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.695920+0000","last_change":"2023-10-09T06:20:53.691307+0000","last_active":"2023-10-09T06:20:54.695920+0000","last_peered":"2023-10-09T06:20:54.695920+0000","last_clean":"2023-10-09T06:20:54.695920+0000","last_became_active":"2023-10-09T06:20:53.691063+0000","last_became_peered":"2023-10-09T06:20:53.691063+0000","last_unstale":"2023-10-09T06:20:54.695920+0000","last_undegraded":"2023-10-09T06:20:54.695920+0000","last_fullsized":"2023-10-09T06:20:54.695920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711494+0000","last_change":"2023-10-09T06:20:54.710553+0000","last_active":"2023-10-09T06:20:54.711494+0000","last_peered":"2023-10-09T06:20:54.711494+0000","last_clean":"2023-10-09T06:20:54.711494+0000","last_became_active":"2023-10-09T06:20:54.709556+0000","last_became_peered":"2023-10-09T06:20:54.709556+0000","last_unstale":"2023-10-09T06:20:54.711494+0000","last_undegraded":"2023-10-09T06:20:54.711494+0000","last_fullsized":"2023-10-09T06:20:54.711494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:46.203108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706958+0000","last_change":"2023-10-09T06:20:53.692986+0000","last_active":"2023-10-09T06:20:54.706958+0000","last_peered":"2023-10-09T06:20:54.706958+0000","last_clean":"2023-10-09T06:20:54.706958+0000","last_became_active":"2023-10-09T06:20:53.692570+0000","last_became_peered":"2023-10-09T06:20:53.692570+0000","last_unstale":"2023-10-09T06:20:54.706958+0000","last_undegraded":"2023-10-09T06:20:54.706958+0000","last_fullsized":"2023-10-09T06:20:54.706958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711428+0000","last_change":"2023-10-09T06:20:54.711358+0000","last_active":"2023-10-09T06:20:54.711428+0000","last_peered":"2023-10-09T06:20:54.711428+0000","last_clean":"2023-10-09T06:20:54.711428+0000","last_became_active":"2023-10-09T06:20:54.711114+0000","last_became_peered":"2023-10-09T06:20:54.711114+0000","last_unstale":"2023-10-09T06:20:54.711428+0000","last_undegraded":"2023-10-09T06:20:54.711428+0000","last_fullsized":"2023-10-09T06:20:54.711428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:31.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.722498+0000","last_change":"2023-10-09T06:20:53.694922+0000","last_active":"2023-10-09T06:20:54.722498+0000","last_peered":"2023-10-09T06:20:54.722498+0000","last_clean":"2023-10-09T06:20:54.722498+0000","last_became_active":"2023-10-09T06:20:53.694642+0000","last_became_peered":"2023-10-09T06:20:53.694642+0000","last_unstale":"2023-10-09T06:20:54.722498+0000","last_undegraded":"2023-10-09T06:20:54.722498+0000","last_fullsized":"2023-10-09T06:20:54.722498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:52.168522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704185+0000","last_change":"2023-10-09T06:20:54.704143+0000","last_active":"2023-10-09T06:20:54.704185+0000","last_peered":"2023-10-09T06:20:54.704185+0000","last_clean":"2023-10-09T06:20:54.704185+0000","last_became_active":"2023-10-09T06:20:54.703957+0000","last_became_peered":"2023-10-09T06:20:54.703957+0000","last_unstale":"2023-10-09T06:20:54.704185+0000","last_undegraded":"2023-10-09T06:20:54.704185+0000","last_fullsized":"2023-10-09T06:20:54.704185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:30.717922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.721464+0000","last_change":"2023-10-09T06:20:53.688682+0000","last_active":"2023-10-09T06:20:54.721464+0000","last_peered":"2023-10-09T06:20:54.721464+0000","last_clean":"2023-10-09T06:20:54.721464+0000","last_became_active":"2023-10-09T06:20:53.688399+0000","last_became_peered":"2023-10-09T06:20:53.688399+0000","last_unstale":"2023-10-09T06:20:54.721464+0000","last_undegraded":"2023-10-09T06:20:54.721464+0000","last_fullsized":"2023-10-09T06:20:54.721464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703190+0000","last_change":"2023-10-09T06:20:54.702039+0000","last_active":"2023-10-09T06:20:54.703190+0000","last_peered":"2023-10-09T06:20:54.703190+0000","last_clean":"2023-10-09T06:20:54.703190+0000","last_became_active":"2023-10-09T06:20:54.701760+0000","last_became_peered":"2023-10-09T06:20:54.701760+0000","last_unstale":"2023-10-09T06:20:54.703190+0000","last_undegraded":"2023-10-09T06:20:54.703190+0000","last_fullsized":"2023-10-09T06:20:54.703190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:41:46.658358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.719418+0000","last_change":"2023-10-09T06:20:53.690779+0000","last_active":"2023-10-09T06:20:54.719418+0000","last_peered":"2023-10-09T06:20:54.719418+0000","last_clean":"2023-10-09T06:20:54.719418+0000","last_became_active":"2023-10-09T06:20:53.690585+0000","last_became_peered":"2023-10-09T06:20:53.690585+0000","last_unstale":"2023-10-09T06:20:54.719418+0000","last_undegraded":"2023-10-09T06:20:54.719418+0000","last_fullsized":"2023-10-09T06:20:54.719418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703490+0000","last_change":"2023-10-09T06:20:54.703248+0000","last_active":"2023-10-09T06:20:54.703490+0000","last_peered":"2023-10-09T06:20:54.703490+0000","last_clean":"2023-10-09T06:20:54.703490+0000","last_became_active":"2023-10-09T06:20:54.701451+0000","last_became_peered":"2023-10-09T06:20:54.701451+0000","last_unstale":"2023-10-09T06:20:54.703490+0000","last_undegraded":"2023-10-09T06:20:54.703490+0000","last_fullsized":"2023-10-09T06:20:54.703490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:05:24.245558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707243+0000","last_change":"2023-10-09T06:20:53.691221+0000","last_active":"2023-10-09T06:20:54.707243+0000","last_peered":"2023-10-09T06:20:54.707243+0000","last_clean":"2023-10-09T06:20:54.707243+0000","last_became_active":"2023-10-09T06:20:53.690265+0000","last_became_peered":"2023-10-09T06:20:53.690265+0000","last_unstale":"2023-10-09T06:20:54.707243+0000","last_undegraded":"2023-10-09T06:20:54.707243+0000","last_fullsized":"2023-10-09T06:20:54.707243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703782+0000","last_change":"2023-10-09T06:20:54.703628+0000","last_active":"2023-10-09T06:20:54.703782+0000","last_peered":"2023-10-09T06:20:54.703782+0000","last_clean":"2023-10-09T06:20:54.703782+0000","last_became_active":"2023-10-09T06:20:54.703234+0000","last_became_peered":"2023-10-09T06:20:54.703234+0000","last_unstale":"2023-10-09T06:20:54.703782+0000","last_undegraded":"2023-10-09T06:20:54.703782+0000","last_fullsized":"2023-10-09T06:20:54.703782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:10:16.498873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699009+0000","last_change":"2023-10-09T06:20:53.684515+0000","last_active":"2023-10-09T06:20:54.699009+0000","last_peered":"2023-10-09T06:20:54.699009+0000","last_clean":"2023-10-09T06:20:54.699009+0000","last_became_active":"2023-10-09T06:20:53.684265+0000","last_became_peered":"2023-10-09T06:20:53.684265+0000","last_unstale":"2023-10-09T06:20:54.699009+0000","last_undegraded":"2023-10-09T06:20:54.699009+0000","last_fullsized":"2023-10-09T06:20:54.699009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699396+0000","last_change":"2023-10-09T06:20:54.699332+0000","last_active":"2023-10-09T06:20:54.699396+0000","last_peered":"2023-10-09T06:20:54.699396+0000","last_clean":"2023-10-09T06:20:54.699396+0000","last_became_active":"2023-10-09T06:20:54.698991+0000","last_became_peered":"2023-10-09T06:20:54.698991+0000","last_unstale":"2023-10-09T06:20:54.699396+0000","last_undegraded":"2023-10-09T06:20:54.699396+0000","last_fullsized":"2023-10-09T06:20:54.699396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:41.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.721075+0000","last_change":"2023-10-09T06:20:53.694124+0000","last_active":"2023-10-09T06:20:54.721075+0000","last_peered":"2023-10-09T06:20:54.721075+0000","last_clean":"2023-10-09T06:20:54.721075+0000","last_became_active":"2023-10-09T06:20:53.693903+0000","last_became_peered":"2023-10-09T06:20:53.693903+0000","last_unstale":"2023-10-09T06:20:54.721075+0000","last_undegraded":"2023-10-09T06:20:54.721075+0000","last_fullsized":"2023-10-09T06:20:54.721075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704529+0000","last_change":"2023-10-09T06:20:54.704310+0000","last_active":"2023-10-09T06:20:54.704529+0000","last_peered":"2023-10-09T06:20:54.704529+0000","last_clean":"2023-10-09T06:20:54.704529+0000","last_became_active":"2023-10-09T06:20:54.703990+0000","last_became_peered":"2023-10-09T06:20:54.703990+0000","last_unstale":"2023-10-09T06:20:54.704529+0000","last_undegraded":"2023-10-09T06:20:54.704529+0000","last_fullsized":"2023-10-09T06:20:54.704529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:14.974632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.719608+0000","last_change":"2023-10-09T06:20:53.692436+0000","last_active":"2023-10-09T06:20:54.719608+0000","last_peered":"2023-10-09T06:20:54.719608+0000","last_clean":"2023-10-09T06:20:54.719608+0000","last_became_active":"2023-10-09T06:20:53.692191+0000","last_became_peered":"2023-10-09T06:20:53.692191+0000","last_unstale":"2023-10-09T06:20:54.719608+0000","last_undegraded":"2023-10-09T06:20:54.719608+0000","last_fullsized":"2023-10-09T06:20:54.719608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703765+0000","last_change":"2023-10-09T06:20:54.703474+0000","last_active":"2023-10-09T06:20:54.703765+0000","last_peered":"2023-10-09T06:20:54.703765+0000","last_clean":"2023-10-09T06:20:54.703765+0000","last_became_active":"2023-10-09T06:20:54.702986+0000","last_became_peered":"2023-10-09T06:20:54.702986+0000","last_unstale":"2023-10-09T06:20:54.703765+0000","last_undegraded":"2023-10-09T06:20:54.703765+0000","last_fullsized":"2023-10-09T06:20:54.703765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:46.203108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699329+0000","last_change":"2023-10-09T06:20:53.692601+0000","last_active":"2023-10-09T06:20:54.699329+0000","last_peered":"2023-10-09T06:20:54.699329+0000","last_clean":"2023-10-09T06:20:54.699329+0000","last_became_active":"2023-10-09T06:20:53.692249+0000","last_became_peered":"2023-10-09T06:20:53.692249+0000","last_unstale":"2023-10-09T06:20:54.699329+0000","last_undegraded":"2023-10-09T06:20:54.699329+0000","last_fullsized":"2023-10-09T06:20:54.699329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710118+0000","last_change":"2023-10-09T06:20:54.709870+0000","last_active":"2023-10-09T06:20:54.710118+0000","last_peered":"2023-10-09T06:20:54.710118+0000","last_clean":"2023-10-09T06:20:54.710118+0000","last_became_active":"2023-10-09T06:20:54.709017+0000","last_became_peered":"2023-10-09T06:20:54.709017+0000","last_unstale":"2023-10-09T06:20:54.710118+0000","last_undegraded":"2023-10-09T06:20:54.710118+0000","last_fullsized":"2023-10-09T06:20:54.710118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:48.043711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707068+0000","last_change":"2023-10-09T06:20:53.694336+0000","last_active":"2023-10-09T06:20:54.707068+0000","last_peered":"2023-10-09T06:20:54.707068+0000","last_clean":"2023-10-09T06:20:54.707068+0000","last_became_active":"2023-10-09T06:20:53.694107+0000","last_became_peered":"2023-10-09T06:20:53.694107+0000","last_unstale":"2023-10-09T06:20:54.707068+0000","last_undegraded":"2023-10-09T06:20:54.707068+0000","last_fullsized":"2023-10-09T06:20:54.707068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.705770+0000","last_change":"2023-10-09T06:20:54.705708+0000","last_active":"2023-10-09T06:20:54.705770+0000","last_peered":"2023-10-09T06:20:54.705770+0000","last_clean":"2023-10-09T06:20:54.705770+0000","last_became_active":"2023-10-09T06:20:54.705487+0000","last_became_peered":"2023-10-09T06:20:54.705487+0000","last_unstale":"2023-10-09T06:20:54.705770+0000","last_undegraded":"2023-10-09T06:20:54.705770+0000","last_fullsized":"2023-10-09T06:20:54.705770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:20.728264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701105+0000","last_change":"2023-10-09T06:20:54.700944+0000","last_active":"2023-10-09T06:20:54.701105+0000","last_peered":"2023-10-09T06:20:54.701105+0000","last_clean":"2023-10-09T06:20:54.701105+0000","last_became_active":"2023-10-09T06:20:54.700732+0000","last_became_peered":"2023-10-09T06:20:54.700732+0000","last_unstale":"2023-10-09T06:20:54.701105+0000","last_undegraded":"2023-10-09T06:20:54.701105+0000","last_fullsized":"2023-10-09T06:20:54.701105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.697278+0000","last_change":"2023-10-09T06:20:53.688729+0000","last_active":"2023-10-09T06:20:54.697278+0000","last_peered":"2023-10-09T06:20:54.697278+0000","last_clean":"2023-10-09T06:20:54.697278+0000","last_became_active":"2023-10-09T06:20:53.688468+0000","last_became_peered":"2023-10-09T06:20:53.688468+0000","last_unstale":"2023-10-09T06:20:54.697278+0000","last_undegraded":"2023-10-09T06:20:54.697278+0000","last_fullsized":"2023-10-09T06:20:54.697278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710841+0000","last_change":"2023-10-09T06:20:54.710794+0000","last_active":"2023-10-09T06:20:54.710841+0000","last_peered":"2023-10-09T06:20:54.710841+0000","last_clean":"2023-10-09T06:20:54.710841+0000","last_became_active":"2023-10-09T06:20:54.710597+0000","last_became_peered":"2023-10-09T06:20:54.710597+0000","last_unstale":"2023-10-09T06:20:54.710841+0000","last_undegraded":"2023-10-09T06:20:54.710841+0000","last_fullsized":"2023-10-09T06:20:54.710841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:46.203108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707347+0000","last_change":"2023-10-09T06:20:53.691840+0000","last_active":"2023-10-09T06:20:54.707347+0000","last_peered":"2023-10-09T06:20:54.707347+0000","last_clean":"2023-10-09T06:20:54.707347+0000","last_became_active":"2023-10-09T06:20:53.691004+0000","last_became_peered":"2023-10-09T06:20:53.691004+0000","last_unstale":"2023-10-09T06:20:54.707347+0000","last_undegraded":"2023-10-09T06:20:54.707347+0000","last_fullsized":"2023-10-09T06:20:54.707347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696667+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:20:54.696667+0000","last_peered":"2023-10-09T06:20:54.696667+0000","last_clean":"2023-10-09T06:20:54.696667+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:20:54.696667+0000","last_undegraded":"2023-10-09T06:20:54.696667+0000","last_fullsized":"2023-10-09T06:20:54.696667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702605+0000","last_change":"2023-10-09T06:20:54.702399+0000","last_active":"2023-10-09T06:20:54.702605+0000","last_peered":"2023-10-09T06:20:54.702605+0000","last_clean":"2023-10-09T06:20:54.702605+0000","last_became_active":"2023-10-09T06:20:54.701799+0000","last_became_peered":"2023-10-09T06:20:54.701799+0000","last_unstale":"2023-10-09T06:20:54.702605+0000","last_undegraded":"2023-10-09T06:20:54.702605+0000","last_fullsized":"2023-10-09T06:20:54.702605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696279+0000","last_change":"2023-10-09T06:20:53.694796+0000","last_active":"2023-10-09T06:20:54.696279+0000","last_peered":"2023-10-09T06:20:54.696279+0000","last_clean":"2023-10-09T06:20:54.696279+0000","last_became_active":"2023-10-09T06:20:53.694541+0000","last_became_peered":"2023-10-09T06:20:53.694541+0000","last_unstale":"2023-10-09T06:20:54.696279+0000","last_undegraded":"2023-10-09T06:20:54.696279+0000","last_fullsized":"2023-10-09T06:20:54.696279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696773+0000","last_change":"2023-10-09T06:20:53.690652+0000","last_active":"2023-10-09T06:20:54.696773+0000","last_peered":"2023-10-09T06:20:54.696773+0000","last_clean":"2023-10-09T06:20:54.696773+0000","last_became_active":"2023-10-09T06:20:53.690426+0000","last_became_peered":"2023-10-09T06:20:53.690426+0000","last_unstale":"2023-10-09T06:20:54.696773+0000","last_undegraded":"2023-10-09T06:20:54.696773+0000","last_fullsized":"2023-10-09T06:20:54.696773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704374+0000","last_change":"2023-10-09T06:20:54.703240+0000","last_active":"2023-10-09T06:20:54.704374+0000","last_peered":"2023-10-09T06:20:54.704374+0000","last_clean":"2023-10-09T06:20:54.704374+0000","last_became_active":"2023-10-09T06:20:54.703000+0000","last_became_peered":"2023-10-09T06:20:54.703000+0000","last_unstale":"2023-10-09T06:20:54.704374+0000","last_undegraded":"2023-10-09T06:20:54.704374+0000","last_fullsized":"2023-10-09T06:20:54.704374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T06:20:55.695702+0000","last_change":"2023-10-09T06:20:53.693463+0000","last_active":"2023-10-09T06:20:55.695702+0000","last_peered":"2023-10-09T06:20:55.695702+0000","last_clean":"2023-10-09T06:20:55.695702+0000","last_became_active":"2023-10-09T06:20:53.693223+0000","last_became_peered":"2023-10-09T06:20:53.693223+0000","last_unstale":"2023-10-09T06:20:55.695702+0000","last_undegraded":"2023-10-09T06:20:55.695702+0000","last_fullsized":"2023-10-09T06:20:55.695702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.705276+0000","last_change":"2023-10-09T06:20:54.705213+0000","last_active":"2023-10-09T06:20:54.705276+0000","last_peered":"2023-10-09T06:20:54.705276+0000","last_clean":"2023-10-09T06:20:54.705276+0000","last_became_active":"2023-10-09T06:20:54.704911+0000","last_became_peered":"2023-10-09T06:20:54.704911+0000","last_unstale":"2023-10-09T06:20:54.705276+0000","last_undegraded":"2023-10-09T06:20:54.705276+0000","last_fullsized":"2023-10-09T06:20:54.705276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:22:23.939760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718435+0000","last_change":"2023-10-09T06:20:53.689939+0000","last_active":"2023-10-09T06:20:54.718435+0000","last_peered":"2023-10-09T06:20:54.718435+0000","last_clean":"2023-10-09T06:20:54.718435+0000","last_became_active":"2023-10-09T06:20:53.689710+0000","last_became_peered":"2023-10-09T06:20:53.689710+0000","last_unstale":"2023-10-09T06:20:54.718435+0000","last_undegraded":"2023-10-09T06:20:54.718435+0000","last_fullsized":"2023-10-09T06:20:54.718435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.698754+0000","last_change":"2023-10-09T06:20:54.698648+0000","last_active":"2023-10-09T06:20:54.698754+0000","last_peered":"2023-10-09T06:20:54.698754+0000","last_clean":"2023-10-09T06:20:54.698754+0000","last_became_active":"2023-10-09T06:20:54.698423+0000","last_became_peered":"2023-10-09T06:20:54.698423+0000","last_unstale":"2023-10-09T06:20:54.698754+0000","last_undegraded":"2023-10-09T06:20:54.698754+0000","last_fullsized":"2023-10-09T06:20:54.698754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.694880+0000","last_change":"2023-10-09T06:20:53.691357+0000","last_active":"2023-10-09T06:20:54.694880+0000","last_peered":"2023-10-09T06:20:54.694880+0000","last_clean":"2023-10-09T06:20:54.694880+0000","last_became_active":"2023-10-09T06:20:53.690961+0000","last_became_peered":"2023-10-09T06:20:53.690961+0000","last_unstale":"2023-10-09T06:20:54.694880+0000","last_undegraded":"2023-10-09T06:20:54.694880+0000","last_fullsized":"2023-10-09T06:20:54.694880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:19.722061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706057+0000","last_change":"2023-10-09T06:20:54.705990+0000","last_active":"2023-10-09T06:20:54.706057+0000","last_peered":"2023-10-09T06:20:54.706057+0000","last_clean":"2023-10-09T06:20:54.706057+0000","last_became_active":"2023-10-09T06:20:54.705793+0000","last_became_peered":"2023-10-09T06:20:54.705793+0000","last_unstale":"2023-10-09T06:20:54.706057+0000","last_undegraded":"2023-10-09T06:20:54.706057+0000","last_fullsized":"2023-10-09T06:20:54.706057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:53.174725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699422+0000","last_change":"2023-10-09T06:20:53.693042+0000","last_active":"2023-10-09T06:20:54.699422+0000","last_peered":"2023-10-09T06:20:54.699422+0000","last_clean":"2023-10-09T06:20:54.699422+0000","last_became_active":"2023-10-09T06:20:53.692818+0000","last_became_peered":"2023-10-09T06:20:53.692818+0000","last_unstale":"2023-10-09T06:20:54.699422+0000","last_undegraded":"2023-10-09T06:20:54.699422+0000","last_fullsized":"2023-10-09T06:20:54.699422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702969+0000","last_change":"2023-10-09T06:20:54.702866+0000","last_active":"2023-10-09T06:20:54.702969+0000","last_peered":"2023-10-09T06:20:54.702969+0000","last_clean":"2023-10-09T06:20:54.702969+0000","last_became_active":"2023-10-09T06:20:54.702652+0000","last_became_peered":"2023-10-09T06:20:54.702652+0000","last_unstale":"2023-10-09T06:20:54.702969+0000","last_undegraded":"2023-10-09T06:20:54.702969+0000","last_fullsized":"2023-10-09T06:20:54.702969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:08.261543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699122+0000","last_change":"2023-10-09T06:20:53.692859+0000","last_active":"2023-10-09T06:20:54.699122+0000","last_peered":"2023-10-09T06:20:54.699122+0000","last_clean":"2023-10-09T06:20:54.699122+0000","last_became_active":"2023-10-09T06:20:53.687193+0000","last_became_peered":"2023-10-09T06:20:53.687193+0000","last_unstale":"2023-10-09T06:20:54.699122+0000","last_undegraded":"2023-10-09T06:20:54.699122+0000","last_fullsized":"2023-10-09T06:20:54.699122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706025+0000","last_change":"2023-10-09T06:20:54.705836+0000","last_active":"2023-10-09T06:20:54.706025+0000","last_peered":"2023-10-09T06:20:54.706025+0000","last_clean":"2023-10-09T06:20:54.706025+0000","last_became_active":"2023-10-09T06:20:54.705607+0000","last_became_peered":"2023-10-09T06:20:54.705607+0000","last_unstale":"2023-10-09T06:20:54.706025+0000","last_undegraded":"2023-10-09T06:20:54.706025+0000","last_fullsized":"2023-10-09T06:20:54.706025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:17.435271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718723+0000","last_change":"2023-10-09T06:20:53.688523+0000","last_active":"2023-10-09T06:20:54.718723+0000","last_peered":"2023-10-09T06:20:54.718723+0000","last_clean":"2023-10-09T06:20:54.718723+0000","last_became_active":"2023-10-09T06:20:53.688245+0000","last_became_peered":"2023-10-09T06:20:53.688245+0000","last_unstale":"2023-10-09T06:20:54.718723+0000","last_undegraded":"2023-10-09T06:20:54.718723+0000","last_fullsized":"2023-10-09T06:20:54.718723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:52.168522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704441+0000","last_change":"2023-10-09T06:20:54.704343+0000","last_active":"2023-10-09T06:20:54.704441+0000","last_peered":"2023-10-09T06:20:54.704441+0000","last_clean":"2023-10-09T06:20:54.704441+0000","last_became_active":"2023-10-09T06:20:54.704076+0000","last_became_peered":"2023-10-09T06:20:54.704076+0000","last_unstale":"2023-10-09T06:20:54.704441+0000","last_undegraded":"2023-10-09T06:20:54.704441+0000","last_fullsized":"2023-10-09T06:20:54.704441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:41.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696258+0000","last_change":"2023-10-09T06:20:53.693147+0000","last_active":"2023-10-09T06:20:54.696258+0000","last_peered":"2023-10-09T06:20:54.696258+0000","last_clean":"2023-10-09T06:20:54.696258+0000","last_became_active":"2023-10-09T06:20:53.692925+0000","last_became_peered":"2023-10-09T06:20:53.692925+0000","last_unstale":"2023-10-09T06:20:54.696258+0000","last_undegraded":"2023-10-09T06:20:54.696258+0000","last_fullsized":"2023-10-09T06:20:54.696258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710381+0000","last_change":"2023-10-09T06:20:54.710313+0000","last_active":"2023-10-09T06:20:54.710381+0000","last_peered":"2023-10-09T06:20:54.710381+0000","last_clean":"2023-10-09T06:20:54.710381+0000","last_became_active":"2023-10-09T06:20:54.710082+0000","last_became_peered":"2023-10-09T06:20:54.710082+0000","last_unstale":"2023-10-09T06:20:54.710381+0000","last_undegraded":"2023-10-09T06:20:54.710381+0000","last_fullsized":"2023-10-09T06:20:54.710381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:45.285681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.720656+0000","last_change":"2023-10-09T06:20:53.692399+0000","last_active":"2023-10-09T06:20:54.720656+0000","last_peered":"2023-10-09T06:20:54.720656+0000","last_clean":"2023-10-09T06:20:54.720656+0000","last_became_active":"2023-10-09T06:20:53.692157+0000","last_became_peered":"2023-10-09T06:20:53.692157+0000","last_unstale":"2023-10-09T06:20:54.720656+0000","last_undegraded":"2023-10-09T06:20:54.720656+0000","last_fullsized":"2023-10-09T06:20:54.720656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711476+0000","last_change":"2023-10-09T06:20:54.710127+0000","last_active":"2023-10-09T06:20:54.711476+0000","last_peered":"2023-10-09T06:20:54.711476+0000","last_clean":"2023-10-09T06:20:54.711476+0000","last_became_active":"2023-10-09T06:20:54.709293+0000","last_became_peered":"2023-10-09T06:20:54.709293+0000","last_unstale":"2023-10-09T06:20:54.711476+0000","last_undegraded":"2023-10-09T06:20:54.711476+0000","last_fullsized":"2023-10-09T06:20:54.711476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:22:23.939760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718472+0000","last_change":"2023-10-09T06:20:53.687221+0000","last_active":"2023-10-09T06:20:54.718472+0000","last_peered":"2023-10-09T06:20:54.718472+0000","last_clean":"2023-10-09T06:20:54.718472+0000","last_became_active":"2023-10-09T06:20:53.686998+0000","last_became_peered":"2023-10-09T06:20:53.686998+0000","last_unstale":"2023-10-09T06:20:54.718472+0000","last_undegraded":"2023-10-09T06:20:54.718472+0000","last_fullsized":"2023-10-09T06:20:54.718472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703747+0000","last_change":"2023-10-09T06:20:54.703089+0000","last_active":"2023-10-09T06:20:54.703747+0000","last_peered":"2023-10-09T06:20:54.703747+0000","last_clean":"2023-10-09T06:20:54.703747+0000","last_became_active":"2023-10-09T06:20:54.702720+0000","last_became_peered":"2023-10-09T06:20:54.702720+0000","last_unstale":"2023-10-09T06:20:54.703747+0000","last_undegraded":"2023-10-09T06:20:54.703747+0000","last_fullsized":"2023-10-09T06:20:54.703747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:48.043711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.700469+0000","last_change":"2023-10-09T06:20:54.700400+0000","last_active":"2023-10-09T06:20:54.700469+0000","last_peered":"2023-10-09T06:20:54.700469+0000","last_clean":"2023-10-09T06:20:54.700469+0000","last_became_active":"2023-10-09T06:20:54.700120+0000","last_became_peered":"2023-10-09T06:20:54.700120+0000","last_unstale":"2023-10-09T06:20:54.700469+0000","last_undegraded":"2023-10-09T06:20:54.700469+0000","last_fullsized":"2023-10-09T06:20:54.700469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711227+0000","last_change":"2023-10-09T06:20:54.711172+0000","last_active":"2023-10-09T06:20:54.711227+0000","last_peered":"2023-10-09T06:20:54.711227+0000","last_clean":"2023-10-09T06:20:54.711227+0000","last_became_active":"2023-10-09T06:20:54.710983+0000","last_became_peered":"2023-10-09T06:20:54.710983+0000","last_unstale":"2023-10-09T06:20:54.711227+0000","last_undegraded":"2023-10-09T06:20:54.711227+0000","last_fullsized":"2023-10-09T06:20:54.711227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:20.728264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.709159+0000","last_change":"2023-10-09T06:20:54.707142+0000","last_active":"2023-10-09T06:20:54.709159+0000","last_peered":"2023-10-09T06:20:54.709159+0000","last_clean":"2023-10-09T06:20:54.709159+0000","last_became_active":"2023-10-09T06:20:54.706670+0000","last_became_peered":"2023-10-09T06:20:54.706670+0000","last_unstale":"2023-10-09T06:20:54.709159+0000","last_undegraded":"2023-10-09T06:20:54.709159+0000","last_fullsized":"2023-10-09T06:20:54.709159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:09.107980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701930+0000","last_change":"2023-10-09T06:20:54.701836+0000","last_active":"2023-10-09T06:20:54.701930+0000","last_peered":"2023-10-09T06:20:54.701930+0000","last_clean":"2023-10-09T06:20:54.701930+0000","last_became_active":"2023-10-09T06:20:54.701556+0000","last_became_peered":"2023-10-09T06:20:54.701556+0000","last_unstale":"2023-10-09T06:20:54.701930+0000","last_undegraded":"2023-10-09T06:20:54.701930+0000","last_fullsized":"2023-10-09T06:20:54.701930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708330+0000","last_change":"2023-10-09T06:20:54.708268+0000","last_active":"2023-10-09T06:20:54.708330+0000","last_peered":"2023-10-09T06:20:54.708330+0000","last_clean":"2023-10-09T06:20:54.708330+0000","last_became_active":"2023-10-09T06:20:54.707751+0000","last_became_peered":"2023-10-09T06:20:54.707751+0000","last_unstale":"2023-10-09T06:20:54.708330+0000","last_undegraded":"2023-10-09T06:20:54.708330+0000","last_fullsized":"2023-10-09T06:20:54.708330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704996+0000","last_change":"2023-10-09T06:20:54.704931+0000","last_active":"2023-10-09T06:20:54.704996+0000","last_peered":"2023-10-09T06:20:54.704996+0000","last_clean":"2023-10-09T06:20:54.704996+0000","last_became_active":"2023-10-09T06:20:54.704697+0000","last_became_peered":"2023-10-09T06:20:54.704697+0000","last_unstale":"2023-10-09T06:20:54.704996+0000","last_undegraded":"2023-10-09T06:20:54.704996+0000","last_fullsized":"2023-10-09T06:20:54.704996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702925+0000","last_change":"2023-10-09T06:20:54.702684+0000","last_active":"2023-10-09T06:20:54.702925+0000","last_peered":"2023-10-09T06:20:54.702925+0000","last_clean":"2023-10-09T06:20:54.702925+0000","last_became_active":"2023-10-09T06:20:54.702422+0000","last_became_peered":"2023-10-09T06:20:54.702422+0000","last_unstale":"2023-10-09T06:20:54.702925+0000","last_undegraded":"2023-10-09T06:20:54.702925+0000","last_fullsized":"2023-10-09T06:20:54.702925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708093+0000","last_change":"2023-10-09T06:20:54.708004+0000","last_active":"2023-10-09T06:20:54.708093+0000","last_peered":"2023-10-09T06:20:54.708093+0000","last_clean":"2023-10-09T06:20:54.708093+0000","last_became_active":"2023-10-09T06:20:54.707760+0000","last_became_peered":"2023-10-09T06:20:54.707760+0000","last_unstale":"2023-10-09T06:20:54.708093+0000","last_undegraded":"2023-10-09T06:20:54.708093+0000","last_fullsized":"2023-10-09T06:20:54.708093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.709600+0000","last_change":"2023-10-09T06:20:54.709536+0000","last_active":"2023-10-09T06:20:54.709600+0000","last_peered":"2023-10-09T06:20:54.709600+0000","last_clean":"2023-10-09T06:20:54.709600+0000","last_became_active":"2023-10-09T06:20:54.707797+0000","last_became_peered":"2023-10-09T06:20:54.707797+0000","last_unstale":"2023-10-09T06:20:54.709600+0000","last_undegraded":"2023-10-09T06:20:54.709600+0000","last_fullsized":"2023-10-09T06:20:54.709600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:10:16.498873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708462+0000","last_change":"2023-10-09T06:20:54.708406+0000","last_active":"2023-10-09T06:20:54.708462+0000","last_peered":"2023-10-09T06:20:54.708462+0000","last_clean":"2023-10-09T06:20:54.708462+0000","last_became_active":"2023-10-09T06:20:54.708045+0000","last_became_peered":"2023-10-09T06:20:54.708045+0000","last_unstale":"2023-10-09T06:20:54.708462+0000","last_undegraded":"2023-10-09T06:20:54.708462+0000","last_fullsized":"2023-10-09T06:20:54.708462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711509+0000","last_change":"2023-10-09T06:20:54.710694+0000","last_active":"2023-10-09T06:20:54.711509+0000","last_peered":"2023-10-09T06:20:54.711509+0000","last_clean":"2023-10-09T06:20:54.711509+0000","last_became_active":"2023-10-09T06:20:54.709873+0000","last_became_peered":"2023-10-09T06:20:54.709873+0000","last_unstale":"2023-10-09T06:20:54.711509+0000","last_undegraded":"2023-10-09T06:20:54.711509+0000","last_fullsized":"2023-10-09T06:20:54.711509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:25.482181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703512+0000","last_change":"2023-10-09T06:20:54.703439+0000","last_active":"2023-10-09T06:20:54.703512+0000","last_peered":"2023-10-09T06:20:54.703512+0000","last_clean":"2023-10-09T06:20:54.703512+0000","last_became_active":"2023-10-09T06:20:54.702617+0000","last_became_peered":"2023-10-09T06:20:54.702617+0000","last_unstale":"2023-10-09T06:20:54.703512+0000","last_undegraded":"2023-10-09T06:20:54.703512+0000","last_fullsized":"2023-10-09T06:20:54.703512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704333+0000","last_change":"2023-10-09T06:20:54.704167+0000","last_active":"2023-10-09T06:20:54.704333+0000","last_peered":"2023-10-09T06:20:54.704333+0000","last_clean":"2023-10-09T06:20:54.704333+0000","last_became_active":"2023-10-09T06:20:54.703924+0000","last_became_peered":"2023-10-09T06:20:54.703924+0000","last_unstale":"2023-10-09T06:20:54.704333+0000","last_undegraded":"2023-10-09T06:20:54.704333+0000","last_fullsized":"2023-10-09T06:20:54.704333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]}],"pool_statfs":[]}} 2023-10-09T06:21:08.543 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:21:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.695+0000 7fe0c498f700 1 Processor -- start 2023-10-09T06:21:08.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.695+0000 7fe0c498f700 1 -- start start 2023-10-09T06:21:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0c498f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0157870 0x7fe0c015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0c498f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c015cbb0 con 0x7fe0c0157c40 2023-10-09T06:21:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0c498f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c015bfa0 con 0x7fe0c015a620 2023-10-09T06:21:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0c498f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c015c280 con 0x7fe0c0157870 2023-10-09T06:21:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0bed9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe0c0157c40 0x7fe0c0158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60718/0 (socket says 172.21.15.31:60718) 2023-10-09T06:21:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0bed9d700 1 -- 172.21.15.31:0/813531697 learned_addr learned my addr 172.21.15.31:0/813531697 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645530319 0 0) 0x7fe0c015cbb0 con 0x7fe0c0157c40 2023-10-09T06:21:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0ac003570 con 0x7fe0c0157c40 2023-10-09T06:21:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0be59c700 1 --2- 172.21.15.31:0/813531697 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0157870 0x7fe0c015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 425697731 0 0) 0x7fe0ac003570 con 0x7fe0c0157c40 2023-10-09T06:21:08.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0157870 msgr2=0x7fe0c015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:08.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0bd59a700 1 --2- 172.21.15.31:0/813531697 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0157870 0x7fe0c015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 >> v1:172.21.15.158:6789/0 conn(0x7fe0c015a620 legacy=0x7fe0c015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c015c560 con 0x7fe0c0157c40 2023-10-09T06:21:08.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fe0b8001470 con 0x7fe0c0157c40 2023-10-09T06:21:08.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 >> v1:172.21.15.31:6789/0 conn(0x7fe0c0157c40 legacy=0x7fe0c0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.696+0000 7fe0bd59a700 1 --2- 172.21.15.31:0/813531697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0ac003a90 0x7fe0ac003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0bd59a700 1 --2- 172.21.15.31:0/813531697 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0ac004810 0x7fe0ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0bd59a700 1 --2- 172.21.15.31:0/813531697 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0157870 0x7fe0ac0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c015c280 con 0x7fe0ac003a90 2023-10-09T06:21:08.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac00bb60 con 0x7fe0ac004810 2023-10-09T06:21:08.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac00bd20 con 0x7fe0c0157870 2023-10-09T06:21:08.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0be59c700 1 --2- 172.21.15.31:0/813531697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0ac003a90 0x7fe0ac003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0bdd9b700 1 --2- 172.21.15.31:0/813531697 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0ac004810 0x7fe0ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0bed9d700 1 --2- 172.21.15.31:0/813531697 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0157870 0x7fe0ac0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0be59c700 1 -- 172.21.15.31:0/813531697 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0157870 msgr2=0x7fe0ac0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:08.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0be59c700 1 --2- 172.21.15.31:0/813531697 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0157870 0x7fe0ac0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0be59c700 1 -- 172.21.15.31:0/813531697 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0ac004810 msgr2=0x7fe0ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:08.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0be59c700 1 --2- 172.21.15.31:0/813531697 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0ac004810 0x7fe0ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0be59c700 1 -- 172.21.15.31:0/813531697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac003570 con 0x7fe0ac003a90 2023-10-09T06:21:08.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0bed9d700 1 --2- 172.21.15.31:0/813531697 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0157870 0x7fe0ac0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0be59c700 1 --2- 172.21.15.31:0/813531697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0ac003a90 0x7fe0ac003ea0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000e210 tx=0x7fe0b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d08e0c86fce0ec server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000eac0 con 0x7fe0ac003a90 2023-10-09T06:21:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b000f040 con 0x7fe0ac003a90 2023-10-09T06:21:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.697+0000 7fe0bd59a700 1 -- 172.21.15.31:0/813531697 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000ee70 con 0x7fe0ac003a90 2023-10-09T06:21:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.698+0000 7fe0c498f700 1 -- 172.21.15.31:0/813531697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0ac003a90 msgr2=0x7fe0ac003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.698+0000 7fe0c498f700 1 --2- 172.21.15.31:0/813531697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0ac003a90 0x7fe0ac003ea0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000e210 tx=0x7fe0b000b040 comp rx=0 tx=0).stop 2023-10-09T06:21:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.698+0000 7fe0bed9d700 1 -- 172.21.15.31:0/813531697 reap_dead start 2023-10-09T06:21:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.698+0000 7fe0c498f700 1 -- 172.21.15.31:0/813531697 shutdown_connections 2023-10-09T06:21:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.698+0000 7fe0c498f700 1 -- 172.21.15.31:0/813531697 >> 172.21.15.31:0/813531697 conn(0x7fe0c0068ce0 msgr2=0x7fe0c00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.698+0000 7fe0c498f700 1 -- 172.21.15.31:0/813531697 shutdown_connections 2023-10-09T06:21:08.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.698+0000 7fe0c498f700 1 -- 172.21.15.31:0/813531697 wait complete. 2023-10-09T06:21:08.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.699+0000 7fe0c498f700 1 Processor -- start 2023-10-09T06:21:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.699+0000 7fe0c498f700 1 -- start start 2023-10-09T06:21:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0c498f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0ac003a90 0x7fe0c014d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0c498f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0151850 0x7fe0c01609a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0c498f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0c01533e0 0x7fe0c0153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0c498f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c014d720 con 0x7fe0c01533e0 2023-10-09T06:21:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0c498f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0161180 con 0x7fe0ac003a90 2023-10-09T06:21:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0c498f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00b2e90 con 0x7fe0c0151850 2023-10-09T06:21:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0bed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0c01533e0 0x7fe0c0153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0bed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0c01533e0 0x7fe0c0153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58524/0 (socket says 172.21.15.31:58524) 2023-10-09T06:21:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0bed9d700 1 -- 172.21.15.31:0/1205426587 learned_addr learned my addr 172.21.15.31:0/1205426587 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0be59c700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0ac003a90 0x7fe0c014d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0bdd9b700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0151850 0x7fe0c01609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0bed9d700 1 -- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0151850 msgr2=0x7fe0c01609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0bed9d700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0151850 0x7fe0c01609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0bed9d700 1 -- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0ac003a90 msgr2=0x7fe0c014d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0bed9d700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0ac003a90 0x7fe0c014d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0bed9d700 1 -- 172.21.15.31:0/1205426587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0160ee0 con 0x7fe0c01533e0 2023-10-09T06:21:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0bdd9b700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0151850 0x7fe0c01609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0bed9d700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0c01533e0 0x7fe0c0153830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac003a60 tx=0x7fe0b8001de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0b67fc700 1 -- 172.21.15.31:0/1205426587 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b800eeb0 con 0x7fe0c01533e0 2023-10-09T06:21:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0b67fc700 1 -- 172.21.15.31:0/1205426587 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b8004830 con 0x7fe0c01533e0 2023-10-09T06:21:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0c498f700 1 -- 172.21.15.31:0/1205426587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c00b2560 con 0x7fe0c01533e0 2023-10-09T06:21:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.700+0000 7fe0b67fc700 1 -- 172.21.15.31:0/1205426587 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8004bb0 con 0x7fe0c01533e0 2023-10-09T06:21:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.701+0000 7fe0c498f700 1 -- 172.21.15.31:0/1205426587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c00b2b20 con 0x7fe0c01533e0 2023-10-09T06:21:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.701+0000 7fe0c498f700 1 -- 172.21.15.31:0/1205426587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c004c3c0 con 0x7fe0c01533e0 2023-10-09T06:21:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.702+0000 7fe0b67fc700 1 -- 172.21.15.31:0/1205426587 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0b800c7b0 con 0x7fe0c01533e0 2023-10-09T06:21:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.702+0000 7fe0b67fc700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe0a0066f30 0x7fe0a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.702+0000 7fe0b67fc700 1 -- 172.21.15.31:0/1205426587 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0b8083dd0 con 0x7fe0c01533e0 2023-10-09T06:21:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.702+0000 7fe0be59c700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe0a0066f30 0x7fe0a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.703+0000 7fe0be59c700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe0a0066f30 0x7fe0a00693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000afd0 tx=0x7fe0b001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.706+0000 7fe0b67fc700 1 -- 172.21.15.31:0/1205426587 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0b804c5a0 con 0x7fe0c01533e0 2023-10-09T06:21:08.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.900+0000 7fe0c498f700 1 -- 172.21.15.31:0/1205426587 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0c00b2fd0 con 0x7fe0a0066f30 2023-10-09T06:21:08.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.908+0000 7fe0b67fc700 1 -- 172.21.15.31:0/1205426587 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260091 (secure 0 0 0) 0x7fe0c00b2fd0 con 0x7fe0a0066f30 2023-10-09T06:21:08.913 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:08.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.910+0000 7fe0c498f700 1 -- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe0a0066f30 msgr2=0x7fe0a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.910+0000 7fe0c498f700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe0a0066f30 0x7fe0a00693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000afd0 tx=0x7fe0b001a000 comp rx=0 tx=0).stop 2023-10-09T06:21:08.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.910+0000 7fe0c498f700 1 -- 172.21.15.31:0/1205426587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0c01533e0 msgr2=0x7fe0c0153830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:08.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.910+0000 7fe0c498f700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0c01533e0 0x7fe0c0153830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac003a60 tx=0x7fe0b8001de0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.910+0000 7fe0c498f700 1 -- 172.21.15.31:0/1205426587 shutdown_connections 2023-10-09T06:21:08.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.910+0000 7fe0c498f700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe0a0066f30 0x7fe0a00693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.910+0000 7fe0c498f700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0c01533e0 0x7fe0c0153830 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.910+0000 7fe0c498f700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0ac003a90 0x7fe0c014d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.910+0000 7fe0c498f700 1 --2- 172.21.15.31:0/1205426587 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe0c0151850 0x7fe0c01609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.910+0000 7fe0c498f700 1 -- 172.21.15.31:0/1205426587 >> 172.21.15.31:0/1205426587 conn(0x7fe0c0068ce0 msgr2=0x7fe0c01598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.911+0000 7fe0c498f700 1 -- 172.21.15.31:0/1205426587 shutdown_connections 2023-10-09T06:21:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:08.911+0000 7fe0c498f700 1 -- 172.21.15.31:0/1205426587 wait complete. 2023-10-09T06:21:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:21:08.923 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T06:21:08.521564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1708,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560791,"statfs":{"total":1600000000,"available":1598250700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009429"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701803+0000","last_change":"2023-10-09T06:20:54.699452+0000","last_active":"2023-10-09T06:20:54.701803+0000","last_peered":"2023-10-09T06:20:54.701803+0000","last_clean":"2023-10-09T06:20:54.701803+0000","last_became_active":"2023-10-09T06:20:54.699233+0000","last_became_peered":"2023-10-09T06:20:54.699233+0000","last_unstale":"2023-10-09T06:20:54.701803+0000","last_undegraded":"2023-10-09T06:20:54.701803+0000","last_fullsized":"2023-10-09T06:20:54.701803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:22.187237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704394+0000","last_change":"2023-10-09T06:20:54.703624+0000","last_active":"2023-10-09T06:20:54.704394+0000","last_peered":"2023-10-09T06:20:54.704394+0000","last_clean":"2023-10-09T06:20:54.704394+0000","last_became_active":"2023-10-09T06:20:54.703378+0000","last_became_peered":"2023-10-09T06:20:54.703378+0000","last_unstale":"2023-10-09T06:20:54.704394+0000","last_undegraded":"2023-10-09T06:20:54.704394+0000","last_fullsized":"2023-10-09T06:20:54.704394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.698154+0000","last_change":"2023-10-09T06:20:54.698072+0000","last_active":"2023-10-09T06:20:54.698154+0000","last_peered":"2023-10-09T06:20:54.698154+0000","last_clean":"2023-10-09T06:20:54.698154+0000","last_became_active":"2023-10-09T06:20:54.697793+0000","last_became_peered":"2023-10-09T06:20:54.697793+0000","last_unstale":"2023-10-09T06:20:54.698154+0000","last_undegraded":"2023-10-09T06:20:54.698154+0000","last_fullsized":"2023-10-09T06:20:54.698154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:13:00.912045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710137+0000","last_change":"2023-10-09T06:20:54.710027+0000","last_active":"2023-10-09T06:20:54.710137+0000","last_peered":"2023-10-09T06:20:54.710137+0000","last_clean":"2023-10-09T06:20:54.710137+0000","last_became_active":"2023-10-09T06:20:54.709311+0000","last_became_peered":"2023-10-09T06:20:54.709311+0000","last_unstale":"2023-10-09T06:20:54.710137+0000","last_undegraded":"2023-10-09T06:20:54.710137+0000","last_fullsized":"2023-10-09T06:20:54.710137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:14.974632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701768+0000","last_change":"2023-10-09T06:20:54.698108+0000","last_active":"2023-10-09T06:20:54.701768+0000","last_peered":"2023-10-09T06:20:54.701768+0000","last_clean":"2023-10-09T06:20:54.701768+0000","last_became_active":"2023-10-09T06:20:54.697253+0000","last_became_peered":"2023-10-09T06:20:54.697253+0000","last_unstale":"2023-10-09T06:20:54.701768+0000","last_undegraded":"2023-10-09T06:20:54.701768+0000","last_fullsized":"2023-10-09T06:20:54.701768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:25.482181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.714409+0000","last_change":"2023-10-09T06:20:54.714338+0000","last_active":"2023-10-09T06:20:54.714409+0000","last_peered":"2023-10-09T06:20:54.714409+0000","last_clean":"2023-10-09T06:20:54.714409+0000","last_became_active":"2023-10-09T06:20:54.710317+0000","last_became_peered":"2023-10-09T06:20:54.710317+0000","last_unstale":"2023-10-09T06:20:54.714409+0000","last_undegraded":"2023-10-09T06:20:54.714409+0000","last_fullsized":"2023-10-09T06:20:54.714409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:41:46.658358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701791+0000","last_change":"2023-10-09T06:20:54.699210+0000","last_active":"2023-10-09T06:20:54.701791+0000","last_peered":"2023-10-09T06:20:54.701791+0000","last_clean":"2023-10-09T06:20:54.701791+0000","last_became_active":"2023-10-09T06:20:54.698983+0000","last_became_peered":"2023-10-09T06:20:54.698983+0000","last_unstale":"2023-10-09T06:20:54.701791+0000","last_undegraded":"2023-10-09T06:20:54.701791+0000","last_fullsized":"2023-10-09T06:20:54.701791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:36.680555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707224+0000","last_change":"2023-10-09T06:20:54.706806+0000","last_active":"2023-10-09T06:20:54.707224+0000","last_peered":"2023-10-09T06:20:54.707224+0000","last_clean":"2023-10-09T06:20:54.707224+0000","last_became_active":"2023-10-09T06:20:54.706576+0000","last_became_peered":"2023-10-09T06:20:54.706576+0000","last_unstale":"2023-10-09T06:20:54.707224+0000","last_undegraded":"2023-10-09T06:20:54.707224+0000","last_fullsized":"2023-10-09T06:20:54.707224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708515+0000","last_change":"2023-10-09T06:20:54.708381+0000","last_active":"2023-10-09T06:20:54.708515+0000","last_peered":"2023-10-09T06:20:54.708515+0000","last_clean":"2023-10-09T06:20:54.708515+0000","last_became_active":"2023-10-09T06:20:54.708151+0000","last_became_peered":"2023-10-09T06:20:54.708151+0000","last_unstale":"2023-10-09T06:20:54.708515+0000","last_undegraded":"2023-10-09T06:20:54.708515+0000","last_fullsized":"2023-10-09T06:20:54.708515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:09.107980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707948+0000","last_change":"2023-10-09T06:20:54.707785+0000","last_active":"2023-10-09T06:20:54.707948+0000","last_peered":"2023-10-09T06:20:54.707948+0000","last_clean":"2023-10-09T06:20:54.707948+0000","last_became_active":"2023-10-09T06:20:54.707546+0000","last_became_peered":"2023-10-09T06:20:54.707546+0000","last_unstale":"2023-10-09T06:20:54.707948+0000","last_undegraded":"2023-10-09T06:20:54.707948+0000","last_fullsized":"2023-10-09T06:20:54.707948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.714127+0000","last_change":"2023-10-09T06:20:54.714014+0000","last_active":"2023-10-09T06:20:54.714127+0000","last_peered":"2023-10-09T06:20:54.714127+0000","last_clean":"2023-10-09T06:20:54.714127+0000","last_became_active":"2023-10-09T06:20:54.713717+0000","last_became_peered":"2023-10-09T06:20:54.713717+0000","last_unstale":"2023-10-09T06:20:54.714127+0000","last_undegraded":"2023-10-09T06:20:54.714127+0000","last_fullsized":"2023-10-09T06:20:54.714127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704060+0000","last_change":"2023-10-09T06:20:54.703797+0000","last_active":"2023-10-09T06:20:54.704060+0000","last_peered":"2023-10-09T06:20:54.704060+0000","last_clean":"2023-10-09T06:20:54.704060+0000","last_became_active":"2023-10-09T06:20:54.703569+0000","last_became_peered":"2023-10-09T06:20:54.703569+0000","last_unstale":"2023-10-09T06:20:54.704060+0000","last_undegraded":"2023-10-09T06:20:54.704060+0000","last_fullsized":"2023-10-09T06:20:54.704060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:20.426721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704373+0000","last_change":"2023-10-09T06:20:54.704118+0000","last_active":"2023-10-09T06:20:54.704373+0000","last_peered":"2023-10-09T06:20:54.704373+0000","last_clean":"2023-10-09T06:20:54.704373+0000","last_became_active":"2023-10-09T06:20:54.703694+0000","last_became_peered":"2023-10-09T06:20:54.703694+0000","last_unstale":"2023-10-09T06:20:54.704373+0000","last_undegraded":"2023-10-09T06:20:54.704373+0000","last_fullsized":"2023-10-09T06:20:54.704373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701375+0000","last_change":"2023-10-09T06:20:54.701294+0000","last_active":"2023-10-09T06:20:54.701375+0000","last_peered":"2023-10-09T06:20:54.701375+0000","last_clean":"2023-10-09T06:20:54.701375+0000","last_became_active":"2023-10-09T06:20:54.701078+0000","last_became_peered":"2023-10-09T06:20:54.701078+0000","last_unstale":"2023-10-09T06:20:54.701375+0000","last_undegraded":"2023-10-09T06:20:54.701375+0000","last_fullsized":"2023-10-09T06:20:54.701375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707239+0000","last_change":"2023-10-09T06:20:54.707148+0000","last_active":"2023-10-09T06:20:54.707239+0000","last_peered":"2023-10-09T06:20:54.707239+0000","last_clean":"2023-10-09T06:20:54.707239+0000","last_became_active":"2023-10-09T06:20:54.706930+0000","last_became_peered":"2023-10-09T06:20:54.706930+0000","last_unstale":"2023-10-09T06:20:54.707239+0000","last_undegraded":"2023-10-09T06:20:54.707239+0000","last_fullsized":"2023-10-09T06:20:54.707239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:41.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.714191+0000","last_change":"2023-10-09T06:20:54.714117+0000","last_active":"2023-10-09T06:20:54.714191+0000","last_peered":"2023-10-09T06:20:54.714191+0000","last_clean":"2023-10-09T06:20:54.714191+0000","last_became_active":"2023-10-09T06:20:54.709963+0000","last_became_peered":"2023-10-09T06:20:54.709963+0000","last_unstale":"2023-10-09T06:20:54.714191+0000","last_undegraded":"2023-10-09T06:20:54.714191+0000","last_fullsized":"2023-10-09T06:20:54.714191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:41.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711538+0000","last_change":"2023-10-09T06:20:54.710872+0000","last_active":"2023-10-09T06:20:54.711538+0000","last_peered":"2023-10-09T06:20:54.711538+0000","last_clean":"2023-10-09T06:20:54.711538+0000","last_became_active":"2023-10-09T06:20:54.710340+0000","last_became_peered":"2023-10-09T06:20:54.710340+0000","last_unstale":"2023-10-09T06:20:54.711538+0000","last_undegraded":"2023-10-09T06:20:54.711538+0000","last_fullsized":"2023-10-09T06:20:54.711538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:22.187237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702470+0000","last_change":"2023-10-09T06:20:54.702406+0000","last_active":"2023-10-09T06:20:54.702470+0000","last_peered":"2023-10-09T06:20:54.702470+0000","last_clean":"2023-10-09T06:20:54.702470+0000","last_became_active":"2023-10-09T06:20:54.702186+0000","last_became_peered":"2023-10-09T06:20:54.702186+0000","last_unstale":"2023-10-09T06:20:54.702470+0000","last_undegraded":"2023-10-09T06:20:54.702470+0000","last_fullsized":"2023-10-09T06:20:54.702470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:25.746263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703219+0000","last_change":"2023-10-09T06:20:54.702948+0000","last_active":"2023-10-09T06:20:54.703219+0000","last_peered":"2023-10-09T06:20:54.703219+0000","last_clean":"2023-10-09T06:20:54.703219+0000","last_became_active":"2023-10-09T06:20:54.702021+0000","last_became_peered":"2023-10-09T06:20:54.702021+0000","last_unstale":"2023-10-09T06:20:54.703219+0000","last_undegraded":"2023-10-09T06:20:54.703219+0000","last_fullsized":"2023-10-09T06:20:54.703219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:22:23.939760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718359+0000","last_change":"2023-10-09T06:20:53.692487+0000","last_active":"2023-10-09T06:20:54.718359+0000","last_peered":"2023-10-09T06:20:54.718359+0000","last_clean":"2023-10-09T06:20:54.718359+0000","last_became_active":"2023-10-09T06:20:53.692243+0000","last_became_peered":"2023-10-09T06:20:53.692243+0000","last_unstale":"2023-10-09T06:20:54.718359+0000","last_undegraded":"2023-10-09T06:20:54.718359+0000","last_fullsized":"2023-10-09T06:20:54.718359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:45.279383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703546+0000","last_change":"2023-10-09T06:20:54.703384+0000","last_active":"2023-10-09T06:20:54.703546+0000","last_peered":"2023-10-09T06:20:54.703546+0000","last_clean":"2023-10-09T06:20:54.703546+0000","last_became_active":"2023-10-09T06:20:54.703039+0000","last_became_peered":"2023-10-09T06:20:54.703039+0000","last_unstale":"2023-10-09T06:20:54.703546+0000","last_undegraded":"2023-10-09T06:20:54.703546+0000","last_fullsized":"2023-10-09T06:20:54.703546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:41:46.658358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.720817+0000","last_change":"2023-10-09T06:20:53.691165+0000","last_active":"2023-10-09T06:20:54.720817+0000","last_peered":"2023-10-09T06:20:54.720817+0000","last_clean":"2023-10-09T06:20:54.720817+0000","last_became_active":"2023-10-09T06:20:53.690550+0000","last_became_peered":"2023-10-09T06:20:53.690550+0000","last_unstale":"2023-10-09T06:20:54.720817+0000","last_undegraded":"2023-10-09T06:20:54.720817+0000","last_fullsized":"2023-10-09T06:20:54.720817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706226+0000","last_change":"2023-10-09T06:20:54.705731+0000","last_active":"2023-10-09T06:20:54.706226+0000","last_peered":"2023-10-09T06:20:54.706226+0000","last_clean":"2023-10-09T06:20:54.706226+0000","last_became_active":"2023-10-09T06:20:54.705514+0000","last_became_peered":"2023-10-09T06:20:54.705514+0000","last_unstale":"2023-10-09T06:20:54.706226+0000","last_undegraded":"2023-10-09T06:20:54.706226+0000","last_fullsized":"2023-10-09T06:20:54.706226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:08.261543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718196+0000","last_change":"2023-10-09T06:20:53.688123+0000","last_active":"2023-10-09T06:20:54.718196+0000","last_peered":"2023-10-09T06:20:54.718196+0000","last_clean":"2023-10-09T06:20:54.718196+0000","last_became_active":"2023-10-09T06:20:53.687892+0000","last_became_peered":"2023-10-09T06:20:53.687892+0000","last_unstale":"2023-10-09T06:20:54.718196+0000","last_undegraded":"2023-10-09T06:20:54.718196+0000","last_fullsized":"2023-10-09T06:20:54.718196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711524+0000","last_change":"2023-10-09T06:20:54.710847+0000","last_active":"2023-10-09T06:20:54.711524+0000","last_peered":"2023-10-09T06:20:54.711524+0000","last_clean":"2023-10-09T06:20:54.711524+0000","last_became_active":"2023-10-09T06:20:54.709608+0000","last_became_peered":"2023-10-09T06:20:54.709608+0000","last_unstale":"2023-10-09T06:20:54.711524+0000","last_undegraded":"2023-10-09T06:20:54.711524+0000","last_fullsized":"2023-10-09T06:20:54.711524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718036+0000","last_change":"2023-10-09T06:20:53.692698+0000","last_active":"2023-10-09T06:20:54.718036+0000","last_peered":"2023-10-09T06:20:54.718036+0000","last_clean":"2023-10-09T06:20:54.718036+0000","last_became_active":"2023-10-09T06:20:53.692506+0000","last_became_peered":"2023-10-09T06:20:53.692506+0000","last_unstale":"2023-10-09T06:20:54.718036+0000","last_undegraded":"2023-10-09T06:20:54.718036+0000","last_fullsized":"2023-10-09T06:20:54.718036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:24.740060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708977+0000","last_change":"2023-10-09T06:20:54.706985+0000","last_active":"2023-10-09T06:20:54.708977+0000","last_peered":"2023-10-09T06:20:54.708977+0000","last_clean":"2023-10-09T06:20:54.708977+0000","last_became_active":"2023-10-09T06:20:54.706350+0000","last_became_peered":"2023-10-09T06:20:54.706350+0000","last_unstale":"2023-10-09T06:20:54.708977+0000","last_undegraded":"2023-10-09T06:20:54.708977+0000","last_fullsized":"2023-10-09T06:20:54.708977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.717497+0000","last_change":"2023-10-09T06:20:53.688426+0000","last_active":"2023-10-09T06:20:54.717497+0000","last_peered":"2023-10-09T06:20:54.717497+0000","last_clean":"2023-10-09T06:20:54.717497+0000","last_became_active":"2023-10-09T06:20:53.688186+0000","last_became_peered":"2023-10-09T06:20:53.688186+0000","last_unstale":"2023-10-09T06:20:54.717497+0000","last_undegraded":"2023-10-09T06:20:54.717497+0000","last_fullsized":"2023-10-09T06:20:54.717497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:20.242831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703715+0000","last_change":"2023-10-09T06:20:54.703174+0000","last_active":"2023-10-09T06:20:54.703715+0000","last_peered":"2023-10-09T06:20:54.703715+0000","last_clean":"2023-10-09T06:20:54.703715+0000","last_became_active":"2023-10-09T06:20:54.702079+0000","last_became_peered":"2023-10-09T06:20:54.702079+0000","last_unstale":"2023-10-09T06:20:54.703715+0000","last_undegraded":"2023-10-09T06:20:54.703715+0000","last_fullsized":"2023-10-09T06:20:54.703715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:16.997567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.716826+0000","last_change":"2023-10-09T06:20:53.685459+0000","last_active":"2023-10-09T06:20:54.716826+0000","last_peered":"2023-10-09T06:20:54.716826+0000","last_clean":"2023-10-09T06:20:54.716826+0000","last_became_active":"2023-10-09T06:20:53.685232+0000","last_became_peered":"2023-10-09T06:20:53.685232+0000","last_unstale":"2023-10-09T06:20:54.716826+0000","last_undegraded":"2023-10-09T06:20:54.716826+0000","last_fullsized":"2023-10-09T06:20:54.716826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702623+0000","last_change":"2023-10-09T06:20:54.702532+0000","last_active":"2023-10-09T06:20:54.702623+0000","last_peered":"2023-10-09T06:20:54.702623+0000","last_clean":"2023-10-09T06:20:54.702623+0000","last_became_active":"2023-10-09T06:20:54.702245+0000","last_became_peered":"2023-10-09T06:20:54.702245+0000","last_unstale":"2023-10-09T06:20:54.702623+0000","last_undegraded":"2023-10-09T06:20:54.702623+0000","last_fullsized":"2023-10-09T06:20:54.702623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:41.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.698863+0000","last_change":"2023-10-09T06:20:53.686387+0000","last_active":"2023-10-09T06:20:54.698863+0000","last_peered":"2023-10-09T06:20:54.698863+0000","last_clean":"2023-10-09T06:20:54.698863+0000","last_became_active":"2023-10-09T06:20:53.686072+0000","last_became_peered":"2023-10-09T06:20:53.686072+0000","last_unstale":"2023-10-09T06:20:54.698863+0000","last_undegraded":"2023-10-09T06:20:54.698863+0000","last_fullsized":"2023-10-09T06:20:54.698863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702605+0000","last_change":"2023-10-09T06:20:54.702542+0000","last_active":"2023-10-09T06:20:54.702605+0000","last_peered":"2023-10-09T06:20:54.702605+0000","last_clean":"2023-10-09T06:20:54.702605+0000","last_became_active":"2023-10-09T06:20:54.702307+0000","last_became_peered":"2023-10-09T06:20:54.702307+0000","last_unstale":"2023-10-09T06:20:54.702605+0000","last_undegraded":"2023-10-09T06:20:54.702605+0000","last_fullsized":"2023-10-09T06:20:54.702605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:41.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701363+0000","last_change":"2023-10-09T06:20:53.692511+0000","last_active":"2023-10-09T06:20:54.701363+0000","last_peered":"2023-10-09T06:20:54.701363+0000","last_clean":"2023-10-09T06:20:54.701363+0000","last_became_active":"2023-10-09T06:20:53.689704+0000","last_became_peered":"2023-10-09T06:20:53.689704+0000","last_unstale":"2023-10-09T06:20:54.701363+0000","last_undegraded":"2023-10-09T06:20:54.701363+0000","last_fullsized":"2023-10-09T06:20:54.701363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704634+0000","last_change":"2023-10-09T06:20:54.704450+0000","last_active":"2023-10-09T06:20:54.704634+0000","last_peered":"2023-10-09T06:20:54.704634+0000","last_clean":"2023-10-09T06:20:54.704634+0000","last_became_active":"2023-10-09T06:20:54.704220+0000","last_became_peered":"2023-10-09T06:20:54.704220+0000","last_unstale":"2023-10-09T06:20:54.704634+0000","last_undegraded":"2023-10-09T06:20:54.704634+0000","last_fullsized":"2023-10-09T06:20:54.704634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.695920+0000","last_change":"2023-10-09T06:20:53.691307+0000","last_active":"2023-10-09T06:20:54.695920+0000","last_peered":"2023-10-09T06:20:54.695920+0000","last_clean":"2023-10-09T06:20:54.695920+0000","last_became_active":"2023-10-09T06:20:53.691063+0000","last_became_peered":"2023-10-09T06:20:53.691063+0000","last_unstale":"2023-10-09T06:20:54.695920+0000","last_undegraded":"2023-10-09T06:20:54.695920+0000","last_fullsized":"2023-10-09T06:20:54.695920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711494+0000","last_change":"2023-10-09T06:20:54.710553+0000","last_active":"2023-10-09T06:20:54.711494+0000","last_peered":"2023-10-09T06:20:54.711494+0000","last_clean":"2023-10-09T06:20:54.711494+0000","last_became_active":"2023-10-09T06:20:54.709556+0000","last_became_peered":"2023-10-09T06:20:54.709556+0000","last_unstale":"2023-10-09T06:20:54.711494+0000","last_undegraded":"2023-10-09T06:20:54.711494+0000","last_fullsized":"2023-10-09T06:20:54.711494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:46.203108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706958+0000","last_change":"2023-10-09T06:20:53.692986+0000","last_active":"2023-10-09T06:20:54.706958+0000","last_peered":"2023-10-09T06:20:54.706958+0000","last_clean":"2023-10-09T06:20:54.706958+0000","last_became_active":"2023-10-09T06:20:53.692570+0000","last_became_peered":"2023-10-09T06:20:53.692570+0000","last_unstale":"2023-10-09T06:20:54.706958+0000","last_undegraded":"2023-10-09T06:20:54.706958+0000","last_fullsized":"2023-10-09T06:20:54.706958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711428+0000","last_change":"2023-10-09T06:20:54.711358+0000","last_active":"2023-10-09T06:20:54.711428+0000","last_peered":"2023-10-09T06:20:54.711428+0000","last_clean":"2023-10-09T06:20:54.711428+0000","last_became_active":"2023-10-09T06:20:54.711114+0000","last_became_peered":"2023-10-09T06:20:54.711114+0000","last_unstale":"2023-10-09T06:20:54.711428+0000","last_undegraded":"2023-10-09T06:20:54.711428+0000","last_fullsized":"2023-10-09T06:20:54.711428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:31.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.722498+0000","last_change":"2023-10-09T06:20:53.694922+0000","last_active":"2023-10-09T06:20:54.722498+0000","last_peered":"2023-10-09T06:20:54.722498+0000","last_clean":"2023-10-09T06:20:54.722498+0000","last_became_active":"2023-10-09T06:20:53.694642+0000","last_became_peered":"2023-10-09T06:20:53.694642+0000","last_unstale":"2023-10-09T06:20:54.722498+0000","last_undegraded":"2023-10-09T06:20:54.722498+0000","last_fullsized":"2023-10-09T06:20:54.722498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:52.168522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704185+0000","last_change":"2023-10-09T06:20:54.704143+0000","last_active":"2023-10-09T06:20:54.704185+0000","last_peered":"2023-10-09T06:20:54.704185+0000","last_clean":"2023-10-09T06:20:54.704185+0000","last_became_active":"2023-10-09T06:20:54.703957+0000","last_became_peered":"2023-10-09T06:20:54.703957+0000","last_unstale":"2023-10-09T06:20:54.704185+0000","last_undegraded":"2023-10-09T06:20:54.704185+0000","last_fullsized":"2023-10-09T06:20:54.704185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:30.717922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.721464+0000","last_change":"2023-10-09T06:20:53.688682+0000","last_active":"2023-10-09T06:20:54.721464+0000","last_peered":"2023-10-09T06:20:54.721464+0000","last_clean":"2023-10-09T06:20:54.721464+0000","last_became_active":"2023-10-09T06:20:53.688399+0000","last_became_peered":"2023-10-09T06:20:53.688399+0000","last_unstale":"2023-10-09T06:20:54.721464+0000","last_undegraded":"2023-10-09T06:20:54.721464+0000","last_fullsized":"2023-10-09T06:20:54.721464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703190+0000","last_change":"2023-10-09T06:20:54.702039+0000","last_active":"2023-10-09T06:20:54.703190+0000","last_peered":"2023-10-09T06:20:54.703190+0000","last_clean":"2023-10-09T06:20:54.703190+0000","last_became_active":"2023-10-09T06:20:54.701760+0000","last_became_peered":"2023-10-09T06:20:54.701760+0000","last_unstale":"2023-10-09T06:20:54.703190+0000","last_undegraded":"2023-10-09T06:20:54.703190+0000","last_fullsized":"2023-10-09T06:20:54.703190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:41:46.658358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.719418+0000","last_change":"2023-10-09T06:20:53.690779+0000","last_active":"2023-10-09T06:20:54.719418+0000","last_peered":"2023-10-09T06:20:54.719418+0000","last_clean":"2023-10-09T06:20:54.719418+0000","last_became_active":"2023-10-09T06:20:53.690585+0000","last_became_peered":"2023-10-09T06:20:53.690585+0000","last_unstale":"2023-10-09T06:20:54.719418+0000","last_undegraded":"2023-10-09T06:20:54.719418+0000","last_fullsized":"2023-10-09T06:20:54.719418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:42.162727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703490+0000","last_change":"2023-10-09T06:20:54.703248+0000","last_active":"2023-10-09T06:20:54.703490+0000","last_peered":"2023-10-09T06:20:54.703490+0000","last_clean":"2023-10-09T06:20:54.703490+0000","last_became_active":"2023-10-09T06:20:54.701451+0000","last_became_peered":"2023-10-09T06:20:54.701451+0000","last_unstale":"2023-10-09T06:20:54.703490+0000","last_undegraded":"2023-10-09T06:20:54.703490+0000","last_fullsized":"2023-10-09T06:20:54.703490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:05:24.245558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707243+0000","last_change":"2023-10-09T06:20:53.691221+0000","last_active":"2023-10-09T06:20:54.707243+0000","last_peered":"2023-10-09T06:20:54.707243+0000","last_clean":"2023-10-09T06:20:54.707243+0000","last_became_active":"2023-10-09T06:20:53.690265+0000","last_became_peered":"2023-10-09T06:20:53.690265+0000","last_unstale":"2023-10-09T06:20:54.707243+0000","last_undegraded":"2023-10-09T06:20:54.707243+0000","last_fullsized":"2023-10-09T06:20:54.707243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703782+0000","last_change":"2023-10-09T06:20:54.703628+0000","last_active":"2023-10-09T06:20:54.703782+0000","last_peered":"2023-10-09T06:20:54.703782+0000","last_clean":"2023-10-09T06:20:54.703782+0000","last_became_active":"2023-10-09T06:20:54.703234+0000","last_became_peered":"2023-10-09T06:20:54.703234+0000","last_unstale":"2023-10-09T06:20:54.703782+0000","last_undegraded":"2023-10-09T06:20:54.703782+0000","last_fullsized":"2023-10-09T06:20:54.703782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:10:16.498873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699009+0000","last_change":"2023-10-09T06:20:53.684515+0000","last_active":"2023-10-09T06:20:54.699009+0000","last_peered":"2023-10-09T06:20:54.699009+0000","last_clean":"2023-10-09T06:20:54.699009+0000","last_became_active":"2023-10-09T06:20:53.684265+0000","last_became_peered":"2023-10-09T06:20:53.684265+0000","last_unstale":"2023-10-09T06:20:54.699009+0000","last_undegraded":"2023-10-09T06:20:54.699009+0000","last_fullsized":"2023-10-09T06:20:54.699009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699396+0000","last_change":"2023-10-09T06:20:54.699332+0000","last_active":"2023-10-09T06:20:54.699396+0000","last_peered":"2023-10-09T06:20:54.699396+0000","last_clean":"2023-10-09T06:20:54.699396+0000","last_became_active":"2023-10-09T06:20:54.698991+0000","last_became_peered":"2023-10-09T06:20:54.698991+0000","last_unstale":"2023-10-09T06:20:54.699396+0000","last_undegraded":"2023-10-09T06:20:54.699396+0000","last_fullsized":"2023-10-09T06:20:54.699396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:41.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.721075+0000","last_change":"2023-10-09T06:20:53.694124+0000","last_active":"2023-10-09T06:20:54.721075+0000","last_peered":"2023-10-09T06:20:54.721075+0000","last_clean":"2023-10-09T06:20:54.721075+0000","last_became_active":"2023-10-09T06:20:53.693903+0000","last_became_peered":"2023-10-09T06:20:53.693903+0000","last_unstale":"2023-10-09T06:20:54.721075+0000","last_undegraded":"2023-10-09T06:20:54.721075+0000","last_fullsized":"2023-10-09T06:20:54.721075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704529+0000","last_change":"2023-10-09T06:20:54.704310+0000","last_active":"2023-10-09T06:20:54.704529+0000","last_peered":"2023-10-09T06:20:54.704529+0000","last_clean":"2023-10-09T06:20:54.704529+0000","last_became_active":"2023-10-09T06:20:54.703990+0000","last_became_peered":"2023-10-09T06:20:54.703990+0000","last_unstale":"2023-10-09T06:20:54.704529+0000","last_undegraded":"2023-10-09T06:20:54.704529+0000","last_fullsized":"2023-10-09T06:20:54.704529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:14.974632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.719608+0000","last_change":"2023-10-09T06:20:53.692436+0000","last_active":"2023-10-09T06:20:54.719608+0000","last_peered":"2023-10-09T06:20:54.719608+0000","last_clean":"2023-10-09T06:20:54.719608+0000","last_became_active":"2023-10-09T06:20:53.692191+0000","last_became_peered":"2023-10-09T06:20:53.692191+0000","last_unstale":"2023-10-09T06:20:54.719608+0000","last_undegraded":"2023-10-09T06:20:54.719608+0000","last_fullsized":"2023-10-09T06:20:54.719608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:54.510879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703765+0000","last_change":"2023-10-09T06:20:54.703474+0000","last_active":"2023-10-09T06:20:54.703765+0000","last_peered":"2023-10-09T06:20:54.703765+0000","last_clean":"2023-10-09T06:20:54.703765+0000","last_became_active":"2023-10-09T06:20:54.702986+0000","last_became_peered":"2023-10-09T06:20:54.702986+0000","last_unstale":"2023-10-09T06:20:54.703765+0000","last_undegraded":"2023-10-09T06:20:54.703765+0000","last_fullsized":"2023-10-09T06:20:54.703765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:46.203108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699329+0000","last_change":"2023-10-09T06:20:53.692601+0000","last_active":"2023-10-09T06:20:54.699329+0000","last_peered":"2023-10-09T06:20:54.699329+0000","last_clean":"2023-10-09T06:20:54.699329+0000","last_became_active":"2023-10-09T06:20:53.692249+0000","last_became_peered":"2023-10-09T06:20:53.692249+0000","last_unstale":"2023-10-09T06:20:54.699329+0000","last_undegraded":"2023-10-09T06:20:54.699329+0000","last_fullsized":"2023-10-09T06:20:54.699329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710118+0000","last_change":"2023-10-09T06:20:54.709870+0000","last_active":"2023-10-09T06:20:54.710118+0000","last_peered":"2023-10-09T06:20:54.710118+0000","last_clean":"2023-10-09T06:20:54.710118+0000","last_became_active":"2023-10-09T06:20:54.709017+0000","last_became_peered":"2023-10-09T06:20:54.709017+0000","last_unstale":"2023-10-09T06:20:54.710118+0000","last_undegraded":"2023-10-09T06:20:54.710118+0000","last_fullsized":"2023-10-09T06:20:54.710118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:48.043711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707068+0000","last_change":"2023-10-09T06:20:53.694336+0000","last_active":"2023-10-09T06:20:54.707068+0000","last_peered":"2023-10-09T06:20:54.707068+0000","last_clean":"2023-10-09T06:20:54.707068+0000","last_became_active":"2023-10-09T06:20:53.694107+0000","last_became_peered":"2023-10-09T06:20:53.694107+0000","last_unstale":"2023-10-09T06:20:54.707068+0000","last_undegraded":"2023-10-09T06:20:54.707068+0000","last_fullsized":"2023-10-09T06:20:54.707068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:29.711719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.705770+0000","last_change":"2023-10-09T06:20:54.705708+0000","last_active":"2023-10-09T06:20:54.705770+0000","last_peered":"2023-10-09T06:20:54.705770+0000","last_clean":"2023-10-09T06:20:54.705770+0000","last_became_active":"2023-10-09T06:20:54.705487+0000","last_became_peered":"2023-10-09T06:20:54.705487+0000","last_unstale":"2023-10-09T06:20:54.705770+0000","last_undegraded":"2023-10-09T06:20:54.705770+0000","last_fullsized":"2023-10-09T06:20:54.705770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:20.728264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701105+0000","last_change":"2023-10-09T06:20:54.700944+0000","last_active":"2023-10-09T06:20:54.701105+0000","last_peered":"2023-10-09T06:20:54.701105+0000","last_clean":"2023-10-09T06:20:54.701105+0000","last_became_active":"2023-10-09T06:20:54.700732+0000","last_became_peered":"2023-10-09T06:20:54.700732+0000","last_unstale":"2023-10-09T06:20:54.701105+0000","last_undegraded":"2023-10-09T06:20:54.701105+0000","last_fullsized":"2023-10-09T06:20:54.701105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.697278+0000","last_change":"2023-10-09T06:20:53.688729+0000","last_active":"2023-10-09T06:20:54.697278+0000","last_peered":"2023-10-09T06:20:54.697278+0000","last_clean":"2023-10-09T06:20:54.697278+0000","last_became_active":"2023-10-09T06:20:53.688468+0000","last_became_peered":"2023-10-09T06:20:53.688468+0000","last_unstale":"2023-10-09T06:20:54.697278+0000","last_undegraded":"2023-10-09T06:20:54.697278+0000","last_fullsized":"2023-10-09T06:20:54.697278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710841+0000","last_change":"2023-10-09T06:20:54.710794+0000","last_active":"2023-10-09T06:20:54.710841+0000","last_peered":"2023-10-09T06:20:54.710841+0000","last_clean":"2023-10-09T06:20:54.710841+0000","last_became_active":"2023-10-09T06:20:54.710597+0000","last_became_peered":"2023-10-09T06:20:54.710597+0000","last_unstale":"2023-10-09T06:20:54.710841+0000","last_undegraded":"2023-10-09T06:20:54.710841+0000","last_fullsized":"2023-10-09T06:20:54.710841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:46.203108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.707347+0000","last_change":"2023-10-09T06:20:53.691840+0000","last_active":"2023-10-09T06:20:54.707347+0000","last_peered":"2023-10-09T06:20:54.707347+0000","last_clean":"2023-10-09T06:20:54.707347+0000","last_became_active":"2023-10-09T06:20:53.691004+0000","last_became_peered":"2023-10-09T06:20:53.691004+0000","last_unstale":"2023-10-09T06:20:54.707347+0000","last_undegraded":"2023-10-09T06:20:54.707347+0000","last_fullsized":"2023-10-09T06:20:54.707347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696667+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:20:54.696667+0000","last_peered":"2023-10-09T06:20:54.696667+0000","last_clean":"2023-10-09T06:20:54.696667+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:20:54.696667+0000","last_undegraded":"2023-10-09T06:20:54.696667+0000","last_fullsized":"2023-10-09T06:20:54.696667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702605+0000","last_change":"2023-10-09T06:20:54.702399+0000","last_active":"2023-10-09T06:20:54.702605+0000","last_peered":"2023-10-09T06:20:54.702605+0000","last_clean":"2023-10-09T06:20:54.702605+0000","last_became_active":"2023-10-09T06:20:54.701799+0000","last_became_peered":"2023-10-09T06:20:54.701799+0000","last_unstale":"2023-10-09T06:20:54.702605+0000","last_undegraded":"2023-10-09T06:20:54.702605+0000","last_fullsized":"2023-10-09T06:20:54.702605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696279+0000","last_change":"2023-10-09T06:20:53.694796+0000","last_active":"2023-10-09T06:20:54.696279+0000","last_peered":"2023-10-09T06:20:54.696279+0000","last_clean":"2023-10-09T06:20:54.696279+0000","last_became_active":"2023-10-09T06:20:53.694541+0000","last_became_peered":"2023-10-09T06:20:53.694541+0000","last_unstale":"2023-10-09T06:20:54.696279+0000","last_undegraded":"2023-10-09T06:20:54.696279+0000","last_fullsized":"2023-10-09T06:20:54.696279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696773+0000","last_change":"2023-10-09T06:20:53.690652+0000","last_active":"2023-10-09T06:20:54.696773+0000","last_peered":"2023-10-09T06:20:54.696773+0000","last_clean":"2023-10-09T06:20:54.696773+0000","last_became_active":"2023-10-09T06:20:53.690426+0000","last_became_peered":"2023-10-09T06:20:53.690426+0000","last_unstale":"2023-10-09T06:20:54.696773+0000","last_undegraded":"2023-10-09T06:20:54.696773+0000","last_fullsized":"2023-10-09T06:20:54.696773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704374+0000","last_change":"2023-10-09T06:20:54.703240+0000","last_active":"2023-10-09T06:20:54.704374+0000","last_peered":"2023-10-09T06:20:54.704374+0000","last_clean":"2023-10-09T06:20:54.704374+0000","last_became_active":"2023-10-09T06:20:54.703000+0000","last_became_peered":"2023-10-09T06:20:54.703000+0000","last_unstale":"2023-10-09T06:20:54.704374+0000","last_undegraded":"2023-10-09T06:20:54.704374+0000","last_fullsized":"2023-10-09T06:20:54.704374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T06:20:55.695702+0000","last_change":"2023-10-09T06:20:53.693463+0000","last_active":"2023-10-09T06:20:55.695702+0000","last_peered":"2023-10-09T06:20:55.695702+0000","last_clean":"2023-10-09T06:20:55.695702+0000","last_became_active":"2023-10-09T06:20:53.693223+0000","last_became_peered":"2023-10-09T06:20:53.693223+0000","last_unstale":"2023-10-09T06:20:55.695702+0000","last_undegraded":"2023-10-09T06:20:55.695702+0000","last_fullsized":"2023-10-09T06:20:55.695702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.705276+0000","last_change":"2023-10-09T06:20:54.705213+0000","last_active":"2023-10-09T06:20:54.705276+0000","last_peered":"2023-10-09T06:20:54.705276+0000","last_clean":"2023-10-09T06:20:54.705276+0000","last_became_active":"2023-10-09T06:20:54.704911+0000","last_became_peered":"2023-10-09T06:20:54.704911+0000","last_unstale":"2023-10-09T06:20:54.705276+0000","last_undegraded":"2023-10-09T06:20:54.705276+0000","last_fullsized":"2023-10-09T06:20:54.705276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:22:23.939760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718435+0000","last_change":"2023-10-09T06:20:53.689939+0000","last_active":"2023-10-09T06:20:54.718435+0000","last_peered":"2023-10-09T06:20:54.718435+0000","last_clean":"2023-10-09T06:20:54.718435+0000","last_became_active":"2023-10-09T06:20:53.689710+0000","last_became_peered":"2023-10-09T06:20:53.689710+0000","last_unstale":"2023-10-09T06:20:54.718435+0000","last_undegraded":"2023-10-09T06:20:54.718435+0000","last_fullsized":"2023-10-09T06:20:54.718435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.698754+0000","last_change":"2023-10-09T06:20:54.698648+0000","last_active":"2023-10-09T06:20:54.698754+0000","last_peered":"2023-10-09T06:20:54.698754+0000","last_clean":"2023-10-09T06:20:54.698754+0000","last_became_active":"2023-10-09T06:20:54.698423+0000","last_became_peered":"2023-10-09T06:20:54.698423+0000","last_unstale":"2023-10-09T06:20:54.698754+0000","last_undegraded":"2023-10-09T06:20:54.698754+0000","last_fullsized":"2023-10-09T06:20:54.698754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.694880+0000","last_change":"2023-10-09T06:20:53.691357+0000","last_active":"2023-10-09T06:20:54.694880+0000","last_peered":"2023-10-09T06:20:54.694880+0000","last_clean":"2023-10-09T06:20:54.694880+0000","last_became_active":"2023-10-09T06:20:53.690961+0000","last_became_peered":"2023-10-09T06:20:53.690961+0000","last_unstale":"2023-10-09T06:20:54.694880+0000","last_undegraded":"2023-10-09T06:20:54.694880+0000","last_fullsized":"2023-10-09T06:20:54.694880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:19.722061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706057+0000","last_change":"2023-10-09T06:20:54.705990+0000","last_active":"2023-10-09T06:20:54.706057+0000","last_peered":"2023-10-09T06:20:54.706057+0000","last_clean":"2023-10-09T06:20:54.706057+0000","last_became_active":"2023-10-09T06:20:54.705793+0000","last_became_peered":"2023-10-09T06:20:54.705793+0000","last_unstale":"2023-10-09T06:20:54.706057+0000","last_undegraded":"2023-10-09T06:20:54.706057+0000","last_fullsized":"2023-10-09T06:20:54.706057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:53.174725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699422+0000","last_change":"2023-10-09T06:20:53.693042+0000","last_active":"2023-10-09T06:20:54.699422+0000","last_peered":"2023-10-09T06:20:54.699422+0000","last_clean":"2023-10-09T06:20:54.699422+0000","last_became_active":"2023-10-09T06:20:53.692818+0000","last_became_peered":"2023-10-09T06:20:53.692818+0000","last_unstale":"2023-10-09T06:20:54.699422+0000","last_undegraded":"2023-10-09T06:20:54.699422+0000","last_fullsized":"2023-10-09T06:20:54.699422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:19.420519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702969+0000","last_change":"2023-10-09T06:20:54.702866+0000","last_active":"2023-10-09T06:20:54.702969+0000","last_peered":"2023-10-09T06:20:54.702969+0000","last_clean":"2023-10-09T06:20:54.702969+0000","last_became_active":"2023-10-09T06:20:54.702652+0000","last_became_peered":"2023-10-09T06:20:54.702652+0000","last_unstale":"2023-10-09T06:20:54.702969+0000","last_undegraded":"2023-10-09T06:20:54.702969+0000","last_fullsized":"2023-10-09T06:20:54.702969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:08.261543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.699122+0000","last_change":"2023-10-09T06:20:53.692859+0000","last_active":"2023-10-09T06:20:54.699122+0000","last_peered":"2023-10-09T06:20:54.699122+0000","last_clean":"2023-10-09T06:20:54.699122+0000","last_became_active":"2023-10-09T06:20:53.687193+0000","last_became_peered":"2023-10-09T06:20:53.687193+0000","last_unstale":"2023-10-09T06:20:54.699122+0000","last_undegraded":"2023-10-09T06:20:54.699122+0000","last_fullsized":"2023-10-09T06:20:54.699122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:15.991364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.706025+0000","last_change":"2023-10-09T06:20:54.705836+0000","last_active":"2023-10-09T06:20:54.706025+0000","last_peered":"2023-10-09T06:20:54.706025+0000","last_clean":"2023-10-09T06:20:54.706025+0000","last_became_active":"2023-10-09T06:20:54.705607+0000","last_became_peered":"2023-10-09T06:20:54.705607+0000","last_unstale":"2023-10-09T06:20:54.706025+0000","last_undegraded":"2023-10-09T06:20:54.706025+0000","last_fullsized":"2023-10-09T06:20:54.706025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:17.435271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718723+0000","last_change":"2023-10-09T06:20:53.688523+0000","last_active":"2023-10-09T06:20:54.718723+0000","last_peered":"2023-10-09T06:20:54.718723+0000","last_clean":"2023-10-09T06:20:54.718723+0000","last_became_active":"2023-10-09T06:20:53.688245+0000","last_became_peered":"2023-10-09T06:20:53.688245+0000","last_unstale":"2023-10-09T06:20:54.718723+0000","last_undegraded":"2023-10-09T06:20:54.718723+0000","last_fullsized":"2023-10-09T06:20:54.718723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:52.168522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704441+0000","last_change":"2023-10-09T06:20:54.704343+0000","last_active":"2023-10-09T06:20:54.704441+0000","last_peered":"2023-10-09T06:20:54.704441+0000","last_clean":"2023-10-09T06:20:54.704441+0000","last_became_active":"2023-10-09T06:20:54.704076+0000","last_became_peered":"2023-10-09T06:20:54.704076+0000","last_unstale":"2023-10-09T06:20:54.704441+0000","last_undegraded":"2023-10-09T06:20:54.704441+0000","last_fullsized":"2023-10-09T06:20:54.704441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:41.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.696258+0000","last_change":"2023-10-09T06:20:53.693147+0000","last_active":"2023-10-09T06:20:54.696258+0000","last_peered":"2023-10-09T06:20:54.696258+0000","last_clean":"2023-10-09T06:20:54.696258+0000","last_became_active":"2023-10-09T06:20:53.692925+0000","last_became_peered":"2023-10-09T06:20:53.692925+0000","last_unstale":"2023-10-09T06:20:54.696258+0000","last_undegraded":"2023-10-09T06:20:54.696258+0000","last_fullsized":"2023-10-09T06:20:54.696258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:22.981305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.710381+0000","last_change":"2023-10-09T06:20:54.710313+0000","last_active":"2023-10-09T06:20:54.710381+0000","last_peered":"2023-10-09T06:20:54.710381+0000","last_clean":"2023-10-09T06:20:54.710381+0000","last_became_active":"2023-10-09T06:20:54.710082+0000","last_became_peered":"2023-10-09T06:20:54.710082+0000","last_unstale":"2023-10-09T06:20:54.710381+0000","last_undegraded":"2023-10-09T06:20:54.710381+0000","last_fullsized":"2023-10-09T06:20:54.710381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:45.285681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.720656+0000","last_change":"2023-10-09T06:20:53.692399+0000","last_active":"2023-10-09T06:20:54.720656+0000","last_peered":"2023-10-09T06:20:54.720656+0000","last_clean":"2023-10-09T06:20:54.720656+0000","last_became_active":"2023-10-09T06:20:53.692157+0000","last_became_peered":"2023-10-09T06:20:53.692157+0000","last_unstale":"2023-10-09T06:20:54.720656+0000","last_undegraded":"2023-10-09T06:20:54.720656+0000","last_fullsized":"2023-10-09T06:20:54.720656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:28.029589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711476+0000","last_change":"2023-10-09T06:20:54.710127+0000","last_active":"2023-10-09T06:20:54.711476+0000","last_peered":"2023-10-09T06:20:54.711476+0000","last_clean":"2023-10-09T06:20:54.711476+0000","last_became_active":"2023-10-09T06:20:54.709293+0000","last_became_peered":"2023-10-09T06:20:54.709293+0000","last_unstale":"2023-10-09T06:20:54.711476+0000","last_undegraded":"2023-10-09T06:20:54.711476+0000","last_fullsized":"2023-10-09T06:20:54.711476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:22:23.939760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.718472+0000","last_change":"2023-10-09T06:20:53.687221+0000","last_active":"2023-10-09T06:20:54.718472+0000","last_peered":"2023-10-09T06:20:54.718472+0000","last_clean":"2023-10-09T06:20:54.718472+0000","last_became_active":"2023-10-09T06:20:53.686998+0000","last_became_peered":"2023-10-09T06:20:53.686998+0000","last_unstale":"2023-10-09T06:20:54.718472+0000","last_undegraded":"2023-10-09T06:20:54.718472+0000","last_fullsized":"2023-10-09T06:20:54.718472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:52.670256+0000","last_clean_scrub_stamp":"2023-10-09T06:20:52.670256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.813783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703747+0000","last_change":"2023-10-09T06:20:54.703089+0000","last_active":"2023-10-09T06:20:54.703747+0000","last_peered":"2023-10-09T06:20:54.703747+0000","last_clean":"2023-10-09T06:20:54.703747+0000","last_became_active":"2023-10-09T06:20:54.702720+0000","last_became_peered":"2023-10-09T06:20:54.702720+0000","last_unstale":"2023-10-09T06:20:54.703747+0000","last_undegraded":"2023-10-09T06:20:54.703747+0000","last_fullsized":"2023-10-09T06:20:54.703747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:48.043711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.700469+0000","last_change":"2023-10-09T06:20:54.700400+0000","last_active":"2023-10-09T06:20:54.700469+0000","last_peered":"2023-10-09T06:20:54.700469+0000","last_clean":"2023-10-09T06:20:54.700469+0000","last_became_active":"2023-10-09T06:20:54.700120+0000","last_became_peered":"2023-10-09T06:20:54.700120+0000","last_unstale":"2023-10-09T06:20:54.700469+0000","last_undegraded":"2023-10-09T06:20:54.700469+0000","last_fullsized":"2023-10-09T06:20:54.700469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711227+0000","last_change":"2023-10-09T06:20:54.711172+0000","last_active":"2023-10-09T06:20:54.711227+0000","last_peered":"2023-10-09T06:20:54.711227+0000","last_clean":"2023-10-09T06:20:54.711227+0000","last_became_active":"2023-10-09T06:20:54.710983+0000","last_became_peered":"2023-10-09T06:20:54.710983+0000","last_unstale":"2023-10-09T06:20:54.711227+0000","last_undegraded":"2023-10-09T06:20:54.711227+0000","last_fullsized":"2023-10-09T06:20:54.711227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:20.728264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.709159+0000","last_change":"2023-10-09T06:20:54.707142+0000","last_active":"2023-10-09T06:20:54.709159+0000","last_peered":"2023-10-09T06:20:54.709159+0000","last_clean":"2023-10-09T06:20:54.709159+0000","last_became_active":"2023-10-09T06:20:54.706670+0000","last_became_peered":"2023-10-09T06:20:54.706670+0000","last_unstale":"2023-10-09T06:20:54.709159+0000","last_undegraded":"2023-10-09T06:20:54.709159+0000","last_fullsized":"2023-10-09T06:20:54.709159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:09.107980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.701930+0000","last_change":"2023-10-09T06:20:54.701836+0000","last_active":"2023-10-09T06:20:54.701930+0000","last_peered":"2023-10-09T06:20:54.701930+0000","last_clean":"2023-10-09T06:20:54.701930+0000","last_became_active":"2023-10-09T06:20:54.701556+0000","last_became_peered":"2023-10-09T06:20:54.701556+0000","last_unstale":"2023-10-09T06:20:54.701930+0000","last_undegraded":"2023-10-09T06:20:54.701930+0000","last_fullsized":"2023-10-09T06:20:54.701930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708330+0000","last_change":"2023-10-09T06:20:54.708268+0000","last_active":"2023-10-09T06:20:54.708330+0000","last_peered":"2023-10-09T06:20:54.708330+0000","last_clean":"2023-10-09T06:20:54.708330+0000","last_became_active":"2023-10-09T06:20:54.707751+0000","last_became_peered":"2023-10-09T06:20:54.707751+0000","last_unstale":"2023-10-09T06:20:54.708330+0000","last_undegraded":"2023-10-09T06:20:54.708330+0000","last_fullsized":"2023-10-09T06:20:54.708330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704996+0000","last_change":"2023-10-09T06:20:54.704931+0000","last_active":"2023-10-09T06:20:54.704996+0000","last_peered":"2023-10-09T06:20:54.704996+0000","last_clean":"2023-10-09T06:20:54.704996+0000","last_became_active":"2023-10-09T06:20:54.704697+0000","last_became_peered":"2023-10-09T06:20:54.704697+0000","last_unstale":"2023-10-09T06:20:54.704996+0000","last_undegraded":"2023-10-09T06:20:54.704996+0000","last_fullsized":"2023-10-09T06:20:54.704996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:41.492228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.702925+0000","last_change":"2023-10-09T06:20:54.702684+0000","last_active":"2023-10-09T06:20:54.702925+0000","last_peered":"2023-10-09T06:20:54.702925+0000","last_clean":"2023-10-09T06:20:54.702925+0000","last_became_active":"2023-10-09T06:20:54.702422+0000","last_became_peered":"2023-10-09T06:20:54.702422+0000","last_unstale":"2023-10-09T06:20:54.702925+0000","last_undegraded":"2023-10-09T06:20:54.702925+0000","last_fullsized":"2023-10-09T06:20:54.702925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708093+0000","last_change":"2023-10-09T06:20:54.708004+0000","last_active":"2023-10-09T06:20:54.708093+0000","last_peered":"2023-10-09T06:20:54.708093+0000","last_clean":"2023-10-09T06:20:54.708093+0000","last_became_active":"2023-10-09T06:20:54.707760+0000","last_became_peered":"2023-10-09T06:20:54.707760+0000","last_unstale":"2023-10-09T06:20:54.708093+0000","last_undegraded":"2023-10-09T06:20:54.708093+0000","last_fullsized":"2023-10-09T06:20:54.708093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:17.509261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.709600+0000","last_change":"2023-10-09T06:20:54.709536+0000","last_active":"2023-10-09T06:20:54.709600+0000","last_peered":"2023-10-09T06:20:54.709600+0000","last_clean":"2023-10-09T06:20:54.709600+0000","last_became_active":"2023-10-09T06:20:54.707797+0000","last_became_peered":"2023-10-09T06:20:54.707797+0000","last_unstale":"2023-10-09T06:20:54.709600+0000","last_undegraded":"2023-10-09T06:20:54.709600+0000","last_fullsized":"2023-10-09T06:20:54.709600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:10:16.498873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.708462+0000","last_change":"2023-10-09T06:20:54.708406+0000","last_active":"2023-10-09T06:20:54.708462+0000","last_peered":"2023-10-09T06:20:54.708462+0000","last_clean":"2023-10-09T06:20:54.708462+0000","last_became_active":"2023-10-09T06:20:54.708045+0000","last_became_peered":"2023-10-09T06:20:54.708045+0000","last_unstale":"2023-10-09T06:20:54.708462+0000","last_undegraded":"2023-10-09T06:20:54.708462+0000","last_fullsized":"2023-10-09T06:20:54.708462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:35.542736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.711509+0000","last_change":"2023-10-09T06:20:54.710694+0000","last_active":"2023-10-09T06:20:54.711509+0000","last_peered":"2023-10-09T06:20:54.711509+0000","last_clean":"2023-10-09T06:20:54.711509+0000","last_became_active":"2023-10-09T06:20:54.709873+0000","last_became_peered":"2023-10-09T06:20:54.709873+0000","last_unstale":"2023-10-09T06:20:54.711509+0000","last_undegraded":"2023-10-09T06:20:54.711509+0000","last_fullsized":"2023-10-09T06:20:54.711509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:25.482181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.703512+0000","last_change":"2023-10-09T06:20:54.703439+0000","last_active":"2023-10-09T06:20:54.703512+0000","last_peered":"2023-10-09T06:20:54.703512+0000","last_clean":"2023-10-09T06:20:54.703512+0000","last_became_active":"2023-10-09T06:20:54.702617+0000","last_became_peered":"2023-10-09T06:20:54.702617+0000","last_unstale":"2023-10-09T06:20:54.703512+0000","last_undegraded":"2023-10-09T06:20:54.703512+0000","last_fullsized":"2023-10-09T06:20:54.703512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.403490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:20:54.704333+0000","last_change":"2023-10-09T06:20:54.704167+0000","last_active":"2023-10-09T06:20:54.704333+0000","last_peered":"2023-10-09T06:20:54.704333+0000","last_clean":"2023-10-09T06:20:54.704333+0000","last_became_active":"2023-10-09T06:20:54.703924+0000","last_became_peered":"2023-10-09T06:20:54.703924+0000","last_unstale":"2023-10-09T06:20:54.704333+0000","last_undegraded":"2023-10-09T06:20:54.704333+0000","last_fullsized":"2023-10-09T06:20:54.704333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:53.676459+0000","last_clean_scrub_stamp":"2023-10-09T06:20:53.676459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.666476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]}],"pool_statfs":[]}} 2023-10-09T06:21:08.929 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-09T06:21:08.929 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-09T06:21:08.930 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-09T06:21:08.930 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-09T06:21:09.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.080+0000 7f43be654700 1 Processor -- start 2023-10-09T06:21:09.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.080+0000 7f43be654700 1 -- start start 2023-10-09T06:21:09.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.081+0000 7f43be654700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f43b815a620 0x7f43b815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.081+0000 7f43be654700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b815cbb0 con 0x7f43b8157870 2023-10-09T06:21:09.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.081+0000 7f43be654700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b815bfa0 con 0x7f43b815d580 2023-10-09T06:21:09.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.081+0000 7f43be654700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b815bdb0 con 0x7f43b815a620 2023-10-09T06:21:09.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.081+0000 7f43b77fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f43b815a620 0x7f43b815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.081+0000 7f43b7fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f43b8157870 0x7f43b815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60726/0 (socket says 172.21.15.31:60726) 2023-10-09T06:21:09.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.081+0000 7f43b7fff700 1 -- 172.21.15.31:0/2125489412 learned_addr learned my addr 172.21.15.31:0/2125489412 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:09.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.081+0000 7f43b77fe700 1 -- 172.21.15.31:0/2125489412 >> v1:172.21.15.158:6789/0 conn(0x7f43b815d580 legacy=0x7f43b8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:09.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.081+0000 7f43b77fe700 1 -- 172.21.15.31:0/2125489412 >> v1:172.21.15.31:6789/0 conn(0x7f43b8157870 legacy=0x7f43b815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.081+0000 7f43b77fe700 1 -- 172.21.15.31:0/2125489412 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b815c280 con 0x7f43b815a620 2023-10-09T06:21:09.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.082+0000 7f43b77fe700 1 --2- 172.21.15.31:0/2125489412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b815a620 0x7f43b815d040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f43a80098e0 tx=0x7f43a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d865aea495dadd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:09.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.082+0000 7f43b6ffd700 1 -- 172.21.15.31:0/2125489412 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8009e80 con 0x7f43b815a620 2023-10-09T06:21:09.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.082+0000 7f43b6ffd700 1 -- 172.21.15.31:0/2125489412 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a800b760 con 0x7f43b815a620 2023-10-09T06:21:09.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.082+0000 7f43b6ffd700 1 -- 172.21.15.31:0/2125489412 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a800bae0 con 0x7f43b815a620 2023-10-09T06:21:09.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.082+0000 7f43be654700 1 -- 172.21.15.31:0/2125489412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b815a620 msgr2=0x7f43b815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.082+0000 7f43be654700 1 --2- 172.21.15.31:0/2125489412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b815a620 0x7f43b815d040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f43a80098e0 tx=0x7f43a80091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.082+0000 7f43be654700 1 -- 172.21.15.31:0/2125489412 shutdown_connections 2023-10-09T06:21:09.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.082+0000 7f43be654700 1 --2- 172.21.15.31:0/2125489412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b815a620 0x7f43b815d040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.082+0000 7f43be654700 1 -- 172.21.15.31:0/2125489412 >> 172.21.15.31:0/2125489412 conn(0x7f43b8068ce0 msgr2=0x7f43b80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:09.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.082+0000 7f43be654700 1 -- 172.21.15.31:0/2125489412 shutdown_connections 2023-10-09T06:21:09.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.082+0000 7f43be654700 1 -- 172.21.15.31:0/2125489412 wait complete. 2023-10-09T06:21:09.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.083+0000 7f43be654700 1 Processor -- start 2023-10-09T06:21:09.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.084+0000 7f43be654700 1 -- start start 2023-10-09T06:21:09.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.084+0000 7f43be654700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43b8157870 0x7f43b814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.084+0000 7f43be654700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43b815a620 0x7f43b814da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.084+0000 7f43be654700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b815d580 0x7f43b814f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.084+0000 7f43be654700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80b0980 con 0x7f43b815d580 2023-10-09T06:21:09.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.084+0000 7f43be654700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b814cd30 con 0x7f43b8157870 2023-10-09T06:21:09.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.084+0000 7f43be654700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b814eb10 con 0x7f43b815a620 2023-10-09T06:21:09.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.084+0000 7f43bcbf1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b815d580 0x7f43b814f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43bcbf1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b815d580 0x7f43b814f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58540/0 (socket says 172.21.15.31:58540) 2023-10-09T06:21:09.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43bcbf1700 1 -- 172.21.15.31:0/3002004362 learned_addr learned my addr 172.21.15.31:0/3002004362 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:09.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43b7fff700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43b8157870 0x7f43b814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43b77fe700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43b815a620 0x7f43b814da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43bcbf1700 1 -- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43b815a620 msgr2=0x7f43b814da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43bcbf1700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43b815a620 0x7f43b814da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43bcbf1700 1 -- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43b8157870 msgr2=0x7f43b814d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43bcbf1700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43b8157870 0x7f43b814d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43bcbf1700 1 -- 172.21.15.31:0/3002004362 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a8009420 con 0x7f43b815d580 2023-10-09T06:21:09.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43b77fe700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43b815a620 0x7f43b814da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:09.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43b7fff700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43b8157870 0x7f43b814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:09.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43bcbf1700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b815d580 0x7f43b814f610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f43b000c810 tx=0x7f43b0001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:09.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f439ffff700 1 -- 172.21.15.31:0/3002004362 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0012630 con 0x7f43b815d580 2023-10-09T06:21:09.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f439ffff700 1 -- 172.21.15.31:0/3002004362 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b00127b0 con 0x7f43b815d580 2023-10-09T06:21:09.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43be654700 1 -- 172.21.15.31:0/3002004362 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b814e270 con 0x7f43b815d580 2023-10-09T06:21:09.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f439ffff700 1 -- 172.21.15.31:0/3002004362 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0012b70 con 0x7f43b815d580 2023-10-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.085+0000 7f43be654700 1 -- 172.21.15.31:0/3002004362 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b814e830 con 0x7f43b815d580 2023-10-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.086+0000 7f43be654700 1 -- 172.21.15.31:0/3002004362 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b804c3c0 con 0x7f43b815d580 2023-10-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.087+0000 7f439ffff700 1 -- 172.21.15.31:0/3002004362 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43b0003030 con 0x7f43b815d580 2023-10-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.087+0000 7f439ffff700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f43a4066f30 0x7f43a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.087+0000 7f439ffff700 1 -- 172.21.15.31:0/3002004362 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43b00844d0 con 0x7f43b815d580 2023-10-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.087+0000 7f43b7fff700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f43a4066f30 0x7f43a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.088+0000 7f43b7fff700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f43a4066f30 0x7f43a40693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f43ac007fd0 tx=0x7f43ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.091+0000 7f439ffff700 1 -- 172.21.15.31:0/3002004362 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43b0051740 con 0x7f43b815d580 2023-10-09T06:21:09.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.326+0000 7f43be654700 1 -- 172.21.15.31:0/3002004362 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f43b815c560 con 0x7f43b815d580 2023-10-09T06:21:09.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.326+0000 7f439ffff700 1 -- 172.21.15.31:0/3002004362 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f43b0054d60 con 0x7f43b815d580 2023-10-09T06:21:09.327 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:09.327 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-09T06:21:09.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.328+0000 7f43be654700 1 -- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f43a4066f30 msgr2=0x7f43a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.328+0000 7f43be654700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f43a4066f30 0x7f43a40693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f43ac007fd0 tx=0x7f43ac009040 comp rx=0 tx=0).stop 2023-10-09T06:21:09.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.328+0000 7f43be654700 1 -- 172.21.15.31:0/3002004362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b815d580 msgr2=0x7f43b814f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.328+0000 7f43be654700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b815d580 0x7f43b814f610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f43b000c810 tx=0x7f43b0001650 comp rx=0 tx=0).stop 2023-10-09T06:21:09.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.328+0000 7f43be654700 1 -- 172.21.15.31:0/3002004362 shutdown_connections 2023-10-09T06:21:09.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.328+0000 7f43be654700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f43a4066f30 0x7f43a40693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.328+0000 7f43be654700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b815d580 0x7f43b814f610 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.328+0000 7f43be654700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43b8157870 0x7f43b814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.328+0000 7f43be654700 1 --2- 172.21.15.31:0/3002004362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43b815a620 0x7f43b814da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.328+0000 7f43be654700 1 -- 172.21.15.31:0/3002004362 >> 172.21.15.31:0/3002004362 conn(0x7f43b8068ce0 msgr2=0x7f43b80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:09.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.328+0000 7f43be654700 1 -- 172.21.15.31:0/3002004362 shutdown_connections 2023-10-09T06:21:09.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.328+0000 7f43be654700 1 -- 172.21.15.31:0/3002004362 wait complete. 2023-10-09T06:21:09.341 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-09T06:21:09.341 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:09.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.459+0000 7f5d0f232700 1 Processor -- start 2023-10-09T06:21:09.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.459+0000 7f5d0f232700 1 -- start start 2023-10-09T06:21:09.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0f232700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5d080cd6e0 0x7f5d080cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0f232700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5d0815cbd0 0x7f5d0815d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0f232700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d080cb7c0 con 0x7f5d080cdab0 2023-10-09T06:21:09.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0f232700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0815e850 con 0x7f5d0815cbd0 2023-10-09T06:21:09.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0f232700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d080cd030 con 0x7f5d080cd6e0 2023-10-09T06:21:09.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0ea31700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5d0815cbd0 0x7f5d0815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0da2f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5d080cdab0 0x7f5d0815d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60740/0 (socket says 172.21.15.31:60740) 2023-10-09T06:21:09.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0da2f700 1 -- 172.21.15.31:0/983670177 learned_addr learned my addr 172.21.15.31:0/983670177 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:09.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0e230700 1 --2- 172.21.15.31:0/983670177 >> v2:172.21.15.158:3300/0 conn(0x7f5d080cd6e0 0x7f5d080cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0ea31700 1 -- 172.21.15.31:0/983670177 >> v2:172.21.15.158:3300/0 conn(0x7f5d080cd6e0 msgr2=0x7f5d080cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:09.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0ea31700 1 --2- 172.21.15.31:0/983670177 >> v2:172.21.15.158:3300/0 conn(0x7f5d080cd6e0 0x7f5d080cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0ea31700 1 -- 172.21.15.31:0/983670177 >> v1:172.21.15.31:6789/0 conn(0x7f5d080cdab0 legacy=0x7f5d0815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0ea31700 1 -- 172.21.15.31:0/983670177 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0815e290 con 0x7f5d0815cbd0 2023-10-09T06:21:09.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.460+0000 7f5d0ea31700 1 --2- 172.21.15.31:0/983670177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d0815cbd0 0x7f5d0815d050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5d0806b730 tx=0x7f5d00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6966a2acfceb415e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:09.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.461+0000 7f5d0d22e700 1 -- 172.21.15.31:0/983670177 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0000e070 con 0x7f5d0815cbd0 2023-10-09T06:21:09.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.461+0000 7f5d0d22e700 1 -- 172.21.15.31:0/983670177 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0000bc30 con 0x7f5d0815cbd0 2023-10-09T06:21:09.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.461+0000 7f5d0d22e700 1 -- 172.21.15.31:0/983670177 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00012430 con 0x7f5d0815cbd0 2023-10-09T06:21:09.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.461+0000 7f5d0f232700 1 -- 172.21.15.31:0/983670177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d0815cbd0 msgr2=0x7f5d0815d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.461+0000 7f5d0f232700 1 --2- 172.21.15.31:0/983670177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d0815cbd0 0x7f5d0815d050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5d0806b730 tx=0x7f5d00009780 comp rx=0 tx=0).stop 2023-10-09T06:21:09.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.461+0000 7f5d0f232700 1 -- 172.21.15.31:0/983670177 shutdown_connections 2023-10-09T06:21:09.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.461+0000 7f5d0f232700 1 --2- 172.21.15.31:0/983670177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d0815cbd0 0x7f5d0815d050 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.461+0000 7f5d0f232700 1 --2- 172.21.15.31:0/983670177 >> v2:172.21.15.158:3300/0 conn(0x7f5d080cd6e0 0x7f5d080cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.461+0000 7f5d0f232700 1 -- 172.21.15.31:0/983670177 >> 172.21.15.31:0/983670177 conn(0x7f5d08067660 msgr2=0x7f5d08067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:09.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.461+0000 7f5d0f232700 1 -- 172.21.15.31:0/983670177 shutdown_connections 2023-10-09T06:21:09.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.461+0000 7f5d0f232700 1 -- 172.21.15.31:0/983670177 wait complete. 2023-10-09T06:21:09.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.462+0000 7f5d0f232700 1 Processor -- start 2023-10-09T06:21:09.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.462+0000 7f5d0f232700 1 -- start start 2023-10-09T06:21:09.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0f232700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d080cd6e0 0x7f5d0814caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0f232700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d080cdab0 0x7f5d080b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0f232700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d0815cbd0 0x7f5d080b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0f232700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d080c7460 con 0x7f5d080cd6e0 2023-10-09T06:21:09.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0f232700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d080c6850 con 0x7f5d0815cbd0 2023-10-09T06:21:09.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0f232700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d080c6b30 con 0x7f5d080cdab0 2023-10-09T06:21:09.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0e230700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d080cd6e0 0x7f5d0814caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0e230700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d080cd6e0 0x7f5d0814caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58554/0 (socket says 172.21.15.31:58554) 2023-10-09T06:21:09.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0e230700 1 -- 172.21.15.31:0/1008623981 learned_addr learned my addr 172.21.15.31:0/1008623981 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:09.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0ea31700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d0815cbd0 0x7f5d080b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0da2f700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d080cdab0 0x7f5d080b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0e230700 1 -- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d080cdab0 msgr2=0x7f5d080b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0e230700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d080cdab0 0x7f5d080b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0e230700 1 -- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d0815cbd0 msgr2=0x7f5d080b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0e230700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d0815cbd0 0x7f5d080b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0e230700 1 -- 172.21.15.31:0/1008623981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d00009a20 con 0x7f5d080cd6e0 2023-10-09T06:21:09.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.463+0000 7f5d0da2f700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d080cdab0 0x7f5d080b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:09.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.464+0000 7f5d0e230700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d080cd6e0 0x7f5d0814caf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800c7d0 tx=0x7f5cf8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:09.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.464+0000 7f5d067fc700 1 -- 172.21.15.31:0/1008623981 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8011600 con 0x7f5d080cd6e0 2023-10-09T06:21:09.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.464+0000 7f5d067fc700 1 -- 172.21.15.31:0/1008623981 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf8011760 con 0x7f5d080cd6e0 2023-10-09T06:21:09.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.464+0000 7f5d0f232700 1 -- 172.21.15.31:0/1008623981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d080c6e10 con 0x7f5d080cd6e0 2023-10-09T06:21:09.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.464+0000 7f5d067fc700 1 -- 172.21.15.31:0/1008623981 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8011b20 con 0x7f5d080cd6e0 2023-10-09T06:21:09.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.464+0000 7f5d0f232700 1 -- 172.21.15.31:0/1008623981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d080b4b30 con 0x7f5d080cd6e0 2023-10-09T06:21:09.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.465+0000 7f5d0f232700 1 -- 172.21.15.31:0/1008623981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d08089280 con 0x7f5d080cd6e0 2023-10-09T06:21:09.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.465+0000 7f5d067fc700 1 -- 172.21.15.31:0/1008623981 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cf80193f0 con 0x7f5d080cd6e0 2023-10-09T06:21:09.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.466+0000 7f5d067fc700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5cf4066f30 0x7f5cf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.466+0000 7f5d067fc700 1 -- 172.21.15.31:0/1008623981 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5cf80849d0 con 0x7f5d080cd6e0 2023-10-09T06:21:09.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.466+0000 7f5d0da2f700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5cf4066f30 0x7f5cf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.466+0000 7f5d0da2f700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5cf4066f30 0x7f5cf40693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5d080c6780 tx=0x7f5cfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:09.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.470+0000 7f5d067fc700 1 -- 172.21.15.31:0/1008623981 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cf8051c40 con 0x7f5d080cd6e0 2023-10-09T06:21:09.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.663+0000 7f5d0f232700 1 -- 172.21.15.31:0/1008623981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d0815e570 con 0x7f5d080cd6e0 2023-10-09T06:21:09.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.664+0000 7f5d067fc700 1 -- 172.21.15.31:0/1008623981 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f5cf8055260 con 0x7f5d080cd6e0 2023-10-09T06:21:09.665 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:09.665 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:55.693313+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.666+0000 7f5d0f232700 1 -- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5cf4066f30 msgr2=0x7f5cf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.666+0000 7f5d0f232700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5cf4066f30 0x7f5cf40693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5d080c6780 tx=0x7f5cfc009040 comp rx=0 tx=0).stop 2023-10-09T06:21:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.666+0000 7f5d0f232700 1 -- 172.21.15.31:0/1008623981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d080cd6e0 msgr2=0x7f5d0814caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.666+0000 7f5d0f232700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d080cd6e0 0x7f5d0814caf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800c7d0 tx=0x7f5cf8008040 comp rx=0 tx=0).stop 2023-10-09T06:21:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.666+0000 7f5d0f232700 1 -- 172.21.15.31:0/1008623981 shutdown_connections 2023-10-09T06:21:09.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.666+0000 7f5d0f232700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5cf4066f30 0x7f5cf40693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.666+0000 7f5d0f232700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d0815cbd0 0x7f5d080b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.666+0000 7f5d0f232700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d080cd6e0 0x7f5d0814caf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.666+0000 7f5d0f232700 1 --2- 172.21.15.31:0/1008623981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d080cdab0 0x7f5d080b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.666+0000 7f5d0f232700 1 -- 172.21.15.31:0/1008623981 >> 172.21.15.31:0/1008623981 conn(0x7f5d08067660 msgr2=0x7f5d08157290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:09.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.666+0000 7f5d0f232700 1 -- 172.21.15.31:0/1008623981 shutdown_connections 2023-10-09T06:21:09.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.666+0000 7f5d0f232700 1 -- 172.21.15.31:0/1008623981 wait complete. 2023-10-09T06:21:09.679 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:20:52.621337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:20:53.053532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:21:09.679 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:21:09.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.801+0000 7f5c50515700 1 Processor -- start 2023-10-09T06:21:09.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.801+0000 7f5c50515700 1 -- start start 2023-10-09T06:21:09.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.802+0000 7f5c50515700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c480d05a0 0x7f5c48164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.802+0000 7f5c50515700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c480b0790 con 0x7f5c4815a290 2023-10-09T06:21:09.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.802+0000 7f5c50515700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c480ce1f0 con 0x7f5c48159ec0 2023-10-09T06:21:09.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.802+0000 7f5c50515700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c480b0b20 con 0x7f5c480d05a0 2023-10-09T06:21:09.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.802+0000 7f5c4eab2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c480d05a0 0x7f5c48164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.802+0000 7f5c4dab0700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5c4815a290 0x7f5c4806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39078/0 (socket says 172.21.15.31:39078) 2023-10-09T06:21:09.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.802+0000 7f5c4dab0700 1 -- 172.21.15.31:0/1500561051 learned_addr learned my addr 172.21.15.31:0/1500561051 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:09.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.802+0000 7f5c4eab2700 1 -- 172.21.15.31:0/1500561051 >> v1:172.21.15.158:6789/0 conn(0x7f5c48159ec0 legacy=0x7f5c480af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:09.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.802+0000 7f5c4eab2700 1 -- 172.21.15.31:0/1500561051 >> v1:172.21.15.31:6789/0 conn(0x7f5c4815a290 legacy=0x7f5c4806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.802+0000 7f5c4d2af700 1 -- 172.21.15.31:0/1500561051 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224884724 0 0) 0x7f5c480b0790 con 0x7f5c4815a290 2023-10-09T06:21:09.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.802+0000 7f5c4eab2700 1 -- 172.21.15.31:0/1500561051 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c480b04b0 con 0x7f5c480d05a0 2023-10-09T06:21:09.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.802+0000 7f5c4eab2700 1 --2- 172.21.15.31:0/1500561051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c480d05a0 0x7f5c48164ed0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5c380098e0 tx=0x7f5c380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6994e6f1b76312a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:09.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.802+0000 7f5c4d2af700 1 -- 172.21.15.31:0/1500561051 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38009e80 con 0x7f5c480d05a0 2023-10-09T06:21:09.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.803+0000 7f5c4d2af700 1 -- 172.21.15.31:0/1500561051 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3800b820 con 0x7f5c480d05a0 2023-10-09T06:21:09.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.803+0000 7f5c4d2af700 1 -- 172.21.15.31:0/1500561051 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800bba0 con 0x7f5c480d05a0 2023-10-09T06:21:09.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.803+0000 7f5c50515700 1 -- 172.21.15.31:0/1500561051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c480d05a0 msgr2=0x7f5c48164ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.803+0000 7f5c50515700 1 --2- 172.21.15.31:0/1500561051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c480d05a0 0x7f5c48164ed0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5c380098e0 tx=0x7f5c380091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.803+0000 7f5c50515700 1 -- 172.21.15.31:0/1500561051 shutdown_connections 2023-10-09T06:21:09.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.803+0000 7f5c50515700 1 --2- 172.21.15.31:0/1500561051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c480d05a0 0x7f5c48164ed0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.803+0000 7f5c50515700 1 -- 172.21.15.31:0/1500561051 >> 172.21.15.31:0/1500561051 conn(0x7f5c480d1880 msgr2=0x7f5c480cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:09.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.803+0000 7f5c50515700 1 -- 172.21.15.31:0/1500561051 shutdown_connections 2023-10-09T06:21:09.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.803+0000 7f5c50515700 1 -- 172.21.15.31:0/1500561051 wait complete. 2023-10-09T06:21:09.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.804+0000 7f5c50515700 1 Processor -- start 2023-10-09T06:21:09.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.804+0000 7f5c50515700 1 -- start start 2023-10-09T06:21:09.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c50515700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c480d05a0 0x7f5c48150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c50515700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c48159ec0 0x7f5c480b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c50515700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5c4815a290 0x7f5c4814fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c50515700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480b5e30 con 0x7f5c480d05a0 2023-10-09T06:21:09.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c50515700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c48151ff0 con 0x7f5c4815a290 2023-10-09T06:21:09.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c50515700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c48152480 con 0x7f5c48159ec0 2023-10-09T06:21:09.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c4e2b1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c480d05a0 0x7f5c48150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c4e2b1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c480d05a0 0x7f5c48150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56228/0 (socket says 172.21.15.31:56228) 2023-10-09T06:21:09.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c4e2b1700 1 -- 172.21.15.31:0/4086579873 learned_addr learned my addr 172.21.15.31:0/4086579873 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:09.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c4e2b1700 1 -- 172.21.15.31:0/4086579873 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c48159ec0 msgr2=0x7f5c480b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c4e2b1700 1 --2- 172.21.15.31:0/4086579873 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c48159ec0 0x7f5c480b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c4e2b1700 1 -- 172.21.15.31:0/4086579873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5c4815a290 msgr2=0x7f5c4814fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:09.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c4e2b1700 1 --2- 172.21.15.31:0/4086579873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5c4815a290 0x7f5c4814fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:09.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c4e2b1700 1 -- 172.21.15.31:0/4086579873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c38009420 con 0x7f5c480d05a0 2023-10-09T06:21:09.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.805+0000 7f5c4e2b1700 1 --2- 172.21.15.31:0/4086579873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c480d05a0 0x7f5c48150d20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000c950 tx=0x7f5c40002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:09.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.806+0000 7f5c467fc700 1 -- 172.21.15.31:0/4086579873 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000a7e0 con 0x7f5c480d05a0 2023-10-09T06:21:09.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.806+0000 7f5c467fc700 1 -- 172.21.15.31:0/4086579873 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4000a940 con 0x7f5c480d05a0 2023-10-09T06:21:09.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.806+0000 7f5c50515700 1 -- 172.21.15.31:0/4086579873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c481513e0 con 0x7f5c480d05a0 2023-10-09T06:21:09.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.806+0000 7f5c467fc700 1 -- 172.21.15.31:0/4086579873 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000ad00 con 0x7f5c480d05a0 2023-10-09T06:21:09.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.806+0000 7f5c50515700 1 -- 172.21.15.31:0/4086579873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c481519a0 con 0x7f5c480d05a0 2023-10-09T06:21:09.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.807+0000 7f5c50515700 1 -- 172.21.15.31:0/4086579873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4804c3c0 con 0x7f5c480d05a0 2023-10-09T06:21:09.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.807+0000 7f5c467fc700 1 -- 172.21.15.31:0/4086579873 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c40012630 con 0x7f5c480d05a0 2023-10-09T06:21:09.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.807+0000 7f5c467fc700 1 --2- 172.21.15.31:0/4086579873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5c34066f30 0x7f5c340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:09.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.808+0000 7f5c467fc700 1 -- 172.21.15.31:0/4086579873 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c40084a00 con 0x7f5c480d05a0 2023-10-09T06:21:09.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.808+0000 7f5c4dab0700 1 --2- 172.21.15.31:0/4086579873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5c34066f30 0x7f5c340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:09.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.808+0000 7f5c4dab0700 1 --2- 172.21.15.31:0/4086579873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5c34066f30 0x7f5c340693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5c48155f40 tx=0x7f5c3c007bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:09.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:09.812+0000 7f5c467fc700 1 -- 172.21.15.31:0/4086579873 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c40051c70 con 0x7f5c480d05a0 2023-10-09T06:21:10.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.004+0000 7f5c50515700 1 -- 172.21.15.31:0/4086579873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c4806b5e0 con 0x7f5c480d05a0 2023-10-09T06:21:10.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.005+0000 7f5c467fc700 1 -- 172.21.15.31:0/4086579873 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c4000ae60 con 0x7f5c480d05a0 2023-10-09T06:21:10.006 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:21:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.007+0000 7f5c50515700 1 -- 172.21.15.31:0/4086579873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5c34066f30 msgr2=0x7f5c340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.007+0000 7f5c50515700 1 --2- 172.21.15.31:0/4086579873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5c34066f30 0x7f5c340693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5c48155f40 tx=0x7f5c3c007bd0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.007+0000 7f5c50515700 1 -- 172.21.15.31:0/4086579873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c480d05a0 msgr2=0x7f5c48150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.007+0000 7f5c50515700 1 --2- 172.21.15.31:0/4086579873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c480d05a0 0x7f5c48150d20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000c950 tx=0x7f5c40002760 comp rx=0 tx=0).stop 2023-10-09T06:21:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.007+0000 7f5c50515700 1 -- 172.21.15.31:0/4086579873 shutdown_connections 2023-10-09T06:21:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.007+0000 7f5c50515700 1 --2- 172.21.15.31:0/4086579873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5c34066f30 0x7f5c340693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.007+0000 7f5c50515700 1 --2- 172.21.15.31:0/4086579873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5c4815a290 0x7f5c4814fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.007+0000 7f5c50515700 1 --2- 172.21.15.31:0/4086579873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c480d05a0 0x7f5c48150d20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.007+0000 7f5c50515700 1 --2- 172.21.15.31:0/4086579873 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c48159ec0 0x7f5c480b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.007+0000 7f5c50515700 1 -- 172.21.15.31:0/4086579873 >> 172.21.15.31:0/4086579873 conn(0x7f5c480d1880 msgr2=0x7f5c48156d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:10.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.007+0000 7f5c50515700 1 -- 172.21.15.31:0/4086579873 shutdown_connections 2023-10-09T06:21:10.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.007+0000 7f5c50515700 1 -- 172.21.15.31:0/4086579873 wait complete. 2023-10-09T06:21:10.020 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:21:10.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.140+0000 7fd164ec6700 1 Processor -- start 2023-10-09T06:21:10.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.140+0000 7fd164ec6700 1 -- start start 2023-10-09T06:21:10.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd164ec6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd160150dd0 0x7fd160157950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd164ec6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd16015a570 0x7fd160067cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd164ec6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd160157e90 con 0x7fd1601511a0 2023-10-09T06:21:10.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd164ec6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd160067870 con 0x7fd160150dd0 2023-10-09T06:21:10.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd164ec6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16015aa00 con 0x7fd16015a570 2023-10-09T06:21:10.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd15f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd160150dd0 0x7fd160157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd15effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd1601511a0 0x7fd160069e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39080/0 (socket says 172.21.15.31:39080) 2023-10-09T06:21:10.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd15f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd160150dd0 0x7fd160157950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56240/0 (socket says 172.21.15.31:56240) 2023-10-09T06:21:10.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd15effd700 1 -- 172.21.15.31:0/2112420477 learned_addr learned my addr 172.21.15.31:0/2112420477 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:10.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd15ffff700 1 --2- 172.21.15.31:0/2112420477 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd16015a570 0x7fd160067cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd15f7fe700 1 -- 172.21.15.31:0/2112420477 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd16015a570 msgr2=0x7fd160067cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:10.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd15f7fe700 1 --2- 172.21.15.31:0/2112420477 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd16015a570 0x7fd160067cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd15f7fe700 1 -- 172.21.15.31:0/2112420477 >> v1:172.21.15.31:6789/0 conn(0x7fd1601511a0 legacy=0x7fd160069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd15f7fe700 1 -- 172.21.15.31:0/2112420477 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16015ace0 con 0x7fd160150dd0 2023-10-09T06:21:10.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.141+0000 7fd15e7fc700 1 -- 172.21.15.31:0/2112420477 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263068931 0 0) 0x7fd160157e90 con 0x7fd1601511a0 2023-10-09T06:21:10.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.142+0000 7fd15ffff700 1 --2- 172.21.15.31:0/2112420477 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd16015a570 0x7fd160067cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:10.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.142+0000 7fd15f7fe700 1 --2- 172.21.15.31:0/2112420477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd160150dd0 0x7fd160157950 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd15000bb90 tx=0x7fd15000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb72b4e261bc0508 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:10.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.142+0000 7fd15e7fc700 1 -- 172.21.15.31:0/2112420477 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15000dba0 con 0x7fd160150dd0 2023-10-09T06:21:10.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.142+0000 7fd15e7fc700 1 -- 172.21.15.31:0/2112420477 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15000dd00 con 0x7fd160150dd0 2023-10-09T06:21:10.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.142+0000 7fd15e7fc700 1 -- 172.21.15.31:0/2112420477 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500196b0 con 0x7fd160150dd0 2023-10-09T06:21:10.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.142+0000 7fd164ec6700 1 -- 172.21.15.31:0/2112420477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd160150dd0 msgr2=0x7fd160157950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.142+0000 7fd164ec6700 1 --2- 172.21.15.31:0/2112420477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd160150dd0 0x7fd160157950 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd15000bb90 tx=0x7fd15000b430 comp rx=0 tx=0).stop 2023-10-09T06:21:10.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.142+0000 7fd164ec6700 1 -- 172.21.15.31:0/2112420477 shutdown_connections 2023-10-09T06:21:10.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.142+0000 7fd164ec6700 1 --2- 172.21.15.31:0/2112420477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd160150dd0 0x7fd160157950 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.142+0000 7fd164ec6700 1 --2- 172.21.15.31:0/2112420477 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd16015a570 0x7fd160067cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.142+0000 7fd164ec6700 1 -- 172.21.15.31:0/2112420477 >> 172.21.15.31:0/2112420477 conn(0x7fd1600cd900 msgr2=0x7fd1600cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:10.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.142+0000 7fd164ec6700 1 -- 172.21.15.31:0/2112420477 shutdown_connections 2023-10-09T06:21:10.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.142+0000 7fd164ec6700 1 -- 172.21.15.31:0/2112420477 wait complete. 2023-10-09T06:21:10.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.144+0000 7fd164ec6700 1 Processor -- start 2023-10-09T06:21:10.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.144+0000 7fd164ec6700 1 -- start start 2023-10-09T06:21:10.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.144+0000 7fd164ec6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd160150dd0 0x7fd1601472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.144+0000 7fd164ec6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd16015a570 0x7fd16014fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.144+0000 7fd164ec6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1601502d0 0x7fd160159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.144+0000 7fd164ec6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd160150770 con 0x7fd16015a570 2023-10-09T06:21:10.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.144+0000 7fd164ec6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd160159270 con 0x7fd1601502d0 2023-10-09T06:21:10.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.144+0000 7fd164ec6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd160158de0 con 0x7fd160150dd0 2023-10-09T06:21:10.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.144+0000 7fd15effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd16015a570 0x7fd16014fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.144+0000 7fd15effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd16015a570 0x7fd16014fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56246/0 (socket says 172.21.15.31:56246) 2023-10-09T06:21:10.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.144+0000 7fd15effd700 1 -- 172.21.15.31:0/2477424239 learned_addr learned my addr 172.21.15.31:0/2477424239 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:10.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.145+0000 7fd15f7fe700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd160150dd0 0x7fd1601472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.145+0000 7fd15ffff700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1601502d0 0x7fd160159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.145+0000 7fd15effd700 1 -- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd160150dd0 msgr2=0x7fd1601472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.145+0000 7fd15effd700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd160150dd0 0x7fd1601472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.145+0000 7fd15effd700 1 -- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1601502d0 msgr2=0x7fd160159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.145+0000 7fd15effd700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1601502d0 0x7fd160159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.145+0000 7fd15effd700 1 -- 172.21.15.31:0/2477424239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15000b6d0 con 0x7fd16015a570 2023-10-09T06:21:10.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.145+0000 7fd15effd700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd16015a570 0x7fd16014fd90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd15400c810 tx=0x7fd154007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.145+0000 7fd1477fe700 1 -- 172.21.15.31:0/2477424239 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154005c00 con 0x7fd16015a570 2023-10-09T06:21:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.145+0000 7fd1477fe700 1 -- 172.21.15.31:0/2477424239 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd154005d60 con 0x7fd16015a570 2023-10-09T06:21:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.145+0000 7fd164ec6700 1 -- 172.21.15.31:0/2477424239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1601581d0 con 0x7fd16015a570 2023-10-09T06:21:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.145+0000 7fd1477fe700 1 -- 172.21.15.31:0/2477424239 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154007300 con 0x7fd16015a570 2023-10-09T06:21:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.145+0000 7fd164ec6700 1 -- 172.21.15.31:0/2477424239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd160158790 con 0x7fd16015a570 2023-10-09T06:21:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.146+0000 7fd164ec6700 1 -- 172.21.15.31:0/2477424239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd160158f90 con 0x7fd16015a570 2023-10-09T06:21:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.146+0000 7fd1477fe700 1 -- 172.21.15.31:0/2477424239 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd15401b3b0 con 0x7fd16015a570 2023-10-09T06:21:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.147+0000 7fd1477fe700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd14c066f30 0x7fd14c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.147+0000 7fd1477fe700 1 -- 172.21.15.31:0/2477424239 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd154083910 con 0x7fd16015a570 2023-10-09T06:21:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.147+0000 7fd15f7fe700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd14c066f30 0x7fd14c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.147+0000 7fd15f7fe700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd14c066f30 0x7fd14c0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd15000b6a0 tx=0x7fd15001b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:10.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.151+0000 7fd1477fe700 1 -- 172.21.15.31:0/2477424239 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd160158f90 con 0x7fd16015a570 2023-10-09T06:21:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.342+0000 7fd164ec6700 1 -- 172.21.15.31:0/2477424239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd160158f50 con 0x7fd16015a570 2023-10-09T06:21:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.343+0000 7fd1477fe700 1 -- 172.21.15.31:0/2477424239 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd154017020 con 0x7fd16015a570 2023-10-09T06:21:10.344 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:21:10.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.345+0000 7fd164ec6700 1 -- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd14c066f30 msgr2=0x7fd14c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.345+0000 7fd164ec6700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd14c066f30 0x7fd14c0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd15000b6a0 tx=0x7fd15001b000 comp rx=0 tx=0).stop 2023-10-09T06:21:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.345+0000 7fd164ec6700 1 -- 172.21.15.31:0/2477424239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd16015a570 msgr2=0x7fd16014fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.345+0000 7fd164ec6700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd16015a570 0x7fd16014fd90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd15400c810 tx=0x7fd154007db0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.345+0000 7fd164ec6700 1 -- 172.21.15.31:0/2477424239 shutdown_connections 2023-10-09T06:21:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.345+0000 7fd164ec6700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd14c066f30 0x7fd14c0693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.345+0000 7fd164ec6700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd160150dd0 0x7fd1601472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.345+0000 7fd164ec6700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1601502d0 0x7fd160159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.345+0000 7fd164ec6700 1 --2- 172.21.15.31:0/2477424239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd16015a570 0x7fd16014fd90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.345+0000 7fd164ec6700 1 -- 172.21.15.31:0/2477424239 >> 172.21.15.31:0/2477424239 conn(0x7fd1600cd900 msgr2=0x7fd1600caaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.345+0000 7fd164ec6700 1 -- 172.21.15.31:0/2477424239 shutdown_connections 2023-10-09T06:21:10.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.345+0000 7fd164ec6700 1 -- 172.21.15.31:0/2477424239 wait complete. 2023-10-09T06:21:10.357 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:21:10.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.478+0000 7f6c654e4700 1 Processor -- start 2023-10-09T06:21:10.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.478+0000 7f6c654e4700 1 -- start start 2023-10-09T06:21:10.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c654e4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c60159860 0x7f6c60159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c654e4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6c600b12a0 0x7f6c600b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c654e4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6c600b2f70 0x7f6c6015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c654e4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6015a170 con 0x7f6c600b12a0 2023-10-09T06:21:10.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c654e4700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6015e710 con 0x7f6c600b2f70 2023-10-09T06:21:10.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c654e4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600b04e0 con 0x7f6c60159860 2023-10-09T06:21:10.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c5e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6c600b12a0 0x7f6c600b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c5e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6c600b12a0 0x7f6c600b2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56256/0 (socket says 172.21.15.31:56256) 2023-10-09T06:21:10.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c5e7fc700 1 -- 172.21.15.31:0/3226759185 learned_addr learned my addr 172.21.15.31:0/3226759185 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:10.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c5effd700 1 --2- 172.21.15.31:0/3226759185 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c60159860 0x7f6c60159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c5f7fe700 1 --2- 172.21.15.31:0/3226759185 >> v2:172.21.15.158:3300/0 conn(0x7f6c600b2f70 0x7f6c6015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c5e7fc700 1 -- 172.21.15.31:0/3226759185 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c60159860 msgr2=0x7f6c60159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:10.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c5e7fc700 1 --2- 172.21.15.31:0/3226759185 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c60159860 0x7f6c60159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c5e7fc700 1 -- 172.21.15.31:0/3226759185 >> v2:172.21.15.158:3300/0 conn(0x7f6c600b2f70 msgr2=0x7f6c6015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:10.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c5e7fc700 1 --2- 172.21.15.31:0/3226759185 >> v2:172.21.15.158:3300/0 conn(0x7f6c600b2f70 0x7f6c6015d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.479+0000 7f6c5e7fc700 1 -- 172.21.15.31:0/3226759185 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600b07c0 con 0x7f6c600b12a0 2023-10-09T06:21:10.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.480+0000 7f6c5e7fc700 1 --2- 172.21.15.31:0/3226759185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c600b12a0 0x7f6c600b2a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6c60089e50 tx=0x7f6c48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c41bb5f2ded9ee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:10.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.480+0000 7f6c5dffb700 1 -- 172.21.15.31:0/3226759185 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800b640 con 0x7f6c600b12a0 2023-10-09T06:21:10.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.480+0000 7f6c5dffb700 1 -- 172.21.15.31:0/3226759185 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4800b7a0 con 0x7f6c600b12a0 2023-10-09T06:21:10.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.480+0000 7f6c5dffb700 1 -- 172.21.15.31:0/3226759185 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800bb60 con 0x7f6c600b12a0 2023-10-09T06:21:10.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.480+0000 7f6c654e4700 1 -- 172.21.15.31:0/3226759185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c600b12a0 msgr2=0x7f6c600b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.480+0000 7f6c654e4700 1 --2- 172.21.15.31:0/3226759185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c600b12a0 0x7f6c600b2a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6c60089e50 tx=0x7f6c48009250 comp rx=0 tx=0).stop 2023-10-09T06:21:10.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.480+0000 7f6c654e4700 1 -- 172.21.15.31:0/3226759185 shutdown_connections 2023-10-09T06:21:10.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.480+0000 7f6c654e4700 1 --2- 172.21.15.31:0/3226759185 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c60159860 0x7f6c60159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.480+0000 7f6c654e4700 1 --2- 172.21.15.31:0/3226759185 >> v2:172.21.15.158:3300/0 conn(0x7f6c600b2f70 0x7f6c6015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.480+0000 7f6c654e4700 1 --2- 172.21.15.31:0/3226759185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c600b12a0 0x7f6c600b2a30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.480+0000 7f6c654e4700 1 -- 172.21.15.31:0/3226759185 >> 172.21.15.31:0/3226759185 conn(0x7f6c60068c80 msgr2=0x7f6c60069080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:10.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.480+0000 7f6c654e4700 1 -- 172.21.15.31:0/3226759185 shutdown_connections 2023-10-09T06:21:10.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.480+0000 7f6c654e4700 1 -- 172.21.15.31:0/3226759185 wait complete. 2023-10-09T06:21:10.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.481+0000 7f6c654e4700 1 Processor -- start 2023-10-09T06:21:10.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.482+0000 7f6c654e4700 1 -- start start 2023-10-09T06:21:10.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.482+0000 7f6c654e4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c600b12a0 0x7f6c600c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.482+0000 7f6c654e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c600b2f70 0x7f6c600c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.482+0000 7f6c654e4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c60159860 0x7f6c6016b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.482+0000 7f6c654e4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6016a7f0 con 0x7f6c600b2f70 2023-10-09T06:21:10.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.482+0000 7f6c654e4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600c7250 con 0x7f6c600b12a0 2023-10-09T06:21:10.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.482+0000 7f6c654e4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600c7510 con 0x7f6c60159860 2023-10-09T06:21:10.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.482+0000 7f6c5e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c600b2f70 0x7f6c600c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.482+0000 7f6c5e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c600b2f70 0x7f6c600c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56258/0 (socket says 172.21.15.31:56258) 2023-10-09T06:21:10.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.482+0000 7f6c5e7fc700 1 -- 172.21.15.31:0/2826194325 learned_addr learned my addr 172.21.15.31:0/2826194325 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:10.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.482+0000 7f6c5f7fe700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c60159860 0x7f6c6016b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.482+0000 7f6c5effd700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c600b12a0 0x7f6c600c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.483+0000 7f6c5e7fc700 1 -- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c60159860 msgr2=0x7f6c6016b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.483+0000 7f6c5e7fc700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c60159860 0x7f6c6016b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.483+0000 7f6c5e7fc700 1 -- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c600b12a0 msgr2=0x7f6c600c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.483+0000 7f6c5e7fc700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c600b12a0 0x7f6c600c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.483+0000 7f6c5e7fc700 1 -- 172.21.15.31:0/2826194325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c480094f0 con 0x7f6c600b2f70 2023-10-09T06:21:10.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.483+0000 7f6c5effd700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c600b12a0 0x7f6c600c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:10.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.483+0000 7f6c5e7fc700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c600b2f70 0x7f6c600c6d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c60068910 tx=0x7f6c48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:10.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.483+0000 7f6c56ffd700 1 -- 172.21.15.31:0/2826194325 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48000d10 con 0x7f6c600b2f70 2023-10-09T06:21:10.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.483+0000 7f6c56ffd700 1 -- 172.21.15.31:0/2826194325 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4800bb20 con 0x7f6c600b2f70 2023-10-09T06:21:10.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.483+0000 7f6c654e4700 1 -- 172.21.15.31:0/2826194325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c600c77f0 con 0x7f6c600b2f70 2023-10-09T06:21:10.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.483+0000 7f6c56ffd700 1 -- 172.21.15.31:0/2826194325 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48011670 con 0x7f6c600b2f70 2023-10-09T06:21:10.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.483+0000 7f6c654e4700 1 -- 172.21.15.31:0/2826194325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6016ace0 con 0x7f6c600b2f70 2023-10-09T06:21:10.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.484+0000 7f6c654e4700 1 -- 172.21.15.31:0/2826194325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c60089870 con 0x7f6c600b2f70 2023-10-09T06:21:10.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.484+0000 7f6c56ffd700 1 -- 172.21.15.31:0/2826194325 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c480119e0 con 0x7f6c600b2f70 2023-10-09T06:21:10.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.485+0000 7f6c56ffd700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6c40066f30 0x7f6c400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.485+0000 7f6c56ffd700 1 -- 172.21.15.31:0/2826194325 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6c48085c90 con 0x7f6c600b2f70 2023-10-09T06:21:10.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.485+0000 7f6c5effd700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6c40066f30 0x7f6c400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.485+0000 7f6c5effd700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6c40066f30 0x7f6c400693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009d80 tx=0x7f6c58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:10.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.489+0000 7f6c56ffd700 1 -- 172.21.15.31:0/2826194325 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c48052f00 con 0x7f6c600b2f70 2023-10-09T06:21:10.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.680+0000 7f6c654e4700 1 -- 172.21.15.31:0/2826194325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c6004bb80 con 0x7f6c600b2f70 2023-10-09T06:21:10.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.680+0000 7f6c56ffd700 1 -- 172.21.15.31:0/2826194325 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c48056520 con 0x7f6c600b2f70 2023-10-09T06:21:10.681 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:21:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.682+0000 7f6c654e4700 1 -- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6c40066f30 msgr2=0x7f6c400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.682+0000 7f6c654e4700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6c40066f30 0x7f6c400693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009d80 tx=0x7f6c58008040 comp rx=0 tx=0).stop 2023-10-09T06:21:10.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.682+0000 7f6c654e4700 1 -- 172.21.15.31:0/2826194325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c600b2f70 msgr2=0x7f6c600c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.682+0000 7f6c654e4700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c600b2f70 0x7f6c600c6d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c60068910 tx=0x7f6c48017000 comp rx=0 tx=0).stop 2023-10-09T06:21:10.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.682+0000 7f6c654e4700 1 -- 172.21.15.31:0/2826194325 shutdown_connections 2023-10-09T06:21:10.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.682+0000 7f6c654e4700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6c40066f30 0x7f6c400693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.682+0000 7f6c654e4700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c60159860 0x7f6c6016b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.682+0000 7f6c654e4700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c600b12a0 0x7f6c600c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.682+0000 7f6c654e4700 1 --2- 172.21.15.31:0/2826194325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c600b2f70 0x7f6c600c6d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.682+0000 7f6c654e4700 1 -- 172.21.15.31:0/2826194325 >> 172.21.15.31:0/2826194325 conn(0x7f6c60068c80 msgr2=0x7f6c600b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.682+0000 7f6c654e4700 1 -- 172.21.15.31:0/2826194325 shutdown_connections 2023-10-09T06:21:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.682+0000 7f6c654e4700 1 -- 172.21.15.31:0/2826194325 wait complete. 2023-10-09T06:21:10.696 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:21:10.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.816+0000 7f6dd076a700 1 Processor -- start 2023-10-09T06:21:10.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.816+0000 7f6dd076a700 1 -- start start 2023-10-09T06:21:10.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.817+0000 7f6dd076a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6dc80b0e50 0x7f6dc80c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.817+0000 7f6dd076a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dc80cb4f0 0x7f6dc80cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.817+0000 7f6dd076a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc815de60 con 0x7f6dc80b1220 2023-10-09T06:21:10.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.817+0000 7f6dd076a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc80cbed0 con 0x7f6dc80b0e50 2023-10-09T06:21:10.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.817+0000 7f6dd076a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc815e140 con 0x7f6dc80cb4f0 2023-10-09T06:21:10.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.817+0000 7f6dce506700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6dc80b0e50 0x7f6dc80c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.818+0000 7f6dce506700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6dc80b0e50 0x7f6dc80c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56270/0 (socket says 172.21.15.31:56270) 2023-10-09T06:21:10.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.818+0000 7f6dce506700 1 -- 172.21.15.31:0/1685285487 learned_addr learned my addr 172.21.15.31:0/1685285487 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:10.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.818+0000 7f6dced07700 1 --2- 172.21.15.31:0/1685285487 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dc80cb4f0 0x7f6dc80cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.818+0000 7f6dce506700 1 -- 172.21.15.31:0/1685285487 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dc80cb4f0 msgr2=0x7f6dc80cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:10.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.818+0000 7f6dce506700 1 --2- 172.21.15.31:0/1685285487 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dc80cb4f0 0x7f6dc80cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.818+0000 7f6dce506700 1 -- 172.21.15.31:0/1685285487 >> v1:172.21.15.158:6789/0 conn(0x7f6dc80b1220 legacy=0x7f6dc806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.818+0000 7f6dce506700 1 -- 172.21.15.31:0/1685285487 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc815e420 con 0x7f6dc80b0e50 2023-10-09T06:21:10.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.818+0000 7f6dce506700 1 --2- 172.21.15.31:0/1685285487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dc80b0e50 0x7f6dc80c9180 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009f20 tx=0x7f6dc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1944387f36a1eeed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:10.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.818+0000 7f6dcd504700 1 -- 172.21.15.31:0/1685285487 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc000e070 con 0x7f6dc80b0e50 2023-10-09T06:21:10.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.818+0000 7f6dcd504700 1 -- 172.21.15.31:0/1685285487 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc000ba80 con 0x7f6dc80b0e50 2023-10-09T06:21:10.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.818+0000 7f6dcd504700 1 -- 172.21.15.31:0/1685285487 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00092e0 con 0x7f6dc80b0e50 2023-10-09T06:21:10.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.819+0000 7f6dd076a700 1 -- 172.21.15.31:0/1685285487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dc80b0e50 msgr2=0x7f6dc80c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.819+0000 7f6dd076a700 1 --2- 172.21.15.31:0/1685285487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dc80b0e50 0x7f6dc80c9180 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009f20 tx=0x7f6dc0009840 comp rx=0 tx=0).stop 2023-10-09T06:21:10.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.819+0000 7f6dd076a700 1 -- 172.21.15.31:0/1685285487 shutdown_connections 2023-10-09T06:21:10.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.819+0000 7f6dd076a700 1 --2- 172.21.15.31:0/1685285487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dc80b0e50 0x7f6dc80c9180 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.819+0000 7f6dd076a700 1 --2- 172.21.15.31:0/1685285487 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dc80cb4f0 0x7f6dc80cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.819+0000 7f6dd076a700 1 -- 172.21.15.31:0/1685285487 >> 172.21.15.31:0/1685285487 conn(0x7f6dc8069870 msgr2=0x7f6dc8069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:10.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.819+0000 7f6dd076a700 1 -- 172.21.15.31:0/1685285487 shutdown_connections 2023-10-09T06:21:10.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.819+0000 7f6dd076a700 1 -- 172.21.15.31:0/1685285487 wait complete. 2023-10-09T06:21:10.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.820+0000 7f6dd076a700 1 Processor -- start 2023-10-09T06:21:10.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.820+0000 7f6dd076a700 1 -- start start 2023-10-09T06:21:10.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dd076a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6dc80b0e50 0x7f6dc8158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dd076a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dc80b1220 0x7f6dc8151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dd076a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dc80cb4f0 0x7f6dc80b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dd076a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc80b1cb0 con 0x7f6dc80cb4f0 2023-10-09T06:21:10.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dd076a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc8151d50 con 0x7f6dc80b0e50 2023-10-09T06:21:10.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dd076a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc8159060 con 0x7f6dc80b1220 2023-10-09T06:21:10.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dced07700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dc80cb4f0 0x7f6dc80b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dced07700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dc80cb4f0 0x7f6dc80b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56274/0 (socket says 172.21.15.31:56274) 2023-10-09T06:21:10.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dced07700 1 -- 172.21.15.31:0/1850307457 learned_addr learned my addr 172.21.15.31:0/1850307457 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:10.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dcdd05700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dc80b1220 0x7f6dc8151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dce506700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6dc80b0e50 0x7f6dc8158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dced07700 1 -- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dc80b1220 msgr2=0x7f6dc8151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dced07700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dc80b1220 0x7f6dc8151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dced07700 1 -- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6dc80b0e50 msgr2=0x7f6dc8158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:10.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dced07700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6dc80b0e50 0x7f6dc8158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:10.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dced07700 1 -- 172.21.15.31:0/1850307457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc0009ae0 con 0x7f6dc80cb4f0 2023-10-09T06:21:10.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dcdd05700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dc80b1220 0x7f6dc8151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:10.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dce506700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6dc80b0e50 0x7f6dc8158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:10.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dced07700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dc80cb4f0 0x7f6dc80b1f80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6db800d890 tx=0x7f6db8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:10.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dc67fc700 1 -- 172.21.15.31:0/1850307457 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db80125f0 con 0x7f6dc80cb4f0 2023-10-09T06:21:10.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dc67fc700 1 -- 172.21.15.31:0/1850307457 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db8012770 con 0x7f6dc80cb4f0 2023-10-09T06:21:10.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dc67fc700 1 -- 172.21.15.31:0/1850307457 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db8012b30 con 0x7f6dc80cb4f0 2023-10-09T06:21:10.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dd076a700 1 -- 172.21.15.31:0/1850307457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc8159340 con 0x7f6dc80cb4f0 2023-10-09T06:21:10.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.821+0000 7f6dd076a700 1 -- 172.21.15.31:0/1850307457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc8159900 con 0x7f6dc80cb4f0 2023-10-09T06:21:10.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.822+0000 7f6dd076a700 1 -- 172.21.15.31:0/1850307457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc804c3c0 con 0x7f6dc80cb4f0 2023-10-09T06:21:10.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.823+0000 7f6dc67fc700 1 -- 172.21.15.31:0/1850307457 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6db801e460 con 0x7f6dc80cb4f0 2023-10-09T06:21:10.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.823+0000 7f6dc67fc700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6db4066f30 0x7f6db40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:10.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.823+0000 7f6dc67fc700 1 -- 172.21.15.31:0/1850307457 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6db8084c90 con 0x7f6dc80cb4f0 2023-10-09T06:21:10.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.823+0000 7f6dce506700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6db4066f30 0x7f6db40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:10.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.824+0000 7f6dce506700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6db4066f30 0x7f6db40693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00073d0 tx=0x7f6dc0018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:10.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:10.828+0000 7f6dc67fc700 1 -- 172.21.15.31:0/1850307457 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6db8051f00 con 0x7f6dc80cb4f0 2023-10-09T06:21:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.064+0000 7f6dd076a700 1 -- 172.21.15.31:0/1850307457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6dc80b08d0 con 0x7f6dc80cb4f0 2023-10-09T06:21:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.064+0000 7f6dc67fc700 1 -- 172.21.15.31:0/1850307457 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f6db8055520 con 0x7f6dc80cb4f0 2023-10-09T06:21:11.065 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:11.065 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3437172994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3437172994},{"type":"v1","addr":"172.21.15.158:6836","nonce":3437172994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2894447386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2894447386},{"type":"v1","addr":"172.21.15.31:6834","nonce":2894447386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1034055293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1034055293},{"type":"v1","addr":"172.21.15.31:6835","nonce":1034055293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:20:54.080779+0000","modified":"2023-10-09T06:20:57.714511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1189249944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1189249944},{"type":"v1","addr":"172.21.15.158:6837","nonce":1189249944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:21:11.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.066+0000 7f6dd076a700 1 -- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6db4066f30 msgr2=0x7f6db40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.066+0000 7f6dd076a700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6db4066f30 0x7f6db40693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00073d0 tx=0x7f6dc0018000 comp rx=0 tx=0).stop 2023-10-09T06:21:11.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.066+0000 7f6dd076a700 1 -- 172.21.15.31:0/1850307457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dc80cb4f0 msgr2=0x7f6dc80b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.066+0000 7f6dd076a700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dc80cb4f0 0x7f6dc80b1f80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6db800d890 tx=0x7f6db8008040 comp rx=0 tx=0).stop 2023-10-09T06:21:11.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.066+0000 7f6dd076a700 1 -- 172.21.15.31:0/1850307457 shutdown_connections 2023-10-09T06:21:11.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.066+0000 7f6dd076a700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6db4066f30 0x7f6db40693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.066+0000 7f6dd076a700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dc80cb4f0 0x7f6dc80b1f80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.066+0000 7f6dd076a700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6dc80b0e50 0x7f6dc8158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.066+0000 7f6dd076a700 1 --2- 172.21.15.31:0/1850307457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6dc80b1220 0x7f6dc8151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.066+0000 7f6dd076a700 1 -- 172.21.15.31:0/1850307457 >> 172.21.15.31:0/1850307457 conn(0x7f6dc8069870 msgr2=0x7f6dc80679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:11.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.066+0000 7f6dd076a700 1 -- 172.21.15.31:0/1850307457 shutdown_connections 2023-10-09T06:21:11.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.066+0000 7f6dd076a700 1 -- 172.21.15.31:0/1850307457 wait complete. 2023-10-09T06:21:11.069 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2023-10-09T06:21:11.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:11.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.197+0000 7f0185968700 1 Processor -- start 2023-10-09T06:21:11.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.197+0000 7f0185968700 1 -- start start 2023-10-09T06:21:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.198+0000 7f0185968700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f018015a1e0 0x7f01800cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.198+0000 7f0185968700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01800b3430 0x7f01800cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.198+0000 7f0185968700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f018015db80 con 0x7f0180159e10 2023-10-09T06:21:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.198+0000 7f0185968700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f018015e800 con 0x7f018015a1e0 2023-10-09T06:21:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.198+0000 7f0185968700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018015de60 con 0x7f01800b3430 2023-10-09T06:21:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.198+0000 7f017e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f018015a1e0 0x7f01800cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.198+0000 7f017e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f018015a1e0 0x7f01800cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56284/0 (socket says 172.21.15.31:56284) 2023-10-09T06:21:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.198+0000 7f017e7fc700 1 -- 172.21.15.31:0/3815351327 learned_addr learned my addr 172.21.15.31:0/3815351327 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.199+0000 7f017f7fe700 1 --2- 172.21.15.31:0/3815351327 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01800b3430 0x7f01800cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.199+0000 7f017e7fc700 1 -- 172.21.15.31:0/3815351327 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01800b3430 msgr2=0x7f01800cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:11.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.199+0000 7f017e7fc700 1 --2- 172.21.15.31:0/3815351327 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01800b3430 0x7f01800cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.199+0000 7f017e7fc700 1 -- 172.21.15.31:0/3815351327 >> v1:172.21.15.158:6789/0 conn(0x7f0180159e10 legacy=0x7f01800b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.199+0000 7f017e7fc700 1 -- 172.21.15.31:0/3815351327 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018015e140 con 0x7f018015a1e0 2023-10-09T06:21:11.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.199+0000 7f017e7fc700 1 --2- 172.21.15.31:0/3815351327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f018015a1e0 0x7f01800cd740 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f01680099b0 tx=0x7f0168009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50633b4a84079c17 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:11.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.199+0000 7f017dffb700 1 -- 172.21.15.31:0/3815351327 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168009ea0 con 0x7f018015a1e0 2023-10-09T06:21:11.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.199+0000 7f017dffb700 1 -- 172.21.15.31:0/3815351327 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016800b860 con 0x7f018015a1e0 2023-10-09T06:21:11.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.199+0000 7f017dffb700 1 -- 172.21.15.31:0/3815351327 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800bc00 con 0x7f018015a1e0 2023-10-09T06:21:11.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.200+0000 7f0185968700 1 -- 172.21.15.31:0/3815351327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f018015a1e0 msgr2=0x7f01800cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.200+0000 7f0185968700 1 --2- 172.21.15.31:0/3815351327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f018015a1e0 0x7f01800cd740 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f01680099b0 tx=0x7f0168009250 comp rx=0 tx=0).stop 2023-10-09T06:21:11.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.200+0000 7f0185968700 1 -- 172.21.15.31:0/3815351327 shutdown_connections 2023-10-09T06:21:11.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.200+0000 7f0185968700 1 --2- 172.21.15.31:0/3815351327 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01800b3430 0x7f01800cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.200+0000 7f0185968700 1 --2- 172.21.15.31:0/3815351327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f018015a1e0 0x7f01800cd740 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.200+0000 7f0185968700 1 -- 172.21.15.31:0/3815351327 >> 172.21.15.31:0/3815351327 conn(0x7f0180067660 msgr2=0x7f0180067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:11.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.200+0000 7f0185968700 1 -- 172.21.15.31:0/3815351327 shutdown_connections 2023-10-09T06:21:11.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.200+0000 7f0185968700 1 -- 172.21.15.31:0/3815351327 wait complete. 2023-10-09T06:21:11.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.201+0000 7f0185968700 1 Processor -- start 2023-10-09T06:21:11.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.201+0000 7f0185968700 1 -- start start 2023-10-09T06:21:11.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f0185968700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01800b3430 0x7f0180151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f0185968700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180159e10 0x7f01800c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f0185968700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f018015a1e0 0x7f0180158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f0185968700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01801517c0 con 0x7f01800b3430 2023-10-09T06:21:11.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f0185968700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01800cac70 con 0x7f0180159e10 2023-10-09T06:21:11.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f0185968700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01800c9bd0 con 0x7f018015a1e0 2023-10-09T06:21:11.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f017effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01800b3430 0x7f0180151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f017effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01800b3430 0x7f0180151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56300/0 (socket says 172.21.15.31:56300) 2023-10-09T06:21:11.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f017effd700 1 -- 172.21.15.31:0/984120056 learned_addr learned my addr 172.21.15.31:0/984120056 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:11.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f017e7fc700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180159e10 0x7f01800c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f017f7fe700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f018015a1e0 0x7f0180158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f017effd700 1 -- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f018015a1e0 msgr2=0x7f0180158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f017effd700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f018015a1e0 0x7f0180158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f017effd700 1 -- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180159e10 msgr2=0x7f01800c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f017effd700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180159e10 0x7f01800c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f017effd700 1 -- 172.21.15.31:0/984120056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680094f0 con 0x7f01800b3430 2023-10-09T06:21:11.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f017e7fc700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180159e10 0x7f01800c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:11.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f017f7fe700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f018015a1e0 0x7f0180158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:11.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f017effd700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01800b3430 0x7f0180151280 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f017800cb10 tx=0x7f01780017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:11.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f0176ffd700 1 -- 172.21.15.31:0/984120056 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017800a760 con 0x7f01800b3430 2023-10-09T06:21:11.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f0176ffd700 1 -- 172.21.15.31:0/984120056 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017800a8e0 con 0x7f01800b3430 2023-10-09T06:21:11.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f0185968700 1 -- 172.21.15.31:0/984120056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01800c9eb0 con 0x7f01800b3430 2023-10-09T06:21:11.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f0176ffd700 1 -- 172.21.15.31:0/984120056 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017800aca0 con 0x7f01800b3430 2023-10-09T06:21:11.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.202+0000 7f0185968700 1 -- 172.21.15.31:0/984120056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01800ca470 con 0x7f01800b3430 2023-10-09T06:21:11.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.203+0000 7f0185968700 1 -- 172.21.15.31:0/984120056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018004c3c0 con 0x7f01800b3430 2023-10-09T06:21:11.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.204+0000 7f0176ffd700 1 -- 172.21.15.31:0/984120056 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0178003030 con 0x7f01800b3430 2023-10-09T06:21:11.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.204+0000 7f0176ffd700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0160066f30 0x7f01600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.204+0000 7f0176ffd700 1 -- 172.21.15.31:0/984120056 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0178084660 con 0x7f01800b3430 2023-10-09T06:21:11.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.204+0000 7f017e7fc700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0160066f30 0x7f01600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.205+0000 7f017e7fc700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0160066f30 0x7f01600693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f01680099b0 tx=0x7f0168017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:11.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.208+0000 7f0176ffd700 1 -- 172.21.15.31:0/984120056 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0178051980 con 0x7f01800b3430 2023-10-09T06:21:11.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.402+0000 7f0185968700 1 -- 172.21.15.31:0/984120056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f018015e420 con 0x7f01800b3430 2023-10-09T06:21:11.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.403+0000 7f0176ffd700 1 -- 172.21.15.31:0/984120056 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f0178054fa0 con 0x7f01800b3430 2023-10-09T06:21:11.404 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:11.404 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:55.693313+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:11.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.405+0000 7f0185968700 1 -- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0160066f30 msgr2=0x7f01600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.405+0000 7f0185968700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0160066f30 0x7f01600693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f01680099b0 tx=0x7f0168017000 comp rx=0 tx=0).stop 2023-10-09T06:21:11.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.405+0000 7f0185968700 1 -- 172.21.15.31:0/984120056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01800b3430 msgr2=0x7f0180151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.405+0000 7f0185968700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01800b3430 0x7f0180151280 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f017800cb10 tx=0x7f01780017b0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.405+0000 7f0185968700 1 -- 172.21.15.31:0/984120056 shutdown_connections 2023-10-09T06:21:11.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.405+0000 7f0185968700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0160066f30 0x7f01600693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.405+0000 7f0185968700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f018015a1e0 0x7f0180158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.405+0000 7f0185968700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01800b3430 0x7f0180151280 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.405+0000 7f0185968700 1 --2- 172.21.15.31:0/984120056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0180159e10 0x7f01800c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.405+0000 7f0185968700 1 -- 172.21.15.31:0/984120056 >> 172.21.15.31:0/984120056 conn(0x7f0180067660 msgr2=0x7f01800b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:11.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.405+0000 7f0185968700 1 -- 172.21.15.31:0/984120056 shutdown_connections 2023-10-09T06:21:11.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.405+0000 7f0185968700 1 -- 172.21.15.31:0/984120056 wait complete. 2023-10-09T06:21:11.418 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:20:52.621337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:20:53.053532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:21:11.418 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:21:11.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.540+0000 7f80819f0700 1 Processor -- start 2023-10-09T06:21:11.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.540+0000 7f80819f0700 1 -- start start 2023-10-09T06:21:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f80819f0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f807c159ec0 0x7f807c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f80819f0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f807c06acb0 0x7f807c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f80819f0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807c0b0790 con 0x7f807c15a290 2023-10-09T06:21:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f80819f0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807c0ce1f0 con 0x7f807c159ec0 2023-10-09T06:21:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f80819f0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807c0b0b20 con 0x7f807c06acb0 2023-10-09T06:21:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f807affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f807c159ec0 0x7f807c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f807a7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f807c15a290 0x7f807c06a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39088/0 (socket says 172.21.15.31:39088) 2023-10-09T06:21:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f807affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f807c159ec0 0x7f807c0af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56314/0 (socket says 172.21.15.31:56314) 2023-10-09T06:21:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f807a7fc700 1 -- 172.21.15.31:0/4224040438 learned_addr learned my addr 172.21.15.31:0/4224040438 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f807b7fe700 1 --2- 172.21.15.31:0/4224040438 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f807c06acb0 0x7f807c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f807affd700 1 -- 172.21.15.31:0/4224040438 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f807c06acb0 msgr2=0x7f807c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f807affd700 1 --2- 172.21.15.31:0/4224040438 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f807c06acb0 0x7f807c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f807affd700 1 -- 172.21.15.31:0/4224040438 >> v1:172.21.15.31:6789/0 conn(0x7f807c15a290 legacy=0x7f807c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f807affd700 1 -- 172.21.15.31:0/4224040438 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c0b04b0 con 0x7f807c159ec0 2023-10-09T06:21:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f8079ffb700 1 -- 172.21.15.31:0/4224040438 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450215358 0 0) 0x7f807c0b0790 con 0x7f807c15a290 2023-10-09T06:21:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f807affd700 1 --2- 172.21.15.31:0/4224040438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f807c159ec0 0x7f807c0af940 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f806c0098e0 tx=0x7f806c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d478e71d4981de server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f8079ffb700 1 -- 172.21.15.31:0/4224040438 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c00b640 con 0x7f807c159ec0 2023-10-09T06:21:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f8079ffb700 1 -- 172.21.15.31:0/4224040438 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c00b7a0 con 0x7f807c159ec0 2023-10-09T06:21:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.541+0000 7f8079ffb700 1 -- 172.21.15.31:0/4224040438 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c00bb40 con 0x7f807c159ec0 2023-10-09T06:21:11.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.542+0000 7f80819f0700 1 -- 172.21.15.31:0/4224040438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f807c159ec0 msgr2=0x7f807c0af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.542+0000 7f80819f0700 1 --2- 172.21.15.31:0/4224040438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f807c159ec0 0x7f807c0af940 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f806c0098e0 tx=0x7f806c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.542+0000 7f80819f0700 1 -- 172.21.15.31:0/4224040438 shutdown_connections 2023-10-09T06:21:11.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.542+0000 7f80819f0700 1 --2- 172.21.15.31:0/4224040438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f807c159ec0 0x7f807c0af940 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.542+0000 7f80819f0700 1 --2- 172.21.15.31:0/4224040438 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f807c06acb0 0x7f807c0afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.542+0000 7f80819f0700 1 -- 172.21.15.31:0/4224040438 >> 172.21.15.31:0/4224040438 conn(0x7f807c0d1880 msgr2=0x7f807c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:11.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.542+0000 7f80819f0700 1 -- 172.21.15.31:0/4224040438 shutdown_connections 2023-10-09T06:21:11.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.542+0000 7f80819f0700 1 -- 172.21.15.31:0/4224040438 wait complete. 2023-10-09T06:21:11.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.543+0000 7f80819f0700 1 Processor -- start 2023-10-09T06:21:11.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.543+0000 7f80819f0700 1 -- start start 2023-10-09T06:21:11.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f80819f0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f807c06acb0 0x7f807c15b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f80819f0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f807c159ec0 0x7f807c16cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f80819f0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f807c15a290 0x7f807c0b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f80819f0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c15be90 con 0x7f807c15a290 2023-10-09T06:21:11.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f80819f0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c15c170 con 0x7f807c06acb0 2023-10-09T06:21:11.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f80819f0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807c15c450 con 0x7f807c159ec0 2023-10-09T06:21:11.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f807b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f807c15a290 0x7f807c0b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f807b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f807c15a290 0x7f807c0b2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56318/0 (socket says 172.21.15.31:56318) 2023-10-09T06:21:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f807b7fe700 1 -- 172.21.15.31:0/1735554905 learned_addr learned my addr 172.21.15.31:0/1735554905 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f807a7fc700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f807c159ec0 0x7f807c16cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f807affd700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f807c06acb0 0x7f807c15b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f807b7fe700 1 -- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f807c159ec0 msgr2=0x7f807c16cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f807b7fe700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f807c159ec0 0x7f807c16cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f807b7fe700 1 -- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f807c06acb0 msgr2=0x7f807c15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f807b7fe700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f807c06acb0 0x7f807c15b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.544+0000 7f807b7fe700 1 -- 172.21.15.31:0/1735554905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c009420 con 0x7f807c15a290 2023-10-09T06:21:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.545+0000 7f807b7fe700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f807c15a290 0x7f807c0b2a20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8074009e90 tx=0x7f807400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.545+0000 7f8072ffd700 1 -- 172.21.15.31:0/1735554905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807400cb70 con 0x7f807c15a290 2023-10-09T06:21:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.545+0000 7f8072ffd700 1 -- 172.21.15.31:0/1735554905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807400f040 con 0x7f807c15a290 2023-10-09T06:21:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.545+0000 7f8072ffd700 1 -- 172.21.15.31:0/1735554905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074014480 con 0x7f807c15a290 2023-10-09T06:21:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.545+0000 7f80819f0700 1 -- 172.21.15.31:0/1735554905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807c15c730 con 0x7f807c15a290 2023-10-09T06:21:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.545+0000 7f80819f0700 1 -- 172.21.15.31:0/1735554905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807c158e80 con 0x7f807c15a290 2023-10-09T06:21:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.546+0000 7f80819f0700 1 -- 172.21.15.31:0/1735554905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807c16a2b0 con 0x7f807c15a290 2023-10-09T06:21:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.546+0000 7f8072ffd700 1 -- 172.21.15.31:0/1735554905 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80740147f0 con 0x7f807c15a290 2023-10-09T06:21:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.546+0000 7f8072ffd700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f805c066f30 0x7f805c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.547+0000 7f8072ffd700 1 -- 172.21.15.31:0/1735554905 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8074085220 con 0x7f807c15a290 2023-10-09T06:21:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.547+0000 7f807affd700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f805c066f30 0x7f805c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.547+0000 7f807affd700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f805c066f30 0x7f805c0693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f806c0093f0 tx=0x7f806c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:11.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.551+0000 7f8072ffd700 1 -- 172.21.15.31:0/1735554905 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8074052490 con 0x7f807c15a290 2023-10-09T06:21:11.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.743+0000 7f80819f0700 1 -- 172.21.15.31:0/1735554905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f807c04c3c0 con 0x7f807c15a290 2023-10-09T06:21:11.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.743+0000 7f8072ffd700 1 -- 172.21.15.31:0/1735554905 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8074055ab0 con 0x7f807c15a290 2023-10-09T06:21:11.744 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:21:11.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.745+0000 7f80819f0700 1 -- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f805c066f30 msgr2=0x7f805c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.745+0000 7f80819f0700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f805c066f30 0x7f805c0693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f806c0093f0 tx=0x7f806c017000 comp rx=0 tx=0).stop 2023-10-09T06:21:11.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.745+0000 7f80819f0700 1 -- 172.21.15.31:0/1735554905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f807c15a290 msgr2=0x7f807c0b2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.745+0000 7f80819f0700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f807c15a290 0x7f807c0b2a20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8074009e90 tx=0x7f807400b040 comp rx=0 tx=0).stop 2023-10-09T06:21:11.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.745+0000 7f80819f0700 1 -- 172.21.15.31:0/1735554905 shutdown_connections 2023-10-09T06:21:11.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.745+0000 7f80819f0700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f805c066f30 0x7f805c0693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.745+0000 7f80819f0700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f807c15a290 0x7f807c0b2a20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.745+0000 7f80819f0700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f807c06acb0 0x7f807c15b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.745+0000 7f80819f0700 1 --2- 172.21.15.31:0/1735554905 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f807c159ec0 0x7f807c16cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.745+0000 7f80819f0700 1 -- 172.21.15.31:0/1735554905 >> 172.21.15.31:0/1735554905 conn(0x7f807c0d1880 msgr2=0x7f807c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:11.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.745+0000 7f80819f0700 1 -- 172.21.15.31:0/1735554905 shutdown_connections 2023-10-09T06:21:11.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.745+0000 7f80819f0700 1 -- 172.21.15.31:0/1735554905 wait complete. 2023-10-09T06:21:11.758 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:21:11.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.879+0000 7fd70093a700 1 Processor -- start 2023-10-09T06:21:11.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.879+0000 7fd70093a700 1 -- start start 2023-10-09T06:21:11.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.880+0000 7fd70093a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd6fc06f430 0x7fd6fc0c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.880+0000 7fd70093a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc0c7710 con 0x7fd6fc0ca250 2023-10-09T06:21:11.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.880+0000 7fd70093a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc0c79f0 con 0x7fd6fc06f060 2023-10-09T06:21:11.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.880+0000 7fd70093a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc06fcb0 con 0x7fd6fc06f430 2023-10-09T06:21:11.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.880+0000 7fd6fb59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd6fc06f430 0x7fd6fc0c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.880+0000 7fd6fa59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd6fc0ca250 0x7fd6fc15b460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39094/0 (socket says 172.21.15.31:39094) 2023-10-09T06:21:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.880+0000 7fd6fa59c700 1 -- 172.21.15.31:0/2790574862 learned_addr learned my addr 172.21.15.31:0/2790574862 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.880+0000 7fd6fb59e700 1 -- 172.21.15.31:0/2790574862 >> v1:172.21.15.158:6789/0 conn(0x7fd6fc06f060 legacy=0x7fd6fc15ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.880+0000 7fd6fb59e700 1 -- 172.21.15.31:0/2790574862 >> v1:172.21.15.31:6789/0 conn(0x7fd6fc0ca250 legacy=0x7fd6fc15b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.880+0000 7fd6fb59e700 1 -- 172.21.15.31:0/2790574862 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0c7cd0 con 0x7fd6fc06f430 2023-10-09T06:21:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.880+0000 7fd6f9d9b700 1 -- 172.21.15.31:0/2790574862 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736604751 0 0) 0x7fd6fc0c7710 con 0x7fd6fc0ca250 2023-10-09T06:21:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.880+0000 7fd6fb59e700 1 --2- 172.21.15.31:0/2790574862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6fc06f430 0x7fd6fc0c87b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009e60 tx=0x7fd6ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a6b7d560472d33 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.881+0000 7fd6f9d9b700 1 -- 172.21.15.31:0/2790574862 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00e070 con 0x7fd6fc06f430 2023-10-09T06:21:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.881+0000 7fd6f9d9b700 1 -- 172.21.15.31:0/2790574862 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec00bc30 con 0x7fd6fc06f430 2023-10-09T06:21:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.881+0000 7fd6f9d9b700 1 -- 172.21.15.31:0/2790574862 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec012430 con 0x7fd6fc06f430 2023-10-09T06:21:11.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.881+0000 7fd70093a700 1 -- 172.21.15.31:0/2790574862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6fc06f430 msgr2=0x7fd6fc0c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.881+0000 7fd70093a700 1 --2- 172.21.15.31:0/2790574862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6fc06f430 0x7fd6fc0c87b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009e60 tx=0x7fd6ec009780 comp rx=0 tx=0).stop 2023-10-09T06:21:11.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.881+0000 7fd70093a700 1 -- 172.21.15.31:0/2790574862 shutdown_connections 2023-10-09T06:21:11.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.881+0000 7fd70093a700 1 --2- 172.21.15.31:0/2790574862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6fc06f430 0x7fd6fc0c87b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.881+0000 7fd70093a700 1 -- 172.21.15.31:0/2790574862 >> 172.21.15.31:0/2790574862 conn(0x7fd6fc0cdba0 msgr2=0x7fd6fc0c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:11.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.881+0000 7fd70093a700 1 -- 172.21.15.31:0/2790574862 shutdown_connections 2023-10-09T06:21:11.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.881+0000 7fd70093a700 1 -- 172.21.15.31:0/2790574862 wait complete. 2023-10-09T06:21:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.882+0000 7fd70093a700 1 Processor -- start 2023-10-09T06:21:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd70093a700 1 -- start start 2023-10-09T06:21:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd70093a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6fc06f060 0x7fd6fc158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd70093a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6fc06f430 0x7fd6fc0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd70093a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0ca250 0x7fd6fc0cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd70093a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0c3770 con 0x7fd6fc06f060 2023-10-09T06:21:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd70093a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0c4bb0 con 0x7fd6fc0ca250 2023-10-09T06:21:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd70093a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0b2c70 con 0x7fd6fc06f430 2023-10-09T06:21:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6fad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6fc06f060 0x7fd6fc158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6fad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6fc06f060 0x7fd6fc158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56340/0 (socket says 172.21.15.31:56340) 2023-10-09T06:21:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6fad9d700 1 -- 172.21.15.31:0/3052933905 learned_addr learned my addr 172.21.15.31:0/3052933905 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6fa59c700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6fc06f430 0x7fd6fc0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6fb59e700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0ca250 0x7fd6fc0cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6fad9d700 1 -- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6fc06f430 msgr2=0x7fd6fc0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6fad9d700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6fc06f430 0x7fd6fc0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6fad9d700 1 -- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0ca250 msgr2=0x7fd6fc0cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6fad9d700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0ca250 0x7fd6fc0cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6fad9d700 1 -- 172.21.15.31:0/3052933905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec009a20 con 0x7fd6fc06f060 2023-10-09T06:21:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6fad9d700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6fc06f060 0x7fd6fc158590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400c5c0 tx=0x7fd6f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6f2ffd700 1 -- 172.21.15.31:0/3052933905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4011590 con 0x7fd6fc06f060 2023-10-09T06:21:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6f2ffd700 1 -- 172.21.15.31:0/3052933905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f4011710 con 0x7fd6fc06f060 2023-10-09T06:21:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd70093a700 1 -- 172.21.15.31:0/3052933905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc0c4280 con 0x7fd6fc06f060 2023-10-09T06:21:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd6f2ffd700 1 -- 172.21.15.31:0/3052933905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4011ad0 con 0x7fd6fc06f060 2023-10-09T06:21:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.884+0000 7fd70093a700 1 -- 172.21.15.31:0/3052933905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc0c4840 con 0x7fd6fc06f060 2023-10-09T06:21:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.885+0000 7fd70093a700 1 -- 172.21.15.31:0/3052933905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc06cb50 con 0x7fd6fc06f060 2023-10-09T06:21:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.885+0000 7fd6f2ffd700 1 -- 172.21.15.31:0/3052933905 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6f401b3b0 con 0x7fd6fc06f060 2023-10-09T06:21:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.886+0000 7fd6f2ffd700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd6dc066f60 0x7fd6dc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.886+0000 7fd6f2ffd700 1 -- 172.21.15.31:0/3052933905 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6f4083980 con 0x7fd6fc06f060 2023-10-09T06:21:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.886+0000 7fd6fa59c700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd6dc066f60 0x7fd6dc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.886+0000 7fd6fa59c700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd6dc066f60 0x7fd6dc069410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0cc1d0 tx=0x7fd6e4007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:11.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:11.890+0000 7fd6f2ffd700 1 -- 172.21.15.31:0/3052933905 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6f4050bf0 con 0x7fd6fc06f060 2023-10-09T06:21:12.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.081+0000 7fd70093a700 1 -- 172.21.15.31:0/3052933905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6fc0c7fb0 con 0x7fd6fc06f060 2023-10-09T06:21:12.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.081+0000 7fd6f2ffd700 1 -- 172.21.15.31:0/3052933905 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6f4017020 con 0x7fd6fc06f060 2023-10-09T06:21:12.082 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:21:12.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.083+0000 7fd70093a700 1 -- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd6dc066f60 msgr2=0x7fd6dc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.083+0000 7fd70093a700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd6dc066f60 0x7fd6dc069410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0cc1d0 tx=0x7fd6e4007f50 comp rx=0 tx=0).stop 2023-10-09T06:21:12.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.083+0000 7fd70093a700 1 -- 172.21.15.31:0/3052933905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6fc06f060 msgr2=0x7fd6fc158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.083+0000 7fd70093a700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6fc06f060 0x7fd6fc158590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400c5c0 tx=0x7fd6f400c8d0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.083+0000 7fd70093a700 1 -- 172.21.15.31:0/3052933905 shutdown_connections 2023-10-09T06:21:12.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.083+0000 7fd70093a700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd6dc066f60 0x7fd6dc069410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.083+0000 7fd70093a700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6fc0ca250 0x7fd6fc0cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.083+0000 7fd70093a700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6fc06f060 0x7fd6fc158590 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.083+0000 7fd70093a700 1 --2- 172.21.15.31:0/3052933905 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6fc06f430 0x7fd6fc0afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.083+0000 7fd70093a700 1 -- 172.21.15.31:0/3052933905 >> 172.21.15.31:0/3052933905 conn(0x7fd6fc0cdba0 msgr2=0x7fd6fc063570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:12.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.083+0000 7fd70093a700 1 -- 172.21.15.31:0/3052933905 shutdown_connections 2023-10-09T06:21:12.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.083+0000 7fd70093a700 1 -- 172.21.15.31:0/3052933905 wait complete. 2023-10-09T06:21:12.096 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:21:12.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.216+0000 7f6572179700 1 Processor -- start 2023-10-09T06:21:12.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.216+0000 7f6572179700 1 -- start start 2023-10-09T06:21:12.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.217+0000 7f6572179700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f656c0cce30 0x7f656c15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.217+0000 7f6572179700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f656c0b6580 0x7f656c06a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.217+0000 7f6572179700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656c0b4d70 con 0x7f656c06a830 2023-10-09T06:21:12.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.217+0000 7f6572179700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656c06ac70 con 0x7f656c0cce30 2023-10-09T06:21:12.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.217+0000 7f6572179700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0cd8d0 con 0x7f656c0b6580 2023-10-09T06:21:12.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.217+0000 7f6571177700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f656c0cce30 0x7f656c15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.217+0000 7f6571978700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f656c06a830 0x7f656c15d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39106/0 (socket says 172.21.15.31:39106) 2023-10-09T06:21:12.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.217+0000 7f6571978700 1 -- 172.21.15.31:0/3207701185 learned_addr learned my addr 172.21.15.31:0/3207701185 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.217+0000 7f6571177700 1 -- 172.21.15.31:0/3207701185 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f656c0b6580 msgr2=0x7f656c06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.217+0000 7f6571177700 1 --2- 172.21.15.31:0/3207701185 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f656c0b6580 0x7f656c06a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.217+0000 7f6571177700 1 -- 172.21.15.31:0/3207701185 >> v1:172.21.15.31:6789/0 conn(0x7f656c06a830 legacy=0x7f656c15d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.217+0000 7f6571177700 1 -- 172.21.15.31:0/3207701185 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c0b4440 con 0x7f656c0cce30 2023-10-09T06:21:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.217+0000 7f656bfff700 1 -- 172.21.15.31:0/3207701185 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243132917 0 0) 0x7f656c0b4d70 con 0x7f656c06a830 2023-10-09T06:21:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.218+0000 7f6571177700 1 --2- 172.21.15.31:0/3207701185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f656c0cce30 0x7f656c15aca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f655c009e60 tx=0x7f655c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9881af6474a5f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.218+0000 7f656bfff700 1 -- 172.21.15.31:0/3207701185 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c00e070 con 0x7f656c0cce30 2023-10-09T06:21:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.218+0000 7f656bfff700 1 -- 172.21.15.31:0/3207701185 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c00bc30 con 0x7f656c0cce30 2023-10-09T06:21:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.218+0000 7f656bfff700 1 -- 172.21.15.31:0/3207701185 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c012430 con 0x7f656c0cce30 2023-10-09T06:21:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.218+0000 7f6572179700 1 -- 172.21.15.31:0/3207701185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f656c0cce30 msgr2=0x7f656c15aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.218+0000 7f6572179700 1 --2- 172.21.15.31:0/3207701185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f656c0cce30 0x7f656c15aca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f655c009e60 tx=0x7f655c009780 comp rx=0 tx=0).stop 2023-10-09T06:21:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.218+0000 7f6572179700 1 -- 172.21.15.31:0/3207701185 shutdown_connections 2023-10-09T06:21:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.218+0000 7f6572179700 1 --2- 172.21.15.31:0/3207701185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f656c0cce30 0x7f656c15aca0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.218+0000 7f6572179700 1 --2- 172.21.15.31:0/3207701185 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f656c0b6580 0x7f656c06a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.218+0000 7f6572179700 1 -- 172.21.15.31:0/3207701185 >> 172.21.15.31:0/3207701185 conn(0x7f656c068cb0 msgr2=0x7f656c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.218+0000 7f6572179700 1 -- 172.21.15.31:0/3207701185 shutdown_connections 2023-10-09T06:21:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.218+0000 7f6572179700 1 -- 172.21.15.31:0/3207701185 wait complete. 2023-10-09T06:21:12.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.219+0000 7f6572179700 1 Processor -- start 2023-10-09T06:21:12.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.219+0000 7f6572179700 1 -- start start 2023-10-09T06:21:12.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.220+0000 7f6572179700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f656c06a830 0x7f656c16ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.220+0000 7f6572179700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f656c0b6580 0x7f656c0d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.220+0000 7f6572179700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f656c0cce30 0x7f656c0d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.220+0000 7f6572179700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c16a6a0 con 0x7f656c0cce30 2023-10-09T06:21:12.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.220+0000 7f6572179700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0b3020 con 0x7f656c06a830 2023-10-09T06:21:12.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.220+0000 7f6572179700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0b3300 con 0x7f656c0b6580 2023-10-09T06:21:12.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.220+0000 7f6571978700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f656c0cce30 0x7f656c0d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.220+0000 7f6571978700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f656c0cce30 0x7f656c0d0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56352/0 (socket says 172.21.15.31:56352) 2023-10-09T06:21:12.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.220+0000 7f6571978700 1 -- 172.21.15.31:0/4114045954 learned_addr learned my addr 172.21.15.31:0/4114045954 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:12.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.221+0000 7f6571177700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f656c06a830 0x7f656c16ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.221+0000 7f6570976700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f656c0b6580 0x7f656c0d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.221+0000 7f6571978700 1 -- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f656c0b6580 msgr2=0x7f656c0d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.221+0000 7f6571978700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f656c0b6580 0x7f656c0d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.221+0000 7f6571978700 1 -- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f656c06a830 msgr2=0x7f656c16ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.221+0000 7f6571978700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f656c06a830 0x7f656c16ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.221+0000 7f6571978700 1 -- 172.21.15.31:0/4114045954 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c009a20 con 0x7f656c0cce30 2023-10-09T06:21:12.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.221+0000 7f6571978700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f656c0cce30 0x7f656c0d0bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f656400c7e0 tx=0x7f6564007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:12.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.221+0000 7f65697fa700 1 -- 172.21.15.31:0/4114045954 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564005c00 con 0x7f656c0cce30 2023-10-09T06:21:12.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.221+0000 7f65697fa700 1 -- 172.21.15.31:0/4114045954 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6564005d80 con 0x7f656c0cce30 2023-10-09T06:21:12.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.221+0000 7f6572179700 1 -- 172.21.15.31:0/4114045954 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656c16a330 con 0x7f656c0cce30 2023-10-09T06:21:12.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.221+0000 7f65697fa700 1 -- 172.21.15.31:0/4114045954 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564007320 con 0x7f656c0cce30 2023-10-09T06:21:12.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.221+0000 7f6572179700 1 -- 172.21.15.31:0/4114045954 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656c14e7a0 con 0x7f656c0cce30 2023-10-09T06:21:12.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.222+0000 7f6572179700 1 -- 172.21.15.31:0/4114045954 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f656c0cd3f0 con 0x7f656c0cce30 2023-10-09T06:21:12.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.222+0000 7f65697fa700 1 -- 172.21.15.31:0/4114045954 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f656401b3b0 con 0x7f656c0cce30 2023-10-09T06:21:12.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.223+0000 7f65697fa700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6558066f30 0x7f65580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.223+0000 7f65697fa700 1 -- 172.21.15.31:0/4114045954 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6564083970 con 0x7f656c0cce30 2023-10-09T06:21:12.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.223+0000 7f6571177700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6558066f30 0x7f65580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.223+0000 7f6571177700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6558066f30 0x7f65580693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f655c009e60 tx=0x7f655c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:12.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.227+0000 7f65697fa700 1 -- 172.21.15.31:0/4114045954 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6564050be0 con 0x7f656c0cce30 2023-10-09T06:21:12.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.418+0000 7f6572179700 1 -- 172.21.15.31:0/4114045954 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f656c16a7e0 con 0x7f656c0cce30 2023-10-09T06:21:12.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.418+0000 7f65697fa700 1 -- 172.21.15.31:0/4114045954 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6564017070 con 0x7f656c0cce30 2023-10-09T06:21:12.419 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:21:12.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.421+0000 7f6572179700 1 -- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6558066f30 msgr2=0x7f65580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.421+0000 7f6572179700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6558066f30 0x7f65580693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f655c009e60 tx=0x7f655c019000 comp rx=0 tx=0).stop 2023-10-09T06:21:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.421+0000 7f6572179700 1 -- 172.21.15.31:0/4114045954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f656c0cce30 msgr2=0x7f656c0d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.421+0000 7f6572179700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f656c0cce30 0x7f656c0d0bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f656400c7e0 tx=0x7f6564007d90 comp rx=0 tx=0).stop 2023-10-09T06:21:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.421+0000 7f6572179700 1 -- 172.21.15.31:0/4114045954 shutdown_connections 2023-10-09T06:21:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.421+0000 7f6572179700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6558066f30 0x7f65580693e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.421+0000 7f6572179700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f656c0cce30 0x7f656c0d0bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.421+0000 7f6572179700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f656c06a830 0x7f656c16ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.421+0000 7f6572179700 1 --2- 172.21.15.31:0/4114045954 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f656c0b6580 0x7f656c0d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.421+0000 7f6572179700 1 -- 172.21.15.31:0/4114045954 >> 172.21.15.31:0/4114045954 conn(0x7f656c068cb0 msgr2=0x7f656c150580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.421+0000 7f6572179700 1 -- 172.21.15.31:0/4114045954 shutdown_connections 2023-10-09T06:21:12.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.421+0000 7f6572179700 1 -- 172.21.15.31:0/4114045954 wait complete. 2023-10-09T06:21:12.433 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:21:12.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.552+0000 7fcf4ed55700 1 Processor -- start 2023-10-09T06:21:12.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.553+0000 7fcf4ed55700 1 -- start start 2023-10-09T06:21:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.553+0000 7fcf4ed55700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf480aedb0 0x7fcf480af180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.553+0000 7fcf4ed55700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf4806f450 0x7fcf480b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.553+0000 7fcf4ed55700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4806efc0 con 0x7fcf480b1bf0 2023-10-09T06:21:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.553+0000 7fcf4ed55700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf48158470 con 0x7fcf4806f450 2023-10-09T06:21:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.553+0000 7fcf4ed55700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf480af6c0 con 0x7fcf480aedb0 2023-10-09T06:21:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.553+0000 7fcf47fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf4806f450 0x7fcf480b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.553+0000 7fcf47fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf4806f450 0x7fcf480b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56366/0 (socket says 172.21.15.31:56366) 2023-10-09T06:21:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.554+0000 7fcf47fff700 1 -- 172.21.15.31:0/4274110629 learned_addr learned my addr 172.21.15.31:0/4274110629 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.554+0000 7fcf4caf1700 1 --2- 172.21.15.31:0/4274110629 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf480aedb0 0x7fcf480af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.554+0000 7fcf47fff700 1 -- 172.21.15.31:0/4274110629 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf480aedb0 msgr2=0x7fcf480af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.554+0000 7fcf47fff700 1 --2- 172.21.15.31:0/4274110629 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf480aedb0 0x7fcf480af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.554+0000 7fcf47fff700 1 -- 172.21.15.31:0/4274110629 >> v1:172.21.15.158:6789/0 conn(0x7fcf480b1bf0 legacy=0x7fcf480c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.554+0000 7fcf47fff700 1 -- 172.21.15.31:0/4274110629 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf480b2100 con 0x7fcf4806f450 2023-10-09T06:21:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.554+0000 7fcf4caf1700 1 --2- 172.21.15.31:0/4274110629 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf480aedb0 0x7fcf480af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.554+0000 7fcf47fff700 1 --2- 172.21.15.31:0/4274110629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf4806f450 0x7fcf480b16b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0099b0 tx=0x7fcf3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c4f77c15966303 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.554+0000 7fcf477fe700 1 -- 172.21.15.31:0/4274110629 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00b860 con 0x7fcf4806f450 2023-10-09T06:21:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.554+0000 7fcf477fe700 1 -- 172.21.15.31:0/4274110629 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c00b9c0 con 0x7fcf4806f450 2023-10-09T06:21:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.554+0000 7fcf477fe700 1 -- 172.21.15.31:0/4274110629 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00bd60 con 0x7fcf4806f450 2023-10-09T06:21:12.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.555+0000 7fcf4ed55700 1 -- 172.21.15.31:0/4274110629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf4806f450 msgr2=0x7fcf480b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.555+0000 7fcf4ed55700 1 --2- 172.21.15.31:0/4274110629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf4806f450 0x7fcf480b16b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0099b0 tx=0x7fcf3c009250 comp rx=0 tx=0).stop 2023-10-09T06:21:12.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.555+0000 7fcf4ed55700 1 -- 172.21.15.31:0/4274110629 shutdown_connections 2023-10-09T06:21:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.555+0000 7fcf4ed55700 1 --2- 172.21.15.31:0/4274110629 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf480aedb0 0x7fcf480af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.555+0000 7fcf4ed55700 1 --2- 172.21.15.31:0/4274110629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf4806f450 0x7fcf480b16b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.555+0000 7fcf4ed55700 1 -- 172.21.15.31:0/4274110629 >> 172.21.15.31:0/4274110629 conn(0x7fcf480cd1e0 msgr2=0x7fcf480cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.555+0000 7fcf4ed55700 1 -- 172.21.15.31:0/4274110629 shutdown_connections 2023-10-09T06:21:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.555+0000 7fcf4ed55700 1 -- 172.21.15.31:0/4274110629 wait complete. 2023-10-09T06:21:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.556+0000 7fcf4ed55700 1 Processor -- start 2023-10-09T06:21:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.556+0000 7fcf4ed55700 1 -- start start 2023-10-09T06:21:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4ed55700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf4806f450 0x7fcf48099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4ed55700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf480aedb0 0x7fcf480cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4ed55700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf480b1bf0 0x7fcf480ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4ed55700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4809a370 con 0x7fcf480b1bf0 2023-10-09T06:21:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4ed55700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4809a650 con 0x7fcf480aedb0 2023-10-09T06:21:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4ed55700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf48158750 con 0x7fcf4806f450 2023-10-09T06:21:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4d2f2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf480b1bf0 0x7fcf480ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4d2f2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf480b1bf0 0x7fcf480ab930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56374/0 (socket says 172.21.15.31:56374) 2023-10-09T06:21:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4d2f2700 1 -- 172.21.15.31:0/1264183458 learned_addr learned my addr 172.21.15.31:0/1264183458 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf47fff700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf480aedb0 0x7fcf480cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4caf1700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf4806f450 0x7fcf48099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4d2f2700 1 -- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf4806f450 msgr2=0x7fcf48099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4d2f2700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf4806f450 0x7fcf48099ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4d2f2700 1 -- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf480aedb0 msgr2=0x7fcf480cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4d2f2700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf480aedb0 0x7fcf480cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4d2f2700 1 -- 172.21.15.31:0/1264183458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c0094f0 con 0x7fcf480b1bf0 2023-10-09T06:21:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf47fff700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf480aedb0 0x7fcf480cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.557+0000 7fcf4d2f2700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf480b1bf0 0x7fcf480ab930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800c490 tx=0x7fcf38007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.558+0000 7fcf44ff9700 1 -- 172.21.15.31:0/1264183458 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38011590 con 0x7fcf480b1bf0 2023-10-09T06:21:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.558+0000 7fcf44ff9700 1 -- 172.21.15.31:0/1264183458 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf38011710 con 0x7fcf480b1bf0 2023-10-09T06:21:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.558+0000 7fcf4ed55700 1 -- 172.21.15.31:0/1264183458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf48158a30 con 0x7fcf480b1bf0 2023-10-09T06:21:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.558+0000 7fcf44ff9700 1 -- 172.21.15.31:0/1264183458 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38011ad0 con 0x7fcf480b1bf0 2023-10-09T06:21:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.558+0000 7fcf4ed55700 1 -- 172.21.15.31:0/1264183458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf480cc920 con 0x7fcf480b1bf0 2023-10-09T06:21:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.558+0000 7fcf4ed55700 1 -- 172.21.15.31:0/1264183458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf481585b0 con 0x7fcf480b1bf0 2023-10-09T06:21:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.559+0000 7fcf44ff9700 1 -- 172.21.15.31:0/1264183458 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf3801b3b0 con 0x7fcf480b1bf0 2023-10-09T06:21:12.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.559+0000 7fcf44ff9700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcf34066f30 0x7fcf340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.560+0000 7fcf44ff9700 1 -- 172.21.15.31:0/1264183458 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf380839e0 con 0x7fcf480b1bf0 2023-10-09T06:21:12.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.560+0000 7fcf4caf1700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcf34066f30 0x7fcf340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.560+0000 7fcf4caf1700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcf34066f30 0x7fcf340693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf400076a0 tx=0x7fcf400098f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:12.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.564+0000 7fcf44ff9700 1 -- 172.21.15.31:0/1264183458 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf481585b0 con 0x7fcf480b1bf0 2023-10-09T06:21:12.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.803+0000 7fcf4ed55700 1 -- 172.21.15.31:0/1264183458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf481585b0 con 0x7fcf480b1bf0 2023-10-09T06:21:12.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.803+0000 7fcf44ff9700 1 -- 172.21.15.31:0/1264183458 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fcf481585b0 con 0x7fcf480b1bf0 2023-10-09T06:21:12.810 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:12.810 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3437172994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3437172994},{"type":"v1","addr":"172.21.15.158:6836","nonce":3437172994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2894447386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2894447386},{"type":"v1","addr":"172.21.15.31:6834","nonce":2894447386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1034055293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1034055293},{"type":"v1","addr":"172.21.15.31:6835","nonce":1034055293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:20:54.080779+0000","modified":"2023-10-09T06:20:57.714511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1189249944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1189249944},{"type":"v1","addr":"172.21.15.158:6837","nonce":1189249944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:21:12.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.806+0000 7fcf4ed55700 1 -- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcf34066f30 msgr2=0x7fcf340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.806+0000 7fcf4ed55700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcf34066f30 0x7fcf340693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf400076a0 tx=0x7fcf400098f0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.806+0000 7fcf4ed55700 1 -- 172.21.15.31:0/1264183458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf480b1bf0 msgr2=0x7fcf480ab930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.806+0000 7fcf4ed55700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf480b1bf0 0x7fcf480ab930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800c490 tx=0x7fcf38007f20 comp rx=0 tx=0).stop 2023-10-09T06:21:12.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.806+0000 7fcf4ed55700 1 -- 172.21.15.31:0/1264183458 shutdown_connections 2023-10-09T06:21:12.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.806+0000 7fcf4ed55700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcf34066f30 0x7fcf340693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.806+0000 7fcf4ed55700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf4806f450 0x7fcf48099ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.806+0000 7fcf4ed55700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf480b1bf0 0x7fcf480ab930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.806+0000 7fcf4ed55700 1 --2- 172.21.15.31:0/1264183458 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf480aedb0 0x7fcf480cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.806+0000 7fcf4ed55700 1 -- 172.21.15.31:0/1264183458 >> 172.21.15.31:0/1264183458 conn(0x7fcf480cd1e0 msgr2=0x7fcf4806ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:12.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.806+0000 7fcf4ed55700 1 -- 172.21.15.31:0/1264183458 shutdown_connections 2023-10-09T06:21:12.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.806+0000 7fcf4ed55700 1 -- 172.21.15.31:0/1264183458 wait complete. 2023-10-09T06:21:12.813 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2023-10-09T06:21:12.818 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:12.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.938+0000 7ff8a723f700 1 Processor -- start 2023-10-09T06:21:12.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.938+0000 7ff8a723f700 1 -- start start 2023-10-09T06:21:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.939+0000 7ff8a723f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff8a00cdab0 0x7ff8a015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.939+0000 7ff8a723f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a00cb7c0 con 0x7ff8a015dda0 2023-10-09T06:21:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.939+0000 7ff8a723f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a015e290 con 0x7ff8a00cd6e0 2023-10-09T06:21:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.939+0000 7ff8a723f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a015e850 con 0x7ff8a00cdab0 2023-10-09T06:21:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.939+0000 7ff8a5a3c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff8a00cdab0 0x7ff8a015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.939+0000 7ff8a6a3e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff8a015dda0 0x7ff8a015cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39116/0 (socket says 172.21.15.31:39116) 2023-10-09T06:21:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.939+0000 7ff8a6a3e700 1 -- 172.21.15.31:0/953761321 learned_addr learned my addr 172.21.15.31:0/953761321 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.939+0000 7ff8a5a3c700 1 -- 172.21.15.31:0/953761321 >> v1:172.21.15.158:6789/0 conn(0x7ff8a00cd6e0 legacy=0x7ff8a00cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.939+0000 7ff8a5a3c700 1 -- 172.21.15.31:0/953761321 >> v1:172.21.15.31:6789/0 conn(0x7ff8a015dda0 legacy=0x7ff8a015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.939+0000 7ff8a5a3c700 1 -- 172.21.15.31:0/953761321 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a015e570 con 0x7ff8a00cdab0 2023-10-09T06:21:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.939+0000 7ff8a5a3c700 1 --2- 172.21.15.31:0/953761321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8a00cdab0 0x7ff8a015d860 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff8940098e0 tx=0x7ff8940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c97055deb6902ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.940+0000 7ff8a523b700 1 -- 172.21.15.31:0/953761321 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894009e80 con 0x7ff8a00cdab0 2023-10-09T06:21:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.940+0000 7ff8a523b700 1 -- 172.21.15.31:0/953761321 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89400b820 con 0x7ff8a00cdab0 2023-10-09T06:21:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.940+0000 7ff8a523b700 1 -- 172.21.15.31:0/953761321 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400bba0 con 0x7ff8a00cdab0 2023-10-09T06:21:12.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.940+0000 7ff8a723f700 1 -- 172.21.15.31:0/953761321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8a00cdab0 msgr2=0x7ff8a015d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.940+0000 7ff8a723f700 1 --2- 172.21.15.31:0/953761321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8a00cdab0 0x7ff8a015d860 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff8940098e0 tx=0x7ff8940091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.940+0000 7ff8a723f700 1 -- 172.21.15.31:0/953761321 shutdown_connections 2023-10-09T06:21:12.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.940+0000 7ff8a723f700 1 --2- 172.21.15.31:0/953761321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8a00cdab0 0x7ff8a015d860 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.940+0000 7ff8a723f700 1 -- 172.21.15.31:0/953761321 >> 172.21.15.31:0/953761321 conn(0x7ff8a0067660 msgr2=0x7ff8a0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:12.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.940+0000 7ff8a723f700 1 -- 172.21.15.31:0/953761321 shutdown_connections 2023-10-09T06:21:12.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.940+0000 7ff8a723f700 1 -- 172.21.15.31:0/953761321 wait complete. 2023-10-09T06:21:12.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.941+0000 7ff8a723f700 1 Processor -- start 2023-10-09T06:21:12.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.941+0000 7ff8a723f700 1 -- start start 2023-10-09T06:21:12.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.942+0000 7ff8a723f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8a00cd6e0 0x7ff8a00b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.942+0000 7ff8a723f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8a00cdab0 0x7ff8a00c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.942+0000 7ff8a723f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff8a015dda0 0x7ff8a0150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.942+0000 7ff8a723f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00cc360 con 0x7ff8a00cdab0 2023-10-09T06:21:12.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.942+0000 7ff8a723f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00c7d20 con 0x7ff8a00cd6e0 2023-10-09T06:21:12.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.942+0000 7ff8a723f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00c7f70 con 0x7ff8a015dda0 2023-10-09T06:21:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.942+0000 7ff8a5a3c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8a00cdab0 0x7ff8a00c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.942+0000 7ff8a5a3c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8a00cdab0 0x7ff8a00c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56398/0 (socket says 172.21.15.31:56398) 2023-10-09T06:21:12.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.942+0000 7ff8a5a3c700 1 -- 172.21.15.31:0/3067672498 learned_addr learned my addr 172.21.15.31:0/3067672498 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:12.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.942+0000 7ff8a623d700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8a00cd6e0 0x7ff8a00b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.942+0000 7ff8a6a3e700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff8a015dda0 0x7ff8a0150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.943+0000 7ff8a5a3c700 1 -- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff8a015dda0 msgr2=0x7ff8a0150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.943+0000 7ff8a5a3c700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff8a015dda0 0x7ff8a0150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.943+0000 7ff8a5a3c700 1 -- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8a00cd6e0 msgr2=0x7ff8a00b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:12.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.943+0000 7ff8a5a3c700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8a00cd6e0 0x7ff8a00b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:12.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.943+0000 7ff8a5a3c700 1 -- 172.21.15.31:0/3067672498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff894009420 con 0x7ff8a00cdab0 2023-10-09T06:21:12.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.943+0000 7ff8a5a3c700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8a00cdab0 0x7ff8a00c9ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff8940030c0 tx=0x7ff894016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:12.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.943+0000 7ff89e7fc700 1 -- 172.21.15.31:0/3067672498 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400ba60 con 0x7ff8a00cdab0 2023-10-09T06:21:12.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.943+0000 7ff89e7fc700 1 -- 172.21.15.31:0/3067672498 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff894020070 con 0x7ff8a00cdab0 2023-10-09T06:21:12.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.943+0000 7ff8a723f700 1 -- 172.21.15.31:0/3067672498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a00c8250 con 0x7ff8a00cdab0 2023-10-09T06:21:12.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.943+0000 7ff89e7fc700 1 -- 172.21.15.31:0/3067672498 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400bbe0 con 0x7ff8a00cdab0 2023-10-09T06:21:12.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.943+0000 7ff8a723f700 1 -- 172.21.15.31:0/3067672498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a00c8810 con 0x7ff8a00cdab0 2023-10-09T06:21:12.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.944+0000 7ff8a723f700 1 -- 172.21.15.31:0/3067672498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a00c8a00 con 0x7ff8a00cdab0 2023-10-09T06:21:12.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.944+0000 7ff89e7fc700 1 -- 172.21.15.31:0/3067672498 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff894022030 con 0x7ff8a00cdab0 2023-10-09T06:21:12.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.945+0000 7ff89e7fc700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff88c066f30 0x7ff88c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:12.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.945+0000 7ff89e7fc700 1 -- 172.21.15.31:0/3067672498 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff894086490 con 0x7ff8a00cdab0 2023-10-09T06:21:12.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.945+0000 7ff8a623d700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff88c066f30 0x7ff88c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:12.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.945+0000 7ff8a623d700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff88c066f30 0x7ff88c0693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff890007fd0 tx=0x7ff8900026a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:12.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:12.949+0000 7ff89e7fc700 1 -- 172.21.15.31:0/3067672498 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff894053700 con 0x7ff8a00cdab0 2023-10-09T06:21:13.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.144+0000 7ff8a723f700 1 -- 172.21.15.31:0/3067672498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8a00c8a00 con 0x7ff8a00cdab0 2023-10-09T06:21:13.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.145+0000 7ff89e7fc700 1 -- 172.21.15.31:0/3067672498 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7ff894056d20 con 0x7ff8a00cdab0 2023-10-09T06:21:13.146 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:13.146 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:55.693313+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:13.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.147+0000 7ff8a723f700 1 -- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff88c066f30 msgr2=0x7ff88c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:13.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.147+0000 7ff8a723f700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff88c066f30 0x7ff88c0693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff890007fd0 tx=0x7ff8900026a0 comp rx=0 tx=0).stop 2023-10-09T06:21:13.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.147+0000 7ff8a723f700 1 -- 172.21.15.31:0/3067672498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8a00cdab0 msgr2=0x7ff8a00c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:13.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.147+0000 7ff8a723f700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8a00cdab0 0x7ff8a00c9ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff8940030c0 tx=0x7ff894016000 comp rx=0 tx=0).stop 2023-10-09T06:21:13.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.147+0000 7ff8a723f700 1 -- 172.21.15.31:0/3067672498 shutdown_connections 2023-10-09T06:21:13.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.147+0000 7ff8a723f700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff88c066f30 0x7ff88c0693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:13.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.147+0000 7ff8a723f700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff8a015dda0 0x7ff8a0150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:13.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.147+0000 7ff8a723f700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8a00cd6e0 0x7ff8a00b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:13.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.147+0000 7ff8a723f700 1 --2- 172.21.15.31:0/3067672498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8a00cdab0 0x7ff8a00c9ac0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:13.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.147+0000 7ff8a723f700 1 -- 172.21.15.31:0/3067672498 >> 172.21.15.31:0/3067672498 conn(0x7ff8a0067660 msgr2=0x7ff8a015c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:13.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.147+0000 7ff8a723f700 1 -- 172.21.15.31:0/3067672498 shutdown_connections 2023-10-09T06:21:13.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.147+0000 7ff8a723f700 1 -- 172.21.15.31:0/3067672498 wait complete. 2023-10-09T06:21:13.159 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:21:13.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.279+0000 7f6b2d0fd700 1 Processor -- start 2023-10-09T06:21:13.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.279+0000 7f6b2d0fd700 1 -- start start 2023-10-09T06:21:13.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b2d0fd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b280cd6e0 0x7f6b280cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:13.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b2d0fd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b280cb7c0 con 0x7f6b280cdab0 2023-10-09T06:21:13.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b2d0fd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2815e290 con 0x7f6b2815cbd0 2023-10-09T06:21:13.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b2d0fd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2815e850 con 0x7f6b280cd6e0 2023-10-09T06:21:13.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b277fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6b280cdab0 0x7f6b2815d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39128/0 (socket says 172.21.15.31:39128) 2023-10-09T06:21:13.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b277fe700 1 -- 172.21.15.31:0/1004877267 learned_addr learned my addr 172.21.15.31:0/1004877267 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:13.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b27fff700 1 --2- 172.21.15.31:0/1004877267 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b280cd6e0 0x7f6b280cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:13.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b26ffd700 1 -- 172.21.15.31:0/1004877267 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127620048 0 0) 0x7f6b280cb7c0 con 0x7f6b280cdab0 2023-10-09T06:21:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b26ffd700 1 -- 172.21.15.31:0/1004877267 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b14003570 con 0x7f6b280cdab0 2023-10-09T06:21:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b26ffd700 1 -- 172.21.15.31:0/1004877267 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416466098 0 0) 0x7f6b2815e290 con 0x7f6b2815cbd0 2023-10-09T06:21:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b26ffd700 1 -- 172.21.15.31:0/1004877267 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b280cb7c0 con 0x7f6b2815cbd0 2023-10-09T06:21:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b27fff700 1 -- 172.21.15.31:0/1004877267 >> v1:172.21.15.158:6789/0 conn(0x7f6b2815cbd0 legacy=0x7f6b2815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b27fff700 1 -- 172.21.15.31:0/1004877267 >> v1:172.21.15.31:6789/0 conn(0x7f6b280cdab0 legacy=0x7f6b2815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.280+0000 7f6b27fff700 1 -- 172.21.15.31:0/1004877267 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2815e570 con 0x7f6b280cd6e0 2023-10-09T06:21:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.281+0000 7f6b27fff700 1 --2- 172.21.15.31:0/1004877267 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b280cd6e0 0x7f6b280cbc50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009910 tx=0x7f6b100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35131ad49e4138aa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.281+0000 7f6b26ffd700 1 -- 172.21.15.31:0/1004877267 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10011630 con 0x7f6b280cd6e0 2023-10-09T06:21:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.281+0000 7f6b26ffd700 1 -- 172.21.15.31:0/1004877267 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b10011790 con 0x7f6b280cd6e0 2023-10-09T06:21:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.281+0000 7f6b26ffd700 1 -- 172.21.15.31:0/1004877267 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10011b30 con 0x7f6b280cd6e0 2023-10-09T06:21:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.281+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/1004877267 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b280cd6e0 msgr2=0x7f6b280cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.281+0000 7f6b2d0fd700 1 --2- 172.21.15.31:0/1004877267 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b280cd6e0 0x7f6b280cbc50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009910 tx=0x7f6b100091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.281+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/1004877267 shutdown_connections 2023-10-09T06:21:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.281+0000 7f6b2d0fd700 1 --2- 172.21.15.31:0/1004877267 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b280cd6e0 0x7f6b280cbc50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.281+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/1004877267 >> 172.21.15.31:0/1004877267 conn(0x7f6b28067660 msgr2=0x7f6b28067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.281+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/1004877267 shutdown_connections 2023-10-09T06:21:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.281+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/1004877267 wait complete. 2023-10-09T06:21:13.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.283+0000 7f6b2d0fd700 1 Processor -- start 2023-10-09T06:21:13.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.283+0000 7f6b2d0fd700 1 -- start start 2023-10-09T06:21:13.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.283+0000 7f6b2d0fd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b280cd6e0 0x7f6b280b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:13.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.283+0000 7f6b2d0fd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b280cdab0 0x7f6b281537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:13.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.283+0000 7f6b2d0fd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b2815cbd0 0x7f6b280b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:13.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.283+0000 7f6b2d0fd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b28151380 con 0x7f6b280cd6e0 2023-10-09T06:21:13.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.283+0000 7f6b2d0fd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2814d0b0 con 0x7f6b280cdab0 2023-10-09T06:21:13.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.283+0000 7f6b2d0fd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b28151510 con 0x7f6b2815cbd0 2023-10-09T06:21:13.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.283+0000 7f6b27fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b280cd6e0 0x7f6b280b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:13.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b27fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b280cd6e0 0x7f6b280b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56408/0 (socket says 172.21.15.31:56408) 2023-10-09T06:21:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b27fff700 1 -- 172.21.15.31:0/3473428422 learned_addr learned my addr 172.21.15.31:0/3473428422 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b277fe700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b280cdab0 0x7f6b281537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b2c8fc700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b2815cbd0 0x7f6b280b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b27fff700 1 -- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b2815cbd0 msgr2=0x7f6b280b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b27fff700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b2815cbd0 0x7f6b280b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b27fff700 1 -- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b280cdab0 msgr2=0x7f6b281537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b27fff700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b280cdab0 0x7f6b281537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b27fff700 1 -- 172.21.15.31:0/3473428422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b10009420 con 0x7f6b280cd6e0 2023-10-09T06:21:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b277fe700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b280cdab0 0x7f6b281537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b2c8fc700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b2815cbd0 0x7f6b280b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b27fff700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b280cd6e0 0x7f6b280b4420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009f00 tx=0x7f6b10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b1ffff700 1 -- 172.21.15.31:0/3473428422 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1001f070 con 0x7f6b280cd6e0 2023-10-09T06:21:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b1ffff700 1 -- 172.21.15.31:0/3473428422 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b10000bc0 con 0x7f6b280cd6e0 2023-10-09T06:21:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/3473428422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b280b6550 con 0x7f6b280cd6e0 2023-10-09T06:21:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b1ffff700 1 -- 172.21.15.31:0/3473428422 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10025420 con 0x7f6b280cd6e0 2023-10-09T06:21:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.284+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/3473428422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b280b4ce0 con 0x7f6b280cd6e0 2023-10-09T06:21:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.285+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/3473428422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b280c7870 con 0x7f6b280cd6e0 2023-10-09T06:21:13.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.286+0000 7f6b1ffff700 1 -- 172.21.15.31:0/3473428422 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b10023070 con 0x7f6b280cd6e0 2023-10-09T06:21:13.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.286+0000 7f6b1ffff700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b08066f30 0x7f6b080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:13.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.286+0000 7f6b1ffff700 1 -- 172.21.15.31:0/3473428422 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b100858f0 con 0x7f6b280cd6e0 2023-10-09T06:21:13.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.286+0000 7f6b277fe700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b08066f30 0x7f6b080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:13.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.287+0000 7f6b277fe700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b08066f30 0x7f6b080693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b281507b0 tx=0x7f6b18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:13.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.290+0000 7f6b1ffff700 1 -- 172.21.15.31:0/3473428422 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b10052b60 con 0x7f6b280cd6e0 2023-10-09T06:21:13.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.529+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/3473428422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b2804bb80 con 0x7f6b280cd6e0 2023-10-09T06:21:13.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.530+0000 7f6b1ffff700 1 -- 172.21.15.31:0/3473428422 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f6b1002a090 con 0x7f6b280cd6e0 2023-10-09T06:21:13.530 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:13.530 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3437172994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3437172994},{"type":"v1","addr":"172.21.15.158:6836","nonce":3437172994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2894447386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2894447386},{"type":"v1","addr":"172.21.15.31:6834","nonce":2894447386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1034055293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1034055293},{"type":"v1","addr":"172.21.15.31:6835","nonce":1034055293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:20:54.080779+0000","modified":"2023-10-09T06:20:57.714511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1189249944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1189249944},{"type":"v1","addr":"172.21.15.158:6837","nonce":1189249944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:21:13.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.532+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b08066f30 msgr2=0x7f6b080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:13.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.532+0000 7f6b2d0fd700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b08066f30 0x7f6b080693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b281507b0 tx=0x7f6b18009040 comp rx=0 tx=0).stop 2023-10-09T06:21:13.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.532+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/3473428422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b280cd6e0 msgr2=0x7f6b280b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:13.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.532+0000 7f6b2d0fd700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b280cd6e0 0x7f6b280b4420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009f00 tx=0x7f6b10017000 comp rx=0 tx=0).stop 2023-10-09T06:21:13.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.532+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/3473428422 shutdown_connections 2023-10-09T06:21:13.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.532+0000 7f6b2d0fd700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b08066f30 0x7f6b080693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:13.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.532+0000 7f6b2d0fd700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b2815cbd0 0x7f6b280b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:13.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.532+0000 7f6b2d0fd700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b280cd6e0 0x7f6b280b4420 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:13.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.532+0000 7f6b2d0fd700 1 --2- 172.21.15.31:0/3473428422 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b280cdab0 0x7f6b281537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:13.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.532+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/3473428422 >> 172.21.15.31:0/3473428422 conn(0x7f6b28067660 msgr2=0x7f6b280cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:13.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.532+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/3473428422 shutdown_connections 2023-10-09T06:21:13.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:13.532+0000 7f6b2d0fd700 1 -- 172.21.15.31:0/3473428422 wait complete. 2023-10-09T06:21:13.533 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2023-10-09T06:21:13.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:20:54.080779+0000', 'modified': '2023-10-09T06:20:57.714511+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.158:6837/1189249944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6835', 'nonce': 1189249944}, {'type': 'v1', 'addr': '172.21.15.158:6837', 'nonce': 1189249944}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:21:13.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:21:13.947 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-09T06:21:14.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.073+0000 7f3812e6e700 1 Processor -- start 2023-10-09T06:21:14.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.073+0000 7f3812e6e700 1 -- start start 2023-10-09T06:21:14.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.074+0000 7f3812e6e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f380c15a170 0x7f380c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.074+0000 7f3812e6e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380c0694a0 con 0x7f380c159da0 2023-10-09T06:21:14.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.074+0000 7f3812e6e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380c15ea70 con 0x7f380c069040 2023-10-09T06:21:14.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.074+0000 7f3812e6e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f380c0b34b0 con 0x7f380c15a170 2023-10-09T06:21:14.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.074+0000 7f3811e6c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f380c159da0 0x7f380c0b2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39140/0 (socket says 172.21.15.31:39140) 2023-10-09T06:21:14.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.074+0000 7f3811e6c700 1 -- 172.21.15.31:0/1435994199 learned_addr learned my addr 172.21.15.31:0/1435994199 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:14.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.074+0000 7f381166b700 1 --2- 172.21.15.31:0/1435994199 >> v2:172.21.15.158:3300/0 conn(0x7f380c15a170 0x7f380c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.074+0000 7f3810e6a700 1 -- 172.21.15.31:0/1435994199 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895968081 0 0) 0x7f37fc001110 con 0x7f380c159da0 2023-10-09T06:21:14.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.074+0000 7f3810e6a700 1 -- 172.21.15.31:0/1435994199 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37f4003570 con 0x7f380c159da0 2023-10-09T06:21:14.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.075+0000 7f3810e6a700 1 -- 172.21.15.31:0/1435994199 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2082038534 0 0) 0x7f37f4003570 con 0x7f380c159da0 2023-10-09T06:21:14.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.075+0000 7f381166b700 1 -- 172.21.15.31:0/1435994199 >> v1:172.21.15.158:6789/0 conn(0x7f380c069040 legacy=0x7f380c0af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.075+0000 7f381166b700 1 -- 172.21.15.31:0/1435994199 >> v1:172.21.15.31:6789/0 conn(0x7f380c159da0 legacy=0x7f380c0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.075+0000 7f381166b700 1 -- 172.21.15.31:0/1435994199 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c0b3990 con 0x7f380c15a170 2023-10-09T06:21:14.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.075+0000 7f381166b700 1 --2- 172.21.15.31:0/1435994199 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f380c15a170 0x7f380c068b00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38000098e0 tx=0x7f38000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5cab118a53971d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:14.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.075+0000 7f3810e6a700 1 -- 172.21.15.31:0/1435994199 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc001600 con 0x7f380c15a170 2023-10-09T06:21:14.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.075+0000 7f3810e6a700 1 -- 172.21.15.31:0/1435994199 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3800011420 con 0x7f380c15a170 2023-10-09T06:21:14.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.075+0000 7f3810e6a700 1 -- 172.21.15.31:0/1435994199 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38000117c0 con 0x7f380c15a170 2023-10-09T06:21:14.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.075+0000 7f3812e6e700 1 -- 172.21.15.31:0/1435994199 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f380c15a170 msgr2=0x7f380c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.075+0000 7f3812e6e700 1 --2- 172.21.15.31:0/1435994199 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f380c15a170 0x7f380c068b00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38000098e0 tx=0x7f38000091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.076+0000 7f3812e6e700 1 -- 172.21.15.31:0/1435994199 shutdown_connections 2023-10-09T06:21:14.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.076+0000 7f3812e6e700 1 --2- 172.21.15.31:0/1435994199 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f380c15a170 0x7f380c068b00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.076+0000 7f3812e6e700 1 -- 172.21.15.31:0/1435994199 >> 172.21.15.31:0/1435994199 conn(0x7f380c0d0bc0 msgr2=0x7f380c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:14.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.076+0000 7f3812e6e700 1 -- 172.21.15.31:0/1435994199 shutdown_connections 2023-10-09T06:21:14.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.076+0000 7f3812e6e700 1 -- 172.21.15.31:0/1435994199 wait complete. 2023-10-09T06:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.077+0000 7f3812e6e700 1 Processor -- start 2023-10-09T06:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.077+0000 7f3812e6e700 1 -- start start 2023-10-09T06:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.077+0000 7f3812e6e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f380c069040 0x7f380c0c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.077+0000 7f3812e6e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f380c159da0 0x7f380c0b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.077+0000 7f3812e6e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f380c15a170 0x7f380c0b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.077+0000 7f3812e6e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c158a50 con 0x7f380c069040 2023-10-09T06:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.077+0000 7f3812e6e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0c78c0 con 0x7f380c159da0 2023-10-09T06:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.077+0000 7f3812e6e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0c6dd0 con 0x7f380c15a170 2023-10-09T06:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3811e6c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f380c069040 0x7f380c0c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3811e6c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f380c069040 0x7f380c0c4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56410/0 (socket says 172.21.15.31:56410) 2023-10-09T06:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3811e6c700 1 -- 172.21.15.31:0/1526140097 learned_addr learned my addr 172.21.15.31:0/1526140097 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f381166b700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f380c159da0 0x7f380c0b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f381266d700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f380c15a170 0x7f380c0b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3811e6c700 1 -- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f380c15a170 msgr2=0x7f380c0b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3811e6c700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f380c15a170 0x7f380c0b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3811e6c700 1 -- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f380c159da0 msgr2=0x7f380c0b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3811e6c700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f380c159da0 0x7f380c0b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3811e6c700 1 -- 172.21.15.31:0/1526140097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3800009420 con 0x7f380c069040 2023-10-09T06:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f381166b700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f380c159da0 0x7f380c0b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3811e6c700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f380c069040 0x7f380c0c4620 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00cb90 tx=0x7f37fc001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3809ffb700 1 -- 172.21.15.31:0/1526140097 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc007360 con 0x7f380c069040 2023-10-09T06:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3809ffb700 1 -- 172.21.15.31:0/1526140097 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37fc0074e0 con 0x7f380c069040 2023-10-09T06:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3812e6e700 1 -- 172.21.15.31:0/1526140097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c147250 con 0x7f380c069040 2023-10-09T06:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3809ffb700 1 -- 172.21.15.31:0/1526140097 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc004830 con 0x7f380c069040 2023-10-09T06:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.078+0000 7f3812e6e700 1 -- 172.21.15.31:0/1526140097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380c0c7300 con 0x7f380c069040 2023-10-09T06:21:14.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.080+0000 7f3809ffb700 1 -- 172.21.15.31:0/1526140097 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37fc004bc0 con 0x7f380c069040 2023-10-09T06:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.081+0000 7f3809ffb700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f37f8066f30 0x7f37f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.081+0000 7f3809ffb700 1 -- 172.21.15.31:0/1526140097 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f37fc083c30 con 0x7f380c069040 2023-10-09T06:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.081+0000 7f381166b700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f37f8066f30 0x7f37f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.081+0000 7f381166b700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f37f8066f30 0x7f37f80693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38000030c0 tx=0x7f3800017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.082+0000 7f381d3c8b80 1 Processor -- start 2023-10-09T06:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.082+0000 7f381d3c8b80 1 -- start start 2023-10-09T06:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381d3c8b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c993480 0x55a81c9727d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381d3c8b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c9465f0 0x55a81c993850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381d3c8b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 0x55a81c948ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381d3c8b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81c89fa70 con 0x55a81c948b80 2023-10-09T06:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381d3c8b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81c89d270 con 0x55a81c9465f0 2023-10-09T06:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381d3c8b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a81c899060 con 0x55a81c993480 2023-10-09T06:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381266d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 0x55a81c948ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381266d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 0x55a81c948ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56412/0 (socket says 172.21.15.31:56412) 2023-10-09T06:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381266d700 1 -- 172.21.15.31:0/2953783525 learned_addr learned my addr 172.21.15.31:0/2953783525 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381166b700 1 --2- 172.21.15.31:0/2953783525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c9465f0 0x55a81c993850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f3811e6c700 1 --2- 172.21.15.31:0/2953783525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c993480 0x55a81c9727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381266d700 1 -- 172.21.15.31:0/2953783525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c993480 msgr2=0x55a81c9727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381266d700 1 --2- 172.21.15.31:0/2953783525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c993480 0x55a81c9727d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381266d700 1 -- 172.21.15.31:0/2953783525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c9465f0 msgr2=0x55a81c993850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381266d700 1 --2- 172.21.15.31:0/2953783525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c9465f0 0x55a81c993850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.083+0000 7f381266d700 1 -- 172.21.15.31:0/2953783525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a81c733270 con 0x55a81c948b80 2023-10-09T06:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.084+0000 7f381266d700 1 --2- 172.21.15.31:0/2953783525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 0x55a81c948ff0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3804003df0 tx=0x7f3804009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bff72230f48e35 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:14.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.084+0000 7f37f2ffd700 1 -- 172.21.15.31:0/2953783525 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040032e0 con 0x55a81c948b80 2023-10-09T06:21:14.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.084+0000 7f37f2ffd700 1 -- 172.21.15.31:0/2953783525 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3804003460 con 0x55a81c948b80 2023-10-09T06:21:14.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.084+0000 7f37f2ffd700 1 -- 172.21.15.31:0/2953783525 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380400e8a0 con 0x55a81c948b80 2023-10-09T06:21:14.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.084+0000 7f381d3c8b80 1 -- 172.21.15.31:0/2953783525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 msgr2=0x55a81c948ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.084+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/2953783525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 0x55a81c948ff0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3804003df0 tx=0x7f3804009040 comp rx=0 tx=0).stop 2023-10-09T06:21:14.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.084+0000 7f381d3c8b80 1 -- 172.21.15.31:0/2953783525 shutdown_connections 2023-10-09T06:21:14.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.084+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/2953783525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c993480 0x55a81c9727d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.084+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/2953783525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 0x55a81c948ff0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.084+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/2953783525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c9465f0 0x55a81c993850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.084+0000 7f381d3c8b80 1 -- 172.21.15.31:0/2953783525 >> 172.21.15.31:0/2953783525 conn(0x55a81c94a0c0 msgr2=0x55a81c94a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:14.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.084+0000 7f381d3c8b80 1 -- 172.21.15.31:0/2953783525 shutdown_connections 2023-10-09T06:21:14.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.084+0000 7f381d3c8b80 1 -- 172.21.15.31:0/2953783525 wait complete. 2023-10-09T06:21:14.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.085+0000 7f381d3c8b80 1 -- start start 2023-10-09T06:21:14.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.085+0000 7f381d3c8b80 1 Processor -- start 2023-10-09T06:21:14.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381d3c8b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c9465f0 0x55a81c98f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381d3c8b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 0x55a81c9775d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381d3c8b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c993480 0x55a81c990770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381d3c8b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81c844890 con 0x55a81c948b80 2023-10-09T06:21:14.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381d3c8b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81c85fea0 con 0x55a81c9465f0 2023-10-09T06:21:14.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381d3c8b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a81c71be30 con 0x55a81c993480 2023-10-09T06:21:14.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381d3c8b80 10 client.0 _ll_register_callbacks cb 0x55a81c90c2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:21:14.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381166b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 0x55a81c9775d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381166b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 0x55a81c9775d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56422/0 (socket says 172.21.15.31:56422) 2023-10-09T06:21:14.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381166b700 1 -- 172.21.15.31:0/26458786 learned_addr learned my addr 172.21.15.31:0/26458786 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:14.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f3811e6c700 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c9465f0 0x55a81c98f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381266d700 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c993480 0x55a81c990770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381166b700 1 -- 172.21.15.31:0/26458786 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c993480 msgr2=0x55a81c990770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:14.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381166b700 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c993480 0x55a81c990770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381166b700 1 -- 172.21.15.31:0/26458786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c9465f0 msgr2=0x55a81c98f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:14.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381166b700 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c9465f0 0x55a81c98f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381166b700 1 -- 172.21.15.31:0/26458786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380400f040 con 0x55a81c948b80 2023-10-09T06:21:14.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f3811e6c700 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c9465f0 0x55a81c98f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:14.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f381166b700 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 0x55a81c9775d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3800000e50 tx=0x7f3800020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3d40f541f42f26 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:14.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.086+0000 7f37ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:21:14.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f37ebfff700 1 -- 172.21.15.31:0/26458786 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380001ea20 con 0x55a81c948b80 2023-10-09T06:21:14.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f37ebfff700 1 -- 172.21.15.31:0/26458786 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3800031070 con 0x55a81c948b80 2023-10-09T06:21:14.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f381d3c8b80 1 -- 172.21.15.31:0/26458786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a81c93dcd0 con 0x55a81c948b80 2023-10-09T06:21:14.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f37ebfff700 1 -- 172.21.15.31:0/26458786 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f380001ed90 con 0x55a81c948b80 2023-10-09T06:21:14.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f381d3c8b80 10 client.4653 fetch_fsmap learned FSMap version 8 2023-10-09T06:21:14.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f381d3c8b80 1 -- 172.21.15.31:0/26458786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a81c6d5fe0 con 0x55a81c948b80 2023-10-09T06:21:14.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f37ebfff700 1 -- 172.21.15.31:0/26458786 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a81c93dcd0 con 0x55a81c948b80 2023-10-09T06:21:14.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f37ebfff700 1 -- 172.21.15.31:0/26458786 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3800035430 con 0x55a81c948b80 2023-10-09T06:21:14.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f381d3c8b80 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2023-10-09T06:21:14.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f381d3c8b80 10 client.4653 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T06:21:14.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f381d3c8b80 20 client.4653 populate_metadata read hostname 'smithi031' 2023-10-09T06:21:14.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.158:6835/1189249944,v1:172.21.15.158:6837/1189249944] conn(0x55a81c96ca40 0x55a81c96ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f381d3c8b80 4 client.4653 mds_command: new command op to 4273 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:21:14.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f381d3c8b80 1 -- 172.21.15.31:0/26458786 --> [v2:172.21.15.158:6835/1189249944,v1:172.21.15.158:6837/1189249944] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a81c91aaa0 con 0x55a81c96ca40 2023-10-09T06:21:14.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.087+0000 7f3811e6c700 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.158:6835/1189249944,v1:172.21.15.158:6837/1189249944] conn(0x55a81c96ca40 0x55a81c96ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f37ebfff700 10 client.4653 ms_handle_connect on v2:172.21.15.158:6835/1189249944 2023-10-09T06:21:14.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f3811e6c700 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.158:6835/1189249944,v1:172.21.15.158:6837/1189249944] conn(0x55a81c96ca40 0x55a81c96ce10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7998092a72a52ac1 server_cookie=f492b796c65f23a8 in_seq=0 out_seq=0 2023-10-09T06:21:14.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f37ebfff700 1 -- 172.21.15.31:0/26458786 <== mds.0 v2:172.21.15.158:6835/1189249944 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a81c91aaa0 con 0x55a81c96ca40 2023-10-09T06:21:14.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f37ebfff700 10 client.4653 handle_command_reply: tid=0 2023-10-09T06:21:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f381d3c8b80 1 client.4653 shutdown 2023-10-09T06:21:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f381d3c8b80 1 -- 172.21.15.31:0/26458786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 msgr2=0x55a81c9775d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 0x55a81c9775d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3800000e50 tx=0x7f3800020070 comp rx=0 tx=0).stop 2023-10-09T06:21:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f381d3c8b80 1 -- 172.21.15.31:0/26458786 shutdown_connections 2023-10-09T06:21:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c993480 0x55a81c990770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.158:6835/1189249944,v1:172.21.15.158:6837/1189249944] conn(0x55a81c96ca40 0x55a81c96ce10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c9465f0 0x55a81c98f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f37ebfff700 0 client.4653 ms_handle_reset on v2:172.21.15.158:6835/1189249944 2023-10-09T06:21:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/26458786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c948b80 0x55a81c9775d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.088+0000 7f381d3c8b80 1 -- 172.21.15.31:0/26458786 >> 172.21.15.31:0/26458786 conn(0x55a81c94a0c0 msgr2=0x55a81c944e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.089+0000 7f381d3c8b80 1 -- 172.21.15.31:0/26458786 shutdown_connections 2023-10-09T06:21:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.089+0000 7f381d3c8b80 1 -- 172.21.15.31:0/26458786 wait complete. 2023-10-09T06:21:14.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.089+0000 7f381d3c8b80 20 client.4653 trim_cache size 0 max 16384 2023-10-09T06:21:14.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.105+0000 7f381d3c8b80 1 Processor -- start 2023-10-09T06:21:14.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.106+0000 7f381d3c8b80 1 -- start start 2023-10-09T06:21:14.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.106+0000 7f381d3c8b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c94a0c0 0x55a81c98ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.106+0000 7f381d3c8b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c9465f0 0x55a81c948f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.106+0000 7f381d3c8b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c948b80 0x55a81c949490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.106+0000 7f381d3c8b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81c98f780 con 0x55a81c9465f0 2023-10-09T06:21:14.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.106+0000 7f381d3c8b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81c9489c0 con 0x55a81c94a0c0 2023-10-09T06:21:14.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.106+0000 7f381d3c8b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a81c9b1c80 con 0x55a81c948b80 2023-10-09T06:21:14.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.106+0000 7f381166b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c9465f0 0x55a81c948f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f381166b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c9465f0 0x55a81c948f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56430/0 (socket says 172.21.15.31:56430) 2023-10-09T06:21:14.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f381166b700 1 -- 172.21.15.31:0/1546127106 learned_addr learned my addr 172.21.15.31:0/1546127106 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:14.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f381266d700 1 --2- 172.21.15.31:0/1546127106 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c948b80 0x55a81c949490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f3811e6c700 1 --2- 172.21.15.31:0/1546127106 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c94a0c0 0x55a81c98ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f381166b700 1 -- 172.21.15.31:0/1546127106 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c948b80 msgr2=0x55a81c949490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:14.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f381166b700 1 --2- 172.21.15.31:0/1546127106 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c948b80 0x55a81c949490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f381166b700 1 -- 172.21.15.31:0/1546127106 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c94a0c0 msgr2=0x55a81c98ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:14.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f381166b700 1 --2- 172.21.15.31:0/1546127106 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c94a0c0 0x55a81c98ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f381166b700 1 -- 172.21.15.31:0/1546127106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a81c867780 con 0x55a81c9465f0 2023-10-09T06:21:14.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f381166b700 1 --2- 172.21.15.31:0/1546127106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c9465f0 0x55a81c948f50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f380001e7e0 tx=0x7f380002d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3ea4f8ec8ae17e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:14.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f37f37fe700 1 -- 172.21.15.31:0/1546127106 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380001ea20 con 0x55a81c9465f0 2023-10-09T06:21:14.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f37f37fe700 1 -- 172.21.15.31:0/1546127106 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380002f070 con 0x55a81c9465f0 2023-10-09T06:21:14.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f37f37fe700 1 -- 172.21.15.31:0/1546127106 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380001e4f0 con 0x55a81c9465f0 2023-10-09T06:21:14.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f381d3c8b80 1 -- 172.21.15.31:0/1546127106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c9465f0 msgr2=0x55a81c948f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.107+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/1546127106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c9465f0 0x55a81c948f50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f380001e7e0 tx=0x7f380002d070 comp rx=0 tx=0).stop 2023-10-09T06:21:14.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.108+0000 7f381d3c8b80 1 -- 172.21.15.31:0/1546127106 shutdown_connections 2023-10-09T06:21:14.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.108+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/1546127106 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c948b80 0x55a81c949490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.108+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/1546127106 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c94a0c0 0x55a81c98ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.108+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/1546127106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c9465f0 0x55a81c948f50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.108+0000 7f381d3c8b80 1 -- 172.21.15.31:0/1546127106 >> 172.21.15.31:0/1546127106 conn(0x55a81c973e30 msgr2=0x55a81c972fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:14.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.108+0000 7f381d3c8b80 1 -- 172.21.15.31:0/1546127106 shutdown_connections 2023-10-09T06:21:14.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.108+0000 7f381d3c8b80 1 -- 172.21.15.31:0/1546127106 wait complete. 2023-10-09T06:21:14.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.108+0000 7f381d3c8b80 1 -- start start 2023-10-09T06:21:14.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.108+0000 7f381d3c8b80 1 Processor -- start 2023-10-09T06:21:14.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.109+0000 7f381d3c8b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c9465f0 0x55a81c9ef220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.109+0000 7f381d3c8b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c948b80 0x55a81c96ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.109+0000 7f381d3c8b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c94a0c0 0x55a81c9f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.109+0000 7f381d3c8b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81c9a91d0 con 0x55a81c94a0c0 2023-10-09T06:21:14.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.109+0000 7f381d3c8b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81c96d900 con 0x55a81c948b80 2023-10-09T06:21:14.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.109+0000 7f381d3c8b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a81c991380 con 0x55a81c9465f0 2023-10-09T06:21:14.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.109+0000 7f381d3c8b80 10 client.0 _ll_register_callbacks cb 0x55a81c90c2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:21:14.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.109+0000 7f381266d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c94a0c0 0x55a81c9f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.109+0000 7f381266d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c94a0c0 0x55a81c9f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56440/0 (socket says 172.21.15.31:56440) 2023-10-09T06:21:14.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.109+0000 7f381266d700 1 -- 172.21.15.31:0/2755557370 learned_addr learned my addr 172.21.15.31:0/2755557370 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:14.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.109+0000 7f381166b700 1 --2- 172.21.15.31:0/2755557370 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c948b80 0x55a81c96ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.109+0000 7f3811e6c700 1 --2- 172.21.15.31:0/2755557370 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c9465f0 0x55a81c9ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381266d700 1 -- 172.21.15.31:0/2755557370 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c9465f0 msgr2=0x55a81c9ef220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:14.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381266d700 1 --2- 172.21.15.31:0/2755557370 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c9465f0 0x55a81c9ef220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381266d700 1 -- 172.21.15.31:0/2755557370 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c948b80 msgr2=0x55a81c96ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:14.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381266d700 1 --2- 172.21.15.31:0/2755557370 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c948b80 0x55a81c96ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381266d700 1 -- 172.21.15.31:0/2755557370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a81c6d5fe0 con 0x55a81c94a0c0 2023-10-09T06:21:14.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381266d700 1 --2- 172.21.15.31:0/2755557370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c94a0c0 0x55a81c9f5ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f380400e440 tx=0x7f3804019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7892240fa2b4608c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:14.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f37ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:21:14.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f37ebfff700 1 -- 172.21.15.31:0/2755557370 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380400ee60 con 0x55a81c94a0c0 2023-10-09T06:21:14.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f37ebfff700 1 -- 172.21.15.31:0/2755557370 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f380400e650 con 0x55a81c94a0c0 2023-10-09T06:21:14.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381d3c8b80 1 -- 172.21.15.31:0/2755557370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3804003460 con 0x55a81c94a0c0 2023-10-09T06:21:14.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f37ebfff700 1 -- 172.21.15.31:0/2755557370 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38040015f0 con 0x55a81c94a0c0 2023-10-09T06:21:14.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381d3c8b80 10 client.4659 fetch_fsmap learned FSMap version 8 2023-10-09T06:21:14.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381d3c8b80 1 -- 172.21.15.31:0/2755557370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a81c84e470 con 0x55a81c94a0c0 2023-10-09T06:21:14.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f37ebfff700 1 -- 172.21.15.31:0/2755557370 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3804003460 con 0x55a81c94a0c0 2023-10-09T06:21:14.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f37ebfff700 1 -- 172.21.15.31:0/2755557370 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3804001750 con 0x55a81c94a0c0 2023-10-09T06:21:14.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381d3c8b80 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2023-10-09T06:21:14.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381d3c8b80 10 client.4659 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T06:21:14.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381d3c8b80 20 client.4659 populate_metadata read hostname 'smithi031' 2023-10-09T06:21:14.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/2755557370 >> [v2:172.21.15.158:6835/1189249944,v1:172.21.15.158:6837/1189249944] conn(0x55a81c993480 0x55a81c98ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381d3c8b80 4 client.4659 mds_command: new command op to 4273 tid=0[{"prefix": "status"}] 2023-10-09T06:21:14.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f381d3c8b80 1 -- 172.21.15.31:0/2755557370 --> [v2:172.21.15.158:6835/1189249944,v1:172.21.15.158:6837/1189249944] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a81c83be00 con 0x55a81c993480 2023-10-09T06:21:14.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.110+0000 7f3811e6c700 1 --2- 172.21.15.31:0/2755557370 >> [v2:172.21.15.158:6835/1189249944,v1:172.21.15.158:6837/1189249944] conn(0x55a81c993480 0x55a81c98ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f3811e6c700 1 --2- 172.21.15.31:0/2755557370 >> [v2:172.21.15.158:6835/1189249944,v1:172.21.15.158:6837/1189249944] conn(0x55a81c993480 0x55a81c98ed40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a1767ef04f3b480 server_cookie=8d6747613963a1a0 in_seq=0 out_seq=0 2023-10-09T06:21:14.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f37ebfff700 10 client.4659 ms_handle_connect on v2:172.21.15.158:6835/1189249944 2023-10-09T06:21:14.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f37ebfff700 1 -- 172.21.15.31:0/2755557370 <== mds.0 v2:172.21.15.158:6835/1189249944 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55a81c83be00 con 0x55a81c993480 2023-10-09T06:21:14.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f37ebfff700 10 client.4659 handle_command_reply: tid=0 2023-10-09T06:21:14.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f381d3c8b80 1 client.4659 shutdown 2023-10-09T06:21:14.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f381d3c8b80 1 -- 172.21.15.31:0/2755557370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c94a0c0 msgr2=0x55a81c9f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/2755557370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c94a0c0 0x55a81c9f5ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f380400e440 tx=0x7f3804019000 comp rx=0 tx=0).stop 2023-10-09T06:21:14.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f381d3c8b80 1 -- 172.21.15.31:0/2755557370 shutdown_connections 2023-10-09T06:21:14.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/2755557370 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55a81c9465f0 0x55a81c9ef220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/2755557370 >> [v2:172.21.15.158:6835/1189249944,v1:172.21.15.158:6837/1189249944] conn(0x55a81c993480 0x55a81c98ed40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/2755557370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a81c94a0c0 0x55a81c9f5ab0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f381d3c8b80 1 --2- 172.21.15.31:0/2755557370 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a81c948b80 0x55a81c96ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f37ebfff700 0 client.4659 ms_handle_reset on v2:172.21.15.158:6835/1189249944 2023-10-09T06:21:14.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f381d3c8b80 1 -- 172.21.15.31:0/2755557370 >> 172.21.15.31:0/2755557370 conn(0x55a81c973e30 msgr2=0x55a81c948f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:14.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f381d3c8b80 1 -- 172.21.15.31:0/2755557370 shutdown_connections 2023-10-09T06:21:14.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f381d3c8b80 1 -- 172.21.15.31:0/2755557370 wait complete. 2023-10-09T06:21:14.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.111+0000 7f381d3c8b80 20 client.4659 trim_cache size 0 max 16384 2023-10-09T06:21:14.118 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:21:14.118 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:21:14.118 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-10-09T06:21:14.118 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4273, 2023-10-09T06:21:14.118 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-10-09T06:21:14.118 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-10-09T06:21:14.118 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-10-09T06:21:14.119 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 19.400619450000001, 2023-10-09T06:21:14.119 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 8, 2023-10-09T06:21:14.119 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 20, 2023-10-09T06:21:14.119 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 20, 2023-10-09T06:21:14.119 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 26.243787518000001 2023-10-09T06:21:14.119 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:21:14.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.112+0000 7f3812e6e700 1 -- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f37f8066f30 msgr2=0x7f37f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.112+0000 7f3812e6e700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f37f8066f30 0x7f37f80693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38000030c0 tx=0x7f3800017000 comp rx=0 tx=0).stop 2023-10-09T06:21:14.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.112+0000 7f3812e6e700 1 -- 172.21.15.31:0/1526140097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f380c069040 msgr2=0x7f380c0c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.112+0000 7f3812e6e700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f380c069040 0x7f380c0c4620 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00cb90 tx=0x7f37fc001070 comp rx=0 tx=0).stop 2023-10-09T06:21:14.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.112+0000 7f3812e6e700 1 -- 172.21.15.31:0/1526140097 shutdown_connections 2023-10-09T06:21:14.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.112+0000 7f3812e6e700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f37f8066f30 0x7f37f80693e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.112+0000 7f3812e6e700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f380c15a170 0x7f380c0b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.112+0000 7f3812e6e700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f380c069040 0x7f380c0c4620 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.112+0000 7f3812e6e700 1 --2- 172.21.15.31:0/1526140097 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f380c159da0 0x7f380c0b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.112+0000 7f3812e6e700 1 -- 172.21.15.31:0/1526140097 >> 172.21.15.31:0/1526140097 conn(0x7f380c0d0bc0 msgr2=0x7f380c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:14.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.112+0000 7f3812e6e700 1 -- 172.21.15.31:0/1526140097 shutdown_connections 2023-10-09T06:21:14.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.112+0000 7f3812e6e700 1 -- 172.21.15.31:0/1526140097 wait complete. 2023-10-09T06:21:14.123 INFO:teuthology.run_tasks:Running task kclient... 2023-10-09T06:21:14.144 INFO:tasks.kclient:Mounting kernel clients... 2023-10-09T06:21:14.144 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-09T06:21:14.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:14.144 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:21:14.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:14.161 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2023-10-09T06:21:14.228 INFO:teuthology.orchestra.run.smithi031.stderr:Cannot find device "ceph-brx" 2023-10-09T06:21:14.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:21:14.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:14.230 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:21:14.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:14.284 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2023-10-09T06:21:14.350 INFO:teuthology.orchestra.run.smithi031.stderr:Cannot find device "ceph-brx" 2023-10-09T06:21:14.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:21:14.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:14.351 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:21:14.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:14.369 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-10-09T06:21:14.443 INFO:teuthology.orchestra.run.smithi158.stderr:Cannot find device "ceph-brx" 2023-10-09T06:21:14.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:21:14.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:14.445 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:21:14.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:14.502 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-10-09T06:21:14.571 INFO:teuthology.orchestra.run.smithi158.stderr:Cannot find device "ceph-brx" 2023-10-09T06:21:14.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:21:14.574 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-09T06:21:14.575 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:21:14.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.696+0000 7ff89053b700 1 Processor -- start 2023-10-09T06:21:14.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.696+0000 7ff89053b700 1 -- start start 2023-10-09T06:21:14.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff89053b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff888157c40 0x7ff888158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff89053b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff88815cbb0 con 0x7ff88815a620 2023-10-09T06:21:14.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff89053b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff88815bfa0 con 0x7ff888157870 2023-10-09T06:21:14.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff89053b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88815bdb0 con 0x7ff888157c40 2023-10-09T06:21:14.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88dad6700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff88815a620 0x7ff88815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39152/0 (socket says 172.21.15.31:39152) 2023-10-09T06:21:14.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88dad6700 1 -- 172.21.15.31:0/3438534305 learned_addr learned my addr 172.21.15.31:0/3438534305 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526534637 0 0) 0x7ff88815cbb0 con 0x7ff88815a620 2023-10-09T06:21:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88ead8700 1 --2- 172.21.15.31:0/3438534305 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff888157c40 0x7ff888158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff874003570 con 0x7ff88815a620 2023-10-09T06:21:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3173982021 0 0) 0x7ff874003570 con 0x7ff88815a620 2023-10-09T06:21:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff888157c40 msgr2=0x7ff888158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88d2d5700 1 --2- 172.21.15.31:0/3438534305 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff888157c40 0x7ff888158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 >> v1:172.21.15.158:6789/0 conn(0x7ff888157870 legacy=0x7ff88815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88815c280 con 0x7ff88815a620 2023-10-09T06:21:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7ff878001470 con 0x7ff88815a620 2023-10-09T06:21:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 >> v1:172.21.15.31:6789/0 conn(0x7ff88815a620 legacy=0x7ff88815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88d2d5700 1 --2- 172.21.15.31:0/3438534305 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff874003a90 0x7ff874003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88d2d5700 1 --2- 172.21.15.31:0/3438534305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff874004810 0x7ff874004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88d2d5700 1 --2- 172.21.15.31:0/3438534305 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff888157c40 0x7ff8740051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.697+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87400bb30 con 0x7ff874004810 2023-10-09T06:21:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87400bca0 con 0x7ff874003a90 2023-10-09T06:21:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87400be60 con 0x7ff888157c40 2023-10-09T06:21:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88dad6700 1 --2- 172.21.15.31:0/3438534305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff874004810 0x7ff874004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88e2d7700 1 --2- 172.21.15.31:0/3438534305 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff874003a90 0x7ff874003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88ead8700 1 --2- 172.21.15.31:0/3438534305 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff888157c40 0x7ff8740051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88dad6700 1 -- 172.21.15.31:0/3438534305 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff888157c40 msgr2=0x7ff8740051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88dad6700 1 --2- 172.21.15.31:0/3438534305 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff888157c40 0x7ff8740051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88dad6700 1 -- 172.21.15.31:0/3438534305 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff874003a90 msgr2=0x7ff874003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:14.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88dad6700 1 --2- 172.21.15.31:0/3438534305 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff874003a90 0x7ff874003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88dad6700 1 -- 172.21.15.31:0/3438534305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff874003570 con 0x7ff874004810 2023-10-09T06:21:14.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88dad6700 1 --2- 172.21.15.31:0/3438534305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff874004810 0x7ff874004c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff87800c390 tx=0x7ff878001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786ff19418fc5490 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:14.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87800cc60 con 0x7ff874004810 2023-10-09T06:21:14.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87800cdc0 con 0x7ff874004810 2023-10-09T06:21:14.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.698+0000 7ff88d2d5700 1 -- 172.21.15.31:0/3438534305 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff878005b50 con 0x7ff874004810 2023-10-09T06:21:14.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.699+0000 7ff89053b700 1 -- 172.21.15.31:0/3438534305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff874004810 msgr2=0x7ff874004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.699+0000 7ff89053b700 1 --2- 172.21.15.31:0/3438534305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff874004810 0x7ff874004c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff87800c390 tx=0x7ff878001e50 comp rx=0 tx=0).stop 2023-10-09T06:21:14.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.699+0000 7ff88ead8700 1 -- 172.21.15.31:0/3438534305 reap_dead start 2023-10-09T06:21:14.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.699+0000 7ff89053b700 1 -- 172.21.15.31:0/3438534305 shutdown_connections 2023-10-09T06:21:14.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.699+0000 7ff89053b700 1 -- 172.21.15.31:0/3438534305 >> 172.21.15.31:0/3438534305 conn(0x7ff888068ce0 msgr2=0x7ff8880690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:14.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.699+0000 7ff89053b700 1 -- 172.21.15.31:0/3438534305 shutdown_connections 2023-10-09T06:21:14.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.699+0000 7ff89053b700 1 -- 172.21.15.31:0/3438534305 wait complete. 2023-10-09T06:21:14.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.700+0000 7ff89053b700 1 Processor -- start 2023-10-09T06:21:14.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.700+0000 7ff89053b700 1 -- start start 2023-10-09T06:21:14.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff89053b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff874004810 0x7ff888156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff89053b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8880a7fd0 0x7ff8880aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff89053b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8880a91c0 0x7ff8880a9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff89053b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8881566b0 con 0x7ff8880a7fd0 2023-10-09T06:21:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff89053b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880a9b80 con 0x7ff8880a91c0 2023-10-09T06:21:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff89053b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88815d4e0 con 0x7ff874004810 2023-10-09T06:21:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff88dad6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8880a7fd0 0x7ff8880aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff88dad6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8880a7fd0 0x7ff8880aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56448/0 (socket says 172.21.15.31:56448) 2023-10-09T06:21:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff88dad6700 1 -- 172.21.15.31:0/1205562278 learned_addr learned my addr 172.21.15.31:0/1205562278 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff88ead8700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8880a91c0 0x7ff8880a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff88e2d7700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff874004810 0x7ff888156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff88dad6700 1 -- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff874004810 msgr2=0x7ff888156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff88dad6700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff874004810 0x7ff888156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff88dad6700 1 -- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8880a91c0 msgr2=0x7ff8880a9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff88dad6700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8880a91c0 0x7ff8880a9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff88dad6700 1 -- 172.21.15.31:0/1205562278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880a84b0 con 0x7ff8880a7fd0 2023-10-09T06:21:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff88e2d7700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff874004810 0x7ff888156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff88ead8700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8880a91c0 0x7ff8880a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff88dad6700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8880a7fd0 0x7ff8880aee10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff878001760 tx=0x7ff878015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.701+0000 7ff87e7fc700 1 -- 172.21.15.31:0/1205562278 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87800cc60 con 0x7ff8880a7fd0 2023-10-09T06:21:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.702+0000 7ff87e7fc700 1 -- 172.21.15.31:0/1205562278 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8780072e0 con 0x7ff8880a7fd0 2023-10-09T06:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.702+0000 7ff89053b700 1 -- 172.21.15.31:0/1205562278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8880a8790 con 0x7ff8880a7fd0 2023-10-09T06:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.702+0000 7ff87e7fc700 1 -- 172.21.15.31:0/1205562278 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff878007680 con 0x7ff8880a7fd0 2023-10-09T06:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.702+0000 7ff89053b700 1 -- 172.21.15.31:0/1205562278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88815d730 con 0x7ff8880a7fd0 2023-10-09T06:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.702+0000 7ff89053b700 1 -- 172.21.15.31:0/1205562278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff88804c3c0 con 0x7ff8880a7fd0 2023-10-09T06:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.703+0000 7ff87e7fc700 1 -- 172.21.15.31:0/1205562278 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff878019030 con 0x7ff8880a7fd0 2023-10-09T06:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.703+0000 7ff87e7fc700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff86c066f30 0x7ff86c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.703+0000 7ff87e7fc700 1 -- 172.21.15.31:0/1205562278 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff8780858c0 con 0x7ff8880a7fd0 2023-10-09T06:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.703+0000 7ff88e2d7700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff86c066f30 0x7ff86c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.704+0000 7ff88e2d7700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff86c066f30 0x7ff86c0693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff884007bc0 tx=0x7ff884009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.708+0000 7ff87e7fc700 1 -- 172.21.15.31:0/1205562278 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff878052b30 con 0x7ff8880a7fd0 2023-10-09T06:21:14.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.947+0000 7ff89053b700 1 -- 172.21.15.31:0/1205562278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff88815c560 con 0x7ff8880a7fd0 2023-10-09T06:21:14.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.947+0000 7ff87e7fc700 1 -- 172.21.15.31:0/1205562278 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff87802b020 con 0x7ff8880a7fd0 2023-10-09T06:21:14.947 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:21:14.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.949+0000 7ff89053b700 1 -- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff86c066f30 msgr2=0x7ff86c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.949+0000 7ff89053b700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff86c066f30 0x7ff86c0693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff884007bc0 tx=0x7ff884009040 comp rx=0 tx=0).stop 2023-10-09T06:21:14.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.949+0000 7ff89053b700 1 -- 172.21.15.31:0/1205562278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8880a7fd0 msgr2=0x7ff8880aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:14.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.949+0000 7ff89053b700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8880a7fd0 0x7ff8880aee10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff878001760 tx=0x7ff878015000 comp rx=0 tx=0).stop 2023-10-09T06:21:14.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.949+0000 7ff89053b700 1 -- 172.21.15.31:0/1205562278 shutdown_connections 2023-10-09T06:21:14.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.949+0000 7ff89053b700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff86c066f30 0x7ff86c0693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.949+0000 7ff89053b700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff874004810 0x7ff888156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.949+0000 7ff89053b700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8880a91c0 0x7ff8880a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.949+0000 7ff89053b700 1 --2- 172.21.15.31:0/1205562278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8880a7fd0 0x7ff8880aee10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:14.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.949+0000 7ff89053b700 1 -- 172.21.15.31:0/1205562278 >> 172.21.15.31:0/1205562278 conn(0x7ff888068ce0 msgr2=0x7ff8880b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:14.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.949+0000 7ff89053b700 1 -- 172.21.15.31:0/1205562278 shutdown_connections 2023-10-09T06:21:14.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:14.949+0000 7ff89053b700 1 -- 172.21.15.31:0/1205562278 wait complete. 2023-10-09T06:21:14.961 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T06:21:14.961 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:21:14.961 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-10-09T06:21:14.961 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:21:14.961 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:21:14.961 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T06:21:14.961 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T06:21:14.961 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:21:14.961 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:21:14.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:14.962 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-10-09T06:21:14.977 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:21:14.977 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:21:14.977 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:21:14.977 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:14.977 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:21:14.977 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:14.978 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:14.978 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:14.978 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-10-09T06:21:14.978 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:14.978 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:14.978 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-10-09T06:21:14.978 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:21:14.978 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:14.978 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-10-09T06:21:14.978 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T06:21:14.978 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42492sec preferred_lft 42492sec 2023-10-09T06:21:14.978 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-10-09T06:21:14.979 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:14.979 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:14.979 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:14.979 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-10-09T06:21:14.979 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-09T06:21:14.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:14.979 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:21:14.980 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:21:14.980 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add name ceph-brx type bridge 2023-10-09T06:21:14.980 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr flush dev ceph-brx 2023-10-09T06:21:14.980 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set ceph-brx up 2023-10-09T06:21:14.980 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-09T06:21:14.980 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:21:15.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:15.140 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:21:15.187 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-10-09T06:21:15.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:15.189 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-10-09T06:21:15.222 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-10-09T06:21:15.222 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:21:15.222 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T06:21:15.222 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T06:21:15.222 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:21:15.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:15.223 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:21:15.223 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:21:15.223 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T06:21:15.223 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T06:21:15.223 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T06:21:15.223 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:21:15.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:15.464 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:21:15.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:15.480 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2023-10-09T06:21:15.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:15.534 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:21:15.534 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:21:15.534 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:21:15.534 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-09T06:21:15.534 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:21:15.625 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-09T06:21:15.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:15.625 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:21:15.626 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:21:15.626 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-09T06:21:15.626 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-09T06:21:15.626 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-09T06:21:15.626 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-09T06:21:15.626 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-09T06:21:15.626 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:21:15.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:15.826 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:21:15.826 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:21:15.826 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-10-09T06:21:15.826 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.0 master ceph-brx 2023-10-09T06:21:15.826 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:21:15.920 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:21:15.920 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:21:15.935 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:21:15.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:21:15.935 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:21:15.990 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:21:15.990 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:21:15.990 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:16.077 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:16.077 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:16.166 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:16.166 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:16.167 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:21:16.167 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:21:16.167 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:21:16.167 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:21:16.167 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:21:16.167 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:21:16.188 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:16.189 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:16.189 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:21:16.189 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:21:16.189 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:21:16.189 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:21:16.189 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:21:16.189 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:21:16.189 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:21:16.189 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:21:16.189 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:21:16.191 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:21:16.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:16.192 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:21:16.218 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-09T06:21:16.218 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:21:16.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.377+0000 7fa4675dd700 1 Processor -- start 2023-10-09T06:21:16.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.378+0000 7fa4675dd700 1 -- start start 2023-10-09T06:21:16.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.378+0000 7fa4675dd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4600afff0 0x7fa46015e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:16.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.378+0000 7fa4675dd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa460069e20 0x7fa46006a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:16.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.378+0000 7fa4675dd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa460070700 0x7fa460070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:16.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.378+0000 7fa4675dd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4600710c0 con 0x7fa460069e20 2023-10-09T06:21:16.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.378+0000 7fa4675dd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4600b03c0 con 0x7fa460070700 2023-10-09T06:21:16.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.378+0000 7fa4675dd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46006a870 con 0x7fa4600afff0 2023-10-09T06:21:16.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa464b78700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa460069e20 0x7fa46006a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:16.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa464b78700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa460069e20 0x7fa46006a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56454/0 (socket says 172.21.15.31:56454) 2023-10-09T06:21:16.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa464b78700 1 -- 172.21.15.31:0/39275334 learned_addr learned my addr 172.21.15.31:0/39275334 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:16.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa465379700 1 --2- 172.21.15.31:0/39275334 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4600afff0 0x7fa46015e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:16.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa465b7a700 1 --2- 172.21.15.31:0/39275334 >> v2:172.21.15.158:3300/0 conn(0x7fa460070700 0x7fa460070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:16.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa464b78700 1 -- 172.21.15.31:0/39275334 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4600afff0 msgr2=0x7fa46015e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:16.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa464b78700 1 --2- 172.21.15.31:0/39275334 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4600afff0 0x7fa46015e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:16.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa464b78700 1 -- 172.21.15.31:0/39275334 >> v2:172.21.15.158:3300/0 conn(0x7fa460070700 msgr2=0x7fa460070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:16.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa464b78700 1 --2- 172.21.15.31:0/39275334 >> v2:172.21.15.158:3300/0 conn(0x7fa460070700 0x7fa460070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:16.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa464b78700 1 -- 172.21.15.31:0/39275334 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46006ab50 con 0x7fa460069e20 2023-10-09T06:21:16.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa464b78700 1 --2- 172.21.15.31:0/39275334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa460069e20 0x7fa46006a290 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa4600c4a90 tx=0x7fa454009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b81721010ca7cac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:16.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa45ffff700 1 -- 172.21.15.31:0/39275334 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45400b860 con 0x7fa460069e20 2023-10-09T06:21:16.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa45ffff700 1 -- 172.21.15.31:0/39275334 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45400b9c0 con 0x7fa460069e20 2023-10-09T06:21:16.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.379+0000 7fa45ffff700 1 -- 172.21.15.31:0/39275334 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45400bd60 con 0x7fa460069e20 2023-10-09T06:21:16.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.380+0000 7fa4675dd700 1 -- 172.21.15.31:0/39275334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa460069e20 msgr2=0x7fa46006a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:16.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.380+0000 7fa4675dd700 1 --2- 172.21.15.31:0/39275334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa460069e20 0x7fa46006a290 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa4600c4a90 tx=0x7fa454009250 comp rx=0 tx=0).stop 2023-10-09T06:21:16.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.380+0000 7fa4675dd700 1 -- 172.21.15.31:0/39275334 shutdown_connections 2023-10-09T06:21:16.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.380+0000 7fa4675dd700 1 --2- 172.21.15.31:0/39275334 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4600afff0 0x7fa46015e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:16.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.380+0000 7fa4675dd700 1 --2- 172.21.15.31:0/39275334 >> v2:172.21.15.158:3300/0 conn(0x7fa460070700 0x7fa460070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:16.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.380+0000 7fa4675dd700 1 --2- 172.21.15.31:0/39275334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa460069e20 0x7fa46006a290 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:16.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.380+0000 7fa4675dd700 1 -- 172.21.15.31:0/39275334 >> 172.21.15.31:0/39275334 conn(0x7fa4600cda50 msgr2=0x7fa4600cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:16.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.380+0000 7fa4675dd700 1 -- 172.21.15.31:0/39275334 shutdown_connections 2023-10-09T06:21:16.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.380+0000 7fa4675dd700 1 -- 172.21.15.31:0/39275334 wait complete. 2023-10-09T06:21:16.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.381+0000 7fa4675dd700 1 Processor -- start 2023-10-09T06:21:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.381+0000 7fa4675dd700 1 -- start start 2023-10-09T06:21:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa4675dd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa460069e20 0x7fa460157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa4675dd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa460070700 0x7fa4600b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa4675dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4600afff0 0x7fa46015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa4675dd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600b1a80 con 0x7fa4600afff0 2023-10-09T06:21:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa4675dd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600b0e70 con 0x7fa460069e20 2023-10-09T06:21:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa4675dd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600b1150 con 0x7fa460070700 2023-10-09T06:21:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa465b7a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4600afff0 0x7fa46015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa465b7a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4600afff0 0x7fa46015abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56460/0 (socket says 172.21.15.31:56460) 2023-10-09T06:21:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa465b7a700 1 -- 172.21.15.31:0/3013232555 learned_addr learned my addr 172.21.15.31:0/3013232555 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa464b78700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa460070700 0x7fa4600b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa465379700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa460069e20 0x7fa460157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa465b7a700 1 -- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa460070700 msgr2=0x7fa4600b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa465b7a700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa460070700 0x7fa4600b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa465b7a700 1 -- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa460069e20 msgr2=0x7fa460157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa465b7a700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa460069e20 0x7fa460157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa465b7a700 1 -- 172.21.15.31:0/3013232555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4540094f0 con 0x7fa4600afff0 2023-10-09T06:21:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.382+0000 7fa465b7a700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4600afff0 0x7fa46015abe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa450009fa0 tx=0x7fa450009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.383+0000 7fa45d7fa700 1 -- 172.21.15.31:0/3013232555 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000ed20 con 0x7fa4600afff0 2023-10-09T06:21:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.383+0000 7fa45d7fa700 1 -- 172.21.15.31:0/3013232555 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45000ee80 con 0x7fa4600afff0 2023-10-09T06:21:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.383+0000 7fa4675dd700 1 -- 172.21.15.31:0/3013232555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4600b1430 con 0x7fa4600afff0 2023-10-09T06:21:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.383+0000 7fa45d7fa700 1 -- 172.21.15.31:0/3013232555 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450014670 con 0x7fa4600afff0 2023-10-09T06:21:16.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.383+0000 7fa4675dd700 1 -- 172.21.15.31:0/3013232555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4600b2450 con 0x7fa4600afff0 2023-10-09T06:21:16.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.383+0000 7fa4675dd700 1 -- 172.21.15.31:0/3013232555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4600b3930 con 0x7fa4600afff0 2023-10-09T06:21:16.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.384+0000 7fa45d7fa700 1 -- 172.21.15.31:0/3013232555 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4500149e0 con 0x7fa4600afff0 2023-10-09T06:21:16.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.384+0000 7fa45d7fa700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa44c066f30 0x7fa44c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:16.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.384+0000 7fa45d7fa700 1 -- 172.21.15.31:0/3013232555 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa450084d20 con 0x7fa4600afff0 2023-10-09T06:21:16.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.384+0000 7fa465379700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa44c066f30 0x7fa44c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:16.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.385+0000 7fa465379700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa44c066f30 0x7fa44c0693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa458006fd0 tx=0x7fa458008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:16.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.388+0000 7fa45d7fa700 1 -- 172.21.15.31:0/3013232555 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa450051f90 con 0x7fa4600afff0 2023-10-09T06:21:16.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.627+0000 7fa4675dd700 1 -- 172.21.15.31:0/3013232555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa46004c3c0 con 0x7fa4600afff0 2023-10-09T06:21:16.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.627+0000 7fa45d7fa700 1 -- 172.21.15.31:0/3013232555 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa4500555b0 con 0x7fa4600afff0 2023-10-09T06:21:16.627 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:21:16.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.629+0000 7fa4675dd700 1 -- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa44c066f30 msgr2=0x7fa44c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:16.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.629+0000 7fa4675dd700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa44c066f30 0x7fa44c0693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa458006fd0 tx=0x7fa458008040 comp rx=0 tx=0).stop 2023-10-09T06:21:16.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.629+0000 7fa4675dd700 1 -- 172.21.15.31:0/3013232555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4600afff0 msgr2=0x7fa46015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:16.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.629+0000 7fa4675dd700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4600afff0 0x7fa46015abe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa450009fa0 tx=0x7fa450009900 comp rx=0 tx=0).stop 2023-10-09T06:21:16.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.629+0000 7fa4675dd700 1 -- 172.21.15.31:0/3013232555 shutdown_connections 2023-10-09T06:21:16.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.629+0000 7fa4675dd700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa44c066f30 0x7fa44c0693e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:16.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.629+0000 7fa4675dd700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4600afff0 0x7fa46015abe0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:16.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.629+0000 7fa4675dd700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa460069e20 0x7fa460157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:16.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.629+0000 7fa4675dd700 1 --2- 172.21.15.31:0/3013232555 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa460070700 0x7fa4600b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:16.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.629+0000 7fa4675dd700 1 -- 172.21.15.31:0/3013232555 >> 172.21.15.31:0/3013232555 conn(0x7fa4600cda50 msgr2=0x7fa46006eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:16.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.629+0000 7fa4675dd700 1 -- 172.21.15.31:0/3013232555 shutdown_connections 2023-10-09T06:21:16.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:16.629+0000 7fa4675dd700 1 -- 172.21.15.31:0/3013232555 wait complete. 2023-10-09T06:21:16.641 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T06:21:16.641 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:21:16.641 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-10-09T06:21:16.641 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-09T06:21:16.641 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-09T06:21:16.641 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T06:21:16.641 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T06:21:16.641 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:21:16.641 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-09T06:21:16.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:16.642 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-10-09T06:21:16.657 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:21:16.657 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:21:16.657 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:21:16.657 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:16.657 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:21:16.657 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:16.658 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:16.658 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-10-09T06:21:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:16.658 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:16.658 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-10-09T06:21:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:21:16.658 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:16.658 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-10-09T06:21:16.658 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T06:21:16.659 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42490sec preferred_lft 42490sec 2023-10-09T06:21:16.659 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-10-09T06:21:16.659 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:16.659 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:16.659 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-10-09T06:21:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:21:16.659 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether f6:bf:b8:0f:49:8b brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:16.659 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:21:16.659 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:16.659 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::b4ad:53ff:fed3:a589/64 scope link tentative 2023-10-09T06:21:16.660 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:16.660 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:21:16.660 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether f6:bf:b8:0f:49:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:21:16.660 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::f4bf:b8ff:fe0f:498b/64 scope link tentative 2023-10-09T06:21:16.660 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:16.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:16.660 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:21:16.721 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-10-09T06:21:16.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:16.723 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-10-09T06:21:16.779 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-10-09T06:21:16.780 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:21:16.780 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T06:21:16.780 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T06:21:16.780 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:21:16.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:16.780 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:21:16.780 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:21:16.780 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T06:21:16.781 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T06:21:16.781 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T06:21:16.781 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:21:16.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:16.882 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:21:16.897 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:21:16.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:16.898 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2023-10-09T06:21:16.953 INFO:teuthology.orchestra.run.smithi031.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-09T06:21:16.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:16.954 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:21:16.954 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:21:16.954 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:21:16.954 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-09T06:21:16.954 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:21:17.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:17.043 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-09T06:21:17.082 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:21:17.082 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:21:17.082 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:21:17.083 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:17.083 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:21:17.083 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:17.083 INFO:teuthology.orchestra.run.smithi031.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:21:17.083 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 36:3a:f9:ad:7f:d6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T06:21:17.083 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T06:21:17.083 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:17.083 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::343a:f9ff:fead:7fd6/64 scope link 2023-10-09T06:21:17.083 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:17.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:17.095 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-09T06:21:17.173 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:21:17.173 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:21:17.173 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:21:17.173 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:21:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:17.174 INFO:teuthology.orchestra.run.smithi031.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:21:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 36:3a:f9:ad:7f:d6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T06:21:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T06:21:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::343a:f9ff:fead:7fd6/64 scope link 2023-10-09T06:21:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:17.188 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-09T06:21:17.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:17.189 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:21:17.189 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:21:17.189 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-09T06:21:17.189 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-09T06:21:17.189 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-09T06:21:17.189 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-09T06:21:17.189 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-09T06:21:17.189 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:21:17.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:17.409 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:21:17.410 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:21:17.410 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.1 up 2023-10-09T06:21:17.410 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.1 master ceph-brx 2023-10-09T06:21:17.410 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:21:17.493 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:21:17.493 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-09T06:21:17.508 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-09T06:21:17.508 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:21:17.508 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-09T06:21:17.562 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-09T06:21:17.563 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:21:17.563 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:17.643 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:17.643 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:17.662 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:17.662 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:17.662 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:21:17.662 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 2@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:21:17.662 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:21:17.663 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:21:17.663 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:21:17.663 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:21:17.684 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:17.684 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:17.684 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:21:17.685 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 2@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:21:17.685 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:21:17.685 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:21:17.685 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:21:17.685 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:21:17.685 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:21:17.685 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:21:17.686 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:21:17.687 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:21:17.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:17.687 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-09T06:21:17.752 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-09T06:21:17.753 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:21:17.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.911+0000 7f271f142700 1 Processor -- start 2023-10-09T06:21:17.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.911+0000 7f271f142700 1 -- start start 2023-10-09T06:21:17.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.912+0000 7f271f142700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2718152010 0x7f271815b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:17.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.912+0000 7f271f142700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f27181523e0 0x7f271806c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:17.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.912+0000 7f271f142700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271806c010 con 0x7f2718158e50 2023-10-09T06:21:17.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.912+0000 7f271f142700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271806bd10 con 0x7f27181523e0 2023-10-09T06:21:17.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.912+0000 7f271f142700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271815c060 con 0x7f2718152010 2023-10-09T06:21:17.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.912+0000 7f2717fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f27181523e0 0x7f271806c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:17.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.912+0000 7f2717fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f27181523e0 0x7f271806c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56472/0 (socket says 172.21.15.31:56472) 2023-10-09T06:21:17.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.912+0000 7f2717fff700 1 -- 172.21.15.31:0/1329399390 learned_addr learned my addr 172.21.15.31:0/1329399390 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:17.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f271cede700 1 --2- 172.21.15.31:0/1329399390 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2718152010 0x7f271815b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:17.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f2717fff700 1 -- 172.21.15.31:0/1329399390 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2718152010 msgr2=0x7f271815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:17.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f2717fff700 1 --2- 172.21.15.31:0/1329399390 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2718152010 0x7f271815b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:17.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f2717fff700 1 -- 172.21.15.31:0/1329399390 >> v1:172.21.15.158:6789/0 conn(0x7f2718158e50 legacy=0x7f27180cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:17.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f2717fff700 1 -- 172.21.15.31:0/1329399390 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271815c340 con 0x7f27181523e0 2023-10-09T06:21:17.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f271cede700 1 --2- 172.21.15.31:0/1329399390 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2718152010 0x7f271815b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:17.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f2717fff700 1 --2- 172.21.15.31:0/1329399390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27181523e0 0x7f271806c4a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2708009f20 tx=0x7f2708009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac491863349e7387 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:17.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f27177fe700 1 -- 172.21.15.31:0/1329399390 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270800e070 con 0x7f27181523e0 2023-10-09T06:21:17.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f27177fe700 1 -- 172.21.15.31:0/1329399390 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270800ba40 con 0x7f27181523e0 2023-10-09T06:21:17.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f27177fe700 1 -- 172.21.15.31:0/1329399390 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080092e0 con 0x7f27181523e0 2023-10-09T06:21:17.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f271f142700 1 -- 172.21.15.31:0/1329399390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27181523e0 msgr2=0x7f271806c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:17.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f271f142700 1 --2- 172.21.15.31:0/1329399390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27181523e0 0x7f271806c4a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2708009f20 tx=0x7f2708009840 comp rx=0 tx=0).stop 2023-10-09T06:21:17.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f271f142700 1 -- 172.21.15.31:0/1329399390 shutdown_connections 2023-10-09T06:21:17.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f271f142700 1 --2- 172.21.15.31:0/1329399390 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2718152010 0x7f271815b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:17.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f271f142700 1 --2- 172.21.15.31:0/1329399390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27181523e0 0x7f271806c4a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:17.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.913+0000 7f271f142700 1 -- 172.21.15.31:0/1329399390 >> 172.21.15.31:0/1329399390 conn(0x7f2718069870 msgr2=0x7f2718069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:17.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.914+0000 7f271f142700 1 -- 172.21.15.31:0/1329399390 shutdown_connections 2023-10-09T06:21:17.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.914+0000 7f271f142700 1 -- 172.21.15.31:0/1329399390 wait complete. 2023-10-09T06:21:17.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.915+0000 7f271f142700 1 Processor -- start 2023-10-09T06:21:17.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.915+0000 7f271f142700 1 -- start start 2023-10-09T06:21:17.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.915+0000 7f271f142700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2718152010 0x7f27180c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:17.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.915+0000 7f271f142700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27181523e0 0x7f2718150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:17.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.915+0000 7f271f142700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2718158e50 0x7f271816b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:17.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.915+0000 7f271f142700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271816c520 con 0x7f2718152010 2023-10-09T06:21:17.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.915+0000 7f271f142700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180b3490 con 0x7f2718158e50 2023-10-09T06:21:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.915+0000 7f271f142700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271816bf60 con 0x7f27181523e0 2023-10-09T06:21:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f271cede700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2718152010 0x7f27180c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f271cede700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2718152010 0x7f27180c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56480/0 (socket says 172.21.15.31:56480) 2023-10-09T06:21:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f271cede700 1 -- 172.21.15.31:0/1350346368 learned_addr learned my addr 172.21.15.31:0/1350346368 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f2717fff700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27181523e0 0x7f2718150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f271d6df700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2718158e50 0x7f271816b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f271cede700 1 -- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27181523e0 msgr2=0x7f2718150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f271cede700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27181523e0 0x7f2718150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f271cede700 1 -- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2718158e50 msgr2=0x7f271816b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f271cede700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2718158e50 0x7f271816b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f271cede700 1 -- 172.21.15.31:0/1350346368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708009ae0 con 0x7f2718152010 2023-10-09T06:21:17.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f271d6df700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2718158e50 0x7f271816b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:17.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f271cede700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2718152010 0x7f27180c5bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f271000c850 tx=0x7f2710008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:17.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f2714ff9700 1 -- 172.21.15.31:0/1350346368 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710011600 con 0x7f2718152010 2023-10-09T06:21:17.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f2714ff9700 1 -- 172.21.15.31:0/1350346368 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710011760 con 0x7f2718152010 2023-10-09T06:21:17.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f271f142700 1 -- 172.21.15.31:0/1350346368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271816c240 con 0x7f2718152010 2023-10-09T06:21:17.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f2714ff9700 1 -- 172.21.15.31:0/1350346368 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710011b00 con 0x7f2718152010 2023-10-09T06:21:17.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.916+0000 7f271f142700 1 -- 172.21.15.31:0/1350346368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271816bb50 con 0x7f2718152010 2023-10-09T06:21:17.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.917+0000 7f271f142700 1 -- 172.21.15.31:0/1350346368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27180b3770 con 0x7f2718152010 2023-10-09T06:21:17.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.918+0000 7f2714ff9700 1 -- 172.21.15.31:0/1350346368 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27100073b0 con 0x7f2718152010 2023-10-09T06:21:17.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.918+0000 7f2714ff9700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26f8066f30 0x7f26f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:17.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.918+0000 7f2714ff9700 1 -- 172.21.15.31:0/1350346368 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2710084530 con 0x7f2718152010 2023-10-09T06:21:17.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.918+0000 7f2717fff700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26f8066f30 0x7f26f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:17.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.919+0000 7f2717fff700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26f8066f30 0x7f26f80693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f27181527f0 tx=0x7f2708017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:17.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:17.922+0000 7f2714ff9700 1 -- 172.21.15.31:0/1350346368 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2710055230 con 0x7f2718152010 2023-10-09T06:21:18.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.161+0000 7f271f142700 1 -- 172.21.15.31:0/1350346368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f271804c3c0 con 0x7f2718152010 2023-10-09T06:21:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.161+0000 7f2714ff9700 1 -- 172.21.15.31:0/1350346368 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2710054dc0 con 0x7f2718152010 2023-10-09T06:21:18.161 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:21:18.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.163+0000 7f271f142700 1 -- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26f8066f30 msgr2=0x7f26f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:18.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.163+0000 7f271f142700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26f8066f30 0x7f26f80693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f27181527f0 tx=0x7f2708017000 comp rx=0 tx=0).stop 2023-10-09T06:21:18.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.163+0000 7f271f142700 1 -- 172.21.15.31:0/1350346368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2718152010 msgr2=0x7f27180c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:18.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.163+0000 7f271f142700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2718152010 0x7f27180c5bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f271000c850 tx=0x7f2710008040 comp rx=0 tx=0).stop 2023-10-09T06:21:18.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.163+0000 7f271f142700 1 -- 172.21.15.31:0/1350346368 shutdown_connections 2023-10-09T06:21:18.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.163+0000 7f271f142700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26f8066f30 0x7f26f80693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:18.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.163+0000 7f271f142700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2718158e50 0x7f271816b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.163+0000 7f271f142700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2718152010 0x7f27180c5bf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.163+0000 7f271f142700 1 --2- 172.21.15.31:0/1350346368 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f27181523e0 0x7f2718150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.163+0000 7f271f142700 1 -- 172.21.15.31:0/1350346368 >> 172.21.15.31:0/1350346368 conn(0x7f2718069870 msgr2=0x7f2718151310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.163+0000 7f271f142700 1 -- 172.21.15.31:0/1350346368 shutdown_connections 2023-10-09T06:21:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:18.163+0000 7f271f142700 1 -- 172.21.15.31:0/1350346368 wait complete. 2023-10-09T06:21:18.174 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T06:21:18.175 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:21:18.175 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-09T06:21:18.175 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T06:21:18.175 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T06:21:18.175 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T06:21:18.175 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T06:21:18.175 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:21:18.175 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:21:18.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:18.175 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-09T06:21:18.194 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:21:18.194 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:21:18.194 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:21:18.194 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:18.194 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:21:18.194 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:18.194 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:18.194 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:18.194 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-09T06:21:18.194 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:18.195 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:18.195 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-09T06:21:18.195 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:18.195 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:18.195 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:21:18.195 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:18.195 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:21:18.195 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42515sec preferred_lft 42515sec 2023-10-09T06:21:18.195 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-09T06:21:18.195 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:18.195 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-09T06:21:18.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:18.196 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:21:18.196 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:21:18.196 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add name ceph-brx type bridge 2023-10-09T06:21:18.196 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip addr flush dev ceph-brx 2023-10-09T06:21:18.196 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set ceph-brx up 2023-10-09T06:21:18.196 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-09T06:21:18.196 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:21:18.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:18.372 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:21:18.415 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-09T06:21:18.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:18.417 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-09T06:21:18.447 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-09T06:21:18.447 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:21:18.447 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:21:18.447 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:21:18.447 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:21:18.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:18.448 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:21:18.448 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:21:18.448 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:21:18.448 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:21:18.448 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:21:18.449 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:21:18.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:18.693 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:21:18.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:18.708 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list-id 2023-10-09T06:21:18.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:18.763 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:21:18.763 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:21:18.763 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:21:18.763 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-09T06:21:18.764 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:21:18.853 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-09T06:21:18.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:18.853 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:21:18.853 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:21:18.853 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-09T06:21:18.853 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-09T06:21:18.853 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-09T06:21:18.853 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-09T06:21:18.854 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-09T06:21:18.854 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:21:19.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:19.064 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:21:19.064 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:21:19.064 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-09T06:21:19.064 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set dev brx.0 master ceph-brx 2023-10-09T06:21:19.064 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:21:19.156 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:21:19.156 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T06:21:19.170 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:21:19.170 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:21:19.170 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:21:19.224 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T06:21:19.224 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:21:19.224 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:19.312 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:19.312 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:19.402 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:19.403 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:19.403 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:21:19.403 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:21:19.403 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:21:19.403 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:21:19.403 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:21:19.403 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:21:19.424 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:19.424 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:19.424 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:21:19.424 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:21:19.424 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:21:19.424 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:21:19.424 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:21:19.424 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:21:19.424 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:21:19.425 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:21:19.425 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:21:19.426 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:21:19.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:19.426 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:21:19.450 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-09T06:21:19.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:21:19.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.586+0000 7f66a620f700 1 Processor -- start 2023-10-09T06:21:19.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.586+0000 7f66a620f700 1 -- start start 2023-10-09T06:21:19.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.586+0000 7f66a620f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f66a00c75c0 0x7f66a00c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.586+0000 7f66a620f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f66a00abeb0 0x7f66a00c8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.586+0000 7f66a620f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a00c9cb0 con 0x7f66a00abae0 2023-10-09T06:21:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.586+0000 7f66a620f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a00c8e80 con 0x7f66a00c75c0 2023-10-09T06:21:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.586+0000 7f66a620f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a00c90a0 con 0x7f66a00abeb0 2023-10-09T06:21:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f66a00c75c0 0x7f66a00c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f66a00abae0 0x7f66a00c6eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39154/0 (socket says 172.21.15.31:39154) 2023-10-09T06:21:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669f7fe700 1 -- 172.21.15.31:0/2768958898 learned_addr learned my addr 172.21.15.31:0/2768958898 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669ffff700 1 --2- 172.21.15.31:0/2768958898 >> v2:172.21.15.158:3300/0 conn(0x7f66a00abeb0 0x7f66a00c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669effd700 1 -- 172.21.15.31:0/2768958898 >> v2:172.21.15.158:3300/0 conn(0x7f66a00abeb0 msgr2=0x7f66a00c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669effd700 1 --2- 172.21.15.31:0/2768958898 >> v2:172.21.15.158:3300/0 conn(0x7f66a00abeb0 0x7f66a00c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:19.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669effd700 1 -- 172.21.15.31:0/2768958898 >> v1:172.21.15.31:6789/0 conn(0x7f66a00abae0 legacy=0x7f66a00c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:19.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669e7fc700 1 -- 172.21.15.31:0/2768958898 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261992397 0 0) 0x7f66a00c9cb0 con 0x7f66a00abae0 2023-10-09T06:21:19.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669effd700 1 -- 172.21.15.31:0/2768958898 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a00c9380 con 0x7f66a00c75c0 2023-10-09T06:21:19.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669ffff700 1 --2- 172.21.15.31:0/2768958898 >> v2:172.21.15.158:3300/0 conn(0x7f66a00abeb0 0x7f66a00c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:19.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669effd700 1 --2- 172.21.15.31:0/2768958898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00c75c0 0x7f66a00c8400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f66a006ccd0 tx=0x7f66940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1424ced6287ba22c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:19.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669e7fc700 1 -- 172.21.15.31:0/2768958898 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400b6b0 con 0x7f66a00c75c0 2023-10-09T06:21:19.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669e7fc700 1 -- 172.21.15.31:0/2768958898 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400b810 con 0x7f66a00c75c0 2023-10-09T06:21:19.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.587+0000 7f669e7fc700 1 -- 172.21.15.31:0/2768958898 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400bbb0 con 0x7f66a00c75c0 2023-10-09T06:21:19.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.588+0000 7f66a620f700 1 -- 172.21.15.31:0/2768958898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00c75c0 msgr2=0x7f66a00c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:19.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.588+0000 7f66a620f700 1 --2- 172.21.15.31:0/2768958898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00c75c0 0x7f66a00c8400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f66a006ccd0 tx=0x7f66940091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:19.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.588+0000 7f66a620f700 1 -- 172.21.15.31:0/2768958898 shutdown_connections 2023-10-09T06:21:19.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.588+0000 7f66a620f700 1 --2- 172.21.15.31:0/2768958898 >> v2:172.21.15.158:3300/0 conn(0x7f66a00abeb0 0x7f66a00c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.588+0000 7f66a620f700 1 --2- 172.21.15.31:0/2768958898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00c75c0 0x7f66a00c8400 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.588+0000 7f66a620f700 1 -- 172.21.15.31:0/2768958898 >> 172.21.15.31:0/2768958898 conn(0x7f66a0067660 msgr2=0x7f66a0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.588+0000 7f66a620f700 1 -- 172.21.15.31:0/2768958898 shutdown_connections 2023-10-09T06:21:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.588+0000 7f66a620f700 1 -- 172.21.15.31:0/2768958898 wait complete. 2023-10-09T06:21:19.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.589+0000 7f66a620f700 1 Processor -- start 2023-10-09T06:21:19.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.589+0000 7f66a620f700 1 -- start start 2023-10-09T06:21:19.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f66a620f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66a00abae0 0x7f66a00c02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:19.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f66a620f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66a00abeb0 0x7f66a01559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:19.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f66a620f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00c75c0 0x7f66a0155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:19.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f66a620f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a015a270 con 0x7f66a00c75c0 2023-10-09T06:21:19.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f66a620f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00c0830 con 0x7f66a00abeb0 2023-10-09T06:21:19.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f66a620f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00c0ad0 con 0x7f66a00abae0 2023-10-09T06:21:19.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f669ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00c75c0 0x7f66a0155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:19.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f669ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00c75c0 0x7f66a0155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56500/0 (socket says 172.21.15.31:56500) 2023-10-09T06:21:19.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f669ffff700 1 -- 172.21.15.31:0/2530614048 learned_addr learned my addr 172.21.15.31:0/2530614048 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:19.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f669effd700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66a00abeb0 0x7f66a01559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:19.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f669f7fe700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66a00abae0 0x7f66a00c02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:19.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f669ffff700 1 -- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66a00abae0 msgr2=0x7f66a00c02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:19.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f669ffff700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66a00abae0 0x7f66a00c02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:19.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f669ffff700 1 -- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66a00abeb0 msgr2=0x7f66a01559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:19.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f669ffff700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66a00abeb0 0x7f66a01559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:19.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.590+0000 7f669ffff700 1 -- 172.21.15.31:0/2530614048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009420 con 0x7f66a00c75c0 2023-10-09T06:21:19.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.591+0000 7f669ffff700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00c75c0 0x7f66a0155f30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f669800a380 tx=0x7f6698007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:19.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.591+0000 7f66877fe700 1 -- 172.21.15.31:0/2530614048 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698015440 con 0x7f66a00c75c0 2023-10-09T06:21:19.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.591+0000 7f66877fe700 1 -- 172.21.15.31:0/2530614048 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66980155a0 con 0x7f66a00c75c0 2023-10-09T06:21:19.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.591+0000 7f66a620f700 1 -- 172.21.15.31:0/2530614048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a00c0db0 con 0x7f66a00c75c0 2023-10-09T06:21:19.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.591+0000 7f66877fe700 1 -- 172.21.15.31:0/2530614048 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698015960 con 0x7f66a00c75c0 2023-10-09T06:21:19.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.591+0000 7f66a620f700 1 -- 172.21.15.31:0/2530614048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a00c1370 con 0x7f66a00c75c0 2023-10-09T06:21:19.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.592+0000 7f66a620f700 1 -- 172.21.15.31:0/2530614048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a004c3c0 con 0x7f66a00c75c0 2023-10-09T06:21:19.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.592+0000 7f66877fe700 1 -- 172.21.15.31:0/2530614048 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f669800d440 con 0x7f66a00c75c0 2023-10-09T06:21:19.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.593+0000 7f66877fe700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f668c066f30 0x7f668c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:19.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.593+0000 7f66877fe700 1 -- 172.21.15.31:0/2530614048 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6698085010 con 0x7f66a00c75c0 2023-10-09T06:21:19.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.593+0000 7f669f7fe700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f668c066f30 0x7f668c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:19.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.593+0000 7f669f7fe700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f668c066f30 0x7f668c0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f66a0158f80 tx=0x7f6690007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:19.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.597+0000 7f66877fe700 1 -- 172.21.15.31:0/2530614048 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6698052280 con 0x7f66a00c75c0 2023-10-09T06:21:19.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.836+0000 7f66a620f700 1 -- 172.21.15.31:0/2530614048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f66a006aeb0 con 0x7f66a00c75c0 2023-10-09T06:21:19.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.836+0000 7f66877fe700 1 -- 172.21.15.31:0/2530614048 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f66980558a0 con 0x7f66a00c75c0 2023-10-09T06:21:19.836 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:21:19.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.839+0000 7f66a620f700 1 -- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f668c066f30 msgr2=0x7f668c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:19.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.839+0000 7f66a620f700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f668c066f30 0x7f668c0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f66a0158f80 tx=0x7f6690007f50 comp rx=0 tx=0).stop 2023-10-09T06:21:19.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.839+0000 7f66a620f700 1 -- 172.21.15.31:0/2530614048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00c75c0 msgr2=0x7f66a0155f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:19.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.839+0000 7f66a620f700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00c75c0 0x7f66a0155f30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f669800a380 tx=0x7f6698007900 comp rx=0 tx=0).stop 2023-10-09T06:21:19.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.839+0000 7f66a620f700 1 -- 172.21.15.31:0/2530614048 shutdown_connections 2023-10-09T06:21:19.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.839+0000 7f66a620f700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f668c066f30 0x7f668c0693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:19.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.839+0000 7f66a620f700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66a00abae0 0x7f66a00c02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:19.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.839+0000 7f66a620f700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00c75c0 0x7f66a0155f30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:19.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.839+0000 7f66a620f700 1 --2- 172.21.15.31:0/2530614048 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66a00abeb0 0x7f66a01559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:19.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.839+0000 7f66a620f700 1 -- 172.21.15.31:0/2530614048 >> 172.21.15.31:0/2530614048 conn(0x7f66a0067660 msgr2=0x7f66a0068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:19.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.839+0000 7f66a620f700 1 -- 172.21.15.31:0/2530614048 shutdown_connections 2023-10-09T06:21:19.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:19.839+0000 7f66a620f700 1 -- 172.21.15.31:0/2530614048 wait complete. 2023-10-09T06:21:19.850 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T06:21:19.850 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:21:19.851 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-09T06:21:19.851 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-09T06:21:19.851 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-09T06:21:19.851 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T06:21:19.851 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T06:21:19.851 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:21:19.851 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-09T06:21:19.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:19.851 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-09T06:21:19.867 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:21:19.867 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:21:19.867 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:21:19.867 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:19.867 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:21:19.868 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:19.868 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:19.868 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:19.868 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-09T06:21:19.868 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:19.868 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:19.868 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-09T06:21:19.868 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:19.868 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:19.868 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:21:19.868 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:19.869 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:21:19.869 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42514sec preferred_lft 42514sec 2023-10-09T06:21:19.869 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-09T06:21:19.869 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:19.869 INFO:teuthology.orchestra.run.smithi158.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:21:19.869 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether e6:10:14:7c:a4:d7 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:19.869 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:21:19.869 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:19.869 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::c5:35ff:fec9:1844/64 scope link tentative 2023-10-09T06:21:19.869 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:19.869 INFO:teuthology.orchestra.run.smithi158.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:21:19.869 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether e6:10:14:7c:a4:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:21:19.869 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::e410:14ff:fe7c:a4d7/64 scope link tentative 2023-10-09T06:21:19.870 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:19.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:19.870 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:21:19.931 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-09T06:21:19.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:19.932 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-09T06:21:19.988 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-09T06:21:19.988 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:21:19.988 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:21:19.988 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:21:19.988 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:21:19.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:19.989 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:21:19.989 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:21:19.989 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:21:19.989 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:21:19.989 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:21:19.989 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:21:20.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:20.090 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:21:20.104 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T06:21:20.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:20.105 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list-id 2023-10-09T06:21:20.158 INFO:teuthology.orchestra.run.smithi158.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-09T06:21:20.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:20.159 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:21:20.159 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:21:20.159 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T06:21:20.159 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-09T06:21:20.159 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:21:20.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:20.247 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-09T06:21:20.284 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:21:20.284 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:21:20.284 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:21:20.284 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:20.284 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:21:20.284 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:20.284 INFO:teuthology.orchestra.run.smithi158.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:21:20.284 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether d6:cd:3f:9d:68:1a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T06:21:20.285 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T06:21:20.285 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:20.285 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::d4cd:3fff:fe9d:681a/64 scope link tentative 2023-10-09T06:21:20.285 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:20.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:20.298 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-09T06:21:20.376 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:21:20.376 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:21:20.376 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:21:20.376 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:20.376 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:21:20.376 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:20.376 INFO:teuthology.orchestra.run.smithi158.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:21:20.376 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether d6:cd:3f:9d:68:1a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T06:21:20.376 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T06:21:20.377 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:20.377 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::d4cd:3fff:fe9d:681a/64 scope link tentative 2023-10-09T06:21:20.377 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:20.388 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-09T06:21:20.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:20.389 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:21:20.389 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:21:20.389 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-09T06:21:20.389 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-09T06:21:20.389 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-09T06:21:20.389 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-09T06:21:20.389 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-09T06:21:20.389 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:21:20.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:20.608 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:21:20.608 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:21:20.608 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.1 up 2023-10-09T06:21:20.608 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set dev brx.1 master ceph-brx 2023-10-09T06:21:20.608 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:21:20.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:21:20.687 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-09T06:21:20.702 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-09T06:21:20.702 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:21:20.702 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-09T06:21:20.758 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-09T06:21:20.758 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:21:20.758 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:20.838 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:20.838 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:20.856 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:20.857 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:20.857 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:21:20.857 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 3@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:21:20.857 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:21:20.857 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:21:20.857 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:21:20.857 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:21:20.878 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:20.878 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:20.878 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:21:20.878 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 3@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:21:20.878 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:21:20.878 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:21:20.878 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:21:20.879 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:21:20.879 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:21:20.879 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:21:20.879 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:21:20.880 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:21:20.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:20.881 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-09T06:21:20.944 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-09T06:21:20.961 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.093+0000 7fd6121ca700 1 Processor -- start 2023-10-09T06:21:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.093+0000 7fd6121ca700 1 -- start start 2023-10-09T06:21:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.094+0000 7fd6121ca700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd60c06f660 0x7fd60c06aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.094+0000 7fd6121ca700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd60c068ae0 0x7fd60c070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.094+0000 7fd6121ca700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c06a050 con 0x7fd60c068710 2023-10-09T06:21:21.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.094+0000 7fd6121ca700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c0c9c20 con 0x7fd60c06f660 2023-10-09T06:21:21.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.094+0000 7fd6121ca700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0acdc0 con 0x7fd60c068ae0 2023-10-09T06:21:21.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.094+0000 7fd6109c7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd60c06f660 0x7fd60c06aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.094+0000 7fd6109c7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd60c06f660 0x7fd60c06aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54132/0 (socket says 172.21.15.31:54132) 2023-10-09T06:21:21.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.094+0000 7fd6109c7700 1 -- 172.21.15.31:0/2791579828 learned_addr learned my addr 172.21.15.31:0/2791579828 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:21.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd6119c9700 1 --2- 172.21.15.31:0/2791579828 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd60c068ae0 0x7fd60c070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd6109c7700 1 -- 172.21.15.31:0/2791579828 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd60c068ae0 msgr2=0x7fd60c070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:21.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd6109c7700 1 --2- 172.21.15.31:0/2791579828 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd60c068ae0 0x7fd60c070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd6109c7700 1 -- 172.21.15.31:0/2791579828 >> v1:172.21.15.158:6789/0 conn(0x7fd60c068710 legacy=0x7fd60c0c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:21.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd6109c7700 1 -- 172.21.15.31:0/2791579828 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0c9e00 con 0x7fd60c06f660 2023-10-09T06:21:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd6119c9700 1 --2- 172.21.15.31:0/2791579828 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd60c068ae0 0x7fd60c070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd6109c7700 1 --2- 172.21.15.31:0/2791579828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd60c06f660 0x7fd60c06aaf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd6000099b0 tx=0x7fd600009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44cc6ad27df5f43 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd60bfff700 1 -- 172.21.15.31:0/2791579828 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60000b820 con 0x7fd60c06f660 2023-10-09T06:21:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd60bfff700 1 -- 172.21.15.31:0/2791579828 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60000b980 con 0x7fd60c06f660 2023-10-09T06:21:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd60bfff700 1 -- 172.21.15.31:0/2791579828 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60000bd20 con 0x7fd60c06f660 2023-10-09T06:21:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd6121ca700 1 -- 172.21.15.31:0/2791579828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd60c06f660 msgr2=0x7fd60c06aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd6121ca700 1 --2- 172.21.15.31:0/2791579828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd60c06f660 0x7fd60c06aaf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd6000099b0 tx=0x7fd600009250 comp rx=0 tx=0).stop 2023-10-09T06:21:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd6121ca700 1 -- 172.21.15.31:0/2791579828 shutdown_connections 2023-10-09T06:21:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd6121ca700 1 --2- 172.21.15.31:0/2791579828 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd60c068ae0 0x7fd60c070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.095+0000 7fd6121ca700 1 --2- 172.21.15.31:0/2791579828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd60c06f660 0x7fd60c06aaf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.096+0000 7fd6121ca700 1 -- 172.21.15.31:0/2791579828 >> 172.21.15.31:0/2791579828 conn(0x7fd60c0cd8f0 msgr2=0x7fd60c0cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.096+0000 7fd6121ca700 1 -- 172.21.15.31:0/2791579828 shutdown_connections 2023-10-09T06:21:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.096+0000 7fd6121ca700 1 -- 172.21.15.31:0/2791579828 wait complete. 2023-10-09T06:21:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.097+0000 7fd6121ca700 1 Processor -- start 2023-10-09T06:21:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.097+0000 7fd6121ca700 1 -- start start 2023-10-09T06:21:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6121ca700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd60c068710 0x7fd60c1528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6121ca700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd60c068ae0 0x7fd60c0c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6121ca700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd60c06f660 0x7fd60c0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6121ca700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0c4760 con 0x7fd60c068710 2023-10-09T06:21:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6121ca700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0b1270 con 0x7fd60c06f660 2023-10-09T06:21:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6121ca700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c152e30 con 0x7fd60c068ae0 2023-10-09T06:21:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6111c8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd60c068710 0x7fd60c1528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6111c8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd60c068710 0x7fd60c1528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54144/0 (socket says 172.21.15.31:54144) 2023-10-09T06:21:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6111c8700 1 -- 172.21.15.31:0/1842293573 learned_addr learned my addr 172.21.15.31:0/1842293573 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6109c7700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd60c068ae0 0x7fd60c0c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6119c9700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd60c06f660 0x7fd60c0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6111c8700 1 -- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd60c068ae0 msgr2=0x7fd60c0c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6111c8700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd60c068ae0 0x7fd60c0c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6111c8700 1 -- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd60c06f660 msgr2=0x7fd60c0c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6111c8700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd60c06f660 0x7fd60c0c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6111c8700 1 -- 172.21.15.31:0/1842293573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6000094f0 con 0x7fd60c068710 2023-10-09T06:21:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6119c9700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd60c06f660 0x7fd60c0c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6109c7700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd60c068ae0 0x7fd60c0c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6111c8700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd60c068710 0x7fd60c1528f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c950 tx=0x7fd604002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6097fa700 1 -- 172.21.15.31:0/1842293573 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60400a780 con 0x7fd60c068710 2023-10-09T06:21:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6097fa700 1 -- 172.21.15.31:0/1842293573 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60400a8e0 con 0x7fd60c068710 2023-10-09T06:21:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6121ca700 1 -- 172.21.15.31:0/1842293573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c0b0940 con 0x7fd60c068710 2023-10-09T06:21:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6097fa700 1 -- 172.21.15.31:0/1842293573 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60400aca0 con 0x7fd60c068710 2023-10-09T06:21:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.098+0000 7fd6121ca700 1 -- 172.21.15.31:0/1842293573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c0b0f00 con 0x7fd60c068710 2023-10-09T06:21:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.099+0000 7fd6121ca700 1 -- 172.21.15.31:0/1842293573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60c06d640 con 0x7fd60c068710 2023-10-09T06:21:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.100+0000 7fd6097fa700 1 -- 172.21.15.31:0/1842293573 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd604012630 con 0x7fd60c068710 2023-10-09T06:21:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.100+0000 7fd6097fa700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd5f8066f00 0x7fd5f80693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.100+0000 7fd6097fa700 1 -- 172.21.15.31:0/1842293573 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd604084ac0 con 0x7fd60c068710 2023-10-09T06:21:21.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.100+0000 7fd6109c7700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd5f8066f00 0x7fd5f80693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.101+0000 7fd6109c7700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd5f8066f00 0x7fd5f80693b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd6000099b0 tx=0x7fd600016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:21.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.104+0000 7fd6097fa700 1 -- 172.21.15.31:0/1842293573 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd604051d40 con 0x7fd60c068710 2023-10-09T06:21:21.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.298+0000 7fd6121ca700 1 -- 172.21.15.31:0/1842293573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd60c06a2f0 con 0x7fd60c068710 2023-10-09T06:21:21.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.299+0000 7fd6097fa700 1 -- 172.21.15.31:0/1842293573 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd604055360 con 0x7fd60c068710 2023-10-09T06:21:21.299 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:21.299 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:55.693313+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:21.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.301+0000 7fd6121ca700 1 -- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd5f8066f00 msgr2=0x7fd5f80693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.301+0000 7fd6121ca700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd5f8066f00 0x7fd5f80693b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd6000099b0 tx=0x7fd600016000 comp rx=0 tx=0).stop 2023-10-09T06:21:21.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.301+0000 7fd6121ca700 1 -- 172.21.15.31:0/1842293573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd60c068710 msgr2=0x7fd60c1528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.301+0000 7fd6121ca700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd60c068710 0x7fd60c1528f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c950 tx=0x7fd604002760 comp rx=0 tx=0).stop 2023-10-09T06:21:21.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.301+0000 7fd6121ca700 1 -- 172.21.15.31:0/1842293573 shutdown_connections 2023-10-09T06:21:21.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.301+0000 7fd6121ca700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd5f8066f00 0x7fd5f80693b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.301+0000 7fd6121ca700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd60c06f660 0x7fd60c0c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.301+0000 7fd6121ca700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd60c068710 0x7fd60c1528f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.301+0000 7fd6121ca700 1 --2- 172.21.15.31:0/1842293573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd60c068ae0 0x7fd60c0c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.301+0000 7fd6121ca700 1 -- 172.21.15.31:0/1842293573 >> 172.21.15.31:0/1842293573 conn(0x7fd60c0cd8f0 msgr2=0x7fd60c0ac140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:21.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.301+0000 7fd6121ca700 1 -- 172.21.15.31:0/1842293573 shutdown_connections 2023-10-09T06:21:21.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.301+0000 7fd6121ca700 1 -- 172.21.15.31:0/1842293573 wait complete. 2023-10-09T06:21:21.313 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:20:52.621337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:20:53.053532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:21:21.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:21:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.435+0000 7f8a55de4700 1 Processor -- start 2023-10-09T06:21:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.435+0000 7f8a55de4700 1 -- start start 2023-10-09T06:21:21.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.436+0000 7f8a55de4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8a50154440 0x7f8a5015da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.436+0000 7f8a55de4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a5015b380 0x7f8a500cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.436+0000 7f8a55de4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5015e1e0 con 0x7f8a5015af30 2023-10-09T06:21:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.436+0000 7f8a55de4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5015dfd0 con 0x7f8a50154440 2023-10-09T06:21:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.436+0000 7f8a55de4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5015e4c0 con 0x7f8a5015b380 2023-10-09T06:21:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.436+0000 7f8a4f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8a50154440 0x7f8a5015da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.436+0000 7f8a4f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8a50154440 0x7f8a5015da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54150/0 (socket says 172.21.15.31:54150) 2023-10-09T06:21:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.436+0000 7f8a4effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8a5015af30 0x7f8a50067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33578/0 (socket says 172.21.15.31:33578) 2023-10-09T06:21:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.436+0000 7f8a4f7fe700 1 -- 172.21.15.31:0/3399700091 learned_addr learned my addr 172.21.15.31:0/3399700091 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.436+0000 7f8a4ffff700 1 --2- 172.21.15.31:0/3399700091 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a5015b380 0x7f8a500cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.437+0000 7f8a4f7fe700 1 -- 172.21.15.31:0/3399700091 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a5015b380 msgr2=0x7f8a500cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.437+0000 7f8a4f7fe700 1 --2- 172.21.15.31:0/3399700091 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a5015b380 0x7f8a500cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.437+0000 7f8a4f7fe700 1 -- 172.21.15.31:0/3399700091 >> v1:172.21.15.31:6789/0 conn(0x7f8a5015af30 legacy=0x7f8a50067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.437+0000 7f8a4e7fc700 1 -- 172.21.15.31:0/3399700091 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689881724 0 0) 0x7f8a5015e1e0 con 0x7f8a5015af30 2023-10-09T06:21:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.437+0000 7f8a4f7fe700 1 -- 172.21.15.31:0/3399700091 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5015e7a0 con 0x7f8a50154440 2023-10-09T06:21:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.437+0000 7f8a4f7fe700 1 --2- 172.21.15.31:0/3399700091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a50154440 0x7f8a5015da90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8a400099b0 tx=0x7f8a40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aeaabe77dcedd55 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.437+0000 7f8a4e7fc700 1 -- 172.21.15.31:0/3399700091 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40009ea0 con 0x7f8a50154440 2023-10-09T06:21:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.437+0000 7f8a4e7fc700 1 -- 172.21.15.31:0/3399700091 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4000b860 con 0x7f8a50154440 2023-10-09T06:21:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.437+0000 7f8a4e7fc700 1 -- 172.21.15.31:0/3399700091 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4000bc20 con 0x7f8a50154440 2023-10-09T06:21:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.437+0000 7f8a55de4700 1 -- 172.21.15.31:0/3399700091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a50154440 msgr2=0x7f8a5015da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.437+0000 7f8a55de4700 1 --2- 172.21.15.31:0/3399700091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a50154440 0x7f8a5015da90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8a400099b0 tx=0x7f8a40009250 comp rx=0 tx=0).stop 2023-10-09T06:21:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.438+0000 7f8a55de4700 1 -- 172.21.15.31:0/3399700091 shutdown_connections 2023-10-09T06:21:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.438+0000 7f8a55de4700 1 --2- 172.21.15.31:0/3399700091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a50154440 0x7f8a5015da90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.438+0000 7f8a55de4700 1 --2- 172.21.15.31:0/3399700091 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a5015b380 0x7f8a500cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.438+0000 7f8a55de4700 1 -- 172.21.15.31:0/3399700091 >> 172.21.15.31:0/3399700091 conn(0x7f8a500d0dd0 msgr2=0x7f8a500d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:21.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.438+0000 7f8a55de4700 1 -- 172.21.15.31:0/3399700091 shutdown_connections 2023-10-09T06:21:21.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.438+0000 7f8a55de4700 1 -- 172.21.15.31:0/3399700091 wait complete. 2023-10-09T06:21:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.439+0000 7f8a55de4700 1 Processor -- start 2023-10-09T06:21:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.439+0000 7f8a55de4700 1 -- start start 2023-10-09T06:21:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.439+0000 7f8a55de4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a50154440 0x7f8a5016b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.439+0000 7f8a55de4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a5015af30 0x7f8a5014b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a55de4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a5015b380 0x7f8a50154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a55de4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5014f820 con 0x7f8a50154440 2023-10-09T06:21:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a55de4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5014fb00 con 0x7f8a5015b380 2023-10-09T06:21:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a55de4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5014fde0 con 0x7f8a5015af30 2023-10-09T06:21:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a4f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a50154440 0x7f8a5016b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a4f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a50154440 0x7f8a5016b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54166/0 (socket says 172.21.15.31:54166) 2023-10-09T06:21:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a4f7fe700 1 -- 172.21.15.31:0/3300368048 learned_addr learned my addr 172.21.15.31:0/3300368048 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a4effd700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a5015af30 0x7f8a5014b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a4ffff700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a5015b380 0x7f8a50154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a4f7fe700 1 -- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a5015af30 msgr2=0x7f8a5014b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a4f7fe700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a5015af30 0x7f8a5014b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a4f7fe700 1 -- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a5015b380 msgr2=0x7f8a50154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a4f7fe700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a5015b380 0x7f8a50154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a4f7fe700 1 -- 172.21.15.31:0/3300368048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a400094f0 con 0x7f8a50154440 2023-10-09T06:21:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a4f7fe700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a50154440 0x7f8a5016b400 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8a40006fd0 tx=0x7f8a40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a377fe700 1 -- 172.21.15.31:0/3300368048 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4001f070 con 0x7f8a50154440 2023-10-09T06:21:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a377fe700 1 -- 172.21.15.31:0/3300368048 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a40006af0 con 0x7f8a50154440 2023-10-09T06:21:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a55de4700 1 -- 172.21.15.31:0/3300368048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a501500c0 con 0x7f8a50154440 2023-10-09T06:21:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a377fe700 1 -- 172.21.15.31:0/3300368048 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4000bc00 con 0x7f8a50154440 2023-10-09T06:21:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.440+0000 7f8a55de4700 1 -- 172.21.15.31:0/3300368048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5014bb20 con 0x7f8a50154440 2023-10-09T06:21:21.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.441+0000 7f8a55de4700 1 -- 172.21.15.31:0/3300368048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a50150300 con 0x7f8a50154440 2023-10-09T06:21:21.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.442+0000 7f8a377fe700 1 -- 172.21.15.31:0/3300368048 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a40011630 con 0x7f8a50154440 2023-10-09T06:21:21.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.442+0000 7f8a377fe700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8a3c066f60 0x7f8a3c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.442+0000 7f8a377fe700 1 -- 172.21.15.31:0/3300368048 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a40085840 con 0x7f8a50154440 2023-10-09T06:21:21.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.442+0000 7f8a4effd700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8a3c066f60 0x7f8a3c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.443+0000 7f8a4effd700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8a3c066f60 0x7f8a3c069410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8a44007fd0 tx=0x7f8a44007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:21.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.446+0000 7f8a377fe700 1 -- 172.21.15.31:0/3300368048 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a50150300 con 0x7f8a50154440 2023-10-09T06:21:21.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.639+0000 7f8a55de4700 1 -- 172.21.15.31:0/3300368048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a50150300 con 0x7f8a50154440 2023-10-09T06:21:21.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.639+0000 7f8a377fe700 1 -- 172.21.15.31:0/3300368048 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a50150300 con 0x7f8a50154440 2023-10-09T06:21:21.639 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:21:21.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.641+0000 7f8a55de4700 1 -- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8a3c066f60 msgr2=0x7f8a3c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.641+0000 7f8a55de4700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8a3c066f60 0x7f8a3c069410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8a44007fd0 tx=0x7f8a44007d50 comp rx=0 tx=0).stop 2023-10-09T06:21:21.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.641+0000 7f8a55de4700 1 -- 172.21.15.31:0/3300368048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a50154440 msgr2=0x7f8a5016b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.641+0000 7f8a55de4700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a50154440 0x7f8a5016b400 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8a40006fd0 tx=0x7f8a40017000 comp rx=0 tx=0).stop 2023-10-09T06:21:21.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.641+0000 7f8a55de4700 1 -- 172.21.15.31:0/3300368048 shutdown_connections 2023-10-09T06:21:21.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.641+0000 7f8a55de4700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8a3c066f60 0x7f8a3c069410 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.641+0000 7f8a55de4700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8a5015b380 0x7f8a50154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.641+0000 7f8a55de4700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a50154440 0x7f8a5016b400 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.641+0000 7f8a55de4700 1 --2- 172.21.15.31:0/3300368048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8a5015af30 0x7f8a5014b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.641+0000 7f8a55de4700 1 -- 172.21.15.31:0/3300368048 >> 172.21.15.31:0/3300368048 conn(0x7f8a500d0dd0 msgr2=0x7f8a501536e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:21.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.641+0000 7f8a55de4700 1 -- 172.21.15.31:0/3300368048 shutdown_connections 2023-10-09T06:21:21.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.641+0000 7f8a55de4700 1 -- 172.21.15.31:0/3300368048 wait complete. 2023-10-09T06:21:21.653 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:21:21.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.775+0000 7f8875100700 1 Processor -- start 2023-10-09T06:21:21.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.775+0000 7f8875100700 1 -- start start 2023-10-09T06:21:21.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.776+0000 7f8875100700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f887015a290 0x7f887006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.776+0000 7f8875100700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f887006aae0 0x7f88700cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.776+0000 7f8875100700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88700b0790 con 0x7f8870159ec0 2023-10-09T06:21:21.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.776+0000 7f8875100700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887006af60 con 0x7f887006aae0 2023-10-09T06:21:21.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.776+0000 7f8875100700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88700ce1f0 con 0x7f887015a290 2023-10-09T06:21:21.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.776+0000 7f886f59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f887006aae0 0x7f88700cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.776+0000 7f886e59c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f887015a290 0x7f887006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.777+0000 7f886f59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f887006aae0 0x7f88700cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:38136/0 (socket says 172.21.15.31:38136) 2023-10-09T06:21:21.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.777+0000 7f886f59e700 1 -- 172.21.15.31:0/3916496356 learned_addr learned my addr 172.21.15.31:0/3916496356 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:21.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.777+0000 7f886ed9d700 1 --1- 172.21.15.31:0/3916496356 >> v1:172.21.15.158:6789/0 conn(0x7f8870159ec0 0x7f88700af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:36820/0 (socket says 172.21.15.31:36820) 2023-10-09T06:21:21.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.777+0000 7f886f59e700 1 -- 172.21.15.31:0/3916496356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f887015a290 msgr2=0x7f887006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:21.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.777+0000 7f886f59e700 1 --2- 172.21.15.31:0/3916496356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f887015a290 0x7f887006a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.777+0000 7f886f59e700 1 -- 172.21.15.31:0/3916496356 >> v1:172.21.15.158:6789/0 conn(0x7f8870159ec0 legacy=0x7f88700af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.777+0000 7f886f59e700 1 -- 172.21.15.31:0/3916496356 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88700b0b20 con 0x7f887006aae0 2023-10-09T06:21:21.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.777+0000 7f886e59c700 1 --2- 172.21.15.31:0/3916496356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f887015a290 0x7f887006a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:21.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.777+0000 7f886f59e700 1 --2- 172.21.15.31:0/3916496356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f887006aae0 0x7f88700cf590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8860009f20 tx=0x7f8860009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ecf0aef9a72bd1a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:21.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.777+0000 7f886dd9b700 1 -- 172.21.15.31:0/3916496356 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000e070 con 0x7f887006aae0 2023-10-09T06:21:21.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.777+0000 7f886dd9b700 1 -- 172.21.15.31:0/3916496356 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886000b9d0 con 0x7f887006aae0 2023-10-09T06:21:21.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.777+0000 7f886dd9b700 1 -- 172.21.15.31:0/3916496356 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88600092e0 con 0x7f887006aae0 2023-10-09T06:21:21.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.778+0000 7f8875100700 1 -- 172.21.15.31:0/3916496356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f887006aae0 msgr2=0x7f88700cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.778+0000 7f8875100700 1 --2- 172.21.15.31:0/3916496356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f887006aae0 0x7f88700cf590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8860009f20 tx=0x7f8860009840 comp rx=0 tx=0).stop 2023-10-09T06:21:21.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.778+0000 7f8875100700 1 -- 172.21.15.31:0/3916496356 shutdown_connections 2023-10-09T06:21:21.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.778+0000 7f8875100700 1 --2- 172.21.15.31:0/3916496356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f887006aae0 0x7f88700cf590 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.778+0000 7f8875100700 1 --2- 172.21.15.31:0/3916496356 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f887015a290 0x7f887006a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.778+0000 7f8875100700 1 -- 172.21.15.31:0/3916496356 >> 172.21.15.31:0/3916496356 conn(0x7f88700d1880 msgr2=0x7f88700cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:21.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.778+0000 7f8875100700 1 -- 172.21.15.31:0/3916496356 shutdown_connections 2023-10-09T06:21:21.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.778+0000 7f8875100700 1 -- 172.21.15.31:0/3916496356 wait complete. 2023-10-09T06:21:21.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.779+0000 7f8875100700 1 Processor -- start 2023-10-09T06:21:21.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.779+0000 7f8875100700 1 -- start start 2023-10-09T06:21:21.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f8875100700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f887006aae0 0x7f887015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f8875100700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8870159ec0 0x7f8870158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f8875100700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f887015a290 0x7f887016a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f8875100700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887015c800 con 0x7f887006aae0 2023-10-09T06:21:21.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f8875100700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887015cae0 con 0x7f887015a290 2023-10-09T06:21:21.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f8875100700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887015cdc0 con 0x7f8870159ec0 2023-10-09T06:21:21.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f886ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f887006aae0 0x7f887015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f886ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f887006aae0 0x7f887015c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54180/0 (socket says 172.21.15.31:54180) 2023-10-09T06:21:21.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f886ed9d700 1 -- 172.21.15.31:0/1946073263 learned_addr learned my addr 172.21.15.31:0/1946073263 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:21.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f886e59c700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8870159ec0 0x7f8870158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f886f59e700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f887015a290 0x7f887016a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f886ed9d700 1 -- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8870159ec0 msgr2=0x7f8870158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f886ed9d700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8870159ec0 0x7f8870158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f886ed9d700 1 -- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f887015a290 msgr2=0x7f887016a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f886ed9d700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f887015a290 0x7f887016a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f886ed9d700 1 -- 172.21.15.31:0/1946073263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8858009420 con 0x7f887006aae0 2023-10-09T06:21:21.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.780+0000 7f886ed9d700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f887006aae0 0x7f887015c170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f886800c7c0 tx=0x7f8868007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:21.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.781+0000 7f8866ffd700 1 -- 172.21.15.31:0/1946073263 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868005a70 con 0x7f887006aae0 2023-10-09T06:21:21.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.781+0000 7f8866ffd700 1 -- 172.21.15.31:0/1946073263 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868005bd0 con 0x7f887006aae0 2023-10-09T06:21:21.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.781+0000 7f8875100700 1 -- 172.21.15.31:0/1946073263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8860009ae0 con 0x7f887006aae0 2023-10-09T06:21:21.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.781+0000 7f8866ffd700 1 -- 172.21.15.31:0/1946073263 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680070d0 con 0x7f887006aae0 2023-10-09T06:21:21.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.781+0000 7f8875100700 1 -- 172.21.15.31:0/1946073263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887016ac40 con 0x7f887006aae0 2023-10-09T06:21:21.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.782+0000 7f8875100700 1 -- 172.21.15.31:0/1946073263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887015d260 con 0x7f887006aae0 2023-10-09T06:21:21.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.782+0000 7f8866ffd700 1 -- 172.21.15.31:0/1946073263 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8868007480 con 0x7f887006aae0 2023-10-09T06:21:21.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.782+0000 7f8866ffd700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8850066f30 0x7f88500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:21.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.782+0000 7f8866ffd700 1 -- 172.21.15.31:0/1946073263 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8868083940 con 0x7f887006aae0 2023-10-09T06:21:21.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.782+0000 7f886e59c700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8850066f30 0x7f88500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:21.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.783+0000 7f886e59c700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8850066f30 0x7f88500693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8870064760 tx=0x7f88580091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:21.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.787+0000 7f8866ffd700 1 -- 172.21.15.31:0/1946073263 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8868050bb0 con 0x7f887006aae0 2023-10-09T06:21:21.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.977+0000 7f8875100700 1 -- 172.21.15.31:0/1946073263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f887004c3c0 con 0x7f887006aae0 2023-10-09T06:21:21.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.977+0000 7f8866ffd700 1 -- 172.21.15.31:0/1946073263 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88680170a0 con 0x7f887006aae0 2023-10-09T06:21:21.978 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:21:21.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.979+0000 7f8875100700 1 -- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8850066f30 msgr2=0x7f88500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.979+0000 7f8875100700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8850066f30 0x7f88500693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8870064760 tx=0x7f88580091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.979+0000 7f8875100700 1 -- 172.21.15.31:0/1946073263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f887006aae0 msgr2=0x7f887015c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.979+0000 7f8875100700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f887006aae0 0x7f887015c170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f886800c7c0 tx=0x7f8868007f70 comp rx=0 tx=0).stop 2023-10-09T06:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.979+0000 7f8875100700 1 -- 172.21.15.31:0/1946073263 shutdown_connections 2023-10-09T06:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.979+0000 7f8875100700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8850066f30 0x7f88500693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.979+0000 7f8875100700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f887015a290 0x7f887016a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.979+0000 7f8875100700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f887006aae0 0x7f887015c170 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.979+0000 7f8875100700 1 --2- 172.21.15.31:0/1946073263 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8870159ec0 0x7f8870158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.979+0000 7f8875100700 1 -- 172.21.15.31:0/1946073263 >> 172.21.15.31:0/1946073263 conn(0x7f88700d1880 msgr2=0x7f88700c6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.979+0000 7f8875100700 1 -- 172.21.15.31:0/1946073263 shutdown_connections 2023-10-09T06:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:21.979+0000 7f8875100700 1 -- 172.21.15.31:0/1946073263 wait complete. 2023-10-09T06:21:21.991 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:21:22.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.113+0000 7f4996d14700 1 Processor -- start 2023-10-09T06:21:22.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.113+0000 7f4996d14700 1 -- start start 2023-10-09T06:21:22.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.113+0000 7f4996d14700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f49901569c0 0x7f49900a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.113+0000 7f4996d14700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49900cdb90 con 0x7f499006ea00 2023-10-09T06:21:22.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.113+0000 7f4996d14700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49900c78c0 con 0x7f4990156d90 2023-10-09T06:21:22.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.113+0000 7f4996d14700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49900c7ba0 con 0x7f49901569c0 2023-10-09T06:21:22.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.114+0000 7f4994ab0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f49901569c0 0x7f49900a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.114+0000 7f4994ab0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f49901569c0 0x7f49900a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54192/0 (socket says 172.21.15.31:54192) 2023-10-09T06:21:22.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.114+0000 7f4994ab0700 1 -- 172.21.15.31:0/3570543442 learned_addr learned my addr 172.21.15.31:0/3570543442 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:22.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.114+0000 7f49952b1700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f499006ea00 0x7f49900cbe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33580/0 (socket says 172.21.15.31:33580) 2023-10-09T06:21:22.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.114+0000 7f4994ab0700 1 -- 172.21.15.31:0/3570543442 >> v1:172.21.15.158:6789/0 conn(0x7f4990156d90 legacy=0x7f499006e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.114+0000 7f4994ab0700 1 -- 172.21.15.31:0/3570543442 >> v1:172.21.15.31:6789/0 conn(0x7f499006ea00 legacy=0x7f49900cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.114+0000 7f4994ab0700 1 -- 172.21.15.31:0/3570543442 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900c7e80 con 0x7f49901569c0 2023-10-09T06:21:22.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.114+0000 7f498f7fe700 1 -- 172.21.15.31:0/3570543442 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828198490 0 0) 0x7f49900cdb90 con 0x7f499006ea00 2023-10-09T06:21:22.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.114+0000 7f4994ab0700 1 --2- 172.21.15.31:0/3570543442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49901569c0 0x7f49900a9ff0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4988009ed0 tx=0x7f4988009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67370ce90186a878 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:22.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.114+0000 7f498f7fe700 1 -- 172.21.15.31:0/3570543442 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498800e070 con 0x7f49901569c0 2023-10-09T06:21:22.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.114+0000 7f498f7fe700 1 -- 172.21.15.31:0/3570543442 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498800ba00 con 0x7f49901569c0 2023-10-09T06:21:22.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.114+0000 7f498f7fe700 1 -- 172.21.15.31:0/3570543442 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49880092e0 con 0x7f49901569c0 2023-10-09T06:21:22.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.115+0000 7f4996d14700 1 -- 172.21.15.31:0/3570543442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49901569c0 msgr2=0x7f49900a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.115+0000 7f4996d14700 1 --2- 172.21.15.31:0/3570543442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49901569c0 0x7f49900a9ff0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4988009ed0 tx=0x7f4988009840 comp rx=0 tx=0).stop 2023-10-09T06:21:22.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.115+0000 7f4996d14700 1 -- 172.21.15.31:0/3570543442 shutdown_connections 2023-10-09T06:21:22.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.115+0000 7f4996d14700 1 --2- 172.21.15.31:0/3570543442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49901569c0 0x7f49900a9ff0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.115+0000 7f4996d14700 1 -- 172.21.15.31:0/3570543442 >> 172.21.15.31:0/3570543442 conn(0x7f4990068170 msgr2=0x7f49900cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:22.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.115+0000 7f4996d14700 1 -- 172.21.15.31:0/3570543442 shutdown_connections 2023-10-09T06:21:22.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.115+0000 7f4996d14700 1 -- 172.21.15.31:0/3570543442 wait complete. 2023-10-09T06:21:22.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.116+0000 7f4996d14700 1 Processor -- start 2023-10-09T06:21:22.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.116+0000 7f4996d14700 1 -- start start 2023-10-09T06:21:22.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4996d14700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f499006ea00 0x7f4990154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4996d14700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f49901569c0 0x7f49900c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4996d14700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4990156d90 0x7f49900c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4996d14700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49900c48f0 con 0x7f499006ea00 2023-10-09T06:21:22.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4996d14700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49900c0e10 con 0x7f49901569c0 2023-10-09T06:21:22.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4996d14700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49900c10f0 con 0x7f4990156d90 2023-10-09T06:21:22.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4994ab0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f499006ea00 0x7f4990154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4994ab0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f499006ea00 0x7f4990154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54206/0 (socket says 172.21.15.31:54206) 2023-10-09T06:21:22.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4994ab0700 1 -- 172.21.15.31:0/3891135303 learned_addr learned my addr 172.21.15.31:0/3891135303 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:22.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4994ab0700 1 -- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4990156d90 msgr2=0x7f49900c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4994ab0700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4990156d90 0x7f49900c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f498ffff700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f49901569c0 0x7f49900c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4994ab0700 1 -- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f49901569c0 msgr2=0x7f49900c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4994ab0700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f49901569c0 0x7f49900c2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4994ab0700 1 -- 172.21.15.31:0/3891135303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4988009ae0 con 0x7f499006ea00 2023-10-09T06:21:22.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f498ffff700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f49901569c0 0x7f49900c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:22.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f4994ab0700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f499006ea00 0x7f4990154a30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4990068870 tx=0x7f4988016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:22.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f498cff9700 1 -- 172.21.15.31:0/3891135303 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498801e450 con 0x7f499006ea00 2023-10-09T06:21:22.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f498cff9700 1 -- 172.21.15.31:0/3891135303 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498801e5f0 con 0x7f499006ea00 2023-10-09T06:21:22.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.117+0000 7f498cff9700 1 -- 172.21.15.31:0/3891135303 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498801e9b0 con 0x7f499006ea00 2023-10-09T06:21:22.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.118+0000 7f4996d14700 1 -- 172.21.15.31:0/3891135303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49900c13d0 con 0x7f499006ea00 2023-10-09T06:21:22.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.118+0000 7f4996d14700 1 -- 172.21.15.31:0/3891135303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4990154f70 con 0x7f499006ea00 2023-10-09T06:21:22.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.118+0000 7f4996d14700 1 -- 172.21.15.31:0/3891135303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49900c46c0 con 0x7f499006ea00 2023-10-09T06:21:22.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.119+0000 7f498cff9700 1 -- 172.21.15.31:0/3891135303 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4988027410 con 0x7f499006ea00 2023-10-09T06:21:22.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.119+0000 7f498cff9700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4970066f30 0x7f49700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.119+0000 7f498cff9700 1 -- 172.21.15.31:0/3891135303 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4988086260 con 0x7f499006ea00 2023-10-09T06:21:22.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.119+0000 7f498ffff700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4970066f30 0x7f49700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.120+0000 7f498ffff700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4970066f30 0x7f49700693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f49900c3a10 tx=0x7f4980009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:22.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.124+0000 7f498cff9700 1 -- 172.21.15.31:0/3891135303 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49900c46c0 con 0x7f499006ea00 2023-10-09T06:21:22.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.315+0000 7f4996d14700 1 -- 172.21.15.31:0/3891135303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49900c46c0 con 0x7f499006ea00 2023-10-09T06:21:22.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.316+0000 7f498cff9700 1 -- 172.21.15.31:0/3891135303 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49900c46c0 con 0x7f499006ea00 2023-10-09T06:21:22.316 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:21:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.318+0000 7f4996d14700 1 -- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4970066f30 msgr2=0x7f49700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.318+0000 7f4996d14700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4970066f30 0x7f49700693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f49900c3a10 tx=0x7f4980009040 comp rx=0 tx=0).stop 2023-10-09T06:21:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.318+0000 7f4996d14700 1 -- 172.21.15.31:0/3891135303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f499006ea00 msgr2=0x7f4990154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.318+0000 7f4996d14700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f499006ea00 0x7f4990154a30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4990068870 tx=0x7f4988016000 comp rx=0 tx=0).stop 2023-10-09T06:21:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.318+0000 7f4996d14700 1 -- 172.21.15.31:0/3891135303 shutdown_connections 2023-10-09T06:21:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.318+0000 7f4996d14700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4970066f30 0x7f49700693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.318+0000 7f4996d14700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4990156d90 0x7f49900c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.318+0000 7f4996d14700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f499006ea00 0x7f4990154a30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.318+0000 7f4996d14700 1 --2- 172.21.15.31:0/3891135303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f49901569c0 0x7f49900c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.318+0000 7f4996d14700 1 -- 172.21.15.31:0/3891135303 >> 172.21.15.31:0/3891135303 conn(0x7f4990068170 msgr2=0x7f49900cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:22.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.318+0000 7f4996d14700 1 -- 172.21.15.31:0/3891135303 shutdown_connections 2023-10-09T06:21:22.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.318+0000 7f4996d14700 1 -- 172.21.15.31:0/3891135303 wait complete. 2023-10-09T06:21:22.330 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:22.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.448+0000 7f9953b8b700 1 Processor -- start 2023-10-09T06:21:22.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.449+0000 7f9953b8b700 1 -- start start 2023-10-09T06:21:22.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.449+0000 7f9953b8b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f994c0b0e50 0x7f994c0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.449+0000 7f9953b8b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f994c0b1220 0x7f994c06d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.449+0000 7f9953b8b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994c15de60 con 0x7f994c06dad0 2023-10-09T06:21:22.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.449+0000 7f9953b8b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f994c15e140 con 0x7f994c0b1220 2023-10-09T06:21:22.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.449+0000 7f9953b8b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c15e420 con 0x7f994c0b0e50 2023-10-09T06:21:22.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9951126700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f994c0b1220 0x7f994c06d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9951927700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f994c0b0e50 0x7f994c0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9952128700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f994c06dad0 0x7f994c0cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:36836/0 (socket says 172.21.15.31:36836) 2023-10-09T06:21:22.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9952128700 1 -- 172.21.15.31:0/1229257420 learned_addr learned my addr 172.21.15.31:0/1229257420 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:22.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9951126700 1 -- 172.21.15.31:0/1229257420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f994c0b0e50 msgr2=0x7f994c0c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:22.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9951126700 1 --2- 172.21.15.31:0/1229257420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f994c0b0e50 0x7f994c0c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9951126700 1 -- 172.21.15.31:0/1229257420 >> v1:172.21.15.158:6789/0 conn(0x7f994c06dad0 legacy=0x7f994c0cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9951126700 1 -- 172.21.15.31:0/1229257420 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c15e700 con 0x7f994c0b1220 2023-10-09T06:21:22.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9950925700 1 -- 172.21.15.31:0/1229257420 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168265788 0 0) 0x7f994c15de60 con 0x7f994c06dad0 2023-10-09T06:21:22.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9951927700 1 --2- 172.21.15.31:0/1229257420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f994c0b0e50 0x7f994c0c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:22.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9951126700 1 --2- 172.21.15.31:0/1229257420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f994c0b1220 0x7f994c06d590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f993c009910 tx=0x7f993c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c029c910ee0255b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:22.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9950925700 1 -- 172.21.15.31:0/1229257420 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00b640 con 0x7f994c0b1220 2023-10-09T06:21:22.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9950925700 1 -- 172.21.15.31:0/1229257420 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c00b7a0 con 0x7f994c0b1220 2023-10-09T06:21:22.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.450+0000 7f9950925700 1 -- 172.21.15.31:0/1229257420 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00bb60 con 0x7f994c0b1220 2023-10-09T06:21:22.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.451+0000 7f9953b8b700 1 -- 172.21.15.31:0/1229257420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f994c0b1220 msgr2=0x7f994c06d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.451+0000 7f9953b8b700 1 --2- 172.21.15.31:0/1229257420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f994c0b1220 0x7f994c06d590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f993c009910 tx=0x7f993c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.451+0000 7f9953b8b700 1 -- 172.21.15.31:0/1229257420 shutdown_connections 2023-10-09T06:21:22.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.451+0000 7f9953b8b700 1 --2- 172.21.15.31:0/1229257420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f994c0b0e50 0x7f994c0c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.451+0000 7f9953b8b700 1 --2- 172.21.15.31:0/1229257420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f994c0b1220 0x7f994c06d590 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.451+0000 7f9953b8b700 1 -- 172.21.15.31:0/1229257420 >> 172.21.15.31:0/1229257420 conn(0x7f994c069870 msgr2=0x7f994c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:22.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.451+0000 7f9953b8b700 1 -- 172.21.15.31:0/1229257420 shutdown_connections 2023-10-09T06:21:22.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.451+0000 7f9953b8b700 1 -- 172.21.15.31:0/1229257420 wait complete. 2023-10-09T06:21:22.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.452+0000 7f9953b8b700 1 Processor -- start 2023-10-09T06:21:22.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.452+0000 7f9953b8b700 1 -- start start 2023-10-09T06:21:22.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9953b8b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f994c06dad0 0x7f994c15a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9953b8b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0e50 0x7f994c0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9953b8b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f994c0b1220 0x7f994c141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9953b8b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c0c6130 con 0x7f994c0b0e50 2023-10-09T06:21:22.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9953b8b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c1591a0 con 0x7f994c0b1220 2023-10-09T06:21:22.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9953b8b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c158900 con 0x7f994c06dad0 2023-10-09T06:21:22.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9951126700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0e50 0x7f994c0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9951126700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0e50 0x7f994c0c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54218/0 (socket says 172.21.15.31:54218) 2023-10-09T06:21:22.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9951126700 1 -- 172.21.15.31:0/261367382 learned_addr learned my addr 172.21.15.31:0/261367382 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:22.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9951927700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f994c06dad0 0x7f994c15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9952128700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f994c0b1220 0x7f994c141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9951126700 1 -- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f994c06dad0 msgr2=0x7f994c15a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9951126700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f994c06dad0 0x7f994c15a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9951126700 1 -- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f994c0b1220 msgr2=0x7f994c141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9951126700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f994c0b1220 0x7f994c141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9951126700 1 -- 172.21.15.31:0/261367382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9948009420 con 0x7f994c0b0e50 2023-10-09T06:21:22.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9952128700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f994c0b1220 0x7f994c141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:22.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.453+0000 7f9951126700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0e50 0x7f994c0c5bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f993c009fb0 tx=0x7f993c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:22.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.454+0000 7f9941ffb700 1 -- 172.21.15.31:0/261367382 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c01f070 con 0x7f994c0b0e50 2023-10-09T06:21:22.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.454+0000 7f9941ffb700 1 -- 172.21.15.31:0/261367382 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c000bc0 con 0x7f994c0b0e50 2023-10-09T06:21:22.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.454+0000 7f9953b8b700 1 -- 172.21.15.31:0/261367382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c009420 con 0x7f994c0b0e50 2023-10-09T06:21:22.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.454+0000 7f9941ffb700 1 -- 172.21.15.31:0/261367382 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00bb60 con 0x7f994c0b0e50 2023-10-09T06:21:22.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.454+0000 7f9953b8b700 1 -- 172.21.15.31:0/261367382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994c0c6500 con 0x7f994c0b0e50 2023-10-09T06:21:22.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.455+0000 7f9953b8b700 1 -- 172.21.15.31:0/261367382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994c0c6350 con 0x7f994c0b0e50 2023-10-09T06:21:22.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.455+0000 7f9941ffb700 1 -- 172.21.15.31:0/261367382 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f993c023070 con 0x7f994c0b0e50 2023-10-09T06:21:22.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.456+0000 7f9941ffb700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9930066f30 0x7f99300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.456+0000 7f9941ffb700 1 -- 172.21.15.31:0/261367382 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f993c085790 con 0x7f994c0b0e50 2023-10-09T06:21:22.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.456+0000 7f9951927700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9930066f30 0x7f99300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.456+0000 7f9951927700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9930066f30 0x7f99300693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9948009f40 tx=0x7f99480091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:22.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.460+0000 7f9941ffb700 1 -- 172.21.15.31:0/261367382 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f993c052a10 con 0x7f994c0b0e50 2023-10-09T06:21:22.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.653+0000 7f9953b8b700 1 -- 172.21.15.31:0/261367382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f994c0c6720 con 0x7f994c0b0e50 2023-10-09T06:21:22.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.653+0000 7f9941ffb700 1 -- 172.21.15.31:0/261367382 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f993c015090 con 0x7f994c0b0e50 2023-10-09T06:21:22.653 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:22.653 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:55.693313+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:22.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.655+0000 7f9953b8b700 1 -- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9930066f30 msgr2=0x7f99300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.655+0000 7f9953b8b700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9930066f30 0x7f99300693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9948009f40 tx=0x7f99480091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.655+0000 7f9953b8b700 1 -- 172.21.15.31:0/261367382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0e50 msgr2=0x7f994c0c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.655+0000 7f9953b8b700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0e50 0x7f994c0c5bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f993c009fb0 tx=0x7f993c017000 comp rx=0 tx=0).stop 2023-10-09T06:21:22.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.655+0000 7f9953b8b700 1 -- 172.21.15.31:0/261367382 shutdown_connections 2023-10-09T06:21:22.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.656+0000 7f9953b8b700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9930066f30 0x7f99300693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.656+0000 7f9953b8b700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f994c06dad0 0x7f994c15a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.656+0000 7f9953b8b700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f994c0b1220 0x7f994c141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.656+0000 7f9953b8b700 1 --2- 172.21.15.31:0/261367382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0e50 0x7f994c0c5bf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.656+0000 7f9953b8b700 1 -- 172.21.15.31:0/261367382 >> 172.21.15.31:0/261367382 conn(0x7f994c069870 msgr2=0x7f994c0cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:22.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.656+0000 7f9953b8b700 1 -- 172.21.15.31:0/261367382 shutdown_connections 2023-10-09T06:21:22.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.656+0000 7f9953b8b700 1 -- 172.21.15.31:0/261367382 wait complete. 2023-10-09T06:21:22.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:20:52.621337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:20:53.053532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:21:22.668 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:21:22.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.790+0000 7f26a0562700 1 Processor -- start 2023-10-09T06:21:22.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.790+0000 7f26a0562700 1 -- start start 2023-10-09T06:21:22.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.791+0000 7f26a0562700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2698159ec0 0x7f26980af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.791+0000 7f26a0562700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f269806acb0 0x7f26980afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.791+0000 7f26a0562700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26980b0790 con 0x7f269815a290 2023-10-09T06:21:22.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.791+0000 7f26a0562700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26980ce1f0 con 0x7f2698159ec0 2023-10-09T06:21:22.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.791+0000 7f26a0562700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26980b0b20 con 0x7f269806acb0 2023-10-09T06:21:22.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.791+0000 7f269eaff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f269806acb0 0x7f26980afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.791+0000 7f269e2fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2698159ec0 0x7f26980af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.791+0000 7f269dafd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f269815a290 0x7f269806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:36838/0 (socket says 172.21.15.31:36838) 2023-10-09T06:21:22.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.791+0000 7f269dafd700 1 -- 172.21.15.31:0/1407727585 learned_addr learned my addr 172.21.15.31:0/1407727585 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:22.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.791+0000 7f269e2fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2698159ec0 0x7f26980af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:38182/0 (socket says 172.21.15.31:38182) 2023-10-09T06:21:22.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.791+0000 7f269e2fe700 1 -- 172.21.15.31:0/1407727585 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f269806acb0 msgr2=0x7f26980afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.791+0000 7f269e2fe700 1 --2- 172.21.15.31:0/1407727585 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f269806acb0 0x7f26980afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.792+0000 7f269e2fe700 1 -- 172.21.15.31:0/1407727585 >> v1:172.21.15.158:6789/0 conn(0x7f269815a290 legacy=0x7f269806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.792+0000 7f269d2fc700 1 -- 172.21.15.31:0/1407727585 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63229980 0 0) 0x7f26980b0790 con 0x7f269815a290 2023-10-09T06:21:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.792+0000 7f269e2fe700 1 -- 172.21.15.31:0/1407727585 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26980b04b0 con 0x7f2698159ec0 2023-10-09T06:21:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.792+0000 7f269eaff700 1 --2- 172.21.15.31:0/1407727585 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f269806acb0 0x7f26980afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.792+0000 7f269e2fe700 1 --2- 172.21.15.31:0/1407727585 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2698159ec0 0x7f26980af940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26940098e0 tx=0x7f26940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afc7db9695263e80 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.792+0000 7f269d2fc700 1 -- 172.21.15.31:0/1407727585 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400b640 con 0x7f2698159ec0 2023-10-09T06:21:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.792+0000 7f269d2fc700 1 -- 172.21.15.31:0/1407727585 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269400b7a0 con 0x7f2698159ec0 2023-10-09T06:21:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.792+0000 7f269d2fc700 1 -- 172.21.15.31:0/1407727585 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400bb40 con 0x7f2698159ec0 2023-10-09T06:21:22.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.792+0000 7f26a0562700 1 -- 172.21.15.31:0/1407727585 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2698159ec0 msgr2=0x7f26980af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.792+0000 7f26a0562700 1 --2- 172.21.15.31:0/1407727585 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2698159ec0 0x7f26980af940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26940098e0 tx=0x7f26940091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.792+0000 7f26a0562700 1 -- 172.21.15.31:0/1407727585 shutdown_connections 2023-10-09T06:21:22.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.792+0000 7f26a0562700 1 --2- 172.21.15.31:0/1407727585 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2698159ec0 0x7f26980af940 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.793+0000 7f26a0562700 1 --2- 172.21.15.31:0/1407727585 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f269806acb0 0x7f26980afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.793+0000 7f26a0562700 1 -- 172.21.15.31:0/1407727585 >> 172.21.15.31:0/1407727585 conn(0x7f26980d1880 msgr2=0x7f26980cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:22.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.793+0000 7f26a0562700 1 -- 172.21.15.31:0/1407727585 shutdown_connections 2023-10-09T06:21:22.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.793+0000 7f26a0562700 1 -- 172.21.15.31:0/1407727585 wait complete. 2023-10-09T06:21:22.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.794+0000 7f26a0562700 1 Processor -- start 2023-10-09T06:21:22.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.794+0000 7f26a0562700 1 -- start start 2023-10-09T06:21:22.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.794+0000 7f26a0562700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f269806acb0 0x7f2698159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.794+0000 7f26a0562700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2698159ec0 0x7f269816b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.794+0000 7f26a0562700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f269815a290 0x7f269816d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.794+0000 7f26a0562700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269816d960 con 0x7f269815a290 2023-10-09T06:21:22.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.794+0000 7f26a0562700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26980c83c0 con 0x7f2698159ec0 2023-10-09T06:21:22.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.794+0000 7f26a0562700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2698157a30 con 0x7f269806acb0 2023-10-09T06:21:22.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.794+0000 7f269eaff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f269815a290 0x7f269816d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f269eaff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f269815a290 0x7f269816d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54222/0 (socket says 172.21.15.31:54222) 2023-10-09T06:21:22.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f269eaff700 1 -- 172.21.15.31:0/4113613127 learned_addr learned my addr 172.21.15.31:0/4113613127 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:22.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f269dafd700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2698159ec0 0x7f269816b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f269e2fe700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f269806acb0 0x7f2698159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f269eaff700 1 -- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f269806acb0 msgr2=0x7f2698159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f269eaff700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f269806acb0 0x7f2698159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f269eaff700 1 -- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2698159ec0 msgr2=0x7f269816b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f269eaff700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2698159ec0 0x7f269816b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f269eaff700 1 -- 172.21.15.31:0/4113613127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2690009a20 con 0x7f269815a290 2023-10-09T06:21:22.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f269eaff700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f269815a290 0x7f269816d420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2690009f60 tx=0x7f269000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:22.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f268e7fc700 1 -- 172.21.15.31:0/4113613127 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269000cb70 con 0x7f269815a290 2023-10-09T06:21:22.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f268e7fc700 1 -- 172.21.15.31:0/4113613127 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269000f040 con 0x7f269815a290 2023-10-09T06:21:22.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f26a0562700 1 -- 172.21.15.31:0/4113613127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2694009420 con 0x7f269815a290 2023-10-09T06:21:22.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f268e7fc700 1 -- 172.21.15.31:0/4113613127 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690014480 con 0x7f269815a290 2023-10-09T06:21:22.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.795+0000 7f26a0562700 1 -- 172.21.15.31:0/4113613127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2698157ff0 con 0x7f269815a290 2023-10-09T06:21:22.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.796+0000 7f26a0562700 1 -- 172.21.15.31:0/4113613127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269804c3c0 con 0x7f269815a290 2023-10-09T06:21:22.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.797+0000 7f268e7fc700 1 -- 172.21.15.31:0/4113613127 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26900147f0 con 0x7f269815a290 2023-10-09T06:21:22.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.797+0000 7f268e7fc700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f267c066f30 0x7f267c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:22.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.797+0000 7f268e7fc700 1 -- 172.21.15.31:0/4113613127 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f26900851c0 con 0x7f269815a290 2023-10-09T06:21:22.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.797+0000 7f269e2fe700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f267c066f30 0x7f267c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:22.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.798+0000 7f269e2fe700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f267c066f30 0x7f267c0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f26940093f0 tx=0x7f2694017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:22.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.801+0000 7f268e7fc700 1 -- 172.21.15.31:0/4113613127 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2690052430 con 0x7f269815a290 2023-10-09T06:21:22.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.993+0000 7f26a0562700 1 -- 172.21.15.31:0/4113613127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26980ceab0 con 0x7f269815a290 2023-10-09T06:21:22.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.993+0000 7f268e7fc700 1 -- 172.21.15.31:0/4113613127 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2690055a50 con 0x7f269815a290 2023-10-09T06:21:22.993 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:21:22.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.995+0000 7f26a0562700 1 -- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f267c066f30 msgr2=0x7f267c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.995+0000 7f26a0562700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f267c066f30 0x7f267c0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f26940093f0 tx=0x7f2694017000 comp rx=0 tx=0).stop 2023-10-09T06:21:22.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.995+0000 7f26a0562700 1 -- 172.21.15.31:0/4113613127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f269815a290 msgr2=0x7f269816d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:22.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.995+0000 7f26a0562700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f269815a290 0x7f269816d420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2690009f60 tx=0x7f269000b040 comp rx=0 tx=0).stop 2023-10-09T06:21:22.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.995+0000 7f26a0562700 1 -- 172.21.15.31:0/4113613127 shutdown_connections 2023-10-09T06:21:22.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.995+0000 7f26a0562700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f267c066f30 0x7f267c0693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.995+0000 7f26a0562700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f269806acb0 0x7f2698159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.995+0000 7f26a0562700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f269815a290 0x7f269816d420 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.995+0000 7f26a0562700 1 --2- 172.21.15.31:0/4113613127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2698159ec0 0x7f269816b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:22.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.995+0000 7f26a0562700 1 -- 172.21.15.31:0/4113613127 >> 172.21.15.31:0/4113613127 conn(0x7f26980d1880 msgr2=0x7f26980b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:22.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.995+0000 7f26a0562700 1 -- 172.21.15.31:0/4113613127 shutdown_connections 2023-10-09T06:21:22.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:22.995+0000 7f26a0562700 1 -- 172.21.15.31:0/4113613127 wait complete. 2023-10-09T06:21:23.007 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:21:23.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.129+0000 7f00ed824700 1 Processor -- start 2023-10-09T06:21:23.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.129+0000 7f00ed824700 1 -- start start 2023-10-09T06:21:23.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.129+0000 7f00ed824700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00e80d05a0 0x7f00e8164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.129+0000 7f00ed824700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e80b0790 con 0x7f00e8159ec0 2023-10-09T06:21:23.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.129+0000 7f00ed824700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e80ce1f0 con 0x7f00e815a290 2023-10-09T06:21:23.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.129+0000 7f00ed824700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e80b0b20 con 0x7f00e80d05a0 2023-10-09T06:21:23.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.130+0000 7f00e77fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00e80d05a0 0x7f00e8164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.130+0000 7f00e6ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f00e8159ec0 0x7f00e80af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33590/0 (socket says 172.21.15.31:33590) 2023-10-09T06:21:23.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.130+0000 7f00e6ffd700 1 -- 172.21.15.31:0/439785549 learned_addr learned my addr 172.21.15.31:0/439785549 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:23.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.130+0000 7f00e77fe700 1 -- 172.21.15.31:0/439785549 >> v1:172.21.15.158:6789/0 conn(0x7f00e815a290 legacy=0x7f00e806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.130+0000 7f00e77fe700 1 -- 172.21.15.31:0/439785549 >> v1:172.21.15.31:6789/0 conn(0x7f00e8159ec0 legacy=0x7f00e80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.130+0000 7f00e5ffb700 1 -- 172.21.15.31:0/439785549 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185258249 0 0) 0x7f00e80ce1f0 con 0x7f00e815a290 2023-10-09T06:21:23.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.130+0000 7f00e77fe700 1 -- 172.21.15.31:0/439785549 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e80b04b0 con 0x7f00e80d05a0 2023-10-09T06:21:23.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.130+0000 7f00e77fe700 1 --2- 172.21.15.31:0/439785549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00e80d05a0 0x7f00e8164ed0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009e60 tx=0x7f00d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332dbfb9b4565190 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.130+0000 7f00e5ffb700 1 -- 172.21.15.31:0/439785549 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d800e070 con 0x7f00e80d05a0 2023-10-09T06:21:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.130+0000 7f00e5ffb700 1 -- 172.21.15.31:0/439785549 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d800bb30 con 0x7f00e80d05a0 2023-10-09T06:21:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.130+0000 7f00e5ffb700 1 -- 172.21.15.31:0/439785549 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d800bed0 con 0x7f00e80d05a0 2023-10-09T06:21:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.131+0000 7f00ed824700 1 -- 172.21.15.31:0/439785549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00e80d05a0 msgr2=0x7f00e8164ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.131+0000 7f00ed824700 1 --2- 172.21.15.31:0/439785549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00e80d05a0 0x7f00e8164ed0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009e60 tx=0x7f00d8009780 comp rx=0 tx=0).stop 2023-10-09T06:21:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.131+0000 7f00ed824700 1 -- 172.21.15.31:0/439785549 shutdown_connections 2023-10-09T06:21:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.131+0000 7f00ed824700 1 --2- 172.21.15.31:0/439785549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00e80d05a0 0x7f00e8164ed0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.131+0000 7f00ed824700 1 -- 172.21.15.31:0/439785549 >> 172.21.15.31:0/439785549 conn(0x7f00e80d1880 msgr2=0x7f00e80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.131+0000 7f00ed824700 1 -- 172.21.15.31:0/439785549 shutdown_connections 2023-10-09T06:21:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.131+0000 7f00ed824700 1 -- 172.21.15.31:0/439785549 wait complete. 2023-10-09T06:21:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.132+0000 7f00ed824700 1 Processor -- start 2023-10-09T06:21:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.132+0000 7f00ed824700 1 -- start start 2023-10-09T06:21:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00ed824700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00e80d05a0 0x7f00e814fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00ed824700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00e8159ec0 0x7f00e8159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00ed824700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00e815a290 0x7f00e8154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00ed824700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80b2960 con 0x7f00e815a290 2023-10-09T06:21:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00ed824700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8157c20 con 0x7f00e80d05a0 2023-10-09T06:21:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00ed824700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8157660 con 0x7f00e8159ec0 2023-10-09T06:21:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00e77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00e815a290 0x7f00e8154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00e77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00e815a290 0x7f00e8154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54236/0 (socket says 172.21.15.31:54236) 2023-10-09T06:21:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00e77fe700 1 -- 172.21.15.31:0/1965447142 learned_addr learned my addr 172.21.15.31:0/1965447142 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00e6ffd700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00e80d05a0 0x7f00e814fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00e67fc700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00e8159ec0 0x7f00e8159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00e77fe700 1 -- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00e8159ec0 msgr2=0x7f00e8159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00e77fe700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00e8159ec0 0x7f00e8159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00e77fe700 1 -- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00e80d05a0 msgr2=0x7f00e814fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00e77fe700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00e80d05a0 0x7f00e814fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00e77fe700 1 -- 172.21.15.31:0/1965447142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d8009a20 con 0x7f00e815a290 2023-10-09T06:21:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00e77fe700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00e815a290 0x7f00e8154a80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f00d8003000 tx=0x7f00d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.133+0000 7f00deffd700 1 -- 172.21.15.31:0/1965447142 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d800be90 con 0x7f00e815a290 2023-10-09T06:21:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.134+0000 7f00deffd700 1 -- 172.21.15.31:0/1965447142 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d801d630 con 0x7f00e815a290 2023-10-09T06:21:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.134+0000 7f00ed824700 1 -- 172.21.15.31:0/1965447142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e8157940 con 0x7f00e815a290 2023-10-09T06:21:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.134+0000 7f00deffd700 1 -- 172.21.15.31:0/1965447142 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d801d9f0 con 0x7f00e815a290 2023-10-09T06:21:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.134+0000 7f00ed824700 1 -- 172.21.15.31:0/1965447142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e81500a0 con 0x7f00e815a290 2023-10-09T06:21:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.135+0000 7f00ed824700 1 -- 172.21.15.31:0/1965447142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e80b2450 con 0x7f00e815a290 2023-10-09T06:21:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.135+0000 7f00deffd700 1 -- 172.21.15.31:0/1965447142 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00d80303f0 con 0x7f00e815a290 2023-10-09T06:21:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.135+0000 7f00deffd700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f00c8066f30 0x7f00c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.135+0000 7f00deffd700 1 -- 172.21.15.31:0/1965447142 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00d8086b00 con 0x7f00e815a290 2023-10-09T06:21:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.136+0000 7f00e6ffd700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f00c8066f30 0x7f00c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.136+0000 7f00e6ffd700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f00c8066f30 0x7f00c80693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f00e00058d0 tx=0x7f00e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:23.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.140+0000 7f00deffd700 1 -- 172.21.15.31:0/1965447142 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00e80b2450 con 0x7f00e815a290 2023-10-09T06:21:23.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.333+0000 7f00ed824700 1 -- 172.21.15.31:0/1965447142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00e80b2450 con 0x7f00e815a290 2023-10-09T06:21:23.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.333+0000 7f00deffd700 1 -- 172.21.15.31:0/1965447142 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f00e80b2450 con 0x7f00e815a290 2023-10-09T06:21:23.333 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:21:23.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.335+0000 7f00ed824700 1 -- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f00c8066f30 msgr2=0x7f00c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.335+0000 7f00ed824700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f00c8066f30 0x7f00c80693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f00e00058d0 tx=0x7f00e0009040 comp rx=0 tx=0).stop 2023-10-09T06:21:23.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.335+0000 7f00ed824700 1 -- 172.21.15.31:0/1965447142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00e815a290 msgr2=0x7f00e8154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.335+0000 7f00ed824700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00e815a290 0x7f00e8154a80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f00d8003000 tx=0x7f00d8018000 comp rx=0 tx=0).stop 2023-10-09T06:21:23.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.335+0000 7f00ed824700 1 -- 172.21.15.31:0/1965447142 shutdown_connections 2023-10-09T06:21:23.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.335+0000 7f00ed824700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f00c8066f30 0x7f00c80693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.335+0000 7f00ed824700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00e815a290 0x7f00e8154a80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.335+0000 7f00ed824700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00e80d05a0 0x7f00e814fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.335+0000 7f00ed824700 1 --2- 172.21.15.31:0/1965447142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00e8159ec0 0x7f00e8159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.335+0000 7f00ed824700 1 -- 172.21.15.31:0/1965447142 >> 172.21.15.31:0/1965447142 conn(0x7f00e80d1880 msgr2=0x7f00e80c67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:23.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.335+0000 7f00ed824700 1 -- 172.21.15.31:0/1965447142 shutdown_connections 2023-10-09T06:21:23.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.335+0000 7f00ed824700 1 -- 172.21.15.31:0/1965447142 wait complete. 2023-10-09T06:21:23.347 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:21:23.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.468+0000 7fd017cf3700 1 Processor -- start 2023-10-09T06:21:23.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.468+0000 7fd017cf3700 1 -- start start 2023-10-09T06:21:23.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.469+0000 7fd017cf3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd0100b4860 0x7fd0100b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.469+0000 7fd017cf3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0100b14f0 con 0x7fd0100b3570 2023-10-09T06:21:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.469+0000 7fd017cf3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0100b17d0 con 0x7fd0100b4c30 2023-10-09T06:21:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.469+0000 7fd017cf3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0100b1ab0 con 0x7fd0100b4860 2023-10-09T06:21:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.469+0000 7fd015a8f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd0100b4860 0x7fd0100b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.469+0000 7fd016290700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd0100b3570 0x7fd0100cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33598/0 (socket says 172.21.15.31:33598) 2023-10-09T06:21:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.469+0000 7fd016290700 1 -- 172.21.15.31:0/4292039714 learned_addr learned my addr 172.21.15.31:0/4292039714 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.470+0000 7fd015a8f700 1 -- 172.21.15.31:0/4292039714 >> v1:172.21.15.158:6789/0 conn(0x7fd0100b4c30 legacy=0x7fd010159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.470+0000 7fd015a8f700 1 -- 172.21.15.31:0/4292039714 >> v1:172.21.15.31:6789/0 conn(0x7fd0100b3570 legacy=0x7fd0100cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.470+0000 7fd015a8f700 1 -- 172.21.15.31:0/4292039714 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0100b1d90 con 0x7fd0100b4860 2023-10-09T06:21:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.470+0000 7fd015a8f700 1 --2- 172.21.15.31:0/4292039714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0100b4860 0x7fd0100b6700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd0080098d0 tx=0x7fd008009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4af2d145ecbcfe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.470+0000 7fd014a8d700 1 -- 172.21.15.31:0/4292039714 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008009e70 con 0x7fd0100b4860 2023-10-09T06:21:23.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.470+0000 7fd014a8d700 1 -- 172.21.15.31:0/4292039714 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd008005c10 con 0x7fd0100b4860 2023-10-09T06:21:23.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.470+0000 7fd014a8d700 1 -- 172.21.15.31:0/4292039714 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00800b6e0 con 0x7fd0100b4860 2023-10-09T06:21:23.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.470+0000 7fd017cf3700 1 -- 172.21.15.31:0/4292039714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0100b4860 msgr2=0x7fd0100b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.470+0000 7fd017cf3700 1 --2- 172.21.15.31:0/4292039714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0100b4860 0x7fd0100b6700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd0080098d0 tx=0x7fd008009120 comp rx=0 tx=0).stop 2023-10-09T06:21:23.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.471+0000 7fd017cf3700 1 -- 172.21.15.31:0/4292039714 shutdown_connections 2023-10-09T06:21:23.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.471+0000 7fd017cf3700 1 --2- 172.21.15.31:0/4292039714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0100b4860 0x7fd0100b6700 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.471+0000 7fd017cf3700 1 -- 172.21.15.31:0/4292039714 >> 172.21.15.31:0/4292039714 conn(0x7fd01009a0f0 msgr2=0x7fd010067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:23.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.471+0000 7fd017cf3700 1 -- 172.21.15.31:0/4292039714 shutdown_connections 2023-10-09T06:21:23.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.471+0000 7fd017cf3700 1 -- 172.21.15.31:0/4292039714 wait complete. 2023-10-09T06:21:23.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.472+0000 7fd017cf3700 1 Processor -- start 2023-10-09T06:21:23.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.472+0000 7fd017cf3700 1 -- start start 2023-10-09T06:21:23.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.472+0000 7fd017cf3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0100b3570 0x7fd01014b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.472+0000 7fd017cf3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0100b4860 0x7fd0100adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.472+0000 7fd017cf3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0100b4c30 0x7fd0100ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.472+0000 7fd017cf3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01009be10 con 0x7fd0100b4860 2023-10-09T06:21:23.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.472+0000 7fd017cf3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01009b510 con 0x7fd0100b3570 2023-10-09T06:21:23.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.472+0000 7fd017cf3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01009d550 con 0x7fd0100b4c30 2023-10-09T06:21:23.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.472+0000 7fd01528e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0100b4860 0x7fd0100adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd01528e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0100b4860 0x7fd0100adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54256/0 (socket says 172.21.15.31:54256) 2023-10-09T06:21:23.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd01528e700 1 -- 172.21.15.31:0/2036731423 learned_addr learned my addr 172.21.15.31:0/2036731423 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:23.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd015a8f700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0100b3570 0x7fd01014b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd016290700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0100b4c30 0x7fd0100ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd01528e700 1 -- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0100b4c30 msgr2=0x7fd0100ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd01528e700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0100b4c30 0x7fd0100ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd01528e700 1 -- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0100b3570 msgr2=0x7fd01014b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd01528e700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0100b3570 0x7fd01014b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd01528e700 1 -- 172.21.15.31:0/2036731423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0080093c0 con 0x7fd0100b4860 2023-10-09T06:21:23.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd016290700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0100b4c30 0x7fd0100ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:23.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd01528e700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0100b4860 0x7fd0100adde0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd00400b5e0 tx=0x7fd004009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:23.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd00dffb700 1 -- 172.21.15.31:0/2036731423 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400f510 con 0x7fd0100b4860 2023-10-09T06:21:23.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd00dffb700 1 -- 172.21.15.31:0/2036731423 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00400f670 con 0x7fd0100b4860 2023-10-09T06:21:23.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd017cf3700 1 -- 172.21.15.31:0/2036731423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01009b7c0 con 0x7fd0100b4860 2023-10-09T06:21:23.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd00dffb700 1 -- 172.21.15.31:0/2036731423 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400fa30 con 0x7fd0100b4860 2023-10-09T06:21:23.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.473+0000 7fd017cf3700 1 -- 172.21.15.31:0/2036731423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0100ac020 con 0x7fd0100b4860 2023-10-09T06:21:23.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.474+0000 7fd017cf3700 1 -- 172.21.15.31:0/2036731423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01009bfc0 con 0x7fd0100b4860 2023-10-09T06:21:23.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.475+0000 7fd00dffb700 1 -- 172.21.15.31:0/2036731423 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd00401a400 con 0x7fd0100b4860 2023-10-09T06:21:23.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.475+0000 7fd00dffb700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcffc066f30 0x7fcffc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.475+0000 7fd00dffb700 1 -- 172.21.15.31:0/2036731423 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd004083f90 con 0x7fd0100b4860 2023-10-09T06:21:23.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.475+0000 7fd015a8f700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcffc066f30 0x7fcffc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.476+0000 7fd015a8f700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcffc066f30 0x7fcffc0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd008003080 tx=0x7fd008015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:23.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.480+0000 7fd00dffb700 1 -- 172.21.15.31:0/2036731423 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd01009bfc0 con 0x7fd0100b4860 2023-10-09T06:21:23.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.670+0000 7fd017cf3700 1 -- 172.21.15.31:0/2036731423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd01004c3c0 con 0x7fd0100b4860 2023-10-09T06:21:23.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.671+0000 7fd00dffb700 1 -- 172.21.15.31:0/2036731423 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd004051280 con 0x7fd0100b4860 2023-10-09T06:21:23.671 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:21:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.673+0000 7fd017cf3700 1 -- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcffc066f30 msgr2=0x7fcffc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.673+0000 7fd017cf3700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcffc066f30 0x7fcffc0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd008003080 tx=0x7fd008015000 comp rx=0 tx=0).stop 2023-10-09T06:21:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.673+0000 7fd017cf3700 1 -- 172.21.15.31:0/2036731423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0100b4860 msgr2=0x7fd0100adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.673+0000 7fd017cf3700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0100b4860 0x7fd0100adde0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd00400b5e0 tx=0x7fd004009120 comp rx=0 tx=0).stop 2023-10-09T06:21:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.673+0000 7fd017cf3700 1 -- 172.21.15.31:0/2036731423 shutdown_connections 2023-10-09T06:21:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.673+0000 7fd017cf3700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcffc066f30 0x7fcffc0693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.673+0000 7fd017cf3700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0100b4c30 0x7fd0100ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.673+0000 7fd017cf3700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0100b3570 0x7fd01014b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.673+0000 7fd017cf3700 1 --2- 172.21.15.31:0/2036731423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0100b4860 0x7fd0100adde0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.673+0000 7fd017cf3700 1 -- 172.21.15.31:0/2036731423 >> 172.21.15.31:0/2036731423 conn(0x7fd01009a0f0 msgr2=0x7fd01015cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:23.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.673+0000 7fd017cf3700 1 -- 172.21.15.31:0/2036731423 shutdown_connections 2023-10-09T06:21:23.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.673+0000 7fd017cf3700 1 -- 172.21.15.31:0/2036731423 wait complete. 2023-10-09T06:21:23.686 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:23.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.804+0000 7fb3f2df2700 1 Processor -- start 2023-10-09T06:21:23.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.805+0000 7fb3f2df2700 1 -- start start 2023-10-09T06:21:23.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.806+0000 7fb3f2df2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3ec15a620 0x7fb3ec15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.806+0000 7fb3f2df2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ec15cbb0 con 0x7fb3ec157870 2023-10-09T06:21:23.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.806+0000 7fb3f2df2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ec15bfa0 con 0x7fb3ec15d580 2023-10-09T06:21:23.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.806+0000 7fb3f2df2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec15bdb0 con 0x7fb3ec15a620 2023-10-09T06:21:23.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.806+0000 7fb3f0b8e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb3ec157870 0x7fb3ec15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33612/0 (socket says 172.21.15.31:33612) 2023-10-09T06:21:23.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.806+0000 7fb3f0b8e700 1 -- 172.21.15.31:0/1977397695 learned_addr learned my addr 172.21.15.31:0/1977397695 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:23.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.806+0000 7fb3ebfff700 1 --2- 172.21.15.31:0/1977397695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3ec15a620 0x7fb3ec15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.806+0000 7fb3ebfff700 1 -- 172.21.15.31:0/1977397695 >> v1:172.21.15.158:6789/0 conn(0x7fb3ec15d580 legacy=0x7fb3ec158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.806+0000 7fb3ebfff700 1 -- 172.21.15.31:0/1977397695 >> v1:172.21.15.31:6789/0 conn(0x7fb3ec157870 legacy=0x7fb3ec15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.806+0000 7fb3ebfff700 1 -- 172.21.15.31:0/1977397695 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec15c280 con 0x7fb3ec15a620 2023-10-09T06:21:23.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.806+0000 7fb3ebfff700 1 --2- 172.21.15.31:0/1977397695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3ec15a620 0x7fb3ec15d040 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009910 tx=0x7fb3d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc2fbf42f4aff44d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:23.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.809+0000 7fb3eb7fe700 1 -- 172.21.15.31:0/1977397695 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d800b860 con 0x7fb3ec15a620 2023-10-09T06:21:23.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.809+0000 7fb3eb7fe700 1 -- 172.21.15.31:0/1977397695 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d800b9c0 con 0x7fb3ec15a620 2023-10-09T06:21:23.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.809+0000 7fb3eb7fe700 1 -- 172.21.15.31:0/1977397695 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d800bd60 con 0x7fb3ec15a620 2023-10-09T06:21:23.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.810+0000 7fb3f2df2700 1 -- 172.21.15.31:0/1977397695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3ec15a620 msgr2=0x7fb3ec15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.810+0000 7fb3f2df2700 1 --2- 172.21.15.31:0/1977397695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3ec15a620 0x7fb3ec15d040 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009910 tx=0x7fb3d80091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.810+0000 7fb3f2df2700 1 -- 172.21.15.31:0/1977397695 shutdown_connections 2023-10-09T06:21:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.810+0000 7fb3f2df2700 1 --2- 172.21.15.31:0/1977397695 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3ec15a620 0x7fb3ec15d040 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.810+0000 7fb3f2df2700 1 -- 172.21.15.31:0/1977397695 >> 172.21.15.31:0/1977397695 conn(0x7fb3ec068ce0 msgr2=0x7fb3ec0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.810+0000 7fb3f2df2700 1 -- 172.21.15.31:0/1977397695 shutdown_connections 2023-10-09T06:21:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.810+0000 7fb3f2df2700 1 -- 172.21.15.31:0/1977397695 wait complete. 2023-10-09T06:21:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.811+0000 7fb3f2df2700 1 Processor -- start 2023-10-09T06:21:23.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.811+0000 7fb3f2df2700 1 -- start start 2023-10-09T06:21:23.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f2df2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3ec157870 0x7fb3ec14c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f2df2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3ec15a620 0x7fb3ec1520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f2df2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec15d580 0x7fb3ec14e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f2df2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec14f160 con 0x7fb3ec157870 2023-10-09T06:21:23.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f2df2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0b0df0 con 0x7fb3ec15d580 2023-10-09T06:21:23.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f2df2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0b1090 con 0x7fb3ec15a620 2023-10-09T06:21:23.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f0b8e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3ec157870 0x7fb3ec14c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f0b8e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3ec157870 0x7fb3ec14c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54270/0 (socket says 172.21.15.31:54270) 2023-10-09T06:21:23.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f0b8e700 1 -- 172.21.15.31:0/3993710847 learned_addr learned my addr 172.21.15.31:0/3993710847 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:23.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3ebfff700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3ec15a620 0x7fb3ec1520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f138f700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec15d580 0x7fb3ec14e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f0b8e700 1 -- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3ec15a620 msgr2=0x7fb3ec1520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f0b8e700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3ec15a620 0x7fb3ec1520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f0b8e700 1 -- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec15d580 msgr2=0x7fb3ec14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:23.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f0b8e700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec15d580 0x7fb3ec14e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:23.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f0b8e700 1 -- 172.21.15.31:0/3993710847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d8009420 con 0x7fb3ec157870 2023-10-09T06:21:23.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.812+0000 7fb3f0b8e700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3ec157870 0x7fb3ec14c7c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000c7c0 tx=0x7fb3e0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:23.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.813+0000 7fb3e8ff9700 1 -- 172.21.15.31:0/3993710847 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0005b30 con 0x7fb3ec157870 2023-10-09T06:21:23.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.813+0000 7fb3e8ff9700 1 -- 172.21.15.31:0/3993710847 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e0005c90 con 0x7fb3ec157870 2023-10-09T06:21:23.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.813+0000 7fb3f2df2700 1 -- 172.21.15.31:0/3993710847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ec0b1370 con 0x7fb3ec157870 2023-10-09T06:21:23.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.813+0000 7fb3e8ff9700 1 -- 172.21.15.31:0/3993710847 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0004a80 con 0x7fb3ec157870 2023-10-09T06:21:23.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.813+0000 7fb3f2df2700 1 -- 172.21.15.31:0/3993710847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ec14d900 con 0x7fb3ec157870 2023-10-09T06:21:23.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.813+0000 7fb3f2df2700 1 -- 172.21.15.31:0/3993710847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ec04c3c0 con 0x7fb3ec157870 2023-10-09T06:21:23.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.814+0000 7fb3e8ff9700 1 -- 172.21.15.31:0/3993710847 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3e00070d0 con 0x7fb3ec157870 2023-10-09T06:21:23.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.814+0000 7fb3e8ff9700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb3d0066f30 0x7fb3d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:23.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.814+0000 7fb3e8ff9700 1 -- 172.21.15.31:0/3993710847 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3e0083810 con 0x7fb3ec157870 2023-10-09T06:21:23.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.815+0000 7fb3ebfff700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb3d0066f30 0x7fb3d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:23.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.815+0000 7fb3ebfff700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb3d0066f30 0x7fb3d00693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec15aa20 tx=0x7fb3d8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:23.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:23.819+0000 7fb3e8ff9700 1 -- 172.21.15.31:0/3993710847 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3e004b5a0 con 0x7fb3ec157870 2023-10-09T06:21:24.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.012+0000 7fb3f2df2700 1 -- 172.21.15.31:0/3993710847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3ec15c560 con 0x7fb3ec157870 2023-10-09T06:21:24.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.012+0000 7fb3e8ff9700 1 -- 172.21.15.31:0/3993710847 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb3e0050a80 con 0x7fb3ec157870 2023-10-09T06:21:24.013 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:24.013 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:55.693313+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:24.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.014+0000 7fb3f2df2700 1 -- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb3d0066f30 msgr2=0x7fb3d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.014+0000 7fb3f2df2700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb3d0066f30 0x7fb3d00693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec15aa20 tx=0x7fb3d8017000 comp rx=0 tx=0).stop 2023-10-09T06:21:24.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.015+0000 7fb3f2df2700 1 -- 172.21.15.31:0/3993710847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3ec157870 msgr2=0x7fb3ec14c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.015+0000 7fb3f2df2700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3ec157870 0x7fb3ec14c7c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000c7c0 tx=0x7fb3e0007f70 comp rx=0 tx=0).stop 2023-10-09T06:21:24.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.015+0000 7fb3f2df2700 1 -- 172.21.15.31:0/3993710847 shutdown_connections 2023-10-09T06:21:24.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.015+0000 7fb3f2df2700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb3d0066f30 0x7fb3d00693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.015+0000 7fb3f2df2700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec15d580 0x7fb3ec14e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.015+0000 7fb3f2df2700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3ec157870 0x7fb3ec14c7c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.015+0000 7fb3f2df2700 1 --2- 172.21.15.31:0/3993710847 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3ec15a620 0x7fb3ec1520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.015+0000 7fb3f2df2700 1 -- 172.21.15.31:0/3993710847 >> 172.21.15.31:0/3993710847 conn(0x7fb3ec068ce0 msgr2=0x7fb3ec1595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:24.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.015+0000 7fb3f2df2700 1 -- 172.21.15.31:0/3993710847 shutdown_connections 2023-10-09T06:21:24.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.015+0000 7fb3f2df2700 1 -- 172.21.15.31:0/3993710847 wait complete. 2023-10-09T06:21:24.028 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:20:52.621337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:20:53.053532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:21:24.028 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:21:24.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.149+0000 7fd8bb07c700 1 Processor -- start 2023-10-09T06:21:24.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.149+0000 7fd8bb07c700 1 -- start start 2023-10-09T06:21:24.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8bb07c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8b40cce30 0x7fd8b415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8bb07c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8b40b6580 0x7fd8b406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8bb07c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd8b406a830 0x7fd8b415d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8bb07c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b40b4d70 con 0x7fd8b40cce30 2023-10-09T06:21:24.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8bb07c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b406ac70 con 0x7fd8b406a830 2023-10-09T06:21:24.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8bb07c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40cd8d0 con 0x7fd8b40b6580 2023-10-09T06:21:24.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8ba07a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8b40cce30 0x7fd8b415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8ba07a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8b40cce30 0x7fd8b415aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54278/0 (socket says 172.21.15.31:54278) 2023-10-09T06:21:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8ba07a700 1 -- 172.21.15.31:0/590284965 learned_addr learned my addr 172.21.15.31:0/590284965 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8b9879700 1 --2- 172.21.15.31:0/590284965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8b40b6580 0x7fd8b406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8ba07a700 1 -- 172.21.15.31:0/590284965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8b40b6580 msgr2=0x7fd8b406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8ba87b700 1 --2- 172.21.15.31:0/590284965 >> v2:172.21.15.158:3300/0 conn(0x7fd8b406a830 0x7fd8b415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8ba07a700 1 --2- 172.21.15.31:0/590284965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8b40b6580 0x7fd8b406a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8ba07a700 1 -- 172.21.15.31:0/590284965 >> v2:172.21.15.158:3300/0 conn(0x7fd8b406a830 msgr2=0x7fd8b415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8ba07a700 1 --2- 172.21.15.31:0/590284965 >> v2:172.21.15.158:3300/0 conn(0x7fd8b406a830 0x7fd8b415d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8ba07a700 1 -- 172.21.15.31:0/590284965 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b40b4440 con 0x7fd8b40cce30 2023-10-09T06:21:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8ba87b700 1 --2- 172.21.15.31:0/590284965 >> v2:172.21.15.158:3300/0 conn(0x7fd8b406a830 0x7fd8b415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.150+0000 7fd8b9879700 1 --2- 172.21.15.31:0/590284965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8b40b6580 0x7fd8b406a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:24.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.151+0000 7fd8ba07a700 1 --2- 172.21.15.31:0/590284965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b40cce30 0x7fd8b415aca0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd8b415a280 tx=0x7fd8ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbbbab554d2ad51 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:24.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.151+0000 7fd8b9078700 1 -- 172.21.15.31:0/590284965 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac00b860 con 0x7fd8b40cce30 2023-10-09T06:21:24.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.151+0000 7fd8b9078700 1 -- 172.21.15.31:0/590284965 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac00b9c0 con 0x7fd8b40cce30 2023-10-09T06:21:24.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.151+0000 7fd8b9078700 1 -- 172.21.15.31:0/590284965 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac00bd60 con 0x7fd8b40cce30 2023-10-09T06:21:24.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.151+0000 7fd8bb07c700 1 -- 172.21.15.31:0/590284965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b40cce30 msgr2=0x7fd8b415aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.151+0000 7fd8bb07c700 1 --2- 172.21.15.31:0/590284965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b40cce30 0x7fd8b415aca0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd8b415a280 tx=0x7fd8ac009250 comp rx=0 tx=0).stop 2023-10-09T06:21:24.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.151+0000 7fd8bb07c700 1 -- 172.21.15.31:0/590284965 shutdown_connections 2023-10-09T06:21:24.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.151+0000 7fd8bb07c700 1 --2- 172.21.15.31:0/590284965 >> v2:172.21.15.158:3300/0 conn(0x7fd8b406a830 0x7fd8b415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.151+0000 7fd8bb07c700 1 --2- 172.21.15.31:0/590284965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b40cce30 0x7fd8b415aca0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.151+0000 7fd8bb07c700 1 --2- 172.21.15.31:0/590284965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8b40b6580 0x7fd8b406a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.151+0000 7fd8bb07c700 1 -- 172.21.15.31:0/590284965 >> 172.21.15.31:0/590284965 conn(0x7fd8b4068cb0 msgr2=0x7fd8b40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:24.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.151+0000 7fd8bb07c700 1 -- 172.21.15.31:0/590284965 shutdown_connections 2023-10-09T06:21:24.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.151+0000 7fd8bb07c700 1 -- 172.21.15.31:0/590284965 wait complete. 2023-10-09T06:21:24.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.153+0000 7fd8bb07c700 1 Processor -- start 2023-10-09T06:21:24.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.153+0000 7fd8bb07c700 1 -- start start 2023-10-09T06:21:24.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.153+0000 7fd8bb07c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8b406a830 0x7fd8b416d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.153+0000 7fd8bb07c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b40b6580 0x7fd8b40c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.153+0000 7fd8bb07c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8b40cce30 0x7fd8b40b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.153+0000 7fd8bb07c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b416dd20 con 0x7fd8b40b6580 2023-10-09T06:21:24.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.153+0000 7fd8bb07c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b416e000 con 0x7fd8b406a830 2023-10-09T06:21:24.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.153+0000 7fd8bb07c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b416e2e0 con 0x7fd8b40cce30 2023-10-09T06:21:24.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.153+0000 7fd8b9879700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b40b6580 0x7fd8b40c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.153+0000 7fd8b9879700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b40b6580 0x7fd8b40c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54294/0 (socket says 172.21.15.31:54294) 2023-10-09T06:21:24.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.153+0000 7fd8b9879700 1 -- 172.21.15.31:0/784392063 learned_addr learned my addr 172.21.15.31:0/784392063 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:24.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.154+0000 7fd8ba07a700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8b406a830 0x7fd8b416d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.154+0000 7fd8ba87b700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8b40cce30 0x7fd8b40b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.154+0000 7fd8b9879700 1 -- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8b40cce30 msgr2=0x7fd8b40b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.154+0000 7fd8b9879700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8b40cce30 0x7fd8b40b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.154+0000 7fd8b9879700 1 -- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8b406a830 msgr2=0x7fd8b416d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.154+0000 7fd8b9879700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8b406a830 0x7fd8b416d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.154+0000 7fd8b9879700 1 -- 172.21.15.31:0/784392063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac0094f0 con 0x7fd8b40b6580 2023-10-09T06:21:24.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.154+0000 7fd8b9879700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b40b6580 0x7fd8b40c83e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800c880 tx=0x7fd8a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:24.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.154+0000 7fd8b27fc700 1 -- 172.21.15.31:0/784392063 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8011600 con 0x7fd8b40b6580 2023-10-09T06:21:24.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.154+0000 7fd8b27fc700 1 -- 172.21.15.31:0/784392063 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a8011760 con 0x7fd8b40b6580 2023-10-09T06:21:24.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.154+0000 7fd8bb07c700 1 -- 172.21.15.31:0/784392063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b40c7be0 con 0x7fd8b40b6580 2023-10-09T06:21:24.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.154+0000 7fd8b27fc700 1 -- 172.21.15.31:0/784392063 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8011ae0 con 0x7fd8b40b6580 2023-10-09T06:21:24.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.154+0000 7fd8bb07c700 1 -- 172.21.15.31:0/784392063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b416d9d0 con 0x7fd8b40b6580 2023-10-09T06:21:24.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.155+0000 7fd8bb07c700 1 -- 172.21.15.31:0/784392063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b40c8100 con 0x7fd8b40b6580 2023-10-09T06:21:24.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.155+0000 7fd8b27fc700 1 -- 172.21.15.31:0/784392063 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8a80193b0 con 0x7fd8b40b6580 2023-10-09T06:21:24.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.156+0000 7fd8b27fc700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd8a0066f30 0x7fd8a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.156+0000 7fd8b27fc700 1 -- 172.21.15.31:0/784392063 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8a8084480 con 0x7fd8b40b6580 2023-10-09T06:21:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.156+0000 7fd8ba07a700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd8a0066f30 0x7fd8a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.157+0000 7fd8ba07a700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd8a0066f30 0x7fd8a00693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd8b415a280 tx=0x7fd8ac017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.160+0000 7fd8b27fc700 1 -- 172.21.15.31:0/784392063 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8b40c8100 con 0x7fd8b40b6580 2023-10-09T06:21:24.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.351+0000 7fd8bb07c700 1 -- 172.21.15.31:0/784392063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8b40c8100 con 0x7fd8b40b6580 2023-10-09T06:21:24.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.351+0000 7fd8b27fc700 1 -- 172.21.15.31:0/784392063 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8b40c8100 con 0x7fd8b40b6580 2023-10-09T06:21:24.352 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:21:24.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.353+0000 7fd8bb07c700 1 -- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd8a0066f30 msgr2=0x7fd8a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.353+0000 7fd8bb07c700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd8a0066f30 0x7fd8a00693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd8b415a280 tx=0x7fd8ac017000 comp rx=0 tx=0).stop 2023-10-09T06:21:24.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.353+0000 7fd8bb07c700 1 -- 172.21.15.31:0/784392063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b40b6580 msgr2=0x7fd8b40c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.353+0000 7fd8bb07c700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b40b6580 0x7fd8b40c83e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800c880 tx=0x7fd8a8008040 comp rx=0 tx=0).stop 2023-10-09T06:21:24.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.353+0000 7fd8bb07c700 1 -- 172.21.15.31:0/784392063 shutdown_connections 2023-10-09T06:21:24.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.353+0000 7fd8bb07c700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd8a0066f30 0x7fd8a00693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.353+0000 7fd8bb07c700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8b40cce30 0x7fd8b40b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.353+0000 7fd8bb07c700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8b406a830 0x7fd8b416d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.353+0000 7fd8bb07c700 1 --2- 172.21.15.31:0/784392063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b40b6580 0x7fd8b40c83e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.353+0000 7fd8bb07c700 1 -- 172.21.15.31:0/784392063 >> 172.21.15.31:0/784392063 conn(0x7fd8b4068cb0 msgr2=0x7fd8b415a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:24.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.353+0000 7fd8bb07c700 1 -- 172.21.15.31:0/784392063 shutdown_connections 2023-10-09T06:21:24.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.353+0000 7fd8bb07c700 1 -- 172.21.15.31:0/784392063 wait complete. 2023-10-09T06:21:24.367 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:21:24.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.488+0000 7fc3fe48c700 1 Processor -- start 2023-10-09T06:21:24.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.488+0000 7fc3fe48c700 1 -- start start 2023-10-09T06:21:24.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3fe48c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3f80b6580 0x7fc3f806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3fe48c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc3f806a830 0x7fc3f80b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3fe48c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f806ac90 con 0x7fc3f80cce30 2023-10-09T06:21:24.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3fe48c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f80b4d70 con 0x7fc3f80b6580 2023-10-09T06:21:24.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3fe48c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f815b3b0 con 0x7fc3f806a830 2023-10-09T06:21:24.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3fcc89700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3f80b6580 0x7fc3f806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3fd48a700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc3f80cce30 0x7fc3f815aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33616/0 (socket says 172.21.15.31:33616) 2023-10-09T06:21:24.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3fd48a700 1 -- 172.21.15.31:0/858197024 learned_addr learned my addr 172.21.15.31:0/858197024 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:24.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3fdc8b700 1 --2- 172.21.15.31:0/858197024 >> v2:172.21.15.158:3300/0 conn(0x7fc3f806a830 0x7fc3f80b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3fcc89700 1 -- 172.21.15.31:0/858197024 >> v2:172.21.15.158:3300/0 conn(0x7fc3f806a830 msgr2=0x7fc3f80b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:24.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3fcc89700 1 --2- 172.21.15.31:0/858197024 >> v2:172.21.15.158:3300/0 conn(0x7fc3f806a830 0x7fc3f80b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3fcc89700 1 -- 172.21.15.31:0/858197024 >> v1:172.21.15.31:6789/0 conn(0x7fc3f80cce30 legacy=0x7fc3f815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3fcc89700 1 -- 172.21.15.31:0/858197024 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f80cd8d0 con 0x7fc3f80b6580 2023-10-09T06:21:24.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.489+0000 7fc3f7fff700 1 -- 172.21.15.31:0/858197024 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739032991 0 0) 0x7fc3f0001110 con 0x7fc3f80cce30 2023-10-09T06:21:24.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.490+0000 7fc3fcc89700 1 --2- 172.21.15.31:0/858197024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3f80b6580 0x7fc3f806a2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80b4ce0 tx=0x7fc3ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170fcc5e4025c820 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:24.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.490+0000 7fc3f7fff700 1 -- 172.21.15.31:0/858197024 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec00b6b0 con 0x7fc3f80b6580 2023-10-09T06:21:24.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.490+0000 7fc3f7fff700 1 -- 172.21.15.31:0/858197024 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec00b810 con 0x7fc3f80b6580 2023-10-09T06:21:24.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.490+0000 7fc3f7fff700 1 -- 172.21.15.31:0/858197024 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec00bbb0 con 0x7fc3f80b6580 2023-10-09T06:21:24.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.490+0000 7fc3fe48c700 1 -- 172.21.15.31:0/858197024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3f80b6580 msgr2=0x7fc3f806a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.490+0000 7fc3fe48c700 1 --2- 172.21.15.31:0/858197024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3f80b6580 0x7fc3f806a2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80b4ce0 tx=0x7fc3ec0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.490+0000 7fc3fe48c700 1 -- 172.21.15.31:0/858197024 shutdown_connections 2023-10-09T06:21:24.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.490+0000 7fc3fe48c700 1 --2- 172.21.15.31:0/858197024 >> v2:172.21.15.158:3300/0 conn(0x7fc3f806a830 0x7fc3f80b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.490+0000 7fc3fe48c700 1 --2- 172.21.15.31:0/858197024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3f80b6580 0x7fc3f806a2f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.490+0000 7fc3fe48c700 1 -- 172.21.15.31:0/858197024 >> 172.21.15.31:0/858197024 conn(0x7fc3f8068cb0 msgr2=0x7fc3f80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:24.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.490+0000 7fc3fe48c700 1 -- 172.21.15.31:0/858197024 shutdown_connections 2023-10-09T06:21:24.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.490+0000 7fc3fe48c700 1 -- 172.21.15.31:0/858197024 wait complete. 2023-10-09T06:21:24.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.491+0000 7fc3fe48c700 1 Processor -- start 2023-10-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.492+0000 7fc3fe48c700 1 -- start start 2023-10-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.492+0000 7fc3fe48c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3f806a830 0x7fc3f813e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.492+0000 7fc3fe48c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3f80b6580 0x7fc3f815c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.492+0000 7fc3fe48c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3f80cce30 0x7fc3f815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.492+0000 7fc3fe48c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f8154700 con 0x7fc3f80cce30 2023-10-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.492+0000 7fc3fe48c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f81575b0 con 0x7fc3f806a830 2023-10-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.492+0000 7fc3fe48c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f813eed0 con 0x7fc3f80b6580 2023-10-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.492+0000 7fc3fdc8b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3f80cce30 0x7fc3f815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3fdc8b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3f80cce30 0x7fc3f815cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54320/0 (socket says 172.21.15.31:54320) 2023-10-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3fdc8b700 1 -- 172.21.15.31:0/2727917219 learned_addr learned my addr 172.21.15.31:0/2727917219 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3fcc89700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3f80b6580 0x7fc3f815c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3fd48a700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3f806a830 0x7fc3f813e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3fdc8b700 1 -- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3f80b6580 msgr2=0x7fc3f815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3fdc8b700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3f80b6580 0x7fc3f815c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3fdc8b700 1 -- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3f806a830 msgr2=0x7fc3f813e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3fdc8b700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3f806a830 0x7fc3f813e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3fdc8b700 1 -- 172.21.15.31:0/2727917219 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec009420 con 0x7fc3f80cce30 2023-10-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3fdc8b700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3f80cce30 0x7fc3f815cae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009fa0 tx=0x7fc3e8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3f57fa700 1 -- 172.21.15.31:0/2727917219 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e800ebc0 con 0x7fc3f80cce30 2023-10-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3f57fa700 1 -- 172.21.15.31:0/2727917219 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e800ed20 con 0x7fc3f80cce30 2023-10-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3fe48c700 1 -- 172.21.15.31:0/2727917219 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f8154140 con 0x7fc3f80cce30 2023-10-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3f57fa700 1 -- 172.21.15.31:0/2727917219 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8014670 con 0x7fc3f80cce30 2023-10-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.493+0000 7fc3fe48c700 1 -- 172.21.15.31:0/2727917219 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f813eb60 con 0x7fc3f80cce30 2023-10-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.494+0000 7fc3fe48c700 1 -- 172.21.15.31:0/2727917219 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f813e9c0 con 0x7fc3f80cce30 2023-10-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.495+0000 7fc3f57fa700 1 -- 172.21.15.31:0/2727917219 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3e80149e0 con 0x7fc3f80cce30 2023-10-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.495+0000 7fc3f57fa700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc3e4066f30 0x7fc3e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.495+0000 7fc3f57fa700 1 -- 172.21.15.31:0/2727917219 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc3e8084bd0 con 0x7fc3f80cce30 2023-10-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.495+0000 7fc3fd48a700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc3e4066f30 0x7fc3e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.496+0000 7fc3fd48a700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc3e4066f30 0x7fc3e40693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0007160 tx=0x7fc3f0007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:24.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.499+0000 7fc3f57fa700 1 -- 172.21.15.31:0/2727917219 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3f813e9c0 con 0x7fc3f80cce30 2023-10-09T06:21:24.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.690+0000 7fc3fe48c700 1 -- 172.21.15.31:0/2727917219 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3f813e9c0 con 0x7fc3f80cce30 2023-10-09T06:21:24.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.691+0000 7fc3f57fa700 1 -- 172.21.15.31:0/2727917219 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3f813e9c0 con 0x7fc3f80cce30 2023-10-09T06:21:24.691 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:21:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.693+0000 7fc3fe48c700 1 -- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc3e4066f30 msgr2=0x7fc3e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.693+0000 7fc3fe48c700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc3e4066f30 0x7fc3e40693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0007160 tx=0x7fc3f0007f50 comp rx=0 tx=0).stop 2023-10-09T06:21:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.693+0000 7fc3fe48c700 1 -- 172.21.15.31:0/2727917219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3f80cce30 msgr2=0x7fc3f815cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.693+0000 7fc3fe48c700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3f80cce30 0x7fc3f815cae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009fa0 tx=0x7fc3e8009900 comp rx=0 tx=0).stop 2023-10-09T06:21:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.693+0000 7fc3fe48c700 1 -- 172.21.15.31:0/2727917219 shutdown_connections 2023-10-09T06:21:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.693+0000 7fc3fe48c700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc3e4066f30 0x7fc3e40693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.693+0000 7fc3fe48c700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3f80cce30 0x7fc3f815cae0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.693+0000 7fc3fe48c700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3f806a830 0x7fc3f813e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.693+0000 7fc3fe48c700 1 --2- 172.21.15.31:0/2727917219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3f80b6580 0x7fc3f815c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.693+0000 7fc3fe48c700 1 -- 172.21.15.31:0/2727917219 >> 172.21.15.31:0/2727917219 conn(0x7fc3f8068cb0 msgr2=0x7fc3f80d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.693+0000 7fc3fe48c700 1 -- 172.21.15.31:0/2727917219 shutdown_connections 2023-10-09T06:21:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.693+0000 7fc3fe48c700 1 -- 172.21.15.31:0/2727917219 wait complete. 2023-10-09T06:21:24.706 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:21:24.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.828+0000 7ffb9531f700 1 Processor -- start 2023-10-09T06:21:24.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.828+0000 7ffb9531f700 1 -- start start 2023-10-09T06:21:24.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.829+0000 7ffb9531f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffb90159ec0 0x7ffb900af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.829+0000 7ffb9531f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ffb9006acb0 0x7ffb900afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.829+0000 7ffb9531f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb900b0790 con 0x7ffb9015a290 2023-10-09T06:21:24.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.829+0000 7ffb9531f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb900ce1f0 con 0x7ffb90159ec0 2023-10-09T06:21:24.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.829+0000 7ffb9531f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb900b0b20 con 0x7ffb9006acb0 2023-10-09T06:21:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.829+0000 7ffb8effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffb90159ec0 0x7ffb900af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.829+0000 7ffb8e7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ffb9015a290 0x7ffb9006a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33628/0 (socket says 172.21.15.31:33628) 2023-10-09T06:21:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.829+0000 7ffb8e7fc700 1 -- 172.21.15.31:0/129472406 learned_addr learned my addr 172.21.15.31:0/129472406 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.830+0000 7ffb8effd700 1 -- 172.21.15.31:0/129472406 >> v2:172.21.15.158:3300/0 conn(0x7ffb9006acb0 msgr2=0x7ffb900afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.830+0000 7ffb8f7fe700 1 --2- 172.21.15.31:0/129472406 >> v2:172.21.15.158:3300/0 conn(0x7ffb9006acb0 0x7ffb900afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.830+0000 7ffb8dffb700 1 -- 172.21.15.31:0/129472406 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151260714 0 0) 0x7ffb900b0790 con 0x7ffb9015a290 2023-10-09T06:21:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.830+0000 7ffb8effd700 1 --2- 172.21.15.31:0/129472406 >> v2:172.21.15.158:3300/0 conn(0x7ffb9006acb0 0x7ffb900afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.830+0000 7ffb8effd700 1 -- 172.21.15.31:0/129472406 >> v1:172.21.15.31:6789/0 conn(0x7ffb9015a290 legacy=0x7ffb9006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.830+0000 7ffb8effd700 1 -- 172.21.15.31:0/129472406 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb900b04b0 con 0x7ffb90159ec0 2023-10-09T06:21:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.830+0000 7ffb8f7fe700 1 --2- 172.21.15.31:0/129472406 >> v2:172.21.15.158:3300/0 conn(0x7ffb9006acb0 0x7ffb900afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.830+0000 7ffb8effd700 1 --2- 172.21.15.31:0/129472406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb90159ec0 0x7ffb900af940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb900711f0 tx=0x7ffb880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c428339f4615de0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.830+0000 7ffb8dffb700 1 -- 172.21.15.31:0/129472406 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8800b6b0 con 0x7ffb90159ec0 2023-10-09T06:21:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.830+0000 7ffb8dffb700 1 -- 172.21.15.31:0/129472406 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8800b810 con 0x7ffb90159ec0 2023-10-09T06:21:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.830+0000 7ffb8dffb700 1 -- 172.21.15.31:0/129472406 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8800bbb0 con 0x7ffb90159ec0 2023-10-09T06:21:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.830+0000 7ffb9531f700 1 -- 172.21.15.31:0/129472406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb90159ec0 msgr2=0x7ffb900af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.830+0000 7ffb9531f700 1 --2- 172.21.15.31:0/129472406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb90159ec0 0x7ffb900af940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb900711f0 tx=0x7ffb880091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.831+0000 7ffb9531f700 1 -- 172.21.15.31:0/129472406 shutdown_connections 2023-10-09T06:21:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.831+0000 7ffb9531f700 1 --2- 172.21.15.31:0/129472406 >> v2:172.21.15.158:3300/0 conn(0x7ffb9006acb0 0x7ffb900afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.831+0000 7ffb9531f700 1 --2- 172.21.15.31:0/129472406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb90159ec0 0x7ffb900af940 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.831+0000 7ffb9531f700 1 -- 172.21.15.31:0/129472406 >> 172.21.15.31:0/129472406 conn(0x7ffb900d1880 msgr2=0x7ffb900cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.831+0000 7ffb9531f700 1 -- 172.21.15.31:0/129472406 shutdown_connections 2023-10-09T06:21:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.831+0000 7ffb9531f700 1 -- 172.21.15.31:0/129472406 wait complete. 2023-10-09T06:21:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.832+0000 7ffb9531f700 1 Processor -- start 2023-10-09T06:21:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.832+0000 7ffb9531f700 1 -- start start 2023-10-09T06:21:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb9531f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb9006acb0 0x7ffb90155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb9531f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb90159ec0 0x7ffb901572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb9531f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffb9015a290 0x7ffb90157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb9531f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900c8da0 con 0x7ffb90159ec0 2023-10-09T06:21:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb9531f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900c8910 con 0x7ffb9006acb0 2023-10-09T06:21:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb9531f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb90159720 con 0x7ffb9015a290 2023-10-09T06:21:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb8e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb90159ec0 0x7ffb901572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb8e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb90159ec0 0x7ffb901572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54340/0 (socket says 172.21.15.31:54340) 2023-10-09T06:21:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb8e7fc700 1 -- 172.21.15.31:0/3162216159 learned_addr learned my addr 172.21.15.31:0/3162216159 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb8effd700 1 --2- 172.21.15.31:0/3162216159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb9006acb0 0x7ffb90155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb8e7fc700 1 -- 172.21.15.31:0/3162216159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffb9015a290 msgr2=0x7ffb90157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb8e7fc700 1 --2- 172.21.15.31:0/3162216159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffb9015a290 0x7ffb90157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb8e7fc700 1 -- 172.21.15.31:0/3162216159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb9006acb0 msgr2=0x7ffb90155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb8e7fc700 1 --2- 172.21.15.31:0/3162216159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb9006acb0 0x7ffb90155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb8e7fc700 1 -- 172.21.15.31:0/3162216159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb88009420 con 0x7ffb90159ec0 2023-10-09T06:21:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb8e7fc700 1 --2- 172.21.15.31:0/3162216159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb90159ec0 0x7ffb901572e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800c5b0 tx=0x7ffb78001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb86ffd700 1 -- 172.21.15.31:0/3162216159 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb78005b30 con 0x7ffb90159ec0 2023-10-09T06:21:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb86ffd700 1 -- 172.21.15.31:0/3162216159 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb78005c90 con 0x7ffb90159ec0 2023-10-09T06:21:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb9531f700 1 -- 172.21.15.31:0/3162216159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb900c7fe0 con 0x7ffb90159ec0 2023-10-09T06:21:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb86ffd700 1 -- 172.21.15.31:0/3162216159 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb78007300 con 0x7ffb90159ec0 2023-10-09T06:21:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.833+0000 7ffb9531f700 1 -- 172.21.15.31:0/3162216159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb900c85a0 con 0x7ffb90159ec0 2023-10-09T06:21:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.834+0000 7ffb9531f700 1 -- 172.21.15.31:0/3162216159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9004c3c0 con 0x7ffb90159ec0 2023-10-09T06:21:24.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.835+0000 7ffb86ffd700 1 -- 172.21.15.31:0/3162216159 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb7801b3b0 con 0x7ffb90159ec0 2023-10-09T06:21:24.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.835+0000 7ffb86ffd700 1 --2- 172.21.15.31:0/3162216159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffb70066f30 0x7ffb700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:24.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.835+0000 7ffb86ffd700 1 -- 172.21.15.31:0/3162216159 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffb78083a60 con 0x7ffb90159ec0 2023-10-09T06:21:24.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.835+0000 7ffb8effd700 1 --2- 172.21.15.31:0/3162216159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffb70066f30 0x7ffb700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:24.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.836+0000 7ffb8effd700 1 --2- 172.21.15.31:0/3162216159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffb70066f30 0x7ffb700693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffb88003080 tx=0x7ffb88017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:24.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:24.839+0000 7ffb86ffd700 1 -- 172.21.15.31:0/3162216159 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb78050cd0 con 0x7ffb90159ec0 2023-10-09T06:21:25.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.030+0000 7ffb9531f700 1 -- 172.21.15.31:0/3162216159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb900c8a50 con 0x7ffb90159ec0 2023-10-09T06:21:25.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.030+0000 7ffb86ffd700 1 -- 172.21.15.31:0/3162216159 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb780170a0 con 0x7ffb90159ec0 2023-10-09T06:21:25.031 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:21:25.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.032+0000 7ffb9531f700 1 -- 172.21.15.31:0/3162216159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffb70066f30 msgr2=0x7ffb700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.032+0000 7ffb9531f700 1 --2- 172.21.15.31:0/3162216159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffb70066f30 0x7ffb700693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffb88003080 tx=0x7ffb88017000 comp rx=0 tx=0).stop 2023-10-09T06:21:25.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.032+0000 7ffb9531f700 1 -- 172.21.15.31:0/3162216159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb90159ec0 msgr2=0x7ffb901572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.032+0000 7ffb9531f700 1 --2- 172.21.15.31:0/3162216159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb90159ec0 0x7ffb901572e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800c5b0 tx=0x7ffb78001070 comp rx=0 tx=0).stop 2023-10-09T06:21:25.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.032+0000 7ffb9531f700 1 -- 172.21.15.31:0/3162216159 shutdown_connections 2023-10-09T06:21:25.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.032+0000 7ffb9531f700 1 --2- 172.21.15.31:0/3162216159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffb70066f30 0x7ffb700693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.032+0000 7ffb9531f700 1 --2- 172.21.15.31:0/3162216159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffb9015a290 0x7ffb90157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.032+0000 7ffb9531f700 1 --2- 172.21.15.31:0/3162216159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb9006acb0 0x7ffb90155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.032+0000 7ffb9531f700 1 --2- 172.21.15.31:0/3162216159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb90159ec0 0x7ffb901572e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.032+0000 7ffb9531f700 1 -- 172.21.15.31:0/3162216159 >> 172.21.15.31:0/3162216159 conn(0x7ffb900d1880 msgr2=0x7ffb900c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:25.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.032+0000 7ffb9531f700 1 -- 172.21.15.31:0/3162216159 shutdown_connections 2023-10-09T06:21:25.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.032+0000 7ffb9531f700 1 -- 172.21.15.31:0/3162216159 wait complete. 2023-10-09T06:21:25.045 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:25.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.164+0000 7fd869d89700 1 Processor -- start 2023-10-09T06:21:25.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.165+0000 7fd869d89700 1 -- start start 2023-10-09T06:21:25.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.165+0000 7fd869d89700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd864158e50 0x7fd8640cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.165+0000 7fd869d89700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86406c010 con 0x7fd8641523e0 2023-10-09T06:21:25.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.165+0000 7fd869d89700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86406bd10 con 0x7fd864152010 2023-10-09T06:21:25.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.165+0000 7fd869d89700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86415c060 con 0x7fd864158e50 2023-10-09T06:21:25.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.165+0000 7fd862ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd8641523e0 0x7fd86406c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33644/0 (socket says 172.21.15.31:33644) 2023-10-09T06:21:25.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.165+0000 7fd862ffd700 1 -- 172.21.15.31:0/3995789235 learned_addr learned my addr 172.21.15.31:0/3995789235 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:25.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.166+0000 7fd863fff700 1 --2- 172.21.15.31:0/3995789235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd864158e50 0x7fd8640cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.166+0000 7fd8627fc700 1 -- 172.21.15.31:0/3995789235 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680189803 0 0) 0x7fd86406c010 con 0x7fd8641523e0 2023-10-09T06:21:25.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.166+0000 7fd8627fc700 1 -- 172.21.15.31:0/3995789235 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd84c003570 con 0x7fd8641523e0 2023-10-09T06:21:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.166+0000 7fd8627fc700 1 -- 172.21.15.31:0/3995789235 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564788402 0 0) 0x7fd86406bd10 con 0x7fd864152010 2023-10-09T06:21:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.166+0000 7fd8627fc700 1 -- 172.21.15.31:0/3995789235 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd86406c010 con 0x7fd864152010 2023-10-09T06:21:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.166+0000 7fd863fff700 1 -- 172.21.15.31:0/3995789235 >> v1:172.21.15.158:6789/0 conn(0x7fd864152010 legacy=0x7fd86415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.166+0000 7fd863fff700 1 -- 172.21.15.31:0/3995789235 >> v1:172.21.15.31:6789/0 conn(0x7fd8641523e0 legacy=0x7fd86406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.166+0000 7fd8627fc700 1 -- 172.21.15.31:0/3995789235 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3157505396 0 0) 0x7fd84c003570 con 0x7fd8641523e0 2023-10-09T06:21:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.166+0000 7fd863fff700 1 -- 172.21.15.31:0/3995789235 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86415c340 con 0x7fd864158e50 2023-10-09T06:21:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.166+0000 7fd863fff700 1 --2- 172.21.15.31:0/3995789235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd864158e50 0x7fd8640cb750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009e90 tx=0x7fd85c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69215bc9f59e9a79 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.166+0000 7fd8627fc700 1 -- 172.21.15.31:0/3995789235 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00e070 con 0x7fd864158e50 2023-10-09T06:21:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.166+0000 7fd8627fc700 1 -- 172.21.15.31:0/3995789235 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c00b870 con 0x7fd864158e50 2023-10-09T06:21:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.166+0000 7fd8627fc700 1 -- 172.21.15.31:0/3995789235 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858001470 con 0x7fd864158e50 2023-10-09T06:21:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.167+0000 7fd869d89700 1 -- 172.21.15.31:0/3995789235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd864158e50 msgr2=0x7fd8640cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.167+0000 7fd869d89700 1 --2- 172.21.15.31:0/3995789235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd864158e50 0x7fd8640cb750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009e90 tx=0x7fd85c009780 comp rx=0 tx=0).stop 2023-10-09T06:21:25.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.167+0000 7fd869d89700 1 -- 172.21.15.31:0/3995789235 shutdown_connections 2023-10-09T06:21:25.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.167+0000 7fd869d89700 1 --2- 172.21.15.31:0/3995789235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd864158e50 0x7fd8640cb750 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.167+0000 7fd869d89700 1 -- 172.21.15.31:0/3995789235 >> 172.21.15.31:0/3995789235 conn(0x7fd864069870 msgr2=0x7fd864069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:25.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.167+0000 7fd869d89700 1 -- 172.21.15.31:0/3995789235 shutdown_connections 2023-10-09T06:21:25.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.167+0000 7fd869d89700 1 -- 172.21.15.31:0/3995789235 wait complete. 2023-10-09T06:21:25.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.168+0000 7fd869d89700 1 Processor -- start 2023-10-09T06:21:25.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.168+0000 7fd869d89700 1 -- start start 2023-10-09T06:21:25.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd869d89700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd864152010 0x7fd864156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd869d89700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8641523e0 0x7fd86415c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd869d89700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd864158e50 0x7fd864142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd869d89700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86415d320 con 0x7fd864152010 2023-10-09T06:21:25.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd869d89700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86415d600 con 0x7fd8641523e0 2023-10-09T06:21:25.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd869d89700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86415d8e0 con 0x7fd864158e50 2023-10-09T06:21:25.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd8637fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd864152010 0x7fd864156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd8637fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd864152010 0x7fd864156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54350/0 (socket says 172.21.15.31:54350) 2023-10-09T06:21:25.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd8637fe700 1 -- 172.21.15.31:0/528141789 learned_addr learned my addr 172.21.15.31:0/528141789 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:25.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd863fff700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd864158e50 0x7fd864142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd862ffd700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8641523e0 0x7fd86415c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd8637fe700 1 -- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd864158e50 msgr2=0x7fd864142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd8637fe700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd864158e50 0x7fd864142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd8637fe700 1 -- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8641523e0 msgr2=0x7fd86415c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd8637fe700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8641523e0 0x7fd86415c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.169+0000 7fd8637fe700 1 -- 172.21.15.31:0/528141789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c009a20 con 0x7fd864152010 2023-10-09T06:21:25.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.170+0000 7fd8637fe700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd864152010 0x7fd864156e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd85400c790 tx=0x7fd854007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:25.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.170+0000 7fd84b7fe700 1 -- 172.21.15.31:0/528141789 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854010510 con 0x7fd864152010 2023-10-09T06:21:25.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.170+0000 7fd84b7fe700 1 -- 172.21.15.31:0/528141789 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd854010670 con 0x7fd864152010 2023-10-09T06:21:25.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.170+0000 7fd869d89700 1 -- 172.21.15.31:0/528141789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86415dbc0 con 0x7fd864152010 2023-10-09T06:21:25.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.170+0000 7fd84b7fe700 1 -- 172.21.15.31:0/528141789 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854010a10 con 0x7fd864152010 2023-10-09T06:21:25.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.170+0000 7fd869d89700 1 -- 172.21.15.31:0/528141789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd864069590 con 0x7fd864152010 2023-10-09T06:21:25.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.171+0000 7fd869d89700 1 -- 172.21.15.31:0/528141789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86415ded0 con 0x7fd864152010 2023-10-09T06:21:25.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.171+0000 7fd84b7fe700 1 -- 172.21.15.31:0/528141789 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd85401b400 con 0x7fd864152010 2023-10-09T06:21:25.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.172+0000 7fd84b7fe700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd850066f30 0x7fd8500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.172+0000 7fd84b7fe700 1 -- 172.21.15.31:0/528141789 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd854084300 con 0x7fd864152010 2023-10-09T06:21:25.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.172+0000 7fd862ffd700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd850066f30 0x7fd8500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.172+0000 7fd862ffd700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd850066f30 0x7fd8500693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8580015a0 tx=0x7fd858000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:25.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.176+0000 7fd84b7fe700 1 -- 172.21.15.31:0/528141789 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd854051570 con 0x7fd864152010 2023-10-09T06:21:25.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.369+0000 7fd869d89700 1 -- 172.21.15.31:0/528141789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd86404c3c0 con 0x7fd864152010 2023-10-09T06:21:25.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.370+0000 7fd84b7fe700 1 -- 172.21.15.31:0/528141789 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd854054b90 con 0x7fd864152010 2023-10-09T06:21:25.370 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:25.371 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:55.693313+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:25.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.372+0000 7fd869d89700 1 -- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd850066f30 msgr2=0x7fd8500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.372+0000 7fd869d89700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd850066f30 0x7fd8500693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8580015a0 tx=0x7fd858000bc0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.372+0000 7fd869d89700 1 -- 172.21.15.31:0/528141789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd864152010 msgr2=0x7fd864156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.372+0000 7fd869d89700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd864152010 0x7fd864156e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd85400c790 tx=0x7fd854007e10 comp rx=0 tx=0).stop 2023-10-09T06:21:25.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.372+0000 7fd869d89700 1 -- 172.21.15.31:0/528141789 shutdown_connections 2023-10-09T06:21:25.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.372+0000 7fd869d89700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd850066f30 0x7fd8500693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.372+0000 7fd869d89700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd864158e50 0x7fd864142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.372+0000 7fd869d89700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd864152010 0x7fd864156e60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.372+0000 7fd869d89700 1 --2- 172.21.15.31:0/528141789 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8641523e0 0x7fd86415c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.372+0000 7fd869d89700 1 -- 172.21.15.31:0/528141789 >> 172.21.15.31:0/528141789 conn(0x7fd864069870 msgr2=0x7fd8640cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:25.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.372+0000 7fd869d89700 1 -- 172.21.15.31:0/528141789 shutdown_connections 2023-10-09T06:21:25.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.372+0000 7fd869d89700 1 -- 172.21.15.31:0/528141789 wait complete. 2023-10-09T06:21:25.385 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:20:52.621337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:20:53.053532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:21:25.385 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:21:25.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.506+0000 7fe659623700 1 Processor -- start 2023-10-09T06:21:25.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.506+0000 7fe659623700 1 -- start start 2023-10-09T06:21:25.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.507+0000 7fe659623700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe654159e60 0x7fe65415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.507+0000 7fe659623700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe6540697c0 0x7fe6540af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.507+0000 7fe659623700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65415ea90 con 0x7fe65415a230 2023-10-09T06:21:25.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.507+0000 7fe659623700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6540d1cf0 con 0x7fe6540697c0 2023-10-09T06:21:25.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.507+0000 7fe659623700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6540b3100 con 0x7fe654159e60 2023-10-09T06:21:25.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.507+0000 7fe6537fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe6540697c0 0x7fe6540af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.507+0000 7fe6527fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe65415a230 0x7fe6540690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33658/0 (socket says 172.21.15.31:33658) 2023-10-09T06:21:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.507+0000 7fe6527fc700 1 -- 172.21.15.31:0/17315097 learned_addr learned my addr 172.21.15.31:0/17315097 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.507+0000 7fe652ffd700 1 --2- 172.21.15.31:0/17315097 >> v2:172.21.15.158:3300/0 conn(0x7fe654159e60 0x7fe65415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.508+0000 7fe6537fe700 1 -- 172.21.15.31:0/17315097 >> v2:172.21.15.158:3300/0 conn(0x7fe654159e60 msgr2=0x7fe65415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.508+0000 7fe6537fe700 1 --2- 172.21.15.31:0/17315097 >> v2:172.21.15.158:3300/0 conn(0x7fe654159e60 0x7fe65415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.508+0000 7fe6537fe700 1 -- 172.21.15.31:0/17315097 >> v1:172.21.15.31:6789/0 conn(0x7fe65415a230 legacy=0x7fe6540690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.508+0000 7fe6537fe700 1 -- 172.21.15.31:0/17315097 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6540d10e0 con 0x7fe6540697c0 2023-10-09T06:21:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.508+0000 7fe651ffb700 1 -- 172.21.15.31:0/17315097 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541282719 0 0) 0x7fe65415ea90 con 0x7fe65415a230 2023-10-09T06:21:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.508+0000 7fe6537fe700 1 --2- 172.21.15.31:0/17315097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6540697c0 0x7fe6540af730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe6540cdf30 tx=0x7fe6440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174c80b2e1f9264b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.508+0000 7fe651ffb700 1 -- 172.21.15.31:0/17315097 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644011630 con 0x7fe6540697c0 2023-10-09T06:21:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.508+0000 7fe651ffb700 1 -- 172.21.15.31:0/17315097 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe644011790 con 0x7fe6540697c0 2023-10-09T06:21:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.508+0000 7fe651ffb700 1 -- 172.21.15.31:0/17315097 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644011b30 con 0x7fe6540697c0 2023-10-09T06:21:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.509+0000 7fe659623700 1 -- 172.21.15.31:0/17315097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6540697c0 msgr2=0x7fe6540af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.509+0000 7fe659623700 1 --2- 172.21.15.31:0/17315097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6540697c0 0x7fe6540af730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe6540cdf30 tx=0x7fe6440091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.509+0000 7fe659623700 1 -- 172.21.15.31:0/17315097 shutdown_connections 2023-10-09T06:21:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.509+0000 7fe659623700 1 --2- 172.21.15.31:0/17315097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6540697c0 0x7fe6540af730 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.509+0000 7fe659623700 1 --2- 172.21.15.31:0/17315097 >> v2:172.21.15.158:3300/0 conn(0x7fe654159e60 0x7fe65415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.509+0000 7fe659623700 1 -- 172.21.15.31:0/17315097 >> 172.21.15.31:0/17315097 conn(0x7fe654070700 msgr2=0x7fe654070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.509+0000 7fe659623700 1 -- 172.21.15.31:0/17315097 shutdown_connections 2023-10-09T06:21:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.509+0000 7fe659623700 1 -- 172.21.15.31:0/17315097 wait complete. 2023-10-09T06:21:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.510+0000 7fe659623700 1 Processor -- start 2023-10-09T06:21:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.510+0000 7fe659623700 1 -- start start 2023-10-09T06:21:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe659623700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6540697c0 0x7fe65416a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe659623700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe654159e60 0x7fe6540c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe659623700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65415a230 0x7fe6540c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe659623700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65416ae60 con 0x7fe65415a230 2023-10-09T06:21:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe659623700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6540c57e0 con 0x7fe654159e60 2023-10-09T06:21:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe659623700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6540c5ac0 con 0x7fe6540697c0 2023-10-09T06:21:25.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe6537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65415a230 0x7fe6540c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe6537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65415a230 0x7fe6540c6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54366/0 (socket says 172.21.15.31:54366) 2023-10-09T06:21:25.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe6537fe700 1 -- 172.21.15.31:0/1437733102 learned_addr learned my addr 172.21.15.31:0/1437733102 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:25.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe6527fc700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe654159e60 0x7fe6540c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe652ffd700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6540697c0 0x7fe65416a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe6537fe700 1 -- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6540697c0 msgr2=0x7fe65416a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe6537fe700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6540697c0 0x7fe65416a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe6537fe700 1 -- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe654159e60 msgr2=0x7fe6540c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe6537fe700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe654159e60 0x7fe6540c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe6537fe700 1 -- 172.21.15.31:0/1437733102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe644009420 con 0x7fe65415a230 2023-10-09T06:21:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe6527fc700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe654159e60 0x7fe6540c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe6537fe700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65415a230 0x7fe6540c6c00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe644013000 tx=0x7fe644017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe64affd700 1 -- 172.21.15.31:0/1437733102 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440195c0 con 0x7fe65415a230 2023-10-09T06:21:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe659623700 1 -- 172.21.15.31:0/1437733102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6540c5da0 con 0x7fe65415a230 2023-10-09T06:21:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe64affd700 1 -- 172.21.15.31:0/1437733102 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe644019720 con 0x7fe65415a230 2023-10-09T06:21:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe64affd700 1 -- 172.21.15.31:0/1437733102 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644019ae0 con 0x7fe65415a230 2023-10-09T06:21:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.511+0000 7fe659623700 1 -- 172.21.15.31:0/1437733102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6540c4a40 con 0x7fe65415a230 2023-10-09T06:21:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.512+0000 7fe659623700 1 -- 172.21.15.31:0/1437733102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6540c62c0 con 0x7fe65415a230 2023-10-09T06:21:25.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.513+0000 7fe64affd700 1 -- 172.21.15.31:0/1437733102 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6440253f0 con 0x7fe65415a230 2023-10-09T06:21:25.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.513+0000 7fe64affd700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe634066f30 0x7fe6340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.513+0000 7fe64affd700 1 -- 172.21.15.31:0/1437733102 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe644086080 con 0x7fe65415a230 2023-10-09T06:21:25.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.513+0000 7fe652ffd700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe634066f30 0x7fe6340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.514+0000 7fe652ffd700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe634066f30 0x7fe6340693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0076a0 tx=0x7fe64c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:25.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.517+0000 7fe64affd700 1 -- 172.21.15.31:0/1437733102 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6540c62c0 con 0x7fe65415a230 2023-10-09T06:21:25.587 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:21:25.590 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:21:25.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.711+0000 7fe659623700 1 -- 172.21.15.31:0/1437733102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6540c62c0 con 0x7fe65415a230 2023-10-09T06:21:25.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.712+0000 7fe64affd700 1 -- 172.21.15.31:0/1437733102 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6540c62c0 con 0x7fe65415a230 2023-10-09T06:21:25.713 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:21:25.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.714+0000 7fe659623700 1 -- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe634066f30 msgr2=0x7fe6340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.714+0000 7fe659623700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe634066f30 0x7fe6340693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0076a0 tx=0x7fe64c00b040 comp rx=0 tx=0).stop 2023-10-09T06:21:25.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.714+0000 7fe659623700 1 -- 172.21.15.31:0/1437733102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65415a230 msgr2=0x7fe6540c6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.714+0000 7fe659623700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65415a230 0x7fe6540c6c00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe644013000 tx=0x7fe644017000 comp rx=0 tx=0).stop 2023-10-09T06:21:25.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.714+0000 7fe659623700 1 -- 172.21.15.31:0/1437733102 shutdown_connections 2023-10-09T06:21:25.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.714+0000 7fe659623700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe634066f30 0x7fe6340693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.714+0000 7fe659623700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6540697c0 0x7fe65416a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.714+0000 7fe659623700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65415a230 0x7fe6540c6c00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.714+0000 7fe659623700 1 --2- 172.21.15.31:0/1437733102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe654159e60 0x7fe6540c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.714+0000 7fe659623700 1 -- 172.21.15.31:0/1437733102 >> 172.21.15.31:0/1437733102 conn(0x7fe654070700 msgr2=0x7fe6540afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.714+0000 7fe659623700 1 -- 172.21.15.31:0/1437733102 shutdown_connections 2023-10-09T06:21:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.714+0000 7fe659623700 1 -- 172.21.15.31:0/1437733102 wait complete. 2023-10-09T06:21:25.727 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:21:25.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.847+0000 7fea9d763700 1 Processor -- start 2023-10-09T06:21:25.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.847+0000 7fea9d763700 1 -- start start 2023-10-09T06:21:25.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.848+0000 7fea9d763700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fea98159ec0 0x7fea980af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.848+0000 7fea9d763700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea9806acb0 0x7fea980afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.848+0000 7fea9d763700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea980b0790 con 0x7fea9815a290 2023-10-09T06:21:25.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.848+0000 7fea9d763700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea980ce1f0 con 0x7fea98159ec0 2023-10-09T06:21:25.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.848+0000 7fea9d763700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea980b0b20 con 0x7fea9806acb0 2023-10-09T06:21:25.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.849+0000 7fea977fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea9806acb0 0x7fea980afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.849+0000 7fea96ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fea98159ec0 0x7fea980af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.849+0000 7fea967fc700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fea9815a290 0x7fea9806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:36878/0 (socket says 172.21.15.31:36878) 2023-10-09T06:21:25.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.849+0000 7fea967fc700 1 -- 172.21.15.31:0/2309426070 learned_addr learned my addr 172.21.15.31:0/2309426070 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:25.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.849+0000 7fea96ffd700 1 -- 172.21.15.31:0/2309426070 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea9806acb0 msgr2=0x7fea980afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:25.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.849+0000 7fea96ffd700 1 --2- 172.21.15.31:0/2309426070 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea9806acb0 0x7fea980afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.849+0000 7fea96ffd700 1 -- 172.21.15.31:0/2309426070 >> v1:172.21.15.158:6789/0 conn(0x7fea9815a290 legacy=0x7fea9806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.849+0000 7fea95ffb700 1 -- 172.21.15.31:0/2309426070 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153867117 0 0) 0x7fea980b0790 con 0x7fea9815a290 2023-10-09T06:21:25.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.849+0000 7fea96ffd700 1 -- 172.21.15.31:0/2309426070 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea980b04b0 con 0x7fea98159ec0 2023-10-09T06:21:25.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.849+0000 7fea977fe700 1 --2- 172.21.15.31:0/2309426070 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea9806acb0 0x7fea980afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:25.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.849+0000 7fea96ffd700 1 --2- 172.21.15.31:0/2309426070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea98159ec0 0x7fea980af940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea880098e0 tx=0x7fea880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73f169bf0ce70d62 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:25.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.850+0000 7fea95ffb700 1 -- 172.21.15.31:0/2309426070 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8800b640 con 0x7fea98159ec0 2023-10-09T06:21:25.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.850+0000 7fea95ffb700 1 -- 172.21.15.31:0/2309426070 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8800b7a0 con 0x7fea98159ec0 2023-10-09T06:21:25.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.850+0000 7fea95ffb700 1 -- 172.21.15.31:0/2309426070 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8800bb40 con 0x7fea98159ec0 2023-10-09T06:21:25.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.850+0000 7fea9d763700 1 -- 172.21.15.31:0/2309426070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea98159ec0 msgr2=0x7fea980af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.850+0000 7fea9d763700 1 --2- 172.21.15.31:0/2309426070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea98159ec0 0x7fea980af940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea880098e0 tx=0x7fea880091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.850+0000 7fea9d763700 1 -- 172.21.15.31:0/2309426070 shutdown_connections 2023-10-09T06:21:25.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.850+0000 7fea9d763700 1 --2- 172.21.15.31:0/2309426070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea98159ec0 0x7fea980af940 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.850+0000 7fea9d763700 1 --2- 172.21.15.31:0/2309426070 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea9806acb0 0x7fea980afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.850+0000 7fea9d763700 1 -- 172.21.15.31:0/2309426070 >> 172.21.15.31:0/2309426070 conn(0x7fea980d1880 msgr2=0x7fea980cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:25.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.850+0000 7fea9d763700 1 -- 172.21.15.31:0/2309426070 shutdown_connections 2023-10-09T06:21:25.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.850+0000 7fea9d763700 1 -- 172.21.15.31:0/2309426070 wait complete. 2023-10-09T06:21:25.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.851+0000 7fea9d763700 1 Processor -- start 2023-10-09T06:21:25.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.851+0000 7fea9d763700 1 -- start start 2023-10-09T06:21:25.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.852+0000 7fea9d763700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea9806acb0 0x7fea98159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.852+0000 7fea9d763700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea98159ec0 0x7fea9816b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.852+0000 7fea9d763700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea9815a290 0x7fea9816d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.852+0000 7fea9d763700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9816d960 con 0x7fea9815a290 2023-10-09T06:21:25.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.852+0000 7fea9d763700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea980c83c0 con 0x7fea9806acb0 2023-10-09T06:21:25.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.852+0000 7fea9d763700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea98157a30 con 0x7fea98159ec0 2023-10-09T06:21:25.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.852+0000 7fea977fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea9815a290 0x7fea9816d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.852+0000 7fea977fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea9815a290 0x7fea9816d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54370/0 (socket says 172.21.15.31:54370) 2023-10-09T06:21:25.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.852+0000 7fea977fe700 1 -- 172.21.15.31:0/549773979 learned_addr learned my addr 172.21.15.31:0/549773979 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:25.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.852+0000 7fea967fc700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea98159ec0 0x7fea9816b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.852+0000 7fea96ffd700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea9806acb0 0x7fea98159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.853+0000 7fea977fe700 1 -- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea98159ec0 msgr2=0x7fea9816b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.853+0000 7fea977fe700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea98159ec0 0x7fea9816b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.853+0000 7fea977fe700 1 -- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea9806acb0 msgr2=0x7fea98159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:25.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.853+0000 7fea977fe700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea9806acb0 0x7fea98159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:25.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.853+0000 7fea977fe700 1 -- 172.21.15.31:0/549773979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea90009a20 con 0x7fea9815a290 2023-10-09T06:21:25.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.853+0000 7fea977fe700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea9815a290 0x7fea9816d420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fea90009f60 tx=0x7fea9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:25.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.853+0000 7fea7effd700 1 -- 172.21.15.31:0/549773979 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000ccd0 con 0x7fea9815a290 2023-10-09T06:21:25.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.853+0000 7fea7effd700 1 -- 172.21.15.31:0/549773979 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9000f040 con 0x7fea9815a290 2023-10-09T06:21:25.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.853+0000 7fea7effd700 1 -- 172.21.15.31:0/549773979 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea900146d0 con 0x7fea9815a290 2023-10-09T06:21:25.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.853+0000 7fea9d763700 1 -- 172.21.15.31:0/549773979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea88009420 con 0x7fea9815a290 2023-10-09T06:21:25.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.853+0000 7fea9d763700 1 -- 172.21.15.31:0/549773979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea98157ff0 con 0x7fea9815a290 2023-10-09T06:21:25.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.854+0000 7fea9d763700 1 -- 172.21.15.31:0/549773979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9804c3c0 con 0x7fea9815a290 2023-10-09T06:21:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.854+0000 7fea7effd700 1 -- 172.21.15.31:0/549773979 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea90014a40 con 0x7fea9815a290 2023-10-09T06:21:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.855+0000 7fea7effd700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea84066f30 0x7fea840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.855+0000 7fea7effd700 1 -- 172.21.15.31:0/549773979 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea900852f0 con 0x7fea9815a290 2023-10-09T06:21:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.855+0000 7fea96ffd700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea84066f30 0x7fea840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:25.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.855+0000 7fea96ffd700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea84066f30 0x7fea840693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fea880093f0 tx=0x7fea88017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:25.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:25.859+0000 7fea7effd700 1 -- 172.21.15.31:0/549773979 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea90052560 con 0x7fea9815a290 2023-10-09T06:21:26.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.050+0000 7fea9d763700 1 -- 172.21.15.31:0/549773979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea980ceab0 con 0x7fea9815a290 2023-10-09T06:21:26.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.050+0000 7fea7effd700 1 -- 172.21.15.31:0/549773979 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea90055b80 con 0x7fea9815a290 2023-10-09T06:21:26.051 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:21:26.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.052+0000 7fea9d763700 1 -- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea84066f30 msgr2=0x7fea840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:26.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.052+0000 7fea9d763700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea84066f30 0x7fea840693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fea880093f0 tx=0x7fea88017000 comp rx=0 tx=0).stop 2023-10-09T06:21:26.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.052+0000 7fea9d763700 1 -- 172.21.15.31:0/549773979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea9815a290 msgr2=0x7fea9816d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:26.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.052+0000 7fea9d763700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea9815a290 0x7fea9816d420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fea90009f60 tx=0x7fea9000b040 comp rx=0 tx=0).stop 2023-10-09T06:21:26.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.052+0000 7fea9d763700 1 -- 172.21.15.31:0/549773979 shutdown_connections 2023-10-09T06:21:26.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.052+0000 7fea9d763700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea84066f30 0x7fea840693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.052+0000 7fea9d763700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea9815a290 0x7fea9816d420 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.052+0000 7fea9d763700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea9806acb0 0x7fea98159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.052+0000 7fea9d763700 1 --2- 172.21.15.31:0/549773979 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea98159ec0 0x7fea9816b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.052+0000 7fea9d763700 1 -- 172.21.15.31:0/549773979 >> 172.21.15.31:0/549773979 conn(0x7fea980d1880 msgr2=0x7fea980b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:26.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.052+0000 7fea9d763700 1 -- 172.21.15.31:0/549773979 shutdown_connections 2023-10-09T06:21:26.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.052+0000 7fea9d763700 1 -- 172.21.15.31:0/549773979 wait complete. 2023-10-09T06:21:26.065 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:21:26.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.185+0000 7f55f12cf700 1 Processor -- start 2023-10-09T06:21:26.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.186+0000 7f55f12cf700 1 -- start start 2023-10-09T06:21:26.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.186+0000 7f55f12cf700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55ec159ec0 0x7f55ec0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:26.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.186+0000 7f55f12cf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ec0b0790 con 0x7f55ec15a290 2023-10-09T06:21:26.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.186+0000 7f55f12cf700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ec0ce1f0 con 0x7f55ec06acb0 2023-10-09T06:21:26.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.186+0000 7f55f12cf700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0b0b20 con 0x7f55ec159ec0 2023-10-09T06:21:26.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.187+0000 7f55ea7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f55ec15a290 0x7f55ec06a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33664/0 (socket says 172.21.15.31:33664) 2023-10-09T06:21:26.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.187+0000 7f55ea7fc700 1 -- 172.21.15.31:0/2782586410 learned_addr learned my addr 172.21.15.31:0/2782586410 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:26.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.187+0000 7f55eaffd700 1 --2- 172.21.15.31:0/2782586410 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55ec159ec0 0x7f55ec0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:26.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.187+0000 7f55e9ffb700 1 -- 172.21.15.31:0/2782586410 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050261172 0 0) 0x7f55ec0b0790 con 0x7f55ec15a290 2023-10-09T06:21:26.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.187+0000 7f55e9ffb700 1 -- 172.21.15.31:0/2782586410 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55d8003570 con 0x7f55ec15a290 2023-10-09T06:21:26.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.187+0000 7f55e9ffb700 1 -- 172.21.15.31:0/2782586410 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473650439 0 0) 0x7f55ec0ce1f0 con 0x7f55ec06acb0 2023-10-09T06:21:26.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.187+0000 7f55e9ffb700 1 -- 172.21.15.31:0/2782586410 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55ec0b0790 con 0x7f55ec06acb0 2023-10-09T06:21:26.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.187+0000 7f55eaffd700 1 -- 172.21.15.31:0/2782586410 >> v1:172.21.15.158:6789/0 conn(0x7f55ec06acb0 legacy=0x7f55ec0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:26.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.187+0000 7f55e9ffb700 1 -- 172.21.15.31:0/2782586410 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1361532895 0 0) 0x7f55d8003570 con 0x7f55ec15a290 2023-10-09T06:21:26.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.187+0000 7f55eaffd700 1 -- 172.21.15.31:0/2782586410 >> v1:172.21.15.31:6789/0 conn(0x7f55ec15a290 legacy=0x7f55ec06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:26.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.187+0000 7f55eaffd700 1 -- 172.21.15.31:0/2782586410 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec0b04b0 con 0x7f55ec159ec0 2023-10-09T06:21:26.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.187+0000 7f55eaffd700 1 --2- 172.21.15.31:0/2782586410 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55ec159ec0 0x7f55ec0af940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f55e4009910 tx=0x7f55e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a790161eaafab962 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:26.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.188+0000 7f55e9ffb700 1 -- 172.21.15.31:0/2782586410 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4001470 con 0x7f55ec159ec0 2023-10-09T06:21:26.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.188+0000 7f55e9ffb700 1 -- 172.21.15.31:0/2782586410 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e4011420 con 0x7f55ec159ec0 2023-10-09T06:21:26.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.188+0000 7f55e9ffb700 1 -- 172.21.15.31:0/2782586410 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e40117a0 con 0x7f55ec159ec0 2023-10-09T06:21:26.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.188+0000 7f55f12cf700 1 -- 172.21.15.31:0/2782586410 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55ec159ec0 msgr2=0x7f55ec0af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:26.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.188+0000 7f55f12cf700 1 --2- 172.21.15.31:0/2782586410 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55ec159ec0 0x7f55ec0af940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f55e4009910 tx=0x7f55e40091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.188+0000 7f55f12cf700 1 -- 172.21.15.31:0/2782586410 shutdown_connections 2023-10-09T06:21:26.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.188+0000 7f55f12cf700 1 --2- 172.21.15.31:0/2782586410 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55ec159ec0 0x7f55ec0af940 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.188+0000 7f55f12cf700 1 -- 172.21.15.31:0/2782586410 >> 172.21.15.31:0/2782586410 conn(0x7f55ec0d1880 msgr2=0x7f55ec0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:26.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.188+0000 7f55f12cf700 1 -- 172.21.15.31:0/2782586410 shutdown_connections 2023-10-09T06:21:26.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.188+0000 7f55f12cf700 1 -- 172.21.15.31:0/2782586410 wait complete. 2023-10-09T06:21:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.189+0000 7f55f12cf700 1 Processor -- start 2023-10-09T06:21:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.189+0000 7f55f12cf700 1 -- start start 2023-10-09T06:21:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.190+0000 7f55f12cf700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55ec06acb0 0x7f55ec155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.190+0000 7f55f12cf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55ec159ec0 0x7f55ec0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.190+0000 7f55f12cf700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55ec15a290 0x7f55ec0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.190+0000 7f55f12cf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec16e580 con 0x7f55ec159ec0 2023-10-09T06:21:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.190+0000 7f55f12cf700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0cb520 con 0x7f55ec15a290 2023-10-09T06:21:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.190+0000 7f55f12cf700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec16d900 con 0x7f55ec06acb0 2023-10-09T06:21:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.190+0000 7f55ea7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55ec159ec0 0x7f55ec0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.190+0000 7f55ea7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55ec159ec0 0x7f55ec0c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54376/0 (socket says 172.21.15.31:54376) 2023-10-09T06:21:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.190+0000 7f55ea7fc700 1 -- 172.21.15.31:0/3556031128 learned_addr learned my addr 172.21.15.31:0/3556031128 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.190+0000 7f55eaffd700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55ec06acb0 0x7f55ec155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.190+0000 7f55eb7fe700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55ec15a290 0x7f55ec0cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.191+0000 7f55ea7fc700 1 -- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55ec06acb0 msgr2=0x7f55ec155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.191+0000 7f55ea7fc700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55ec06acb0 0x7f55ec155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.191+0000 7f55ea7fc700 1 -- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55ec15a290 msgr2=0x7f55ec0cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.191+0000 7f55ea7fc700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55ec15a290 0x7f55ec0cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.191+0000 7f55ea7fc700 1 -- 172.21.15.31:0/3556031128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e4009420 con 0x7f55ec159ec0 2023-10-09T06:21:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.191+0000 7f55ea7fc700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55ec159ec0 0x7f55ec0c7e60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f55d400c810 tx=0x7f55d4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.191+0000 7f55e2ffd700 1 -- 172.21.15.31:0/3556031128 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4007360 con 0x7f55ec159ec0 2023-10-09T06:21:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.191+0000 7f55e2ffd700 1 -- 172.21.15.31:0/3556031128 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d40074e0 con 0x7f55ec159ec0 2023-10-09T06:21:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.191+0000 7f55f12cf700 1 -- 172.21.15.31:0/3556031128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ec16dbe0 con 0x7f55ec159ec0 2023-10-09T06:21:26.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.191+0000 7f55e2ffd700 1 -- 172.21.15.31:0/3556031128 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4004830 con 0x7f55ec159ec0 2023-10-09T06:21:26.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.191+0000 7f55f12cf700 1 -- 172.21.15.31:0/3556031128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ec16e1a0 con 0x7f55ec159ec0 2023-10-09T06:21:26.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.192+0000 7f55f12cf700 1 -- 172.21.15.31:0/3556031128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ec04c3c0 con 0x7f55ec159ec0 2023-10-09T06:21:26.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.192+0000 7f55e2ffd700 1 -- 172.21.15.31:0/3556031128 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55d4004ba0 con 0x7f55ec159ec0 2023-10-09T06:21:26.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.193+0000 7f55e2ffd700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55cc066f30 0x7f55cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:26.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.193+0000 7f55e2ffd700 1 -- 172.21.15.31:0/3556031128 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55d40837e0 con 0x7f55ec159ec0 2023-10-09T06:21:26.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.193+0000 7f55eaffd700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55cc066f30 0x7f55cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:26.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.193+0000 7f55eaffd700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55cc066f30 0x7f55cc0693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f55e40091e0 tx=0x7f55e4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:26.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.197+0000 7f55e2ffd700 1 -- 172.21.15.31:0/3556031128 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55d4050a50 con 0x7f55ec159ec0 2023-10-09T06:21:26.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.391+0000 7f55f12cf700 1 -- 172.21.15.31:0/3556031128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f55ec0ceab0 con 0x7f55ec159ec0 2023-10-09T06:21:26.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.391+0000 7f55e2ffd700 1 -- 172.21.15.31:0/3556031128 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f55d4018020 con 0x7f55ec159ec0 2023-10-09T06:21:26.392 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:21:26.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.393+0000 7f55f12cf700 1 -- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55cc066f30 msgr2=0x7f55cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:26.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.393+0000 7f55f12cf700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55cc066f30 0x7f55cc0693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f55e40091e0 tx=0x7f55e4016000 comp rx=0 tx=0).stop 2023-10-09T06:21:26.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.393+0000 7f55f12cf700 1 -- 172.21.15.31:0/3556031128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55ec159ec0 msgr2=0x7f55ec0c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:26.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.393+0000 7f55f12cf700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55ec159ec0 0x7f55ec0c7e60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f55d400c810 tx=0x7f55d4001a30 comp rx=0 tx=0).stop 2023-10-09T06:21:26.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.393+0000 7f55f12cf700 1 -- 172.21.15.31:0/3556031128 shutdown_connections 2023-10-09T06:21:26.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.393+0000 7f55f12cf700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55cc066f30 0x7f55cc0693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.393+0000 7f55f12cf700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55ec06acb0 0x7f55ec155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.393+0000 7f55f12cf700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55ec15a290 0x7f55ec0cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.393+0000 7f55f12cf700 1 --2- 172.21.15.31:0/3556031128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55ec159ec0 0x7f55ec0c7e60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.393+0000 7f55f12cf700 1 -- 172.21.15.31:0/3556031128 >> 172.21.15.31:0/3556031128 conn(0x7f55ec0d1880 msgr2=0x7f55ec0c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:26.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.393+0000 7f55f12cf700 1 -- 172.21.15.31:0/3556031128 shutdown_connections 2023-10-09T06:21:26.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.393+0000 7f55f12cf700 1 -- 172.21.15.31:0/3556031128 wait complete. 2023-10-09T06:21:26.424 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-09T06:21:26.425 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-10-09T06:21:26.425 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-09T06:21:26.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.543+0000 7f1493541700 1 Processor -- start 2023-10-09T06:21:26.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.543+0000 7f1493541700 1 -- start start 2023-10-09T06:21:26.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.544+0000 7f1493541700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f148c0cc410 0x7f148c0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:26.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.544+0000 7f1493541700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f148c15a2e0 0x7f148c0cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:26.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.544+0000 7f1493541700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c0ae320 con 0x7f148c159f10 2023-10-09T06:21:26.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.544+0000 7f1493541700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c15a760 con 0x7f148c0cc410 2023-10-09T06:21:26.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.544+0000 7f1493541700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0ad710 con 0x7f148c15a2e0 2023-10-09T06:21:26.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.544+0000 7f149253f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f148c159f10 0x7f148c0cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33678/0 (socket says 172.21.15.31:33678) 2023-10-09T06:21:26.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.544+0000 7f149253f700 1 -- 172.21.15.31:0/2260725274 learned_addr learned my addr 172.21.15.31:0/2260725274 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:26.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.544+0000 7f1492d40700 1 --2- 172.21.15.31:0/2260725274 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f148c15a2e0 0x7f148c0cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:26.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.544+0000 7f1491d3e700 1 --2- 172.21.15.31:0/2260725274 >> v2:172.21.15.158:3300/0 conn(0x7f148c0cc410 0x7f148c0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:26.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.544+0000 7f149153d700 1 -- 172.21.15.31:0/2260725274 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812271423 0 0) 0x7f148c0ae320 con 0x7f148c159f10 2023-10-09T06:21:26.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.544+0000 7f149153d700 1 -- 172.21.15.31:0/2260725274 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1474003570 con 0x7f148c159f10 2023-10-09T06:21:26.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.545+0000 7f1491d3e700 1 -- 172.21.15.31:0/2260725274 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f148c15a2e0 msgr2=0x7f148c0cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:26.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.545+0000 7f1491d3e700 1 --2- 172.21.15.31:0/2260725274 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f148c15a2e0 0x7f148c0cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.545+0000 7f1491d3e700 1 -- 172.21.15.31:0/2260725274 >> v1:172.21.15.31:6789/0 conn(0x7f148c159f10 legacy=0x7f148c0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:26.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.545+0000 7f1491d3e700 1 -- 172.21.15.31:0/2260725274 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0ad9f0 con 0x7f148c0cc410 2023-10-09T06:21:26.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.545+0000 7f1491d3e700 1 --2- 172.21.15.31:0/2260725274 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f148c0cc410 0x7f148c0c59e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f14800098e0 tx=0x7f14800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=802deeca8e7af50f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:26.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.545+0000 7f149153d700 1 -- 172.21.15.31:0/2260725274 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480011630 con 0x7f148c0cc410 2023-10-09T06:21:26.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.545+0000 7f149153d700 1 -- 172.21.15.31:0/2260725274 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1480011790 con 0x7f148c0cc410 2023-10-09T06:21:26.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.545+0000 7f149153d700 1 -- 172.21.15.31:0/2260725274 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480011b30 con 0x7f148c0cc410 2023-10-09T06:21:26.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.546+0000 7f1493541700 1 -- 172.21.15.31:0/2260725274 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f148c0cc410 msgr2=0x7f148c0c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:26.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.546+0000 7f1493541700 1 --2- 172.21.15.31:0/2260725274 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f148c0cc410 0x7f148c0c59e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f14800098e0 tx=0x7f14800091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.546+0000 7f1493541700 1 -- 172.21.15.31:0/2260725274 shutdown_connections 2023-10-09T06:21:26.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.546+0000 7f1493541700 1 --2- 172.21.15.31:0/2260725274 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f148c15a2e0 0x7f148c0cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.546+0000 7f1493541700 1 --2- 172.21.15.31:0/2260725274 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f148c0cc410 0x7f148c0c59e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.546+0000 7f1493541700 1 -- 172.21.15.31:0/2260725274 >> 172.21.15.31:0/2260725274 conn(0x7f148c067e40 msgr2=0x7f148c0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:26.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.546+0000 7f1493541700 1 -- 172.21.15.31:0/2260725274 shutdown_connections 2023-10-09T06:21:26.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.546+0000 7f1493541700 1 -- 172.21.15.31:0/2260725274 wait complete. 2023-10-09T06:21:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.547+0000 7f1493541700 1 Processor -- start 2023-10-09T06:21:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.547+0000 7f1493541700 1 -- start start 2023-10-09T06:21:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.547+0000 7f1493541700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f148c0cc410 0x7f148c155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.547+0000 7f1493541700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f148c159f10 0x7f148c156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.547+0000 7f1493541700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148c15a2e0 0x7f148c0b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.547+0000 7f1493541700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c155d50 con 0x7f148c15a2e0 2023-10-09T06:21:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.547+0000 7f1493541700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0c8a10 con 0x7f148c159f10 2023-10-09T06:21:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.547+0000 7f1493541700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c157590 con 0x7f148c0cc410 2023-10-09T06:21:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f1492d40700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148c15a2e0 0x7f148c0b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f1492d40700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148c15a2e0 0x7f148c0b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54378/0 (socket says 172.21.15.31:54378) 2023-10-09T06:21:26.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f1492d40700 1 -- 172.21.15.31:0/3219446402 learned_addr learned my addr 172.21.15.31:0/3219446402 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:26.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f1491d3e700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f148c159f10 0x7f148c156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:26.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f149253f700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f148c0cc410 0x7f148c155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:26.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f1492d40700 1 -- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f148c0cc410 msgr2=0x7f148c155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:26.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f1492d40700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f148c0cc410 0x7f148c155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f1492d40700 1 -- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f148c159f10 msgr2=0x7f148c156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:26.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f1492d40700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f148c159f10 0x7f148c156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:26.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f1492d40700 1 -- 172.21.15.31:0/3219446402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1480009420 con 0x7f148c15a2e0 2023-10-09T06:21:26.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f1491d3e700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f148c159f10 0x7f148c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:26.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f1492d40700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148c15a2e0 0x7f148c0b5e70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f147c00e8d0 tx=0x7f147c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:26.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f148a7fc700 1 -- 172.21.15.31:0/3219446402 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c009530 con 0x7f148c15a2e0 2023-10-09T06:21:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f148a7fc700 1 -- 172.21.15.31:0/3219446402 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c00c850 con 0x7f148c15a2e0 2023-10-09T06:21:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f1493541700 1 -- 172.21.15.31:0/3219446402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148c157870 con 0x7f148c15a2e0 2023-10-09T06:21:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f148a7fc700 1 -- 172.21.15.31:0/3219446402 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00cc10 con 0x7f148c15a2e0 2023-10-09T06:21:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.548+0000 7f1493541700 1 -- 172.21.15.31:0/3219446402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c1572a0 con 0x7f148c15a2e0 2023-10-09T06:21:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.549+0000 7f1493541700 1 -- 172.21.15.31:0/3219446402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c0c87e0 con 0x7f148c15a2e0 2023-10-09T06:21:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.549+0000 7f148a7fc700 1 -- 172.21.15.31:0/3219446402 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f147c013470 con 0x7f148c15a2e0 2023-10-09T06:21:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.550+0000 7f148a7fc700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1478066f30 0x7f14780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.550+0000 7f148a7fc700 1 -- 172.21.15.31:0/3219446402 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f147c084670 con 0x7f148c15a2e0 2023-10-09T06:21:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.550+0000 7f149253f700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1478066f30 0x7f14780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.551+0000 7f149253f700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1478066f30 0x7f14780693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f148c0cafe0 tx=0x7f1484009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:26.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.554+0000 7f148a7fc700 1 -- 172.21.15.31:0/3219446402 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f148c0c87e0 con 0x7f148c15a2e0 2023-10-09T06:21:26.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:26.831+0000 7f1493541700 1 -- 172.21.15.31:0/3219446402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f148c0c87e0 con 0x7f148c15a2e0 2023-10-09T06:21:27.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:27.818+0000 7f148a7fc700 1 -- 172.21.15.31:0/3219446402 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v49) v1 ==== 133+0+0 (secure 0 0 0) 0x7f148c0c87e0 con 0x7f148c15a2e0 2023-10-09T06:21:27.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:27.820+0000 7f1493541700 1 -- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1478066f30 msgr2=0x7f14780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:27.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:27.820+0000 7f1493541700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1478066f30 0x7f14780693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f148c0cafe0 tx=0x7f1484009040 comp rx=0 tx=0).stop 2023-10-09T06:21:27.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:27.820+0000 7f1493541700 1 -- 172.21.15.31:0/3219446402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148c15a2e0 msgr2=0x7f148c0b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:27.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:27.820+0000 7f1493541700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148c15a2e0 0x7f148c0b5e70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f147c00e8d0 tx=0x7f147c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:27.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:27.820+0000 7f1493541700 1 -- 172.21.15.31:0/3219446402 shutdown_connections 2023-10-09T06:21:27.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:27.820+0000 7f1493541700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1478066f30 0x7f14780693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:27.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:27.820+0000 7f1493541700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f148c0cc410 0x7f148c155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:27.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:27.820+0000 7f1493541700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148c15a2e0 0x7f148c0b5e70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:27.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:27.820+0000 7f1493541700 1 --2- 172.21.15.31:0/3219446402 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f148c159f10 0x7f148c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:27.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:27.820+0000 7f1493541700 1 -- 172.21.15.31:0/3219446402 >> 172.21.15.31:0/3219446402 conn(0x7f148c067e40 msgr2=0x7f148c1588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:27.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:27.820+0000 7f1493541700 1 -- 172.21.15.31:0/3219446402 shutdown_connections 2023-10-09T06:21:27.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:27.820+0000 7f1493541700 1 -- 172.21.15.31:0/3219446402 wait complete. 2023-10-09T06:21:27.834 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-09T06:21:27.972 INFO:teuthology.orchestra.run.smithi031.stdout:{"osd_objectstore":"memstore"} 2023-10-09T06:21:27.972 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-09T06:21:27.972 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:21:28.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.093+0000 7f4f1b7dd700 1 Processor -- start 2023-10-09T06:21:28.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.093+0000 7f4f1b7dd700 1 -- start start 2023-10-09T06:21:28.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.094+0000 7f4f1b7dd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f140678b0 0x7f4f1415db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:28.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.094+0000 7f4f1b7dd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f140cbf10 0x7f4f1415e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:28.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.094+0000 7f4f1b7dd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f140cae70 con 0x7f4f140c9390 2023-10-09T06:21:28.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.094+0000 7f4f1b7dd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f140cb150 con 0x7f4f140cbf10 2023-10-09T06:21:28.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.094+0000 7f4f1b7dd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f140cb430 con 0x7f4f140678b0 2023-10-09T06:21:28.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.094+0000 7f4f18d78700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f140cbf10 0x7f4f1415e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:28.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.094+0000 7f4f19d7a700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4f140c9390 0x7f4f1406bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33686/0 (socket says 172.21.15.31:33686) 2023-10-09T06:21:28.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.094+0000 7f4f19d7a700 1 -- 172.21.15.31:0/246514205 learned_addr learned my addr 172.21.15.31:0/246514205 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:28.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.095+0000 7f4f19579700 1 --2- 172.21.15.31:0/246514205 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f140678b0 0x7f4f1415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:28.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.095+0000 7f4f18d78700 1 -- 172.21.15.31:0/246514205 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f140678b0 msgr2=0x7f4f1415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:28.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.095+0000 7f4f18d78700 1 --2- 172.21.15.31:0/246514205 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f140678b0 0x7f4f1415db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.095+0000 7f4f18d78700 1 -- 172.21.15.31:0/246514205 >> v1:172.21.15.31:6789/0 conn(0x7f4f140c9390 legacy=0x7f4f1406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:28.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.095+0000 7f4f18d78700 1 -- 172.21.15.31:0/246514205 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f140cb710 con 0x7f4f140cbf10 2023-10-09T06:21:28.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.095+0000 7f4f18d78700 1 --2- 172.21.15.31:0/246514205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f140cbf10 0x7f4f1415e0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4f040098e0 tx=0x7f4f040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47242e0a1440345 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:28.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.095+0000 7f4f0bfff700 1 -- 172.21.15.31:0/246514205 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f04009e80 con 0x7f4f140cbf10 2023-10-09T06:21:28.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.095+0000 7f4f0bfff700 1 -- 172.21.15.31:0/246514205 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0400b860 con 0x7f4f140cbf10 2023-10-09T06:21:28.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.095+0000 7f4f0bfff700 1 -- 172.21.15.31:0/246514205 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400bbe0 con 0x7f4f140cbf10 2023-10-09T06:21:28.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.095+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/246514205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f140cbf10 msgr2=0x7f4f1415e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:28.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.096+0000 7f4f1b7dd700 1 --2- 172.21.15.31:0/246514205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f140cbf10 0x7f4f1415e0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4f040098e0 tx=0x7f4f040091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.096+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/246514205 shutdown_connections 2023-10-09T06:21:28.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.096+0000 7f4f1b7dd700 1 --2- 172.21.15.31:0/246514205 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f140678b0 0x7f4f1415db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.096+0000 7f4f1b7dd700 1 --2- 172.21.15.31:0/246514205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f140cbf10 0x7f4f1415e0c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.096+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/246514205 >> 172.21.15.31:0/246514205 conn(0x7f4f14069870 msgr2=0x7f4f14069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:28.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.096+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/246514205 shutdown_connections 2023-10-09T06:21:28.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.096+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/246514205 wait complete. 2023-10-09T06:21:28.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.097+0000 7f4f1b7dd700 1 Processor -- start 2023-10-09T06:21:28.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.097+0000 7f4f1b7dd700 1 -- start start 2023-10-09T06:21:28.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f1b7dd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f140678b0 0x7f4f1416e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:28.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f1b7dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f140c9390 0x7f4f1416a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:28.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f1b7dd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f140cbf10 0x7f4f140c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:28.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f1b7dd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f140cd620 con 0x7f4f140c9390 2023-10-09T06:21:28.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f1b7dd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1416e840 con 0x7f4f140cbf10 2023-10-09T06:21:28.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f1b7dd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f140cc730 con 0x7f4f140678b0 2023-10-09T06:21:28.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f18d78700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f140c9390 0x7f4f1416a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:28.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f18d78700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f140c9390 0x7f4f1416a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54396/0 (socket says 172.21.15.31:54396) 2023-10-09T06:21:28.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f18d78700 1 -- 172.21.15.31:0/1402381514 learned_addr learned my addr 172.21.15.31:0/1402381514 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:28.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f19579700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f140678b0 0x7f4f1416e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:28.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f19d7a700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f140cbf10 0x7f4f140c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:28.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f18d78700 1 -- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f140678b0 msgr2=0x7f4f1416e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:28.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f18d78700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f140678b0 0x7f4f1416e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f18d78700 1 -- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f140cbf10 msgr2=0x7f4f140c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:28.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f18d78700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f140cbf10 0x7f4f140c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f18d78700 1 -- 172.21.15.31:0/1402381514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f04009420 con 0x7f4f140c9390 2023-10-09T06:21:28.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f18d78700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f140c9390 0x7f4f1416a2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4f1406a380 tx=0x7f4f04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:28.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f097fa700 1 -- 172.21.15.31:0/1402381514 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400bbe0 con 0x7f4f140c9390 2023-10-09T06:21:28.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f097fa700 1 -- 172.21.15.31:0/1402381514 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f04011420 con 0x7f4f140c9390 2023-10-09T06:21:28.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/1402381514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f140cca10 con 0x7f4f140c9390 2023-10-09T06:21:28.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f097fa700 1 -- 172.21.15.31:0/1402381514 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f040117c0 con 0x7f4f140c9390 2023-10-09T06:21:28.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.098+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/1402381514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f140ccfd0 con 0x7f4f140c9390 2023-10-09T06:21:28.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.099+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/1402381514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f140cd790 con 0x7f4f140c9390 2023-10-09T06:21:28.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.100+0000 7f4f097fa700 1 -- 172.21.15.31:0/1402381514 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f04011bb0 con 0x7f4f140c9390 2023-10-09T06:21:28.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.100+0000 7f4f097fa700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ef8066f30 0x7f4ef80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:28.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.100+0000 7f4f097fa700 1 -- 172.21.15.31:0/1402381514 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f04085e60 con 0x7f4f140c9390 2023-10-09T06:21:28.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.100+0000 7f4f19579700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ef8066f30 0x7f4ef80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:28.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.101+0000 7f4f19579700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ef8066f30 0x7f4ef80693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c006fd0 tx=0x7f4f0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:28.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.105+0000 7f4f097fa700 1 -- 172.21.15.31:0/1402381514 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f040530d0 con 0x7f4f140c9390 2023-10-09T06:21:28.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.296+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/1402381514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4f1404c3c0 con 0x7f4f140c9390 2023-10-09T06:21:28.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.300+0000 7f4f097fa700 1 -- 172.21.15.31:0/1402381514 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4f04011e60 con 0x7f4f140c9390 2023-10-09T06:21:28.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.302+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ef8066f30 msgr2=0x7f4ef80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:28.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.302+0000 7f4f1b7dd700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ef8066f30 0x7f4ef80693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c006fd0 tx=0x7f4f0c008040 comp rx=0 tx=0).stop 2023-10-09T06:21:28.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.302+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/1402381514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f140c9390 msgr2=0x7f4f1416a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:28.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.302+0000 7f4f1b7dd700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f140c9390 0x7f4f1416a2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4f1406a380 tx=0x7f4f04017000 comp rx=0 tx=0).stop 2023-10-09T06:21:28.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.302+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/1402381514 shutdown_connections 2023-10-09T06:21:28.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.302+0000 7f4f1b7dd700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ef8066f30 0x7f4ef80693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.302+0000 7f4f1b7dd700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f140678b0 0x7f4f1416e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.302+0000 7f4f1b7dd700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f140cbf10 0x7f4f140c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.302+0000 7f4f1b7dd700 1 --2- 172.21.15.31:0/1402381514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f140c9390 0x7f4f1416a2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.302+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/1402381514 >> 172.21.15.31:0/1402381514 conn(0x7f4f14069870 msgr2=0x7f4f14155cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:28.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.302+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/1402381514 shutdown_connections 2023-10-09T06:21:28.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.302+0000 7f4f1b7dd700 1 -- 172.21.15.31:0/1402381514 wait complete. 2023-10-09T06:21:28.315 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:21:28.351 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:21:28.386 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:21:28.434 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:21:28.434 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:21:28.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:21:28.434 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-09T06:21:28.474 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:21:28.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:28.474 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:21:28.530 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T06:21:28.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:21:28.530 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-09T06:21:28.574 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:21:28.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:28.574 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T06:21:28.632 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-09T06:21:28.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:21:28.633 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-09T06:21:28.668 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:21:28.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:28.668 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T06:21:28.723 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-09T06:21:28.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:21:28.724 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-09T06:21:28.762 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:21:28.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:28.762 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T06:21:28.818 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:21:28.818 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:21:28.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.936+0000 7f240ab6f700 1 Processor -- start 2023-10-09T06:21:28.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.936+0000 7f240ab6f700 1 -- start start 2023-10-09T06:21:28.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.937+0000 7f240ab6f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f24040cdab0 0x7f240415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:28.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.937+0000 7f240ab6f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f240415dda0 0x7f240415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.937+0000 7f240ab6f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24040cb7c0 con 0x7f24040cd6e0 2023-10-09T06:21:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.937+0000 7f240ab6f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240415e850 con 0x7f240415dda0 2023-10-09T06:21:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.937+0000 7f240ab6f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24040cc360 con 0x7f24040cdab0 2023-10-09T06:21:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.937+0000 7f2409b6d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f24040cd6e0 0x7f24040cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33694/0 (socket says 172.21.15.31:33694) 2023-10-09T06:21:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.937+0000 7f240a36e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f240415dda0 0x7f240415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.937+0000 7f2409b6d700 1 -- 172.21.15.31:0/120720689 learned_addr learned my addr 172.21.15.31:0/120720689 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.937+0000 7f240936c700 1 --2- 172.21.15.31:0/120720689 >> v2:172.21.15.158:3300/0 conn(0x7f24040cdab0 0x7f240415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.937+0000 7f240a36e700 1 -- 172.21.15.31:0/120720689 >> v2:172.21.15.158:3300/0 conn(0x7f24040cdab0 msgr2=0x7f240415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.937+0000 7f240a36e700 1 --2- 172.21.15.31:0/120720689 >> v2:172.21.15.158:3300/0 conn(0x7f24040cdab0 0x7f240415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.937+0000 7f240a36e700 1 -- 172.21.15.31:0/120720689 >> v1:172.21.15.31:6789/0 conn(0x7f24040cd6e0 legacy=0x7f24040cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f2408b6b700 1 -- 172.21.15.31:0/120720689 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909611159 0 0) 0x7f24040cb7c0 con 0x7f24040cd6e0 2023-10-09T06:21:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f240a36e700 1 -- 172.21.15.31:0/120720689 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240415e290 con 0x7f240415dda0 2023-10-09T06:21:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f240a36e700 1 --2- 172.21.15.31:0/120720689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240415dda0 0x7f240415cbd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f24040b6c70 tx=0x7f23f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab2266a212859cb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f2408b6b700 1 -- 172.21.15.31:0/120720689 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f400e070 con 0x7f240415dda0 2023-10-09T06:21:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f2408b6b700 1 -- 172.21.15.31:0/120720689 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f400bb60 con 0x7f240415dda0 2023-10-09T06:21:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f2408b6b700 1 -- 172.21.15.31:0/120720689 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4012430 con 0x7f240415dda0 2023-10-09T06:21:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f240ab6f700 1 -- 172.21.15.31:0/120720689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240415dda0 msgr2=0x7f240415cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f240ab6f700 1 --2- 172.21.15.31:0/120720689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240415dda0 0x7f240415cbd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f24040b6c70 tx=0x7f23f4009780 comp rx=0 tx=0).stop 2023-10-09T06:21:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f240ab6f700 1 -- 172.21.15.31:0/120720689 shutdown_connections 2023-10-09T06:21:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f240ab6f700 1 --2- 172.21.15.31:0/120720689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240415dda0 0x7f240415cbd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f240ab6f700 1 --2- 172.21.15.31:0/120720689 >> v2:172.21.15.158:3300/0 conn(0x7f24040cdab0 0x7f240415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f240ab6f700 1 -- 172.21.15.31:0/120720689 >> 172.21.15.31:0/120720689 conn(0x7f2404067660 msgr2=0x7f2404067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f240ab6f700 1 -- 172.21.15.31:0/120720689 shutdown_connections 2023-10-09T06:21:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.938+0000 7f240ab6f700 1 -- 172.21.15.31:0/120720689 wait complete. 2023-10-09T06:21:28.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.939+0000 7f240ab6f700 1 Processor -- start 2023-10-09T06:21:28.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.940+0000 7f240ab6f700 1 -- start start 2023-10-09T06:21:28.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.940+0000 7f240ab6f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24040cd6e0 0x7f240414cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:28.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.940+0000 7f240ab6f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24040cdab0 0x7f24040b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.940+0000 7f240ab6f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f240415dda0 0x7f24040b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.940+0000 7f240ab6f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24040b4d40 con 0x7f24040cd6e0 2023-10-09T06:21:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.940+0000 7f240ab6f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240414d050 con 0x7f24040cdab0 2023-10-09T06:21:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.940+0000 7f240ab6f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24040c8a50 con 0x7f240415dda0 2023-10-09T06:21:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.940+0000 7f2409b6d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24040cd6e0 0x7f240414cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.940+0000 7f2409b6d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24040cd6e0 0x7f240414cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54406/0 (socket says 172.21.15.31:54406) 2023-10-09T06:21:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.940+0000 7f2409b6d700 1 -- 172.21.15.31:0/1184118584 learned_addr learned my addr 172.21.15.31:0/1184118584 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.940+0000 7f240936c700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24040cdab0 0x7f24040b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.940+0000 7f240a36e700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f240415dda0 0x7f24040b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.941+0000 7f2409b6d700 1 -- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f240415dda0 msgr2=0x7f24040b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.941+0000 7f2409b6d700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f240415dda0 0x7f24040b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.941+0000 7f2409b6d700 1 -- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24040cdab0 msgr2=0x7f24040b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.941+0000 7f2409b6d700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24040cdab0 0x7f24040b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.941+0000 7f2409b6d700 1 -- 172.21.15.31:0/1184118584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f4009a20 con 0x7f24040cd6e0 2023-10-09T06:21:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.941+0000 7f2409b6d700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24040cd6e0 0x7f240414cb10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00c810 tx=0x7f23fc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.941+0000 7f2401ffb700 1 -- 172.21.15.31:0/1184118584 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc005b30 con 0x7f24040cd6e0 2023-10-09T06:21:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.941+0000 7f2401ffb700 1 -- 172.21.15.31:0/1184118584 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc005c90 con 0x7f24040cd6e0 2023-10-09T06:21:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.941+0000 7f240ab6f700 1 -- 172.21.15.31:0/1184118584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24040c8d30 con 0x7f24040cd6e0 2023-10-09T06:21:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.941+0000 7f2401ffb700 1 -- 172.21.15.31:0/1184118584 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc007300 con 0x7f24040cd6e0 2023-10-09T06:21:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.941+0000 7f240ab6f700 1 -- 172.21.15.31:0/1184118584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24040c92f0 con 0x7f24040cd6e0 2023-10-09T06:21:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.942+0000 7f240ab6f700 1 -- 172.21.15.31:0/1184118584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2404089280 con 0x7f24040cd6e0 2023-10-09T06:21:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.943+0000 7f2401ffb700 1 -- 172.21.15.31:0/1184118584 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23fc01b3b0 con 0x7f24040cd6e0 2023-10-09T06:21:28.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.943+0000 7f2401ffb700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f23f0066f30 0x7f23f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:28.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.943+0000 7f2401ffb700 1 -- 172.21.15.31:0/1184118584 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23fc083ad0 con 0x7f24040cd6e0 2023-10-09T06:21:28.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.943+0000 7f240936c700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f23f0066f30 0x7f23f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:28.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.944+0000 7f240936c700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f23f0066f30 0x7f23f00693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f24040b2cc0 tx=0x7f23f80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:28.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:28.948+0000 7f2401ffb700 1 -- 172.21.15.31:0/1184118584 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23fc050d40 con 0x7f24040cd6e0 2023-10-09T06:21:29.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.185+0000 7f240ab6f700 1 -- 172.21.15.31:0/1184118584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f240415db80 con 0x7f24040cd6e0 2023-10-09T06:21:29.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.186+0000 7f2401ffb700 1 -- 172.21.15.31:0/1184118584 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f23fc017020 con 0x7f24040cd6e0 2023-10-09T06:21:29.187 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:29.187 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3437172994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3437172994},{"type":"v1","addr":"172.21.15.158:6836","nonce":3437172994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2894447386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2894447386},{"type":"v1","addr":"172.21.15.31:6834","nonce":2894447386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1034055293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1034055293},{"type":"v1","addr":"172.21.15.31:6835","nonce":1034055293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:20:54.080779+0000","modified":"2023-10-09T06:20:57.714511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1189249944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1189249944},{"type":"v1","addr":"172.21.15.158:6837","nonce":1189249944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:21:29.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.188+0000 7f240ab6f700 1 -- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f23f0066f30 msgr2=0x7f23f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:29.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.188+0000 7f240ab6f700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f23f0066f30 0x7f23f00693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f24040b2cc0 tx=0x7f23f80091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.188+0000 7f240ab6f700 1 -- 172.21.15.31:0/1184118584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24040cd6e0 msgr2=0x7f240414cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:29.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.188+0000 7f240ab6f700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24040cd6e0 0x7f240414cb10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00c810 tx=0x7f23fc007df0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.188+0000 7f240ab6f700 1 -- 172.21.15.31:0/1184118584 shutdown_connections 2023-10-09T06:21:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.188+0000 7f240ab6f700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f23f0066f30 0x7f23f00693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.188+0000 7f240ab6f700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f240415dda0 0x7f24040b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.188+0000 7f240ab6f700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24040cd6e0 0x7f240414cb10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.188+0000 7f240ab6f700 1 --2- 172.21.15.31:0/1184118584 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24040cdab0 0x7f24040b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.188+0000 7f240ab6f700 1 -- 172.21.15.31:0/1184118584 >> 172.21.15.31:0/1184118584 conn(0x7f2404067660 msgr2=0x7f240414d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.188+0000 7f240ab6f700 1 -- 172.21.15.31:0/1184118584 shutdown_connections 2023-10-09T06:21:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.188+0000 7f240ab6f700 1 -- 172.21.15.31:0/1184118584 wait complete. 2023-10-09T06:21:29.191 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2023-10-09T06:21:29.201 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:29.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.321+0000 7f03dc3af700 1 Processor -- start 2023-10-09T06:21:29.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.321+0000 7f03dc3af700 1 -- start start 2023-10-09T06:21:29.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.321+0000 7f03dc3af700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03d4157870 0x7f03d415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:29.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.321+0000 7f03dc3af700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03d415a620 0x7f03d415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:29.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.321+0000 7f03dc3af700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d415cbb0 con 0x7f03d415d580 2023-10-09T06:21:29.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.321+0000 7f03dc3af700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d415bfa0 con 0x7f03d415a620 2023-10-09T06:21:29.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.321+0000 7f03dc3af700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d415c280 con 0x7f03d4157870 2023-10-09T06:21:29.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.322+0000 7f03d994a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03d415a620 0x7f03d415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:29.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.322+0000 7f03d994a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03d415a620 0x7f03d415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54416/0 (socket says 172.21.15.31:54416) 2023-10-09T06:21:29.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.322+0000 7f03d994a700 1 -- 172.21.15.31:0/752876700 learned_addr learned my addr 172.21.15.31:0/752876700 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:29.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.322+0000 7f03da14b700 1 --2- 172.21.15.31:0/752876700 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03d4157870 0x7f03d415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:29.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.322+0000 7f03d994a700 1 -- 172.21.15.31:0/752876700 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03d4157870 msgr2=0x7f03d415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:29.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.322+0000 7f03d994a700 1 --2- 172.21.15.31:0/752876700 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03d4157870 0x7f03d415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.322+0000 7f03d994a700 1 -- 172.21.15.31:0/752876700 >> v1:172.21.15.158:6789/0 conn(0x7f03d415d580 legacy=0x7f03d4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:29.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.322+0000 7f03d994a700 1 -- 172.21.15.31:0/752876700 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d415c560 con 0x7f03d415a620 2023-10-09T06:21:29.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.322+0000 7f03d994a700 1 --2- 172.21.15.31:0/752876700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d415a620 0x7f03d415d040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f03c80099b0 tx=0x7f03c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3783a8cb6b6fa991 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:29.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.322+0000 7f03d9149700 1 -- 172.21.15.31:0/752876700 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c8009ea0 con 0x7f03d415a620 2023-10-09T06:21:29.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.322+0000 7f03d9149700 1 -- 172.21.15.31:0/752876700 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c800b860 con 0x7f03d415a620 2023-10-09T06:21:29.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.322+0000 7f03d9149700 1 -- 172.21.15.31:0/752876700 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c800bc00 con 0x7f03d415a620 2023-10-09T06:21:29.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.323+0000 7f03dc3af700 1 -- 172.21.15.31:0/752876700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d415a620 msgr2=0x7f03d415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:29.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.323+0000 7f03dc3af700 1 --2- 172.21.15.31:0/752876700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d415a620 0x7f03d415d040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f03c80099b0 tx=0x7f03c8009250 comp rx=0 tx=0).stop 2023-10-09T06:21:29.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.323+0000 7f03dc3af700 1 -- 172.21.15.31:0/752876700 shutdown_connections 2023-10-09T06:21:29.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.323+0000 7f03dc3af700 1 --2- 172.21.15.31:0/752876700 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03d4157870 0x7f03d415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.323+0000 7f03dc3af700 1 --2- 172.21.15.31:0/752876700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d415a620 0x7f03d415d040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.323+0000 7f03dc3af700 1 -- 172.21.15.31:0/752876700 >> 172.21.15.31:0/752876700 conn(0x7f03d4068ce0 msgr2=0x7f03d40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:29.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.323+0000 7f03dc3af700 1 -- 172.21.15.31:0/752876700 shutdown_connections 2023-10-09T06:21:29.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.323+0000 7f03dc3af700 1 -- 172.21.15.31:0/752876700 wait complete. 2023-10-09T06:21:29.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.324+0000 7f03dc3af700 1 Processor -- start 2023-10-09T06:21:29.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.324+0000 7f03dc3af700 1 -- start start 2023-10-09T06:21:29.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03dc3af700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03d4157870 0x7f03d40cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:29.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03dc3af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d415a620 0x7f03d40d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:29.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03dc3af700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03d415d580 0x7f03d41498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:29.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03dc3af700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d416eac0 con 0x7f03d415a620 2023-10-09T06:21:29.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03dc3af700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d416deb0 con 0x7f03d415d580 2023-10-09T06:21:29.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03dc3af700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d416e190 con 0x7f03d4157870 2023-10-09T06:21:29.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03d994a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d415a620 0x7f03d40d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:29.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03d994a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d415a620 0x7f03d40d05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54428/0 (socket says 172.21.15.31:54428) 2023-10-09T06:21:29.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03d994a700 1 -- 172.21.15.31:0/3599580907 learned_addr learned my addr 172.21.15.31:0/3599580907 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:29.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03da94c700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03d415d580 0x7f03d41498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:29.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03da14b700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03d4157870 0x7f03d40cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:29.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03d994a700 1 -- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03d4157870 msgr2=0x7f03d40cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:29.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03d994a700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03d4157870 0x7f03d40cfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03d994a700 1 -- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03d415d580 msgr2=0x7f03d41498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:29.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03d994a700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03d415d580 0x7f03d41498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03d994a700 1 -- 172.21.15.31:0/3599580907 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c80094f0 con 0x7f03d415a620 2023-10-09T06:21:29.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03da94c700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03d415d580 0x7f03d41498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:29.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.325+0000 7f03d994a700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d415a620 0x7f03d40d05d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f03d406b530 tx=0x7f03c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:29.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.326+0000 7f03d27fc700 1 -- 172.21.15.31:0/3599580907 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c800bbe0 con 0x7f03d415a620 2023-10-09T06:21:29.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.326+0000 7f03d27fc700 1 -- 172.21.15.31:0/3599580907 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c8011420 con 0x7f03d415a620 2023-10-09T06:21:29.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.326+0000 7f03dc3af700 1 -- 172.21.15.31:0/3599580907 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d416e470 con 0x7f03d415a620 2023-10-09T06:21:29.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.326+0000 7f03d27fc700 1 -- 172.21.15.31:0/3599580907 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c80117c0 con 0x7f03d415a620 2023-10-09T06:21:29.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.326+0000 7f03dc3af700 1 -- 172.21.15.31:0/3599580907 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d40d0b10 con 0x7f03d415a620 2023-10-09T06:21:29.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.327+0000 7f03dc3af700 1 -- 172.21.15.31:0/3599580907 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d404c3c0 con 0x7f03d415a620 2023-10-09T06:21:29.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.327+0000 7f03d27fc700 1 -- 172.21.15.31:0/3599580907 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03c8011bf0 con 0x7f03d415a620 2023-10-09T06:21:29.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.328+0000 7f03d27fc700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f03c0066f30 0x7f03c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:29.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.328+0000 7f03d27fc700 1 -- 172.21.15.31:0/3599580907 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03c8085ec0 con 0x7f03d415a620 2023-10-09T06:21:29.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.328+0000 7f03da14b700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f03c0066f30 0x7f03c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:29.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.328+0000 7f03da14b700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f03c0066f30 0x7f03c00693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009db0 tx=0x7f03cc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:29.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.332+0000 7f03d27fc700 1 -- 172.21.15.31:0/3599580907 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03c8053090 con 0x7f03d415a620 2023-10-09T06:21:29.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.525+0000 7f03dc3af700 1 -- 172.21.15.31:0/3599580907 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03d415c840 con 0x7f03d415a620 2023-10-09T06:21:29.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.526+0000 7f03d27fc700 1 -- 172.21.15.31:0/3599580907 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f03c80566b0 con 0x7f03d415a620 2023-10-09T06:21:29.527 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:29.527 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:55.693313+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:29.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.528+0000 7f03dc3af700 1 -- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f03c0066f30 msgr2=0x7f03c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:29.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.528+0000 7f03dc3af700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f03c0066f30 0x7f03c00693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009db0 tx=0x7f03cc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.528+0000 7f03dc3af700 1 -- 172.21.15.31:0/3599580907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d415a620 msgr2=0x7f03d40d05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.528+0000 7f03dc3af700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d415a620 0x7f03d40d05d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f03d406b530 tx=0x7f03c8017000 comp rx=0 tx=0).stop 2023-10-09T06:21:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.528+0000 7f03dc3af700 1 -- 172.21.15.31:0/3599580907 shutdown_connections 2023-10-09T06:21:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.528+0000 7f03dc3af700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f03c0066f30 0x7f03c00693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.529+0000 7f03dc3af700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03d4157870 0x7f03d40cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.529+0000 7f03dc3af700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03d415d580 0x7f03d41498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.529+0000 7f03dc3af700 1 --2- 172.21.15.31:0/3599580907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d415a620 0x7f03d40d05d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.529+0000 7f03dc3af700 1 -- 172.21.15.31:0/3599580907 >> 172.21.15.31:0/3599580907 conn(0x7f03d4068ce0 msgr2=0x7f03d4158ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.529+0000 7f03dc3af700 1 -- 172.21.15.31:0/3599580907 shutdown_connections 2023-10-09T06:21:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.529+0000 7f03dc3af700 1 -- 172.21.15.31:0/3599580907 wait complete. 2023-10-09T06:21:29.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:20:52.621337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:20:53.053532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:21:29.542 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:21:29.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.662+0000 7f57fbcd8700 1 Processor -- start 2023-10-09T06:21:29.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.663+0000 7f57fbcd8700 1 -- start start 2023-10-09T06:21:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.663+0000 7f57fbcd8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f57f4159ec0 0x7f57f40af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57fbcd8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57f415a290 0x7f57f40afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57fbcd8700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f40b0790 con 0x7f57f406a5a0 2023-10-09T06:21:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57fbcd8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f40ce1f0 con 0x7f57f415a290 2023-10-09T06:21:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57fbcd8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f40b0b20 con 0x7f57f4159ec0 2023-10-09T06:21:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57f9273700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57f415a290 0x7f57f40afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57f9273700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57f415a290 0x7f57f40afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44276/0 (socket says 172.21.15.31:44276) 2023-10-09T06:21:29.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57f9273700 1 -- 172.21.15.31:0/3978484633 learned_addr learned my addr 172.21.15.31:0/3978484633 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:29.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57f9a74700 1 --2- 172.21.15.31:0/3978484633 >> v2:172.21.15.158:3300/0 conn(0x7f57f4159ec0 0x7f57f40af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:29.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57f9273700 1 -- 172.21.15.31:0/3978484633 >> v2:172.21.15.158:3300/0 conn(0x7f57f4159ec0 msgr2=0x7f57f40af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:29.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57f9273700 1 --2- 172.21.15.31:0/3978484633 >> v2:172.21.15.158:3300/0 conn(0x7f57f4159ec0 0x7f57f40af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57f9273700 1 -- 172.21.15.31:0/3978484633 >> v1:172.21.15.158:6789/0 conn(0x7f57f406a5a0 legacy=0x7f57f415db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:29.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57f9273700 1 -- 172.21.15.31:0/3978484633 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f40b04b0 con 0x7f57f415a290 2023-10-09T06:21:29.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57f9273700 1 --2- 172.21.15.31:0/3978484633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57f415a290 0x7f57f40afe80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f57f40898e0 tx=0x7f57e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149967df747fbbe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:29.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57f8a72700 1 -- 172.21.15.31:0/3978484633 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e800b820 con 0x7f57f415a290 2023-10-09T06:21:29.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57f8a72700 1 -- 172.21.15.31:0/3978484633 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e800b980 con 0x7f57f415a290 2023-10-09T06:21:29.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.664+0000 7f57f8a72700 1 -- 172.21.15.31:0/3978484633 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e800bd20 con 0x7f57f415a290 2023-10-09T06:21:29.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.665+0000 7f57fbcd8700 1 -- 172.21.15.31:0/3978484633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57f415a290 msgr2=0x7f57f40afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:29.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.665+0000 7f57fbcd8700 1 --2- 172.21.15.31:0/3978484633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57f415a290 0x7f57f40afe80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f57f40898e0 tx=0x7f57e8009250 comp rx=0 tx=0).stop 2023-10-09T06:21:29.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.665+0000 7f57fbcd8700 1 -- 172.21.15.31:0/3978484633 shutdown_connections 2023-10-09T06:21:29.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.665+0000 7f57fbcd8700 1 --2- 172.21.15.31:0/3978484633 >> v2:172.21.15.158:3300/0 conn(0x7f57f4159ec0 0x7f57f40af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.665+0000 7f57fbcd8700 1 --2- 172.21.15.31:0/3978484633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57f415a290 0x7f57f40afe80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.665+0000 7f57fbcd8700 1 -- 172.21.15.31:0/3978484633 >> 172.21.15.31:0/3978484633 conn(0x7f57f40d1880 msgr2=0x7f57f40cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:29.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.665+0000 7f57fbcd8700 1 -- 172.21.15.31:0/3978484633 shutdown_connections 2023-10-09T06:21:29.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.665+0000 7f57fbcd8700 1 -- 172.21.15.31:0/3978484633 wait complete. 2023-10-09T06:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.666+0000 7f57fbcd8700 1 Processor -- start 2023-10-09T06:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.666+0000 7f57fbcd8700 1 -- start start 2023-10-09T06:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fbcd8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57f406a5a0 0x7f57f4155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fbcd8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57f4159ec0 0x7f57f40b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fbcd8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57f415a290 0x7f57f415b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fbcd8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f40b23c0 con 0x7f57f415a290 2023-10-09T06:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fbcd8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f40b26a0 con 0x7f57f4159ec0 2023-10-09T06:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fbcd8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f40b2980 con 0x7f57f406a5a0 2023-10-09T06:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fa275700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57f415a290 0x7f57f415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fa275700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57f415a290 0x7f57f415b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44292/0 (socket says 172.21.15.31:44292) 2023-10-09T06:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fa275700 1 -- 172.21.15.31:0/1501386485 learned_addr learned my addr 172.21.15.31:0/1501386485 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fa275700 1 -- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57f406a5a0 msgr2=0x7f57f4155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57f9273700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57f4159ec0 0x7f57f40b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57f9a74700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57f406a5a0 0x7f57f4155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fa275700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57f406a5a0 0x7f57f4155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fa275700 1 -- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57f4159ec0 msgr2=0x7f57f40b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fa275700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57f4159ec0 0x7f57f40b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fa275700 1 -- 172.21.15.31:0/1501386485 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e80094f0 con 0x7f57f415a290 2023-10-09T06:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57f9a74700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57f406a5a0 0x7f57f4155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57f9273700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57f4159ec0 0x7f57f40b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.667+0000 7f57fa275700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57f415a290 0x7f57f415b090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f57e400c930 tx=0x7f57e40026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.668+0000 7f57f1ffb700 1 -- 172.21.15.31:0/1501386485 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e400ce70 con 0x7f57f415a290 2023-10-09T06:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.668+0000 7f57f1ffb700 1 -- 172.21.15.31:0/1501386485 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e400a7e0 con 0x7f57f415a290 2023-10-09T06:21:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.668+0000 7f57fbcd8700 1 -- 172.21.15.31:0/1501386485 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f40b4db0 con 0x7f57f415a290 2023-10-09T06:21:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.668+0000 7f57f1ffb700 1 -- 172.21.15.31:0/1501386485 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e400aba0 con 0x7f57f415a290 2023-10-09T06:21:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.668+0000 7f57fbcd8700 1 -- 172.21.15.31:0/1501386485 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f40b2090 con 0x7f57f415a290 2023-10-09T06:21:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.669+0000 7f57fbcd8700 1 -- 172.21.15.31:0/1501386485 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f40b4bf0 con 0x7f57f415a290 2023-10-09T06:21:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.669+0000 7f57f1ffb700 1 -- 172.21.15.31:0/1501386485 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57e4012420 con 0x7f57f415a290 2023-10-09T06:21:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.669+0000 7f57f1ffb700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57e0066f30 0x7f57e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.670+0000 7f57f1ffb700 1 -- 172.21.15.31:0/1501386485 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f57e4084940 con 0x7f57f415a290 2023-10-09T06:21:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.670+0000 7f57f9a74700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57e0066f30 0x7f57e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.670+0000 7f57f9a74700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57e0066f30 0x7f57e00693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f57f40d0830 tx=0x7f57ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:29.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.674+0000 7f57f1ffb700 1 -- 172.21.15.31:0/1501386485 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57e4051c60 con 0x7f57f415a290 2023-10-09T06:21:29.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.864+0000 7f57fbcd8700 1 -- 172.21.15.31:0/1501386485 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57f404c3c0 con 0x7f57f415a290 2023-10-09T06:21:29.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.864+0000 7f57f1ffb700 1 -- 172.21.15.31:0/1501386485 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57e4016020 con 0x7f57f415a290 2023-10-09T06:21:29.865 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:21:29.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.866+0000 7f57fbcd8700 1 -- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57e0066f30 msgr2=0x7f57e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:29.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.866+0000 7f57fbcd8700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57e0066f30 0x7f57e00693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f57f40d0830 tx=0x7f57ec008040 comp rx=0 tx=0).stop 2023-10-09T06:21:29.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.866+0000 7f57fbcd8700 1 -- 172.21.15.31:0/1501386485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57f415a290 msgr2=0x7f57f415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:29.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.866+0000 7f57fbcd8700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57f415a290 0x7f57f415b090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f57e400c930 tx=0x7f57e40026e0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.866+0000 7f57fbcd8700 1 -- 172.21.15.31:0/1501386485 shutdown_connections 2023-10-09T06:21:29.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.866+0000 7f57fbcd8700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57e0066f30 0x7f57e00693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.866+0000 7f57fbcd8700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57f406a5a0 0x7f57f4155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.866+0000 7f57fbcd8700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57f415a290 0x7f57f415b090 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.866+0000 7f57fbcd8700 1 --2- 172.21.15.31:0/1501386485 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57f4159ec0 0x7f57f40b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:29.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.866+0000 7f57fbcd8700 1 -- 172.21.15.31:0/1501386485 >> 172.21.15.31:0/1501386485 conn(0x7f57f40d1880 msgr2=0x7f57f4157540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:29.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.866+0000 7f57fbcd8700 1 -- 172.21.15.31:0/1501386485 shutdown_connections 2023-10-09T06:21:29.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:29.866+0000 7f57fbcd8700 1 -- 172.21.15.31:0/1501386485 wait complete. 2023-10-09T06:21:29.878 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:21:30.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.000+0000 7f936e7eb700 1 Processor -- start 2023-10-09T06:21:30.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.000+0000 7f936e7eb700 1 -- start start 2023-10-09T06:21:30.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.001+0000 7f936e7eb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93680cce30 0x7f936815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.001+0000 7f936e7eb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93680b4d70 con 0x7f93680b6580 2023-10-09T06:21:30.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.001+0000 7f936e7eb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93680cd8d0 con 0x7f936806aa00 2023-10-09T06:21:30.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.001+0000 7f936e7eb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93680b4440 con 0x7f93680cce30 2023-10-09T06:21:30.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.001+0000 7f936d7e9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93680cce30 0x7f936815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.001+0000 7f936d7e9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93680cce30 0x7f936815aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44300/0 (socket says 172.21.15.31:44300) 2023-10-09T06:21:30.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.001+0000 7f936cfe8700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f93680b6580 0x7f936806a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33140/0 (socket says 172.21.15.31:33140) 2023-10-09T06:21:30.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.001+0000 7f936d7e9700 1 -- 172.21.15.31:0/3400782655 learned_addr learned my addr 172.21.15.31:0/3400782655 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:30.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.001+0000 7f936d7e9700 1 -- 172.21.15.31:0/3400782655 >> v1:172.21.15.158:6789/0 conn(0x7f936806aa00 legacy=0x7f93680b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.001+0000 7f936d7e9700 1 -- 172.21.15.31:0/3400782655 >> v1:172.21.15.31:6789/0 conn(0x7f93680b6580 legacy=0x7f936806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.001+0000 7f936d7e9700 1 -- 172.21.15.31:0/3400782655 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93680b4720 con 0x7f93680cce30 2023-10-09T06:21:30.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.001+0000 7f935ffff700 1 -- 172.21.15.31:0/3400782655 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648190878 0 0) 0x7f93680b4d70 con 0x7f93680b6580 2023-10-09T06:21:30.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.001+0000 7f936d7e9700 1 --2- 172.21.15.31:0/3400782655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93680cce30 0x7f936815aca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93640099b0 tx=0x7f9364009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66a7c17184a5b8a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:30.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.002+0000 7f935ffff700 1 -- 172.21.15.31:0/3400782655 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936400b860 con 0x7f93680cce30 2023-10-09T06:21:30.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.002+0000 7f935ffff700 1 -- 172.21.15.31:0/3400782655 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936400b9c0 con 0x7f93680cce30 2023-10-09T06:21:30.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.002+0000 7f935ffff700 1 -- 172.21.15.31:0/3400782655 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936400bd60 con 0x7f93680cce30 2023-10-09T06:21:30.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.002+0000 7f936e7eb700 1 -- 172.21.15.31:0/3400782655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93680cce30 msgr2=0x7f936815aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.002+0000 7f936e7eb700 1 --2- 172.21.15.31:0/3400782655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93680cce30 0x7f936815aca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93640099b0 tx=0x7f9364009250 comp rx=0 tx=0).stop 2023-10-09T06:21:30.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.002+0000 7f936e7eb700 1 -- 172.21.15.31:0/3400782655 shutdown_connections 2023-10-09T06:21:30.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.002+0000 7f936e7eb700 1 --2- 172.21.15.31:0/3400782655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93680cce30 0x7f936815aca0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.002+0000 7f936e7eb700 1 -- 172.21.15.31:0/3400782655 >> 172.21.15.31:0/3400782655 conn(0x7f9368068cb0 msgr2=0x7f93680690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:30.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.002+0000 7f936e7eb700 1 -- 172.21.15.31:0/3400782655 shutdown_connections 2023-10-09T06:21:30.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.002+0000 7f936e7eb700 1 -- 172.21.15.31:0/3400782655 wait complete. 2023-10-09T06:21:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.003+0000 7f936e7eb700 1 Processor -- start 2023-10-09T06:21:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.003+0000 7f936e7eb700 1 -- start start 2023-10-09T06:21:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.004+0000 7f936e7eb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f936806aa00 0x7f93681538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.004+0000 7f936e7eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93680b6580 0x7f9368156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.004+0000 7f936e7eb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93680cce30 0x7f93681577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.004+0000 7f936e7eb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9368152820 con 0x7f93680b6580 2023-10-09T06:21:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.004+0000 7f936e7eb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9368152b00 con 0x7f93680cce30 2023-10-09T06:21:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.004+0000 7f936e7eb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9368152de0 con 0x7f936806aa00 2023-10-09T06:21:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.004+0000 7f936cfe8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93680b6580 0x7f9368156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.004+0000 7f936cfe8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93680b6580 0x7f9368156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44316/0 (socket says 172.21.15.31:44316) 2023-10-09T06:21:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.004+0000 7f936cfe8700 1 -- 172.21.15.31:0/505399292 learned_addr learned my addr 172.21.15.31:0/505399292 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.004+0000 7f936dfea700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93680cce30 0x7f93681577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.005+0000 7f936d7e9700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f936806aa00 0x7f93681538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.005+0000 7f936cfe8700 1 -- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f936806aa00 msgr2=0x7f93681538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.005+0000 7f936cfe8700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f936806aa00 0x7f93681538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.005+0000 7f936cfe8700 1 -- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93680cce30 msgr2=0x7f93681577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.005+0000 7f936cfe8700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93680cce30 0x7f93681577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.005+0000 7f936cfe8700 1 -- 172.21.15.31:0/505399292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93640094f0 con 0x7f93680b6580 2023-10-09T06:21:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.005+0000 7f936dfea700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93680cce30 0x7f93681577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.005+0000 7f936cfe8700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93680b6580 0x7f9368156550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f935800c810 tx=0x7f9358007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.005+0000 7f935d7fa700 1 -- 172.21.15.31:0/505399292 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93580073d0 con 0x7f93680b6580 2023-10-09T06:21:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.005+0000 7f935d7fa700 1 -- 172.21.15.31:0/505399292 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9358007550 con 0x7f93680b6580 2023-10-09T06:21:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.005+0000 7f936e7eb700 1 -- 172.21.15.31:0/505399292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93681530c0 con 0x7f93680b6580 2023-10-09T06:21:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.005+0000 7f935d7fa700 1 -- 172.21.15.31:0/505399292 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358004a80 con 0x7f93680b6580 2023-10-09T06:21:30.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.005+0000 7f936e7eb700 1 -- 172.21.15.31:0/505399292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9368156a90 con 0x7f93680b6580 2023-10-09T06:21:30.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.006+0000 7f936e7eb700 1 -- 172.21.15.31:0/505399292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93681535e0 con 0x7f93680b6580 2023-10-09T06:21:30.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.006+0000 7f935d7fa700 1 -- 172.21.15.31:0/505399292 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f935801c3b0 con 0x7f93680b6580 2023-10-09T06:21:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.007+0000 7f935d7fa700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f934c066f30 0x7f934c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.007+0000 7f935d7fa700 1 -- 172.21.15.31:0/505399292 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9358083a30 con 0x7f93680b6580 2023-10-09T06:21:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.007+0000 7f936d7e9700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f934c066f30 0x7f934c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.007+0000 7f936d7e9700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f934c066f30 0x7f934c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f93640099b0 tx=0x7f9364017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:30.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.011+0000 7f935d7fa700 1 -- 172.21.15.31:0/505399292 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93681535e0 con 0x7f93680b6580 2023-10-09T06:21:30.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.202+0000 7f936e7eb700 1 -- 172.21.15.31:0/505399292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93681535e0 con 0x7f93680b6580 2023-10-09T06:21:30.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.203+0000 7f935d7fa700 1 -- 172.21.15.31:0/505399292 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9358018020 con 0x7f93680b6580 2023-10-09T06:21:30.204 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:21:30.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.205+0000 7f936e7eb700 1 -- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f934c066f30 msgr2=0x7f934c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.205+0000 7f936e7eb700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f934c066f30 0x7f934c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f93640099b0 tx=0x7f9364017000 comp rx=0 tx=0).stop 2023-10-09T06:21:30.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.205+0000 7f936e7eb700 1 -- 172.21.15.31:0/505399292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93680b6580 msgr2=0x7f9368156550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.205+0000 7f936e7eb700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93680b6580 0x7f9368156550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f935800c810 tx=0x7f9358007d90 comp rx=0 tx=0).stop 2023-10-09T06:21:30.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.205+0000 7f936e7eb700 1 -- 172.21.15.31:0/505399292 shutdown_connections 2023-10-09T06:21:30.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.205+0000 7f936e7eb700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f934c066f30 0x7f934c0693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.205+0000 7f936e7eb700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f936806aa00 0x7f93681538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.205+0000 7f936e7eb700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93680cce30 0x7f93681577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.205+0000 7f936e7eb700 1 --2- 172.21.15.31:0/505399292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93680b6580 0x7f9368156550 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.205+0000 7f936e7eb700 1 -- 172.21.15.31:0/505399292 >> 172.21.15.31:0/505399292 conn(0x7f9368068cb0 msgr2=0x7f936815c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:30.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.205+0000 7f936e7eb700 1 -- 172.21.15.31:0/505399292 shutdown_connections 2023-10-09T06:21:30.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.205+0000 7f936e7eb700 1 -- 172.21.15.31:0/505399292 wait complete. 2023-10-09T06:21:30.218 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:21:30.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.339+0000 7f465932b700 1 Processor -- start 2023-10-09T06:21:30.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.339+0000 7f465932b700 1 -- start start 2023-10-09T06:21:30.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.340+0000 7f465932b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f465406aa00 0x7f4654164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.340+0000 7f465932b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46540b4d70 con 0x7f46540cce30 2023-10-09T06:21:30.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.340+0000 7f465932b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465415b3b0 con 0x7f46540b6580 2023-10-09T06:21:30.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.340+0000 7f465932b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46540cd8d0 con 0x7f465406aa00 2023-10-09T06:21:30.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.340+0000 7f4658b2a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f465406aa00 0x7f4654164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.340+0000 7f4653fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f46540cce30 0x7f465415aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33144/0 (socket says 172.21.15.31:33144) 2023-10-09T06:21:30.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.340+0000 7f4653fff700 1 -- 172.21.15.31:0/1259780872 learned_addr learned my addr 172.21.15.31:0/1259780872 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:30.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.340+0000 7f4658b2a700 1 -- 172.21.15.31:0/1259780872 >> v1:172.21.15.158:6789/0 conn(0x7f46540b6580 legacy=0x7f465406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:30.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.340+0000 7f4658b2a700 1 -- 172.21.15.31:0/1259780872 >> v1:172.21.15.31:6789/0 conn(0x7f46540cce30 legacy=0x7f465415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.340+0000 7f4658b2a700 1 -- 172.21.15.31:0/1259780872 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540b4440 con 0x7f465406aa00 2023-10-09T06:21:30.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.340+0000 7f46537fe700 1 -- 172.21.15.31:0/1259780872 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587683047 0 0) 0x7f46540b4d70 con 0x7f46540cce30 2023-10-09T06:21:30.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.341+0000 7f4658b2a700 1 --2- 172.21.15.31:0/1259780872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465406aa00 0x7f4654164c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f464c009e60 tx=0x7f464c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a3aef8b7db6fe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:30.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.341+0000 7f46537fe700 1 -- 172.21.15.31:0/1259780872 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c00e070 con 0x7f465406aa00 2023-10-09T06:21:30.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.341+0000 7f46537fe700 1 -- 172.21.15.31:0/1259780872 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c00bbf0 con 0x7f465406aa00 2023-10-09T06:21:30.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.341+0000 7f46537fe700 1 -- 172.21.15.31:0/1259780872 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c012430 con 0x7f465406aa00 2023-10-09T06:21:30.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.341+0000 7f465932b700 1 -- 172.21.15.31:0/1259780872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465406aa00 msgr2=0x7f4654164c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.341+0000 7f465932b700 1 --2- 172.21.15.31:0/1259780872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465406aa00 0x7f4654164c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f464c009e60 tx=0x7f464c009780 comp rx=0 tx=0).stop 2023-10-09T06:21:30.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.341+0000 7f465932b700 1 -- 172.21.15.31:0/1259780872 shutdown_connections 2023-10-09T06:21:30.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.341+0000 7f465932b700 1 --2- 172.21.15.31:0/1259780872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465406aa00 0x7f4654164c20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.341+0000 7f465932b700 1 -- 172.21.15.31:0/1259780872 >> 172.21.15.31:0/1259780872 conn(0x7f4654068cb0 msgr2=0x7f46540690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:30.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.341+0000 7f465932b700 1 -- 172.21.15.31:0/1259780872 shutdown_connections 2023-10-09T06:21:30.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.341+0000 7f465932b700 1 -- 172.21.15.31:0/1259780872 wait complete. 2023-10-09T06:21:30.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.342+0000 7f465932b700 1 Processor -- start 2023-10-09T06:21:30.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.343+0000 7f465932b700 1 -- start start 2023-10-09T06:21:30.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.343+0000 7f465932b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465406aa00 0x7f4654143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.343+0000 7f465932b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46540b6580 0x7f4654151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.343+0000 7f465932b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46540cce30 0x7f465415c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.343+0000 7f465932b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4654152da0 con 0x7f465406aa00 2023-10-09T06:21:30.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.343+0000 7f465932b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4654152790 con 0x7f46540cce30 2023-10-09T06:21:30.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.343+0000 7f465932b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4654155a70 con 0x7f46540b6580 2023-10-09T06:21:30.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.343+0000 7f4653fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465406aa00 0x7f4654143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.343+0000 7f4653fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465406aa00 0x7f4654143940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44330/0 (socket says 172.21.15.31:44330) 2023-10-09T06:21:30.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.343+0000 7f4653fff700 1 -- 172.21.15.31:0/1990920488 learned_addr learned my addr 172.21.15.31:0/1990920488 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:30.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.343+0000 7f4658b2a700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46540cce30 0x7f465415c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.343+0000 7f464bfff700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46540b6580 0x7f4654151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.344+0000 7f4653fff700 1 -- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46540b6580 msgr2=0x7f4654151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.344+0000 7f4653fff700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46540b6580 0x7f4654151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.344+0000 7f4653fff700 1 -- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46540cce30 msgr2=0x7f465415c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.344+0000 7f4653fff700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46540cce30 0x7f465415c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.344+0000 7f4653fff700 1 -- 172.21.15.31:0/1990920488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c009a20 con 0x7f465406aa00 2023-10-09T06:21:30.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.344+0000 7f464bfff700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46540b6580 0x7f4654151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:30.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.344+0000 7f4658b2a700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46540cce30 0x7f465415c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:30.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.344+0000 7f4653fff700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465406aa00 0x7f4654143940 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f464400c5b0 tx=0x7f4644001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:30.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.344+0000 7f4650ff9700 1 -- 172.21.15.31:0/1990920488 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644005b30 con 0x7f465406aa00 2023-10-09T06:21:30.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.344+0000 7f4650ff9700 1 -- 172.21.15.31:0/1990920488 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4644005c90 con 0x7f465406aa00 2023-10-09T06:21:30.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.344+0000 7f465932b700 1 -- 172.21.15.31:0/1990920488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4654155790 con 0x7f465406aa00 2023-10-09T06:21:30.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.344+0000 7f4650ff9700 1 -- 172.21.15.31:0/1990920488 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644007300 con 0x7f465406aa00 2023-10-09T06:21:30.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.344+0000 7f465932b700 1 -- 172.21.15.31:0/1990920488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46541522e0 con 0x7f465406aa00 2023-10-09T06:21:30.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.345+0000 7f465932b700 1 -- 172.21.15.31:0/1990920488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4654089550 con 0x7f465406aa00 2023-10-09T06:21:30.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.345+0000 7f4650ff9700 1 -- 172.21.15.31:0/1990920488 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f464401b3b0 con 0x7f465406aa00 2023-10-09T06:21:30.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.346+0000 7f4650ff9700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4634066f30 0x7f46340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.346+0000 7f4650ff9700 1 -- 172.21.15.31:0/1990920488 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4644083a70 con 0x7f465406aa00 2023-10-09T06:21:30.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.346+0000 7f464bfff700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4634066f30 0x7f46340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.346+0000 7f464bfff700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4634066f30 0x7f46340693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f463c007fd0 tx=0x7f463c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:30.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.350+0000 7f4650ff9700 1 -- 172.21.15.31:0/1990920488 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4644050ce0 con 0x7f465406aa00 2023-10-09T06:21:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.540+0000 7f465932b700 1 -- 172.21.15.31:0/1990920488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46540b4720 con 0x7f465406aa00 2023-10-09T06:21:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.540+0000 7f4650ff9700 1 -- 172.21.15.31:0/1990920488 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f46440170a0 con 0x7f465406aa00 2023-10-09T06:21:30.541 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:21:30.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.542+0000 7f465932b700 1 -- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4634066f30 msgr2=0x7f46340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.542+0000 7f465932b700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4634066f30 0x7f46340693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f463c007fd0 tx=0x7f463c009040 comp rx=0 tx=0).stop 2023-10-09T06:21:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.542+0000 7f465932b700 1 -- 172.21.15.31:0/1990920488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465406aa00 msgr2=0x7f4654143940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.542+0000 7f465932b700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465406aa00 0x7f4654143940 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f464400c5b0 tx=0x7f4644001070 comp rx=0 tx=0).stop 2023-10-09T06:21:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.542+0000 7f465932b700 1 -- 172.21.15.31:0/1990920488 shutdown_connections 2023-10-09T06:21:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.542+0000 7f465932b700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4634066f30 0x7f46340693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.542+0000 7f465932b700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46540cce30 0x7f465415c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.542+0000 7f465932b700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465406aa00 0x7f4654143940 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.542+0000 7f465932b700 1 --2- 172.21.15.31:0/1990920488 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46540b6580 0x7f4654151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.542+0000 7f465932b700 1 -- 172.21.15.31:0/1990920488 >> 172.21.15.31:0/1990920488 conn(0x7f4654068cb0 msgr2=0x7f46540cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.543+0000 7f465932b700 1 -- 172.21.15.31:0/1990920488 shutdown_connections 2023-10-09T06:21:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.543+0000 7f465932b700 1 -- 172.21.15.31:0/1990920488 wait complete. 2023-10-09T06:21:30.555 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:21:30.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.673+0000 7f54addad700 1 Processor -- start 2023-10-09T06:21:30.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.673+0000 7f54addad700 1 -- start start 2023-10-09T06:21:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54addad700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f54a815a2b0 0x7f54a80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54addad700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54a80cfe20 0x7f54a80ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54addad700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a80c5d80 con 0x7f54a80d1c30 2023-10-09T06:21:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54addad700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a8068470 con 0x7f54a80cfe20 2023-10-09T06:21:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54addad700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a80c6060 con 0x7f54a815a2b0 2023-10-09T06:21:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54a7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54a80cfe20 0x7f54a80ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54a6ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f54a80d1c30 0x7f54a80cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33148/0 (socket says 172.21.15.31:33148) 2023-10-09T06:21:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54a6ffd700 1 -- 172.21.15.31:0/1539175925 learned_addr learned my addr 172.21.15.31:0/1539175925 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54a77fe700 1 --2- 172.21.15.31:0/1539175925 >> v2:172.21.15.158:3300/0 conn(0x7f54a815a2b0 0x7f54a80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54a7fff700 1 -- 172.21.15.31:0/1539175925 >> v2:172.21.15.158:3300/0 conn(0x7f54a815a2b0 msgr2=0x7f54a80b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54a7fff700 1 --2- 172.21.15.31:0/1539175925 >> v2:172.21.15.158:3300/0 conn(0x7f54a815a2b0 0x7f54a80b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54a7fff700 1 -- 172.21.15.31:0/1539175925 >> v1:172.21.15.31:6789/0 conn(0x7f54a80d1c30 legacy=0x7f54a80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54a7fff700 1 -- 172.21.15.31:0/1539175925 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a80c6340 con 0x7f54a80cfe20 2023-10-09T06:21:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.674+0000 7f54a7fff700 1 --2- 172.21.15.31:0/1539175925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a80cfe20 0x7f54a80ccdd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f54a8089220 tx=0x7f54a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777dcea46b1dabdd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.675+0000 7f54a67fc700 1 -- 172.21.15.31:0/1539175925 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a000e070 con 0x7f54a80cfe20 2023-10-09T06:21:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.675+0000 7f54a67fc700 1 -- 172.21.15.31:0/1539175925 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a000bc30 con 0x7f54a80cfe20 2023-10-09T06:21:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.675+0000 7f54a67fc700 1 -- 172.21.15.31:0/1539175925 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0012430 con 0x7f54a80cfe20 2023-10-09T06:21:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.675+0000 7f54addad700 1 -- 172.21.15.31:0/1539175925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a80cfe20 msgr2=0x7f54a80ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.675+0000 7f54addad700 1 --2- 172.21.15.31:0/1539175925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a80cfe20 0x7f54a80ccdd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f54a8089220 tx=0x7f54a0009780 comp rx=0 tx=0).stop 2023-10-09T06:21:30.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.675+0000 7f54addad700 1 -- 172.21.15.31:0/1539175925 shutdown_connections 2023-10-09T06:21:30.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.675+0000 7f54addad700 1 --2- 172.21.15.31:0/1539175925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a80cfe20 0x7f54a80ccdd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.675+0000 7f54addad700 1 --2- 172.21.15.31:0/1539175925 >> v2:172.21.15.158:3300/0 conn(0x7f54a815a2b0 0x7f54a80b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.675+0000 7f54addad700 1 -- 172.21.15.31:0/1539175925 >> 172.21.15.31:0/1539175925 conn(0x7f54a8067e40 msgr2=0x7f54a80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:30.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.675+0000 7f54addad700 1 -- 172.21.15.31:0/1539175925 shutdown_connections 2023-10-09T06:21:30.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.675+0000 7f54addad700 1 -- 172.21.15.31:0/1539175925 wait complete. 2023-10-09T06:21:30.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.676+0000 7f54addad700 1 Processor -- start 2023-10-09T06:21:30.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.676+0000 7f54addad700 1 -- start start 2023-10-09T06:21:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.677+0000 7f54addad700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54a80cfe20 0x7f54a815ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.677+0000 7f54addad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a80d1c30 0x7f54a815b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.677+0000 7f54addad700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54a815a2b0 0x7f54a815bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.677+0000 7f54addad700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a815ddb0 con 0x7f54a80d1c30 2023-10-09T06:21:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.677+0000 7f54addad700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80ca1f0 con 0x7f54a815a2b0 2023-10-09T06:21:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.677+0000 7f54addad700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a8158460 con 0x7f54a80cfe20 2023-10-09T06:21:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.677+0000 7f54a6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a80d1c30 0x7f54a815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.677+0000 7f54a6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a80d1c30 0x7f54a815b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44354/0 (socket says 172.21.15.31:44354) 2023-10-09T06:21:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.677+0000 7f54a6ffd700 1 -- 172.21.15.31:0/3702690255 learned_addr learned my addr 172.21.15.31:0/3702690255 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.677+0000 7f54a77fe700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54a80cfe20 0x7f54a815ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.677+0000 7f54a7fff700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54a815a2b0 0x7f54a815bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.678+0000 7f54a6ffd700 1 -- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54a80cfe20 msgr2=0x7f54a815ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.678+0000 7f54a6ffd700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54a80cfe20 0x7f54a815ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.678+0000 7f54a6ffd700 1 -- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54a815a2b0 msgr2=0x7f54a815bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.678+0000 7f54a6ffd700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54a815a2b0 0x7f54a815bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.678+0000 7f54a6ffd700 1 -- 172.21.15.31:0/3702690255 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0009a20 con 0x7f54a80d1c30 2023-10-09T06:21:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.678+0000 7f54a7fff700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54a815a2b0 0x7f54a815bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.678+0000 7f54a6ffd700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a80d1c30 0x7f54a815b700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c5c0 tx=0x7f549c001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.678+0000 7f548f7fe700 1 -- 172.21.15.31:0/3702690255 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c005b30 con 0x7f54a80d1c30 2023-10-09T06:21:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.678+0000 7f548f7fe700 1 -- 172.21.15.31:0/3702690255 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c005cb0 con 0x7f54a80d1c30 2023-10-09T06:21:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.678+0000 7f54addad700 1 -- 172.21.15.31:0/3702690255 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a815dad0 con 0x7f54a80d1c30 2023-10-09T06:21:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.678+0000 7f548f7fe700 1 -- 172.21.15.31:0/3702690255 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c007320 con 0x7f54a80d1c30 2023-10-09T06:21:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.678+0000 7f54addad700 1 -- 172.21.15.31:0/3702690255 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a80c9e80 con 0x7f54a80d1c30 2023-10-09T06:21:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.679+0000 7f54addad700 1 -- 172.21.15.31:0/3702690255 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a804c3c0 con 0x7f54a80d1c30 2023-10-09T06:21:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.679+0000 7f548f7fe700 1 -- 172.21.15.31:0/3702690255 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f549c01b3b0 con 0x7f54a80d1c30 2023-10-09T06:21:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.680+0000 7f548f7fe700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5494066f30 0x7f54940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.680+0000 7f548f7fe700 1 -- 172.21.15.31:0/3702690255 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f549c083920 con 0x7f54a80d1c30 2023-10-09T06:21:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.680+0000 7f54a77fe700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5494066f30 0x7f54940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.680+0000 7f54a77fe700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5494066f30 0x7f54940693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f549800ac00 tx=0x7f5498008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.684+0000 7f548f7fe700 1 -- 172.21.15.31:0/3702690255 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f549c050b90 con 0x7f54a80d1c30 2023-10-09T06:21:30.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.923+0000 7f54addad700 1 -- 172.21.15.31:0/3702690255 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54a8064a00 con 0x7f54a80d1c30 2023-10-09T06:21:30.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.923+0000 7f548f7fe700 1 -- 172.21.15.31:0/3702690255 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f549c017020 con 0x7f54a80d1c30 2023-10-09T06:21:30.924 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:30.925 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3437172994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3437172994},{"type":"v1","addr":"172.21.15.158:6836","nonce":3437172994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2894447386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2894447386},{"type":"v1","addr":"172.21.15.31:6834","nonce":2894447386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1034055293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1034055293},{"type":"v1","addr":"172.21.15.31:6835","nonce":1034055293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:20:54.080779+0000","modified":"2023-10-09T06:20:57.714511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1189249944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1189249944},{"type":"v1","addr":"172.21.15.158:6837","nonce":1189249944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:21:30.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.925+0000 7f54addad700 1 -- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5494066f30 msgr2=0x7f54940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.925+0000 7f54addad700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5494066f30 0x7f54940693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f549800ac00 tx=0x7f5498008040 comp rx=0 tx=0).stop 2023-10-09T06:21:30.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.925+0000 7f54addad700 1 -- 172.21.15.31:0/3702690255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a80d1c30 msgr2=0x7f54a815b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.925+0000 7f54addad700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a80d1c30 0x7f54a815b700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c5c0 tx=0x7f549c001020 comp rx=0 tx=0).stop 2023-10-09T06:21:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.925+0000 7f54addad700 1 -- 172.21.15.31:0/3702690255 shutdown_connections 2023-10-09T06:21:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.925+0000 7f54addad700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5494066f30 0x7f54940693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.925+0000 7f54addad700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54a80cfe20 0x7f54a815ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.925+0000 7f54addad700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54a815a2b0 0x7f54a815bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.925+0000 7f54addad700 1 --2- 172.21.15.31:0/3702690255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a80d1c30 0x7f54a815b700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.925+0000 7f54addad700 1 -- 172.21.15.31:0/3702690255 >> 172.21.15.31:0/3702690255 conn(0x7f54a8067e40 msgr2=0x7f54a8069070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.925+0000 7f54addad700 1 -- 172.21.15.31:0/3702690255 shutdown_connections 2023-10-09T06:21:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:30.925+0000 7f54addad700 1 -- 172.21.15.31:0/3702690255 wait complete. 2023-10-09T06:21:30.928 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2023-10-09T06:21:30.938 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:31.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.056+0000 7f226dcc1700 1 Processor -- start 2023-10-09T06:21:31.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.056+0000 7f226dcc1700 1 -- start start 2023-10-09T06:21:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.057+0000 7f226dcc1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f22680cd6e0 0x7f22680cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.057+0000 7f226dcc1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f22680cdab0 0x7f226815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.057+0000 7f226dcc1700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22680cb7c0 con 0x7f226815dda0 2023-10-09T06:21:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.057+0000 7f226dcc1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226815e850 con 0x7f22680cdab0 2023-10-09T06:21:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.057+0000 7f226dcc1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22680cd030 con 0x7f22680cd6e0 2023-10-09T06:21:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.057+0000 7f2267fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f22680cdab0 0x7f226815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.057+0000 7f2267fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f22680cdab0 0x7f226815d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44370/0 (socket says 172.21.15.31:44370) 2023-10-09T06:21:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.057+0000 7f2267fff700 1 -- 172.21.15.31:0/1558366462 learned_addr learned my addr 172.21.15.31:0/1558366462 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.057+0000 7f226ccbf700 1 --2- 172.21.15.31:0/1558366462 >> v2:172.21.15.158:3300/0 conn(0x7f22680cd6e0 0x7f22680cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.057+0000 7f2267fff700 1 -- 172.21.15.31:0/1558366462 >> v2:172.21.15.158:3300/0 conn(0x7f22680cd6e0 msgr2=0x7f22680cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.057+0000 7f2267fff700 1 --2- 172.21.15.31:0/1558366462 >> v2:172.21.15.158:3300/0 conn(0x7f22680cd6e0 0x7f22680cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.057+0000 7f2267fff700 1 -- 172.21.15.31:0/1558366462 >> v1:172.21.15.158:6789/0 conn(0x7f226815dda0 legacy=0x7f226815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.058+0000 7f2267fff700 1 -- 172.21.15.31:0/1558366462 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226815e290 con 0x7f22680cdab0 2023-10-09T06:21:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.058+0000 7f2267fff700 1 --2- 172.21.15.31:0/1558366462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22680cdab0 0x7f226815d860 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f226806b730 tx=0x7f225c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb11931db15fffd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.058+0000 7f22677fe700 1 -- 172.21.15.31:0/1558366462 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c00b860 con 0x7f22680cdab0 2023-10-09T06:21:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.058+0000 7f22677fe700 1 -- 172.21.15.31:0/1558366462 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c00b9c0 con 0x7f22680cdab0 2023-10-09T06:21:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.058+0000 7f22677fe700 1 -- 172.21.15.31:0/1558366462 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c00bd60 con 0x7f22680cdab0 2023-10-09T06:21:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.058+0000 7f226dcc1700 1 -- 172.21.15.31:0/1558366462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22680cdab0 msgr2=0x7f226815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.058+0000 7f226dcc1700 1 --2- 172.21.15.31:0/1558366462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22680cdab0 0x7f226815d860 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f226806b730 tx=0x7f225c009250 comp rx=0 tx=0).stop 2023-10-09T06:21:31.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.058+0000 7f226dcc1700 1 -- 172.21.15.31:0/1558366462 shutdown_connections 2023-10-09T06:21:31.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.058+0000 7f226dcc1700 1 --2- 172.21.15.31:0/1558366462 >> v2:172.21.15.158:3300/0 conn(0x7f22680cd6e0 0x7f22680cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.058+0000 7f226dcc1700 1 --2- 172.21.15.31:0/1558366462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22680cdab0 0x7f226815d860 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.058+0000 7f226dcc1700 1 -- 172.21.15.31:0/1558366462 >> 172.21.15.31:0/1558366462 conn(0x7f2268067660 msgr2=0x7f2268067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:31.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.058+0000 7f226dcc1700 1 -- 172.21.15.31:0/1558366462 shutdown_connections 2023-10-09T06:21:31.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.058+0000 7f226dcc1700 1 -- 172.21.15.31:0/1558366462 wait complete. 2023-10-09T06:21:31.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.059+0000 7f226dcc1700 1 Processor -- start 2023-10-09T06:21:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.060+0000 7f226dcc1700 1 -- start start 2023-10-09T06:21:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.060+0000 7f226dcc1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22680cd6e0 0x7f226814d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.060+0000 7f226dcc1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22680cdab0 0x7f22680c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.060+0000 7f226dcc1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f226815dda0 0x7f22681573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.060+0000 7f226dcc1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226814e840 con 0x7f22680cd6e0 2023-10-09T06:21:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.060+0000 7f226dcc1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268151220 con 0x7f22680cdab0 2023-10-09T06:21:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.060+0000 7f226dcc1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226814eac0 con 0x7f226815dda0 2023-10-09T06:21:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.060+0000 7f226ccbf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22680cd6e0 0x7f226814d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f226ccbf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22680cd6e0 0x7f226814d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44380/0 (socket says 172.21.15.31:44380) 2023-10-09T06:21:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f226ccbf700 1 -- 172.21.15.31:0/1754485777 learned_addr learned my addr 172.21.15.31:0/1754485777 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:31.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f2267fff700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22680cdab0 0x7f22680c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f226d4c0700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f226815dda0 0x7f22681573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f226ccbf700 1 -- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f226815dda0 msgr2=0x7f22681573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f226ccbf700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f226815dda0 0x7f22681573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f226ccbf700 1 -- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22680cdab0 msgr2=0x7f22680c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f226ccbf700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22680cdab0 0x7f22680c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f226ccbf700 1 -- 172.21.15.31:0/1754485777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0094f0 con 0x7f22680cd6e0 2023-10-09T06:21:31.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f226ccbf700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22680cd6e0 0x7f226814d0d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f225800d890 tx=0x7f2258008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:31.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f2264ff9700 1 -- 172.21.15.31:0/1754485777 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22580125f0 con 0x7f22680cd6e0 2023-10-09T06:21:31.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f2264ff9700 1 -- 172.21.15.31:0/1754485777 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2258012750 con 0x7f22680cd6e0 2023-10-09T06:21:31.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f226dcc1700 1 -- 172.21.15.31:0/1754485777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22680c8ec0 con 0x7f22680cd6e0 2023-10-09T06:21:31.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f2264ff9700 1 -- 172.21.15.31:0/1754485777 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2258012ad0 con 0x7f22680cd6e0 2023-10-09T06:21:31.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.061+0000 7f226dcc1700 1 -- 172.21.15.31:0/1754485777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22680c8980 con 0x7f22680cd6e0 2023-10-09T06:21:31.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.062+0000 7f226dcc1700 1 -- 172.21.15.31:0/1754485777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2268089280 con 0x7f22680cd6e0 2023-10-09T06:21:31.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.063+0000 7f2264ff9700 1 -- 172.21.15.31:0/1754485777 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f225801e460 con 0x7f22680cd6e0 2023-10-09T06:21:31.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.063+0000 7f2264ff9700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2254066f30 0x7f22540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.063+0000 7f2264ff9700 1 -- 172.21.15.31:0/1754485777 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2258084b40 con 0x7f22680cd6e0 2023-10-09T06:21:31.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.063+0000 7f2267fff700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2254066f30 0x7f22540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.064+0000 7f2267fff700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2254066f30 0x7f22540693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f226806b730 tx=0x7f225c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:31.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.067+0000 7f2264ff9700 1 -- 172.21.15.31:0/1754485777 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2258051db0 con 0x7f22680cd6e0 2023-10-09T06:21:31.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.263+0000 7f226dcc1700 1 -- 172.21.15.31:0/1754485777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f226815e570 con 0x7f22680cd6e0 2023-10-09T06:21:31.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.264+0000 7f2264ff9700 1 -- 172.21.15.31:0/1754485777 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f22580553d0 con 0x7f22680cd6e0 2023-10-09T06:21:31.264 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:31.264 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:55.693313+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:31.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.266+0000 7f226dcc1700 1 -- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2254066f30 msgr2=0x7f22540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.266+0000 7f226dcc1700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2254066f30 0x7f22540693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f226806b730 tx=0x7f225c017000 comp rx=0 tx=0).stop 2023-10-09T06:21:31.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.266+0000 7f226dcc1700 1 -- 172.21.15.31:0/1754485777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22680cd6e0 msgr2=0x7f226814d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.266+0000 7f226dcc1700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22680cd6e0 0x7f226814d0d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f225800d890 tx=0x7f2258008040 comp rx=0 tx=0).stop 2023-10-09T06:21:31.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.266+0000 7f226dcc1700 1 -- 172.21.15.31:0/1754485777 shutdown_connections 2023-10-09T06:21:31.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.266+0000 7f226dcc1700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2254066f30 0x7f22540693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.266+0000 7f226dcc1700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f226815dda0 0x7f22681573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.266+0000 7f226dcc1700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22680cd6e0 0x7f226814d0d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.266+0000 7f226dcc1700 1 --2- 172.21.15.31:0/1754485777 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22680cdab0 0x7f22680c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.266+0000 7f226dcc1700 1 -- 172.21.15.31:0/1754485777 >> 172.21.15.31:0/1754485777 conn(0x7f2268067660 msgr2=0x7f22680b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:31.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.266+0000 7f226dcc1700 1 -- 172.21.15.31:0/1754485777 shutdown_connections 2023-10-09T06:21:31.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.266+0000 7f226dcc1700 1 -- 172.21.15.31:0/1754485777 wait complete. 2023-10-09T06:21:31.279 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:21:31.279 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:21:31.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.397+0000 7f91b96fe700 1 Processor -- start 2023-10-09T06:21:31.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.397+0000 7f91b96fe700 1 -- start start 2023-10-09T06:21:31.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.398+0000 7f91b96fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b40cb1b0 0x7f91b40cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.398+0000 7f91b96fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f91b40c7c90 0x7f91b40c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.398+0000 7f91b96fe700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b40cbb40 con 0x7f91b415d3a0 2023-10-09T06:21:31.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.398+0000 7f91b96fe700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b40cd170 con 0x7f91b40c7c90 2023-10-09T06:21:31.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.398+0000 7f91b96fe700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40d1a30 con 0x7f91b40cb1b0 2023-10-09T06:21:31.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.398+0000 7f91b37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f91b40c7c90 0x7f91b40c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.398+0000 7f91b37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f91b40c7c90 0x7f91b40c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44384/0 (socket says 172.21.15.31:44384) 2023-10-09T06:21:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.398+0000 7f91b37fe700 1 -- 172.21.15.31:0/2530840012 learned_addr learned my addr 172.21.15.31:0/2530840012 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.398+0000 7f91b27fc700 1 --2- 172.21.15.31:0/2530840012 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b40cb1b0 0x7f91b40cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.398+0000 7f91b37fe700 1 -- 172.21.15.31:0/2530840012 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b40cb1b0 msgr2=0x7f91b40cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.398+0000 7f91b37fe700 1 --2- 172.21.15.31:0/2530840012 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b40cb1b0 0x7f91b40cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.398+0000 7f91b37fe700 1 -- 172.21.15.31:0/2530840012 >> v1:172.21.15.158:6789/0 conn(0x7f91b415d3a0 legacy=0x7f91b40d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.398+0000 7f91b37fe700 1 -- 172.21.15.31:0/2530840012 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b40cf7f0 con 0x7f91b40c7c90 2023-10-09T06:21:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.399+0000 7f91b37fe700 1 --2- 172.21.15.31:0/2530840012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40c7c90 0x7f91b40c80f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009f20 tx=0x7f91a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc12052555db1f91 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.399+0000 7f91b1ffb700 1 -- 172.21.15.31:0/2530840012 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a400e070 con 0x7f91b40c7c90 2023-10-09T06:21:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.399+0000 7f91b1ffb700 1 -- 172.21.15.31:0/2530840012 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a400b9d0 con 0x7f91b40c7c90 2023-10-09T06:21:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.399+0000 7f91b1ffb700 1 -- 172.21.15.31:0/2530840012 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40092e0 con 0x7f91b40c7c90 2023-10-09T06:21:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.399+0000 7f91b96fe700 1 -- 172.21.15.31:0/2530840012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40c7c90 msgr2=0x7f91b40c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.399+0000 7f91b96fe700 1 --2- 172.21.15.31:0/2530840012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40c7c90 0x7f91b40c80f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009f20 tx=0x7f91a4009840 comp rx=0 tx=0).stop 2023-10-09T06:21:31.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.399+0000 7f91b96fe700 1 -- 172.21.15.31:0/2530840012 shutdown_connections 2023-10-09T06:21:31.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.399+0000 7f91b96fe700 1 --2- 172.21.15.31:0/2530840012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40c7c90 0x7f91b40c80f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.399+0000 7f91b96fe700 1 --2- 172.21.15.31:0/2530840012 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b40cb1b0 0x7f91b40cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.399+0000 7f91b96fe700 1 -- 172.21.15.31:0/2530840012 >> 172.21.15.31:0/2530840012 conn(0x7f91b4067e40 msgr2=0x7f91b40d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:31.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.399+0000 7f91b96fe700 1 -- 172.21.15.31:0/2530840012 shutdown_connections 2023-10-09T06:21:31.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.399+0000 7f91b96fe700 1 -- 172.21.15.31:0/2530840012 wait complete. 2023-10-09T06:21:31.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.401+0000 7f91b96fe700 1 Processor -- start 2023-10-09T06:21:31.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.401+0000 7f91b96fe700 1 -- start start 2023-10-09T06:21:31.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.401+0000 7f91b96fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40c7c90 0x7f91b40b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.401+0000 7f91b96fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b40cb1b0 0x7f91b414e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.401+0000 7f91b96fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91b415d3a0 0x7f91b409c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.401+0000 7f91b96fe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40b39c0 con 0x7f91b40c7c90 2023-10-09T06:21:31.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.401+0000 7f91b96fe700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40b3f80 con 0x7f91b415d3a0 2023-10-09T06:21:31.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.401+0000 7f91b96fe700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b414e5c0 con 0x7f91b40cb1b0 2023-10-09T06:21:31.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40c7c90 0x7f91b40b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40c7c90 0x7f91b40b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44392/0 (socket says 172.21.15.31:44392) 2023-10-09T06:21:31.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b2ffd700 1 -- 172.21.15.31:0/4138457599 learned_addr learned my addr 172.21.15.31:0/4138457599 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:31.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b37fe700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91b415d3a0 0x7f91b409c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b27fc700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b40cb1b0 0x7f91b414e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b2ffd700 1 -- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b40cb1b0 msgr2=0x7f91b414e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b2ffd700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b40cb1b0 0x7f91b414e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b2ffd700 1 -- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91b415d3a0 msgr2=0x7f91b409c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b2ffd700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91b415d3a0 0x7f91b409c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b2ffd700 1 -- 172.21.15.31:0/4138457599 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a4009ae0 con 0x7f91b40c7c90 2023-10-09T06:21:31.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b27fc700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b40cb1b0 0x7f91b414e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:31.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b2ffd700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40c7c90 0x7f91b40b5de0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00c540 tx=0x7f91ac001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:31.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91aaffd700 1 -- 172.21.15.31:0/4138457599 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac011590 con 0x7f91b40c7c90 2023-10-09T06:21:31.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91aaffd700 1 -- 172.21.15.31:0/4138457599 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac0116f0 con 0x7f91b40c7c90 2023-10-09T06:21:31.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91aaffd700 1 -- 172.21.15.31:0/4138457599 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac011ab0 con 0x7f91b40c7c90 2023-10-09T06:21:31.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b96fe700 1 -- 172.21.15.31:0/4138457599 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b409b620 con 0x7f91b40c7c90 2023-10-09T06:21:31.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.402+0000 7f91b96fe700 1 -- 172.21.15.31:0/4138457599 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b40b3c10 con 0x7f91b40c7c90 2023-10-09T06:21:31.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.403+0000 7f91b96fe700 1 -- 172.21.15.31:0/4138457599 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b406ac50 con 0x7f91b40c7c90 2023-10-09T06:21:31.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.403+0000 7f91aaffd700 1 -- 172.21.15.31:0/4138457599 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91ac01b3b0 con 0x7f91b40c7c90 2023-10-09T06:21:31.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.404+0000 7f91aaffd700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9194066f30 0x7f91940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.404+0000 7f91aaffd700 1 -- 172.21.15.31:0/4138457599 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91ac083980 con 0x7f91b40c7c90 2023-10-09T06:21:31.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.404+0000 7f91b27fc700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9194066f30 0x7f91940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.405+0000 7f91b27fc700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9194066f30 0x7f91940693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f919c006f00 tx=0x7f919c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:31.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.408+0000 7f91aaffd700 1 -- 172.21.15.31:0/4138457599 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91ac050ca0 con 0x7f91b40c7c90 2023-10-09T06:21:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.644+0000 7f91b96fe700 1 -- 172.21.15.31:0/4138457599 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91b40cfad0 con 0x7f91b40c7c90 2023-10-09T06:21:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.645+0000 7f91aaffd700 1 -- 172.21.15.31:0/4138457599 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f91ac017070 con 0x7f91b40c7c90 2023-10-09T06:21:31.645 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:31.645 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3437172994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3437172994},{"type":"v1","addr":"172.21.15.158:6836","nonce":3437172994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2894447386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2894447386},{"type":"v1","addr":"172.21.15.31:6834","nonce":2894447386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1034055293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1034055293},{"type":"v1","addr":"172.21.15.31:6835","nonce":1034055293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:20:54.080779+0000","modified":"2023-10-09T06:20:57.714511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1189249944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1189249944},{"type":"v1","addr":"172.21.15.158:6837","nonce":1189249944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:21:31.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.646+0000 7f91b96fe700 1 -- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9194066f30 msgr2=0x7f91940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.646+0000 7f91b96fe700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9194066f30 0x7f91940693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f919c006f00 tx=0x7f919c008040 comp rx=0 tx=0).stop 2023-10-09T06:21:31.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.646+0000 7f91b96fe700 1 -- 172.21.15.31:0/4138457599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40c7c90 msgr2=0x7f91b40b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.646+0000 7f91b96fe700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40c7c90 0x7f91b40b5de0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00c540 tx=0x7f91ac001070 comp rx=0 tx=0).stop 2023-10-09T06:21:31.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.646+0000 7f91b96fe700 1 -- 172.21.15.31:0/4138457599 shutdown_connections 2023-10-09T06:21:31.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.646+0000 7f91b96fe700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9194066f30 0x7f91940693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.646+0000 7f91b96fe700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91b415d3a0 0x7f91b409c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.646+0000 7f91b96fe700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b40c7c90 0x7f91b40b5de0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.646+0000 7f91b96fe700 1 --2- 172.21.15.31:0/4138457599 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91b40cb1b0 0x7f91b414e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.646+0000 7f91b96fe700 1 -- 172.21.15.31:0/4138457599 >> 172.21.15.31:0/4138457599 conn(0x7f91b4067e40 msgr2=0x7f91b40c9820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:31.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.647+0000 7f91b96fe700 1 -- 172.21.15.31:0/4138457599 shutdown_connections 2023-10-09T06:21:31.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.647+0000 7f91b96fe700 1 -- 172.21.15.31:0/4138457599 wait complete. 2023-10-09T06:21:31.649 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2023-10-09T06:21:31.659 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:21:31.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.777+0000 7fbb84baa700 1 Processor -- start 2023-10-09T06:21:31.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.777+0000 7fbb84baa700 1 -- start start 2023-10-09T06:21:31.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.778+0000 7fbb84baa700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb8006c630 0x7fbb80067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.778+0000 7fbb84baa700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbb80067ba0 0x7fbb80159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.778+0000 7fbb84baa700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb80068000 con 0x7fbb800b0890 2023-10-09T06:21:31.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.778+0000 7fbb84baa700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb800cb370 con 0x7fbb80067ba0 2023-10-09T06:21:31.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.778+0000 7fbb84baa700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800b0c60 con 0x7fbb8006c630 2023-10-09T06:21:31.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.778+0000 7fbb7e59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbb800b0890 0x7fbb800cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33162/0 (socket says 172.21.15.31:33162) 2023-10-09T06:21:31.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.778+0000 7fbb7e59c700 1 -- 172.21.15.31:0/3488647063 learned_addr learned my addr 172.21.15.31:0/3488647063 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:31.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.778+0000 7fbb7dd9b700 1 --2- 172.21.15.31:0/3488647063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb8006c630 0x7fbb80067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.778+0000 7fbb7ed9d700 1 --2- 172.21.15.31:0/3488647063 >> v2:172.21.15.158:3300/0 conn(0x7fbb80067ba0 0x7fbb80159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.778+0000 7fbb7d59a700 1 -- 172.21.15.31:0/3488647063 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119465171 0 0) 0x7fbb80068000 con 0x7fbb800b0890 2023-10-09T06:21:31.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.779+0000 7fbb7d59a700 1 -- 172.21.15.31:0/3488647063 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb6c003570 con 0x7fbb800b0890 2023-10-09T06:21:31.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.779+0000 7fbb7d59a700 1 -- 172.21.15.31:0/3488647063 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 305342309 0 0) 0x7fbb6c003570 con 0x7fbb800b0890 2023-10-09T06:21:31.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.779+0000 7fbb7dd9b700 1 -- 172.21.15.31:0/3488647063 >> v2:172.21.15.158:3300/0 conn(0x7fbb80067ba0 msgr2=0x7fbb80159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:31.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.779+0000 7fbb7dd9b700 1 --2- 172.21.15.31:0/3488647063 >> v2:172.21.15.158:3300/0 conn(0x7fbb80067ba0 0x7fbb80159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.779+0000 7fbb7dd9b700 1 -- 172.21.15.31:0/3488647063 >> v1:172.21.15.31:6789/0 conn(0x7fbb800b0890 legacy=0x7fbb800cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.779+0000 7fbb7dd9b700 1 -- 172.21.15.31:0/3488647063 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8006a1e0 con 0x7fbb8006c630 2023-10-09T06:21:31.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.779+0000 7fbb7ed9d700 1 --2- 172.21.15.31:0/3488647063 >> v2:172.21.15.158:3300/0 conn(0x7fbb80067ba0 0x7fbb80159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:31.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.779+0000 7fbb7dd9b700 1 --2- 172.21.15.31:0/3488647063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb8006c630 0x7fbb80067660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbb680098e0 tx=0x7fbb680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a37cacea11fca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:31.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.779+0000 7fbb7d59a700 1 -- 172.21.15.31:0/3488647063 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb780017f0 con 0x7fbb8006c630 2023-10-09T06:21:31.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.779+0000 7fbb7d59a700 1 -- 172.21.15.31:0/3488647063 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb68011420 con 0x7fbb8006c630 2023-10-09T06:21:31.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.779+0000 7fbb7d59a700 1 -- 172.21.15.31:0/3488647063 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb680117c0 con 0x7fbb8006c630 2023-10-09T06:21:31.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.780+0000 7fbb84baa700 1 -- 172.21.15.31:0/3488647063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb8006c630 msgr2=0x7fbb80067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.780+0000 7fbb84baa700 1 --2- 172.21.15.31:0/3488647063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb8006c630 0x7fbb80067660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbb680098e0 tx=0x7fbb680091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.780+0000 7fbb84baa700 1 -- 172.21.15.31:0/3488647063 shutdown_connections 2023-10-09T06:21:31.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.780+0000 7fbb84baa700 1 --2- 172.21.15.31:0/3488647063 >> v2:172.21.15.158:3300/0 conn(0x7fbb80067ba0 0x7fbb80159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.780+0000 7fbb84baa700 1 --2- 172.21.15.31:0/3488647063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb8006c630 0x7fbb80067660 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.780+0000 7fbb84baa700 1 -- 172.21.15.31:0/3488647063 >> 172.21.15.31:0/3488647063 conn(0x7fbb8006fe50 msgr2=0x7fbb80069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:31.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.780+0000 7fbb84baa700 1 -- 172.21.15.31:0/3488647063 shutdown_connections 2023-10-09T06:21:31.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.780+0000 7fbb84baa700 1 -- 172.21.15.31:0/3488647063 wait complete. 2023-10-09T06:21:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.781+0000 7fbb84baa700 1 Processor -- start 2023-10-09T06:21:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.781+0000 7fbb84baa700 1 -- start start 2023-10-09T06:21:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb84baa700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb80067ba0 0x7fbb8015a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb84baa700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb8006c630 0x7fbb800b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb84baa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb800b0890 0x7fbb80068000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb84baa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8016a550 con 0x7fbb800b0890 2023-10-09T06:21:31.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb84baa700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800c2960 con 0x7fbb8006c630 2023-10-09T06:21:31.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb84baa700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800c2c40 con 0x7fbb80067ba0 2023-10-09T06:21:31.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb7ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb800b0890 0x7fbb80068000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb7ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb800b0890 0x7fbb80068000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44400/0 (socket says 172.21.15.31:44400) 2023-10-09T06:21:31.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb7ed9d700 1 -- 172.21.15.31:0/3856999644 learned_addr learned my addr 172.21.15.31:0/3856999644 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:31.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb7dd9b700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb8006c630 0x7fbb800b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb7e59c700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb80067ba0 0x7fbb8015a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb7ed9d700 1 -- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb80067ba0 msgr2=0x7fbb8015a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb7ed9d700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb80067ba0 0x7fbb8015a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb7ed9d700 1 -- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb8006c630 msgr2=0x7fbb800b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:31.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb7ed9d700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb8006c630 0x7fbb800b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:31.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb7ed9d700 1 -- 172.21.15.31:0/3856999644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb70009420 con 0x7fbb800b0890 2023-10-09T06:21:31.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb7e59c700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb80067ba0 0x7fbb8015a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:31.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb7dd9b700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb8006c630 0x7fbb800b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:31.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb7ed9d700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb800b0890 0x7fbb80068000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000ec80 tx=0x7fbb700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:31.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb767fc700 1 -- 172.21.15.31:0/3856999644 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7000c9d0 con 0x7fbb800b0890 2023-10-09T06:21:31.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb767fc700 1 -- 172.21.15.31:0/3856999644 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7000cb30 con 0x7fbb800b0890 2023-10-09T06:21:31.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb84baa700 1 -- 172.21.15.31:0/3856999644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb68009420 con 0x7fbb800b0890 2023-10-09T06:21:31.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb767fc700 1 -- 172.21.15.31:0/3856999644 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70013470 con 0x7fbb800b0890 2023-10-09T06:21:31.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.782+0000 7fbb84baa700 1 -- 172.21.15.31:0/3856999644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb800c3200 con 0x7fbb800b0890 2023-10-09T06:21:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.783+0000 7fbb84baa700 1 -- 172.21.15.31:0/3856999644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8004c3c0 con 0x7fbb800b0890 2023-10-09T06:21:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.784+0000 7fbb767fc700 1 -- 172.21.15.31:0/3856999644 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb70013860 con 0x7fbb800b0890 2023-10-09T06:21:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.784+0000 7fbb767fc700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb60066f30 0x7fbb600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.784+0000 7fbb767fc700 1 -- 172.21.15.31:0/3856999644 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb700846e0 con 0x7fbb800b0890 2023-10-09T06:21:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.784+0000 7fbb7e59c700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb60066f30 0x7fbb600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.785+0000 7fbb7e59c700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb60066f30 0x7fbb600693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb780019a0 tx=0x7fbb78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:31.788+0000 7fbb767fc700 1 -- 172.21.15.31:0/3856999644 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb70051950 con 0x7fbb800b0890 2023-10-09T06:21:32.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.031+0000 7fbb84baa700 1 -- 172.21.15.31:0/3856999644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb8016a690 con 0x7fbb800b0890 2023-10-09T06:21:32.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.031+0000 7fbb767fc700 1 -- 172.21.15.31:0/3856999644 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fbb70054f70 con 0x7fbb800b0890 2023-10-09T06:21:32.032 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:32.032 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3437172994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3437172994},{"type":"v1","addr":"172.21.15.158:6836","nonce":3437172994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2894447386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2894447386},{"type":"v1","addr":"172.21.15.31:6834","nonce":2894447386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1034055293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1034055293},{"type":"v1","addr":"172.21.15.31:6835","nonce":1034055293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:20:54.080779+0000","modified":"2023-10-09T06:20:57.714511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1189249944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1189249944},{"type":"v1","addr":"172.21.15.158:6837","nonce":1189249944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:21:32.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.033+0000 7fbb84baa700 1 -- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb60066f30 msgr2=0x7fbb600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.033+0000 7fbb84baa700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb60066f30 0x7fbb600693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb780019a0 tx=0x7fbb78009040 comp rx=0 tx=0).stop 2023-10-09T06:21:32.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.033+0000 7fbb84baa700 1 -- 172.21.15.31:0/3856999644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb800b0890 msgr2=0x7fbb80068000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.033+0000 7fbb84baa700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb800b0890 0x7fbb80068000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000ec80 tx=0x7fbb700091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.033+0000 7fbb84baa700 1 -- 172.21.15.31:0/3856999644 shutdown_connections 2023-10-09T06:21:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.033+0000 7fbb84baa700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb60066f30 0x7fbb600693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.033+0000 7fbb84baa700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb80067ba0 0x7fbb8015a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.033+0000 7fbb84baa700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb800b0890 0x7fbb80068000 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.033+0000 7fbb84baa700 1 --2- 172.21.15.31:0/3856999644 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb8006c630 0x7fbb800b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.033+0000 7fbb84baa700 1 -- 172.21.15.31:0/3856999644 >> 172.21.15.31:0/3856999644 conn(0x7fbb8006fe50 msgr2=0x7fbb800cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.033+0000 7fbb84baa700 1 -- 172.21.15.31:0/3856999644 shutdown_connections 2023-10-09T06:21:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.034+0000 7fbb84baa700 1 -- 172.21.15.31:0/3856999644 wait complete. 2023-10-09T06:21:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2023-10-09T06:21:32.046 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:32.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.164+0000 7f79c92d1700 1 Processor -- start 2023-10-09T06:21:32.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.164+0000 7f79c92d1700 1 -- start start 2023-10-09T06:21:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.165+0000 7f79c92d1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79c40ade00 0x7f79c4161b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.165+0000 7f79c92d1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c40c9cb0 con 0x7f79c40abae0 2023-10-09T06:21:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.165+0000 7f79c92d1700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c40c90a0 con 0x7f79c40c75c0 2023-10-09T06:21:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.165+0000 7f79c92d1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40c9380 con 0x7f79c40ade00 2023-10-09T06:21:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.165+0000 7f79c2ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f79c40abae0 0x7f79c40c6eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33168/0 (socket says 172.21.15.31:33168) 2023-10-09T06:21:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.165+0000 7f79c2ffd700 1 -- 172.21.15.31:0/257374224 learned_addr learned my addr 172.21.15.31:0/257374224 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.165+0000 7f79c37fe700 1 --2- 172.21.15.31:0/257374224 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79c40ade00 0x7f79c4161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.166+0000 7f79c1ffb700 1 -- 172.21.15.31:0/257374224 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401614769 0 0) 0x7f79c40c9cb0 con 0x7f79c40abae0 2023-10-09T06:21:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.166+0000 7f79c1ffb700 1 -- 172.21.15.31:0/257374224 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79b0003570 con 0x7f79c40abae0 2023-10-09T06:21:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.166+0000 7f79c1ffb700 1 -- 172.21.15.31:0/257374224 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953512008 0 0) 0x7f79c40c90a0 con 0x7f79c40c75c0 2023-10-09T06:21:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.166+0000 7f79c1ffb700 1 -- 172.21.15.31:0/257374224 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c40c9cb0 con 0x7f79c40c75c0 2023-10-09T06:21:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.166+0000 7f79c37fe700 1 -- 172.21.15.31:0/257374224 >> v1:172.21.15.158:6789/0 conn(0x7f79c40c75c0 legacy=0x7f79c40c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.166+0000 7f79c37fe700 1 -- 172.21.15.31:0/257374224 >> v1:172.21.15.31:6789/0 conn(0x7f79c40abae0 legacy=0x7f79c40c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.166+0000 7f79c37fe700 1 -- 172.21.15.31:0/257374224 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c40c9660 con 0x7f79c40ade00 2023-10-09T06:21:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.166+0000 7f79c37fe700 1 --2- 172.21.15.31:0/257374224 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79c40ade00 0x7f79c4161b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009e90 tx=0x7f79bc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee0eb98659353ab4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.166+0000 7f79c1ffb700 1 -- 172.21.15.31:0/257374224 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00e070 con 0x7f79c40ade00 2023-10-09T06:21:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.166+0000 7f79c1ffb700 1 -- 172.21.15.31:0/257374224 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc00bb80 con 0x7f79c40ade00 2023-10-09T06:21:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.166+0000 7f79c1ffb700 1 -- 172.21.15.31:0/257374224 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc012430 con 0x7f79c40ade00 2023-10-09T06:21:32.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.167+0000 7f79c92d1700 1 -- 172.21.15.31:0/257374224 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79c40ade00 msgr2=0x7f79c4161b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.167+0000 7f79c92d1700 1 --2- 172.21.15.31:0/257374224 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79c40ade00 0x7f79c4161b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009e90 tx=0x7f79bc009780 comp rx=0 tx=0).stop 2023-10-09T06:21:32.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.167+0000 7f79c92d1700 1 -- 172.21.15.31:0/257374224 shutdown_connections 2023-10-09T06:21:32.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.167+0000 7f79c92d1700 1 --2- 172.21.15.31:0/257374224 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79c40ade00 0x7f79c4161b40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.167+0000 7f79c92d1700 1 -- 172.21.15.31:0/257374224 >> 172.21.15.31:0/257374224 conn(0x7f79c4067660 msgr2=0x7f79c4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:32.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.167+0000 7f79c92d1700 1 -- 172.21.15.31:0/257374224 shutdown_connections 2023-10-09T06:21:32.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.167+0000 7f79c92d1700 1 -- 172.21.15.31:0/257374224 wait complete. 2023-10-09T06:21:32.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.168+0000 7f79c92d1700 1 Processor -- start 2023-10-09T06:21:32.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.168+0000 7f79c92d1700 1 -- start start 2023-10-09T06:21:32.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c92d1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79c40abae0 0x7f79c40c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c92d1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79c40ade00 0x7f79c416bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c92d1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79c40c75c0 0x7f79c41685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c92d1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40c0910 con 0x7f79c40abae0 2023-10-09T06:21:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c92d1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4167bd0 con 0x7f79c40c75c0 2023-10-09T06:21:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c92d1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4168130 con 0x7f79c40ade00 2023-10-09T06:21:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79c40abae0 0x7f79c40c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79c40abae0 0x7f79c40c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44412/0 (socket says 172.21.15.31:44412) 2023-10-09T06:21:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c2ffd700 1 -- 172.21.15.31:0/4115834361 learned_addr learned my addr 172.21.15.31:0/4115834361 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c2ffd700 1 -- 172.21.15.31:0/4115834361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79c40ade00 msgr2=0x7f79c416bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c2ffd700 1 --2- 172.21.15.31:0/4115834361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79c40ade00 0x7f79c416bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c2ffd700 1 -- 172.21.15.31:0/4115834361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79c40c75c0 msgr2=0x7f79c41685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c2ffd700 1 --2- 172.21.15.31:0/4115834361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79c40c75c0 0x7f79c41685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c2ffd700 1 -- 172.21.15.31:0/4115834361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc009a20 con 0x7f79c40abae0 2023-10-09T06:21:32.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c2ffd700 1 --2- 172.21.15.31:0/4115834361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79c40abae0 0x7f79c40c62e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79b400c7c0 tx=0x7f79b4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:32.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79baffd700 1 -- 172.21.15.31:0/4115834361 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4005b30 con 0x7f79c40abae0 2023-10-09T06:21:32.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79baffd700 1 -- 172.21.15.31:0/4115834361 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b4005c90 con 0x7f79c40abae0 2023-10-09T06:21:32.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79c92d1700 1 -- 172.21.15.31:0/4115834361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c40c6820 con 0x7f79c40abae0 2023-10-09T06:21:32.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.169+0000 7f79baffd700 1 -- 172.21.15.31:0/4115834361 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b40072e0 con 0x7f79c40abae0 2023-10-09T06:21:32.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.170+0000 7f79c92d1700 1 -- 172.21.15.31:0/4115834361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c40c0350 con 0x7f79c40abae0 2023-10-09T06:21:32.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.170+0000 7f79c92d1700 1 -- 172.21.15.31:0/4115834361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c40c8b70 con 0x7f79c40abae0 2023-10-09T06:21:32.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.171+0000 7f79baffd700 1 -- 172.21.15.31:0/4115834361 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79b4007650 con 0x7f79c40abae0 2023-10-09T06:21:32.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.171+0000 7f79baffd700 1 --2- 172.21.15.31:0/4115834361 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f79a4066f30 0x7f79a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.171+0000 7f79baffd700 1 -- 172.21.15.31:0/4115834361 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f79b4083960 con 0x7f79c40abae0 2023-10-09T06:21:32.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.171+0000 7f79c27fc700 1 --2- 172.21.15.31:0/4115834361 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f79a4066f30 0x7f79a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.172+0000 7f79c27fc700 1 --2- 172.21.15.31:0/4115834361 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f79a4066f30 0x7f79a40693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79c40cad80 tx=0x7f79ac0079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:32.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.175+0000 7f79baffd700 1 -- 172.21.15.31:0/4115834361 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79b404b5a0 con 0x7f79c40abae0 2023-10-09T06:21:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.370+0000 7f79c92d1700 1 -- 172.21.15.31:0/4115834361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79c404c3c0 con 0x7f79c40abae0 2023-10-09T06:21:32.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.371+0000 7f79baffd700 1 -- 172.21.15.31:0/4115834361 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f79b4017020 con 0x7f79c40abae0 2023-10-09T06:21:32.372 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:32.373 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:20:55.693313+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:20:52.621337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:20:53.053532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.373+0000 7f79c92d1700 1 -- 172.21.15.31:0/4115834361 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f79a4066f30 msgr2=0x7f79a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.373+0000 7f79c92d1700 1 --2- 172.21.15.31:0/4115834361 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f79a4066f30 0x7f79a40693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79c40cad80 tx=0x7f79ac0079d0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.373+0000 7f79c92d1700 1 -- 172.21.15.31:0/4115834361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79c40abae0 msgr2=0x7f79c40c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.373+0000 7f79c92d1700 1 --2- 172.21.15.31:0/4115834361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79c40abae0 0x7f79c40c62e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79b400c7c0 tx=0x7f79b4007ea0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.373+0000 7f79c92d1700 1 -- 172.21.15.31:0/4115834361 shutdown_connections 2023-10-09T06:21:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.373+0000 7f79c92d1700 1 --2- 172.21.15.31:0/4115834361 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f79a4066f30 0x7f79a40693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.373+0000 7f79c92d1700 1 --2- 172.21.15.31:0/4115834361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79c40c75c0 0x7f79c41685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.373+0000 7f79c92d1700 1 --2- 172.21.15.31:0/4115834361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79c40abae0 0x7f79c40c62e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.373+0000 7f79c92d1700 1 --2- 172.21.15.31:0/4115834361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79c40ade00 0x7f79c416bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.373+0000 7f79c92d1700 1 -- 172.21.15.31:0/4115834361 >> 172.21.15.31:0/4115834361 conn(0x7f79c4067660 msgr2=0x7f79c4063570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:32.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.373+0000 7f79c92d1700 1 -- 172.21.15.31:0/4115834361 shutdown_connections 2023-10-09T06:21:32.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.373+0000 7f79c92d1700 1 -- 172.21.15.31:0/4115834361 wait complete. 2023-10-09T06:21:32.386 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:21:32.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.505+0000 7fb1ba811700 1 Processor -- start 2023-10-09T06:21:32.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.506+0000 7fb1ba811700 1 -- start start 2023-10-09T06:21:32.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.506+0000 7fb1ba811700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1b415e4d0 0x7fb1b40d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.506+0000 7fb1ba811700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb1b40b2e60 0x7fb1b415a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.506+0000 7fb1ba811700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b40d0030 con 0x7fb1b415e8a0 2023-10-09T06:21:32.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.506+0000 7fb1ba811700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b415b570 con 0x7fb1b40b2e60 2023-10-09T06:21:32.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.506+0000 7fb1ba811700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40cf460 con 0x7fb1b415e4d0 2023-10-09T06:21:32.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.506+0000 7fb1b37fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb1b415e8a0 0x7fb1b40b2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33174/0 (socket says 172.21.15.31:33174) 2023-10-09T06:21:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.507+0000 7fb1b37fe700 1 -- 172.21.15.31:0/236870288 learned_addr learned my addr 172.21.15.31:0/236870288 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.507+0000 7fb1b3fff700 1 --2- 172.21.15.31:0/236870288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1b415e4d0 0x7fb1b40d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.507+0000 7fb1b8dae700 1 --2- 172.21.15.31:0/236870288 >> v2:172.21.15.158:3300/0 conn(0x7fb1b40b2e60 0x7fb1b415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.507+0000 7fb1b2ffd700 1 -- 172.21.15.31:0/236870288 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520848725 0 0) 0x7fb1b40d0030 con 0x7fb1b415e8a0 2023-10-09T06:21:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.507+0000 7fb1b2ffd700 1 -- 172.21.15.31:0/236870288 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a0003570 con 0x7fb1b415e8a0 2023-10-09T06:21:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.507+0000 7fb1b8dae700 1 -- 172.21.15.31:0/236870288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1b415e4d0 msgr2=0x7fb1b40d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.507+0000 7fb1b8dae700 1 --2- 172.21.15.31:0/236870288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1b415e4d0 0x7fb1b40d04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.507+0000 7fb1b8dae700 1 -- 172.21.15.31:0/236870288 >> v1:172.21.15.31:6789/0 conn(0x7fb1b415e8a0 legacy=0x7fb1b40b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.507+0000 7fb1b8dae700 1 -- 172.21.15.31:0/236870288 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b40cf700 con 0x7fb1b40b2e60 2023-10-09T06:21:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.507+0000 7fb1b8dae700 1 --2- 172.21.15.31:0/236870288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1b40b2e60 0x7fb1b415a810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009e60 tx=0x7fb1ac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c1ad4451a62b423 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.507+0000 7fb1b2ffd700 1 -- 172.21.15.31:0/236870288 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00e070 con 0x7fb1b40b2e60 2023-10-09T06:21:32.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.507+0000 7fb1b2ffd700 1 -- 172.21.15.31:0/236870288 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac00bab0 con 0x7fb1b40b2e60 2023-10-09T06:21:32.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.507+0000 7fb1b2ffd700 1 -- 172.21.15.31:0/236870288 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00be70 con 0x7fb1b40b2e60 2023-10-09T06:21:32.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.508+0000 7fb1ba811700 1 -- 172.21.15.31:0/236870288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1b40b2e60 msgr2=0x7fb1b415a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.508+0000 7fb1ba811700 1 --2- 172.21.15.31:0/236870288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1b40b2e60 0x7fb1b415a810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009e60 tx=0x7fb1ac009780 comp rx=0 tx=0).stop 2023-10-09T06:21:32.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.508+0000 7fb1ba811700 1 -- 172.21.15.31:0/236870288 shutdown_connections 2023-10-09T06:21:32.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.508+0000 7fb1ba811700 1 --2- 172.21.15.31:0/236870288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1b40b2e60 0x7fb1b415a810 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.508+0000 7fb1ba811700 1 --2- 172.21.15.31:0/236870288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1b415e4d0 0x7fb1b40d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.508+0000 7fb1ba811700 1 -- 172.21.15.31:0/236870288 >> 172.21.15.31:0/236870288 conn(0x7fb1b4068d50 msgr2=0x7fb1b4069120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:32.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.508+0000 7fb1ba811700 1 -- 172.21.15.31:0/236870288 shutdown_connections 2023-10-09T06:21:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.508+0000 7fb1ba811700 1 -- 172.21.15.31:0/236870288 wait complete. 2023-10-09T06:21:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.509+0000 7fb1ba811700 1 Processor -- start 2023-10-09T06:21:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.509+0000 7fb1ba811700 1 -- start start 2023-10-09T06:21:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1ba811700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1b40b2e60 0x7fb1b414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1ba811700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1b415e4d0 0x7fb1b4156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1ba811700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1b415e8a0 0x7fb1b40b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1ba811700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b41563e0 con 0x7fb1b40b2e60 2023-10-09T06:21:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1ba811700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b415ad20 con 0x7fb1b415e8a0 2023-10-09T06:21:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1ba811700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b41557d0 con 0x7fb1b415e4d0 2023-10-09T06:21:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1b3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1b40b2e60 0x7fb1b414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1b3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1b40b2e60 0x7fb1b414f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44416/0 (socket says 172.21.15.31:44416) 2023-10-09T06:21:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1b3fff700 1 -- 172.21.15.31:0/1608547682 learned_addr learned my addr 172.21.15.31:0/1608547682 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:32.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1b37fe700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1b415e4d0 0x7fb1b4156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1b8dae700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1b415e8a0 0x7fb1b40b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1b3fff700 1 -- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1b415e4d0 msgr2=0x7fb1b4156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1b3fff700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1b415e4d0 0x7fb1b4156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1b3fff700 1 -- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1b415e8a0 msgr2=0x7fb1b40b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1b3fff700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1b415e8a0 0x7fb1b40b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1b3fff700 1 -- 172.21.15.31:0/1608547682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac009a20 con 0x7fb1b40b2e60 2023-10-09T06:21:32.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.510+0000 7fb1b3fff700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1b40b2e60 0x7fb1b414f5f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400ec80 tx=0x7fb1a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:32.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.511+0000 7fb1abfff700 1 -- 172.21.15.31:0/1608547682 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400c9d0 con 0x7fb1b40b2e60 2023-10-09T06:21:32.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.511+0000 7fb1abfff700 1 -- 172.21.15.31:0/1608547682 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a400cb30 con 0x7fb1b40b2e60 2023-10-09T06:21:32.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.511+0000 7fb1ba811700 1 -- 172.21.15.31:0/1608547682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b4155ab0 con 0x7fb1b40b2e60 2023-10-09T06:21:32.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.511+0000 7fb1abfff700 1 -- 172.21.15.31:0/1608547682 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4013470 con 0x7fb1b40b2e60 2023-10-09T06:21:32.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.511+0000 7fb1ba811700 1 -- 172.21.15.31:0/1608547682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b4156070 con 0x7fb1b40b2e60 2023-10-09T06:21:32.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.512+0000 7fb1ba811700 1 -- 172.21.15.31:0/1608547682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b41566c0 con 0x7fb1b40b2e60 2023-10-09T06:21:32.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.512+0000 7fb1abfff700 1 -- 172.21.15.31:0/1608547682 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1a4013820 con 0x7fb1b40b2e60 2023-10-09T06:21:32.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.512+0000 7fb1abfff700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb194066f30 0x7fb1940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.512+0000 7fb1abfff700 1 -- 172.21.15.31:0/1608547682 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb1a40848a0 con 0x7fb1b40b2e60 2023-10-09T06:21:32.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.513+0000 7fb1b37fe700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb194066f30 0x7fb1940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.513+0000 7fb1b37fe700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb194066f30 0x7fb1940693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40b2db0 tx=0x7fb19c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:32.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.517+0000 7fb1abfff700 1 -- 172.21.15.31:0/1608547682 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1a4051b10 con 0x7fb1b40b2e60 2023-10-09T06:21:32.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.754+0000 7fb1ba811700 1 -- 172.21.15.31:0/1608547682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb1b404c3c0 con 0x7fb1b40b2e60 2023-10-09T06:21:32.755 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:21:32.755+0000 7fc5e82b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:21:32.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.758+0000 7fb1abfff700 1 -- 172.21.15.31:0/1608547682 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb1a4055130 con 0x7fb1b40b2e60 2023-10-09T06:21:32.760 INFO:tasks.ceph.mds.b.smithi158.stderr: -2919> 2023-10-09T06:20:47.866+0000 7f5e485b5700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-09T06:21:32.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.760+0000 7fb1ba811700 1 -- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb194066f30 msgr2=0x7fb1940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.760+0000 7fb1ba811700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb194066f30 0x7fb1940693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40b2db0 tx=0x7fb19c009040 comp rx=0 tx=0).stop 2023-10-09T06:21:32.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.760+0000 7fb1ba811700 1 -- 172.21.15.31:0/1608547682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1b40b2e60 msgr2=0x7fb1b414f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.760+0000 7fb1ba811700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1b40b2e60 0x7fb1b414f5f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400ec80 tx=0x7fb1a40091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.760+0000 7fb1ba811700 1 -- 172.21.15.31:0/1608547682 shutdown_connections 2023-10-09T06:21:32.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.760+0000 7fb1ba811700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb194066f30 0x7fb1940693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.760+0000 7fb1ba811700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1b415e8a0 0x7fb1b40b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.760+0000 7fb1ba811700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1b40b2e60 0x7fb1b414f5f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.760+0000 7fb1ba811700 1 --2- 172.21.15.31:0/1608547682 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1b415e4d0 0x7fb1b4156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.760+0000 7fb1ba811700 1 -- 172.21.15.31:0/1608547682 >> 172.21.15.31:0/1608547682 conn(0x7fb1b4068d50 msgr2=0x7fb1b415c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.760+0000 7fb1ba811700 1 -- 172.21.15.31:0/1608547682 shutdown_connections 2023-10-09T06:21:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.760+0000 7fb1ba811700 1 -- 172.21.15.31:0/1608547682 wait complete. 2023-10-09T06:21:32.763 INFO:tasks.ceph.mds.b.smithi158.stderr: -1757> 2023-10-09T06:20:58.869+0000 7f5e425a9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:21:32.763 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:21:32.773 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:21:32.785 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:21:32.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.896+0000 7f4946257700 1 Processor -- start 2023-10-09T06:21:32.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.896+0000 7f4946257700 1 -- start start 2023-10-09T06:21:32.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f4946257700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f49400cd300 0x7f494015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f4946257700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f49400b6760 0x7f49400d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f4946257700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49401513f0 con 0x7f49400d12a0 2023-10-09T06:21:32.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f4946257700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494015e7a0 con 0x7f49400b6760 2023-10-09T06:21:32.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f4946257700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49400d1700 con 0x7f49400cd300 2023-10-09T06:21:32.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f493effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f49400b6760 0x7f49400d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f493effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f49400b6760 0x7f49400d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44426/0 (socket says 172.21.15.31:44426) 2023-10-09T06:21:32.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f493effd700 1 -- 172.21.15.31:0/1760643092 learned_addr learned my addr 172.21.15.31:0/1760643092 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:32.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f493f7fe700 1 --2- 172.21.15.31:0/1760643092 >> v2:172.21.15.158:3300/0 conn(0x7f49400cd300 0x7f494015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f493effd700 1 -- 172.21.15.31:0/1760643092 >> v2:172.21.15.158:3300/0 conn(0x7f49400cd300 msgr2=0x7f494015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:32.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f493effd700 1 --2- 172.21.15.31:0/1760643092 >> v2:172.21.15.158:3300/0 conn(0x7f49400cd300 0x7f494015afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f493effd700 1 -- 172.21.15.31:0/1760643092 >> v1:172.21.15.158:6789/0 conn(0x7f49400d12a0 legacy=0x7f494006a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f493effd700 1 -- 172.21.15.31:0/1760643092 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494015db20 con 0x7f49400b6760 2023-10-09T06:21:32.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f493effd700 1 --2- 172.21.15.31:0/1760643092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49400b6760 0x7f49400d0d60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4940089ea0 tx=0x7f4934009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955011952226b8c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:32.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f493e7fc700 1 -- 172.21.15.31:0/1760643092 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934009e70 con 0x7f49400b6760 2023-10-09T06:21:32.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f493e7fc700 1 -- 172.21.15.31:0/1760643092 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400b860 con 0x7f49400b6760 2023-10-09T06:21:32.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.897+0000 7f493e7fc700 1 -- 172.21.15.31:0/1760643092 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400bc00 con 0x7f49400b6760 2023-10-09T06:21:32.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.898+0000 7f4946257700 1 -- 172.21.15.31:0/1760643092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49400b6760 msgr2=0x7f49400d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.898+0000 7f4946257700 1 --2- 172.21.15.31:0/1760643092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49400b6760 0x7f49400d0d60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4940089ea0 tx=0x7f4934009250 comp rx=0 tx=0).stop 2023-10-09T06:21:32.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.898+0000 7f4946257700 1 -- 172.21.15.31:0/1760643092 shutdown_connections 2023-10-09T06:21:32.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.898+0000 7f4946257700 1 --2- 172.21.15.31:0/1760643092 >> v2:172.21.15.158:3300/0 conn(0x7f49400cd300 0x7f494015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.898+0000 7f4946257700 1 --2- 172.21.15.31:0/1760643092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49400b6760 0x7f49400d0d60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.898+0000 7f4946257700 1 -- 172.21.15.31:0/1760643092 >> 172.21.15.31:0/1760643092 conn(0x7f4940068d90 msgr2=0x7f4940069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:32.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.898+0000 7f4946257700 1 -- 172.21.15.31:0/1760643092 shutdown_connections 2023-10-09T06:21:32.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.898+0000 7f4946257700 1 -- 172.21.15.31:0/1760643092 wait complete. 2023-10-09T06:21:32.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.899+0000 7f4946257700 1 Processor -- start 2023-10-09T06:21:32.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.899+0000 7f4946257700 1 -- start start 2023-10-09T06:21:32.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f4946257700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49400b6760 0x7f49400c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f4946257700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f49400cd300 0x7f4940158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f4946257700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f49400d12a0 0x7f494015cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f4946257700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494016eb70 con 0x7f49400b6760 2023-10-09T06:21:32.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f4946257700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49400c89d0 con 0x7f49400d12a0 2023-10-09T06:21:32.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f4946257700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494016e890 con 0x7f49400cd300 2023-10-09T06:21:32.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f493f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49400b6760 0x7f49400c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f493f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49400b6760 0x7f49400c8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44432/0 (socket says 172.21.15.31:44432) 2023-10-09T06:21:32.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f493f7fe700 1 -- 172.21.15.31:0/1278521533 learned_addr learned my addr 172.21.15.31:0/1278521533 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:32.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f493effd700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f49400cd300 0x7f4940158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f493ffff700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f49400d12a0 0x7f494015cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f493f7fe700 1 -- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f49400cd300 msgr2=0x7f4940158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f493f7fe700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f49400cd300 0x7f4940158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f493f7fe700 1 -- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f49400d12a0 msgr2=0x7f494015cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:32.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f493f7fe700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f49400d12a0 0x7f494015cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:32.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f493f7fe700 1 -- 172.21.15.31:0/1278521533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49340094f0 con 0x7f49400b6760 2023-10-09T06:21:32.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.900+0000 7f493ffff700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f49400d12a0 0x7f494015cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:32.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.901+0000 7f493f7fe700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49400b6760 0x7f49400c8e60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f493000ec80 tx=0x7f49300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:32.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.901+0000 7f49277fe700 1 -- 172.21.15.31:0/1278521533 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493000c850 con 0x7f49400b6760 2023-10-09T06:21:32.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.901+0000 7f49277fe700 1 -- 172.21.15.31:0/1278521533 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493000c9b0 con 0x7f49400b6760 2023-10-09T06:21:32.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.901+0000 7f49277fe700 1 -- 172.21.15.31:0/1278521533 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493000cd50 con 0x7f49400b6760 2023-10-09T06:21:32.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.901+0000 7f4946257700 1 -- 172.21.15.31:0/1278521533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49400c8380 con 0x7f49400b6760 2023-10-09T06:21:32.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.901+0000 7f4946257700 1 -- 172.21.15.31:0/1278521533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4940158f90 con 0x7f49400b6760 2023-10-09T06:21:32.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.902+0000 7f4946257700 1 -- 172.21.15.31:0/1278521533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49400c81e0 con 0x7f49400b6760 2023-10-09T06:21:32.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.902+0000 7f49277fe700 1 -- 172.21.15.31:0/1278521533 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4930013680 con 0x7f49400b6760 2023-10-09T06:21:32.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.903+0000 7f49277fe700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f492c066f30 0x7f492c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:32.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.903+0000 7f49277fe700 1 -- 172.21.15.31:0/1278521533 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f4930084840 con 0x7f49400b6760 2023-10-09T06:21:32.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.903+0000 7f493effd700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f492c066f30 0x7f492c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:32.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.903+0000 7f493effd700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f492c066f30 0x7f492c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4940089ea0 tx=0x7f4934017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:32.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:32.907+0000 7f49277fe700 1 -- 172.21.15.31:0/1278521533 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49400c81e0 con 0x7f49400b6760 2023-10-09T06:21:33.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.145+0000 7f4946257700 1 -- 172.21.15.31:0/1278521533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f49400c81e0 con 0x7f49400b6760 2023-10-09T06:21:33.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.759+0000 7f49277fe700 1 -- 172.21.15.31:0/1278521533 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f49400c81e0 con 0x7f49400b6760 2023-10-09T06:21:33.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.761+0000 7f4946257700 1 -- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f492c066f30 msgr2=0x7f492c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:33.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.761+0000 7f4946257700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f492c066f30 0x7f492c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4940089ea0 tx=0x7f4934017000 comp rx=0 tx=0).stop 2023-10-09T06:21:33.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.761+0000 7f4946257700 1 -- 172.21.15.31:0/1278521533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49400b6760 msgr2=0x7f49400c8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:33.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.761+0000 7f4946257700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49400b6760 0x7f49400c8e60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f493000ec80 tx=0x7f49300091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:33.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.761+0000 7f4946257700 1 -- 172.21.15.31:0/1278521533 shutdown_connections 2023-10-09T06:21:33.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.761+0000 7f4946257700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f492c066f30 0x7f492c0693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:33.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.761+0000 7f4946257700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f49400d12a0 0x7f494015cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:33.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.761+0000 7f4946257700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49400b6760 0x7f49400c8e60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:33.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.761+0000 7f4946257700 1 --2- 172.21.15.31:0/1278521533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f49400cd300 0x7f4940158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:33.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.761+0000 7f4946257700 1 -- 172.21.15.31:0/1278521533 >> 172.21.15.31:0/1278521533 conn(0x7f4940068d90 msgr2=0x7f494014fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:33.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.761+0000 7f4946257700 1 -- 172.21.15.31:0/1278521533 shutdown_connections 2023-10-09T06:21:33.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.761+0000 7f4946257700 1 -- 172.21.15.31:0/1278521533 wait complete. 2023-10-09T06:21:33.775 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:21:33.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.903+0000 7f10b759e700 1 Processor -- start 2023-10-09T06:21:33.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.903+0000 7f10b759e700 1 -- start start 2023-10-09T06:21:33.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f10b80b06f0 0x7f10b80ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:33.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b759e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10b80b0ac0 0x7f10b80ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:33.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b759e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f10b815b850 0x7f10b815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:33.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b80b1830 con 0x7f10b80b06f0 2023-10-09T06:21:33.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b759e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b80b2650 con 0x7f10b815b850 2023-10-09T06:21:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b759e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b80b1a40 con 0x7f10b80b0ac0 2023-10-09T06:21:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f10b80b06f0 0x7f10b80ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f10b80b06f0 0x7f10b80ad910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44440/0 (socket says 172.21.15.31:44440) 2023-10-09T06:21:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b659c700 1 -- 172.21.15.31:0/3081672822 learned_addr learned my addr 172.21.15.31:0/3081672822 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b5d9b700 1 --2- 172.21.15.31:0/3081672822 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10b80b0ac0 0x7f10b80ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b6d9d700 1 --2- 172.21.15.31:0/3081672822 >> v2:172.21.15.158:3300/0 conn(0x7f10b815b850 0x7f10b815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b659c700 1 -- 172.21.15.31:0/3081672822 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10b80b0ac0 msgr2=0x7f10b80ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b659c700 1 --2- 172.21.15.31:0/3081672822 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10b80b0ac0 0x7f10b80ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b659c700 1 -- 172.21.15.31:0/3081672822 >> v2:172.21.15.158:3300/0 conn(0x7f10b815b850 msgr2=0x7f10b815bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:33.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b659c700 1 --2- 172.21.15.31:0/3081672822 >> v2:172.21.15.158:3300/0 conn(0x7f10b815b850 0x7f10b815bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:33.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b659c700 1 -- 172.21.15.31:0/3081672822 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b80b1d20 con 0x7f10b80b06f0 2023-10-09T06:21:33.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b659c700 1 --2- 172.21.15.31:0/3081672822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b80b06f0 0x7f10b80ad910 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f10b80b4770 tx=0x7f10a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ad83603a672e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:33.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b559a700 1 -- 172.21.15.31:0/3081672822 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a800e070 con 0x7f10b80b06f0 2023-10-09T06:21:33.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b559a700 1 -- 172.21.15.31:0/3081672822 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a800ba50 con 0x7f10b80b06f0 2023-10-09T06:21:33.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.904+0000 7f10b559a700 1 -- 172.21.15.31:0/3081672822 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a80092e0 con 0x7f10b80b06f0 2023-10-09T06:21:33.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.905+0000 7f10b759e700 1 -- 172.21.15.31:0/3081672822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b80b06f0 msgr2=0x7f10b80ad910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:33.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.905+0000 7f10b759e700 1 --2- 172.21.15.31:0/3081672822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b80b06f0 0x7f10b80ad910 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f10b80b4770 tx=0x7f10a8009840 comp rx=0 tx=0).stop 2023-10-09T06:21:33.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.905+0000 7f10b759e700 1 -- 172.21.15.31:0/3081672822 shutdown_connections 2023-10-09T06:21:33.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.905+0000 7f10b759e700 1 --2- 172.21.15.31:0/3081672822 >> v2:172.21.15.158:3300/0 conn(0x7f10b815b850 0x7f10b815bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:33.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.905+0000 7f10b759e700 1 --2- 172.21.15.31:0/3081672822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b80b06f0 0x7f10b80ad910 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:33.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.905+0000 7f10b759e700 1 --2- 172.21.15.31:0/3081672822 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10b80b0ac0 0x7f10b80ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:33.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.905+0000 7f10b759e700 1 -- 172.21.15.31:0/3081672822 >> 172.21.15.31:0/3081672822 conn(0x7f10b806c700 msgr2=0x7f10b806f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:33.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.905+0000 7f10b759e700 1 -- 172.21.15.31:0/3081672822 shutdown_connections 2023-10-09T06:21:33.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.905+0000 7f10b759e700 1 -- 172.21.15.31:0/3081672822 wait complete. 2023-10-09T06:21:33.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.906+0000 7f10b759e700 1 Processor -- start 2023-10-09T06:21:33.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.906+0000 7f10b759e700 1 -- start start 2023-10-09T06:21:33.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b759e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10b80b06f0 0x7f10b80c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:33.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b759e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10b80b0ac0 0x7f10b81577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:33.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815b850 0x7f10b80c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:33.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b8168e20 con 0x7f10b815b850 2023-10-09T06:21:33.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b759e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b80c3990 con 0x7f10b80b0ac0 2023-10-09T06:21:33.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b759e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b80c3c70 con 0x7f10b80b06f0 2023-10-09T06:21:33.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815b850 0x7f10b80c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:33.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815b850 0x7f10b80c4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44452/0 (socket says 172.21.15.31:44452) 2023-10-09T06:21:33.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b6d9d700 1 -- 172.21.15.31:0/2792096643 learned_addr learned my addr 172.21.15.31:0/2792096643 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:33.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b659c700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10b80b06f0 0x7f10b80c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:33.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b5d9b700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10b80b0ac0 0x7f10b81577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:33.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b6d9d700 1 -- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10b80b06f0 msgr2=0x7f10b80c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:33.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b6d9d700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10b80b06f0 0x7f10b80c5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:33.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b6d9d700 1 -- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10b80b0ac0 msgr2=0x7f10b81577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:33.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b6d9d700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10b80b0ac0 0x7f10b81577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:33.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b6d9d700 1 -- 172.21.15.31:0/2792096643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a8009ae0 con 0x7f10b815b850 2023-10-09T06:21:33.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.907+0000 7f10b659c700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10b80b06f0 0x7f10b80c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:33.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.908+0000 7f10b6d9d700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815b850 0x7f10b80c4470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f10b000d860 tx=0x7f10b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:33.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.908+0000 7f10a67fc700 1 -- 172.21.15.31:0/2792096643 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b00125f0 con 0x7f10b815b850 2023-10-09T06:21:33.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.908+0000 7f10a67fc700 1 -- 172.21.15.31:0/2792096643 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b0012750 con 0x7f10b815b850 2023-10-09T06:21:33.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.908+0000 7f10b759e700 1 -- 172.21.15.31:0/2792096643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b80c3f50 con 0x7f10b815b850 2023-10-09T06:21:33.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.908+0000 7f10a67fc700 1 -- 172.21.15.31:0/2792096643 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b0012b10 con 0x7f10b815b850 2023-10-09T06:21:33.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.908+0000 7f10b759e700 1 -- 172.21.15.31:0/2792096643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b8157d10 con 0x7f10b815b850 2023-10-09T06:21:33.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.909+0000 7f10b759e700 1 -- 172.21.15.31:0/2792096643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b80c4140 con 0x7f10b815b850 2023-10-09T06:21:33.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.909+0000 7f10a67fc700 1 -- 172.21.15.31:0/2792096643 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10b001e460 con 0x7f10b815b850 2023-10-09T06:21:33.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.909+0000 7f10a67fc700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1098066f30 0x7f10980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:33.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.910+0000 7f10a67fc700 1 -- 172.21.15.31:0/2792096643 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f10b0084b30 con 0x7f10b815b850 2023-10-09T06:21:33.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.910+0000 7f10b659c700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1098066f30 0x7f10980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:33.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.910+0000 7f10b659c700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1098066f30 0x7f10980693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f10a8009ab0 tx=0x7f10a8018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:33.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:33.914+0000 7f10a67fc700 1 -- 172.21.15.31:0/2792096643 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10b00557e0 con 0x7f10b815b850 2023-10-09T06:21:34.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.105+0000 7f10b759e700 1 -- 172.21.15.31:0/2792096643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f10b8157f30 con 0x7f10b815b850 2023-10-09T06:21:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.838+0000 7f10a67fc700 1 -- 172.21.15.31:0/2792096643 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f10b0055370 con 0x7f10b815b850 2023-10-09T06:21:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.841+0000 7f10b759e700 1 -- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1098066f30 msgr2=0x7f10980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.841+0000 7f10b759e700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1098066f30 0x7f10980693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f10a8009ab0 tx=0x7f10a8018000 comp rx=0 tx=0).stop 2023-10-09T06:21:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.841+0000 7f10b759e700 1 -- 172.21.15.31:0/2792096643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815b850 msgr2=0x7f10b80c4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.841+0000 7f10b759e700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815b850 0x7f10b80c4470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f10b000d860 tx=0x7f10b0008040 comp rx=0 tx=0).stop 2023-10-09T06:21:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.841+0000 7f10b759e700 1 -- 172.21.15.31:0/2792096643 shutdown_connections 2023-10-09T06:21:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.841+0000 7f10b759e700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1098066f30 0x7f10980693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.841+0000 7f10b759e700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10b80b06f0 0x7f10b80c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.841+0000 7f10b759e700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815b850 0x7f10b80c4470 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.841+0000 7f10b759e700 1 --2- 172.21.15.31:0/2792096643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10b80b0ac0 0x7f10b81577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.841+0000 7f10b759e700 1 -- 172.21.15.31:0/2792096643 >> 172.21.15.31:0/2792096643 conn(0x7f10b806c700 msgr2=0x7f10b80ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.841+0000 7f10b759e700 1 -- 172.21.15.31:0/2792096643 shutdown_connections 2023-10-09T06:21:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.841+0000 7f10b759e700 1 -- 172.21.15.31:0/2792096643 wait complete. 2023-10-09T06:21:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:21:34.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:21:34.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.985+0000 7f09acd40700 1 Processor -- start 2023-10-09T06:21:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.985+0000 7f09acd40700 1 -- start start 2023-10-09T06:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.986+0000 7f09acd40700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09a80b6a10 0x7f09a815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.986+0000 7f09acd40700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f09a80b46f0 0x7f09a80b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.986+0000 7f09acd40700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a80b5090 con 0x7f09a8159ef0 2023-10-09T06:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.986+0000 7f09acd40700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a80b17b0 con 0x7f09a80b46f0 2023-10-09T06:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.986+0000 7f09acd40700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80b1a60 con 0x7f09a80b6a10 2023-10-09T06:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.986+0000 7f09a6d9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f09a80b46f0 0x7f09a80b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.986+0000 7f09a5d9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09a80b6a10 0x7f09a815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.986+0000 7f09a6d9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f09a80b46f0 0x7f09a80b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:48212/0 (socket says 172.21.15.31:48212) 2023-10-09T06:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.986+0000 7f09a6d9d700 1 -- 172.21.15.31:0/3264296082 learned_addr learned my addr 172.21.15.31:0/3264296082 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.986+0000 7f09a659c700 1 --1- 172.21.15.31:0/3264296082 >> v1:172.21.15.158:6789/0 conn(0x7f09a8159ef0 0x7f09a80b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:34944/0 (socket says 172.21.15.31:34944) 2023-10-09T06:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.987+0000 7f09a5d9b700 1 -- 172.21.15.31:0/3264296082 >> v2:172.21.15.158:3300/0 conn(0x7f09a80b46f0 msgr2=0x7f09a80b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.987+0000 7f09a5d9b700 1 --2- 172.21.15.31:0/3264296082 >> v2:172.21.15.158:3300/0 conn(0x7f09a80b46f0 0x7f09a80b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.987+0000 7f09a5d9b700 1 -- 172.21.15.31:0/3264296082 >> v1:172.21.15.158:6789/0 conn(0x7f09a8159ef0 legacy=0x7f09a80b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.987+0000 7f09a5d9b700 1 -- 172.21.15.31:0/3264296082 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80b1d40 con 0x7f09a80b6a10 2023-10-09T06:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.987+0000 7f09a559a700 1 -- 172.21.15.31:0/3264296082 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717621798 0 0) 0x7f0998001160 con 0x7f09a8159ef0 2023-10-09T06:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.987+0000 7f09a6d9d700 1 --2- 172.21.15.31:0/3264296082 >> v2:172.21.15.158:3300/0 conn(0x7f09a80b46f0 0x7f09a80b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.987+0000 7f09a5d9b700 1 --2- 172.21.15.31:0/3264296082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09a80b6a10 0x7f09a815a2c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f099c0098e0 tx=0x7f099c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=144df087c09d75cb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.987+0000 7f09a559a700 1 -- 172.21.15.31:0/3264296082 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c00b640 con 0x7f09a80b6a10 2023-10-09T06:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.987+0000 7f09a559a700 1 -- 172.21.15.31:0/3264296082 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099c00b7a0 con 0x7f09a80b6a10 2023-10-09T06:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.987+0000 7f09a559a700 1 -- 172.21.15.31:0/3264296082 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c00bb40 con 0x7f09a80b6a10 2023-10-09T06:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.987+0000 7f09acd40700 1 -- 172.21.15.31:0/3264296082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09a80b6a10 msgr2=0x7f09a815a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:34.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.987+0000 7f09acd40700 1 --2- 172.21.15.31:0/3264296082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09a80b6a10 0x7f09a815a2c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f099c0098e0 tx=0x7f099c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:34.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.988+0000 7f09acd40700 1 -- 172.21.15.31:0/3264296082 shutdown_connections 2023-10-09T06:21:34.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.988+0000 7f09acd40700 1 --2- 172.21.15.31:0/3264296082 >> v2:172.21.15.158:3300/0 conn(0x7f09a80b46f0 0x7f09a80b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:34.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.988+0000 7f09acd40700 1 --2- 172.21.15.31:0/3264296082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09a80b6a10 0x7f09a815a2c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:34.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.988+0000 7f09acd40700 1 -- 172.21.15.31:0/3264296082 >> 172.21.15.31:0/3264296082 conn(0x7f09a809a0a0 msgr2=0x7f09a8067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:34.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.988+0000 7f09acd40700 1 -- 172.21.15.31:0/3264296082 shutdown_connections 2023-10-09T06:21:34.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.988+0000 7f09acd40700 1 -- 172.21.15.31:0/3264296082 wait complete. 2023-10-09T06:21:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.989+0000 7f09acd40700 1 Processor -- start 2023-10-09T06:21:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.989+0000 7f09acd40700 1 -- start start 2023-10-09T06:21:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.989+0000 7f09acd40700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09a80b46f0 0x7f09a816ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.989+0000 7f09acd40700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a80b6a10 0x7f09a81573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.989+0000 7f09acd40700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09a8159ef0 0x7f09a80abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.989+0000 7f09acd40700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a8158eb0 con 0x7f09a8159ef0 2023-10-09T06:21:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.989+0000 7f09acd40700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a8157e10 con 0x7f09a80b6a10 2023-10-09T06:21:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.989+0000 7f09acd40700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a81580f0 con 0x7f09a80b46f0 2023-10-09T06:21:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09a6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09a8159ef0 0x7f09a80abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09a6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09a8159ef0 0x7f09a80abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44468/0 (socket says 172.21.15.31:44468) 2023-10-09T06:21:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09a6d9d700 1 -- 172.21.15.31:0/3152368697 learned_addr learned my addr 172.21.15.31:0/3152368697 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09a5d9b700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a80b6a10 0x7f09a81573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09a659c700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09a80b46f0 0x7f09a816ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09a6d9d700 1 -- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09a80b46f0 msgr2=0x7f09a816ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09a6d9d700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09a80b46f0 0x7f09a816ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09a6d9d700 1 -- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a80b6a10 msgr2=0x7f09a81573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09a6d9d700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a80b6a10 0x7f09a81573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09a6d9d700 1 -- 172.21.15.31:0/3152368697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0009ae0 con 0x7f09a8159ef0 2023-10-09T06:21:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09a6d9d700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09a8159ef0 0x7f09a80abe60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009fd0 tx=0x7f09a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09967fc700 1 -- 172.21.15.31:0/3152368697 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0018070 con 0x7f09a8159ef0 2023-10-09T06:21:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09967fc700 1 -- 172.21.15.31:0/3152368697 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a000f040 con 0x7f09a8159ef0 2023-10-09T06:21:34.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09acd40700 1 -- 172.21.15.31:0/3152368697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c009420 con 0x7f09a8159ef0 2023-10-09T06:21:34.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09967fc700 1 -- 172.21.15.31:0/3152368697 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a000cbd0 con 0x7f09a8159ef0 2023-10-09T06:21:34.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.990+0000 7f09acd40700 1 -- 172.21.15.31:0/3152368697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a81586b0 con 0x7f09a8159ef0 2023-10-09T06:21:34.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.991+0000 7f09acd40700 1 -- 172.21.15.31:0/3152368697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a804c3c0 con 0x7f09a8159ef0 2023-10-09T06:21:34.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.992+0000 7f09967fc700 1 -- 172.21.15.31:0/3152368697 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09a0003020 con 0x7f09a8159ef0 2023-10-09T06:21:34.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.992+0000 7f09967fc700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0988066f30 0x7f09880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:34.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.992+0000 7f09967fc700 1 -- 172.21.15.31:0/3152368697 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f09a0084850 con 0x7f09a8159ef0 2023-10-09T06:21:34.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.992+0000 7f09a659c700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0988066f30 0x7f09880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:34.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.993+0000 7f09a659c700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0988066f30 0x7f09880693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0998000fb0 tx=0x7f0998007f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:34.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:34.996+0000 7f09967fc700 1 -- 172.21.15.31:0/3152368697 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09a0051c20 con 0x7f09a8159ef0 2023-10-09T06:21:35.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.190+0000 7f09acd40700 1 -- 172.21.15.31:0/3152368697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f09a80ab430 con 0x7f09a8159ef0 2023-10-09T06:21:35.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.843+0000 7f09967fc700 1 -- 172.21.15.31:0/3152368697 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f09a0055240 con 0x7f09a8159ef0 2023-10-09T06:21:35.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.846+0000 7f09acd40700 1 -- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0988066f30 msgr2=0x7f09880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:35.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.846+0000 7f09acd40700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0988066f30 0x7f09880693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0998000fb0 tx=0x7f0998007f00 comp rx=0 tx=0).stop 2023-10-09T06:21:35.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.847+0000 7f09acd40700 1 -- 172.21.15.31:0/3152368697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09a8159ef0 msgr2=0x7f09a80abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:35.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.847+0000 7f09acd40700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09a8159ef0 0x7f09a80abe60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009fd0 tx=0x7f09a000b040 comp rx=0 tx=0).stop 2023-10-09T06:21:35.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.847+0000 7f09acd40700 1 -- 172.21.15.31:0/3152368697 shutdown_connections 2023-10-09T06:21:35.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.847+0000 7f09acd40700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0988066f30 0x7f09880693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:35.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.847+0000 7f09acd40700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09a80b46f0 0x7f09a816ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:35.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.847+0000 7f09acd40700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09a8159ef0 0x7f09a80abe60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:35.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.847+0000 7f09acd40700 1 --2- 172.21.15.31:0/3152368697 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a80b6a10 0x7f09a81573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:35.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.847+0000 7f09acd40700 1 -- 172.21.15.31:0/3152368697 >> 172.21.15.31:0/3152368697 conn(0x7f09a809a0a0 msgr2=0x7f09a8159420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:35.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.847+0000 7f09acd40700 1 -- 172.21.15.31:0/3152368697 shutdown_connections 2023-10-09T06:21:35.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:35.847+0000 7f09acd40700 1 -- 172.21.15.31:0/3152368697 wait complete. 2023-10-09T06:21:35.849 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2023-10-09T06:21:35.862 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:21:35.862 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:21:35.863 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:21:35.863 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:21:35.863 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:21:35.863 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:21:35.863 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:21:35.863 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:21:35.864 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:21:35.864 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:21:35.864 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:21:35.864 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:21:35.864 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:21:35.864 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:21:35.864 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:21:35.865 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:21:35.872 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:21:35.872 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:21:35.873 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:21:35.873 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:21:35.874 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:21:35.875 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:21:35.875 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:21:35.875 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:21:35.915 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:21:35.915 DEBUG:teuthology.parallel:result is None 2023-10-09T06:21:35.916 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:21:35.916 DEBUG:teuthology.parallel:result is None 2023-10-09T06:21:35.917 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:21:35.918 DEBUG:teuthology.parallel:result is None 2023-10-09T06:21:35.918 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:21:35.918 DEBUG:teuthology.parallel:result is None 2023-10-09T06:21:35.919 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:21:35.994 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:21:35.994 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-10-09T06:21:35.998 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:21:35.998 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-09T06:21:36.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.045+0000 7f5c8ff10700 1 Processor -- start 2023-10-09T06:21:36.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.045+0000 7f5c8ff10700 1 -- start start 2023-10-09T06:21:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.046+0000 7f5c8ff10700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c88159cb0 0x7f5c8815a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.046+0000 7f5c8ff10700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c880acc20 0x7f5c88070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.046+0000 7f5c8ff10700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c8815e650 con 0x7f5c88070700 2023-10-09T06:21:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.046+0000 7f5c8ff10700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c880ad270 con 0x7f5c88159cb0 2023-10-09T06:21:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.046+0000 7f5c8ff10700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c880ad080 con 0x7f5c880acc20 2023-10-09T06:21:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.046+0000 7f5c8dcac700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c88159cb0 0x7f5c8815a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.046+0000 7f5c8d4ab700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5c88070700 0x7f5c880ac510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33196/0 (socket says 172.21.15.31:33196) 2023-10-09T06:21:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.047+0000 7f5c8d4ab700 1 -- 172.21.15.31:0/114165776 learned_addr learned my addr 172.21.15.31:0/114165776 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.047+0000 7f5c8e4ad700 1 --2- 172.21.15.31:0/114165776 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c880acc20 0x7f5c88070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.047+0000 7f5c8dcac700 1 -- 172.21.15.31:0/114165776 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c880acc20 msgr2=0x7f5c88070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:36.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.047+0000 7f5c8dcac700 1 --2- 172.21.15.31:0/114165776 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c880acc20 0x7f5c88070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:36.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.047+0000 7f5c8dcac700 1 -- 172.21.15.31:0/114165776 >> v1:172.21.15.31:6789/0 conn(0x7f5c88070700 legacy=0x7f5c880ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:36.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.047+0000 7f5c8dcac700 1 -- 172.21.15.31:0/114165776 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c88071090 con 0x7f5c88159cb0 2023-10-09T06:21:36.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.047+0000 7f5c8e4ad700 1 --2- 172.21.15.31:0/114165776 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c880acc20 0x7f5c88070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:36.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.047+0000 7f5c8dcac700 1 --2- 172.21.15.31:0/114165776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c88159cb0 0x7f5c8815a080 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5c780098e0 tx=0x7f5c780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82174bc186b6087 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:36.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.047+0000 7f5c8ccaa700 1 -- 172.21.15.31:0/114165776 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78009e80 con 0x7f5c88159cb0 2023-10-09T06:21:36.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.047+0000 7f5c8ccaa700 1 -- 172.21.15.31:0/114165776 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7800b860 con 0x7f5c88159cb0 2023-10-09T06:21:36.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.047+0000 7f5c8ccaa700 1 -- 172.21.15.31:0/114165776 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7800bbe0 con 0x7f5c88159cb0 2023-10-09T06:21:36.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.048+0000 7f5c8ff10700 1 -- 172.21.15.31:0/114165776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c88159cb0 msgr2=0x7f5c8815a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:36.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.048+0000 7f5c8ff10700 1 --2- 172.21.15.31:0/114165776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c88159cb0 0x7f5c8815a080 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5c780098e0 tx=0x7f5c780091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:36.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.048+0000 7f5c8ff10700 1 -- 172.21.15.31:0/114165776 shutdown_connections 2023-10-09T06:21:36.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.048+0000 7f5c8ff10700 1 --2- 172.21.15.31:0/114165776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c88159cb0 0x7f5c8815a080 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:36.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.048+0000 7f5c8ff10700 1 --2- 172.21.15.31:0/114165776 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c880acc20 0x7f5c88070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:36.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.048+0000 7f5c8ff10700 1 -- 172.21.15.31:0/114165776 >> 172.21.15.31:0/114165776 conn(0x7f5c8806ad40 msgr2=0x7f5c880cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:36.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.048+0000 7f5c8ff10700 1 -- 172.21.15.31:0/114165776 shutdown_connections 2023-10-09T06:21:36.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.048+0000 7f5c8ff10700 1 -- 172.21.15.31:0/114165776 wait complete. 2023-10-09T06:21:36.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.049+0000 7f5c8ff10700 1 Processor -- start 2023-10-09T06:21:36.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.049+0000 7f5c8ff10700 1 -- start start 2023-10-09T06:21:36.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.049+0000 7f5c8ff10700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5c88070700 0x7f5c88143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:36.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.049+0000 7f5c8ff10700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c880acc20 0x7f5c8816a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:36.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8ff10700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c88159cb0 0x7f5c8816a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:36.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8ff10700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8816ad30 con 0x7f5c88159cb0 2023-10-09T06:21:36.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8ff10700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8816b3d0 con 0x7f5c88070700 2023-10-09T06:21:36.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8ff10700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8815b000 con 0x7f5c880acc20 2023-10-09T06:21:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8e4ad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c88159cb0 0x7f5c8816a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8e4ad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c88159cb0 0x7f5c8816a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44494/0 (socket says 172.21.15.31:44494) 2023-10-09T06:21:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8e4ad700 1 -- 172.21.15.31:0/386760481 learned_addr learned my addr 172.21.15.31:0/386760481 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8d4ab700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c880acc20 0x7f5c8816a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8dcac700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5c88070700 0x7f5c88143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8e4ad700 1 -- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c880acc20 msgr2=0x7f5c8816a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8e4ad700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c880acc20 0x7f5c8816a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8e4ad700 1 -- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5c88070700 msgr2=0x7f5c88143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8e4ad700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5c88070700 0x7f5c88143ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8e4ad700 1 -- 172.21.15.31:0/386760481 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c78009420 con 0x7f5c88159cb0 2023-10-09T06:21:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8d4ab700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c880acc20 0x7f5c8816a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8e4ad700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c88159cb0 0x7f5c8816a7f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000a380 tx=0x7f5c80007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c7dffb700 1 -- 172.21.15.31:0/386760481 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8000ae10 con 0x7f5c88159cb0 2023-10-09T06:21:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c7dffb700 1 -- 172.21.15.31:0/386760481 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8000d650 con 0x7f5c88159cb0 2023-10-09T06:21:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c8ff10700 1 -- 172.21.15.31:0/386760481 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8815b2e0 con 0x7f5c88159cb0 2023-10-09T06:21:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.050+0000 7f5c7dffb700 1 -- 172.21.15.31:0/386760481 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8000da10 con 0x7f5c88159cb0 2023-10-09T06:21:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.051+0000 7f5c8ff10700 1 -- 172.21.15.31:0/386760481 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8815b8a0 con 0x7f5c88159cb0 2023-10-09T06:21:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.051+0000 7f5c8ff10700 1 -- 172.21.15.31:0/386760481 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8816b5a0 con 0x7f5c88159cb0 2023-10-09T06:21:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.052+0000 7f5c7dffb700 1 -- 172.21.15.31:0/386760481 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c8001e3b0 con 0x7f5c88159cb0 2023-10-09T06:21:36.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.052+0000 7f5c7dffb700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5c6c066f30 0x7f5c6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:36.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.052+0000 7f5c7dffb700 1 -- 172.21.15.31:0/386760481 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5c80084c20 con 0x7f5c88159cb0 2023-10-09T06:21:36.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.052+0000 7f5c8dcac700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5c6c066f30 0x7f5c6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:36.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.053+0000 7f5c8dcac700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5c6c066f30 0x7f5c6c0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5c78003080 tx=0x7f5c78017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:36.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.056+0000 7f5c7dffb700 1 -- 172.21.15.31:0/386760481 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c80052190 con 0x7f5c88159cb0 2023-10-09T06:21:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:36.263+0000 7f5c8ff10700 1 -- 172.21.15.31:0/386760481 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5c8804c3c0 con 0x7f5c88159cb0 2023-10-09T06:21:37.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.679+0000 7f5c7dffb700 1 -- 172.21.15.31:0/386760481 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5c8001a020 con 0x7f5c88159cb0 2023-10-09T06:21:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.682+0000 7f5c8ff10700 1 -- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5c6c066f30 msgr2=0x7f5c6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.682+0000 7f5c8ff10700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5c6c066f30 0x7f5c6c0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5c78003080 tx=0x7f5c78017000 comp rx=0 tx=0).stop 2023-10-09T06:21:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.682+0000 7f5c8ff10700 1 -- 172.21.15.31:0/386760481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c88159cb0 msgr2=0x7f5c8816a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.682+0000 7f5c8ff10700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c88159cb0 0x7f5c8816a7f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000a380 tx=0x7f5c80007900 comp rx=0 tx=0).stop 2023-10-09T06:21:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.682+0000 7f5c8ff10700 1 -- 172.21.15.31:0/386760481 shutdown_connections 2023-10-09T06:21:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.682+0000 7f5c8ff10700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5c6c066f30 0x7f5c6c0693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.682+0000 7f5c8ff10700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c88159cb0 0x7f5c8816a7f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.682+0000 7f5c8ff10700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5c88070700 0x7f5c88143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.682+0000 7f5c8ff10700 1 --2- 172.21.15.31:0/386760481 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5c880acc20 0x7f5c8816a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.682+0000 7f5c8ff10700 1 -- 172.21.15.31:0/386760481 >> 172.21.15.31:0/386760481 conn(0x7f5c8806ad40 msgr2=0x7f5c880b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.682+0000 7f5c8ff10700 1 -- 172.21.15.31:0/386760481 shutdown_connections 2023-10-09T06:21:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.682+0000 7f5c8ff10700 1 -- 172.21.15.31:0/386760481 wait complete. 2023-10-09T06:21:37.684 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2023-10-09T06:21:37.697 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:21:37.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.822+0000 7f08edb41700 1 Processor -- start 2023-10-09T06:21:37.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.822+0000 7f08edb41700 1 -- start start 2023-10-09T06:21:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.822+0000 7f08edb41700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f08e80cdab0 0x7f08e815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.822+0000 7f08edb41700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08e815dda0 0x7f08e815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.822+0000 7f08edb41700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e80cb7c0 con 0x7f08e80cd6e0 2023-10-09T06:21:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.822+0000 7f08edb41700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e815e850 con 0x7f08e815dda0 2023-10-09T06:21:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.822+0000 7f08edb41700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e80cc360 con 0x7f08e80cdab0 2023-10-09T06:21:37.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.823+0000 7f08ecb3f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f08e80cd6e0 0x7f08e80cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33210/0 (socket says 172.21.15.31:33210) 2023-10-09T06:21:37.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.823+0000 7f08ed340700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08e815dda0 0x7f08e815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:37.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.823+0000 7f08ecb3f700 1 -- 172.21.15.31:0/1961366947 learned_addr learned my addr 172.21.15.31:0/1961366947 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:37.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.823+0000 7f08e7fff700 1 --2- 172.21.15.31:0/1961366947 >> v2:172.21.15.158:3300/0 conn(0x7f08e80cdab0 0x7f08e815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:37.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.823+0000 7f08ed340700 1 -- 172.21.15.31:0/1961366947 >> v2:172.21.15.158:3300/0 conn(0x7f08e80cdab0 msgr2=0x7f08e815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:37.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.823+0000 7f08ed340700 1 --2- 172.21.15.31:0/1961366947 >> v2:172.21.15.158:3300/0 conn(0x7f08e80cdab0 0x7f08e815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:37.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.823+0000 7f08ed340700 1 -- 172.21.15.31:0/1961366947 >> v1:172.21.15.31:6789/0 conn(0x7f08e80cd6e0 legacy=0x7f08e80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:37.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.823+0000 7f08e77fe700 1 -- 172.21.15.31:0/1961366947 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364794551 0 0) 0x7f08e80cb7c0 con 0x7f08e80cd6e0 2023-10-09T06:21:37.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.823+0000 7f08ed340700 1 -- 172.21.15.31:0/1961366947 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e815e290 con 0x7f08e815dda0 2023-10-09T06:21:37.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.823+0000 7f08ed340700 1 --2- 172.21.15.31:0/1961366947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e815dda0 0x7f08e815cbd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f08e80b6c70 tx=0x7f08e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c51ea581abed68 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:37.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.823+0000 7f08e77fe700 1 -- 172.21.15.31:0/1961366947 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e000e070 con 0x7f08e815dda0 2023-10-09T06:21:37.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.823+0000 7f08e77fe700 1 -- 172.21.15.31:0/1961366947 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e000bb60 con 0x7f08e815dda0 2023-10-09T06:21:37.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.823+0000 7f08e77fe700 1 -- 172.21.15.31:0/1961366947 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0012430 con 0x7f08e815dda0 2023-10-09T06:21:37.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.824+0000 7f08edb41700 1 -- 172.21.15.31:0/1961366947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e815dda0 msgr2=0x7f08e815cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:37.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.824+0000 7f08edb41700 1 --2- 172.21.15.31:0/1961366947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e815dda0 0x7f08e815cbd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f08e80b6c70 tx=0x7f08e0009780 comp rx=0 tx=0).stop 2023-10-09T06:21:37.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.824+0000 7f08edb41700 1 -- 172.21.15.31:0/1961366947 shutdown_connections 2023-10-09T06:21:37.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.824+0000 7f08edb41700 1 --2- 172.21.15.31:0/1961366947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e815dda0 0x7f08e815cbd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:37.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.824+0000 7f08edb41700 1 --2- 172.21.15.31:0/1961366947 >> v2:172.21.15.158:3300/0 conn(0x7f08e80cdab0 0x7f08e815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:37.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.824+0000 7f08edb41700 1 -- 172.21.15.31:0/1961366947 >> 172.21.15.31:0/1961366947 conn(0x7f08e8067660 msgr2=0x7f08e8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:37.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.824+0000 7f08edb41700 1 -- 172.21.15.31:0/1961366947 shutdown_connections 2023-10-09T06:21:37.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.824+0000 7f08edb41700 1 -- 172.21.15.31:0/1961366947 wait complete. 2023-10-09T06:21:37.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.825+0000 7f08edb41700 1 Processor -- start 2023-10-09T06:21:37.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.825+0000 7f08edb41700 1 -- start start 2023-10-09T06:21:37.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08edb41700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e80cd6e0 0x7f08e814cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:37.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08edb41700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f08e80cdab0 0x7f08e80b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:37.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08edb41700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f08e815dda0 0x7f08e80b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:37.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08edb41700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e80b4d40 con 0x7f08e80cd6e0 2023-10-09T06:21:37.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08edb41700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e814d050 con 0x7f08e80cdab0 2023-10-09T06:21:37.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08edb41700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e80c8a50 con 0x7f08e815dda0 2023-10-09T06:21:37.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08ecb3f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e80cd6e0 0x7f08e814cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:37.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08ecb3f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e80cd6e0 0x7f08e814cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44514/0 (socket says 172.21.15.31:44514) 2023-10-09T06:21:37.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08ecb3f700 1 -- 172.21.15.31:0/3476701121 learned_addr learned my addr 172.21.15.31:0/3476701121 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:37.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08ecb3f700 1 -- 172.21.15.31:0/3476701121 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f08e815dda0 msgr2=0x7f08e80b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:37.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08ed340700 1 --2- 172.21.15.31:0/3476701121 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f08e815dda0 0x7f08e80b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:37.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08ecb3f700 1 --2- 172.21.15.31:0/3476701121 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f08e815dda0 0x7f08e80b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:37.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08ecb3f700 1 -- 172.21.15.31:0/3476701121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f08e80cdab0 msgr2=0x7f08e80b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:37.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08ecb3f700 1 --2- 172.21.15.31:0/3476701121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f08e80cdab0 0x7f08e80b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:37.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08ecb3f700 1 -- 172.21.15.31:0/3476701121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e0009a20 con 0x7f08e80cd6e0 2023-10-09T06:21:37.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.826+0000 7f08ecb3f700 1 --2- 172.21.15.31:0/3476701121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e80cd6e0 0x7f08e814cb10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f08d800c810 tx=0x7f08d8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:37.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.827+0000 7f08e4ff9700 1 -- 172.21.15.31:0/3476701121 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8005b30 con 0x7f08e80cd6e0 2023-10-09T06:21:37.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.827+0000 7f08e4ff9700 1 -- 172.21.15.31:0/3476701121 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d8005c90 con 0x7f08e80cd6e0 2023-10-09T06:21:37.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.827+0000 7f08edb41700 1 -- 172.21.15.31:0/3476701121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e80c8d30 con 0x7f08e80cd6e0 2023-10-09T06:21:37.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.827+0000 7f08e4ff9700 1 -- 172.21.15.31:0/3476701121 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8007300 con 0x7f08e80cd6e0 2023-10-09T06:21:37.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.827+0000 7f08edb41700 1 -- 172.21.15.31:0/3476701121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e80c92f0 con 0x7f08e80cd6e0 2023-10-09T06:21:37.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.827+0000 7f08edb41700 1 -- 172.21.15.31:0/3476701121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e8089280 con 0x7f08e80cd6e0 2023-10-09T06:21:37.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.828+0000 7f08e4ff9700 1 -- 172.21.15.31:0/3476701121 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08d801b400 con 0x7f08e80cd6e0 2023-10-09T06:21:37.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.828+0000 7f08e4ff9700 1 --2- 172.21.15.31:0/3476701121 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f08d4066f30 0x7f08d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:37.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.828+0000 7f08e4ff9700 1 -- 172.21.15.31:0/3476701121 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f08d8083cb0 con 0x7f08e80cd6e0 2023-10-09T06:21:37.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.829+0000 7f08e7fff700 1 --2- 172.21.15.31:0/3476701121 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f08d4066f30 0x7f08d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:37.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.829+0000 7f08e7fff700 1 --2- 172.21.15.31:0/3476701121 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f08d4066f30 0x7f08d40693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f08e80b2cc0 tx=0x7f08dc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:37.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:37.833+0000 7f08e4ff9700 1 -- 172.21.15.31:0/3476701121 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08d80512f0 con 0x7f08e80cd6e0 2023-10-09T06:21:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.101+0000 7f08edb41700 1 -- 172.21.15.31:0/3476701121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f08e815db80 con 0x7f08e80cd6e0 2023-10-09T06:21:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.102+0000 7f08e4ff9700 1 -- 172.21.15.31:0/3476701121 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f08d8054910 con 0x7f08e80cd6e0 2023-10-09T06:21:38.103 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:38.103 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:21:38.103 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2023-10-09T06:21:38.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.103 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2023-10-09T06:21:38.103 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl/nWKAxAA1kcqjt4lPGPkmDivDpIVjQ==", 2023-10-09T06:21:38.103 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.103 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:21:38.104 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:21:38.104 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:21:38.104 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.104 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.104 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2023-10-09T06:21:38.104 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl9xYEDxAAQJeaqz7lkrArv45vLGb34g==", 2023-10-09T06:21:38.104 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.104 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:21:38.105 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:21:38.105 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:21:38.105 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.105 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.105 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2023-10-09T06:21:38.105 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlJOp0ChAADGiI4SX7ZLvDrtjDtU905A==", 2023-10-09T06:21:38.105 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.105 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:21:38.105 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:21:38.105 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:21:38.106 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.106 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.106 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2023-10-09T06:21:38.106 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlbnnJFRAAO+XoxRQDaHv0ZicyggniLQ==", 2023-10-09T06:21:38.106 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.106 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:21:38.106 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:21:38.106 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:21:38.106 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.107 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.107 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2023-10-09T06:21:38.107 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNloyZ+LxAApAHpPxV7R1OVE2wlIaU+PA==", 2023-10-09T06:21:38.107 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.107 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:21:38.107 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:21:38.107 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.107 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.108 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2023-10-09T06:21:38.108 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNlvHeUNhAAXblIEmmsc5eTo5VcZVirfA==", 2023-10-09T06:21:38.108 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.108 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:21:38.108 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:21:38.108 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.108 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.108 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2023-10-09T06:21:38.108 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlxfIaBBAAE8WbXh4Q4SxaW2k7MkSTHg==", 2023-10-09T06:21:38.108 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.109 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:21:38.109 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:21:38.109 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.109 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.109 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2023-10-09T06:21:38.109 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlUtX3DRAA5NEq+lFMzqhu1GF1ZWT2ag==", 2023-10-09T06:21:38.109 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.109 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:21:38.109 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:21:38.109 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.110 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2023-10-09T06:21:38.110 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlcWc5IBAA5e62AwhIuHdw4dTjnNS8hQ==", 2023-10-09T06:21:38.110 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.110 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:21:38.110 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:21:38.110 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.111 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2023-10-09T06:21:38.111 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlX5S6JhAAzvzO2YEqEtq2fJ3FW9Fddg==", 2023-10-09T06:21:38.111 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.111 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:21:38.111 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:21:38.111 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.111 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.111 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2023-10-09T06:21:38.112 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl9jy5LxAAxgMslSN6ayxB2MFRf2dwNQ==", 2023-10-09T06:21:38.112 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.112 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:21:38.112 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:21:38.112 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.112 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.112 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2023-10-09T06:21:38.112 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl8M+TOBAARhk2wEaXO9Pi4TP9d+L5Gg==", 2023-10-09T06:21:38.112 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.112 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:21:38.113 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:21:38.113 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.113 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.113 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2023-10-09T06:21:38.113 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlfsC2GRAAlm37QI8DkNclcBpD5ZBR7A==", 2023-10-09T06:21:38.113 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.113 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:21:38.113 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:21:38.113 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:21:38.114 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:21:38.114 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.114 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2023-10-09T06:21:38.114 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlapIxIhAAiBZUkpnf6tyFHwySGKhRpQ==", 2023-10-09T06:21:38.114 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.114 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:21:38.114 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:21:38.114 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:21:38.114 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:21:38.115 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.115 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2023-10-09T06:21:38.115 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEZYuHxAA7WEH0vXmAEH5Wki8ESrDBg==", 2023-10-09T06:21:38.115 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.115 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:21:38.115 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:21:38.115 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:21:38.115 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:21:38.115 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.116 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2023-10-09T06:21:38.116 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlFvuIJxAAGuTp4gsXrvUzDd1B7d5vcg==", 2023-10-09T06:21:38.116 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.116 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:21:38.116 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:21:38.116 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:21:38.116 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:21:38.116 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.116 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2023-10-09T06:21:38.117 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlS8AlJBAAg8lLRVasKHyhbFlOTfgt9g==", 2023-10-09T06:21:38.117 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.117 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:21:38.117 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:21:38.117 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:21:38.117 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.117 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.117 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-mds", 2023-10-09T06:21:38.117 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQC0myNlrBWBNhAAf4lPEnTQtlkG2bwWB6Za4w==", 2023-10-09T06:21:38.118 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.118 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-mds" 2023-10-09T06:21:38.118 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.118 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-mgr", 2023-10-09T06:21:38.118 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQC0myNlBR+BNhAAbQYo4RcBMkrqdOlLN9eadg==", 2023-10-09T06:21:38.118 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.118 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-09T06:21:38.118 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.119 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-osd", 2023-10-09T06:21:38.119 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQC0myNl9jCBNhAAcquWQiAjy/kbTI5VbKzvog==", 2023-10-09T06:21:38.119 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.119 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-osd" 2023-10-09T06:21:38.119 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.119 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rbd", 2023-10-09T06:21:38.119 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQC0myNlKzuBNhAARd+QkqW0f3Y5iV4bjSVTyw==", 2023-10-09T06:21:38.119 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.119 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-09T06:21:38.120 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.120 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-09T06:21:38.120 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQC0myNlakSBNhAAKm6dvpEhu+WY6o6YNFez1w==", 2023-10-09T06:21:38.120 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.120 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-09T06:21:38.120 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.120 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rgw", 2023-10-09T06:21:38.120 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQC0myNly0yBNhAAZbTz8OjsD9oXQEgW3xC1bQ==", 2023-10-09T06:21:38.121 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.121 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-09T06:21:38.121 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.121 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2023-10-09T06:21:38.121 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEE9eABAAHbJ1yvlmOUNo6n2uAhPrnw==", 2023-10-09T06:21:38.121 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.121 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:21:38.121 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:21:38.121 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.121 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:38.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:38.122 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2023-10-09T06:21:38.122 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlhol5OBAAZSZ+PbojVwsOJtLlTl6wAA==", 2023-10-09T06:21:38.122 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:21:38.122 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:21:38.122 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:21:38.122 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:21:38.122 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.122 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:38.122 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:21:38.123 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:21:38.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.104+0000 7f08edb41700 1 -- 172.21.15.31:0/3476701121 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f08d4066f30 msgr2=0x7f08d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.104+0000 7f08edb41700 1 --2- 172.21.15.31:0/3476701121 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f08d4066f30 0x7f08d40693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f08e80b2cc0 tx=0x7f08dc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.104+0000 7f08edb41700 1 -- 172.21.15.31:0/3476701121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e80cd6e0 msgr2=0x7f08e814cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.104+0000 7f08edb41700 1 --2- 172.21.15.31:0/3476701121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e80cd6e0 0x7f08e814cb10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f08d800c810 tx=0x7f08d8007df0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.104+0000 7f08edb41700 1 -- 172.21.15.31:0/3476701121 shutdown_connections 2023-10-09T06:21:38.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.104+0000 7f08edb41700 1 --2- 172.21.15.31:0/3476701121 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f08d4066f30 0x7f08d40693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.104+0000 7f08edb41700 1 --2- 172.21.15.31:0/3476701121 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f08e815dda0 0x7f08e80b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.104+0000 7f08edb41700 1 --2- 172.21.15.31:0/3476701121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e80cd6e0 0x7f08e814cb10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.104+0000 7f08edb41700 1 --2- 172.21.15.31:0/3476701121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f08e80cdab0 0x7f08e80b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.104+0000 7f08edb41700 1 -- 172.21.15.31:0/3476701121 >> 172.21.15.31:0/3476701121 conn(0x7f08e8067660 msgr2=0x7f08e814d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:38.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.104+0000 7f08edb41700 1 -- 172.21.15.31:0/3476701121 shutdown_connections 2023-10-09T06:21:38.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.104+0000 7f08edb41700 1 -- 172.21.15.31:0/3476701121 wait complete. 2023-10-09T06:21:38.125 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-09T06:21:38.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.244+0000 7fd219022700 1 Processor -- start 2023-10-09T06:21:38.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.244+0000 7fd219022700 1 -- start start 2023-10-09T06:21:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd219022700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2140c9af0 0x7fd21406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd219022700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd214070700 0x7fd214070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd219022700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd214071040 con 0x7fd2141510f0 2023-10-09T06:21:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd219022700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140ca0b0 con 0x7fd2140c9af0 2023-10-09T06:21:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd219022700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd214068a10 con 0x7fd214070700 2023-10-09T06:21:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd21259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2140c9af0 0x7fd21406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd21259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2140c9af0 0x7fd21406ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44528/0 (socket says 172.21.15.31:44528) 2023-10-09T06:21:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd21259c700 1 -- 172.21.15.31:0/984344412 learned_addr learned my addr 172.21.15.31:0/984344412 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd21359e700 1 --2- 172.21.15.31:0/984344412 >> v2:172.21.15.158:3300/0 conn(0x7fd214070700 0x7fd214070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd21259c700 1 -- 172.21.15.31:0/984344412 >> v2:172.21.15.158:3300/0 conn(0x7fd214070700 msgr2=0x7fd214070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd21259c700 1 --2- 172.21.15.31:0/984344412 >> v2:172.21.15.158:3300/0 conn(0x7fd214070700 0x7fd214070b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd21259c700 1 -- 172.21.15.31:0/984344412 >> v1:172.21.15.158:6789/0 conn(0x7fd2141510f0 legacy=0x7fd21415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd21259c700 1 -- 172.21.15.31:0/984344412 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd214068cf0 con 0x7fd2140c9af0 2023-10-09T06:21:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd21259c700 1 --2- 172.21.15.31:0/984344412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2140c9af0 0x7fd21406ecc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd21406df40 tx=0x7fd1fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5835e9bb166fb11 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.245+0000 7fd211d9b700 1 -- 172.21.15.31:0/984344412 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc009e70 con 0x7fd2140c9af0 2023-10-09T06:21:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.246+0000 7fd211d9b700 1 -- 172.21.15.31:0/984344412 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc00b860 con 0x7fd2140c9af0 2023-10-09T06:21:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.246+0000 7fd211d9b700 1 -- 172.21.15.31:0/984344412 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc00bc00 con 0x7fd2140c9af0 2023-10-09T06:21:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.246+0000 7fd219022700 1 -- 172.21.15.31:0/984344412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2140c9af0 msgr2=0x7fd21406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.246+0000 7fd219022700 1 --2- 172.21.15.31:0/984344412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2140c9af0 0x7fd21406ecc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd21406df40 tx=0x7fd1fc009250 comp rx=0 tx=0).stop 2023-10-09T06:21:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.246+0000 7fd219022700 1 -- 172.21.15.31:0/984344412 shutdown_connections 2023-10-09T06:21:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.246+0000 7fd219022700 1 --2- 172.21.15.31:0/984344412 >> v2:172.21.15.158:3300/0 conn(0x7fd214070700 0x7fd214070b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.246+0000 7fd219022700 1 --2- 172.21.15.31:0/984344412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2140c9af0 0x7fd21406ecc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.246+0000 7fd219022700 1 -- 172.21.15.31:0/984344412 >> 172.21.15.31:0/984344412 conn(0x7fd2140ca4f0 msgr2=0x7fd2140ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.246+0000 7fd219022700 1 -- 172.21.15.31:0/984344412 shutdown_connections 2023-10-09T06:21:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.246+0000 7fd219022700 1 -- 172.21.15.31:0/984344412 wait complete. 2023-10-09T06:21:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.247+0000 7fd219022700 1 Processor -- start 2023-10-09T06:21:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.247+0000 7fd219022700 1 -- start start 2023-10-09T06:21:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd219022700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd214070700 0x7fd2141504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd219022700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2140c9af0 0x7fd2140afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd219022700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2141510f0 0x7fd2141594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd219022700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140c4b30 con 0x7fd2141510f0 2023-10-09T06:21:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd219022700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140c56b0 con 0x7fd2140c9af0 2023-10-09T06:21:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd219022700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140c4d80 con 0x7fd214070700 2023-10-09T06:21:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd21359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2141510f0 0x7fd2141594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd21359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2141510f0 0x7fd2141594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44536/0 (socket says 172.21.15.31:44536) 2023-10-09T06:21:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd21359e700 1 -- 172.21.15.31:0/672859386 learned_addr learned my addr 172.21.15.31:0/672859386 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd21259c700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2140c9af0 0x7fd2140afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd212d9d700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd214070700 0x7fd2141504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd21359e700 1 -- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd214070700 msgr2=0x7fd2141504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd21359e700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd214070700 0x7fd2141504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd21359e700 1 -- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2140c9af0 msgr2=0x7fd2140afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd21359e700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2140c9af0 0x7fd2140afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd21359e700 1 -- 172.21.15.31:0/672859386 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc0094f0 con 0x7fd2141510f0 2023-10-09T06:21:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.248+0000 7fd21259c700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2140c9af0 0x7fd2140afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.249+0000 7fd21359e700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2141510f0 0x7fd2141594e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd20400ea80 tx=0x7fd2040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.249+0000 7fd20affd700 1 -- 172.21.15.31:0/672859386 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400c920 con 0x7fd2141510f0 2023-10-09T06:21:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.249+0000 7fd20affd700 1 -- 172.21.15.31:0/672859386 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20400ca80 con 0x7fd2141510f0 2023-10-09T06:21:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.249+0000 7fd219022700 1 -- 172.21.15.31:0/672859386 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2140c5060 con 0x7fd2141510f0 2023-10-09T06:21:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.249+0000 7fd20affd700 1 -- 172.21.15.31:0/672859386 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400ce40 con 0x7fd2141510f0 2023-10-09T06:21:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.249+0000 7fd219022700 1 -- 172.21.15.31:0/672859386 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2141509e0 con 0x7fd2141510f0 2023-10-09T06:21:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.250+0000 7fd219022700 1 -- 172.21.15.31:0/672859386 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21406f940 con 0x7fd2141510f0 2023-10-09T06:21:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.250+0000 7fd20affd700 1 -- 172.21.15.31:0/672859386 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd204013680 con 0x7fd2141510f0 2023-10-09T06:21:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.250+0000 7fd20affd700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1f4066f30 0x7fd1f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.251+0000 7fd20affd700 1 -- 172.21.15.31:0/672859386 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd2040845a0 con 0x7fd2141510f0 2023-10-09T06:21:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.251+0000 7fd212d9d700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1f4066f30 0x7fd1f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.251+0000 7fd212d9d700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1f4066f30 0x7fd1f40693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd20c007fd0 tx=0x7fd20c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.255+0000 7fd20affd700 1 -- 172.21.15.31:0/672859386 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd204051b60 con 0x7fd2141510f0 2023-10-09T06:21:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.531+0000 7fd219022700 1 -- 172.21.15.31:0/672859386 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd21404c3c0 con 0x7fd2141510f0 2023-10-09T06:21:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.534+0000 7fd20affd700 1 -- 172.21.15.31:0/672859386 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd204055180 con 0x7fd2141510f0 2023-10-09T06:21:38.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.536+0000 7fd219022700 1 -- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1f4066f30 msgr2=0x7fd1f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.536+0000 7fd219022700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1f4066f30 0x7fd1f40693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd20c007fd0 tx=0x7fd20c009040 comp rx=0 tx=0).stop 2023-10-09T06:21:38.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.536+0000 7fd219022700 1 -- 172.21.15.31:0/672859386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2141510f0 msgr2=0x7fd2141594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.536+0000 7fd219022700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2141510f0 0x7fd2141594e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd20400ea80 tx=0x7fd2040091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.536+0000 7fd219022700 1 -- 172.21.15.31:0/672859386 shutdown_connections 2023-10-09T06:21:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.536+0000 7fd219022700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1f4066f30 0x7fd1f40693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.536+0000 7fd219022700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd214070700 0x7fd2141504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.536+0000 7fd219022700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2141510f0 0x7fd2141594e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.536+0000 7fd219022700 1 --2- 172.21.15.31:0/672859386 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2140c9af0 0x7fd2140afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.536+0000 7fd219022700 1 -- 172.21.15.31:0/672859386 >> 172.21.15.31:0/672859386 conn(0x7fd2140ca4f0 msgr2=0x7fd2140ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.536+0000 7fd219022700 1 -- 172.21.15.31:0/672859386 shutdown_connections 2023-10-09T06:21:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.536+0000 7fd219022700 1 -- 172.21.15.31:0/672859386 wait complete. 2023-10-09T06:21:38.549 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-09T06:21:38.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.668+0000 7f1679b7b700 1 Processor -- start 2023-10-09T06:21:38.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.668+0000 7f1679b7b700 1 -- start start 2023-10-09T06:21:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.668+0000 7f1679b7b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1674157870 0x7f167415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.668+0000 7f1679b7b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f167415a620 0x7f167415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.668+0000 7f1679b7b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167415cbb0 con 0x7f167415d580 2023-10-09T06:21:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.668+0000 7f1679b7b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167415bfa0 con 0x7f167415a620 2023-10-09T06:21:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.668+0000 7f1679b7b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167415c280 con 0x7f1674157870 2023-10-09T06:21:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.669+0000 7f16737fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1674157870 0x7f167415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.669+0000 7f1672ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f167415a620 0x7f167415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.669+0000 7f16737fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1674157870 0x7f167415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:56662/0 (socket says 172.21.15.31:56662) 2023-10-09T06:21:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.669+0000 7f16737fe700 1 -- 172.21.15.31:0/1179073814 learned_addr learned my addr 172.21.15.31:0/1179073814 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.669+0000 7f1672ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f167415a620 0x7f167415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:48312/0 (socket says 172.21.15.31:48312) 2023-10-09T06:21:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.669+0000 7f1673fff700 1 --1- 172.21.15.31:0/1179073814 >> v1:172.21.15.158:6789/0 conn(0x7f167415d580 0x7f1674158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:34968/0 (socket says 172.21.15.31:34968) 2023-10-09T06:21:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.669+0000 7f16737fe700 1 -- 172.21.15.31:0/1179073814 >> v2:172.21.15.158:3300/0 conn(0x7f167415a620 msgr2=0x7f167415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.669+0000 7f16737fe700 1 --2- 172.21.15.31:0/1179073814 >> v2:172.21.15.158:3300/0 conn(0x7f167415a620 0x7f167415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.669+0000 7f16737fe700 1 -- 172.21.15.31:0/1179073814 >> v1:172.21.15.158:6789/0 conn(0x7f167415d580 legacy=0x7f1674158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.669+0000 7f16737fe700 1 -- 172.21.15.31:0/1179073814 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167415c560 con 0x7f1674157870 2023-10-09T06:21:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.669+0000 7f16727fc700 1 -- 172.21.15.31:0/1179073814 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438624456 0 0) 0x7f167415cbb0 con 0x7f167415d580 2023-10-09T06:21:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.669+0000 7f1672ffd700 1 --2- 172.21.15.31:0/1179073814 >> v2:172.21.15.158:3300/0 conn(0x7f167415a620 0x7f167415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.669+0000 7f16737fe700 1 --2- 172.21.15.31:0/1179073814 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1674157870 0x7f167415b6a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f16640099b0 tx=0x7f1664009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45f6a5b9701d716 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.670+0000 7f16727fc700 1 -- 172.21.15.31:0/1179073814 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664009ea0 con 0x7f1674157870 2023-10-09T06:21:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.670+0000 7f16727fc700 1 -- 172.21.15.31:0/1179073814 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166400b860 con 0x7f1674157870 2023-10-09T06:21:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.670+0000 7f16727fc700 1 -- 172.21.15.31:0/1179073814 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166400bc00 con 0x7f1674157870 2023-10-09T06:21:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.670+0000 7f1679b7b700 1 -- 172.21.15.31:0/1179073814 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1674157870 msgr2=0x7f167415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.670+0000 7f1679b7b700 1 --2- 172.21.15.31:0/1179073814 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1674157870 0x7f167415b6a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f16640099b0 tx=0x7f1664009250 comp rx=0 tx=0).stop 2023-10-09T06:21:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.670+0000 7f1679b7b700 1 -- 172.21.15.31:0/1179073814 shutdown_connections 2023-10-09T06:21:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.670+0000 7f1679b7b700 1 --2- 172.21.15.31:0/1179073814 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1674157870 0x7f167415b6a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.670+0000 7f1679b7b700 1 --2- 172.21.15.31:0/1179073814 >> v2:172.21.15.158:3300/0 conn(0x7f167415a620 0x7f167415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.670+0000 7f1679b7b700 1 -- 172.21.15.31:0/1179073814 >> 172.21.15.31:0/1179073814 conn(0x7f1674068ce0 msgr2=0x7f16740690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.670+0000 7f1679b7b700 1 -- 172.21.15.31:0/1179073814 shutdown_connections 2023-10-09T06:21:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.670+0000 7f1679b7b700 1 -- 172.21.15.31:0/1179073814 wait complete. 2023-10-09T06:21:38.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.671+0000 7f1679b7b700 1 Processor -- start 2023-10-09T06:21:38.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.671+0000 7f1679b7b700 1 -- start start 2023-10-09T06:21:38.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.672+0000 7f1679b7b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1674157870 0x7f167416ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:38.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.672+0000 7f1679b7b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f167415a620 0x7f1674152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:38.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.672+0000 7f1679b7b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167415d580 0x7f167415e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:38.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.672+0000 7f1679b7b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1674153220 con 0x7f167415d580 2023-10-09T06:21:38.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.672+0000 7f1679b7b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1674154040 con 0x7f1674157870 2023-10-09T06:21:38.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.672+0000 7f1679b7b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1674153430 con 0x7f167415a620 2023-10-09T06:21:38.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.672+0000 7f1673fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167415d580 0x7f167415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:38.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.672+0000 7f1673fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167415d580 0x7f167415e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44544/0 (socket says 172.21.15.31:44544) 2023-10-09T06:21:38.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.672+0000 7f1673fff700 1 -- 172.21.15.31:0/3977957303 learned_addr learned my addr 172.21.15.31:0/3977957303 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:38.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.672+0000 7f1672ffd700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f167415a620 0x7f1674152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:38.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.672+0000 7f16737fe700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1674157870 0x7f167416ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.673+0000 7f1673fff700 1 -- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f167415a620 msgr2=0x7f1674152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.673+0000 7f1673fff700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f167415a620 0x7f1674152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.673+0000 7f1673fff700 1 -- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1674157870 msgr2=0x7f167416ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.673+0000 7f1673fff700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1674157870 0x7f167416ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.673+0000 7f1673fff700 1 -- 172.21.15.31:0/3977957303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1668009420 con 0x7f167415d580 2023-10-09T06:21:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.673+0000 7f1673fff700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167415d580 0x7f167415e520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f166c00cd70 tx=0x7f166c001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.673+0000 7f165b7fe700 1 -- 172.21.15.31:0/3977957303 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c00ce70 con 0x7f167415d580 2023-10-09T06:21:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.673+0000 7f165b7fe700 1 -- 172.21.15.31:0/3977957303 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166c005df0 con 0x7f167415d580 2023-10-09T06:21:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.673+0000 7f1679b7b700 1 -- 172.21.15.31:0/3977957303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16640094f0 con 0x7f167415d580 2023-10-09T06:21:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.673+0000 7f165b7fe700 1 -- 172.21.15.31:0/3977957303 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c00aae0 con 0x7f167415d580 2023-10-09T06:21:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.673+0000 7f1679b7b700 1 -- 172.21.15.31:0/3977957303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16741539f0 con 0x7f167415d580 2023-10-09T06:21:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.674+0000 7f1679b7b700 1 -- 172.21.15.31:0/3977957303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16740b0610 con 0x7f167415d580 2023-10-09T06:21:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.674+0000 7f165b7fe700 1 -- 172.21.15.31:0/3977957303 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f166c0070f0 con 0x7f167415d580 2023-10-09T06:21:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.675+0000 7f165b7fe700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1660066f30 0x7f16600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.675+0000 7f165b7fe700 1 -- 172.21.15.31:0/3977957303 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f166c084290 con 0x7f167415d580 2023-10-09T06:21:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.675+0000 7f16737fe700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1660066f30 0x7f16600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.675+0000 7f16737fe700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1660066f30 0x7f16600693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f16640099b0 tx=0x7f1664017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.679+0000 7f165b7fe700 1 -- 172.21.15.31:0/3977957303 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16740b0610 con 0x7f167415d580 2023-10-09T06:21:38.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.956+0000 7f1679b7b700 1 -- 172.21.15.31:0/3977957303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f16740b0610 con 0x7f167415d580 2023-10-09T06:21:38.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.961+0000 7f165b7fe700 1 -- 172.21.15.31:0/3977957303 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f16740b0610 con 0x7f167415d580 2023-10-09T06:21:38.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.963+0000 7f1679b7b700 1 -- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1660066f30 msgr2=0x7f16600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.963+0000 7f1679b7b700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1660066f30 0x7f16600693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f16640099b0 tx=0x7f1664017000 comp rx=0 tx=0).stop 2023-10-09T06:21:38.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.963+0000 7f1679b7b700 1 -- 172.21.15.31:0/3977957303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167415d580 msgr2=0x7f167415e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:38.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.963+0000 7f1679b7b700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167415d580 0x7f167415e520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f166c00cd70 tx=0x7f166c001aa0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.963+0000 7f1679b7b700 1 -- 172.21.15.31:0/3977957303 shutdown_connections 2023-10-09T06:21:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.963+0000 7f1679b7b700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1660066f30 0x7f16600693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.963+0000 7f1679b7b700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167415d580 0x7f167415e520 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.963+0000 7f1679b7b700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1674157870 0x7f167416ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.963+0000 7f1679b7b700 1 --2- 172.21.15.31:0/3977957303 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f167415a620 0x7f1674152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.963+0000 7f1679b7b700 1 -- 172.21.15.31:0/3977957303 >> 172.21.15.31:0/3977957303 conn(0x7f1674068ce0 msgr2=0x7f1674159710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.963+0000 7f1679b7b700 1 -- 172.21.15.31:0/3977957303 shutdown_connections 2023-10-09T06:21:38.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:38.963+0000 7f1679b7b700 1 -- 172.21.15.31:0/3977957303 wait complete. 2023-10-09T06:21:38.976 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-09T06:21:39.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.095+0000 7f446a479700 1 Processor -- start 2023-10-09T06:21:39.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.095+0000 7f446a479700 1 -- start start 2023-10-09T06:21:39.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.095+0000 7f446a479700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4464159cf0 0x7f446415e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.095+0000 7f446a479700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f446415a0c0 0x7f44640ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.095+0000 7f446a479700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44640cca20 con 0x7f44640ce1a0 2023-10-09T06:21:39.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.095+0000 7f446a479700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446415ea40 con 0x7f446415a0c0 2023-10-09T06:21:39.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.095+0000 7f446a479700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4464067660 con 0x7f4464159cf0 2023-10-09T06:21:39.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.096+0000 7f44637fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f446415a0c0 0x7f44640ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.096+0000 7f4468a16700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f44640ce1a0 0x7f44640cb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33222/0 (socket says 172.21.15.31:33222) 2023-10-09T06:21:39.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.096+0000 7f4468a16700 1 -- 172.21.15.31:0/547128872 learned_addr learned my addr 172.21.15.31:0/547128872 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:39.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.096+0000 7f4463fff700 1 --2- 172.21.15.31:0/547128872 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4464159cf0 0x7f446415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.096+0000 7f44637fe700 1 -- 172.21.15.31:0/547128872 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4464159cf0 msgr2=0x7f446415e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:39.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.096+0000 7f44637fe700 1 --2- 172.21.15.31:0/547128872 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4464159cf0 0x7f446415e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.096+0000 7f44637fe700 1 -- 172.21.15.31:0/547128872 >> v1:172.21.15.31:6789/0 conn(0x7f44640ce1a0 legacy=0x7f44640cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.096+0000 7f4462ffd700 1 -- 172.21.15.31:0/547128872 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580430490 0 0) 0x7f44640cca20 con 0x7f44640ce1a0 2023-10-09T06:21:39.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.096+0000 7f44637fe700 1 -- 172.21.15.31:0/547128872 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4464067f00 con 0x7f446415a0c0 2023-10-09T06:21:39.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.096+0000 7f44637fe700 1 --2- 172.21.15.31:0/547128872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f446415a0c0 0x7f44640ceab0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f44580098e0 tx=0x7f44580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1fbca628b61b28 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:39.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.096+0000 7f4462ffd700 1 -- 172.21.15.31:0/547128872 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445800b640 con 0x7f446415a0c0 2023-10-09T06:21:39.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.096+0000 7f4462ffd700 1 -- 172.21.15.31:0/547128872 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445800b7a0 con 0x7f446415a0c0 2023-10-09T06:21:39.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.096+0000 7f4462ffd700 1 -- 172.21.15.31:0/547128872 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445800bb40 con 0x7f446415a0c0 2023-10-09T06:21:39.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.097+0000 7f446a479700 1 -- 172.21.15.31:0/547128872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f446415a0c0 msgr2=0x7f44640ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.097+0000 7f446a479700 1 --2- 172.21.15.31:0/547128872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f446415a0c0 0x7f44640ceab0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f44580098e0 tx=0x7f44580091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.097+0000 7f446a479700 1 -- 172.21.15.31:0/547128872 shutdown_connections 2023-10-09T06:21:39.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.097+0000 7f446a479700 1 --2- 172.21.15.31:0/547128872 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4464159cf0 0x7f446415e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.097+0000 7f446a479700 1 --2- 172.21.15.31:0/547128872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f446415a0c0 0x7f44640ceab0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.097+0000 7f446a479700 1 -- 172.21.15.31:0/547128872 >> 172.21.15.31:0/547128872 conn(0x7f446406c6e0 msgr2=0x7f4464069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:39.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.097+0000 7f446a479700 1 -- 172.21.15.31:0/547128872 shutdown_connections 2023-10-09T06:21:39.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.097+0000 7f446a479700 1 -- 172.21.15.31:0/547128872 wait complete. 2023-10-09T06:21:39.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.098+0000 7f446a479700 1 Processor -- start 2023-10-09T06:21:39.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.098+0000 7f446a479700 1 -- start start 2023-10-09T06:21:39.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f446a479700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44640ce1a0 0x7f44641564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f446a479700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4464159cf0 0x7f44640b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f446a479700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f446415a0c0 0x7f446416a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f446a479700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44640c7610 con 0x7f44640ce1a0 2023-10-09T06:21:39.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f446a479700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44640b37e0 con 0x7f446415a0c0 2023-10-09T06:21:39.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f446a479700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44640c7bb0 con 0x7f4464159cf0 2023-10-09T06:21:39.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f4463fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44640ce1a0 0x7f44641564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f4463fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44640ce1a0 0x7f44641564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44556/0 (socket says 172.21.15.31:44556) 2023-10-09T06:21:39.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f4463fff700 1 -- 172.21.15.31:0/211644082 learned_addr learned my addr 172.21.15.31:0/211644082 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:39.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f44637fe700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4464159cf0 0x7f44640b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f4463fff700 1 -- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4464159cf0 msgr2=0x7f44640b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f4463fff700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4464159cf0 0x7f44640b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f4463fff700 1 -- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f446415a0c0 msgr2=0x7f446416a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f4468a16700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f446415a0c0 0x7f446416a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f4463fff700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f446415a0c0 0x7f446416a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f4463fff700 1 -- 172.21.15.31:0/211644082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4458009420 con 0x7f44640ce1a0 2023-10-09T06:21:39.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f44637fe700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4464159cf0 0x7f44640b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:39.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f4468a16700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f446415a0c0 0x7f446416a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:39.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.099+0000 7f4463fff700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44640ce1a0 0x7f44641564c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f445400ecb0 tx=0x7f44540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:39.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.100+0000 7f444bfff700 1 -- 172.21.15.31:0/211644082 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445400c9d0 con 0x7f44640ce1a0 2023-10-09T06:21:39.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.100+0000 7f444bfff700 1 -- 172.21.15.31:0/211644082 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445400cb30 con 0x7f44640ce1a0 2023-10-09T06:21:39.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.100+0000 7f444bfff700 1 -- 172.21.15.31:0/211644082 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445400ced0 con 0x7f44640ce1a0 2023-10-09T06:21:39.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.100+0000 7f446a479700 1 -- 172.21.15.31:0/211644082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44640b3220 con 0x7f44640ce1a0 2023-10-09T06:21:39.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.100+0000 7f446a479700 1 -- 172.21.15.31:0/211644082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44640c7840 con 0x7f44640ce1a0 2023-10-09T06:21:39.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.101+0000 7f446a479700 1 -- 172.21.15.31:0/211644082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44640c7e90 con 0x7f44640ce1a0 2023-10-09T06:21:39.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.101+0000 7f444bfff700 1 -- 172.21.15.31:0/211644082 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4454013680 con 0x7f44640ce1a0 2023-10-09T06:21:39.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.101+0000 7f444bfff700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4450066f30 0x7f44500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.101+0000 7f444bfff700 1 -- 172.21.15.31:0/211644082 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4454084540 con 0x7f44640ce1a0 2023-10-09T06:21:39.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.102+0000 7f44637fe700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4450066f30 0x7f44500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.102+0000 7f44637fe700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4450066f30 0x7f44500693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f44580098e0 tx=0x7f4458017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:39.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.106+0000 7f444bfff700 1 -- 172.21.15.31:0/211644082 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4454051b00 con 0x7f44640ce1a0 2023-10-09T06:21:39.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.377+0000 7f446a479700 1 -- 172.21.15.31:0/211644082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f446404c3c0 con 0x7f44640ce1a0 2023-10-09T06:21:39.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.382+0000 7f444bfff700 1 -- 172.21.15.31:0/211644082 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4454055120 con 0x7f44640ce1a0 2023-10-09T06:21:39.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.384+0000 7f446a479700 1 -- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4450066f30 msgr2=0x7f44500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.384+0000 7f446a479700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4450066f30 0x7f44500693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f44580098e0 tx=0x7f4458017000 comp rx=0 tx=0).stop 2023-10-09T06:21:39.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.384+0000 7f446a479700 1 -- 172.21.15.31:0/211644082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44640ce1a0 msgr2=0x7f44641564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.384+0000 7f446a479700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44640ce1a0 0x7f44641564c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f445400ecb0 tx=0x7f44540091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.384+0000 7f446a479700 1 -- 172.21.15.31:0/211644082 shutdown_connections 2023-10-09T06:21:39.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.384+0000 7f446a479700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4450066f30 0x7f44500693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.384+0000 7f446a479700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f446415a0c0 0x7f446416a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.384+0000 7f446a479700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44640ce1a0 0x7f44641564c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.384+0000 7f446a479700 1 --2- 172.21.15.31:0/211644082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4464159cf0 0x7f44640b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.384+0000 7f446a479700 1 -- 172.21.15.31:0/211644082 >> 172.21.15.31:0/211644082 conn(0x7f446406c6e0 msgr2=0x7f44640c38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:39.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.384+0000 7f446a479700 1 -- 172.21.15.31:0/211644082 shutdown_connections 2023-10-09T06:21:39.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.385+0000 7f446a479700 1 -- 172.21.15.31:0/211644082 wait complete. 2023-10-09T06:21:39.397 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-09T06:21:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.515+0000 7fb8f85c7700 1 Processor -- start 2023-10-09T06:21:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.515+0000 7fb8f85c7700 1 -- start start 2023-10-09T06:21:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.516+0000 7fb8f85c7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb8f01523e0 0x7fb8f006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.516+0000 7fb8f85c7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8f0158e50 0x7fb8f00cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.516+0000 7fb8f85c7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f006c010 con 0x7fb8f0152010 2023-10-09T06:21:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.516+0000 7fb8f85c7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f006bd10 con 0x7fb8f01523e0 2023-10-09T06:21:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.516+0000 7fb8f85c7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f015c060 con 0x7fb8f0158e50 2023-10-09T06:21:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.516+0000 7fb8f6363700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb8f0152010 0x7fb8f015b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33228/0 (socket says 172.21.15.31:33228) 2023-10-09T06:21:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.516+0000 7fb8f6363700 1 -- 172.21.15.31:0/3082308554 learned_addr learned my addr 172.21.15.31:0/3082308554 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.516+0000 7fb8f5b62700 1 --2- 172.21.15.31:0/3082308554 >> v2:172.21.15.31:3300/0 conn(0x7fb8f01523e0 0x7fb8f006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.517+0000 7fb8f5361700 1 -- 172.21.15.31:0/3082308554 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583944766 0 0) 0x7fb8f006c010 con 0x7fb8f0152010 2023-10-09T06:21:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.517+0000 7fb8f5361700 1 -- 172.21.15.31:0/3082308554 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d8003570 con 0x7fb8f0152010 2023-10-09T06:21:39.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.517+0000 7fb8f6b64700 1 --2- 172.21.15.31:0/3082308554 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8f0158e50 0x7fb8f00cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.517+0000 7fb8f5b62700 1 -- 172.21.15.31:0/3082308554 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8f0158e50 msgr2=0x7fb8f00cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:39.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.517+0000 7fb8f5361700 1 -- 172.21.15.31:0/3082308554 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3211548206 0 0) 0x7fb8d8003570 con 0x7fb8f0152010 2023-10-09T06:21:39.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.517+0000 7fb8f5b62700 1 --2- 172.21.15.31:0/3082308554 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8f0158e50 0x7fb8f00cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.517+0000 7fb8f5b62700 1 -- 172.21.15.31:0/3082308554 >> v1:172.21.15.31:6789/0 conn(0x7fb8f0152010 legacy=0x7fb8f015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.517+0000 7fb8f5b62700 1 -- 172.21.15.31:0/3082308554 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f015c340 con 0x7fb8f01523e0 2023-10-09T06:21:39.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.517+0000 7fb8f5b62700 1 --2- 172.21.15.31:0/3082308554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8f01523e0 0x7fb8f006c4a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40098e0 tx=0x7fb8e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc99eee0c9befeb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:39.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.517+0000 7fb8f5361700 1 -- 172.21.15.31:0/3082308554 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80017f0 con 0x7fb8f01523e0 2023-10-09T06:21:39.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.517+0000 7fb8f5361700 1 -- 172.21.15.31:0/3082308554 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e4011420 con 0x7fb8f01523e0 2023-10-09T06:21:39.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.517+0000 7fb8f5361700 1 -- 172.21.15.31:0/3082308554 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40117c0 con 0x7fb8f01523e0 2023-10-09T06:21:39.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.518+0000 7fb8f85c7700 1 -- 172.21.15.31:0/3082308554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8f01523e0 msgr2=0x7fb8f006c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.518+0000 7fb8f85c7700 1 --2- 172.21.15.31:0/3082308554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8f01523e0 0x7fb8f006c4a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40098e0 tx=0x7fb8e40091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.518+0000 7fb8f85c7700 1 -- 172.21.15.31:0/3082308554 shutdown_connections 2023-10-09T06:21:39.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.518+0000 7fb8f85c7700 1 --2- 172.21.15.31:0/3082308554 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8f0158e50 0x7fb8f00cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.518+0000 7fb8f85c7700 1 --2- 172.21.15.31:0/3082308554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8f01523e0 0x7fb8f006c4a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.518+0000 7fb8f85c7700 1 -- 172.21.15.31:0/3082308554 >> 172.21.15.31:0/3082308554 conn(0x7fb8f0069870 msgr2=0x7fb8f0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:39.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.518+0000 7fb8f85c7700 1 -- 172.21.15.31:0/3082308554 shutdown_connections 2023-10-09T06:21:39.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.518+0000 7fb8f85c7700 1 -- 172.21.15.31:0/3082308554 wait complete. 2023-10-09T06:21:39.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.519+0000 7fb8f85c7700 1 Processor -- start 2023-10-09T06:21:39.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.519+0000 7fb8f85c7700 1 -- start start 2023-10-09T06:21:39.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.519+0000 7fb8f85c7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8f0152010 0x7fb8f014f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f85c7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8f01523e0 0x7fb8f0155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f85c7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8f0158e50 0x7fb8f0156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f85c7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0068bd0 con 0x7fb8f0152010 2023-10-09T06:21:39.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f85c7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0153a40 con 0x7fb8f01523e0 2023-10-09T06:21:39.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f85c7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0067fc0 con 0x7fb8f0158e50 2023-10-09T06:21:39.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f6363700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8f0152010 0x7fb8f014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f6363700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8f0152010 0x7fb8f014f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44574/0 (socket says 172.21.15.31:44574) 2023-10-09T06:21:39.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f6363700 1 -- 172.21.15.31:0/1536733166 learned_addr learned my addr 172.21.15.31:0/1536733166 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:39.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f6b64700 1 --2- 172.21.15.31:0/1536733166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8f0158e50 0x7fb8f0156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f6363700 1 -- 172.21.15.31:0/1536733166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8f0158e50 msgr2=0x7fb8f0156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f6363700 1 --2- 172.21.15.31:0/1536733166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8f0158e50 0x7fb8f0156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f6363700 1 -- 172.21.15.31:0/1536733166 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8f01523e0 msgr2=0x7fb8f0155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f6363700 1 --2- 172.21.15.31:0/1536733166 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8f01523e0 0x7fb8f0155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f6363700 1 -- 172.21.15.31:0/1536733166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4009420 con 0x7fb8f0152010 2023-10-09T06:21:39.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f6363700 1 --2- 172.21.15.31:0/1536733166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8f0152010 0x7fb8f014f180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800ccc0 tx=0x7fb8e80016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:39.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8ee7fc700 1 -- 172.21.15.31:0/1536733166 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800ce70 con 0x7fb8f0152010 2023-10-09T06:21:39.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8ee7fc700 1 -- 172.21.15.31:0/1536733166 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e8004dc0 con 0x7fb8f0152010 2023-10-09T06:21:39.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f85c7700 1 -- 172.21.15.31:0/1536733166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f00682a0 con 0x7fb8f0152010 2023-10-09T06:21:39.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8ee7fc700 1 -- 172.21.15.31:0/1536733166 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800ab90 con 0x7fb8f0152010 2023-10-09T06:21:39.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.520+0000 7fb8f85c7700 1 -- 172.21.15.31:0/1536733166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f0068860 con 0x7fb8f0152010 2023-10-09T06:21:39.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.521+0000 7fb8f85c7700 1 -- 172.21.15.31:0/1536733166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f004c3c0 con 0x7fb8f0152010 2023-10-09T06:21:39.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.522+0000 7fb8ee7fc700 1 -- 172.21.15.31:0/1536733166 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8e8007150 con 0x7fb8f0152010 2023-10-09T06:21:39.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.522+0000 7fb8ee7fc700 1 --2- 172.21.15.31:0/1536733166 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb8dc066f30 0x7fb8dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.522+0000 7fb8ee7fc700 1 -- 172.21.15.31:0/1536733166 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb8e8083e00 con 0x7fb8f0152010 2023-10-09T06:21:39.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.522+0000 7fb8f5b62700 1 --2- 172.21.15.31:0/1536733166 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb8dc066f30 0x7fb8dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.523+0000 7fb8f5b62700 1 --2- 172.21.15.31:0/1536733166 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb8dc066f30 0x7fb8dc0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb8f01577b0 tx=0x7fb8e4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:39.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.526+0000 7fb8ee7fc700 1 -- 172.21.15.31:0/1536733166 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8e8051440 con 0x7fb8f0152010 2023-10-09T06:21:39.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.795+0000 7fb8f85c7700 1 -- 172.21.15.31:0/1536733166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb8f006d1b0 con 0x7fb8f0152010 2023-10-09T06:21:39.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.798+0000 7fb8ee7fc700 1 -- 172.21.15.31:0/1536733166 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb8e8018070 con 0x7fb8f0152010 2023-10-09T06:21:39.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.800+0000 7fb8f85c7700 1 -- 172.21.15.31:0/1536733166 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb8dc066f30 msgr2=0x7fb8dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.800+0000 7fb8f85c7700 1 --2- 172.21.15.31:0/1536733166 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb8dc066f30 0x7fb8dc0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb8f01577b0 tx=0x7fb8e4016000 comp rx=0 tx=0).stop 2023-10-09T06:21:39.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.801+0000 7fb8f85c7700 1 -- 172.21.15.31:0/1536733166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8f0152010 msgr2=0x7fb8f014f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.801+0000 7fb8f85c7700 1 --2- 172.21.15.31:0/1536733166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8f0152010 0x7fb8f014f180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800ccc0 tx=0x7fb8e80016f0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.801+0000 7fb8f85c7700 1 -- 172.21.15.31:0/1536733166 shutdown_connections 2023-10-09T06:21:39.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.801+0000 7fb8f85c7700 1 --2- 172.21.15.31:0/1536733166 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb8dc066f30 0x7fb8dc0693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.801+0000 7fb8f85c7700 1 --2- 172.21.15.31:0/1536733166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8f0158e50 0x7fb8f0156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.801+0000 7fb8f85c7700 1 --2- 172.21.15.31:0/1536733166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8f0152010 0x7fb8f014f180 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.801+0000 7fb8f85c7700 1 --2- 172.21.15.31:0/1536733166 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8f01523e0 0x7fb8f0155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.801+0000 7fb8f85c7700 1 -- 172.21.15.31:0/1536733166 >> 172.21.15.31:0/1536733166 conn(0x7fb8f0069870 msgr2=0x7fb8f0150800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:39.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.801+0000 7fb8f85c7700 1 -- 172.21.15.31:0/1536733166 shutdown_connections 2023-10-09T06:21:39.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.801+0000 7fb8f85c7700 1 -- 172.21.15.31:0/1536733166 wait complete. 2023-10-09T06:21:39.813 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-09T06:21:39.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.933+0000 7fa2013f9700 1 Processor -- start 2023-10-09T06:21:39.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.933+0000 7fa2013f9700 1 -- start start 2023-10-09T06:21:39.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa2013f9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa1fc157870 0x7fa1fc15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa2013f9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1fc15a620 0x7fa1fc15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa2013f9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa1fc15d580 0x7fa1fc158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa2013f9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1fc15cbb0 con 0x7fa1fc157870 2023-10-09T06:21:39.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa2013f9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1fc15bfa0 con 0x7fa1fc15d580 2023-10-09T06:21:39.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa2013f9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc15c280 con 0x7fa1fc15a620 2023-10-09T06:21:39.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa1faffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa1fc157870 0x7fa1fc15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa1faffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa1fc157870 0x7fa1fc15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43918/0 (socket says 172.21.15.31:43918) 2023-10-09T06:21:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa1faffd700 1 -- 172.21.15.31:0/330859328 learned_addr learned my addr 172.21.15.31:0/330859328 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa1fb7fe700 1 --2- 172.21.15.31:0/330859328 >> v2:172.21.15.158:3300/0 conn(0x7fa1fc15d580 0x7fa1fc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa1fa7fc700 1 --2- 172.21.15.31:0/330859328 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1fc15a620 0x7fa1fc15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa1faffd700 1 -- 172.21.15.31:0/330859328 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1fc15a620 msgr2=0x7fa1fc15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa1faffd700 1 --2- 172.21.15.31:0/330859328 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1fc15a620 0x7fa1fc15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa1faffd700 1 -- 172.21.15.31:0/330859328 >> v2:172.21.15.158:3300/0 conn(0x7fa1fc15d580 msgr2=0x7fa1fc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa1faffd700 1 --2- 172.21.15.31:0/330859328 >> v2:172.21.15.158:3300/0 conn(0x7fa1fc15d580 0x7fa1fc158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa1faffd700 1 -- 172.21.15.31:0/330859328 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc15c560 con 0x7fa1fc157870 2023-10-09T06:21:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa1faffd700 1 --2- 172.21.15.31:0/330859328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1fc157870 0x7fa1fc15b6a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0b03b0 tx=0x7fa1f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a936b25c67179f00 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.934+0000 7fa1f9ffb700 1 -- 172.21.15.31:0/330859328 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f400b860 con 0x7fa1fc157870 2023-10-09T06:21:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.935+0000 7fa1f9ffb700 1 -- 172.21.15.31:0/330859328 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f400b9c0 con 0x7fa1fc157870 2023-10-09T06:21:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.935+0000 7fa1f9ffb700 1 -- 172.21.15.31:0/330859328 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f400bd60 con 0x7fa1fc157870 2023-10-09T06:21:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.935+0000 7fa2013f9700 1 -- 172.21.15.31:0/330859328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1fc157870 msgr2=0x7fa1fc15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.935+0000 7fa2013f9700 1 --2- 172.21.15.31:0/330859328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1fc157870 0x7fa1fc15b6a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0b03b0 tx=0x7fa1f4009250 comp rx=0 tx=0).stop 2023-10-09T06:21:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.935+0000 7fa2013f9700 1 -- 172.21.15.31:0/330859328 shutdown_connections 2023-10-09T06:21:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.935+0000 7fa2013f9700 1 --2- 172.21.15.31:0/330859328 >> v2:172.21.15.158:3300/0 conn(0x7fa1fc15d580 0x7fa1fc158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.935+0000 7fa2013f9700 1 --2- 172.21.15.31:0/330859328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1fc157870 0x7fa1fc15b6a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.935+0000 7fa2013f9700 1 --2- 172.21.15.31:0/330859328 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1fc15a620 0x7fa1fc15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.935+0000 7fa2013f9700 1 -- 172.21.15.31:0/330859328 >> 172.21.15.31:0/330859328 conn(0x7fa1fc068ce0 msgr2=0x7fa1fc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.935+0000 7fa2013f9700 1 -- 172.21.15.31:0/330859328 shutdown_connections 2023-10-09T06:21:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.935+0000 7fa2013f9700 1 -- 172.21.15.31:0/330859328 wait complete. 2023-10-09T06:21:39.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.936+0000 7fa2013f9700 1 Processor -- start 2023-10-09T06:21:39.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.936+0000 7fa2013f9700 1 -- start start 2023-10-09T06:21:39.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.937+0000 7fa2013f9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1fc157870 0x7fa1fc144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.937+0000 7fa2013f9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1fc15a620 0x7fa1fc0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.937+0000 7fa2013f9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1fc15d580 0x7fa1fc0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.937+0000 7fa2013f9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc16b9c0 con 0x7fa1fc15d580 2023-10-09T06:21:39.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.937+0000 7fa2013f9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc144fd0 con 0x7fa1fc15a620 2023-10-09T06:21:39.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.937+0000 7fa2013f9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc0aebe0 con 0x7fa1fc157870 2023-10-09T06:21:39.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.937+0000 7fa1fb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1fc15d580 0x7fa1fc0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.937+0000 7fa1fb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1fc15d580 0x7fa1fc0b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43922/0 (socket says 172.21.15.31:43922) 2023-10-09T06:21:39.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.937+0000 7fa1fb7fe700 1 -- 172.21.15.31:0/1863707037 learned_addr learned my addr 172.21.15.31:0/1863707037 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:39.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.937+0000 7fa1fa7fc700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1fc15a620 0x7fa1fc0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.937+0000 7fa1faffd700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1fc157870 0x7fa1fc144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.938+0000 7fa1fb7fe700 1 -- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1fc157870 msgr2=0x7fa1fc144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.938+0000 7fa1fb7fe700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1fc157870 0x7fa1fc144a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.938+0000 7fa1fb7fe700 1 -- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1fc15a620 msgr2=0x7fa1fc0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:39.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.938+0000 7fa1fb7fe700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1fc15a620 0x7fa1fc0b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:39.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.938+0000 7fa1fb7fe700 1 -- 172.21.15.31:0/1863707037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f40094f0 con 0x7fa1fc15d580 2023-10-09T06:21:39.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.938+0000 7fa1faffd700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1fc157870 0x7fa1fc144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:39.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.938+0000 7fa1fb7fe700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1fc15d580 0x7fa1fc0b2ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00cd60 tx=0x7fa1ec0077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:39.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.938+0000 7fa1f2ffd700 1 -- 172.21.15.31:0/1863707037 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec00aac0 con 0x7fa1fc15d580 2023-10-09T06:21:39.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.938+0000 7fa1f2ffd700 1 -- 172.21.15.31:0/1863707037 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec00ac40 con 0x7fa1fc15d580 2023-10-09T06:21:39.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.938+0000 7fa2013f9700 1 -- 172.21.15.31:0/1863707037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1fc0aeec0 con 0x7fa1fc15d580 2023-10-09T06:21:39.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.938+0000 7fa1f2ffd700 1 -- 172.21.15.31:0/1863707037 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec017430 con 0x7fa1fc15d580 2023-10-09T06:21:39.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.938+0000 7fa2013f9700 1 -- 172.21.15.31:0/1863707037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1fc0af480 con 0x7fa1fc15d580 2023-10-09T06:21:39.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.939+0000 7fa2013f9700 1 -- 172.21.15.31:0/1863707037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1fc04c3c0 con 0x7fa1fc15d580 2023-10-09T06:21:39.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.939+0000 7fa1f2ffd700 1 -- 172.21.15.31:0/1863707037 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1ec003020 con 0x7fa1fc15d580 2023-10-09T06:21:39.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.940+0000 7fa1f2ffd700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa1dc066f30 0x7fa1dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:39.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.940+0000 7fa1f2ffd700 1 -- 172.21.15.31:0/1863707037 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa1ec013070 con 0x7fa1fc15d580 2023-10-09T06:21:39.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.940+0000 7fa1faffd700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa1dc066f30 0x7fa1dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:39.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.940+0000 7fa1faffd700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa1dc066f30 0x7fa1dc0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0b03b0 tx=0x7fa1f4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:39.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:39.944+0000 7fa1f2ffd700 1 -- 172.21.15.31:0/1863707037 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1ec051c60 con 0x7fa1fc15d580 2023-10-09T06:21:40.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.215+0000 7fa2013f9700 1 -- 172.21.15.31:0/1863707037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa1fc16bb00 con 0x7fa1fc15d580 2023-10-09T06:21:40.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.219+0000 7fa1f2ffd700 1 -- 172.21.15.31:0/1863707037 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa1ec055280 con 0x7fa1fc15d580 2023-10-09T06:21:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.221+0000 7fa2013f9700 1 -- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa1dc066f30 msgr2=0x7fa1dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.221+0000 7fa2013f9700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa1dc066f30 0x7fa1dc0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0b03b0 tx=0x7fa1f4017000 comp rx=0 tx=0).stop 2023-10-09T06:21:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.221+0000 7fa2013f9700 1 -- 172.21.15.31:0/1863707037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1fc15d580 msgr2=0x7fa1fc0b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.221+0000 7fa2013f9700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1fc15d580 0x7fa1fc0b2ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00cd60 tx=0x7fa1ec0077c0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.221+0000 7fa2013f9700 1 -- 172.21.15.31:0/1863707037 shutdown_connections 2023-10-09T06:21:40.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.221+0000 7fa2013f9700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa1dc066f30 0x7fa1dc0693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.221+0000 7fa2013f9700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1fc157870 0x7fa1fc144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.221+0000 7fa2013f9700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1fc15d580 0x7fa1fc0b2ca0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.221+0000 7fa2013f9700 1 --2- 172.21.15.31:0/1863707037 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1fc15a620 0x7fa1fc0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.221+0000 7fa2013f9700 1 -- 172.21.15.31:0/1863707037 >> 172.21.15.31:0/1863707037 conn(0x7fa1fc068ce0 msgr2=0x7fa1fc1568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:40.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.221+0000 7fa2013f9700 1 -- 172.21.15.31:0/1863707037 shutdown_connections 2023-10-09T06:21:40.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.221+0000 7fa2013f9700 1 -- 172.21.15.31:0/1863707037 wait complete. 2023-10-09T06:21:40.233 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-09T06:21:40.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.352+0000 7f006b5aa700 1 Processor -- start 2023-10-09T06:21:40.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.352+0000 7f006b5aa700 1 -- start start 2023-10-09T06:21:40.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.353+0000 7f006b5aa700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f006406c630 0x7f0064067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.353+0000 7f006b5aa700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0064067ba0 0x7f0064159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.353+0000 7f006b5aa700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00640cb370 con 0x7f00640b0890 2023-10-09T06:21:40.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.353+0000 7f006b5aa700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0064067fe0 con 0x7f006406c630 2023-10-09T06:21:40.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.353+0000 7f006b5aa700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00640b0c60 con 0x7f0064067ba0 2023-10-09T06:21:40.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.353+0000 7f0069346700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f00640b0890 0x7f00640cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40670/0 (socket says 172.21.15.31:40670) 2023-10-09T06:21:40.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.353+0000 7f0069346700 1 -- 172.21.15.31:0/2566172604 learned_addr learned my addr 172.21.15.31:0/2566172604 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:40.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0069b47700 1 --2- 172.21.15.31:0/2566172604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0064067ba0 0x7f0064159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0068b45700 1 --2- 172.21.15.31:0/2566172604 >> v2:172.21.15.158:3300/0 conn(0x7f006406c630 0x7f0064067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456202441 0 0) 0x7f00640cb370 con 0x7f00640b0890 2023-10-09T06:21:40.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f004c003570 con 0x7f00640b0890 2023-10-09T06:21:40.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3899678469 0 0) 0x7f004c003570 con 0x7f00640b0890 2023-10-09T06:21:40.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0064067ba0 msgr2=0x7f0064159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:40.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 --2- 172.21.15.31:0/2566172604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0064067ba0 0x7f0064159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 >> v2:172.21.15.158:3300/0 conn(0x7f006406c630 msgr2=0x7f0064067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:40.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 --2- 172.21.15.31:0/2566172604 >> v2:172.21.15.158:3300/0 conn(0x7f006406c630 0x7f0064067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006406a1e0 con 0x7f00640b0890 2023-10-09T06:21:40.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f005c001470 con 0x7f00640b0890 2023-10-09T06:21:40.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 >> v1:172.21.15.31:6789/0 conn(0x7f00640b0890 legacy=0x7f00640cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 --2- 172.21.15.31:0/2566172604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f004c003a60 0x7f004c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 --2- 172.21.15.31:0/2566172604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0064067ba0 0x7f004c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 --2- 172.21.15.31:0/2566172604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f004c004d50 0x7f004c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0064067fe0 con 0x7f004c004d50 2023-10-09T06:21:40.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00640b0c60 con 0x7f004c003a60 2023-10-09T06:21:40.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c00ba60 con 0x7f0064067ba0 2023-10-09T06:21:40.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0069b47700 1 --2- 172.21.15.31:0/2566172604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f004c004d50 0x7f004c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0069346700 1 --2- 172.21.15.31:0/2566172604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f004c003a60 0x7f004c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0068b45700 1 --2- 172.21.15.31:0/2566172604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0064067ba0 0x7f004c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0069b47700 1 -- 172.21.15.31:0/2566172604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0064067ba0 msgr2=0x7f004c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:40.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0069b47700 1 --2- 172.21.15.31:0/2566172604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0064067ba0 0x7f004c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0069b47700 1 -- 172.21.15.31:0/2566172604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f004c003a60 msgr2=0x7f004c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:40.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0069b47700 1 --2- 172.21.15.31:0/2566172604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f004c003a60 0x7f004c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.354+0000 7f0069b47700 1 -- 172.21.15.31:0/2566172604 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c003570 con 0x7f004c004d50 2023-10-09T06:21:40.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.355+0000 7f0069b47700 1 --2- 172.21.15.31:0/2566172604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f004c004d50 0x7f004c0051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f005400e210 tx=0x7f005400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f420a535462258a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:40.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.355+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005400ea60 con 0x7f004c004d50 2023-10-09T06:21:40.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.355+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005400f040 con 0x7f004c004d50 2023-10-09T06:21:40.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.355+0000 7f0063fff700 1 -- 172.21.15.31:0/2566172604 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005400ee10 con 0x7f004c004d50 2023-10-09T06:21:40.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.355+0000 7f006b5aa700 1 -- 172.21.15.31:0/2566172604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f004c004d50 msgr2=0x7f004c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.355+0000 7f006b5aa700 1 --2- 172.21.15.31:0/2566172604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f004c004d50 0x7f004c0051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f005400e210 tx=0x7f005400b040 comp rx=0 tx=0).stop 2023-10-09T06:21:40.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.355+0000 7f0069b47700 1 -- 172.21.15.31:0/2566172604 reap_dead start 2023-10-09T06:21:40.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.355+0000 7f006b5aa700 1 -- 172.21.15.31:0/2566172604 shutdown_connections 2023-10-09T06:21:40.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.355+0000 7f006b5aa700 1 -- 172.21.15.31:0/2566172604 >> 172.21.15.31:0/2566172604 conn(0x7f006406fe50 msgr2=0x7f0064069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:40.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.355+0000 7f006b5aa700 1 -- 172.21.15.31:0/2566172604 shutdown_connections 2023-10-09T06:21:40.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.355+0000 7f006b5aa700 1 -- 172.21.15.31:0/2566172604 wait complete. 2023-10-09T06:21:40.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.356+0000 7f006b5aa700 1 Processor -- start 2023-10-09T06:21:40.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.356+0000 7f006b5aa700 1 -- start start 2023-10-09T06:21:40.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.357+0000 7f006b5aa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00641599e0 0x7f00640c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.357+0000 7f006b5aa700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00640c4760 0x7f00640cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.357+0000 7f006b5aa700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00640cd750 0x7f00640c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.357+0000 7f006b5aa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00640c37a0 con 0x7f00641599e0 2023-10-09T06:21:40.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.357+0000 7f006b5aa700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006415fc10 con 0x7f00640cd750 2023-10-09T06:21:40.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.357+0000 7f006b5aa700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00640cdbc0 con 0x7f00640c4760 2023-10-09T06:21:40.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.357+0000 7f0069346700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00641599e0 0x7f00640c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.357+0000 7f0069346700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00641599e0 0x7f00640c2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43938/0 (socket says 172.21.15.31:43938) 2023-10-09T06:21:40.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.357+0000 7f0069346700 1 -- 172.21.15.31:0/2352424238 learned_addr learned my addr 172.21.15.31:0/2352424238 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:40.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f0069b47700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00640cd750 0x7f00640c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f0068b45700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00640c4760 0x7f00640cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f0069346700 1 -- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00640c4760 msgr2=0x7f00640cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f0069346700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00640c4760 0x7f00640cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f0069346700 1 -- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00640cd750 msgr2=0x7f00640c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f0069346700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00640cd750 0x7f00640c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f0069346700 1 -- 172.21.15.31:0/2352424238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00640c6600 con 0x7f00641599e0 2023-10-09T06:21:40.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f0069b47700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00640cd750 0x7f00640c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:40.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f0069346700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00641599e0 0x7f00640c2f40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f005c0073c0 tx=0x7f005c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:40.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f00617fa700 1 -- 172.21.15.31:0/2352424238 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c018030 con 0x7f00641599e0 2023-10-09T06:21:40.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f00617fa700 1 -- 172.21.15.31:0/2352424238 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c00f8d0 con 0x7f00641599e0 2023-10-09T06:21:40.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f006b5aa700 1 -- 172.21.15.31:0/2352424238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00640c5cd0 con 0x7f00641599e0 2023-10-09T06:21:40.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f00617fa700 1 -- 172.21.15.31:0/2352424238 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c00fc90 con 0x7f00641599e0 2023-10-09T06:21:40.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.358+0000 7f006b5aa700 1 -- 172.21.15.31:0/2352424238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00640c6290 con 0x7f00641599e0 2023-10-09T06:21:40.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.359+0000 7f006b5aa700 1 -- 172.21.15.31:0/2352424238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006404c3c0 con 0x7f00641599e0 2023-10-09T06:21:40.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.359+0000 7f00617fa700 1 -- 172.21.15.31:0/2352424238 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f005c01b070 con 0x7f00641599e0 2023-10-09T06:21:40.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.360+0000 7f00617fa700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0050066f60 0x7f0050069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.360+0000 7f00617fa700 1 -- 172.21.15.31:0/2352424238 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f005c019070 con 0x7f00641599e0 2023-10-09T06:21:40.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.360+0000 7f0068b45700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0050066f60 0x7f0050069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.360+0000 7f0068b45700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0050066f60 0x7f0050069410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f00640ce040 tx=0x7f0058008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:40.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.364+0000 7f00617fa700 1 -- 172.21.15.31:0/2352424238 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f005c0517f0 con 0x7f00641599e0 2023-10-09T06:21:40.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.635+0000 7f006b5aa700 1 -- 172.21.15.31:0/2352424238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f006406cdc0 con 0x7f00641599e0 2023-10-09T06:21:40.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.639+0000 7f00617fa700 1 -- 172.21.15.31:0/2352424238 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f005c054e10 con 0x7f00641599e0 2023-10-09T06:21:40.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.641+0000 7f006b5aa700 1 -- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0050066f60 msgr2=0x7f0050069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.641+0000 7f006b5aa700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0050066f60 0x7f0050069410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f00640ce040 tx=0x7f0058008040 comp rx=0 tx=0).stop 2023-10-09T06:21:40.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.641+0000 7f006b5aa700 1 -- 172.21.15.31:0/2352424238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00641599e0 msgr2=0x7f00640c2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.641+0000 7f006b5aa700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00641599e0 0x7f00640c2f40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f005c0073c0 tx=0x7f005c001e90 comp rx=0 tx=0).stop 2023-10-09T06:21:40.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.641+0000 7f006b5aa700 1 -- 172.21.15.31:0/2352424238 shutdown_connections 2023-10-09T06:21:40.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.641+0000 7f006b5aa700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0050066f60 0x7f0050069410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.641+0000 7f006b5aa700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00640cd750 0x7f00640c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.641+0000 7f006b5aa700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00641599e0 0x7f00640c2f40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.641+0000 7f006b5aa700 1 --2- 172.21.15.31:0/2352424238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00640c4760 0x7f00640cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.641+0000 7f006b5aa700 1 -- 172.21.15.31:0/2352424238 >> 172.21.15.31:0/2352424238 conn(0x7f006406fe50 msgr2=0x7f006415bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.641+0000 7f006b5aa700 1 -- 172.21.15.31:0/2352424238 shutdown_connections 2023-10-09T06:21:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.641+0000 7f006b5aa700 1 -- 172.21.15.31:0/2352424238 wait complete. 2023-10-09T06:21:40.654 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:40.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.772+0000 7ff85f59e700 1 Processor -- start 2023-10-09T06:21:40.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.772+0000 7ff85f59e700 1 -- start start 2023-10-09T06:21:40.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.773+0000 7ff85f59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff8600cd6e0 0x7ff8600cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.773+0000 7ff85f59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff86015cbd0 0x7ff86015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.773+0000 7ff85f59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8600cb7c0 con 0x7ff8600cdab0 2023-10-09T06:21:40.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.773+0000 7ff85f59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86015e850 con 0x7ff8600cd6e0 2023-10-09T06:21:40.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.773+0000 7ff85f59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600cd030 con 0x7ff86015cbd0 2023-10-09T06:21:40.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.773+0000 7ff85e59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff8600cd6e0 0x7ff8600cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.773+0000 7ff85dd9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff8600cdab0 0x7ff86015d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40672/0 (socket says 172.21.15.31:40672) 2023-10-09T06:21:40.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.773+0000 7ff85dd9b700 1 -- 172.21.15.31:0/3083174652 learned_addr learned my addr 172.21.15.31:0/3083174652 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:40.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.773+0000 7ff85ed9d700 1 --2- 172.21.15.31:0/3083174652 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff86015cbd0 0x7ff86015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.773+0000 7ff85e59c700 1 -- 172.21.15.31:0/3083174652 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff86015cbd0 msgr2=0x7ff86015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:40.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.773+0000 7ff85e59c700 1 --2- 172.21.15.31:0/3083174652 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff86015cbd0 0x7ff86015d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.773+0000 7ff85e59c700 1 -- 172.21.15.31:0/3083174652 >> v1:172.21.15.31:6789/0 conn(0x7ff8600cdab0 legacy=0x7ff86015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.774+0000 7ff85e59c700 1 -- 172.21.15.31:0/3083174652 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86015e290 con 0x7ff8600cd6e0 2023-10-09T06:21:40.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.774+0000 7ff85d59a700 1 -- 172.21.15.31:0/3083174652 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481950002 0 0) 0x7ff8600cb7c0 con 0x7ff8600cdab0 2023-10-09T06:21:40.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.774+0000 7ff85e59c700 1 --2- 172.21.15.31:0/3083174652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8600cd6e0 0x7ff8600cbc50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff8580098e0 tx=0x7ff8580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4356d776ecae3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:40.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.774+0000 7ff85d59a700 1 -- 172.21.15.31:0/3083174652 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85800b640 con 0x7ff8600cd6e0 2023-10-09T06:21:40.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.774+0000 7ff85d59a700 1 -- 172.21.15.31:0/3083174652 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85800b7a0 con 0x7ff8600cd6e0 2023-10-09T06:21:40.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.774+0000 7ff85d59a700 1 -- 172.21.15.31:0/3083174652 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85800bb40 con 0x7ff8600cd6e0 2023-10-09T06:21:40.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.774+0000 7ff85f59e700 1 -- 172.21.15.31:0/3083174652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8600cd6e0 msgr2=0x7ff8600cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.774+0000 7ff85f59e700 1 --2- 172.21.15.31:0/3083174652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8600cd6e0 0x7ff8600cbc50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff8580098e0 tx=0x7ff8580091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.774+0000 7ff85f59e700 1 -- 172.21.15.31:0/3083174652 shutdown_connections 2023-10-09T06:21:40.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.774+0000 7ff85f59e700 1 --2- 172.21.15.31:0/3083174652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8600cd6e0 0x7ff8600cbc50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.774+0000 7ff85f59e700 1 --2- 172.21.15.31:0/3083174652 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff86015cbd0 0x7ff86015d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.774+0000 7ff85f59e700 1 -- 172.21.15.31:0/3083174652 >> 172.21.15.31:0/3083174652 conn(0x7ff860067660 msgr2=0x7ff860067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:40.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.774+0000 7ff85f59e700 1 -- 172.21.15.31:0/3083174652 shutdown_connections 2023-10-09T06:21:40.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.775+0000 7ff85f59e700 1 -- 172.21.15.31:0/3083174652 wait complete. 2023-10-09T06:21:40.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.776+0000 7ff85f59e700 1 Processor -- start 2023-10-09T06:21:40.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.776+0000 7ff85f59e700 1 -- start start 2023-10-09T06:21:40.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.776+0000 7ff85f59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff8600cd6e0 0x7ff8600afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.776+0000 7ff85f59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8600cdab0 0x7ff860158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.776+0000 7ff85f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff86015cbd0 0x7ff860155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.776+0000 7ff85f59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600c86f0 con 0x7ff86015cbd0 2023-10-09T06:21:40.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.776+0000 7ff85f59e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600b03e0 con 0x7ff8600cdab0 2023-10-09T06:21:40.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.776+0000 7ff85f59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff860158cd0 con 0x7ff8600cd6e0 2023-10-09T06:21:40.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.776+0000 7ff85ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff86015cbd0 0x7ff860155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.776+0000 7ff85ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff86015cbd0 0x7ff860155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43962/0 (socket says 172.21.15.31:43962) 2023-10-09T06:21:40.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.776+0000 7ff85ed9d700 1 -- 172.21.15.31:0/2091519403 learned_addr learned my addr 172.21.15.31:0/2091519403 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:40.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff85e59c700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff8600cd6e0 0x7ff8600afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff85dd9b700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8600cdab0 0x7ff860158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff85ed9d700 1 -- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff8600cd6e0 msgr2=0x7ff8600afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff85ed9d700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff8600cd6e0 0x7ff8600afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff85ed9d700 1 -- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8600cdab0 msgr2=0x7ff860158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff85ed9d700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8600cdab0 0x7ff860158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff85ed9d700 1 -- 172.21.15.31:0/2091519403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff858009420 con 0x7ff86015cbd0 2023-10-09T06:21:40.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff85e59c700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff8600cd6e0 0x7ff8600afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:40.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff85ed9d700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff86015cbd0 0x7ff860155c10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff850009e90 tx=0x7ff85000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:40.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff8567fc700 1 -- 172.21.15.31:0/2091519403 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85000cc20 con 0x7ff86015cbd0 2023-10-09T06:21:40.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff8567fc700 1 -- 172.21.15.31:0/2091519403 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85000f040 con 0x7ff86015cbd0 2023-10-09T06:21:40.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff85f59e700 1 -- 172.21.15.31:0/2091519403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8600c7dc0 con 0x7ff86015cbd0 2023-10-09T06:21:40.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff8567fc700 1 -- 172.21.15.31:0/2091519403 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff850014480 con 0x7ff86015cbd0 2023-10-09T06:21:40.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.777+0000 7ff85f59e700 1 -- 172.21.15.31:0/2091519403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8600c8380 con 0x7ff86015cbd0 2023-10-09T06:21:40.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.778+0000 7ff85f59e700 1 -- 172.21.15.31:0/2091519403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86015c3b0 con 0x7ff86015cbd0 2023-10-09T06:21:40.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.778+0000 7ff8567fc700 1 -- 172.21.15.31:0/2091519403 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff850014830 con 0x7ff86015cbd0 2023-10-09T06:21:40.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.779+0000 7ff8567fc700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff840066f30 0x7ff8400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:40.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.779+0000 7ff8567fc700 1 -- 172.21.15.31:0/2091519403 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff850084ee0 con 0x7ff86015cbd0 2023-10-09T06:21:40.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.779+0000 7ff85e59c700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff840066f30 0x7ff8400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:40.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.780+0000 7ff85e59c700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff840066f30 0x7ff8400693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff8580091e0 tx=0x7ff858017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:40.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.783+0000 7ff8567fc700 1 -- 172.21.15.31:0/2091519403 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff850055f30 con 0x7ff86015cbd0 2023-10-09T06:21:40.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.978+0000 7ff85f59e700 1 -- 172.21.15.31:0/2091519403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8600c8830 con 0x7ff86015cbd0 2023-10-09T06:21:40.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.979+0000 7ff8567fc700 1 -- 172.21.15.31:0/2091519403 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12134 (secure 0 0 0) 0x7ff850055ac0 con 0x7ff86015cbd0 2023-10-09T06:21:40.980 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:40.980 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":28,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:21:37.674859+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:40.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.981+0000 7ff85f59e700 1 -- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff840066f30 msgr2=0x7ff8400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.981+0000 7ff85f59e700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff840066f30 0x7ff8400693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff8580091e0 tx=0x7ff858017000 comp rx=0 tx=0).stop 2023-10-09T06:21:40.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.981+0000 7ff85f59e700 1 -- 172.21.15.31:0/2091519403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff86015cbd0 msgr2=0x7ff860155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:40.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.981+0000 7ff85f59e700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff86015cbd0 0x7ff860155c10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff850009e90 tx=0x7ff85000b040 comp rx=0 tx=0).stop 2023-10-09T06:21:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.981+0000 7ff85f59e700 1 -- 172.21.15.31:0/2091519403 shutdown_connections 2023-10-09T06:21:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.981+0000 7ff85f59e700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff840066f30 0x7ff8400693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.981+0000 7ff85f59e700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff8600cd6e0 0x7ff8600afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.981+0000 7ff85f59e700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff86015cbd0 0x7ff860155c10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.981+0000 7ff85f59e700 1 --2- 172.21.15.31:0/2091519403 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8600cdab0 0x7ff860158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.981+0000 7ff85f59e700 1 -- 172.21.15.31:0/2091519403 >> 172.21.15.31:0/2091519403 conn(0x7ff860067660 msgr2=0x7ff860157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.981+0000 7ff85f59e700 1 -- 172.21.15.31:0/2091519403 shutdown_connections 2023-10-09T06:21:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:40.981+0000 7ff85f59e700 1 -- 172.21.15.31:0/2091519403 wait complete. 2023-10-09T06:21:40.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:21:40.994 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:21:41.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.114+0000 7f3c4c507700 1 Processor -- start 2023-10-09T06:21:41.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.114+0000 7f3c4c507700 1 -- start start 2023-10-09T06:21:41.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.115+0000 7f3c4c507700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c440d05a0 0x7f3c44164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.115+0000 7f3c4c507700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c440b0790 con 0x7f3c44159ec0 2023-10-09T06:21:41.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.115+0000 7f3c4c507700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c440ce1f0 con 0x7f3c4415a290 2023-10-09T06:21:41.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.115+0000 7f3c4c507700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440b0b20 con 0x7f3c440d05a0 2023-10-09T06:21:41.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.115+0000 7f3c4a2a3700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3c44159ec0 0x7f3c440af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40684/0 (socket says 172.21.15.31:40684) 2023-10-09T06:21:41.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.115+0000 7f3c4a2a3700 1 -- 172.21.15.31:0/740722329 learned_addr learned my addr 172.21.15.31:0/740722329 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:41.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.116+0000 7f3c4aaa4700 1 --2- 172.21.15.31:0/740722329 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c440d05a0 0x7f3c44164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.116+0000 7f3c492a1700 1 -- 172.21.15.31:0/740722329 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821466038 0 0) 0x7f3c440b0790 con 0x7f3c44159ec0 2023-10-09T06:21:41.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.116+0000 7f3c492a1700 1 -- 172.21.15.31:0/740722329 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c2c003570 con 0x7f3c44159ec0 2023-10-09T06:21:41.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.116+0000 7f3c492a1700 1 -- 172.21.15.31:0/740722329 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557880677 0 0) 0x7f3c440ce1f0 con 0x7f3c4415a290 2023-10-09T06:21:41.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.116+0000 7f3c492a1700 1 -- 172.21.15.31:0/740722329 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c440b0790 con 0x7f3c4415a290 2023-10-09T06:21:41.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.116+0000 7f3c492a1700 1 -- 172.21.15.31:0/740722329 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3174483456 0 0) 0x7f3c2c003570 con 0x7f3c44159ec0 2023-10-09T06:21:41.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.116+0000 7f3c4aaa4700 1 -- 172.21.15.31:0/740722329 >> v1:172.21.15.158:6789/0 conn(0x7f3c4415a290 legacy=0x7f3c4406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.116+0000 7f3c4aaa4700 1 -- 172.21.15.31:0/740722329 >> v1:172.21.15.31:6789/0 conn(0x7f3c44159ec0 legacy=0x7f3c440af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.116+0000 7f3c4aaa4700 1 -- 172.21.15.31:0/740722329 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c440b04b0 con 0x7f3c440d05a0 2023-10-09T06:21:41.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.116+0000 7f3c4aaa4700 1 --2- 172.21.15.31:0/740722329 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c440d05a0 0x7f3c44164ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009e90 tx=0x7f3c3c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fac07251f624d50c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:41.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.116+0000 7f3c492a1700 1 -- 172.21.15.31:0/740722329 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00e070 con 0x7f3c440d05a0 2023-10-09T06:21:41.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.116+0000 7f3c492a1700 1 -- 172.21.15.31:0/740722329 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c00b870 con 0x7f3c440d05a0 2023-10-09T06:21:41.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.116+0000 7f3c492a1700 1 -- 172.21.15.31:0/740722329 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34001470 con 0x7f3c440d05a0 2023-10-09T06:21:41.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.117+0000 7f3c4c507700 1 -- 172.21.15.31:0/740722329 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c440d05a0 msgr2=0x7f3c44164ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.117+0000 7f3c4c507700 1 --2- 172.21.15.31:0/740722329 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c440d05a0 0x7f3c44164ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009e90 tx=0x7f3c3c009780 comp rx=0 tx=0).stop 2023-10-09T06:21:41.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.117+0000 7f3c4c507700 1 -- 172.21.15.31:0/740722329 shutdown_connections 2023-10-09T06:21:41.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.117+0000 7f3c4c507700 1 --2- 172.21.15.31:0/740722329 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c440d05a0 0x7f3c44164ed0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.117+0000 7f3c4c507700 1 -- 172.21.15.31:0/740722329 >> 172.21.15.31:0/740722329 conn(0x7f3c440d1880 msgr2=0x7f3c440cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:41.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.117+0000 7f3c4c507700 1 -- 172.21.15.31:0/740722329 shutdown_connections 2023-10-09T06:21:41.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.117+0000 7f3c4c507700 1 -- 172.21.15.31:0/740722329 wait complete. 2023-10-09T06:21:41.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.118+0000 7f3c4c507700 1 Processor -- start 2023-10-09T06:21:41.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.118+0000 7f3c4c507700 1 -- start start 2023-10-09T06:21:41.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4c507700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c440d05a0 0x7f3c4415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4c507700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c44159ec0 0x7f3c440b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4c507700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c4415a290 0x7f3c44155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4c507700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4415d6d0 con 0x7f3c440d05a0 2023-10-09T06:21:41.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4c507700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440b5010 con 0x7f3c4415a290 2023-10-09T06:21:41.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4c507700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440b46e0 con 0x7f3c44159ec0 2023-10-09T06:21:41.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4a2a3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c440d05a0 0x7f3c4415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4a2a3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c440d05a0 0x7f3c4415dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43964/0 (socket says 172.21.15.31:43964) 2023-10-09T06:21:41.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4a2a3700 1 -- 172.21.15.31:0/2803529347 learned_addr learned my addr 172.21.15.31:0/2803529347 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:41.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c49aa2700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c44159ec0 0x7f3c440b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4a2a3700 1 -- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c44159ec0 msgr2=0x7f3c440b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4a2a3700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c44159ec0 0x7f3c440b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4a2a3700 1 -- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c4415a290 msgr2=0x7f3c44155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4a2a3700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c4415a290 0x7f3c44155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c4a2a3700 1 -- 172.21.15.31:0/2803529347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c009a20 con 0x7f3c440d05a0 2023-10-09T06:21:41.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.119+0000 7f3c49aa2700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c44159ec0 0x7f3c440b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:41.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.120+0000 7f3c4a2a3700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c440d05a0 0x7f3c4415dd70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400cb90 tx=0x7f3c34001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:41.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.120+0000 7f3c427fc700 1 -- 172.21.15.31:0/2803529347 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34007360 con 0x7f3c440d05a0 2023-10-09T06:21:41.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.120+0000 7f3c427fc700 1 -- 172.21.15.31:0/2803529347 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c340074e0 con 0x7f3c440d05a0 2023-10-09T06:21:41.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.120+0000 7f3c4c507700 1 -- 172.21.15.31:0/2803529347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c440b49c0 con 0x7f3c440d05a0 2023-10-09T06:21:41.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.120+0000 7f3c427fc700 1 -- 172.21.15.31:0/2803529347 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34004830 con 0x7f3c440d05a0 2023-10-09T06:21:41.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.120+0000 7f3c4c507700 1 -- 172.21.15.31:0/2803529347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4415e2b0 con 0x7f3c440d05a0 2023-10-09T06:21:41.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.121+0000 7f3c4c507700 1 -- 172.21.15.31:0/2803529347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4415e500 con 0x7f3c440d05a0 2023-10-09T06:21:41.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.121+0000 7f3c427fc700 1 -- 172.21.15.31:0/2803529347 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c34004ba0 con 0x7f3c440d05a0 2023-10-09T06:21:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.121+0000 7f3c427fc700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c30066f30 0x7f3c300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.122+0000 7f3c427fc700 1 -- 172.21.15.31:0/2803529347 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3c340839d0 con 0x7f3c440d05a0 2023-10-09T06:21:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.122+0000 7f3c49aa2700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c30066f30 0x7f3c300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.122+0000 7f3c49aa2700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c30066f30 0x7f3c300693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c38007fd0 tx=0x7f3c38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:41.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.126+0000 7f3c427fc700 1 -- 172.21.15.31:0/2803529347 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c34051010 con 0x7f3c440d05a0 2023-10-09T06:21:41.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.324+0000 7f3c4c507700 1 -- 172.21.15.31:0/2803529347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c4404c3c0 con 0x7f3c440d05a0 2023-10-09T06:21:41.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.324+0000 7f3c427fc700 1 -- 172.21.15.31:0/2803529347 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c340180a0 con 0x7f3c440d05a0 2023-10-09T06:21:41.325 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:21:41.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.326+0000 7f3c4c507700 1 -- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c30066f30 msgr2=0x7f3c300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.326+0000 7f3c4c507700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c30066f30 0x7f3c300693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c38007fd0 tx=0x7f3c38009040 comp rx=0 tx=0).stop 2023-10-09T06:21:41.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.326+0000 7f3c4c507700 1 -- 172.21.15.31:0/2803529347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c440d05a0 msgr2=0x7f3c4415dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.326+0000 7f3c4c507700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c440d05a0 0x7f3c4415dd70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400cb90 tx=0x7f3c34001b50 comp rx=0 tx=0).stop 2023-10-09T06:21:41.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.326+0000 7f3c4c507700 1 -- 172.21.15.31:0/2803529347 shutdown_connections 2023-10-09T06:21:41.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.326+0000 7f3c4c507700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c30066f30 0x7f3c300693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.326+0000 7f3c4c507700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c4415a290 0x7f3c44155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.326+0000 7f3c4c507700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c440d05a0 0x7f3c4415dd70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.326+0000 7f3c4c507700 1 --2- 172.21.15.31:0/2803529347 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c44159ec0 0x7f3c440b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.326+0000 7f3c4c507700 1 -- 172.21.15.31:0/2803529347 >> 172.21.15.31:0/2803529347 conn(0x7f3c440d1880 msgr2=0x7f3c440c74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:41.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.326+0000 7f3c4c507700 1 -- 172.21.15.31:0/2803529347 shutdown_connections 2023-10-09T06:21:41.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.326+0000 7f3c4c507700 1 -- 172.21.15.31:0/2803529347 wait complete. 2023-10-09T06:21:41.339 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:21:41.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.456+0000 7f6aeb59e700 1 Processor -- start 2023-10-09T06:21:41.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.456+0000 7f6aeb59e700 1 -- start start 2023-10-09T06:21:41.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6aeb59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6aec143520 0x7f6aec0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6aeb59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6aec1438f0 0x7f6aec06a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6aeb59e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec0d0870 con 0x7f6aec0ccf00 2023-10-09T06:21:41.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6aeb59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec0cdfb0 con 0x7f6aec143520 2023-10-09T06:21:41.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6aeb59e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec0cfc60 con 0x7f6aec1438f0 2023-10-09T06:21:41.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6aea59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6aec143520 0x7f6aec0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6aea59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6aec143520 0x7f6aec0cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43966/0 (socket says 172.21.15.31:43966) 2023-10-09T06:21:41.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6aea59c700 1 -- 172.21.15.31:0/571255041 learned_addr learned my addr 172.21.15.31:0/571255041 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:41.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6ae9d9b700 1 --2- 172.21.15.31:0/571255041 >> v2:172.21.15.158:3300/0 conn(0x7f6aec1438f0 0x7f6aec06a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6aea59c700 1 -- 172.21.15.31:0/571255041 >> v2:172.21.15.158:3300/0 conn(0x7f6aec1438f0 msgr2=0x7f6aec06a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:41.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6aea59c700 1 --2- 172.21.15.31:0/571255041 >> v2:172.21.15.158:3300/0 conn(0x7f6aec1438f0 0x7f6aec06a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6aea59c700 1 -- 172.21.15.31:0/571255041 >> v1:172.21.15.158:6789/0 conn(0x7f6aec0ccf00 legacy=0x7f6aec15da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:41.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6aea59c700 1 -- 172.21.15.31:0/571255041 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec0cff40 con 0x7f6aec143520 2023-10-09T06:21:41.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.457+0000 7f6ae9d9b700 1 --2- 172.21.15.31:0/571255041 >> v2:172.21.15.158:3300/0 conn(0x7f6aec1438f0 0x7f6aec06a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:41.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.458+0000 7f6aea59c700 1 --2- 172.21.15.31:0/571255041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec143520 0x7f6aec0cf580 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6aec15d9c0 tx=0x7f6ae4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce80b76e8f15f5c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:41.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.458+0000 7f6ae959a700 1 -- 172.21.15.31:0/571255041 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae400e070 con 0x7f6aec143520 2023-10-09T06:21:41.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.458+0000 7f6ae959a700 1 -- 172.21.15.31:0/571255041 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae400ba10 con 0x7f6aec143520 2023-10-09T06:21:41.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.458+0000 7f6ae959a700 1 -- 172.21.15.31:0/571255041 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40092e0 con 0x7f6aec143520 2023-10-09T06:21:41.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.458+0000 7f6aeb59e700 1 -- 172.21.15.31:0/571255041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec143520 msgr2=0x7f6aec0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.458+0000 7f6aeb59e700 1 --2- 172.21.15.31:0/571255041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec143520 0x7f6aec0cf580 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6aec15d9c0 tx=0x7f6ae4009840 comp rx=0 tx=0).stop 2023-10-09T06:21:41.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.458+0000 7f6aeb59e700 1 -- 172.21.15.31:0/571255041 shutdown_connections 2023-10-09T06:21:41.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.458+0000 7f6aeb59e700 1 --2- 172.21.15.31:0/571255041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec143520 0x7f6aec0cf580 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.458+0000 7f6aeb59e700 1 --2- 172.21.15.31:0/571255041 >> v2:172.21.15.158:3300/0 conn(0x7f6aec1438f0 0x7f6aec06a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.458+0000 7f6aeb59e700 1 -- 172.21.15.31:0/571255041 >> 172.21.15.31:0/571255041 conn(0x7f6aec069750 msgr2=0x7f6aec0b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:41.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.458+0000 7f6aeb59e700 1 -- 172.21.15.31:0/571255041 shutdown_connections 2023-10-09T06:21:41.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.458+0000 7f6aeb59e700 1 -- 172.21.15.31:0/571255041 wait complete. 2023-10-09T06:21:41.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.459+0000 7f6aeb59e700 1 Processor -- start 2023-10-09T06:21:41.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.460+0000 7f6aeb59e700 1 -- start start 2023-10-09T06:21:41.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.460+0000 7f6aeb59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6aec0ccf00 0x7f6aec158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.460+0000 7f6aeb59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec143520 0x7f6aec15c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.460+0000 7f6aeb59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aec1438f0 0x7f6aec06a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.460+0000 7f6aeb59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec13e540 con 0x7f6aec143520 2023-10-09T06:21:41.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.460+0000 7f6aeb59e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec13d780 con 0x7f6aec1438f0 2023-10-09T06:21:41.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.460+0000 7f6aeb59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec13da60 con 0x7f6aec0ccf00 2023-10-09T06:21:41.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.460+0000 7f6ae9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec143520 0x7f6aec15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.460+0000 7f6ae9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec143520 0x7f6aec15c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43972/0 (socket says 172.21.15.31:43972) 2023-10-09T06:21:41.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.460+0000 7f6ae9d9b700 1 -- 172.21.15.31:0/2144656217 learned_addr learned my addr 172.21.15.31:0/2144656217 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:41.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.461+0000 7f6aea59c700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6aec0ccf00 0x7f6aec158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.461+0000 7f6aead9d700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aec1438f0 0x7f6aec06a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.461+0000 7f6ae9d9b700 1 -- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6aec0ccf00 msgr2=0x7f6aec158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.461+0000 7f6ae9d9b700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6aec0ccf00 0x7f6aec158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.461+0000 7f6ae9d9b700 1 -- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aec1438f0 msgr2=0x7f6aec06a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.461+0000 7f6ae9d9b700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aec1438f0 0x7f6aec06a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.461+0000 7f6ae9d9b700 1 -- 172.21.15.31:0/2144656217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4009ae0 con 0x7f6aec143520 2023-10-09T06:21:41.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.461+0000 7f6ae9d9b700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec143520 0x7f6aec15c840 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000c850 tx=0x7f6ae0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:41.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.461+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2144656217 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0011600 con 0x7f6aec143520 2023-10-09T06:21:41.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.461+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2144656217 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae0011760 con 0x7f6aec143520 2023-10-09T06:21:41.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.461+0000 7f6aeb59e700 1 -- 172.21.15.31:0/2144656217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec13dd40 con 0x7f6aec143520 2023-10-09T06:21:41.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.461+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2144656217 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0011b00 con 0x7f6aec143520 2023-10-09T06:21:41.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.461+0000 7f6aeb59e700 1 -- 172.21.15.31:0/2144656217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec13d470 con 0x7f6aec143520 2023-10-09T06:21:41.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.462+0000 7f6aeb59e700 1 -- 172.21.15.31:0/2144656217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aec089030 con 0x7f6aec143520 2023-10-09T06:21:41.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.462+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2144656217 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ae0018350 con 0x7f6aec143520 2023-10-09T06:21:41.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.463+0000 7f6ada7fc700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6acc066f30 0x7f6acc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.463+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2144656217 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6ae0084080 con 0x7f6aec143520 2023-10-09T06:21:41.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.463+0000 7f6aea59c700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6acc066f30 0x7f6acc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.464+0000 7f6aea59c700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6acc066f30 0x7f6acc0693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009880 tx=0x7f6ae4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:41.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.467+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2144656217 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ae00550d0 con 0x7f6aec143520 2023-10-09T06:21:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.662+0000 7f6aeb59e700 1 -- 172.21.15.31:0/2144656217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6aec0d0220 con 0x7f6aec143520 2023-10-09T06:21:41.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.662+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2144656217 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6ae0054c60 con 0x7f6aec143520 2023-10-09T06:21:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:41.663 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-10-09T06:21:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-10-09T06:21:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-10-09T06:21:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:41.663 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-10-09T06:21:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.664+0000 7f6aeb59e700 1 -- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6acc066f30 msgr2=0x7f6acc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.664+0000 7f6aeb59e700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6acc066f30 0x7f6acc0693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009880 tx=0x7f6ae4017000 comp rx=0 tx=0).stop 2023-10-09T06:21:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.664+0000 7f6aeb59e700 1 -- 172.21.15.31:0/2144656217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec143520 msgr2=0x7f6aec15c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.664+0000 7f6aeb59e700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec143520 0x7f6aec15c840 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000c850 tx=0x7f6ae0008040 comp rx=0 tx=0).stop 2023-10-09T06:21:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.664+0000 7f6aeb59e700 1 -- 172.21.15.31:0/2144656217 shutdown_connections 2023-10-09T06:21:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.664+0000 7f6aeb59e700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6acc066f30 0x7f6acc0693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.664+0000 7f6aeb59e700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6aec0ccf00 0x7f6aec158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.664+0000 7f6aeb59e700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aec1438f0 0x7f6aec06a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.664+0000 7f6aeb59e700 1 --2- 172.21.15.31:0/2144656217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec143520 0x7f6aec15c840 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.664+0000 7f6aeb59e700 1 -- 172.21.15.31:0/2144656217 >> 172.21.15.31:0/2144656217 conn(0x7f6aec069750 msgr2=0x7f6aec0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:41.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.664+0000 7f6aeb59e700 1 -- 172.21.15.31:0/2144656217 shutdown_connections 2023-10-09T06:21:41.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.664+0000 7f6aeb59e700 1 -- 172.21.15.31:0/2144656217 wait complete. 2023-10-09T06:21:41.677 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:21:41.677 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:21:41.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.799+0000 7f0d887d6700 1 Processor -- start 2023-10-09T06:21:41.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.799+0000 7f0d887d6700 1 -- start start 2023-10-09T06:21:41.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.800+0000 7f0d887d6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d80159de0 0x7f0d800b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.800+0000 7f0d887d6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d8015a1b0 0x7f0d800b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.800+0000 7f0d887d6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8015eb10 con 0x7f0d800b32a0 2023-10-09T06:21:41.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.800+0000 7f0d887d6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d800b3790 con 0x7f0d80159de0 2023-10-09T06:21:41.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.800+0000 7f0d887d6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8015e680 con 0x7f0d8015a1b0 2023-10-09T06:21:41.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.800+0000 7f0d86572700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d80159de0 0x7f0d800b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.800+0000 7f0d86572700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d80159de0 0x7f0d800b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43988/0 (socket says 172.21.15.31:43988) 2023-10-09T06:21:41.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.800+0000 7f0d86572700 1 -- 172.21.15.31:0/538602105 learned_addr learned my addr 172.21.15.31:0/538602105 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:41.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.801+0000 7f0d85d71700 1 --2- 172.21.15.31:0/538602105 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d8015a1b0 0x7f0d800b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.801+0000 7f0d86572700 1 -- 172.21.15.31:0/538602105 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d8015a1b0 msgr2=0x7f0d800b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:41.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.801+0000 7f0d86572700 1 --2- 172.21.15.31:0/538602105 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d8015a1b0 0x7f0d800b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.801+0000 7f0d86572700 1 -- 172.21.15.31:0/538602105 >> v1:172.21.15.158:6789/0 conn(0x7f0d800b32a0 legacy=0x7f0d8006a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.801+0000 7f0d86572700 1 -- 172.21.15.31:0/538602105 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8015dd50 con 0x7f0d80159de0 2023-10-09T06:21:41.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.801+0000 7f0d86572700 1 --2- 172.21.15.31:0/538602105 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d80159de0 0x7f0d800b14e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009f20 tx=0x7f0d78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288fca50ce1859ac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:41.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.801+0000 7f0d85570700 1 -- 172.21.15.31:0/538602105 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7800e070 con 0x7f0d80159de0 2023-10-09T06:21:41.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.801+0000 7f0d85570700 1 -- 172.21.15.31:0/538602105 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7800ba80 con 0x7f0d80159de0 2023-10-09T06:21:41.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.801+0000 7f0d85570700 1 -- 172.21.15.31:0/538602105 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d780092e0 con 0x7f0d80159de0 2023-10-09T06:21:41.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.801+0000 7f0d887d6700 1 -- 172.21.15.31:0/538602105 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d80159de0 msgr2=0x7f0d800b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.801+0000 7f0d887d6700 1 --2- 172.21.15.31:0/538602105 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d80159de0 0x7f0d800b14e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009f20 tx=0x7f0d78009840 comp rx=0 tx=0).stop 2023-10-09T06:21:41.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.802+0000 7f0d887d6700 1 -- 172.21.15.31:0/538602105 shutdown_connections 2023-10-09T06:21:41.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.802+0000 7f0d887d6700 1 --2- 172.21.15.31:0/538602105 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d80159de0 0x7f0d800b14e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.802+0000 7f0d887d6700 1 --2- 172.21.15.31:0/538602105 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d8015a1b0 0x7f0d800b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.802+0000 7f0d887d6700 1 -- 172.21.15.31:0/538602105 >> 172.21.15.31:0/538602105 conn(0x7f0d80068d60 msgr2=0x7f0d80069160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:41.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.802+0000 7f0d887d6700 1 -- 172.21.15.31:0/538602105 shutdown_connections 2023-10-09T06:21:41.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.802+0000 7f0d887d6700 1 -- 172.21.15.31:0/538602105 wait complete. 2023-10-09T06:21:41.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.803+0000 7f0d887d6700 1 Processor -- start 2023-10-09T06:21:41.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.803+0000 7f0d887d6700 1 -- start start 2023-10-09T06:21:41.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.803+0000 7f0d887d6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d800b32a0 0x7f0d801555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.803+0000 7f0d887d6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d80159de0 0x7f0d8015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.803+0000 7f0d887d6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d8015a1b0 0x7f0d800b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.803+0000 7f0d887d6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800c4f40 con 0x7f0d800b32a0 2023-10-09T06:21:41.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.803+0000 7f0d887d6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800c8370 con 0x7f0d8015a1b0 2023-10-09T06:21:41.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.803+0000 7f0d887d6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800c4930 con 0x7f0d80159de0 2023-10-09T06:21:41.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d86572700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d800b32a0 0x7f0d801555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d86572700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d800b32a0 0x7f0d801555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44002/0 (socket says 172.21.15.31:44002) 2023-10-09T06:21:41.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d86572700 1 -- 172.21.15.31:0/3231906222 learned_addr learned my addr 172.21.15.31:0/3231906222 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:41.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d85d71700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d80159de0 0x7f0d8015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d86572700 1 -- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d80159de0 msgr2=0x7f0d8015a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d86d73700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d8015a1b0 0x7f0d800b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d86572700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d80159de0 0x7f0d8015a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d86572700 1 -- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d8015a1b0 msgr2=0x7f0d800b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:41.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d86572700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d8015a1b0 0x7f0d800b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:41.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d86572700 1 -- 172.21.15.31:0/3231906222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d78009ae0 con 0x7f0d800b32a0 2023-10-09T06:21:41.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d86d73700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d8015a1b0 0x7f0d800b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:41.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d86572700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d800b32a0 0x7f0d801555b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800b6c0 tx=0x7f0d78018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:41.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d7e7fc700 1 -- 172.21.15.31:0/3231906222 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78008bb0 con 0x7f0d800b32a0 2023-10-09T06:21:41.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d7e7fc700 1 -- 172.21.15.31:0/3231906222 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d78008d10 con 0x7f0d800b32a0 2023-10-09T06:21:41.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d887d6700 1 -- 172.21.15.31:0/3231906222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d800c7db0 con 0x7f0d800b32a0 2023-10-09T06:21:41.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d7e7fc700 1 -- 172.21.15.31:0/3231906222 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d780266b0 con 0x7f0d800b32a0 2023-10-09T06:21:41.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.804+0000 7f0d887d6700 1 -- 172.21.15.31:0/3231906222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d800c4bd0 con 0x7f0d800b32a0 2023-10-09T06:21:41.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.805+0000 7f0d887d6700 1 -- 172.21.15.31:0/3231906222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8004c3c0 con 0x7f0d800b32a0 2023-10-09T06:21:41.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.806+0000 7f0d7e7fc700 1 -- 172.21.15.31:0/3231906222 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d78003040 con 0x7f0d800b32a0 2023-10-09T06:21:41.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.806+0000 7f0d7e7fc700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d6c066f30 0x7f0d6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:41.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.806+0000 7f0d7e7fc700 1 -- 172.21.15.31:0/3231906222 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0d780860d0 con 0x7f0d800b32a0 2023-10-09T06:21:41.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.806+0000 7f0d85d71700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d6c066f30 0x7f0d6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:41.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.807+0000 7f0d85d71700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d6c066f30 0x7f0d6c0693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0d800b5fd0 tx=0x7f0d74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:41.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:41.810+0000 7f0d7e7fc700 1 -- 172.21.15.31:0/3231906222 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d78053690 con 0x7f0d800b32a0 2023-10-09T06:21:42.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.004+0000 7f0d887d6700 1 -- 172.21.15.31:0/3231906222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0d800cb0c0 con 0x7f0d800b32a0 2023-10-09T06:21:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.873+0000 7f0d7e7fc700 1 -- 172.21.15.31:0/3231906222 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0d78056cb0 con 0x7f0d800b32a0 2023-10-09T06:21:42.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.877+0000 7f0d887d6700 1 -- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d6c066f30 msgr2=0x7f0d6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:42.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.877+0000 7f0d887d6700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d6c066f30 0x7f0d6c0693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0d800b5fd0 tx=0x7f0d74008040 comp rx=0 tx=0).stop 2023-10-09T06:21:42.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.877+0000 7f0d887d6700 1 -- 172.21.15.31:0/3231906222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d800b32a0 msgr2=0x7f0d801555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:42.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.877+0000 7f0d887d6700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d800b32a0 0x7f0d801555b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800b6c0 tx=0x7f0d78018000 comp rx=0 tx=0).stop 2023-10-09T06:21:42.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.877+0000 7f0d887d6700 1 -- 172.21.15.31:0/3231906222 shutdown_connections 2023-10-09T06:21:42.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.877+0000 7f0d887d6700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d6c066f30 0x7f0d6c0693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:42.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.877+0000 7f0d887d6700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d8015a1b0 0x7f0d800b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:42.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.877+0000 7f0d887d6700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d800b32a0 0x7f0d801555b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:42.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.877+0000 7f0d887d6700 1 --2- 172.21.15.31:0/3231906222 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d80159de0 0x7f0d8015a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:42.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.877+0000 7f0d887d6700 1 -- 172.21.15.31:0/3231906222 >> 172.21.15.31:0/3231906222 conn(0x7f0d80068d60 msgr2=0x7f0d800cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:42.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.877+0000 7f0d887d6700 1 -- 172.21.15.31:0/3231906222 shutdown_connections 2023-10-09T06:21:42.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:42.877+0000 7f0d887d6700 1 -- 172.21.15.31:0/3231906222 wait complete. 2023-10-09T06:21:42.880 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-10-09T06:21:42.893 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:21:43.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.025+0000 7f2217a0e700 1 Processor -- start 2023-10-09T06:21:43.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.026+0000 7f2217a0e700 1 -- start start 2023-10-09T06:21:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.026+0000 7f2217a0e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f221015a230 0x7f221015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.026+0000 7f2217a0e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221015ea90 con 0x7f22100697c0 2023-10-09T06:21:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.026+0000 7f2217a0e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22100b3100 con 0x7f2210159e60 2023-10-09T06:21:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.026+0000 7f2217a0e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22100d1cf0 con 0x7f221015a230 2023-10-09T06:21:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.027+0000 7f2215fab700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f221015a230 0x7f221015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.027+0000 7f2214fa9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f22100697c0 0x7f22100af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40686/0 (socket says 172.21.15.31:40686) 2023-10-09T06:21:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.027+0000 7f2214fa9700 1 -- 172.21.15.31:0/1025479509 learned_addr learned my addr 172.21.15.31:0/1025479509 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.027+0000 7f2215fab700 1 -- 172.21.15.31:0/1025479509 >> v1:172.21.15.158:6789/0 conn(0x7f2210159e60 legacy=0x7f22100690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.027+0000 7f2215fab700 1 -- 172.21.15.31:0/1025479509 >> v1:172.21.15.31:6789/0 conn(0x7f22100697c0 legacy=0x7f22100af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.027+0000 7f2215fab700 1 -- 172.21.15.31:0/1025479509 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22100d10e0 con 0x7f221015a230 2023-10-09T06:21:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.027+0000 7f220ffff700 1 -- 172.21.15.31:0/1025479509 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551352645 0 0) 0x7f221015ea90 con 0x7f22100697c0 2023-10-09T06:21:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.027+0000 7f2215fab700 1 --2- 172.21.15.31:0/1025479509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f221015a230 0x7f221015e550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2200009e60 tx=0x7f2200009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2be3cd4e4858e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.027+0000 7f220ffff700 1 -- 172.21.15.31:0/1025479509 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220000e070 con 0x7f221015a230 2023-10-09T06:21:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.027+0000 7f220ffff700 1 -- 172.21.15.31:0/1025479509 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220000bc30 con 0x7f221015a230 2023-10-09T06:21:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.027+0000 7f220ffff700 1 -- 172.21.15.31:0/1025479509 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200012430 con 0x7f221015a230 2023-10-09T06:21:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.028+0000 7f2217a0e700 1 -- 172.21.15.31:0/1025479509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f221015a230 msgr2=0x7f221015e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.028+0000 7f2217a0e700 1 --2- 172.21.15.31:0/1025479509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f221015a230 0x7f221015e550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2200009e60 tx=0x7f2200009780 comp rx=0 tx=0).stop 2023-10-09T06:21:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.028+0000 7f2217a0e700 1 -- 172.21.15.31:0/1025479509 shutdown_connections 2023-10-09T06:21:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.028+0000 7f2217a0e700 1 --2- 172.21.15.31:0/1025479509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f221015a230 0x7f221015e550 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.028+0000 7f2217a0e700 1 -- 172.21.15.31:0/1025479509 >> 172.21.15.31:0/1025479509 conn(0x7f2210070700 msgr2=0x7f2210070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.028+0000 7f2217a0e700 1 -- 172.21.15.31:0/1025479509 shutdown_connections 2023-10-09T06:21:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.028+0000 7f2217a0e700 1 -- 172.21.15.31:0/1025479509 wait complete. 2023-10-09T06:21:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.029+0000 7f2217a0e700 1 Processor -- start 2023-10-09T06:21:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.029+0000 7f2217a0e700 1 -- start start 2023-10-09T06:21:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2217a0e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22100697c0 0x7f221016a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2217a0e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2210159e60 0x7f221016a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2217a0e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f221015a230 0x7f221016acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2217a0e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221015d940 con 0x7f2210159e60 2023-10-09T06:21:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2217a0e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22100c5980 con 0x7f22100697c0 2023-10-09T06:21:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2217a0e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22100c9ec0 con 0x7f221015a230 2023-10-09T06:21:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2214fa9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2210159e60 0x7f221016a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2214fa9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2210159e60 0x7f221016a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44008/0 (socket says 172.21.15.31:44008) 2023-10-09T06:21:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2214fa9700 1 -- 172.21.15.31:0/510698653 learned_addr learned my addr 172.21.15.31:0/510698653 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2215fab700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f221015a230 0x7f221016acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f22157aa700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22100697c0 0x7f221016a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2214fa9700 1 -- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f221015a230 msgr2=0x7f221016acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2214fa9700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f221015a230 0x7f221016acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2214fa9700 1 -- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22100697c0 msgr2=0x7f221016a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2214fa9700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22100697c0 0x7f221016a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.030+0000 7f2214fa9700 1 -- 172.21.15.31:0/510698653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2200009a20 con 0x7f2210159e60 2023-10-09T06:21:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.031+0000 7f2214fa9700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2210159e60 0x7f221016a790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f220400c810 tx=0x7f2204007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.031+0000 7f220d7fa700 1 -- 172.21.15.31:0/510698653 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204005b30 con 0x7f2210159e60 2023-10-09T06:21:43.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.031+0000 7f220d7fa700 1 -- 172.21.15.31:0/510698653 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2204005c90 con 0x7f2210159e60 2023-10-09T06:21:43.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.031+0000 7f2217a0e700 1 -- 172.21.15.31:0/510698653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221015d0a0 con 0x7f2210159e60 2023-10-09T06:21:43.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.031+0000 7f220d7fa700 1 -- 172.21.15.31:0/510698653 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204007300 con 0x7f2210159e60 2023-10-09T06:21:43.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.031+0000 7f2217a0e700 1 -- 172.21.15.31:0/510698653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221015d660 con 0x7f2210159e60 2023-10-09T06:21:43.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.032+0000 7f2217a0e700 1 -- 172.21.15.31:0/510698653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221004c3c0 con 0x7f2210159e60 2023-10-09T06:21:43.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.032+0000 7f220d7fa700 1 -- 172.21.15.31:0/510698653 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f220401b3b0 con 0x7f2210159e60 2023-10-09T06:21:43.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.033+0000 7f220d7fa700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21fc066f30 0x7f21fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:43.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.033+0000 7f220d7fa700 1 -- 172.21.15.31:0/510698653 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f2204083800 con 0x7f2210159e60 2023-10-09T06:21:43.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.033+0000 7f22157aa700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21fc066f30 0x7f21fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:43.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.033+0000 7f22157aa700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21fc066f30 0x7f21fc0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f22100c8090 tx=0x7f2208009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:43.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.037+0000 7f220d7fa700 1 -- 172.21.15.31:0/510698653 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2204050c50 con 0x7f2210159e60 2023-10-09T06:21:43.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.229+0000 7f2217a0e700 1 -- 172.21.15.31:0/510698653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f22100cb590 con 0x7f2210159e60 2023-10-09T06:21:43.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.874+0000 7f220d7fa700 1 -- 172.21.15.31:0/510698653 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f22040170d0 con 0x7f2210159e60 2023-10-09T06:21:43.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.885+0000 7f2217a0e700 1 -- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21fc066f30 msgr2=0x7f21fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:43.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.885+0000 7f2217a0e700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21fc066f30 0x7f21fc0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f22100c8090 tx=0x7f2208009040 comp rx=0 tx=0).stop 2023-10-09T06:21:43.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.885+0000 7f2217a0e700 1 -- 172.21.15.31:0/510698653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2210159e60 msgr2=0x7f221016a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:43.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.885+0000 7f2217a0e700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2210159e60 0x7f221016a790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f220400c810 tx=0x7f2204007df0 comp rx=0 tx=0).stop 2023-10-09T06:21:43.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.886+0000 7f2217a0e700 1 -- 172.21.15.31:0/510698653 shutdown_connections 2023-10-09T06:21:43.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.886+0000 7f2217a0e700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21fc066f30 0x7f21fc0693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:43.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.886+0000 7f2217a0e700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f221015a230 0x7f221016acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:43.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.886+0000 7f2217a0e700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22100697c0 0x7f221016a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:43.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.886+0000 7f2217a0e700 1 --2- 172.21.15.31:0/510698653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2210159e60 0x7f221016a790 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:43.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.886+0000 7f2217a0e700 1 -- 172.21.15.31:0/510698653 >> 172.21.15.31:0/510698653 conn(0x7f2210070700 msgr2=0x7f22101590e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:43.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.886+0000 7f2217a0e700 1 -- 172.21.15.31:0/510698653 shutdown_connections 2023-10-09T06:21:43.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:43.886+0000 7f2217a0e700 1 -- 172.21.15.31:0/510698653 wait complete. 2023-10-09T06:21:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-10-09T06:21:43.903 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:21:44.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.029+0000 7f5dff59e700 1 Processor -- start 2023-10-09T06:21:44.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.029+0000 7f5dff59e700 1 -- start start 2023-10-09T06:21:44.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.030+0000 7f5dff59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e000adc80 0x7f5e000b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:44.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.030+0000 7f5dff59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5e000b0460 0x7f5e000b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.030+0000 7f5dff59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5e000ce9e0 0x7f5e000cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.030+0000 7f5dff59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e000b1850 con 0x7f5e000ce9e0 2023-10-09T06:21:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.030+0000 7f5dff59e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e000b20f0 con 0x7f5e000b0460 2023-10-09T06:21:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.030+0000 7f5dff59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e000b0e10 con 0x7f5e000adc80 2023-10-09T06:21:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.030+0000 7f5dfed9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5e000ce9e0 0x7f5e000cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.030+0000 7f5dfed9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5e000ce9e0 0x7f5e000cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44012/0 (socket says 172.21.15.31:44012) 2023-10-09T06:21:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.030+0000 7f5dfed9d700 1 -- 172.21.15.31:0/3315813991 learned_addr learned my addr 172.21.15.31:0/3315813991 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:44.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.030+0000 7f5dfdd9b700 1 --2- 172.21.15.31:0/3315813991 >> v2:172.21.15.158:3300/0 conn(0x7f5e000b0460 0x7f5e000b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:44.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.030+0000 7f5dfe59c700 1 --2- 172.21.15.31:0/3315813991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e000adc80 0x7f5e000b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:44.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dfed9d700 1 -- 172.21.15.31:0/3315813991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e000adc80 msgr2=0x7f5e000b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:44.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dfed9d700 1 --2- 172.21.15.31:0/3315813991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e000adc80 0x7f5e000b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:44.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dfed9d700 1 -- 172.21.15.31:0/3315813991 >> v2:172.21.15.158:3300/0 conn(0x7f5e000b0460 msgr2=0x7f5e000b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:44.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dfed9d700 1 --2- 172.21.15.31:0/3315813991 >> v2:172.21.15.158:3300/0 conn(0x7f5e000b0460 0x7f5e000b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:44.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dfed9d700 1 -- 172.21.15.31:0/3315813991 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e000cf750 con 0x7f5e000ce9e0 2023-10-09T06:21:44.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dfe59c700 1 --2- 172.21.15.31:0/3315813991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e000adc80 0x7f5e000b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:44.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dfdd9b700 1 --2- 172.21.15.31:0/3315813991 >> v2:172.21.15.158:3300/0 conn(0x7f5e000b0460 0x7f5e000b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:44.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dfed9d700 1 --2- 172.21.15.31:0/3315813991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e000ce9e0 0x7f5e000cee40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5e0006ba90 tx=0x7f5df0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0152537782b8e79 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:44.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dfd59a700 1 -- 172.21.15.31:0/3315813991 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df000e070 con 0x7f5e000ce9e0 2023-10-09T06:21:44.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dfd59a700 1 -- 172.21.15.31:0/3315813991 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df000ba50 con 0x7f5e000ce9e0 2023-10-09T06:21:44.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dfd59a700 1 -- 172.21.15.31:0/3315813991 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00092e0 con 0x7f5e000ce9e0 2023-10-09T06:21:44.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dff59e700 1 -- 172.21.15.31:0/3315813991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e000ce9e0 msgr2=0x7f5e000cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:44.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dff59e700 1 --2- 172.21.15.31:0/3315813991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e000ce9e0 0x7f5e000cee40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5e0006ba90 tx=0x7f5df0009840 comp rx=0 tx=0).stop 2023-10-09T06:21:44.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dff59e700 1 -- 172.21.15.31:0/3315813991 shutdown_connections 2023-10-09T06:21:44.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dff59e700 1 --2- 172.21.15.31:0/3315813991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e000adc80 0x7f5e000b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:44.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dff59e700 1 --2- 172.21.15.31:0/3315813991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e000ce9e0 0x7f5e000cee40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:44.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dff59e700 1 --2- 172.21.15.31:0/3315813991 >> v2:172.21.15.158:3300/0 conn(0x7f5e000b0460 0x7f5e000b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:44.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.031+0000 7f5dff59e700 1 -- 172.21.15.31:0/3315813991 >> 172.21.15.31:0/3315813991 conn(0x7f5e0006c700 msgr2=0x7f5e00069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:44.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.032+0000 7f5dff59e700 1 -- 172.21.15.31:0/3315813991 shutdown_connections 2023-10-09T06:21:44.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.032+0000 7f5dff59e700 1 -- 172.21.15.31:0/3315813991 wait complete. 2023-10-09T06:21:44.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.033+0000 7f5dff59e700 1 Processor -- start 2023-10-09T06:21:44.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.033+0000 7f5dff59e700 1 -- start start 2023-10-09T06:21:44.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.033+0000 7f5dff59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e000adc80 0x7f5e00168020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:44.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.033+0000 7f5dff59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e000b0460 0x7f5e000ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:44.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.033+0000 7f5dff59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e000ce9e0 0x7f5e000acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:44.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.033+0000 7f5dff59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e001688e0 con 0x7f5e000b0460 2023-10-09T06:21:44.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.033+0000 7f5dff59e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e00168bc0 con 0x7f5e000adc80 2023-10-09T06:21:44.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.033+0000 7f5dff59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e00168ea0 con 0x7f5e000ce9e0 2023-10-09T06:21:44.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.033+0000 7f5dfdd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e000b0460 0x7f5e000ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:44.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.033+0000 7f5dfdd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e000b0460 0x7f5e000ab1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44014/0 (socket says 172.21.15.31:44014) 2023-10-09T06:21:44.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5dfdd9b700 1 -- 172.21.15.31:0/1447992761 learned_addr learned my addr 172.21.15.31:0/1447992761 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:44.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5dfe59c700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e000adc80 0x7f5e00168020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:44.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5dfed9d700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e000ce9e0 0x7f5e000acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:44.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5dfdd9b700 1 -- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e000ce9e0 msgr2=0x7f5e000acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:44.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5dfdd9b700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e000ce9e0 0x7f5e000acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:44.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5dfdd9b700 1 -- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e000adc80 msgr2=0x7f5e00168020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:44.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5dfdd9b700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e000adc80 0x7f5e00168020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:44.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5dfdd9b700 1 -- 172.21.15.31:0/1447992761 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df0009ae0 con 0x7f5e000b0460 2023-10-09T06:21:44.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5dfed9d700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e000ce9e0 0x7f5e000acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:44.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5dfdd9b700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e000b0460 0x7f5e000ab1f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5de800e850 tx=0x7f5de8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:44.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5df67fc700 1 -- 172.21.15.31:0/1447992761 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8013410 con 0x7f5e000b0460 2023-10-09T06:21:44.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5df67fc700 1 -- 172.21.15.31:0/1447992761 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de8013570 con 0x7f5e000b0460 2023-10-09T06:21:44.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5df67fc700 1 -- 172.21.15.31:0/1447992761 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8013910 con 0x7f5e000b0460 2023-10-09T06:21:44.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5dff59e700 1 -- 172.21.15.31:0/1447992761 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e001691f0 con 0x7f5e000b0460 2023-10-09T06:21:44.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.034+0000 7f5dff59e700 1 -- 172.21.15.31:0/1447992761 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e00168560 con 0x7f5e000b0460 2023-10-09T06:21:44.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.035+0000 7f5dff59e700 1 -- 172.21.15.31:0/1447992761 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e00169840 con 0x7f5e000b0460 2023-10-09T06:21:44.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.035+0000 7f5df67fc700 1 -- 172.21.15.31:0/1447992761 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5de8013d00 con 0x7f5e000b0460 2023-10-09T06:21:44.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.036+0000 7f5df67fc700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5de0066f30 0x7f5de00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:44.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.036+0000 7f5df67fc700 1 -- 172.21.15.31:0/1447992761 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f5de8084210 con 0x7f5e000b0460 2023-10-09T06:21:44.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.036+0000 7f5dfe59c700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5de0066f30 0x7f5de00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:44.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.037+0000 7f5dfe59c700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5de0066f30 0x7f5de00693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5e0015d6a0 tx=0x7f5df8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:44.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.041+0000 7f5df67fc700 1 -- 172.21.15.31:0/1447992761 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5de80514e0 con 0x7f5e000b0460 2023-10-09T06:21:44.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.274+0000 7f5dff59e700 1 -- 172.21.15.31:0/1447992761 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5e0004c3c0 con 0x7f5e000b0460 2023-10-09T06:21:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.901+0000 7f5df67fc700 1 -- 172.21.15.31:0/1447992761 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5de8054b00 con 0x7f5e000b0460 2023-10-09T06:21:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.905+0000 7f5dff59e700 1 -- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5de0066f30 msgr2=0x7f5de00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.905+0000 7f5dff59e700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5de0066f30 0x7f5de00693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5e0015d6a0 tx=0x7f5df8008040 comp rx=0 tx=0).stop 2023-10-09T06:21:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.905+0000 7f5dff59e700 1 -- 172.21.15.31:0/1447992761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e000b0460 msgr2=0x7f5e000ab1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.905+0000 7f5dff59e700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e000b0460 0x7f5e000ab1f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5de800e850 tx=0x7f5de8008040 comp rx=0 tx=0).stop 2023-10-09T06:21:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.907+0000 7f5dff59e700 1 -- 172.21.15.31:0/1447992761 shutdown_connections 2023-10-09T06:21:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.907+0000 7f5dff59e700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5de0066f30 0x7f5de00693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.907+0000 7f5dff59e700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e000ce9e0 0x7f5e000acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.907+0000 7f5dff59e700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e000adc80 0x7f5e00168020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.907+0000 7f5dff59e700 1 --2- 172.21.15.31:0/1447992761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e000b0460 0x7f5e000ab1f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.907+0000 7f5dff59e700 1 -- 172.21.15.31:0/1447992761 >> 172.21.15.31:0/1447992761 conn(0x7f5e0006c700 msgr2=0x7f5e000cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.907+0000 7f5dff59e700 1 -- 172.21.15.31:0/1447992761 shutdown_connections 2023-10-09T06:21:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:44.907+0000 7f5dff59e700 1 -- 172.21.15.31:0/1447992761 wait complete. 2023-10-09T06:21:44.909 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 4 and data pool 5 2023-10-09T06:21:44.921 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.043+0000 7fbf2fea3700 1 Processor -- start 2023-10-09T06:21:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.043+0000 7fbf2fea3700 1 -- start start 2023-10-09T06:21:45.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.044+0000 7fbf2fea3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf28157870 0x7fbf2815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.044+0000 7fbf2fea3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbf2815a620 0x7fbf2815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.044+0000 7fbf2fea3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf2815d580 0x7fbf28158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.044+0000 7fbf2fea3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2815cbb0 con 0x7fbf2815d580 2023-10-09T06:21:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.044+0000 7fbf2fea3700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2815bfa0 con 0x7fbf2815a620 2023-10-09T06:21:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.044+0000 7fbf2fea3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2815c280 con 0x7fbf28157870 2023-10-09T06:21:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.044+0000 7fbf2e440700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf2815d580 0x7fbf28158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.044+0000 7fbf2e440700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf2815d580 0x7fbf28158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44020/0 (socket says 172.21.15.31:44020) 2023-10-09T06:21:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.044+0000 7fbf2e440700 1 -- 172.21.15.31:0/3597834962 learned_addr learned my addr 172.21.15.31:0/3597834962 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.045+0000 7fbf2d43e700 1 --2- 172.21.15.31:0/3597834962 >> v2:172.21.15.158:3300/0 conn(0x7fbf2815a620 0x7fbf2815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.045+0000 7fbf2dc3f700 1 --2- 172.21.15.31:0/3597834962 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf28157870 0x7fbf2815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.045+0000 7fbf2e440700 1 -- 172.21.15.31:0/3597834962 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf28157870 msgr2=0x7fbf2815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.045+0000 7fbf2e440700 1 --2- 172.21.15.31:0/3597834962 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf28157870 0x7fbf2815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.045+0000 7fbf2e440700 1 -- 172.21.15.31:0/3597834962 >> v2:172.21.15.158:3300/0 conn(0x7fbf2815a620 msgr2=0x7fbf2815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.045+0000 7fbf2e440700 1 --2- 172.21.15.31:0/3597834962 >> v2:172.21.15.158:3300/0 conn(0x7fbf2815a620 0x7fbf2815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.045+0000 7fbf2e440700 1 -- 172.21.15.31:0/3597834962 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2815c560 con 0x7fbf2815d580 2023-10-09T06:21:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.045+0000 7fbf2d43e700 1 --2- 172.21.15.31:0/3597834962 >> v2:172.21.15.158:3300/0 conn(0x7fbf2815a620 0x7fbf2815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.045+0000 7fbf2dc3f700 1 --2- 172.21.15.31:0/3597834962 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf28157870 0x7fbf2815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.045+0000 7fbf2e440700 1 --2- 172.21.15.31:0/3597834962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2815d580 0x7fbf28158110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbf280897d0 tx=0x7fbf18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8c1d195164d7e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.045+0000 7fbf2cc3d700 1 -- 172.21.15.31:0/3597834962 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1800e070 con 0x7fbf2815d580 2023-10-09T06:21:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.045+0000 7fbf2cc3d700 1 -- 172.21.15.31:0/3597834962 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1800ba50 con 0x7fbf2815d580 2023-10-09T06:21:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.045+0000 7fbf2cc3d700 1 -- 172.21.15.31:0/3597834962 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf180092e0 con 0x7fbf2815d580 2023-10-09T06:21:45.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.046+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3597834962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2815d580 msgr2=0x7fbf28158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.046+0000 7fbf2fea3700 1 --2- 172.21.15.31:0/3597834962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2815d580 0x7fbf28158110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbf280897d0 tx=0x7fbf18009840 comp rx=0 tx=0).stop 2023-10-09T06:21:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.046+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3597834962 shutdown_connections 2023-10-09T06:21:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.046+0000 7fbf2fea3700 1 --2- 172.21.15.31:0/3597834962 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf28157870 0x7fbf2815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.046+0000 7fbf2fea3700 1 --2- 172.21.15.31:0/3597834962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2815d580 0x7fbf28158110 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.046+0000 7fbf2fea3700 1 --2- 172.21.15.31:0/3597834962 >> v2:172.21.15.158:3300/0 conn(0x7fbf2815a620 0x7fbf2815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.046+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3597834962 >> 172.21.15.31:0/3597834962 conn(0x7fbf28068ce0 msgr2=0x7fbf280690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.046+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3597834962 shutdown_connections 2023-10-09T06:21:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.046+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3597834962 wait complete. 2023-10-09T06:21:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.047+0000 7fbf2fea3700 1 Processor -- start 2023-10-09T06:21:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.047+0000 7fbf2fea3700 1 -- start start 2023-10-09T06:21:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.047+0000 7fbf2fea3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf28157870 0x7fbf280b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.047+0000 7fbf2fea3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2815a620 0x7fbf280b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.047+0000 7fbf2fea3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf2815d580 0x7fbf28159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.047+0000 7fbf2fea3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280b28d0 con 0x7fbf2815a620 2023-10-09T06:21:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.047+0000 7fbf2fea3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280b1090 con 0x7fbf28157870 2023-10-09T06:21:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.047+0000 7fbf2fea3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2815a000 con 0x7fbf2815d580 2023-10-09T06:21:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf2d43e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2815a620 0x7fbf280b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf2d43e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2815a620 0x7fbf280b2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44022/0 (socket says 172.21.15.31:44022) 2023-10-09T06:21:45.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf2d43e700 1 -- 172.21.15.31:0/3482622671 learned_addr learned my addr 172.21.15.31:0/3482622671 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:45.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf2e440700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf2815d580 0x7fbf28159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf2dc3f700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf28157870 0x7fbf280b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf2d43e700 1 -- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf2815d580 msgr2=0x7fbf28159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf2d43e700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf2815d580 0x7fbf28159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf2d43e700 1 -- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf28157870 msgr2=0x7fbf280b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf2d43e700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf28157870 0x7fbf280b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf2d43e700 1 -- 172.21.15.31:0/3482622671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf18009ae0 con 0x7fbf2815a620 2023-10-09T06:21:45.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf2d43e700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2815a620 0x7fbf280b2390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00c830 tx=0x7fbf1c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:45.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf25ffb700 1 -- 172.21.15.31:0/3482622671 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c011600 con 0x7fbf2815a620 2023-10-09T06:21:45.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf25ffb700 1 -- 172.21.15.31:0/3482622671 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c011760 con 0x7fbf2815a620 2023-10-09T06:21:45.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf25ffb700 1 -- 172.21.15.31:0/3482622671 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c011b20 con 0x7fbf2815a620 2023-10-09T06:21:45.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3482622671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2815a250 con 0x7fbf2815a620 2023-10-09T06:21:45.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.048+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3482622671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf280b0a40 con 0x7fbf2815a620 2023-10-09T06:21:45.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.049+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3482622671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2804c3c0 con 0x7fbf2815a620 2023-10-09T06:21:45.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.050+0000 7fbf25ffb700 1 -- 172.21.15.31:0/3482622671 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf1c018360 con 0x7fbf2815a620 2023-10-09T06:21:45.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.050+0000 7fbf25ffb700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbf14066f30 0x7fbf140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.050+0000 7fbf25ffb700 1 -- 172.21.15.31:0/3482622671 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf1c0844c0 con 0x7fbf2815a620 2023-10-09T06:21:45.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.050+0000 7fbf2dc3f700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbf14066f30 0x7fbf140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.051+0000 7fbf2dc3f700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbf14066f30 0x7fbf140693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000acc0 tx=0x7fbf20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:45.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.055+0000 7fbf25ffb700 1 -- 172.21.15.31:0/3482622671 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf1c051730 con 0x7fbf2815a620 2023-10-09T06:21:45.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.248+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3482622671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf2815c840 con 0x7fbf2815a620 2023-10-09T06:21:45.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.249+0000 7fbf25ffb700 1 -- 172.21.15.31:0/3482622671 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fbf1c054d50 con 0x7fbf2815a620 2023-10-09T06:21:45.250 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:45.250 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":31,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:21:44.276471+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:21:42.035162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T06:21:43.259545+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:45.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.251+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbf14066f30 msgr2=0x7fbf140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.251+0000 7fbf2fea3700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbf14066f30 0x7fbf140693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000acc0 tx=0x7fbf20008040 comp rx=0 tx=0).stop 2023-10-09T06:21:45.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.251+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3482622671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2815a620 msgr2=0x7fbf280b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.251+0000 7fbf2fea3700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2815a620 0x7fbf280b2390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00c830 tx=0x7fbf1c008040 comp rx=0 tx=0).stop 2023-10-09T06:21:45.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.251+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3482622671 shutdown_connections 2023-10-09T06:21:45.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.251+0000 7fbf2fea3700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbf14066f30 0x7fbf140693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.251+0000 7fbf2fea3700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbf2815d580 0x7fbf28159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.251+0000 7fbf2fea3700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf28157870 0x7fbf280b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.251+0000 7fbf2fea3700 1 --2- 172.21.15.31:0/3482622671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2815a620 0x7fbf280b2390 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.251+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3482622671 >> 172.21.15.31:0/3482622671 conn(0x7fbf28068ce0 msgr2=0x7fbf280b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:45.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.251+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3482622671 shutdown_connections 2023-10-09T06:21:45.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.251+0000 7fbf2fea3700 1 -- 172.21.15.31:0/3482622671 wait complete. 2023-10-09T06:21:45.264 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:45.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.382+0000 7f8f12125700 1 Processor -- start 2023-10-09T06:21:45.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.382+0000 7f8f12125700 1 -- start start 2023-10-09T06:21:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.382+0000 7f8f12125700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8f0c0b3430 0x7f8f0c164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.382+0000 7f8f12125700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0c15db80 con 0x7f8f0c15a1e0 2023-10-09T06:21:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.383+0000 7f8f12125700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0c15de60 con 0x7f8f0c159e10 2023-10-09T06:21:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.383+0000 7f8f12125700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c15e800 con 0x7f8f0c0b3430 2023-10-09T06:21:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.383+0000 7f8f0bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8f0c0b3430 0x7f8f0c164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.383+0000 7f8f0affd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8f0c15a1e0 0x7f8f0c0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40702/0 (socket says 172.21.15.31:40702) 2023-10-09T06:21:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.383+0000 7f8f0affd700 1 -- 172.21.15.31:0/2271483361 learned_addr learned my addr 172.21.15.31:0/2271483361 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.383+0000 7f8f0bfff700 1 -- 172.21.15.31:0/2271483361 >> v1:172.21.15.158:6789/0 conn(0x7f8f0c159e10 legacy=0x7f8f0c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.383+0000 7f8f0bfff700 1 -- 172.21.15.31:0/2271483361 >> v1:172.21.15.31:6789/0 conn(0x7f8f0c15a1e0 legacy=0x7f8f0c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.383+0000 7f8f0bfff700 1 -- 172.21.15.31:0/2271483361 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c15e140 con 0x7f8f0c0b3430 2023-10-09T06:21:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.383+0000 7f8f0bfff700 1 --2- 172.21.15.31:0/2271483361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c0b3430 0x7f8f0c164e20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009e60 tx=0x7f8f04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87995fa72e4a71e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.383+0000 7f8f0a7fc700 1 -- 172.21.15.31:0/2271483361 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0400e070 con 0x7f8f0c0b3430 2023-10-09T06:21:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.383+0000 7f8f0a7fc700 1 -- 172.21.15.31:0/2271483361 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0400bc30 con 0x7f8f0c0b3430 2023-10-09T06:21:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.383+0000 7f8f0a7fc700 1 -- 172.21.15.31:0/2271483361 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04012430 con 0x7f8f0c0b3430 2023-10-09T06:21:45.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.384+0000 7f8f12125700 1 -- 172.21.15.31:0/2271483361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c0b3430 msgr2=0x7f8f0c164e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.384+0000 7f8f12125700 1 --2- 172.21.15.31:0/2271483361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c0b3430 0x7f8f0c164e20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009e60 tx=0x7f8f04009780 comp rx=0 tx=0).stop 2023-10-09T06:21:45.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.384+0000 7f8f12125700 1 -- 172.21.15.31:0/2271483361 shutdown_connections 2023-10-09T06:21:45.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.384+0000 7f8f12125700 1 --2- 172.21.15.31:0/2271483361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c0b3430 0x7f8f0c164e20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.384+0000 7f8f12125700 1 -- 172.21.15.31:0/2271483361 >> 172.21.15.31:0/2271483361 conn(0x7f8f0c067660 msgr2=0x7f8f0c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:45.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.384+0000 7f8f12125700 1 -- 172.21.15.31:0/2271483361 shutdown_connections 2023-10-09T06:21:45.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.384+0000 7f8f12125700 1 -- 172.21.15.31:0/2271483361 wait complete. 2023-10-09T06:21:45.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.385+0000 7f8f12125700 1 Processor -- start 2023-10-09T06:21:45.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.385+0000 7f8f12125700 1 -- start start 2023-10-09T06:21:45.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f12125700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f0c0b3430 0x7f8f0c0c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f12125700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c159e10 0x7f8f0c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f12125700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8f0c15a1e0 0x7f8f0c0c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f12125700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c0c5660 con 0x7f8f0c159e10 2023-10-09T06:21:45.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f12125700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c0cfad0 con 0x7f8f0c15a1e0 2023-10-09T06:21:45.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f12125700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c0c5870 con 0x7f8f0c0b3430 2023-10-09T06:21:45.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f0affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c159e10 0x7f8f0c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f0affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c159e10 0x7f8f0c0cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44034/0 (socket says 172.21.15.31:44034) 2023-10-09T06:21:45.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f0affd700 1 -- 172.21.15.31:0/1250363787 learned_addr learned my addr 172.21.15.31:0/1250363787 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:45.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f0b7fe700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f0c0b3430 0x7f8f0c0c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f0bfff700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8f0c15a1e0 0x7f8f0c0c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f0affd700 1 -- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f0c0b3430 msgr2=0x7f8f0c0c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f0affd700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f0c0b3430 0x7f8f0c0c5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f0affd700 1 -- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8f0c15a1e0 msgr2=0x7f8f0c0c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f0affd700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8f0c15a1e0 0x7f8f0c0c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f0affd700 1 -- 172.21.15.31:0/1250363787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f04009a20 con 0x7f8f0c159e10 2023-10-09T06:21:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.386+0000 7f8f0affd700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c159e10 0x7f8f0c0cf590 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400c590 tx=0x7f8ef4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.387+0000 7f8f037fe700 1 -- 172.21.15.31:0/1250363787 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4005b30 con 0x7f8f0c159e10 2023-10-09T06:21:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.387+0000 7f8f037fe700 1 -- 172.21.15.31:0/1250363787 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef4005cb0 con 0x7f8f0c159e10 2023-10-09T06:21:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.387+0000 7f8f12125700 1 -- 172.21.15.31:0/1250363787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c0c7d50 con 0x7f8f0c159e10 2023-10-09T06:21:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.387+0000 7f8f037fe700 1 -- 172.21.15.31:0/1250363787 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4007320 con 0x7f8f0c159e10 2023-10-09T06:21:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.387+0000 7f8f12125700 1 -- 172.21.15.31:0/1250363787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c0c8390 con 0x7f8f0c159e10 2023-10-09T06:21:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.388+0000 7f8f12125700 1 -- 172.21.15.31:0/1250363787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c04c3c0 con 0x7f8f0c159e10 2023-10-09T06:21:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.388+0000 7f8f037fe700 1 -- 172.21.15.31:0/1250363787 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ef401c440 con 0x7f8f0c159e10 2023-10-09T06:21:45.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.388+0000 7f8f037fe700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8eec066f30 0x7f8eec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.389+0000 7f8f037fe700 1 -- 172.21.15.31:0/1250363787 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ef4083880 con 0x7f8f0c159e10 2023-10-09T06:21:45.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.389+0000 7f8f0b7fe700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8eec066f30 0x7f8eec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.389+0000 7f8f0b7fe700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8eec066f30 0x7f8eec0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8efc001760 tx=0x7f8efc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:45.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.393+0000 7f8f037fe700 1 -- 172.21.15.31:0/1250363787 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ef404b5a0 con 0x7f8f0c159e10 2023-10-09T06:21:45.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.588+0000 7f8f12125700 1 -- 172.21.15.31:0/1250363787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f0c15e420 con 0x7f8f0c159e10 2023-10-09T06:21:45.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.589+0000 7f8f037fe700 1 -- 172.21.15.31:0/1250363787 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f8ef4017090 con 0x7f8f0c159e10 2023-10-09T06:21:45.590 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:45.590 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":31,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:21:44.276471+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:21:42.035162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T06:21:43.259545+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:45.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.591+0000 7f8f12125700 1 -- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8eec066f30 msgr2=0x7f8eec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.591+0000 7f8f12125700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8eec066f30 0x7f8eec0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8efc001760 tx=0x7f8efc009040 comp rx=0 tx=0).stop 2023-10-09T06:21:45.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.591+0000 7f8f12125700 1 -- 172.21.15.31:0/1250363787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c159e10 msgr2=0x7f8f0c0cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.591+0000 7f8f12125700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c159e10 0x7f8f0c0cf590 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400c590 tx=0x7f8ef4007f70 comp rx=0 tx=0).stop 2023-10-09T06:21:45.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.591+0000 7f8f12125700 1 -- 172.21.15.31:0/1250363787 shutdown_connections 2023-10-09T06:21:45.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.591+0000 7f8f12125700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8eec066f30 0x7f8eec0693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.591+0000 7f8f12125700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8f0c0b3430 0x7f8f0c0c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.591+0000 7f8f12125700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8f0c15a1e0 0x7f8f0c0c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.591+0000 7f8f12125700 1 --2- 172.21.15.31:0/1250363787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c159e10 0x7f8f0c0cf590 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.591+0000 7f8f12125700 1 -- 172.21.15.31:0/1250363787 >> 172.21.15.31:0/1250363787 conn(0x7f8f0c067660 msgr2=0x7f8f0c0cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:45.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.592+0000 7f8f12125700 1 -- 172.21.15.31:0/1250363787 shutdown_connections 2023-10-09T06:21:45.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.592+0000 7f8f12125700 1 -- 172.21.15.31:0/1250363787 wait complete. 2023-10-09T06:21:45.604 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:21:45.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.725+0000 7fda9b31e700 1 Processor -- start 2023-10-09T06:21:45.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.725+0000 7fda9b31e700 1 -- start start 2023-10-09T06:21:45.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.726+0000 7fda9b31e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda9415a300 0x7fda9415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.726+0000 7fda9b31e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda9415ac10 0x7fda940cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.726+0000 7fda9b31e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda940cc760 con 0x7fda940cb970 2023-10-09T06:21:45.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.726+0000 7fda9b31e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9415b460 con 0x7fda9415a300 2023-10-09T06:21:45.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.726+0000 7fda9b31e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9415ba20 con 0x7fda9415ac10 2023-10-09T06:21:45.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.727+0000 7fda9a31c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda9415a300 0x7fda9415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.727+0000 7fda99b1b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda9415ac10 0x7fda940cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.727+0000 7fda9ab1d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fda940cb970 0x7fda9415beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:59248/0 (socket says 172.21.15.31:59248) 2023-10-09T06:21:45.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.727+0000 7fda9ab1d700 1 -- 172.21.15.31:0/355854698 learned_addr learned my addr 172.21.15.31:0/355854698 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:45.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.727+0000 7fda99b1b700 1 -- 172.21.15.31:0/355854698 >> v2:172.21.15.158:3300/0 conn(0x7fda9415a300 msgr2=0x7fda9415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:45.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.727+0000 7fda99b1b700 1 --2- 172.21.15.31:0/355854698 >> v2:172.21.15.158:3300/0 conn(0x7fda9415a300 0x7fda9415a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.727+0000 7fda99b1b700 1 -- 172.21.15.31:0/355854698 >> v1:172.21.15.158:6789/0 conn(0x7fda940cb970 legacy=0x7fda9415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.727+0000 7fda99b1b700 1 -- 172.21.15.31:0/355854698 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda940cc1a0 con 0x7fda9415ac10 2023-10-09T06:21:45.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.727+0000 7fda9931a700 1 -- 172.21.15.31:0/355854698 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205606426 0 0) 0x7fda940cc760 con 0x7fda940cb970 2023-10-09T06:21:45.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.727+0000 7fda9a31c700 1 --2- 172.21.15.31:0/355854698 >> v2:172.21.15.158:3300/0 conn(0x7fda9415a300 0x7fda9415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:45.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.727+0000 7fda99b1b700 1 --2- 172.21.15.31:0/355854698 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda9415ac10 0x7fda940cb430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda840098e0 tx=0x7fda840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9271dcb198db0191 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:45.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.728+0000 7fda9931a700 1 -- 172.21.15.31:0/355854698 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8400b640 con 0x7fda9415ac10 2023-10-09T06:21:45.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.728+0000 7fda9931a700 1 -- 172.21.15.31:0/355854698 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8400b7a0 con 0x7fda9415ac10 2023-10-09T06:21:45.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.728+0000 7fda9931a700 1 -- 172.21.15.31:0/355854698 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8400bb40 con 0x7fda9415ac10 2023-10-09T06:21:45.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.728+0000 7fda9b31e700 1 -- 172.21.15.31:0/355854698 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda9415ac10 msgr2=0x7fda940cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.728+0000 7fda9b31e700 1 --2- 172.21.15.31:0/355854698 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda9415ac10 0x7fda940cb430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda840098e0 tx=0x7fda840091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.728+0000 7fda9b31e700 1 -- 172.21.15.31:0/355854698 shutdown_connections 2023-10-09T06:21:45.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.728+0000 7fda9b31e700 1 --2- 172.21.15.31:0/355854698 >> v2:172.21.15.158:3300/0 conn(0x7fda9415a300 0x7fda9415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.728+0000 7fda9b31e700 1 --2- 172.21.15.31:0/355854698 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda9415ac10 0x7fda940cb430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.728+0000 7fda9b31e700 1 -- 172.21.15.31:0/355854698 >> 172.21.15.31:0/355854698 conn(0x7fda94099f50 msgr2=0x7fda94067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:45.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.728+0000 7fda9b31e700 1 -- 172.21.15.31:0/355854698 shutdown_connections 2023-10-09T06:21:45.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.728+0000 7fda9b31e700 1 -- 172.21.15.31:0/355854698 wait complete. 2023-10-09T06:21:45.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.729+0000 7fda9b31e700 1 Processor -- start 2023-10-09T06:21:45.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.729+0000 7fda9b31e700 1 -- start start 2023-10-09T06:21:45.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.730+0000 7fda9b31e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda940cb970 0x7fda940c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.730+0000 7fda9b31e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda9415a300 0x7fda940b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.730+0000 7fda9b31e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda9415ac10 0x7fda940b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.730+0000 7fda9b31e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9414f940 con 0x7fda940cb970 2023-10-09T06:21:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.730+0000 7fda9b31e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda940c46a0 con 0x7fda9415a300 2023-10-09T06:21:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.730+0000 7fda9b31e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda940c4980 con 0x7fda9415ac10 2023-10-09T06:21:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.730+0000 7fda9a31c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda940cb970 0x7fda940c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.730+0000 7fda9a31c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda940cb970 0x7fda940c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44038/0 (socket says 172.21.15.31:44038) 2023-10-09T06:21:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.730+0000 7fda9a31c700 1 -- 172.21.15.31:0/4110363297 learned_addr learned my addr 172.21.15.31:0/4110363297 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.730+0000 7fda9ab1d700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda9415ac10 0x7fda940b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.730+0000 7fda99b1b700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda9415a300 0x7fda940b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.730+0000 7fda9a31c700 1 -- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda9415ac10 msgr2=0x7fda940b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.730+0000 7fda9a31c700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda9415ac10 0x7fda940b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.731+0000 7fda9a31c700 1 -- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda9415a300 msgr2=0x7fda940b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:45.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.731+0000 7fda9a31c700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda9415a300 0x7fda940b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:45.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.731+0000 7fda9a31c700 1 -- 172.21.15.31:0/4110363297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0093c0 con 0x7fda940cb970 2023-10-09T06:21:45.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.731+0000 7fda9a31c700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda940cb970 0x7fda940c7460 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00ec80 tx=0x7fda8c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:45.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.731+0000 7fda8a7fc700 1 -- 172.21.15.31:0/4110363297 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c005a00 con 0x7fda940cb970 2023-10-09T06:21:45.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.731+0000 7fda8a7fc700 1 -- 172.21.15.31:0/4110363297 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c005b60 con 0x7fda940cb970 2023-10-09T06:21:45.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.731+0000 7fda9b31e700 1 -- 172.21.15.31:0/4110363297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda84009420 con 0x7fda940cb970 2023-10-09T06:21:45.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.731+0000 7fda8a7fc700 1 -- 172.21.15.31:0/4110363297 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c00c850 con 0x7fda940cb970 2023-10-09T06:21:45.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.731+0000 7fda9b31e700 1 -- 172.21.15.31:0/4110363297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda940b5e90 con 0x7fda940cb970 2023-10-09T06:21:45.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.732+0000 7fda9b31e700 1 -- 172.21.15.31:0/4110363297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9406ada0 con 0x7fda940cb970 2023-10-09T06:21:45.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.732+0000 7fda8a7fc700 1 -- 172.21.15.31:0/4110363297 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda8c00cbc0 con 0x7fda940cb970 2023-10-09T06:21:45.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.733+0000 7fda8a7fc700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda78066f30 0x7fda780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:45.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.733+0000 7fda8a7fc700 1 -- 172.21.15.31:0/4110363297 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda8c084950 con 0x7fda940cb970 2023-10-09T06:21:45.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.733+0000 7fda99b1b700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda78066f30 0x7fda780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:45.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.733+0000 7fda99b1b700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda78066f30 0x7fda780693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fda840093f0 tx=0x7fda84017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:45.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.737+0000 7fda8a7fc700 1 -- 172.21.15.31:0/4110363297 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda8c051bc0 con 0x7fda940cb970 2023-10-09T06:21:45.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:45.978+0000 7fda9b31e700 1 -- 172.21.15.31:0/4110363297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fda940cc480 con 0x7fda940cb970 2023-10-09T06:21:46.857 INFO:tasks.ceph.mds.d.smithi158.stderr:2023-10-09T06:21:46.856+0000 7f21720c0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:21:46.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:46.909+0000 7fda8a7fc700 1 -- 172.21.15.31:0/4110363297 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fda8c0551e0 con 0x7fda940cb970 2023-10-09T06:21:46.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:46.912+0000 7fda9b31e700 1 -- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda78066f30 msgr2=0x7fda780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:46.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:46.912+0000 7fda9b31e700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda78066f30 0x7fda780693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fda840093f0 tx=0x7fda84017000 comp rx=0 tx=0).stop 2023-10-09T06:21:46.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:46.912+0000 7fda9b31e700 1 -- 172.21.15.31:0/4110363297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda940cb970 msgr2=0x7fda940c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:46.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:46.912+0000 7fda9b31e700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda940cb970 0x7fda940c7460 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00ec80 tx=0x7fda8c009120 comp rx=0 tx=0).stop 2023-10-09T06:21:46.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:46.912+0000 7fda9b31e700 1 -- 172.21.15.31:0/4110363297 shutdown_connections 2023-10-09T06:21:46.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:46.912+0000 7fda9b31e700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda78066f30 0x7fda780693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:46.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:46.912+0000 7fda9b31e700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda9415ac10 0x7fda940b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:46.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:46.912+0000 7fda9b31e700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda940cb970 0x7fda940c7460 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:46.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:46.912+0000 7fda9b31e700 1 --2- 172.21.15.31:0/4110363297 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda9415a300 0x7fda940b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:46.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:46.912+0000 7fda9b31e700 1 -- 172.21.15.31:0/4110363297 >> 172.21.15.31:0/4110363297 conn(0x7fda94099f50 msgr2=0x7fda9415beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:46.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:46.912+0000 7fda9b31e700 1 -- 172.21.15.31:0/4110363297 shutdown_connections 2023-10-09T06:21:46.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:46.912+0000 7fda9b31e700 1 -- 172.21.15.31:0/4110363297 wait complete. 2023-10-09T06:21:46.927 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:21:47.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.055+0000 7f7b13f9c700 1 Processor -- start 2023-10-09T06:21:47.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.055+0000 7f7b13f9c700 1 -- start start 2023-10-09T06:21:47.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b13f9c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7b0c0cbf10 0x7f7b0c15e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:47.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b13f9c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7b0c0c9390 0x7f7b0c15a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:47.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b13f9c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0c0cae70 con 0x7f7b0c0678b0 2023-10-09T06:21:47.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b13f9c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cb150 con 0x7f7b0c0cbf10 2023-10-09T06:21:47.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b13f9c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cb430 con 0x7f7b0c0c9390 2023-10-09T06:21:47.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b11d38700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7b0c0678b0 0x7f7b0c15db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40716/0 (socket says 172.21.15.31:40716) 2023-10-09T06:21:47.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b11d38700 1 -- 172.21.15.31:0/1879177373 learned_addr learned my addr 172.21.15.31:0/1879177373 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:47.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747091383 0 0) 0x7f7b0c0cae70 con 0x7f7b0c0678b0 2023-10-09T06:21:47.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7af4003570 con 0x7f7b0c0678b0 2023-10-09T06:21:47.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b11537700 1 --2- 172.21.15.31:0/1879177373 >> v2:172.21.15.158:3300/0 conn(0x7f7b0c0cbf10 0x7f7b0c15e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:47.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b12539700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7b0c0c9390 0x7f7b0c15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:47.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1256611832 0 0) 0x7f7af4003570 con 0x7f7b0c0678b0 2023-10-09T06:21:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7b0c0c9390 msgr2=0x7f7b0c15a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7b0c0c9390 0x7f7b0c15a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 >> v2:172.21.15.158:3300/0 conn(0x7f7b0c0cbf10 msgr2=0x7f7b0c15e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 --2- 172.21.15.31:0/1879177373 >> v2:172.21.15.158:3300/0 conn(0x7f7b0c0cbf10 0x7f7b0c15e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c0cb710 con 0x7f7b0c0678b0 2023-10-09T06:21:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f7b04001470 con 0x7f7b0c0678b0 2023-10-09T06:21:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b12539700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7b0c0c9390 0x7f7b0c15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 >> v1:172.21.15.31:6789/0 conn(0x7f7b0c0678b0 legacy=0x7f7b0c15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7af4003a60 0x7f7af4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7af4004810 0x7f7af4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7b0c0c9390 0x7f7af40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cb150 con 0x7f7af4003a60 2023-10-09T06:21:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cb430 con 0x7f7af4004810 2023-10-09T06:21:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af400bae0 con 0x7f7b0c0c9390 2023-10-09T06:21:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.056+0000 7f7b11d38700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7af4003a60 0x7f7af4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.057+0000 7f7b11537700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7af4004810 0x7f7af4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.057+0000 7f7b12539700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7b0c0c9390 0x7f7af40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:47.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.057+0000 7f7b11d38700 1 -- 172.21.15.31:0/1879177373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7b0c0c9390 msgr2=0x7f7af40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:47.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.057+0000 7f7b11d38700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7b0c0c9390 0x7f7af40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:47.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.057+0000 7f7b11d38700 1 -- 172.21.15.31:0/1879177373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7af4004810 msgr2=0x7f7af4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:47.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.057+0000 7f7b11d38700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7af4004810 0x7f7af4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:47.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.057+0000 7f7b11d38700 1 -- 172.21.15.31:0/1879177373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af4003570 con 0x7f7af4003a60 2023-10-09T06:21:47.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.057+0000 7f7b12539700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7b0c0c9390 0x7f7af40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:47.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.057+0000 7f7b11d38700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7af4003a60 0x7f7af4003e70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400c3c0 tx=0x7f7b04001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e26a3237cca16e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:47.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.057+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0400cc90 con 0x7f7af4003a60 2023-10-09T06:21:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.057+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0400ce30 con 0x7f7af4003a60 2023-10-09T06:21:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.057+0000 7f7b10d36700 1 -- 172.21.15.31:0/1879177373 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b04005b70 con 0x7f7af4003a60 2023-10-09T06:21:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.058+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1879177373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7af4003a60 msgr2=0x7f7af4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.058+0000 7f7b13f9c700 1 --2- 172.21.15.31:0/1879177373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7af4003a60 0x7f7af4003e70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400c3c0 tx=0x7f7b04001e90 comp rx=0 tx=0).stop 2023-10-09T06:21:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.058+0000 7f7b12539700 1 -- 172.21.15.31:0/1879177373 reap_dead start 2023-10-09T06:21:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.058+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1879177373 shutdown_connections 2023-10-09T06:21:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.058+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1879177373 >> 172.21.15.31:0/1879177373 conn(0x7f7b0c069870 msgr2=0x7f7b0c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.058+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1879177373 shutdown_connections 2023-10-09T06:21:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.058+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1879177373 wait complete. 2023-10-09T06:21:47.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.059+0000 7f7b13f9c700 1 Processor -- start 2023-10-09T06:21:47.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.059+0000 7f7b13f9c700 1 -- start start 2023-10-09T06:21:47.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.059+0000 7f7b13f9c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7af4003a60 0x7f7b0c16a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:47.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.059+0000 7f7b13f9c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7b0c150730 0x7f7b0c0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:47.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.059+0000 7f7b13f9c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b0c15e1d0 0x7f7b0c15e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:47.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.059+0000 7f7b13f9c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c15ebb0 con 0x7f7b0c15e1d0 2023-10-09T06:21:47.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.059+0000 7f7b13f9c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0c5ff0 con 0x7f7b0c150730 2023-10-09T06:21:47.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.059+0000 7f7b13f9c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0c62d0 con 0x7f7af4003a60 2023-10-09T06:21:47.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b12539700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b0c15e1d0 0x7f7b0c15e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:47.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b12539700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b0c15e1d0 0x7f7b0c15e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44048/0 (socket says 172.21.15.31:44048) 2023-10-09T06:21:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b12539700 1 -- 172.21.15.31:0/1192139045 learned_addr learned my addr 172.21.15.31:0/1192139045 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b11537700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7b0c150730 0x7f7b0c0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b11d38700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7af4003a60 0x7f7b0c16a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b12539700 1 -- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7af4003a60 msgr2=0x7f7b0c16a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b12539700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7af4003a60 0x7f7b0c16a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b12539700 1 -- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7b0c150730 msgr2=0x7f7b0c0ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b12539700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7b0c150730 0x7f7b0c0ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b12539700 1 -- 172.21.15.31:0/1192139045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c0c65b0 con 0x7f7b0c15e1d0 2023-10-09T06:21:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b11d38700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7af4003a60 0x7f7b0c16a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b12539700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b0c15e1d0 0x7f7b0c15e670 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0ca070 tx=0x7f7afc009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b09ffb700 1 -- 172.21.15.31:0/1192139045 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc007ea0 con 0x7f7b0c15e1d0 2023-10-09T06:21:47.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b09ffb700 1 -- 172.21.15.31:0/1192139045 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc00f050 con 0x7f7b0c15e1d0 2023-10-09T06:21:47.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1192139045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0c0c6890 con 0x7f7b0c15e1d0 2023-10-09T06:21:47.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b09ffb700 1 -- 172.21.15.31:0/1192139045 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc014410 con 0x7f7b0c15e1d0 2023-10-09T06:21:47.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.060+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1192139045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0c0ce630 con 0x7f7b0c15e1d0 2023-10-09T06:21:47.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.061+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1192139045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b0c04c3c0 con 0x7f7b0c15e1d0 2023-10-09T06:21:47.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.062+0000 7f7b09ffb700 1 -- 172.21.15.31:0/1192139045 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7afc003040 con 0x7f7b0c15e1d0 2023-10-09T06:21:47.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.062+0000 7f7b09ffb700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7af8066f60 0x7f7af8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:47.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.062+0000 7f7b09ffb700 1 -- 172.21.15.31:0/1192139045 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7afc084780 con 0x7f7b0c15e1d0 2023-10-09T06:21:47.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.062+0000 7f7b11d38700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7af8066f60 0x7f7af8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:47.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.063+0000 7f7b11d38700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7af8066f60 0x7f7af8069410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400c3c0 tx=0x7f7b04015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:47.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.066+0000 7f7b09ffb700 1 -- 172.21.15.31:0/1192139045 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7afc0519f0 con 0x7f7b0c15e1d0 2023-10-09T06:21:47.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.303+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1192139045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7b0c068da0 con 0x7f7b0c15e1d0 2023-10-09T06:21:47.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.909+0000 7f7b09ffb700 1 -- 172.21.15.31:0/1192139045 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7afc055010 con 0x7f7b0c15e1d0 2023-10-09T06:21:47.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.912+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7af8066f60 msgr2=0x7f7af8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:47.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.912+0000 7f7b13f9c700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7af8066f60 0x7f7af8069410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400c3c0 tx=0x7f7b04015000 comp rx=0 tx=0).stop 2023-10-09T06:21:47.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.912+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1192139045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b0c15e1d0 msgr2=0x7f7b0c15e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:47.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.912+0000 7f7b13f9c700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b0c15e1d0 0x7f7b0c15e670 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0ca070 tx=0x7f7afc009870 comp rx=0 tx=0).stop 2023-10-09T06:21:47.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.912+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1192139045 shutdown_connections 2023-10-09T06:21:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.912+0000 7f7b13f9c700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7af8066f60 0x7f7af8069410 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.912+0000 7f7b13f9c700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7af4003a60 0x7f7b0c16a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.912+0000 7f7b13f9c700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b0c15e1d0 0x7f7b0c15e670 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.912+0000 7f7b13f9c700 1 --2- 172.21.15.31:0/1192139045 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7b0c150730 0x7f7b0c0ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.912+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1192139045 >> 172.21.15.31:0/1192139045 conn(0x7f7b0c069870 msgr2=0x7f7b0c0c39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.912+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1192139045 shutdown_connections 2023-10-09T06:21:47.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:47.912+0000 7f7b13f9c700 1 -- 172.21.15.31:0/1192139045 wait complete. 2023-10-09T06:21:47.926 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:21:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.048+0000 7f68ecef1700 1 Processor -- start 2023-10-09T06:21:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.048+0000 7f68ecef1700 1 -- start start 2023-10-09T06:21:48.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.049+0000 7f68ecef1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f68e80cc720 0x7f68e80cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.049+0000 7f68ecef1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68e80c9200 0x7f68e80b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.049+0000 7f68ecef1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68e80cba50 0x7f68e80cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.049+0000 7f68ecef1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e80caa60 con 0x7f68e80c9200 2023-10-09T06:21:48.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.049+0000 7f68ecef1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e80cf570 con 0x7f68e80cc720 2023-10-09T06:21:48.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.049+0000 7f68ecef1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e80cb5c0 con 0x7f68e80cba50 2023-10-09T06:21:48.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.049+0000 7f68e5d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68e80c9200 0x7f68e80b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.049+0000 7f68e5d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68e80c9200 0x7f68e80b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44064/0 (socket says 172.21.15.31:44064) 2023-10-09T06:21:48.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.049+0000 7f68e5d9b700 1 -- 172.21.15.31:0/49609184 learned_addr learned my addr 172.21.15.31:0/49609184 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:48.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.050+0000 7f68e6d9d700 1 --2- 172.21.15.31:0/49609184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68e80cba50 0x7f68e80cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.050+0000 7f68e659c700 1 --2- 172.21.15.31:0/49609184 >> v2:172.21.15.158:3300/0 conn(0x7f68e80cc720 0x7f68e80cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.050+0000 7f68e5d9b700 1 -- 172.21.15.31:0/49609184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68e80cba50 msgr2=0x7f68e80cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:48.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.050+0000 7f68e5d9b700 1 --2- 172.21.15.31:0/49609184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68e80cba50 0x7f68e80cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.050+0000 7f68e5d9b700 1 -- 172.21.15.31:0/49609184 >> v2:172.21.15.158:3300/0 conn(0x7f68e80cc720 msgr2=0x7f68e80cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:48.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.050+0000 7f68e5d9b700 1 --2- 172.21.15.31:0/49609184 >> v2:172.21.15.158:3300/0 conn(0x7f68e80cc720 0x7f68e80cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.050+0000 7f68e5d9b700 1 -- 172.21.15.31:0/49609184 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e80cac90 con 0x7f68e80c9200 2023-10-09T06:21:48.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.050+0000 7f68e5d9b700 1 --2- 172.21.15.31:0/49609184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e80c9200 0x7f68e80b18f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f68e80c9710 tx=0x7f68d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd8fe3d3ed66c61 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:48.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.050+0000 7f68e559a700 1 -- 172.21.15.31:0/49609184 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d000b860 con 0x7f68e80c9200 2023-10-09T06:21:48.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.050+0000 7f68e559a700 1 -- 172.21.15.31:0/49609184 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d000b9c0 con 0x7f68e80c9200 2023-10-09T06:21:48.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.050+0000 7f68e559a700 1 -- 172.21.15.31:0/49609184 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d000bd60 con 0x7f68e80c9200 2023-10-09T06:21:48.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.050+0000 7f68ecef1700 1 -- 172.21.15.31:0/49609184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e80c9200 msgr2=0x7f68e80b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.050+0000 7f68ecef1700 1 --2- 172.21.15.31:0/49609184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e80c9200 0x7f68e80b18f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f68e80c9710 tx=0x7f68d0009250 comp rx=0 tx=0).stop 2023-10-09T06:21:48.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.051+0000 7f68ecef1700 1 -- 172.21.15.31:0/49609184 shutdown_connections 2023-10-09T06:21:48.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.051+0000 7f68ecef1700 1 --2- 172.21.15.31:0/49609184 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68e80cba50 0x7f68e80cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.051+0000 7f68ecef1700 1 --2- 172.21.15.31:0/49609184 >> v2:172.21.15.158:3300/0 conn(0x7f68e80cc720 0x7f68e80cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.051+0000 7f68ecef1700 1 --2- 172.21.15.31:0/49609184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e80c9200 0x7f68e80b18f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.051+0000 7f68ecef1700 1 -- 172.21.15.31:0/49609184 >> 172.21.15.31:0/49609184 conn(0x7f68e806c6e0 msgr2=0x7f68e8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:48.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.051+0000 7f68ecef1700 1 -- 172.21.15.31:0/49609184 shutdown_connections 2023-10-09T06:21:48.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.051+0000 7f68ecef1700 1 -- 172.21.15.31:0/49609184 wait complete. 2023-10-09T06:21:48.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.052+0000 7f68ecef1700 1 Processor -- start 2023-10-09T06:21:48.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.052+0000 7f68ecef1700 1 -- start start 2023-10-09T06:21:48.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.052+0000 7f68ecef1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68e80c9200 0x7f68e8145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.052+0000 7f68ecef1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e80cba50 0x7f68e815c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68ecef1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68e80cc720 0x7f68e8145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68ecef1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e8145b90 con 0x7f68e80cba50 2023-10-09T06:21:48.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68ecef1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e80c6cf0 con 0x7f68e80cc720 2023-10-09T06:21:48.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68ecef1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e80c60e0 con 0x7f68e80c9200 2023-10-09T06:21:48.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68e5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e80cba50 0x7f68e815c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68e5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e80cba50 0x7f68e815c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44074/0 (socket says 172.21.15.31:44074) 2023-10-09T06:21:48.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68e5d9b700 1 -- 172.21.15.31:0/4137171830 learned_addr learned my addr 172.21.15.31:0/4137171830 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:48.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68e6d9d700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68e80cc720 0x7f68e8145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68e659c700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68e80c9200 0x7f68e8145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68e5d9b700 1 -- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68e80c9200 msgr2=0x7f68e8145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68e5d9b700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68e80c9200 0x7f68e8145650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68e5d9b700 1 -- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68e80cc720 msgr2=0x7f68e8145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68e5d9b700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68e80cc720 0x7f68e8145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68e5d9b700 1 -- 172.21.15.31:0/4137171830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d00094f0 con 0x7f68e80cba50 2023-10-09T06:21:48.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68e659c700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68e80c9200 0x7f68e8145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:48.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68e5d9b700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e80cba50 0x7f68e815c2a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f68d0006fd0 tx=0x7f68d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:48.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68de7fc700 1 -- 172.21.15.31:0/4137171830 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0011e30 con 0x7f68e80cba50 2023-10-09T06:21:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68de7fc700 1 -- 172.21.15.31:0/4137171830 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d0024440 con 0x7f68e80cba50 2023-10-09T06:21:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68ecef1700 1 -- 172.21.15.31:0/4137171830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e80c63c0 con 0x7f68e80cba50 2023-10-09T06:21:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68de7fc700 1 -- 172.21.15.31:0/4137171830 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0024800 con 0x7f68e80cba50 2023-10-09T06:21:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.053+0000 7f68ecef1700 1 -- 172.21.15.31:0/4137171830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e80c6980 con 0x7f68e80cba50 2023-10-09T06:21:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.054+0000 7f68ecef1700 1 -- 172.21.15.31:0/4137171830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e80c6e80 con 0x7f68e80cba50 2023-10-09T06:21:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.055+0000 7f68de7fc700 1 -- 172.21.15.31:0/4137171830 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68d001a420 con 0x7f68e80cba50 2023-10-09T06:21:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.055+0000 7f68de7fc700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68c8066f30 0x7f68c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.055+0000 7f68de7fc700 1 -- 172.21.15.31:0/4137171830 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68d0086420 con 0x7f68e80cba50 2023-10-09T06:21:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.055+0000 7f68e659c700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68c8066f30 0x7f68c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.056+0000 7f68e659c700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68c8066f30 0x7f68c80693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009fd0 tx=0x7f68e0009740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:48.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.060+0000 7f68de7fc700 1 -- 172.21.15.31:0/4137171830 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68d0053690 con 0x7f68e80cba50 2023-10-09T06:21:48.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.295+0000 7f68ecef1700 1 -- 172.21.15.31:0/4137171830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68e804c3c0 con 0x7f68e80cba50 2023-10-09T06:21:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.295+0000 7f68de7fc700 1 -- 172.21.15.31:0/4137171830 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f68d0056cb0 con 0x7f68e80cba50 2023-10-09T06:21:48.296 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:48.296 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1792934235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1792934235},{"type":"v1","addr":"172.21.15.158:6837","nonce":1792934235}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/893363730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":893363730},{"type":"v1","addr":"172.21.15.31:6834","nonce":893363730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4923,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2780075004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2780075004},{"type":"v1","addr":"172.21.15.31:6835","nonce":2780075004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:21:44.276772+0000","modified":"2023-10-09T06:21:47.908951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6836/1041874650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1041874650},{"type":"v1","addr":"172.21.15.158:6836","nonce":1041874650}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:21:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.297+0000 7f68ecef1700 1 -- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68c8066f30 msgr2=0x7f68c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.297+0000 7f68ecef1700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68c8066f30 0x7f68c80693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009fd0 tx=0x7f68e0009740 comp rx=0 tx=0).stop 2023-10-09T06:21:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.297+0000 7f68ecef1700 1 -- 172.21.15.31:0/4137171830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e80cba50 msgr2=0x7f68e815c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.297+0000 7f68ecef1700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e80cba50 0x7f68e815c2a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f68d0006fd0 tx=0x7f68d0017000 comp rx=0 tx=0).stop 2023-10-09T06:21:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.297+0000 7f68ecef1700 1 -- 172.21.15.31:0/4137171830 shutdown_connections 2023-10-09T06:21:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.297+0000 7f68ecef1700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68c8066f30 0x7f68c80693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.297+0000 7f68ecef1700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68e80c9200 0x7f68e8145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.297+0000 7f68ecef1700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68e80cc720 0x7f68e8145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.297+0000 7f68ecef1700 1 --2- 172.21.15.31:0/4137171830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e80cba50 0x7f68e815c2a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.297+0000 7f68ecef1700 1 -- 172.21.15.31:0/4137171830 >> 172.21.15.31:0/4137171830 conn(0x7f68e806c6e0 msgr2=0x7f68e80c5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.297+0000 7f68ecef1700 1 -- 172.21.15.31:0/4137171830 shutdown_connections 2023-10-09T06:21:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.297+0000 7f68ecef1700 1 -- 172.21.15.31:0/4137171830 wait complete. 2023-10-09T06:21:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 16 2023-10-09T06:21:48.310 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:48.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.427+0000 7f700e0a0700 1 Processor -- start 2023-10-09T06:21:48.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.427+0000 7f700e0a0700 1 -- start start 2023-10-09T06:21:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.428+0000 7f700e0a0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7008157870 0x7f700815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.428+0000 7f700e0a0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f700815a620 0x7f700815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.428+0000 7f700e0a0700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700815cbb0 con 0x7f700815d580 2023-10-09T06:21:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.428+0000 7f700e0a0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700815bfa0 con 0x7f7008157870 2023-10-09T06:21:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.428+0000 7f700e0a0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700815c280 con 0x7f700815a620 2023-10-09T06:21:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.428+0000 7f7007fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f700815d580 0x7f7008158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:59258/0 (socket says 172.21.15.31:59258) 2023-10-09T06:21:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.429+0000 7f7007fff700 1 -- 172.21.15.31:0/1412009351 learned_addr learned my addr 172.21.15.31:0/1412009351 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.429+0000 7f70077fe700 1 --2- 172.21.15.31:0/1412009351 >> v2:172.21.15.158:3300/0 conn(0x7f7008157870 0x7f700815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.429+0000 7f7006ffd700 1 --2- 172.21.15.31:0/1412009351 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f700815a620 0x7f700815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.429+0000 7f70067fc700 1 -- 172.21.15.31:0/1412009351 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218080516 0 0) 0x7f700815cbb0 con 0x7f700815d580 2023-10-09T06:21:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.429+0000 7f70067fc700 1 -- 172.21.15.31:0/1412009351 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff0003570 con 0x7f700815d580 2023-10-09T06:21:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.429+0000 7f70077fe700 1 -- 172.21.15.31:0/1412009351 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f700815a620 msgr2=0x7f700815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.429+0000 7f70077fe700 1 --2- 172.21.15.31:0/1412009351 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f700815a620 0x7f700815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.429+0000 7f70077fe700 1 -- 172.21.15.31:0/1412009351 >> v1:172.21.15.158:6789/0 conn(0x7f700815d580 legacy=0x7f7008158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.429+0000 7f70077fe700 1 -- 172.21.15.31:0/1412009351 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700815c560 con 0x7f7008157870 2023-10-09T06:21:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.429+0000 7f70077fe700 1 --2- 172.21.15.31:0/1412009351 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7008157870 0x7f700815b6a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80098e0 tx=0x7f6ff80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee48f16e34a4da5a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.429+0000 7f70067fc700 1 -- 172.21.15.31:0/1412009351 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8011630 con 0x7f7008157870 2023-10-09T06:21:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.429+0000 7f70067fc700 1 -- 172.21.15.31:0/1412009351 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff8011790 con 0x7f7008157870 2023-10-09T06:21:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.429+0000 7f70067fc700 1 -- 172.21.15.31:0/1412009351 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8011b30 con 0x7f7008157870 2023-10-09T06:21:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.430+0000 7f700e0a0700 1 -- 172.21.15.31:0/1412009351 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7008157870 msgr2=0x7f700815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.430+0000 7f700e0a0700 1 --2- 172.21.15.31:0/1412009351 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7008157870 0x7f700815b6a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80098e0 tx=0x7f6ff80091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.430+0000 7f700e0a0700 1 -- 172.21.15.31:0/1412009351 shutdown_connections 2023-10-09T06:21:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.430+0000 7f700e0a0700 1 --2- 172.21.15.31:0/1412009351 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7008157870 0x7f700815b6a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.430+0000 7f700e0a0700 1 --2- 172.21.15.31:0/1412009351 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f700815a620 0x7f700815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.430+0000 7f700e0a0700 1 -- 172.21.15.31:0/1412009351 >> 172.21.15.31:0/1412009351 conn(0x7f7008068ce0 msgr2=0x7f70080690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.430+0000 7f700e0a0700 1 -- 172.21.15.31:0/1412009351 shutdown_connections 2023-10-09T06:21:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.430+0000 7f700e0a0700 1 -- 172.21.15.31:0/1412009351 wait complete. 2023-10-09T06:21:48.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.431+0000 7f700e0a0700 1 Processor -- start 2023-10-09T06:21:48.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.431+0000 7f700e0a0700 1 -- start start 2023-10-09T06:21:48.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f700e0a0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7008157870 0x7f70080cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f700e0a0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f700815a620 0x7f70080b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f700e0a0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f700815d580 0x7f70080b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f700e0a0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70080d01e0 con 0x7f700815d580 2023-10-09T06:21:48.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f700e0a0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700816aba0 con 0x7f700815a620 2023-10-09T06:21:48.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f700e0a0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70080d0a70 con 0x7f7008157870 2023-10-09T06:21:48.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f7007fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f700815d580 0x7f70080b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f7007fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f700815d580 0x7f70080b0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44078/0 (socket says 172.21.15.31:44078) 2023-10-09T06:21:48.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f7007fff700 1 -- 172.21.15.31:0/3922868844 learned_addr learned my addr 172.21.15.31:0/3922868844 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f70077fe700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7008157870 0x7f70080cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f7006ffd700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f700815a620 0x7f70080b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f7007fff700 1 -- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7008157870 msgr2=0x7f70080cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f7007fff700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7008157870 0x7f70080cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f7007fff700 1 -- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f700815a620 msgr2=0x7f70080b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f7007fff700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f700815a620 0x7f70080b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.432+0000 7f7007fff700 1 -- 172.21.15.31:0/3922868844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff8009420 con 0x7f700815d580 2023-10-09T06:21:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.433+0000 7f7007fff700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f700815d580 0x7f70080b0610 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f700000cc40 tx=0x7f7000001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.433+0000 7f6fef7fe700 1 -- 172.21.15.31:0/3922868844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700000a8b0 con 0x7f700815d580 2023-10-09T06:21:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.433+0000 7f700e0a0700 1 -- 172.21.15.31:0/3922868844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70080cf940 con 0x7f700815d580 2023-10-09T06:21:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.433+0000 7f6fef7fe700 1 -- 172.21.15.31:0/3922868844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700000aa10 con 0x7f700815d580 2023-10-09T06:21:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.433+0000 7f6fef7fe700 1 -- 172.21.15.31:0/3922868844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700000ad90 con 0x7f700815d580 2023-10-09T06:21:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.433+0000 7f700e0a0700 1 -- 172.21.15.31:0/3922868844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70080cff00 con 0x7f700815d580 2023-10-09T06:21:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.434+0000 7f700e0a0700 1 -- 172.21.15.31:0/3922868844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700816a970 con 0x7f700815d580 2023-10-09T06:21:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.434+0000 7f6fef7fe700 1 -- 172.21.15.31:0/3922868844 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7000007300 con 0x7f700815d580 2023-10-09T06:21:48.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.435+0000 7f6fef7fe700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ff4066f30 0x7f6ff40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.435+0000 7f6fef7fe700 1 -- 172.21.15.31:0/3922868844 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70000848b0 con 0x7f700815d580 2023-10-09T06:21:48.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.435+0000 7f70077fe700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ff4066f30 0x7f6ff40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.435+0000 7f70077fe700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ff4066f30 0x7f6ff40693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80091e0 tx=0x7f6ff8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:48.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.439+0000 7f6fef7fe700 1 -- 172.21.15.31:0/3922868844 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f700816a970 con 0x7f700815d580 2023-10-09T06:21:48.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.634+0000 7f700e0a0700 1 -- 172.21.15.31:0/3922868844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f700816a970 con 0x7f700815d580 2023-10-09T06:21:48.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.635+0000 7f6fef7fe700 1 -- 172.21.15.31:0/3922868844 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f700816a970 con 0x7f700815d580 2023-10-09T06:21:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:48.636 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":32,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:21:45.884902+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:21:42.035162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T06:21:43.259545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:48.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.637+0000 7f700e0a0700 1 -- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ff4066f30 msgr2=0x7f6ff40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.637+0000 7f700e0a0700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ff4066f30 0x7f6ff40693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80091e0 tx=0x7f6ff8017000 comp rx=0 tx=0).stop 2023-10-09T06:21:48.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.637+0000 7f700e0a0700 1 -- 172.21.15.31:0/3922868844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f700815d580 msgr2=0x7f70080b0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.637+0000 7f700e0a0700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f700815d580 0x7f70080b0610 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f700000cc40 tx=0x7f7000001a00 comp rx=0 tx=0).stop 2023-10-09T06:21:48.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.637+0000 7f700e0a0700 1 -- 172.21.15.31:0/3922868844 shutdown_connections 2023-10-09T06:21:48.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.637+0000 7f700e0a0700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ff4066f30 0x7f6ff40693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.637+0000 7f700e0a0700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7008157870 0x7f70080cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.637+0000 7f700e0a0700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f700815d580 0x7f70080b0610 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.637+0000 7f700e0a0700 1 --2- 172.21.15.31:0/3922868844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f700815a620 0x7f70080b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.637+0000 7f700e0a0700 1 -- 172.21.15.31:0/3922868844 >> 172.21.15.31:0/3922868844 conn(0x7f7008068ce0 msgr2=0x7f7008155fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:48.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.637+0000 7f700e0a0700 1 -- 172.21.15.31:0/3922868844 shutdown_connections 2023-10-09T06:21:48.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.637+0000 7f700e0a0700 1 -- 172.21.15.31:0/3922868844 wait complete. 2023-10-09T06:21:48.650 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:21:48.650 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:21:48.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.768+0000 7f8dd1e79700 1 Processor -- start 2023-10-09T06:21:48.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.768+0000 7f8dd1e79700 1 -- start start 2023-10-09T06:21:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dd1e79700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dcc159f10 0x7f8dcc0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dd1e79700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8dcc15a2e0 0x7f8dcc0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dd1e79700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dcc15a730 con 0x7f8dcc0cc240 2023-10-09T06:21:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dd1e79700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dcc0ae320 con 0x7f8dcc15a2e0 2023-10-09T06:21:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dd1e79700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc0ad710 con 0x7f8dcc159f10 2023-10-09T06:21:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dd1678700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8dcc0cc240 0x7f8dcc0ae7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40732/0 (socket says 172.21.15.31:40732) 2023-10-09T06:21:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dcbfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8dcc15a2e0 0x7f8dcc0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dd1678700 1 -- 172.21.15.31:0/3557665585 learned_addr learned my addr 172.21.15.31:0/3557665585 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dd0e77700 1 --2- 172.21.15.31:0/3557665585 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dcc159f10 0x7f8dcc0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dcb7fe700 1 -- 172.21.15.31:0/3557665585 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532058042 0 0) 0x7f8dc4001490 con 0x7f8dcc0cc240 2023-10-09T06:21:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dcb7fe700 1 -- 172.21.15.31:0/3557665585 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8db4003570 con 0x7f8dcc0cc240 2023-10-09T06:21:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dcbfff700 1 -- 172.21.15.31:0/3557665585 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dcc159f10 msgr2=0x7f8dcc0c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dcbfff700 1 --2- 172.21.15.31:0/3557665585 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dcc159f10 0x7f8dcc0c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dcbfff700 1 -- 172.21.15.31:0/3557665585 >> v1:172.21.15.31:6789/0 conn(0x7f8dcc0cc240 legacy=0x7f8dcc0ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.769+0000 7f8dcbfff700 1 -- 172.21.15.31:0/3557665585 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc0ad9f0 con 0x7f8dcc15a2e0 2023-10-09T06:21:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.770+0000 7f8dcbfff700 1 --2- 172.21.15.31:0/3557665585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dcc15a2e0 0x7f8dcc0cbd00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00098e0 tx=0x7f8dc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33131ed90c50ad6a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.770+0000 7f8dcb7fe700 1 -- 172.21.15.31:0/3557665585 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc000b640 con 0x7f8dcc15a2e0 2023-10-09T06:21:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.770+0000 7f8dcb7fe700 1 -- 172.21.15.31:0/3557665585 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc000b7a0 con 0x7f8dcc15a2e0 2023-10-09T06:21:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.770+0000 7f8dcb7fe700 1 -- 172.21.15.31:0/3557665585 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc000bb40 con 0x7f8dcc15a2e0 2023-10-09T06:21:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.770+0000 7f8dd1e79700 1 -- 172.21.15.31:0/3557665585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dcc15a2e0 msgr2=0x7f8dcc0cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.770+0000 7f8dd1e79700 1 --2- 172.21.15.31:0/3557665585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dcc15a2e0 0x7f8dcc0cbd00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00098e0 tx=0x7f8dc00091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.770+0000 7f8dd1e79700 1 -- 172.21.15.31:0/3557665585 shutdown_connections 2023-10-09T06:21:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.770+0000 7f8dd1e79700 1 --2- 172.21.15.31:0/3557665585 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dcc159f10 0x7f8dcc0c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.770+0000 7f8dd1e79700 1 --2- 172.21.15.31:0/3557665585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dcc15a2e0 0x7f8dcc0cbd00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.770+0000 7f8dd1e79700 1 -- 172.21.15.31:0/3557665585 >> 172.21.15.31:0/3557665585 conn(0x7f8dcc067e40 msgr2=0x7f8dcc0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:48.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.770+0000 7f8dd1e79700 1 -- 172.21.15.31:0/3557665585 shutdown_connections 2023-10-09T06:21:48.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.770+0000 7f8dd1e79700 1 -- 172.21.15.31:0/3557665585 wait complete. 2023-10-09T06:21:48.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.771+0000 7f8dd1e79700 1 Processor -- start 2023-10-09T06:21:48.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.772+0000 7f8dd1e79700 1 -- start start 2023-10-09T06:21:48.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.772+0000 7f8dd1e79700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dcc0cc240 0x7f8dcc155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.772+0000 7f8dd1e79700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dcc159f10 0x7f8dcc154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.772+0000 7f8dd1e79700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dcc15a2e0 0x7f8dcc15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.772+0000 7f8dd1e79700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc155760 con 0x7f8dcc0cc240 2023-10-09T06:21:48.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.772+0000 7f8dd1e79700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc156130 con 0x7f8dcc15a2e0 2023-10-09T06:21:48.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.772+0000 7f8dd1e79700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc154640 con 0x7f8dcc159f10 2023-10-09T06:21:48.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.772+0000 7f8dd0e77700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dcc0cc240 0x7f8dcc155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.772+0000 7f8dd0e77700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dcc0cc240 0x7f8dcc155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44090/0 (socket says 172.21.15.31:44090) 2023-10-09T06:21:48.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.772+0000 7f8dd0e77700 1 -- 172.21.15.31:0/2632235018 learned_addr learned my addr 172.21.15.31:0/2632235018 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:48.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.772+0000 7f8dd1678700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dcc15a2e0 0x7f8dcc15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.772+0000 7f8dcbfff700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dcc159f10 0x7f8dcc154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.773+0000 7f8dd0e77700 1 -- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dcc159f10 msgr2=0x7f8dcc154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.773+0000 7f8dd0e77700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dcc159f10 0x7f8dcc154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.773+0000 7f8dd0e77700 1 -- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dcc15a2e0 msgr2=0x7f8dcc15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.773+0000 7f8dd0e77700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dcc15a2e0 0x7f8dcc15b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.773+0000 7f8dd0e77700 1 -- 172.21.15.31:0/2632235018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc0009420 con 0x7f8dcc0cc240 2023-10-09T06:21:48.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.773+0000 7f8dd0e77700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dcc0cc240 0x7f8dcc155bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00d890 tx=0x7f8dbc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:48.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.773+0000 7f8dc8ff9700 1 -- 172.21.15.31:0/2632235018 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc00b600 con 0x7f8dcc0cc240 2023-10-09T06:21:48.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.773+0000 7f8dc8ff9700 1 -- 172.21.15.31:0/2632235018 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc00b760 con 0x7f8dcc0cc240 2023-10-09T06:21:48.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.773+0000 7f8dd1e79700 1 -- 172.21.15.31:0/2632235018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dcc154870 con 0x7f8dcc0cc240 2023-10-09T06:21:48.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.773+0000 7f8dc8ff9700 1 -- 172.21.15.31:0/2632235018 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc00bae0 con 0x7f8dcc0cc240 2023-10-09T06:21:48.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.773+0000 7f8dd1e79700 1 -- 172.21.15.31:0/2632235018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dcc154e30 con 0x7f8dcc0cc240 2023-10-09T06:21:48.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.774+0000 7f8dd1e79700 1 -- 172.21.15.31:0/2632235018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dcc155a40 con 0x7f8dcc0cc240 2023-10-09T06:21:48.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.774+0000 7f8dc8ff9700 1 -- 172.21.15.31:0/2632235018 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8dbc01e460 con 0x7f8dcc0cc240 2023-10-09T06:21:48.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.775+0000 7f8dc8ff9700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8db8066f30 0x7f8db80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:48.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.775+0000 7f8dc8ff9700 1 -- 172.21.15.31:0/2632235018 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8dbc084c40 con 0x7f8dcc0cc240 2023-10-09T06:21:48.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.775+0000 7f8dcbfff700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8db8066f30 0x7f8db80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:48.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.775+0000 7f8dcbfff700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8db8066f30 0x7f8db80693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00093f0 tx=0x7f8dc0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:48.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.779+0000 7f8dc8ff9700 1 -- 172.21.15.31:0/2632235018 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8dbc051eb0 con 0x7f8dcc0cc240 2023-10-09T06:21:48.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.966+0000 7f8dd1e79700 1 -- 172.21.15.31:0/2632235018 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8dcc1558a0 con 0x7f8db8066f30 2023-10-09T06:21:48.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.975+0000 7f8dc8ff9700 1 -- 172.21.15.31:0/2632235018 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283967 (secure 0 0 0) 0x7f8dc0000c50 con 0x7f8db8066f30 2023-10-09T06:21:48.979 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:48.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.978+0000 7f8dd1e79700 1 -- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8db8066f30 msgr2=0x7f8db80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.978+0000 7f8dd1e79700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8db8066f30 0x7f8db80693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00093f0 tx=0x7f8dc0017000 comp rx=0 tx=0).stop 2023-10-09T06:21:48.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.978+0000 7f8dd1e79700 1 -- 172.21.15.31:0/2632235018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dcc0cc240 msgr2=0x7f8dcc155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:48.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.978+0000 7f8dd1e79700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dcc0cc240 0x7f8dcc155bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00d890 tx=0x7f8dbc008040 comp rx=0 tx=0).stop 2023-10-09T06:21:48.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.978+0000 7f8dd1e79700 1 -- 172.21.15.31:0/2632235018 shutdown_connections 2023-10-09T06:21:48.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.978+0000 7f8dd1e79700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8db8066f30 0x7f8db80693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.978+0000 7f8dd1e79700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dcc15a2e0 0x7f8dcc15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.978+0000 7f8dd1e79700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dcc0cc240 0x7f8dcc155bf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.978+0000 7f8dd1e79700 1 --2- 172.21.15.31:0/2632235018 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dcc159f10 0x7f8dcc154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:48.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.978+0000 7f8dd1e79700 1 -- 172.21.15.31:0/2632235018 >> 172.21.15.31:0/2632235018 conn(0x7f8dcc067e40 msgr2=0x7f8dcc0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:48.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.978+0000 7f8dd1e79700 1 -- 172.21.15.31:0/2632235018 shutdown_connections 2023-10-09T06:21:48.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:48.978+0000 7f8dd1e79700 1 -- 172.21.15.31:0/2632235018 wait complete. 2023-10-09T06:21:48.985 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:21:48.991 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-09T06:21:48.531149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2242,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560257,"statfs":{"total":1600000000,"available":1597703796,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.660115"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.901273+0000","last_change":"2023-10-09T06:21:44.901207+0000","last_active":"2023-10-09T06:21:44.901273+0000","last_peered":"2023-10-09T06:21:44.901273+0000","last_clean":"2023-10-09T06:21:44.901273+0000","last_became_active":"2023-10-09T06:21:44.900986+0000","last_became_peered":"2023-10-09T06:21:44.900986+0000","last_unstale":"2023-10-09T06:21:44.901273+0000","last_undegraded":"2023-10-09T06:21:44.901273+0000","last_fullsized":"2023-10-09T06:21:44.901273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:26:40.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897044+0000","last_change":"2023-10-09T06:21:44.896287+0000","last_active":"2023-10-09T06:21:44.897044+0000","last_peered":"2023-10-09T06:21:44.897044+0000","last_clean":"2023-10-09T06:21:44.897044+0000","last_became_active":"2023-10-09T06:21:44.896069+0000","last_became_peered":"2023-10-09T06:21:44.896069+0000","last_unstale":"2023-10-09T06:21:44.897044+0000","last_undegraded":"2023-10-09T06:21:44.897044+0000","last_fullsized":"2023-10-09T06:21:44.897044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:27:19.328015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.899880+0000","last_change":"2023-10-09T06:21:44.899829+0000","last_active":"2023-10-09T06:21:44.899880+0000","last_peered":"2023-10-09T06:21:44.899880+0000","last_clean":"2023-10-09T06:21:44.899880+0000","last_became_active":"2023-10-09T06:21:44.899619+0000","last_became_peered":"2023-10-09T06:21:44.899619+0000","last_unstale":"2023-10-09T06:21:44.899880+0000","last_undegraded":"2023-10-09T06:21:44.899880+0000","last_fullsized":"2023-10-09T06:21:44.899880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:02.533604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.889860+0000","last_change":"2023-10-09T06:21:44.889688+0000","last_active":"2023-10-09T06:21:44.889860+0000","last_peered":"2023-10-09T06:21:44.889860+0000","last_clean":"2023-10-09T06:21:44.889860+0000","last_became_active":"2023-10-09T06:21:44.889471+0000","last_became_peered":"2023-10-09T06:21:44.889471+0000","last_unstale":"2023-10-09T06:21:44.889860+0000","last_undegraded":"2023-10-09T06:21:44.889860+0000","last_fullsized":"2023-10-09T06:21:44.889860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:10.322515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.892660+0000","last_change":"2023-10-09T06:21:44.892581+0000","last_active":"2023-10-09T06:21:44.892660+0000","last_peered":"2023-10-09T06:21:44.892660+0000","last_clean":"2023-10-09T06:21:44.892660+0000","last_became_active":"2023-10-09T06:21:44.892362+0000","last_became_peered":"2023-10-09T06:21:44.892362+0000","last_unstale":"2023-10-09T06:21:44.892660+0000","last_undegraded":"2023-10-09T06:21:44.892660+0000","last_fullsized":"2023-10-09T06:21:44.892660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:40.094258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.900640+0000","last_change":"2023-10-09T06:21:44.900520+0000","last_active":"2023-10-09T06:21:44.900640+0000","last_peered":"2023-10-09T06:21:44.900640+0000","last_clean":"2023-10-09T06:21:44.900640+0000","last_became_active":"2023-10-09T06:21:44.900324+0000","last_became_peered":"2023-10-09T06:21:44.900324+0000","last_unstale":"2023-10-09T06:21:44.900640+0000","last_undegraded":"2023-10-09T06:21:44.900640+0000","last_fullsized":"2023-10-09T06:21:44.900640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:02.533604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.896235+0000","last_change":"2023-10-09T06:21:44.896130+0000","last_active":"2023-10-09T06:21:44.896235+0000","last_peered":"2023-10-09T06:21:44.896235+0000","last_clean":"2023-10-09T06:21:44.896235+0000","last_became_active":"2023-10-09T06:21:44.895620+0000","last_became_peered":"2023-10-09T06:21:44.895620+0000","last_unstale":"2023-10-09T06:21:44.896235+0000","last_undegraded":"2023-10-09T06:21:44.896235+0000","last_fullsized":"2023-10-09T06:21:44.896235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:50:10.283484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897363+0000","last_change":"2023-10-09T06:21:44.897252+0000","last_active":"2023-10-09T06:21:44.897363+0000","last_peered":"2023-10-09T06:21:44.897363+0000","last_clean":"2023-10-09T06:21:44.897363+0000","last_became_active":"2023-10-09T06:21:44.895849+0000","last_became_peered":"2023-10-09T06:21:44.895849+0000","last_unstale":"2023-10-09T06:21:44.897363+0000","last_undegraded":"2023-10-09T06:21:44.897363+0000","last_fullsized":"2023-10-09T06:21:44.897363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:06.309775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.891823+0000","last_change":"2023-10-09T06:21:44.891767+0000","last_active":"2023-10-09T06:21:44.891823+0000","last_peered":"2023-10-09T06:21:44.891823+0000","last_clean":"2023-10-09T06:21:44.891823+0000","last_became_active":"2023-10-09T06:21:44.890912+0000","last_became_peered":"2023-10-09T06:21:44.890912+0000","last_unstale":"2023-10-09T06:21:44.891823+0000","last_undegraded":"2023-10-09T06:21:44.891823+0000","last_fullsized":"2023-10-09T06:21:44.891823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:28:25.465656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.890929+0000","last_change":"2023-10-09T06:21:44.890668+0000","last_active":"2023-10-09T06:21:44.890929+0000","last_peered":"2023-10-09T06:21:44.890929+0000","last_clean":"2023-10-09T06:21:44.890929+0000","last_became_active":"2023-10-09T06:21:44.890433+0000","last_became_peered":"2023-10-09T06:21:44.890433+0000","last_unstale":"2023-10-09T06:21:44.890929+0000","last_undegraded":"2023-10-09T06:21:44.890929+0000","last_fullsized":"2023-10-09T06:21:44.890929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:50:10.283484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895284+0000","last_change":"2023-10-09T06:21:44.895222+0000","last_active":"2023-10-09T06:21:44.895284+0000","last_peered":"2023-10-09T06:21:44.895284+0000","last_clean":"2023-10-09T06:21:44.895284+0000","last_became_active":"2023-10-09T06:21:44.894993+0000","last_became_peered":"2023-10-09T06:21:44.894993+0000","last_unstale":"2023-10-09T06:21:44.895284+0000","last_undegraded":"2023-10-09T06:21:44.895284+0000","last_fullsized":"2023-10-09T06:21:44.895284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:06.837494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.901310+0000","last_change":"2023-10-09T06:21:44.901077+0000","last_active":"2023-10-09T06:21:44.901310+0000","last_peered":"2023-10-09T06:21:44.901310+0000","last_clean":"2023-10-09T06:21:44.901310+0000","last_became_active":"2023-10-09T06:21:44.900334+0000","last_became_peered":"2023-10-09T06:21:44.900334+0000","last_unstale":"2023-10-09T06:21:44.901310+0000","last_undegraded":"2023-10-09T06:21:44.901310+0000","last_fullsized":"2023-10-09T06:21:44.901310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:17.852524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.889894+0000","last_change":"2023-10-09T06:21:44.889825+0000","last_active":"2023-10-09T06:21:44.889894+0000","last_peered":"2023-10-09T06:21:44.889894+0000","last_clean":"2023-10-09T06:21:44.889894+0000","last_became_active":"2023-10-09T06:21:44.889631+0000","last_became_peered":"2023-10-09T06:21:44.889631+0000","last_unstale":"2023-10-09T06:21:44.889894+0000","last_undegraded":"2023-10-09T06:21:44.889894+0000","last_fullsized":"2023-10-09T06:21:44.889894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:00.201008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895392+0000","last_change":"2023-10-09T06:21:44.895316+0000","last_active":"2023-10-09T06:21:44.895392+0000","last_peered":"2023-10-09T06:21:44.895392+0000","last_clean":"2023-10-09T06:21:44.895392+0000","last_became_active":"2023-10-09T06:21:44.894794+0000","last_became_peered":"2023-10-09T06:21:44.894794+0000","last_unstale":"2023-10-09T06:21:44.895392+0000","last_undegraded":"2023-10-09T06:21:44.895392+0000","last_fullsized":"2023-10-09T06:21:44.895392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:06.309775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.900232+0000","last_change":"2023-10-09T06:21:44.900171+0000","last_active":"2023-10-09T06:21:44.900232+0000","last_peered":"2023-10-09T06:21:44.900232+0000","last_clean":"2023-10-09T06:21:44.900232+0000","last_became_active":"2023-10-09T06:21:44.899954+0000","last_became_peered":"2023-10-09T06:21:44.899954+0000","last_unstale":"2023-10-09T06:21:44.900232+0000","last_undegraded":"2023-10-09T06:21:44.900232+0000","last_fullsized":"2023-10-09T06:21:44.900232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:18:12.153830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.899172+0000","last_change":"2023-10-09T06:21:44.899108+0000","last_active":"2023-10-09T06:21:44.899172+0000","last_peered":"2023-10-09T06:21:44.899172+0000","last_clean":"2023-10-09T06:21:44.899172+0000","last_became_active":"2023-10-09T06:21:44.898737+0000","last_became_peered":"2023-10-09T06:21:44.898737+0000","last_unstale":"2023-10-09T06:21:44.899172+0000","last_undegraded":"2023-10-09T06:21:44.899172+0000","last_fullsized":"2023-10-09T06:21:44.899172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:27:19.328015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.896376+0000","last_change":"2023-10-09T06:21:44.896318+0000","last_active":"2023-10-09T06:21:44.896376+0000","last_peered":"2023-10-09T06:21:44.896376+0000","last_clean":"2023-10-09T06:21:44.896376+0000","last_became_active":"2023-10-09T06:21:44.895911+0000","last_became_peered":"2023-10-09T06:21:44.895911+0000","last_unstale":"2023-10-09T06:21:44.896376+0000","last_undegraded":"2023-10-09T06:21:44.896376+0000","last_fullsized":"2023-10-09T06:21:44.896376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:29.470571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.892691+0000","last_change":"2023-10-09T06:21:44.892330+0000","last_active":"2023-10-09T06:21:44.892691+0000","last_peered":"2023-10-09T06:21:44.892691+0000","last_clean":"2023-10-09T06:21:44.892691+0000","last_became_active":"2023-10-09T06:21:44.892078+0000","last_became_peered":"2023-10-09T06:21:44.892078+0000","last_unstale":"2023-10-09T06:21:44.892691+0000","last_undegraded":"2023-10-09T06:21:44.892691+0000","last_fullsized":"2023-10-09T06:21:44.892691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:29.440729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897026+0000","last_change":"2023-10-09T06:21:44.896217+0000","last_active":"2023-10-09T06:21:44.897026+0000","last_peered":"2023-10-09T06:21:44.897026+0000","last_clean":"2023-10-09T06:21:44.897026+0000","last_became_active":"2023-10-09T06:21:44.895626+0000","last_became_peered":"2023-10-09T06:21:44.895626+0000","last_unstale":"2023-10-09T06:21:44.897026+0000","last_undegraded":"2023-10-09T06:21:44.897026+0000","last_fullsized":"2023-10-09T06:21:44.897026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:01.374097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897984+0000","last_change":"2023-10-09T06:21:44.897927+0000","last_active":"2023-10-09T06:21:44.897984+0000","last_peered":"2023-10-09T06:21:44.897984+0000","last_clean":"2023-10-09T06:21:44.897984+0000","last_became_active":"2023-10-09T06:21:44.897737+0000","last_became_peered":"2023-10-09T06:21:44.897737+0000","last_unstale":"2023-10-09T06:21:44.897984+0000","last_undegraded":"2023-10-09T06:21:44.897984+0000","last_fullsized":"2023-10-09T06:21:44.897984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:02.366721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.896055+0000","last_change":"2023-10-09T06:21:44.895993+0000","last_active":"2023-10-09T06:21:44.896055+0000","last_peered":"2023-10-09T06:21:44.896055+0000","last_clean":"2023-10-09T06:21:44.896055+0000","last_became_active":"2023-10-09T06:21:44.895765+0000","last_became_peered":"2023-10-09T06:21:44.895765+0000","last_unstale":"2023-10-09T06:21:44.896055+0000","last_undegraded":"2023-10-09T06:21:44.896055+0000","last_fullsized":"2023-10-09T06:21:44.896055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:47.120088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894194+0000","last_change":"2023-10-09T06:21:44.894120+0000","last_active":"2023-10-09T06:21:44.894194+0000","last_peered":"2023-10-09T06:21:44.894194+0000","last_clean":"2023-10-09T06:21:44.894194+0000","last_became_active":"2023-10-09T06:21:44.893520+0000","last_became_peered":"2023-10-09T06:21:44.893520+0000","last_unstale":"2023-10-09T06:21:44.894194+0000","last_undegraded":"2023-10-09T06:21:44.894194+0000","last_fullsized":"2023-10-09T06:21:44.894194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:18:12.153830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895061+0000","last_change":"2023-10-09T06:21:44.894838+0000","last_active":"2023-10-09T06:21:44.895061+0000","last_peered":"2023-10-09T06:21:44.895061+0000","last_clean":"2023-10-09T06:21:44.895061+0000","last_became_active":"2023-10-09T06:21:44.894625+0000","last_became_peered":"2023-10-09T06:21:44.894625+0000","last_unstale":"2023-10-09T06:21:44.895061+0000","last_undegraded":"2023-10-09T06:21:44.895061+0000","last_fullsized":"2023-10-09T06:21:44.895061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:47.120088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.899121+0000","last_change":"2023-10-09T06:21:44.898499+0000","last_active":"2023-10-09T06:21:44.899121+0000","last_peered":"2023-10-09T06:21:44.899121+0000","last_clean":"2023-10-09T06:21:44.899121+0000","last_became_active":"2023-10-09T06:21:44.898043+0000","last_became_peered":"2023-10-09T06:21:44.898043+0000","last_unstale":"2023-10-09T06:21:44.899121+0000","last_undegraded":"2023-10-09T06:21:44.899121+0000","last_fullsized":"2023-10-09T06:21:44.899121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:06.309775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.892226+0000","last_change":"2023-10-09T06:21:44.892155+0000","last_active":"2023-10-09T06:21:44.892226+0000","last_peered":"2023-10-09T06:21:44.892226+0000","last_clean":"2023-10-09T06:21:44.892226+0000","last_became_active":"2023-10-09T06:21:44.891721+0000","last_became_peered":"2023-10-09T06:21:44.891721+0000","last_unstale":"2023-10-09T06:21:44.892226+0000","last_undegraded":"2023-10-09T06:21:44.892226+0000","last_fullsized":"2023-10-09T06:21:44.892226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:54.195601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895730+0000","last_change":"2023-10-09T06:21:44.895666+0000","last_active":"2023-10-09T06:21:44.895730+0000","last_peered":"2023-10-09T06:21:44.895730+0000","last_clean":"2023-10-09T06:21:44.895730+0000","last_became_active":"2023-10-09T06:21:44.895039+0000","last_became_peered":"2023-10-09T06:21:44.895039+0000","last_unstale":"2023-10-09T06:21:44.895730+0000","last_undegraded":"2023-10-09T06:21:44.895730+0000","last_fullsized":"2023-10-09T06:21:44.895730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:06.837494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.892739+0000","last_change":"2023-10-09T06:21:44.892629+0000","last_active":"2023-10-09T06:21:44.892739+0000","last_peered":"2023-10-09T06:21:44.892739+0000","last_clean":"2023-10-09T06:21:44.892739+0000","last_became_active":"2023-10-09T06:21:44.892265+0000","last_became_peered":"2023-10-09T06:21:44.892265+0000","last_unstale":"2023-10-09T06:21:44.892739+0000","last_undegraded":"2023-10-09T06:21:44.892739+0000","last_fullsized":"2023-10-09T06:21:44.892739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:18:12.153830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.902900+0000","last_change":"2023-10-09T06:21:44.902824+0000","last_active":"2023-10-09T06:21:44.902900+0000","last_peered":"2023-10-09T06:21:44.902900+0000","last_clean":"2023-10-09T06:21:44.902900+0000","last_became_active":"2023-10-09T06:21:44.902562+0000","last_became_peered":"2023-10-09T06:21:44.902562+0000","last_unstale":"2023-10-09T06:21:44.902900+0000","last_undegraded":"2023-10-09T06:21:44.902900+0000","last_fullsized":"2023-10-09T06:21:44.902900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:27:19.328015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.893922+0000","last_change":"2023-10-09T06:21:44.892208+0000","last_active":"2023-10-09T06:21:44.893922+0000","last_peered":"2023-10-09T06:21:44.893922+0000","last_clean":"2023-10-09T06:21:44.893922+0000","last_became_active":"2023-10-09T06:21:44.891972+0000","last_became_peered":"2023-10-09T06:21:44.891972+0000","last_unstale":"2023-10-09T06:21:44.893922+0000","last_undegraded":"2023-10-09T06:21:44.893922+0000","last_fullsized":"2023-10-09T06:21:44.893922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:10.322515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.898260+0000","last_change":"2023-10-09T06:21:44.898011+0000","last_active":"2023-10-09T06:21:44.898260+0000","last_peered":"2023-10-09T06:21:44.898260+0000","last_clean":"2023-10-09T06:21:44.898260+0000","last_became_active":"2023-10-09T06:21:44.897452+0000","last_became_peered":"2023-10-09T06:21:44.897452+0000","last_unstale":"2023-10-09T06:21:44.898260+0000","last_undegraded":"2023-10-09T06:21:44.898260+0000","last_fullsized":"2023-10-09T06:21:44.898260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:47:52.815298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897307+0000","last_change":"2023-10-09T06:21:44.897214+0000","last_active":"2023-10-09T06:21:44.897307+0000","last_peered":"2023-10-09T06:21:44.897307+0000","last_clean":"2023-10-09T06:21:44.897307+0000","last_became_active":"2023-10-09T06:21:44.896924+0000","last_became_peered":"2023-10-09T06:21:44.896924+0000","last_unstale":"2023-10-09T06:21:44.897307+0000","last_undegraded":"2023-10-09T06:21:44.897307+0000","last_fullsized":"2023-10-09T06:21:44.897307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:43.291037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895157+0000","last_change":"2023-10-09T06:21:44.895049+0000","last_active":"2023-10-09T06:21:44.895157+0000","last_peered":"2023-10-09T06:21:44.895157+0000","last_clean":"2023-10-09T06:21:44.895157+0000","last_became_active":"2023-10-09T06:21:44.894813+0000","last_became_peered":"2023-10-09T06:21:44.894813+0000","last_unstale":"2023-10-09T06:21:44.895157+0000","last_undegraded":"2023-10-09T06:21:44.895157+0000","last_fullsized":"2023-10-09T06:21:44.895157+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:17.852524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.896625+0000","last_change":"2023-10-09T06:21:44.896555+0000","last_active":"2023-10-09T06:21:44.896625+0000","last_peered":"2023-10-09T06:21:44.896625+0000","last_clean":"2023-10-09T06:21:44.896625+0000","last_became_active":"2023-10-09T06:21:44.896001+0000","last_became_peered":"2023-10-09T06:21:44.896001+0000","last_unstale":"2023-10-09T06:21:44.896625+0000","last_undegraded":"2023-10-09T06:21:44.896625+0000","last_fullsized":"2023-10-09T06:21:44.896625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:26:40.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908297+0000","last_change":"2023-10-09T06:21:43.883129+0000","last_active":"2023-10-09T06:21:44.908297+0000","last_peered":"2023-10-09T06:21:44.908297+0000","last_clean":"2023-10-09T06:21:44.908297+0000","last_became_active":"2023-10-09T06:21:43.882867+0000","last_became_peered":"2023-10-09T06:21:43.882867+0000","last_unstale":"2023-10-09T06:21:44.908297+0000","last_undegraded":"2023-10-09T06:21:44.908297+0000","last_fullsized":"2023-10-09T06:21:44.908297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:09.773232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.891952+0000","last_change":"2023-10-09T06:21:44.891757+0000","last_active":"2023-10-09T06:21:44.891952+0000","last_peered":"2023-10-09T06:21:44.891952+0000","last_clean":"2023-10-09T06:21:44.891952+0000","last_became_active":"2023-10-09T06:21:44.891507+0000","last_became_peered":"2023-10-09T06:21:44.891507+0000","last_unstale":"2023-10-09T06:21:44.891952+0000","last_undegraded":"2023-10-09T06:21:44.891952+0000","last_fullsized":"2023-10-09T06:21:44.891952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:15:32.019098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908042+0000","last_change":"2023-10-09T06:21:43.885343+0000","last_active":"2023-10-09T06:21:44.908042+0000","last_peered":"2023-10-09T06:21:44.908042+0000","last_clean":"2023-10-09T06:21:44.908042+0000","last_became_active":"2023-10-09T06:21:43.884873+0000","last_became_peered":"2023-10-09T06:21:43.884873+0000","last_unstale":"2023-10-09T06:21:44.908042+0000","last_undegraded":"2023-10-09T06:21:44.908042+0000","last_fullsized":"2023-10-09T06:21:44.908042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:09.773232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894782+0000","last_change":"2023-10-09T06:21:44.894722+0000","last_active":"2023-10-09T06:21:44.894782+0000","last_peered":"2023-10-09T06:21:44.894782+0000","last_clean":"2023-10-09T06:21:44.894782+0000","last_became_active":"2023-10-09T06:21:44.894491+0000","last_became_peered":"2023-10-09T06:21:44.894491+0000","last_unstale":"2023-10-09T06:21:44.894782+0000","last_undegraded":"2023-10-09T06:21:44.894782+0000","last_fullsized":"2023-10-09T06:21:44.894782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:26:40.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.909851+0000","last_change":"2023-10-09T06:21:43.888981+0000","last_active":"2023-10-09T06:21:44.909851+0000","last_peered":"2023-10-09T06:21:44.909851+0000","last_clean":"2023-10-09T06:21:44.909851+0000","last_became_active":"2023-10-09T06:21:43.888750+0000","last_became_peered":"2023-10-09T06:21:43.888750+0000","last_unstale":"2023-10-09T06:21:44.909851+0000","last_undegraded":"2023-10-09T06:21:44.909851+0000","last_fullsized":"2023-10-09T06:21:44.909851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:15:31.014816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894726+0000","last_change":"2023-10-09T06:21:44.894664+0000","last_active":"2023-10-09T06:21:44.894726+0000","last_peered":"2023-10-09T06:21:44.894726+0000","last_clean":"2023-10-09T06:21:44.894726+0000","last_became_active":"2023-10-09T06:21:44.894380+0000","last_became_peered":"2023-10-09T06:21:44.894380+0000","last_unstale":"2023-10-09T06:21:44.894726+0000","last_undegraded":"2023-10-09T06:21:44.894726+0000","last_fullsized":"2023-10-09T06:21:44.894726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:29.470571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.909615+0000","last_change":"2023-10-09T06:21:43.886115+0000","last_active":"2023-10-09T06:21:44.909615+0000","last_peered":"2023-10-09T06:21:44.909615+0000","last_clean":"2023-10-09T06:21:44.909615+0000","last_became_active":"2023-10-09T06:21:43.885883+0000","last_became_peered":"2023-10-09T06:21:43.885883+0000","last_unstale":"2023-10-09T06:21:44.909615+0000","last_undegraded":"2023-10-09T06:21:44.909615+0000","last_fullsized":"2023-10-09T06:21:44.909615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:51.691940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.892759+0000","last_change":"2023-10-09T06:21:44.892664+0000","last_active":"2023-10-09T06:21:44.892759+0000","last_peered":"2023-10-09T06:21:44.892759+0000","last_clean":"2023-10-09T06:21:44.892759+0000","last_became_active":"2023-10-09T06:21:44.892087+0000","last_became_peered":"2023-10-09T06:21:44.892087+0000","last_unstale":"2023-10-09T06:21:44.892759+0000","last_undegraded":"2023-10-09T06:21:44.892759+0000","last_fullsized":"2023-10-09T06:21:44.892759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:42:55.463742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908006+0000","last_change":"2023-10-09T06:21:43.882030+0000","last_active":"2023-10-09T06:21:44.908006+0000","last_peered":"2023-10-09T06:21:44.908006+0000","last_clean":"2023-10-09T06:21:44.908006+0000","last_became_active":"2023-10-09T06:21:43.881060+0000","last_became_peered":"2023-10-09T06:21:43.881060+0000","last_unstale":"2023-10-09T06:21:44.908006+0000","last_undegraded":"2023-10-09T06:21:44.908006+0000","last_fullsized":"2023-10-09T06:21:44.908006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:02.773971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.902306+0000","last_change":"2023-10-09T06:21:44.902257+0000","last_active":"2023-10-09T06:21:44.902306+0000","last_peered":"2023-10-09T06:21:44.902306+0000","last_clean":"2023-10-09T06:21:44.902306+0000","last_became_active":"2023-10-09T06:21:44.902105+0000","last_became_peered":"2023-10-09T06:21:44.902105+0000","last_unstale":"2023-10-09T06:21:44.902306+0000","last_undegraded":"2023-10-09T06:21:44.902306+0000","last_fullsized":"2023-10-09T06:21:44.902306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:29.470571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.907971+0000","last_change":"2023-10-09T06:21:43.881125+0000","last_active":"2023-10-09T06:21:44.907971+0000","last_peered":"2023-10-09T06:21:44.907971+0000","last_clean":"2023-10-09T06:21:44.907971+0000","last_became_active":"2023-10-09T06:21:43.880892+0000","last_became_peered":"2023-10-09T06:21:43.880892+0000","last_unstale":"2023-10-09T06:21:44.907971+0000","last_undegraded":"2023-10-09T06:21:44.907971+0000","last_fullsized":"2023-10-09T06:21:44.907971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:01.362439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.898817+0000","last_change":"2023-10-09T06:21:44.898588+0000","last_active":"2023-10-09T06:21:44.898817+0000","last_peered":"2023-10-09T06:21:44.898817+0000","last_clean":"2023-10-09T06:21:44.898817+0000","last_became_active":"2023-10-09T06:21:44.898086+0000","last_became_peered":"2023-10-09T06:21:44.898086+0000","last_unstale":"2023-10-09T06:21:44.898817+0000","last_undegraded":"2023-10-09T06:21:44.898817+0000","last_fullsized":"2023-10-09T06:21:44.898817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:12.807403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.888791+0000","last_change":"2023-10-09T06:21:43.883361+0000","last_active":"2023-10-09T06:21:44.888791+0000","last_peered":"2023-10-09T06:21:44.888791+0000","last_clean":"2023-10-09T06:21:44.888791+0000","last_became_active":"2023-10-09T06:21:43.882960+0000","last_became_peered":"2023-10-09T06:21:43.882960+0000","last_unstale":"2023-10-09T06:21:44.888791+0000","last_undegraded":"2023-10-09T06:21:44.888791+0000","last_fullsized":"2023-10-09T06:21:44.888791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:46.115806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.900020+0000","last_change":"2023-10-09T06:21:44.899920+0000","last_active":"2023-10-09T06:21:44.900020+0000","last_peered":"2023-10-09T06:21:44.900020+0000","last_clean":"2023-10-09T06:21:44.900020+0000","last_became_active":"2023-10-09T06:21:44.899712+0000","last_became_peered":"2023-10-09T06:21:44.899712+0000","last_unstale":"2023-10-09T06:21:44.900020+0000","last_undegraded":"2023-10-09T06:21:44.900020+0000","last_fullsized":"2023-10-09T06:21:44.900020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:47.120088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.891405+0000","last_change":"2023-10-09T06:21:43.880029+0000","last_active":"2023-10-09T06:21:44.891405+0000","last_peered":"2023-10-09T06:21:44.891405+0000","last_clean":"2023-10-09T06:21:44.891405+0000","last_became_active":"2023-10-09T06:21:43.879294+0000","last_became_peered":"2023-10-09T06:21:43.879294+0000","last_unstale":"2023-10-09T06:21:44.891405+0000","last_undegraded":"2023-10-09T06:21:44.891405+0000","last_fullsized":"2023-10-09T06:21:44.891405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:39.089976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.901293+0000","last_change":"2023-10-09T06:21:44.900940+0000","last_active":"2023-10-09T06:21:44.901293+0000","last_peered":"2023-10-09T06:21:44.901293+0000","last_clean":"2023-10-09T06:21:44.901293+0000","last_became_active":"2023-10-09T06:21:44.900097+0000","last_became_peered":"2023-10-09T06:21:44.900097+0000","last_unstale":"2023-10-09T06:21:44.901293+0000","last_undegraded":"2023-10-09T06:21:44.901293+0000","last_fullsized":"2023-10-09T06:21:44.901293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:34.291489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.889709+0000","last_change":"2023-10-09T06:21:43.885219+0000","last_active":"2023-10-09T06:21:44.889709+0000","last_peered":"2023-10-09T06:21:44.889709+0000","last_clean":"2023-10-09T06:21:44.889709+0000","last_became_active":"2023-10-09T06:21:43.884738+0000","last_became_peered":"2023-10-09T06:21:43.884738+0000","last_unstale":"2023-10-09T06:21:44.889709+0000","last_undegraded":"2023-10-09T06:21:44.889709+0000","last_fullsized":"2023-10-09T06:21:44.889709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:14:49.994917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895357+0000","last_change":"2023-10-09T06:21:44.895280+0000","last_active":"2023-10-09T06:21:44.895357+0000","last_peered":"2023-10-09T06:21:44.895357+0000","last_clean":"2023-10-09T06:21:44.895357+0000","last_became_active":"2023-10-09T06:21:44.894013+0000","last_became_peered":"2023-10-09T06:21:44.894013+0000","last_unstale":"2023-10-09T06:21:44.895357+0000","last_undegraded":"2023-10-09T06:21:44.895357+0000","last_fullsized":"2023-10-09T06:21:44.895357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:54.245307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895088+0000","last_change":"2023-10-09T06:21:43.881572+0000","last_active":"2023-10-09T06:21:44.895088+0000","last_peered":"2023-10-09T06:21:44.895088+0000","last_clean":"2023-10-09T06:21:44.895088+0000","last_became_active":"2023-10-09T06:21:43.881336+0000","last_became_peered":"2023-10-09T06:21:43.881336+0000","last_unstale":"2023-10-09T06:21:44.895088+0000","last_undegraded":"2023-10-09T06:21:44.895088+0000","last_fullsized":"2023-10-09T06:21:44.895088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:01.362439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897087+0000","last_change":"2023-10-09T06:21:44.896862+0000","last_active":"2023-10-09T06:21:44.897087+0000","last_peered":"2023-10-09T06:21:44.897087+0000","last_clean":"2023-10-09T06:21:44.897087+0000","last_became_active":"2023-10-09T06:21:44.896573+0000","last_became_peered":"2023-10-09T06:21:44.896573+0000","last_unstale":"2023-10-09T06:21:44.897087+0000","last_undegraded":"2023-10-09T06:21:44.897087+0000","last_fullsized":"2023-10-09T06:21:44.897087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:37.824326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908979+0000","last_change":"2023-10-09T06:21:43.885360+0000","last_active":"2023-10-09T06:21:44.908979+0000","last_peered":"2023-10-09T06:21:44.908979+0000","last_clean":"2023-10-09T06:21:44.908979+0000","last_became_active":"2023-10-09T06:21:43.885151+0000","last_became_peered":"2023-10-09T06:21:43.885151+0000","last_unstale":"2023-10-09T06:21:44.908979+0000","last_undegraded":"2023-10-09T06:21:44.908979+0000","last_fullsized":"2023-10-09T06:21:44.908979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:12.031411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.900783+0000","last_change":"2023-10-09T06:21:44.900721+0000","last_active":"2023-10-09T06:21:44.900783+0000","last_peered":"2023-10-09T06:21:44.900783+0000","last_clean":"2023-10-09T06:21:44.900783+0000","last_became_active":"2023-10-09T06:21:44.900510+0000","last_became_peered":"2023-10-09T06:21:44.900510+0000","last_unstale":"2023-10-09T06:21:44.900783+0000","last_undegraded":"2023-10-09T06:21:44.900783+0000","last_fullsized":"2023-10-09T06:21:44.900783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:06.837494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.910457+0000","last_change":"2023-10-09T06:21:43.886976+0000","last_active":"2023-10-09T06:21:44.910457+0000","last_peered":"2023-10-09T06:21:44.910457+0000","last_clean":"2023-10-09T06:21:44.910457+0000","last_became_active":"2023-10-09T06:21:43.886369+0000","last_became_peered":"2023-10-09T06:21:43.886369+0000","last_unstale":"2023-10-09T06:21:44.910457+0000","last_undegraded":"2023-10-09T06:21:44.910457+0000","last_fullsized":"2023-10-09T06:21:44.910457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:42.286755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.901097+0000","last_change":"2023-10-09T06:21:44.901047+0000","last_active":"2023-10-09T06:21:44.901097+0000","last_peered":"2023-10-09T06:21:44.901097+0000","last_clean":"2023-10-09T06:21:44.901097+0000","last_became_active":"2023-10-09T06:21:44.900851+0000","last_became_peered":"2023-10-09T06:21:44.900851+0000","last_unstale":"2023-10-09T06:21:44.901097+0000","last_undegraded":"2023-10-09T06:21:44.901097+0000","last_fullsized":"2023-10-09T06:21:44.901097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:34.291489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.907936+0000","last_change":"2023-10-09T06:21:43.880761+0000","last_active":"2023-10-09T06:21:44.907936+0000","last_peered":"2023-10-09T06:21:44.907936+0000","last_clean":"2023-10-09T06:21:44.907936+0000","last_became_active":"2023-10-09T06:21:43.879595+0000","last_became_peered":"2023-10-09T06:21:43.879595+0000","last_unstale":"2023-10-09T06:21:44.907936+0000","last_undegraded":"2023-10-09T06:21:44.907936+0000","last_fullsized":"2023-10-09T06:21:44.907936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:01:31.851116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.893749+0000","last_change":"2023-10-09T06:21:44.893705+0000","last_active":"2023-10-09T06:21:44.893749+0000","last_peered":"2023-10-09T06:21:44.893749+0000","last_clean":"2023-10-09T06:21:44.893749+0000","last_became_active":"2023-10-09T06:21:44.893510+0000","last_became_peered":"2023-10-09T06:21:44.893510+0000","last_unstale":"2023-10-09T06:21:44.893749+0000","last_undegraded":"2023-10-09T06:21:44.893749+0000","last_fullsized":"2023-10-09T06:21:44.893749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:17.852524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.886179+0000","last_change":"2023-10-09T06:21:43.885053+0000","last_active":"2023-10-09T06:21:44.886179+0000","last_peered":"2023-10-09T06:21:44.886179+0000","last_clean":"2023-10-09T06:21:44.886179+0000","last_became_active":"2023-10-09T06:21:43.884790+0000","last_became_peered":"2023-10-09T06:21:43.884790+0000","last_unstale":"2023-10-09T06:21:44.886179+0000","last_undegraded":"2023-10-09T06:21:44.886179+0000","last_fullsized":"2023-10-09T06:21:44.886179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:30.273920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.893462+0000","last_change":"2023-10-09T06:21:44.893265+0000","last_active":"2023-10-09T06:21:44.893462+0000","last_peered":"2023-10-09T06:21:44.893462+0000","last_clean":"2023-10-09T06:21:44.893462+0000","last_became_active":"2023-10-09T06:21:44.892411+0000","last_became_peered":"2023-10-09T06:21:44.892411+0000","last_unstale":"2023-10-09T06:21:44.893462+0000","last_undegraded":"2023-10-09T06:21:44.893462+0000","last_fullsized":"2023-10-09T06:21:44.893462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:34.291489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.887878+0000","last_change":"2023-10-09T06:21:43.885216+0000","last_active":"2023-10-09T06:21:44.887878+0000","last_peered":"2023-10-09T06:21:44.887878+0000","last_clean":"2023-10-09T06:21:44.887878+0000","last_became_active":"2023-10-09T06:21:43.884959+0000","last_became_peered":"2023-10-09T06:21:43.884959+0000","last_unstale":"2023-10-09T06:21:44.887878+0000","last_undegraded":"2023-10-09T06:21:44.887878+0000","last_fullsized":"2023-10-09T06:21:44.887878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:09.661454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.898115+0000","last_change":"2023-10-09T06:21:44.898034+0000","last_active":"2023-10-09T06:21:44.898115+0000","last_peered":"2023-10-09T06:21:44.898115+0000","last_clean":"2023-10-09T06:21:44.898115+0000","last_became_active":"2023-10-09T06:21:44.897663+0000","last_became_peered":"2023-10-09T06:21:44.897663+0000","last_unstale":"2023-10-09T06:21:44.898115+0000","last_undegraded":"2023-10-09T06:21:44.898115+0000","last_fullsized":"2023-10-09T06:21:44.898115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:10.665736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.910019+0000","last_change":"2023-10-09T06:21:43.886786+0000","last_active":"2023-10-09T06:21:44.910019+0000","last_peered":"2023-10-09T06:21:44.910019+0000","last_clean":"2023-10-09T06:21:44.910019+0000","last_became_active":"2023-10-09T06:21:43.886323+0000","last_became_peered":"2023-10-09T06:21:43.886323+0000","last_unstale":"2023-10-09T06:21:44.910019+0000","last_undegraded":"2023-10-09T06:21:44.910019+0000","last_fullsized":"2023-10-09T06:21:44.910019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:26:39.669965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.898833+0000","last_change":"2023-10-09T06:21:44.898736+0000","last_active":"2023-10-09T06:21:44.898833+0000","last_peered":"2023-10-09T06:21:44.898833+0000","last_clean":"2023-10-09T06:21:44.898833+0000","last_became_active":"2023-10-09T06:21:44.898366+0000","last_became_peered":"2023-10-09T06:21:44.898366+0000","last_unstale":"2023-10-09T06:21:44.898833+0000","last_undegraded":"2023-10-09T06:21:44.898833+0000","last_fullsized":"2023-10-09T06:21:44.898833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:54.195601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908122+0000","last_change":"2023-10-09T06:21:43.886393+0000","last_active":"2023-10-09T06:21:44.908122+0000","last_peered":"2023-10-09T06:21:44.908122+0000","last_clean":"2023-10-09T06:21:44.908122+0000","last_became_active":"2023-10-09T06:21:43.886154+0000","last_became_peered":"2023-10-09T06:21:43.886154+0000","last_unstale":"2023-10-09T06:21:44.908122+0000","last_undegraded":"2023-10-09T06:21:44.908122+0000","last_fullsized":"2023-10-09T06:21:44.908122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:09.773232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.899083+0000","last_change":"2023-10-09T06:21:44.898350+0000","last_active":"2023-10-09T06:21:44.899083+0000","last_peered":"2023-10-09T06:21:44.899083+0000","last_clean":"2023-10-09T06:21:44.899083+0000","last_became_active":"2023-10-09T06:21:44.897739+0000","last_became_peered":"2023-10-09T06:21:44.897739+0000","last_unstale":"2023-10-09T06:21:44.899083+0000","last_undegraded":"2023-10-09T06:21:44.899083+0000","last_fullsized":"2023-10-09T06:21:44.899083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:46.401951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.907765+0000","last_change":"2023-10-09T06:21:43.881952+0000","last_active":"2023-10-09T06:21:44.907765+0000","last_peered":"2023-10-09T06:21:44.907765+0000","last_clean":"2023-10-09T06:21:44.907765+0000","last_became_active":"2023-10-09T06:21:43.881721+0000","last_became_peered":"2023-10-09T06:21:43.881721+0000","last_unstale":"2023-10-09T06:21:44.907765+0000","last_undegraded":"2023-10-09T06:21:44.907765+0000","last_fullsized":"2023-10-09T06:21:44.907765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:26:40.217662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.892720+0000","last_change":"2023-10-09T06:21:44.892490+0000","last_active":"2023-10-09T06:21:44.892720+0000","last_peered":"2023-10-09T06:21:44.892720+0000","last_clean":"2023-10-09T06:21:44.892720+0000","last_became_active":"2023-10-09T06:21:44.891956+0000","last_became_peered":"2023-10-09T06:21:44.891956+0000","last_unstale":"2023-10-09T06:21:44.892720+0000","last_undegraded":"2023-10-09T06:21:44.892720+0000","last_fullsized":"2023-10-09T06:21:44.892720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:28:25.465656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908635+0000","last_change":"2023-10-09T06:21:43.877352+0000","last_active":"2023-10-09T06:21:44.908635+0000","last_peered":"2023-10-09T06:21:44.908635+0000","last_clean":"2023-10-09T06:21:44.908635+0000","last_became_active":"2023-10-09T06:21:43.877131+0000","last_became_peered":"2023-10-09T06:21:43.877131+0000","last_unstale":"2023-10-09T06:21:44.908635+0000","last_undegraded":"2023-10-09T06:21:44.908635+0000","last_fullsized":"2023-10-09T06:21:44.908635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:58.954030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894062+0000","last_change":"2023-10-09T06:21:44.893602+0000","last_active":"2023-10-09T06:21:44.894062+0000","last_peered":"2023-10-09T06:21:44.894062+0000","last_clean":"2023-10-09T06:21:44.894062+0000","last_became_active":"2023-10-09T06:21:44.893385+0000","last_became_peered":"2023-10-09T06:21:44.893385+0000","last_unstale":"2023-10-09T06:21:44.894062+0000","last_undegraded":"2023-10-09T06:21:44.894062+0000","last_fullsized":"2023-10-09T06:21:44.894062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:31.278203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.890654+0000","last_change":"2023-10-09T06:21:43.882168+0000","last_active":"2023-10-09T06:21:44.890654+0000","last_peered":"2023-10-09T06:21:44.890654+0000","last_clean":"2023-10-09T06:21:44.890654+0000","last_became_active":"2023-10-09T06:21:43.881359+0000","last_became_peered":"2023-10-09T06:21:43.881359+0000","last_unstale":"2023-10-09T06:21:44.890654+0000","last_undegraded":"2023-10-09T06:21:44.890654+0000","last_fullsized":"2023-10-09T06:21:44.890654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:04.038400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894045+0000","last_change":"2023-10-09T06:21:44.893031+0000","last_active":"2023-10-09T06:21:44.894045+0000","last_peered":"2023-10-09T06:21:44.894045+0000","last_clean":"2023-10-09T06:21:44.894045+0000","last_became_active":"2023-10-09T06:21:44.892784+0000","last_became_peered":"2023-10-09T06:21:44.892784+0000","last_unstale":"2023-10-09T06:21:44.894045+0000","last_undegraded":"2023-10-09T06:21:44.894045+0000","last_fullsized":"2023-10-09T06:21:44.894045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:10.777514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.909551+0000","last_change":"2023-10-09T06:21:43.883145+0000","last_active":"2023-10-09T06:21:44.909551+0000","last_peered":"2023-10-09T06:21:44.909551+0000","last_clean":"2023-10-09T06:21:44.909551+0000","last_became_active":"2023-10-09T06:21:43.882810+0000","last_became_peered":"2023-10-09T06:21:43.882810+0000","last_unstale":"2023-10-09T06:21:44.909551+0000","last_undegraded":"2023-10-09T06:21:44.909551+0000","last_fullsized":"2023-10-09T06:21:44.909551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:30.273920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897047+0000","last_change":"2023-10-09T06:21:44.896986+0000","last_active":"2023-10-09T06:21:44.897047+0000","last_peered":"2023-10-09T06:21:44.897047+0000","last_clean":"2023-10-09T06:21:44.897047+0000","last_became_active":"2023-10-09T06:21:44.896757+0000","last_became_peered":"2023-10-09T06:21:44.896757+0000","last_unstale":"2023-10-09T06:21:44.897047+0000","last_undegraded":"2023-10-09T06:21:44.897047+0000","last_fullsized":"2023-10-09T06:21:44.897047+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:09.781837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.888180+0000","last_change":"2023-10-09T06:21:43.880928+0000","last_active":"2023-10-09T06:21:44.888180+0000","last_peered":"2023-10-09T06:21:44.888180+0000","last_clean":"2023-10-09T06:21:44.888180+0000","last_became_active":"2023-10-09T06:21:43.880414+0000","last_became_peered":"2023-10-09T06:21:43.880414+0000","last_unstale":"2023-10-09T06:21:44.888180+0000","last_undegraded":"2023-10-09T06:21:44.888180+0000","last_fullsized":"2023-10-09T06:21:44.888180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:30.273920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897645+0000","last_change":"2023-10-09T06:21:44.897580+0000","last_active":"2023-10-09T06:21:44.897645+0000","last_peered":"2023-10-09T06:21:44.897645+0000","last_clean":"2023-10-09T06:21:44.897645+0000","last_became_active":"2023-10-09T06:21:44.897158+0000","last_became_peered":"2023-10-09T06:21:44.897158+0000","last_unstale":"2023-10-09T06:21:44.897645+0000","last_undegraded":"2023-10-09T06:21:44.897645+0000","last_fullsized":"2023-10-09T06:21:44.897645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:09.971549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.891589+0000","last_change":"2023-10-09T06:21:43.884264+0000","last_active":"2023-10-09T06:21:44.891589+0000","last_peered":"2023-10-09T06:21:44.891589+0000","last_clean":"2023-10-09T06:21:44.891589+0000","last_became_active":"2023-10-09T06:21:43.884034+0000","last_became_peered":"2023-10-09T06:21:43.884034+0000","last_unstale":"2023-10-09T06:21:44.891589+0000","last_undegraded":"2023-10-09T06:21:44.891589+0000","last_fullsized":"2023-10-09T06:21:44.891589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:09.378864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.898276+0000","last_change":"2023-10-09T06:21:44.898175+0000","last_active":"2023-10-09T06:21:44.898276+0000","last_peered":"2023-10-09T06:21:44.898276+0000","last_clean":"2023-10-09T06:21:44.898276+0000","last_became_active":"2023-10-09T06:21:44.897768+0000","last_became_peered":"2023-10-09T06:21:44.897768+0000","last_unstale":"2023-10-09T06:21:44.898276+0000","last_undegraded":"2023-10-09T06:21:44.898276+0000","last_fullsized":"2023-10-09T06:21:44.898276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:46.401951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.899834+0000","last_change":"2023-10-09T06:21:43.885869+0000","last_active":"2023-10-09T06:21:44.899834+0000","last_peered":"2023-10-09T06:21:44.899834+0000","last_clean":"2023-10-09T06:21:44.899834+0000","last_became_active":"2023-10-09T06:21:43.885610+0000","last_became_peered":"2023-10-09T06:21:43.885610+0000","last_unstale":"2023-10-09T06:21:44.899834+0000","last_undegraded":"2023-10-09T06:21:44.899834+0000","last_fullsized":"2023-10-09T06:21:44.899834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:09.661454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.900995+0000","last_change":"2023-10-09T06:21:44.900930+0000","last_active":"2023-10-09T06:21:44.900995+0000","last_peered":"2023-10-09T06:21:44.900995+0000","last_clean":"2023-10-09T06:21:44.900995+0000","last_became_active":"2023-10-09T06:21:44.900696+0000","last_became_peered":"2023-10-09T06:21:44.900696+0000","last_unstale":"2023-10-09T06:21:44.900995+0000","last_undegraded":"2023-10-09T06:21:44.900995+0000","last_fullsized":"2023-10-09T06:21:44.900995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:14:50.999199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908970+0000","last_change":"2023-10-09T06:21:43.886421+0000","last_active":"2023-10-09T06:21:44.908970+0000","last_peered":"2023-10-09T06:21:44.908970+0000","last_clean":"2023-10-09T06:21:44.908970+0000","last_became_active":"2023-10-09T06:21:43.885417+0000","last_became_peered":"2023-10-09T06:21:43.885417+0000","last_unstale":"2023-10-09T06:21:44.908970+0000","last_undegraded":"2023-10-09T06:21:44.908970+0000","last_fullsized":"2023-10-09T06:21:44.908970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:39.089976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.901325+0000","last_change":"2023-10-09T06:21:44.901216+0000","last_active":"2023-10-09T06:21:44.901325+0000","last_peered":"2023-10-09T06:21:44.901325+0000","last_clean":"2023-10-09T06:21:44.901325+0000","last_became_active":"2023-10-09T06:21:44.900678+0000","last_became_peered":"2023-10-09T06:21:44.900678+0000","last_unstale":"2023-10-09T06:21:44.901325+0000","last_undegraded":"2023-10-09T06:21:44.901325+0000","last_fullsized":"2023-10-09T06:21:44.901325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:50:10.283484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-09T06:21:46.004261+0000","last_change":"2023-10-09T06:21:43.879771+0000","last_active":"2023-10-09T06:21:46.004261+0000","last_peered":"2023-10-09T06:21:46.004261+0000","last_clean":"2023-10-09T06:21:46.004261+0000","last_became_active":"2023-10-09T06:21:43.879548+0000","last_became_peered":"2023-10-09T06:21:43.879548+0000","last_unstale":"2023-10-09T06:21:46.004261+0000","last_undegraded":"2023-10-09T06:21:46.004261+0000","last_fullsized":"2023-10-09T06:21:46.004261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:39.089976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.896915+0000","last_change":"2023-10-09T06:21:44.896696+0000","last_active":"2023-10-09T06:21:44.896915+0000","last_peered":"2023-10-09T06:21:44.896915+0000","last_clean":"2023-10-09T06:21:44.896915+0000","last_became_active":"2023-10-09T06:21:44.896331+0000","last_became_peered":"2023-10-09T06:21:44.896331+0000","last_unstale":"2023-10-09T06:21:44.896915+0000","last_undegraded":"2023-10-09T06:21:44.896915+0000","last_fullsized":"2023-10-09T06:21:44.896915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:15:32.019098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.886767+0000","last_change":"2023-10-09T06:21:43.888365+0000","last_active":"2023-10-09T06:21:44.886767+0000","last_peered":"2023-10-09T06:21:44.886767+0000","last_clean":"2023-10-09T06:21:44.886767+0000","last_became_active":"2023-10-09T06:21:43.887826+0000","last_became_peered":"2023-10-09T06:21:43.887826+0000","last_unstale":"2023-10-09T06:21:44.886767+0000","last_undegraded":"2023-10-09T06:21:44.886767+0000","last_fullsized":"2023-10-09T06:21:44.886767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:08.777554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.898097+0000","last_change":"2023-10-09T06:21:44.897898+0000","last_active":"2023-10-09T06:21:44.898097+0000","last_peered":"2023-10-09T06:21:44.898097+0000","last_clean":"2023-10-09T06:21:44.898097+0000","last_became_active":"2023-10-09T06:21:44.896985+0000","last_became_peered":"2023-10-09T06:21:44.896985+0000","last_unstale":"2023-10-09T06:21:44.898097+0000","last_undegraded":"2023-10-09T06:21:44.898097+0000","last_fullsized":"2023-10-09T06:21:44.898097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:47.120088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894017+0000","last_change":"2023-10-09T06:21:43.878693+0000","last_active":"2023-10-09T06:21:44.894017+0000","last_peered":"2023-10-09T06:21:44.894017+0000","last_clean":"2023-10-09T06:21:44.894017+0000","last_became_active":"2023-10-09T06:21:43.878461+0000","last_became_peered":"2023-10-09T06:21:43.878461+0000","last_unstale":"2023-10-09T06:21:44.894017+0000","last_undegraded":"2023-10-09T06:21:44.894017+0000","last_fullsized":"2023-10-09T06:21:44.894017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:08.777554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.899542+0000","last_change":"2023-10-09T06:21:44.899435+0000","last_active":"2023-10-09T06:21:44.899542+0000","last_peered":"2023-10-09T06:21:44.899542+0000","last_clean":"2023-10-09T06:21:44.899542+0000","last_became_active":"2023-10-09T06:21:44.899094+0000","last_became_peered":"2023-10-09T06:21:44.899094+0000","last_unstale":"2023-10-09T06:21:44.899542+0000","last_undegraded":"2023-10-09T06:21:44.899542+0000","last_fullsized":"2023-10-09T06:21:44.899542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:43.291037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.886524+0000","last_change":"2023-10-09T06:21:43.887751+0000","last_active":"2023-10-09T06:21:44.886524+0000","last_peered":"2023-10-09T06:21:44.886524+0000","last_clean":"2023-10-09T06:21:44.886524+0000","last_became_active":"2023-10-09T06:21:43.885747+0000","last_became_peered":"2023-10-09T06:21:43.885747+0000","last_unstale":"2023-10-09T06:21:44.886524+0000","last_undegraded":"2023-10-09T06:21:44.886524+0000","last_fullsized":"2023-10-09T06:21:44.886524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:09.378864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897060+0000","last_change":"2023-10-09T06:21:44.896355+0000","last_active":"2023-10-09T06:21:44.897060+0000","last_peered":"2023-10-09T06:21:44.897060+0000","last_clean":"2023-10-09T06:21:44.897060+0000","last_became_active":"2023-10-09T06:21:44.895953+0000","last_became_peered":"2023-10-09T06:21:44.895953+0000","last_unstale":"2023-10-09T06:21:44.897060+0000","last_undegraded":"2023-10-09T06:21:44.897060+0000","last_fullsized":"2023-10-09T06:21:44.897060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:09:03.735734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.887782+0000","last_change":"2023-10-09T06:21:43.883931+0000","last_active":"2023-10-09T06:21:44.887782+0000","last_peered":"2023-10-09T06:21:44.887782+0000","last_clean":"2023-10-09T06:21:44.887782+0000","last_became_active":"2023-10-09T06:21:43.883718+0000","last_became_peered":"2023-10-09T06:21:43.883718+0000","last_unstale":"2023-10-09T06:21:44.887782+0000","last_undegraded":"2023-10-09T06:21:44.887782+0000","last_fullsized":"2023-10-09T06:21:44.887782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:33:05.233994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894213+0000","last_change":"2023-10-09T06:21:44.894165+0000","last_active":"2023-10-09T06:21:44.894213+0000","last_peered":"2023-10-09T06:21:44.894213+0000","last_clean":"2023-10-09T06:21:44.894213+0000","last_became_active":"2023-10-09T06:21:44.893864+0000","last_became_peered":"2023-10-09T06:21:44.893864+0000","last_unstale":"2023-10-09T06:21:44.894213+0000","last_undegraded":"2023-10-09T06:21:44.894213+0000","last_fullsized":"2023-10-09T06:21:44.894213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:43.291037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.889172+0000","last_change":"2023-10-09T06:21:43.886830+0000","last_active":"2023-10-09T06:21:44.889172+0000","last_peered":"2023-10-09T06:21:44.889172+0000","last_clean":"2023-10-09T06:21:44.889172+0000","last_became_active":"2023-10-09T06:21:43.886033+0000","last_became_peered":"2023-10-09T06:21:43.886033+0000","last_unstale":"2023-10-09T06:21:44.889172+0000","last_undegraded":"2023-10-09T06:21:44.889172+0000","last_fullsized":"2023-10-09T06:21:44.889172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:12.031411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895042+0000","last_change":"2023-10-09T06:21:44.894274+0000","last_active":"2023-10-09T06:21:44.895042+0000","last_peered":"2023-10-09T06:21:44.895042+0000","last_clean":"2023-10-09T06:21:44.895042+0000","last_became_active":"2023-10-09T06:21:44.894063+0000","last_became_peered":"2023-10-09T06:21:44.894063+0000","last_unstale":"2023-10-09T06:21:44.895042+0000","last_undegraded":"2023-10-09T06:21:44.895042+0000","last_fullsized":"2023-10-09T06:21:44.895042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:55.484657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.888273+0000","last_change":"2023-10-09T06:21:43.881068+0000","last_active":"2023-10-09T06:21:44.888273+0000","last_peered":"2023-10-09T06:21:44.888273+0000","last_clean":"2023-10-09T06:21:44.888273+0000","last_became_active":"2023-10-09T06:21:43.880707+0000","last_became_peered":"2023-10-09T06:21:43.880707+0000","last_unstale":"2023-10-09T06:21:44.888273+0000","last_undegraded":"2023-10-09T06:21:44.888273+0000","last_fullsized":"2023-10-09T06:21:44.888273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:01.362439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.893005+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:21:44.893005+0000","last_peered":"2023-10-09T06:21:44.893005+0000","last_clean":"2023-10-09T06:21:44.893005+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:21:44.893005+0000","last_undegraded":"2023-10-09T06:21:44.893005+0000","last_fullsized":"2023-10-09T06:21:44.893005+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":712,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270685,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.45000000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.496}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.621},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.65000000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.437},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46999999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860555,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.0960000000000001,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.63100000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":7.1299999999999999,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.55500000000000005}]},{"osd":4,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.52200000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.499},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.29399999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.311},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.32400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.44},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.36399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.5270000000000001,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.48099999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.42299999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.495},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.38500000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":712,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270775,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.29199999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":12.929,"5min":12.929,"15min":12.929},"last":0.315},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.39000000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.373}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.65400000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.55300000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.72299999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.745},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.57199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199861073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.981999999999999,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":9.1600000000000001,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.32800000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":8.4930000000000003,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":9.0239999999999991,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":4.6870000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":8.5190000000000001,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":15.007999999999999,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.377}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":14.917999999999999,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":8.9610000000000003,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.3919999999999995,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.505}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.56599999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":8.9160000000000004,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":8.4640000000000004,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.44700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.34599999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.30099999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.42599999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.59399999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199861039,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.379},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.3250000000000002,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.498}]},{"osd":2,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":11.715,"5min":11.715,"15min":11.715},"last":0.436}]},{"osd":3,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.64900000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.52100000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.42699999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.47799999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.54000000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.373}]},{"osd":6,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.64200000000000002}]}]}],"pool_statfs":[]}} 2023-10-09T06:21:48.999 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:21:49.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.150+0000 7f8fbda4e700 1 Processor -- start 2023-10-09T06:21:49.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.150+0000 7f8fbda4e700 1 -- start start 2023-10-09T06:21:49.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.151+0000 7f8fbda4e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb80cdab0 0x7f8fb815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.151+0000 7f8fbda4e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8fb815dda0 0x7f8fb815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.151+0000 7f8fbda4e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb80cb7c0 con 0x7f8fb80cd6e0 2023-10-09T06:21:49.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.151+0000 7f8fbda4e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb815e850 con 0x7f8fb815dda0 2023-10-09T06:21:49.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.151+0000 7f8fbda4e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb80cc360 con 0x7f8fb80cdab0 2023-10-09T06:21:49.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.151+0000 7f8fbd24d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8fb815dda0 0x7f8fb815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.151+0000 7f8fb7fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb80cdab0 0x7f8fb815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.151+0000 7f8fbca4c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f8fb80cd6e0 0x7f8fb80cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:59272/0 (socket says 172.21.15.31:59272) 2023-10-09T06:21:49.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.151+0000 7f8fbca4c700 1 -- 172.21.15.31:0/4272546093 learned_addr learned my addr 172.21.15.31:0/4272546093 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:49.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.152+0000 7f8fb7fff700 1 -- 172.21.15.31:0/4272546093 >> v2:172.21.15.158:3300/0 conn(0x7f8fb815dda0 msgr2=0x7f8fb815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:49.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.152+0000 7f8fb7fff700 1 --2- 172.21.15.31:0/4272546093 >> v2:172.21.15.158:3300/0 conn(0x7f8fb815dda0 0x7f8fb815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.152+0000 7f8fb77fe700 1 -- 172.21.15.31:0/4272546093 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102008082 0 0) 0x7f8fb80cb7c0 con 0x7f8fb80cd6e0 2023-10-09T06:21:49.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.152+0000 7f8fb7fff700 1 -- 172.21.15.31:0/4272546093 >> v1:172.21.15.158:6789/0 conn(0x7f8fb80cd6e0 legacy=0x7f8fb80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.152+0000 7f8fb7fff700 1 -- 172.21.15.31:0/4272546093 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb815e290 con 0x7f8fb80cdab0 2023-10-09T06:21:49.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.152+0000 7f8fbd24d700 1 --2- 172.21.15.31:0/4272546093 >> v2:172.21.15.158:3300/0 conn(0x7f8fb815dda0 0x7f8fb815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:49.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.152+0000 7f8fb7fff700 1 --2- 172.21.15.31:0/4272546093 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb80cdab0 0x7f8fb815d860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009e60 tx=0x7f8fa8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adf067174c4192e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:49.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.152+0000 7f8fb77fe700 1 -- 172.21.15.31:0/4272546093 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800e070 con 0x7f8fb80cdab0 2023-10-09T06:21:49.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.152+0000 7f8fb77fe700 1 -- 172.21.15.31:0/4272546093 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa800bb60 con 0x7f8fb80cdab0 2023-10-09T06:21:49.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.152+0000 7f8fb77fe700 1 -- 172.21.15.31:0/4272546093 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8012430 con 0x7f8fb80cdab0 2023-10-09T06:21:49.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.153+0000 7f8fbda4e700 1 -- 172.21.15.31:0/4272546093 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb80cdab0 msgr2=0x7f8fb815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.153+0000 7f8fbda4e700 1 --2- 172.21.15.31:0/4272546093 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb80cdab0 0x7f8fb815d860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009e60 tx=0x7f8fa8009780 comp rx=0 tx=0).stop 2023-10-09T06:21:49.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.153+0000 7f8fbda4e700 1 -- 172.21.15.31:0/4272546093 shutdown_connections 2023-10-09T06:21:49.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.153+0000 7f8fbda4e700 1 --2- 172.21.15.31:0/4272546093 >> v2:172.21.15.158:3300/0 conn(0x7f8fb815dda0 0x7f8fb815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.153+0000 7f8fbda4e700 1 --2- 172.21.15.31:0/4272546093 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb80cdab0 0x7f8fb815d860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.153+0000 7f8fbda4e700 1 -- 172.21.15.31:0/4272546093 >> 172.21.15.31:0/4272546093 conn(0x7f8fb8067660 msgr2=0x7f8fb8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:49.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.153+0000 7f8fbda4e700 1 -- 172.21.15.31:0/4272546093 shutdown_connections 2023-10-09T06:21:49.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.153+0000 7f8fbda4e700 1 -- 172.21.15.31:0/4272546093 wait complete. 2023-10-09T06:21:49.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.154+0000 7f8fbda4e700 1 Processor -- start 2023-10-09T06:21:49.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.154+0000 7f8fbda4e700 1 -- start start 2023-10-09T06:21:49.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fbda4e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb80cd6e0 0x7f8fb814a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fbda4e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb80cdab0 0x7f8fb8158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fbda4e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fb815dda0 0x7f8fb80c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fbda4e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb814ace0 con 0x7f8fb80cdab0 2023-10-09T06:21:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fbda4e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb815c420 con 0x7f8fb815dda0 2023-10-09T06:21:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fbda4e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb815b810 con 0x7f8fb80cd6e0 2023-10-09T06:21:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fb7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb80cdab0 0x7f8fb8158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fb7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb80cdab0 0x7f8fb8158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44092/0 (socket says 172.21.15.31:44092) 2023-10-09T06:21:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fb7fff700 1 -- 172.21.15.31:0/273012893 learned_addr learned my addr 172.21.15.31:0/273012893 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fbca4c700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb80cd6e0 0x7f8fb814a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fbd24d700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fb815dda0 0x7f8fb80c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fb7fff700 1 -- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb80cd6e0 msgr2=0x7f8fb814a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fb7fff700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb80cd6e0 0x7f8fb814a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fb7fff700 1 -- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fb815dda0 msgr2=0x7f8fb80c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fb7fff700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fb815dda0 0x7f8fb80c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fb7fff700 1 -- 172.21.15.31:0/273012893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb0009420 con 0x7f8fb80cdab0 2023-10-09T06:21:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.155+0000 7f8fb7fff700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb80cdab0 0x7f8fb8158f60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80ccac0 tx=0x7f8fa8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.156+0000 7f8fb4ff9700 1 -- 172.21.15.31:0/273012893 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8012e20 con 0x7f8fb80cdab0 2023-10-09T06:21:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.156+0000 7f8fb4ff9700 1 -- 172.21.15.31:0/273012893 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa8027470 con 0x7f8fb80cdab0 2023-10-09T06:21:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.156+0000 7f8fbda4e700 1 -- 172.21.15.31:0/273012893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa8009a20 con 0x7f8fb80cdab0 2023-10-09T06:21:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.156+0000 7f8fb4ff9700 1 -- 172.21.15.31:0/273012893 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8027830 con 0x7f8fb80cdab0 2023-10-09T06:21:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.156+0000 7f8fbda4e700 1 -- 172.21.15.31:0/273012893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb815bdd0 con 0x7f8fb80cdab0 2023-10-09T06:21:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.157+0000 7f8fbda4e700 1 -- 172.21.15.31:0/273012893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb815c590 con 0x7f8fb80cdab0 2023-10-09T06:21:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.157+0000 7f8fb4ff9700 1 -- 172.21.15.31:0/273012893 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8fa8024070 con 0x7f8fb80cdab0 2023-10-09T06:21:49.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.157+0000 7f8fb4ff9700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8f98066f30 0x7f8f980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.158+0000 7f8fb4ff9700 1 -- 172.21.15.31:0/273012893 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8fa8086fe0 con 0x7f8fb80cdab0 2023-10-09T06:21:49.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.158+0000 7f8fbca4c700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8f98066f30 0x7f8f980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.158+0000 7f8fbca4c700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8f98066f30 0x7f8f980693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00011e0 tx=0x7f8fa0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:49.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.162+0000 7f8fb4ff9700 1 -- 172.21.15.31:0/273012893 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fa8054250 con 0x7f8fb80cdab0 2023-10-09T06:21:49.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.353+0000 7f8fbda4e700 1 -- 172.21.15.31:0/273012893 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8fb804bb80 con 0x7f8f98066f30 2023-10-09T06:21:49.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.361+0000 7f8fb4ff9700 1 -- 172.21.15.31:0/273012893 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283967 (secure 0 0 0) 0x7f8fb804bb80 con 0x7f8f98066f30 2023-10-09T06:21:49.365 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:49.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.364+0000 7f8fbda4e700 1 -- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8f98066f30 msgr2=0x7f8f980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.364+0000 7f8fbda4e700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8f98066f30 0x7f8f980693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00011e0 tx=0x7f8fa0009040 comp rx=0 tx=0).stop 2023-10-09T06:21:49.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.364+0000 7f8fbda4e700 1 -- 172.21.15.31:0/273012893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb80cdab0 msgr2=0x7f8fb8158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.364+0000 7f8fbda4e700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb80cdab0 0x7f8fb8158f60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80ccac0 tx=0x7f8fa8019000 comp rx=0 tx=0).stop 2023-10-09T06:21:49.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.364+0000 7f8fbda4e700 1 -- 172.21.15.31:0/273012893 shutdown_connections 2023-10-09T06:21:49.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.364+0000 7f8fbda4e700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8f98066f30 0x7f8f980693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.364+0000 7f8fbda4e700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fb80cd6e0 0x7f8fb814a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.364+0000 7f8fbda4e700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fb815dda0 0x7f8fb80c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.364+0000 7f8fbda4e700 1 --2- 172.21.15.31:0/273012893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb80cdab0 0x7f8fb8158f60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.364+0000 7f8fbda4e700 1 -- 172.21.15.31:0/273012893 >> 172.21.15.31:0/273012893 conn(0x7f8fb8067660 msgr2=0x7f8fb815d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:49.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.364+0000 7f8fbda4e700 1 -- 172.21.15.31:0/273012893 shutdown_connections 2023-10-09T06:21:49.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.364+0000 7f8fbda4e700 1 -- 172.21.15.31:0/273012893 wait complete. 2023-10-09T06:21:49.368 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:21:49.376 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-09T06:21:48.531149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2242,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560257,"statfs":{"total":1600000000,"available":1597703796,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.660115"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.901273+0000","last_change":"2023-10-09T06:21:44.901207+0000","last_active":"2023-10-09T06:21:44.901273+0000","last_peered":"2023-10-09T06:21:44.901273+0000","last_clean":"2023-10-09T06:21:44.901273+0000","last_became_active":"2023-10-09T06:21:44.900986+0000","last_became_peered":"2023-10-09T06:21:44.900986+0000","last_unstale":"2023-10-09T06:21:44.901273+0000","last_undegraded":"2023-10-09T06:21:44.901273+0000","last_fullsized":"2023-10-09T06:21:44.901273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:26:40.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897044+0000","last_change":"2023-10-09T06:21:44.896287+0000","last_active":"2023-10-09T06:21:44.897044+0000","last_peered":"2023-10-09T06:21:44.897044+0000","last_clean":"2023-10-09T06:21:44.897044+0000","last_became_active":"2023-10-09T06:21:44.896069+0000","last_became_peered":"2023-10-09T06:21:44.896069+0000","last_unstale":"2023-10-09T06:21:44.897044+0000","last_undegraded":"2023-10-09T06:21:44.897044+0000","last_fullsized":"2023-10-09T06:21:44.897044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:27:19.328015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.899880+0000","last_change":"2023-10-09T06:21:44.899829+0000","last_active":"2023-10-09T06:21:44.899880+0000","last_peered":"2023-10-09T06:21:44.899880+0000","last_clean":"2023-10-09T06:21:44.899880+0000","last_became_active":"2023-10-09T06:21:44.899619+0000","last_became_peered":"2023-10-09T06:21:44.899619+0000","last_unstale":"2023-10-09T06:21:44.899880+0000","last_undegraded":"2023-10-09T06:21:44.899880+0000","last_fullsized":"2023-10-09T06:21:44.899880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:02.533604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.889860+0000","last_change":"2023-10-09T06:21:44.889688+0000","last_active":"2023-10-09T06:21:44.889860+0000","last_peered":"2023-10-09T06:21:44.889860+0000","last_clean":"2023-10-09T06:21:44.889860+0000","last_became_active":"2023-10-09T06:21:44.889471+0000","last_became_peered":"2023-10-09T06:21:44.889471+0000","last_unstale":"2023-10-09T06:21:44.889860+0000","last_undegraded":"2023-10-09T06:21:44.889860+0000","last_fullsized":"2023-10-09T06:21:44.889860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:10.322515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.892660+0000","last_change":"2023-10-09T06:21:44.892581+0000","last_active":"2023-10-09T06:21:44.892660+0000","last_peered":"2023-10-09T06:21:44.892660+0000","last_clean":"2023-10-09T06:21:44.892660+0000","last_became_active":"2023-10-09T06:21:44.892362+0000","last_became_peered":"2023-10-09T06:21:44.892362+0000","last_unstale":"2023-10-09T06:21:44.892660+0000","last_undegraded":"2023-10-09T06:21:44.892660+0000","last_fullsized":"2023-10-09T06:21:44.892660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:40.094258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.900640+0000","last_change":"2023-10-09T06:21:44.900520+0000","last_active":"2023-10-09T06:21:44.900640+0000","last_peered":"2023-10-09T06:21:44.900640+0000","last_clean":"2023-10-09T06:21:44.900640+0000","last_became_active":"2023-10-09T06:21:44.900324+0000","last_became_peered":"2023-10-09T06:21:44.900324+0000","last_unstale":"2023-10-09T06:21:44.900640+0000","last_undegraded":"2023-10-09T06:21:44.900640+0000","last_fullsized":"2023-10-09T06:21:44.900640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:02.533604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.896235+0000","last_change":"2023-10-09T06:21:44.896130+0000","last_active":"2023-10-09T06:21:44.896235+0000","last_peered":"2023-10-09T06:21:44.896235+0000","last_clean":"2023-10-09T06:21:44.896235+0000","last_became_active":"2023-10-09T06:21:44.895620+0000","last_became_peered":"2023-10-09T06:21:44.895620+0000","last_unstale":"2023-10-09T06:21:44.896235+0000","last_undegraded":"2023-10-09T06:21:44.896235+0000","last_fullsized":"2023-10-09T06:21:44.896235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:50:10.283484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897363+0000","last_change":"2023-10-09T06:21:44.897252+0000","last_active":"2023-10-09T06:21:44.897363+0000","last_peered":"2023-10-09T06:21:44.897363+0000","last_clean":"2023-10-09T06:21:44.897363+0000","last_became_active":"2023-10-09T06:21:44.895849+0000","last_became_peered":"2023-10-09T06:21:44.895849+0000","last_unstale":"2023-10-09T06:21:44.897363+0000","last_undegraded":"2023-10-09T06:21:44.897363+0000","last_fullsized":"2023-10-09T06:21:44.897363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:06.309775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.891823+0000","last_change":"2023-10-09T06:21:44.891767+0000","last_active":"2023-10-09T06:21:44.891823+0000","last_peered":"2023-10-09T06:21:44.891823+0000","last_clean":"2023-10-09T06:21:44.891823+0000","last_became_active":"2023-10-09T06:21:44.890912+0000","last_became_peered":"2023-10-09T06:21:44.890912+0000","last_unstale":"2023-10-09T06:21:44.891823+0000","last_undegraded":"2023-10-09T06:21:44.891823+0000","last_fullsized":"2023-10-09T06:21:44.891823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:28:25.465656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.890929+0000","last_change":"2023-10-09T06:21:44.890668+0000","last_active":"2023-10-09T06:21:44.890929+0000","last_peered":"2023-10-09T06:21:44.890929+0000","last_clean":"2023-10-09T06:21:44.890929+0000","last_became_active":"2023-10-09T06:21:44.890433+0000","last_became_peered":"2023-10-09T06:21:44.890433+0000","last_unstale":"2023-10-09T06:21:44.890929+0000","last_undegraded":"2023-10-09T06:21:44.890929+0000","last_fullsized":"2023-10-09T06:21:44.890929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:50:10.283484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895284+0000","last_change":"2023-10-09T06:21:44.895222+0000","last_active":"2023-10-09T06:21:44.895284+0000","last_peered":"2023-10-09T06:21:44.895284+0000","last_clean":"2023-10-09T06:21:44.895284+0000","last_became_active":"2023-10-09T06:21:44.894993+0000","last_became_peered":"2023-10-09T06:21:44.894993+0000","last_unstale":"2023-10-09T06:21:44.895284+0000","last_undegraded":"2023-10-09T06:21:44.895284+0000","last_fullsized":"2023-10-09T06:21:44.895284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:06.837494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.901310+0000","last_change":"2023-10-09T06:21:44.901077+0000","last_active":"2023-10-09T06:21:44.901310+0000","last_peered":"2023-10-09T06:21:44.901310+0000","last_clean":"2023-10-09T06:21:44.901310+0000","last_became_active":"2023-10-09T06:21:44.900334+0000","last_became_peered":"2023-10-09T06:21:44.900334+0000","last_unstale":"2023-10-09T06:21:44.901310+0000","last_undegraded":"2023-10-09T06:21:44.901310+0000","last_fullsized":"2023-10-09T06:21:44.901310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:17.852524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.889894+0000","last_change":"2023-10-09T06:21:44.889825+0000","last_active":"2023-10-09T06:21:44.889894+0000","last_peered":"2023-10-09T06:21:44.889894+0000","last_clean":"2023-10-09T06:21:44.889894+0000","last_became_active":"2023-10-09T06:21:44.889631+0000","last_became_peered":"2023-10-09T06:21:44.889631+0000","last_unstale":"2023-10-09T06:21:44.889894+0000","last_undegraded":"2023-10-09T06:21:44.889894+0000","last_fullsized":"2023-10-09T06:21:44.889894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:00.201008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895392+0000","last_change":"2023-10-09T06:21:44.895316+0000","last_active":"2023-10-09T06:21:44.895392+0000","last_peered":"2023-10-09T06:21:44.895392+0000","last_clean":"2023-10-09T06:21:44.895392+0000","last_became_active":"2023-10-09T06:21:44.894794+0000","last_became_peered":"2023-10-09T06:21:44.894794+0000","last_unstale":"2023-10-09T06:21:44.895392+0000","last_undegraded":"2023-10-09T06:21:44.895392+0000","last_fullsized":"2023-10-09T06:21:44.895392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:06.309775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.900232+0000","last_change":"2023-10-09T06:21:44.900171+0000","last_active":"2023-10-09T06:21:44.900232+0000","last_peered":"2023-10-09T06:21:44.900232+0000","last_clean":"2023-10-09T06:21:44.900232+0000","last_became_active":"2023-10-09T06:21:44.899954+0000","last_became_peered":"2023-10-09T06:21:44.899954+0000","last_unstale":"2023-10-09T06:21:44.900232+0000","last_undegraded":"2023-10-09T06:21:44.900232+0000","last_fullsized":"2023-10-09T06:21:44.900232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:18:12.153830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.899172+0000","last_change":"2023-10-09T06:21:44.899108+0000","last_active":"2023-10-09T06:21:44.899172+0000","last_peered":"2023-10-09T06:21:44.899172+0000","last_clean":"2023-10-09T06:21:44.899172+0000","last_became_active":"2023-10-09T06:21:44.898737+0000","last_became_peered":"2023-10-09T06:21:44.898737+0000","last_unstale":"2023-10-09T06:21:44.899172+0000","last_undegraded":"2023-10-09T06:21:44.899172+0000","last_fullsized":"2023-10-09T06:21:44.899172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:27:19.328015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.896376+0000","last_change":"2023-10-09T06:21:44.896318+0000","last_active":"2023-10-09T06:21:44.896376+0000","last_peered":"2023-10-09T06:21:44.896376+0000","last_clean":"2023-10-09T06:21:44.896376+0000","last_became_active":"2023-10-09T06:21:44.895911+0000","last_became_peered":"2023-10-09T06:21:44.895911+0000","last_unstale":"2023-10-09T06:21:44.896376+0000","last_undegraded":"2023-10-09T06:21:44.896376+0000","last_fullsized":"2023-10-09T06:21:44.896376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:29.470571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.892691+0000","last_change":"2023-10-09T06:21:44.892330+0000","last_active":"2023-10-09T06:21:44.892691+0000","last_peered":"2023-10-09T06:21:44.892691+0000","last_clean":"2023-10-09T06:21:44.892691+0000","last_became_active":"2023-10-09T06:21:44.892078+0000","last_became_peered":"2023-10-09T06:21:44.892078+0000","last_unstale":"2023-10-09T06:21:44.892691+0000","last_undegraded":"2023-10-09T06:21:44.892691+0000","last_fullsized":"2023-10-09T06:21:44.892691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:29.440729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897026+0000","last_change":"2023-10-09T06:21:44.896217+0000","last_active":"2023-10-09T06:21:44.897026+0000","last_peered":"2023-10-09T06:21:44.897026+0000","last_clean":"2023-10-09T06:21:44.897026+0000","last_became_active":"2023-10-09T06:21:44.895626+0000","last_became_peered":"2023-10-09T06:21:44.895626+0000","last_unstale":"2023-10-09T06:21:44.897026+0000","last_undegraded":"2023-10-09T06:21:44.897026+0000","last_fullsized":"2023-10-09T06:21:44.897026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:01.374097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897984+0000","last_change":"2023-10-09T06:21:44.897927+0000","last_active":"2023-10-09T06:21:44.897984+0000","last_peered":"2023-10-09T06:21:44.897984+0000","last_clean":"2023-10-09T06:21:44.897984+0000","last_became_active":"2023-10-09T06:21:44.897737+0000","last_became_peered":"2023-10-09T06:21:44.897737+0000","last_unstale":"2023-10-09T06:21:44.897984+0000","last_undegraded":"2023-10-09T06:21:44.897984+0000","last_fullsized":"2023-10-09T06:21:44.897984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:02.366721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.896055+0000","last_change":"2023-10-09T06:21:44.895993+0000","last_active":"2023-10-09T06:21:44.896055+0000","last_peered":"2023-10-09T06:21:44.896055+0000","last_clean":"2023-10-09T06:21:44.896055+0000","last_became_active":"2023-10-09T06:21:44.895765+0000","last_became_peered":"2023-10-09T06:21:44.895765+0000","last_unstale":"2023-10-09T06:21:44.896055+0000","last_undegraded":"2023-10-09T06:21:44.896055+0000","last_fullsized":"2023-10-09T06:21:44.896055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:47.120088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894194+0000","last_change":"2023-10-09T06:21:44.894120+0000","last_active":"2023-10-09T06:21:44.894194+0000","last_peered":"2023-10-09T06:21:44.894194+0000","last_clean":"2023-10-09T06:21:44.894194+0000","last_became_active":"2023-10-09T06:21:44.893520+0000","last_became_peered":"2023-10-09T06:21:44.893520+0000","last_unstale":"2023-10-09T06:21:44.894194+0000","last_undegraded":"2023-10-09T06:21:44.894194+0000","last_fullsized":"2023-10-09T06:21:44.894194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:18:12.153830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895061+0000","last_change":"2023-10-09T06:21:44.894838+0000","last_active":"2023-10-09T06:21:44.895061+0000","last_peered":"2023-10-09T06:21:44.895061+0000","last_clean":"2023-10-09T06:21:44.895061+0000","last_became_active":"2023-10-09T06:21:44.894625+0000","last_became_peered":"2023-10-09T06:21:44.894625+0000","last_unstale":"2023-10-09T06:21:44.895061+0000","last_undegraded":"2023-10-09T06:21:44.895061+0000","last_fullsized":"2023-10-09T06:21:44.895061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:47.120088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.899121+0000","last_change":"2023-10-09T06:21:44.898499+0000","last_active":"2023-10-09T06:21:44.899121+0000","last_peered":"2023-10-09T06:21:44.899121+0000","last_clean":"2023-10-09T06:21:44.899121+0000","last_became_active":"2023-10-09T06:21:44.898043+0000","last_became_peered":"2023-10-09T06:21:44.898043+0000","last_unstale":"2023-10-09T06:21:44.899121+0000","last_undegraded":"2023-10-09T06:21:44.899121+0000","last_fullsized":"2023-10-09T06:21:44.899121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:06.309775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.892226+0000","last_change":"2023-10-09T06:21:44.892155+0000","last_active":"2023-10-09T06:21:44.892226+0000","last_peered":"2023-10-09T06:21:44.892226+0000","last_clean":"2023-10-09T06:21:44.892226+0000","last_became_active":"2023-10-09T06:21:44.891721+0000","last_became_peered":"2023-10-09T06:21:44.891721+0000","last_unstale":"2023-10-09T06:21:44.892226+0000","last_undegraded":"2023-10-09T06:21:44.892226+0000","last_fullsized":"2023-10-09T06:21:44.892226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:54.195601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895730+0000","last_change":"2023-10-09T06:21:44.895666+0000","last_active":"2023-10-09T06:21:44.895730+0000","last_peered":"2023-10-09T06:21:44.895730+0000","last_clean":"2023-10-09T06:21:44.895730+0000","last_became_active":"2023-10-09T06:21:44.895039+0000","last_became_peered":"2023-10-09T06:21:44.895039+0000","last_unstale":"2023-10-09T06:21:44.895730+0000","last_undegraded":"2023-10-09T06:21:44.895730+0000","last_fullsized":"2023-10-09T06:21:44.895730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:06.837494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.892739+0000","last_change":"2023-10-09T06:21:44.892629+0000","last_active":"2023-10-09T06:21:44.892739+0000","last_peered":"2023-10-09T06:21:44.892739+0000","last_clean":"2023-10-09T06:21:44.892739+0000","last_became_active":"2023-10-09T06:21:44.892265+0000","last_became_peered":"2023-10-09T06:21:44.892265+0000","last_unstale":"2023-10-09T06:21:44.892739+0000","last_undegraded":"2023-10-09T06:21:44.892739+0000","last_fullsized":"2023-10-09T06:21:44.892739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:18:12.153830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.902900+0000","last_change":"2023-10-09T06:21:44.902824+0000","last_active":"2023-10-09T06:21:44.902900+0000","last_peered":"2023-10-09T06:21:44.902900+0000","last_clean":"2023-10-09T06:21:44.902900+0000","last_became_active":"2023-10-09T06:21:44.902562+0000","last_became_peered":"2023-10-09T06:21:44.902562+0000","last_unstale":"2023-10-09T06:21:44.902900+0000","last_undegraded":"2023-10-09T06:21:44.902900+0000","last_fullsized":"2023-10-09T06:21:44.902900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:27:19.328015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.893922+0000","last_change":"2023-10-09T06:21:44.892208+0000","last_active":"2023-10-09T06:21:44.893922+0000","last_peered":"2023-10-09T06:21:44.893922+0000","last_clean":"2023-10-09T06:21:44.893922+0000","last_became_active":"2023-10-09T06:21:44.891972+0000","last_became_peered":"2023-10-09T06:21:44.891972+0000","last_unstale":"2023-10-09T06:21:44.893922+0000","last_undegraded":"2023-10-09T06:21:44.893922+0000","last_fullsized":"2023-10-09T06:21:44.893922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:10.322515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.898260+0000","last_change":"2023-10-09T06:21:44.898011+0000","last_active":"2023-10-09T06:21:44.898260+0000","last_peered":"2023-10-09T06:21:44.898260+0000","last_clean":"2023-10-09T06:21:44.898260+0000","last_became_active":"2023-10-09T06:21:44.897452+0000","last_became_peered":"2023-10-09T06:21:44.897452+0000","last_unstale":"2023-10-09T06:21:44.898260+0000","last_undegraded":"2023-10-09T06:21:44.898260+0000","last_fullsized":"2023-10-09T06:21:44.898260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:47:52.815298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897307+0000","last_change":"2023-10-09T06:21:44.897214+0000","last_active":"2023-10-09T06:21:44.897307+0000","last_peered":"2023-10-09T06:21:44.897307+0000","last_clean":"2023-10-09T06:21:44.897307+0000","last_became_active":"2023-10-09T06:21:44.896924+0000","last_became_peered":"2023-10-09T06:21:44.896924+0000","last_unstale":"2023-10-09T06:21:44.897307+0000","last_undegraded":"2023-10-09T06:21:44.897307+0000","last_fullsized":"2023-10-09T06:21:44.897307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:43.291037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895157+0000","last_change":"2023-10-09T06:21:44.895049+0000","last_active":"2023-10-09T06:21:44.895157+0000","last_peered":"2023-10-09T06:21:44.895157+0000","last_clean":"2023-10-09T06:21:44.895157+0000","last_became_active":"2023-10-09T06:21:44.894813+0000","last_became_peered":"2023-10-09T06:21:44.894813+0000","last_unstale":"2023-10-09T06:21:44.895157+0000","last_undegraded":"2023-10-09T06:21:44.895157+0000","last_fullsized":"2023-10-09T06:21:44.895157+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:17.852524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.896625+0000","last_change":"2023-10-09T06:21:44.896555+0000","last_active":"2023-10-09T06:21:44.896625+0000","last_peered":"2023-10-09T06:21:44.896625+0000","last_clean":"2023-10-09T06:21:44.896625+0000","last_became_active":"2023-10-09T06:21:44.896001+0000","last_became_peered":"2023-10-09T06:21:44.896001+0000","last_unstale":"2023-10-09T06:21:44.896625+0000","last_undegraded":"2023-10-09T06:21:44.896625+0000","last_fullsized":"2023-10-09T06:21:44.896625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:26:40.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908297+0000","last_change":"2023-10-09T06:21:43.883129+0000","last_active":"2023-10-09T06:21:44.908297+0000","last_peered":"2023-10-09T06:21:44.908297+0000","last_clean":"2023-10-09T06:21:44.908297+0000","last_became_active":"2023-10-09T06:21:43.882867+0000","last_became_peered":"2023-10-09T06:21:43.882867+0000","last_unstale":"2023-10-09T06:21:44.908297+0000","last_undegraded":"2023-10-09T06:21:44.908297+0000","last_fullsized":"2023-10-09T06:21:44.908297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:09.773232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.891952+0000","last_change":"2023-10-09T06:21:44.891757+0000","last_active":"2023-10-09T06:21:44.891952+0000","last_peered":"2023-10-09T06:21:44.891952+0000","last_clean":"2023-10-09T06:21:44.891952+0000","last_became_active":"2023-10-09T06:21:44.891507+0000","last_became_peered":"2023-10-09T06:21:44.891507+0000","last_unstale":"2023-10-09T06:21:44.891952+0000","last_undegraded":"2023-10-09T06:21:44.891952+0000","last_fullsized":"2023-10-09T06:21:44.891952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:15:32.019098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908042+0000","last_change":"2023-10-09T06:21:43.885343+0000","last_active":"2023-10-09T06:21:44.908042+0000","last_peered":"2023-10-09T06:21:44.908042+0000","last_clean":"2023-10-09T06:21:44.908042+0000","last_became_active":"2023-10-09T06:21:43.884873+0000","last_became_peered":"2023-10-09T06:21:43.884873+0000","last_unstale":"2023-10-09T06:21:44.908042+0000","last_undegraded":"2023-10-09T06:21:44.908042+0000","last_fullsized":"2023-10-09T06:21:44.908042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:09.773232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894782+0000","last_change":"2023-10-09T06:21:44.894722+0000","last_active":"2023-10-09T06:21:44.894782+0000","last_peered":"2023-10-09T06:21:44.894782+0000","last_clean":"2023-10-09T06:21:44.894782+0000","last_became_active":"2023-10-09T06:21:44.894491+0000","last_became_peered":"2023-10-09T06:21:44.894491+0000","last_unstale":"2023-10-09T06:21:44.894782+0000","last_undegraded":"2023-10-09T06:21:44.894782+0000","last_fullsized":"2023-10-09T06:21:44.894782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:26:40.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.909851+0000","last_change":"2023-10-09T06:21:43.888981+0000","last_active":"2023-10-09T06:21:44.909851+0000","last_peered":"2023-10-09T06:21:44.909851+0000","last_clean":"2023-10-09T06:21:44.909851+0000","last_became_active":"2023-10-09T06:21:43.888750+0000","last_became_peered":"2023-10-09T06:21:43.888750+0000","last_unstale":"2023-10-09T06:21:44.909851+0000","last_undegraded":"2023-10-09T06:21:44.909851+0000","last_fullsized":"2023-10-09T06:21:44.909851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:15:31.014816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894726+0000","last_change":"2023-10-09T06:21:44.894664+0000","last_active":"2023-10-09T06:21:44.894726+0000","last_peered":"2023-10-09T06:21:44.894726+0000","last_clean":"2023-10-09T06:21:44.894726+0000","last_became_active":"2023-10-09T06:21:44.894380+0000","last_became_peered":"2023-10-09T06:21:44.894380+0000","last_unstale":"2023-10-09T06:21:44.894726+0000","last_undegraded":"2023-10-09T06:21:44.894726+0000","last_fullsized":"2023-10-09T06:21:44.894726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:29.470571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.909615+0000","last_change":"2023-10-09T06:21:43.886115+0000","last_active":"2023-10-09T06:21:44.909615+0000","last_peered":"2023-10-09T06:21:44.909615+0000","last_clean":"2023-10-09T06:21:44.909615+0000","last_became_active":"2023-10-09T06:21:43.885883+0000","last_became_peered":"2023-10-09T06:21:43.885883+0000","last_unstale":"2023-10-09T06:21:44.909615+0000","last_undegraded":"2023-10-09T06:21:44.909615+0000","last_fullsized":"2023-10-09T06:21:44.909615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:51.691940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.892759+0000","last_change":"2023-10-09T06:21:44.892664+0000","last_active":"2023-10-09T06:21:44.892759+0000","last_peered":"2023-10-09T06:21:44.892759+0000","last_clean":"2023-10-09T06:21:44.892759+0000","last_became_active":"2023-10-09T06:21:44.892087+0000","last_became_peered":"2023-10-09T06:21:44.892087+0000","last_unstale":"2023-10-09T06:21:44.892759+0000","last_undegraded":"2023-10-09T06:21:44.892759+0000","last_fullsized":"2023-10-09T06:21:44.892759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:42:55.463742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908006+0000","last_change":"2023-10-09T06:21:43.882030+0000","last_active":"2023-10-09T06:21:44.908006+0000","last_peered":"2023-10-09T06:21:44.908006+0000","last_clean":"2023-10-09T06:21:44.908006+0000","last_became_active":"2023-10-09T06:21:43.881060+0000","last_became_peered":"2023-10-09T06:21:43.881060+0000","last_unstale":"2023-10-09T06:21:44.908006+0000","last_undegraded":"2023-10-09T06:21:44.908006+0000","last_fullsized":"2023-10-09T06:21:44.908006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:02.773971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.902306+0000","last_change":"2023-10-09T06:21:44.902257+0000","last_active":"2023-10-09T06:21:44.902306+0000","last_peered":"2023-10-09T06:21:44.902306+0000","last_clean":"2023-10-09T06:21:44.902306+0000","last_became_active":"2023-10-09T06:21:44.902105+0000","last_became_peered":"2023-10-09T06:21:44.902105+0000","last_unstale":"2023-10-09T06:21:44.902306+0000","last_undegraded":"2023-10-09T06:21:44.902306+0000","last_fullsized":"2023-10-09T06:21:44.902306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:29.470571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.907971+0000","last_change":"2023-10-09T06:21:43.881125+0000","last_active":"2023-10-09T06:21:44.907971+0000","last_peered":"2023-10-09T06:21:44.907971+0000","last_clean":"2023-10-09T06:21:44.907971+0000","last_became_active":"2023-10-09T06:21:43.880892+0000","last_became_peered":"2023-10-09T06:21:43.880892+0000","last_unstale":"2023-10-09T06:21:44.907971+0000","last_undegraded":"2023-10-09T06:21:44.907971+0000","last_fullsized":"2023-10-09T06:21:44.907971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:01.362439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.898817+0000","last_change":"2023-10-09T06:21:44.898588+0000","last_active":"2023-10-09T06:21:44.898817+0000","last_peered":"2023-10-09T06:21:44.898817+0000","last_clean":"2023-10-09T06:21:44.898817+0000","last_became_active":"2023-10-09T06:21:44.898086+0000","last_became_peered":"2023-10-09T06:21:44.898086+0000","last_unstale":"2023-10-09T06:21:44.898817+0000","last_undegraded":"2023-10-09T06:21:44.898817+0000","last_fullsized":"2023-10-09T06:21:44.898817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:12.807403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.888791+0000","last_change":"2023-10-09T06:21:43.883361+0000","last_active":"2023-10-09T06:21:44.888791+0000","last_peered":"2023-10-09T06:21:44.888791+0000","last_clean":"2023-10-09T06:21:44.888791+0000","last_became_active":"2023-10-09T06:21:43.882960+0000","last_became_peered":"2023-10-09T06:21:43.882960+0000","last_unstale":"2023-10-09T06:21:44.888791+0000","last_undegraded":"2023-10-09T06:21:44.888791+0000","last_fullsized":"2023-10-09T06:21:44.888791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:46.115806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.900020+0000","last_change":"2023-10-09T06:21:44.899920+0000","last_active":"2023-10-09T06:21:44.900020+0000","last_peered":"2023-10-09T06:21:44.900020+0000","last_clean":"2023-10-09T06:21:44.900020+0000","last_became_active":"2023-10-09T06:21:44.899712+0000","last_became_peered":"2023-10-09T06:21:44.899712+0000","last_unstale":"2023-10-09T06:21:44.900020+0000","last_undegraded":"2023-10-09T06:21:44.900020+0000","last_fullsized":"2023-10-09T06:21:44.900020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:47.120088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.891405+0000","last_change":"2023-10-09T06:21:43.880029+0000","last_active":"2023-10-09T06:21:44.891405+0000","last_peered":"2023-10-09T06:21:44.891405+0000","last_clean":"2023-10-09T06:21:44.891405+0000","last_became_active":"2023-10-09T06:21:43.879294+0000","last_became_peered":"2023-10-09T06:21:43.879294+0000","last_unstale":"2023-10-09T06:21:44.891405+0000","last_undegraded":"2023-10-09T06:21:44.891405+0000","last_fullsized":"2023-10-09T06:21:44.891405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:39.089976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.901293+0000","last_change":"2023-10-09T06:21:44.900940+0000","last_active":"2023-10-09T06:21:44.901293+0000","last_peered":"2023-10-09T06:21:44.901293+0000","last_clean":"2023-10-09T06:21:44.901293+0000","last_became_active":"2023-10-09T06:21:44.900097+0000","last_became_peered":"2023-10-09T06:21:44.900097+0000","last_unstale":"2023-10-09T06:21:44.901293+0000","last_undegraded":"2023-10-09T06:21:44.901293+0000","last_fullsized":"2023-10-09T06:21:44.901293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:34.291489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.889709+0000","last_change":"2023-10-09T06:21:43.885219+0000","last_active":"2023-10-09T06:21:44.889709+0000","last_peered":"2023-10-09T06:21:44.889709+0000","last_clean":"2023-10-09T06:21:44.889709+0000","last_became_active":"2023-10-09T06:21:43.884738+0000","last_became_peered":"2023-10-09T06:21:43.884738+0000","last_unstale":"2023-10-09T06:21:44.889709+0000","last_undegraded":"2023-10-09T06:21:44.889709+0000","last_fullsized":"2023-10-09T06:21:44.889709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:14:49.994917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895357+0000","last_change":"2023-10-09T06:21:44.895280+0000","last_active":"2023-10-09T06:21:44.895357+0000","last_peered":"2023-10-09T06:21:44.895357+0000","last_clean":"2023-10-09T06:21:44.895357+0000","last_became_active":"2023-10-09T06:21:44.894013+0000","last_became_peered":"2023-10-09T06:21:44.894013+0000","last_unstale":"2023-10-09T06:21:44.895357+0000","last_undegraded":"2023-10-09T06:21:44.895357+0000","last_fullsized":"2023-10-09T06:21:44.895357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:54.245307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895088+0000","last_change":"2023-10-09T06:21:43.881572+0000","last_active":"2023-10-09T06:21:44.895088+0000","last_peered":"2023-10-09T06:21:44.895088+0000","last_clean":"2023-10-09T06:21:44.895088+0000","last_became_active":"2023-10-09T06:21:43.881336+0000","last_became_peered":"2023-10-09T06:21:43.881336+0000","last_unstale":"2023-10-09T06:21:44.895088+0000","last_undegraded":"2023-10-09T06:21:44.895088+0000","last_fullsized":"2023-10-09T06:21:44.895088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:01.362439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897087+0000","last_change":"2023-10-09T06:21:44.896862+0000","last_active":"2023-10-09T06:21:44.897087+0000","last_peered":"2023-10-09T06:21:44.897087+0000","last_clean":"2023-10-09T06:21:44.897087+0000","last_became_active":"2023-10-09T06:21:44.896573+0000","last_became_peered":"2023-10-09T06:21:44.896573+0000","last_unstale":"2023-10-09T06:21:44.897087+0000","last_undegraded":"2023-10-09T06:21:44.897087+0000","last_fullsized":"2023-10-09T06:21:44.897087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:37.824326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908979+0000","last_change":"2023-10-09T06:21:43.885360+0000","last_active":"2023-10-09T06:21:44.908979+0000","last_peered":"2023-10-09T06:21:44.908979+0000","last_clean":"2023-10-09T06:21:44.908979+0000","last_became_active":"2023-10-09T06:21:43.885151+0000","last_became_peered":"2023-10-09T06:21:43.885151+0000","last_unstale":"2023-10-09T06:21:44.908979+0000","last_undegraded":"2023-10-09T06:21:44.908979+0000","last_fullsized":"2023-10-09T06:21:44.908979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:12.031411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.900783+0000","last_change":"2023-10-09T06:21:44.900721+0000","last_active":"2023-10-09T06:21:44.900783+0000","last_peered":"2023-10-09T06:21:44.900783+0000","last_clean":"2023-10-09T06:21:44.900783+0000","last_became_active":"2023-10-09T06:21:44.900510+0000","last_became_peered":"2023-10-09T06:21:44.900510+0000","last_unstale":"2023-10-09T06:21:44.900783+0000","last_undegraded":"2023-10-09T06:21:44.900783+0000","last_fullsized":"2023-10-09T06:21:44.900783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:06.837494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.910457+0000","last_change":"2023-10-09T06:21:43.886976+0000","last_active":"2023-10-09T06:21:44.910457+0000","last_peered":"2023-10-09T06:21:44.910457+0000","last_clean":"2023-10-09T06:21:44.910457+0000","last_became_active":"2023-10-09T06:21:43.886369+0000","last_became_peered":"2023-10-09T06:21:43.886369+0000","last_unstale":"2023-10-09T06:21:44.910457+0000","last_undegraded":"2023-10-09T06:21:44.910457+0000","last_fullsized":"2023-10-09T06:21:44.910457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:42.286755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.901097+0000","last_change":"2023-10-09T06:21:44.901047+0000","last_active":"2023-10-09T06:21:44.901097+0000","last_peered":"2023-10-09T06:21:44.901097+0000","last_clean":"2023-10-09T06:21:44.901097+0000","last_became_active":"2023-10-09T06:21:44.900851+0000","last_became_peered":"2023-10-09T06:21:44.900851+0000","last_unstale":"2023-10-09T06:21:44.901097+0000","last_undegraded":"2023-10-09T06:21:44.901097+0000","last_fullsized":"2023-10-09T06:21:44.901097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:34.291489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.907936+0000","last_change":"2023-10-09T06:21:43.880761+0000","last_active":"2023-10-09T06:21:44.907936+0000","last_peered":"2023-10-09T06:21:44.907936+0000","last_clean":"2023-10-09T06:21:44.907936+0000","last_became_active":"2023-10-09T06:21:43.879595+0000","last_became_peered":"2023-10-09T06:21:43.879595+0000","last_unstale":"2023-10-09T06:21:44.907936+0000","last_undegraded":"2023-10-09T06:21:44.907936+0000","last_fullsized":"2023-10-09T06:21:44.907936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:01:31.851116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.893749+0000","last_change":"2023-10-09T06:21:44.893705+0000","last_active":"2023-10-09T06:21:44.893749+0000","last_peered":"2023-10-09T06:21:44.893749+0000","last_clean":"2023-10-09T06:21:44.893749+0000","last_became_active":"2023-10-09T06:21:44.893510+0000","last_became_peered":"2023-10-09T06:21:44.893510+0000","last_unstale":"2023-10-09T06:21:44.893749+0000","last_undegraded":"2023-10-09T06:21:44.893749+0000","last_fullsized":"2023-10-09T06:21:44.893749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:17.852524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.886179+0000","last_change":"2023-10-09T06:21:43.885053+0000","last_active":"2023-10-09T06:21:44.886179+0000","last_peered":"2023-10-09T06:21:44.886179+0000","last_clean":"2023-10-09T06:21:44.886179+0000","last_became_active":"2023-10-09T06:21:43.884790+0000","last_became_peered":"2023-10-09T06:21:43.884790+0000","last_unstale":"2023-10-09T06:21:44.886179+0000","last_undegraded":"2023-10-09T06:21:44.886179+0000","last_fullsized":"2023-10-09T06:21:44.886179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:30.273920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.893462+0000","last_change":"2023-10-09T06:21:44.893265+0000","last_active":"2023-10-09T06:21:44.893462+0000","last_peered":"2023-10-09T06:21:44.893462+0000","last_clean":"2023-10-09T06:21:44.893462+0000","last_became_active":"2023-10-09T06:21:44.892411+0000","last_became_peered":"2023-10-09T06:21:44.892411+0000","last_unstale":"2023-10-09T06:21:44.893462+0000","last_undegraded":"2023-10-09T06:21:44.893462+0000","last_fullsized":"2023-10-09T06:21:44.893462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:34.291489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.887878+0000","last_change":"2023-10-09T06:21:43.885216+0000","last_active":"2023-10-09T06:21:44.887878+0000","last_peered":"2023-10-09T06:21:44.887878+0000","last_clean":"2023-10-09T06:21:44.887878+0000","last_became_active":"2023-10-09T06:21:43.884959+0000","last_became_peered":"2023-10-09T06:21:43.884959+0000","last_unstale":"2023-10-09T06:21:44.887878+0000","last_undegraded":"2023-10-09T06:21:44.887878+0000","last_fullsized":"2023-10-09T06:21:44.887878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:09.661454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.898115+0000","last_change":"2023-10-09T06:21:44.898034+0000","last_active":"2023-10-09T06:21:44.898115+0000","last_peered":"2023-10-09T06:21:44.898115+0000","last_clean":"2023-10-09T06:21:44.898115+0000","last_became_active":"2023-10-09T06:21:44.897663+0000","last_became_peered":"2023-10-09T06:21:44.897663+0000","last_unstale":"2023-10-09T06:21:44.898115+0000","last_undegraded":"2023-10-09T06:21:44.898115+0000","last_fullsized":"2023-10-09T06:21:44.898115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:10.665736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.910019+0000","last_change":"2023-10-09T06:21:43.886786+0000","last_active":"2023-10-09T06:21:44.910019+0000","last_peered":"2023-10-09T06:21:44.910019+0000","last_clean":"2023-10-09T06:21:44.910019+0000","last_became_active":"2023-10-09T06:21:43.886323+0000","last_became_peered":"2023-10-09T06:21:43.886323+0000","last_unstale":"2023-10-09T06:21:44.910019+0000","last_undegraded":"2023-10-09T06:21:44.910019+0000","last_fullsized":"2023-10-09T06:21:44.910019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:26:39.669965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.898833+0000","last_change":"2023-10-09T06:21:44.898736+0000","last_active":"2023-10-09T06:21:44.898833+0000","last_peered":"2023-10-09T06:21:44.898833+0000","last_clean":"2023-10-09T06:21:44.898833+0000","last_became_active":"2023-10-09T06:21:44.898366+0000","last_became_peered":"2023-10-09T06:21:44.898366+0000","last_unstale":"2023-10-09T06:21:44.898833+0000","last_undegraded":"2023-10-09T06:21:44.898833+0000","last_fullsized":"2023-10-09T06:21:44.898833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:54.195601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908122+0000","last_change":"2023-10-09T06:21:43.886393+0000","last_active":"2023-10-09T06:21:44.908122+0000","last_peered":"2023-10-09T06:21:44.908122+0000","last_clean":"2023-10-09T06:21:44.908122+0000","last_became_active":"2023-10-09T06:21:43.886154+0000","last_became_peered":"2023-10-09T06:21:43.886154+0000","last_unstale":"2023-10-09T06:21:44.908122+0000","last_undegraded":"2023-10-09T06:21:44.908122+0000","last_fullsized":"2023-10-09T06:21:44.908122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:09.773232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.899083+0000","last_change":"2023-10-09T06:21:44.898350+0000","last_active":"2023-10-09T06:21:44.899083+0000","last_peered":"2023-10-09T06:21:44.899083+0000","last_clean":"2023-10-09T06:21:44.899083+0000","last_became_active":"2023-10-09T06:21:44.897739+0000","last_became_peered":"2023-10-09T06:21:44.897739+0000","last_unstale":"2023-10-09T06:21:44.899083+0000","last_undegraded":"2023-10-09T06:21:44.899083+0000","last_fullsized":"2023-10-09T06:21:44.899083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:46.401951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.907765+0000","last_change":"2023-10-09T06:21:43.881952+0000","last_active":"2023-10-09T06:21:44.907765+0000","last_peered":"2023-10-09T06:21:44.907765+0000","last_clean":"2023-10-09T06:21:44.907765+0000","last_became_active":"2023-10-09T06:21:43.881721+0000","last_became_peered":"2023-10-09T06:21:43.881721+0000","last_unstale":"2023-10-09T06:21:44.907765+0000","last_undegraded":"2023-10-09T06:21:44.907765+0000","last_fullsized":"2023-10-09T06:21:44.907765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:26:40.217662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.892720+0000","last_change":"2023-10-09T06:21:44.892490+0000","last_active":"2023-10-09T06:21:44.892720+0000","last_peered":"2023-10-09T06:21:44.892720+0000","last_clean":"2023-10-09T06:21:44.892720+0000","last_became_active":"2023-10-09T06:21:44.891956+0000","last_became_peered":"2023-10-09T06:21:44.891956+0000","last_unstale":"2023-10-09T06:21:44.892720+0000","last_undegraded":"2023-10-09T06:21:44.892720+0000","last_fullsized":"2023-10-09T06:21:44.892720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:28:25.465656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908635+0000","last_change":"2023-10-09T06:21:43.877352+0000","last_active":"2023-10-09T06:21:44.908635+0000","last_peered":"2023-10-09T06:21:44.908635+0000","last_clean":"2023-10-09T06:21:44.908635+0000","last_became_active":"2023-10-09T06:21:43.877131+0000","last_became_peered":"2023-10-09T06:21:43.877131+0000","last_unstale":"2023-10-09T06:21:44.908635+0000","last_undegraded":"2023-10-09T06:21:44.908635+0000","last_fullsized":"2023-10-09T06:21:44.908635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:58.954030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894062+0000","last_change":"2023-10-09T06:21:44.893602+0000","last_active":"2023-10-09T06:21:44.894062+0000","last_peered":"2023-10-09T06:21:44.894062+0000","last_clean":"2023-10-09T06:21:44.894062+0000","last_became_active":"2023-10-09T06:21:44.893385+0000","last_became_peered":"2023-10-09T06:21:44.893385+0000","last_unstale":"2023-10-09T06:21:44.894062+0000","last_undegraded":"2023-10-09T06:21:44.894062+0000","last_fullsized":"2023-10-09T06:21:44.894062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:31.278203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.890654+0000","last_change":"2023-10-09T06:21:43.882168+0000","last_active":"2023-10-09T06:21:44.890654+0000","last_peered":"2023-10-09T06:21:44.890654+0000","last_clean":"2023-10-09T06:21:44.890654+0000","last_became_active":"2023-10-09T06:21:43.881359+0000","last_became_peered":"2023-10-09T06:21:43.881359+0000","last_unstale":"2023-10-09T06:21:44.890654+0000","last_undegraded":"2023-10-09T06:21:44.890654+0000","last_fullsized":"2023-10-09T06:21:44.890654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:04.038400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894045+0000","last_change":"2023-10-09T06:21:44.893031+0000","last_active":"2023-10-09T06:21:44.894045+0000","last_peered":"2023-10-09T06:21:44.894045+0000","last_clean":"2023-10-09T06:21:44.894045+0000","last_became_active":"2023-10-09T06:21:44.892784+0000","last_became_peered":"2023-10-09T06:21:44.892784+0000","last_unstale":"2023-10-09T06:21:44.894045+0000","last_undegraded":"2023-10-09T06:21:44.894045+0000","last_fullsized":"2023-10-09T06:21:44.894045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:10.777514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.909551+0000","last_change":"2023-10-09T06:21:43.883145+0000","last_active":"2023-10-09T06:21:44.909551+0000","last_peered":"2023-10-09T06:21:44.909551+0000","last_clean":"2023-10-09T06:21:44.909551+0000","last_became_active":"2023-10-09T06:21:43.882810+0000","last_became_peered":"2023-10-09T06:21:43.882810+0000","last_unstale":"2023-10-09T06:21:44.909551+0000","last_undegraded":"2023-10-09T06:21:44.909551+0000","last_fullsized":"2023-10-09T06:21:44.909551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:30.273920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897047+0000","last_change":"2023-10-09T06:21:44.896986+0000","last_active":"2023-10-09T06:21:44.897047+0000","last_peered":"2023-10-09T06:21:44.897047+0000","last_clean":"2023-10-09T06:21:44.897047+0000","last_became_active":"2023-10-09T06:21:44.896757+0000","last_became_peered":"2023-10-09T06:21:44.896757+0000","last_unstale":"2023-10-09T06:21:44.897047+0000","last_undegraded":"2023-10-09T06:21:44.897047+0000","last_fullsized":"2023-10-09T06:21:44.897047+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:09.781837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.888180+0000","last_change":"2023-10-09T06:21:43.880928+0000","last_active":"2023-10-09T06:21:44.888180+0000","last_peered":"2023-10-09T06:21:44.888180+0000","last_clean":"2023-10-09T06:21:44.888180+0000","last_became_active":"2023-10-09T06:21:43.880414+0000","last_became_peered":"2023-10-09T06:21:43.880414+0000","last_unstale":"2023-10-09T06:21:44.888180+0000","last_undegraded":"2023-10-09T06:21:44.888180+0000","last_fullsized":"2023-10-09T06:21:44.888180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:30.273920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897645+0000","last_change":"2023-10-09T06:21:44.897580+0000","last_active":"2023-10-09T06:21:44.897645+0000","last_peered":"2023-10-09T06:21:44.897645+0000","last_clean":"2023-10-09T06:21:44.897645+0000","last_became_active":"2023-10-09T06:21:44.897158+0000","last_became_peered":"2023-10-09T06:21:44.897158+0000","last_unstale":"2023-10-09T06:21:44.897645+0000","last_undegraded":"2023-10-09T06:21:44.897645+0000","last_fullsized":"2023-10-09T06:21:44.897645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:09.971549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.891589+0000","last_change":"2023-10-09T06:21:43.884264+0000","last_active":"2023-10-09T06:21:44.891589+0000","last_peered":"2023-10-09T06:21:44.891589+0000","last_clean":"2023-10-09T06:21:44.891589+0000","last_became_active":"2023-10-09T06:21:43.884034+0000","last_became_peered":"2023-10-09T06:21:43.884034+0000","last_unstale":"2023-10-09T06:21:44.891589+0000","last_undegraded":"2023-10-09T06:21:44.891589+0000","last_fullsized":"2023-10-09T06:21:44.891589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:09.378864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.898276+0000","last_change":"2023-10-09T06:21:44.898175+0000","last_active":"2023-10-09T06:21:44.898276+0000","last_peered":"2023-10-09T06:21:44.898276+0000","last_clean":"2023-10-09T06:21:44.898276+0000","last_became_active":"2023-10-09T06:21:44.897768+0000","last_became_peered":"2023-10-09T06:21:44.897768+0000","last_unstale":"2023-10-09T06:21:44.898276+0000","last_undegraded":"2023-10-09T06:21:44.898276+0000","last_fullsized":"2023-10-09T06:21:44.898276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:46.401951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.899834+0000","last_change":"2023-10-09T06:21:43.885869+0000","last_active":"2023-10-09T06:21:44.899834+0000","last_peered":"2023-10-09T06:21:44.899834+0000","last_clean":"2023-10-09T06:21:44.899834+0000","last_became_active":"2023-10-09T06:21:43.885610+0000","last_became_peered":"2023-10-09T06:21:43.885610+0000","last_unstale":"2023-10-09T06:21:44.899834+0000","last_undegraded":"2023-10-09T06:21:44.899834+0000","last_fullsized":"2023-10-09T06:21:44.899834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:09.661454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.900995+0000","last_change":"2023-10-09T06:21:44.900930+0000","last_active":"2023-10-09T06:21:44.900995+0000","last_peered":"2023-10-09T06:21:44.900995+0000","last_clean":"2023-10-09T06:21:44.900995+0000","last_became_active":"2023-10-09T06:21:44.900696+0000","last_became_peered":"2023-10-09T06:21:44.900696+0000","last_unstale":"2023-10-09T06:21:44.900995+0000","last_undegraded":"2023-10-09T06:21:44.900995+0000","last_fullsized":"2023-10-09T06:21:44.900995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:14:50.999199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.908970+0000","last_change":"2023-10-09T06:21:43.886421+0000","last_active":"2023-10-09T06:21:44.908970+0000","last_peered":"2023-10-09T06:21:44.908970+0000","last_clean":"2023-10-09T06:21:44.908970+0000","last_became_active":"2023-10-09T06:21:43.885417+0000","last_became_peered":"2023-10-09T06:21:43.885417+0000","last_unstale":"2023-10-09T06:21:44.908970+0000","last_undegraded":"2023-10-09T06:21:44.908970+0000","last_fullsized":"2023-10-09T06:21:44.908970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:39.089976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.901325+0000","last_change":"2023-10-09T06:21:44.901216+0000","last_active":"2023-10-09T06:21:44.901325+0000","last_peered":"2023-10-09T06:21:44.901325+0000","last_clean":"2023-10-09T06:21:44.901325+0000","last_became_active":"2023-10-09T06:21:44.900678+0000","last_became_peered":"2023-10-09T06:21:44.900678+0000","last_unstale":"2023-10-09T06:21:44.901325+0000","last_undegraded":"2023-10-09T06:21:44.901325+0000","last_fullsized":"2023-10-09T06:21:44.901325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:50:10.283484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-09T06:21:46.004261+0000","last_change":"2023-10-09T06:21:43.879771+0000","last_active":"2023-10-09T06:21:46.004261+0000","last_peered":"2023-10-09T06:21:46.004261+0000","last_clean":"2023-10-09T06:21:46.004261+0000","last_became_active":"2023-10-09T06:21:43.879548+0000","last_became_peered":"2023-10-09T06:21:43.879548+0000","last_unstale":"2023-10-09T06:21:46.004261+0000","last_undegraded":"2023-10-09T06:21:46.004261+0000","last_fullsized":"2023-10-09T06:21:46.004261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:39.089976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.896915+0000","last_change":"2023-10-09T06:21:44.896696+0000","last_active":"2023-10-09T06:21:44.896915+0000","last_peered":"2023-10-09T06:21:44.896915+0000","last_clean":"2023-10-09T06:21:44.896915+0000","last_became_active":"2023-10-09T06:21:44.896331+0000","last_became_peered":"2023-10-09T06:21:44.896331+0000","last_unstale":"2023-10-09T06:21:44.896915+0000","last_undegraded":"2023-10-09T06:21:44.896915+0000","last_fullsized":"2023-10-09T06:21:44.896915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:15:32.019098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.886767+0000","last_change":"2023-10-09T06:21:43.888365+0000","last_active":"2023-10-09T06:21:44.886767+0000","last_peered":"2023-10-09T06:21:44.886767+0000","last_clean":"2023-10-09T06:21:44.886767+0000","last_became_active":"2023-10-09T06:21:43.887826+0000","last_became_peered":"2023-10-09T06:21:43.887826+0000","last_unstale":"2023-10-09T06:21:44.886767+0000","last_undegraded":"2023-10-09T06:21:44.886767+0000","last_fullsized":"2023-10-09T06:21:44.886767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:08.777554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.898097+0000","last_change":"2023-10-09T06:21:44.897898+0000","last_active":"2023-10-09T06:21:44.898097+0000","last_peered":"2023-10-09T06:21:44.898097+0000","last_clean":"2023-10-09T06:21:44.898097+0000","last_became_active":"2023-10-09T06:21:44.896985+0000","last_became_peered":"2023-10-09T06:21:44.896985+0000","last_unstale":"2023-10-09T06:21:44.898097+0000","last_undegraded":"2023-10-09T06:21:44.898097+0000","last_fullsized":"2023-10-09T06:21:44.898097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:47.120088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894017+0000","last_change":"2023-10-09T06:21:43.878693+0000","last_active":"2023-10-09T06:21:44.894017+0000","last_peered":"2023-10-09T06:21:44.894017+0000","last_clean":"2023-10-09T06:21:44.894017+0000","last_became_active":"2023-10-09T06:21:43.878461+0000","last_became_peered":"2023-10-09T06:21:43.878461+0000","last_unstale":"2023-10-09T06:21:44.894017+0000","last_undegraded":"2023-10-09T06:21:44.894017+0000","last_fullsized":"2023-10-09T06:21:44.894017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:08.777554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.899542+0000","last_change":"2023-10-09T06:21:44.899435+0000","last_active":"2023-10-09T06:21:44.899542+0000","last_peered":"2023-10-09T06:21:44.899542+0000","last_clean":"2023-10-09T06:21:44.899542+0000","last_became_active":"2023-10-09T06:21:44.899094+0000","last_became_peered":"2023-10-09T06:21:44.899094+0000","last_unstale":"2023-10-09T06:21:44.899542+0000","last_undegraded":"2023-10-09T06:21:44.899542+0000","last_fullsized":"2023-10-09T06:21:44.899542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:43.291037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.886524+0000","last_change":"2023-10-09T06:21:43.887751+0000","last_active":"2023-10-09T06:21:44.886524+0000","last_peered":"2023-10-09T06:21:44.886524+0000","last_clean":"2023-10-09T06:21:44.886524+0000","last_became_active":"2023-10-09T06:21:43.885747+0000","last_became_peered":"2023-10-09T06:21:43.885747+0000","last_unstale":"2023-10-09T06:21:44.886524+0000","last_undegraded":"2023-10-09T06:21:44.886524+0000","last_fullsized":"2023-10-09T06:21:44.886524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:09.378864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.897060+0000","last_change":"2023-10-09T06:21:44.896355+0000","last_active":"2023-10-09T06:21:44.897060+0000","last_peered":"2023-10-09T06:21:44.897060+0000","last_clean":"2023-10-09T06:21:44.897060+0000","last_became_active":"2023-10-09T06:21:44.895953+0000","last_became_peered":"2023-10-09T06:21:44.895953+0000","last_unstale":"2023-10-09T06:21:44.897060+0000","last_undegraded":"2023-10-09T06:21:44.897060+0000","last_fullsized":"2023-10-09T06:21:44.897060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:09:03.735734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.887782+0000","last_change":"2023-10-09T06:21:43.883931+0000","last_active":"2023-10-09T06:21:44.887782+0000","last_peered":"2023-10-09T06:21:44.887782+0000","last_clean":"2023-10-09T06:21:44.887782+0000","last_became_active":"2023-10-09T06:21:43.883718+0000","last_became_peered":"2023-10-09T06:21:43.883718+0000","last_unstale":"2023-10-09T06:21:44.887782+0000","last_undegraded":"2023-10-09T06:21:44.887782+0000","last_fullsized":"2023-10-09T06:21:44.887782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:33:05.233994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.894213+0000","last_change":"2023-10-09T06:21:44.894165+0000","last_active":"2023-10-09T06:21:44.894213+0000","last_peered":"2023-10-09T06:21:44.894213+0000","last_clean":"2023-10-09T06:21:44.894213+0000","last_became_active":"2023-10-09T06:21:44.893864+0000","last_became_peered":"2023-10-09T06:21:44.893864+0000","last_unstale":"2023-10-09T06:21:44.894213+0000","last_undegraded":"2023-10-09T06:21:44.894213+0000","last_fullsized":"2023-10-09T06:21:44.894213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:43.291037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.889172+0000","last_change":"2023-10-09T06:21:43.886830+0000","last_active":"2023-10-09T06:21:44.889172+0000","last_peered":"2023-10-09T06:21:44.889172+0000","last_clean":"2023-10-09T06:21:44.889172+0000","last_became_active":"2023-10-09T06:21:43.886033+0000","last_became_peered":"2023-10-09T06:21:43.886033+0000","last_unstale":"2023-10-09T06:21:44.889172+0000","last_undegraded":"2023-10-09T06:21:44.889172+0000","last_fullsized":"2023-10-09T06:21:44.889172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:12.031411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.895042+0000","last_change":"2023-10-09T06:21:44.894274+0000","last_active":"2023-10-09T06:21:44.895042+0000","last_peered":"2023-10-09T06:21:44.895042+0000","last_clean":"2023-10-09T06:21:44.895042+0000","last_became_active":"2023-10-09T06:21:44.894063+0000","last_became_peered":"2023-10-09T06:21:44.894063+0000","last_unstale":"2023-10-09T06:21:44.895042+0000","last_undegraded":"2023-10-09T06:21:44.895042+0000","last_fullsized":"2023-10-09T06:21:44.895042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:43.870409+0000","last_clean_scrub_stamp":"2023-10-09T06:21:43.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:55.484657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.888273+0000","last_change":"2023-10-09T06:21:43.881068+0000","last_active":"2023-10-09T06:21:44.888273+0000","last_peered":"2023-10-09T06:21:44.888273+0000","last_clean":"2023-10-09T06:21:44.888273+0000","last_became_active":"2023-10-09T06:21:43.880707+0000","last_became_peered":"2023-10-09T06:21:43.880707+0000","last_unstale":"2023-10-09T06:21:44.888273+0000","last_undegraded":"2023-10-09T06:21:44.888273+0000","last_fullsized":"2023-10-09T06:21:44.888273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:21:42.866127+0000","last_clean_scrub_stamp":"2023-10-09T06:21:42.866127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:01.362439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:21:44.893005+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:21:44.893005+0000","last_peered":"2023-10-09T06:21:44.893005+0000","last_clean":"2023-10-09T06:21:44.893005+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:21:44.893005+0000","last_undegraded":"2023-10-09T06:21:44.893005+0000","last_fullsized":"2023-10-09T06:21:44.893005+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":712,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270685,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.45000000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.496}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.621},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.65000000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.437},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46999999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860555,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.0960000000000001,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.63100000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":7.1299999999999999,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.55500000000000005}]},{"osd":4,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.52200000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.499},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.29399999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.311},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.32400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.44},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.36399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.5270000000000001,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.48099999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.42299999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.495},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.38500000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":712,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270775,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.29199999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":12.929,"5min":12.929,"15min":12.929},"last":0.315},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.39000000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.373}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.65400000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.55300000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.72299999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.745},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.57199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199861073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.981999999999999,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":9.1600000000000001,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.32800000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":8.4930000000000003,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":9.0239999999999991,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":4.6870000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":8.5190000000000001,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":15.007999999999999,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.377}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":14.917999999999999,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":8.9610000000000003,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.3919999999999995,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.505}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.56599999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":8.9160000000000004,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":8.4640000000000004,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.44700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.34599999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.30099999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.42599999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.59399999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199861039,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.379},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.3250000000000002,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.498}]},{"osd":2,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":11.715,"5min":11.715,"15min":11.715},"last":0.436}]},{"osd":3,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.64900000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.52100000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.42699999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.47799999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.54000000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.373}]},{"osd":6,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.64200000000000002}]}]}],"pool_statfs":[]}} 2023-10-09T06:21:49.383 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:21:49.383 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:21:49.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.541+0000 7f1145078700 1 Processor -- start 2023-10-09T06:21:49.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.541+0000 7f1145078700 1 -- start start 2023-10-09T06:21:49.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.542+0000 7f1145078700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f11400cdaa0 0x7f11400cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.542+0000 7f1145078700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400add80 con 0x7f1140159d30 2023-10-09T06:21:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.542+0000 7f1145078700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400cfed0 con 0x7f11400cf690 2023-10-09T06:21:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.542+0000 7f1145078700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400adbf0 con 0x7f11400cdaa0 2023-10-09T06:21:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.542+0000 7f113ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1140159d30 0x7f11400cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40734/0 (socket says 172.21.15.31:40734) 2023-10-09T06:21:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.542+0000 7f113ffff700 1 -- 172.21.15.31:0/2315550339 learned_addr learned my addr 172.21.15.31:0/2315550339 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.542+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645338188 0 0) 0x7f11400add80 con 0x7f1140159d30 2023-10-09T06:21:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.542+0000 7f113f7fe700 1 --2- 172.21.15.31:0/2315550339 >> v2:172.21.15.158:3300/0 conn(0x7f11400cdaa0 0x7f11400cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.542+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1128003570 con 0x7f1140159d30 2023-10-09T06:21:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 626787838 0 0) 0x7f1128003570 con 0x7f1140159d30 2023-10-09T06:21:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 >> v2:172.21.15.158:3300/0 conn(0x7f11400cdaa0 msgr2=0x7f11400cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 --2- 172.21.15.31:0/2315550339 >> v2:172.21.15.158:3300/0 conn(0x7f11400cdaa0 0x7f11400cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 >> v1:172.21.15.158:6789/0 conn(0x7f11400cf690 legacy=0x7f11400ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400d01b0 con 0x7f1140159d30 2023-10-09T06:21:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f11300015f0 con 0x7f1140159d30 2023-10-09T06:21:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 >> v1:172.21.15.31:6789/0 conn(0x7f1140159d30 legacy=0x7f11400cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 --2- 172.21.15.31:0/2315550339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1128003a60 0x7f1128003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 --2- 172.21.15.31:0/2315550339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1128004810 0x7f1128004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 --2- 172.21.15.31:0/2315550339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11280051c0 0x7f112800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400adbf0 con 0x7f1128004810 2023-10-09T06:21:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112800c0d0 con 0x7f11280051c0 2023-10-09T06:21:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112800c290 con 0x7f1128003a60 2023-10-09T06:21:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113f7fe700 1 --2- 172.21.15.31:0/2315550339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1128004810 0x7f1128004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113ffff700 1 --2- 172.21.15.31:0/2315550339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1128003a60 0x7f1128003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f1144877700 1 --2- 172.21.15.31:0/2315550339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11280051c0 0x7f112800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113f7fe700 1 -- 172.21.15.31:0/2315550339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1128003a60 msgr2=0x7f1128003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113f7fe700 1 --2- 172.21.15.31:0/2315550339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1128003a60 0x7f1128003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113f7fe700 1 -- 172.21.15.31:0/2315550339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11280051c0 msgr2=0x7f112800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113f7fe700 1 --2- 172.21.15.31:0/2315550339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11280051c0 0x7f112800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113f7fe700 1 -- 172.21.15.31:0/2315550339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1128003570 con 0x7f1128004810 2023-10-09T06:21:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113ffff700 1 --2- 172.21.15.31:0/2315550339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1128003a60 0x7f1128003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f1144877700 1 --2- 172.21.15.31:0/2315550339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11280051c0 0x7f112800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f1144877700 1 -- 172.21.15.31:0/2315550339 reap_dead start 2023-10-09T06:21:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113f7fe700 1 --2- 172.21.15.31:0/2315550339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1128004810 0x7f1128004c80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1134009c00 tx=0x7f11340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596c6ac053f8bf78 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113400e710 con 0x7f1128004810 2023-10-09T06:21:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113400e870 con 0x7f1128004810 2023-10-09T06:21:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.543+0000 7f113effd700 1 -- 172.21.15.31:0/2315550339 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113400ec30 con 0x7f1128004810 2023-10-09T06:21:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.544+0000 7f1145078700 1 -- 172.21.15.31:0/2315550339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1128004810 msgr2=0x7f1128004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.544+0000 7f1145078700 1 --2- 172.21.15.31:0/2315550339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1128004810 0x7f1128004c80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1134009c00 tx=0x7f11340091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.544+0000 7f1145078700 1 -- 172.21.15.31:0/2315550339 shutdown_connections 2023-10-09T06:21:49.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.544+0000 7f1145078700 1 --2- 172.21.15.31:0/2315550339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1128004810 0x7f1128004c80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.544+0000 7f1145078700 1 -- 172.21.15.31:0/2315550339 >> 172.21.15.31:0/2315550339 conn(0x7f1140099f50 msgr2=0x7f1140067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:49.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.544+0000 7f1145078700 1 -- 172.21.15.31:0/2315550339 shutdown_connections 2023-10-09T06:21:49.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.544+0000 7f1145078700 1 -- 172.21.15.31:0/2315550339 wait complete. 2023-10-09T06:21:49.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.545+0000 7f1145078700 1 Processor -- start 2023-10-09T06:21:49.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.545+0000 7f1145078700 1 -- start start 2023-10-09T06:21:49.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f1145078700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1128004810 0x7f1140169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f1145078700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1140158c90 0x7f114009ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f1145078700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1140159100 0x7f114009d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f1145078700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400b0db0 con 0x7f1140158c90 2023-10-09T06:21:49.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f1145078700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114009d950 con 0x7f1128004810 2023-10-09T06:21:49.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f1145078700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11400b0480 con 0x7f1140159100 2023-10-09T06:21:49.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f113f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1140158c90 0x7f114009ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f113f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1140158c90 0x7f114009ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44106/0 (socket says 172.21.15.31:44106) 2023-10-09T06:21:49.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f113f7fe700 1 -- 172.21.15.31:0/913285033 learned_addr learned my addr 172.21.15.31:0/913285033 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:49.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f113ffff700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1128004810 0x7f1140169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f1144877700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1140159100 0x7f114009d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f113f7fe700 1 -- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1140159100 msgr2=0x7f114009d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f113f7fe700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1140159100 0x7f114009d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f113f7fe700 1 -- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1128004810 msgr2=0x7f1140169e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f113f7fe700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1128004810 0x7f1140169e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f113f7fe700 1 -- 172.21.15.31:0/913285033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400b0760 con 0x7f1140158c90 2023-10-09T06:21:49.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f1144877700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1140159100 0x7f114009d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:49.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.546+0000 7f113ffff700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1128004810 0x7f1140169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:49.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.547+0000 7f113f7fe700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1140158c90 0x7f114009ce30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f112800c0a0 tx=0x7f113401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:49.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.547+0000 7f1127fff700 1 -- 172.21.15.31:0/913285033 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134022070 con 0x7f1140158c90 2023-10-09T06:21:49.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.547+0000 7f1127fff700 1 -- 172.21.15.31:0/913285033 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113400e9e0 con 0x7f1140158c90 2023-10-09T06:21:49.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.547+0000 7f1127fff700 1 -- 172.21.15.31:0/913285033 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113401c450 con 0x7f1140158c90 2023-10-09T06:21:49.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.547+0000 7f1145078700 1 -- 172.21.15.31:0/913285033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11400b0db0 con 0x7f1140158c90 2023-10-09T06:21:49.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.547+0000 7f1145078700 1 -- 172.21.15.31:0/913285033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114016a3b0 con 0x7f1140158c90 2023-10-09T06:21:49.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.548+0000 7f1145078700 1 -- 172.21.15.31:0/913285033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11400b0c00 con 0x7f1140158c90 2023-10-09T06:21:49.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.548+0000 7f1127fff700 1 -- 172.21.15.31:0/913285033 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f113401c880 con 0x7f1140158c90 2023-10-09T06:21:49.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.549+0000 7f1127fff700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f112c066f30 0x7f112c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.549+0000 7f1127fff700 1 -- 172.21.15.31:0/913285033 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1134085d40 con 0x7f1140158c90 2023-10-09T06:21:49.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.549+0000 7f113ffff700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f112c066f30 0x7f112c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.549+0000 7f113ffff700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f112c066f30 0x7f112c0693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1130002ee0 tx=0x7f1130009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:49.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.553+0000 7f1127fff700 1 -- 172.21.15.31:0/913285033 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1134053060 con 0x7f1140158c90 2023-10-09T06:21:49.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.824+0000 7f1145078700 1 -- 172.21.15.31:0/913285033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f114006ada0 con 0x7f1140158c90 2023-10-09T06:21:49.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.828+0000 7f1127fff700 1 -- 172.21.15.31:0/913285033 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f11340170e0 con 0x7f1140158c90 2023-10-09T06:21:49.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.830+0000 7f1145078700 1 -- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f112c066f30 msgr2=0x7f112c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.830+0000 7f1145078700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f112c066f30 0x7f112c0693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1130002ee0 tx=0x7f1130009040 comp rx=0 tx=0).stop 2023-10-09T06:21:49.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.830+0000 7f1145078700 1 -- 172.21.15.31:0/913285033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1140158c90 msgr2=0x7f114009ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.830+0000 7f1145078700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1140158c90 0x7f114009ce30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f112800c0a0 tx=0x7f113401a000 comp rx=0 tx=0).stop 2023-10-09T06:21:49.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.830+0000 7f1145078700 1 -- 172.21.15.31:0/913285033 shutdown_connections 2023-10-09T06:21:49.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.830+0000 7f1145078700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f112c066f30 0x7f112c0693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.830+0000 7f1145078700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1140159100 0x7f114009d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.830+0000 7f1145078700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1128004810 0x7f1140169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.830+0000 7f1145078700 1 --2- 172.21.15.31:0/913285033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1140158c90 0x7f114009ce30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.830+0000 7f1145078700 1 -- 172.21.15.31:0/913285033 >> 172.21.15.31:0/913285033 conn(0x7f1140099f50 msgr2=0x7f11400d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:49.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.830+0000 7f1145078700 1 -- 172.21.15.31:0/913285033 shutdown_connections 2023-10-09T06:21:49.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.830+0000 7f1145078700 1 -- 172.21.15.31:0/913285033 wait complete. 2023-10-09T06:21:49.834 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2023-10-09T06:21:49.844 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:21:49.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.963+0000 7fc422564700 1 Processor -- start 2023-10-09T06:21:49.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.963+0000 7fc422564700 1 -- start start 2023-10-09T06:21:49.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.964+0000 7fc422564700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc41c0cdab0 0x7fc41c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.964+0000 7fc422564700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc41c15dda0 0x7fc41c15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.964+0000 7fc422564700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c0cb7c0 con 0x7fc41c0cd6e0 2023-10-09T06:21:49.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.964+0000 7fc422564700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41c15e850 con 0x7fc41c0cdab0 2023-10-09T06:21:49.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.964+0000 7fc422564700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0cc360 con 0x7fc41c15dda0 2023-10-09T06:21:49.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.964+0000 7fc421d63700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc41c15dda0 0x7fc41c15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.964+0000 7fc420d61700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc41c0cdab0 0x7fc41c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.964+0000 7fc421d63700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc41c15dda0 0x7fc41c15cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:56268/0 (socket says 172.21.15.31:56268) 2023-10-09T06:21:49.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.964+0000 7fc421562700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fc41c0cd6e0 0x7fc41c0cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:59276/0 (socket says 172.21.15.31:59276) 2023-10-09T06:21:49.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.964+0000 7fc421d63700 1 -- 172.21.15.31:0/3677194357 learned_addr learned my addr 172.21.15.31:0/3677194357 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:49.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.965+0000 7fc41bfff700 1 -- 172.21.15.31:0/3677194357 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285105927 0 0) 0x7fc41c0cb7c0 con 0x7fc41c0cd6e0 2023-10-09T06:21:49.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.965+0000 7fc41bfff700 1 -- 172.21.15.31:0/3677194357 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc404003570 con 0x7fc41c0cd6e0 2023-10-09T06:21:49.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.965+0000 7fc421d63700 1 -- 172.21.15.31:0/3677194357 >> v2:172.21.15.158:3300/0 conn(0x7fc41c0cdab0 msgr2=0x7fc41c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:49.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.965+0000 7fc421d63700 1 --2- 172.21.15.31:0/3677194357 >> v2:172.21.15.158:3300/0 conn(0x7fc41c0cdab0 0x7fc41c15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.965+0000 7fc421d63700 1 -- 172.21.15.31:0/3677194357 >> v1:172.21.15.158:6789/0 conn(0x7fc41c0cd6e0 legacy=0x7fc41c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.965+0000 7fc421d63700 1 -- 172.21.15.31:0/3677194357 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c15e290 con 0x7fc41c15dda0 2023-10-09T06:21:49.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.965+0000 7fc421d63700 1 --2- 172.21.15.31:0/3677194357 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc41c15dda0 0x7fc41c15cbd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009f20 tx=0x7fc40c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96ffbd2483b8c07b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:49.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.965+0000 7fc41bfff700 1 -- 172.21.15.31:0/3677194357 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c00e070 con 0x7fc41c15dda0 2023-10-09T06:21:49.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.965+0000 7fc41bfff700 1 -- 172.21.15.31:0/3677194357 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40c00b970 con 0x7fc41c15dda0 2023-10-09T06:21:49.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.965+0000 7fc41bfff700 1 -- 172.21.15.31:0/3677194357 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c0092e0 con 0x7fc41c15dda0 2023-10-09T06:21:49.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.966+0000 7fc422564700 1 -- 172.21.15.31:0/3677194357 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc41c15dda0 msgr2=0x7fc41c15cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.966+0000 7fc422564700 1 --2- 172.21.15.31:0/3677194357 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc41c15dda0 0x7fc41c15cbd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009f20 tx=0x7fc40c009840 comp rx=0 tx=0).stop 2023-10-09T06:21:49.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.966+0000 7fc422564700 1 -- 172.21.15.31:0/3677194357 shutdown_connections 2023-10-09T06:21:49.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.966+0000 7fc422564700 1 --2- 172.21.15.31:0/3677194357 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc41c15dda0 0x7fc41c15cbd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.966+0000 7fc422564700 1 --2- 172.21.15.31:0/3677194357 >> v2:172.21.15.158:3300/0 conn(0x7fc41c0cdab0 0x7fc41c15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.966+0000 7fc422564700 1 -- 172.21.15.31:0/3677194357 >> 172.21.15.31:0/3677194357 conn(0x7fc41c067660 msgr2=0x7fc41c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:49.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.966+0000 7fc422564700 1 -- 172.21.15.31:0/3677194357 shutdown_connections 2023-10-09T06:21:49.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.966+0000 7fc422564700 1 -- 172.21.15.31:0/3677194357 wait complete. 2023-10-09T06:21:49.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.967+0000 7fc422564700 1 Processor -- start 2023-10-09T06:21:49.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.967+0000 7fc422564700 1 -- start start 2023-10-09T06:21:49.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc422564700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc41c0cd6e0 0x7fc41c0b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc422564700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc41c0cdab0 0x7fc41c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc422564700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc41c15dda0 0x7fc41c14b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc422564700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c14ccf0 con 0x7fc41c0cdab0 2023-10-09T06:21:49.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc422564700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c14c730 con 0x7fc41c0cd6e0 2023-10-09T06:21:49.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc422564700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c14ca10 con 0x7fc41c15dda0 2023-10-09T06:21:49.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc420d61700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc41c0cdab0 0x7fc41c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc420d61700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc41c0cdab0 0x7fc41c1551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37388/0 (socket says 172.21.15.31:37388) 2023-10-09T06:21:49.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc420d61700 1 -- 172.21.15.31:0/1348463120 learned_addr learned my addr 172.21.15.31:0/1348463120 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:49.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc421d63700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc41c15dda0 0x7fc41c14b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc421562700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc41c0cd6e0 0x7fc41c0b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc420d61700 1 -- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc41c15dda0 msgr2=0x7fc41c14b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc420d61700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc41c15dda0 0x7fc41c14b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc420d61700 1 -- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc41c0cd6e0 msgr2=0x7fc41c0b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:49.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc420d61700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc41c0cd6e0 0x7fc41c0b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:49.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc420d61700 1 -- 172.21.15.31:0/1348463120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c009ae0 con 0x7fc41c0cdab0 2023-10-09T06:21:49.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc421d63700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc41c15dda0 0x7fc41c14b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:49.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc421562700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc41c0cd6e0 0x7fc41c0b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:49.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc420d61700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc41c0cdab0 0x7fc41c1551d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc41000ec80 tx=0x7fc4100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:49.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.968+0000 7fc4197fa700 1 -- 172.21.15.31:0/1348463120 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41000c9d0 con 0x7fc41c0cdab0 2023-10-09T06:21:49.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.969+0000 7fc4197fa700 1 -- 172.21.15.31:0/1348463120 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41000cb30 con 0x7fc41c0cdab0 2023-10-09T06:21:49.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.969+0000 7fc422564700 1 -- 172.21.15.31:0/1348463120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41c0b1030 con 0x7fc41c0cdab0 2023-10-09T06:21:49.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.969+0000 7fc4197fa700 1 -- 172.21.15.31:0/1348463120 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410013470 con 0x7fc41c0cdab0 2023-10-09T06:21:49.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.969+0000 7fc422564700 1 -- 172.21.15.31:0/1348463120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41c0b6000 con 0x7fc41c0cdab0 2023-10-09T06:21:49.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.969+0000 7fc422564700 1 -- 172.21.15.31:0/1348463120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41c0d1a30 con 0x7fc41c0cdab0 2023-10-09T06:21:49.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.970+0000 7fc4197fa700 1 -- 172.21.15.31:0/1348463120 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc410013820 con 0x7fc41c0cdab0 2023-10-09T06:21:49.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.970+0000 7fc4197fa700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc408066f30 0x7fc4080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:49.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.970+0000 7fc4197fa700 1 -- 172.21.15.31:0/1348463120 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc4100848c0 con 0x7fc41c0cdab0 2023-10-09T06:21:49.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.971+0000 7fc421562700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc408066f30 0x7fc4080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:49.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.971+0000 7fc421562700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc408066f30 0x7fc4080693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc414005f00 tx=0x7fc414007c60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:49.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:49.975+0000 7fc4197fa700 1 -- 172.21.15.31:0/1348463120 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc410051b30 con 0x7fc41c0cdab0 2023-10-09T06:21:50.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.215+0000 7fc422564700 1 -- 172.21.15.31:0/1348463120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc41c04bb80 con 0x7fc41c0cdab0 2023-10-09T06:21:50.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.216+0000 7fc4197fa700 1 -- 172.21.15.31:0/1348463120 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fc410055150 con 0x7fc41c0cdab0 2023-10-09T06:21:50.218 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:50.218 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1792934235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1792934235},{"type":"v1","addr":"172.21.15.158:6837","nonce":1792934235}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/893363730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":893363730},{"type":"v1","addr":"172.21.15.31:6834","nonce":893363730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4923,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2780075004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2780075004},{"type":"v1","addr":"172.21.15.31:6835","nonce":2780075004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:21:44.276772+0000","modified":"2023-10-09T06:21:47.908951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6836/1041874650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1041874650},{"type":"v1","addr":"172.21.15.158:6836","nonce":1041874650}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:21:50.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.218+0000 7fc422564700 1 -- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc408066f30 msgr2=0x7fc4080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.218+0000 7fc422564700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc408066f30 0x7fc4080693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc414005f00 tx=0x7fc414007c60 comp rx=0 tx=0).stop 2023-10-09T06:21:50.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.218+0000 7fc422564700 1 -- 172.21.15.31:0/1348463120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc41c0cdab0 msgr2=0x7fc41c1551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.218+0000 7fc422564700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc41c0cdab0 0x7fc41c1551d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc41000ec80 tx=0x7fc4100091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.218+0000 7fc422564700 1 -- 172.21.15.31:0/1348463120 shutdown_connections 2023-10-09T06:21:50.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.218+0000 7fc422564700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc408066f30 0x7fc4080693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.218+0000 7fc422564700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc41c15dda0 0x7fc41c14b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.218+0000 7fc422564700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc41c0cd6e0 0x7fc41c0b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.218+0000 7fc422564700 1 --2- 172.21.15.31:0/1348463120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc41c0cdab0 0x7fc41c1551d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.218+0000 7fc422564700 1 -- 172.21.15.31:0/1348463120 >> 172.21.15.31:0/1348463120 conn(0x7fc41c067660 msgr2=0x7fc41c0c5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.218+0000 7fc422564700 1 -- 172.21.15.31:0/1348463120 shutdown_connections 2023-10-09T06:21:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.218+0000 7fc422564700 1 -- 172.21.15.31:0/1348463120 wait complete. 2023-10-09T06:21:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 16 2023-10-09T06:21:50.634 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:21:44.276772+0000', 'modified': '2023-10-09T06:21:47.908951+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4926}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4926': {'gid': 4926, 'name': 'd', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.158:6836/1041874650', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6834', 'nonce': 1041874650}, {'type': 'v1', 'addr': '172.21.15.158:6836', 'nonce': 1041874650}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:21:50.634 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:21:50.634 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T06:21:50.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.756+0000 7f36a6818700 1 Processor -- start 2023-10-09T06:21:50.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.756+0000 7f36a6818700 1 -- start start 2023-10-09T06:21:50.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.757+0000 7f36a6818700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f36a0159da0 0x7f36a00b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.757+0000 7f36a6818700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f36a015a170 0x7f36a0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.757+0000 7f36a6818700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a015ea70 con 0x7f36a0069040 2023-10-09T06:21:50.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.757+0000 7f36a6818700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a00694e0 con 0x7f36a0159da0 2023-10-09T06:21:50.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.757+0000 7f36a6818700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00b3990 con 0x7f36a015a170 2023-10-09T06:21:50.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.757+0000 7f36a5015700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f36a015a170 0x7f36a0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.757+0000 7f36a5816700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f36a0159da0 0x7f36a00b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.757+0000 7f36a5816700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f36a0159da0 0x7f36a00b2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:42450/0 (socket says 172.21.15.31:42450) 2023-10-09T06:21:50.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.757+0000 7f36a5015700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f36a015a170 0x7f36a0068b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:56282/0 (socket says 172.21.15.31:56282) 2023-10-09T06:21:50.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.757+0000 7f36a5816700 1 -- 172.21.15.31:0/248769352 learned_addr learned my addr 172.21.15.31:0/248769352 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:50.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.758+0000 7f36a5816700 1 -- 172.21.15.31:0/248769352 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f36a015a170 msgr2=0x7f36a0068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:50.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.758+0000 7f36a5816700 1 --2- 172.21.15.31:0/248769352 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f36a015a170 0x7f36a0068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.758+0000 7f36a5816700 1 -- 172.21.15.31:0/248769352 >> v1:172.21.15.158:6789/0 conn(0x7f36a0069040 legacy=0x7f36a00af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.758+0000 7f36a5816700 1 -- 172.21.15.31:0/248769352 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00b0b70 con 0x7f36a0159da0 2023-10-09T06:21:50.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.758+0000 7f36a4814700 1 -- 172.21.15.31:0/248769352 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761976056 0 0) 0x7f36a015ea70 con 0x7f36a0069040 2023-10-09T06:21:50.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.758+0000 7f36a5015700 1 --2- 172.21.15.31:0/248769352 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f36a015a170 0x7f36a0068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:50.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.758+0000 7f36a5816700 1 --2- 172.21.15.31:0/248769352 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36a0159da0 0x7f36a00b2da0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f36940099b0 tx=0x7f3694009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=938cd88bb988e11 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:50.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.758+0000 7f36a4814700 1 -- 172.21.15.31:0/248769352 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694009ea0 con 0x7f36a0159da0 2023-10-09T06:21:50.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.758+0000 7f36a4814700 1 -- 172.21.15.31:0/248769352 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369400b860 con 0x7f36a0159da0 2023-10-09T06:21:50.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.758+0000 7f36a4814700 1 -- 172.21.15.31:0/248769352 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400bc20 con 0x7f36a0159da0 2023-10-09T06:21:50.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.759+0000 7f36a6818700 1 -- 172.21.15.31:0/248769352 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36a0159da0 msgr2=0x7f36a00b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.759+0000 7f36a6818700 1 --2- 172.21.15.31:0/248769352 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36a0159da0 0x7f36a00b2da0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f36940099b0 tx=0x7f3694009250 comp rx=0 tx=0).stop 2023-10-09T06:21:50.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.759+0000 7f36a6818700 1 -- 172.21.15.31:0/248769352 shutdown_connections 2023-10-09T06:21:50.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.759+0000 7f36a6818700 1 --2- 172.21.15.31:0/248769352 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36a0159da0 0x7f36a00b2da0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.759+0000 7f36a6818700 1 --2- 172.21.15.31:0/248769352 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f36a015a170 0x7f36a0068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.759+0000 7f36a6818700 1 -- 172.21.15.31:0/248769352 >> 172.21.15.31:0/248769352 conn(0x7f36a00d0bc0 msgr2=0x7f36a00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:50.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.759+0000 7f36a6818700 1 -- 172.21.15.31:0/248769352 shutdown_connections 2023-10-09T06:21:50.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.759+0000 7f36a6818700 1 -- 172.21.15.31:0/248769352 wait complete. 2023-10-09T06:21:50.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.760+0000 7f36a6818700 1 Processor -- start 2023-10-09T06:21:50.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.760+0000 7f36a6818700 1 -- start start 2023-10-09T06:21:50.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a6818700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36a0069040 0x7f36a00c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a6818700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f36a0159da0 0x7f36a014abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a6818700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36a015a170 0x7f36a014b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a6818700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00ca4b0 con 0x7f36a0069040 2023-10-09T06:21:50.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a6818700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00c98a0 con 0x7f36a015a170 2023-10-09T06:21:50.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a6818700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00c9b80 con 0x7f36a0159da0 2023-10-09T06:21:50.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a5816700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36a0069040 0x7f36a00c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a5816700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36a0069040 0x7f36a00c5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37392/0 (socket says 172.21.15.31:37392) 2023-10-09T06:21:50.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a5816700 1 -- 172.21.15.31:0/1056307288 learned_addr learned my addr 172.21.15.31:0/1056307288 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:50.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a5015700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f36a0159da0 0x7f36a014abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a6017700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36a015a170 0x7f36a014b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a5816700 1 -- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f36a0159da0 msgr2=0x7f36a014abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a5816700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f36a0159da0 0x7f36a014abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a5816700 1 -- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36a015a170 msgr2=0x7f36a014b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a5816700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36a015a170 0x7f36a014b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a5816700 1 -- 172.21.15.31:0/1056307288 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c009420 con 0x7f36a0069040 2023-10-09T06:21:50.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a6017700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36a015a170 0x7f36a014b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:50.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f36a5816700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36a0069040 0x7f36a00c5280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f36a006b5c0 tx=0x7f3694017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:50.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f3691ffb700 1 -- 172.21.15.31:0/1056307288 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369401f070 con 0x7f36a0069040 2023-10-09T06:21:50.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.761+0000 7f3691ffb700 1 -- 172.21.15.31:0/1056307288 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694006ab0 con 0x7f36a0069040 2023-10-09T06:21:50.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.762+0000 7f36a6818700 1 -- 172.21.15.31:0/1056307288 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36940094f0 con 0x7f36a0069040 2023-10-09T06:21:50.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.762+0000 7f3691ffb700 1 -- 172.21.15.31:0/1056307288 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400b9d0 con 0x7f36a0069040 2023-10-09T06:21:50.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.762+0000 7f36a6818700 1 -- 172.21.15.31:0/1056307288 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a00ca140 con 0x7f36a0069040 2023-10-09T06:21:50.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.763+0000 7f3691ffb700 1 -- 172.21.15.31:0/1056307288 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3694023070 con 0x7f36a0069040 2023-10-09T06:21:50.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.764+0000 7f3691ffb700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3684066f30 0x7f36840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.764+0000 7f3691ffb700 1 -- 172.21.15.31:0/1056307288 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36940856c0 con 0x7f36a0069040 2023-10-09T06:21:50.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.764+0000 7f36a5015700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3684066f30 0x7f36840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.764+0000 7f36a5015700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3684066f30 0x7f36840693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f36a0157740 tx=0x7f369c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:50.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.766+0000 7f36b0d72b80 1 Processor -- start 2023-10-09T06:21:50.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.766+0000 7f36b0d72b80 1 -- start start 2023-10-09T06:21:50.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.766+0000 7f36b0d72b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e2399480 0x55e0e23787d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.766+0000 7f36b0d72b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234c5f0 0x55e0e2399850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.766+0000 7f36b0d72b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234eb80 0x55e0e234eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.766+0000 7f36b0d72b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0e22a5a70 con 0x55e0e234eb80 2023-10-09T06:21:50.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.766+0000 7f36b0d72b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0e22a3270 con 0x55e0e2399480 2023-10-09T06:21:50.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.766+0000 7f36b0d72b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0e229f060 con 0x55e0e234c5f0 2023-10-09T06:21:50.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.766+0000 7f36a6017700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234eb80 0x55e0e234eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.766+0000 7f36a6017700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234eb80 0x55e0e234eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37394/0 (socket says 172.21.15.31:37394) 2023-10-09T06:21:50.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.766+0000 7f36a6017700 1 -- 172.21.15.31:0/781913219 learned_addr learned my addr 172.21.15.31:0/781913219 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:50.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.766+0000 7f36a5816700 1 --2- 172.21.15.31:0/781913219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e2399480 0x55e0e23787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.766+0000 7f36a5015700 1 --2- 172.21.15.31:0/781913219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234c5f0 0x55e0e2399850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.767+0000 7f36a6017700 1 -- 172.21.15.31:0/781913219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234c5f0 msgr2=0x55e0e2399850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:50.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.767+0000 7f36a6017700 1 --2- 172.21.15.31:0/781913219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234c5f0 0x55e0e2399850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.767+0000 7f36a6017700 1 -- 172.21.15.31:0/781913219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e2399480 msgr2=0x55e0e23787d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:50.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.767+0000 7f36a6017700 1 --2- 172.21.15.31:0/781913219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e2399480 0x55e0e23787d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.767+0000 7f36a6017700 1 -- 172.21.15.31:0/781913219 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0e2139270 con 0x55e0e234eb80 2023-10-09T06:21:50.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.767+0000 7f36a6017700 1 --2- 172.21.15.31:0/781913219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234eb80 0x55e0e234eff0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3698001df0 tx=0x7f3698009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fc74c558bd9453 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:50.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.767+0000 7f368affd700 1 -- 172.21.15.31:0/781913219 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800e930 con 0x55e0e234eb80 2023-10-09T06:21:50.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.767+0000 7f368affd700 1 -- 172.21.15.31:0/781913219 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800ea90 con 0x55e0e234eb80 2023-10-09T06:21:50.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.767+0000 7f368affd700 1 -- 172.21.15.31:0/781913219 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800ee30 con 0x55e0e234eb80 2023-10-09T06:21:50.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.767+0000 7f36b0d72b80 1 -- 172.21.15.31:0/781913219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234eb80 msgr2=0x55e0e234eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.767+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/781913219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234eb80 0x55e0e234eff0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3698001df0 tx=0x7f3698009040 comp rx=0 tx=0).stop 2023-10-09T06:21:50.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.768+0000 7f36b0d72b80 1 -- 172.21.15.31:0/781913219 shutdown_connections 2023-10-09T06:21:50.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.768+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/781913219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234eb80 0x55e0e234eff0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.768+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/781913219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e2399480 0x55e0e23787d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.768+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/781913219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234c5f0 0x55e0e2399850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.768+0000 7f36b0d72b80 1 -- 172.21.15.31:0/781913219 >> 172.21.15.31:0/781913219 conn(0x55e0e23500c0 msgr2=0x55e0e23508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:50.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.768+0000 7f36b0d72b80 1 -- 172.21.15.31:0/781913219 shutdown_connections 2023-10-09T06:21:50.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.768+0000 7f36b0d72b80 1 -- 172.21.15.31:0/781913219 wait complete. 2023-10-09T06:21:50.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.768+0000 7f36b0d72b80 1 -- start start 2023-10-09T06:21:50.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.768+0000 7f36b0d72b80 1 Processor -- start 2023-10-09T06:21:50.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.769+0000 7f36b0d72b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e234c5f0 0x55e0e23717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.769+0000 7f36b0d72b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234eb80 0x55e0e23986b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.769+0000 7f36b0d72b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e2399480 0x55e0e2398bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.769+0000 7f36b0d72b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0e224a890 con 0x55e0e2399480 2023-10-09T06:21:50.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.769+0000 7f36b0d72b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0e2265ea0 con 0x55e0e234c5f0 2023-10-09T06:21:50.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.769+0000 7f36b0d72b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0e2121e30 con 0x55e0e234eb80 2023-10-09T06:21:50.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.769+0000 7f36b0d72b80 10 client.0 _ll_register_callbacks cb 0x55e0e23122c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:21:50.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.769+0000 7f36a6017700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e2399480 0x55e0e2398bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.769+0000 7f36a6017700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e2399480 0x55e0e2398bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37410/0 (socket says 172.21.15.31:37410) 2023-10-09T06:21:50.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.769+0000 7f36a6017700 1 -- 172.21.15.31:0/3134020539 learned_addr learned my addr 172.21.15.31:0/3134020539 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:50.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.769+0000 7f36a5015700 1 --2- 172.21.15.31:0/3134020539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234eb80 0x55e0e23986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.769+0000 7f36a5816700 1 --2- 172.21.15.31:0/3134020539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e234c5f0 0x55e0e23717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f36a6017700 1 -- 172.21.15.31:0/3134020539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234eb80 msgr2=0x55e0e23986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:50.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f36a6017700 1 --2- 172.21.15.31:0/3134020539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234eb80 0x55e0e23986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f36a6017700 1 -- 172.21.15.31:0/3134020539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e234c5f0 msgr2=0x55e0e23717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:50.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f36a6017700 1 --2- 172.21.15.31:0/3134020539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e234c5f0 0x55e0e23717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f36a6017700 1 -- 172.21.15.31:0/3134020539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369800f040 con 0x55e0e2399480 2023-10-09T06:21:50.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f36a6017700 1 --2- 172.21.15.31:0/3134020539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e2399480 0x55e0e2398bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f369800e440 tx=0x7f369801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e28884d1578867f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:50.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f367ffff700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:21:50.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f367ffff700 1 -- 172.21.15.31:0/3134020539 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698013630 con 0x55e0e2399480 2023-10-09T06:21:50.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f367ffff700 1 -- 172.21.15.31:0/3134020539 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3698013790 con 0x55e0e2399480 2023-10-09T06:21:50.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3134020539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0e2343cd0 con 0x55e0e2399480 2023-10-09T06:21:50.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f367ffff700 1 -- 172.21.15.31:0/3134020539 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3698013b60 con 0x55e0e2399480 2023-10-09T06:21:50.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f36b0d72b80 10 client.5091 fetch_fsmap learned FSMap version 16 2023-10-09T06:21:50.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3134020539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e0e20dbfe0 con 0x55e0e2399480 2023-10-09T06:21:50.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f367ffff700 1 -- 172.21.15.31:0/3134020539 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0e2343cd0 con 0x55e0e2399480 2023-10-09T06:21:50.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f367ffff700 1 -- 172.21.15.31:0/3134020539 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3698013cc0 con 0x55e0e2399480 2023-10-09T06:21:50.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f36b0d72b80 10 client.5091 fetch_fsmap finished waiting for FSMap version 16 2023-10-09T06:21:50.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f36b0d72b80 10 client.5091 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T06:21:50.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f36b0d72b80 20 client.5091 populate_metadata read hostname 'smithi031' 2023-10-09T06:21:50.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.770+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3134020539 >> [v2:172.21.15.158:6834/1041874650,v1:172.21.15.158:6836/1041874650] conn(0x55e0e23728a0 0x55e0e2372c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.771+0000 7f36b0d72b80 4 client.5091 mds_command: new command op to 4926 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:21:50.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.771+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3134020539 --> [v2:172.21.15.158:6834/1041874650,v1:172.21.15.158:6836/1041874650] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0e2320aa0 con 0x55e0e23728a0 2023-10-09T06:21:50.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.771+0000 7f36a5816700 1 --2- 172.21.15.31:0/3134020539 >> [v2:172.21.15.158:6834/1041874650,v1:172.21.15.158:6836/1041874650] conn(0x55e0e23728a0 0x55e0e2372c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.771+0000 7f36a5816700 1 --2- 172.21.15.31:0/3134020539 >> [v2:172.21.15.158:6834/1041874650,v1:172.21.15.158:6836/1041874650] conn(0x55e0e23728a0 0x55e0e2372c70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=852e97d3572b3025 server_cookie=d9d2350887ea1de0 in_seq=0 out_seq=0 2023-10-09T06:21:50.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.771+0000 7f367ffff700 10 client.5091 ms_handle_connect on v2:172.21.15.158:6834/1041874650 2023-10-09T06:21:50.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f367ffff700 1 -- 172.21.15.31:0/3134020539 <== mds.0 v2:172.21.15.158:6834/1041874650 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e0e2320aa0 con 0x55e0e23728a0 2023-10-09T06:21:50.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f367ffff700 10 client.5091 handle_command_reply: tid=0 2023-10-09T06:21:50.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f36b0d72b80 1 client.5091 shutdown 2023-10-09T06:21:50.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3134020539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e2399480 msgr2=0x55e0e2398bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3134020539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e2399480 0x55e0e2398bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f369800e440 tx=0x7f369801a000 comp rx=0 tx=0).stop 2023-10-09T06:21:50.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3134020539 shutdown_connections 2023-10-09T06:21:50.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3134020539 >> [v2:172.21.15.158:6834/1041874650,v1:172.21.15.158:6836/1041874650] conn(0x55e0e23728a0 0x55e0e2372c70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3134020539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e2399480 0x55e0e2398bf0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f367ffff700 0 client.5091 ms_handle_reset on v2:172.21.15.158:6834/1041874650 2023-10-09T06:21:50.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3134020539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e234c5f0 0x55e0e23717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3134020539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234eb80 0x55e0e23986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3134020539 >> 172.21.15.31:0/3134020539 conn(0x55e0e23500c0 msgr2=0x55e0e234ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:50.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3134020539 shutdown_connections 2023-10-09T06:21:50.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3134020539 wait complete. 2023-10-09T06:21:50.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.772+0000 7f36b0d72b80 20 client.5091 trim_cache size 0 max 16384 2023-10-09T06:21:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.789+0000 7f36b0d72b80 1 Processor -- start 2023-10-09T06:21:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.789+0000 7f36b0d72b80 1 -- start start 2023-10-09T06:21:50.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36b0d72b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 0x55e0e2371a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36b0d72b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e234eb80 0x55e0e234ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36b0d72b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e2399480 0x55e0e2398960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36b0d72b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0e232e5b0 con 0x55e0e234c5f0 2023-10-09T06:21:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36b0d72b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0e234d5c0 con 0x55e0e234eb80 2023-10-09T06:21:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36b0d72b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0e2378e70 con 0x55e0e2399480 2023-10-09T06:21:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36a5816700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 0x55e0e2371a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36a5816700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 0x55e0e2371a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37414/0 (socket says 172.21.15.31:37414) 2023-10-09T06:21:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36a5816700 1 -- 172.21.15.31:0/3779362291 learned_addr learned my addr 172.21.15.31:0/3779362291 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36a5816700 1 -- 172.21.15.31:0/3779362291 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e2399480 msgr2=0x55e0e2398960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36a5816700 1 --2- 172.21.15.31:0/3779362291 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e2399480 0x55e0e2398960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36a5816700 1 -- 172.21.15.31:0/3779362291 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e234eb80 msgr2=0x55e0e234ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36a5816700 1 --2- 172.21.15.31:0/3779362291 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e234eb80 0x55e0e234ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36a5816700 1 -- 172.21.15.31:0/3779362291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0e237bd40 con 0x55e0e234c5f0 2023-10-09T06:21:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.790+0000 7f36a5816700 1 --2- 172.21.15.31:0/3779362291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 0x55e0e2371a80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3694083c90 tx=0x7f369401c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be39b9d086cb0a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.791+0000 7f368b7fe700 1 -- 172.21.15.31:0/3779362291 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369405d590 con 0x55e0e234c5f0 2023-10-09T06:21:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.791+0000 7f368b7fe700 1 -- 172.21.15.31:0/3779362291 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694083cf0 con 0x55e0e234c5f0 2023-10-09T06:21:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.791+0000 7f368b7fe700 1 -- 172.21.15.31:0/3779362291 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400bb30 con 0x55e0e234c5f0 2023-10-09T06:21:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.791+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3779362291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 msgr2=0x55e0e2371a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.791+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3779362291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 0x55e0e2371a80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3694083c90 tx=0x7f369401c040 comp rx=0 tx=0).stop 2023-10-09T06:21:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.791+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3779362291 shutdown_connections 2023-10-09T06:21:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.791+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3779362291 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e2399480 0x55e0e2398960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.791+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3779362291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 0x55e0e2371a80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.791+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3779362291 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e234eb80 0x55e0e234ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.791+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3779362291 >> 172.21.15.31:0/3779362291 conn(0x55e0e23500c0 msgr2=0x55e0e2399850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:50.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.791+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3779362291 shutdown_connections 2023-10-09T06:21:50.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.791+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3779362291 wait complete. 2023-10-09T06:21:50.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.792+0000 7f36b0d72b80 1 -- start start 2023-10-09T06:21:50.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.792+0000 7f36b0d72b80 1 Processor -- start 2023-10-09T06:21:50.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36b0d72b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 0x55e0e23e3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36b0d72b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234eb80 0x55e0e234b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36b0d72b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e2399480 0x55e0e234bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36b0d72b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0e23e4120 con 0x55e0e234c5f0 2023-10-09T06:21:50.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36b0d72b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0e23ac4a0 con 0x55e0e2399480 2023-10-09T06:21:50.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36b0d72b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0e23adee0 con 0x55e0e234eb80 2023-10-09T06:21:50.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36b0d72b80 10 client.0 _ll_register_callbacks cb 0x55e0e23122c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:21:50.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36a5816700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 0x55e0e23e3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36a5816700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 0x55e0e23e3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37424/0 (socket says 172.21.15.31:37424) 2023-10-09T06:21:50.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36a5816700 1 -- 172.21.15.31:0/3254618972 learned_addr learned my addr 172.21.15.31:0/3254618972 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:50.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36a6017700 1 --2- 172.21.15.31:0/3254618972 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e2399480 0x55e0e234bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36a5015700 1 --2- 172.21.15.31:0/3254618972 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234eb80 0x55e0e234b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36a5816700 1 -- 172.21.15.31:0/3254618972 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234eb80 msgr2=0x55e0e234b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:50.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36a5816700 1 --2- 172.21.15.31:0/3254618972 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234eb80 0x55e0e234b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36a5816700 1 -- 172.21.15.31:0/3254618972 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e2399480 msgr2=0x55e0e234bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:50.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36a5816700 1 --2- 172.21.15.31:0/3254618972 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e2399480 0x55e0e234bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36a5816700 1 -- 172.21.15.31:0/3254618972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a00ca140 con 0x55e0e234c5f0 2023-10-09T06:21:50.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36a5816700 1 --2- 172.21.15.31:0/3254618972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 0x55e0e23e3be0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f369400b3e0 tx=0x7f3694059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221fa6c80f82cb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:50.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f367ffff700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:21:50.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f367ffff700 1 -- 172.21.15.31:0/3254618972 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369405d590 con 0x55e0e234c5f0 2023-10-09T06:21:50.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f367ffff700 1 -- 172.21.15.31:0/3254618972 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3694068e40 con 0x55e0e234c5f0 2023-10-09T06:21:50.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.793+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3254618972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f369800ea90 con 0x55e0e234c5f0 2023-10-09T06:21:50.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f367ffff700 1 -- 172.21.15.31:0/3254618972 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3694055da0 con 0x55e0e234c5f0 2023-10-09T06:21:50.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f36b0d72b80 10 client.5097 fetch_fsmap learned FSMap version 16 2023-10-09T06:21:50.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3254618972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e0e226d780 con 0x55e0e234c5f0 2023-10-09T06:21:50.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f367ffff700 1 -- 172.21.15.31:0/3254618972 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800ea90 con 0x55e0e234c5f0 2023-10-09T06:21:50.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f367ffff700 1 -- 172.21.15.31:0/3254618972 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f369405d100 con 0x55e0e234c5f0 2023-10-09T06:21:50.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f36b0d72b80 10 client.5097 fetch_fsmap finished waiting for FSMap version 16 2023-10-09T06:21:50.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f36b0d72b80 10 client.5097 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T06:21:50.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f36b0d72b80 20 client.5097 populate_metadata read hostname 'smithi031' 2023-10-09T06:21:50.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3254618972 >> [v2:172.21.15.158:6834/1041874650,v1:172.21.15.158:6836/1041874650] conn(0x55e0e23a63c0 0x55e0e23a6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f36b0d72b80 4 client.5097 mds_command: new command op to 4926 tid=0[{"prefix": "status"}] 2023-10-09T06:21:50.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3254618972 --> [v2:172.21.15.158:6834/1041874650,v1:172.21.15.158:6836/1041874650] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e0e2241e00 con 0x55e0e23a63c0 2023-10-09T06:21:50.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f36a5015700 1 --2- 172.21.15.31:0/3254618972 >> [v2:172.21.15.158:6834/1041874650,v1:172.21.15.158:6836/1041874650] conn(0x55e0e23a63c0 0x55e0e23a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f367ffff700 10 client.5097 ms_handle_connect on v2:172.21.15.158:6834/1041874650 2023-10-09T06:21:50.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.794+0000 7f36a5015700 1 --2- 172.21.15.31:0/3254618972 >> [v2:172.21.15.158:6834/1041874650,v1:172.21.15.158:6836/1041874650] conn(0x55e0e23a63c0 0x55e0e23a6790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f02f595ba87834b server_cookie=124d5e4a619db576 in_seq=0 out_seq=0 2023-10-09T06:21:50.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f367ffff700 1 -- 172.21.15.31:0/3254618972 <== mds.0 v2:172.21.15.158:6834/1041874650 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e0e2241e00 con 0x55e0e23a63c0 2023-10-09T06:21:50.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f367ffff700 10 client.5097 handle_command_reply: tid=0 2023-10-09T06:21:50.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f36b0d72b80 1 client.5097 shutdown 2023-10-09T06:21:50.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3254618972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 msgr2=0x55e0e23e3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3254618972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 0x55e0e23e3be0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f369400b3e0 tx=0x7f3694059000 comp rx=0 tx=0).stop 2023-10-09T06:21:50.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3254618972 shutdown_connections 2023-10-09T06:21:50.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3254618972 >> [v2:172.21.15.158:6834/1041874650,v1:172.21.15.158:6836/1041874650] conn(0x55e0e23a63c0 0x55e0e23a6790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3254618972 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e0e2399480 0x55e0e234bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3254618972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e0e234c5f0 0x55e0e23e3be0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f367ffff700 0 client.5097 ms_handle_reset on v2:172.21.15.158:6834/1041874650 2023-10-09T06:21:50.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f36b0d72b80 1 --2- 172.21.15.31:0/3254618972 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55e0e234eb80 0x55e0e234b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3254618972 >> 172.21.15.31:0/3254618972 conn(0x55e0e23500c0 msgr2=0x55e0e234ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:50.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3254618972 shutdown_connections 2023-10-09T06:21:50.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f36b0d72b80 1 -- 172.21.15.31:0/3254618972 wait complete. 2023-10-09T06:21:50.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.795+0000 7f36b0d72b80 20 client.5097 trim_cache size 0 max 16384 2023-10-09T06:21:50.805 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:21:50.805 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:21:50.805 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-10-09T06:21:50.805 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4926, 2023-10-09T06:21:50.805 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-10-09T06:21:50.806 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-10-09T06:21:50.806 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-10-09T06:21:50.806 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 5.8956387460000004, 2023-10-09T06:21:50.806 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 16, 2023-10-09T06:21:50.806 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 32, 2023-10-09T06:21:50.806 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 32, 2023-10-09T06:21:50.806 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 14.796014381999999 2023-10-09T06:21:50.806 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:21:50.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.796+0000 7f36a6818700 1 -- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3684066f30 msgr2=0x7f36840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.796+0000 7f36a6818700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3684066f30 0x7f36840693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f36a0157740 tx=0x7f369c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.796+0000 7f36a6818700 1 -- 172.21.15.31:0/1056307288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36a0069040 msgr2=0x7f36a00c5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.796+0000 7f36a6818700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36a0069040 0x7f36a00c5280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f36a006b5c0 tx=0x7f3694017000 comp rx=0 tx=0).stop 2023-10-09T06:21:50.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.796+0000 7f36a6818700 1 -- 172.21.15.31:0/1056307288 shutdown_connections 2023-10-09T06:21:50.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.796+0000 7f36a6818700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3684066f30 0x7f36840693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.796+0000 7f36a6818700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36a015a170 0x7f36a014b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.796+0000 7f36a6818700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36a0069040 0x7f36a00c5280 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.796+0000 7f36a6818700 1 --2- 172.21.15.31:0/1056307288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f36a0159da0 0x7f36a014abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.796+0000 7f36a6818700 1 -- 172.21.15.31:0/1056307288 >> 172.21.15.31:0/1056307288 conn(0x7f36a00d0bc0 msgr2=0x7f36a00cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:50.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.796+0000 7f36a6818700 1 -- 172.21.15.31:0/1056307288 shutdown_connections 2023-10-09T06:21:50.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.796+0000 7f36a6818700 1 -- 172.21.15.31:0/1056307288 wait complete. 2023-10-09T06:21:50.810 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:21:50.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.928+0000 7fc7bb4a5700 1 Processor -- start 2023-10-09T06:21:50.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.928+0000 7fc7bb4a5700 1 -- start start 2023-10-09T06:21:50.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.929+0000 7fc7bb4a5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc7b415a620 0x7fc7b415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.929+0000 7fc7bb4a5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7b415d580 0x7fc7b4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.929+0000 7fc7bb4a5700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b415cbb0 con 0x7fc7b4157870 2023-10-09T06:21:50.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.929+0000 7fc7bb4a5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b415bdb0 con 0x7fc7b415d580 2023-10-09T06:21:50.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.929+0000 7fc7bb4a5700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b415bfa0 con 0x7fc7b415a620 2023-10-09T06:21:50.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.929+0000 7fc7b9a42700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7b415d580 0x7fc7b4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.929+0000 7fc7b9a42700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7b415d580 0x7fc7b4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37434/0 (socket says 172.21.15.31:37434) 2023-10-09T06:21:50.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.929+0000 7fc7b9a42700 1 -- 172.21.15.31:0/3034501885 learned_addr learned my addr 172.21.15.31:0/3034501885 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:50.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.930+0000 7fc7b8a40700 1 --2- 172.21.15.31:0/3034501885 >> v2:172.21.15.158:3300/0 conn(0x7fc7b415a620 0x7fc7b415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.930+0000 7fc7b9a42700 1 -- 172.21.15.31:0/3034501885 >> v2:172.21.15.158:3300/0 conn(0x7fc7b415a620 msgr2=0x7fc7b415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:50.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.930+0000 7fc7b9a42700 1 --2- 172.21.15.31:0/3034501885 >> v2:172.21.15.158:3300/0 conn(0x7fc7b415a620 0x7fc7b415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.930+0000 7fc7b9a42700 1 -- 172.21.15.31:0/3034501885 >> v1:172.21.15.158:6789/0 conn(0x7fc7b4157870 legacy=0x7fc7b415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.930+0000 7fc7b9a42700 1 -- 172.21.15.31:0/3034501885 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b415c280 con 0x7fc7b415d580 2023-10-09T06:21:50.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.930+0000 7fc7b9a42700 1 --2- 172.21.15.31:0/3034501885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b415d580 0x7fc7b4158110 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc7b415cb20 tx=0x7fc7ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72ec18e40935c51 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:50.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.930+0000 7fc7b3fff700 1 -- 172.21.15.31:0/3034501885 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac00b860 con 0x7fc7b415d580 2023-10-09T06:21:50.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.930+0000 7fc7b3fff700 1 -- 172.21.15.31:0/3034501885 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac00b9c0 con 0x7fc7b415d580 2023-10-09T06:21:50.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.930+0000 7fc7b3fff700 1 -- 172.21.15.31:0/3034501885 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac00bd60 con 0x7fc7b415d580 2023-10-09T06:21:50.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.930+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/3034501885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b415d580 msgr2=0x7fc7b4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.931+0000 7fc7bb4a5700 1 --2- 172.21.15.31:0/3034501885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b415d580 0x7fc7b4158110 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc7b415cb20 tx=0x7fc7ac009250 comp rx=0 tx=0).stop 2023-10-09T06:21:50.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.931+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/3034501885 shutdown_connections 2023-10-09T06:21:50.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.931+0000 7fc7bb4a5700 1 --2- 172.21.15.31:0/3034501885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b415d580 0x7fc7b4158110 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.931+0000 7fc7bb4a5700 1 --2- 172.21.15.31:0/3034501885 >> v2:172.21.15.158:3300/0 conn(0x7fc7b415a620 0x7fc7b415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.931+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/3034501885 >> 172.21.15.31:0/3034501885 conn(0x7fc7b4068ce0 msgr2=0x7fc7b40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:50.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.931+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/3034501885 shutdown_connections 2023-10-09T06:21:50.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.931+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/3034501885 wait complete. 2023-10-09T06:21:50.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.932+0000 7fc7bb4a5700 1 Processor -- start 2023-10-09T06:21:50.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.932+0000 7fc7bb4a5700 1 -- start start 2023-10-09T06:21:50.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7bb4a5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b4157870 0x7fc7b40d0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7bb4a5700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7b415a620 0x7fc7b40b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7bb4a5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b415d580 0x7fc7b40b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7bb4a5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b414d360 con 0x7fc7b4157870 2023-10-09T06:21:50.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7bb4a5700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40b36e0 con 0x7fc7b415a620 2023-10-09T06:21:50.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7bb4a5700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40d01d0 con 0x7fc7b415d580 2023-10-09T06:21:50.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b9241700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b4157870 0x7fc7b40d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b9241700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b4157870 0x7fc7b40d0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37436/0 (socket says 172.21.15.31:37436) 2023-10-09T06:21:50.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b9241700 1 -- 172.21.15.31:0/4210801935 learned_addr learned my addr 172.21.15.31:0/4210801935 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:50.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b9241700 1 -- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b415d580 msgr2=0x7fc7b40b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b8a40700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7b415a620 0x7fc7b40b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b9a42700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b415d580 0x7fc7b40b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b9241700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b415d580 0x7fc7b40b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b9241700 1 -- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7b415a620 msgr2=0x7fc7b40b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:50.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b9241700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7b415a620 0x7fc7b40b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:50.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b9241700 1 -- 172.21.15.31:0/4210801935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac0094f0 con 0x7fc7b4157870 2023-10-09T06:21:50.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b8a40700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7b415a620 0x7fc7b40b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:50.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b9241700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b4157870 0x7fc7b40d0660 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400cb10 tx=0x7fc7a40017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:50.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b17fa700 1 -- 172.21.15.31:0/4210801935 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400a760 con 0x7fc7b4157870 2023-10-09T06:21:50.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b17fa700 1 -- 172.21.15.31:0/4210801935 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a400a8e0 con 0x7fc7b4157870 2023-10-09T06:21:50.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/4210801935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b40b3160 con 0x7fc7b4157870 2023-10-09T06:21:50.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7b17fa700 1 -- 172.21.15.31:0/4210801935 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400aca0 con 0x7fc7b4157870 2023-10-09T06:21:50.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.933+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/4210801935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b40cfb70 con 0x7fc7b4157870 2023-10-09T06:21:50.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.934+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/4210801935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b40d04b0 con 0x7fc7b4157870 2023-10-09T06:21:50.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.935+0000 7fc7b17fa700 1 -- 172.21.15.31:0/4210801935 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7a4003030 con 0x7fc7b4157870 2023-10-09T06:21:50.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.935+0000 7fc7b17fa700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc7a0066f30 0x7fc7a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:50.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.935+0000 7fc7b17fa700 1 -- 172.21.15.31:0/4210801935 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7a4084630 con 0x7fc7b4157870 2023-10-09T06:21:50.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.935+0000 7fc7b8a40700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc7a0066f30 0x7fc7a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:50.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.936+0000 7fc7b8a40700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc7a0066f30 0x7fc7a00693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4153a20 tx=0x7fc7a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:50.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:50.939+0000 7fc7b17fa700 1 -- 172.21.15.31:0/4210801935 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7a40518a0 con 0x7fc7b4157870 2023-10-09T06:21:51.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.177+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/4210801935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc7b4063820 con 0x7fc7b4157870 2023-10-09T06:21:51.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.178+0000 7fc7b17fa700 1 -- 172.21.15.31:0/4210801935 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc7a4054ec0 con 0x7fc7b4157870 2023-10-09T06:21:51.178 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:21:51.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.179+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc7a0066f30 msgr2=0x7fc7a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:51.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.179+0000 7fc7bb4a5700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc7a0066f30 0x7fc7a00693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4153a20 tx=0x7fc7a8008040 comp rx=0 tx=0).stop 2023-10-09T06:21:51.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.179+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/4210801935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b4157870 msgr2=0x7fc7b40d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:51.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.179+0000 7fc7bb4a5700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b4157870 0x7fc7b40d0660 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400cb10 tx=0x7fc7a40017b0 comp rx=0 tx=0).stop 2023-10-09T06:21:51.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.179+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/4210801935 shutdown_connections 2023-10-09T06:21:51.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.179+0000 7fc7bb4a5700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc7a0066f30 0x7fc7a00693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:51.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.179+0000 7fc7bb4a5700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b415d580 0x7fc7b40b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:51.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.179+0000 7fc7bb4a5700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b4157870 0x7fc7b40d0660 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:51.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.180+0000 7fc7bb4a5700 1 --2- 172.21.15.31:0/4210801935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7b415a620 0x7fc7b40b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:51.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.180+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/4210801935 >> 172.21.15.31:0/4210801935 conn(0x7fc7b4068ce0 msgr2=0x7fc7b4155770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:51.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.180+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/4210801935 shutdown_connections 2023-10-09T06:21:51.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.180+0000 7fc7bb4a5700 1 -- 172.21.15.31:0/4210801935 wait complete. 2023-10-09T06:21:51.192 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:21:51.192 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:21:51.193 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-10-09T06:21:51.193 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:21:51.193 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:21:51.193 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:21:51.193 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:21:51.193 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:21:51.193 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:21:51.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:51.194 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-10-09T06:21:51.209 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:21:51.209 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:21:51.209 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:21:51.209 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:51.209 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:21:51.209 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:51.209 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:51.209 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:51.209 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-10-09T06:21:51.210 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:51.210 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:51.210 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-10-09T06:21:51.210 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:21:51.210 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:51.210 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-10-09T06:21:51.210 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T06:21:51.210 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42456sec preferred_lft 42456sec 2023-10-09T06:21:51.210 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-10-09T06:21:51.210 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:51.211 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:51.211 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:51.211 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-10-09T06:21:51.211 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:21:51.211 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:51.211 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:21:51.211 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:51.211 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::b4ad:53ff:fed3:a589/64 scope link 2023-10-09T06:21:51.211 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:51.211 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:21:51.211 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether f6:bf:b8:0f:49:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:21:51.211 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::f4bf:b8ff:fe0f:498b/64 scope link 2023-10-09T06:21:51.212 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:51.212 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:21:51.212 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:21:51.212 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::d8ab:b5ff:fe1d:e066/64 scope link 2023-10-09T06:21:51.212 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:51.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:51.212 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:21:51.273 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-10-09T06:21:51.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:51.275 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-10-09T06:21:51.332 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-10-09T06:21:51.332 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:21:51.332 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T06:21:51.332 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T06:21:51.332 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:21:51.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:51.333 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:21:51.333 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:21:51.333 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T06:21:51.333 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T06:21:51.333 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T06:21:51.333 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:21:51.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:51.434 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:21:51.449 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:21:51.449 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:21:51.449 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:21:51.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:51.450 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-10-09T06:21:51.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:21:51.515 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:21:51.570 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:21:51.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:21:51.571 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:21:51.625 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:21:51.625 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:21:51.625 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:51.707 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:51.707 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:51.726 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:51.726 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:51.727 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:21:51.727 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:21:51.727 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:21:51.727 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:21:51.727 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:21:51.727 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:21:51.749 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:51.749 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:51.750 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:21:51.750 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:21:51.750 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:21:51.750 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:21:51.750 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:21:51.750 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:21:51.750 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:21:51.750 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:21:51.750 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:21:51.752 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:21:51.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:51.752 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:21:51.819 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:21:51.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.979+0000 7f781dfc7700 1 Processor -- start 2023-10-09T06:21:51.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.979+0000 7f781dfc7700 1 -- start start 2023-10-09T06:21:51.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.980+0000 7f781dfc7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7818159f10 0x7f78180c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:51.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.980+0000 7f781dfc7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f781815a2e0 0x7f78180cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:51.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.980+0000 7f781dfc7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781815a730 con 0x7f78180cc240 2023-10-09T06:21:51.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.980+0000 7f781dfc7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78180ae320 con 0x7f7818159f10 2023-10-09T06:21:51.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.980+0000 7f781dfc7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78180ad710 con 0x7f781815a2e0 2023-10-09T06:21:51.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.980+0000 7f781d7c6700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f78180cc240 0x7f78180ae7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47112/0 (socket says 172.21.15.31:47112) 2023-10-09T06:21:51.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.980+0000 7f781d7c6700 1 -- 172.21.15.31:0/3524718583 learned_addr learned my addr 172.21.15.31:0/3524718583 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:51.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.980+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500492136 0 0) 0x7f7800001110 con 0x7f78180cc240 2023-10-09T06:21:51.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.980+0000 7f781cfc5700 1 --2- 172.21.15.31:0/3524718583 >> v2:172.21.15.158:3300/0 conn(0x7f7818159f10 0x7f78180c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:51.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.980+0000 7f7817fff700 1 --2- 172.21.15.31:0/3524718583 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f781815a2e0 0x7f78180cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:51.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.980+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7804003570 con 0x7f78180cc240 2023-10-09T06:21:51.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2750559278 0 0) 0x7f7804003570 con 0x7f78180cc240 2023-10-09T06:21:51.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f781815a2e0 msgr2=0x7f78180cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:51.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 --2- 172.21.15.31:0/3524718583 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f781815a2e0 0x7f78180cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:51.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 >> v2:172.21.15.158:3300/0 conn(0x7f7818159f10 msgr2=0x7f78180c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:51.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 --2- 172.21.15.31:0/3524718583 >> v2:172.21.15.158:3300/0 conn(0x7f7818159f10 0x7f78180c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:51.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78180ad9f0 con 0x7f78180cc240 2023-10-09T06:21:51.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f7800001600 con 0x7f78180cc240 2023-10-09T06:21:51.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 >> v1:172.21.15.31:6789/0 conn(0x7f78180cc240 legacy=0x7f78180ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:51.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 --2- 172.21.15.31:0/3524718583 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7804003ae0 0x7f7804003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:51.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 --2- 172.21.15.31:0/3524718583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7804004810 0x7f7804004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:51.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 --2- 172.21.15.31:0/3524718583 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f781815a2e0 0x7f78040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:51.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78180ae320 con 0x7f7804004810 2023-10-09T06:21:51.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78180ad710 con 0x7f7804003ae0 2023-10-09T06:21:51.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780400bb40 con 0x7f781815a2e0 2023-10-09T06:21:51.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f7817fff700 1 --2- 172.21.15.31:0/3524718583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7804004810 0x7f7804004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:51.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f781cfc5700 1 --2- 172.21.15.31:0/3524718583 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7804003ae0 0x7f7804003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:51.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f781d7c6700 1 --2- 172.21.15.31:0/3524718583 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f781815a2e0 0x7f78040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:51.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f7817fff700 1 -- 172.21.15.31:0/3524718583 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f781815a2e0 msgr2=0x7f78040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:51.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f7817fff700 1 --2- 172.21.15.31:0/3524718583 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f781815a2e0 0x7f78040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:51.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f7817fff700 1 -- 172.21.15.31:0/3524718583 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7804003ae0 msgr2=0x7f7804003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:51.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f7817fff700 1 --2- 172.21.15.31:0/3524718583 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7804003ae0 0x7f7804003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:51.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f7817fff700 1 -- 172.21.15.31:0/3524718583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7804003570 con 0x7f7804004810 2023-10-09T06:21:51.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f7817fff700 1 --2- 172.21.15.31:0/3524718583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7804004810 0x7f7804004c80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f780800e210 tx=0x7f780800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7113031e6a193e8c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:51.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.981+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800eac0 con 0x7f7804004810 2023-10-09T06:21:51.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.982+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780800f040 con 0x7f7804004810 2023-10-09T06:21:51.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.982+0000 7f78177fe700 1 -- 172.21.15.31:0/3524718583 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800ee70 con 0x7f7804004810 2023-10-09T06:21:51.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.982+0000 7f781dfc7700 1 -- 172.21.15.31:0/3524718583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7804004810 msgr2=0x7f7804004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:51.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.982+0000 7f781dfc7700 1 --2- 172.21.15.31:0/3524718583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7804004810 0x7f7804004c80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f780800e210 tx=0x7f780800b040 comp rx=0 tx=0).stop 2023-10-09T06:21:51.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.982+0000 7f781d7c6700 1 -- 172.21.15.31:0/3524718583 reap_dead start 2023-10-09T06:21:51.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.982+0000 7f781dfc7700 1 -- 172.21.15.31:0/3524718583 shutdown_connections 2023-10-09T06:21:51.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.982+0000 7f781dfc7700 1 -- 172.21.15.31:0/3524718583 >> 172.21.15.31:0/3524718583 conn(0x7f7818067e40 msgr2=0x7f78180d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:51.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.982+0000 7f781dfc7700 1 -- 172.21.15.31:0/3524718583 shutdown_connections 2023-10-09T06:21:51.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.982+0000 7f781dfc7700 1 -- 172.21.15.31:0/3524718583 wait complete. 2023-10-09T06:21:51.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.983+0000 7f781dfc7700 1 Processor -- start 2023-10-09T06:21:51.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.983+0000 7f781dfc7700 1 -- start start 2023-10-09T06:21:51.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781dfc7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78181561f0 0x7f78180c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:51.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781dfc7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78180b43f0 0x7f78180c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:51.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781dfc7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78180c6f30 0x7f78180c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:51.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781dfc7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78180c73b0 con 0x7f78181561f0 2023-10-09T06:21:51.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781dfc7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78180b5530 con 0x7f78180c6f30 2023-10-09T06:21:51.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781dfc7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78180b4920 con 0x7f78180b43f0 2023-10-09T06:21:51.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781cfc5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78181561f0 0x7f78180c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:51.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781cfc5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78181561f0 0x7f78180c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37448/0 (socket says 172.21.15.31:37448) 2023-10-09T06:21:51.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781cfc5700 1 -- 172.21.15.31:0/617874000 learned_addr learned my addr 172.21.15.31:0/617874000 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:51.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781d7c6700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78180c6f30 0x7f78180c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:51.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f7817fff700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78180b43f0 0x7f78180c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:51.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781cfc5700 1 -- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78180b43f0 msgr2=0x7f78180c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:51.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781cfc5700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78180b43f0 0x7f78180c69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:51.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781cfc5700 1 -- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78180c6f30 msgr2=0x7f78180c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:51.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781cfc5700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78180c6f30 0x7f78180c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:51.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.984+0000 7f781cfc5700 1 -- 172.21.15.31:0/617874000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78180b4c00 con 0x7f78181561f0 2023-10-09T06:21:51.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.985+0000 7f781cfc5700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78181561f0 0x7f78180c97e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7810011990 tx=0x7f7810008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:51.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.985+0000 7f7814ff9700 1 -- 172.21.15.31:0/617874000 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781000f6d0 con 0x7f78181561f0 2023-10-09T06:21:51.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.985+0000 7f7814ff9700 1 -- 172.21.15.31:0/617874000 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781000f830 con 0x7f78181561f0 2023-10-09T06:21:51.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.985+0000 7f781dfc7700 1 -- 172.21.15.31:0/617874000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78180b4ee0 con 0x7f78181561f0 2023-10-09T06:21:51.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.985+0000 7f7814ff9700 1 -- 172.21.15.31:0/617874000 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781000fbf0 con 0x7f78181561f0 2023-10-09T06:21:51.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.985+0000 7f781dfc7700 1 -- 172.21.15.31:0/617874000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78180c9d20 con 0x7f78181561f0 2023-10-09T06:21:51.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.986+0000 7f781dfc7700 1 -- 172.21.15.31:0/617874000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7818089300 con 0x7f78181561f0 2023-10-09T06:21:51.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.986+0000 7f7814ff9700 1 -- 172.21.15.31:0/617874000 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7810015460 con 0x7f78181561f0 2023-10-09T06:21:51.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.987+0000 7f7814ff9700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f77f8066f30 0x7f77f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:51.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.987+0000 7f7814ff9700 1 -- 172.21.15.31:0/617874000 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7810084cd0 con 0x7f78181561f0 2023-10-09T06:21:51.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.987+0000 7f7817fff700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f77f8066f30 0x7f77f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:51.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.987+0000 7f7817fff700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f77f8066f30 0x7f77f80693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f78180776a0 tx=0x7f780801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:51.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:51.991+0000 7f7814ff9700 1 -- 172.21.15.31:0/617874000 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7810051fa0 con 0x7f78181561f0 2023-10-09T06:21:52.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.229+0000 7f781dfc7700 1 -- 172.21.15.31:0/617874000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f78180890a0 con 0x7f78181561f0 2023-10-09T06:21:52.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.229+0000 7f7814ff9700 1 -- 172.21.15.31:0/617874000 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f78100555c0 con 0x7f78181561f0 2023-10-09T06:21:52.230 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:21:52.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.231+0000 7f781dfc7700 1 -- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f77f8066f30 msgr2=0x7f77f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:52.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.231+0000 7f781dfc7700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f77f8066f30 0x7f77f80693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f78180776a0 tx=0x7f780801a000 comp rx=0 tx=0).stop 2023-10-09T06:21:52.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.231+0000 7f781dfc7700 1 -- 172.21.15.31:0/617874000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78181561f0 msgr2=0x7f78180c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:52.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.231+0000 7f781dfc7700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78181561f0 0x7f78180c97e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7810011990 tx=0x7f7810008040 comp rx=0 tx=0).stop 2023-10-09T06:21:52.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.231+0000 7f781dfc7700 1 -- 172.21.15.31:0/617874000 shutdown_connections 2023-10-09T06:21:52.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.231+0000 7f781dfc7700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f77f8066f30 0x7f77f80693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:52.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.231+0000 7f781dfc7700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78180c6f30 0x7f78180c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:52.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.231+0000 7f781dfc7700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78181561f0 0x7f78180c97e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:52.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.231+0000 7f781dfc7700 1 --2- 172.21.15.31:0/617874000 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78180b43f0 0x7f78180c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:52.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.231+0000 7f781dfc7700 1 -- 172.21.15.31:0/617874000 >> 172.21.15.31:0/617874000 conn(0x7f7818067e40 msgr2=0x7f7818157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:52.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.231+0000 7f781dfc7700 1 -- 172.21.15.31:0/617874000 shutdown_connections 2023-10-09T06:21:52.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:52.231+0000 7f781dfc7700 1 -- 172.21.15.31:0/617874000 wait complete. 2023-10-09T06:21:52.244 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:21:52.244 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:21:52.244 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-09T06:21:52.244 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T06:21:52.244 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T06:21:52.244 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:21:52.244 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:21:52.245 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:21:52.245 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:21:52.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:52.245 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-09T06:21:52.265 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:21:52.265 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:21:52.265 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:21:52.265 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:52.265 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:21:52.265 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:52.265 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:52.266 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:52.266 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-09T06:21:52.266 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:52.266 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:52.266 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-09T06:21:52.266 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:21:52.266 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:52.266 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:21:52.266 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:52.267 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:21:52.267 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42481sec preferred_lft 42481sec 2023-10-09T06:21:52.267 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-09T06:21:52.267 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:52.267 INFO:teuthology.orchestra.run.smithi158.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:21:52.267 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:21:52.267 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:21:52.267 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:52.267 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::c5:35ff:fec9:1844/64 scope link 2023-10-09T06:21:52.267 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:52.268 INFO:teuthology.orchestra.run.smithi158.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:21:52.268 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether e6:10:14:7c:a4:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:21:52.268 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::e410:14ff:fe7c:a4d7/64 scope link 2023-10-09T06:21:52.268 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:52.268 INFO:teuthology.orchestra.run.smithi158.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:21:52.268 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T06:21:52.268 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::44a9:f1ff:fe2b:babb/64 scope link 2023-10-09T06:21:52.268 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:21:52.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:52.269 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:21:52.334 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-09T06:21:52.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:52.336 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-09T06:21:52.395 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-09T06:21:52.395 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:21:52.395 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:21:52.396 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:21:52.396 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:21:52.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:52.396 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:21:52.396 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:21:52.396 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:21:52.396 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:21:52.396 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:21:52.396 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:21:52.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:52.502 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:21:52.516 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T06:21:52.516 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T06:21:52.516 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:21:52.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:52.517 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-09T06:21:52.582 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:21:52.583 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T06:21:52.637 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:21:52.637 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:21:52.637 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:21:52.692 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T06:21:52.692 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:21:52.693 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:52.772 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:52.772 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:52.791 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:52.791 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:52.792 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:21:52.792 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:21:52.792 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:21:52.792 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:21:52.792 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:21:52.792 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:21:52.813 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:21:52.813 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:21:52.813 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:21:52.813 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:21:52.813 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:21:52.813 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:21:52.814 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:21:52.814 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:21:52.814 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:21:52.814 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:21:52.814 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:21:52.815 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:21:52.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:52.815 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:21:52.880 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:21:53.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.004+0000 7fbd1edc0700 1 Processor -- start 2023-10-09T06:21:53.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.004+0000 7fbd1edc0700 1 -- start start 2023-10-09T06:21:53.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1edc0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbd1815a2b0 0x7fbd180b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:53.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1edc0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd180d1c30 0x7fbd180cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:53.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1edc0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbd1815a680 0x7fbd180cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:53.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1edc0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd18068470 con 0x7fbd1815a680 2023-10-09T06:21:53.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1edc0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd180c5d80 con 0x7fbd1815a2b0 2023-10-09T06:21:53.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1edc0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180c6060 con 0x7fbd180d1c30 2023-10-09T06:21:53.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1d35d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbd1815a680 0x7fbd180cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:53.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1d35d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbd1815a680 0x7fbd180cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37464/0 (socket says 172.21.15.31:37464) 2023-10-09T06:21:53.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1d35d700 1 -- 172.21.15.31:0/149087625 learned_addr learned my addr 172.21.15.31:0/149087625 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:53.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1cb5c700 1 --2- 172.21.15.31:0/149087625 >> v2:172.21.15.158:3300/0 conn(0x7fbd1815a2b0 0x7fbd180b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:53.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd17fff700 1 --2- 172.21.15.31:0/149087625 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd180d1c30 0x7fbd180cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:53.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1d35d700 1 -- 172.21.15.31:0/149087625 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd180d1c30 msgr2=0x7fbd180cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:53.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1d35d700 1 --2- 172.21.15.31:0/149087625 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd180d1c30 0x7fbd180cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1d35d700 1 -- 172.21.15.31:0/149087625 >> v2:172.21.15.158:3300/0 conn(0x7fbd1815a2b0 msgr2=0x7fbd180b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:53.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1d35d700 1 --2- 172.21.15.31:0/149087625 >> v2:172.21.15.158:3300/0 conn(0x7fbd1815a2b0 0x7fbd180b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1d35d700 1 -- 172.21.15.31:0/149087625 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd180c6340 con 0x7fbd1815a680 2023-10-09T06:21:53.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.005+0000 7fbd1d35d700 1 --2- 172.21.15.31:0/149087625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd1815a680 0x7fbd180cfc50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbd18089220 tx=0x7fbd08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824f43ee3aaebe01 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:53.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.006+0000 7fbd177fe700 1 -- 172.21.15.31:0/149087625 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0800b640 con 0x7fbd1815a680 2023-10-09T06:21:53.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.006+0000 7fbd177fe700 1 -- 172.21.15.31:0/149087625 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0800b7a0 con 0x7fbd1815a680 2023-10-09T06:21:53.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.006+0000 7fbd177fe700 1 -- 172.21.15.31:0/149087625 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0800bb60 con 0x7fbd1815a680 2023-10-09T06:21:53.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.006+0000 7fbd1edc0700 1 -- 172.21.15.31:0/149087625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd1815a680 msgr2=0x7fbd180cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:53.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.006+0000 7fbd1edc0700 1 --2- 172.21.15.31:0/149087625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd1815a680 0x7fbd180cfc50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbd18089220 tx=0x7fbd08009250 comp rx=0 tx=0).stop 2023-10-09T06:21:53.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.006+0000 7fbd1edc0700 1 -- 172.21.15.31:0/149087625 shutdown_connections 2023-10-09T06:21:53.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.006+0000 7fbd1edc0700 1 --2- 172.21.15.31:0/149087625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd1815a680 0x7fbd180cfc50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.006+0000 7fbd1edc0700 1 --2- 172.21.15.31:0/149087625 >> v2:172.21.15.158:3300/0 conn(0x7fbd1815a2b0 0x7fbd180b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.006+0000 7fbd1edc0700 1 --2- 172.21.15.31:0/149087625 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd180d1c30 0x7fbd180cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.006+0000 7fbd1edc0700 1 -- 172.21.15.31:0/149087625 >> 172.21.15.31:0/149087625 conn(0x7fbd18067e40 msgr2=0x7fbd180d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:53.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.006+0000 7fbd1edc0700 1 -- 172.21.15.31:0/149087625 shutdown_connections 2023-10-09T06:21:53.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.006+0000 7fbd1edc0700 1 -- 172.21.15.31:0/149087625 wait complete. 2023-10-09T06:21:53.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.007+0000 7fbd1edc0700 1 Processor -- start 2023-10-09T06:21:53.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.007+0000 7fbd1edc0700 1 -- start start 2023-10-09T06:21:53.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd1edc0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd180d1c30 0x7fbd1815d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:53.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd1edc0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd1815a2b0 0x7fbd180c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:53.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd1edc0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbd1815a680 0x7fbd180c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:53.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd1edc0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180c9480 con 0x7fbd1815a2b0 2023-10-09T06:21:53.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd1edc0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180c85d0 con 0x7fbd1815a680 2023-10-09T06:21:53.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd1edc0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180c8870 con 0x7fbd180d1c30 2023-10-09T06:21:53.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd17fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd1815a2b0 0x7fbd180c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:53.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd17fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd1815a2b0 0x7fbd180c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37476/0 (socket says 172.21.15.31:37476) 2023-10-09T06:21:53.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd17fff700 1 -- 172.21.15.31:0/2936391992 learned_addr learned my addr 172.21.15.31:0/2936391992 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:53.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd1d35d700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbd1815a680 0x7fbd180c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:53.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd1cb5c700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd180d1c30 0x7fbd1815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:53.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd17fff700 1 -- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd180d1c30 msgr2=0x7fbd1815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:53.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd17fff700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd180d1c30 0x7fbd1815d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd17fff700 1 -- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbd1815a680 msgr2=0x7fbd180c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:53.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.008+0000 7fbd17fff700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbd1815a680 0x7fbd180c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.009+0000 7fbd17fff700 1 -- 172.21.15.31:0/2936391992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd080094f0 con 0x7fbd1815a2b0 2023-10-09T06:21:53.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.009+0000 7fbd1cb5c700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd180d1c30 0x7fbd1815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:53.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.009+0000 7fbd1d35d700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbd1815a680 0x7fbd180c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:53.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.009+0000 7fbd17fff700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd1815a2b0 0x7fbd180c8090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00e900 tx=0x7fbd0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:53.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.009+0000 7fbd14ff9700 1 -- 172.21.15.31:0/2936391992 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00eea0 con 0x7fbd1815a2b0 2023-10-09T06:21:53.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.009+0000 7fbd14ff9700 1 -- 172.21.15.31:0/2936391992 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c00c850 con 0x7fbd1815a2b0 2023-10-09T06:21:53.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.009+0000 7fbd1edc0700 1 -- 172.21.15.31:0/2936391992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd180c8b50 con 0x7fbd1815a2b0 2023-10-09T06:21:53.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.009+0000 7fbd14ff9700 1 -- 172.21.15.31:0/2936391992 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00cc10 con 0x7fbd1815a2b0 2023-10-09T06:21:53.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.009+0000 7fbd1edc0700 1 -- 172.21.15.31:0/2936391992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd180c9110 con 0x7fbd1815a2b0 2023-10-09T06:21:53.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.010+0000 7fbd1edc0700 1 -- 172.21.15.31:0/2936391992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1804c3c0 con 0x7fbd1815a2b0 2023-10-09T06:21:53.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.010+0000 7fbd14ff9700 1 -- 172.21.15.31:0/2936391992 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd0c013470 con 0x7fbd1815a2b0 2023-10-09T06:21:53.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.011+0000 7fbd14ff9700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbd04066f30 0x7fbd040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:53.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.011+0000 7fbd14ff9700 1 -- 172.21.15.31:0/2936391992 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd0c0846a0 con 0x7fbd1815a2b0 2023-10-09T06:21:53.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.011+0000 7fbd1cb5c700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbd04066f30 0x7fbd040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:53.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.011+0000 7fbd1cb5c700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbd04066f30 0x7fbd040693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009fd0 tx=0x7fbd1000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:53.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.015+0000 7fbd14ff9700 1 -- 172.21.15.31:0/2936391992 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd0c051910 con 0x7fbd1815a2b0 2023-10-09T06:21:53.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.251+0000 7fbd1edc0700 1 -- 172.21.15.31:0/2936391992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd180ca730 con 0x7fbd1815a2b0 2023-10-09T06:21:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.252+0000 7fbd14ff9700 1 -- 172.21.15.31:0/2936391992 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fbd0c054f30 con 0x7fbd1815a2b0 2023-10-09T06:21:53.253 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:53.253 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1792934235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1792934235},{"type":"v1","addr":"172.21.15.158:6837","nonce":1792934235}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/893363730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":893363730},{"type":"v1","addr":"172.21.15.31:6834","nonce":893363730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4923,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2780075004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2780075004},{"type":"v1","addr":"172.21.15.31:6835","nonce":2780075004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:21:44.276772+0000","modified":"2023-10-09T06:21:47.908951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6836/1041874650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1041874650},{"type":"v1","addr":"172.21.15.158:6836","nonce":1041874650}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:21:53.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.254+0000 7fbd1edc0700 1 -- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbd04066f30 msgr2=0x7fbd040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:53.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.254+0000 7fbd1edc0700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbd04066f30 0x7fbd040693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009fd0 tx=0x7fbd1000b040 comp rx=0 tx=0).stop 2023-10-09T06:21:53.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.254+0000 7fbd1edc0700 1 -- 172.21.15.31:0/2936391992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd1815a2b0 msgr2=0x7fbd180c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:53.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.254+0000 7fbd1edc0700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd1815a2b0 0x7fbd180c8090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00e900 tx=0x7fbd0c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.254+0000 7fbd1edc0700 1 -- 172.21.15.31:0/2936391992 shutdown_connections 2023-10-09T06:21:53.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.254+0000 7fbd1edc0700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbd04066f30 0x7fbd040693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.254+0000 7fbd1edc0700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd180d1c30 0x7fbd1815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.254+0000 7fbd1edc0700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbd1815a680 0x7fbd180c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.254+0000 7fbd1edc0700 1 --2- 172.21.15.31:0/2936391992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd1815a2b0 0x7fbd180c8090 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.254+0000 7fbd1edc0700 1 -- 172.21.15.31:0/2936391992 >> 172.21.15.31:0/2936391992 conn(0x7fbd18067e40 msgr2=0x7fbd180b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:53.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.254+0000 7fbd1edc0700 1 -- 172.21.15.31:0/2936391992 shutdown_connections 2023-10-09T06:21:53.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.254+0000 7fbd1edc0700 1 -- 172.21.15.31:0/2936391992 wait complete. 2023-10-09T06:21:53.256 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 16 2023-10-09T06:21:53.267 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-09T06:21:53.400 INFO:teuthology.orchestra.run.smithi158.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":4926,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.4910533560000001,"mdsmap_epoch":16,"osdmap_epoch":32,"osdmap_epoch_barrier":32,"uptime":17.391431197999999} 2023-10-09T06:21:53.401 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 4926, "mdsmap_epoch": 16, "osdmap_epoch": 32, "osdmap_epoch_barrier": 32, "rank_uptime": 8.491053356, "state": "up:active", "uptime": 17.391431198, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:21:53.401 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-10-09T06:21:53.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.518+0000 7fc0ff3b1700 1 Processor -- start 2023-10-09T06:21:53.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.518+0000 7fc0ff3b1700 1 -- start start 2023-10-09T06:21:53.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.519+0000 7fc0ff3b1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc0f80cdab0 0x7fc0f815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:53.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.519+0000 7fc0ff3b1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0f815dda0 0x7fc0f815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:53.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.519+0000 7fc0ff3b1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f80cb7c0 con 0x7fc0f80cd6e0 2023-10-09T06:21:53.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.519+0000 7fc0ff3b1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f815e850 con 0x7fc0f80cdab0 2023-10-09T06:21:53.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.519+0000 7fc0ff3b1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80cc360 con 0x7fc0f815dda0 2023-10-09T06:21:53.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.519+0000 7fc0fe3af700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc0f80cd6e0 0x7fc0f80cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47116/0 (socket says 172.21.15.31:47116) 2023-10-09T06:21:53.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.519+0000 7fc0fe3af700 1 -- 172.21.15.31:0/31255187 learned_addr learned my addr 172.21.15.31:0/31255187 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:53.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.519+0000 7fc0fdbae700 1 --2- 172.21.15.31:0/31255187 >> v2:172.21.15.158:3300/0 conn(0x7fc0f80cdab0 0x7fc0f815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:53.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.519+0000 7fc0febb0700 1 --2- 172.21.15.31:0/31255187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0f815dda0 0x7fc0f815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:53.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.520+0000 7fc0fd3ad700 1 -- 172.21.15.31:0/31255187 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335491228 0 0) 0x7fc0f80cb7c0 con 0x7fc0f80cd6e0 2023-10-09T06:21:53.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.520+0000 7fc0fd3ad700 1 -- 172.21.15.31:0/31255187 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e4003570 con 0x7fc0f80cd6e0 2023-10-09T06:21:53.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.520+0000 7fc0febb0700 1 -- 172.21.15.31:0/31255187 >> v2:172.21.15.158:3300/0 conn(0x7fc0f80cdab0 msgr2=0x7fc0f815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:53.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.520+0000 7fc0febb0700 1 --2- 172.21.15.31:0/31255187 >> v2:172.21.15.158:3300/0 conn(0x7fc0f80cdab0 0x7fc0f815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.520+0000 7fc0febb0700 1 -- 172.21.15.31:0/31255187 >> v1:172.21.15.31:6789/0 conn(0x7fc0f80cd6e0 legacy=0x7fc0f80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:53.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.520+0000 7fc0febb0700 1 -- 172.21.15.31:0/31255187 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f815e290 con 0x7fc0f815dda0 2023-10-09T06:21:53.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.520+0000 7fc0fdbae700 1 --2- 172.21.15.31:0/31255187 >> v2:172.21.15.158:3300/0 conn(0x7fc0f80cdab0 0x7fc0f815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:21:53.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.520+0000 7fc0febb0700 1 --2- 172.21.15.31:0/31255187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0f815dda0 0x7fc0f815cbd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009e60 tx=0x7fc0f0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e6bdbb45c9d3d4f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:53.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.520+0000 7fc0fd3ad700 1 -- 172.21.15.31:0/31255187 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000e070 con 0x7fc0f815dda0 2023-10-09T06:21:53.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.520+0000 7fc0fd3ad700 1 -- 172.21.15.31:0/31255187 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f000bab0 con 0x7fc0f815dda0 2023-10-09T06:21:53.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.520+0000 7fc0fd3ad700 1 -- 172.21.15.31:0/31255187 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000be70 con 0x7fc0f815dda0 2023-10-09T06:21:53.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.521+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/31255187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0f815dda0 msgr2=0x7fc0f815cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:53.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.521+0000 7fc0ff3b1700 1 --2- 172.21.15.31:0/31255187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0f815dda0 0x7fc0f815cbd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009e60 tx=0x7fc0f0009780 comp rx=0 tx=0).stop 2023-10-09T06:21:53.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.521+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/31255187 shutdown_connections 2023-10-09T06:21:53.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.521+0000 7fc0ff3b1700 1 --2- 172.21.15.31:0/31255187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0f815dda0 0x7fc0f815cbd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.521+0000 7fc0ff3b1700 1 --2- 172.21.15.31:0/31255187 >> v2:172.21.15.158:3300/0 conn(0x7fc0f80cdab0 0x7fc0f815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.521+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/31255187 >> 172.21.15.31:0/31255187 conn(0x7fc0f8067660 msgr2=0x7fc0f8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:53.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.521+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/31255187 shutdown_connections 2023-10-09T06:21:53.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.521+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/31255187 wait complete. 2023-10-09T06:21:53.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.522+0000 7fc0ff3b1700 1 Processor -- start 2023-10-09T06:21:53.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.522+0000 7fc0ff3b1700 1 -- start start 2023-10-09T06:21:53.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0ff3b1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0f80cd6e0 0x7fc0f80b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:53.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0ff3b1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80cdab0 0x7fc0f81551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:53.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0ff3b1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0f815dda0 0x7fc0f814b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:53.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0ff3b1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f814ccf0 con 0x7fc0f80cdab0 2023-10-09T06:21:53.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0ff3b1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f814c730 con 0x7fc0f815dda0 2023-10-09T06:21:53.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0ff3b1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f814ca10 con 0x7fc0f80cd6e0 2023-10-09T06:21:53.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0fdbae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80cdab0 0x7fc0f81551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:53.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0fdbae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80cdab0 0x7fc0f81551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37490/0 (socket says 172.21.15.31:37490) 2023-10-09T06:21:53.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0fdbae700 1 -- 172.21.15.31:0/2521251943 learned_addr learned my addr 172.21.15.31:0/2521251943 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:53.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0fe3af700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0f80cd6e0 0x7fc0f80b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:53.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0febb0700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0f815dda0 0x7fc0f814b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:53.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0fdbae700 1 -- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0f80cd6e0 msgr2=0x7fc0f80b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:53.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0fdbae700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0f80cd6e0 0x7fc0f80b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0fdbae700 1 -- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0f815dda0 msgr2=0x7fc0f814b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:53.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0fdbae700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0f815dda0 0x7fc0f814b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0fdbae700 1 -- 172.21.15.31:0/2521251943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f4009420 con 0x7fc0f80cdab0 2023-10-09T06:21:53.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0fdbae700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80cdab0 0x7fc0f81551d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400ec80 tx=0x7fc0f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:53.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0ee7fc700 1 -- 172.21.15.31:0/2521251943 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f400c920 con 0x7fc0f80cdab0 2023-10-09T06:21:53.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0ee7fc700 1 -- 172.21.15.31:0/2521251943 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f400ca80 con 0x7fc0f80cdab0 2023-10-09T06:21:53.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/2521251943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f0009a20 con 0x7fc0f80cdab0 2023-10-09T06:21:53.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.523+0000 7fc0ee7fc700 1 -- 172.21.15.31:0/2521251943 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f400ce00 con 0x7fc0f80cdab0 2023-10-09T06:21:53.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.524+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/2521251943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f80b10e0 con 0x7fc0f80cdab0 2023-10-09T06:21:53.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.525+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/2521251943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f80d1a30 con 0x7fc0f80cdab0 2023-10-09T06:21:53.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.525+0000 7fc0ee7fc700 1 -- 172.21.15.31:0/2521251943 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0f4013680 con 0x7fc0f80cdab0 2023-10-09T06:21:53.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.525+0000 7fc0ee7fc700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc0dc066f30 0x7fc0dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:53.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.526+0000 7fc0ee7fc700 1 -- 172.21.15.31:0/2521251943 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0f4084c40 con 0x7fc0f80cdab0 2023-10-09T06:21:53.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.526+0000 7fc0fe3af700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc0dc066f30 0x7fc0dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:53.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.526+0000 7fc0fe3af700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc0dc066f30 0x7fc0dc0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8007fd0 tx=0x7fc0e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:53.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.530+0000 7fc0ee7fc700 1 -- 172.21.15.31:0/2521251943 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0f4051eb0 con 0x7fc0f80cdab0 2023-10-09T06:21:53.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.803+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/2521251943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fc0f80b60d0 con 0x7fc0f80cdab0 2023-10-09T06:21:53.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.803+0000 7fc0ee7fc700 1 -- 172.21.15.31:0/2521251943 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1620 (secure 0 0 0) 0x7fc0f4021670 con 0x7fc0f80cdab0 2023-10-09T06:21:53.804 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:53.804 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:21:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "stats": { 2023-10-09T06:21:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "total_bytes": 1600000000, 2023-10-09T06:21:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "total_avail_bytes": 1597703796, 2023-10-09T06:21:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "total_used_bytes": 2296204, 2023-10-09T06:21:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "total_used_raw_bytes": 2296204, 2023-10-09T06:21:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "total_used_raw_ratio": 0.0014351274585351348, 2023-10-09T06:21:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "num_osds": 8, 2023-10-09T06:21:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "num_per_pool_osds": 0, 2023-10-09T06:21:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "num_per_pool_omap_osds": 0 2023-10-09T06:21:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "stats_by_class": { 2023-10-09T06:21:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "hdd": { 2023-10-09T06:21:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "total_bytes": 1600000000, 2023-10-09T06:21:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "total_avail_bytes": 1597703796, 2023-10-09T06:21:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "total_used_bytes": 2296204, 2023-10-09T06:21:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "total_used_raw_bytes": 2296204, 2023-10-09T06:21:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "total_used_raw_ratio": 0.0014351274585351348 2023-10-09T06:21:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:21:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: "name": ".mgr", 2023-10-09T06:21:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 1, 2023-10-09T06:21:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: "stats": { 2023-10-09T06:21:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: "stored": 590368, 2023-10-09T06:21:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: "objects": 2, 2023-10-09T06:21:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: "kb_used": 577, 2023-10-09T06:21:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_used": 590368, 2023-10-09T06:21:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: "percent_used": 0.00052959454478695989, 2023-10-09T06:21:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: "max_avail": 557082176 2023-10-09T06:21:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs_metadata", 2023-10-09T06:21:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4, 2023-10-09T06:21:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "stats": { 2023-10-09T06:21:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "stored": 2306, 2023-10-09T06:21:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "objects": 22, 2023-10-09T06:21:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "kb_used": 3, 2023-10-09T06:21:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_used": 2306, 2023-10-09T06:21:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "percent_used": 2.0697082163678715e-06, 2023-10-09T06:21:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "max_avail": 557082176 2023-10-09T06:21:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:21:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:21:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs_data", 2023-10-09T06:21:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5, 2023-10-09T06:21:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: "stats": { 2023-10-09T06:21:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: "stored": 0, 2023-10-09T06:21:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: "objects": 0, 2023-10-09T06:21:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: "kb_used": 0, 2023-10-09T06:21:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_used": 0, 2023-10-09T06:21:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: "percent_used": 0, 2023-10-09T06:21:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: "max_avail": 557082176 2023-10-09T06:21:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:21:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:21:53.811 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:21:53.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.806+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc0dc066f30 msgr2=0x7fc0dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:53.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.806+0000 7fc0ff3b1700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc0dc066f30 0x7fc0dc0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8007fd0 tx=0x7fc0e8009040 comp rx=0 tx=0).stop 2023-10-09T06:21:53.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.806+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/2521251943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80cdab0 msgr2=0x7fc0f81551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:53.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.806+0000 7fc0ff3b1700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80cdab0 0x7fc0f81551d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400ec80 tx=0x7fc0f40091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.806+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/2521251943 shutdown_connections 2023-10-09T06:21:53.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.806+0000 7fc0ff3b1700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc0dc066f30 0x7fc0dc0693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.806+0000 7fc0ff3b1700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc0f80cd6e0 0x7fc0f80b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.806+0000 7fc0ff3b1700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0f815dda0 0x7fc0f814b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.806+0000 7fc0ff3b1700 1 --2- 172.21.15.31:0/2521251943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80cdab0 0x7fc0f81551d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:53.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.806+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/2521251943 >> 172.21.15.31:0/2521251943 conn(0x7fc0f8067660 msgr2=0x7fc0f80c5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:53.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.806+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/2521251943 shutdown_connections 2023-10-09T06:21:53.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:53.806+0000 7fc0ff3b1700 1 -- 172.21.15.31:0/2521251943 wait complete. 2023-10-09T06:21:53.819 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T06:21:53.819 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-10-09T06:21:53.819 DEBUG:teuthology.orchestra.run.smithi031:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-09T06:21:53.820 DEBUG:teuthology.orchestra.run.smithi031:> os.fchmod(fd, 0O666) 2023-10-09T06:21:53.820 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(fd) 2023-10-09T06:21:53.820 DEBUG:teuthology.orchestra.run.smithi031:> os.close(fd) 2023-10-09T06:21:53.820 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-10-09T06:21:54.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:21:54.074 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T06:21:54.145 INFO:teuthology.orchestra.run.smithi031.stdout:client4963 2023-10-09T06:21:54.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:54.145 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.client4963/osdmap') 2023-10-09T06:21:54.223 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 32 barrier 32 flags 0x588000 2023-10-09T06:21:54.223 INFO:teuthology.orchestra.run.smithi031.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:21:54.223 INFO:teuthology.orchestra.run.smithi031.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:21:54.223 INFO:teuthology.orchestra.run.smithi031.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:21:54.224 INFO:teuthology.orchestra.run.smithi031.stdout:osd0 (1)172.21.15.31:6801 100% (exists, up) 100% -1 2023-10-09T06:21:54.224 INFO:teuthology.orchestra.run.smithi031.stdout:osd1 (1)172.21.15.31:6817 100% (exists, up) 100% -1 2023-10-09T06:21:54.224 INFO:teuthology.orchestra.run.smithi031.stdout:osd2 (1)172.21.15.31:6821 100% (exists, up) 100% -1 2023-10-09T06:21:54.224 INFO:teuthology.orchestra.run.smithi031.stdout:osd3 (1)172.21.15.31:6809 100% (exists, up) 100% -1 2023-10-09T06:21:54.225 INFO:teuthology.orchestra.run.smithi031.stdout:osd4 (1)172.21.15.158:6817 100% (exists, up) 100% -1 2023-10-09T06:21:54.225 INFO:teuthology.orchestra.run.smithi031.stdout:osd5 (1)172.21.15.158:6804 100% (exists, up) 100% -1 2023-10-09T06:21:54.225 INFO:teuthology.orchestra.run.smithi031.stdout:osd6 (1)172.21.15.158:6801 100% (exists, up) 100% -1 2023-10-09T06:21:54.225 INFO:teuthology.orchestra.run.smithi031.stdout:osd7 (1)172.21.15.158:6825 100% (exists, up) 100% -1 2023-10-09T06:21:54.226 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records in 2023-10-09T06:21:54.226 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records out 2023-10-09T06:21:54.226 INFO:teuthology.orchestra.run.smithi031.stderr:795 bytes copied, 3.9436e-05 s, 20.2 MB/s 2023-10-09T06:21:54.227 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-09T06:21:54.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.391+0000 7f2571340700 1 Processor -- start 2023-10-09T06:21:54.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.391+0000 7f2571340700 1 -- start start 2023-10-09T06:21:54.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.392+0000 7f2571340700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f256c159850 0x7f256c159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:54.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.392+0000 7f2571340700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256c0cbaa0 con 0x7f256c069220 2023-10-09T06:21:54.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.392+0000 7f2571340700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256c0cbd80 con 0x7f256c0b2be0 2023-10-09T06:21:54.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.392+0000 7f2571340700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256c0cc060 con 0x7f256c159850 2023-10-09T06:21:54.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.392+0000 7f256affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f256c159850 0x7f256c159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:54.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.392+0000 7f256b7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f256c069220 0x7f256c0ccb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47124/0 (socket says 172.21.15.31:47124) 2023-10-09T06:21:54.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.392+0000 7f256b7fe700 1 -- 172.21.15.31:0/2830303229 learned_addr learned my addr 172.21.15.31:0/2830303229 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:54.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.392+0000 7f256affd700 1 -- 172.21.15.31:0/2830303229 >> v1:172.21.15.158:6789/0 conn(0x7f256c0b2be0 legacy=0x7f256c068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:54.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.392+0000 7f256affd700 1 -- 172.21.15.31:0/2830303229 >> v1:172.21.15.31:6789/0 conn(0x7f256c069220 legacy=0x7f256c0ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:54.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.392+0000 7f256affd700 1 -- 172.21.15.31:0/2830303229 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c0cc340 con 0x7f256c159850 2023-10-09T06:21:54.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.392+0000 7f256affd700 1 --2- 172.21.15.31:0/2830303229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f256c159850 0x7f256c159c20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f255c0098e0 tx=0x7f255c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6879f3dc9b0c06a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:54.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.393+0000 7f2569ffb700 1 -- 172.21.15.31:0/2830303229 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c009e80 con 0x7f256c159850 2023-10-09T06:21:54.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.393+0000 7f2569ffb700 1 -- 172.21.15.31:0/2830303229 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c00b820 con 0x7f256c159850 2023-10-09T06:21:54.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.393+0000 7f2569ffb700 1 -- 172.21.15.31:0/2830303229 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c00bba0 con 0x7f256c159850 2023-10-09T06:21:54.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.393+0000 7f2571340700 1 -- 172.21.15.31:0/2830303229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f256c159850 msgr2=0x7f256c159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:54.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.393+0000 7f2571340700 1 --2- 172.21.15.31:0/2830303229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f256c159850 0x7f256c159c20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f255c0098e0 tx=0x7f255c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:54.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.393+0000 7f2571340700 1 -- 172.21.15.31:0/2830303229 shutdown_connections 2023-10-09T06:21:54.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.393+0000 7f2571340700 1 --2- 172.21.15.31:0/2830303229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f256c159850 0x7f256c159c20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:54.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.393+0000 7f2571340700 1 -- 172.21.15.31:0/2830303229 >> 172.21.15.31:0/2830303229 conn(0x7f256c067660 msgr2=0x7f256c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:54.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.393+0000 7f2571340700 1 -- 172.21.15.31:0/2830303229 shutdown_connections 2023-10-09T06:21:54.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.393+0000 7f2571340700 1 -- 172.21.15.31:0/2830303229 wait complete. 2023-10-09T06:21:54.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.394+0000 7f2571340700 1 Processor -- start 2023-10-09T06:21:54.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.394+0000 7f2571340700 1 -- start start 2023-10-09T06:21:54.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f2571340700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f256c069220 0x7f256c15cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:54.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f2571340700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f256c0b2be0 0x7f256c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:54.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f2571340700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f256c159850 0x7f256c169e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:54.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f2571340700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c16bd80 con 0x7f256c069220 2023-10-09T06:21:54.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f2571340700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c15d7f0 con 0x7f256c0b2be0 2023-10-09T06:21:54.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f2571340700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256c16b170 con 0x7f256c159850 2023-10-09T06:21:54.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f256affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f256c069220 0x7f256c15cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:54.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f256affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f256c069220 0x7f256c15cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37512/0 (socket says 172.21.15.31:37512) 2023-10-09T06:21:54.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f256affd700 1 -- 172.21.15.31:0/2764966114 learned_addr learned my addr 172.21.15.31:0/2764966114 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:54.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f256a7fc700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f256c0b2be0 0x7f256c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:54.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f256b7fe700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f256c159850 0x7f256c169e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:54.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f256affd700 1 -- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f256c159850 msgr2=0x7f256c169e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:54.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f256affd700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f256c159850 0x7f256c169e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:54.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f256affd700 1 -- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f256c0b2be0 msgr2=0x7f256c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:54.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f256affd700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f256c0b2be0 0x7f256c15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:54.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f256affd700 1 -- 172.21.15.31:0/2764966114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c009420 con 0x7f256c069220 2023-10-09T06:21:54.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f256b7fe700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f256c159850 0x7f256c169e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:54.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.395+0000 7f256a7fc700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f256c0b2be0 0x7f256c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:54.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.396+0000 7f256affd700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f256c069220 0x7f256c15cd70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f255c0030c0 tx=0x7f255c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:54.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.396+0000 7f2562ffd700 1 -- 172.21.15.31:0/2764966114 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c01b470 con 0x7f256c069220 2023-10-09T06:21:54.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.396+0000 7f2562ffd700 1 -- 172.21.15.31:0/2764966114 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c01b5f0 con 0x7f256c069220 2023-10-09T06:21:54.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.396+0000 7f2562ffd700 1 -- 172.21.15.31:0/2764966114 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c01b9b0 con 0x7f256c069220 2023-10-09T06:21:54.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.396+0000 7f2571340700 1 -- 172.21.15.31:0/2764966114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256c16b450 con 0x7f256c069220 2023-10-09T06:21:54.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.396+0000 7f2571340700 1 -- 172.21.15.31:0/2764966114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256c16ba10 con 0x7f256c069220 2023-10-09T06:21:54.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.397+0000 7f2571340700 1 -- 172.21.15.31:0/2764966114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256c0891c0 con 0x7f256c069220 2023-10-09T06:21:54.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.397+0000 7f2562ffd700 1 -- 172.21.15.31:0/2764966114 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f255c01c450 con 0x7f256c069220 2023-10-09T06:21:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.398+0000 7f2562ffd700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f254c066f30 0x7f254c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.398+0000 7f2562ffd700 1 -- 172.21.15.31:0/2764966114 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f255c0862c0 con 0x7f256c069220 2023-10-09T06:21:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.398+0000 7f256a7fc700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f254c066f30 0x7f254c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.398+0000 7f256a7fc700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f254c066f30 0x7f254c0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2554007fd0 tx=0x7f2554009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.402+0000 7f2562ffd700 1 -- 172.21.15.31:0/2764966114 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f255c053530 con 0x7f256c069220 2023-10-09T06:21:54.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.605+0000 7f2571340700 1 -- 172.21.15.31:0/2764966114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f256c0b14e0 con 0x7f256c069220 2023-10-09T06:21:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.930+0000 7f2562ffd700 1 -- 172.21.15.31:0/2764966114 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v33) v1 ==== 93+0+0 (secure 0 0 0) 0x7f255c056b50 con 0x7f256c069220 2023-10-09T06:21:54.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.932+0000 7f2571340700 1 -- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f254c066f30 msgr2=0x7f254c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:54.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.932+0000 7f2571340700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f254c066f30 0x7f254c0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2554007fd0 tx=0x7f2554009040 comp rx=0 tx=0).stop 2023-10-09T06:21:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.932+0000 7f2571340700 1 -- 172.21.15.31:0/2764966114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f256c069220 msgr2=0x7f256c15cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.932+0000 7f2571340700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f256c069220 0x7f256c15cd70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f255c0030c0 tx=0x7f255c016000 comp rx=0 tx=0).stop 2023-10-09T06:21:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.932+0000 7f2571340700 1 -- 172.21.15.31:0/2764966114 shutdown_connections 2023-10-09T06:21:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.932+0000 7f2571340700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f254c066f30 0x7f254c0693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.932+0000 7f2571340700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f256c159850 0x7f256c169e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.932+0000 7f2571340700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f256c069220 0x7f256c15cd70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.932+0000 7f2571340700 1 --2- 172.21.15.31:0/2764966114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f256c0b2be0 0x7f256c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.932+0000 7f2571340700 1 -- 172.21.15.31:0/2764966114 >> 172.21.15.31:0/2764966114 conn(0x7f256c067660 msgr2=0x7f256c1578b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.933+0000 7f2571340700 1 -- 172.21.15.31:0/2764966114 shutdown_connections 2023-10-09T06:21:54.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:54.933+0000 7f2571340700 1 -- 172.21.15.31:0/2764966114 wait complete. 2023-10-09T06:21:54.935 INFO:teuthology.orchestra.run.smithi031.stderr:pauserd,pausewr is set 2023-10-09T06:21:54.946 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-09T06:21:55.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.071+0000 7fdddd7be700 1 Processor -- start 2023-10-09T06:21:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.071+0000 7fdddd7be700 1 -- start start 2023-10-09T06:21:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.071+0000 7fdddd7be700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fddd81510f0 0x7fddd806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.071+0000 7fdddd7be700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fddd80c9af0 0x7fddd815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.071+0000 7fdddd7be700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fddd8070700 0x7fddd8070b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.071+0000 7fdddd7be700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd8071080 con 0x7fddd81510f0 2023-10-09T06:21:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.071+0000 7fdddd7be700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd815e280 con 0x7fddd80c9af0 2023-10-09T06:21:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.071+0000 7fdddd7be700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80ca0b0 con 0x7fddd8070700 2023-10-09T06:21:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.072+0000 7fddd6ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fddd81510f0 0x7fddd806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.072+0000 7fddd6ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fddd81510f0 0x7fddd806ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37528/0 (socket says 172.21.15.31:37528) 2023-10-09T06:21:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.072+0000 7fddd6ffd700 1 -- 172.21.15.31:0/3247954259 learned_addr learned my addr 172.21.15.31:0/3247954259 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.072+0000 7fddd67fc700 1 --2- 172.21.15.31:0/3247954259 >> v2:172.21.15.158:3300/0 conn(0x7fddd80c9af0 0x7fddd815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.072+0000 7fddd6ffd700 1 -- 172.21.15.31:0/3247954259 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fddd8070700 msgr2=0x7fddd8070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.072+0000 7fddd6ffd700 1 --2- 172.21.15.31:0/3247954259 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fddd8070700 0x7fddd8070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.072+0000 7fddd6ffd700 1 -- 172.21.15.31:0/3247954259 >> v2:172.21.15.158:3300/0 conn(0x7fddd80c9af0 msgr2=0x7fddd815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.072+0000 7fddd6ffd700 1 --2- 172.21.15.31:0/3247954259 >> v2:172.21.15.158:3300/0 conn(0x7fddd80c9af0 0x7fddd815dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.072+0000 7fddd6ffd700 1 -- 172.21.15.31:0/3247954259 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8068a10 con 0x7fddd81510f0 2023-10-09T06:21:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.072+0000 7fddd6ffd700 1 --2- 172.21.15.31:0/3247954259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd81510f0 0x7fddd806ecc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fddd8069b20 tx=0x7fddd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5d37717053eabd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.072+0000 7fddd5ffb700 1 -- 172.21.15.31:0/3247954259 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000b860 con 0x7fddd81510f0 2023-10-09T06:21:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.072+0000 7fddd5ffb700 1 -- 172.21.15.31:0/3247954259 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd000b9c0 con 0x7fddd81510f0 2023-10-09T06:21:55.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.072+0000 7fddd5ffb700 1 -- 172.21.15.31:0/3247954259 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000bd60 con 0x7fddd81510f0 2023-10-09T06:21:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.073+0000 7fdddd7be700 1 -- 172.21.15.31:0/3247954259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd81510f0 msgr2=0x7fddd806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.073+0000 7fdddd7be700 1 --2- 172.21.15.31:0/3247954259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd81510f0 0x7fddd806ecc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fddd8069b20 tx=0x7fddd0009250 comp rx=0 tx=0).stop 2023-10-09T06:21:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.073+0000 7fdddd7be700 1 -- 172.21.15.31:0/3247954259 shutdown_connections 2023-10-09T06:21:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.073+0000 7fdddd7be700 1 --2- 172.21.15.31:0/3247954259 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fddd8070700 0x7fddd8070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.073+0000 7fdddd7be700 1 --2- 172.21.15.31:0/3247954259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd81510f0 0x7fddd806ecc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.073+0000 7fdddd7be700 1 --2- 172.21.15.31:0/3247954259 >> v2:172.21.15.158:3300/0 conn(0x7fddd80c9af0 0x7fddd815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.073+0000 7fdddd7be700 1 -- 172.21.15.31:0/3247954259 >> 172.21.15.31:0/3247954259 conn(0x7fddd80ca4f0 msgr2=0x7fddd80ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.073+0000 7fdddd7be700 1 -- 172.21.15.31:0/3247954259 shutdown_connections 2023-10-09T06:21:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.073+0000 7fdddd7be700 1 -- 172.21.15.31:0/3247954259 wait complete. 2023-10-09T06:21:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.074+0000 7fdddd7be700 1 Processor -- start 2023-10-09T06:21:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.074+0000 7fdddd7be700 1 -- start start 2023-10-09T06:21:55.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fdddd7be700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fddd8070700 0x7fddd81553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:55.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fdddd7be700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd80c9af0 0x7fddd815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:55.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fdddd7be700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fddd81510f0 0x7fddd815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:55.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fdddd7be700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd816b1a0 con 0x7fddd80c9af0 2023-10-09T06:21:55.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fdddd7be700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd815d7e0 con 0x7fddd8070700 2023-10-09T06:21:55.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fdddd7be700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd81558e0 con 0x7fddd81510f0 2023-10-09T06:21:55.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fddd67fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd80c9af0 0x7fddd815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fddd67fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd80c9af0 0x7fddd815c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37540/0 (socket says 172.21.15.31:37540) 2023-10-09T06:21:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fddd67fc700 1 -- 172.21.15.31:0/2843277178 learned_addr learned my addr 172.21.15.31:0/2843277178 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fddd6ffd700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fddd8070700 0x7fddd81553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fddd77fe700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fddd81510f0 0x7fddd815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fddd67fc700 1 -- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fddd81510f0 msgr2=0x7fddd815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fddd67fc700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fddd81510f0 0x7fddd815ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fddd67fc700 1 -- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fddd8070700 msgr2=0x7fddd81553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fddd67fc700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fddd8070700 0x7fddd81553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fddd67fc700 1 -- 172.21.15.31:0/2843277178 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd00094f0 con 0x7fddd80c9af0 2023-10-09T06:21:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fddd77fe700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fddd81510f0 0x7fddd815ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fddd67fc700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd80c9af0 0x7fddd815c8c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fddc000c830 tx=0x7fddc0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:55.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.075+0000 7fddceffd700 1 -- 172.21.15.31:0/2843277178 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0011600 con 0x7fddd80c9af0 2023-10-09T06:21:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.076+0000 7fddceffd700 1 -- 172.21.15.31:0/2843277178 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc0011760 con 0x7fddd80c9af0 2023-10-09T06:21:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.076+0000 7fdddd7be700 1 -- 172.21.15.31:0/2843277178 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd816a820 con 0x7fddd80c9af0 2023-10-09T06:21:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.076+0000 7fddceffd700 1 -- 172.21.15.31:0/2843277178 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0011b00 con 0x7fddd80c9af0 2023-10-09T06:21:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.076+0000 7fdddd7be700 1 -- 172.21.15.31:0/2843277178 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd816aae0 con 0x7fddd80c9af0 2023-10-09T06:21:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.077+0000 7fdddd7be700 1 -- 172.21.15.31:0/2843277178 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd816b2e0 con 0x7fddd80c9af0 2023-10-09T06:21:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.077+0000 7fddceffd700 1 -- 172.21.15.31:0/2843277178 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddc00193f0 con 0x7fddd80c9af0 2023-10-09T06:21:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.077+0000 7fddceffd700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fddb8066f30 0x7fddb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.078+0000 7fddceffd700 1 -- 172.21.15.31:0/2843277178 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fddc0084800 con 0x7fddd80c9af0 2023-10-09T06:21:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.078+0000 7fddceffd700 1 -- 172.21.15.31:0/2843277178 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=34+}) v3 -- 0x7fddb806ea50 con 0x7fddd80c9af0 2023-10-09T06:21:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.078+0000 7fddd6ffd700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fddb8066f30 0x7fddb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:55.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.078+0000 7fddd6ffd700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fddb8066f30 0x7fddb80693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fddd8069b20 tx=0x7fddd0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.082+0000 7fddceffd700 1 -- 172.21.15.31:0/2843277178 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddd816b2e0 con 0x7fddd80c9af0 2023-10-09T06:21:55.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.286+0000 7fdddd7be700 1 -- 172.21.15.31:0/2843277178 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fddd816b2e0 con 0x7fddd80c9af0 2023-10-09T06:21:55.646 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:21:55.649 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:21:55.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.931+0000 7fddceffd700 1 -- 172.21.15.31:0/2843277178 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(34..34 src has 1..34) v4 ==== 280+0+0 (secure 0 0 0) 0x7fddc0055e30 con 0x7fddd80c9af0 2023-10-09T06:21:55.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.931+0000 7fddceffd700 1 -- 172.21.15.31:0/2843277178 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=35}) v3 -- 0x7fddb806f3a0 con 0x7fddd80c9af0 2023-10-09T06:21:55.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.933+0000 7fddceffd700 1 -- 172.21.15.31:0/2843277178 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7fddd816b2e0 con 0x7fddd80c9af0 2023-10-09T06:21:55.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.935+0000 7fdddd7be700 1 -- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fddb8066f30 msgr2=0x7fddb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:55.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.935+0000 7fdddd7be700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fddb8066f30 0x7fddb80693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fddd8069b20 tx=0x7fddd0017000 comp rx=0 tx=0).stop 2023-10-09T06:21:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.935+0000 7fdddd7be700 1 -- 172.21.15.31:0/2843277178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd80c9af0 msgr2=0x7fddd815c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.935+0000 7fdddd7be700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd80c9af0 0x7fddd815c8c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fddc000c830 tx=0x7fddc0008040 comp rx=0 tx=0).stop 2023-10-09T06:21:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.935+0000 7fdddd7be700 1 -- 172.21.15.31:0/2843277178 shutdown_connections 2023-10-09T06:21:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.935+0000 7fdddd7be700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fddb8066f30 0x7fddb80693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.935+0000 7fdddd7be700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fddd81510f0 0x7fddd815ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.935+0000 7fdddd7be700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fddd8070700 0x7fddd81553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.935+0000 7fdddd7be700 1 --2- 172.21.15.31:0/2843277178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd80c9af0 0x7fddd815c8c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.935+0000 7fdddd7be700 1 -- 172.21.15.31:0/2843277178 >> 172.21.15.31:0/2843277178 conn(0x7fddd80ca4f0 msgr2=0x7fddd80ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:55.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.935+0000 7fdddd7be700 1 -- 172.21.15.31:0/2843277178 shutdown_connections 2023-10-09T06:21:55.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:55.936+0000 7fdddd7be700 1 -- 172.21.15.31:0/2843277178 wait complete. 2023-10-09T06:21:55.938 INFO:teuthology.orchestra.run.smithi031.stderr:pauserd,pausewr is unset 2023-10-09T06:21:55.949 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:56.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.070+0000 7f4b95fc8700 1 Processor -- start 2023-10-09T06:21:56.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.070+0000 7f4b95fc8700 1 -- start start 2023-10-09T06:21:56.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.071+0000 7f4b95fc8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b90152020 0x7f4b900ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.071+0000 7f4b95fc8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4b9015bf00 0x7f4b9006c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.071+0000 7f4b95fc8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900cbb10 con 0x7f4b901523f0 2023-10-09T06:21:56.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.071+0000 7f4b95fc8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b900cbfa0 con 0x7f4b9015bf00 2023-10-09T06:21:56.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.071+0000 7f4b95fc8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900caca0 con 0x7f4b90152020 2023-10-09T06:21:56.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.071+0000 7f4b8effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4b901523f0 0x7f4b9015b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47132/0 (socket says 172.21.15.31:47132) 2023-10-09T06:21:56.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.071+0000 7f4b8effd700 1 -- 172.21.15.31:0/1917711365 learned_addr learned my addr 172.21.15.31:0/1917711365 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:56.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8ffff700 1 --2- 172.21.15.31:0/1917711365 >> v2:172.21.15.158:3300/0 conn(0x7f4b9015bf00 0x7f4b9006c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:56.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8f7fe700 1 --2- 172.21.15.31:0/1917711365 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b90152020 0x7f4b900ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:56.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187947624 0 0) 0x7f4b900cbb10 con 0x7f4b901523f0 2023-10-09T06:21:56.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b78003570 con 0x7f4b901523f0 2023-10-09T06:21:56.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2385917196 0 0) 0x7f4b78003570 con 0x7f4b901523f0 2023-10-09T06:21:56.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b90152020 msgr2=0x7f4b900ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:56.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 --2- 172.21.15.31:0/1917711365 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b90152020 0x7f4b900ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 >> v2:172.21.15.158:3300/0 conn(0x7f4b9015bf00 msgr2=0x7f4b9006c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:56.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 --2- 172.21.15.31:0/1917711365 >> v2:172.21.15.158:3300/0 conn(0x7f4b9015bf00 0x7f4b9006c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9006cd30 con 0x7f4b901523f0 2023-10-09T06:21:56.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f4b84001470 con 0x7f4b901523f0 2023-10-09T06:21:56.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 >> v1:172.21.15.31:6789/0 conn(0x7f4b901523f0 legacy=0x7f4b9015b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:56.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 --2- 172.21.15.31:0/1917711365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b78003a60 0x7f4b78003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 --2- 172.21.15.31:0/1917711365 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b78004810 0x7f4b78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 --2- 172.21.15.31:0/1917711365 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b90152020 0x7f4b780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900cbfa0 con 0x7f4b78003a60 2023-10-09T06:21:56.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900caca0 con 0x7f4b78004810 2023-10-09T06:21:56.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7800ba60 con 0x7f4b90152020 2023-10-09T06:21:56.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8f7fe700 1 --2- 172.21.15.31:0/1917711365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b78003a60 0x7f4b78003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:56.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8effd700 1 --2- 172.21.15.31:0/1917711365 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b78004810 0x7f4b78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:56.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8ffff700 1 --2- 172.21.15.31:0/1917711365 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b90152020 0x7f4b780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:56.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8f7fe700 1 -- 172.21.15.31:0/1917711365 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b90152020 msgr2=0x7f4b780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:56.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8f7fe700 1 --2- 172.21.15.31:0/1917711365 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b90152020 0x7f4b780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8f7fe700 1 -- 172.21.15.31:0/1917711365 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b78004810 msgr2=0x7f4b78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:56.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8f7fe700 1 --2- 172.21.15.31:0/1917711365 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b78004810 0x7f4b78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.072+0000 7f4b8f7fe700 1 -- 172.21.15.31:0/1917711365 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b78003570 con 0x7f4b78003a60 2023-10-09T06:21:56.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.073+0000 7f4b8f7fe700 1 --2- 172.21.15.31:0/1917711365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b78003a60 0x7f4b78003e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009c30 tx=0x7f4b800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c438d38c4cb1243b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:56.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.073+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000e710 con 0x7f4b78003a60 2023-10-09T06:21:56.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.073+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8000e870 con 0x7f4b78003a60 2023-10-09T06:21:56.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.073+0000 7f4b8e7fc700 1 -- 172.21.15.31:0/1917711365 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000ec30 con 0x7f4b78003a60 2023-10-09T06:21:56.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.073+0000 7f4b95fc8700 1 -- 172.21.15.31:0/1917711365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b78003a60 msgr2=0x7f4b78003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:56.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.073+0000 7f4b95fc8700 1 --2- 172.21.15.31:0/1917711365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b78003a60 0x7f4b78003e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009c30 tx=0x7f4b800091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.073+0000 7f4b8ffff700 1 -- 172.21.15.31:0/1917711365 reap_dead start 2023-10-09T06:21:56.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.073+0000 7f4b95fc8700 1 -- 172.21.15.31:0/1917711365 shutdown_connections 2023-10-09T06:21:56.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.073+0000 7f4b95fc8700 1 -- 172.21.15.31:0/1917711365 >> 172.21.15.31:0/1917711365 conn(0x7f4b90069870 msgr2=0x7f4b90069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:56.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.073+0000 7f4b95fc8700 1 -- 172.21.15.31:0/1917711365 shutdown_connections 2023-10-09T06:21:56.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.073+0000 7f4b95fc8700 1 -- 172.21.15.31:0/1917711365 wait complete. 2023-10-09T06:21:56.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.075+0000 7f4b95fc8700 1 Processor -- start 2023-10-09T06:21:56.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.075+0000 7f4b95fc8700 1 -- start start 2023-10-09T06:21:56.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.075+0000 7f4b95fc8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b78003a60 0x7f4b900cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.075+0000 7f4b95fc8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b900cc6b0 0x7f4b900b4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.075+0000 7f4b95fc8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b900b45c0 0x7f4b900c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.075+0000 7f4b95fc8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900b3bf0 con 0x7f4b900cc6b0 2023-10-09T06:21:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.075+0000 7f4b95fc8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900b3020 con 0x7f4b900b45c0 2023-10-09T06:21:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.075+0000 7f4b95fc8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900cdb10 con 0x7f4b78003a60 2023-10-09T06:21:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.075+0000 7f4b8effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b900cc6b0 0x7f4b900b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.075+0000 7f4b8effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b900cc6b0 0x7f4b900b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37558/0 (socket says 172.21.15.31:37558) 2023-10-09T06:21:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b8effd700 1 -- 172.21.15.31:0/3304257313 learned_addr learned my addr 172.21.15.31:0/3304257313 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b8ffff700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b900b45c0 0x7f4b900c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:56.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b8f7fe700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b78003a60 0x7f4b900cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:56.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b8effd700 1 -- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b78003a60 msgr2=0x7f4b900cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:56.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b8effd700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b78003a60 0x7f4b900cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b8effd700 1 -- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b900b45c0 msgr2=0x7f4b900c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:56.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b8effd700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b900b45c0 0x7f4b900c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b8effd700 1 -- 172.21.15.31:0/3304257313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900b32c0 con 0x7f4b900cc6b0 2023-10-09T06:21:56.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b8effd700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b900cc6b0 0x7f4b900b4080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4b840073f0 tx=0x7f4b90159200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:56.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b777fe700 1 -- 172.21.15.31:0/3304257313 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b84018030 con 0x7f4b900cc6b0 2023-10-09T06:21:56.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b777fe700 1 -- 172.21.15.31:0/3304257313 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8400f850 con 0x7f4b900cc6b0 2023-10-09T06:21:56.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b95fc8700 1 -- 172.21.15.31:0/3304257313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b900b35a0 con 0x7f4b900cc6b0 2023-10-09T06:21:56.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b777fe700 1 -- 172.21.15.31:0/3304257313 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8400fbf0 con 0x7f4b900cc6b0 2023-10-09T06:21:56.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.076+0000 7f4b95fc8700 1 -- 172.21.15.31:0/3304257313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b900c8490 con 0x7f4b900cc6b0 2023-10-09T06:21:56.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.077+0000 7f4b95fc8700 1 -- 172.21.15.31:0/3304257313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9015c330 con 0x7f4b900cc6b0 2023-10-09T06:21:56.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.078+0000 7f4b777fe700 1 -- 172.21.15.31:0/3304257313 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b8401b070 con 0x7f4b900cc6b0 2023-10-09T06:21:56.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.078+0000 7f4b777fe700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4b7c066f30 0x7f4b7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.078+0000 7f4b777fe700 1 -- 172.21.15.31:0/3304257313 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b84019070 con 0x7f4b900cc6b0 2023-10-09T06:21:56.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.078+0000 7f4b8f7fe700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4b7c066f30 0x7f4b7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.079+0000 7f4b8f7fe700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4b7c066f30 0x7f4b7c0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4b800091e0 tx=0x7f4b8001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.082+0000 7f4b777fe700 1 -- 172.21.15.31:0/3304257313 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b84051850 con 0x7f4b900cc6b0 2023-10-09T06:21:56.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.275+0000 7f4b95fc8700 1 -- 172.21.15.31:0/3304257313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b9015c5d0 con 0x7f4b900cc6b0 2023-10-09T06:21:56.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.275+0000 7f4b777fe700 1 -- 172.21.15.31:0/3304257313 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f4b84054e70 con 0x7f4b900cc6b0 2023-10-09T06:21:56.276 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:56.276 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":34,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:21:55.930107+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:21:42.035162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T06:21:43.259545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:56.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.277+0000 7f4b95fc8700 1 -- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4b7c066f30 msgr2=0x7f4b7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:56.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.277+0000 7f4b95fc8700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4b7c066f30 0x7f4b7c0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4b800091e0 tx=0x7f4b8001a000 comp rx=0 tx=0).stop 2023-10-09T06:21:56.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.277+0000 7f4b95fc8700 1 -- 172.21.15.31:0/3304257313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b900cc6b0 msgr2=0x7f4b900b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:56.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.277+0000 7f4b95fc8700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b900cc6b0 0x7f4b900b4080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4b840073f0 tx=0x7f4b90159200 comp rx=0 tx=0).stop 2023-10-09T06:21:56.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.278+0000 7f4b95fc8700 1 -- 172.21.15.31:0/3304257313 shutdown_connections 2023-10-09T06:21:56.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.278+0000 7f4b95fc8700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4b7c066f30 0x7f4b7c0693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.278+0000 7f4b95fc8700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b78003a60 0x7f4b900cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.278+0000 7f4b95fc8700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b900b45c0 0x7f4b900c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.278+0000 7f4b95fc8700 1 --2- 172.21.15.31:0/3304257313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b900cc6b0 0x7f4b900b4080 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.278+0000 7f4b95fc8700 1 -- 172.21.15.31:0/3304257313 >> 172.21.15.31:0/3304257313 conn(0x7f4b90069870 msgr2=0x7f4b9014b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:56.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.278+0000 7f4b95fc8700 1 -- 172.21.15.31:0/3304257313 shutdown_connections 2023-10-09T06:21:56.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.278+0000 7f4b95fc8700 1 -- 172.21.15.31:0/3304257313 wait complete. 2023-10-09T06:21:56.291 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T06:21:56.291 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-10-09T06:21:56.291 DEBUG:teuthology.orchestra.run.smithi031:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-09T06:21:56.291 DEBUG:teuthology.orchestra.run.smithi031:> os.fchmod(fd, 0O666) 2023-10-09T06:21:56.291 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(fd) 2023-10-09T06:21:56.291 DEBUG:teuthology.orchestra.run.smithi031:> os.close(fd) 2023-10-09T06:21:56.291 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-10-09T06:21:56.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:21:56.546 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T06:21:56.617 INFO:teuthology.orchestra.run.smithi031.stdout:client4963 2023-10-09T06:21:56.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:56.618 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.client4963/osdmap') 2023-10-09T06:21:56.695 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 32 barrier 32 flags 0x588000 2023-10-09T06:21:56.695 INFO:teuthology.orchestra.run.smithi031.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:21:56.696 INFO:teuthology.orchestra.run.smithi031.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:21:56.696 INFO:teuthology.orchestra.run.smithi031.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:21:56.696 INFO:teuthology.orchestra.run.smithi031.stdout:osd0 (1)172.21.15.31:6801 100% (exists, up) 100% -1 2023-10-09T06:21:56.696 INFO:teuthology.orchestra.run.smithi031.stdout:osd1 (1)172.21.15.31:6817 100% (exists, up) 100% -1 2023-10-09T06:21:56.696 INFO:teuthology.orchestra.run.smithi031.stdout:osd2 (1)172.21.15.31:6821 100% (exists, up) 100% -1 2023-10-09T06:21:56.696 INFO:teuthology.orchestra.run.smithi031.stdout:osd3 (1)172.21.15.31:6809 100% (exists, up) 100% -1 2023-10-09T06:21:56.696 INFO:teuthology.orchestra.run.smithi031.stdout:osd4 (1)172.21.15.158:6817 100% (exists, up) 100% -1 2023-10-09T06:21:56.696 INFO:teuthology.orchestra.run.smithi031.stdout:osd5 (1)172.21.15.158:6804 100% (exists, up) 100% -1 2023-10-09T06:21:56.696 INFO:teuthology.orchestra.run.smithi031.stdout:osd6 (1)172.21.15.158:6801 100% (exists, up) 100% -1 2023-10-09T06:21:56.696 INFO:teuthology.orchestra.run.smithi031.stdout:osd7 (1)172.21.15.158:6825 100% (exists, up) 100% -1 2023-10-09T06:21:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records in 2023-10-09T06:21:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records out 2023-10-09T06:21:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:795 bytes copied, 4.5084e-05 s, 17.6 MB/s 2023-10-09T06:21:56.698 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:21:56.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.855+0000 7f5d70f56700 1 Processor -- start 2023-10-09T06:21:56.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.855+0000 7f5d70f56700 1 -- start start 2023-10-09T06:21:56.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.856+0000 7f5d70f56700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5d6c1510f0 0x7f5d6c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.856+0000 7f5d70f56700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6c0ca0b0 con 0x7f5d6c0c9af0 2023-10-09T06:21:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.856+0000 7f5d70f56700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6c068a10 con 0x7f5d6c070700 2023-10-09T06:21:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.856+0000 7f5d70f56700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c068cf0 con 0x7f5d6c1510f0 2023-10-09T06:21:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.857+0000 7f5d6a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5d6c1510f0 0x7f5d6c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.857+0000 7f5d69d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5d6c0c9af0 0x7f5d6c15dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47146/0 (socket says 172.21.15.31:47146) 2023-10-09T06:21:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.857+0000 7f5d6a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5d6c1510f0 0x7f5d6c06ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37570/0 (socket says 172.21.15.31:37570) 2023-10-09T06:21:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.857+0000 7f5d69d9b700 1 -- 172.21.15.31:0/626992471 learned_addr learned my addr 172.21.15.31:0/626992471 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.857+0000 7f5d6a59c700 1 -- 172.21.15.31:0/626992471 >> v1:172.21.15.158:6789/0 conn(0x7f5d6c070700 legacy=0x7f5d6c070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.857+0000 7f5d6a59c700 1 -- 172.21.15.31:0/626992471 >> v1:172.21.15.31:6789/0 conn(0x7f5d6c0c9af0 legacy=0x7f5d6c15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.857+0000 7f5d6a59c700 1 -- 172.21.15.31:0/626992471 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c0cb230 con 0x7f5d6c1510f0 2023-10-09T06:21:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.857+0000 7f5d6959a700 1 -- 172.21.15.31:0/626992471 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520195397 0 0) 0x7f5d6c0ca0b0 con 0x7f5d6c0c9af0 2023-10-09T06:21:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.857+0000 7f5d6a59c700 1 --2- 172.21.15.31:0/626992471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d6c1510f0 0x7f5d6c06ecc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009e60 tx=0x7f5d5c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93601f51c9d2666b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.857+0000 7f5d6959a700 1 -- 172.21.15.31:0/626992471 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c00e070 con 0x7f5d6c1510f0 2023-10-09T06:21:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.857+0000 7f5d6959a700 1 -- 172.21.15.31:0/626992471 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c00bc30 con 0x7f5d6c1510f0 2023-10-09T06:21:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.857+0000 7f5d6959a700 1 -- 172.21.15.31:0/626992471 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c012430 con 0x7f5d6c1510f0 2023-10-09T06:21:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.858+0000 7f5d70f56700 1 -- 172.21.15.31:0/626992471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d6c1510f0 msgr2=0x7f5d6c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.858+0000 7f5d70f56700 1 --2- 172.21.15.31:0/626992471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d6c1510f0 0x7f5d6c06ecc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009e60 tx=0x7f5d5c009780 comp rx=0 tx=0).stop 2023-10-09T06:21:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.858+0000 7f5d70f56700 1 -- 172.21.15.31:0/626992471 shutdown_connections 2023-10-09T06:21:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.858+0000 7f5d70f56700 1 --2- 172.21.15.31:0/626992471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d6c1510f0 0x7f5d6c06ecc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.858+0000 7f5d70f56700 1 -- 172.21.15.31:0/626992471 >> 172.21.15.31:0/626992471 conn(0x7f5d6c0ca4f0 msgr2=0x7f5d6c0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.858+0000 7f5d70f56700 1 -- 172.21.15.31:0/626992471 shutdown_connections 2023-10-09T06:21:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.858+0000 7f5d70f56700 1 -- 172.21.15.31:0/626992471 wait complete. 2023-10-09T06:21:56.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.859+0000 7f5d70f56700 1 Processor -- start 2023-10-09T06:21:56.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.859+0000 7f5d70f56700 1 -- start start 2023-10-09T06:21:56.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d70f56700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d6c070700 0x7f5d6c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d70f56700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d6c0c9af0 0x7f5d6c1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d70f56700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d6c1510f0 0x7f5d6c159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d70f56700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0c5bd0 con 0x7f5d6c070700 2023-10-09T06:21:56.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d70f56700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0b1ec0 con 0x7f5d6c0c9af0 2023-10-09T06:21:56.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d70f56700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0c4fc0 con 0x7f5d6c1510f0 2023-10-09T06:21:56.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d6a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d6c070700 0x7f5d6c0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:56.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d6a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d6c070700 0x7f5d6c0b1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37572/0 (socket says 172.21.15.31:37572) 2023-10-09T06:21:56.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d6a59c700 1 -- 172.21.15.31:0/2809358959 learned_addr learned my addr 172.21.15.31:0/2809358959 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:56.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d6a59c700 1 -- 172.21.15.31:0/2809358959 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d6c1510f0 msgr2=0x7f5d6c159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:56.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d6a59c700 1 --2- 172.21.15.31:0/2809358959 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d6c1510f0 0x7f5d6c159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d6a59c700 1 -- 172.21.15.31:0/2809358959 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d6c0c9af0 msgr2=0x7f5d6c1504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:56.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d6a59c700 1 --2- 172.21.15.31:0/2809358959 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d6c0c9af0 0x7f5d6c1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:56.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d6a59c700 1 -- 172.21.15.31:0/2809358959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c009a20 con 0x7f5d6c070700 2023-10-09T06:21:56.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d6a59c700 1 --2- 172.21.15.31:0/2809358959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d6c070700 0x7f5d6c0b1980 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c013000 tx=0x7f5d5c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:56.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d627fc700 1 -- 172.21.15.31:0/2809358959 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c027470 con 0x7f5d6c070700 2023-10-09T06:21:56.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d627fc700 1 -- 172.21.15.31:0/2809358959 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c0275d0 con 0x7f5d6c070700 2023-10-09T06:21:56.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d70f56700 1 -- 172.21.15.31:0/2809358959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6c0c52a0 con 0x7f5d6c070700 2023-10-09T06:21:56.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d627fc700 1 -- 172.21.15.31:0/2809358959 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c027990 con 0x7f5d6c070700 2023-10-09T06:21:56.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.860+0000 7f5d70f56700 1 -- 172.21.15.31:0/2809358959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c0c5860 con 0x7f5d6c070700 2023-10-09T06:21:56.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.861+0000 7f5d70f56700 1 -- 172.21.15.31:0/2809358959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6c0c7e90 con 0x7f5d6c070700 2023-10-09T06:21:56.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.862+0000 7f5d627fc700 1 -- 172.21.15.31:0/2809358959 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d5c024070 con 0x7f5d6c070700 2023-10-09T06:21:56.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.862+0000 7f5d627fc700 1 --2- 172.21.15.31:0/2809358959 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5d4c066f30 0x7f5d4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:56.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.862+0000 7f5d627fc700 1 -- 172.21.15.31:0/2809358959 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d5c0870c0 con 0x7f5d6c070700 2023-10-09T06:21:56.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.862+0000 7f5d69d9b700 1 --2- 172.21.15.31:0/2809358959 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5d4c066f30 0x7f5d4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:56.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.863+0000 7f5d69d9b700 1 --2- 172.21.15.31:0/2809358959 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5d4c066f30 0x7f5d4c0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5d540011e0 tx=0x7f5d540079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:56.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:56.866+0000 7f5d627fc700 1 -- 172.21.15.31:0/2809358959 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d5c054330 con 0x7f5d6c070700 2023-10-09T06:21:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.103+0000 7f5d70f56700 1 -- 172.21.15.31:0/2809358959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d6c04c3c0 con 0x7f5d6c070700 2023-10-09T06:21:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.104+0000 7f5d627fc700 1 -- 172.21.15.31:0/2809358959 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f5d5c057950 con 0x7f5d6c070700 2023-10-09T06:21:57.105 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:57.105 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1792934235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1792934235},{"type":"v1","addr":"172.21.15.158:6837","nonce":1792934235}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/893363730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":893363730},{"type":"v1","addr":"172.21.15.31:6834","nonce":893363730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4923,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2780075004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2780075004},{"type":"v1","addr":"172.21.15.31:6835","nonce":2780075004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:21:44.276772+0000","modified":"2023-10-09T06:21:47.908951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6836/1041874650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1041874650},{"type":"v1","addr":"172.21.15.158:6836","nonce":1041874650}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:21:57.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.105+0000 7f5d70f56700 1 -- 172.21.15.31:0/2809358959 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5d4c066f30 msgr2=0x7f5d4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:57.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.105+0000 7f5d70f56700 1 --2- 172.21.15.31:0/2809358959 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5d4c066f30 0x7f5d4c0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5d540011e0 tx=0x7f5d540079d0 comp rx=0 tx=0).stop 2023-10-09T06:21:57.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.105+0000 7f5d70f56700 1 -- 172.21.15.31:0/2809358959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d6c070700 msgr2=0x7f5d6c0b1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:57.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.105+0000 7f5d70f56700 1 --2- 172.21.15.31:0/2809358959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d6c070700 0x7f5d6c0b1980 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c013000 tx=0x7f5d5c019000 comp rx=0 tx=0).stop 2023-10-09T06:21:57.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.105+0000 7f5d70f56700 1 -- 172.21.15.31:0/2809358959 shutdown_connections 2023-10-09T06:21:57.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.105+0000 7f5d70f56700 1 --2- 172.21.15.31:0/2809358959 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5d4c066f30 0x7f5d4c0693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:57.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.105+0000 7f5d70f56700 1 --2- 172.21.15.31:0/2809358959 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d6c1510f0 0x7f5d6c159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:57.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.105+0000 7f5d70f56700 1 --2- 172.21.15.31:0/2809358959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d6c070700 0x7f5d6c0b1980 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:57.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.105+0000 7f5d70f56700 1 --2- 172.21.15.31:0/2809358959 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d6c0c9af0 0x7f5d6c1504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:57.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.105+0000 7f5d70f56700 1 -- 172.21.15.31:0/2809358959 >> 172.21.15.31:0/2809358959 conn(0x7f5d6c0ca4f0 msgr2=0x7f5d6c0cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:57.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.105+0000 7f5d70f56700 1 -- 172.21.15.31:0/2809358959 shutdown_connections 2023-10-09T06:21:57.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:57.105+0000 7f5d70f56700 1 -- 172.21.15.31:0/2809358959 wait complete. 2023-10-09T06:21:57.108 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 16 2023-10-09T06:21:57.118 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json osdmap barrier 34 2023-10-09T06:21:57.262 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-09T06:21:57.262 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T06:21:57.262 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-10-09T06:21:57.262 DEBUG:teuthology.orchestra.run.smithi031:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-09T06:21:57.262 DEBUG:teuthology.orchestra.run.smithi031:> os.fchmod(fd, 0O666) 2023-10-09T06:21:57.262 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(fd) 2023-10-09T06:21:57.263 DEBUG:teuthology.orchestra.run.smithi031:> os.close(fd) 2023-10-09T06:21:57.263 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-10-09T06:21:57.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:21:57.517 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T06:21:57.588 INFO:teuthology.orchestra.run.smithi031.stdout:client4963 2023-10-09T06:21:57.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:57.589 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.client4963/osdmap') 2023-10-09T06:21:57.666 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 34 barrier 34 flags 0x588000 2023-10-09T06:21:57.666 INFO:teuthology.orchestra.run.smithi031.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:21:57.666 INFO:teuthology.orchestra.run.smithi031.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:21:57.666 INFO:teuthology.orchestra.run.smithi031.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:21:57.666 INFO:teuthology.orchestra.run.smithi031.stdout:osd0 (1)172.21.15.31:6801 100% (exists, up) 100% -1 2023-10-09T06:21:57.666 INFO:teuthology.orchestra.run.smithi031.stdout:osd1 (1)172.21.15.31:6817 100% (exists, up) 100% -1 2023-10-09T06:21:57.666 INFO:teuthology.orchestra.run.smithi031.stdout:osd2 (1)172.21.15.31:6821 100% (exists, up) 100% -1 2023-10-09T06:21:57.666 INFO:teuthology.orchestra.run.smithi031.stdout:osd3 (1)172.21.15.31:6809 100% (exists, up) 100% -1 2023-10-09T06:21:57.667 INFO:teuthology.orchestra.run.smithi031.stdout:osd4 (1)172.21.15.158:6817 100% (exists, up) 100% -1 2023-10-09T06:21:57.667 INFO:teuthology.orchestra.run.smithi031.stdout:osd5 (1)172.21.15.158:6804 100% (exists, up) 100% -1 2023-10-09T06:21:57.667 INFO:teuthology.orchestra.run.smithi031.stdout:osd6 (1)172.21.15.158:6801 100% (exists, up) 100% -1 2023-10-09T06:21:57.667 INFO:teuthology.orchestra.run.smithi031.stdout:osd7 (1)172.21.15.158:6825 100% (exists, up) 100% -1 2023-10-09T06:21:57.668 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records in 2023-10-09T06:21:57.668 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records out 2023-10-09T06:21:57.668 INFO:teuthology.orchestra.run.smithi031.stderr:795 bytes copied, 3.7256e-05 s, 21.3 MB/s 2023-10-09T06:21:57.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:21:57.668 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T06:21:57.738 INFO:teuthology.orchestra.run.smithi031.stdout:client4963 2023-10-09T06:21:57.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:57.739 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.client4963/osdmap') 2023-10-09T06:21:57.816 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 34 barrier 34 flags 0x588000 2023-10-09T06:21:57.816 INFO:teuthology.orchestra.run.smithi031.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:21:57.816 INFO:teuthology.orchestra.run.smithi031.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:21:57.816 INFO:teuthology.orchestra.run.smithi031.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:21:57.816 INFO:teuthology.orchestra.run.smithi031.stdout:osd0 (1)172.21.15.31:6801 100% (exists, up) 100% -1 2023-10-09T06:21:57.816 INFO:teuthology.orchestra.run.smithi031.stdout:osd1 (1)172.21.15.31:6817 100% (exists, up) 100% -1 2023-10-09T06:21:57.816 INFO:teuthology.orchestra.run.smithi031.stdout:osd2 (1)172.21.15.31:6821 100% (exists, up) 100% -1 2023-10-09T06:21:57.816 INFO:teuthology.orchestra.run.smithi031.stdout:osd3 (1)172.21.15.31:6809 100% (exists, up) 100% -1 2023-10-09T06:21:57.816 INFO:teuthology.orchestra.run.smithi031.stdout:osd4 (1)172.21.15.158:6817 100% (exists, up) 100% -1 2023-10-09T06:21:57.816 INFO:teuthology.orchestra.run.smithi031.stdout:osd5 (1)172.21.15.158:6804 100% (exists, up) 100% -1 2023-10-09T06:21:57.817 INFO:teuthology.orchestra.run.smithi031.stdout:osd6 (1)172.21.15.158:6801 100% (exists, up) 100% -1 2023-10-09T06:21:57.817 INFO:teuthology.orchestra.run.smithi031.stdout:osd7 (1)172.21.15.158:6825 100% (exists, up) 100% -1 2023-10-09T06:21:57.818 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records in 2023-10-09T06:21:57.818 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records out 2023-10-09T06:21:57.818 INFO:teuthology.orchestra.run.smithi031.stderr:795 bytes copied, 3.8786e-05 s, 20.5 MB/s 2023-10-09T06:21:57.818 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T06:21:57.818 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:21:57.818 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:21:57.896 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:21:57.935 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:21:57.935 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:21:57.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:21:57.935 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:21:58.000 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:21:58.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:58.000 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:21:58.017 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T06:21:58.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:21:58.018 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T06:21:58.058 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:21:58.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:21:58.059 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T06:21:58.113 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:21:58.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.232+0000 7f46af09c700 1 Processor -- start 2023-10-09T06:21:58.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.232+0000 7f46af09c700 1 -- start start 2023-10-09T06:21:58.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46af09c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f46a80d1c30 0x7f46a80ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46af09c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a80c5d80 con 0x7f46a815a680 2023-10-09T06:21:58.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46af09c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a80c6060 con 0x7f46a815a2b0 2023-10-09T06:21:58.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46af09c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a8068470 con 0x7f46a80d1c30 2023-10-09T06:21:58.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46ad639700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f46a815a680 0x7f46a80cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47160/0 (socket says 172.21.15.31:47160) 2023-10-09T06:21:58.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46ad639700 1 -- 172.21.15.31:0/2800663286 learned_addr learned my addr 172.21.15.31:0/2800663286 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:58.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846042571 0 0) 0x7f46a80c5d80 con 0x7f46a815a680 2023-10-09T06:21:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46a7fff700 1 --2- 172.21.15.31:0/2800663286 >> v2:172.21.15.158:3300/0 conn(0x7f46a80d1c30 0x7f46a80ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4694003570 con 0x7f46a815a680 2023-10-09T06:21:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2840537199 0 0) 0x7f4694003570 con 0x7f46a815a680 2023-10-09T06:21:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 >> v2:172.21.15.158:3300/0 conn(0x7f46a80d1c30 msgr2=0x7f46a80ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46a77fe700 1 --2- 172.21.15.31:0/2800663286 >> v2:172.21.15.158:3300/0 conn(0x7f46a80d1c30 0x7f46a80ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 >> v1:172.21.15.158:6789/0 conn(0x7f46a815a2b0 legacy=0x7f46a80b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a80c6340 con 0x7f46a815a680 2023-10-09T06:21:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.233+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f4690001470 con 0x7f46a815a680 2023-10-09T06:21:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 >> v1:172.21.15.31:6789/0 conn(0x7f46a815a680 legacy=0x7f46a80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a77fe700 1 --2- 172.21.15.31:0/2800663286 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4694003a60 0x7f4694003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a77fe700 1 --2- 172.21.15.31:0/2800663286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4694004810 0x7f4694004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a77fe700 1 --2- 172.21.15.31:0/2800663286 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46940051c0 0x7f469400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a8068470 con 0x7f4694004810 2023-10-09T06:21:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469400c0d0 con 0x7f46940051c0 2023-10-09T06:21:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469400c290 con 0x7f4694003a60 2023-10-09T06:21:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a7fff700 1 --2- 172.21.15.31:0/2800663286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4694004810 0x7f4694004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46ad639700 1 --2- 172.21.15.31:0/2800663286 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46940051c0 0x7f469400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46ace38700 1 --2- 172.21.15.31:0/2800663286 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4694003a60 0x7f4694003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a7fff700 1 -- 172.21.15.31:0/2800663286 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4694003a60 msgr2=0x7f4694003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a7fff700 1 --2- 172.21.15.31:0/2800663286 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4694003a60 0x7f4694003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a7fff700 1 -- 172.21.15.31:0/2800663286 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46940051c0 msgr2=0x7f469400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a7fff700 1 --2- 172.21.15.31:0/2800663286 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46940051c0 0x7f469400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a7fff700 1 -- 172.21.15.31:0/2800663286 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694003570 con 0x7f4694004810 2023-10-09T06:21:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46ad639700 1 -- 172.21.15.31:0/2800663286 reap_dead start 2023-10-09T06:21:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a7fff700 1 --2- 172.21.15.31:0/2800663286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4694004810 0x7f4694004c80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f46a80d2000 tx=0x7f469800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe6a12b5d25941a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800ea90 con 0x7f4694004810 2023-10-09T06:21:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800f040 con 0x7f4694004810 2023-10-09T06:21:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.234+0000 7f46a77fe700 1 -- 172.21.15.31:0/2800663286 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800ee40 con 0x7f4694004810 2023-10-09T06:21:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.235+0000 7f46af09c700 1 -- 172.21.15.31:0/2800663286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4694004810 msgr2=0x7f4694004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.235+0000 7f46af09c700 1 --2- 172.21.15.31:0/2800663286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4694004810 0x7f4694004c80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f46a80d2000 tx=0x7f469800b040 comp rx=0 tx=0).stop 2023-10-09T06:21:58.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.235+0000 7f46af09c700 1 -- 172.21.15.31:0/2800663286 shutdown_connections 2023-10-09T06:21:58.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.235+0000 7f46af09c700 1 --2- 172.21.15.31:0/2800663286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4694004810 0x7f4694004c80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.235+0000 7f46af09c700 1 -- 172.21.15.31:0/2800663286 >> 172.21.15.31:0/2800663286 conn(0x7f46a8067e40 msgr2=0x7f46a80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:58.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.235+0000 7f46af09c700 1 -- 172.21.15.31:0/2800663286 shutdown_connections 2023-10-09T06:21:58.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.235+0000 7f46af09c700 1 -- 172.21.15.31:0/2800663286 wait complete. 2023-10-09T06:21:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.236+0000 7f46af09c700 1 Processor -- start 2023-10-09T06:21:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.236+0000 7f46af09c700 1 -- start start 2023-10-09T06:21:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46af09c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4694004810 0x7f46a816ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46af09c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46a815ba50 0x7f46a815bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46af09c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46a80ca860 0x7f46a80cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46af09c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a815d100 con 0x7f4694004810 2023-10-09T06:21:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46af09c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80cb210 con 0x7f46a815ba50 2023-10-09T06:21:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46af09c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a815c4f0 con 0x7f46a80ca860 2023-10-09T06:21:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46ace38700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4694004810 0x7f46a816ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46ace38700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4694004810 0x7f46a816ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37604/0 (socket says 172.21.15.31:37604) 2023-10-09T06:21:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46ace38700 1 -- 172.21.15.31:0/4185251813 learned_addr learned my addr 172.21.15.31:0/4185251813 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46a7fff700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46a815ba50 0x7f46a815bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46ad639700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46a80ca860 0x7f46a80cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46ace38700 1 -- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46a80ca860 msgr2=0x7f46a80cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46ace38700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46a80ca860 0x7f46a80cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46ace38700 1 -- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46a815ba50 msgr2=0x7f46a815bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46ace38700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46a815ba50 0x7f46a815bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46ace38700 1 -- 172.21.15.31:0/4185251813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a815c7d0 con 0x7f4694004810 2023-10-09T06:21:58.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.237+0000 7f46ace38700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4694004810 0x7f46a816ac80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f46a00029d0 tx=0x7f46a0007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:58.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.238+0000 7f46a4ff9700 1 -- 172.21.15.31:0/4185251813 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0013600 con 0x7f4694004810 2023-10-09T06:21:58.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.238+0000 7f46a4ff9700 1 -- 172.21.15.31:0/4185251813 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a0013760 con 0x7f4694004810 2023-10-09T06:21:58.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.238+0000 7f46af09c700 1 -- 172.21.15.31:0/4185251813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a815cab0 con 0x7f4694004810 2023-10-09T06:21:58.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.238+0000 7f46a4ff9700 1 -- 172.21.15.31:0/4185251813 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0013ae0 con 0x7f4694004810 2023-10-09T06:21:58.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.238+0000 7f46af09c700 1 -- 172.21.15.31:0/4185251813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a816a520 con 0x7f4694004810 2023-10-09T06:21:58.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.238+0000 7f46af09c700 1 -- 172.21.15.31:0/4185251813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a815cf50 con 0x7f4694004810 2023-10-09T06:21:58.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.239+0000 7f46a4ff9700 1 -- 172.21.15.31:0/4185251813 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46a001c400 con 0x7f4694004810 2023-10-09T06:21:58.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.239+0000 7f46a4ff9700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4688066f30 0x7f46880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.240+0000 7f46a4ff9700 1 -- 172.21.15.31:0/4185251813 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f46a0084690 con 0x7f4694004810 2023-10-09T06:21:58.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.240+0000 7f46a7fff700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4688066f30 0x7f46880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.240+0000 7f46a7fff700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4688066f30 0x7f46880693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f469800afd0 tx=0x7f469801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:58.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.244+0000 7f46a4ff9700 1 -- 172.21.15.31:0/4185251813 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46a0051900 con 0x7f4694004810 2023-10-09T06:21:58.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.480+0000 7f46af09c700 1 -- 172.21.15.31:0/4185251813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46a804c3c0 con 0x7f4694004810 2023-10-09T06:21:58.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.480+0000 7f46a4ff9700 1 -- 172.21.15.31:0/4185251813 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f46a0054f20 con 0x7f4694004810 2023-10-09T06:21:58.481 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:58.481 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1792934235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1792934235},{"type":"v1","addr":"172.21.15.158:6837","nonce":1792934235}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/893363730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":893363730},{"type":"v1","addr":"172.21.15.31:6834","nonce":893363730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4923,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2780075004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2780075004},{"type":"v1","addr":"172.21.15.31:6835","nonce":2780075004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:21:44.276772+0000","modified":"2023-10-09T06:21:47.908951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6836/1041874650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1041874650},{"type":"v1","addr":"172.21.15.158:6836","nonce":1041874650}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:21:58.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.482+0000 7f46af09c700 1 -- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4688066f30 msgr2=0x7f46880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.482+0000 7f46af09c700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4688066f30 0x7f46880693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f469800afd0 tx=0x7f469801a000 comp rx=0 tx=0).stop 2023-10-09T06:21:58.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.482+0000 7f46af09c700 1 -- 172.21.15.31:0/4185251813 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4694004810 msgr2=0x7f46a816ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.482+0000 7f46af09c700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4694004810 0x7f46a816ac80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f46a00029d0 tx=0x7f46a0007d80 comp rx=0 tx=0).stop 2023-10-09T06:21:58.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.482+0000 7f46af09c700 1 -- 172.21.15.31:0/4185251813 shutdown_connections 2023-10-09T06:21:58.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.482+0000 7f46af09c700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4688066f30 0x7f46880693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.482+0000 7f46af09c700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46a80ca860 0x7f46a80cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.482+0000 7f46af09c700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4694004810 0x7f46a816ac80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.482+0000 7f46af09c700 1 --2- 172.21.15.31:0/4185251813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46a815ba50 0x7f46a815bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.482+0000 7f46af09c700 1 -- 172.21.15.31:0/4185251813 >> 172.21.15.31:0/4185251813 conn(0x7f46a8067e40 msgr2=0x7f46a80b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:58.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.482+0000 7f46af09c700 1 -- 172.21.15.31:0/4185251813 shutdown_connections 2023-10-09T06:21:58.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.482+0000 7f46af09c700 1 -- 172.21.15.31:0/4185251813 wait complete. 2023-10-09T06:21:58.485 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 16 2023-10-09T06:21:58.495 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:21:58.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.613+0000 7fd92d43f700 1 Processor -- start 2023-10-09T06:21:58.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.613+0000 7fd92d43f700 1 -- start start 2023-10-09T06:21:58.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.614+0000 7fd92d43f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd928069220 0x7fd928159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.614+0000 7fd92d43f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9280cbaa0 con 0x7fd9280b32f0 2023-10-09T06:21:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.614+0000 7fd92d43f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9280cbd80 con 0x7fd928159850 2023-10-09T06:21:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.614+0000 7fd92d43f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9280cc060 con 0x7fd928069220 2023-10-09T06:21:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.614+0000 7fd9267fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd9280b32f0 0x7fd928068b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47174/0 (socket says 172.21.15.31:47174) 2023-10-09T06:21:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.614+0000 7fd9267fc700 1 -- 172.21.15.31:0/4021289412 learned_addr learned my addr 172.21.15.31:0/4021289412 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.614+0000 7fd9277fe700 1 --2- 172.21.15.31:0/4021289412 >> v2:172.21.15.158:3300/0 conn(0x7fd928069220 0x7fd928159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.614+0000 7fd925ffb700 1 -- 172.21.15.31:0/4021289412 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863513466 0 0) 0x7fd9280cbaa0 con 0x7fd9280b32f0 2023-10-09T06:21:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.614+0000 7fd925ffb700 1 -- 172.21.15.31:0/4021289412 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd914003570 con 0x7fd9280b32f0 2023-10-09T06:21:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.615+0000 7fd925ffb700 1 -- 172.21.15.31:0/4021289412 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042431013 0 0) 0x7fd9280cbd80 con 0x7fd928159850 2023-10-09T06:21:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.615+0000 7fd925ffb700 1 -- 172.21.15.31:0/4021289412 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9280cbaa0 con 0x7fd928159850 2023-10-09T06:21:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.615+0000 7fd9277fe700 1 -- 172.21.15.31:0/4021289412 >> v1:172.21.15.158:6789/0 conn(0x7fd928159850 legacy=0x7fd9280b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.615+0000 7fd9277fe700 1 -- 172.21.15.31:0/4021289412 >> v1:172.21.15.31:6789/0 conn(0x7fd9280b32f0 legacy=0x7fd928068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.615+0000 7fd9277fe700 1 -- 172.21.15.31:0/4021289412 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9280cc340 con 0x7fd928069220 2023-10-09T06:21:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.615+0000 7fd9277fe700 1 --2- 172.21.15.31:0/4021289412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd928069220 0x7fd928159c20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd920009e60 tx=0x7fd920009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=532d95305e891fa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.615+0000 7fd925ffb700 1 -- 172.21.15.31:0/4021289412 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92000e070 con 0x7fd928069220 2023-10-09T06:21:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.615+0000 7fd925ffb700 1 -- 172.21.15.31:0/4021289412 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92000bab0 con 0x7fd928069220 2023-10-09T06:21:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.615+0000 7fd925ffb700 1 -- 172.21.15.31:0/4021289412 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92000be70 con 0x7fd928069220 2023-10-09T06:21:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.616+0000 7fd92d43f700 1 -- 172.21.15.31:0/4021289412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd928069220 msgr2=0x7fd928159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.616+0000 7fd92d43f700 1 --2- 172.21.15.31:0/4021289412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd928069220 0x7fd928159c20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd920009e60 tx=0x7fd920009780 comp rx=0 tx=0).stop 2023-10-09T06:21:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.616+0000 7fd92d43f700 1 -- 172.21.15.31:0/4021289412 shutdown_connections 2023-10-09T06:21:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.616+0000 7fd92d43f700 1 --2- 172.21.15.31:0/4021289412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd928069220 0x7fd928159c20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.616+0000 7fd92d43f700 1 -- 172.21.15.31:0/4021289412 >> 172.21.15.31:0/4021289412 conn(0x7fd928067660 msgr2=0x7fd928067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.616+0000 7fd92d43f700 1 -- 172.21.15.31:0/4021289412 shutdown_connections 2023-10-09T06:21:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.616+0000 7fd92d43f700 1 -- 172.21.15.31:0/4021289412 wait complete. 2023-10-09T06:21:58.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.617+0000 7fd92d43f700 1 Processor -- start 2023-10-09T06:21:58.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.617+0000 7fd92d43f700 1 -- start start 2023-10-09T06:21:58.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd92d43f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd928069220 0x7fd928154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd92d43f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9280b32f0 0x7fd92814f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd92d43f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd928159850 0x7fd9280ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd92d43f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92814fe20 con 0x7fd9280b32f0 2023-10-09T06:21:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd92d43f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9280ca700 con 0x7fd928159850 2023-10-09T06:21:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd92d43f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd928153090 con 0x7fd928069220 2023-10-09T06:21:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd9267fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9280b32f0 0x7fd92814f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd9267fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9280b32f0 0x7fd92814f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37610/0 (socket says 172.21.15.31:37610) 2023-10-09T06:21:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd9267fc700 1 -- 172.21.15.31:0/2722460926 learned_addr learned my addr 172.21.15.31:0/2722460926 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd9277fe700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd928159850 0x7fd9280ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd926ffd700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd928069220 0x7fd928154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd9267fc700 1 -- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd928069220 msgr2=0x7fd928154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd9267fc700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd928069220 0x7fd928154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd9267fc700 1 -- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd928159850 msgr2=0x7fd9280ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd9267fc700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd928159850 0x7fd9280ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd9267fc700 1 -- 172.21.15.31:0/2722460926 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd920009a20 con 0x7fd9280b32f0 2023-10-09T06:21:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.618+0000 7fd9267fc700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9280b32f0 0x7fd92814f8e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c790 tx=0x7fd910007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.619+0000 7fd91effd700 1 -- 172.21.15.31:0/2722460926 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910005b30 con 0x7fd9280b32f0 2023-10-09T06:21:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.619+0000 7fd91effd700 1 -- 172.21.15.31:0/2722460926 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd910005c90 con 0x7fd9280b32f0 2023-10-09T06:21:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.619+0000 7fd92d43f700 1 -- 172.21.15.31:0/2722460926 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd928152db0 con 0x7fd9280b32f0 2023-10-09T06:21:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.619+0000 7fd91effd700 1 -- 172.21.15.31:0/2722460926 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910007300 con 0x7fd9280b32f0 2023-10-09T06:21:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.619+0000 7fd92d43f700 1 -- 172.21.15.31:0/2722460926 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9280c5e40 con 0x7fd9280b32f0 2023-10-09T06:21:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.620+0000 7fd92d43f700 1 -- 172.21.15.31:0/2722460926 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9280891c0 con 0x7fd9280b32f0 2023-10-09T06:21:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.620+0000 7fd91effd700 1 -- 172.21.15.31:0/2722460926 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd91001b3b0 con 0x7fd9280b32f0 2023-10-09T06:21:58.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.621+0000 7fd91effd700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd908066f30 0x7fd9080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.621+0000 7fd91effd700 1 -- 172.21.15.31:0/2722460926 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd910083a80 con 0x7fd9280b32f0 2023-10-09T06:21:58.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.621+0000 7fd926ffd700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd908066f30 0x7fd9080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.621+0000 7fd926ffd700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd908066f30 0x7fd9080693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd918007fd0 tx=0x7fd918007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:58.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.625+0000 7fd91effd700 1 -- 172.21.15.31:0/2722460926 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd910050cf0 con 0x7fd9280b32f0 2023-10-09T06:21:58.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.820+0000 7fd92d43f700 1 -- 172.21.15.31:0/2722460926 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9280cc620 con 0x7fd9280b32f0 2023-10-09T06:21:58.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.821+0000 7fd91effd700 1 -- 172.21.15.31:0/2722460926 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd910017020 con 0x7fd9280b32f0 2023-10-09T06:21:58.822 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:21:58.822 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":34,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:21:55.930107+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:21:42.035162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T06:21:43.259545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:21:58.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.823+0000 7fd92d43f700 1 -- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd908066f30 msgr2=0x7fd9080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.823+0000 7fd92d43f700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd908066f30 0x7fd9080693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd918007fd0 tx=0x7fd918007d50 comp rx=0 tx=0).stop 2023-10-09T06:21:58.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.823+0000 7fd92d43f700 1 -- 172.21.15.31:0/2722460926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9280b32f0 msgr2=0x7fd92814f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.823+0000 7fd92d43f700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9280b32f0 0x7fd92814f8e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c790 tx=0x7fd910007ea0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.823+0000 7fd92d43f700 1 -- 172.21.15.31:0/2722460926 shutdown_connections 2023-10-09T06:21:58.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.823+0000 7fd92d43f700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd908066f30 0x7fd9080693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.823+0000 7fd92d43f700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd928069220 0x7fd928154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.823+0000 7fd92d43f700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd928159850 0x7fd9280ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.823+0000 7fd92d43f700 1 --2- 172.21.15.31:0/2722460926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9280b32f0 0x7fd92814f8e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.823+0000 7fd92d43f700 1 -- 172.21.15.31:0/2722460926 >> 172.21.15.31:0/2722460926 conn(0x7fd928067660 msgr2=0x7fd9280b5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:58.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.823+0000 7fd92d43f700 1 -- 172.21.15.31:0/2722460926 shutdown_connections 2023-10-09T06:21:58.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.823+0000 7fd92d43f700 1 -- 172.21.15.31:0/2722460926 wait complete. 2023-10-09T06:21:58.836 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:21:42.035162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:21:43.259545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:21:58.836 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:21:58.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.959+0000 7f31b854c700 1 Processor -- start 2023-10-09T06:21:58.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.959+0000 7f31b854c700 1 -- start start 2023-10-09T06:21:58.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b854c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f31b00678b0 0x7f31b015db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b854c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f31b00c9390 0x7f31b015a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b854c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b00cae70 con 0x7f31b00cbf10 2023-10-09T06:21:58.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b854c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b00cb150 con 0x7f31b00c9390 2023-10-09T06:21:58.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b854c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b00cb430 con 0x7f31b00678b0 2023-10-09T06:21:58.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b6ae9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f31b00c9390 0x7f31b015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b5ae7700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f31b00cbf10 0x7f31b015e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47186/0 (socket says 172.21.15.31:47186) 2023-10-09T06:21:58.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b5ae7700 1 -- 172.21.15.31:0/2284538545 learned_addr learned my addr 172.21.15.31:0/2284538545 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:58.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b62e8700 1 --2- 172.21.15.31:0/2284538545 >> v2:172.21.15.158:3300/0 conn(0x7f31b00678b0 0x7f31b015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b6ae9700 1 -- 172.21.15.31:0/2284538545 >> v2:172.21.15.158:3300/0 conn(0x7f31b00678b0 msgr2=0x7f31b015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:58.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b6ae9700 1 --2- 172.21.15.31:0/2284538545 >> v2:172.21.15.158:3300/0 conn(0x7f31b00678b0 0x7f31b015db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b6ae9700 1 -- 172.21.15.31:0/2284538545 >> v1:172.21.15.31:6789/0 conn(0x7f31b00cbf10 legacy=0x7f31b015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b6ae9700 1 -- 172.21.15.31:0/2284538545 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b00cb710 con 0x7f31b00c9390 2023-10-09T06:21:58.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b52e6700 1 -- 172.21.15.31:0/2284538545 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665541285 0 0) 0x7f31b00cae70 con 0x7f31b00cbf10 2023-10-09T06:21:58.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b6ae9700 1 --2- 172.21.15.31:0/2284538545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31b00c9390 0x7f31b015a370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f31b00c5b10 tx=0x7f31a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8687d95e6782865b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:58.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b52e6700 1 -- 172.21.15.31:0/2284538545 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000e070 con 0x7f31b00c9390 2023-10-09T06:21:58.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b52e6700 1 -- 172.21.15.31:0/2284538545 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a000bc30 con 0x7f31b00c9390 2023-10-09T06:21:58.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.960+0000 7f31b52e6700 1 -- 172.21.15.31:0/2284538545 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0012430 con 0x7f31b00c9390 2023-10-09T06:21:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.961+0000 7f31b854c700 1 -- 172.21.15.31:0/2284538545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31b00c9390 msgr2=0x7f31b015a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.961+0000 7f31b854c700 1 --2- 172.21.15.31:0/2284538545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31b00c9390 0x7f31b015a370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f31b00c5b10 tx=0x7f31a0009780 comp rx=0 tx=0).stop 2023-10-09T06:21:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.961+0000 7f31b854c700 1 -- 172.21.15.31:0/2284538545 shutdown_connections 2023-10-09T06:21:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.961+0000 7f31b854c700 1 --2- 172.21.15.31:0/2284538545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31b00c9390 0x7f31b015a370 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.961+0000 7f31b854c700 1 --2- 172.21.15.31:0/2284538545 >> v2:172.21.15.158:3300/0 conn(0x7f31b00678b0 0x7f31b015db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.961+0000 7f31b854c700 1 -- 172.21.15.31:0/2284538545 >> 172.21.15.31:0/2284538545 conn(0x7f31b0069870 msgr2=0x7f31b0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:58.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.961+0000 7f31b854c700 1 -- 172.21.15.31:0/2284538545 shutdown_connections 2023-10-09T06:21:58.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.961+0000 7f31b854c700 1 -- 172.21.15.31:0/2284538545 wait complete. 2023-10-09T06:21:58.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.962+0000 7f31b854c700 1 Processor -- start 2023-10-09T06:21:58.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.962+0000 7f31b854c700 1 -- start start 2023-10-09T06:21:58.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b854c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31b00678b0 0x7f31b0153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b854c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31b00c9390 0x7f31b0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b854c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31b00cbf10 0x7f31b00cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b854c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b01561c0 con 0x7f31b00cbf10 2023-10-09T06:21:58.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b854c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b0154440 con 0x7f31b00c9390 2023-10-09T06:21:58.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b854c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b0155540 con 0x7f31b00678b0 2023-10-09T06:21:58.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b6ae9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31b00cbf10 0x7f31b00cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b6ae9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31b00cbf10 0x7f31b00cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37634/0 (socket says 172.21.15.31:37634) 2023-10-09T06:21:58.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b6ae9700 1 -- 172.21.15.31:0/3853568893 learned_addr learned my addr 172.21.15.31:0/3853568893 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:58.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b5ae7700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31b00c9390 0x7f31b0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b62e8700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31b00678b0 0x7f31b0153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b6ae9700 1 -- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31b00678b0 msgr2=0x7f31b0153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b6ae9700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31b00678b0 0x7f31b0153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b6ae9700 1 -- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31b00c9390 msgr2=0x7f31b0156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:58.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b6ae9700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31b00c9390 0x7f31b0156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:58.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.963+0000 7f31b6ae9700 1 -- 172.21.15.31:0/3853568893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a0009a20 con 0x7f31b00cbf10 2023-10-09T06:21:58.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.964+0000 7f31b6ae9700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31b00cbf10 0x7f31b00cc730 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f31a00097c0 tx=0x7f31a0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:58.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.964+0000 7f31ae7fc700 1 -- 172.21.15.31:0/3853568893 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0027470 con 0x7f31b00cbf10 2023-10-09T06:21:58.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.964+0000 7f31ae7fc700 1 -- 172.21.15.31:0/3853568893 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a00275f0 con 0x7f31b00cbf10 2023-10-09T06:21:58.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.964+0000 7f31b854c700 1 -- 172.21.15.31:0/3853568893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b0155820 con 0x7f31b00cbf10 2023-10-09T06:21:58.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.964+0000 7f31ae7fc700 1 -- 172.21.15.31:0/3853568893 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00279b0 con 0x7f31b00cbf10 2023-10-09T06:21:58.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.964+0000 7f31b854c700 1 -- 172.21.15.31:0/3853568893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b0155de0 con 0x7f31b00cbf10 2023-10-09T06:21:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.965+0000 7f31b854c700 1 -- 172.21.15.31:0/3853568893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b004c3c0 con 0x7f31b00cbf10 2023-10-09T06:21:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.965+0000 7f31ae7fc700 1 -- 172.21.15.31:0/3853568893 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31a0024070 con 0x7f31b00cbf10 2023-10-09T06:21:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.966+0000 7f31ae7fc700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f319c066f30 0x7f319c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.966+0000 7f31ae7fc700 1 -- 172.21.15.31:0/3853568893 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31a0086d90 con 0x7f31b00cbf10 2023-10-09T06:21:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.966+0000 7f31b62e8700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f319c066f30 0x7f319c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.966+0000 7f31b62e8700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f319c066f30 0x7f319c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f31a8006fd0 tx=0x7f31a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:58.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:58.970+0000 7f31ae7fc700 1 -- 172.21.15.31:0/3853568893 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31a0053f60 con 0x7f31b00cbf10 2023-10-09T06:21:59.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.163+0000 7f31b854c700 1 -- 172.21.15.31:0/3853568893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31b0068da0 con 0x7f31b00cbf10 2023-10-09T06:21:59.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.164+0000 7f31ae7fc700 1 -- 172.21.15.31:0/3853568893 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31a0057580 con 0x7f31b00cbf10 2023-10-09T06:21:59.165 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:21:59.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.165+0000 7f31b854c700 1 -- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f319c066f30 msgr2=0x7f319c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.165+0000 7f31b854c700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f319c066f30 0x7f319c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f31a8006fd0 tx=0x7f31a8008040 comp rx=0 tx=0).stop 2023-10-09T06:21:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.165+0000 7f31b854c700 1 -- 172.21.15.31:0/3853568893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31b00cbf10 msgr2=0x7f31b00cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.165+0000 7f31b854c700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31b00cbf10 0x7f31b00cc730 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f31a00097c0 tx=0x7f31a0019000 comp rx=0 tx=0).stop 2023-10-09T06:21:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.166+0000 7f31b854c700 1 -- 172.21.15.31:0/3853568893 shutdown_connections 2023-10-09T06:21:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.166+0000 7f31b854c700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f319c066f30 0x7f319c0693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.166+0000 7f31b854c700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31b00678b0 0x7f31b0153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.166+0000 7f31b854c700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31b00cbf10 0x7f31b00cc730 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.166+0000 7f31b854c700 1 --2- 172.21.15.31:0/3853568893 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31b00c9390 0x7f31b0156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.166+0000 7f31b854c700 1 -- 172.21.15.31:0/3853568893 >> 172.21.15.31:0/3853568893 conn(0x7f31b0069870 msgr2=0x7f31b01584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.166+0000 7f31b854c700 1 -- 172.21.15.31:0/3853568893 shutdown_connections 2023-10-09T06:21:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.166+0000 7f31b854c700 1 -- 172.21.15.31:0/3853568893 wait complete. 2023-10-09T06:21:59.178 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:21:59.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.299+0000 7f2ce94c2700 1 Processor -- start 2023-10-09T06:21:59.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.299+0000 7f2ce94c2700 1 -- start start 2023-10-09T06:21:59.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.300+0000 7f2ce94c2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2ce40cce30 0x7f2ce415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.300+0000 7f2ce94c2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2ce40b6580 0x7f2ce406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.300+0000 7f2ce94c2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce406ac90 con 0x7f2ce406a830 2023-10-09T06:21:59.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.300+0000 7f2ce94c2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce40b4d70 con 0x7f2ce40b6580 2023-10-09T06:21:59.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.300+0000 7f2ce94c2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce40cd8d0 con 0x7f2ce40cce30 2023-10-09T06:21:59.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.300+0000 7f2ce37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2ce40b6580 0x7f2ce406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.300+0000 7f2ce8cc1700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2ce406a830 0x7f2ce415d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47194/0 (socket says 172.21.15.31:47194) 2023-10-09T06:21:59.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.300+0000 7f2ce8cc1700 1 -- 172.21.15.31:0/196110999 learned_addr learned my addr 172.21.15.31:0/196110999 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:59.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.300+0000 7f2ce37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2ce40b6580 0x7f2ce406a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37650/0 (socket says 172.21.15.31:37650) 2023-10-09T06:21:59.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.300+0000 7f2ce3fff700 1 --2- 172.21.15.31:0/196110999 >> v2:172.21.15.158:3300/0 conn(0x7f2ce40cce30 0x7f2ce415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce37fe700 1 -- 172.21.15.31:0/196110999 >> v2:172.21.15.158:3300/0 conn(0x7f2ce40cce30 msgr2=0x7f2ce415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:59.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce37fe700 1 --2- 172.21.15.31:0/196110999 >> v2:172.21.15.158:3300/0 conn(0x7f2ce40cce30 0x7f2ce415aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce37fe700 1 -- 172.21.15.31:0/196110999 >> v1:172.21.15.31:6789/0 conn(0x7f2ce406a830 legacy=0x7f2ce415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce37fe700 1 -- 172.21.15.31:0/196110999 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce40b4440 con 0x7f2ce40b6580 2023-10-09T06:21:59.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce2ffd700 1 -- 172.21.15.31:0/196110999 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133299186 0 0) 0x7f2cdc001490 con 0x7f2ce406a830 2023-10-09T06:21:59.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce37fe700 1 --2- 172.21.15.31:0/196110999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce40b6580 0x7f2ce406a2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40b3770 tx=0x7f2cd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711ab6d65d4a59c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:59.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce2ffd700 1 -- 172.21.15.31:0/196110999 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4011630 con 0x7f2ce40b6580 2023-10-09T06:21:59.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce2ffd700 1 -- 172.21.15.31:0/196110999 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd4011790 con 0x7f2ce40b6580 2023-10-09T06:21:59.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce2ffd700 1 -- 172.21.15.31:0/196110999 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4011b30 con 0x7f2ce40b6580 2023-10-09T06:21:59.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce94c2700 1 -- 172.21.15.31:0/196110999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce40b6580 msgr2=0x7f2ce406a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce94c2700 1 --2- 172.21.15.31:0/196110999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce40b6580 0x7f2ce406a2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40b3770 tx=0x7f2cd40091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce94c2700 1 -- 172.21.15.31:0/196110999 shutdown_connections 2023-10-09T06:21:59.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce94c2700 1 --2- 172.21.15.31:0/196110999 >> v2:172.21.15.158:3300/0 conn(0x7f2ce40cce30 0x7f2ce415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce94c2700 1 --2- 172.21.15.31:0/196110999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce40b6580 0x7f2ce406a2f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce94c2700 1 -- 172.21.15.31:0/196110999 >> 172.21.15.31:0/196110999 conn(0x7f2ce4068cb0 msgr2=0x7f2ce40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:59.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce94c2700 1 -- 172.21.15.31:0/196110999 shutdown_connections 2023-10-09T06:21:59.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.301+0000 7f2ce94c2700 1 -- 172.21.15.31:0/196110999 wait complete. 2023-10-09T06:21:59.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.302+0000 7f2ce94c2700 1 Processor -- start 2023-10-09T06:21:59.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.303+0000 7f2ce94c2700 1 -- start start 2023-10-09T06:21:59.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.303+0000 7f2ce94c2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce406a830 0x7f2ce4158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.303+0000 7f2ce94c2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ce40b6580 0x7f2ce4154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.303+0000 7f2ce94c2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ce40cce30 0x7f2ce415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.303+0000 7f2ce94c2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce416a5e0 con 0x7f2ce406a830 2023-10-09T06:21:59.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.303+0000 7f2ce94c2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce416a8c0 con 0x7f2ce40cce30 2023-10-09T06:21:59.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.303+0000 7f2ce94c2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce416aba0 con 0x7f2ce40b6580 2023-10-09T06:21:59.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.303+0000 7f2ce3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce406a830 0x7f2ce4158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ce3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce406a830 0x7f2ce4158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37660/0 (socket says 172.21.15.31:37660) 2023-10-09T06:21:59.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ce3fff700 1 -- 172.21.15.31:0/2258622172 learned_addr learned my addr 172.21.15.31:0/2258622172 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:59.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ce8cc1700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ce40cce30 0x7f2ce415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ce37fe700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ce40b6580 0x7f2ce4154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ce3fff700 1 -- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ce40b6580 msgr2=0x7f2ce4154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ce3fff700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ce40b6580 0x7f2ce4154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ce3fff700 1 -- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ce40cce30 msgr2=0x7f2ce415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ce3fff700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ce40cce30 0x7f2ce415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ce3fff700 1 -- 172.21.15.31:0/2258622172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd4009420 con 0x7f2ce406a830 2023-10-09T06:21:59.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ce8cc1700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ce40cce30 0x7f2ce415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:21:59.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ce3fff700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce406a830 0x7f2ce4158f80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800e930 tx=0x7f2cd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:59.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ccbfff700 1 -- 172.21.15.31:0/2258622172 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd800eed0 con 0x7f2ce406a830 2023-10-09T06:21:59.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ccbfff700 1 -- 172.21.15.31:0/2258622172 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd800c850 con 0x7f2ce406a830 2023-10-09T06:21:59.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ce94c2700 1 -- 172.21.15.31:0/2258622172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce416ae80 con 0x7f2ce406a830 2023-10-09T06:21:59.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ccbfff700 1 -- 172.21.15.31:0/2258622172 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd800cbf0 con 0x7f2ce406a830 2023-10-09T06:21:59.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.304+0000 7f2ce94c2700 1 -- 172.21.15.31:0/2258622172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce414eca0 con 0x7f2ce406a830 2023-10-09T06:21:59.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.305+0000 7f2ce94c2700 1 -- 172.21.15.31:0/2258622172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce416b320 con 0x7f2ce406a830 2023-10-09T06:21:59.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.306+0000 7f2ccbfff700 1 -- 172.21.15.31:0/2258622172 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2cd8013470 con 0x7f2ce406a830 2023-10-09T06:21:59.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.306+0000 7f2ccbfff700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2cd0066f30 0x7f2cd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.306+0000 7f2ccbfff700 1 -- 172.21.15.31:0/2258622172 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2cd8084760 con 0x7f2ce406a830 2023-10-09T06:21:59.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.306+0000 7f2ce37fe700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2cd0066f30 0x7f2cd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.307+0000 7f2ce37fe700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2cd0066f30 0x7f2cd00693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2ce415fa10 tx=0x7f2cd4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:59.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.310+0000 7f2ccbfff700 1 -- 172.21.15.31:0/2258622172 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cd80519d0 con 0x7f2ce406a830 2023-10-09T06:21:59.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.501+0000 7f2ce94c2700 1 -- 172.21.15.31:0/2258622172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ce40b4720 con 0x7f2ce406a830 2023-10-09T06:21:59.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.502+0000 7f2ccbfff700 1 -- 172.21.15.31:0/2258622172 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2cd8054ff0 con 0x7f2ce406a830 2023-10-09T06:21:59.502 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:21:59.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.503+0000 7f2ce94c2700 1 -- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2cd0066f30 msgr2=0x7f2cd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.503+0000 7f2ce94c2700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2cd0066f30 0x7f2cd00693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2ce415fa10 tx=0x7f2cd4017000 comp rx=0 tx=0).stop 2023-10-09T06:21:59.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.503+0000 7f2ce94c2700 1 -- 172.21.15.31:0/2258622172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce406a830 msgr2=0x7f2ce4158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.503+0000 7f2ce94c2700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce406a830 0x7f2ce4158f80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800e930 tx=0x7f2cd80091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.503+0000 7f2ce94c2700 1 -- 172.21.15.31:0/2258622172 shutdown_connections 2023-10-09T06:21:59.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.503+0000 7f2ce94c2700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2cd0066f30 0x7f2cd00693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.503+0000 7f2ce94c2700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ce40cce30 0x7f2ce415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.503+0000 7f2ce94c2700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce406a830 0x7f2ce4158f80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.503+0000 7f2ce94c2700 1 --2- 172.21.15.31:0/2258622172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ce40b6580 0x7f2ce4154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.503+0000 7f2ce94c2700 1 -- 172.21.15.31:0/2258622172 >> 172.21.15.31:0/2258622172 conn(0x7f2ce4068cb0 msgr2=0x7f2ce41507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:59.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.503+0000 7f2ce94c2700 1 -- 172.21.15.31:0/2258622172 shutdown_connections 2023-10-09T06:21:59.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.503+0000 7f2ce94c2700 1 -- 172.21.15.31:0/2258622172 wait complete. 2023-10-09T06:21:59.516 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:21:59.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.637+0000 7fd63acb3700 1 Processor -- start 2023-10-09T06:21:59.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.637+0000 7fd63acb3700 1 -- start start 2023-10-09T06:21:59.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.638+0000 7fd63acb3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd634152300 0x7fd63415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.638+0000 7fd63acb3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63415c8d0 con 0x7fd634158df0 2023-10-09T06:21:59.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.638+0000 7fd63acb3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6340c9370 con 0x7fd63406d370 2023-10-09T06:21:59.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.638+0000 7fd63acb3700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6340b1400 con 0x7fd634152300 2023-10-09T06:21:59.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.638+0000 7fd633fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd634158df0 0x7fd6340caaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54738/0 (socket says 172.21.15.31:54738) 2023-10-09T06:21:59.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.638+0000 7fd633fff700 1 -- 172.21.15.31:0/3233871617 learned_addr learned my addr 172.21.15.31:0/3233871617 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:21:59.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd638a4f700 1 --2- 172.21.15.31:0/3233871617 >> v2:172.21.15.158:3300/0 conn(0x7fd634152300 0x7fd63415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257779527 0 0) 0x7fd63415c8d0 con 0x7fd634158df0 2023-10-09T06:21:59.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd620003570 con 0x7fd634158df0 2023-10-09T06:21:59.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 211233696 0 0) 0x7fd620003570 con 0x7fd634158df0 2023-10-09T06:21:59.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 >> v2:172.21.15.158:3300/0 conn(0x7fd634152300 msgr2=0x7fd63415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:59.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 --2- 172.21.15.31:0/3233871617 >> v2:172.21.15.158:3300/0 conn(0x7fd634152300 0x7fd63415b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 >> v1:172.21.15.158:6789/0 conn(0x7fd63406d370 legacy=0x7fd63406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63415c030 con 0x7fd634158df0 2023-10-09T06:21:59.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fd6240017f0 con 0x7fd634158df0 2023-10-09T06:21:59.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 >> v1:172.21.15.31:6789/0 conn(0x7fd634158df0 legacy=0x7fd6340caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 --2- 172.21.15.31:0/3233871617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd620003a60 0x7fd620003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 --2- 172.21.15.31:0/3233871617 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd620004810 0x7fd620004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 --2- 172.21.15.31:0/3233871617 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6200051c0 0x7fd62000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62000c050 con 0x7fd620003a60 2023-10-09T06:21:59.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62000c190 con 0x7fd6200051c0 2023-10-09T06:21:59.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62000c350 con 0x7fd620004810 2023-10-09T06:21:59.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd638a4f700 1 --2- 172.21.15.31:0/3233871617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd620003a60 0x7fd620003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd639250700 1 --2- 172.21.15.31:0/3233871617 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6200051c0 0x7fd62000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd633fff700 1 --2- 172.21.15.31:0/3233871617 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd620004810 0x7fd620004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.639+0000 7fd638a4f700 1 -- 172.21.15.31:0/3233871617 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd620004810 msgr2=0x7fd620004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:59.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd638a4f700 1 --2- 172.21.15.31:0/3233871617 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd620004810 0x7fd620004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd638a4f700 1 -- 172.21.15.31:0/3233871617 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6200051c0 msgr2=0x7fd62000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:59.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd638a4f700 1 --2- 172.21.15.31:0/3233871617 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd6200051c0 0x7fd62000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd639250700 1 -- 172.21.15.31:0/3233871617 reap_dead start 2023-10-09T06:21:59.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd638a4f700 1 -- 172.21.15.31:0/3233871617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd620003570 con 0x7fd620003a60 2023-10-09T06:21:59.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd633fff700 1 --2- 172.21.15.31:0/3233871617 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd620004810 0x7fd620004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:59.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd638a4f700 1 --2- 172.21.15.31:0/3233871617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd620003a60 0x7fd620003e30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009c00 tx=0x7fd62c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571352d08ef801af server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:59.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00e710 con 0x7fd620003a60 2023-10-09T06:21:59.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c00e870 con 0x7fd620003a60 2023-10-09T06:21:59.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd6337fe700 1 -- 172.21.15.31:0/3233871617 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00ec30 con 0x7fd620003a60 2023-10-09T06:21:59.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd63acb3700 1 -- 172.21.15.31:0/3233871617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd620003a60 msgr2=0x7fd620003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd63acb3700 1 --2- 172.21.15.31:0/3233871617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd620003a60 0x7fd620003e30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009c00 tx=0x7fd62c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd63acb3700 1 -- 172.21.15.31:0/3233871617 shutdown_connections 2023-10-09T06:21:59.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd63acb3700 1 --2- 172.21.15.31:0/3233871617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd620003a60 0x7fd620003e30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd63acb3700 1 -- 172.21.15.31:0/3233871617 >> 172.21.15.31:0/3233871617 conn(0x7fd634069870 msgr2=0x7fd634069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:59.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd63acb3700 1 -- 172.21.15.31:0/3233871617 shutdown_connections 2023-10-09T06:21:59.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.640+0000 7fd63acb3700 1 -- 172.21.15.31:0/3233871617 wait complete. 2023-10-09T06:21:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.641+0000 7fd63acb3700 1 Processor -- start 2023-10-09T06:21:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.642+0000 7fd63acb3700 1 -- start start 2023-10-09T06:21:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.642+0000 7fd63acb3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd620003a60 0x7fd63413e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.642+0000 7fd63acb3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6341526d0 0x7fd634152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.642+0000 7fd63acb3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6340c7640 0x7fd6340c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.642+0000 7fd63acb3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd634150450 con 0x7fd6341526d0 2023-10-09T06:21:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.642+0000 7fd63acb3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63413e810 con 0x7fd620003a60 2023-10-09T06:21:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.642+0000 7fd63acb3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd634153080 con 0x7fd6340c7640 2023-10-09T06:21:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.642+0000 7fd633fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6341526d0 0x7fd634152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd633fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6341526d0 0x7fd634152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46490/0 (socket says 172.21.15.31:46490) 2023-10-09T06:21:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd633fff700 1 -- 172.21.15.31:0/3268864362 learned_addr learned my addr 172.21.15.31:0/3268864362 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd638a4f700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd620003a60 0x7fd63413e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd639250700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6340c7640 0x7fd6340c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd633fff700 1 -- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6340c7640 msgr2=0x7fd6340c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd633fff700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6340c7640 0x7fd6340c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd633fff700 1 -- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd620003a60 msgr2=0x7fd63413e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd633fff700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd620003a60 0x7fd63413e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd633fff700 1 -- 172.21.15.31:0/3268864362 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd634169670 con 0x7fd6341526d0 2023-10-09T06:21:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd633fff700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6341526d0 0x7fd634152b40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd624001f20 tx=0x7fd624002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd630ff9700 1 -- 172.21.15.31:0/3268864362 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400ebf0 con 0x7fd6341526d0 2023-10-09T06:21:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd630ff9700 1 -- 172.21.15.31:0/3268864362 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62400ed50 con 0x7fd6341526d0 2023-10-09T06:21:59.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd63acb3700 1 -- 172.21.15.31:0/3268864362 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6340c8000 con 0x7fd6341526d0 2023-10-09T06:21:59.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd630ff9700 1 -- 172.21.15.31:0/3268864362 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624013650 con 0x7fd6341526d0 2023-10-09T06:21:59.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.643+0000 7fd63acb3700 1 -- 172.21.15.31:0/3268864362 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6340c8270 con 0x7fd6341526d0 2023-10-09T06:21:59.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.644+0000 7fd63acb3700 1 -- 172.21.15.31:0/3268864362 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd634169800 con 0x7fd6341526d0 2023-10-09T06:21:59.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.645+0000 7fd630ff9700 1 -- 172.21.15.31:0/3268864362 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6240139c0 con 0x7fd6341526d0 2023-10-09T06:21:59.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.645+0000 7fd630ff9700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd614066f30 0x7fd6140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.645+0000 7fd630ff9700 1 -- 172.21.15.31:0/3268864362 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd624084a30 con 0x7fd6341526d0 2023-10-09T06:21:59.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.645+0000 7fd638a4f700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd614066f30 0x7fd6140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.646+0000 7fd638a4f700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd614066f30 0x7fd6140693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0091e0 tx=0x7fd62c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:59.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.649+0000 7fd630ff9700 1 -- 172.21.15.31:0/3268864362 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd624051d60 con 0x7fd6341526d0 2023-10-09T06:21:59.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.841+0000 7fd63acb3700 1 -- 172.21.15.31:0/3268864362 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd63404c3c0 con 0x7fd6341526d0 2023-10-09T06:21:59.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.842+0000 7fd630ff9700 1 -- 172.21.15.31:0/3268864362 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd624055380 con 0x7fd6341526d0 2023-10-09T06:21:59.842 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:21:59.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.844+0000 7fd63acb3700 1 -- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd614066f30 msgr2=0x7fd6140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.844+0000 7fd63acb3700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd614066f30 0x7fd6140693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0091e0 tx=0x7fd62c01a000 comp rx=0 tx=0).stop 2023-10-09T06:21:59.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.844+0000 7fd63acb3700 1 -- 172.21.15.31:0/3268864362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6341526d0 msgr2=0x7fd634152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.844+0000 7fd63acb3700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6341526d0 0x7fd634152b40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd624001f20 tx=0x7fd624002140 comp rx=0 tx=0).stop 2023-10-09T06:21:59.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.844+0000 7fd63acb3700 1 -- 172.21.15.31:0/3268864362 shutdown_connections 2023-10-09T06:21:59.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.844+0000 7fd63acb3700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd614066f30 0x7fd6140693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.844+0000 7fd63acb3700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd6340c7640 0x7fd6340c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.844+0000 7fd63acb3700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd620003a60 0x7fd63413e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.844+0000 7fd63acb3700 1 --2- 172.21.15.31:0/3268864362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6341526d0 0x7fd634152b40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.844+0000 7fd63acb3700 1 -- 172.21.15.31:0/3268864362 >> 172.21.15.31:0/3268864362 conn(0x7fd634069870 msgr2=0x7fd63415a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:59.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.844+0000 7fd63acb3700 1 -- 172.21.15.31:0/3268864362 shutdown_connections 2023-10-09T06:21:59.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.844+0000 7fd63acb3700 1 -- 172.21.15.31:0/3268864362 wait complete. 2023-10-09T06:21:59.857 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:21:59.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.977+0000 7f956e038700 1 Processor -- start 2023-10-09T06:21:59.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.977+0000 7f956e038700 1 -- start start 2023-10-09T06:21:59.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.978+0000 7f956e038700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9568068710 0x7f956806aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.978+0000 7f956e038700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f956806f660 0x7f9568068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.978+0000 7f956e038700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9568069020 con 0x7f95680c9510 2023-10-09T06:21:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.978+0000 7f956e038700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956806a050 con 0x7f9568068710 2023-10-09T06:21:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.978+0000 7f956e038700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95680acdc0 con 0x7f956806f660 2023-10-09T06:21:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.978+0000 7f956d036700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9568068710 0x7f956806aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.978+0000 7f956d036700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9568068710 0x7f956806aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46506/0 (socket says 172.21.15.31:46506) 2023-10-09T06:21:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.978+0000 7f956d036700 1 -- 172.21.15.31:0/542783150 learned_addr learned my addr 172.21.15.31:0/542783150 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.978+0000 7f956c835700 1 --2- 172.21.15.31:0/542783150 >> v2:172.21.15.158:3300/0 conn(0x7f956806f660 0x7f9568068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f956d036700 1 -- 172.21.15.31:0/542783150 >> v2:172.21.15.158:3300/0 conn(0x7f956806f660 msgr2=0x7f9568068ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:21:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f956d036700 1 --2- 172.21.15.31:0/542783150 >> v2:172.21.15.158:3300/0 conn(0x7f956806f660 0x7f9568068ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f956d036700 1 -- 172.21.15.31:0/542783150 >> v1:172.21.15.158:6789/0 conn(0x7f95680c9510 legacy=0x7f9568070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f956d036700 1 -- 172.21.15.31:0/542783150 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680c9e00 con 0x7f9568068710 2023-10-09T06:21:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f956d036700 1 --2- 172.21.15.31:0/542783150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9568068710 0x7f956806aaf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f956806e240 tx=0x7f9560009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177906ca3775efc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f9567fff700 1 -- 172.21.15.31:0/542783150 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956000b860 con 0x7f9568068710 2023-10-09T06:21:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f9567fff700 1 -- 172.21.15.31:0/542783150 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956000b9c0 con 0x7f9568068710 2023-10-09T06:21:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f9567fff700 1 -- 172.21.15.31:0/542783150 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956000bd60 con 0x7f9568068710 2023-10-09T06:21:59.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f956e038700 1 -- 172.21.15.31:0/542783150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9568068710 msgr2=0x7f956806aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f956e038700 1 --2- 172.21.15.31:0/542783150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9568068710 0x7f956806aaf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f956806e240 tx=0x7f9560009250 comp rx=0 tx=0).stop 2023-10-09T06:21:59.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f956e038700 1 -- 172.21.15.31:0/542783150 shutdown_connections 2023-10-09T06:21:59.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f956e038700 1 --2- 172.21.15.31:0/542783150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9568068710 0x7f956806aaf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f956e038700 1 --2- 172.21.15.31:0/542783150 >> v2:172.21.15.158:3300/0 conn(0x7f956806f660 0x7f9568068ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.979+0000 7f956e038700 1 -- 172.21.15.31:0/542783150 >> 172.21.15.31:0/542783150 conn(0x7f95680cd8f0 msgr2=0x7f95680cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:21:59.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.980+0000 7f956e038700 1 -- 172.21.15.31:0/542783150 shutdown_connections 2023-10-09T06:21:59.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.980+0000 7f956e038700 1 -- 172.21.15.31:0/542783150 wait complete. 2023-10-09T06:21:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.981+0000 7f956e038700 1 Processor -- start 2023-10-09T06:21:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.981+0000 7f956e038700 1 -- start start 2023-10-09T06:21:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956e038700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9568068710 0x7f95680b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956e038700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f956806f660 0x7f9568169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956e038700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95680c9510 0x7f95680c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956e038700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9568158f10 con 0x7f9568068710 2023-10-09T06:21:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956e038700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9568158300 con 0x7f95680c9510 2023-10-09T06:21:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956e038700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95681585e0 con 0x7f956806f660 2023-10-09T06:21:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956d036700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9568068710 0x7f95680b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956d036700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9568068710 0x7f95680b1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46512/0 (socket says 172.21.15.31:46512) 2023-10-09T06:21:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956d036700 1 -- 172.21.15.31:0/1296447082 learned_addr learned my addr 172.21.15.31:0/1296447082 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:21:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956c835700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f956806f660 0x7f9568169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956d837700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95680c9510 0x7f95680c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956d036700 1 -- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f956806f660 msgr2=0x7f9568169a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956d036700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f956806f660 0x7f9568169a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956d036700 1 -- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95680c9510 msgr2=0x7f95680c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:21:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956d036700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95680c9510 0x7f95680c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:21:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956d036700 1 -- 172.21.15.31:0/1296447082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95600094f0 con 0x7f9568068710 2023-10-09T06:21:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956c835700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f956806f660 0x7f9568169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956d837700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95680c9510 0x7f95680c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:21:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956d036700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9568068710 0x7f95680b1160 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f956806b2c0 tx=0x7f9560017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f95657fa700 1 -- 172.21.15.31:0/1296447082 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560011e60 con 0x7f9568068710 2023-10-09T06:21:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f95657fa700 1 -- 172.21.15.31:0/1296447082 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956001a630 con 0x7f9568068710 2023-10-09T06:21:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f95657fa700 1 -- 172.21.15.31:0/1296447082 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956001a9f0 con 0x7f9568068710 2023-10-09T06:21:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956e038700 1 -- 172.21.15.31:0/1296447082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95681588c0 con 0x7f9568068710 2023-10-09T06:21:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.982+0000 7f956e038700 1 -- 172.21.15.31:0/1296447082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956815a8b0 con 0x7f9568068710 2023-10-09T06:21:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.983+0000 7f956e038700 1 -- 172.21.15.31:0/1296447082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956806d640 con 0x7f9568068710 2023-10-09T06:21:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.984+0000 7f95657fa700 1 -- 172.21.15.31:0/1296447082 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f956002d440 con 0x7f9568068710 2023-10-09T06:21:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.984+0000 7f95657fa700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9554066f30 0x7f95540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:21:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.984+0000 7f95657fa700 1 -- 172.21.15.31:0/1296447082 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95600861b0 con 0x7f9568068710 2023-10-09T06:21:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.985+0000 7f956c835700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9554066f30 0x7f95540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:21:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.985+0000 7f956c835700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9554066f30 0x7f95540693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9568161210 tx=0x7f955c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:21:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:21:59.988+0000 7f95657fa700 1 -- 172.21.15.31:0/1296447082 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9560053420 con 0x7f9568068710 2023-10-09T06:22:00.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.225+0000 7f956e038700 1 -- 172.21.15.31:0/1296447082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f956806a2f0 con 0x7f9568068710 2023-10-09T06:22:00.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.226+0000 7f95657fa700 1 -- 172.21.15.31:0/1296447082 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f9560056a40 con 0x7f9568068710 2023-10-09T06:22:00.227 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:00.227 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1792934235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1792934235},{"type":"v1","addr":"172.21.15.158:6837","nonce":1792934235}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/893363730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":893363730},{"type":"v1","addr":"172.21.15.31:6834","nonce":893363730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4923,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2780075004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2780075004},{"type":"v1","addr":"172.21.15.31:6835","nonce":2780075004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:21:44.276772+0000","modified":"2023-10-09T06:21:47.908951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6836/1041874650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1041874650},{"type":"v1","addr":"172.21.15.158:6836","nonce":1041874650}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:22:00.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.228+0000 7f956e038700 1 -- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9554066f30 msgr2=0x7f95540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.228+0000 7f956e038700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9554066f30 0x7f95540693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9568161210 tx=0x7f955c008040 comp rx=0 tx=0).stop 2023-10-09T06:22:00.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.228+0000 7f956e038700 1 -- 172.21.15.31:0/1296447082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9568068710 msgr2=0x7f95680b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.228+0000 7f956e038700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9568068710 0x7f95680b1160 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f956806b2c0 tx=0x7f9560017000 comp rx=0 tx=0).stop 2023-10-09T06:22:00.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.228+0000 7f956e038700 1 -- 172.21.15.31:0/1296447082 shutdown_connections 2023-10-09T06:22:00.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.228+0000 7f956e038700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9554066f30 0x7f95540693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.228+0000 7f956e038700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95680c9510 0x7f95680c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.228+0000 7f956e038700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9568068710 0x7f95680b1160 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.228+0000 7f956e038700 1 --2- 172.21.15.31:0/1296447082 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f956806f660 0x7f9568169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.228+0000 7f956e038700 1 -- 172.21.15.31:0/1296447082 >> 172.21.15.31:0/1296447082 conn(0x7f95680cd8f0 msgr2=0x7f95680ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:00.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.228+0000 7f956e038700 1 -- 172.21.15.31:0/1296447082 shutdown_connections 2023-10-09T06:22:00.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.228+0000 7f956e038700 1 -- 172.21.15.31:0/1296447082 wait complete. 2023-10-09T06:22:00.233 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 16 2023-10-09T06:22:00.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:22:00.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.358+0000 7fdcee263700 1 Processor -- start 2023-10-09T06:22:00.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.359+0000 7fdcee263700 1 -- start start 2023-10-09T06:22:00.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.359+0000 7fdcee263700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdce8157870 0x7fdce815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:00.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.359+0000 7fdcee263700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdce8157c40 0x7fdce8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:00.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.359+0000 7fdcee263700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce815cbb0 con 0x7fdce815a620 2023-10-09T06:22:00.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.359+0000 7fdcee263700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce815bfa0 con 0x7fdce8157c40 2023-10-09T06:22:00.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.359+0000 7fdcee263700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce815c280 con 0x7fdce8157870 2023-10-09T06:22:00.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdce77fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdce815a620 0x7fdce815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54740/0 (socket says 172.21.15.31:54740) 2023-10-09T06:22:00.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdce77fe700 1 -- 172.21.15.31:0/470743454 learned_addr learned my addr 172.21.15.31:0/470743454 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:00.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdce7fff700 1 --2- 172.21.15.31:0/470743454 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdce8157870 0x7fdce815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:00.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdcec800700 1 --2- 172.21.15.31:0/470743454 >> v2:172.21.15.158:3300/0 conn(0x7fdce8157c40 0x7fdce8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:00.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdce6ffd700 1 -- 172.21.15.31:0/470743454 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477510965 0 0) 0x7fdce815cbb0 con 0x7fdce815a620 2023-10-09T06:22:00.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdce6ffd700 1 -- 172.21.15.31:0/470743454 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcd0003570 con 0x7fdce815a620 2023-10-09T06:22:00.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdce7fff700 1 -- 172.21.15.31:0/470743454 >> v2:172.21.15.158:3300/0 conn(0x7fdce8157c40 msgr2=0x7fdce8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:00.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdce7fff700 1 --2- 172.21.15.31:0/470743454 >> v2:172.21.15.158:3300/0 conn(0x7fdce8157c40 0x7fdce8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdce7fff700 1 -- 172.21.15.31:0/470743454 >> v1:172.21.15.31:6789/0 conn(0x7fdce815a620 legacy=0x7fdce815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdce7fff700 1 -- 172.21.15.31:0/470743454 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce815c560 con 0x7fdce8157870 2023-10-09T06:22:00.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdce7fff700 1 --2- 172.21.15.31:0/470743454 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdce8157870 0x7fdce815b6a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80098e0 tx=0x7fdcd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cb612c7b83f8dfb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:00.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdce6ffd700 1 -- 172.21.15.31:0/470743454 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8011630 con 0x7fdce8157870 2023-10-09T06:22:00.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdce6ffd700 1 -- 172.21.15.31:0/470743454 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8011790 con 0x7fdce8157870 2023-10-09T06:22:00.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.360+0000 7fdce6ffd700 1 -- 172.21.15.31:0/470743454 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8011b30 con 0x7fdce8157870 2023-10-09T06:22:00.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.361+0000 7fdcee263700 1 -- 172.21.15.31:0/470743454 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdce8157870 msgr2=0x7fdce815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.361+0000 7fdcee263700 1 --2- 172.21.15.31:0/470743454 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdce8157870 0x7fdce815b6a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80098e0 tx=0x7fdcd80091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.361+0000 7fdcee263700 1 -- 172.21.15.31:0/470743454 shutdown_connections 2023-10-09T06:22:00.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.361+0000 7fdcee263700 1 --2- 172.21.15.31:0/470743454 >> v2:172.21.15.158:3300/0 conn(0x7fdce8157c40 0x7fdce8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.361+0000 7fdcee263700 1 --2- 172.21.15.31:0/470743454 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdce8157870 0x7fdce815b6a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.361+0000 7fdcee263700 1 -- 172.21.15.31:0/470743454 >> 172.21.15.31:0/470743454 conn(0x7fdce8068ce0 msgr2=0x7fdce80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:00.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.361+0000 7fdcee263700 1 -- 172.21.15.31:0/470743454 shutdown_connections 2023-10-09T06:22:00.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.361+0000 7fdcee263700 1 -- 172.21.15.31:0/470743454 wait complete. 2023-10-09T06:22:00.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.362+0000 7fdcee263700 1 Processor -- start 2023-10-09T06:22:00.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.362+0000 7fdcee263700 1 -- start start 2023-10-09T06:22:00.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcee263700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdce8157870 0x7fdce813f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:00.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcee263700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdce8157c40 0x7fdce814d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:00.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcee263700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce815a620 0x7fdce814ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:00.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcee263700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce814d240 con 0x7fdce815a620 2023-10-09T06:22:00.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcee263700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce8152230 con 0x7fdce8157870 2023-10-09T06:22:00.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcee263700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80b2bd0 con 0x7fdce8157c40 2023-10-09T06:22:00.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcec800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce815a620 0x7fdce814ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:00.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcec800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce815a620 0x7fdce814ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46516/0 (socket says 172.21.15.31:46516) 2023-10-09T06:22:00.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcec800700 1 -- 172.21.15.31:0/4073331897 learned_addr learned my addr 172.21.15.31:0/4073331897 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:00.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdce7fff700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdce8157870 0x7fdce813f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:00.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdce77fe700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdce8157c40 0x7fdce814d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:00.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcec800700 1 -- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdce8157c40 msgr2=0x7fdce814d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcec800700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdce8157c40 0x7fdce814d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcec800700 1 -- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdce8157870 msgr2=0x7fdce813f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcec800700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdce8157870 0x7fdce813f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdcec800700 1 -- 172.21.15.31:0/4073331897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd8009420 con 0x7fdce815a620 2023-10-09T06:22:00.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.363+0000 7fdce7fff700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdce8157870 0x7fdce813f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:00.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.364+0000 7fdcec800700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce815a620 0x7fdce814ded0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009e90 tx=0x7fdce000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:00.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.364+0000 7fdccffff700 1 -- 172.21.15.31:0/4073331897 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce000cc20 con 0x7fdce815a620 2023-10-09T06:22:00.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.364+0000 7fdccffff700 1 -- 172.21.15.31:0/4073331897 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce000f040 con 0x7fdce815a620 2023-10-09T06:22:00.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.364+0000 7fdccffff700 1 -- 172.21.15.31:0/4073331897 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0014480 con 0x7fdce815a620 2023-10-09T06:22:00.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.364+0000 7fdcee263700 1 -- 172.21.15.31:0/4073331897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce80b2eb0 con 0x7fdce815a620 2023-10-09T06:22:00.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.364+0000 7fdcee263700 1 -- 172.21.15.31:0/4073331897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce8151ec0 con 0x7fdce815a620 2023-10-09T06:22:00.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.365+0000 7fdcee263700 1 -- 172.21.15.31:0/4073331897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce804c3c0 con 0x7fdce815a620 2023-10-09T06:22:00.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.365+0000 7fdccffff700 1 -- 172.21.15.31:0/4073331897 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdce00147f0 con 0x7fdce815a620 2023-10-09T06:22:00.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.366+0000 7fdccffff700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdcd4066f30 0x7fdcd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:00.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.366+0000 7fdccffff700 1 -- 172.21.15.31:0/4073331897 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdce0085830 con 0x7fdce815a620 2023-10-09T06:22:00.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.366+0000 7fdce7fff700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdcd4066f30 0x7fdcd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:00.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.366+0000 7fdce7fff700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdcd4066f30 0x7fdcd40693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80091e0 tx=0x7fdcd8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:00.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.369+0000 7fdccffff700 1 -- 172.21.15.31:0/4073331897 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdce0056530 con 0x7fdce815a620 2023-10-09T06:22:00.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.563+0000 7fdcee263700 1 -- 172.21.15.31:0/4073331897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdce815c840 con 0x7fdce815a620 2023-10-09T06:22:00.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.563+0000 7fdccffff700 1 -- 172.21.15.31:0/4073331897 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fdce0085020 con 0x7fdce815a620 2023-10-09T06:22:00.564 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:00.564 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":34,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:21:55.930107+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:21:42.035162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T06:21:43.259545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:22:00.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.565+0000 7fdcee263700 1 -- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdcd4066f30 msgr2=0x7fdcd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.565+0000 7fdcee263700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdcd4066f30 0x7fdcd40693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80091e0 tx=0x7fdcd8017000 comp rx=0 tx=0).stop 2023-10-09T06:22:00.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.566+0000 7fdcee263700 1 -- 172.21.15.31:0/4073331897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce815a620 msgr2=0x7fdce814ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.566+0000 7fdcee263700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce815a620 0x7fdce814ded0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009e90 tx=0x7fdce000b040 comp rx=0 tx=0).stop 2023-10-09T06:22:00.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.566+0000 7fdcee263700 1 -- 172.21.15.31:0/4073331897 shutdown_connections 2023-10-09T06:22:00.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.566+0000 7fdcee263700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdcd4066f30 0x7fdcd40693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.566+0000 7fdcee263700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce815a620 0x7fdce814ded0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.566+0000 7fdcee263700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdce8157870 0x7fdce813f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.566+0000 7fdcee263700 1 --2- 172.21.15.31:0/4073331897 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdce8157c40 0x7fdce814d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.566+0000 7fdcee263700 1 -- 172.21.15.31:0/4073331897 >> 172.21.15.31:0/4073331897 conn(0x7fdce8068ce0 msgr2=0x7fdce80b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:00.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.566+0000 7fdcee263700 1 -- 172.21.15.31:0/4073331897 shutdown_connections 2023-10-09T06:22:00.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.566+0000 7fdcee263700 1 -- 172.21.15.31:0/4073331897 wait complete. 2023-10-09T06:22:00.578 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:22:00.579 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:22:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.697+0000 7f8e5ad5e700 1 Processor -- start 2023-10-09T06:22:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.697+0000 7f8e5ad5e700 1 -- start start 2023-10-09T06:22:00.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.698+0000 7f8e5ad5e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e540cdab0 0x7f8e5415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:00.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.698+0000 7f8e5ad5e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e540cb7c0 con 0x7f8e540cd6e0 2023-10-09T06:22:00.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.698+0000 7f8e5ad5e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5415e290 con 0x7f8e5415dda0 2023-10-09T06:22:00.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.698+0000 7f8e5ad5e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5415e850 con 0x7f8e540cdab0 2023-10-09T06:22:00.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.698+0000 7f8e5955b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e540cdab0 0x7f8e5415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:00.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.698+0000 7f8e59d5c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8e540cd6e0 0x7f8e540cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54744/0 (socket says 172.21.15.31:54744) 2023-10-09T06:22:00.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.698+0000 7f8e59d5c700 1 -- 172.21.15.31:0/2557646410 learned_addr learned my addr 172.21.15.31:0/2557646410 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:00.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.698+0000 7f8e5955b700 1 -- 172.21.15.31:0/2557646410 >> v1:172.21.15.158:6789/0 conn(0x7f8e5415dda0 legacy=0x7f8e5415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:00.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.698+0000 7f8e5955b700 1 -- 172.21.15.31:0/2557646410 >> v1:172.21.15.31:6789/0 conn(0x7f8e540cd6e0 legacy=0x7f8e540cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.698+0000 7f8e5955b700 1 -- 172.21.15.31:0/2557646410 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5415e570 con 0x7f8e540cdab0 2023-10-09T06:22:00.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.698+0000 7f8e58d5a700 1 -- 172.21.15.31:0/2557646410 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315808597 0 0) 0x7f8e540cb7c0 con 0x7f8e540cd6e0 2023-10-09T06:22:00.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.699+0000 7f8e5955b700 1 --2- 172.21.15.31:0/2557646410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e540cdab0 0x7f8e5415d860 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8e480098e0 tx=0x7f8e480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffa5ce61be9930e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:00.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.699+0000 7f8e58d5a700 1 -- 172.21.15.31:0/2557646410 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48009e80 con 0x7f8e540cdab0 2023-10-09T06:22:00.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.699+0000 7f8e58d5a700 1 -- 172.21.15.31:0/2557646410 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4800b820 con 0x7f8e540cdab0 2023-10-09T06:22:00.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.699+0000 7f8e58d5a700 1 -- 172.21.15.31:0/2557646410 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800bba0 con 0x7f8e540cdab0 2023-10-09T06:22:00.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.699+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/2557646410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e540cdab0 msgr2=0x7f8e5415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.699+0000 7f8e5ad5e700 1 --2- 172.21.15.31:0/2557646410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e540cdab0 0x7f8e5415d860 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8e480098e0 tx=0x7f8e480091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.699+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/2557646410 shutdown_connections 2023-10-09T06:22:00.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.699+0000 7f8e5ad5e700 1 --2- 172.21.15.31:0/2557646410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e540cdab0 0x7f8e5415d860 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.699+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/2557646410 >> 172.21.15.31:0/2557646410 conn(0x7f8e54067660 msgr2=0x7f8e54067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:00.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.699+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/2557646410 shutdown_connections 2023-10-09T06:22:00.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.699+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/2557646410 wait complete. 2023-10-09T06:22:00.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.700+0000 7f8e5ad5e700 1 Processor -- start 2023-10-09T06:22:00.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.700+0000 7f8e5ad5e700 1 -- start start 2023-10-09T06:22:00.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.701+0000 7f8e5ad5e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e540cd6e0 0x7f8e540b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:00.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.701+0000 7f8e5ad5e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5415dda0 0x7f8e54151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:00.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.701+0000 7f8e5ad5e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e540b6110 0x7f8e5416db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:00.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.701+0000 7f8e5ad5e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e540cc360 con 0x7f8e5415dda0 2023-10-09T06:22:00.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.701+0000 7f8e5ad5e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5414dc70 con 0x7f8e540b6110 2023-10-09T06:22:00.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.701+0000 7f8e5ad5e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e540b55a0 con 0x7f8e540cd6e0 2023-10-09T06:22:00.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.701+0000 7f8e5955b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5415dda0 0x7f8e54151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:00.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.701+0000 7f8e5955b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5415dda0 0x7f8e54151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46542/0 (socket says 172.21.15.31:46542) 2023-10-09T06:22:00.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.701+0000 7f8e5955b700 1 -- 172.21.15.31:0/645022634 learned_addr learned my addr 172.21.15.31:0/645022634 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:00.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.701+0000 7f8e5a55d700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e540b6110 0x7f8e5416db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:00.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.701+0000 7f8e59d5c700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e540cd6e0 0x7f8e540b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:00.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.702+0000 7f8e5955b700 1 -- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e540cd6e0 msgr2=0x7f8e540b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.702+0000 7f8e5955b700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e540cd6e0 0x7f8e540b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.702+0000 7f8e5955b700 1 -- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e540b6110 msgr2=0x7f8e5416db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.702+0000 7f8e5955b700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e540b6110 0x7f8e5416db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.702+0000 7f8e5955b700 1 -- 172.21.15.31:0/645022634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e48009420 con 0x7f8e5415dda0 2023-10-09T06:22:00.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.702+0000 7f8e5a55d700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e540b6110 0x7f8e5416db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:00.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.702+0000 7f8e5955b700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5415dda0 0x7f8e54151180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8e480030c0 tx=0x7f8e48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:00.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.702+0000 7f8e51ffb700 1 -- 172.21.15.31:0/645022634 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800b990 con 0x7f8e5415dda0 2023-10-09T06:22:00.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.702+0000 7f8e51ffb700 1 -- 172.21.15.31:0/645022634 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e48020070 con 0x7f8e5415dda0 2023-10-09T06:22:00.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.702+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/645022634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e541516c0 con 0x7f8e5415dda0 2023-10-09T06:22:00.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.702+0000 7f8e51ffb700 1 -- 172.21.15.31:0/645022634 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4801b6a0 con 0x7f8e5415dda0 2023-10-09T06:22:00.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.702+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/645022634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e540b6640 con 0x7f8e5415dda0 2023-10-09T06:22:00.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.703+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/645022634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e54089280 con 0x7f8e5415dda0 2023-10-09T06:22:00.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.704+0000 7f8e51ffb700 1 -- 172.21.15.31:0/645022634 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e48022030 con 0x7f8e5415dda0 2023-10-09T06:22:00.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.704+0000 7f8e51ffb700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e40066f30 0x7f8e400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:00.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.704+0000 7f8e51ffb700 1 -- 172.21.15.31:0/645022634 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e48085bb0 con 0x7f8e5415dda0 2023-10-09T06:22:00.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.704+0000 7f8e59d5c700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e40066f30 0x7f8e400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:00.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.705+0000 7f8e59d5c700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e40066f30 0x7f8e400693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c007fd0 tx=0x7f8e4c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:00.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.708+0000 7f8e51ffb700 1 -- 172.21.15.31:0/645022634 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e48052e20 con 0x7f8e5415dda0 2023-10-09T06:22:00.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.949+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/645022634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e5404bb80 con 0x7f8e5415dda0 2023-10-09T06:22:00.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.949+0000 7f8e51ffb700 1 -- 172.21.15.31:0/645022634 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f8e48056440 con 0x7f8e5415dda0 2023-10-09T06:22:00.950 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:00.950 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1792934235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1792934235},{"type":"v1","addr":"172.21.15.158:6837","nonce":1792934235}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/893363730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":893363730},{"type":"v1","addr":"172.21.15.31:6834","nonce":893363730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4923,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2780075004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2780075004},{"type":"v1","addr":"172.21.15.31:6835","nonce":2780075004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:21:44.276772+0000","modified":"2023-10-09T06:21:47.908951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6836/1041874650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1041874650},{"type":"v1","addr":"172.21.15.158:6836","nonce":1041874650}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:22:00.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.951+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e40066f30 msgr2=0x7f8e400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.951+0000 7f8e5ad5e700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e40066f30 0x7f8e400693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c007fd0 tx=0x7f8e4c007d30 comp rx=0 tx=0).stop 2023-10-09T06:22:00.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.951+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/645022634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5415dda0 msgr2=0x7f8e54151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:00.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.951+0000 7f8e5ad5e700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5415dda0 0x7f8e54151180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8e480030c0 tx=0x7f8e48016000 comp rx=0 tx=0).stop 2023-10-09T06:22:00.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.951+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/645022634 shutdown_connections 2023-10-09T06:22:00.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.951+0000 7f8e5ad5e700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e40066f30 0x7f8e400693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.951+0000 7f8e5ad5e700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e540cd6e0 0x7f8e540b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.951+0000 7f8e5ad5e700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e540b6110 0x7f8e5416db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.951+0000 7f8e5ad5e700 1 --2- 172.21.15.31:0/645022634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5415dda0 0x7f8e54151180 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:00.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.951+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/645022634 >> 172.21.15.31:0/645022634 conn(0x7f8e54067660 msgr2=0x7f8e540c7100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:00.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.951+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/645022634 shutdown_connections 2023-10-09T06:22:00.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:00.951+0000 7f8e5ad5e700 1 -- 172.21.15.31:0/645022634 wait complete. 2023-10-09T06:22:00.954 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 16 2023-10-09T06:22:00.964 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:22:01.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.082+0000 7f68aa3d7700 1 Processor -- start 2023-10-09T06:22:01.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.082+0000 7f68aa3d7700 1 -- start start 2023-10-09T06:22:01.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.083+0000 7f68aa3d7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a4157870 0x7f68a415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.083+0000 7f68aa3d7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68a415a620 0x7f68a415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.083+0000 7f68aa3d7700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a415cbb0 con 0x7f68a415d580 2023-10-09T06:22:01.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.083+0000 7f68aa3d7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a415bfa0 con 0x7f68a415a620 2023-10-09T06:22:01.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.083+0000 7f68aa3d7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a415c280 con 0x7f68a4157870 2023-10-09T06:22:01.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.083+0000 7f68a37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68a415a620 0x7f68a415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.083+0000 7f68a37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68a415a620 0x7f68a415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46558/0 (socket says 172.21.15.31:46558) 2023-10-09T06:22:01.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.083+0000 7f68a37fe700 1 -- 172.21.15.31:0/3620549657 learned_addr learned my addr 172.21.15.31:0/3620549657 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:01.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.083+0000 7f68a3fff700 1 --2- 172.21.15.31:0/3620549657 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a4157870 0x7f68a415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68a37fe700 1 -- 172.21.15.31:0/3620549657 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a4157870 msgr2=0x7f68a415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:01.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68a37fe700 1 --2- 172.21.15.31:0/3620549657 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a4157870 0x7f68a415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68a37fe700 1 -- 172.21.15.31:0/3620549657 >> v1:172.21.15.158:6789/0 conn(0x7f68a415d580 legacy=0x7f68a4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:01.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68a37fe700 1 -- 172.21.15.31:0/3620549657 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a415c560 con 0x7f68a415a620 2023-10-09T06:22:01.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68a37fe700 1 --2- 172.21.15.31:0/3620549657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a415a620 0x7f68a415d040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f68940099b0 tx=0x7f6894009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece52b82bf86205a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:01.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68a2ffd700 1 -- 172.21.15.31:0/3620549657 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689400b820 con 0x7f68a415a620 2023-10-09T06:22:01.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68a2ffd700 1 -- 172.21.15.31:0/3620549657 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689400b980 con 0x7f68a415a620 2023-10-09T06:22:01.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68a2ffd700 1 -- 172.21.15.31:0/3620549657 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689400bd20 con 0x7f68a415a620 2023-10-09T06:22:01.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3620549657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a415a620 msgr2=0x7f68a415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68aa3d7700 1 --2- 172.21.15.31:0/3620549657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a415a620 0x7f68a415d040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f68940099b0 tx=0x7f6894009250 comp rx=0 tx=0).stop 2023-10-09T06:22:01.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3620549657 shutdown_connections 2023-10-09T06:22:01.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68aa3d7700 1 --2- 172.21.15.31:0/3620549657 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a4157870 0x7f68a415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68aa3d7700 1 --2- 172.21.15.31:0/3620549657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a415a620 0x7f68a415d040 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.084+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3620549657 >> 172.21.15.31:0/3620549657 conn(0x7f68a4068ce0 msgr2=0x7f68a40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:01.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.085+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3620549657 shutdown_connections 2023-10-09T06:22:01.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.085+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3620549657 wait complete. 2023-10-09T06:22:01.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.086+0000 7f68aa3d7700 1 Processor -- start 2023-10-09T06:22:01.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.086+0000 7f68aa3d7700 1 -- start start 2023-10-09T06:22:01.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.086+0000 7f68aa3d7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68a4157870 0x7f68a416e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.086+0000 7f68aa3d7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a415a620 0x7f68a4154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68aa3d7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a415d580 0x7f68a414a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68aa3d7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40d0f80 con 0x7f68a415d580 2023-10-09T06:22:01.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68aa3d7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40d0650 con 0x7f68a4157870 2023-10-09T06:22:01.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68aa3d7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40d0930 con 0x7f68a415a620 2023-10-09T06:22:01.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68a8974700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a415d580 0x7f68a414a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68a8974700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a415d580 0x7f68a414a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46574/0 (socket says 172.21.15.31:46574) 2023-10-09T06:22:01.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68a8974700 1 -- 172.21.15.31:0/3889876256 learned_addr learned my addr 172.21.15.31:0/3889876256 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:01.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68a3fff700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68a4157870 0x7f68a416e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68a37fe700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a415a620 0x7f68a4154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68a8974700 1 -- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a415a620 msgr2=0x7f68a4154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68a8974700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a415a620 0x7f68a4154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68a8974700 1 -- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68a4157870 msgr2=0x7f68a416e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68a8974700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68a4157870 0x7f68a416e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68a8974700 1 -- 172.21.15.31:0/3889876256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68940094f0 con 0x7f68a415d580 2023-10-09T06:22:01.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68a37fe700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a415a620 0x7f68a4154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:01.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68a8974700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a415d580 0x7f68a414a650 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f689c00bb60 tx=0x7f689c0097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:01.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f689bfff700 1 -- 172.21.15.31:0/3889876256 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c00c8c0 con 0x7f68a415d580 2023-10-09T06:22:01.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f689bfff700 1 -- 172.21.15.31:0/3889876256 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c00ca60 con 0x7f68a415d580 2023-10-09T06:22:01.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3889876256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a40d0c10 con 0x7f68a415d580 2023-10-09T06:22:01.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f689bfff700 1 -- 172.21.15.31:0/3889876256 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c00ce20 con 0x7f68a415d580 2023-10-09T06:22:01.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.087+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3889876256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a40d15d0 con 0x7f68a415d580 2023-10-09T06:22:01.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.088+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3889876256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a40d10f0 con 0x7f68a415d580 2023-10-09T06:22:01.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.089+0000 7f689bfff700 1 -- 172.21.15.31:0/3889876256 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f689c014620 con 0x7f68a415d580 2023-10-09T06:22:01.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.089+0000 7f689bfff700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6884066f30 0x7f68840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.089+0000 7f689bfff700 1 -- 172.21.15.31:0/3889876256 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f689c084520 con 0x7f68a415d580 2023-10-09T06:22:01.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.089+0000 7f68a3fff700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6884066f30 0x7f68840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.090+0000 7f68a3fff700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6884066f30 0x7f68840693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f688c006fd0 tx=0x7f688c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:01.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.093+0000 7f689bfff700 1 -- 172.21.15.31:0/3889876256 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f689c051790 con 0x7f68a415d580 2023-10-09T06:22:01.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.329+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3889876256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68a404c3c0 con 0x7f68a415d580 2023-10-09T06:22:01.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.330+0000 7f689bfff700 1 -- 172.21.15.31:0/3889876256 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f689c082e60 con 0x7f68a415d580 2023-10-09T06:22:01.331 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:01.331 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1792934235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1792934235},{"type":"v1","addr":"172.21.15.158:6837","nonce":1792934235}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/893363730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":893363730},{"type":"v1","addr":"172.21.15.31:6834","nonce":893363730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4923,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2780075004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2780075004},{"type":"v1","addr":"172.21.15.31:6835","nonce":2780075004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:21:44.276772+0000","modified":"2023-10-09T06:21:47.908951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6836/1041874650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1041874650},{"type":"v1","addr":"172.21.15.158:6836","nonce":1041874650}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:22:01.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.332+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6884066f30 msgr2=0x7f68840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.332+0000 7f68aa3d7700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6884066f30 0x7f68840693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f688c006fd0 tx=0x7f688c008040 comp rx=0 tx=0).stop 2023-10-09T06:22:01.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.332+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3889876256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a415d580 msgr2=0x7f68a414a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.332+0000 7f68aa3d7700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a415d580 0x7f68a414a650 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f689c00bb60 tx=0x7f689c0097f0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.332+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3889876256 shutdown_connections 2023-10-09T06:22:01.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.332+0000 7f68aa3d7700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6884066f30 0x7f68840693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.332+0000 7f68aa3d7700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a415d580 0x7f68a414a650 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.332+0000 7f68aa3d7700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68a4157870 0x7f68a416e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.332+0000 7f68aa3d7700 1 --2- 172.21.15.31:0/3889876256 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a415a620 0x7f68a4154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.332+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3889876256 >> 172.21.15.31:0/3889876256 conn(0x7f68a4068ce0 msgr2=0x7f68a414c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:01.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.332+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3889876256 shutdown_connections 2023-10-09T06:22:01.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.332+0000 7f68aa3d7700 1 -- 172.21.15.31:0/3889876256 wait complete. 2023-10-09T06:22:01.334 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 16 2023-10-09T06:22:01.345 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:22:01.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.463+0000 7f9662644700 1 Processor -- start 2023-10-09T06:22:01.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.463+0000 7f9662644700 1 -- start start 2023-10-09T06:22:01.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.464+0000 7f9662644700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f965c0cd6e0 0x7f965c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.464+0000 7f9662644700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f965c15cbd0 0x7f965c15d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.464+0000 7f9662644700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965c0cb7c0 con 0x7f965c0cdab0 2023-10-09T06:22:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.464+0000 7f9662644700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965c15e850 con 0x7f965c0cd6e0 2023-10-09T06:22:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.464+0000 7f9662644700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0cd030 con 0x7f965c15cbd0 2023-10-09T06:22:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.464+0000 7f9661e43700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f965c15cbd0 0x7f965c15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.464+0000 7f9661642700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f965c0cd6e0 0x7f965c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.464+0000 7f9660e41700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f965c0cdab0 0x7f965c15d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:44008/0 (socket says 172.21.15.31:44008) 2023-10-09T06:22:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.464+0000 7f9660e41700 1 -- 172.21.15.31:0/3504082090 learned_addr learned my addr 172.21.15.31:0/3504082090 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.465+0000 7f9661642700 1 -- 172.21.15.31:0/3504082090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f965c15cbd0 msgr2=0x7f965c15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:01.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.465+0000 7f9661642700 1 --2- 172.21.15.31:0/3504082090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f965c15cbd0 0x7f965c15d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.465+0000 7f9661642700 1 -- 172.21.15.31:0/3504082090 >> v1:172.21.15.158:6789/0 conn(0x7f965c0cdab0 legacy=0x7f965c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.465+0000 7f9661642700 1 -- 172.21.15.31:0/3504082090 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c15e290 con 0x7f965c0cd6e0 2023-10-09T06:22:01.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.465+0000 7f965bfff700 1 -- 172.21.15.31:0/3504082090 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108411724 0 0) 0x7f965c0cb7c0 con 0x7f965c0cdab0 2023-10-09T06:22:01.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.465+0000 7f9661642700 1 --2- 172.21.15.31:0/3504082090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c0cd6e0 0x7f965c0cbc50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f96540098e0 tx=0x7f96540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12a58fe09c7bcd2c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:01.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.465+0000 7f965bfff700 1 -- 172.21.15.31:0/3504082090 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965400b640 con 0x7f965c0cd6e0 2023-10-09T06:22:01.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.465+0000 7f965bfff700 1 -- 172.21.15.31:0/3504082090 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965400b7a0 con 0x7f965c0cd6e0 2023-10-09T06:22:01.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.465+0000 7f965bfff700 1 -- 172.21.15.31:0/3504082090 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965400bb40 con 0x7f965c0cd6e0 2023-10-09T06:22:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.466+0000 7f9662644700 1 -- 172.21.15.31:0/3504082090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c0cd6e0 msgr2=0x7f965c0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.466+0000 7f9662644700 1 --2- 172.21.15.31:0/3504082090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c0cd6e0 0x7f965c0cbc50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f96540098e0 tx=0x7f96540091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.466+0000 7f9662644700 1 -- 172.21.15.31:0/3504082090 shutdown_connections 2023-10-09T06:22:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.466+0000 7f9662644700 1 --2- 172.21.15.31:0/3504082090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c0cd6e0 0x7f965c0cbc50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.466+0000 7f9662644700 1 --2- 172.21.15.31:0/3504082090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f965c15cbd0 0x7f965c15d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.466+0000 7f9662644700 1 -- 172.21.15.31:0/3504082090 >> 172.21.15.31:0/3504082090 conn(0x7f965c067660 msgr2=0x7f965c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.466+0000 7f9662644700 1 -- 172.21.15.31:0/3504082090 shutdown_connections 2023-10-09T06:22:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.466+0000 7f9662644700 1 -- 172.21.15.31:0/3504082090 wait complete. 2023-10-09T06:22:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.467+0000 7f9662644700 1 Processor -- start 2023-10-09T06:22:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.467+0000 7f9662644700 1 -- start start 2023-10-09T06:22:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9662644700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c0cd6e0 0x7f965c14d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9662644700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f965c0cdab0 0x7f965c0b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9662644700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c15cbd0 0x7f965c0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9662644700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0b4a90 con 0x7f965c0cd6e0 2023-10-09T06:22:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9662644700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0b3e80 con 0x7f965c15cbd0 2023-10-09T06:22:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9662644700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0b4160 con 0x7f965c0cdab0 2023-10-09T06:22:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9661642700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c0cd6e0 0x7f965c14d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9661642700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c0cd6e0 0x7f965c14d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46576/0 (socket says 172.21.15.31:46576) 2023-10-09T06:22:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9661642700 1 -- 172.21.15.31:0/741911479 learned_addr learned my addr 172.21.15.31:0/741911479 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9660e41700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f965c0cdab0 0x7f965c0b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9661e43700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c15cbd0 0x7f965c0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9661642700 1 -- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f965c0cdab0 msgr2=0x7f965c0b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9661642700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f965c0cdab0 0x7f965c0b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9661642700 1 -- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c15cbd0 msgr2=0x7f965c0b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9661642700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c15cbd0 0x7f965c0b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9661642700 1 -- 172.21.15.31:0/741911479 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9654009420 con 0x7f965c0cd6e0 2023-10-09T06:22:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9661642700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c0cd6e0 0x7f965c14d6d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f965c0c7b10 tx=0x7f9654017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f96597fa700 1 -- 172.21.15.31:0/741911479 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965400bb20 con 0x7f965c0cd6e0 2023-10-09T06:22:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f96597fa700 1 -- 172.21.15.31:0/741911479 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9654011420 con 0x7f965c0cd6e0 2023-10-09T06:22:01.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9662644700 1 -- 172.21.15.31:0/741911479 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965c0b4440 con 0x7f965c0cd6e0 2023-10-09T06:22:01.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f96597fa700 1 -- 172.21.15.31:0/741911479 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96540117c0 con 0x7f965c0cd6e0 2023-10-09T06:22:01.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.468+0000 7f9662644700 1 -- 172.21.15.31:0/741911479 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965c0b5b80 con 0x7f965c0cd6e0 2023-10-09T06:22:01.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.469+0000 7f9662644700 1 -- 172.21.15.31:0/741911479 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965c089280 con 0x7f965c0cd6e0 2023-10-09T06:22:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.470+0000 7f96597fa700 1 -- 172.21.15.31:0/741911479 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9654011b70 con 0x7f965c0cd6e0 2023-10-09T06:22:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.470+0000 7f96597fa700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9648066f30 0x7f96480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.470+0000 7f96597fa700 1 -- 172.21.15.31:0/741911479 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9654085c10 con 0x7f965c0cd6e0 2023-10-09T06:22:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.470+0000 7f9660e41700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9648066f30 0x7f96480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.471+0000 7f9660e41700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9648066f30 0x7f96480693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f965c0b32f0 tx=0x7f9650009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:01.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.475+0000 7f96597fa700 1 -- 172.21.15.31:0/741911479 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9654052e80 con 0x7f965c0cd6e0 2023-10-09T06:22:01.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.667+0000 7f9662644700 1 -- 172.21.15.31:0/741911479 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f965c15e570 con 0x7f965c0cd6e0 2023-10-09T06:22:01.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.669+0000 7f96597fa700 1 -- 172.21.15.31:0/741911479 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f96540564a0 con 0x7f965c0cd6e0 2023-10-09T06:22:01.670 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:01.670 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":34,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:21:55.930107+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:21:42.035162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T06:21:43.259545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:22:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.671+0000 7f9662644700 1 -- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9648066f30 msgr2=0x7f96480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.671+0000 7f9662644700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9648066f30 0x7f96480693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f965c0b32f0 tx=0x7f9650009040 comp rx=0 tx=0).stop 2023-10-09T06:22:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.671+0000 7f9662644700 1 -- 172.21.15.31:0/741911479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c0cd6e0 msgr2=0x7f965c14d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.671+0000 7f9662644700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c0cd6e0 0x7f965c14d6d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f965c0c7b10 tx=0x7f9654017000 comp rx=0 tx=0).stop 2023-10-09T06:22:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.671+0000 7f9662644700 1 -- 172.21.15.31:0/741911479 shutdown_connections 2023-10-09T06:22:01.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.671+0000 7f9662644700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9648066f30 0x7f96480693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.671+0000 7f9662644700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f965c15cbd0 0x7f965c0b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.671+0000 7f9662644700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f965c0cd6e0 0x7f965c14d6d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.671+0000 7f9662644700 1 --2- 172.21.15.31:0/741911479 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f965c0cdab0 0x7f965c0b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.671+0000 7f9662644700 1 -- 172.21.15.31:0/741911479 >> 172.21.15.31:0/741911479 conn(0x7f965c067660 msgr2=0x7f965c15be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:01.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.671+0000 7f9662644700 1 -- 172.21.15.31:0/741911479 shutdown_connections 2023-10-09T06:22:01.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.671+0000 7f9662644700 1 -- 172.21.15.31:0/741911479 wait complete. 2023-10-09T06:22:01.684 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:22:01.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.803+0000 7fcf6295d700 1 Processor -- start 2023-10-09T06:22:01.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.803+0000 7fcf6295d700 1 -- start start 2023-10-09T06:22:01.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.804+0000 7fcf6295d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcf5c15a170 0x7fcf5c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.804+0000 7fcf6295d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf5c069040 0x7fcf5c0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.804+0000 7fcf6295d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c15ea70 con 0x7fcf5c159da0 2023-10-09T06:22:01.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.804+0000 7fcf6295d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0b34b0 con 0x7fcf5c15a170 2023-10-09T06:22:01.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.804+0000 7fcf6295d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0694e0 con 0x7fcf5c069040 2023-10-09T06:22:01.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.804+0000 7fcf6215c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf5c069040 0x7fcf5c0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.804+0000 7fcf6115a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcf5c15a170 0x7fcf5c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.804+0000 7fcf6215c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf5c069040 0x7fcf5c0af4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:50804/0 (socket says 172.21.15.31:50804) 2023-10-09T06:22:01.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.804+0000 7fcf6215c700 1 -- 172.21.15.31:0/3142854339 learned_addr learned my addr 172.21.15.31:0/3142854339 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:01.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.804+0000 7fcf6195b700 1 --1- 172.21.15.31:0/3142854339 >> v1:172.21.15.158:6789/0 conn(0x7fcf5c159da0 0x7fcf5c0b2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:44016/0 (socket says 172.21.15.31:44016) 2023-10-09T06:22:01.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.805+0000 7fcf6115a700 1 -- 172.21.15.31:0/3142854339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf5c069040 msgr2=0x7fcf5c0af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:01.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.805+0000 7fcf6115a700 1 --2- 172.21.15.31:0/3142854339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf5c069040 0x7fcf5c0af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.805+0000 7fcf6115a700 1 -- 172.21.15.31:0/3142854339 >> v1:172.21.15.158:6789/0 conn(0x7fcf5c159da0 legacy=0x7fcf5c0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.805+0000 7fcf60959700 1 -- 172.21.15.31:0/3142854339 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131601605 0 0) 0x7fcf5c15ea70 con 0x7fcf5c159da0 2023-10-09T06:22:01.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.805+0000 7fcf6115a700 1 -- 172.21.15.31:0/3142854339 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0b3990 con 0x7fcf5c15a170 2023-10-09T06:22:01.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.805+0000 7fcf6115a700 1 --2- 172.21.15.31:0/3142854339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf5c15a170 0x7fcf5c068b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf500098e0 tx=0x7fcf500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17b10c7ff29376f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:01.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.805+0000 7fcf60959700 1 -- 172.21.15.31:0/3142854339 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000b640 con 0x7fcf5c15a170 2023-10-09T06:22:01.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.805+0000 7fcf60959700 1 -- 172.21.15.31:0/3142854339 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5000b7a0 con 0x7fcf5c15a170 2023-10-09T06:22:01.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.805+0000 7fcf60959700 1 -- 172.21.15.31:0/3142854339 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000bb40 con 0x7fcf5c15a170 2023-10-09T06:22:01.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.805+0000 7fcf6295d700 1 -- 172.21.15.31:0/3142854339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf5c15a170 msgr2=0x7fcf5c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.805+0000 7fcf6295d700 1 --2- 172.21.15.31:0/3142854339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf5c15a170 0x7fcf5c068b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf500098e0 tx=0x7fcf500091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.806+0000 7fcf6295d700 1 -- 172.21.15.31:0/3142854339 shutdown_connections 2023-10-09T06:22:01.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.806+0000 7fcf6295d700 1 --2- 172.21.15.31:0/3142854339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf5c069040 0x7fcf5c0af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.806+0000 7fcf6295d700 1 --2- 172.21.15.31:0/3142854339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf5c15a170 0x7fcf5c068b00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.806+0000 7fcf6295d700 1 -- 172.21.15.31:0/3142854339 >> 172.21.15.31:0/3142854339 conn(0x7fcf5c0d0bc0 msgr2=0x7fcf5c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:01.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.806+0000 7fcf6295d700 1 -- 172.21.15.31:0/3142854339 shutdown_connections 2023-10-09T06:22:01.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.806+0000 7fcf6295d700 1 -- 172.21.15.31:0/3142854339 wait complete. 2023-10-09T06:22:01.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.807+0000 7fcf6295d700 1 Processor -- start 2023-10-09T06:22:01.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.807+0000 7fcf6295d700 1 -- start start 2023-10-09T06:22:01.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6295d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf5c069040 0x7fcf5c15cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6295d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf5c159da0 0x7fcf5c155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6295d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf5c15a170 0x7fcf5c0c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6295d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c15d640 con 0x7fcf5c15a170 2023-10-09T06:22:01.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6295d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c15a580 con 0x7fcf5c069040 2023-10-09T06:22:01.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6295d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0c47c0 con 0x7fcf5c159da0 2023-10-09T06:22:01.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6215c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf5c15a170 0x7fcf5c0c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6215c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf5c15a170 0x7fcf5c0c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46590/0 (socket says 172.21.15.31:46590) 2023-10-09T06:22:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6215c700 1 -- 172.21.15.31:0/826077514 learned_addr learned my addr 172.21.15.31:0/826077514 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6115a700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf5c159da0 0x7fcf5c155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6195b700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf5c069040 0x7fcf5c15cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6215c700 1 -- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf5c159da0 msgr2=0x7fcf5c155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6215c700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf5c159da0 0x7fcf5c155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6215c700 1 -- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf5c069040 msgr2=0x7fcf5c15cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6215c700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf5c069040 0x7fcf5c15cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6215c700 1 -- 172.21.15.31:0/826077514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf50009420 con 0x7fcf5c15a170 2023-10-09T06:22:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf6215c700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf5c15a170 0x7fcf5c0c67a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400e930 tx=0x7fcf54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf59ffb700 1 -- 172.21.15.31:0/826077514 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54013680 con 0x7fcf5c15a170 2023-10-09T06:22:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.808+0000 7fcf59ffb700 1 -- 172.21.15.31:0/826077514 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf540137e0 con 0x7fcf5c15a170 2023-10-09T06:22:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.809+0000 7fcf6295d700 1 -- 172.21.15.31:0/826077514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c0c4aa0 con 0x7fcf5c15a170 2023-10-09T06:22:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.809+0000 7fcf59ffb700 1 -- 172.21.15.31:0/826077514 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54013ba0 con 0x7fcf5c15a170 2023-10-09T06:22:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.809+0000 7fcf6295d700 1 -- 172.21.15.31:0/826077514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c0c5060 con 0x7fcf5c15a170 2023-10-09T06:22:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.810+0000 7fcf6295d700 1 -- 172.21.15.31:0/826077514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c0b5b80 con 0x7fcf5c15a170 2023-10-09T06:22:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.810+0000 7fcf59ffb700 1 -- 172.21.15.31:0/826077514 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf5400c3e0 con 0x7fcf5c15a170 2023-10-09T06:22:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.811+0000 7fcf59ffb700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcf48066f30 0x7fcf480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.811+0000 7fcf59ffb700 1 -- 172.21.15.31:0/826077514 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf54084670 con 0x7fcf5c15a170 2023-10-09T06:22:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.811+0000 7fcf6195b700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcf48066f30 0x7fcf480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.811+0000 7fcf6195b700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcf48066f30 0x7fcf480693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c001560 tx=0x7fcf4c001b00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:01.815+0000 7fcf59ffb700 1 -- 172.21.15.31:0/826077514 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf540518e0 con 0x7fcf5c15a170 2023-10-09T06:22:02.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.055+0000 7fcf6295d700 1 -- 172.21.15.31:0/826077514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcf5c15d390 con 0x7fcf5c15a170 2023-10-09T06:22:02.056 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:22:02.055+0000 7fc5e82b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:22:02.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.059+0000 7fcf59ffb700 1 -- 172.21.15.31:0/826077514 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcf54054f00 con 0x7fcf5c15a170 2023-10-09T06:22:02.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.062+0000 7fcf6295d700 1 -- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcf48066f30 msgr2=0x7fcf480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:02.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.062+0000 7fcf6295d700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcf48066f30 0x7fcf480693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c001560 tx=0x7fcf4c001b00 comp rx=0 tx=0).stop 2023-10-09T06:22:02.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.062+0000 7fcf6295d700 1 -- 172.21.15.31:0/826077514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf5c15a170 msgr2=0x7fcf5c0c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:02.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.062+0000 7fcf6295d700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf5c15a170 0x7fcf5c0c67a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400e930 tx=0x7fcf54009250 comp rx=0 tx=0).stop 2023-10-09T06:22:02.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.062+0000 7fcf6295d700 1 -- 172.21.15.31:0/826077514 shutdown_connections 2023-10-09T06:22:02.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.062+0000 7fcf6295d700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcf48066f30 0x7fcf480693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:02.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.062+0000 7fcf6295d700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf5c15a170 0x7fcf5c0c67a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:02.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.062+0000 7fcf6295d700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf5c069040 0x7fcf5c15cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:02.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.062+0000 7fcf6295d700 1 --2- 172.21.15.31:0/826077514 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf5c159da0 0x7fcf5c155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:02.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.062+0000 7fcf6295d700 1 -- 172.21.15.31:0/826077514 >> 172.21.15.31:0/826077514 conn(0x7fcf5c0d0bc0 msgr2=0x7fcf5c0ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:02.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.062+0000 7fcf6295d700 1 -- 172.21.15.31:0/826077514 shutdown_connections 2023-10-09T06:22:02.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.062+0000 7fcf6295d700 1 -- 172.21.15.31:0/826077514 wait complete. 2023-10-09T06:22:02.064 INFO:tasks.ceph.mds.d.smithi158.stderr: -3422> 2023-10-09T06:21:46.856+0000 7f21720c0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:22:02.064 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:22:02.074 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:22:02.089 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-09T06:22:02.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.194+0000 7fcff33dd700 1 Processor -- start 2023-10-09T06:22:02.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.194+0000 7fcff33dd700 1 -- start start 2023-10-09T06:22:02.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.195+0000 7fcff33dd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfec0cce30 0x7fcfec15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:02.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.195+0000 7fcff33dd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec0b4d70 con 0x7fcfec06aa00 2023-10-09T06:22:02.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.195+0000 7fcff33dd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec0cd8d0 con 0x7fcfec0b6580 2023-10-09T06:22:02.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.195+0000 7fcff33dd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec0b4440 con 0x7fcfec0cce30 2023-10-09T06:22:02.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.195+0000 7fcff23db700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfec0cce30 0x7fcfec15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:02.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.195+0000 7fcff2bdc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcfec06aa00 0x7fcfec0b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54758/0 (socket says 172.21.15.31:54758) 2023-10-09T06:22:02.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.195+0000 7fcff2bdc700 1 -- 172.21.15.31:0/2484901506 learned_addr learned my addr 172.21.15.31:0/2484901506 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:02.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.195+0000 7fcff23db700 1 -- 172.21.15.31:0/2484901506 >> v1:172.21.15.158:6789/0 conn(0x7fcfec0b6580 legacy=0x7fcfec06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:02.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.195+0000 7fcff23db700 1 -- 172.21.15.31:0/2484901506 >> v1:172.21.15.31:6789/0 conn(0x7fcfec06aa00 legacy=0x7fcfec0b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:02.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.195+0000 7fcff23db700 1 -- 172.21.15.31:0/2484901506 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec0b4720 con 0x7fcfec0cce30 2023-10-09T06:22:02.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.195+0000 7fcff13d9700 1 -- 172.21.15.31:0/2484901506 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089036406 0 0) 0x7fcfec0b4d70 con 0x7fcfec06aa00 2023-10-09T06:22:02.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.196+0000 7fcff23db700 1 --2- 172.21.15.31:0/2484901506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfec0cce30 0x7fcfec15aca0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40098e0 tx=0x7fcfe40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e7a30db5666503 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:02.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.196+0000 7fcff13d9700 1 -- 172.21.15.31:0/2484901506 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4009e80 con 0x7fcfec0cce30 2023-10-09T06:22:02.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.196+0000 7fcff13d9700 1 -- 172.21.15.31:0/2484901506 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe400b820 con 0x7fcfec0cce30 2023-10-09T06:22:02.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.196+0000 7fcff13d9700 1 -- 172.21.15.31:0/2484901506 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400bba0 con 0x7fcfec0cce30 2023-10-09T06:22:02.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.196+0000 7fcff33dd700 1 -- 172.21.15.31:0/2484901506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfec0cce30 msgr2=0x7fcfec15aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:02.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.196+0000 7fcff33dd700 1 --2- 172.21.15.31:0/2484901506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfec0cce30 0x7fcfec15aca0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40098e0 tx=0x7fcfe40091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:02.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.196+0000 7fcff33dd700 1 -- 172.21.15.31:0/2484901506 shutdown_connections 2023-10-09T06:22:02.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.196+0000 7fcff33dd700 1 --2- 172.21.15.31:0/2484901506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfec0cce30 0x7fcfec15aca0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:02.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.196+0000 7fcff33dd700 1 -- 172.21.15.31:0/2484901506 >> 172.21.15.31:0/2484901506 conn(0x7fcfec068cb0 msgr2=0x7fcfec0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:02.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.197+0000 7fcff33dd700 1 -- 172.21.15.31:0/2484901506 shutdown_connections 2023-10-09T06:22:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.197+0000 7fcff33dd700 1 -- 172.21.15.31:0/2484901506 wait complete. 2023-10-09T06:22:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.198+0000 7fcff33dd700 1 Processor -- start 2023-10-09T06:22:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.198+0000 7fcff33dd700 1 -- start start 2023-10-09T06:22:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.198+0000 7fcff33dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfec06aa00 0x7fcfec14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.198+0000 7fcff33dd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfec0b6580 0x7fcfec152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.198+0000 7fcff33dd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfec0cce30 0x7fcfec153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.198+0000 7fcff33dd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec158a20 con 0x7fcfec06aa00 2023-10-09T06:22:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.198+0000 7fcff33dd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec158d00 con 0x7fcfec0cce30 2023-10-09T06:22:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.198+0000 7fcff33dd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec158fe0 con 0x7fcfec0b6580 2023-10-09T06:22:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.198+0000 7fcff23db700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfec06aa00 0x7fcfec14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.198+0000 7fcff23db700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfec06aa00 0x7fcfec14f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46614/0 (socket says 172.21.15.31:46614) 2023-10-09T06:22:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.198+0000 7fcff23db700 1 -- 172.21.15.31:0/1663904770 learned_addr learned my addr 172.21.15.31:0/1663904770 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:02.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.199+0000 7fcff23db700 1 -- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfec0b6580 msgr2=0x7fcfec152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:02.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.199+0000 7fcff1bda700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfec0b6580 0x7fcfec152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:02.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.199+0000 7fcff23db700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfec0b6580 0x7fcfec152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:02.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.199+0000 7fcff23db700 1 -- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfec0cce30 msgr2=0x7fcfec153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:02.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.199+0000 7fcff2bdc700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfec0cce30 0x7fcfec153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:02.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.199+0000 7fcff23db700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfec0cce30 0x7fcfec153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:02.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.199+0000 7fcff23db700 1 -- 172.21.15.31:0/1663904770 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe4009420 con 0x7fcfec06aa00 2023-10-09T06:22:02.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.199+0000 7fcff23db700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfec06aa00 0x7fcfec14f9e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40030c0 tx=0x7fcfe4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:02.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.199+0000 7fcfea7fc700 1 -- 172.21.15.31:0/1663904770 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400ba10 con 0x7fcfec06aa00 2023-10-09T06:22:02.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.199+0000 7fcfea7fc700 1 -- 172.21.15.31:0/1663904770 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe4020070 con 0x7fcfec06aa00 2023-10-09T06:22:02.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.199+0000 7fcff33dd700 1 -- 172.21.15.31:0/1663904770 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec1592c0 con 0x7fcfec06aa00 2023-10-09T06:22:02.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.199+0000 7fcfea7fc700 1 -- 172.21.15.31:0/1663904770 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe401b6a0 con 0x7fcfec06aa00 2023-10-09T06:22:02.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.199+0000 7fcff33dd700 1 -- 172.21.15.31:0/1663904770 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec14ff20 con 0x7fcfec06aa00 2023-10-09T06:22:02.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.200+0000 7fcff33dd700 1 -- 172.21.15.31:0/1663904770 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec089550 con 0x7fcfec06aa00 2023-10-09T06:22:02.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.200+0000 7fcfea7fc700 1 -- 172.21.15.31:0/1663904770 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfe4022030 con 0x7fcfec06aa00 2023-10-09T06:22:02.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.201+0000 7fcfea7fc700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfd8066f30 0x7fcfd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:02.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.201+0000 7fcfea7fc700 1 -- 172.21.15.31:0/1663904770 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fcfe4086500 con 0x7fcfec06aa00 2023-10-09T06:22:02.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.201+0000 7fcff1bda700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfd8066f30 0x7fcfd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:02.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.202+0000 7fcff1bda700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfd8066f30 0x7fcfd80693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0b3590 tx=0x7fcfe0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:02.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.205+0000 7fcfea7fc700 1 -- 172.21.15.31:0/1663904770 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfe4053720 con 0x7fcfec06aa00 2023-10-09T06:22:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:02.444+0000 7fcff33dd700 1 -- 172.21.15.31:0/1663904770 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcfec0b4a00 con 0x7fcfec06aa00 2023-10-09T06:22:03.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.061+0000 7fcfea7fc700 1 -- 172.21.15.31:0/1663904770 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcfe4056d40 con 0x7fcfec06aa00 2023-10-09T06:22:03.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.064+0000 7fcff33dd700 1 -- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfd8066f30 msgr2=0x7fcfd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:03.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.064+0000 7fcff33dd700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfd8066f30 0x7fcfd80693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0b3590 tx=0x7fcfe0009040 comp rx=0 tx=0).stop 2023-10-09T06:22:03.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.064+0000 7fcff33dd700 1 -- 172.21.15.31:0/1663904770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfec06aa00 msgr2=0x7fcfec14f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:03.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.064+0000 7fcff33dd700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfec06aa00 0x7fcfec14f9e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40030c0 tx=0x7fcfe4016000 comp rx=0 tx=0).stop 2023-10-09T06:22:03.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.064+0000 7fcff33dd700 1 -- 172.21.15.31:0/1663904770 shutdown_connections 2023-10-09T06:22:03.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.064+0000 7fcff33dd700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfd8066f30 0x7fcfd80693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:03.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.064+0000 7fcff33dd700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfec0cce30 0x7fcfec153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:03.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.064+0000 7fcff33dd700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfec06aa00 0x7fcfec14f9e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:03.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.064+0000 7fcff33dd700 1 --2- 172.21.15.31:0/1663904770 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfec0b6580 0x7fcfec152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:03.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.064+0000 7fcff33dd700 1 -- 172.21.15.31:0/1663904770 >> 172.21.15.31:0/1663904770 conn(0x7fcfec068cb0 msgr2=0x7fcfec150360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:03.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.064+0000 7fcff33dd700 1 -- 172.21.15.31:0/1663904770 shutdown_connections 2023-10-09T06:22:03.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.064+0000 7fcff33dd700 1 -- 172.21.15.31:0/1663904770 wait complete. 2023-10-09T06:22:03.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:22:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.206+0000 7fa19e4bc700 1 Processor -- start 2023-10-09T06:22:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.206+0000 7fa19e4bc700 1 -- start start 2023-10-09T06:22:03.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.207+0000 7fa19e4bc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa198159fe0 0x7fa1980ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:03.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.207+0000 7fa19e4bc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980cdcc0 0x7fa1980ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.207+0000 7fa19e4bc700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1980d0140 con 0x7fa198159c10 2023-10-09T06:22:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.207+0000 7fa19e4bc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1980cf280 con 0x7fa198159fe0 2023-10-09T06:22:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.207+0000 7fa19e4bc700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1980cf530 con 0x7fa1980cdcc0 2023-10-09T06:22:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.207+0000 7fa19ccb9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa198159fe0 0x7fa1980ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.207+0000 7fa19d4ba700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa198159c10 0x7fa1980cd5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54764/0 (socket says 172.21.15.31:54764) 2023-10-09T06:22:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.207+0000 7fa19ccb9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa198159fe0 0x7fa1980ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46618/0 (socket says 172.21.15.31:46618) 2023-10-09T06:22:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.207+0000 7fa19d4ba700 1 -- 172.21.15.31:0/934593759 learned_addr learned my addr 172.21.15.31:0/934593759 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.208+0000 7fa19ccb9700 1 -- 172.21.15.31:0/934593759 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980cdcc0 msgr2=0x7fa1980ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.208+0000 7fa19dcbb700 1 --2- 172.21.15.31:0/934593759 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980cdcc0 0x7fa1980ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.208+0000 7fa19ccb9700 1 --2- 172.21.15.31:0/934593759 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980cdcc0 0x7fa1980ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.208+0000 7fa19ccb9700 1 -- 172.21.15.31:0/934593759 >> v1:172.21.15.31:6789/0 conn(0x7fa198159c10 legacy=0x7fa1980cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.208+0000 7fa197fff700 1 -- 172.21.15.31:0/934593759 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370164055 0 0) 0x7fa1980d0140 con 0x7fa198159c10 2023-10-09T06:22:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.208+0000 7fa19ccb9700 1 -- 172.21.15.31:0/934593759 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1980cf810 con 0x7fa198159fe0 2023-10-09T06:22:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.208+0000 7fa19dcbb700 1 --2- 172.21.15.31:0/934593759 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980cdcc0 0x7fa1980ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.208+0000 7fa19ccb9700 1 --2- 172.21.15.31:0/934593759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa198159fe0 0x7fa1980ce800 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0098e0 tx=0x7fa18c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3565a77077ecbb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.208+0000 7fa197fff700 1 -- 172.21.15.31:0/934593759 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c009e80 con 0x7fa198159fe0 2023-10-09T06:22:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.208+0000 7fa197fff700 1 -- 172.21.15.31:0/934593759 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c00b860 con 0x7fa198159fe0 2023-10-09T06:22:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.208+0000 7fa197fff700 1 -- 172.21.15.31:0/934593759 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c00bbe0 con 0x7fa198159fe0 2023-10-09T06:22:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.208+0000 7fa19e4bc700 1 -- 172.21.15.31:0/934593759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa198159fe0 msgr2=0x7fa1980ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.208+0000 7fa19e4bc700 1 --2- 172.21.15.31:0/934593759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa198159fe0 0x7fa1980ce800 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0098e0 tx=0x7fa18c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.209+0000 7fa19e4bc700 1 -- 172.21.15.31:0/934593759 shutdown_connections 2023-10-09T06:22:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.209+0000 7fa19e4bc700 1 --2- 172.21.15.31:0/934593759 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa1980cdcc0 0x7fa1980ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.209+0000 7fa19e4bc700 1 --2- 172.21.15.31:0/934593759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa198159fe0 0x7fa1980ce800 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.209+0000 7fa19e4bc700 1 -- 172.21.15.31:0/934593759 >> 172.21.15.31:0/934593759 conn(0x7fa1980696b0 msgr2=0x7fa198067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.209+0000 7fa19e4bc700 1 -- 172.21.15.31:0/934593759 shutdown_connections 2023-10-09T06:22:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.209+0000 7fa19e4bc700 1 -- 172.21.15.31:0/934593759 wait complete. 2023-10-09T06:22:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.210+0000 7fa19e4bc700 1 Processor -- start 2023-10-09T06:22:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.210+0000 7fa19e4bc700 1 -- start start 2023-10-09T06:22:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19e4bc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1980cdcc0 0x7fa1981533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19e4bc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa198159c10 0x7fa1980c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19e4bc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa198159fe0 0x7fa1980cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19e4bc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1980ca510 con 0x7fa198159c10 2023-10-09T06:22:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19e4bc700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19816b2f0 con 0x7fa1980cdcc0 2023-10-09T06:22:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19e4bc700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1980ca080 con 0x7fa198159fe0 2023-10-09T06:22:03.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19ccb9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa198159c10 0x7fa1980c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:03.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19ccb9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa198159c10 0x7fa1980c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46634/0 (socket says 172.21.15.31:46634) 2023-10-09T06:22:03.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19ccb9700 1 -- 172.21.15.31:0/200953160 learned_addr learned my addr 172.21.15.31:0/200953160 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:03.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19d4ba700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1980cdcc0 0x7fa1981533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:03.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19dcbb700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa198159fe0 0x7fa1980cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:03.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19ccb9700 1 -- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa198159fe0 msgr2=0x7fa1980cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:03.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19ccb9700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa198159fe0 0x7fa1980cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:03.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19ccb9700 1 -- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1980cdcc0 msgr2=0x7fa1981533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:03.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19ccb9700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1980cdcc0 0x7fa1981533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:03.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19ccb9700 1 -- 172.21.15.31:0/200953160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c009420 con 0x7fa198159c10 2023-10-09T06:22:03.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19d4ba700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1980cdcc0 0x7fa1981533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:03.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19dcbb700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa198159fe0 0x7fa1980cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:03.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa19ccb9700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa198159c10 0x7fa1980c8820 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa198068a10 tx=0x7fa18c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:03.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa1957fa700 1 -- 172.21.15.31:0/200953160 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c00bbe0 con 0x7fa198159c10 2023-10-09T06:22:03.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.211+0000 7fa1957fa700 1 -- 172.21.15.31:0/200953160 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c011420 con 0x7fa198159c10 2023-10-09T06:22:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.212+0000 7fa19e4bc700 1 -- 172.21.15.31:0/200953160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa198153900 con 0x7fa198159c10 2023-10-09T06:22:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.212+0000 7fa1957fa700 1 -- 172.21.15.31:0/200953160 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0117e0 con 0x7fa198159c10 2023-10-09T06:22:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.212+0000 7fa19e4bc700 1 -- 172.21.15.31:0/200953160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1980c9470 con 0x7fa198159c10 2023-10-09T06:22:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.212+0000 7fa19e4bc700 1 -- 172.21.15.31:0/200953160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1980ca1c0 con 0x7fa198159c10 2023-10-09T06:22:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.213+0000 7fa1957fa700 1 -- 172.21.15.31:0/200953160 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa18c011bd0 con 0x7fa198159c10 2023-10-09T06:22:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.213+0000 7fa1957fa700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa184066f30 0x7fa1840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.213+0000 7fa1957fa700 1 -- 172.21.15.31:0/200953160 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fa18c086050 con 0x7fa198159c10 2023-10-09T06:22:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.214+0000 7fa19d4ba700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa184066f30 0x7fa1840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.214+0000 7fa19d4ba700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa184066f30 0x7fa1840693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa188001560 tx=0x7fa188009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:03.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.218+0000 7fa1957fa700 1 -- 172.21.15.31:0/200953160 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa18c053270 con 0x7fa198159c10 2023-10-09T06:22:03.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:03.410+0000 7fa19e4bc700 1 -- 172.21.15.31:0/200953160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa19804bb80 con 0x7fa198159c10 2023-10-09T06:22:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.063+0000 7fa1957fa700 1 -- 172.21.15.31:0/200953160 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa18c056890 con 0x7fa198159c10 2023-10-09T06:22:04.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.066+0000 7fa19e4bc700 1 -- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa184066f30 msgr2=0x7fa1840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:04.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.066+0000 7fa19e4bc700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa184066f30 0x7fa1840693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa188001560 tx=0x7fa188009040 comp rx=0 tx=0).stop 2023-10-09T06:22:04.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.066+0000 7fa19e4bc700 1 -- 172.21.15.31:0/200953160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa198159c10 msgr2=0x7fa1980c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:04.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.066+0000 7fa19e4bc700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa198159c10 0x7fa1980c8820 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa198068a10 tx=0x7fa18c017000 comp rx=0 tx=0).stop 2023-10-09T06:22:04.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.066+0000 7fa19e4bc700 1 -- 172.21.15.31:0/200953160 shutdown_connections 2023-10-09T06:22:04.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.066+0000 7fa19e4bc700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa184066f30 0x7fa1840693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:04.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.066+0000 7fa19e4bc700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa198159fe0 0x7fa1980cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:04.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.066+0000 7fa19e4bc700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1980cdcc0 0x7fa1981533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:04.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.066+0000 7fa19e4bc700 1 --2- 172.21.15.31:0/200953160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa198159c10 0x7fa1980c8820 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:04.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.067+0000 7fa19e4bc700 1 -- 172.21.15.31:0/200953160 >> 172.21.15.31:0/200953160 conn(0x7fa1980696b0 msgr2=0x7fa1980b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:04.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.067+0000 7fa19e4bc700 1 -- 172.21.15.31:0/200953160 shutdown_connections 2023-10-09T06:22:04.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.067+0000 7fa19e4bc700 1 -- 172.21.15.31:0/200953160 wait complete. 2023-10-09T06:22:04.069 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:22:04.082 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:22:04.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.210+0000 7f8797300700 1 Processor -- start 2023-10-09T06:22:04.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.211+0000 7f8797300700 1 -- start start 2023-10-09T06:22:04.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.211+0000 7f8797300700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f87900b0f80 0x7f879015daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:04.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.211+0000 7f8797300700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f879006d4c0 0x7f879006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:04.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.211+0000 7f8797300700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8790067660 con 0x7f87900c50a0 2023-10-09T06:22:04.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.211+0000 7f8797300700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879006bfa0 con 0x7f87900b0f80 2023-10-09T06:22:04.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.211+0000 7f8797300700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87900684c0 con 0x7f879006d4c0 2023-10-09T06:22:04.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f879589d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f87900c50a0 0x7f87900c54d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54770/0 (socket says 172.21.15.31:54770) 2023-10-09T06:22:04.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f879589d700 1 -- 172.21.15.31:0/236045740 learned_addr learned my addr 172.21.15.31:0/236045740 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:04.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800813531 0 0) 0x7f8790067660 con 0x7f87900c50a0 2023-10-09T06:22:04.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f879509c700 1 --2- 172.21.15.31:0/236045740 >> v2:172.21.15.158:3300/0 conn(0x7f87900b0f80 0x7f879015daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:04.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8778003570 con 0x7f87900c50a0 2023-10-09T06:22:04.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f879489b700 1 --2- 172.21.15.31:0/236045740 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f879006d4c0 0x7f879006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:04.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1030240782 0 0) 0x7f8778003570 con 0x7f87900c50a0 2023-10-09T06:22:04.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f879006d4c0 msgr2=0x7f879006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:04.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 --2- 172.21.15.31:0/236045740 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f879006d4c0 0x7f879006d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:04.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 >> v2:172.21.15.158:3300/0 conn(0x7f87900b0f80 msgr2=0x7f879015daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:04.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 --2- 172.21.15.31:0/236045740 >> v2:172.21.15.158:3300/0 conn(0x7f87900b0f80 0x7f879015daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:04.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87900678b0 con 0x7f87900c50a0 2023-10-09T06:22:04.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f8788001470 con 0x7f87900c50a0 2023-10-09T06:22:04.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 >> v1:172.21.15.31:6789/0 conn(0x7f87900c50a0 legacy=0x7f87900c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:04.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 --2- 172.21.15.31:0/236045740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8778003a60 0x7f8778003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:04.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 --2- 172.21.15.31:0/236045740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778004810 0x7f8778004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:04.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 --2- 172.21.15.31:0/236045740 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f879006d4c0 0x7f87780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:04.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879006bfa0 con 0x7f8778004810 2023-10-09T06:22:04.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87900684c0 con 0x7f8778003a60 2023-10-09T06:22:04.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877800ba60 con 0x7f879006d4c0 2023-10-09T06:22:04.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f879489b700 1 --2- 172.21.15.31:0/236045740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778004810 0x7f8778004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:04.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f879509c700 1 --2- 172.21.15.31:0/236045740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8778003a60 0x7f8778003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:04.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.212+0000 7f879589d700 1 --2- 172.21.15.31:0/236045740 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f879006d4c0 0x7f87780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:04.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f879489b700 1 -- 172.21.15.31:0/236045740 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f879006d4c0 msgr2=0x7f87780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:04.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f879489b700 1 --2- 172.21.15.31:0/236045740 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f879006d4c0 0x7f87780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:04.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f879489b700 1 -- 172.21.15.31:0/236045740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8778003a60 msgr2=0x7f8778003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:04.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f879489b700 1 --2- 172.21.15.31:0/236045740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8778003a60 0x7f8778003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:04.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f879489b700 1 -- 172.21.15.31:0/236045740 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778003570 con 0x7f8778004810 2023-10-09T06:22:04.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f879489b700 1 --2- 172.21.15.31:0/236045740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778004810 0x7f8778004c80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8784009c30 tx=0x7f87840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b150af678b176d7d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:04.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878400e710 con 0x7f8778004810 2023-10-09T06:22:04.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878400e870 con 0x7f8778004810 2023-10-09T06:22:04.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f878ffff700 1 -- 172.21.15.31:0/236045740 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878400ec30 con 0x7f8778004810 2023-10-09T06:22:04.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f8797300700 1 -- 172.21.15.31:0/236045740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778004810 msgr2=0x7f8778004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:04.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f8797300700 1 --2- 172.21.15.31:0/236045740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778004810 0x7f8778004c80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8784009c30 tx=0x7f87840091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:04.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f879589d700 1 -- 172.21.15.31:0/236045740 reap_dead start 2023-10-09T06:22:04.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f8797300700 1 -- 172.21.15.31:0/236045740 shutdown_connections 2023-10-09T06:22:04.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.213+0000 7f8797300700 1 -- 172.21.15.31:0/236045740 >> 172.21.15.31:0/236045740 conn(0x7f8790069870 msgr2=0x7f8790069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:04.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.214+0000 7f8797300700 1 -- 172.21.15.31:0/236045740 shutdown_connections 2023-10-09T06:22:04.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.214+0000 7f8797300700 1 -- 172.21.15.31:0/236045740 wait complete. 2023-10-09T06:22:04.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.215+0000 7f8797300700 1 Processor -- start 2023-10-09T06:22:04.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.215+0000 7f8797300700 1 -- start start 2023-10-09T06:22:04.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f8797300700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778004810 0x7f8790152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:04.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f8797300700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87900b4280 0x7f8790153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:04.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f8797300700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8790154470 0x7f87900b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:04.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f8797300700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87900cb090 con 0x7f8778004810 2023-10-09T06:22:04.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f8797300700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87900ca8c0 con 0x7f8790154470 2023-10-09T06:22:04.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f8797300700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8790153aa0 con 0x7f87900b4280 2023-10-09T06:22:04.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f879509c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778004810 0x7f8790152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:04.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f879509c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778004810 0x7f8790152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46652/0 (socket says 172.21.15.31:46652) 2023-10-09T06:22:04.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f879509c700 1 -- 172.21.15.31:0/3537847098 learned_addr learned my addr 172.21.15.31:0/3537847098 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:04.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f879489b700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87900b4280 0x7f8790153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:04.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f879589d700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8790154470 0x7f87900b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:04.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f879509c700 1 -- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87900b4280 msgr2=0x7f8790153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:04.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f879509c700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87900b4280 0x7f8790153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:04.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f879509c700 1 -- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8790154470 msgr2=0x7f87900b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:04.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f879509c700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8790154470 0x7f87900b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:04.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f879509c700 1 -- 172.21.15.31:0/3537847098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87900caad0 con 0x7f8778004810 2023-10-09T06:22:04.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f879509c700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778004810 0x7f8790152890 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8780011fb0 tx=0x7f878000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:04.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f878d7fa700 1 -- 172.21.15.31:0/3537847098 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878000e040 con 0x7f8778004810 2023-10-09T06:22:04.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f878d7fa700 1 -- 172.21.15.31:0/3537847098 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878000f040 con 0x7f8778004810 2023-10-09T06:22:04.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f878d7fa700 1 -- 172.21.15.31:0/3537847098 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780015430 con 0x7f8778004810 2023-10-09T06:22:04.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f8797300700 1 -- 172.21.15.31:0/3537847098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87900cadb0 con 0x7f8778004810 2023-10-09T06:22:04.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.216+0000 7f8797300700 1 -- 172.21.15.31:0/3537847098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87900b46f0 con 0x7f8778004810 2023-10-09T06:22:04.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.217+0000 7f8797300700 1 -- 172.21.15.31:0/3537847098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8790153d80 con 0x7f8778004810 2023-10-09T06:22:04.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.218+0000 7f878d7fa700 1 -- 172.21.15.31:0/3537847098 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87800157e0 con 0x7f8778004810 2023-10-09T06:22:04.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.218+0000 7f878d7fa700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f877c066f30 0x7f877c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:04.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.218+0000 7f878d7fa700 1 -- 172.21.15.31:0/3537847098 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f8780084fe0 con 0x7f8778004810 2023-10-09T06:22:04.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.218+0000 7f879489b700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f877c066f30 0x7f877c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:04.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.219+0000 7f879489b700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f877c066f30 0x7f877c0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f87840091e0 tx=0x7f878401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:04.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.222+0000 7f878d7fa700 1 -- 172.21.15.31:0/3537847098 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87800523b0 con 0x7f8778004810 2023-10-09T06:22:04.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:04.414+0000 7f8797300700 1 -- 172.21.15.31:0/3537847098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f879004c3c0 con 0x7f8778004810 2023-10-09T06:22:05.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.070+0000 7f878d7fa700 1 -- 172.21.15.31:0/3537847098 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7f87800559d0 con 0x7f8778004810 2023-10-09T06:22:05.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.072+0000 7f8797300700 1 -- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f877c066f30 msgr2=0x7f877c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:05.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.072+0000 7f8797300700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f877c066f30 0x7f877c0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f87840091e0 tx=0x7f878401a000 comp rx=0 tx=0).stop 2023-10-09T06:22:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.072+0000 7f8797300700 1 -- 172.21.15.31:0/3537847098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778004810 msgr2=0x7f8790152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.072+0000 7f8797300700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778004810 0x7f8790152890 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8780011fb0 tx=0x7f878000b040 comp rx=0 tx=0).stop 2023-10-09T06:22:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.072+0000 7f8797300700 1 -- 172.21.15.31:0/3537847098 shutdown_connections 2023-10-09T06:22:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.072+0000 7f8797300700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f877c066f30 0x7f877c0693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.072+0000 7f8797300700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8790154470 0x7f87900b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.072+0000 7f8797300700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778004810 0x7f8790152890 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.072+0000 7f8797300700 1 --2- 172.21.15.31:0/3537847098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87900b4280 0x7f8790153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.072+0000 7f8797300700 1 -- 172.21.15.31:0/3537847098 >> 172.21.15.31:0/3537847098 conn(0x7f8790069870 msgr2=0x7f8790154fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:05.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.073+0000 7f8797300700 1 -- 172.21.15.31:0/3537847098 shutdown_connections 2023-10-09T06:22:05.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.073+0000 7f8797300700 1 -- 172.21.15.31:0/3537847098 wait complete. 2023-10-09T06:22:05.075 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2023-10-09T06:22:05.086 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:22:05.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.207+0000 7f48d8075700 1 Processor -- start 2023-10-09T06:22:05.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.208+0000 7f48d8075700 1 -- start start 2023-10-09T06:22:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d8075700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f48d015da90 0x7f48d0067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d8075700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48d0067ba0 0x7f48d00cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d8075700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d0068000 con 0x7f48d0154440 2023-10-09T06:22:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d8075700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d015e1e0 con 0x7f48d015da90 2023-10-09T06:22:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d8075700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d015e4c0 con 0x7f48d0067ba0 2023-10-09T06:22:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d5e11700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f48d0154440 0x7f48d015af30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54778/0 (socket says 172.21.15.31:54778) 2023-10-09T06:22:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d5e11700 1 -- 172.21.15.31:0/924980026 learned_addr learned my addr 172.21.15.31:0/924980026 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d5610700 1 --2- 172.21.15.31:0/924980026 >> v2:172.21.15.158:3300/0 conn(0x7f48d015da90 0x7f48d0067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d6612700 1 --2- 172.21.15.31:0/924980026 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48d0067ba0 0x7f48d00cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608335491 0 0) 0x7f48c0001490 con 0x7f48d0154440 2023-10-09T06:22:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48b8003570 con 0x7f48d0154440 2023-10-09T06:22:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1362209415 0 0) 0x7f48b8003570 con 0x7f48d0154440 2023-10-09T06:22:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48d0067ba0 msgr2=0x7f48d00cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 --2- 172.21.15.31:0/924980026 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48d0067ba0 0x7f48d00cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 >> v2:172.21.15.158:3300/0 conn(0x7f48d015da90 msgr2=0x7f48d0067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 --2- 172.21.15.31:0/924980026 >> v2:172.21.15.158:3300/0 conn(0x7f48d015da90 0x7f48d0067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d015e7a0 con 0x7f48d0154440 2023-10-09T06:22:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f48c0001980 con 0x7f48d0154440 2023-10-09T06:22:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 >> v1:172.21.15.31:6789/0 conn(0x7f48d0154440 legacy=0x7f48d015af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 --2- 172.21.15.31:0/924980026 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48b8003a60 0x7f48b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 --2- 172.21.15.31:0/924980026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b8004810 0x7f48b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 --2- 172.21.15.31:0/924980026 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48d0067ba0 0x7f48b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d015e1e0 con 0x7f48b8004810 2023-10-09T06:22:05.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d015e4c0 con 0x7f48b8003a60 2023-10-09T06:22:05.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b800bb10 con 0x7f48d0067ba0 2023-10-09T06:22:05.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d5610700 1 --2- 172.21.15.31:0/924980026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b8004810 0x7f48b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.209+0000 7f48d5e11700 1 --2- 172.21.15.31:0/924980026 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48b8003a60 0x7f48b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.210+0000 7f48d6612700 1 --2- 172.21.15.31:0/924980026 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48d0067ba0 0x7f48b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.210+0000 7f48d5610700 1 -- 172.21.15.31:0/924980026 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48d0067ba0 msgr2=0x7f48b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:05.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.210+0000 7f48d5610700 1 --2- 172.21.15.31:0/924980026 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48d0067ba0 0x7f48b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.210+0000 7f48d5610700 1 -- 172.21.15.31:0/924980026 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48b8003a60 msgr2=0x7f48b8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:05.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.210+0000 7f48d5610700 1 --2- 172.21.15.31:0/924980026 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48b8003a60 0x7f48b8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.210+0000 7f48d5610700 1 -- 172.21.15.31:0/924980026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b8003570 con 0x7f48b8004810 2023-10-09T06:22:05.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.210+0000 7f48d5610700 1 --2- 172.21.15.31:0/924980026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b8004810 0x7f48b8004c80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009c00 tx=0x7f48c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543deabc8905acff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:05.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.210+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400e710 con 0x7f48b8004810 2023-10-09T06:22:05.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.210+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c400e870 con 0x7f48b8004810 2023-10-09T06:22:05.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.210+0000 7f48d4e0f700 1 -- 172.21.15.31:0/924980026 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400ec30 con 0x7f48b8004810 2023-10-09T06:22:05.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.210+0000 7f48d8075700 1 -- 172.21.15.31:0/924980026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b8004810 msgr2=0x7f48b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:05.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.211+0000 7f48d8075700 1 --2- 172.21.15.31:0/924980026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b8004810 0x7f48b8004c80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009c00 tx=0x7f48c40091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.211+0000 7f48d6612700 1 -- 172.21.15.31:0/924980026 reap_dead start 2023-10-09T06:22:05.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.211+0000 7f48d8075700 1 -- 172.21.15.31:0/924980026 shutdown_connections 2023-10-09T06:22:05.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.211+0000 7f48d8075700 1 -- 172.21.15.31:0/924980026 >> 172.21.15.31:0/924980026 conn(0x7f48d00d0dd0 msgr2=0x7f48d00d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:05.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.211+0000 7f48d8075700 1 -- 172.21.15.31:0/924980026 shutdown_connections 2023-10-09T06:22:05.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.211+0000 7f48d8075700 1 -- 172.21.15.31:0/924980026 wait complete. 2023-10-09T06:22:05.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.212+0000 7f48d8075700 1 Processor -- start 2023-10-09T06:22:05.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.212+0000 7f48d8075700 1 -- start start 2023-10-09T06:22:05.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.212+0000 7f48d8075700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b8004810 0x7f48d0144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.212+0000 7f48d8075700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48d01557e0 0x7f48d00b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d8075700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48d0153800 0x7f48d0156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d8075700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d0155c50 con 0x7f48d01557e0 2023-10-09T06:22:05.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d8075700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00b2440 con 0x7f48d0153800 2023-10-09T06:22:05.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d8075700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d0156710 con 0x7f48b8004810 2023-10-09T06:22:05.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d5610700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48d01557e0 0x7f48d00b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d5610700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48d01557e0 0x7f48d00b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46670/0 (socket says 172.21.15.31:46670) 2023-10-09T06:22:05.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d5610700 1 -- 172.21.15.31:0/2176790344 learned_addr learned my addr 172.21.15.31:0/2176790344 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:05.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d6612700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48d0153800 0x7f48d0156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d5610700 1 -- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b8004810 msgr2=0x7f48d0144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d5e11700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b8004810 0x7f48d0144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d5610700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b8004810 0x7f48d0144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d5610700 1 -- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48d0153800 msgr2=0x7f48d0156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d5610700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48d0153800 0x7f48d0156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d5610700 1 -- 172.21.15.31:0/2176790344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d00b07a0 con 0x7f48d01557e0 2023-10-09T06:22:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d5610700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48d01557e0 0x7f48d00b2870 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f48c400e4b0 tx=0x7f48c401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48cdffb700 1 -- 172.21.15.31:0/2176790344 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4022070 con 0x7f48d01557e0 2023-10-09T06:22:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48cdffb700 1 -- 172.21.15.31:0/2176790344 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c400ebf0 con 0x7f48d01557e0 2023-10-09T06:22:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d8075700 1 -- 172.21.15.31:0/2176790344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d0155e70 con 0x7f48d01557e0 2023-10-09T06:22:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48cdffb700 1 -- 172.21.15.31:0/2176790344 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c401c6a0 con 0x7f48d01557e0 2023-10-09T06:22:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.213+0000 7f48d8075700 1 -- 172.21.15.31:0/2176790344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d0156430 con 0x7f48d01557e0 2023-10-09T06:22:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.214+0000 7f48d8075700 1 -- 172.21.15.31:0/2176790344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d004c3c0 con 0x7f48d01557e0 2023-10-09T06:22:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.215+0000 7f48cdffb700 1 -- 172.21.15.31:0/2176790344 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48c401ca50 con 0x7f48d01557e0 2023-10-09T06:22:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.215+0000 7f48cdffb700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48bc066f30 0x7f48bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.216+0000 7f48cdffb700 1 -- 172.21.15.31:0/2176790344 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f48c4085aa0 con 0x7f48d01557e0 2023-10-09T06:22:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.216+0000 7f48d5e11700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48bc066f30 0x7f48bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.216+0000 7f48d5e11700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48bc066f30 0x7f48bc0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f48c0001b30 tx=0x7f48c0006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.220+0000 7f48cdffb700 1 -- 172.21.15.31:0/2176790344 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48c4053140 con 0x7f48d01557e0 2023-10-09T06:22:05.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.419+0000 7f48d8075700 1 -- 172.21.15.31:0/2176790344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f48d00b1ed0 con 0x7f48d01557e0 2023-10-09T06:22:05.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.423+0000 7f48cdffb700 1 -- 172.21.15.31:0/2176790344 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f48c40566e0 con 0x7f48d01557e0 2023-10-09T06:22:05.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.425+0000 7f48d8075700 1 -- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48bc066f30 msgr2=0x7f48bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:05.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.425+0000 7f48d8075700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48bc066f30 0x7f48bc0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f48c0001b30 tx=0x7f48c0006040 comp rx=0 tx=0).stop 2023-10-09T06:22:05.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.425+0000 7f48d8075700 1 -- 172.21.15.31:0/2176790344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48d01557e0 msgr2=0x7f48d00b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:05.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.425+0000 7f48d8075700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48d01557e0 0x7f48d00b2870 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f48c400e4b0 tx=0x7f48c401a000 comp rx=0 tx=0).stop 2023-10-09T06:22:05.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.425+0000 7f48d8075700 1 -- 172.21.15.31:0/2176790344 shutdown_connections 2023-10-09T06:22:05.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.425+0000 7f48d8075700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48bc066f30 0x7f48bc0693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.425+0000 7f48d8075700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b8004810 0x7f48d0144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.425+0000 7f48d8075700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48d0153800 0x7f48d0156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.425+0000 7f48d8075700 1 --2- 172.21.15.31:0/2176790344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48d01557e0 0x7f48d00b2870 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.425+0000 7f48d8075700 1 -- 172.21.15.31:0/2176790344 >> 172.21.15.31:0/2176790344 conn(0x7f48d00d0dd0 msgr2=0x7f48d01528c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:05.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.425+0000 7f48d8075700 1 -- 172.21.15.31:0/2176790344 shutdown_connections 2023-10-09T06:22:05.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.425+0000 7f48d8075700 1 -- 172.21.15.31:0/2176790344 wait complete. 2023-10-09T06:22:05.437 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-09T06:22:05.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.555+0000 7f6fe7dbf700 1 Processor -- start 2023-10-09T06:22:05.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.556+0000 7f6fe7dbf700 1 -- start start 2023-10-09T06:22:05.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.556+0000 7f6fe7dbf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6fe00b0e50 0x7f6fe00c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.556+0000 7f6fe7dbf700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6fe00b1220 0x7f6fe006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.556+0000 7f6fe7dbf700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe015de60 con 0x7f6fe006dad0 2023-10-09T06:22:05.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.556+0000 7f6fe7dbf700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe015e140 con 0x7f6fe00b0e50 2023-10-09T06:22:05.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.556+0000 7f6fe7dbf700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe015e420 con 0x7f6fe00b1220 2023-10-09T06:22:05.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.556+0000 7f6fe5b5b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6fe00b0e50 0x7f6fe00c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.557+0000 7f6fe5b5b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6fe00b0e50 0x7f6fe00c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46676/0 (socket says 172.21.15.31:46676) 2023-10-09T06:22:05.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.557+0000 7f6fe5b5b700 1 -- 172.21.15.31:0/1323388455 learned_addr learned my addr 172.21.15.31:0/1323388455 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:05.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.557+0000 7f6fe5b5b700 1 -- 172.21.15.31:0/1323388455 >> v2:172.21.15.158:3300/0 conn(0x7f6fe00b1220 msgr2=0x7f6fe006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:05.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.557+0000 7f6fe535a700 1 --2- 172.21.15.31:0/1323388455 >> v2:172.21.15.158:3300/0 conn(0x7f6fe00b1220 0x7f6fe006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.557+0000 7f6fe5b5b700 1 --2- 172.21.15.31:0/1323388455 >> v2:172.21.15.158:3300/0 conn(0x7f6fe00b1220 0x7f6fe006d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.557+0000 7f6fe5b5b700 1 -- 172.21.15.31:0/1323388455 >> v1:172.21.15.158:6789/0 conn(0x7f6fe006dad0 legacy=0x7f6fe00cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:05.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.557+0000 7f6fe5b5b700 1 -- 172.21.15.31:0/1323388455 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe015e700 con 0x7f6fe00b0e50 2023-10-09T06:22:05.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.557+0000 7f6fe535a700 1 --2- 172.21.15.31:0/1323388455 >> v2:172.21.15.158:3300/0 conn(0x7f6fe00b1220 0x7f6fe006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:05.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.557+0000 7f6fe5b5b700 1 --2- 172.21.15.31:0/1323388455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe00b0e50 0x7f6fe00c9180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6fe006cd30 tx=0x7f6fd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2d29574b398fa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:05.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.557+0000 7f6fe4b59700 1 -- 172.21.15.31:0/1323388455 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd800b820 con 0x7f6fe00b0e50 2023-10-09T06:22:05.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.557+0000 7f6fe4b59700 1 -- 172.21.15.31:0/1323388455 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd800b980 con 0x7f6fe00b0e50 2023-10-09T06:22:05.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.557+0000 7f6fe4b59700 1 -- 172.21.15.31:0/1323388455 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd800bd40 con 0x7f6fe00b0e50 2023-10-09T06:22:05.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.558+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/1323388455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe00b0e50 msgr2=0x7f6fe00c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:05.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.558+0000 7f6fe7dbf700 1 --2- 172.21.15.31:0/1323388455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe00b0e50 0x7f6fe00c9180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6fe006cd30 tx=0x7f6fd8009250 comp rx=0 tx=0).stop 2023-10-09T06:22:05.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.558+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/1323388455 shutdown_connections 2023-10-09T06:22:05.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.558+0000 7f6fe7dbf700 1 --2- 172.21.15.31:0/1323388455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe00b0e50 0x7f6fe00c9180 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.558+0000 7f6fe7dbf700 1 --2- 172.21.15.31:0/1323388455 >> v2:172.21.15.158:3300/0 conn(0x7f6fe00b1220 0x7f6fe006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.558+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/1323388455 >> 172.21.15.31:0/1323388455 conn(0x7f6fe0069870 msgr2=0x7f6fe0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.558+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/1323388455 shutdown_connections 2023-10-09T06:22:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.558+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/1323388455 wait complete. 2023-10-09T06:22:05.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.559+0000 7f6fe7dbf700 1 Processor -- start 2023-10-09T06:22:05.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.559+0000 7f6fe7dbf700 1 -- start start 2023-10-09T06:22:05.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe7dbf700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe006dad0 0x7f6fe01457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe7dbf700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe00b0e50 0x7f6fe0144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe7dbf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe00b1220 0x7f6fe00c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe7dbf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0145db0 con 0x7f6fe00b1220 2023-10-09T06:22:05.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe7dbf700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0146090 con 0x7f6fe006dad0 2023-10-09T06:22:05.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe7dbf700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0146370 con 0x7f6fe00b0e50 2023-10-09T06:22:05.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe635c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe00b1220 0x7f6fe00c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe635c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe00b1220 0x7f6fe00c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46678/0 (socket says 172.21.15.31:46678) 2023-10-09T06:22:05.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe635c700 1 -- 172.21.15.31:0/2140838055 learned_addr learned my addr 172.21.15.31:0/2140838055 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:05.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe5b5b700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe006dad0 0x7f6fe01457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe535a700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe00b0e50 0x7f6fe0144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe635c700 1 -- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe00b0e50 msgr2=0x7f6fe0144f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:05.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe635c700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe00b0e50 0x7f6fe0144f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe635c700 1 -- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe006dad0 msgr2=0x7f6fe01457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:05.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe635c700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe006dad0 0x7f6fe01457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:05.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe635c700 1 -- 172.21.15.31:0/2140838055 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd80094f0 con 0x7f6fe00b1220 2023-10-09T06:22:05.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe535a700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe00b0e50 0x7f6fe0144f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:05.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fe635c700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe00b1220 0x7f6fe00c8be0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000c890 tx=0x7f6fd00026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:05.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.560+0000 7f6fddffb700 1 -- 172.21.15.31:0/2140838055 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0012630 con 0x7f6fe00b1220 2023-10-09T06:22:05.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.561+0000 7f6fddffb700 1 -- 172.21.15.31:0/2140838055 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0012790 con 0x7f6fe00b1220 2023-10-09T06:22:05.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.561+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/2140838055 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe0146650 con 0x7f6fe00b1220 2023-10-09T06:22:05.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.561+0000 7f6fddffb700 1 -- 172.21.15.31:0/2140838055 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0012b50 con 0x7f6fe00b1220 2023-10-09T06:22:05.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.561+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/2140838055 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe0145480 con 0x7f6fe00b1220 2023-10-09T06:22:05.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.562+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/2140838055 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe0146b70 con 0x7f6fe00b1220 2023-10-09T06:22:05.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.562+0000 7f6fddffb700 1 -- 172.21.15.31:0/2140838055 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fd001b400 con 0x7f6fe00b1220 2023-10-09T06:22:05.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.562+0000 7f6fddffb700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6fcc066f30 0x7f6fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:05.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.562+0000 7f6fddffb700 1 -- 172.21.15.31:0/2140838055 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6fd0084550 con 0x7f6fe00b1220 2023-10-09T06:22:05.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.563+0000 7f6fe5b5b700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6fcc066f30 0x7f6fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:05.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.563+0000 7f6fe5b5b700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6fcc066f30 0x7f6fcc0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6fe006cd30 tx=0x7f6fd8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:05.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.566+0000 7f6fddffb700 1 -- 172.21.15.31:0/2140838055 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fe0146b70 con 0x7f6fe00b1220 2023-10-09T06:22:05.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:05.837+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/2140838055 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f6fe0146b70 con 0x7f6fe00b1220 2023-10-09T06:22:06.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.069+0000 7f6fddffb700 1 -- 172.21.15.31:0/2140838055 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v87) v1 ==== 130+0+0 (secure 0 0 0) 0x7f6fe0146b70 con 0x7f6fe00b1220 2023-10-09T06:22:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.071+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6fcc066f30 msgr2=0x7f6fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.071+0000 7f6fe7dbf700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6fcc066f30 0x7f6fcc0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6fe006cd30 tx=0x7f6fd8016000 comp rx=0 tx=0).stop 2023-10-09T06:22:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.071+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/2140838055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe00b1220 msgr2=0x7f6fe00c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:06.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.071+0000 7f6fe7dbf700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe00b1220 0x7f6fe00c8be0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000c890 tx=0x7f6fd00026a0 comp rx=0 tx=0).stop 2023-10-09T06:22:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.071+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/2140838055 shutdown_connections 2023-10-09T06:22:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.071+0000 7f6fe7dbf700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6fcc066f30 0x7f6fcc0693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.071+0000 7f6fe7dbf700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe00b1220 0x7f6fe00c8be0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.071+0000 7f6fe7dbf700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe006dad0 0x7f6fe01457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.071+0000 7f6fe7dbf700 1 --2- 172.21.15.31:0/2140838055 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe00b0e50 0x7f6fe0144f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.071+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/2140838055 >> 172.21.15.31:0/2140838055 conn(0x7f6fe0069870 msgr2=0x7f6fe0157040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.071+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/2140838055 shutdown_connections 2023-10-09T06:22:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.071+0000 7f6fe7dbf700 1 -- 172.21.15.31:0/2140838055 wait complete. 2023-10-09T06:22:06.084 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-09T06:22:06.084 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-09T06:22:06.084 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-09T06:22:06.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.203+0000 7f9a12b5b700 1 Processor -- start 2023-10-09T06:22:06.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.203+0000 7f9a12b5b700 1 -- start start 2023-10-09T06:22:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a12b5b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a0c0aa870 0x7f9a0c0cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a12b5b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0ac650 con 0x7f9a0c0aac40 2023-10-09T06:22:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a12b5b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0ad4b0 con 0x7f9a0c15a310 2023-10-09T06:22:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a12b5b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0b0490 con 0x7f9a0c0aa870 2023-10-09T06:22:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a110f8700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9a0c0aac40 0x7f9a0c0ab090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54790/0 (socket says 172.21.15.31:54790) 2023-10-09T06:22:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a110f8700 1 -- 172.21.15.31:0/3391243584 learned_addr learned my addr 172.21.15.31:0/3391243584 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a108f7700 1 --2- 172.21.15.31:0/3391243584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a0c0aa870 0x7f9a0c0cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a0b7fe700 1 -- 172.21.15.31:0/3391243584 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790988323 0 0) 0x7f9a0c0ac650 con 0x7f9a0c0aac40 2023-10-09T06:22:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a0b7fe700 1 -- 172.21.15.31:0/3391243584 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f8003570 con 0x7f9a0c0aac40 2023-10-09T06:22:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a0b7fe700 1 -- 172.21.15.31:0/3391243584 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199702323 0 0) 0x7f9a0c0ad4b0 con 0x7f9a0c15a310 2023-10-09T06:22:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a0b7fe700 1 -- 172.21.15.31:0/3391243584 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a0c0ac650 con 0x7f9a0c15a310 2023-10-09T06:22:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a108f7700 1 -- 172.21.15.31:0/3391243584 >> v1:172.21.15.158:6789/0 conn(0x7f9a0c15a310 legacy=0x7f9a0c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a108f7700 1 -- 172.21.15.31:0/3391243584 >> v1:172.21.15.31:6789/0 conn(0x7f9a0c0aac40 legacy=0x7f9a0c0ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.204+0000 7f9a108f7700 1 -- 172.21.15.31:0/3391243584 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0ac8a0 con 0x7f9a0c0aa870 2023-10-09T06:22:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.205+0000 7f9a108f7700 1 --2- 172.21.15.31:0/3391243584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a0c0aa870 0x7f9a0c0cd4b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009910 tx=0x7f99f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dea4e4bcbcba4a80 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.205+0000 7f9a0b7fe700 1 -- 172.21.15.31:0/3391243584 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400b690 con 0x7f9a0c0aa870 2023-10-09T06:22:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.205+0000 7f9a0b7fe700 1 -- 172.21.15.31:0/3391243584 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f400b7f0 con 0x7f9a0c0aa870 2023-10-09T06:22:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.205+0000 7f9a0b7fe700 1 -- 172.21.15.31:0/3391243584 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400bb70 con 0x7f9a0c0aa870 2023-10-09T06:22:06.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.205+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3391243584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a0c0aa870 msgr2=0x7f9a0c0cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:06.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.205+0000 7f9a12b5b700 1 --2- 172.21.15.31:0/3391243584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a0c0aa870 0x7f9a0c0cd4b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009910 tx=0x7f99f40091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:06.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.205+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3391243584 shutdown_connections 2023-10-09T06:22:06.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.205+0000 7f9a12b5b700 1 --2- 172.21.15.31:0/3391243584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a0c0aa870 0x7f9a0c0cd4b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:06.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.205+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3391243584 >> 172.21.15.31:0/3391243584 conn(0x7f9a0c0680f0 msgr2=0x7f9a0c0ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:06.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.205+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3391243584 shutdown_connections 2023-10-09T06:22:06.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.205+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3391243584 wait complete. 2023-10-09T06:22:06.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.206+0000 7f9a12b5b700 1 Processor -- start 2023-10-09T06:22:06.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.207+0000 7f9a12b5b700 1 -- start start 2023-10-09T06:22:06.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.207+0000 7f9a12b5b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a0c0aa870 0x7f9a0c146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:06.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.207+0000 7f9a12b5b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a0c0aac40 0x7f9a0c156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:06.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.207+0000 7f9a12b5b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a0c15a310 0x7f9a0c156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:06.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.207+0000 7f9a12b5b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c152cc0 con 0x7f9a0c0aac40 2023-10-09T06:22:06.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.207+0000 7f9a12b5b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c157260 con 0x7f9a0c15a310 2023-10-09T06:22:06.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.207+0000 7f9a12b5b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c157540 con 0x7f9a0c0aa870 2023-10-09T06:22:06.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.207+0000 7f9a0bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a0c0aac40 0x7f9a0c156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:06.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.207+0000 7f9a0bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a0c0aac40 0x7f9a0c156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46684/0 (socket says 172.21.15.31:46684) 2023-10-09T06:22:06.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.207+0000 7f9a0bfff700 1 -- 172.21.15.31:0/3538870679 learned_addr learned my addr 172.21.15.31:0/3538870679 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:06.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.207+0000 7f9a108f7700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a0c0aa870 0x7f9a0c146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:06.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.207+0000 7f9a110f8700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a0c15a310 0x7f9a0c156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:06.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.208+0000 7f9a0bfff700 1 -- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a0c0aa870 msgr2=0x7f9a0c146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:06.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.208+0000 7f9a0bfff700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a0c0aa870 0x7f9a0c146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:06.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.208+0000 7f9a0bfff700 1 -- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a0c15a310 msgr2=0x7f9a0c156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:06.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.208+0000 7f9a0bfff700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a0c15a310 0x7f9a0c156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:06.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.208+0000 7f9a0bfff700 1 -- 172.21.15.31:0/3538870679 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f4009420 con 0x7f9a0c0aac40 2023-10-09T06:22:06.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.208+0000 7f9a0bfff700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a0c0aac40 0x7f9a0c156680 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c7c0 tx=0x7f99fc007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:06.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.208+0000 7f9a08ff9700 1 -- 172.21.15.31:0/3538870679 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc010510 con 0x7f9a0c0aac40 2023-10-09T06:22:06.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.208+0000 7f9a08ff9700 1 -- 172.21.15.31:0/3538870679 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc0106b0 con 0x7f9a0c0aac40 2023-10-09T06:22:06.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.208+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3538870679 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c157820 con 0x7f9a0c0aac40 2023-10-09T06:22:06.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.208+0000 7f9a08ff9700 1 -- 172.21.15.31:0/3538870679 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc010a70 con 0x7f9a0c0aac40 2023-10-09T06:22:06.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.208+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3538870679 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c146ca0 con 0x7f9a0c0aac40 2023-10-09T06:22:06.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.209+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3538870679 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c1530f0 con 0x7f9a0c0aac40 2023-10-09T06:22:06.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.210+0000 7f9a08ff9700 1 -- 172.21.15.31:0/3538870679 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99fc012440 con 0x7f9a0c0aac40 2023-10-09T06:22:06.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.210+0000 7f9a08ff9700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f99ec066f30 0x7f99ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:06.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.210+0000 7f9a08ff9700 1 -- 172.21.15.31:0/3538870679 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f99fc083900 con 0x7f9a0c0aac40 2023-10-09T06:22:06.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.210+0000 7f9a108f7700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f99ec066f30 0x7f99ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:06.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.211+0000 7f9a108f7700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f99ec066f30 0x7f99ec0693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009860 tx=0x7f99f4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:06.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.214+0000 7f9a08ff9700 1 -- 172.21.15.31:0/3538870679 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99fc04b5a0 con 0x7f9a0c0aac40 2023-10-09T06:22:06.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:06.485+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3538870679 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f9a0c1534b0 con 0x7f9a0c0aac40 2023-10-09T06:22:07.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.073+0000 7f9a08ff9700 1 -- 172.21.15.31:0/3538870679 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v88) v1 ==== 145+0+0 (secure 0 0 0) 0x7f99fc017070 con 0x7f9a0c0aac40 2023-10-09T06:22:07.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.076+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f99ec066f30 msgr2=0x7f99ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:07.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.076+0000 7f9a12b5b700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f99ec066f30 0x7f99ec0693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009860 tx=0x7f99f4017000 comp rx=0 tx=0).stop 2023-10-09T06:22:07.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.076+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3538870679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a0c0aac40 msgr2=0x7f9a0c156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:07.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.076+0000 7f9a12b5b700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a0c0aac40 0x7f9a0c156680 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c7c0 tx=0x7f99fc007de0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.076+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3538870679 shutdown_connections 2023-10-09T06:22:07.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.076+0000 7f9a12b5b700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f99ec066f30 0x7f99ec0693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.076+0000 7f9a12b5b700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a0c0aa870 0x7f9a0c146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.076+0000 7f9a12b5b700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a0c15a310 0x7f9a0c156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.076+0000 7f9a12b5b700 1 --2- 172.21.15.31:0/3538870679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a0c0aac40 0x7f9a0c156680 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.076+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3538870679 >> 172.21.15.31:0/3538870679 conn(0x7f9a0c0680f0 msgr2=0x7f9a0c069280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.076+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3538870679 shutdown_connections 2023-10-09T06:22:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.076+0000 7f9a12b5b700 1 -- 172.21.15.31:0/3538870679 wait complete. 2023-10-09T06:22:07.089 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-09T06:22:07.224 INFO:teuthology.orchestra.run.smithi031.stdout:{"osd_objectstore":"memstore"} 2023-10-09T06:22:07.224 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-09T06:22:07.225 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:22:07.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.345+0000 7fa7c5c95700 1 Processor -- start 2023-10-09T06:22:07.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.345+0000 7fa7c5c95700 1 -- start start 2023-10-09T06:22:07.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.346+0000 7fa7c5c95700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa7c00b06b0 0x7fa7c00b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.346+0000 7fa7c5c95700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7c00cf5a0 0x7fa7c00b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.346+0000 7fa7c5c95700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c0069680 con 0x7fa7c0069240 2023-10-09T06:22:07.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.346+0000 7fa7c5c95700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c00ce7e0 con 0x7fa7c00b06b0 2023-10-09T06:22:07.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.346+0000 7fa7c5c95700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00ceac0 con 0x7fa7c00cf5a0 2023-10-09T06:22:07.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.346+0000 7fa7c5494700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa7c0069240 0x7fa7c01597b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54804/0 (socket says 172.21.15.31:54804) 2023-10-09T06:22:07.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.346+0000 7fa7c5494700 1 -- 172.21.15.31:0/2967787846 learned_addr learned my addr 172.21.15.31:0/2967787846 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:07.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7c4c93700 1 --2- 172.21.15.31:0/2967787846 >> v2:172.21.15.158:3300/0 conn(0x7fa7c00b06b0 0x7fa7c00b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bffff700 1 --2- 172.21.15.31:0/2967787846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7c00cf5a0 0x7fa7c00b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127981646 0 0) 0x7fa7c0069680 con 0x7fa7c0069240 2023-10-09T06:22:07.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a8003570 con 0x7fa7c0069240 2023-10-09T06:22:07.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640838441 0 0) 0x7fa7a8003570 con 0x7fa7c0069240 2023-10-09T06:22:07.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7c00cf5a0 msgr2=0x7fa7c00b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 --2- 172.21.15.31:0/2967787846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7c00cf5a0 0x7fa7c00b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 >> v2:172.21.15.158:3300/0 conn(0x7fa7c00b06b0 msgr2=0x7fa7c00b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 --2- 172.21.15.31:0/2967787846 >> v2:172.21.15.158:3300/0 conn(0x7fa7c00b06b0 0x7fa7c00b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c00ceda0 con 0x7fa7c0069240 2023-10-09T06:22:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fa7b0001470 con 0x7fa7c0069240 2023-10-09T06:22:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 >> v1:172.21.15.31:6789/0 conn(0x7fa7c0069240 legacy=0x7fa7c01597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 --2- 172.21.15.31:0/2967787846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7c00cf5a0 0x7fa7a8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 --2- 172.21.15.31:0/2967787846 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7a8003fe0 0x7fa7a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 --2- 172.21.15.31:0/2967787846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a8004d50 0x7fa7a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00ce7e0 con 0x7fa7a8004d50 2023-10-09T06:22:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00ceac0 con 0x7fa7a8003fe0 2023-10-09T06:22:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a800ba90 con 0x7fa7c00cf5a0 2023-10-09T06:22:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7c5494700 1 --2- 172.21.15.31:0/2967787846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a8004d50 0x7fa7a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7c4c93700 1 --2- 172.21.15.31:0/2967787846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7c00cf5a0 0x7fa7a8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bffff700 1 --2- 172.21.15.31:0/2967787846 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7a8003fe0 0x7fa7a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7c5494700 1 -- 172.21.15.31:0/2967787846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7c00cf5a0 msgr2=0x7fa7a8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7c5494700 1 --2- 172.21.15.31:0/2967787846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7c00cf5a0 0x7fa7a8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7c5494700 1 -- 172.21.15.31:0/2967787846 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7a8003fe0 msgr2=0x7fa7a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7c5494700 1 --2- 172.21.15.31:0/2967787846 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7a8003fe0 0x7fa7a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7c5494700 1 -- 172.21.15.31:0/2967787846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a8003570 con 0x7fa7a8004d50 2023-10-09T06:22:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.347+0000 7fa7bffff700 1 --2- 172.21.15.31:0/2967787846 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7a8003fe0 0x7fa7a8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.348+0000 7fa7c5494700 1 --2- 172.21.15.31:0/2967787846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a8004d50 0x7fa7a80051c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c3c0 tx=0x7fa7b0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc65b9550340e002 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:07.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.348+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000cc30 con 0x7fa7a8004d50 2023-10-09T06:22:07.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.348+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b000cdb0 con 0x7fa7a8004d50 2023-10-09T06:22:07.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.348+0000 7fa7bf7fe700 1 -- 172.21.15.31:0/2967787846 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0005b70 con 0x7fa7a8004d50 2023-10-09T06:22:07.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.348+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2967787846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a8004d50 msgr2=0x7fa7a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:07.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.348+0000 7fa7c5c95700 1 --2- 172.21.15.31:0/2967787846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a8004d50 0x7fa7a80051c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c3c0 tx=0x7fa7b0001e90 comp rx=0 tx=0).stop 2023-10-09T06:22:07.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.348+0000 7fa7c5494700 1 -- 172.21.15.31:0/2967787846 reap_dead start 2023-10-09T06:22:07.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.348+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2967787846 shutdown_connections 2023-10-09T06:22:07.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.348+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2967787846 >> 172.21.15.31:0/2967787846 conn(0x7fa7c006c700 msgr2=0x7fa7c0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:07.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.348+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2967787846 shutdown_connections 2023-10-09T06:22:07.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.348+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2967787846 wait complete. 2023-10-09T06:22:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.349+0000 7fa7c5c95700 1 Processor -- start 2023-10-09T06:22:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.350+0000 7fa7c5c95700 1 -- start start 2023-10-09T06:22:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.350+0000 7fa7c5c95700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7c0155590 0x7fa7c016ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.350+0000 7fa7c5c95700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7c015c220 0x7fa7c015fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.350+0000 7fa7c5c95700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7c0160080 0x7fa7c015a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.350+0000 7fa7c5c95700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c0155960 con 0x7fa7c0160080 2023-10-09T06:22:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.350+0000 7fa7c5c95700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c015bbe0 con 0x7fa7c0155590 2023-10-09T06:22:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.350+0000 7fa7c5c95700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c01604f0 con 0x7fa7c015c220 2023-10-09T06:22:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.350+0000 7fa7c5494700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7c0160080 0x7fa7c015a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.350+0000 7fa7c5494700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7c0160080 0x7fa7c015a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46694/0 (socket says 172.21.15.31:46694) 2023-10-09T06:22:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.350+0000 7fa7c5494700 1 -- 172.21.15.31:0/2206067930 learned_addr learned my addr 172.21.15.31:0/2206067930 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.350+0000 7fa7c4c93700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7c0155590 0x7fa7c016ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.350+0000 7fa7bffff700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7c015c220 0x7fa7c015fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.351+0000 7fa7c5494700 1 -- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7c015c220 msgr2=0x7fa7c015fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.351+0000 7fa7c5494700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7c015c220 0x7fa7c015fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.351+0000 7fa7c5494700 1 -- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7c0155590 msgr2=0x7fa7c016ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.351+0000 7fa7c5494700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7c0155590 0x7fa7c016ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.351+0000 7fa7c5494700 1 -- 172.21.15.31:0/2206067930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c016b050 con 0x7fa7c0160080 2023-10-09T06:22:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.351+0000 7fa7c5494700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7c0160080 0x7fa7c015a550 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0011000 tx=0x7fa7b0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.351+0000 7fa7bcff9700 1 -- 172.21.15.31:0/2206067930 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0022070 con 0x7fa7c0160080 2023-10-09T06:22:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.351+0000 7fa7bcff9700 1 -- 172.21.15.31:0/2206067930 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b000cc30 con 0x7fa7c0160080 2023-10-09T06:22:07.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.351+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2206067930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c015c720 con 0x7fa7c0160080 2023-10-09T06:22:07.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.351+0000 7fa7bcff9700 1 -- 172.21.15.31:0/2206067930 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0007550 con 0x7fa7c0160080 2023-10-09T06:22:07.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.351+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2206067930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c015cce0 con 0x7fa7c0160080 2023-10-09T06:22:07.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.352+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2206067930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c00c7c40 con 0x7fa7c0160080 2023-10-09T06:22:07.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.352+0000 7fa7bcff9700 1 -- 172.21.15.31:0/2206067930 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7b001e430 con 0x7fa7c0160080 2023-10-09T06:22:07.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.353+0000 7fa7bcff9700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa7ac066f30 0x7fa7ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.353+0000 7fa7bcff9700 1 -- 172.21.15.31:0/2206067930 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa7b0084b30 con 0x7fa7c0160080 2023-10-09T06:22:07.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.353+0000 7fa7c4c93700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa7ac066f30 0x7fa7ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.353+0000 7fa7c4c93700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa7ac066f30 0x7fa7ac0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa7c01606f0 tx=0x7fa7b800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:07.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.357+0000 7fa7bcff9700 1 -- 172.21.15.31:0/2206067930 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7c00c7c40 con 0x7fa7c0160080 2023-10-09T06:22:07.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.549+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2206067930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa7c00c7c40 con 0x7fa7c0160080 2023-10-09T06:22:07.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.552+0000 7fa7bcff9700 1 -- 172.21.15.31:0/2206067930 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa7c00c7c40 con 0x7fa7c0160080 2023-10-09T06:22:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.554+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa7ac066f30 msgr2=0x7fa7ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.554+0000 7fa7c5c95700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa7ac066f30 0x7fa7ac0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa7c01606f0 tx=0x7fa7b800b040 comp rx=0 tx=0).stop 2023-10-09T06:22:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.554+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2206067930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7c0160080 msgr2=0x7fa7c015a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.554+0000 7fa7c5c95700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7c0160080 0x7fa7c015a550 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0011000 tx=0x7fa7b0015000 comp rx=0 tx=0).stop 2023-10-09T06:22:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.554+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2206067930 shutdown_connections 2023-10-09T06:22:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.554+0000 7fa7c5c95700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa7ac066f30 0x7fa7ac0693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.554+0000 7fa7c5c95700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7c0160080 0x7fa7c015a550 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.554+0000 7fa7c5c95700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa7c0155590 0x7fa7c016ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.554+0000 7fa7c5c95700 1 --2- 172.21.15.31:0/2206067930 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa7c015c220 0x7fa7c015fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.554+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2206067930 >> 172.21.15.31:0/2206067930 conn(0x7fa7c006c700 msgr2=0x7fa7c0068840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.554+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2206067930 shutdown_connections 2023-10-09T06:22:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.554+0000 7fa7c5c95700 1 -- 172.21.15.31:0/2206067930 wait complete. 2023-10-09T06:22:07.567 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:22:07.567 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:22:07.614 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:22:07.666 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:22:07.666 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:22:07.666 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:22:07.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.784+0000 7fbb2a589700 1 Processor -- start 2023-10-09T06:22:07.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.784+0000 7fbb2a589700 1 -- start start 2023-10-09T06:22:07.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.785+0000 7fbb2a589700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb24159e10 0x7fbb240b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.785+0000 7fbb2a589700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb2415a1e0 0x7fbb240b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.785+0000 7fbb2a589700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbb240b1610 0x7fbb240cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.785+0000 7fbb2a589700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2415e800 con 0x7fbb2415a1e0 2023-10-09T06:22:07.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.785+0000 7fbb2a589700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2415db80 con 0x7fbb240b1610 2023-10-09T06:22:07.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.785+0000 7fbb2a589700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2415de60 con 0x7fbb24159e10 2023-10-09T06:22:07.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.785+0000 7fbb237fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb2415a1e0 0x7fbb240b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.785+0000 7fbb237fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb2415a1e0 0x7fbb240b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46698/0 (socket says 172.21.15.31:46698) 2023-10-09T06:22:07.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.785+0000 7fbb237fe700 1 -- 172.21.15.31:0/3548576921 learned_addr learned my addr 172.21.15.31:0/3548576921 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:07.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.785+0000 7fbb23fff700 1 --2- 172.21.15.31:0/3548576921 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb24159e10 0x7fbb240b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.785+0000 7fbb28b26700 1 --2- 172.21.15.31:0/3548576921 >> v2:172.21.15.158:3300/0 conn(0x7fbb240b1610 0x7fbb240cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.786+0000 7fbb237fe700 1 -- 172.21.15.31:0/3548576921 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb24159e10 msgr2=0x7fbb240b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:07.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.786+0000 7fbb237fe700 1 --2- 172.21.15.31:0/3548576921 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb24159e10 0x7fbb240b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.786+0000 7fbb237fe700 1 -- 172.21.15.31:0/3548576921 >> v2:172.21.15.158:3300/0 conn(0x7fbb240b1610 msgr2=0x7fbb240cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:07.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.786+0000 7fbb237fe700 1 --2- 172.21.15.31:0/3548576921 >> v2:172.21.15.158:3300/0 conn(0x7fbb240b1610 0x7fbb240cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.786+0000 7fbb237fe700 1 -- 172.21.15.31:0/3548576921 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2415e140 con 0x7fbb2415a1e0 2023-10-09T06:22:07.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.786+0000 7fbb23fff700 1 --2- 172.21.15.31:0/3548576921 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb24159e10 0x7fbb240b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:07.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.786+0000 7fbb28b26700 1 --2- 172.21.15.31:0/3548576921 >> v2:172.21.15.158:3300/0 conn(0x7fbb240b1610 0x7fbb240cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:07.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.786+0000 7fbb237fe700 1 --2- 172.21.15.31:0/3548576921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb2415a1e0 0x7fbb240b3260 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbb24069d00 tx=0x7fbb0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6d5aa39900895b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:07.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.786+0000 7fbb22ffd700 1 -- 172.21.15.31:0/3548576921 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c00b860 con 0x7fbb2415a1e0 2023-10-09T06:22:07.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.786+0000 7fbb22ffd700 1 -- 172.21.15.31:0/3548576921 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c00b9c0 con 0x7fbb2415a1e0 2023-10-09T06:22:07.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.786+0000 7fbb22ffd700 1 -- 172.21.15.31:0/3548576921 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c00bd60 con 0x7fbb2415a1e0 2023-10-09T06:22:07.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.787+0000 7fbb2a589700 1 -- 172.21.15.31:0/3548576921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb2415a1e0 msgr2=0x7fbb240b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:07.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.787+0000 7fbb2a589700 1 --2- 172.21.15.31:0/3548576921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb2415a1e0 0x7fbb240b3260 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbb24069d00 tx=0x7fbb0c009250 comp rx=0 tx=0).stop 2023-10-09T06:22:07.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.787+0000 7fbb2a589700 1 -- 172.21.15.31:0/3548576921 shutdown_connections 2023-10-09T06:22:07.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.787+0000 7fbb2a589700 1 --2- 172.21.15.31:0/3548576921 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb24159e10 0x7fbb240b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.787+0000 7fbb2a589700 1 --2- 172.21.15.31:0/3548576921 >> v2:172.21.15.158:3300/0 conn(0x7fbb240b1610 0x7fbb240cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.787+0000 7fbb2a589700 1 --2- 172.21.15.31:0/3548576921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb2415a1e0 0x7fbb240b3260 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.787+0000 7fbb2a589700 1 -- 172.21.15.31:0/3548576921 >> 172.21.15.31:0/3548576921 conn(0x7fbb24067660 msgr2=0x7fbb24067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:07.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.787+0000 7fbb2a589700 1 -- 172.21.15.31:0/3548576921 shutdown_connections 2023-10-09T06:22:07.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.787+0000 7fbb2a589700 1 -- 172.21.15.31:0/3548576921 wait complete. 2023-10-09T06:22:07.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.788+0000 7fbb2a589700 1 Processor -- start 2023-10-09T06:22:07.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.788+0000 7fbb2a589700 1 -- start start 2023-10-09T06:22:07.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb2a589700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb240b1610 0x7fbb2415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb2a589700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb24159e10 0x7fbb240c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb2a589700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb2415a1e0 0x7fbb240c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb2a589700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240ced80 con 0x7fbb240b1610 2023-10-09T06:22:07.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb2a589700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2415a5d0 con 0x7fbb2415a1e0 2023-10-09T06:22:07.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb2a589700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240c7240 con 0x7fbb24159e10 2023-10-09T06:22:07.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb23fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb240b1610 0x7fbb2415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb23fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb240b1610 0x7fbb2415d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46704/0 (socket says 172.21.15.31:46704) 2023-10-09T06:22:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb23fff700 1 -- 172.21.15.31:0/4196704681 learned_addr learned my addr 172.21.15.31:0/4196704681 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb23fff700 1 -- 172.21.15.31:0/4196704681 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb24159e10 msgr2=0x7fbb240c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb23fff700 1 --2- 172.21.15.31:0/4196704681 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb24159e10 0x7fbb240c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb23fff700 1 -- 172.21.15.31:0/4196704681 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb2415a1e0 msgr2=0x7fbb240c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb23fff700 1 --2- 172.21.15.31:0/4196704681 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb2415a1e0 0x7fbb240c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb23fff700 1 -- 172.21.15.31:0/4196704681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0094f0 con 0x7fbb240b1610 2023-10-09T06:22:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb23fff700 1 --2- 172.21.15.31:0/4196704681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb240b1610 0x7fbb2415d200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400e850 tx=0x7fbb14008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb1bfff700 1 -- 172.21.15.31:0/4196704681 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14013410 con 0x7fbb240b1610 2023-10-09T06:22:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb1bfff700 1 -- 172.21.15.31:0/4196704681 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb14013570 con 0x7fbb240b1610 2023-10-09T06:22:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb2a589700 1 -- 172.21.15.31:0/4196704681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb240c7520 con 0x7fbb240b1610 2023-10-09T06:22:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb1bfff700 1 -- 172.21.15.31:0/4196704681 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14013910 con 0x7fbb240b1610 2023-10-09T06:22:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.789+0000 7fbb2a589700 1 -- 172.21.15.31:0/4196704681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb240c84d0 con 0x7fbb240b1610 2023-10-09T06:22:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.790+0000 7fbb2a589700 1 -- 172.21.15.31:0/4196704681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb240ce850 con 0x7fbb240b1610 2023-10-09T06:22:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.791+0000 7fbb1bfff700 1 -- 172.21.15.31:0/4196704681 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb14013d00 con 0x7fbb240b1610 2023-10-09T06:22:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.791+0000 7fbb1bfff700 1 --2- 172.21.15.31:0/4196704681 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb04066f30 0x7fbb040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.791+0000 7fbb1bfff700 1 -- 172.21.15.31:0/4196704681 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbb14084080 con 0x7fbb240b1610 2023-10-09T06:22:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.792+0000 7fbb237fe700 1 --2- 172.21.15.31:0/4196704681 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb04066f30 0x7fbb040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.792+0000 7fbb237fe700 1 --2- 172.21.15.31:0/4196704681 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb04066f30 0x7fbb040693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb24069d00 tx=0x7fbb0c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:07.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:07.796+0000 7fbb1bfff700 1 -- 172.21.15.31:0/4196704681 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb140515f0 con 0x7fbb240b1610 2023-10-09T06:22:08.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.031+0000 7fbb2a589700 1 -- 172.21.15.31:0/4196704681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb241518f0 con 0x7fbb240b1610 2023-10-09T06:22:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.032+0000 7fbb1bfff700 1 -- 172.21.15.31:0/4196704681 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fbb14020de0 con 0x7fbb240b1610 2023-10-09T06:22:08.033 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:08.033 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1792934235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1792934235},{"type":"v1","addr":"172.21.15.158:6837","nonce":1792934235}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/1708540587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1708540587},{"type":"v1","addr":"172.21.15.158:6836","nonce":1708540587}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/893363730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":893363730},{"type":"v1","addr":"172.21.15.31:6834","nonce":893363730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4923,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2780075004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2780075004},{"type":"v1","addr":"172.21.15.31:6835","nonce":2780075004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[]} 2023-10-09T06:22:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.034+0000 7fbb2a589700 1 -- 172.21.15.31:0/4196704681 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb04066f30 msgr2=0x7fbb040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.034+0000 7fbb2a589700 1 --2- 172.21.15.31:0/4196704681 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb04066f30 0x7fbb040693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb24069d00 tx=0x7fbb0c017000 comp rx=0 tx=0).stop 2023-10-09T06:22:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.034+0000 7fbb2a589700 1 -- 172.21.15.31:0/4196704681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb240b1610 msgr2=0x7fbb2415d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.034+0000 7fbb2a589700 1 --2- 172.21.15.31:0/4196704681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb240b1610 0x7fbb2415d200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400e850 tx=0x7fbb14008040 comp rx=0 tx=0).stop 2023-10-09T06:22:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.034+0000 7fbb2a589700 1 -- 172.21.15.31:0/4196704681 shutdown_connections 2023-10-09T06:22:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.034+0000 7fbb2a589700 1 --2- 172.21.15.31:0/4196704681 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb04066f30 0x7fbb040693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.034+0000 7fbb2a589700 1 --2- 172.21.15.31:0/4196704681 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb2415a1e0 0x7fbb240c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.034+0000 7fbb2a589700 1 --2- 172.21.15.31:0/4196704681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb240b1610 0x7fbb2415d200 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:08.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.034+0000 7fbb2a589700 1 --2- 172.21.15.31:0/4196704681 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb24159e10 0x7fbb240c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:08.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.034+0000 7fbb2a589700 1 -- 172.21.15.31:0/4196704681 >> 172.21.15.31:0/4196704681 conn(0x7fbb24067660 msgr2=0x7fbb24063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:08.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.034+0000 7fbb2a589700 1 -- 172.21.15.31:0/4196704681 shutdown_connections 2023-10-09T06:22:08.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.034+0000 7fbb2a589700 1 -- 172.21.15.31:0/4196704681 wait complete. 2023-10-09T06:22:08.036 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 18 2023-10-09T06:22:08.047 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:22:08.047 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:22:08.047 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:22:08.047 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:22:08.047 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:22:08.047 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:22:08.048 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:22:08.048 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:22:08.048 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:22:08.048 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:22:08.048 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:22:08.048 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:22:08.049 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:22:08.049 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:22:08.049 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:22:08.049 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:22:08.055 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:22:08.055 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:22:08.056 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:22:08.056 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:22:08.058 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:22:08.059 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:22:08.059 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:22:08.059 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:22:08.098 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:22:08.098 DEBUG:teuthology.parallel:result is None 2023-10-09T06:22:08.099 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:22:08.099 DEBUG:teuthology.parallel:result is None 2023-10-09T06:22:08.102 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:22:08.102 DEBUG:teuthology.parallel:result is None 2023-10-09T06:22:08.102 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:22:08.103 DEBUG:teuthology.parallel:result is None 2023-10-09T06:22:08.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:22:08.173 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-10-09T06:22:08.174 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:22:08.183 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:22:08.183 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-09T06:22:08.184 INFO:tasks.ceph.mds.d.smithi158.stderr:2023-10-09T06:22:08.184+0000 7efd01585700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-09T06:22:08.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.228+0000 7f7546948700 1 Processor -- start 2023-10-09T06:22:08.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.229+0000 7f7546948700 1 -- start start 2023-10-09T06:22:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.229+0000 7f7546948700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f75401523f0 0x7f75400ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.229+0000 7f7546948700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75400cbb10 con 0x7f754015bf00 2023-10-09T06:22:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.229+0000 7f7546948700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75400cbfa0 con 0x7f7540152020 2023-10-09T06:22:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.229+0000 7f7546948700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75400caca0 con 0x7f75401523f0 2023-10-09T06:22:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f753f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f754015bf00 0x7f75401593c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54820/0 (socket says 172.21.15.31:54820) 2023-10-09T06:22:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f753f7fe700 1 -- 172.21.15.31:0/3526204126 learned_addr learned my addr 172.21.15.31:0/3526204126 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f7544ee5700 1 --2- 172.21.15.31:0/3526204126 >> v2:172.21.15.158:3300/0 conn(0x7f75401523f0 0x7f75400ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f753effd700 1 -- 172.21.15.31:0/3526204126 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118592054 0 0) 0x7f75400cbb10 con 0x7f754015bf00 2023-10-09T06:22:08.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f753effd700 1 -- 172.21.15.31:0/3526204126 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7528003570 con 0x7f754015bf00 2023-10-09T06:22:08.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f753effd700 1 -- 172.21.15.31:0/3526204126 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237819023 0 0) 0x7f75400cbfa0 con 0x7f7540152020 2023-10-09T06:22:08.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f753effd700 1 -- 172.21.15.31:0/3526204126 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75400cbb10 con 0x7f7540152020 2023-10-09T06:22:08.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f7544ee5700 1 -- 172.21.15.31:0/3526204126 >> v1:172.21.15.158:6789/0 conn(0x7f7540152020 legacy=0x7f754015b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:08.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f7544ee5700 1 -- 172.21.15.31:0/3526204126 >> v1:172.21.15.31:6789/0 conn(0x7f754015bf00 legacy=0x7f75401593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:08.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f7544ee5700 1 -- 172.21.15.31:0/3526204126 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75400caf00 con 0x7f75401523f0 2023-10-09T06:22:08.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f7544ee5700 1 --2- 172.21.15.31:0/3526204126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75401523f0 0x7f75400ca760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7538009e60 tx=0x7f7538009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdb902232395eaa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:08.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f753effd700 1 -- 172.21.15.31:0/3526204126 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753800e070 con 0x7f75401523f0 2023-10-09T06:22:08.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f753effd700 1 -- 172.21.15.31:0/3526204126 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753800bab0 con 0x7f75401523f0 2023-10-09T06:22:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.230+0000 7f753effd700 1 -- 172.21.15.31:0/3526204126 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753800be30 con 0x7f75401523f0 2023-10-09T06:22:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.231+0000 7f7546948700 1 -- 172.21.15.31:0/3526204126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75401523f0 msgr2=0x7f75400ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.231+0000 7f7546948700 1 --2- 172.21.15.31:0/3526204126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75401523f0 0x7f75400ca760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7538009e60 tx=0x7f7538009780 comp rx=0 tx=0).stop 2023-10-09T06:22:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.231+0000 7f7546948700 1 -- 172.21.15.31:0/3526204126 shutdown_connections 2023-10-09T06:22:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.231+0000 7f7546948700 1 --2- 172.21.15.31:0/3526204126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75401523f0 0x7f75400ca760 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.231+0000 7f7546948700 1 -- 172.21.15.31:0/3526204126 >> 172.21.15.31:0/3526204126 conn(0x7f7540069870 msgr2=0x7f7540069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.231+0000 7f7546948700 1 -- 172.21.15.31:0/3526204126 shutdown_connections 2023-10-09T06:22:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.231+0000 7f7546948700 1 -- 172.21.15.31:0/3526204126 wait complete. 2023-10-09T06:22:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.232+0000 7f7546948700 1 Processor -- start 2023-10-09T06:22:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.232+0000 7f7546948700 1 -- start start 2023-10-09T06:22:08.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f7546948700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7540152020 0x7f754014af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f7546948700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f75401523f0 0x7f7540150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f7546948700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f754015bf00 0x7f7540150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f7546948700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754016b160 con 0x7f7540152020 2023-10-09T06:22:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f7546948700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754016ae80 con 0x7f754015bf00 2023-10-09T06:22:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f7546948700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7540157650 con 0x7f75401523f0 2023-10-09T06:22:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f753ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7540152020 0x7f754014af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f753ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7540152020 0x7f754014af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46732/0 (socket says 172.21.15.31:46732) 2023-10-09T06:22:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f753ffff700 1 -- 172.21.15.31:0/3188733144 learned_addr learned my addr 172.21.15.31:0/3188733144 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f753f7fe700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f75401523f0 0x7f7540150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f7544ee5700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f754015bf00 0x7f7540150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f753ffff700 1 -- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f75401523f0 msgr2=0x7f7540150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f753ffff700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f75401523f0 0x7f7540150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f753ffff700 1 -- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f754015bf00 msgr2=0x7f7540150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f753ffff700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f754015bf00 0x7f7540150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f753ffff700 1 -- 172.21.15.31:0/3188733144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7538009a20 con 0x7f7540152020 2023-10-09T06:22:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.233+0000 7f753ffff700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7540152020 0x7f754014af20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f753000c7c0 tx=0x7f7530007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.234+0000 7f7527fff700 1 -- 172.21.15.31:0/3188733144 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530010510 con 0x7f7540152020 2023-10-09T06:22:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.234+0000 7f7527fff700 1 -- 172.21.15.31:0/3188733144 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7530010670 con 0x7f7540152020 2023-10-09T06:22:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.234+0000 7f7546948700 1 -- 172.21.15.31:0/3188733144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7540157930 con 0x7f7540152020 2023-10-09T06:22:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.234+0000 7f7527fff700 1 -- 172.21.15.31:0/3188733144 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530010a30 con 0x7f7540152020 2023-10-09T06:22:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.234+0000 7f7546948700 1 -- 172.21.15.31:0/3188733144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754014b460 con 0x7f7540152020 2023-10-09T06:22:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.234+0000 7f7546948700 1 -- 172.21.15.31:0/3188733144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75401574b0 con 0x7f7540152020 2023-10-09T06:22:08.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.235+0000 7f7527fff700 1 -- 172.21.15.31:0/3188733144 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f753001b400 con 0x7f7540152020 2023-10-09T06:22:08.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.235+0000 7f7527fff700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f752c066f30 0x7f752c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:08.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.235+0000 7f7527fff700 1 -- 172.21.15.31:0/3188733144 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7530083930 con 0x7f7540152020 2023-10-09T06:22:08.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.236+0000 7f753f7fe700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f752c066f30 0x7f752c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:08.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.236+0000 7f753f7fe700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f752c066f30 0x7f752c0693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f754015b330 tx=0x7f7534009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:08.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.239+0000 7f7527fff700 1 -- 172.21.15.31:0/3188733144 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f753004b5a0 con 0x7f7540152020 2023-10-09T06:22:08.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:08.450+0000 7f7546948700 1 -- 172.21.15.31:0/3188733144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7540157e50 con 0x7f7540152020 2023-10-09T06:22:09.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.093+0000 7f7527fff700 1 -- 172.21.15.31:0/3188733144 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7530016020 con 0x7f7540152020 2023-10-09T06:22:09.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.095+0000 7f7546948700 1 -- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f752c066f30 msgr2=0x7f752c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.095+0000 7f7546948700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f752c066f30 0x7f752c0693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f754015b330 tx=0x7f7534009040 comp rx=0 tx=0).stop 2023-10-09T06:22:09.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.095+0000 7f7546948700 1 -- 172.21.15.31:0/3188733144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7540152020 msgr2=0x7f754014af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.095+0000 7f7546948700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7540152020 0x7f754014af20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f753000c7c0 tx=0x7f7530007dc0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.095+0000 7f7546948700 1 -- 172.21.15.31:0/3188733144 shutdown_connections 2023-10-09T06:22:09.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.095+0000 7f7546948700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f752c066f30 0x7f752c0693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.095+0000 7f7546948700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f754015bf00 0x7f7540150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.095+0000 7f7546948700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7540152020 0x7f754014af20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.095+0000 7f7546948700 1 --2- 172.21.15.31:0/3188733144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f75401523f0 0x7f7540150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.095+0000 7f7546948700 1 -- 172.21.15.31:0/3188733144 >> 172.21.15.31:0/3188733144 conn(0x7f7540069870 msgr2=0x7f754014e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:09.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.095+0000 7f7546948700 1 -- 172.21.15.31:0/3188733144 shutdown_connections 2023-10-09T06:22:09.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.095+0000 7f7546948700 1 -- 172.21.15.31:0/3188733144 wait complete. 2023-10-09T06:22:09.098 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2023-10-09T06:22:09.110 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:22:09.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.232+0000 7f213051b700 1 Processor -- start 2023-10-09T06:22:09.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.232+0000 7f213051b700 1 -- start start 2023-10-09T06:22:09.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.233+0000 7f213051b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f212815a2b0 0x7f21280b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.233+0000 7f213051b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f21280cfe20 0x7f21280ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.233+0000 7f213051b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280c5d80 con 0x7f21280d1c30 2023-10-09T06:22:09.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.233+0000 7f213051b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2128068470 con 0x7f21280cfe20 2023-10-09T06:22:09.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.233+0000 7f213051b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21280c6060 con 0x7f212815a2b0 2023-10-09T06:22:09.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.234+0000 7f212eab8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f21280cfe20 0x7f21280ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.234+0000 7f212e2b7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f212815a2b0 0x7f21280b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.234+0000 7f212dab6700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f21280d1c30 0x7f21280cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:44066/0 (socket says 172.21.15.31:44066) 2023-10-09T06:22:09.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.234+0000 7f212dab6700 1 -- 172.21.15.31:0/3570796400 learned_addr learned my addr 172.21.15.31:0/3570796400 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:09.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.234+0000 7f212d2b5700 1 -- 172.21.15.31:0/3570796400 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913543755 0 0) 0x7f21280c5d80 con 0x7f21280d1c30 2023-10-09T06:22:09.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.234+0000 7f212d2b5700 1 -- 172.21.15.31:0/3570796400 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2110003570 con 0x7f21280d1c30 2023-10-09T06:22:09.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.234+0000 7f212e2b7700 1 -- 172.21.15.31:0/3570796400 >> v2:172.21.15.158:3300/0 conn(0x7f21280cfe20 msgr2=0x7f21280ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:09.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.234+0000 7f212e2b7700 1 --2- 172.21.15.31:0/3570796400 >> v2:172.21.15.158:3300/0 conn(0x7f21280cfe20 0x7f21280ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.234+0000 7f212e2b7700 1 -- 172.21.15.31:0/3570796400 >> v1:172.21.15.158:6789/0 conn(0x7f21280d1c30 legacy=0x7f21280cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.234+0000 7f212e2b7700 1 -- 172.21.15.31:0/3570796400 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280c6340 con 0x7f212815a2b0 2023-10-09T06:22:09.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.234+0000 7f212eab8700 1 --2- 172.21.15.31:0/3570796400 >> v2:172.21.15.158:3300/0 conn(0x7f21280cfe20 0x7f21280ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:22:09.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.234+0000 7f212e2b7700 1 --2- 172.21.15.31:0/3570796400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f212815a2b0 0x7f21280b3da0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2118009eb0 tx=0x7f2118009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae56b2f642a65d20 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:09.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.235+0000 7f212d2b5700 1 -- 172.21.15.31:0/3570796400 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211800e070 con 0x7f212815a2b0 2023-10-09T06:22:09.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.235+0000 7f212d2b5700 1 -- 172.21.15.31:0/3570796400 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211800bb80 con 0x7f212815a2b0 2023-10-09T06:22:09.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.235+0000 7f212d2b5700 1 -- 172.21.15.31:0/3570796400 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118012430 con 0x7f212815a2b0 2023-10-09T06:22:09.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.235+0000 7f213051b700 1 -- 172.21.15.31:0/3570796400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f212815a2b0 msgr2=0x7f21280b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.235+0000 7f213051b700 1 --2- 172.21.15.31:0/3570796400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f212815a2b0 0x7f21280b3da0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2118009eb0 tx=0x7f2118009780 comp rx=0 tx=0).stop 2023-10-09T06:22:09.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.235+0000 7f213051b700 1 -- 172.21.15.31:0/3570796400 shutdown_connections 2023-10-09T06:22:09.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.235+0000 7f213051b700 1 --2- 172.21.15.31:0/3570796400 >> v2:172.21.15.158:3300/0 conn(0x7f21280cfe20 0x7f21280ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.235+0000 7f213051b700 1 --2- 172.21.15.31:0/3570796400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f212815a2b0 0x7f21280b3da0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.235+0000 7f213051b700 1 -- 172.21.15.31:0/3570796400 >> 172.21.15.31:0/3570796400 conn(0x7f2128067e40 msgr2=0x7f21280d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:09.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.235+0000 7f213051b700 1 -- 172.21.15.31:0/3570796400 shutdown_connections 2023-10-09T06:22:09.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.235+0000 7f213051b700 1 -- 172.21.15.31:0/3570796400 wait complete. 2023-10-09T06:22:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.236+0000 7f213051b700 1 Processor -- start 2023-10-09T06:22:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.236+0000 7f213051b700 1 -- start start 2023-10-09T06:22:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f213051b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21280cfe20 0x7f212816a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f213051b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21280d1c30 0x7f2128167490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f213051b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f212815a2b0 0x7f21280d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f213051b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21281679d0 con 0x7f21280d1c30 2023-10-09T06:22:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f213051b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212809b410 con 0x7f21280cfe20 2023-10-09T06:22:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f213051b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2128167b50 con 0x7f212815a2b0 2023-10-09T06:22:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f212dab6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21280d1c30 0x7f2128167490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f212dab6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21280d1c30 0x7f2128167490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46738/0 (socket says 172.21.15.31:46738) 2023-10-09T06:22:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f212dab6700 1 -- 172.21.15.31:0/2679202500 learned_addr learned my addr 172.21.15.31:0/2679202500 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f212eab8700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f212815a2b0 0x7f21280d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f212e2b7700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21280cfe20 0x7f212816a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f212dab6700 1 -- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f212815a2b0 msgr2=0x7f21280d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f212dab6700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f212815a2b0 0x7f21280d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f212dab6700 1 -- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21280cfe20 msgr2=0x7f212816a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f212dab6700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21280cfe20 0x7f212816a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f212dab6700 1 -- 172.21.15.31:0/2679202500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2120009420 con 0x7f21280d1c30 2023-10-09T06:22:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f212e2b7700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21280cfe20 0x7f212816a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.237+0000 7f212eab8700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f212815a2b0 0x7f21280d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.238+0000 7f212dab6700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21280d1c30 0x7f2128167490 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c560 tx=0x7f211c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.238+0000 7f21267fc700 1 -- 172.21.15.31:0/2679202500 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c005c00 con 0x7f21280d1c30 2023-10-09T06:22:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.238+0000 7f21267fc700 1 -- 172.21.15.31:0/2679202500 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c005d60 con 0x7f21280d1c30 2023-10-09T06:22:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.238+0000 7f213051b700 1 -- 172.21.15.31:0/2679202500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2118009a20 con 0x7f21280d1c30 2023-10-09T06:22:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.238+0000 7f21267fc700 1 -- 172.21.15.31:0/2679202500 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c007300 con 0x7f21280d1c30 2023-10-09T06:22:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.238+0000 7f213051b700 1 -- 172.21.15.31:0/2679202500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2128167d60 con 0x7f21280d1c30 2023-10-09T06:22:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.239+0000 7f213051b700 1 -- 172.21.15.31:0/2679202500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212804c3c0 con 0x7f21280d1c30 2023-10-09T06:22:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.239+0000 7f21267fc700 1 -- 172.21.15.31:0/2679202500 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f211c01b3b0 con 0x7f21280d1c30 2023-10-09T06:22:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.239+0000 7f21267fc700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2114066f30 0x7f21140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.240+0000 7f21267fc700 1 -- 172.21.15.31:0/2679202500 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f211c083850 con 0x7f21280d1c30 2023-10-09T06:22:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.240+0000 7f212e2b7700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2114066f30 0x7f21140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.240+0000 7f212e2b7700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2114066f30 0x7f21140693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f21180097c0 tx=0x7f2118019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:09.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.244+0000 7f21267fc700 1 -- 172.21.15.31:0/2679202500 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f211c050d70 con 0x7f21280d1c30 2023-10-09T06:22:09.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.512+0000 7f213051b700 1 -- 172.21.15.31:0/2679202500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f212815d7b0 con 0x7f21280d1c30 2023-10-09T06:22:09.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.512+0000 7f21267fc700 1 -- 172.21.15.31:0/2679202500 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f211c017020 con 0x7f21280d1c30 2023-10-09T06:22:09.513 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:09.513 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:22:09.513 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2023-10-09T06:22:09.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.513 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2023-10-09T06:22:09.514 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl/nWKAxAA1kcqjt4lPGPkmDivDpIVjQ==", 2023-10-09T06:22:09.514 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.514 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:22:09.514 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:22:09.514 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:22:09.514 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.514 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.514 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2023-10-09T06:22:09.514 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl9xYEDxAAQJeaqz7lkrArv45vLGb34g==", 2023-10-09T06:22:09.515 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.515 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:22:09.515 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:22:09.515 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:22:09.515 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.515 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.515 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2023-10-09T06:22:09.515 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlJOp0ChAADGiI4SX7ZLvDrtjDtU905A==", 2023-10-09T06:22:09.515 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.515 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:22:09.516 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:22:09.516 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:22:09.516 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.516 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.516 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2023-10-09T06:22:09.516 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlbnnJFRAAO+XoxRQDaHv0ZicyggniLQ==", 2023-10-09T06:22:09.516 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.516 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:22:09.516 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:22:09.516 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:22:09.517 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.517 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.517 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2023-10-09T06:22:09.517 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNloyZ+LxAApAHpPxV7R1OVE2wlIaU+PA==", 2023-10-09T06:22:09.517 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.517 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:22:09.517 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:22:09.518 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.518 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.519 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2023-10-09T06:22:09.519 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNlvHeUNhAAXblIEmmsc5eTo5VcZVirfA==", 2023-10-09T06:22:09.519 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.519 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:22:09.519 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:22:09.519 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.519 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.519 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2023-10-09T06:22:09.520 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlxfIaBBAAE8WbXh4Q4SxaW2k7MkSTHg==", 2023-10-09T06:22:09.520 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.520 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:22:09.520 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:22:09.520 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.520 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.520 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2023-10-09T06:22:09.520 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlUtX3DRAA5NEq+lFMzqhu1GF1ZWT2ag==", 2023-10-09T06:22:09.520 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.520 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:22:09.521 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:22:09.521 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.521 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.521 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2023-10-09T06:22:09.521 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlcWc5IBAA5e62AwhIuHdw4dTjnNS8hQ==", 2023-10-09T06:22:09.521 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.521 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:22:09.521 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:22:09.521 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.521 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.522 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2023-10-09T06:22:09.522 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlX5S6JhAAzvzO2YEqEtq2fJ3FW9Fddg==", 2023-10-09T06:22:09.522 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.522 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:22:09.522 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:22:09.522 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.522 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.523 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2023-10-09T06:22:09.523 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl9jy5LxAAxgMslSN6ayxB2MFRf2dwNQ==", 2023-10-09T06:22:09.523 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.523 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:22:09.523 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:22:09.523 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.523 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.523 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2023-10-09T06:22:09.523 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl8M+TOBAARhk2wEaXO9Pi4TP9d+L5Gg==", 2023-10-09T06:22:09.523 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.524 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:22:09.524 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:22:09.524 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.524 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.524 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2023-10-09T06:22:09.524 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlfsC2GRAAlm37QI8DkNclcBpD5ZBR7A==", 2023-10-09T06:22:09.524 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.525 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:22:09.525 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2023-10-09T06:22:09.525 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T06:22:09.525 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.525 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2023-10-09T06:22:09.525 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlapIxIhAAiBZUkpnf6tyFHwySGKhRpQ==", 2023-10-09T06:22:09.525 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.525 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2023-10-09T06:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEZYuHxAA7WEH0vXmAEH5Wki8ESrDBg==", 2023-10-09T06:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2023-10-09T06:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlFvuIJxAAGuTp4gsXrvUzDd1B7d5vcg==", 2023-10-09T06:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2023-10-09T06:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlS8AlJBAAg8lLRVasKHyhbFlOTfgt9g==", 2023-10-09T06:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.530 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.530 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2023-10-09T06:22:09.530 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEE9eABAAHbJ1yvlmOUNo6n2uAhPrnw==", 2023-10-09T06:22:09.530 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.530 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:22:09.530 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:22:09.531 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.531 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:09.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:09.531 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2023-10-09T06:22:09.531 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlhol5OBAAZSZ+PbojVwsOJtLlTl6wAA==", 2023-10-09T06:22:09.531 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:22:09.531 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:22:09.531 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:22:09.532 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:22:09.532 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.532 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:09.532 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:09.532 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:22:09.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.514+0000 7f213051b700 1 -- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2114066f30 msgr2=0x7f21140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.514+0000 7f213051b700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2114066f30 0x7f21140693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f21180097c0 tx=0x7f2118019000 comp rx=0 tx=0).stop 2023-10-09T06:22:09.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.514+0000 7f213051b700 1 -- 172.21.15.31:0/2679202500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21280d1c30 msgr2=0x7f2128167490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.514+0000 7f213051b700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21280d1c30 0x7f2128167490 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c560 tx=0x7f211c007dd0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.514+0000 7f213051b700 1 -- 172.21.15.31:0/2679202500 shutdown_connections 2023-10-09T06:22:09.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.514+0000 7f213051b700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2114066f30 0x7f21140693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.514+0000 7f213051b700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f212815a2b0 0x7f21280d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.514+0000 7f213051b700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21280cfe20 0x7f212816a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.514+0000 7f213051b700 1 --2- 172.21.15.31:0/2679202500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21280d1c30 0x7f2128167490 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.514+0000 7f213051b700 1 -- 172.21.15.31:0/2679202500 >> 172.21.15.31:0/2679202500 conn(0x7f2128067e40 msgr2=0x7f21280ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:09.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.514+0000 7f213051b700 1 -- 172.21.15.31:0/2679202500 shutdown_connections 2023-10-09T06:22:09.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.514+0000 7f213051b700 1 -- 172.21.15.31:0/2679202500 wait complete. 2023-10-09T06:22:09.536 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:22:09.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.654+0000 7fd94597f700 1 Processor -- start 2023-10-09T06:22:09.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.654+0000 7fd94597f700 1 -- start start 2023-10-09T06:22:09.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.655+0000 7fd94597f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd940157870 0x7fd94015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.655+0000 7fd94597f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd940157c40 0x7fd940158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.655+0000 7fd94597f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94015cbb0 con 0x7fd94015a620 2023-10-09T06:22:09.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.655+0000 7fd94597f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94015bfa0 con 0x7fd940157870 2023-10-09T06:22:09.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.655+0000 7fd94597f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94015c280 con 0x7fd940157c40 2023-10-09T06:22:09.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.655+0000 7fd93e7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd94015a620 0x7fd94015d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53408/0 (socket says 172.21.15.31:53408) 2023-10-09T06:22:09.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.655+0000 7fd93e7fc700 1 -- 172.21.15.31:0/2379706153 learned_addr learned my addr 172.21.15.31:0/2379706153 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:09.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93effd700 1 --2- 172.21.15.31:0/2379706153 >> v2:172.21.15.158:3300/0 conn(0x7fd940157870 0x7fd94015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93f7fe700 1 --2- 172.21.15.31:0/2379706153 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd940157c40 0x7fd940158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682654699 0 0) 0x7fd94015cbb0 con 0x7fd94015a620 2023-10-09T06:22:09.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd92c003570 con 0x7fd94015a620 2023-10-09T06:22:09.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1460108052 0 0) 0x7fd92c003570 con 0x7fd94015a620 2023-10-09T06:22:09.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd940157c40 msgr2=0x7fd940158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:09.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 --2- 172.21.15.31:0/2379706153 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd940157c40 0x7fd940158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 >> v2:172.21.15.158:3300/0 conn(0x7fd940157870 msgr2=0x7fd94015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:09.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 --2- 172.21.15.31:0/2379706153 >> v2:172.21.15.158:3300/0 conn(0x7fd940157870 0x7fd94015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94015c560 con 0x7fd94015a620 2023-10-09T06:22:09.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fd928001470 con 0x7fd94015a620 2023-10-09T06:22:09.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 >> v1:172.21.15.31:6789/0 conn(0x7fd94015a620 legacy=0x7fd94015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 --2- 172.21.15.31:0/2379706153 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd92c003a60 0x7fd92c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 --2- 172.21.15.31:0/2379706153 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd940157c40 0x7fd92c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 --2- 172.21.15.31:0/2379706153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd92c004d50 0x7fd92c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94015bfa0 con 0x7fd92c004d50 2023-10-09T06:22:09.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94015c280 con 0x7fd92c003a60 2023-10-09T06:22:09.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92c00ba60 con 0x7fd940157c40 2023-10-09T06:22:09.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93effd700 1 --2- 172.21.15.31:0/2379706153 >> v2:172.21.15.158:3300/0 conn(0x7fd940157870 0x7fd94015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:22:09.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93f7fe700 1 --2- 172.21.15.31:0/2379706153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd92c004d50 0x7fd92c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93e7fc700 1 --2- 172.21.15.31:0/2379706153 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd940157c40 0x7fd92c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.656+0000 7fd93effd700 1 --2- 172.21.15.31:0/2379706153 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd92c003a60 0x7fd92c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd93f7fe700 1 -- 172.21.15.31:0/2379706153 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd940157c40 msgr2=0x7fd92c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:09.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd93f7fe700 1 --2- 172.21.15.31:0/2379706153 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd940157c40 0x7fd92c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd93f7fe700 1 -- 172.21.15.31:0/2379706153 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd92c003a60 msgr2=0x7fd92c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:09.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd93f7fe700 1 --2- 172.21.15.31:0/2379706153 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd92c003a60 0x7fd92c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd93f7fe700 1 -- 172.21.15.31:0/2379706153 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92c003570 con 0x7fd92c004d50 2023-10-09T06:22:09.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd93f7fe700 1 --2- 172.21.15.31:0/2379706153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd92c004d50 0x7fd92c0051c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd9401580c0 tx=0x7fd9380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e78b5d713fcbb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:09.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93800e6b0 con 0x7fd92c004d50 2023-10-09T06:22:09.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93800e810 con 0x7fd92c004d50 2023-10-09T06:22:09.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd93dffb700 1 -- 172.21.15.31:0/2379706153 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93800ebd0 con 0x7fd92c004d50 2023-10-09T06:22:09.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd94597f700 1 -- 172.21.15.31:0/2379706153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd92c004d50 msgr2=0x7fd92c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd94597f700 1 --2- 172.21.15.31:0/2379706153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd92c004d50 0x7fd92c0051c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd9401580c0 tx=0x7fd9380091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd93f7fe700 1 -- 172.21.15.31:0/2379706153 reap_dead start 2023-10-09T06:22:09.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd94597f700 1 -- 172.21.15.31:0/2379706153 shutdown_connections 2023-10-09T06:22:09.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd94597f700 1 -- 172.21.15.31:0/2379706153 >> 172.21.15.31:0/2379706153 conn(0x7fd940068ce0 msgr2=0x7fd9400690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:09.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd94597f700 1 -- 172.21.15.31:0/2379706153 shutdown_connections 2023-10-09T06:22:09.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.657+0000 7fd94597f700 1 -- 172.21.15.31:0/2379706153 wait complete. 2023-10-09T06:22:09.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.659+0000 7fd94597f700 1 Processor -- start 2023-10-09T06:22:09.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.659+0000 7fd94597f700 1 -- start start 2023-10-09T06:22:09.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.659+0000 7fd94597f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd92c004d50 0x7fd9401604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.659+0000 7fd94597f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9400b1fc0 0x7fd940150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.659+0000 7fd94597f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9400b2430 0x7fd940150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.659+0000 7fd94597f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9401524d0 con 0x7fd92c004d50 2023-10-09T06:22:09.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.659+0000 7fd94597f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd940150dc0 con 0x7fd9400b1fc0 2023-10-09T06:22:09.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.659+0000 7fd94597f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd940160a10 con 0x7fd9400b2430 2023-10-09T06:22:09.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd93effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd92c004d50 0x7fd9401604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd93effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd92c004d50 0x7fd9401604d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35620/0 (socket says 172.21.15.31:35620) 2023-10-09T06:22:09.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd93effd700 1 -- 172.21.15.31:0/430038053 learned_addr learned my addr 172.21.15.31:0/430038053 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:09.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd93f7fe700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9400b2430 0x7fd940150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd93e7fc700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9400b1fc0 0x7fd940150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd93effd700 1 -- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9400b2430 msgr2=0x7fd940150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd93effd700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9400b2430 0x7fd940150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd93effd700 1 -- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9400b1fc0 msgr2=0x7fd940150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd93effd700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9400b1fc0 0x7fd940150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd93effd700 1 -- 172.21.15.31:0/430038053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94016e3b0 con 0x7fd92c004d50 2023-10-09T06:22:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd93e7fc700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9400b1fc0 0x7fd940150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd93f7fe700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9400b2430 0x7fd940150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd93effd700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd92c004d50 0x7fd9401604d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd93000f1e0 tx=0x7fd93000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd936ffd700 1 -- 172.21.15.31:0/430038053 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93000e040 con 0x7fd92c004d50 2023-10-09T06:22:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd936ffd700 1 -- 172.21.15.31:0/430038053 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93000f040 con 0x7fd92c004d50 2023-10-09T06:22:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd94597f700 1 -- 172.21.15.31:0/430038053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94016e690 con 0x7fd92c004d50 2023-10-09T06:22:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd936ffd700 1 -- 172.21.15.31:0/430038053 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd930015680 con 0x7fd92c004d50 2023-10-09T06:22:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.660+0000 7fd94597f700 1 -- 172.21.15.31:0/430038053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94016ec50 con 0x7fd92c004d50 2023-10-09T06:22:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.661+0000 7fd94597f700 1 -- 172.21.15.31:0/430038053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9400d0d50 con 0x7fd92c004d50 2023-10-09T06:22:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.661+0000 7fd936ffd700 1 -- 172.21.15.31:0/430038053 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd930015a30 con 0x7fd92c004d50 2023-10-09T06:22:09.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.662+0000 7fd936ffd700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd920066f60 0x7fd920069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.662+0000 7fd936ffd700 1 -- 172.21.15.31:0/430038053 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd930085110 con 0x7fd92c004d50 2023-10-09T06:22:09.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.662+0000 7fd93e7fc700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd920066f60 0x7fd920069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:09.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.663+0000 7fd93e7fc700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd920066f60 0x7fd920069410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd9280015a0 tx=0x7fd928009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:09.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.666+0000 7fd936ffd700 1 -- 172.21.15.31:0/430038053 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9300526d0 con 0x7fd92c004d50 2023-10-09T06:22:09.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.859+0000 7fd94597f700 1 -- 172.21.15.31:0/430038053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd94004c3c0 con 0x7fd92c004d50 2023-10-09T06:22:09.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.859+0000 7fd936ffd700 1 -- 172.21.15.31:0/430038053 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+12134 (secure 0 0 0) 0x7fd930055cf0 con 0x7fd92c004d50 2023-10-09T06:22:09.860 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:09.860 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":41,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:22:09.099185+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:22:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.862+0000 7fd94597f700 1 -- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd920066f60 msgr2=0x7fd920069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.862+0000 7fd94597f700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd920066f60 0x7fd920069410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd9280015a0 tx=0x7fd928009040 comp rx=0 tx=0).stop 2023-10-09T06:22:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.862+0000 7fd94597f700 1 -- 172.21.15.31:0/430038053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd92c004d50 msgr2=0x7fd9401604d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.862+0000 7fd94597f700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd92c004d50 0x7fd9401604d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd93000f1e0 tx=0x7fd93000b040 comp rx=0 tx=0).stop 2023-10-09T06:22:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.862+0000 7fd94597f700 1 -- 172.21.15.31:0/430038053 shutdown_connections 2023-10-09T06:22:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.862+0000 7fd94597f700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd920066f60 0x7fd920069410 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.862+0000 7fd94597f700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9400b2430 0x7fd940150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.862+0000 7fd94597f700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd92c004d50 0x7fd9401604d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.862+0000 7fd94597f700 1 --2- 172.21.15.31:0/430038053 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9400b1fc0 0x7fd940150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.862+0000 7fd94597f700 1 -- 172.21.15.31:0/430038053 >> 172.21.15.31:0/430038053 conn(0x7fd940068ce0 msgr2=0x7fd940159820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:09.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.862+0000 7fd94597f700 1 -- 172.21.15.31:0/430038053 shutdown_connections 2023-10-09T06:22:09.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.862+0000 7fd94597f700 1 -- 172.21.15.31:0/430038053 wait complete. 2023-10-09T06:22:09.874 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:22:09.875 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:22:09.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.998+0000 7f3d1a0d7700 1 Processor -- start 2023-10-09T06:22:09.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.998+0000 7f3d1a0d7700 1 -- start start 2023-10-09T06:22:09.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.998+0000 7f3d1a0d7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d1415a290 0x7f3d1406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.998+0000 7f3d1a0d7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3d1406aae0 0x7f3d140cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:09.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.998+0000 7f3d1a0d7700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d140b0790 con 0x7f3d14159ec0 2023-10-09T06:22:09.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.998+0000 7f3d1a0d7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1406af60 con 0x7f3d1406aae0 2023-10-09T06:22:09.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.998+0000 7f3d1a0d7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140ce1f0 con 0x7f3d1415a290 2023-10-09T06:22:10.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.999+0000 7f3d12ffd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d1415a290 0x7f3d1406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.999+0000 7f3d13fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3d1406aae0 0x7f3d140cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.999+0000 7f3d12ffd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d1415a290 0x7f3d1406a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:49704/0 (socket says 172.21.15.31:49704) 2023-10-09T06:22:10.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.999+0000 7f3d12ffd700 1 -- 172.21.15.31:0/1449923353 learned_addr learned my addr 172.21.15.31:0/1449923353 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:10.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.999+0000 7f3d137fe700 1 --1- 172.21.15.31:0/1449923353 >> v1:172.21.15.158:6789/0 conn(0x7f3d14159ec0 0x7f3d140af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:52008/0 (socket says 172.21.15.31:52008) 2023-10-09T06:22:10.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.999+0000 7f3d13fff700 1 -- 172.21.15.31:0/1449923353 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d1415a290 msgr2=0x7f3d1406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:10.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.999+0000 7f3d13fff700 1 --2- 172.21.15.31:0/1449923353 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d1415a290 0x7f3d1406a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.999+0000 7f3d13fff700 1 -- 172.21.15.31:0/1449923353 >> v1:172.21.15.158:6789/0 conn(0x7f3d14159ec0 legacy=0x7f3d140af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.999+0000 7f3d127fc700 1 -- 172.21.15.31:0/1449923353 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783305781 0 0) 0x7f3d140b0790 con 0x7f3d14159ec0 2023-10-09T06:22:10.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.999+0000 7f3d13fff700 1 -- 172.21.15.31:0/1449923353 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d140b0b20 con 0x7f3d1406aae0 2023-10-09T06:22:10.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:09.999+0000 7f3d13fff700 1 --2- 172.21.15.31:0/1449923353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d1406aae0 0x7f3d140cf590 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009e60 tx=0x7f3d0c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e6fd86d881747dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:10.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.000+0000 7f3d127fc700 1 -- 172.21.15.31:0/1449923353 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c00e070 con 0x7f3d1406aae0 2023-10-09T06:22:10.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.000+0000 7f3d127fc700 1 -- 172.21.15.31:0/1449923353 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c00bb60 con 0x7f3d1406aae0 2023-10-09T06:22:10.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.000+0000 7f3d127fc700 1 -- 172.21.15.31:0/1449923353 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c012430 con 0x7f3d1406aae0 2023-10-09T06:22:10.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.000+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1449923353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d1406aae0 msgr2=0x7f3d140cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.000+0000 7f3d1a0d7700 1 --2- 172.21.15.31:0/1449923353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d1406aae0 0x7f3d140cf590 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009e60 tx=0x7f3d0c009780 comp rx=0 tx=0).stop 2023-10-09T06:22:10.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.000+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1449923353 shutdown_connections 2023-10-09T06:22:10.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.000+0000 7f3d1a0d7700 1 --2- 172.21.15.31:0/1449923353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d1406aae0 0x7f3d140cf590 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.000+0000 7f3d1a0d7700 1 --2- 172.21.15.31:0/1449923353 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d1415a290 0x7f3d1406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.000+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1449923353 >> 172.21.15.31:0/1449923353 conn(0x7f3d140d1880 msgr2=0x7f3d140cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:10.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.000+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1449923353 shutdown_connections 2023-10-09T06:22:10.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.000+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1449923353 wait complete. 2023-10-09T06:22:10.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.001+0000 7f3d1a0d7700 1 Processor -- start 2023-10-09T06:22:10.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.001+0000 7f3d1a0d7700 1 -- start start 2023-10-09T06:22:10.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.002+0000 7f3d1a0d7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d1406aae0 0x7f3d1415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.002+0000 7f3d1a0d7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d14159ec0 0x7f3d141422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.002+0000 7f3d1a0d7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d1415a290 0x7f3d140b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.002+0000 7f3d1a0d7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1415d000 con 0x7f3d14159ec0 2023-10-09T06:22:10.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.002+0000 7f3d1a0d7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140b5ab0 con 0x7f3d1406aae0 2023-10-09T06:22:10.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.002+0000 7f3d1a0d7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140b4ea0 con 0x7f3d1415a290 2023-10-09T06:22:10.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.002+0000 7f3d12ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d14159ec0 0x7f3d141422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.002+0000 7f3d12ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d14159ec0 0x7f3d141422e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35636/0 (socket says 172.21.15.31:35636) 2023-10-09T06:22:10.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.002+0000 7f3d12ffd700 1 -- 172.21.15.31:0/1076361750 learned_addr learned my addr 172.21.15.31:0/1076361750 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:10.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.002+0000 7f3d13fff700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d1415a290 0x7f3d140b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.002+0000 7f3d137fe700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d1406aae0 0x7f3d1415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.003+0000 7f3d12ffd700 1 -- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d1415a290 msgr2=0x7f3d140b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.003+0000 7f3d12ffd700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d1415a290 0x7f3d140b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.003+0000 7f3d12ffd700 1 -- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d1406aae0 msgr2=0x7f3d1415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.003+0000 7f3d12ffd700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d1406aae0 0x7f3d1415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.003+0000 7f3d12ffd700 1 -- 172.21.15.31:0/1076361750 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c009a20 con 0x7f3d14159ec0 2023-10-09T06:22:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.003+0000 7f3d12ffd700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d14159ec0 0x7f3d141422e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400e9b0 tx=0x7f3d04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.003+0000 7f3d0b7fe700 1 -- 172.21.15.31:0/1076361750 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04013680 con 0x7f3d14159ec0 2023-10-09T06:22:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.003+0000 7f3d0b7fe700 1 -- 172.21.15.31:0/1076361750 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d040137e0 con 0x7f3d14159ec0 2023-10-09T06:22:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.003+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1076361750 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d140b5180 con 0x7f3d14159ec0 2023-10-09T06:22:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.003+0000 7f3d0b7fe700 1 -- 172.21.15.31:0/1076361750 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04013b60 con 0x7f3d14159ec0 2023-10-09T06:22:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.003+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1076361750 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d140b5740 con 0x7f3d14159ec0 2023-10-09T06:22:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.004+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1076361750 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d140b5c40 con 0x7f3d14159ec0 2023-10-09T06:22:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.004+0000 7f3d0b7fe700 1 -- 172.21.15.31:0/1076361750 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d0400c460 con 0x7f3d14159ec0 2023-10-09T06:22:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.005+0000 7f3d0b7fe700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3cf4066f30 0x7f3cf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.005+0000 7f3d0b7fe700 1 -- 172.21.15.31:0/1076361750 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3d04084290 con 0x7f3d14159ec0 2023-10-09T06:22:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.005+0000 7f3d137fe700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3cf4066f30 0x7f3cf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.006+0000 7f3d137fe700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3cf4066f30 0x7f3cf40693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc007fd0 tx=0x7f3cfc007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:10.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.009+0000 7f3d0b7fe700 1 -- 172.21.15.31:0/1076361750 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d040552e0 con 0x7f3d14159ec0 2023-10-09T06:22:10.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.203+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1076361750 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d1404c3c0 con 0x7f3d14159ec0 2023-10-09T06:22:10.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.203+0000 7f3d0b7fe700 1 -- 172.21.15.31:0/1076361750 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d04054e70 con 0x7f3d14159ec0 2023-10-09T06:22:10.204 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:22:10.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.205+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3cf4066f30 msgr2=0x7f3cf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.205+0000 7f3d1a0d7700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3cf4066f30 0x7f3cf40693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc007fd0 tx=0x7f3cfc007d50 comp rx=0 tx=0).stop 2023-10-09T06:22:10.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.205+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1076361750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d14159ec0 msgr2=0x7f3d141422e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.205+0000 7f3d1a0d7700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d14159ec0 0x7f3d141422e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400e9b0 tx=0x7f3d04009250 comp rx=0 tx=0).stop 2023-10-09T06:22:10.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.205+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1076361750 shutdown_connections 2023-10-09T06:22:10.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.205+0000 7f3d1a0d7700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3cf4066f30 0x7f3cf40693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.205+0000 7f3d1a0d7700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d1415a290 0x7f3d140b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.205+0000 7f3d1a0d7700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d1406aae0 0x7f3d1415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.205+0000 7f3d1a0d7700 1 --2- 172.21.15.31:0/1076361750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d14159ec0 0x7f3d141422e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.205+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1076361750 >> 172.21.15.31:0/1076361750 conn(0x7f3d140d1880 msgr2=0x7f3d14156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:10.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.205+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1076361750 shutdown_connections 2023-10-09T06:22:10.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.205+0000 7f3d1a0d7700 1 -- 172.21.15.31:0/1076361750 wait complete. 2023-10-09T06:22:10.218 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:22:10.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.336+0000 7fad2f71f700 1 Processor -- start 2023-10-09T06:22:10.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.336+0000 7fad2f71f700 1 -- start start 2023-10-09T06:22:10.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.337+0000 7fad2f71f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fad2815a620 0x7fad2815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.337+0000 7fad2f71f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2815cbb0 con 0x7fad2815d580 2023-10-09T06:22:10.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.337+0000 7fad2f71f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2815bfa0 con 0x7fad28157870 2023-10-09T06:22:10.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.337+0000 7fad2f71f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2815bdb0 con 0x7fad2815a620 2023-10-09T06:22:10.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.337+0000 7fad2dcbc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fad2815d580 0x7fad28158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53416/0 (socket says 172.21.15.31:53416) 2023-10-09T06:22:10.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.337+0000 7fad2dcbc700 1 -- 172.21.15.31:0/3195873039 learned_addr learned my addr 172.21.15.31:0/3195873039 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:10.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.337+0000 7fad2ccba700 1 --2- 172.21.15.31:0/3195873039 >> v2:172.21.15.158:3300/0 conn(0x7fad2815a620 0x7fad2815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.338+0000 7fad27fff700 1 -- 172.21.15.31:0/3195873039 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185849909 0 0) 0x7fad2815cbb0 con 0x7fad2815d580 2023-10-09T06:22:10.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.338+0000 7fad27fff700 1 -- 172.21.15.31:0/3195873039 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad10003570 con 0x7fad2815d580 2023-10-09T06:22:10.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.338+0000 7fad2ccba700 1 -- 172.21.15.31:0/3195873039 >> v1:172.21.15.158:6789/0 conn(0x7fad28157870 legacy=0x7fad2815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.338+0000 7fad2ccba700 1 -- 172.21.15.31:0/3195873039 >> v1:172.21.15.31:6789/0 conn(0x7fad2815d580 legacy=0x7fad28158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.338+0000 7fad2ccba700 1 -- 172.21.15.31:0/3195873039 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2815c280 con 0x7fad2815a620 2023-10-09T06:22:10.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.338+0000 7fad2ccba700 1 --2- 172.21.15.31:0/3195873039 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad2815a620 0x7fad2815d040 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0098e0 tx=0x7fad1c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1249f827a35e4654 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:10.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.338+0000 7fad27fff700 1 -- 172.21.15.31:0/3195873039 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c00b640 con 0x7fad2815a620 2023-10-09T06:22:10.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.338+0000 7fad27fff700 1 -- 172.21.15.31:0/3195873039 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c00b7a0 con 0x7fad2815a620 2023-10-09T06:22:10.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.338+0000 7fad27fff700 1 -- 172.21.15.31:0/3195873039 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c00bb20 con 0x7fad2815a620 2023-10-09T06:22:10.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.339+0000 7fad2f71f700 1 -- 172.21.15.31:0/3195873039 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad2815a620 msgr2=0x7fad2815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.339+0000 7fad2f71f700 1 --2- 172.21.15.31:0/3195873039 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad2815a620 0x7fad2815d040 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0098e0 tx=0x7fad1c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.339+0000 7fad2f71f700 1 -- 172.21.15.31:0/3195873039 shutdown_connections 2023-10-09T06:22:10.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.339+0000 7fad2f71f700 1 --2- 172.21.15.31:0/3195873039 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad2815a620 0x7fad2815d040 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.339+0000 7fad2f71f700 1 -- 172.21.15.31:0/3195873039 >> 172.21.15.31:0/3195873039 conn(0x7fad28068ce0 msgr2=0x7fad280690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.339+0000 7fad2f71f700 1 -- 172.21.15.31:0/3195873039 shutdown_connections 2023-10-09T06:22:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.339+0000 7fad2f71f700 1 -- 172.21.15.31:0/3195873039 wait complete. 2023-10-09T06:22:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.340+0000 7fad2f71f700 1 Processor -- start 2023-10-09T06:22:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.340+0000 7fad2f71f700 1 -- start start 2023-10-09T06:22:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2f71f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad28157870 0x7fad280b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2f71f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad2815a620 0x7fad2816e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2f71f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2815d580 0x7fad28154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2f71f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad280b06c0 con 0x7fad2815d580 2023-10-09T06:22:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2f71f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad280b09a0 con 0x7fad2815a620 2023-10-09T06:22:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2f71f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2816e990 con 0x7fad28157870 2023-10-09T06:22:10.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2dcbc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2815d580 0x7fad28154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2dcbc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2815d580 0x7fad28154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35642/0 (socket says 172.21.15.31:35642) 2023-10-09T06:22:10.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2dcbc700 1 -- 172.21.15.31:0/2707442437 learned_addr learned my addr 172.21.15.31:0/2707442437 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:10.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2ccba700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad2815a620 0x7fad2816e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2d4bb700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad28157870 0x7fad280b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2dcbc700 1 -- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad28157870 msgr2=0x7fad280b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2dcbc700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad28157870 0x7fad280b2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2dcbc700 1 -- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad2815a620 msgr2=0x7fad2816e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2dcbc700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad2815a620 0x7fad2816e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2dcbc700 1 -- 172.21.15.31:0/2707442437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c009420 con 0x7fad2815d580 2023-10-09T06:22:10.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad2dcbc700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2815d580 0x7fad28154da0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fad2000c590 tx=0x7fad20007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:10.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad257fa700 1 -- 172.21.15.31:0/2707442437 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20005c00 con 0x7fad2815d580 2023-10-09T06:22:10.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.341+0000 7fad257fa700 1 -- 172.21.15.31:0/2707442437 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad20005d60 con 0x7fad2815d580 2023-10-09T06:22:10.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.342+0000 7fad2f71f700 1 -- 172.21.15.31:0/2707442437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2816ec30 con 0x7fad2815d580 2023-10-09T06:22:10.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.342+0000 7fad257fa700 1 -- 172.21.15.31:0/2707442437 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20007300 con 0x7fad2815d580 2023-10-09T06:22:10.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.342+0000 7fad2f71f700 1 -- 172.21.15.31:0/2707442437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2816f1f0 con 0x7fad2815d580 2023-10-09T06:22:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.342+0000 7fad2f71f700 1 -- 172.21.15.31:0/2707442437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2804c3c0 con 0x7fad2815d580 2023-10-09T06:22:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.343+0000 7fad257fa700 1 -- 172.21.15.31:0/2707442437 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad2001b3b0 con 0x7fad2815d580 2023-10-09T06:22:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.343+0000 7fad257fa700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad14066f30 0x7fad140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.343+0000 7fad257fa700 1 -- 172.21.15.31:0/2707442437 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fad20083660 con 0x7fad2815d580 2023-10-09T06:22:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.343+0000 7fad2d4bb700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad14066f30 0x7fad140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.344+0000 7fad2d4bb700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad14066f30 0x7fad140693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad18007fd0 tx=0x7fad18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:10.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.347+0000 7fad257fa700 1 -- 172.21.15.31:0/2707442437 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad20050c20 con 0x7fad2815d580 2023-10-09T06:22:10.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.541+0000 7fad2f71f700 1 -- 172.21.15.31:0/2707442437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fad280b0ae0 con 0x7fad2815d580 2023-10-09T06:22:10.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.542+0000 7fad257fa700 1 -- 172.21.15.31:0/2707442437 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) v1 ==== 84+0+65 (secure 0 0 0) 0x7fad20017090 con 0x7fad2815d580 2023-10-09T06:22:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:10.543 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-10-09T06:22:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-10-09T06:22:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-10-09T06:22:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:10.544 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-10-09T06:22:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.544+0000 7fad2f71f700 1 -- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad14066f30 msgr2=0x7fad140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.544+0000 7fad2f71f700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad14066f30 0x7fad140693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad18007fd0 tx=0x7fad18009040 comp rx=0 tx=0).stop 2023-10-09T06:22:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.544+0000 7fad2f71f700 1 -- 172.21.15.31:0/2707442437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2815d580 msgr2=0x7fad28154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.544+0000 7fad2f71f700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2815d580 0x7fad28154da0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fad2000c590 tx=0x7fad20007d90 comp rx=0 tx=0).stop 2023-10-09T06:22:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.544+0000 7fad2f71f700 1 -- 172.21.15.31:0/2707442437 shutdown_connections 2023-10-09T06:22:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.544+0000 7fad2f71f700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad14066f30 0x7fad140693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.544+0000 7fad2f71f700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad28157870 0x7fad280b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.544+0000 7fad2f71f700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2815d580 0x7fad28154da0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.544+0000 7fad2f71f700 1 --2- 172.21.15.31:0/2707442437 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad2815a620 0x7fad2816e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.544+0000 7fad2f71f700 1 -- 172.21.15.31:0/2707442437 >> 172.21.15.31:0/2707442437 conn(0x7fad28068ce0 msgr2=0x7fad28158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:10.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.544+0000 7fad2f71f700 1 -- 172.21.15.31:0/2707442437 shutdown_connections 2023-10-09T06:22:10.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.544+0000 7fad2f71f700 1 -- 172.21.15.31:0/2707442437 wait complete. 2023-10-09T06:22:10.557 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:22:10.557 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:22:10.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.679+0000 7f48f1336700 1 Processor -- start 2023-10-09T06:22:10.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.679+0000 7f48f1336700 1 -- start start 2023-10-09T06:22:10.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.680+0000 7f48f1336700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f48ec15d240 0x7f48ec0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.680+0000 7f48f1336700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48ec0ce810 0x7f48ec0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.680+0000 7f48f1336700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ec0cd4f0 con 0x7f48ec0cc940 2023-10-09T06:22:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.680+0000 7f48f1336700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ec0b3f40 con 0x7f48ec15d240 2023-10-09T06:22:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.680+0000 7f48f1336700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0cbb80 con 0x7f48ec0ce810 2023-10-09T06:22:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.680+0000 7f48ebfff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f48ec15d240 0x7f48ec0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.680+0000 7f48f0b35700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48ec0ce810 0x7f48ec0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.680+0000 7f48eb7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f48ec0cc940 0x7f48ec0ccde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:52034/0 (socket says 172.21.15.31:52034) 2023-10-09T06:22:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.680+0000 7f48f0b35700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48ec0ce810 0x7f48ec0cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:49740/0 (socket says 172.21.15.31:49740) 2023-10-09T06:22:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.680+0000 7f48ebfff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f48ec15d240 0x7f48ec0b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:41902/0 (socket says 172.21.15.31:41902) 2023-10-09T06:22:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.680+0000 7f48eb7fe700 1 -- 172.21.15.31:0/320227028 learned_addr learned my addr 172.21.15.31:0/320227028 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.681+0000 7f48f0b35700 1 -- 172.21.15.31:0/320227028 >> v2:172.21.15.158:3300/0 conn(0x7f48ec15d240 msgr2=0x7f48ec0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.681+0000 7f48f0b35700 1 --2- 172.21.15.31:0/320227028 >> v2:172.21.15.158:3300/0 conn(0x7f48ec15d240 0x7f48ec0b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.681+0000 7f48f0b35700 1 -- 172.21.15.31:0/320227028 >> v1:172.21.15.158:6789/0 conn(0x7f48ec0cc940 legacy=0x7f48ec0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.681+0000 7f48f0b35700 1 -- 172.21.15.31:0/320227028 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec0cbe60 con 0x7f48ec0ce810 2023-10-09T06:22:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.681+0000 7f48eaffd700 1 -- 172.21.15.31:0/320227028 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348018200 0 0) 0x7f48ec0cd4f0 con 0x7f48ec0cc940 2023-10-09T06:22:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.681+0000 7f48ebfff700 1 --2- 172.21.15.31:0/320227028 >> v2:172.21.15.158:3300/0 conn(0x7f48ec15d240 0x7f48ec0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:22:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.681+0000 7f48f0b35700 1 --2- 172.21.15.31:0/320227028 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48ec0ce810 0x7f48ec0cec90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009e60 tx=0x7f48e4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a35e33ca6dd49c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.681+0000 7f48eaffd700 1 -- 172.21.15.31:0/320227028 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e400e070 con 0x7f48ec0ce810 2023-10-09T06:22:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.681+0000 7f48eaffd700 1 -- 172.21.15.31:0/320227028 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e400bb60 con 0x7f48ec0ce810 2023-10-09T06:22:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.681+0000 7f48eaffd700 1 -- 172.21.15.31:0/320227028 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4012430 con 0x7f48ec0ce810 2023-10-09T06:22:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.681+0000 7f48f1336700 1 -- 172.21.15.31:0/320227028 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48ec0ce810 msgr2=0x7f48ec0cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.681+0000 7f48f1336700 1 --2- 172.21.15.31:0/320227028 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48ec0ce810 0x7f48ec0cec90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009e60 tx=0x7f48e4009780 comp rx=0 tx=0).stop 2023-10-09T06:22:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.682+0000 7f48f1336700 1 -- 172.21.15.31:0/320227028 shutdown_connections 2023-10-09T06:22:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.682+0000 7f48f1336700 1 --2- 172.21.15.31:0/320227028 >> v2:172.21.15.158:3300/0 conn(0x7f48ec15d240 0x7f48ec0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.682+0000 7f48f1336700 1 --2- 172.21.15.31:0/320227028 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48ec0ce810 0x7f48ec0cec90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.682+0000 7f48f1336700 1 -- 172.21.15.31:0/320227028 >> 172.21.15.31:0/320227028 conn(0x7f48ec067e40 msgr2=0x7f48ec0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.682+0000 7f48f1336700 1 -- 172.21.15.31:0/320227028 shutdown_connections 2023-10-09T06:22:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.682+0000 7f48f1336700 1 -- 172.21.15.31:0/320227028 wait complete. 2023-10-09T06:22:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.683+0000 7f48f1336700 1 Processor -- start 2023-10-09T06:22:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.683+0000 7f48f1336700 1 -- start start 2023-10-09T06:22:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.683+0000 7f48f1336700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48ec0cc940 0x7f48ec169eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.683+0000 7f48f1336700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48ec0ce810 0x7f48ec158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.683+0000 7f48f1336700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48ec15d240 0x7f48ec1594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48f1336700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0b5ef0 con 0x7f48ec0cc940 2023-10-09T06:22:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48f1336700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec16ae30 con 0x7f48ec15d240 2023-10-09T06:22:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48f1336700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec16a870 con 0x7f48ec0ce810 2023-10-09T06:22:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48ec0cc940 0x7f48ec169eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48ec0cc940 0x7f48ec169eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35646/0 (socket says 172.21.15.31:35646) 2023-10-09T06:22:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48ebfff700 1 -- 172.21.15.31:0/239325694 learned_addr learned my addr 172.21.15.31:0/239325694 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48eb7fe700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48ec0ce810 0x7f48ec158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48f0b35700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48ec15d240 0x7f48ec1594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48ebfff700 1 -- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48ec0ce810 msgr2=0x7f48ec158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48ebfff700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48ec0ce810 0x7f48ec158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48ebfff700 1 -- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48ec15d240 msgr2=0x7f48ec1594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48ebfff700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48ec15d240 0x7f48ec1594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48ebfff700 1 -- 172.21.15.31:0/239325694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40093c0 con 0x7f48ec0cc940 2023-10-09T06:22:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48f0b35700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48ec15d240 0x7f48ec1594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48ebfff700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48ec0cc940 0x7f48ec169eb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f48d400ec80 tx=0x7f48d4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48e3fff700 1 -- 172.21.15.31:0/239325694 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4005a00 con 0x7f48ec0cc940 2023-10-09T06:22:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48e3fff700 1 -- 172.21.15.31:0/239325694 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d4005b60 con 0x7f48ec0cc940 2023-10-09T06:22:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48f1336700 1 -- 172.21.15.31:0/239325694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e4009a20 con 0x7f48ec0cc940 2023-10-09T06:22:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48e3fff700 1 -- 172.21.15.31:0/239325694 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d400c850 con 0x7f48ec0cc940 2023-10-09T06:22:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.684+0000 7f48f1336700 1 -- 172.21.15.31:0/239325694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ec16d630 con 0x7f48ec0cc940 2023-10-09T06:22:10.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.685+0000 7f48f1336700 1 -- 172.21.15.31:0/239325694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ec06ac60 con 0x7f48ec0cc940 2023-10-09T06:22:10.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.686+0000 7f48e3fff700 1 -- 172.21.15.31:0/239325694 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48d400cbc0 con 0x7f48ec0cc940 2023-10-09T06:22:10.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.686+0000 7f48e3fff700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48cc066f30 0x7f48cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:10.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.686+0000 7f48e3fff700 1 -- 172.21.15.31:0/239325694 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f48d4084680 con 0x7f48ec0cc940 2023-10-09T06:22:10.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.686+0000 7f48eb7fe700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48cc066f30 0x7f48cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:10.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.687+0000 7f48eb7fe700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48cc066f30 0x7f48cc0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f48ec1544c0 tx=0x7f48dc007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:10.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.691+0000 7f48e3fff700 1 -- 172.21.15.31:0/239325694 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48d40556d0 con 0x7f48ec0cc940 2023-10-09T06:22:10.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:10.884+0000 7f48f1336700 1 -- 172.21.15.31:0/239325694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f48ec158d50 con 0x7f48ec0cc940 2023-10-09T06:22:11.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.098+0000 7f48e3fff700 1 -- 172.21.15.31:0/239325694 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) v1 ==== 138+0+0 (secure 0 0 0) 0x7f48d4055260 con 0x7f48ec0cc940 2023-10-09T06:22:11.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.101+0000 7f48f1336700 1 -- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48cc066f30 msgr2=0x7f48cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:11.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.101+0000 7f48f1336700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48cc066f30 0x7f48cc0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f48ec1544c0 tx=0x7f48dc007f50 comp rx=0 tx=0).stop 2023-10-09T06:22:11.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.101+0000 7f48f1336700 1 -- 172.21.15.31:0/239325694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48ec0cc940 msgr2=0x7f48ec169eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:11.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.101+0000 7f48f1336700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48ec0cc940 0x7f48ec169eb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f48d400ec80 tx=0x7f48d4009120 comp rx=0 tx=0).stop 2023-10-09T06:22:11.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.101+0000 7f48f1336700 1 -- 172.21.15.31:0/239325694 shutdown_connections 2023-10-09T06:22:11.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.101+0000 7f48f1336700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48cc066f30 0x7f48cc0693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:11.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.101+0000 7f48f1336700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48ec15d240 0x7f48ec1594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:11.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.101+0000 7f48f1336700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48ec0cc940 0x7f48ec169eb0 secure :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f48d400ec80 tx=0x7f48d4009120 comp rx=0 tx=0).stop 2023-10-09T06:22:11.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.101+0000 7f48f1336700 1 --2- 172.21.15.31:0/239325694 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48ec0ce810 0x7f48ec158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:11.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.101+0000 7f48f1336700 1 -- 172.21.15.31:0/239325694 >> 172.21.15.31:0/239325694 conn(0x7f48ec067e40 msgr2=0x7f48ec1564e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:11.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.102+0000 7f48f1336700 1 -- 172.21.15.31:0/239325694 shutdown_connections 2023-10-09T06:22:11.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.102+0000 7f48f1336700 1 -- 172.21.15.31:0/239325694 wait complete. 2023-10-09T06:22:11.104 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-10-09T06:22:11.115 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:22:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.240+0000 7f1959a60700 1 Processor -- start 2023-10-09T06:22:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.240+0000 7f1959a60700 1 -- start start 2023-10-09T06:22:11.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.241+0000 7f1959a60700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f195415afb0 0x7f19540d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:11.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.241+0000 7f1959a60700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19541513f0 con 0x7f19540d12a0 2023-10-09T06:22:11.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.241+0000 7f1959a60700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19540d1700 con 0x7f19540cd300 2023-10-09T06:22:11.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.241+0000 7f1959a60700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195415e7a0 con 0x7f195415afb0 2023-10-09T06:22:11.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.241+0000 7f19527fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f195415afb0 0x7f19540d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:11.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.241+0000 7f19537fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f19540d12a0 0x7f19540cf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53426/0 (socket says 172.21.15.31:53426) 2023-10-09T06:22:11.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.241+0000 7f19537fe700 1 -- 172.21.15.31:0/3403861902 learned_addr learned my addr 172.21.15.31:0/3403861902 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.242+0000 7f19527fc700 1 -- 172.21.15.31:0/3403861902 >> v1:172.21.15.158:6789/0 conn(0x7f19540cd300 legacy=0x7f19540b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.242+0000 7f19527fc700 1 -- 172.21.15.31:0/3403861902 >> v1:172.21.15.31:6789/0 conn(0x7f19540d12a0 legacy=0x7f19540cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.242+0000 7f19527fc700 1 -- 172.21.15.31:0/3403861902 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195415db20 con 0x7f195415afb0 2023-10-09T06:22:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.242+0000 7f1951ffb700 1 -- 172.21.15.31:0/3403861902 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155913785 0 0) 0x7f19541513f0 con 0x7f19540d12a0 2023-10-09T06:22:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.242+0000 7f19527fc700 1 --2- 172.21.15.31:0/3403861902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f195415afb0 0x7f19540d0d60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f193c0098e0 tx=0x7f193c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e6c6b98c69157c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.242+0000 7f1951ffb700 1 -- 172.21.15.31:0/3403861902 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c009e80 con 0x7f195415afb0 2023-10-09T06:22:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.242+0000 7f1951ffb700 1 -- 172.21.15.31:0/3403861902 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c00b860 con 0x7f195415afb0 2023-10-09T06:22:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.242+0000 7f1951ffb700 1 -- 172.21.15.31:0/3403861902 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c00bbe0 con 0x7f195415afb0 2023-10-09T06:22:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.243+0000 7f1959a60700 1 -- 172.21.15.31:0/3403861902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f195415afb0 msgr2=0x7f19540d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.243+0000 7f1959a60700 1 --2- 172.21.15.31:0/3403861902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f195415afb0 0x7f19540d0d60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f193c0098e0 tx=0x7f193c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:11.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.243+0000 7f1959a60700 1 -- 172.21.15.31:0/3403861902 shutdown_connections 2023-10-09T06:22:11.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.243+0000 7f1959a60700 1 --2- 172.21.15.31:0/3403861902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f195415afb0 0x7f19540d0d60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:11.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.243+0000 7f1959a60700 1 -- 172.21.15.31:0/3403861902 >> 172.21.15.31:0/3403861902 conn(0x7f1954068d90 msgr2=0x7f1954069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:11.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.243+0000 7f1959a60700 1 -- 172.21.15.31:0/3403861902 shutdown_connections 2023-10-09T06:22:11.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.243+0000 7f1959a60700 1 -- 172.21.15.31:0/3403861902 wait complete. 2023-10-09T06:22:11.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f1959a60700 1 Processor -- start 2023-10-09T06:22:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f1959a60700 1 -- start start 2023-10-09T06:22:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f1959a60700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19540cd300 0x7f1954155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f1959a60700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19540d12a0 0x7f1954152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f1959a60700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f195415afb0 0x7f1954159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f1959a60700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1954158c80 con 0x7f195415afb0 2023-10-09T06:22:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f1959a60700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1954152ae0 con 0x7f19540d12a0 2023-10-09T06:22:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f1959a60700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1954152dc0 con 0x7f19540cd300 2023-10-09T06:22:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f19537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f195415afb0 0x7f1954159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f19537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f195415afb0 0x7f1954159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35654/0 (socket says 172.21.15.31:35654) 2023-10-09T06:22:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f19537fe700 1 -- 172.21.15.31:0/3413713257 learned_addr learned my addr 172.21.15.31:0/3413713257 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f19527fc700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19540d12a0 0x7f1954152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f1952ffd700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19540cd300 0x7f1954155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f19537fe700 1 -- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19540cd300 msgr2=0x7f1954155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f19537fe700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19540cd300 0x7f1954155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f19537fe700 1 -- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19540d12a0 msgr2=0x7f1954152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f19537fe700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19540d12a0 0x7f1954152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f19537fe700 1 -- 172.21.15.31:0/3413713257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c009420 con 0x7f195415afb0 2023-10-09T06:22:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f19537fe700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f195415afb0 0x7f1954159110 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f194400cc90 tx=0x7f1944001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f194affd700 1 -- 172.21.15.31:0/3413713257 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194400cea0 con 0x7f195415afb0 2023-10-09T06:22:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f194affd700 1 -- 172.21.15.31:0/3413713257 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194400ab30 con 0x7f195415afb0 2023-10-09T06:22:11.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.245+0000 7f1959a60700 1 -- 172.21.15.31:0/3413713257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19541530a0 con 0x7f195415afb0 2023-10-09T06:22:11.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.246+0000 7f194affd700 1 -- 172.21.15.31:0/3413713257 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19440070f0 con 0x7f195415afb0 2023-10-09T06:22:11.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.246+0000 7f1959a60700 1 -- 172.21.15.31:0/3413713257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19541526d0 con 0x7f195415afb0 2023-10-09T06:22:11.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.246+0000 7f1959a60700 1 -- 172.21.15.31:0/3413713257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1954158770 con 0x7f195415afb0 2023-10-09T06:22:11.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.247+0000 7f194affd700 1 -- 172.21.15.31:0/3413713257 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19440074a0 con 0x7f195415afb0 2023-10-09T06:22:11.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.247+0000 7f194affd700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1934066f30 0x7f19340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:11.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.248+0000 7f194affd700 1 -- 172.21.15.31:0/3413713257 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f19440848c0 con 0x7f195415afb0 2023-10-09T06:22:11.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.248+0000 7f1952ffd700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1934066f30 0x7f19340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:11.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.248+0000 7f1952ffd700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1934066f30 0x7f19340693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f19540d0940 tx=0x7f194c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:11.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.253+0000 7f194affd700 1 -- 172.21.15.31:0/3413713257 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1954158770 con 0x7f195415afb0 2023-10-09T06:22:11.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:11.445+0000 7f1959a60700 1 -- 172.21.15.31:0/3413713257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1954158770 con 0x7f195415afb0 2023-10-09T06:22:12.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.102+0000 7f194affd700 1 -- 172.21.15.31:0/3413713257 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1954158770 con 0x7f195415afb0 2023-10-09T06:22:12.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.114+0000 7f1959a60700 1 -- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1934066f30 msgr2=0x7f19340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:12.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.114+0000 7f1959a60700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1934066f30 0x7f19340693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f19540d0940 tx=0x7f194c009040 comp rx=0 tx=0).stop 2023-10-09T06:22:12.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.114+0000 7f1959a60700 1 -- 172.21.15.31:0/3413713257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f195415afb0 msgr2=0x7f1954159110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:12.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.114+0000 7f1959a60700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f195415afb0 0x7f1954159110 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f194400cc90 tx=0x7f1944001a20 comp rx=0 tx=0).stop 2023-10-09T06:22:12.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.114+0000 7f1959a60700 1 -- 172.21.15.31:0/3413713257 shutdown_connections 2023-10-09T06:22:12.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.114+0000 7f1959a60700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1934066f30 0x7f19340693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:12.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.114+0000 7f1959a60700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19540cd300 0x7f1954155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:12.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.114+0000 7f1959a60700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f195415afb0 0x7f1954159110 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:12.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.114+0000 7f1959a60700 1 --2- 172.21.15.31:0/3413713257 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19540d12a0 0x7f1954152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:12.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.114+0000 7f1959a60700 1 -- 172.21.15.31:0/3413713257 >> 172.21.15.31:0/3413713257 conn(0x7f1954068d90 msgr2=0x7f19540b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:12.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.114+0000 7f1959a60700 1 -- 172.21.15.31:0/3413713257 shutdown_connections 2023-10-09T06:22:12.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.114+0000 7f1959a60700 1 -- 172.21.15.31:0/3413713257 wait complete. 2023-10-09T06:22:12.115 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-10-09T06:22:12.127 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:22:12.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.253+0000 7f48be2a6700 1 Processor -- start 2023-10-09T06:22:12.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.253+0000 7f48be2a6700 1 -- start start 2023-10-09T06:22:12.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.254+0000 7f48be2a6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f48b80b6580 0x7f48b806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:12.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.254+0000 7f48be2a6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b806a830 0x7f48b80b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:12.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.254+0000 7f48be2a6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b806ac90 con 0x7f48b80cce30 2023-10-09T06:22:12.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.254+0000 7f48be2a6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b80b4d70 con 0x7f48b80b6580 2023-10-09T06:22:12.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.254+0000 7f48be2a6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b815b3b0 con 0x7f48b806a830 2023-10-09T06:22:12.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.254+0000 7f48bcaa3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f48b80b6580 0x7f48b806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:12.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.254+0000 7f48bcaa3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f48b80b6580 0x7f48b806a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35660/0 (socket says 172.21.15.31:35660) 2023-10-09T06:22:12.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.254+0000 7f48bcaa3700 1 -- 172.21.15.31:0/3132372821 learned_addr learned my addr 172.21.15.31:0/3132372821 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:12.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.254+0000 7f48bdaa5700 1 --2- 172.21.15.31:0/3132372821 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b806a830 0x7f48b80b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:12.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48bcaa3700 1 -- 172.21.15.31:0/3132372821 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b806a830 msgr2=0x7f48b80b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:12.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48bcaa3700 1 --2- 172.21.15.31:0/3132372821 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b806a830 0x7f48b80b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:12.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48bcaa3700 1 -- 172.21.15.31:0/3132372821 >> v1:172.21.15.158:6789/0 conn(0x7f48b80cce30 legacy=0x7f48b815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:12.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48bcaa3700 1 -- 172.21.15.31:0/3132372821 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b80cd8d0 con 0x7f48b80b6580 2023-10-09T06:22:12.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48bcaa3700 1 --2- 172.21.15.31:0/3132372821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b80b6580 0x7f48b806a2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0099b0 tx=0x7f48ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30384d6cc01d416 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:12.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48b7fff700 1 -- 172.21.15.31:0/3132372821 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00b860 con 0x7f48b80b6580 2023-10-09T06:22:12.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48b7fff700 1 -- 172.21.15.31:0/3132372821 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac00b9c0 con 0x7f48b80b6580 2023-10-09T06:22:12.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48b7fff700 1 -- 172.21.15.31:0/3132372821 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00bd60 con 0x7f48b80b6580 2023-10-09T06:22:12.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48be2a6700 1 -- 172.21.15.31:0/3132372821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b80b6580 msgr2=0x7f48b806a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:12.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48be2a6700 1 --2- 172.21.15.31:0/3132372821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b80b6580 0x7f48b806a2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0099b0 tx=0x7f48ac009250 comp rx=0 tx=0).stop 2023-10-09T06:22:12.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48be2a6700 1 -- 172.21.15.31:0/3132372821 shutdown_connections 2023-10-09T06:22:12.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48be2a6700 1 --2- 172.21.15.31:0/3132372821 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b806a830 0x7f48b80b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:12.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48be2a6700 1 --2- 172.21.15.31:0/3132372821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b80b6580 0x7f48b806a2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:12.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.255+0000 7f48be2a6700 1 -- 172.21.15.31:0/3132372821 >> 172.21.15.31:0/3132372821 conn(0x7f48b8068cb0 msgr2=0x7f48b80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:12.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.256+0000 7f48be2a6700 1 -- 172.21.15.31:0/3132372821 shutdown_connections 2023-10-09T06:22:12.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.256+0000 7f48be2a6700 1 -- 172.21.15.31:0/3132372821 wait complete. 2023-10-09T06:22:12.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.257+0000 7f48be2a6700 1 Processor -- start 2023-10-09T06:22:12.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.257+0000 7f48be2a6700 1 -- start start 2023-10-09T06:22:12.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.257+0000 7f48be2a6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48b806a830 0x7f48b8154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:12.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.257+0000 7f48be2a6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b80b6580 0x7f48b80b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:12.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.257+0000 7f48be2a6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b80cce30 0x7f48b814e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:12.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.257+0000 7f48be2a6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8155f20 con 0x7f48b80cce30 2023-10-09T06:22:12.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.257+0000 7f48be2a6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8154f20 con 0x7f48b806a830 2023-10-09T06:22:12.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.257+0000 7f48be2a6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8155200 con 0x7f48b80b6580 2023-10-09T06:22:12.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48bdaa5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b80cce30 0x7f48b814e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:12.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48bdaa5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b80cce30 0x7f48b814e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35674/0 (socket says 172.21.15.31:35674) 2023-10-09T06:22:12.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48bdaa5700 1 -- 172.21.15.31:0/3439898514 learned_addr learned my addr 172.21.15.31:0/3439898514 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:12.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48bcaa3700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b80b6580 0x7f48b80b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:12.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48bd2a4700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48b806a830 0x7f48b8154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:12.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48bdaa5700 1 -- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b80b6580 msgr2=0x7f48b80b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:12.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48bdaa5700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b80b6580 0x7f48b80b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:12.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48bdaa5700 1 -- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48b806a830 msgr2=0x7f48b8154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:12.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48bdaa5700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48b806a830 0x7f48b8154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:12.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48bdaa5700 1 -- 172.21.15.31:0/3439898514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac0094f0 con 0x7f48b80cce30 2023-10-09T06:22:12.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48bdaa5700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b80cce30 0x7f48b814e590 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009fa0 tx=0x7f48a8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:12.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48b57fa700 1 -- 172.21.15.31:0/3439898514 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800ebc0 con 0x7f48b80cce30 2023-10-09T06:22:12.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48b57fa700 1 -- 172.21.15.31:0/3439898514 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a800ed20 con 0x7f48b80cce30 2023-10-09T06:22:12.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48b57fa700 1 -- 172.21.15.31:0/3439898514 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a8014670 con 0x7f48b80cce30 2023-10-09T06:22:12.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48be2a6700 1 -- 172.21.15.31:0/3439898514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b81554e0 con 0x7f48b80cce30 2023-10-09T06:22:12.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.258+0000 7f48be2a6700 1 -- 172.21.15.31:0/3439898514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b814ead0 con 0x7f48b80cce30 2023-10-09T06:22:12.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.259+0000 7f48be2a6700 1 -- 172.21.15.31:0/3439898514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b8155d50 con 0x7f48b80cce30 2023-10-09T06:22:12.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.260+0000 7f48b57fa700 1 -- 172.21.15.31:0/3439898514 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48a80149e0 con 0x7f48b80cce30 2023-10-09T06:22:12.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.260+0000 7f48b57fa700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48a4066f30 0x7f48a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:12.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.260+0000 7f48b57fa700 1 -- 172.21.15.31:0/3439898514 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f48a8084b70 con 0x7f48b80cce30 2023-10-09T06:22:12.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.260+0000 7f48bd2a4700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48a4066f30 0x7f48a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:12.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.261+0000 7f48bd2a4700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48a4066f30 0x7f48a40693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f48b00039e0 tx=0x7f48b0007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:12.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.265+0000 7f48b57fa700 1 -- 172.21.15.31:0/3439898514 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48a8051e40 con 0x7f48b80cce30 2023-10-09T06:22:12.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:12.503+0000 7f48be2a6700 1 -- 172.21.15.31:0/3439898514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f48b80b4440 con 0x7f48b80cce30 2023-10-09T06:22:13.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.120+0000 7f48b57fa700 1 -- 172.21.15.31:0/3439898514 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f48a8055460 con 0x7f48b80cce30 2023-10-09T06:22:13.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.124+0000 7f48be2a6700 1 -- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48a4066f30 msgr2=0x7f48a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.124+0000 7f48be2a6700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48a4066f30 0x7f48a40693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f48b00039e0 tx=0x7f48b0007ec0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.124+0000 7f48be2a6700 1 -- 172.21.15.31:0/3439898514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b80cce30 msgr2=0x7f48b814e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.124+0000 7f48be2a6700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b80cce30 0x7f48b814e590 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009fa0 tx=0x7f48a8009900 comp rx=0 tx=0).stop 2023-10-09T06:22:13.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.126+0000 7f48be2a6700 1 -- 172.21.15.31:0/3439898514 shutdown_connections 2023-10-09T06:22:13.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.126+0000 7f48be2a6700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48a4066f30 0x7f48a40693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.126+0000 7f48be2a6700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b80cce30 0x7f48b814e590 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.126+0000 7f48be2a6700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48b806a830 0x7f48b8154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.126+0000 7f48be2a6700 1 --2- 172.21.15.31:0/3439898514 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48b80b6580 0x7f48b80b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.126+0000 7f48be2a6700 1 -- 172.21.15.31:0/3439898514 >> 172.21.15.31:0/3439898514 conn(0x7f48b8068cb0 msgr2=0x7f48b81503e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:13.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.126+0000 7f48be2a6700 1 -- 172.21.15.31:0/3439898514 shutdown_connections 2023-10-09T06:22:13.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.126+0000 7f48be2a6700 1 -- 172.21.15.31:0/3439898514 wait complete. 2023-10-09T06:22:13.126 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 6 and data pool 7 2023-10-09T06:22:13.139 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:22:13.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.259+0000 7f98e359e700 1 Processor -- start 2023-10-09T06:22:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.259+0000 7f98e359e700 1 -- start start 2023-10-09T06:22:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f98e4159db0 0x7f98e40d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f98e40b1f00 0x7f98e40aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e40b4bf0 con 0x7f98e4068240 2023-10-09T06:22:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e40b5790 con 0x7f98e4159db0 2023-10-09T06:22:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e359e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e40ae9b0 con 0x7f98e40b1f00 2023-10-09T06:22:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f98e4159db0 0x7f98e40d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e1d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f98e4068240 0x7f98e40b17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53428/0 (socket says 172.21.15.31:53428) 2023-10-09T06:22:13.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e1d9b700 1 -- 172.21.15.31:0/2216591678 learned_addr learned my addr 172.21.15.31:0/2216591678 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:13.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e2d9d700 1 --2- 172.21.15.31:0/2216591678 >> v2:172.21.15.158:3300/0 conn(0x7f98e40b1f00 0x7f98e40aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e259c700 1 -- 172.21.15.31:0/2216591678 >> v2:172.21.15.158:3300/0 conn(0x7f98e40b1f00 msgr2=0x7f98e40aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:13.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e259c700 1 --2- 172.21.15.31:0/2216591678 >> v2:172.21.15.158:3300/0 conn(0x7f98e40b1f00 0x7f98e40aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e259c700 1 -- 172.21.15.31:0/2216591678 >> v1:172.21.15.31:6789/0 conn(0x7f98e4068240 legacy=0x7f98e40b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e259c700 1 -- 172.21.15.31:0/2216591678 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e40b59e0 con 0x7f98e4159db0 2023-10-09T06:22:13.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.260+0000 7f98e2d9d700 1 --2- 172.21.15.31:0/2216591678 >> v2:172.21.15.158:3300/0 conn(0x7f98e40b1f00 0x7f98e40aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:13.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.261+0000 7f98e259c700 1 --2- 172.21.15.31:0/2216591678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e4159db0 0x7f98e40d13c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f98e408af90 tx=0x7f98d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f192beb0ec037c18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:13.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.261+0000 7f98e159a700 1 -- 172.21.15.31:0/2216591678 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d400e070 con 0x7f98e4159db0 2023-10-09T06:22:13.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.261+0000 7f98e159a700 1 -- 172.21.15.31:0/2216591678 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d400bc30 con 0x7f98e4159db0 2023-10-09T06:22:13.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.261+0000 7f98e159a700 1 -- 172.21.15.31:0/2216591678 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4012430 con 0x7f98e4159db0 2023-10-09T06:22:13.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.261+0000 7f98e359e700 1 -- 172.21.15.31:0/2216591678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e4159db0 msgr2=0x7f98e40d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.261+0000 7f98e359e700 1 --2- 172.21.15.31:0/2216591678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e4159db0 0x7f98e40d13c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f98e408af90 tx=0x7f98d4009780 comp rx=0 tx=0).stop 2023-10-09T06:22:13.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.261+0000 7f98e359e700 1 -- 172.21.15.31:0/2216591678 shutdown_connections 2023-10-09T06:22:13.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.261+0000 7f98e359e700 1 --2- 172.21.15.31:0/2216591678 >> v2:172.21.15.158:3300/0 conn(0x7f98e40b1f00 0x7f98e40aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.261+0000 7f98e359e700 1 --2- 172.21.15.31:0/2216591678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e4159db0 0x7f98e40d13c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.261+0000 7f98e359e700 1 -- 172.21.15.31:0/2216591678 >> 172.21.15.31:0/2216591678 conn(0x7f98e4067e40 msgr2=0x7f98e40d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:13.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.261+0000 7f98e359e700 1 -- 172.21.15.31:0/2216591678 shutdown_connections 2023-10-09T06:22:13.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.261+0000 7f98e359e700 1 -- 172.21.15.31:0/2216591678 wait complete. 2023-10-09T06:22:13.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.263+0000 7f98e359e700 1 Processor -- start 2023-10-09T06:22:13.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.263+0000 7f98e359e700 1 -- start start 2023-10-09T06:22:13.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.263+0000 7f98e359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e4068240 0x7f98e416a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.263+0000 7f98e359e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b1f00 0x7f98e40b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.263+0000 7f98e359e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98e4159db0 0x7f98e40b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.263+0000 7f98e359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e415abb0 con 0x7f98e4068240 2023-10-09T06:22:13.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.263+0000 7f98e359e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e40b1850 con 0x7f98e4159db0 2023-10-09T06:22:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.263+0000 7f98e359e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e40b0c40 con 0x7f98e40b1f00 2023-10-09T06:22:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.263+0000 7f98e259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e4068240 0x7f98e416a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.263+0000 7f98e259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e4068240 0x7f98e416a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35692/0 (socket says 172.21.15.31:35692) 2023-10-09T06:22:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.263+0000 7f98e259c700 1 -- 172.21.15.31:0/2210821301 learned_addr learned my addr 172.21.15.31:0/2210821301 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:13.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98e2d9d700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98e4159db0 0x7f98e40b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98e1d9b700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b1f00 0x7f98e40b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98e259c700 1 -- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b1f00 msgr2=0x7f98e40b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98e259c700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b1f00 0x7f98e40b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98e259c700 1 -- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98e4159db0 msgr2=0x7f98e40b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98e259c700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98e4159db0 0x7f98e40b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98e259c700 1 -- 172.21.15.31:0/2210821301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4009a20 con 0x7f98e4068240 2023-10-09T06:22:13.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98e1d9b700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b1f00 0x7f98e40b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:13.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98e259c700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e4068240 0x7f98e416a170 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f98d4012580 tx=0x7f98d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:13.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98da7fc700 1 -- 172.21.15.31:0/2210821301 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4012e20 con 0x7f98e4068240 2023-10-09T06:22:13.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98da7fc700 1 -- 172.21.15.31:0/2210821301 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d4027470 con 0x7f98e4068240 2023-10-09T06:22:13.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98e359e700 1 -- 172.21.15.31:0/2210821301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e40b0f20 con 0x7f98e4068240 2023-10-09T06:22:13.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98da7fc700 1 -- 172.21.15.31:0/2210821301 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4027830 con 0x7f98e4068240 2023-10-09T06:22:13.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.264+0000 7f98e359e700 1 -- 172.21.15.31:0/2210821301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e40b14e0 con 0x7f98e4068240 2023-10-09T06:22:13.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.265+0000 7f98e359e700 1 -- 172.21.15.31:0/2210821301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e40b28a0 con 0x7f98e4068240 2023-10-09T06:22:13.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.265+0000 7f98da7fc700 1 -- 172.21.15.31:0/2210821301 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98d4024070 con 0x7f98e4068240 2023-10-09T06:22:13.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.266+0000 7f98da7fc700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98c4066f30 0x7f98c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.266+0000 7f98da7fc700 1 -- 172.21.15.31:0/2210821301 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f98d4086ad0 con 0x7f98e4068240 2023-10-09T06:22:13.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.266+0000 7f98e1d9b700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98c4066f30 0x7f98c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.267+0000 7f98e1d9b700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98c4066f30 0x7f98c40693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98e4153890 tx=0x7f98cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:13.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.270+0000 7f98da7fc700 1 -- 172.21.15.31:0/2210821301 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98d4053d40 con 0x7f98e4068240 2023-10-09T06:22:13.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.467+0000 7f98e359e700 1 -- 172.21.15.31:0/2210821301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98e406ace0 con 0x7f98e4068240 2023-10-09T06:22:13.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.468+0000 7f98da7fc700 1 -- 172.21.15.31:0/2210821301 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f98d4057360 con 0x7f98e4068240 2023-10-09T06:22:13.469 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:13.469 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":44,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:22:12.503714+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:22:10.914998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T06:22:11.476116+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:22:13.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.470+0000 7f98e359e700 1 -- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98c4066f30 msgr2=0x7f98c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.470+0000 7f98e359e700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98c4066f30 0x7f98c40693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98e4153890 tx=0x7f98cc009040 comp rx=0 tx=0).stop 2023-10-09T06:22:13.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.470+0000 7f98e359e700 1 -- 172.21.15.31:0/2210821301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e4068240 msgr2=0x7f98e416a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.470+0000 7f98e359e700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e4068240 0x7f98e416a170 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f98d4012580 tx=0x7f98d4019000 comp rx=0 tx=0).stop 2023-10-09T06:22:13.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.470+0000 7f98e359e700 1 -- 172.21.15.31:0/2210821301 shutdown_connections 2023-10-09T06:22:13.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.470+0000 7f98e359e700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98c4066f30 0x7f98c40693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.470+0000 7f98e359e700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98e4159db0 0x7f98e40b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.470+0000 7f98e359e700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e4068240 0x7f98e416a170 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.470+0000 7f98e359e700 1 --2- 172.21.15.31:0/2210821301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b1f00 0x7f98e40b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.470+0000 7f98e359e700 1 -- 172.21.15.31:0/2210821301 >> 172.21.15.31:0/2210821301 conn(0x7f98e4067e40 msgr2=0x7f98e40cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:13.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.470+0000 7f98e359e700 1 -- 172.21.15.31:0/2210821301 shutdown_connections 2023-10-09T06:22:13.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.470+0000 7f98e359e700 1 -- 172.21.15.31:0/2210821301 wait complete. 2023-10-09T06:22:13.482 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:22:13.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.602+0000 7f6908412700 1 Processor -- start 2023-10-09T06:22:13.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.602+0000 7f6908412700 1 -- start start 2023-10-09T06:22:13.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.603+0000 7f6908412700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f690015a2b0 0x7f69000b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.603+0000 7f6908412700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f69000d1c30 0x7f69000cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.603+0000 7f6908412700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f690015a680 0x7f69000cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.603+0000 7f6908412700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6900068470 con 0x7f690015a2b0 2023-10-09T06:22:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.603+0000 7f6908412700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69000c5d80 con 0x7f690015a680 2023-10-09T06:22:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.603+0000 7f6908412700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69000c6060 con 0x7f69000d1c30 2023-10-09T06:22:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.603+0000 7f69061ae700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f690015a2b0 0x7f69000b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.603+0000 7f69061ae700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f690015a2b0 0x7f69000b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35698/0 (socket says 172.21.15.31:35698) 2023-10-09T06:22:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.603+0000 7f69061ae700 1 -- 172.21.15.31:0/1761242857 learned_addr learned my addr 172.21.15.31:0/1761242857 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.603+0000 7f69069af700 1 --2- 172.21.15.31:0/1761242857 >> v2:172.21.15.158:3300/0 conn(0x7f690015a680 0x7f69000cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.603+0000 7f69059ad700 1 --2- 172.21.15.31:0/1761242857 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f69000d1c30 0x7f69000cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.604+0000 7f69061ae700 1 -- 172.21.15.31:0/1761242857 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f69000d1c30 msgr2=0x7f69000cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.604+0000 7f69061ae700 1 --2- 172.21.15.31:0/1761242857 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f69000d1c30 0x7f69000cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.604+0000 7f69061ae700 1 -- 172.21.15.31:0/1761242857 >> v2:172.21.15.158:3300/0 conn(0x7f690015a680 msgr2=0x7f69000cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.604+0000 7f69061ae700 1 --2- 172.21.15.31:0/1761242857 >> v2:172.21.15.158:3300/0 conn(0x7f690015a680 0x7f69000cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.604+0000 7f69061ae700 1 -- 172.21.15.31:0/1761242857 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69000c6340 con 0x7f690015a2b0 2023-10-09T06:22:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.604+0000 7f69059ad700 1 --2- 172.21.15.31:0/1761242857 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f69000d1c30 0x7f69000cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.604+0000 7f69069af700 1 --2- 172.21.15.31:0/1761242857 >> v2:172.21.15.158:3300/0 conn(0x7f690015a680 0x7f69000cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.604+0000 7f69061ae700 1 --2- 172.21.15.31:0/1761242857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690015a2b0 0x7f69000b3da0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f690008a810 tx=0x7f68f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ad32cc53126918 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.604+0000 7f69051ac700 1 -- 172.21.15.31:0/1761242857 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f800e070 con 0x7f690015a2b0 2023-10-09T06:22:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.604+0000 7f69051ac700 1 -- 172.21.15.31:0/1761242857 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f800bad0 con 0x7f690015a2b0 2023-10-09T06:22:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.604+0000 7f69051ac700 1 -- 172.21.15.31:0/1761242857 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f80092e0 con 0x7f690015a2b0 2023-10-09T06:22:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.604+0000 7f6908412700 1 -- 172.21.15.31:0/1761242857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690015a2b0 msgr2=0x7f69000b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.604+0000 7f6908412700 1 --2- 172.21.15.31:0/1761242857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690015a2b0 0x7f69000b3da0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f690008a810 tx=0x7f68f8009840 comp rx=0 tx=0).stop 2023-10-09T06:22:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.605+0000 7f6908412700 1 -- 172.21.15.31:0/1761242857 shutdown_connections 2023-10-09T06:22:13.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.605+0000 7f6908412700 1 --2- 172.21.15.31:0/1761242857 >> v2:172.21.15.158:3300/0 conn(0x7f690015a680 0x7f69000cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.605+0000 7f6908412700 1 --2- 172.21.15.31:0/1761242857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690015a2b0 0x7f69000b3da0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.605+0000 7f6908412700 1 --2- 172.21.15.31:0/1761242857 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f69000d1c30 0x7f69000cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.605+0000 7f6908412700 1 -- 172.21.15.31:0/1761242857 >> 172.21.15.31:0/1761242857 conn(0x7f6900067e40 msgr2=0x7f69000d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:13.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.605+0000 7f6908412700 1 -- 172.21.15.31:0/1761242857 shutdown_connections 2023-10-09T06:22:13.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.605+0000 7f6908412700 1 -- 172.21.15.31:0/1761242857 wait complete. 2023-10-09T06:22:13.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.606+0000 7f6908412700 1 Processor -- start 2023-10-09T06:22:13.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.606+0000 7f6908412700 1 -- start start 2023-10-09T06:22:13.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.606+0000 7f6908412700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f69000d1c30 0x7f690015da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.606+0000 7f6908412700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f690015a2b0 0x7f690014ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.606+0000 7f6908412700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690015a680 0x7f69001588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.606+0000 7f6908412700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69000c9970 con 0x7f690015a680 2023-10-09T06:22:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.606+0000 7f6908412700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69000cacd0 con 0x7f690015a2b0 2023-10-09T06:22:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.606+0000 7f6908412700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69000c9bc0 con 0x7f69000d1c30 2023-10-09T06:22:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.606+0000 7f69069af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690015a680 0x7f69001588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f69069af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690015a680 0x7f69001588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35714/0 (socket says 172.21.15.31:35714) 2023-10-09T06:22:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f69069af700 1 -- 172.21.15.31:0/1918892388 learned_addr learned my addr 172.21.15.31:0/1918892388 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f69059ad700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f690015a2b0 0x7f690014ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f69061ae700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f69000d1c30 0x7f690015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f69069af700 1 -- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f69000d1c30 msgr2=0x7f690015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f69069af700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f69000d1c30 0x7f690015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f69069af700 1 -- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f690015a2b0 msgr2=0x7f690014ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f69069af700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f690015a2b0 0x7f690014ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f69069af700 1 -- 172.21.15.31:0/1918892388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f8009ae0 con 0x7f690015a680 2023-10-09T06:22:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f69069af700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690015a680 0x7f69001588f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f68f000d890 tx=0x7f68f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f68fe7fc700 1 -- 172.21.15.31:0/1918892388 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f00125f0 con 0x7f690015a680 2023-10-09T06:22:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f68fe7fc700 1 -- 172.21.15.31:0/1918892388 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f0012750 con 0x7f690015a680 2023-10-09T06:22:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f6908412700 1 -- 172.21.15.31:0/1918892388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69000ca3a0 con 0x7f690015a680 2023-10-09T06:22:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f68fe7fc700 1 -- 172.21.15.31:0/1918892388 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0012ad0 con 0x7f690015a680 2023-10-09T06:22:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.607+0000 7f6908412700 1 -- 172.21.15.31:0/1918892388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69000ca960 con 0x7f690015a680 2023-10-09T06:22:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.608+0000 7f6908412700 1 -- 172.21.15.31:0/1918892388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690015c570 con 0x7f690015a680 2023-10-09T06:22:13.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.608+0000 7f68fe7fc700 1 -- 172.21.15.31:0/1918892388 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68f0014430 con 0x7f690015a680 2023-10-09T06:22:13.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.609+0000 7f68fe7fc700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68ec066f30 0x7f68ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.609+0000 7f68fe7fc700 1 -- 172.21.15.31:0/1918892388 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68f0084800 con 0x7f690015a680 2023-10-09T06:22:13.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.609+0000 7f69061ae700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68ec066f30 0x7f68ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.610+0000 7f69061ae700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68ec066f30 0x7f68ec0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009fd0 tx=0x7f68f8018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:13.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.613+0000 7f68fe7fc700 1 -- 172.21.15.31:0/1918892388 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68f0051a70 con 0x7f690015a680 2023-10-09T06:22:13.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.808+0000 7f6908412700 1 -- 172.21.15.31:0/1918892388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f690004c3c0 con 0x7f690015a680 2023-10-09T06:22:13.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.809+0000 7f68fe7fc700 1 -- 172.21.15.31:0/1918892388 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f68f0055090 con 0x7f690015a680 2023-10-09T06:22:13.808 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:13.808 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":44,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:22:12.503714+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:22:10.914998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T06:22:11.476116+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:22:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.811+0000 7f6908412700 1 -- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68ec066f30 msgr2=0x7f68ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.811+0000 7f6908412700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68ec066f30 0x7f68ec0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009fd0 tx=0x7f68f8018000 comp rx=0 tx=0).stop 2023-10-09T06:22:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.811+0000 7f6908412700 1 -- 172.21.15.31:0/1918892388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690015a680 msgr2=0x7f69001588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.811+0000 7f6908412700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690015a680 0x7f69001588f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f68f000d890 tx=0x7f68f0008040 comp rx=0 tx=0).stop 2023-10-09T06:22:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.811+0000 7f6908412700 1 -- 172.21.15.31:0/1918892388 shutdown_connections 2023-10-09T06:22:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.811+0000 7f6908412700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68ec066f30 0x7f68ec0693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.811+0000 7f6908412700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f69000d1c30 0x7f690015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.811+0000 7f6908412700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690015a680 0x7f69001588f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.811+0000 7f6908412700 1 --2- 172.21.15.31:0/1918892388 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f690015a2b0 0x7f690014ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.811+0000 7f6908412700 1 -- 172.21.15.31:0/1918892388 >> 172.21.15.31:0/1918892388 conn(0x7f6900067e40 msgr2=0x7f6900069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:13.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.811+0000 7f6908412700 1 -- 172.21.15.31:0/1918892388 shutdown_connections 2023-10-09T06:22:13.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.811+0000 7f6908412700 1 -- 172.21.15.31:0/1918892388 wait complete. 2023-10-09T06:22:13.823 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:22:13.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.945+0000 7f62c976a700 1 Processor -- start 2023-10-09T06:22:13.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.945+0000 7f62c976a700 1 -- start start 2023-10-09T06:22:13.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.946+0000 7f62c976a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62c4159860 0x7f62c4159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.946+0000 7f62c976a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f62c40b3140 0x7f62c415d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.946+0000 7f62c976a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c415a170 con 0x7f62c40b12a0 2023-10-09T06:22:13.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.946+0000 7f62c976a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c415e710 con 0x7f62c40b3140 2023-10-09T06:22:13.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.946+0000 7f62c976a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40b04e0 con 0x7f62c4159860 2023-10-09T06:22:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.946+0000 7f62c37fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f62c40b3140 0x7f62c415d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.946+0000 7f62c2ffd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62c4159860 0x7f62c4159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.946+0000 7f62c27fc700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f62c40b12a0 0x7f62c40b2a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:52074/0 (socket says 172.21.15.31:52074) 2023-10-09T06:22:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.946+0000 7f62c27fc700 1 -- 172.21.15.31:0/3103516744 learned_addr learned my addr 172.21.15.31:0/3103516744 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.947+0000 7f62c1ffb700 1 -- 172.21.15.31:0/3103516744 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163643609 0 0) 0x7f62c415a170 con 0x7f62c40b12a0 2023-10-09T06:22:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.947+0000 7f62c1ffb700 1 -- 172.21.15.31:0/3103516744 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62b0003570 con 0x7f62c40b12a0 2023-10-09T06:22:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.947+0000 7f62c37fe700 1 -- 172.21.15.31:0/3103516744 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62c4159860 msgr2=0x7f62c4159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.947+0000 7f62c37fe700 1 --2- 172.21.15.31:0/3103516744 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62c4159860 0x7f62c4159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.947+0000 7f62c37fe700 1 -- 172.21.15.31:0/3103516744 >> v1:172.21.15.158:6789/0 conn(0x7f62c40b12a0 legacy=0x7f62c40b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.947+0000 7f62c37fe700 1 -- 172.21.15.31:0/3103516744 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40b07c0 con 0x7f62c40b3140 2023-10-09T06:22:13.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.947+0000 7f62c2ffd700 1 --2- 172.21.15.31:0/3103516744 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62c4159860 0x7f62c4159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:22:13.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.947+0000 7f62c37fe700 1 --2- 172.21.15.31:0/3103516744 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62c40b3140 0x7f62c415d9b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009e60 tx=0x7f62b4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45444004f27e5e18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:13.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.947+0000 7f62c1ffb700 1 -- 172.21.15.31:0/3103516744 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b400e070 con 0x7f62c40b3140 2023-10-09T06:22:13.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.947+0000 7f62c1ffb700 1 -- 172.21.15.31:0/3103516744 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b400bab0 con 0x7f62c40b3140 2023-10-09T06:22:13.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.947+0000 7f62c1ffb700 1 -- 172.21.15.31:0/3103516744 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b400be70 con 0x7f62c40b3140 2023-10-09T06:22:13.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.948+0000 7f62c976a700 1 -- 172.21.15.31:0/3103516744 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62c40b3140 msgr2=0x7f62c415d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.948+0000 7f62c976a700 1 --2- 172.21.15.31:0/3103516744 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62c40b3140 0x7f62c415d9b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009e60 tx=0x7f62b4009780 comp rx=0 tx=0).stop 2023-10-09T06:22:13.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.948+0000 7f62c976a700 1 -- 172.21.15.31:0/3103516744 shutdown_connections 2023-10-09T06:22:13.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.948+0000 7f62c976a700 1 --2- 172.21.15.31:0/3103516744 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62c40b3140 0x7f62c415d9b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.948+0000 7f62c976a700 1 --2- 172.21.15.31:0/3103516744 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62c4159860 0x7f62c4159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.948+0000 7f62c976a700 1 -- 172.21.15.31:0/3103516744 >> 172.21.15.31:0/3103516744 conn(0x7f62c4068c80 msgr2=0x7f62c4069080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:13.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.948+0000 7f62c976a700 1 -- 172.21.15.31:0/3103516744 shutdown_connections 2023-10-09T06:22:13.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.948+0000 7f62c976a700 1 -- 172.21.15.31:0/3103516744 wait complete. 2023-10-09T06:22:13.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.949+0000 7f62c976a700 1 Processor -- start 2023-10-09T06:22:13.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.949+0000 7f62c976a700 1 -- start start 2023-10-09T06:22:13.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c976a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62c40b12a0 0x7f62c4156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c976a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c40b3140 0x7f62c40ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c976a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62c4159860 0x7f62c40b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c976a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40cef90 con 0x7f62c40b3140 2023-10-09T06:22:13.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c976a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40cf270 con 0x7f62c4159860 2023-10-09T06:22:13.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c976a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40cf550 con 0x7f62c40b12a0 2023-10-09T06:22:13.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c27fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c40b3140 0x7f62c40ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c27fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c40b3140 0x7f62c40ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35730/0 (socket says 172.21.15.31:35730) 2023-10-09T06:22:13.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c27fc700 1 -- 172.21.15.31:0/569897428 learned_addr learned my addr 172.21.15.31:0/569897428 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:13.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c2ffd700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62c40b12a0 0x7f62c4156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c37fe700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62c4159860 0x7f62c40b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c27fc700 1 -- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62c40b12a0 msgr2=0x7f62c4156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c27fc700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62c40b12a0 0x7f62c4156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c27fc700 1 -- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62c4159860 msgr2=0x7f62c40b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:13.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c27fc700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62c4159860 0x7f62c40b4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:13.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c27fc700 1 -- 172.21.15.31:0/569897428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc009420 con 0x7f62c40b3140 2023-10-09T06:22:13.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c27fc700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c40b3140 0x7f62c40ce740 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c560 tx=0x7f62ac007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:13.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62baffd700 1 -- 172.21.15.31:0/569897428 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac005b30 con 0x7f62c40b3140 2023-10-09T06:22:13.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62baffd700 1 -- 172.21.15.31:0/569897428 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac005c90 con 0x7f62c40b3140 2023-10-09T06:22:13.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c976a700 1 -- 172.21.15.31:0/569897428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b4009a20 con 0x7f62c40b3140 2023-10-09T06:22:13.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62baffd700 1 -- 172.21.15.31:0/569897428 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0072e0 con 0x7f62c40b3140 2023-10-09T06:22:13.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.950+0000 7f62c976a700 1 -- 172.21.15.31:0/569897428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c40cfb10 con 0x7f62c40b3140 2023-10-09T06:22:13.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.951+0000 7f62c976a700 1 -- 172.21.15.31:0/569897428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c40cfd30 con 0x7f62c40b3140 2023-10-09T06:22:13.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.952+0000 7f62baffd700 1 -- 172.21.15.31:0/569897428 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62ac01b3b0 con 0x7f62c40b3140 2023-10-09T06:22:13.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.952+0000 7f62baffd700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f62a4066f30 0x7f62a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:13.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.952+0000 7f62baffd700 1 -- 172.21.15.31:0/569897428 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f62ac0837b0 con 0x7f62c40b3140 2023-10-09T06:22:13.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.952+0000 7f62c2ffd700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f62a4066f30 0x7f62a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:13.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.953+0000 7f62c2ffd700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f62a4066f30 0x7f62a40693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62c40c79e0 tx=0x7f62bc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:13.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:13.957+0000 7f62baffd700 1 -- 172.21.15.31:0/569897428 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62ac04b5a0 con 0x7f62c40b3140 2023-10-09T06:22:14.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:14.199+0000 7f62c976a700 1 -- 172.21.15.31:0/569897428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f62c40c58f0 con 0x7f62c40b3140 2023-10-09T06:22:15.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.131+0000 7f62baffd700 1 -- 172.21.15.31:0/569897428 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f62ac0170b0 con 0x7f62c40b3140 2023-10-09T06:22:15.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.133+0000 7f62c976a700 1 -- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f62a4066f30 msgr2=0x7f62a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:15.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.134+0000 7f62c976a700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f62a4066f30 0x7f62a40693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62c40c79e0 tx=0x7f62bc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.134+0000 7f62c976a700 1 -- 172.21.15.31:0/569897428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c40b3140 msgr2=0x7f62c40ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.134+0000 7f62c976a700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c40b3140 0x7f62c40ce740 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c560 tx=0x7f62ac007dd0 comp rx=0 tx=0).stop 2023-10-09T06:22:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.134+0000 7f62c976a700 1 -- 172.21.15.31:0/569897428 shutdown_connections 2023-10-09T06:22:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.134+0000 7f62c976a700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f62a4066f30 0x7f62a40693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.134+0000 7f62c976a700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62c40b12a0 0x7f62c4156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.134+0000 7f62c976a700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62c4159860 0x7f62c40b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.134+0000 7f62c976a700 1 --2- 172.21.15.31:0/569897428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c40b3140 0x7f62c40ce740 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.134+0000 7f62c976a700 1 -- 172.21.15.31:0/569897428 >> 172.21.15.31:0/569897428 conn(0x7f62c4068c80 msgr2=0x7f62c415b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.134+0000 7f62c976a700 1 -- 172.21.15.31:0/569897428 shutdown_connections 2023-10-09T06:22:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.134+0000 7f62c976a700 1 -- 172.21.15.31:0/569897428 wait complete. 2023-10-09T06:22:15.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:22:15.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.270+0000 7f12e186a700 1 Processor -- start 2023-10-09T06:22:15.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.270+0000 7f12e186a700 1 -- start start 2023-10-09T06:22:15.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.271+0000 7f12e186a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f12dc0cd300 0x7f12dc15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:15.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.271+0000 7f12e186a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12dc0d1470 0x7f12dc0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:15.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.271+0000 7f12e186a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12dc1513f0 con 0x7f12dc0b6760 2023-10-09T06:22:15.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.271+0000 7f12e186a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12dc15e7a0 con 0x7f12dc0cd300 2023-10-09T06:22:15.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.271+0000 7f12e186a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc15db20 con 0x7f12dc0d1470 2023-10-09T06:22:15.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.271+0000 7f12da7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f12dc0b6760 0x7f12dc0d0d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53442/0 (socket says 172.21.15.31:53442) 2023-10-09T06:22:15.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.271+0000 7f12da7fc700 1 -- 172.21.15.31:0/390374696 learned_addr learned my addr 172.21.15.31:0/390374696 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:15.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.271+0000 7f12db7fe700 1 --2- 172.21.15.31:0/390374696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12dc0d1470 0x7f12dc0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:15.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.271+0000 7f12daffd700 1 --2- 172.21.15.31:0/390374696 >> v2:172.21.15.158:3300/0 conn(0x7f12dc0cd300 0x7f12dc15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:15.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.271+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062403411 0 0) 0x7f12dc1513f0 con 0x7f12dc0b6760 2023-10-09T06:22:15.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c8003570 con 0x7f12dc0b6760 2023-10-09T06:22:15.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1462482854 0 0) 0x7f12c8003570 con 0x7f12dc0b6760 2023-10-09T06:22:15.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12dc0d1470 msgr2=0x7f12dc0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:15.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 --2- 172.21.15.31:0/390374696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12dc0d1470 0x7f12dc0cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:15.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 >> v2:172.21.15.158:3300/0 conn(0x7f12dc0cd300 msgr2=0x7f12dc15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:15.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 --2- 172.21.15.31:0/390374696 >> v2:172.21.15.158:3300/0 conn(0x7f12dc0cd300 0x7f12dc15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:15.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc15de00 con 0x7f12dc0b6760 2023-10-09T06:22:15.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f12c4001470 con 0x7f12dc0b6760 2023-10-09T06:22:15.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 >> v1:172.21.15.31:6789/0 conn(0x7f12dc0b6760 legacy=0x7f12dc0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:15.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 --2- 172.21.15.31:0/390374696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12c8003a60 0x7f12c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:15.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 --2- 172.21.15.31:0/390374696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c8004810 0x7f12c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:15.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 --2- 172.21.15.31:0/390374696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12dc0d1470 0x7f12c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:15.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc15e7a0 con 0x7f12c8003a60 2023-10-09T06:22:15.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc15db20 con 0x7f12c8004810 2023-10-09T06:22:15.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c800ba60 con 0x7f12dc0d1470 2023-10-09T06:22:15.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12daffd700 1 --2- 172.21.15.31:0/390374696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12c8003a60 0x7f12c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:15.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12da7fc700 1 --2- 172.21.15.31:0/390374696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c8004810 0x7f12c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:15.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12db7fe700 1 --2- 172.21.15.31:0/390374696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12dc0d1470 0x7f12c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:15.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12daffd700 1 -- 172.21.15.31:0/390374696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12dc0d1470 msgr2=0x7f12c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:15.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12daffd700 1 --2- 172.21.15.31:0/390374696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12dc0d1470 0x7f12c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:15.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12daffd700 1 -- 172.21.15.31:0/390374696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c8004810 msgr2=0x7f12c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:15.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12daffd700 1 --2- 172.21.15.31:0/390374696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c8004810 0x7f12c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:15.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12daffd700 1 -- 172.21.15.31:0/390374696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c8003570 con 0x7f12c8003a60 2023-10-09T06:22:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12da7fc700 1 --2- 172.21.15.31:0/390374696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c8004810 0x7f12c8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12daffd700 1 --2- 172.21.15.31:0/390374696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12c8003a60 0x7f12c8003e70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009c30 tx=0x7f12d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9729c3bc913e7096 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.272+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d400e710 con 0x7f12c8003a60 2023-10-09T06:22:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.273+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d400e870 con 0x7f12c8003a60 2023-10-09T06:22:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.273+0000 7f12d9ffb700 1 -- 172.21.15.31:0/390374696 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d400ec30 con 0x7f12c8003a60 2023-10-09T06:22:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.273+0000 7f12e186a700 1 -- 172.21.15.31:0/390374696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12c8003a60 msgr2=0x7f12c8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.273+0000 7f12e186a700 1 --2- 172.21.15.31:0/390374696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12c8003a60 0x7f12c8003e70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009c30 tx=0x7f12d40091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.273+0000 7f12db7fe700 1 -- 172.21.15.31:0/390374696 reap_dead start 2023-10-09T06:22:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.273+0000 7f12e186a700 1 -- 172.21.15.31:0/390374696 shutdown_connections 2023-10-09T06:22:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.273+0000 7f12e186a700 1 -- 172.21.15.31:0/390374696 >> 172.21.15.31:0/390374696 conn(0x7f12dc068d90 msgr2=0x7f12dc069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.273+0000 7f12e186a700 1 -- 172.21.15.31:0/390374696 shutdown_connections 2023-10-09T06:22:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.273+0000 7f12e186a700 1 -- 172.21.15.31:0/390374696 wait complete. 2023-10-09T06:22:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.274+0000 7f12e186a700 1 Processor -- start 2023-10-09T06:22:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.274+0000 7f12e186a700 1 -- start start 2023-10-09T06:22:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.275+0000 7f12e186a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c8003a60 0x7f12dc14d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.275+0000 7f12e186a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12dc0c8d00 0x7f12dc0c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.275+0000 7f12e186a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12dc15c9a0 0x7f12dc15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.275+0000 7f12e186a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0ca530 con 0x7f12dc0c8d00 2023-10-09T06:22:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.275+0000 7f12e186a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc15d350 con 0x7f12c8003a60 2023-10-09T06:22:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.275+0000 7f12e186a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc14de70 con 0x7f12dc15c9a0 2023-10-09T06:22:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.275+0000 7f12da7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12dc0c8d00 0x7f12dc0c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.275+0000 7f12da7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12dc0c8d00 0x7f12dc0c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35748/0 (socket says 172.21.15.31:35748) 2023-10-09T06:22:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.275+0000 7f12da7fc700 1 -- 172.21.15.31:0/841416149 learned_addr learned my addr 172.21.15.31:0/841416149 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.275+0000 7f12daffd700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c8003a60 0x7f12dc14d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.275+0000 7f12db7fe700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12dc15c9a0 0x7f12dc15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.276+0000 7f12da7fc700 1 -- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12dc15c9a0 msgr2=0x7f12dc15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.276+0000 7f12da7fc700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12dc15c9a0 0x7f12dc15ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.276+0000 7f12da7fc700 1 -- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c8003a60 msgr2=0x7f12dc14d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.276+0000 7f12da7fc700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c8003a60 0x7f12dc14d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.276+0000 7f12da7fc700 1 -- 172.21.15.31:0/841416149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc0c6ea0 con 0x7f12dc0c8d00 2023-10-09T06:22:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.276+0000 7f12da7fc700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12dc0c8d00 0x7f12dc0c6560 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f12c4001010 tx=0x7f12c4001570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.276+0000 7f12d2ffd700 1 -- 172.21.15.31:0/841416149 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c400c5a0 con 0x7f12dc0c8d00 2023-10-09T06:22:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.276+0000 7f12d2ffd700 1 -- 172.21.15.31:0/841416149 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c400c700 con 0x7f12dc0c8d00 2023-10-09T06:22:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.276+0000 7f12e186a700 1 -- 172.21.15.31:0/841416149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12dc0c7180 con 0x7f12dc0c8d00 2023-10-09T06:22:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.276+0000 7f12d2ffd700 1 -- 172.21.15.31:0/841416149 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c400caa0 con 0x7f12dc0c8d00 2023-10-09T06:22:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.276+0000 7f12e186a700 1 -- 172.21.15.31:0/841416149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12dc0c7740 con 0x7f12dc0c8d00 2023-10-09T06:22:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.277+0000 7f12e186a700 1 -- 172.21.15.31:0/841416149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12dc0ca670 con 0x7f12dc0c8d00 2023-10-09T06:22:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.277+0000 7f12d2ffd700 1 -- 172.21.15.31:0/841416149 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12c401d460 con 0x7f12dc0c8d00 2023-10-09T06:22:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.278+0000 7f12d2ffd700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f12bc066f60 0x7f12bc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.278+0000 7f12d2ffd700 1 -- 172.21.15.31:0/841416149 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12c4084410 con 0x7f12dc0c8d00 2023-10-09T06:22:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.278+0000 7f12daffd700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f12bc066f60 0x7f12bc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.278+0000 7f12daffd700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f12bc066f60 0x7f12bc069410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f12d40091e0 tx=0x7f12d401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.282+0000 7f12d2ffd700 1 -- 172.21.15.31:0/841416149 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12c4051680 con 0x7f12dc0c8d00 2023-10-09T06:22:15.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:15.521+0000 7f12e186a700 1 -- 172.21.15.31:0/841416149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f12dc04c3c0 con 0x7f12dc0c8d00 2023-10-09T06:22:16.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.132+0000 7f12d2ffd700 1 -- 172.21.15.31:0/841416149 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f12c4054ca0 con 0x7f12dc0c8d00 2023-10-09T06:22:16.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.134+0000 7f12e186a700 1 -- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f12bc066f60 msgr2=0x7f12bc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.134+0000 7f12e186a700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f12bc066f60 0x7f12bc069410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f12d40091e0 tx=0x7f12d401a000 comp rx=0 tx=0).stop 2023-10-09T06:22:16.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.134+0000 7f12e186a700 1 -- 172.21.15.31:0/841416149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12dc0c8d00 msgr2=0x7f12dc0c6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.134+0000 7f12e186a700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12dc0c8d00 0x7f12dc0c6560 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f12c4001010 tx=0x7f12c4001570 comp rx=0 tx=0).stop 2023-10-09T06:22:16.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.135+0000 7f12e186a700 1 -- 172.21.15.31:0/841416149 shutdown_connections 2023-10-09T06:22:16.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.135+0000 7f12e186a700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f12bc066f60 0x7f12bc069410 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.135+0000 7f12e186a700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12dc15c9a0 0x7f12dc15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.135+0000 7f12e186a700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c8003a60 0x7f12dc14d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.135+0000 7f12e186a700 1 --2- 172.21.15.31:0/841416149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12dc0c8d00 0x7f12dc0c6560 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.135+0000 7f12e186a700 1 -- 172.21.15.31:0/841416149 >> 172.21.15.31:0/841416149 conn(0x7f12dc068d90 msgr2=0x7f12dc15b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:16.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.135+0000 7f12e186a700 1 -- 172.21.15.31:0/841416149 shutdown_connections 2023-10-09T06:22:16.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.135+0000 7f12e186a700 1 -- 172.21.15.31:0/841416149 wait complete. 2023-10-09T06:22:16.148 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:22:16.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.271+0000 7f3e5a120700 1 Processor -- start 2023-10-09T06:22:16.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.271+0000 7f3e5a120700 1 -- start start 2023-10-09T06:22:16.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e5a120700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3e5415a620 0x7f3e5415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e5a120700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5415cbb0 con 0x7f3e54157870 2023-10-09T06:22:16.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e5a120700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5415bfa0 con 0x7f3e5415d580 2023-10-09T06:22:16.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e5a120700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5415bdb0 con 0x7f3e5415a620 2023-10-09T06:22:16.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e537fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3e54157870 0x7f3e5415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53454/0 (socket says 172.21.15.31:53454) 2023-10-09T06:22:16.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e537fe700 1 -- 172.21.15.31:0/1442108759 learned_addr learned my addr 172.21.15.31:0/1442108759 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:16.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e52ffd700 1 --2- 172.21.15.31:0/1442108759 >> v2:172.21.15.158:3300/0 conn(0x7f3e5415a620 0x7f3e5415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124033201 0 0) 0x7f3e5415cbb0 con 0x7f3e54157870 2023-10-09T06:22:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e3c003570 con 0x7f3e54157870 2023-10-09T06:22:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402219097 0 0) 0x7f3e5415bfa0 con 0x7f3e5415d580 2023-10-09T06:22:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e5415cbb0 con 0x7f3e5415d580 2023-10-09T06:22:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1338168334 0 0) 0x7f3e3c003570 con 0x7f3e54157870 2023-10-09T06:22:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 >> v2:172.21.15.158:3300/0 conn(0x7f3e5415a620 msgr2=0x7f3e5415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e527fc700 1 --2- 172.21.15.31:0/1442108759 >> v2:172.21.15.158:3300/0 conn(0x7f3e5415a620 0x7f3e5415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 >> v1:172.21.15.158:6789/0 conn(0x7f3e5415d580 legacy=0x7f3e54158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5415c280 con 0x7f3e54157870 2023-10-09T06:22:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.272+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f3e44001470 con 0x7f3e54157870 2023-10-09T06:22:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 >> v1:172.21.15.31:6789/0 conn(0x7f3e54157870 legacy=0x7f3e5415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e527fc700 1 --2- 172.21.15.31:0/1442108759 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3e3c003c40 0x7f3e3c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e527fc700 1 --2- 172.21.15.31:0/1442108759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c004810 0x7f3e3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e527fc700 1 --2- 172.21.15.31:0/1442108759 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e3c005210 0x7f3e3c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c00c180 con 0x7f3e3c004810 2023-10-09T06:22:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c00c2f0 con 0x7f3e3c005210 2023-10-09T06:22:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c00c4b0 con 0x7f3e3c003c40 2023-10-09T06:22:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e52ffd700 1 --2- 172.21.15.31:0/1442108759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c004810 0x7f3e3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e537fe700 1 --2- 172.21.15.31:0/1442108759 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3e3c003c40 0x7f3e3c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e53fff700 1 --2- 172.21.15.31:0/1442108759 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e3c005210 0x7f3e3c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e52ffd700 1 -- 172.21.15.31:0/1442108759 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3e3c003c40 msgr2=0x7f3e3c004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e52ffd700 1 --2- 172.21.15.31:0/1442108759 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3e3c003c40 0x7f3e3c004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e52ffd700 1 -- 172.21.15.31:0/1442108759 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e3c005210 msgr2=0x7f3e3c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e52ffd700 1 --2- 172.21.15.31:0/1442108759 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e3c005210 0x7f3e3c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e52ffd700 1 -- 172.21.15.31:0/1442108759 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c003570 con 0x7f3e3c004810 2023-10-09T06:22:16.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e53fff700 1 -- 172.21.15.31:0/1442108759 reap_dead start 2023-10-09T06:22:16.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e52ffd700 1 --2- 172.21.15.31:0/1442108759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c004810 0x7f3e3c004c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3e48006f00 tx=0x7f3e480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d9e84a00dba863 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:16.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800e6e0 con 0x7f3e3c004810 2023-10-09T06:22:16.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4800e840 con 0x7f3e3c004810 2023-10-09T06:22:16.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.273+0000 7f3e527fc700 1 -- 172.21.15.31:0/1442108759 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800ec00 con 0x7f3e3c004810 2023-10-09T06:22:16.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.274+0000 7f3e5a120700 1 -- 172.21.15.31:0/1442108759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c004810 msgr2=0x7f3e3c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.274+0000 7f3e5a120700 1 --2- 172.21.15.31:0/1442108759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c004810 0x7f3e3c004c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3e48006f00 tx=0x7f3e480091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.274+0000 7f3e5a120700 1 -- 172.21.15.31:0/1442108759 shutdown_connections 2023-10-09T06:22:16.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.274+0000 7f3e5a120700 1 --2- 172.21.15.31:0/1442108759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c004810 0x7f3e3c004c80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.274+0000 7f3e5a120700 1 -- 172.21.15.31:0/1442108759 >> 172.21.15.31:0/1442108759 conn(0x7f3e54068ce0 msgr2=0x7f3e540690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:16.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.274+0000 7f3e5a120700 1 -- 172.21.15.31:0/1442108759 shutdown_connections 2023-10-09T06:22:16.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.274+0000 7f3e5a120700 1 -- 172.21.15.31:0/1442108759 wait complete. 2023-10-09T06:22:16.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.275+0000 7f3e5a120700 1 Processor -- start 2023-10-09T06:22:16.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.275+0000 7f3e5a120700 1 -- start start 2023-10-09T06:22:16.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e5a120700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c004810 0x7f3e5416a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e5a120700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e540d12e0 0x7f3e5416aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e5a120700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3e540b4c70 0x7f3e540b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e5a120700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e540d0e50 con 0x7f3e3c004810 2023-10-09T06:22:16.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e5a120700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e540d0240 con 0x7f3e540d12e0 2023-10-09T06:22:16.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e5a120700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e540d0520 con 0x7f3e540b4c70 2023-10-09T06:22:16.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c004810 0x7f3e5416a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c004810 0x7f3e5416a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35768/0 (socket says 172.21.15.31:35768) 2023-10-09T06:22:16.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e537fe700 1 -- 172.21.15.31:0/1264466649 learned_addr learned my addr 172.21.15.31:0/1264466649 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:16.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e53fff700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3e540b4c70 0x7f3e540b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e52ffd700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e540d12e0 0x7f3e5416aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e537fe700 1 -- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3e540b4c70 msgr2=0x7f3e540b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e537fe700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3e540b4c70 0x7f3e540b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e537fe700 1 -- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e540d12e0 msgr2=0x7f3e5416aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e537fe700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e540d12e0 0x7f3e5416aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.276+0000 7f3e537fe700 1 -- 172.21.15.31:0/1264466649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e540d0800 con 0x7f3e3c004810 2023-10-09T06:22:16.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.277+0000 7f3e537fe700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c004810 0x7f3e5416a540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3e440073c0 tx=0x7f3e44001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:16.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.277+0000 7f3e3b7fe700 1 -- 172.21.15.31:0/1264466649 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44018030 con 0x7f3e3c004810 2023-10-09T06:22:16.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.277+0000 7f3e3b7fe700 1 -- 172.21.15.31:0/1264466649 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4400f6c0 con 0x7f3e3c004810 2023-10-09T06:22:16.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.277+0000 7f3e5a120700 1 -- 172.21.15.31:0/1264466649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e540d0ae0 con 0x7f3e3c004810 2023-10-09T06:22:16.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.277+0000 7f3e3b7fe700 1 -- 172.21.15.31:0/1264466649 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400fa80 con 0x7f3e3c004810 2023-10-09T06:22:16.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.277+0000 7f3e5a120700 1 -- 172.21.15.31:0/1264466649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e540b5620 con 0x7f3e3c004810 2023-10-09T06:22:16.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.278+0000 7f3e5a120700 1 -- 172.21.15.31:0/1264466649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e540d1130 con 0x7f3e3c004810 2023-10-09T06:22:16.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.278+0000 7f3e3b7fe700 1 -- 172.21.15.31:0/1264466649 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e4401b070 con 0x7f3e3c004810 2023-10-09T06:22:16.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.278+0000 7f3e3b7fe700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e40066f30 0x7f3e400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.278+0000 7f3e3b7fe700 1 -- 172.21.15.31:0/1264466649 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e44019070 con 0x7f3e3c004810 2023-10-09T06:22:16.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.279+0000 7f3e52ffd700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e40066f30 0x7f3e400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.279+0000 7f3e52ffd700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e40066f30 0x7f3e400693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e480091e0 tx=0x7f3e4801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:16.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.283+0000 7f3e3b7fe700 1 -- 172.21.15.31:0/1264466649 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e440515c0 con 0x7f3e3c004810 2023-10-09T06:22:16.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.523+0000 7f3e5a120700 1 -- 172.21.15.31:0/1264466649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e5404c3c0 con 0x7f3e3c004810 2023-10-09T06:22:16.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.524+0000 7f3e3b7fe700 1 -- 172.21.15.31:0/1264466649 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f3e44054be0 con 0x7f3e3c004810 2023-10-09T06:22:16.524 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:16.524 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2970905850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2970905850},{"type":"v1","addr":"172.21.15.158:6837","nonce":2970905850}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5119,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1945558670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1945558670},{"type":"v1","addr":"172.21.15.31:6835","nonce":1945558670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3853703125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3853703125},{"type":"v1","addr":"172.21.15.31:6834","nonce":3853703125}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:22:12.504027+0000","modified":"2023-10-09T06:22:16.130642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/1366477380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1366477380},{"type":"v1","addr":"172.21.15.158:6836","nonce":1366477380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:22:16.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.526+0000 7f3e5a120700 1 -- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e40066f30 msgr2=0x7f3e400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.526+0000 7f3e5a120700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e40066f30 0x7f3e400693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e480091e0 tx=0x7f3e4801a000 comp rx=0 tx=0).stop 2023-10-09T06:22:16.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.526+0000 7f3e5a120700 1 -- 172.21.15.31:0/1264466649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c004810 msgr2=0x7f3e5416a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.526+0000 7f3e5a120700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c004810 0x7f3e5416a540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3e440073c0 tx=0x7f3e44001d40 comp rx=0 tx=0).stop 2023-10-09T06:22:16.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.526+0000 7f3e5a120700 1 -- 172.21.15.31:0/1264466649 shutdown_connections 2023-10-09T06:22:16.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.526+0000 7f3e5a120700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e40066f30 0x7f3e400693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.526+0000 7f3e5a120700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3e540b4c70 0x7f3e540b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.526+0000 7f3e5a120700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c004810 0x7f3e5416a540 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.526+0000 7f3e5a120700 1 --2- 172.21.15.31:0/1264466649 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e540d12e0 0x7f3e5416aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.526+0000 7f3e5a120700 1 -- 172.21.15.31:0/1264466649 >> 172.21.15.31:0/1264466649 conn(0x7f3e54068ce0 msgr2=0x7f3e5414c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:16.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.526+0000 7f3e5a120700 1 -- 172.21.15.31:0/1264466649 shutdown_connections 2023-10-09T06:22:16.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.526+0000 7f3e5a120700 1 -- 172.21.15.31:0/1264466649 wait complete. 2023-10-09T06:22:16.528 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 25 2023-10-09T06:22:16.538 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:22:16.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.658+0000 7f0a71208700 1 Processor -- start 2023-10-09T06:22:16.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.658+0000 7f0a71208700 1 -- start start 2023-10-09T06:22:16.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a71208700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6c0cd6e0 0x7f0a6c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a71208700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0a6c15cbd0 0x7f0a6c15d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a71208700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c0cb7c0 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a71208700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c15e850 con 0x7f0a6c15cbd0 2023-10-09T06:22:16.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a71208700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0cd030 con 0x7f0a6c0cd6e0 2023-10-09T06:22:16.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a70a07700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0a6c15cbd0 0x7f0a6c15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a6b7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0a6c0cdab0 0x7f0a6c15d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53464/0 (socket says 172.21.15.31:53464) 2023-10-09T06:22:16.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a6b7fe700 1 -- 172.21.15.31:0/3937718064 learned_addr learned my addr 172.21.15.31:0/3937718064 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:16.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a6bfff700 1 --2- 172.21.15.31:0/3937718064 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6c0cd6e0 0x7f0a6c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a70a07700 1 -- 172.21.15.31:0/3937718064 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6c0cd6e0 msgr2=0x7f0a6c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:16.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a70a07700 1 --2- 172.21.15.31:0/3937718064 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6c0cd6e0 0x7f0a6c0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a70a07700 1 -- 172.21.15.31:0/3937718064 >> v1:172.21.15.31:6789/0 conn(0x7f0a6c0cdab0 legacy=0x7f0a6c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a6affd700 1 -- 172.21.15.31:0/3937718064 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392259745 0 0) 0x7f0a6c0cb7c0 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.659+0000 7f0a70a07700 1 -- 172.21.15.31:0/3937718064 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c15e290 con 0x7f0a6c15cbd0 2023-10-09T06:22:16.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.660+0000 7f0a70a07700 1 --2- 172.21.15.31:0/3937718064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a6c15cbd0 0x7f0a6c15d020 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009e60 tx=0x7f0a64009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54802b1203410e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:16.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.660+0000 7f0a6affd700 1 -- 172.21.15.31:0/3937718064 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6400e070 con 0x7f0a6c15cbd0 2023-10-09T06:22:16.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.660+0000 7f0a6affd700 1 -- 172.21.15.31:0/3937718064 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6400bb60 con 0x7f0a6c15cbd0 2023-10-09T06:22:16.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.660+0000 7f0a6affd700 1 -- 172.21.15.31:0/3937718064 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64012430 con 0x7f0a6c15cbd0 2023-10-09T06:22:16.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.660+0000 7f0a71208700 1 -- 172.21.15.31:0/3937718064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a6c15cbd0 msgr2=0x7f0a6c15d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.660+0000 7f0a71208700 1 --2- 172.21.15.31:0/3937718064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a6c15cbd0 0x7f0a6c15d020 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009e60 tx=0x7f0a64009780 comp rx=0 tx=0).stop 2023-10-09T06:22:16.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.660+0000 7f0a71208700 1 -- 172.21.15.31:0/3937718064 shutdown_connections 2023-10-09T06:22:16.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.660+0000 7f0a71208700 1 --2- 172.21.15.31:0/3937718064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a6c15cbd0 0x7f0a6c15d020 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.660+0000 7f0a71208700 1 --2- 172.21.15.31:0/3937718064 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6c0cd6e0 0x7f0a6c0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.660+0000 7f0a71208700 1 -- 172.21.15.31:0/3937718064 >> 172.21.15.31:0/3937718064 conn(0x7f0a6c067660 msgr2=0x7f0a6c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:16.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.660+0000 7f0a71208700 1 -- 172.21.15.31:0/3937718064 shutdown_connections 2023-10-09T06:22:16.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.660+0000 7f0a71208700 1 -- 172.21.15.31:0/3937718064 wait complete. 2023-10-09T06:22:16.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.661+0000 7f0a71208700 1 Processor -- start 2023-10-09T06:22:16.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.662+0000 7f0a71208700 1 -- start start 2023-10-09T06:22:16.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.662+0000 7f0a71208700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a6c0cd6e0 0x7f0a6c150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.662+0000 7f0a71208700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a6c0cdab0 0x7f0a6c14eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.662+0000 7f0a71208700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6c15cbd0 0x7f0a6c0c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.662+0000 7f0a71208700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c150d80 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.662+0000 7f0a71208700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0b4200 con 0x7f0a6c0cd6e0 2023-10-09T06:22:16.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.662+0000 7f0a71208700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0b6630 con 0x7f0a6c15cbd0 2023-10-09T06:22:16.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.662+0000 7f0a6b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a6c0cdab0 0x7f0a6c14eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.662+0000 7f0a6b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a6c0cdab0 0x7f0a6c14eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35792/0 (socket says 172.21.15.31:35792) 2023-10-09T06:22:16.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.662+0000 7f0a6b7fe700 1 -- 172.21.15.31:0/322689332 learned_addr learned my addr 172.21.15.31:0/322689332 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:16.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.663+0000 7f0a70a07700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6c15cbd0 0x7f0a6c0c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.663+0000 7f0a6bfff700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a6c0cd6e0 0x7f0a6c150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.663+0000 7f0a6b7fe700 1 -- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6c15cbd0 msgr2=0x7f0a6c0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.663+0000 7f0a6b7fe700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6c15cbd0 0x7f0a6c0c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.663+0000 7f0a6b7fe700 1 -- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a6c0cd6e0 msgr2=0x7f0a6c150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.663+0000 7f0a6b7fe700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a6c0cd6e0 0x7f0a6c150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.663+0000 7f0a6b7fe700 1 -- 172.21.15.31:0/322689332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64009a20 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.663+0000 7f0a6b7fe700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a6c0cdab0 0x7f0a6c14eb10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400c7e0 tx=0x7f0a54007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:16.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.663+0000 7f0a63fff700 1 -- 172.21.15.31:0/322689332 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54005b30 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.663+0000 7f0a63fff700 1 -- 172.21.15.31:0/322689332 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a54005c90 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.663+0000 7f0a71208700 1 -- 172.21.15.31:0/322689332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6c0b3bb0 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.663+0000 7f0a63fff700 1 -- 172.21.15.31:0/322689332 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54007300 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.663+0000 7f0a71208700 1 -- 172.21.15.31:0/322689332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c14f050 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.664+0000 7f0a71208700 1 -- 172.21.15.31:0/322689332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6c0b3a10 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.664+0000 7f0a63fff700 1 -- 172.21.15.31:0/322689332 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a5401b400 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.665+0000 7f0a63fff700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0a4c066f30 0x7f0a4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:16.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.665+0000 7f0a63fff700 1 -- 172.21.15.31:0/322689332 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a54084040 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.665+0000 7f0a6bfff700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0a4c066f30 0x7f0a4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:16.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.665+0000 7f0a6bfff700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0a4c066f30 0x7f0a4c0693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009ca0 tx=0x7f0a5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:16.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.669+0000 7f0a63fff700 1 -- 172.21.15.31:0/322689332 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a6c0b3a10 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.865+0000 7f0a71208700 1 -- 172.21.15.31:0/322689332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a6c0b3a10 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.865+0000 7f0a63fff700 1 -- 172.21.15.31:0/322689332 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f0a6c0b3a10 con 0x7f0a6c0cdab0 2023-10-09T06:22:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":45,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:22:14.102446+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:22:10.914998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T06:22:11.476116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:22:16.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.867+0000 7f0a71208700 1 -- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0a4c066f30 msgr2=0x7f0a4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.867+0000 7f0a71208700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0a4c066f30 0x7f0a4c0693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009ca0 tx=0x7f0a5c008040 comp rx=0 tx=0).stop 2023-10-09T06:22:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.867+0000 7f0a71208700 1 -- 172.21.15.31:0/322689332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a6c0cdab0 msgr2=0x7f0a6c14eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.867+0000 7f0a71208700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a6c0cdab0 0x7f0a6c14eb10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400c7e0 tx=0x7f0a54007df0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.867+0000 7f0a71208700 1 -- 172.21.15.31:0/322689332 shutdown_connections 2023-10-09T06:22:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.868+0000 7f0a71208700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0a4c066f30 0x7f0a4c0693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.868+0000 7f0a71208700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6c15cbd0 0x7f0a6c0c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.868+0000 7f0a71208700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a6c0cd6e0 0x7f0a6c150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.868+0000 7f0a71208700 1 --2- 172.21.15.31:0/322689332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a6c0cdab0 0x7f0a6c14eb10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.868+0000 7f0a71208700 1 -- 172.21.15.31:0/322689332 >> 172.21.15.31:0/322689332 conn(0x7f0a6c067660 msgr2=0x7f0a6c157780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.868+0000 7f0a71208700 1 -- 172.21.15.31:0/322689332 shutdown_connections 2023-10-09T06:22:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:16.868+0000 7f0a71208700 1 -- 172.21.15.31:0/322689332 wait complete. 2023-10-09T06:22:16.880 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:22:16.880 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:22:16.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.000+0000 7f3506433700 1 Processor -- start 2023-10-09T06:22:16.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.000+0000 7f3506433700 1 -- start start 2023-10-09T06:22:17.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.000+0000 7f3506433700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35000afff0 0x7f350015e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.000+0000 7f3506433700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3500069e20 0x7f350006a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.000+0000 7f3506433700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3500070700 0x7f3500070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.000+0000 7f3506433700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35000710c0 con 0x7f3500070700 2023-10-09T06:22:17.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.000+0000 7f3506433700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35000b03c0 con 0x7f3500069e20 2023-10-09T06:22:17.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.000+0000 7f3506433700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350006a870 con 0x7f35000afff0 2023-10-09T06:22:17.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f35049d0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3500070700 0x7f3500070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f35049d0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3500070700 0x7f3500070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35798/0 (socket says 172.21.15.31:35798) 2023-10-09T06:22:17.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f35049d0700 1 -- 172.21.15.31:0/1736572369 learned_addr learned my addr 172.21.15.31:0/1736572369 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:17.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f34ff7fe700 1 --2- 172.21.15.31:0/1736572369 >> v2:172.21.15.158:3300/0 conn(0x7f3500069e20 0x7f350006a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f34fffff700 1 --2- 172.21.15.31:0/1736572369 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35000afff0 0x7f350015e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f35049d0700 1 -- 172.21.15.31:0/1736572369 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35000afff0 msgr2=0x7f350015e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f35049d0700 1 --2- 172.21.15.31:0/1736572369 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35000afff0 0x7f350015e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f35049d0700 1 -- 172.21.15.31:0/1736572369 >> v2:172.21.15.158:3300/0 conn(0x7f3500069e20 msgr2=0x7f350006a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f35049d0700 1 --2- 172.21.15.31:0/1736572369 >> v2:172.21.15.158:3300/0 conn(0x7f3500069e20 0x7f350006a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f35049d0700 1 -- 172.21.15.31:0/1736572369 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350006ab50 con 0x7f3500070700 2023-10-09T06:22:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f34ff7fe700 1 --2- 172.21.15.31:0/1736572369 >> v2:172.21.15.158:3300/0 conn(0x7f3500069e20 0x7f350006a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f34fffff700 1 --2- 172.21.15.31:0/1736572369 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35000afff0 0x7f350015e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f35049d0700 1 --2- 172.21.15.31:0/1736572369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3500070700 0x7f3500070b80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f350006d670 tx=0x7f34f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2b3d13a4c2fd75 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f34feffd700 1 -- 172.21.15.31:0/1736572369 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f800e070 con 0x7f3500070700 2023-10-09T06:22:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f34feffd700 1 -- 172.21.15.31:0/1736572369 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f800ba50 con 0x7f3500070700 2023-10-09T06:22:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.001+0000 7f34feffd700 1 -- 172.21.15.31:0/1736572369 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80092e0 con 0x7f3500070700 2023-10-09T06:22:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.002+0000 7f3506433700 1 -- 172.21.15.31:0/1736572369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3500070700 msgr2=0x7f3500070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.002+0000 7f3506433700 1 --2- 172.21.15.31:0/1736572369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3500070700 0x7f3500070b80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f350006d670 tx=0x7f34f8009840 comp rx=0 tx=0).stop 2023-10-09T06:22:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.002+0000 7f3506433700 1 -- 172.21.15.31:0/1736572369 shutdown_connections 2023-10-09T06:22:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.002+0000 7f3506433700 1 --2- 172.21.15.31:0/1736572369 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f35000afff0 0x7f350015e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.002+0000 7f3506433700 1 --2- 172.21.15.31:0/1736572369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3500070700 0x7f3500070b80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.002+0000 7f3506433700 1 --2- 172.21.15.31:0/1736572369 >> v2:172.21.15.158:3300/0 conn(0x7f3500069e20 0x7f350006a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.002+0000 7f3506433700 1 -- 172.21.15.31:0/1736572369 >> 172.21.15.31:0/1736572369 conn(0x7f35000cda50 msgr2=0x7f35000cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.002+0000 7f3506433700 1 -- 172.21.15.31:0/1736572369 shutdown_connections 2023-10-09T06:22:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.002+0000 7f3506433700 1 -- 172.21.15.31:0/1736572369 wait complete. 2023-10-09T06:22:17.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.003+0000 7f3506433700 1 Processor -- start 2023-10-09T06:22:17.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.003+0000 7f3506433700 1 -- start start 2023-10-09T06:22:17.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f3506433700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3500069e20 0x7f35001570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f3506433700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3500070700 0x7f35001575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f3506433700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35000afff0 0x7f350015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f3506433700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3500152820 con 0x7f35000afff0 2023-10-09T06:22:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f3506433700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350016b2f0 con 0x7f3500069e20 2023-10-09T06:22:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f3506433700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350015aeb0 con 0x7f3500070700 2023-10-09T06:22:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f35049d0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35000afff0 0x7f350015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f35049d0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35000afff0 0x7f350015a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35806/0 (socket says 172.21.15.31:35806) 2023-10-09T06:22:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f35049d0700 1 -- 172.21.15.31:0/3591584903 learned_addr learned my addr 172.21.15.31:0/3591584903 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f34ff7fe700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3500070700 0x7f35001575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f35049d0700 1 -- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3500070700 msgr2=0x7f35001575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f34fffff700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3500069e20 0x7f35001570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f35049d0700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3500070700 0x7f35001575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f35049d0700 1 -- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3500069e20 msgr2=0x7f35001570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f35049d0700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3500069e20 0x7f35001570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f35049d0700 1 -- 172.21.15.31:0/3591584903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f8009ae0 con 0x7f35000afff0 2023-10-09T06:22:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.004+0000 7f35049d0700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35000afff0 0x7f350015a1c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f350006b150 tx=0x7f34f8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.005+0000 7f34e7fff700 1 -- 172.21.15.31:0/3591584903 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80094e0 con 0x7f35000afff0 2023-10-09T06:22:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.005+0000 7f34e7fff700 1 -- 172.21.15.31:0/3591584903 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f80032f0 con 0x7f35000afff0 2023-10-09T06:22:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.005+0000 7f3506433700 1 -- 172.21.15.31:0/3591584903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350015b190 con 0x7f35000afff0 2023-10-09T06:22:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.005+0000 7f34e7fff700 1 -- 172.21.15.31:0/3591584903 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80266b0 con 0x7f35000afff0 2023-10-09T06:22:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.005+0000 7f3506433700 1 -- 172.21.15.31:0/3591584903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350016af80 con 0x7f35000afff0 2023-10-09T06:22:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.006+0000 7f3506433700 1 -- 172.21.15.31:0/3591584903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350004c3c0 con 0x7f35000afff0 2023-10-09T06:22:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.006+0000 7f34e7fff700 1 -- 172.21.15.31:0/3591584903 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34f8003040 con 0x7f35000afff0 2023-10-09T06:22:17.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.006+0000 7f34e7fff700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34ec066f30 0x7f34ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.007+0000 7f34e7fff700 1 -- 172.21.15.31:0/3591584903 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34f8086650 con 0x7f35000afff0 2023-10-09T06:22:17.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.007+0000 7f34fffff700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34ec066f30 0x7f34ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.007+0000 7f34fffff700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34ec066f30 0x7f34ec0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f34f0008a50 tx=0x7f34f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:17.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.011+0000 7f34e7fff700 1 -- 172.21.15.31:0/3591584903 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34f8053970 con 0x7f35000afff0 2023-10-09T06:22:17.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.200+0000 7f3506433700 1 -- 172.21.15.31:0/3591584903 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35000c7190 con 0x7f34ec066f30 2023-10-09T06:22:17.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.208+0000 7f34e7fff700 1 -- 172.21.15.31:0/3591584903 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283944 (secure 0 0 0) 0x7f35000c7190 con 0x7f34ec066f30 2023-10-09T06:22:17.212 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:17.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.211+0000 7f3506433700 1 -- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34ec066f30 msgr2=0x7f34ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.211+0000 7f3506433700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34ec066f30 0x7f34ec0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f34f0008a50 tx=0x7f34f0008040 comp rx=0 tx=0).stop 2023-10-09T06:22:17.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.211+0000 7f3506433700 1 -- 172.21.15.31:0/3591584903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35000afff0 msgr2=0x7f350015a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.211+0000 7f3506433700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35000afff0 0x7f350015a1c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f350006b150 tx=0x7f34f8018000 comp rx=0 tx=0).stop 2023-10-09T06:22:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.212+0000 7f3506433700 1 -- 172.21.15.31:0/3591584903 shutdown_connections 2023-10-09T06:22:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.212+0000 7f3506433700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34ec066f30 0x7f34ec0693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.212+0000 7f3506433700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35000afff0 0x7f350015a1c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.212+0000 7f3506433700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3500069e20 0x7f35001570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.212+0000 7f3506433700 1 --2- 172.21.15.31:0/3591584903 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3500070700 0x7f35001575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.212+0000 7f3506433700 1 -- 172.21.15.31:0/3591584903 >> 172.21.15.31:0/3591584903 conn(0x7f35000cda50 msgr2=0x7f35000cb600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.212+0000 7f3506433700 1 -- 172.21.15.31:0/3591584903 shutdown_connections 2023-10-09T06:22:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.212+0000 7f3506433700 1 -- 172.21.15.31:0/3591584903 wait complete. 2023-10-09T06:22:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:22:17.223 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-10-09T06:22:16.537698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2748,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559751,"statfs":{"total":1600000000,"available":1597185554,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.440270"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113415+0000","last_change":"2023-10-09T06:22:13.113415+0000","last_active":"2023-10-09T06:22:13.113415+0000","last_peered":"2023-10-09T06:22:13.113415+0000","last_clean":"2023-10-09T06:22:13.113415+0000","last_became_active":"2023-10-09T06:22:13.112473+0000","last_became_peered":"2023-10-09T06:22:13.112473+0000","last_unstale":"2023-10-09T06:22:13.113415+0000","last_undegraded":"2023-10-09T06:22:13.113415+0000","last_fullsized":"2023-10-09T06:22:13.113415+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:30:13.644885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.116740+0000","last_change":"2023-10-09T06:22:13.116740+0000","last_active":"2023-10-09T06:22:13.116740+0000","last_peered":"2023-10-09T06:22:13.116740+0000","last_clean":"2023-10-09T06:22:13.116740+0000","last_became_active":"2023-10-09T06:22:13.115558+0000","last_became_peered":"2023-10-09T06:22:13.115558+0000","last_unstale":"2023-10-09T06:22:13.116740+0000","last_undegraded":"2023-10-09T06:22:13.116740+0000","last_fullsized":"2023-10-09T06:22:13.116740+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:03.724332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.117892+0000","last_change":"2023-10-09T06:22:13.117892+0000","last_active":"2023-10-09T06:22:13.117892+0000","last_peered":"2023-10-09T06:22:13.117892+0000","last_clean":"2023-10-09T06:22:13.117892+0000","last_became_active":"2023-10-09T06:22:13.116515+0000","last_became_peered":"2023-10-09T06:22:13.116515+0000","last_unstale":"2023-10-09T06:22:13.117892+0000","last_undegraded":"2023-10-09T06:22:13.117892+0000","last_fullsized":"2023-10-09T06:22:13.117892+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:32:17.052242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112885+0000","last_change":"2023-10-09T06:22:13.112885+0000","last_active":"2023-10-09T06:22:13.112885+0000","last_peered":"2023-10-09T06:22:13.112885+0000","last_clean":"2023-10-09T06:22:13.112885+0000","last_became_active":"2023-10-09T06:22:13.112478+0000","last_became_peered":"2023-10-09T06:22:13.112478+0000","last_unstale":"2023-10-09T06:22:13.112885+0000","last_undegraded":"2023-10-09T06:22:13.112885+0000","last_fullsized":"2023-10-09T06:22:13.112885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:33:11.593427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.117790+0000","last_change":"2023-10-09T06:22:13.117790+0000","last_active":"2023-10-09T06:22:13.117790+0000","last_peered":"2023-10-09T06:22:13.117790+0000","last_clean":"2023-10-09T06:22:13.117790+0000","last_became_active":"2023-10-09T06:22:13.117554+0000","last_became_peered":"2023-10-09T06:22:13.117554+0000","last_unstale":"2023-10-09T06:22:13.117790+0000","last_undegraded":"2023-10-09T06:22:13.117790+0000","last_fullsized":"2023-10-09T06:22:13.117790+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:26.802239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115468+0000","last_change":"2023-10-09T06:22:13.115468+0000","last_active":"2023-10-09T06:22:13.115468+0000","last_peered":"2023-10-09T06:22:13.115468+0000","last_clean":"2023-10-09T06:22:13.115468+0000","last_became_active":"2023-10-09T06:22:13.114114+0000","last_became_peered":"2023-10-09T06:22:13.114114+0000","last_unstale":"2023-10-09T06:22:13.115468+0000","last_undegraded":"2023-10-09T06:22:13.115468+0000","last_fullsized":"2023-10-09T06:22:13.115468+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:01:45.932229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.108032+0000","last_change":"2023-10-09T06:22:13.108032+0000","last_active":"2023-10-09T06:22:13.108032+0000","last_peered":"2023-10-09T06:22:13.108032+0000","last_clean":"2023-10-09T06:22:13.108032+0000","last_became_active":"2023-10-09T06:22:13.107791+0000","last_became_peered":"2023-10-09T06:22:13.107791+0000","last_unstale":"2023-10-09T06:22:13.108032+0000","last_undegraded":"2023-10-09T06:22:13.108032+0000","last_fullsized":"2023-10-09T06:22:13.108032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:10.168642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.109241+0000","last_change":"2023-10-09T06:22:13.109241+0000","last_active":"2023-10-09T06:22:13.109241+0000","last_peered":"2023-10-09T06:22:13.109241+0000","last_clean":"2023-10-09T06:22:13.109241+0000","last_became_active":"2023-10-09T06:22:13.108873+0000","last_became_peered":"2023-10-09T06:22:13.108873+0000","last_unstale":"2023-10-09T06:22:13.109241+0000","last_undegraded":"2023-10-09T06:22:13.109241+0000","last_fullsized":"2023-10-09T06:22:13.109241+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:47.385472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115014+0000","last_change":"2023-10-09T06:22:13.115014+0000","last_active":"2023-10-09T06:22:13.115014+0000","last_peered":"2023-10-09T06:22:13.115014+0000","last_clean":"2023-10-09T06:22:13.115014+0000","last_became_active":"2023-10-09T06:22:13.114600+0000","last_became_peered":"2023-10-09T06:22:13.114600+0000","last_unstale":"2023-10-09T06:22:13.115014+0000","last_undegraded":"2023-10-09T06:22:13.115014+0000","last_fullsized":"2023-10-09T06:22:13.115014+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:48.008121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.108026+0000","last_change":"2023-10-09T06:22:13.108026+0000","last_active":"2023-10-09T06:22:13.108026+0000","last_peered":"2023-10-09T06:22:13.108026+0000","last_clean":"2023-10-09T06:22:13.108026+0000","last_became_active":"2023-10-09T06:22:13.107505+0000","last_became_peered":"2023-10-09T06:22:13.107505+0000","last_unstale":"2023-10-09T06:22:13.108026+0000","last_undegraded":"2023-10-09T06:22:13.108026+0000","last_fullsized":"2023-10-09T06:22:13.108026+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:58.356155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.110302+0000","last_change":"2023-10-09T06:22:13.110302+0000","last_active":"2023-10-09T06:22:13.110302+0000","last_peered":"2023-10-09T06:22:13.110302+0000","last_clean":"2023-10-09T06:22:13.110302+0000","last_became_active":"2023-10-09T06:22:13.110082+0000","last_became_peered":"2023-10-09T06:22:13.110082+0000","last_unstale":"2023-10-09T06:22:13.110302+0000","last_undegraded":"2023-10-09T06:22:13.110302+0000","last_fullsized":"2023-10-09T06:22:13.110302+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:26.518679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.116915+0000","last_change":"2023-10-09T06:22:13.116915+0000","last_active":"2023-10-09T06:22:13.116915+0000","last_peered":"2023-10-09T06:22:13.116915+0000","last_clean":"2023-10-09T06:22:13.116915+0000","last_became_active":"2023-10-09T06:22:13.115845+0000","last_became_peered":"2023-10-09T06:22:13.115845+0000","last_unstale":"2023-10-09T06:22:13.116915+0000","last_undegraded":"2023-10-09T06:22:13.116915+0000","last_fullsized":"2023-10-09T06:22:13.116915+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:58.356155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.108870+0000","last_change":"2023-10-09T06:22:13.108870+0000","last_active":"2023-10-09T06:22:13.108870+0000","last_peered":"2023-10-09T06:22:13.108870+0000","last_clean":"2023-10-09T06:22:13.108870+0000","last_became_active":"2023-10-09T06:22:13.108655+0000","last_became_peered":"2023-10-09T06:22:13.108655+0000","last_unstale":"2023-10-09T06:22:13.108870+0000","last_undegraded":"2023-10-09T06:22:13.108870+0000","last_fullsized":"2023-10-09T06:22:13.108870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:54:40.053234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114865+0000","last_change":"2023-10-09T06:22:13.114865+0000","last_active":"2023-10-09T06:22:13.114865+0000","last_peered":"2023-10-09T06:22:13.114865+0000","last_clean":"2023-10-09T06:22:13.114865+0000","last_became_active":"2023-10-09T06:22:13.114277+0000","last_became_peered":"2023-10-09T06:22:13.114277+0000","last_unstale":"2023-10-09T06:22:13.114865+0000","last_undegraded":"2023-10-09T06:22:13.114865+0000","last_fullsized":"2023-10-09T06:22:13.114865+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:26.246587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113458+0000","last_change":"2023-10-09T06:22:13.113458+0000","last_active":"2023-10-09T06:22:13.113458+0000","last_peered":"2023-10-09T06:22:13.113458+0000","last_clean":"2023-10-09T06:22:13.113458+0000","last_became_active":"2023-10-09T06:22:13.113236+0000","last_became_peered":"2023-10-09T06:22:13.113236+0000","last_unstale":"2023-10-09T06:22:13.113458+0000","last_undegraded":"2023-10-09T06:22:13.113458+0000","last_fullsized":"2023-10-09T06:22:13.113458+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:57.552699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114547+0000","last_change":"2023-10-09T06:22:13.114547+0000","last_active":"2023-10-09T06:22:13.114547+0000","last_peered":"2023-10-09T06:22:13.114547+0000","last_clean":"2023-10-09T06:22:13.114547+0000","last_became_active":"2023-10-09T06:22:13.114314+0000","last_became_peered":"2023-10-09T06:22:13.114314+0000","last_unstale":"2023-10-09T06:22:13.114547+0000","last_undegraded":"2023-10-09T06:22:13.114547+0000","last_fullsized":"2023-10-09T06:22:13.114547+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:36.794911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114919+0000","last_change":"2023-10-09T06:22:13.114919+0000","last_active":"2023-10-09T06:22:13.114919+0000","last_peered":"2023-10-09T06:22:13.114919+0000","last_clean":"2023-10-09T06:22:13.114919+0000","last_became_active":"2023-10-09T06:22:13.114482+0000","last_became_peered":"2023-10-09T06:22:13.114482+0000","last_unstale":"2023-10-09T06:22:13.114919+0000","last_undegraded":"2023-10-09T06:22:13.114919+0000","last_fullsized":"2023-10-09T06:22:13.114919+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:03.724332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.118345+0000","last_change":"2023-10-09T06:22:13.118345+0000","last_active":"2023-10-09T06:22:13.118345+0000","last_peered":"2023-10-09T06:22:13.118345+0000","last_clean":"2023-10-09T06:22:13.118345+0000","last_became_active":"2023-10-09T06:22:13.117668+0000","last_became_peered":"2023-10-09T06:22:13.117668+0000","last_unstale":"2023-10-09T06:22:13.118345+0000","last_undegraded":"2023-10-09T06:22:13.118345+0000","last_fullsized":"2023-10-09T06:22:13.118345+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:26.246587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111573+0000","last_change":"2023-10-09T06:22:13.111573+0000","last_active":"2023-10-09T06:22:13.111573+0000","last_peered":"2023-10-09T06:22:13.111573+0000","last_clean":"2023-10-09T06:22:13.111573+0000","last_became_active":"2023-10-09T06:22:13.111169+0000","last_became_peered":"2023-10-09T06:22:13.111169+0000","last_unstale":"2023-10-09T06:22:13.111573+0000","last_undegraded":"2023-10-09T06:22:13.111573+0000","last_fullsized":"2023-10-09T06:22:13.111573+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:44:00.271505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.116885+0000","last_change":"2023-10-09T06:22:13.116885+0000","last_active":"2023-10-09T06:22:13.116885+0000","last_peered":"2023-10-09T06:22:13.116885+0000","last_clean":"2023-10-09T06:22:13.116885+0000","last_became_active":"2023-10-09T06:22:13.116651+0000","last_became_peered":"2023-10-09T06:22:13.116651+0000","last_unstale":"2023-10-09T06:22:13.116885+0000","last_undegraded":"2023-10-09T06:22:13.116885+0000","last_fullsized":"2023-10-09T06:22:13.116885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:01.424001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115902+0000","last_change":"2023-10-09T06:22:13.115902+0000","last_active":"2023-10-09T06:22:13.115902+0000","last_peered":"2023-10-09T06:22:13.115902+0000","last_clean":"2023-10-09T06:22:13.115902+0000","last_became_active":"2023-10-09T06:22:13.115275+0000","last_became_peered":"2023-10-09T06:22:13.115275+0000","last_unstale":"2023-10-09T06:22:13.115902+0000","last_undegraded":"2023-10-09T06:22:13.115902+0000","last_fullsized":"2023-10-09T06:22:13.115902+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:55:12.164357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.109978+0000","last_change":"2023-10-09T06:22:13.109978+0000","last_active":"2023-10-09T06:22:13.109978+0000","last_peered":"2023-10-09T06:22:13.109978+0000","last_clean":"2023-10-09T06:22:13.109978+0000","last_became_active":"2023-10-09T06:22:13.109707+0000","last_became_peered":"2023-10-09T06:22:13.109707+0000","last_unstale":"2023-10-09T06:22:13.109978+0000","last_undegraded":"2023-10-09T06:22:13.109978+0000","last_fullsized":"2023-10-09T06:22:13.109978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:01.494393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111561+0000","last_change":"2023-10-09T06:22:13.111561+0000","last_active":"2023-10-09T06:22:13.111561+0000","last_peered":"2023-10-09T06:22:13.111561+0000","last_clean":"2023-10-09T06:22:13.111561+0000","last_became_active":"2023-10-09T06:22:13.111140+0000","last_became_peered":"2023-10-09T06:22:13.111140+0000","last_unstale":"2023-10-09T06:22:13.111561+0000","last_undegraded":"2023-10-09T06:22:13.111561+0000","last_fullsized":"2023-10-09T06:22:13.111561+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:55.958187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.110940+0000","last_change":"2023-10-09T06:22:13.110940+0000","last_active":"2023-10-09T06:22:13.110940+0000","last_peered":"2023-10-09T06:22:13.110940+0000","last_clean":"2023-10-09T06:22:13.110940+0000","last_became_active":"2023-10-09T06:22:13.110478+0000","last_became_peered":"2023-10-09T06:22:13.110478+0000","last_unstale":"2023-10-09T06:22:13.110940+0000","last_undegraded":"2023-10-09T06:22:13.110940+0000","last_fullsized":"2023-10-09T06:22:13.110940+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:30:00.476457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114440+0000","last_change":"2023-10-09T06:22:13.114440+0000","last_active":"2023-10-09T06:22:13.114440+0000","last_peered":"2023-10-09T06:22:13.114440+0000","last_clean":"2023-10-09T06:22:13.114440+0000","last_became_active":"2023-10-09T06:22:13.113921+0000","last_became_peered":"2023-10-09T06:22:13.113921+0000","last_unstale":"2023-10-09T06:22:13.114440+0000","last_undegraded":"2023-10-09T06:22:13.114440+0000","last_fullsized":"2023-10-09T06:22:13.114440+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:28:21.289305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112242+0000","last_change":"2023-10-09T06:22:13.112242+0000","last_active":"2023-10-09T06:22:13.112242+0000","last_peered":"2023-10-09T06:22:13.112242+0000","last_clean":"2023-10-09T06:22:13.112242+0000","last_became_active":"2023-10-09T06:22:13.112019+0000","last_became_peered":"2023-10-09T06:22:13.112019+0000","last_unstale":"2023-10-09T06:22:13.112242+0000","last_undegraded":"2023-10-09T06:22:13.112242+0000","last_fullsized":"2023-10-09T06:22:13.112242+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:43.738240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114745+0000","last_change":"2023-10-09T06:22:13.114745+0000","last_active":"2023-10-09T06:22:13.114745+0000","last_peered":"2023-10-09T06:22:13.114745+0000","last_clean":"2023-10-09T06:22:13.114745+0000","last_became_active":"2023-10-09T06:22:13.113751+0000","last_became_peered":"2023-10-09T06:22:13.113751+0000","last_unstale":"2023-10-09T06:22:13.114745+0000","last_undegraded":"2023-10-09T06:22:13.114745+0000","last_fullsized":"2023-10-09T06:22:13.114745+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:48.008121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112052+0000","last_change":"2023-10-09T06:22:13.112052+0000","last_active":"2023-10-09T06:22:13.112052+0000","last_peered":"2023-10-09T06:22:13.112052+0000","last_clean":"2023-10-09T06:22:13.112052+0000","last_became_active":"2023-10-09T06:22:13.111816+0000","last_became_peered":"2023-10-09T06:22:13.111816+0000","last_unstale":"2023-10-09T06:22:13.112052+0000","last_undegraded":"2023-10-09T06:22:13.112052+0000","last_fullsized":"2023-10-09T06:22:13.112052+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:06.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.117365+0000","last_change":"2023-10-09T06:22:13.117365+0000","last_active":"2023-10-09T06:22:13.117365+0000","last_peered":"2023-10-09T06:22:13.117365+0000","last_clean":"2023-10-09T06:22:13.117365+0000","last_became_active":"2023-10-09T06:22:13.117129+0000","last_became_peered":"2023-10-09T06:22:13.117129+0000","last_unstale":"2023-10-09T06:22:13.117365+0000","last_undegraded":"2023-10-09T06:22:13.117365+0000","last_fullsized":"2023-10-09T06:22:13.117365+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:11.616807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114809+0000","last_change":"2023-10-09T06:22:13.114809+0000","last_active":"2023-10-09T06:22:13.114809+0000","last_peered":"2023-10-09T06:22:13.114809+0000","last_clean":"2023-10-09T06:22:13.114809+0000","last_became_active":"2023-10-09T06:22:13.114003+0000","last_became_peered":"2023-10-09T06:22:13.114003+0000","last_unstale":"2023-10-09T06:22:13.114809+0000","last_undegraded":"2023-10-09T06:22:13.114809+0000","last_fullsized":"2023-10-09T06:22:13.114809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:36.794911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115731+0000","last_change":"2023-10-09T06:22:13.115731+0000","last_active":"2023-10-09T06:22:13.115731+0000","last_peered":"2023-10-09T06:22:13.115731+0000","last_clean":"2023-10-09T06:22:13.115731+0000","last_became_active":"2023-10-09T06:22:13.114717+0000","last_became_peered":"2023-10-09T06:22:13.114717+0000","last_unstale":"2023-10-09T06:22:13.115731+0000","last_undegraded":"2023-10-09T06:22:13.115731+0000","last_fullsized":"2023-10-09T06:22:13.115731+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:42.220360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115583+0000","last_change":"2023-10-09T06:22:13.115583+0000","last_active":"2023-10-09T06:22:13.115583+0000","last_peered":"2023-10-09T06:22:13.115583+0000","last_clean":"2023-10-09T06:22:13.115583+0000","last_became_active":"2023-10-09T06:22:13.115357+0000","last_became_peered":"2023-10-09T06:22:13.115357+0000","last_unstale":"2023-10-09T06:22:13.115583+0000","last_undegraded":"2023-10-09T06:22:13.115583+0000","last_fullsized":"2023-10-09T06:22:13.115583+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:07.470084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111822+0000","last_change":"2023-10-09T06:22:13.111822+0000","last_active":"2023-10-09T06:22:13.111822+0000","last_peered":"2023-10-09T06:22:13.111822+0000","last_clean":"2023-10-09T06:22:13.111822+0000","last_became_active":"2023-10-09T06:22:13.111615+0000","last_became_peered":"2023-10-09T06:22:13.111615+0000","last_unstale":"2023-10-09T06:22:13.111822+0000","last_undegraded":"2023-10-09T06:22:13.111822+0000","last_fullsized":"2023-10-09T06:22:13.111822+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:55.958187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.126261+0000","last_change":"2023-10-09T06:22:12.110900+0000","last_active":"2023-10-09T06:22:13.126261+0000","last_peered":"2023-10-09T06:22:13.126261+0000","last_clean":"2023-10-09T06:22:13.126261+0000","last_became_active":"2023-10-09T06:22:12.110410+0000","last_became_peered":"2023-10-09T06:22:12.110410+0000","last_unstale":"2023-10-09T06:22:13.126261+0000","last_undegraded":"2023-10-09T06:22:13.126261+0000","last_fullsized":"2023-10-09T06:22:13.126261+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:25.512236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115488+0000","last_change":"2023-10-09T06:22:13.115488+0000","last_active":"2023-10-09T06:22:13.115488+0000","last_peered":"2023-10-09T06:22:13.115488+0000","last_clean":"2023-10-09T06:22:13.115488+0000","last_became_active":"2023-10-09T06:22:13.115181+0000","last_became_peered":"2023-10-09T06:22:13.115181+0000","last_unstale":"2023-10-09T06:22:13.115488+0000","last_undegraded":"2023-10-09T06:22:13.115488+0000","last_fullsized":"2023-10-09T06:22:13.115488+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:11.690847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.109685+0000","last_change":"2023-10-09T06:22:12.113922+0000","last_active":"2023-10-09T06:22:13.109685+0000","last_peered":"2023-10-09T06:22:13.109685+0000","last_clean":"2023-10-09T06:22:13.109685+0000","last_became_active":"2023-10-09T06:22:12.113691+0000","last_became_peered":"2023-10-09T06:22:12.113691+0000","last_unstale":"2023-10-09T06:22:13.109685+0000","last_undegraded":"2023-10-09T06:22:13.109685+0000","last_fullsized":"2023-10-09T06:22:13.109685+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:19.764733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.116145+0000","last_change":"2023-10-09T06:22:13.116145+0000","last_active":"2023-10-09T06:22:13.116145+0000","last_peered":"2023-10-09T06:22:13.116145+0000","last_clean":"2023-10-09T06:22:13.116145+0000","last_became_active":"2023-10-09T06:22:13.115826+0000","last_became_peered":"2023-10-09T06:22:13.115826+0000","last_unstale":"2023-10-09T06:22:13.116145+0000","last_undegraded":"2023-10-09T06:22:13.116145+0000","last_fullsized":"2023-10-09T06:22:13.116145+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:47.385472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.126220+0000","last_change":"2023-10-09T06:22:12.115150+0000","last_active":"2023-10-09T06:22:13.126220+0000","last_peered":"2023-10-09T06:22:13.126220+0000","last_clean":"2023-10-09T06:22:13.126220+0000","last_became_active":"2023-10-09T06:22:12.114770+0000","last_became_peered":"2023-10-09T06:22:12.114770+0000","last_unstale":"2023-10-09T06:22:13.126220+0000","last_undegraded":"2023-10-09T06:22:13.126220+0000","last_fullsized":"2023-10-09T06:22:13.126220+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:00.417558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.117664+0000","last_change":"2023-10-09T06:22:13.117664+0000","last_active":"2023-10-09T06:22:13.117664+0000","last_peered":"2023-10-09T06:22:13.117664+0000","last_clean":"2023-10-09T06:22:13.117664+0000","last_became_active":"2023-10-09T06:22:13.117365+0000","last_became_peered":"2023-10-09T06:22:13.117365+0000","last_unstale":"2023-10-09T06:22:13.117664+0000","last_undegraded":"2023-10-09T06:22:13.117664+0000","last_fullsized":"2023-10-09T06:22:13.117664+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:04:47.579462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.125510+0000","last_change":"2023-10-09T06:22:12.114449+0000","last_active":"2023-10-09T06:22:13.125510+0000","last_peered":"2023-10-09T06:22:13.125510+0000","last_clean":"2023-10-09T06:22:13.125510+0000","last_became_active":"2023-10-09T06:22:12.113778+0000","last_became_peered":"2023-10-09T06:22:12.113778+0000","last_unstale":"2023-10-09T06:22:13.125510+0000","last_undegraded":"2023-10-09T06:22:13.125510+0000","last_fullsized":"2023-10-09T06:22:13.125510+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:25.512236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.118037+0000","last_change":"2023-10-09T06:22:13.118037+0000","last_active":"2023-10-09T06:22:13.118037+0000","last_peered":"2023-10-09T06:22:13.118037+0000","last_clean":"2023-10-09T06:22:13.118037+0000","last_became_active":"2023-10-09T06:22:13.116963+0000","last_became_peered":"2023-10-09T06:22:13.116963+0000","last_unstale":"2023-10-09T06:22:13.118037+0000","last_undegraded":"2023-10-09T06:22:13.118037+0000","last_fullsized":"2023-10-09T06:22:13.118037+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:26.518679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.107674+0000","last_change":"2023-10-09T06:22:12.109962+0000","last_active":"2023-10-09T06:22:13.107674+0000","last_peered":"2023-10-09T06:22:13.107674+0000","last_clean":"2023-10-09T06:22:13.107674+0000","last_became_active":"2023-10-09T06:22:12.109713+0000","last_became_peered":"2023-10-09T06:22:12.109713+0000","last_unstale":"2023-10-09T06:22:13.107674+0000","last_undegraded":"2023-10-09T06:22:13.107674+0000","last_fullsized":"2023-10-09T06:22:13.107674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:47.001679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113260+0000","last_change":"2023-10-09T06:22:13.113260+0000","last_active":"2023-10-09T06:22:13.113260+0000","last_peered":"2023-10-09T06:22:13.113260+0000","last_clean":"2023-10-09T06:22:13.113260+0000","last_became_active":"2023-10-09T06:22:13.113017+0000","last_became_peered":"2023-10-09T06:22:13.113017+0000","last_unstale":"2023-10-09T06:22:13.113260+0000","last_undegraded":"2023-10-09T06:22:13.113260+0000","last_fullsized":"2023-10-09T06:22:13.113260+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:39.051851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113713+0000","last_change":"2023-10-09T06:22:12.113448+0000","last_active":"2023-10-09T06:22:13.113713+0000","last_peered":"2023-10-09T06:22:13.113713+0000","last_clean":"2023-10-09T06:22:13.113713+0000","last_became_active":"2023-10-09T06:22:12.113212+0000","last_became_peered":"2023-10-09T06:22:12.113212+0000","last_unstale":"2023-10-09T06:22:13.113713+0000","last_undegraded":"2023-10-09T06:22:13.113713+0000","last_fullsized":"2023-10-09T06:22:13.113713+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:54:39.046792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.108168+0000","last_change":"2023-10-09T06:22:13.108168+0000","last_active":"2023-10-09T06:22:13.108168+0000","last_peered":"2023-10-09T06:22:13.108168+0000","last_clean":"2023-10-09T06:22:13.108168+0000","last_became_active":"2023-10-09T06:22:13.107795+0000","last_became_peered":"2023-10-09T06:22:13.107795+0000","last_unstale":"2023-10-09T06:22:13.108168+0000","last_undegraded":"2023-10-09T06:22:13.108168+0000","last_fullsized":"2023-10-09T06:22:13.108168+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:06.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.114868+0000","last_change":"2023-10-09T06:22:12.114812+0000","last_active":"2023-10-09T06:22:12.114868+0000","last_peered":"2023-10-09T06:22:12.114868+0000","last_clean":"2023-10-09T06:22:12.114868+0000","last_became_active":"2023-10-09T06:22:12.114542+0000","last_became_peered":"2023-10-09T06:22:12.114542+0000","last_unstale":"2023-10-09T06:22:12.114868+0000","last_undegraded":"2023-10-09T06:22:12.114868+0000","last_fullsized":"2023-10-09T06:22:12.114868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:10.684405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111419+0000","last_change":"2023-10-09T06:22:13.111419+0000","last_active":"2023-10-09T06:22:13.111419+0000","last_peered":"2023-10-09T06:22:13.111419+0000","last_clean":"2023-10-09T06:22:13.111419+0000","last_became_active":"2023-10-09T06:22:13.110702+0000","last_became_peered":"2023-10-09T06:22:13.110702+0000","last_unstale":"2023-10-09T06:22:13.111419+0000","last_undegraded":"2023-10-09T06:22:13.111419+0000","last_fullsized":"2023-10-09T06:22:13.111419+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:04:47.579462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.109865+0000","last_change":"2023-10-09T06:22:12.109067+0000","last_active":"2023-10-09T06:22:12.109865+0000","last_peered":"2023-10-09T06:22:12.109865+0000","last_clean":"2023-10-09T06:22:12.109865+0000","last_became_active":"2023-10-09T06:22:12.108296+0000","last_became_peered":"2023-10-09T06:22:12.108296+0000","last_unstale":"2023-10-09T06:22:12.109865+0000","last_undegraded":"2023-10-09T06:22:12.109865+0000","last_fullsized":"2023-10-09T06:22:12.109865+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:31.006036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.117324+0000","last_change":"2023-10-09T06:22:13.117324+0000","last_active":"2023-10-09T06:22:13.117324+0000","last_peered":"2023-10-09T06:22:13.117324+0000","last_clean":"2023-10-09T06:22:13.117324+0000","last_became_active":"2023-10-09T06:22:13.117032+0000","last_became_peered":"2023-10-09T06:22:13.117032+0000","last_unstale":"2023-10-09T06:22:13.117324+0000","last_undegraded":"2023-10-09T06:22:13.117324+0000","last_fullsized":"2023-10-09T06:22:13.117324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:39.051851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.110278+0000","last_change":"2023-10-09T06:22:12.110212+0000","last_active":"2023-10-09T06:22:12.110278+0000","last_peered":"2023-10-09T06:22:12.110278+0000","last_clean":"2023-10-09T06:22:12.110278+0000","last_became_active":"2023-10-09T06:22:12.109990+0000","last_became_peered":"2023-10-09T06:22:12.109990+0000","last_unstale":"2023-10-09T06:22:12.110278+0000","last_undegraded":"2023-10-09T06:22:12.110278+0000","last_fullsized":"2023-10-09T06:22:12.110278+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:06.463641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113562+0000","last_change":"2023-10-09T06:22:13.113562+0000","last_active":"2023-10-09T06:22:13.113562+0000","last_peered":"2023-10-09T06:22:13.113562+0000","last_clean":"2023-10-09T06:22:13.113562+0000","last_became_active":"2023-10-09T06:22:13.113195+0000","last_became_peered":"2023-10-09T06:22:13.113195+0000","last_unstale":"2023-10-09T06:22:13.113562+0000","last_undegraded":"2023-10-09T06:22:13.113562+0000","last_fullsized":"2023-10-09T06:22:13.113562+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:41.809977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.108355+0000","last_change":"2023-10-09T06:22:12.108288+0000","last_active":"2023-10-09T06:22:12.108355+0000","last_peered":"2023-10-09T06:22:12.108355+0000","last_clean":"2023-10-09T06:22:12.108355+0000","last_became_active":"2023-10-09T06:22:12.108037+0000","last_became_peered":"2023-10-09T06:22:12.108037+0000","last_unstale":"2023-10-09T06:22:12.108355+0000","last_undegraded":"2023-10-09T06:22:12.108355+0000","last_fullsized":"2023-10-09T06:22:12.108355+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:45.782618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112179+0000","last_change":"2023-10-09T06:22:13.112179+0000","last_active":"2023-10-09T06:22:13.112179+0000","last_peered":"2023-10-09T06:22:13.112179+0000","last_clean":"2023-10-09T06:22:13.112179+0000","last_became_active":"2023-10-09T06:22:13.112001+0000","last_became_peered":"2023-10-09T06:22:13.112001+0000","last_unstale":"2023-10-09T06:22:13.112179+0000","last_undegraded":"2023-10-09T06:22:13.112179+0000","last_fullsized":"2023-10-09T06:22:13.112179+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:15:06.918345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.126172+0000","last_change":"2023-10-09T06:22:12.112493+0000","last_active":"2023-10-09T06:22:13.126172+0000","last_peered":"2023-10-09T06:22:13.126172+0000","last_clean":"2023-10-09T06:22:13.126172+0000","last_became_active":"2023-10-09T06:22:12.112041+0000","last_became_peered":"2023-10-09T06:22:12.112041+0000","last_unstale":"2023-10-09T06:22:13.126172+0000","last_undegraded":"2023-10-09T06:22:13.126172+0000","last_fullsized":"2023-10-09T06:22:13.126172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:29:59.470014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111851+0000","last_change":"2023-10-09T06:22:13.111851+0000","last_active":"2023-10-09T06:22:13.111851+0000","last_peered":"2023-10-09T06:22:13.111851+0000","last_clean":"2023-10-09T06:22:13.111851+0000","last_became_active":"2023-10-09T06:22:13.111609+0000","last_became_peered":"2023-10-09T06:22:13.111609+0000","last_unstale":"2023-10-09T06:22:13.111851+0000","last_undegraded":"2023-10-09T06:22:13.111851+0000","last_fullsized":"2023-10-09T06:22:13.111851+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:06.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.126472+0000","last_change":"2023-10-09T06:22:12.110233+0000","last_active":"2023-10-09T06:22:13.126472+0000","last_peered":"2023-10-09T06:22:13.126472+0000","last_clean":"2023-10-09T06:22:13.126472+0000","last_became_active":"2023-10-09T06:22:12.109964+0000","last_became_peered":"2023-10-09T06:22:12.109964+0000","last_unstale":"2023-10-09T06:22:13.126472+0000","last_undegraded":"2023-10-09T06:22:13.126472+0000","last_fullsized":"2023-10-09T06:22:13.126472+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:48.568229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112943+0000","last_change":"2023-10-09T06:22:13.112943+0000","last_active":"2023-10-09T06:22:13.112943+0000","last_peered":"2023-10-09T06:22:13.112943+0000","last_clean":"2023-10-09T06:22:13.112943+0000","last_became_active":"2023-10-09T06:22:13.112539+0000","last_became_peered":"2023-10-09T06:22:13.112539+0000","last_unstale":"2023-10-09T06:22:13.112943+0000","last_undegraded":"2023-10-09T06:22:13.112943+0000","last_fullsized":"2023-10-09T06:22:13.112943+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:57.485227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.126542+0000","last_change":"2023-10-09T06:22:12.113302+0000","last_active":"2023-10-09T06:22:13.126542+0000","last_peered":"2023-10-09T06:22:13.126542+0000","last_clean":"2023-10-09T06:22:13.126542+0000","last_became_active":"2023-10-09T06:22:12.113061+0000","last_became_peered":"2023-10-09T06:22:12.113061+0000","last_unstale":"2023-10-09T06:22:13.126542+0000","last_undegraded":"2023-10-09T06:22:13.126542+0000","last_fullsized":"2023-10-09T06:22:13.126542+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:46.379029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.108557+0000","last_change":"2023-10-09T06:22:13.108557+0000","last_active":"2023-10-09T06:22:13.108557+0000","last_peered":"2023-10-09T06:22:13.108557+0000","last_clean":"2023-10-09T06:22:13.108557+0000","last_became_active":"2023-10-09T06:22:13.108337+0000","last_became_peered":"2023-10-09T06:22:13.108337+0000","last_unstale":"2023-10-09T06:22:13.108557+0000","last_undegraded":"2023-10-09T06:22:13.108557+0000","last_fullsized":"2023-10-09T06:22:13.108557+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:32:17.052242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.110053+0000","last_change":"2023-10-09T06:22:12.109845+0000","last_active":"2023-10-09T06:22:12.110053+0000","last_peered":"2023-10-09T06:22:12.110053+0000","last_clean":"2023-10-09T06:22:12.110053+0000","last_became_active":"2023-10-09T06:22:12.108540+0000","last_became_peered":"2023-10-09T06:22:12.108540+0000","last_unstale":"2023-10-09T06:22:12.110053+0000","last_undegraded":"2023-10-09T06:22:12.110053+0000","last_fullsized":"2023-10-09T06:22:12.110053+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:25.240144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111838+0000","last_change":"2023-10-09T06:22:13.111838+0000","last_active":"2023-10-09T06:22:13.111838+0000","last_peered":"2023-10-09T06:22:13.111838+0000","last_clean":"2023-10-09T06:22:13.111838+0000","last_became_active":"2023-10-09T06:22:13.111609+0000","last_became_peered":"2023-10-09T06:22:13.111609+0000","last_unstale":"2023-10-09T06:22:13.111838+0000","last_undegraded":"2023-10-09T06:22:13.111838+0000","last_fullsized":"2023-10-09T06:22:13.111838+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:58.359099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.114679+0000","last_change":"2023-10-09T06:22:12.114627+0000","last_active":"2023-10-09T06:22:12.114679+0000","last_peered":"2023-10-09T06:22:12.114679+0000","last_clean":"2023-10-09T06:22:12.114679+0000","last_became_active":"2023-10-09T06:22:12.114286+0000","last_became_peered":"2023-10-09T06:22:12.114286+0000","last_unstale":"2023-10-09T06:22:12.114679+0000","last_undegraded":"2023-10-09T06:22:12.114679+0000","last_fullsized":"2023-10-09T06:22:12.114679+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:02.084602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.108600+0000","last_change":"2023-10-09T06:22:13.108600+0000","last_active":"2023-10-09T06:22:13.108600+0000","last_peered":"2023-10-09T06:22:13.108600+0000","last_clean":"2023-10-09T06:22:13.108600+0000","last_became_active":"2023-10-09T06:22:13.108382+0000","last_became_peered":"2023-10-09T06:22:13.108382+0000","last_unstale":"2023-10-09T06:22:13.108600+0000","last_undegraded":"2023-10-09T06:22:13.108600+0000","last_fullsized":"2023-10-09T06:22:13.108600+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:05:39.549755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.127962+0000","last_change":"2023-10-09T06:22:12.112602+0000","last_active":"2023-10-09T06:22:13.127962+0000","last_peered":"2023-10-09T06:22:13.127962+0000","last_clean":"2023-10-09T06:22:13.127962+0000","last_became_active":"2023-10-09T06:22:12.112373+0000","last_became_peered":"2023-10-09T06:22:12.112373+0000","last_unstale":"2023-10-09T06:22:13.127962+0000","last_undegraded":"2023-10-09T06:22:13.127962+0000","last_fullsized":"2023-10-09T06:22:13.127962+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:19.764733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114711+0000","last_change":"2023-10-09T06:22:13.114711+0000","last_active":"2023-10-09T06:22:13.114711+0000","last_peered":"2023-10-09T06:22:13.114711+0000","last_clean":"2023-10-09T06:22:13.114711+0000","last_became_active":"2023-10-09T06:22:13.113806+0000","last_became_peered":"2023-10-09T06:22:13.113806+0000","last_unstale":"2023-10-09T06:22:13.114711+0000","last_undegraded":"2023-10-09T06:22:13.114711+0000","last_fullsized":"2023-10-09T06:22:13.114711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:58.716429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.110105+0000","last_change":"2023-10-09T06:22:12.106819+0000","last_active":"2023-10-09T06:22:13.110105+0000","last_peered":"2023-10-09T06:22:13.110105+0000","last_clean":"2023-10-09T06:22:13.110105+0000","last_became_active":"2023-10-09T06:22:12.105575+0000","last_became_peered":"2023-10-09T06:22:12.105575+0000","last_unstale":"2023-10-09T06:22:13.110105+0000","last_undegraded":"2023-10-09T06:22:13.110105+0000","last_fullsized":"2023-10-09T06:22:13.110105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:47.662829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111761+0000","last_change":"2023-10-09T06:22:13.111761+0000","last_active":"2023-10-09T06:22:13.111761+0000","last_peered":"2023-10-09T06:22:13.111761+0000","last_clean":"2023-10-09T06:22:13.111761+0000","last_became_active":"2023-10-09T06:22:13.111522+0000","last_became_peered":"2023-10-09T06:22:13.111522+0000","last_unstale":"2023-10-09T06:22:13.111761+0000","last_undegraded":"2023-10-09T06:22:13.111761+0000","last_fullsized":"2023-10-09T06:22:13.111761+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:26.802239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.124455+0000","last_change":"2023-10-09T06:22:12.108917+0000","last_active":"2023-10-09T06:22:13.124455+0000","last_peered":"2023-10-09T06:22:13.124455+0000","last_clean":"2023-10-09T06:22:13.124455+0000","last_became_active":"2023-10-09T06:22:12.108629+0000","last_became_peered":"2023-10-09T06:22:12.108629+0000","last_unstale":"2023-10-09T06:22:13.124455+0000","last_undegraded":"2023-10-09T06:22:13.124455+0000","last_fullsized":"2023-10-09T06:22:13.124455+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:42.731798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115231+0000","last_change":"2023-10-09T06:22:13.115231+0000","last_active":"2023-10-09T06:22:13.115231+0000","last_peered":"2023-10-09T06:22:13.115231+0000","last_clean":"2023-10-09T06:22:13.115231+0000","last_became_active":"2023-10-09T06:22:13.115011+0000","last_became_peered":"2023-10-09T06:22:13.115011+0000","last_unstale":"2023-10-09T06:22:13.115231+0000","last_undegraded":"2023-10-09T06:22:13.115231+0000","last_fullsized":"2023-10-09T06:22:13.115231+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:32:17.052242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.110305+0000","last_change":"2023-10-09T06:22:12.114815+0000","last_active":"2023-10-09T06:22:13.110305+0000","last_peered":"2023-10-09T06:22:13.110305+0000","last_clean":"2023-10-09T06:22:13.110305+0000","last_became_active":"2023-10-09T06:22:12.114564+0000","last_became_peered":"2023-10-09T06:22:12.114564+0000","last_unstale":"2023-10-09T06:22:13.110305+0000","last_undegraded":"2023-10-09T06:22:13.110305+0000","last_fullsized":"2023-10-09T06:22:13.110305+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:35.788468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112791+0000","last_change":"2023-10-09T06:22:13.112791+0000","last_active":"2023-10-09T06:22:13.112791+0000","last_peered":"2023-10-09T06:22:13.112791+0000","last_clean":"2023-10-09T06:22:13.112791+0000","last_became_active":"2023-10-09T06:22:13.112116+0000","last_became_peered":"2023-10-09T06:22:13.112116+0000","last_unstale":"2023-10-09T06:22:13.112791+0000","last_undegraded":"2023-10-09T06:22:13.112791+0000","last_fullsized":"2023-10-09T06:22:13.112791+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:01.424001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.114557+0000","last_change":"2023-10-09T06:22:12.114495+0000","last_active":"2023-10-09T06:22:12.114557+0000","last_peered":"2023-10-09T06:22:12.114557+0000","last_clean":"2023-10-09T06:22:12.114557+0000","last_became_active":"2023-10-09T06:22:12.113937+0000","last_became_peered":"2023-10-09T06:22:12.113937+0000","last_unstale":"2023-10-09T06:22:12.114557+0000","last_undegraded":"2023-10-09T06:22:12.114557+0000","last_fullsized":"2023-10-09T06:22:12.114557+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:25.240144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113437+0000","last_change":"2023-10-09T06:22:13.113437+0000","last_active":"2023-10-09T06:22:13.113437+0000","last_peered":"2023-10-09T06:22:13.113437+0000","last_clean":"2023-10-09T06:22:13.113437+0000","last_became_active":"2023-10-09T06:22:13.113017+0000","last_became_peered":"2023-10-09T06:22:13.113017+0000","last_unstale":"2023-10-09T06:22:13.113437+0000","last_undegraded":"2023-10-09T06:22:13.113437+0000","last_fullsized":"2023-10-09T06:22:13.113437+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:58.828665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.125783+0000","last_change":"2023-10-09T06:22:12.109873+0000","last_active":"2023-10-09T06:22:13.125783+0000","last_peered":"2023-10-09T06:22:13.125783+0000","last_clean":"2023-10-09T06:22:13.125783+0000","last_became_active":"2023-10-09T06:22:12.109627+0000","last_became_peered":"2023-10-09T06:22:12.109627+0000","last_unstale":"2023-10-09T06:22:13.125783+0000","last_undegraded":"2023-10-09T06:22:13.125783+0000","last_fullsized":"2023-10-09T06:22:13.125783+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:02.717889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111167+0000","last_change":"2023-10-09T06:22:13.111167+0000","last_active":"2023-10-09T06:22:13.111167+0000","last_peered":"2023-10-09T06:22:13.111167+0000","last_clean":"2023-10-09T06:22:13.111167+0000","last_became_active":"2023-10-09T06:22:13.110946+0000","last_became_peered":"2023-10-09T06:22:13.110946+0000","last_unstale":"2023-10-09T06:22:13.111167+0000","last_undegraded":"2023-10-09T06:22:13.111167+0000","last_fullsized":"2023-10-09T06:22:13.111167+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:36.794911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.115482+0000","last_change":"2023-10-09T06:22:12.115345+0000","last_active":"2023-10-09T06:22:12.115482+0000","last_peered":"2023-10-09T06:22:12.115482+0000","last_clean":"2023-10-09T06:22:12.115482+0000","last_became_active":"2023-10-09T06:22:12.115096+0000","last_became_peered":"2023-10-09T06:22:12.115096+0000","last_unstale":"2023-10-09T06:22:12.115482+0000","last_undegraded":"2023-10-09T06:22:12.115482+0000","last_fullsized":"2023-10-09T06:22:12.115482+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:04:46.573020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115597+0000","last_change":"2023-10-09T06:22:13.115597+0000","last_active":"2023-10-09T06:22:13.115597+0000","last_peered":"2023-10-09T06:22:13.115597+0000","last_clean":"2023-10-09T06:22:13.115597+0000","last_became_active":"2023-10-09T06:22:13.115230+0000","last_became_peered":"2023-10-09T06:22:13.115230+0000","last_unstale":"2023-10-09T06:22:13.115597+0000","last_undegraded":"2023-10-09T06:22:13.115597+0000","last_fullsized":"2023-10-09T06:22:13.115597+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:23.067590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.109882+0000","last_change":"2023-10-09T06:22:12.109218+0000","last_active":"2023-10-09T06:22:12.109882+0000","last_peered":"2023-10-09T06:22:12.109882+0000","last_clean":"2023-10-09T06:22:12.109882+0000","last_became_active":"2023-10-09T06:22:12.108851+0000","last_became_peered":"2023-10-09T06:22:12.108851+0000","last_unstale":"2023-10-09T06:22:12.109882+0000","last_undegraded":"2023-10-09T06:22:12.109882+0000","last_fullsized":"2023-10-09T06:22:12.109882+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:16.607426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113278+0000","last_change":"2023-10-09T06:22:13.113278+0000","last_active":"2023-10-09T06:22:13.113278+0000","last_peered":"2023-10-09T06:22:13.113278+0000","last_clean":"2023-10-09T06:22:13.113278+0000","last_became_active":"2023-10-09T06:22:13.111885+0000","last_became_peered":"2023-10-09T06:22:13.111885+0000","last_unstale":"2023-10-09T06:22:13.113278+0000","last_undegraded":"2023-10-09T06:22:13.113278+0000","last_fullsized":"2023-10-09T06:22:13.113278+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:03.724332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.110070+0000","last_change":"2023-10-09T06:22:12.109993+0000","last_active":"2023-10-09T06:22:12.110070+0000","last_peered":"2023-10-09T06:22:12.110070+0000","last_clean":"2023-10-09T06:22:12.110070+0000","last_became_active":"2023-10-09T06:22:12.109616+0000","last_became_peered":"2023-10-09T06:22:12.109616+0000","last_unstale":"2023-10-09T06:22:12.110070+0000","last_undegraded":"2023-10-09T06:22:12.110070+0000","last_fullsized":"2023-10-09T06:22:12.110070+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:38.045408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112698+0000","last_change":"2023-10-09T06:22:13.112698+0000","last_active":"2023-10-09T06:22:13.112698+0000","last_peered":"2023-10-09T06:22:13.112698+0000","last_clean":"2023-10-09T06:22:13.112698+0000","last_became_active":"2023-10-09T06:22:13.112345+0000","last_became_peered":"2023-10-09T06:22:13.112345+0000","last_unstale":"2023-10-09T06:22:13.112698+0000","last_undegraded":"2023-10-09T06:22:13.112698+0000","last_fullsized":"2023-10-09T06:22:13.112698+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:49:54.113118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.113324+0000","last_change":"2023-10-09T06:22:12.113220+0000","last_active":"2023-10-09T06:22:12.113324+0000","last_peered":"2023-10-09T06:22:12.113324+0000","last_clean":"2023-10-09T06:22:12.113324+0000","last_became_active":"2023-10-09T06:22:12.112904+0000","last_became_peered":"2023-10-09T06:22:12.112904+0000","last_unstale":"2023-10-09T06:22:12.113324+0000","last_undegraded":"2023-10-09T06:22:12.113324+0000","last_fullsized":"2023-10-09T06:22:12.113324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:25.795796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115767+0000","last_change":"2023-10-09T06:22:13.115767+0000","last_active":"2023-10-09T06:22:13.115767+0000","last_peered":"2023-10-09T06:22:13.115767+0000","last_clean":"2023-10-09T06:22:13.115767+0000","last_became_active":"2023-10-09T06:22:13.113490+0000","last_became_peered":"2023-10-09T06:22:13.113490+0000","last_unstale":"2023-10-09T06:22:13.115767+0000","last_undegraded":"2023-10-09T06:22:13.115767+0000","last_fullsized":"2023-10-09T06:22:13.115767+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:03.091044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.112932+0000","last_change":"2023-10-09T06:22:12.112763+0000","last_active":"2023-10-09T06:22:12.112932+0000","last_peered":"2023-10-09T06:22:12.112932+0000","last_clean":"2023-10-09T06:22:12.112932+0000","last_became_active":"2023-10-09T06:22:12.112521+0000","last_became_peered":"2023-10-09T06:22:12.112521+0000","last_unstale":"2023-10-09T06:22:12.112932+0000","last_undegraded":"2023-10-09T06:22:12.112932+0000","last_fullsized":"2023-10-09T06:22:12.112932+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:35.788468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112771+0000","last_change":"2023-10-09T06:22:13.112771+0000","last_active":"2023-10-09T06:22:13.112771+0000","last_peered":"2023-10-09T06:22:13.112771+0000","last_clean":"2023-10-09T06:22:13.112771+0000","last_became_active":"2023-10-09T06:22:13.112395+0000","last_became_peered":"2023-10-09T06:22:13.112395+0000","last_unstale":"2023-10-09T06:22:13.112771+0000","last_undegraded":"2023-10-09T06:22:13.112771+0000","last_fullsized":"2023-10-09T06:22:13.112771+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:01.494393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.115069+0000","last_change":"2023-10-09T06:22:12.115009+0000","last_active":"2023-10-09T06:22:12.115069+0000","last_peered":"2023-10-09T06:22:12.115069+0000","last_clean":"2023-10-09T06:22:12.115069+0000","last_became_active":"2023-10-09T06:22:12.114456+0000","last_became_peered":"2023-10-09T06:22:12.114456+0000","last_unstale":"2023-10-09T06:22:12.115069+0000","last_undegraded":"2023-10-09T06:22:12.115069+0000","last_fullsized":"2023-10-09T06:22:12.115069+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:57.709986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.109721+0000","last_change":"2023-10-09T06:22:13.109721+0000","last_active":"2023-10-09T06:22:13.109721+0000","last_peered":"2023-10-09T06:22:13.109721+0000","last_clean":"2023-10-09T06:22:13.109721+0000","last_became_active":"2023-10-09T06:22:13.109496+0000","last_became_peered":"2023-10-09T06:22:13.109496+0000","last_unstale":"2023-10-09T06:22:13.109721+0000","last_undegraded":"2023-10-09T06:22:13.109721+0000","last_fullsized":"2023-10-09T06:22:13.109721+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:30:13.644885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.114512+0000","last_change":"2023-10-09T06:22:12.114295+0000","last_active":"2023-10-09T06:22:12.114512+0000","last_peered":"2023-10-09T06:22:12.114512+0000","last_clean":"2023-10-09T06:22:12.114512+0000","last_became_active":"2023-10-09T06:22:12.113179+0000","last_became_peered":"2023-10-09T06:22:12.113179+0000","last_unstale":"2023-10-09T06:22:12.114512+0000","last_undegraded":"2023-10-09T06:22:12.114512+0000","last_fullsized":"2023-10-09T06:22:12.114512+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:59.265062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115589+0000","last_change":"2023-10-09T06:22:13.115589+0000","last_active":"2023-10-09T06:22:13.115589+0000","last_peered":"2023-10-09T06:22:13.115589+0000","last_clean":"2023-10-09T06:22:13.115589+0000","last_became_active":"2023-10-09T06:22:13.114417+0000","last_became_peered":"2023-10-09T06:22:13.114417+0000","last_unstale":"2023-10-09T06:22:13.115589+0000","last_undegraded":"2023-10-09T06:22:13.115589+0000","last_fullsized":"2023-10-09T06:22:13.115589+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:23.346089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.112008+0000","last_change":"2023-10-09T06:22:12.111935+0000","last_active":"2023-10-09T06:22:12.112008+0000","last_peered":"2023-10-09T06:22:12.112008+0000","last_clean":"2023-10-09T06:22:12.112008+0000","last_became_active":"2023-10-09T06:22:12.111460+0000","last_became_peered":"2023-10-09T06:22:12.111460+0000","last_unstale":"2023-10-09T06:22:12.112008+0000","last_undegraded":"2023-10-09T06:22:12.112008+0000","last_fullsized":"2023-10-09T06:22:12.112008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:57.709986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.116138+0000","last_change":"2023-10-09T06:22:13.116138+0000","last_active":"2023-10-09T06:22:13.116138+0000","last_peered":"2023-10-09T06:22:13.116138+0000","last_clean":"2023-10-09T06:22:13.116138+0000","last_became_active":"2023-10-09T06:22:13.115631+0000","last_became_peered":"2023-10-09T06:22:13.115631+0000","last_unstale":"2023-10-09T06:22:13.116138+0000","last_undegraded":"2023-10-09T06:22:13.116138+0000","last_fullsized":"2023-10-09T06:22:13.116138+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:01.494393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.110795+0000","last_change":"2023-10-09T06:22:12.110727+0000","last_active":"2023-10-09T06:22:12.110795+0000","last_peered":"2023-10-09T06:22:12.110795+0000","last_clean":"2023-10-09T06:22:12.110795+0000","last_became_active":"2023-10-09T06:22:12.110511+0000","last_became_peered":"2023-10-09T06:22:12.110511+0000","last_unstale":"2023-10-09T06:22:12.110795+0000","last_undegraded":"2023-10-09T06:22:12.110795+0000","last_fullsized":"2023-10-09T06:22:12.110795+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:42.731798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.118177+0000","last_change":"2023-10-09T06:22:13.118177+0000","last_active":"2023-10-09T06:22:13.118177+0000","last_peered":"2023-10-09T06:22:13.118177+0000","last_clean":"2023-10-09T06:22:13.118177+0000","last_became_active":"2023-10-09T06:22:13.117345+0000","last_became_peered":"2023-10-09T06:22:13.117345+0000","last_unstale":"2023-10-09T06:22:13.118177+0000","last_undegraded":"2023-10-09T06:22:13.118177+0000","last_fullsized":"2023-10-09T06:22:13.118177+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:44:00.271505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.112107+0000","last_change":"2023-10-09T06:22:12.111960+0000","last_active":"2023-10-09T06:22:12.112107+0000","last_peered":"2023-10-09T06:22:12.112107+0000","last_clean":"2023-10-09T06:22:12.112107+0000","last_became_active":"2023-10-09T06:22:12.111559+0000","last_became_peered":"2023-10-09T06:22:12.111559+0000","last_unstale":"2023-10-09T06:22:12.112107+0000","last_undegraded":"2023-10-09T06:22:12.112107+0000","last_fullsized":"2023-10-09T06:22:12.112107+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:22.061147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.109100+0000","last_change":"2023-10-09T06:22:13.109100+0000","last_active":"2023-10-09T06:22:13.109100+0000","last_peered":"2023-10-09T06:22:13.109100+0000","last_clean":"2023-10-09T06:22:13.109100+0000","last_became_active":"2023-10-09T06:22:13.108572+0000","last_became_peered":"2023-10-09T06:22:13.108572+0000","last_unstale":"2023-10-09T06:22:13.109100+0000","last_undegraded":"2023-10-09T06:22:13.109100+0000","last_fullsized":"2023-10-09T06:22:13.109100+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:44:00.271505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.125511+0000","last_change":"2023-10-09T06:22:12.110984+0000","last_active":"2023-10-09T06:22:13.125511+0000","last_peered":"2023-10-09T06:22:13.125511+0000","last_clean":"2023-10-09T06:22:13.125511+0000","last_became_active":"2023-10-09T06:22:12.110752+0000","last_became_peered":"2023-10-09T06:22:12.110752+0000","last_unstale":"2023-10-09T06:22:13.125511+0000","last_undegraded":"2023-10-09T06:22:13.125511+0000","last_fullsized":"2023-10-09T06:22:13.125511+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:29:59.470014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":181,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.106987+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:22:12.106987+0000","last_peered":"2023-10-09T06:22:12.106987+0000","last_clean":"2023-10-09T06:22:12.106987+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:22:12.106987+0000","last_undegraded":"2023-10-09T06:22:12.106987+0000","last_fullsized":"2023-10-09T06:22:12.106987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":779,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194533,"statfs":{"total":200000000,"available":199202119,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.53000000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.69399999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.38100000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41199999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.442}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195109,"statfs":{"total":200000000,"available":199791933,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.0960000000000001,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.53300000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.50900000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":7.1299999999999999,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.502}]},{"osd":4,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.443}]},{"osd":5,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.52500000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":195,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799340,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.314},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.53100000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.5270000000000001,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.40600000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.502}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.64000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":779,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194533,"statfs":{"total":200000000,"available":199202175,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.223},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.32300000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":12.929,"5min":12.929,"15min":12.929},"last":0.312},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.28299999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.379},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.33800000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.61799999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.629}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.60999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":195,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799340,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.981999999999999,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":9.1600000000000001,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":8.4930000000000003,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":9.0239999999999991,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.318}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":8.5190000000000001,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":15.007999999999999,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.34499999999999997}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":14.917999999999999,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.52200000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":8.9610000000000003,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.3919999999999995,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.42999999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.498},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.50800000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":8.9160000000000004,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":8.4640000000000004,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.45100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195109,"statfs":{"total":200000000,"available":199791967,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.36499999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.30399999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.38700000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.499},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.39300000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41199999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.504}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.438},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":195,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799340,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.3250000000000002,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":11.715,"5min":11.715,"15min":11.715},"last":0.60199999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.622},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.85599999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.56799999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.88600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":195,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799340,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.497}]},{"osd":2,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55300000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57599999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.39200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51400000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.40400000000000003}]}]}],"pool_statfs":[]}} 2023-10-09T06:22:17.232 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:22:17.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.384+0000 7fa5005b4700 1 Processor -- start 2023-10-09T06:22:17.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.384+0000 7fa5005b4700 1 -- start start 2023-10-09T06:22:17.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.385+0000 7fa5005b4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa4f815a620 0x7fa4f815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.385+0000 7fa5005b4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f815cbb0 con 0x7fa4f8157870 2023-10-09T06:22:17.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.385+0000 7fa5005b4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f815bfa0 con 0x7fa4f815d580 2023-10-09T06:22:17.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.385+0000 7fa5005b4700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f815bdb0 con 0x7fa4f815a620 2023-10-09T06:22:17.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.385+0000 7fa4fe350700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa4f8157870 0x7fa4f815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53468/0 (socket says 172.21.15.31:53468) 2023-10-09T06:22:17.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.385+0000 7fa4fe350700 1 -- 172.21.15.31:0/3517427046 learned_addr learned my addr 172.21.15.31:0/3517427046 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:17.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828827563 0 0) 0x7fa4f815cbb0 con 0x7fa4f8157870 2023-10-09T06:22:17.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4e0003570 con 0x7fa4f8157870 2023-10-09T06:22:17.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fdb4f700 1 --2- 172.21.15.31:0/3517427046 >> v2:172.21.15.158:3300/0 conn(0x7fa4f815a620 0x7fa4f815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1893862397 0 0) 0x7fa4e0003570 con 0x7fa4f8157870 2023-10-09T06:22:17.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 >> v2:172.21.15.158:3300/0 conn(0x7fa4f815a620 msgr2=0x7fa4f815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:17.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 --2- 172.21.15.31:0/3517427046 >> v2:172.21.15.158:3300/0 conn(0x7fa4f815a620 0x7fa4f815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 >> v1:172.21.15.158:6789/0 conn(0x7fa4f815d580 legacy=0x7fa4f8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f815c280 con 0x7fa4f8157870 2023-10-09T06:22:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fa4f0001470 con 0x7fa4f8157870 2023-10-09T06:22:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 >> v1:172.21.15.31:6789/0 conn(0x7fa4f8157870 legacy=0x7fa4f815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 --2- 172.21.15.31:0/3517427046 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4e0003a60 0x7fa4e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 --2- 172.21.15.31:0/3517427046 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4e0004810 0x7fa4e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 --2- 172.21.15.31:0/3517427046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4e00051c0 0x7fa4e000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e000c130 con 0x7fa4e00051c0 2023-10-09T06:22:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e000c2a0 con 0x7fa4e0003a60 2023-10-09T06:22:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e000c460 con 0x7fa4e0004810 2023-10-09T06:22:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4feb51700 1 --2- 172.21.15.31:0/3517427046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4e00051c0 0x7fa4e000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fe350700 1 --2- 172.21.15.31:0/3517427046 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4e0003a60 0x7fa4e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4fdb4f700 1 --2- 172.21.15.31:0/3517427046 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4e0004810 0x7fa4e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4feb51700 1 -- 172.21.15.31:0/3517427046 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4e0004810 msgr2=0x7fa4e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4feb51700 1 --2- 172.21.15.31:0/3517427046 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4e0004810 0x7fa4e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4feb51700 1 -- 172.21.15.31:0/3517427046 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4e0003a60 msgr2=0x7fa4e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4feb51700 1 --2- 172.21.15.31:0/3517427046 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4e0003a60 0x7fa4e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4feb51700 1 -- 172.21.15.31:0/3517427046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e0003570 con 0x7fa4e00051c0 2023-10-09T06:22:17.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4feb51700 1 -- 172.21.15.31:0/3517427046 reap_dead start 2023-10-09T06:22:17.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.386+0000 7fa4feb51700 1 --2- 172.21.15.31:0/3517427046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4e00051c0 0x7fa4e000ba60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8001f90 tx=0x7fa4e8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b7efa56ed055be server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:17.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.387+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8001950 con 0x7fa4e00051c0 2023-10-09T06:22:17.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.387+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e800c8b0 con 0x7fa4e00051c0 2023-10-09T06:22:17.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.387+0000 7fa4fd34e700 1 -- 172.21.15.31:0/3517427046 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800cc50 con 0x7fa4e00051c0 2023-10-09T06:22:17.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.387+0000 7fa5005b4700 1 -- 172.21.15.31:0/3517427046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4e00051c0 msgr2=0x7fa4e000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.387+0000 7fa5005b4700 1 --2- 172.21.15.31:0/3517427046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4e00051c0 0x7fa4e000ba60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8001f90 tx=0x7fa4e8001640 comp rx=0 tx=0).stop 2023-10-09T06:22:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.387+0000 7fa5005b4700 1 -- 172.21.15.31:0/3517427046 shutdown_connections 2023-10-09T06:22:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.387+0000 7fa5005b4700 1 --2- 172.21.15.31:0/3517427046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4e00051c0 0x7fa4e000ba60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.387+0000 7fa5005b4700 1 -- 172.21.15.31:0/3517427046 >> 172.21.15.31:0/3517427046 conn(0x7fa4f8068ce0 msgr2=0x7fa4f80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.387+0000 7fa5005b4700 1 -- 172.21.15.31:0/3517427046 shutdown_connections 2023-10-09T06:22:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.387+0000 7fa5005b4700 1 -- 172.21.15.31:0/3517427046 wait complete. 2023-10-09T06:22:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.388+0000 7fa5005b4700 1 Processor -- start 2023-10-09T06:22:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.388+0000 7fa5005b4700 1 -- start start 2023-10-09T06:22:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.389+0000 7fa5005b4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4e00051c0 0x7fa4f80b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.389+0000 7fa5005b4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f80b64e0 0x7fa4f80b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.389+0000 7fa5005b4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f80b0b50 0x7fa4f80b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.389+0000 7fa5005b4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f8150480 con 0x7fa4f80b0b50 2023-10-09T06:22:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.389+0000 7fa5005b4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f814b450 con 0x7fa4e00051c0 2023-10-09T06:22:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.389+0000 7fa5005b4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80b57b0 con 0x7fa4f80b64e0 2023-10-09T06:22:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.389+0000 7fa4feb51700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f80b0b50 0x7fa4f80b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.389+0000 7fa4fe350700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4e00051c0 0x7fa4f80b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.389+0000 7fa4feb51700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f80b0b50 0x7fa4f80b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35818/0 (socket says 172.21.15.31:35818) 2023-10-09T06:22:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.389+0000 7fa4feb51700 1 -- 172.21.15.31:0/1791278752 learned_addr learned my addr 172.21.15.31:0/1791278752 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.389+0000 7fa4fdb4f700 1 --2- 172.21.15.31:0/1791278752 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f80b64e0 0x7fa4f80b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.390+0000 7fa4feb51700 1 -- 172.21.15.31:0/1791278752 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f80b64e0 msgr2=0x7fa4f80b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.390+0000 7fa4feb51700 1 --2- 172.21.15.31:0/1791278752 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f80b64e0 0x7fa4f80b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.390+0000 7fa4feb51700 1 -- 172.21.15.31:0/1791278752 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4e00051c0 msgr2=0x7fa4f80b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.390+0000 7fa4feb51700 1 --2- 172.21.15.31:0/1791278752 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4e00051c0 0x7fa4f80b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.390+0000 7fa4feb51700 1 -- 172.21.15.31:0/1791278752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80b6050 con 0x7fa4f80b0b50 2023-10-09T06:22:17.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.390+0000 7fa4feb51700 1 --2- 172.21.15.31:0/1791278752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f80b0b50 0x7fa4f80b0fc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80b3830 tx=0x7fa4e8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:17.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.390+0000 7fa4f67fc700 1 -- 172.21.15.31:0/1791278752 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800c6d0 con 0x7fa4f80b0b50 2023-10-09T06:22:17.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.390+0000 7fa4f67fc700 1 -- 172.21.15.31:0/1791278752 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e8012dd0 con 0x7fa4f80b0b50 2023-10-09T06:22:17.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.390+0000 7fa5005b4700 1 -- 172.21.15.31:0/1791278752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f814b6a0 con 0x7fa4f80b0b50 2023-10-09T06:22:17.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.390+0000 7fa4f67fc700 1 -- 172.21.15.31:0/1791278752 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e801d650 con 0x7fa4f80b0b50 2023-10-09T06:22:17.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.390+0000 7fa5005b4700 1 -- 172.21.15.31:0/1791278752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f80b5ce0 con 0x7fa4f80b0b50 2023-10-09T06:22:17.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.391+0000 7fa5005b4700 1 -- 172.21.15.31:0/1791278752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f80b61e0 con 0x7fa4f80b0b50 2023-10-09T06:22:17.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.391+0000 7fa4f67fc700 1 -- 172.21.15.31:0/1791278752 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4e801da80 con 0x7fa4f80b0b50 2023-10-09T06:22:17.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.392+0000 7fa4f67fc700 1 --2- 172.21.15.31:0/1791278752 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa4e4066f60 0x7fa4e4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.392+0000 7fa4f67fc700 1 -- 172.21.15.31:0/1791278752 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4e80859f0 con 0x7fa4f80b0b50 2023-10-09T06:22:17.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.392+0000 7fa4fe350700 1 --2- 172.21.15.31:0/1791278752 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa4e4066f60 0x7fa4e4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.392+0000 7fa4fe350700 1 --2- 172.21.15.31:0/1791278752 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa4e4066f60 0x7fa4e4069410 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0007eb0 tx=0x7fa4f0001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:17.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.396+0000 7fa4f67fc700 1 -- 172.21.15.31:0/1791278752 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4e8052c60 con 0x7fa4f80b0b50 2023-10-09T06:22:17.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.587+0000 7fa5005b4700 1 -- 172.21.15.31:0/1791278752 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4f804c3c0 con 0x7fa4e4066f60 2023-10-09T06:22:17.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.596+0000 7fa4f67fc700 1 -- 172.21.15.31:0/1791278752 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283944 (secure 0 0 0) 0x7fa4f804c3c0 con 0x7fa4e4066f60 2023-10-09T06:22:17.600 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:17.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.599+0000 7fa5005b4700 1 -- 172.21.15.31:0/1791278752 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa4e4066f60 msgr2=0x7fa4e4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.599+0000 7fa5005b4700 1 --2- 172.21.15.31:0/1791278752 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa4e4066f60 0x7fa4e4069410 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0007eb0 tx=0x7fa4f0001e50 comp rx=0 tx=0).stop 2023-10-09T06:22:17.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.599+0000 7fa5005b4700 1 -- 172.21.15.31:0/1791278752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f80b0b50 msgr2=0x7fa4f80b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.599+0000 7fa5005b4700 1 --2- 172.21.15.31:0/1791278752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f80b0b50 0x7fa4f80b0fc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80b3830 tx=0x7fa4e8015000 comp rx=0 tx=0).stop 2023-10-09T06:22:17.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.599+0000 7fa5005b4700 1 -- 172.21.15.31:0/1791278752 shutdown_connections 2023-10-09T06:22:17.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.599+0000 7fa5005b4700 1 --2- 172.21.15.31:0/1791278752 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa4e4066f60 0x7fa4e4069410 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.599+0000 7fa5005b4700 1 --2- 172.21.15.31:0/1791278752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f80b0b50 0x7fa4f80b0fc0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.599+0000 7fa5005b4700 1 --2- 172.21.15.31:0/1791278752 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4e00051c0 0x7fa4f80b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.599+0000 7fa5005b4700 1 --2- 172.21.15.31:0/1791278752 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa4f80b64e0 0x7fa4f80b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.599+0000 7fa5005b4700 1 -- 172.21.15.31:0/1791278752 >> 172.21.15.31:0/1791278752 conn(0x7fa4f8068ce0 msgr2=0x7fa4f8158840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:17.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.599+0000 7fa5005b4700 1 -- 172.21.15.31:0/1791278752 shutdown_connections 2023-10-09T06:22:17.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.599+0000 7fa5005b4700 1 -- 172.21.15.31:0/1791278752 wait complete. 2023-10-09T06:22:17.606 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:22:17.610 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-10-09T06:22:16.537698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2748,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559751,"statfs":{"total":1600000000,"available":1597185554,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.440270"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113415+0000","last_change":"2023-10-09T06:22:13.113415+0000","last_active":"2023-10-09T06:22:13.113415+0000","last_peered":"2023-10-09T06:22:13.113415+0000","last_clean":"2023-10-09T06:22:13.113415+0000","last_became_active":"2023-10-09T06:22:13.112473+0000","last_became_peered":"2023-10-09T06:22:13.112473+0000","last_unstale":"2023-10-09T06:22:13.113415+0000","last_undegraded":"2023-10-09T06:22:13.113415+0000","last_fullsized":"2023-10-09T06:22:13.113415+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:30:13.644885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.116740+0000","last_change":"2023-10-09T06:22:13.116740+0000","last_active":"2023-10-09T06:22:13.116740+0000","last_peered":"2023-10-09T06:22:13.116740+0000","last_clean":"2023-10-09T06:22:13.116740+0000","last_became_active":"2023-10-09T06:22:13.115558+0000","last_became_peered":"2023-10-09T06:22:13.115558+0000","last_unstale":"2023-10-09T06:22:13.116740+0000","last_undegraded":"2023-10-09T06:22:13.116740+0000","last_fullsized":"2023-10-09T06:22:13.116740+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:03.724332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.117892+0000","last_change":"2023-10-09T06:22:13.117892+0000","last_active":"2023-10-09T06:22:13.117892+0000","last_peered":"2023-10-09T06:22:13.117892+0000","last_clean":"2023-10-09T06:22:13.117892+0000","last_became_active":"2023-10-09T06:22:13.116515+0000","last_became_peered":"2023-10-09T06:22:13.116515+0000","last_unstale":"2023-10-09T06:22:13.117892+0000","last_undegraded":"2023-10-09T06:22:13.117892+0000","last_fullsized":"2023-10-09T06:22:13.117892+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:32:17.052242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112885+0000","last_change":"2023-10-09T06:22:13.112885+0000","last_active":"2023-10-09T06:22:13.112885+0000","last_peered":"2023-10-09T06:22:13.112885+0000","last_clean":"2023-10-09T06:22:13.112885+0000","last_became_active":"2023-10-09T06:22:13.112478+0000","last_became_peered":"2023-10-09T06:22:13.112478+0000","last_unstale":"2023-10-09T06:22:13.112885+0000","last_undegraded":"2023-10-09T06:22:13.112885+0000","last_fullsized":"2023-10-09T06:22:13.112885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:33:11.593427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.117790+0000","last_change":"2023-10-09T06:22:13.117790+0000","last_active":"2023-10-09T06:22:13.117790+0000","last_peered":"2023-10-09T06:22:13.117790+0000","last_clean":"2023-10-09T06:22:13.117790+0000","last_became_active":"2023-10-09T06:22:13.117554+0000","last_became_peered":"2023-10-09T06:22:13.117554+0000","last_unstale":"2023-10-09T06:22:13.117790+0000","last_undegraded":"2023-10-09T06:22:13.117790+0000","last_fullsized":"2023-10-09T06:22:13.117790+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:26.802239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115468+0000","last_change":"2023-10-09T06:22:13.115468+0000","last_active":"2023-10-09T06:22:13.115468+0000","last_peered":"2023-10-09T06:22:13.115468+0000","last_clean":"2023-10-09T06:22:13.115468+0000","last_became_active":"2023-10-09T06:22:13.114114+0000","last_became_peered":"2023-10-09T06:22:13.114114+0000","last_unstale":"2023-10-09T06:22:13.115468+0000","last_undegraded":"2023-10-09T06:22:13.115468+0000","last_fullsized":"2023-10-09T06:22:13.115468+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:01:45.932229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.108032+0000","last_change":"2023-10-09T06:22:13.108032+0000","last_active":"2023-10-09T06:22:13.108032+0000","last_peered":"2023-10-09T06:22:13.108032+0000","last_clean":"2023-10-09T06:22:13.108032+0000","last_became_active":"2023-10-09T06:22:13.107791+0000","last_became_peered":"2023-10-09T06:22:13.107791+0000","last_unstale":"2023-10-09T06:22:13.108032+0000","last_undegraded":"2023-10-09T06:22:13.108032+0000","last_fullsized":"2023-10-09T06:22:13.108032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:10.168642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.109241+0000","last_change":"2023-10-09T06:22:13.109241+0000","last_active":"2023-10-09T06:22:13.109241+0000","last_peered":"2023-10-09T06:22:13.109241+0000","last_clean":"2023-10-09T06:22:13.109241+0000","last_became_active":"2023-10-09T06:22:13.108873+0000","last_became_peered":"2023-10-09T06:22:13.108873+0000","last_unstale":"2023-10-09T06:22:13.109241+0000","last_undegraded":"2023-10-09T06:22:13.109241+0000","last_fullsized":"2023-10-09T06:22:13.109241+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:47.385472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115014+0000","last_change":"2023-10-09T06:22:13.115014+0000","last_active":"2023-10-09T06:22:13.115014+0000","last_peered":"2023-10-09T06:22:13.115014+0000","last_clean":"2023-10-09T06:22:13.115014+0000","last_became_active":"2023-10-09T06:22:13.114600+0000","last_became_peered":"2023-10-09T06:22:13.114600+0000","last_unstale":"2023-10-09T06:22:13.115014+0000","last_undegraded":"2023-10-09T06:22:13.115014+0000","last_fullsized":"2023-10-09T06:22:13.115014+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:48.008121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.108026+0000","last_change":"2023-10-09T06:22:13.108026+0000","last_active":"2023-10-09T06:22:13.108026+0000","last_peered":"2023-10-09T06:22:13.108026+0000","last_clean":"2023-10-09T06:22:13.108026+0000","last_became_active":"2023-10-09T06:22:13.107505+0000","last_became_peered":"2023-10-09T06:22:13.107505+0000","last_unstale":"2023-10-09T06:22:13.108026+0000","last_undegraded":"2023-10-09T06:22:13.108026+0000","last_fullsized":"2023-10-09T06:22:13.108026+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:58.356155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.110302+0000","last_change":"2023-10-09T06:22:13.110302+0000","last_active":"2023-10-09T06:22:13.110302+0000","last_peered":"2023-10-09T06:22:13.110302+0000","last_clean":"2023-10-09T06:22:13.110302+0000","last_became_active":"2023-10-09T06:22:13.110082+0000","last_became_peered":"2023-10-09T06:22:13.110082+0000","last_unstale":"2023-10-09T06:22:13.110302+0000","last_undegraded":"2023-10-09T06:22:13.110302+0000","last_fullsized":"2023-10-09T06:22:13.110302+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:26.518679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.116915+0000","last_change":"2023-10-09T06:22:13.116915+0000","last_active":"2023-10-09T06:22:13.116915+0000","last_peered":"2023-10-09T06:22:13.116915+0000","last_clean":"2023-10-09T06:22:13.116915+0000","last_became_active":"2023-10-09T06:22:13.115845+0000","last_became_peered":"2023-10-09T06:22:13.115845+0000","last_unstale":"2023-10-09T06:22:13.116915+0000","last_undegraded":"2023-10-09T06:22:13.116915+0000","last_fullsized":"2023-10-09T06:22:13.116915+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:58.356155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.108870+0000","last_change":"2023-10-09T06:22:13.108870+0000","last_active":"2023-10-09T06:22:13.108870+0000","last_peered":"2023-10-09T06:22:13.108870+0000","last_clean":"2023-10-09T06:22:13.108870+0000","last_became_active":"2023-10-09T06:22:13.108655+0000","last_became_peered":"2023-10-09T06:22:13.108655+0000","last_unstale":"2023-10-09T06:22:13.108870+0000","last_undegraded":"2023-10-09T06:22:13.108870+0000","last_fullsized":"2023-10-09T06:22:13.108870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:54:40.053234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114865+0000","last_change":"2023-10-09T06:22:13.114865+0000","last_active":"2023-10-09T06:22:13.114865+0000","last_peered":"2023-10-09T06:22:13.114865+0000","last_clean":"2023-10-09T06:22:13.114865+0000","last_became_active":"2023-10-09T06:22:13.114277+0000","last_became_peered":"2023-10-09T06:22:13.114277+0000","last_unstale":"2023-10-09T06:22:13.114865+0000","last_undegraded":"2023-10-09T06:22:13.114865+0000","last_fullsized":"2023-10-09T06:22:13.114865+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:26.246587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113458+0000","last_change":"2023-10-09T06:22:13.113458+0000","last_active":"2023-10-09T06:22:13.113458+0000","last_peered":"2023-10-09T06:22:13.113458+0000","last_clean":"2023-10-09T06:22:13.113458+0000","last_became_active":"2023-10-09T06:22:13.113236+0000","last_became_peered":"2023-10-09T06:22:13.113236+0000","last_unstale":"2023-10-09T06:22:13.113458+0000","last_undegraded":"2023-10-09T06:22:13.113458+0000","last_fullsized":"2023-10-09T06:22:13.113458+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:57.552699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114547+0000","last_change":"2023-10-09T06:22:13.114547+0000","last_active":"2023-10-09T06:22:13.114547+0000","last_peered":"2023-10-09T06:22:13.114547+0000","last_clean":"2023-10-09T06:22:13.114547+0000","last_became_active":"2023-10-09T06:22:13.114314+0000","last_became_peered":"2023-10-09T06:22:13.114314+0000","last_unstale":"2023-10-09T06:22:13.114547+0000","last_undegraded":"2023-10-09T06:22:13.114547+0000","last_fullsized":"2023-10-09T06:22:13.114547+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:36.794911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114919+0000","last_change":"2023-10-09T06:22:13.114919+0000","last_active":"2023-10-09T06:22:13.114919+0000","last_peered":"2023-10-09T06:22:13.114919+0000","last_clean":"2023-10-09T06:22:13.114919+0000","last_became_active":"2023-10-09T06:22:13.114482+0000","last_became_peered":"2023-10-09T06:22:13.114482+0000","last_unstale":"2023-10-09T06:22:13.114919+0000","last_undegraded":"2023-10-09T06:22:13.114919+0000","last_fullsized":"2023-10-09T06:22:13.114919+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:03.724332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.118345+0000","last_change":"2023-10-09T06:22:13.118345+0000","last_active":"2023-10-09T06:22:13.118345+0000","last_peered":"2023-10-09T06:22:13.118345+0000","last_clean":"2023-10-09T06:22:13.118345+0000","last_became_active":"2023-10-09T06:22:13.117668+0000","last_became_peered":"2023-10-09T06:22:13.117668+0000","last_unstale":"2023-10-09T06:22:13.118345+0000","last_undegraded":"2023-10-09T06:22:13.118345+0000","last_fullsized":"2023-10-09T06:22:13.118345+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:26.246587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111573+0000","last_change":"2023-10-09T06:22:13.111573+0000","last_active":"2023-10-09T06:22:13.111573+0000","last_peered":"2023-10-09T06:22:13.111573+0000","last_clean":"2023-10-09T06:22:13.111573+0000","last_became_active":"2023-10-09T06:22:13.111169+0000","last_became_peered":"2023-10-09T06:22:13.111169+0000","last_unstale":"2023-10-09T06:22:13.111573+0000","last_undegraded":"2023-10-09T06:22:13.111573+0000","last_fullsized":"2023-10-09T06:22:13.111573+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:44:00.271505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.116885+0000","last_change":"2023-10-09T06:22:13.116885+0000","last_active":"2023-10-09T06:22:13.116885+0000","last_peered":"2023-10-09T06:22:13.116885+0000","last_clean":"2023-10-09T06:22:13.116885+0000","last_became_active":"2023-10-09T06:22:13.116651+0000","last_became_peered":"2023-10-09T06:22:13.116651+0000","last_unstale":"2023-10-09T06:22:13.116885+0000","last_undegraded":"2023-10-09T06:22:13.116885+0000","last_fullsized":"2023-10-09T06:22:13.116885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:01.424001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115902+0000","last_change":"2023-10-09T06:22:13.115902+0000","last_active":"2023-10-09T06:22:13.115902+0000","last_peered":"2023-10-09T06:22:13.115902+0000","last_clean":"2023-10-09T06:22:13.115902+0000","last_became_active":"2023-10-09T06:22:13.115275+0000","last_became_peered":"2023-10-09T06:22:13.115275+0000","last_unstale":"2023-10-09T06:22:13.115902+0000","last_undegraded":"2023-10-09T06:22:13.115902+0000","last_fullsized":"2023-10-09T06:22:13.115902+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:55:12.164357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.109978+0000","last_change":"2023-10-09T06:22:13.109978+0000","last_active":"2023-10-09T06:22:13.109978+0000","last_peered":"2023-10-09T06:22:13.109978+0000","last_clean":"2023-10-09T06:22:13.109978+0000","last_became_active":"2023-10-09T06:22:13.109707+0000","last_became_peered":"2023-10-09T06:22:13.109707+0000","last_unstale":"2023-10-09T06:22:13.109978+0000","last_undegraded":"2023-10-09T06:22:13.109978+0000","last_fullsized":"2023-10-09T06:22:13.109978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:01.494393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111561+0000","last_change":"2023-10-09T06:22:13.111561+0000","last_active":"2023-10-09T06:22:13.111561+0000","last_peered":"2023-10-09T06:22:13.111561+0000","last_clean":"2023-10-09T06:22:13.111561+0000","last_became_active":"2023-10-09T06:22:13.111140+0000","last_became_peered":"2023-10-09T06:22:13.111140+0000","last_unstale":"2023-10-09T06:22:13.111561+0000","last_undegraded":"2023-10-09T06:22:13.111561+0000","last_fullsized":"2023-10-09T06:22:13.111561+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:55.958187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.110940+0000","last_change":"2023-10-09T06:22:13.110940+0000","last_active":"2023-10-09T06:22:13.110940+0000","last_peered":"2023-10-09T06:22:13.110940+0000","last_clean":"2023-10-09T06:22:13.110940+0000","last_became_active":"2023-10-09T06:22:13.110478+0000","last_became_peered":"2023-10-09T06:22:13.110478+0000","last_unstale":"2023-10-09T06:22:13.110940+0000","last_undegraded":"2023-10-09T06:22:13.110940+0000","last_fullsized":"2023-10-09T06:22:13.110940+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:30:00.476457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114440+0000","last_change":"2023-10-09T06:22:13.114440+0000","last_active":"2023-10-09T06:22:13.114440+0000","last_peered":"2023-10-09T06:22:13.114440+0000","last_clean":"2023-10-09T06:22:13.114440+0000","last_became_active":"2023-10-09T06:22:13.113921+0000","last_became_peered":"2023-10-09T06:22:13.113921+0000","last_unstale":"2023-10-09T06:22:13.114440+0000","last_undegraded":"2023-10-09T06:22:13.114440+0000","last_fullsized":"2023-10-09T06:22:13.114440+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:28:21.289305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112242+0000","last_change":"2023-10-09T06:22:13.112242+0000","last_active":"2023-10-09T06:22:13.112242+0000","last_peered":"2023-10-09T06:22:13.112242+0000","last_clean":"2023-10-09T06:22:13.112242+0000","last_became_active":"2023-10-09T06:22:13.112019+0000","last_became_peered":"2023-10-09T06:22:13.112019+0000","last_unstale":"2023-10-09T06:22:13.112242+0000","last_undegraded":"2023-10-09T06:22:13.112242+0000","last_fullsized":"2023-10-09T06:22:13.112242+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:43.738240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114745+0000","last_change":"2023-10-09T06:22:13.114745+0000","last_active":"2023-10-09T06:22:13.114745+0000","last_peered":"2023-10-09T06:22:13.114745+0000","last_clean":"2023-10-09T06:22:13.114745+0000","last_became_active":"2023-10-09T06:22:13.113751+0000","last_became_peered":"2023-10-09T06:22:13.113751+0000","last_unstale":"2023-10-09T06:22:13.114745+0000","last_undegraded":"2023-10-09T06:22:13.114745+0000","last_fullsized":"2023-10-09T06:22:13.114745+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:48.008121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112052+0000","last_change":"2023-10-09T06:22:13.112052+0000","last_active":"2023-10-09T06:22:13.112052+0000","last_peered":"2023-10-09T06:22:13.112052+0000","last_clean":"2023-10-09T06:22:13.112052+0000","last_became_active":"2023-10-09T06:22:13.111816+0000","last_became_peered":"2023-10-09T06:22:13.111816+0000","last_unstale":"2023-10-09T06:22:13.112052+0000","last_undegraded":"2023-10-09T06:22:13.112052+0000","last_fullsized":"2023-10-09T06:22:13.112052+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:06.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.117365+0000","last_change":"2023-10-09T06:22:13.117365+0000","last_active":"2023-10-09T06:22:13.117365+0000","last_peered":"2023-10-09T06:22:13.117365+0000","last_clean":"2023-10-09T06:22:13.117365+0000","last_became_active":"2023-10-09T06:22:13.117129+0000","last_became_peered":"2023-10-09T06:22:13.117129+0000","last_unstale":"2023-10-09T06:22:13.117365+0000","last_undegraded":"2023-10-09T06:22:13.117365+0000","last_fullsized":"2023-10-09T06:22:13.117365+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:11.616807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114809+0000","last_change":"2023-10-09T06:22:13.114809+0000","last_active":"2023-10-09T06:22:13.114809+0000","last_peered":"2023-10-09T06:22:13.114809+0000","last_clean":"2023-10-09T06:22:13.114809+0000","last_became_active":"2023-10-09T06:22:13.114003+0000","last_became_peered":"2023-10-09T06:22:13.114003+0000","last_unstale":"2023-10-09T06:22:13.114809+0000","last_undegraded":"2023-10-09T06:22:13.114809+0000","last_fullsized":"2023-10-09T06:22:13.114809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:36.794911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115731+0000","last_change":"2023-10-09T06:22:13.115731+0000","last_active":"2023-10-09T06:22:13.115731+0000","last_peered":"2023-10-09T06:22:13.115731+0000","last_clean":"2023-10-09T06:22:13.115731+0000","last_became_active":"2023-10-09T06:22:13.114717+0000","last_became_peered":"2023-10-09T06:22:13.114717+0000","last_unstale":"2023-10-09T06:22:13.115731+0000","last_undegraded":"2023-10-09T06:22:13.115731+0000","last_fullsized":"2023-10-09T06:22:13.115731+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:42.220360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115583+0000","last_change":"2023-10-09T06:22:13.115583+0000","last_active":"2023-10-09T06:22:13.115583+0000","last_peered":"2023-10-09T06:22:13.115583+0000","last_clean":"2023-10-09T06:22:13.115583+0000","last_became_active":"2023-10-09T06:22:13.115357+0000","last_became_peered":"2023-10-09T06:22:13.115357+0000","last_unstale":"2023-10-09T06:22:13.115583+0000","last_undegraded":"2023-10-09T06:22:13.115583+0000","last_fullsized":"2023-10-09T06:22:13.115583+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:07.470084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111822+0000","last_change":"2023-10-09T06:22:13.111822+0000","last_active":"2023-10-09T06:22:13.111822+0000","last_peered":"2023-10-09T06:22:13.111822+0000","last_clean":"2023-10-09T06:22:13.111822+0000","last_became_active":"2023-10-09T06:22:13.111615+0000","last_became_peered":"2023-10-09T06:22:13.111615+0000","last_unstale":"2023-10-09T06:22:13.111822+0000","last_undegraded":"2023-10-09T06:22:13.111822+0000","last_fullsized":"2023-10-09T06:22:13.111822+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:55.958187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.126261+0000","last_change":"2023-10-09T06:22:12.110900+0000","last_active":"2023-10-09T06:22:13.126261+0000","last_peered":"2023-10-09T06:22:13.126261+0000","last_clean":"2023-10-09T06:22:13.126261+0000","last_became_active":"2023-10-09T06:22:12.110410+0000","last_became_peered":"2023-10-09T06:22:12.110410+0000","last_unstale":"2023-10-09T06:22:13.126261+0000","last_undegraded":"2023-10-09T06:22:13.126261+0000","last_fullsized":"2023-10-09T06:22:13.126261+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:25.512236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115488+0000","last_change":"2023-10-09T06:22:13.115488+0000","last_active":"2023-10-09T06:22:13.115488+0000","last_peered":"2023-10-09T06:22:13.115488+0000","last_clean":"2023-10-09T06:22:13.115488+0000","last_became_active":"2023-10-09T06:22:13.115181+0000","last_became_peered":"2023-10-09T06:22:13.115181+0000","last_unstale":"2023-10-09T06:22:13.115488+0000","last_undegraded":"2023-10-09T06:22:13.115488+0000","last_fullsized":"2023-10-09T06:22:13.115488+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:11.690847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.109685+0000","last_change":"2023-10-09T06:22:12.113922+0000","last_active":"2023-10-09T06:22:13.109685+0000","last_peered":"2023-10-09T06:22:13.109685+0000","last_clean":"2023-10-09T06:22:13.109685+0000","last_became_active":"2023-10-09T06:22:12.113691+0000","last_became_peered":"2023-10-09T06:22:12.113691+0000","last_unstale":"2023-10-09T06:22:13.109685+0000","last_undegraded":"2023-10-09T06:22:13.109685+0000","last_fullsized":"2023-10-09T06:22:13.109685+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:19.764733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.116145+0000","last_change":"2023-10-09T06:22:13.116145+0000","last_active":"2023-10-09T06:22:13.116145+0000","last_peered":"2023-10-09T06:22:13.116145+0000","last_clean":"2023-10-09T06:22:13.116145+0000","last_became_active":"2023-10-09T06:22:13.115826+0000","last_became_peered":"2023-10-09T06:22:13.115826+0000","last_unstale":"2023-10-09T06:22:13.116145+0000","last_undegraded":"2023-10-09T06:22:13.116145+0000","last_fullsized":"2023-10-09T06:22:13.116145+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:47.385472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.126220+0000","last_change":"2023-10-09T06:22:12.115150+0000","last_active":"2023-10-09T06:22:13.126220+0000","last_peered":"2023-10-09T06:22:13.126220+0000","last_clean":"2023-10-09T06:22:13.126220+0000","last_became_active":"2023-10-09T06:22:12.114770+0000","last_became_peered":"2023-10-09T06:22:12.114770+0000","last_unstale":"2023-10-09T06:22:13.126220+0000","last_undegraded":"2023-10-09T06:22:13.126220+0000","last_fullsized":"2023-10-09T06:22:13.126220+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:00.417558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.117664+0000","last_change":"2023-10-09T06:22:13.117664+0000","last_active":"2023-10-09T06:22:13.117664+0000","last_peered":"2023-10-09T06:22:13.117664+0000","last_clean":"2023-10-09T06:22:13.117664+0000","last_became_active":"2023-10-09T06:22:13.117365+0000","last_became_peered":"2023-10-09T06:22:13.117365+0000","last_unstale":"2023-10-09T06:22:13.117664+0000","last_undegraded":"2023-10-09T06:22:13.117664+0000","last_fullsized":"2023-10-09T06:22:13.117664+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:04:47.579462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.125510+0000","last_change":"2023-10-09T06:22:12.114449+0000","last_active":"2023-10-09T06:22:13.125510+0000","last_peered":"2023-10-09T06:22:13.125510+0000","last_clean":"2023-10-09T06:22:13.125510+0000","last_became_active":"2023-10-09T06:22:12.113778+0000","last_became_peered":"2023-10-09T06:22:12.113778+0000","last_unstale":"2023-10-09T06:22:13.125510+0000","last_undegraded":"2023-10-09T06:22:13.125510+0000","last_fullsized":"2023-10-09T06:22:13.125510+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:25.512236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.118037+0000","last_change":"2023-10-09T06:22:13.118037+0000","last_active":"2023-10-09T06:22:13.118037+0000","last_peered":"2023-10-09T06:22:13.118037+0000","last_clean":"2023-10-09T06:22:13.118037+0000","last_became_active":"2023-10-09T06:22:13.116963+0000","last_became_peered":"2023-10-09T06:22:13.116963+0000","last_unstale":"2023-10-09T06:22:13.118037+0000","last_undegraded":"2023-10-09T06:22:13.118037+0000","last_fullsized":"2023-10-09T06:22:13.118037+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:26.518679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.107674+0000","last_change":"2023-10-09T06:22:12.109962+0000","last_active":"2023-10-09T06:22:13.107674+0000","last_peered":"2023-10-09T06:22:13.107674+0000","last_clean":"2023-10-09T06:22:13.107674+0000","last_became_active":"2023-10-09T06:22:12.109713+0000","last_became_peered":"2023-10-09T06:22:12.109713+0000","last_unstale":"2023-10-09T06:22:13.107674+0000","last_undegraded":"2023-10-09T06:22:13.107674+0000","last_fullsized":"2023-10-09T06:22:13.107674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:47.001679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113260+0000","last_change":"2023-10-09T06:22:13.113260+0000","last_active":"2023-10-09T06:22:13.113260+0000","last_peered":"2023-10-09T06:22:13.113260+0000","last_clean":"2023-10-09T06:22:13.113260+0000","last_became_active":"2023-10-09T06:22:13.113017+0000","last_became_peered":"2023-10-09T06:22:13.113017+0000","last_unstale":"2023-10-09T06:22:13.113260+0000","last_undegraded":"2023-10-09T06:22:13.113260+0000","last_fullsized":"2023-10-09T06:22:13.113260+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:39.051851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113713+0000","last_change":"2023-10-09T06:22:12.113448+0000","last_active":"2023-10-09T06:22:13.113713+0000","last_peered":"2023-10-09T06:22:13.113713+0000","last_clean":"2023-10-09T06:22:13.113713+0000","last_became_active":"2023-10-09T06:22:12.113212+0000","last_became_peered":"2023-10-09T06:22:12.113212+0000","last_unstale":"2023-10-09T06:22:13.113713+0000","last_undegraded":"2023-10-09T06:22:13.113713+0000","last_fullsized":"2023-10-09T06:22:13.113713+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:54:39.046792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.108168+0000","last_change":"2023-10-09T06:22:13.108168+0000","last_active":"2023-10-09T06:22:13.108168+0000","last_peered":"2023-10-09T06:22:13.108168+0000","last_clean":"2023-10-09T06:22:13.108168+0000","last_became_active":"2023-10-09T06:22:13.107795+0000","last_became_peered":"2023-10-09T06:22:13.107795+0000","last_unstale":"2023-10-09T06:22:13.108168+0000","last_undegraded":"2023-10-09T06:22:13.108168+0000","last_fullsized":"2023-10-09T06:22:13.108168+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:06.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.114868+0000","last_change":"2023-10-09T06:22:12.114812+0000","last_active":"2023-10-09T06:22:12.114868+0000","last_peered":"2023-10-09T06:22:12.114868+0000","last_clean":"2023-10-09T06:22:12.114868+0000","last_became_active":"2023-10-09T06:22:12.114542+0000","last_became_peered":"2023-10-09T06:22:12.114542+0000","last_unstale":"2023-10-09T06:22:12.114868+0000","last_undegraded":"2023-10-09T06:22:12.114868+0000","last_fullsized":"2023-10-09T06:22:12.114868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:10.684405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111419+0000","last_change":"2023-10-09T06:22:13.111419+0000","last_active":"2023-10-09T06:22:13.111419+0000","last_peered":"2023-10-09T06:22:13.111419+0000","last_clean":"2023-10-09T06:22:13.111419+0000","last_became_active":"2023-10-09T06:22:13.110702+0000","last_became_peered":"2023-10-09T06:22:13.110702+0000","last_unstale":"2023-10-09T06:22:13.111419+0000","last_undegraded":"2023-10-09T06:22:13.111419+0000","last_fullsized":"2023-10-09T06:22:13.111419+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:04:47.579462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.109865+0000","last_change":"2023-10-09T06:22:12.109067+0000","last_active":"2023-10-09T06:22:12.109865+0000","last_peered":"2023-10-09T06:22:12.109865+0000","last_clean":"2023-10-09T06:22:12.109865+0000","last_became_active":"2023-10-09T06:22:12.108296+0000","last_became_peered":"2023-10-09T06:22:12.108296+0000","last_unstale":"2023-10-09T06:22:12.109865+0000","last_undegraded":"2023-10-09T06:22:12.109865+0000","last_fullsized":"2023-10-09T06:22:12.109865+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:31.006036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.117324+0000","last_change":"2023-10-09T06:22:13.117324+0000","last_active":"2023-10-09T06:22:13.117324+0000","last_peered":"2023-10-09T06:22:13.117324+0000","last_clean":"2023-10-09T06:22:13.117324+0000","last_became_active":"2023-10-09T06:22:13.117032+0000","last_became_peered":"2023-10-09T06:22:13.117032+0000","last_unstale":"2023-10-09T06:22:13.117324+0000","last_undegraded":"2023-10-09T06:22:13.117324+0000","last_fullsized":"2023-10-09T06:22:13.117324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:39.051851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.110278+0000","last_change":"2023-10-09T06:22:12.110212+0000","last_active":"2023-10-09T06:22:12.110278+0000","last_peered":"2023-10-09T06:22:12.110278+0000","last_clean":"2023-10-09T06:22:12.110278+0000","last_became_active":"2023-10-09T06:22:12.109990+0000","last_became_peered":"2023-10-09T06:22:12.109990+0000","last_unstale":"2023-10-09T06:22:12.110278+0000","last_undegraded":"2023-10-09T06:22:12.110278+0000","last_fullsized":"2023-10-09T06:22:12.110278+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:06.463641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113562+0000","last_change":"2023-10-09T06:22:13.113562+0000","last_active":"2023-10-09T06:22:13.113562+0000","last_peered":"2023-10-09T06:22:13.113562+0000","last_clean":"2023-10-09T06:22:13.113562+0000","last_became_active":"2023-10-09T06:22:13.113195+0000","last_became_peered":"2023-10-09T06:22:13.113195+0000","last_unstale":"2023-10-09T06:22:13.113562+0000","last_undegraded":"2023-10-09T06:22:13.113562+0000","last_fullsized":"2023-10-09T06:22:13.113562+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:41.809977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.108355+0000","last_change":"2023-10-09T06:22:12.108288+0000","last_active":"2023-10-09T06:22:12.108355+0000","last_peered":"2023-10-09T06:22:12.108355+0000","last_clean":"2023-10-09T06:22:12.108355+0000","last_became_active":"2023-10-09T06:22:12.108037+0000","last_became_peered":"2023-10-09T06:22:12.108037+0000","last_unstale":"2023-10-09T06:22:12.108355+0000","last_undegraded":"2023-10-09T06:22:12.108355+0000","last_fullsized":"2023-10-09T06:22:12.108355+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:45.782618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112179+0000","last_change":"2023-10-09T06:22:13.112179+0000","last_active":"2023-10-09T06:22:13.112179+0000","last_peered":"2023-10-09T06:22:13.112179+0000","last_clean":"2023-10-09T06:22:13.112179+0000","last_became_active":"2023-10-09T06:22:13.112001+0000","last_became_peered":"2023-10-09T06:22:13.112001+0000","last_unstale":"2023-10-09T06:22:13.112179+0000","last_undegraded":"2023-10-09T06:22:13.112179+0000","last_fullsized":"2023-10-09T06:22:13.112179+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:15:06.918345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.126172+0000","last_change":"2023-10-09T06:22:12.112493+0000","last_active":"2023-10-09T06:22:13.126172+0000","last_peered":"2023-10-09T06:22:13.126172+0000","last_clean":"2023-10-09T06:22:13.126172+0000","last_became_active":"2023-10-09T06:22:12.112041+0000","last_became_peered":"2023-10-09T06:22:12.112041+0000","last_unstale":"2023-10-09T06:22:13.126172+0000","last_undegraded":"2023-10-09T06:22:13.126172+0000","last_fullsized":"2023-10-09T06:22:13.126172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:29:59.470014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111851+0000","last_change":"2023-10-09T06:22:13.111851+0000","last_active":"2023-10-09T06:22:13.111851+0000","last_peered":"2023-10-09T06:22:13.111851+0000","last_clean":"2023-10-09T06:22:13.111851+0000","last_became_active":"2023-10-09T06:22:13.111609+0000","last_became_peered":"2023-10-09T06:22:13.111609+0000","last_unstale":"2023-10-09T06:22:13.111851+0000","last_undegraded":"2023-10-09T06:22:13.111851+0000","last_fullsized":"2023-10-09T06:22:13.111851+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:06.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.126472+0000","last_change":"2023-10-09T06:22:12.110233+0000","last_active":"2023-10-09T06:22:13.126472+0000","last_peered":"2023-10-09T06:22:13.126472+0000","last_clean":"2023-10-09T06:22:13.126472+0000","last_became_active":"2023-10-09T06:22:12.109964+0000","last_became_peered":"2023-10-09T06:22:12.109964+0000","last_unstale":"2023-10-09T06:22:13.126472+0000","last_undegraded":"2023-10-09T06:22:13.126472+0000","last_fullsized":"2023-10-09T06:22:13.126472+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:48.568229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112943+0000","last_change":"2023-10-09T06:22:13.112943+0000","last_active":"2023-10-09T06:22:13.112943+0000","last_peered":"2023-10-09T06:22:13.112943+0000","last_clean":"2023-10-09T06:22:13.112943+0000","last_became_active":"2023-10-09T06:22:13.112539+0000","last_became_peered":"2023-10-09T06:22:13.112539+0000","last_unstale":"2023-10-09T06:22:13.112943+0000","last_undegraded":"2023-10-09T06:22:13.112943+0000","last_fullsized":"2023-10-09T06:22:13.112943+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:57.485227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.126542+0000","last_change":"2023-10-09T06:22:12.113302+0000","last_active":"2023-10-09T06:22:13.126542+0000","last_peered":"2023-10-09T06:22:13.126542+0000","last_clean":"2023-10-09T06:22:13.126542+0000","last_became_active":"2023-10-09T06:22:12.113061+0000","last_became_peered":"2023-10-09T06:22:12.113061+0000","last_unstale":"2023-10-09T06:22:13.126542+0000","last_undegraded":"2023-10-09T06:22:13.126542+0000","last_fullsized":"2023-10-09T06:22:13.126542+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:46.379029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.108557+0000","last_change":"2023-10-09T06:22:13.108557+0000","last_active":"2023-10-09T06:22:13.108557+0000","last_peered":"2023-10-09T06:22:13.108557+0000","last_clean":"2023-10-09T06:22:13.108557+0000","last_became_active":"2023-10-09T06:22:13.108337+0000","last_became_peered":"2023-10-09T06:22:13.108337+0000","last_unstale":"2023-10-09T06:22:13.108557+0000","last_undegraded":"2023-10-09T06:22:13.108557+0000","last_fullsized":"2023-10-09T06:22:13.108557+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:32:17.052242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.110053+0000","last_change":"2023-10-09T06:22:12.109845+0000","last_active":"2023-10-09T06:22:12.110053+0000","last_peered":"2023-10-09T06:22:12.110053+0000","last_clean":"2023-10-09T06:22:12.110053+0000","last_became_active":"2023-10-09T06:22:12.108540+0000","last_became_peered":"2023-10-09T06:22:12.108540+0000","last_unstale":"2023-10-09T06:22:12.110053+0000","last_undegraded":"2023-10-09T06:22:12.110053+0000","last_fullsized":"2023-10-09T06:22:12.110053+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:25.240144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111838+0000","last_change":"2023-10-09T06:22:13.111838+0000","last_active":"2023-10-09T06:22:13.111838+0000","last_peered":"2023-10-09T06:22:13.111838+0000","last_clean":"2023-10-09T06:22:13.111838+0000","last_became_active":"2023-10-09T06:22:13.111609+0000","last_became_peered":"2023-10-09T06:22:13.111609+0000","last_unstale":"2023-10-09T06:22:13.111838+0000","last_undegraded":"2023-10-09T06:22:13.111838+0000","last_fullsized":"2023-10-09T06:22:13.111838+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:58.359099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.114679+0000","last_change":"2023-10-09T06:22:12.114627+0000","last_active":"2023-10-09T06:22:12.114679+0000","last_peered":"2023-10-09T06:22:12.114679+0000","last_clean":"2023-10-09T06:22:12.114679+0000","last_became_active":"2023-10-09T06:22:12.114286+0000","last_became_peered":"2023-10-09T06:22:12.114286+0000","last_unstale":"2023-10-09T06:22:12.114679+0000","last_undegraded":"2023-10-09T06:22:12.114679+0000","last_fullsized":"2023-10-09T06:22:12.114679+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:02.084602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.108600+0000","last_change":"2023-10-09T06:22:13.108600+0000","last_active":"2023-10-09T06:22:13.108600+0000","last_peered":"2023-10-09T06:22:13.108600+0000","last_clean":"2023-10-09T06:22:13.108600+0000","last_became_active":"2023-10-09T06:22:13.108382+0000","last_became_peered":"2023-10-09T06:22:13.108382+0000","last_unstale":"2023-10-09T06:22:13.108600+0000","last_undegraded":"2023-10-09T06:22:13.108600+0000","last_fullsized":"2023-10-09T06:22:13.108600+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:05:39.549755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.127962+0000","last_change":"2023-10-09T06:22:12.112602+0000","last_active":"2023-10-09T06:22:13.127962+0000","last_peered":"2023-10-09T06:22:13.127962+0000","last_clean":"2023-10-09T06:22:13.127962+0000","last_became_active":"2023-10-09T06:22:12.112373+0000","last_became_peered":"2023-10-09T06:22:12.112373+0000","last_unstale":"2023-10-09T06:22:13.127962+0000","last_undegraded":"2023-10-09T06:22:13.127962+0000","last_fullsized":"2023-10-09T06:22:13.127962+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:19.764733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.114711+0000","last_change":"2023-10-09T06:22:13.114711+0000","last_active":"2023-10-09T06:22:13.114711+0000","last_peered":"2023-10-09T06:22:13.114711+0000","last_clean":"2023-10-09T06:22:13.114711+0000","last_became_active":"2023-10-09T06:22:13.113806+0000","last_became_peered":"2023-10-09T06:22:13.113806+0000","last_unstale":"2023-10-09T06:22:13.114711+0000","last_undegraded":"2023-10-09T06:22:13.114711+0000","last_fullsized":"2023-10-09T06:22:13.114711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:58.716429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.110105+0000","last_change":"2023-10-09T06:22:12.106819+0000","last_active":"2023-10-09T06:22:13.110105+0000","last_peered":"2023-10-09T06:22:13.110105+0000","last_clean":"2023-10-09T06:22:13.110105+0000","last_became_active":"2023-10-09T06:22:12.105575+0000","last_became_peered":"2023-10-09T06:22:12.105575+0000","last_unstale":"2023-10-09T06:22:13.110105+0000","last_undegraded":"2023-10-09T06:22:13.110105+0000","last_fullsized":"2023-10-09T06:22:13.110105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:47.662829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111761+0000","last_change":"2023-10-09T06:22:13.111761+0000","last_active":"2023-10-09T06:22:13.111761+0000","last_peered":"2023-10-09T06:22:13.111761+0000","last_clean":"2023-10-09T06:22:13.111761+0000","last_became_active":"2023-10-09T06:22:13.111522+0000","last_became_peered":"2023-10-09T06:22:13.111522+0000","last_unstale":"2023-10-09T06:22:13.111761+0000","last_undegraded":"2023-10-09T06:22:13.111761+0000","last_fullsized":"2023-10-09T06:22:13.111761+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:26.802239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.124455+0000","last_change":"2023-10-09T06:22:12.108917+0000","last_active":"2023-10-09T06:22:13.124455+0000","last_peered":"2023-10-09T06:22:13.124455+0000","last_clean":"2023-10-09T06:22:13.124455+0000","last_became_active":"2023-10-09T06:22:12.108629+0000","last_became_peered":"2023-10-09T06:22:12.108629+0000","last_unstale":"2023-10-09T06:22:13.124455+0000","last_undegraded":"2023-10-09T06:22:13.124455+0000","last_fullsized":"2023-10-09T06:22:13.124455+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:42.731798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115231+0000","last_change":"2023-10-09T06:22:13.115231+0000","last_active":"2023-10-09T06:22:13.115231+0000","last_peered":"2023-10-09T06:22:13.115231+0000","last_clean":"2023-10-09T06:22:13.115231+0000","last_became_active":"2023-10-09T06:22:13.115011+0000","last_became_peered":"2023-10-09T06:22:13.115011+0000","last_unstale":"2023-10-09T06:22:13.115231+0000","last_undegraded":"2023-10-09T06:22:13.115231+0000","last_fullsized":"2023-10-09T06:22:13.115231+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:32:17.052242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.110305+0000","last_change":"2023-10-09T06:22:12.114815+0000","last_active":"2023-10-09T06:22:13.110305+0000","last_peered":"2023-10-09T06:22:13.110305+0000","last_clean":"2023-10-09T06:22:13.110305+0000","last_became_active":"2023-10-09T06:22:12.114564+0000","last_became_peered":"2023-10-09T06:22:12.114564+0000","last_unstale":"2023-10-09T06:22:13.110305+0000","last_undegraded":"2023-10-09T06:22:13.110305+0000","last_fullsized":"2023-10-09T06:22:13.110305+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:35.788468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112791+0000","last_change":"2023-10-09T06:22:13.112791+0000","last_active":"2023-10-09T06:22:13.112791+0000","last_peered":"2023-10-09T06:22:13.112791+0000","last_clean":"2023-10-09T06:22:13.112791+0000","last_became_active":"2023-10-09T06:22:13.112116+0000","last_became_peered":"2023-10-09T06:22:13.112116+0000","last_unstale":"2023-10-09T06:22:13.112791+0000","last_undegraded":"2023-10-09T06:22:13.112791+0000","last_fullsized":"2023-10-09T06:22:13.112791+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:01.424001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.114557+0000","last_change":"2023-10-09T06:22:12.114495+0000","last_active":"2023-10-09T06:22:12.114557+0000","last_peered":"2023-10-09T06:22:12.114557+0000","last_clean":"2023-10-09T06:22:12.114557+0000","last_became_active":"2023-10-09T06:22:12.113937+0000","last_became_peered":"2023-10-09T06:22:12.113937+0000","last_unstale":"2023-10-09T06:22:12.114557+0000","last_undegraded":"2023-10-09T06:22:12.114557+0000","last_fullsized":"2023-10-09T06:22:12.114557+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:29:25.240144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113437+0000","last_change":"2023-10-09T06:22:13.113437+0000","last_active":"2023-10-09T06:22:13.113437+0000","last_peered":"2023-10-09T06:22:13.113437+0000","last_clean":"2023-10-09T06:22:13.113437+0000","last_became_active":"2023-10-09T06:22:13.113017+0000","last_became_peered":"2023-10-09T06:22:13.113017+0000","last_unstale":"2023-10-09T06:22:13.113437+0000","last_undegraded":"2023-10-09T06:22:13.113437+0000","last_fullsized":"2023-10-09T06:22:13.113437+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:58.828665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.125783+0000","last_change":"2023-10-09T06:22:12.109873+0000","last_active":"2023-10-09T06:22:13.125783+0000","last_peered":"2023-10-09T06:22:13.125783+0000","last_clean":"2023-10-09T06:22:13.125783+0000","last_became_active":"2023-10-09T06:22:12.109627+0000","last_became_peered":"2023-10-09T06:22:12.109627+0000","last_unstale":"2023-10-09T06:22:13.125783+0000","last_undegraded":"2023-10-09T06:22:13.125783+0000","last_fullsized":"2023-10-09T06:22:13.125783+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:02.717889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.111167+0000","last_change":"2023-10-09T06:22:13.111167+0000","last_active":"2023-10-09T06:22:13.111167+0000","last_peered":"2023-10-09T06:22:13.111167+0000","last_clean":"2023-10-09T06:22:13.111167+0000","last_became_active":"2023-10-09T06:22:13.110946+0000","last_became_peered":"2023-10-09T06:22:13.110946+0000","last_unstale":"2023-10-09T06:22:13.111167+0000","last_undegraded":"2023-10-09T06:22:13.111167+0000","last_fullsized":"2023-10-09T06:22:13.111167+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:36.794911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.115482+0000","last_change":"2023-10-09T06:22:12.115345+0000","last_active":"2023-10-09T06:22:12.115482+0000","last_peered":"2023-10-09T06:22:12.115482+0000","last_clean":"2023-10-09T06:22:12.115482+0000","last_became_active":"2023-10-09T06:22:12.115096+0000","last_became_peered":"2023-10-09T06:22:12.115096+0000","last_unstale":"2023-10-09T06:22:12.115482+0000","last_undegraded":"2023-10-09T06:22:12.115482+0000","last_fullsized":"2023-10-09T06:22:12.115482+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:04:46.573020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115597+0000","last_change":"2023-10-09T06:22:13.115597+0000","last_active":"2023-10-09T06:22:13.115597+0000","last_peered":"2023-10-09T06:22:13.115597+0000","last_clean":"2023-10-09T06:22:13.115597+0000","last_became_active":"2023-10-09T06:22:13.115230+0000","last_became_peered":"2023-10-09T06:22:13.115230+0000","last_unstale":"2023-10-09T06:22:13.115597+0000","last_undegraded":"2023-10-09T06:22:13.115597+0000","last_fullsized":"2023-10-09T06:22:13.115597+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:23.067590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.109882+0000","last_change":"2023-10-09T06:22:12.109218+0000","last_active":"2023-10-09T06:22:12.109882+0000","last_peered":"2023-10-09T06:22:12.109882+0000","last_clean":"2023-10-09T06:22:12.109882+0000","last_became_active":"2023-10-09T06:22:12.108851+0000","last_became_peered":"2023-10-09T06:22:12.108851+0000","last_unstale":"2023-10-09T06:22:12.109882+0000","last_undegraded":"2023-10-09T06:22:12.109882+0000","last_fullsized":"2023-10-09T06:22:12.109882+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:16.607426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.113278+0000","last_change":"2023-10-09T06:22:13.113278+0000","last_active":"2023-10-09T06:22:13.113278+0000","last_peered":"2023-10-09T06:22:13.113278+0000","last_clean":"2023-10-09T06:22:13.113278+0000","last_became_active":"2023-10-09T06:22:13.111885+0000","last_became_peered":"2023-10-09T06:22:13.111885+0000","last_unstale":"2023-10-09T06:22:13.113278+0000","last_undegraded":"2023-10-09T06:22:13.113278+0000","last_fullsized":"2023-10-09T06:22:13.113278+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:03.724332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.110070+0000","last_change":"2023-10-09T06:22:12.109993+0000","last_active":"2023-10-09T06:22:12.110070+0000","last_peered":"2023-10-09T06:22:12.110070+0000","last_clean":"2023-10-09T06:22:12.110070+0000","last_became_active":"2023-10-09T06:22:12.109616+0000","last_became_peered":"2023-10-09T06:22:12.109616+0000","last_unstale":"2023-10-09T06:22:12.110070+0000","last_undegraded":"2023-10-09T06:22:12.110070+0000","last_fullsized":"2023-10-09T06:22:12.110070+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:38.045408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112698+0000","last_change":"2023-10-09T06:22:13.112698+0000","last_active":"2023-10-09T06:22:13.112698+0000","last_peered":"2023-10-09T06:22:13.112698+0000","last_clean":"2023-10-09T06:22:13.112698+0000","last_became_active":"2023-10-09T06:22:13.112345+0000","last_became_peered":"2023-10-09T06:22:13.112345+0000","last_unstale":"2023-10-09T06:22:13.112698+0000","last_undegraded":"2023-10-09T06:22:13.112698+0000","last_fullsized":"2023-10-09T06:22:13.112698+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:49:54.113118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.113324+0000","last_change":"2023-10-09T06:22:12.113220+0000","last_active":"2023-10-09T06:22:12.113324+0000","last_peered":"2023-10-09T06:22:12.113324+0000","last_clean":"2023-10-09T06:22:12.113324+0000","last_became_active":"2023-10-09T06:22:12.112904+0000","last_became_peered":"2023-10-09T06:22:12.112904+0000","last_unstale":"2023-10-09T06:22:12.113324+0000","last_undegraded":"2023-10-09T06:22:12.113324+0000","last_fullsized":"2023-10-09T06:22:12.113324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:25.795796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115767+0000","last_change":"2023-10-09T06:22:13.115767+0000","last_active":"2023-10-09T06:22:13.115767+0000","last_peered":"2023-10-09T06:22:13.115767+0000","last_clean":"2023-10-09T06:22:13.115767+0000","last_became_active":"2023-10-09T06:22:13.113490+0000","last_became_peered":"2023-10-09T06:22:13.113490+0000","last_unstale":"2023-10-09T06:22:13.115767+0000","last_undegraded":"2023-10-09T06:22:13.115767+0000","last_fullsized":"2023-10-09T06:22:13.115767+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:03.091044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.112932+0000","last_change":"2023-10-09T06:22:12.112763+0000","last_active":"2023-10-09T06:22:12.112932+0000","last_peered":"2023-10-09T06:22:12.112932+0000","last_clean":"2023-10-09T06:22:12.112932+0000","last_became_active":"2023-10-09T06:22:12.112521+0000","last_became_peered":"2023-10-09T06:22:12.112521+0000","last_unstale":"2023-10-09T06:22:12.112932+0000","last_undegraded":"2023-10-09T06:22:12.112932+0000","last_fullsized":"2023-10-09T06:22:12.112932+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:35.788468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.112771+0000","last_change":"2023-10-09T06:22:13.112771+0000","last_active":"2023-10-09T06:22:13.112771+0000","last_peered":"2023-10-09T06:22:13.112771+0000","last_clean":"2023-10-09T06:22:13.112771+0000","last_became_active":"2023-10-09T06:22:13.112395+0000","last_became_peered":"2023-10-09T06:22:13.112395+0000","last_unstale":"2023-10-09T06:22:13.112771+0000","last_undegraded":"2023-10-09T06:22:13.112771+0000","last_fullsized":"2023-10-09T06:22:13.112771+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:01.494393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.115069+0000","last_change":"2023-10-09T06:22:12.115009+0000","last_active":"2023-10-09T06:22:12.115069+0000","last_peered":"2023-10-09T06:22:12.115069+0000","last_clean":"2023-10-09T06:22:12.115069+0000","last_became_active":"2023-10-09T06:22:12.114456+0000","last_became_peered":"2023-10-09T06:22:12.114456+0000","last_unstale":"2023-10-09T06:22:12.115069+0000","last_undegraded":"2023-10-09T06:22:12.115069+0000","last_fullsized":"2023-10-09T06:22:12.115069+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:57.709986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.109721+0000","last_change":"2023-10-09T06:22:13.109721+0000","last_active":"2023-10-09T06:22:13.109721+0000","last_peered":"2023-10-09T06:22:13.109721+0000","last_clean":"2023-10-09T06:22:13.109721+0000","last_became_active":"2023-10-09T06:22:13.109496+0000","last_became_peered":"2023-10-09T06:22:13.109496+0000","last_unstale":"2023-10-09T06:22:13.109721+0000","last_undegraded":"2023-10-09T06:22:13.109721+0000","last_fullsized":"2023-10-09T06:22:13.109721+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:30:13.644885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.114512+0000","last_change":"2023-10-09T06:22:12.114295+0000","last_active":"2023-10-09T06:22:12.114512+0000","last_peered":"2023-10-09T06:22:12.114512+0000","last_clean":"2023-10-09T06:22:12.114512+0000","last_became_active":"2023-10-09T06:22:12.113179+0000","last_became_peered":"2023-10-09T06:22:12.113179+0000","last_unstale":"2023-10-09T06:22:12.114512+0000","last_undegraded":"2023-10-09T06:22:12.114512+0000","last_fullsized":"2023-10-09T06:22:12.114512+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:59.265062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.115589+0000","last_change":"2023-10-09T06:22:13.115589+0000","last_active":"2023-10-09T06:22:13.115589+0000","last_peered":"2023-10-09T06:22:13.115589+0000","last_clean":"2023-10-09T06:22:13.115589+0000","last_became_active":"2023-10-09T06:22:13.114417+0000","last_became_peered":"2023-10-09T06:22:13.114417+0000","last_unstale":"2023-10-09T06:22:13.115589+0000","last_undegraded":"2023-10-09T06:22:13.115589+0000","last_fullsized":"2023-10-09T06:22:13.115589+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:23.346089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.112008+0000","last_change":"2023-10-09T06:22:12.111935+0000","last_active":"2023-10-09T06:22:12.112008+0000","last_peered":"2023-10-09T06:22:12.112008+0000","last_clean":"2023-10-09T06:22:12.112008+0000","last_became_active":"2023-10-09T06:22:12.111460+0000","last_became_peered":"2023-10-09T06:22:12.111460+0000","last_unstale":"2023-10-09T06:22:12.112008+0000","last_undegraded":"2023-10-09T06:22:12.112008+0000","last_fullsized":"2023-10-09T06:22:12.112008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:57.709986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.116138+0000","last_change":"2023-10-09T06:22:13.116138+0000","last_active":"2023-10-09T06:22:13.116138+0000","last_peered":"2023-10-09T06:22:13.116138+0000","last_clean":"2023-10-09T06:22:13.116138+0000","last_became_active":"2023-10-09T06:22:13.115631+0000","last_became_peered":"2023-10-09T06:22:13.115631+0000","last_unstale":"2023-10-09T06:22:13.116138+0000","last_undegraded":"2023-10-09T06:22:13.116138+0000","last_fullsized":"2023-10-09T06:22:13.116138+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:01.494393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.110795+0000","last_change":"2023-10-09T06:22:12.110727+0000","last_active":"2023-10-09T06:22:12.110795+0000","last_peered":"2023-10-09T06:22:12.110795+0000","last_clean":"2023-10-09T06:22:12.110795+0000","last_became_active":"2023-10-09T06:22:12.110511+0000","last_became_peered":"2023-10-09T06:22:12.110511+0000","last_unstale":"2023-10-09T06:22:12.110795+0000","last_undegraded":"2023-10-09T06:22:12.110795+0000","last_fullsized":"2023-10-09T06:22:12.110795+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:42.731798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.118177+0000","last_change":"2023-10-09T06:22:13.118177+0000","last_active":"2023-10-09T06:22:13.118177+0000","last_peered":"2023-10-09T06:22:13.118177+0000","last_clean":"2023-10-09T06:22:13.118177+0000","last_became_active":"2023-10-09T06:22:13.117345+0000","last_became_peered":"2023-10-09T06:22:13.117345+0000","last_unstale":"2023-10-09T06:22:13.118177+0000","last_undegraded":"2023-10-09T06:22:13.118177+0000","last_fullsized":"2023-10-09T06:22:13.118177+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:44:00.271505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.112107+0000","last_change":"2023-10-09T06:22:12.111960+0000","last_active":"2023-10-09T06:22:12.112107+0000","last_peered":"2023-10-09T06:22:12.112107+0000","last_clean":"2023-10-09T06:22:12.112107+0000","last_became_active":"2023-10-09T06:22:12.111559+0000","last_became_peered":"2023-10-09T06:22:12.111559+0000","last_unstale":"2023-10-09T06:22:12.112107+0000","last_undegraded":"2023-10-09T06:22:12.112107+0000","last_fullsized":"2023-10-09T06:22:12.112107+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:22.061147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.109100+0000","last_change":"2023-10-09T06:22:13.109100+0000","last_active":"2023-10-09T06:22:13.109100+0000","last_peered":"2023-10-09T06:22:13.109100+0000","last_clean":"2023-10-09T06:22:13.109100+0000","last_became_active":"2023-10-09T06:22:13.108572+0000","last_became_peered":"2023-10-09T06:22:13.108572+0000","last_unstale":"2023-10-09T06:22:13.109100+0000","last_undegraded":"2023-10-09T06:22:13.109100+0000","last_fullsized":"2023-10-09T06:22:13.109100+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:12.096906+0000","last_clean_scrub_stamp":"2023-10-09T06:22:12.096906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:44:00.271505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-09T06:22:13.125511+0000","last_change":"2023-10-09T06:22:12.110984+0000","last_active":"2023-10-09T06:22:13.125511+0000","last_peered":"2023-10-09T06:22:13.125511+0000","last_clean":"2023-10-09T06:22:13.125511+0000","last_became_active":"2023-10-09T06:22:12.110752+0000","last_became_peered":"2023-10-09T06:22:12.110752+0000","last_unstale":"2023-10-09T06:22:13.125511+0000","last_undegraded":"2023-10-09T06:22:13.125511+0000","last_fullsized":"2023-10-09T06:22:13.125511+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:22:11.090464+0000","last_clean_scrub_stamp":"2023-10-09T06:22:11.090464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:29:59.470014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":181,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T06:22:12.106987+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:22:12.106987+0000","last_peered":"2023-10-09T06:22:12.106987+0000","last_clean":"2023-10-09T06:22:12.106987+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:22:12.106987+0000","last_undegraded":"2023-10-09T06:22:12.106987+0000","last_fullsized":"2023-10-09T06:22:12.106987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":779,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194533,"statfs":{"total":200000000,"available":199202119,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.53000000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.69399999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.38100000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41199999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.442}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195109,"statfs":{"total":200000000,"available":199791933,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.0960000000000001,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.53300000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.50900000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":7.1299999999999999,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.502}]},{"osd":4,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.443}]},{"osd":5,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.52500000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":195,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799340,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.314},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.53100000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.5270000000000001,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.40600000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.502}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.64000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":779,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194533,"statfs":{"total":200000000,"available":199202175,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.223},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.32300000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":12.929,"5min":12.929,"15min":12.929},"last":0.312},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.28299999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.379},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.33800000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.61799999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.629}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.60999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":195,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799340,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.981999999999999,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":9.1600000000000001,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":8.4930000000000003,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":9.0239999999999991,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.318}]},{"osd":3,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":8.5190000000000001,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":15.007999999999999,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.34499999999999997}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":14.917999999999999,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.52200000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":8.9610000000000003,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.3919999999999995,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.42999999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.498},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.50800000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":8.9160000000000004,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":8.4640000000000004,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.45100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195109,"statfs":{"total":200000000,"available":199791967,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.36499999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.30399999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.38700000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.499},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.39300000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41199999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.504}]},{"osd":7,"last update":"Mon Oct 9 06:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.438},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":195,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799340,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.3250000000000002,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":11.715,"5min":11.715,"15min":11.715},"last":0.60199999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.622},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.85599999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.56799999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.88600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":195,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799340,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.497}]},{"osd":2,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55300000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57599999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.39200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51400000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.40400000000000003}]}]}],"pool_statfs":[]}} 2023-10-09T06:22:17.620 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:22:17.620 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:22:17.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.780+0000 7f673cc92700 1 Processor -- start 2023-10-09T06:22:17.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.780+0000 7f673cc92700 1 -- start start 2023-10-09T06:22:17.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.781+0000 7f673cc92700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6738159ec0 0x7f67380af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.781+0000 7f673cc92700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f673815a290 0x7f67380afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.781+0000 7f673cc92700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67380b0790 con 0x7f673806a5a0 2023-10-09T06:22:17.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.781+0000 7f673cc92700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67380ce1f0 con 0x7f6738159ec0 2023-10-09T06:22:17.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.781+0000 7f673cc92700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67380b0b20 con 0x7f673815a290 2023-10-09T06:22:17.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.781+0000 7f673659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6738159ec0 0x7f67380af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.781+0000 7f673659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6738159ec0 0x7f67380af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35832/0 (socket says 172.21.15.31:35832) 2023-10-09T06:22:17.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.781+0000 7f673659c700 1 -- 172.21.15.31:0/4122950243 learned_addr learned my addr 172.21.15.31:0/4122950243 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:17.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.781+0000 7f6735d9b700 1 --2- 172.21.15.31:0/4122950243 >> v2:172.21.15.158:3300/0 conn(0x7f673815a290 0x7f67380afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.782+0000 7f673659c700 1 -- 172.21.15.31:0/4122950243 >> v2:172.21.15.158:3300/0 conn(0x7f673815a290 msgr2=0x7f67380afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:17.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.782+0000 7f673659c700 1 --2- 172.21.15.31:0/4122950243 >> v2:172.21.15.158:3300/0 conn(0x7f673815a290 0x7f67380afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.782+0000 7f673659c700 1 -- 172.21.15.31:0/4122950243 >> v1:172.21.15.158:6789/0 conn(0x7f673806a5a0 legacy=0x7f673815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.782+0000 7f673659c700 1 -- 172.21.15.31:0/4122950243 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67380b04b0 con 0x7f6738159ec0 2023-10-09T06:22:17.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.782+0000 7f673659c700 1 --2- 172.21.15.31:0/4122950243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6738159ec0 0x7f67380af940 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6738089910 tx=0x7f6728009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbdeb2a1c409240 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:17.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.782+0000 7f673559a700 1 -- 172.21.15.31:0/4122950243 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672800b860 con 0x7f6738159ec0 2023-10-09T06:22:17.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.782+0000 7f673559a700 1 -- 172.21.15.31:0/4122950243 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672800b9c0 con 0x7f6738159ec0 2023-10-09T06:22:17.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.782+0000 7f673559a700 1 -- 172.21.15.31:0/4122950243 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672800bd60 con 0x7f6738159ec0 2023-10-09T06:22:17.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.782+0000 7f673cc92700 1 -- 172.21.15.31:0/4122950243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6738159ec0 msgr2=0x7f67380af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.782+0000 7f673cc92700 1 --2- 172.21.15.31:0/4122950243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6738159ec0 0x7f67380af940 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6738089910 tx=0x7f6728009250 comp rx=0 tx=0).stop 2023-10-09T06:22:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.783+0000 7f673cc92700 1 -- 172.21.15.31:0/4122950243 shutdown_connections 2023-10-09T06:22:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.783+0000 7f673cc92700 1 --2- 172.21.15.31:0/4122950243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6738159ec0 0x7f67380af940 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.783+0000 7f673cc92700 1 --2- 172.21.15.31:0/4122950243 >> v2:172.21.15.158:3300/0 conn(0x7f673815a290 0x7f67380afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.783+0000 7f673cc92700 1 -- 172.21.15.31:0/4122950243 >> 172.21.15.31:0/4122950243 conn(0x7f67380d1880 msgr2=0x7f67380cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.783+0000 7f673cc92700 1 -- 172.21.15.31:0/4122950243 shutdown_connections 2023-10-09T06:22:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.783+0000 7f673cc92700 1 -- 172.21.15.31:0/4122950243 wait complete. 2023-10-09T06:22:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.784+0000 7f673cc92700 1 Processor -- start 2023-10-09T06:22:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.784+0000 7f673cc92700 1 -- start start 2023-10-09T06:22:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.784+0000 7f673cc92700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f673806a5a0 0x7f673815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.784+0000 7f673cc92700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6738159ec0 0x7f67380cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.784+0000 7f673cc92700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f673815a290 0x7f6738153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.784+0000 7f673cc92700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673815b890 con 0x7f673806a5a0 2023-10-09T06:22:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.784+0000 7f673cc92700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67380cbf10 con 0x7f6738159ec0 2023-10-09T06:22:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.784+0000 7f673cc92700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673815ac80 con 0x7f673815a290 2023-10-09T06:22:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f673659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f673806a5a0 0x7f673815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f673659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f673806a5a0 0x7f673815a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35834/0 (socket says 172.21.15.31:35834) 2023-10-09T06:22:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f673659c700 1 -- 172.21.15.31:0/3723058585 learned_addr learned my addr 172.21.15.31:0/3723058585 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f6735d9b700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6738159ec0 0x7f67380cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f6736d9d700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f673815a290 0x7f6738153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f673659c700 1 -- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f673815a290 msgr2=0x7f6738153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f673659c700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f673815a290 0x7f6738153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f673659c700 1 -- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6738159ec0 msgr2=0x7f67380cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:17.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f673659c700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6738159ec0 0x7f67380cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:17.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f673659c700 1 -- 172.21.15.31:0/3723058585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67280094f0 con 0x7f673806a5a0 2023-10-09T06:22:17.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f673659c700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f673806a5a0 0x7f673815a680 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6738071eb0 tx=0x7f6728017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:17.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f672e7fc700 1 -- 172.21.15.31:0/3723058585 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728024440 con 0x7f673806a5a0 2023-10-09T06:22:17.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f672e7fc700 1 -- 172.21.15.31:0/3723058585 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67280245a0 con 0x7f673806a5a0 2023-10-09T06:22:17.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f673cc92700 1 -- 172.21.15.31:0/3723058585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673815af60 con 0x7f673806a5a0 2023-10-09T06:22:17.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f672e7fc700 1 -- 172.21.15.31:0/3723058585 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728024960 con 0x7f673806a5a0 2023-10-09T06:22:17.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.785+0000 7f673cc92700 1 -- 172.21.15.31:0/3723058585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673815b520 con 0x7f673806a5a0 2023-10-09T06:22:17.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.786+0000 7f673cc92700 1 -- 172.21.15.31:0/3723058585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6738071b90 con 0x7f673806a5a0 2023-10-09T06:22:17.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.787+0000 7f672e7fc700 1 -- 172.21.15.31:0/3723058585 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f672801a420 con 0x7f673806a5a0 2023-10-09T06:22:17.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.787+0000 7f672e7fc700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6718066f30 0x7f67180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:17.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.787+0000 7f672e7fc700 1 -- 172.21.15.31:0/3723058585 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6728086390 con 0x7f673806a5a0 2023-10-09T06:22:17.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.787+0000 7f6735d9b700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6718066f30 0x7f67180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:17.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.788+0000 7f6735d9b700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6718066f30 0x7f67180693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f67380cc540 tx=0x7f6720008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:17.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:17.791+0000 7f672e7fc700 1 -- 172.21.15.31:0/3723058585 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6738071b90 con 0x7f673806a5a0 2023-10-09T06:22:18.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.066+0000 7f673cc92700 1 -- 172.21.15.31:0/3723058585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6738071b90 con 0x7f673806a5a0 2023-10-09T06:22:18.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.069+0000 7f672e7fc700 1 -- 172.21.15.31:0/3723058585 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6738071b90 con 0x7f673806a5a0 2023-10-09T06:22:18.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.071+0000 7f673cc92700 1 -- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6718066f30 msgr2=0x7f67180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:18.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.071+0000 7f673cc92700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6718066f30 0x7f67180693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f67380cc540 tx=0x7f6720008040 comp rx=0 tx=0).stop 2023-10-09T06:22:18.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.071+0000 7f673cc92700 1 -- 172.21.15.31:0/3723058585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f673806a5a0 msgr2=0x7f673815a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:18.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.071+0000 7f673cc92700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f673806a5a0 0x7f673815a680 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6738071eb0 tx=0x7f6728017000 comp rx=0 tx=0).stop 2023-10-09T06:22:18.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.072+0000 7f673cc92700 1 -- 172.21.15.31:0/3723058585 shutdown_connections 2023-10-09T06:22:18.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.072+0000 7f673cc92700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6718066f30 0x7f67180693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.072+0000 7f673cc92700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f673815a290 0x7f6738153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.072+0000 7f673cc92700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f673806a5a0 0x7f673815a680 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.072+0000 7f673cc92700 1 --2- 172.21.15.31:0/3723058585 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6738159ec0 0x7f67380cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.072+0000 7f673cc92700 1 -- 172.21.15.31:0/3723058585 >> 172.21.15.31:0/3723058585 conn(0x7f67380d1880 msgr2=0x7f67380b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:18.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.072+0000 7f673cc92700 1 -- 172.21.15.31:0/3723058585 shutdown_connections 2023-10-09T06:22:18.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.072+0000 7f673cc92700 1 -- 172.21.15.31:0/3723058585 wait complete. 2023-10-09T06:22:18.073 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2023-10-09T06:22:18.084 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:22:18.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.205+0000 7f1dd9b94700 1 Processor -- start 2023-10-09T06:22:18.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.205+0000 7f1dd9b94700 1 -- start start 2023-10-09T06:22:18.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.206+0000 7f1dd9b94700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1dd4157870 0x7f1dd415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:18.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.206+0000 7f1dd9b94700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1dd4157c40 0x7f1dd4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:18.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.206+0000 7f1dd9b94700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd415cbb0 con 0x7f1dd415a620 2023-10-09T06:22:18.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.206+0000 7f1dd9b94700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd415bfa0 con 0x7f1dd4157c40 2023-10-09T06:22:18.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.206+0000 7f1dd9b94700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd415c280 con 0x7f1dd4157870 2023-10-09T06:22:18.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.206+0000 7f1dd3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1dd4157c40 0x7f1dd4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:18.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.206+0000 7f1dd2ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1dd415a620 0x7f1dd415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53480/0 (socket says 172.21.15.31:53480) 2023-10-09T06:22:18.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.206+0000 7f1dd2ffd700 1 -- 172.21.15.31:0/3022940383 learned_addr learned my addr 172.21.15.31:0/3022940383 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:18.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.206+0000 7f1dd3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1dd4157c40 0x7f1dd4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35840/0 (socket says 172.21.15.31:35840) 2023-10-09T06:22:18.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd37fe700 1 --2- 172.21.15.31:0/3022940383 >> v2:172.21.15.158:3300/0 conn(0x7f1dd4157870 0x7f1dd415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:18.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd3fff700 1 -- 172.21.15.31:0/3022940383 >> v2:172.21.15.158:3300/0 conn(0x7f1dd4157870 msgr2=0x7f1dd415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:18.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd3fff700 1 --2- 172.21.15.31:0/3022940383 >> v2:172.21.15.158:3300/0 conn(0x7f1dd4157870 0x7f1dd415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd3fff700 1 -- 172.21.15.31:0/3022940383 >> v1:172.21.15.31:6789/0 conn(0x7f1dd415a620 legacy=0x7f1dd415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:18.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd27fc700 1 -- 172.21.15.31:0/3022940383 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487460476 0 0) 0x7f1dd415cbb0 con 0x7f1dd415a620 2023-10-09T06:22:18.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd3fff700 1 -- 172.21.15.31:0/3022940383 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd415c560 con 0x7f1dd4157c40 2023-10-09T06:22:18.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd3fff700 1 --2- 172.21.15.31:0/3022940383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd4157c40 0x7f1dd4158110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4069d80 tx=0x7f1dcc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f1c11375b29ca7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:18.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd27fc700 1 -- 172.21.15.31:0/3022940383 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc00e070 con 0x7f1dd4157c40 2023-10-09T06:22:18.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd27fc700 1 -- 172.21.15.31:0/3022940383 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc00bc30 con 0x7f1dd4157c40 2023-10-09T06:22:18.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd27fc700 1 -- 172.21.15.31:0/3022940383 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc012430 con 0x7f1dd4157c40 2023-10-09T06:22:18.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd9b94700 1 -- 172.21.15.31:0/3022940383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd4157c40 msgr2=0x7f1dd4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:18.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd9b94700 1 --2- 172.21.15.31:0/3022940383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd4157c40 0x7f1dd4158110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4069d80 tx=0x7f1dcc009780 comp rx=0 tx=0).stop 2023-10-09T06:22:18.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd9b94700 1 -- 172.21.15.31:0/3022940383 shutdown_connections 2023-10-09T06:22:18.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd9b94700 1 --2- 172.21.15.31:0/3022940383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd4157c40 0x7f1dd4158110 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd9b94700 1 --2- 172.21.15.31:0/3022940383 >> v2:172.21.15.158:3300/0 conn(0x7f1dd4157870 0x7f1dd415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd9b94700 1 -- 172.21.15.31:0/3022940383 >> 172.21.15.31:0/3022940383 conn(0x7f1dd4068ce0 msgr2=0x7f1dd40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:18.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.207+0000 7f1dd9b94700 1 -- 172.21.15.31:0/3022940383 shutdown_connections 2023-10-09T06:22:18.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.208+0000 7f1dd9b94700 1 -- 172.21.15.31:0/3022940383 wait complete. 2023-10-09T06:22:18.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.209+0000 7f1dd9b94700 1 Processor -- start 2023-10-09T06:22:18.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.209+0000 7f1dd9b94700 1 -- start start 2023-10-09T06:22:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.209+0000 7f1dd9b94700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1dd4157870 0x7f1dd414c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.209+0000 7f1dd9b94700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd4157c40 0x7f1dd41522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.209+0000 7f1dd9b94700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1dd415a620 0x7f1dd4153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.209+0000 7f1dd9b94700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd40b19c0 con 0x7f1dd4157c40 2023-10-09T06:22:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.209+0000 7f1dd9b94700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd4151e40 con 0x7f1dd4157870 2023-10-09T06:22:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.209+0000 7f1dd9b94700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd4151230 con 0x7f1dd415a620 2023-10-09T06:22:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dd2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd4157c40 0x7f1dd41522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dd2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd4157c40 0x7f1dd41522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35846/0 (socket says 172.21.15.31:35846) 2023-10-09T06:22:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dd2ffd700 1 -- 172.21.15.31:0/2208149133 learned_addr learned my addr 172.21.15.31:0/2208149133 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dd37fe700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1dd4157870 0x7f1dd414c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dd3fff700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1dd415a620 0x7f1dd4153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:18.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dd2ffd700 1 -- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1dd415a620 msgr2=0x7f1dd4153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:18.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dd2ffd700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1dd415a620 0x7f1dd4153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dd2ffd700 1 -- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1dd4157870 msgr2=0x7f1dd414c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:18.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dd2ffd700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1dd4157870 0x7f1dd414c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dd2ffd700 1 -- 172.21.15.31:0/2208149133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc009a20 con 0x7f1dd4157c40 2023-10-09T06:22:18.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dd2ffd700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd4157c40 0x7f1dd41522d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800c5e0 tx=0x7f1dc8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:18.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dbb7fe700 1 -- 172.21.15.31:0/2208149133 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8005b30 con 0x7f1dd4157c40 2023-10-09T06:22:18.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dbb7fe700 1 -- 172.21.15.31:0/2208149133 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc8005c90 con 0x7f1dd4157c40 2023-10-09T06:22:18.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dd9b94700 1 -- 172.21.15.31:0/2208149133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd4151510 con 0x7f1dd4157c40 2023-10-09T06:22:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dbb7fe700 1 -- 172.21.15.31:0/2208149133 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8007300 con 0x7f1dd4157c40 2023-10-09T06:22:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.210+0000 7f1dd9b94700 1 -- 172.21.15.31:0/2208149133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd4151ad0 con 0x7f1dd4157c40 2023-10-09T06:22:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.211+0000 7f1dd9b94700 1 -- 172.21.15.31:0/2208149133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd4151fb0 con 0x7f1dd4157c40 2023-10-09T06:22:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.212+0000 7f1dbb7fe700 1 -- 172.21.15.31:0/2208149133 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1dc8007670 con 0x7f1dd4157c40 2023-10-09T06:22:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.212+0000 7f1dbb7fe700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1dc0066f30 0x7f1dc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.212+0000 7f1dbb7fe700 1 -- 172.21.15.31:0/2208149133 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1dc8083a60 con 0x7f1dd4157c40 2023-10-09T06:22:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.212+0000 7f1dd37fe700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1dc0066f30 0x7f1dc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.213+0000 7f1dd37fe700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1dc0066f30 0x7f1dc00693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40089b0 tx=0x7f1dc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.216+0000 7f1dbb7fe700 1 -- 172.21.15.31:0/2208149133 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1dc8050cd0 con 0x7f1dd4157c40 2023-10-09T06:22:18.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.453+0000 7f1dd9b94700 1 -- 172.21.15.31:0/2208149133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dd414cf90 con 0x7f1dd4157c40 2023-10-09T06:22:18.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.454+0000 7f1dbb7fe700 1 -- 172.21.15.31:0/2208149133 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f1dc8017020 con 0x7f1dd4157c40 2023-10-09T06:22:18.453 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:18.454 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2970905850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2970905850},{"type":"v1","addr":"172.21.15.158:6837","nonce":2970905850}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5119,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1945558670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1945558670},{"type":"v1","addr":"172.21.15.31:6835","nonce":1945558670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3853703125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3853703125},{"type":"v1","addr":"172.21.15.31:6834","nonce":3853703125}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:22:12.504027+0000","modified":"2023-10-09T06:22:16.130642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/1366477380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1366477380},{"type":"v1","addr":"172.21.15.158:6836","nonce":1366477380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:22:18.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.455+0000 7f1dd9b94700 1 -- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1dc0066f30 msgr2=0x7f1dc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:18.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.455+0000 7f1dd9b94700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1dc0066f30 0x7f1dc00693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40089b0 tx=0x7f1dc4008040 comp rx=0 tx=0).stop 2023-10-09T06:22:18.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.455+0000 7f1dd9b94700 1 -- 172.21.15.31:0/2208149133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd4157c40 msgr2=0x7f1dd41522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:18.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.455+0000 7f1dd9b94700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd4157c40 0x7f1dd41522d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800c5e0 tx=0x7f1dc8000fe0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.456+0000 7f1dd9b94700 1 -- 172.21.15.31:0/2208149133 shutdown_connections 2023-10-09T06:22:18.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.456+0000 7f1dd9b94700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1dc0066f30 0x7f1dc00693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.456+0000 7f1dd9b94700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1dd415a620 0x7f1dd4153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.456+0000 7f1dd9b94700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1dd4157870 0x7f1dd414c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.456+0000 7f1dd9b94700 1 --2- 172.21.15.31:0/2208149133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd4157c40 0x7f1dd41522d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:18.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.456+0000 7f1dd9b94700 1 -- 172.21.15.31:0/2208149133 >> 172.21.15.31:0/2208149133 conn(0x7f1dd4068ce0 msgr2=0x7f1dd40b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:18.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.456+0000 7f1dd9b94700 1 -- 172.21.15.31:0/2208149133 shutdown_connections 2023-10-09T06:22:18.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.456+0000 7f1dd9b94700 1 -- 172.21.15.31:0/2208149133 wait complete. 2023-10-09T06:22:18.457 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 25 2023-10-09T06:22:18.872 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:22:12.504027+0000', 'modified': '2023-10-09T06:22:16.130642+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5307}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5307': {'gid': 5307, 'name': 'b', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.158:6836/1366477380', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6834', 'nonce': 1366477380}, {'type': 'v1', 'addr': '172.21.15.158:6836', 'nonce': 1366477380}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:22:18.872 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:22:18.872 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-09T06:22:18.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.994+0000 7f3fa58ca700 1 Processor -- start 2023-10-09T06:22:18.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.994+0000 7f3fa58ca700 1 -- start start 2023-10-09T06:22:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.995+0000 7f3fa58ca700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa0159da0 0x7f3fa00b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.995+0000 7f3fa58ca700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3fa015a170 0x7f3fa0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.995+0000 7f3fa58ca700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa015ea70 con 0x7f3fa0069040 2023-10-09T06:22:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.995+0000 7f3fa58ca700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa00694e0 con 0x7f3fa015a170 2023-10-09T06:22:19.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.995+0000 7f3fa58ca700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00b3990 con 0x7f3fa0159da0 2023-10-09T06:22:19.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.995+0000 7f3fa50c9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3fa0069040 0x7f3fa00af4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53494/0 (socket says 172.21.15.31:53494) 2023-10-09T06:22:19.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.995+0000 7f3fa50c9700 1 -- 172.21.15.31:0/2144552614 learned_addr learned my addr 172.21.15.31:0/2144552614 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:19.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.995+0000 7f3f9ffff700 1 --2- 172.21.15.31:0/2144552614 >> v2:172.21.15.158:3300/0 conn(0x7f3fa015a170 0x7f3fa0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.995+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/2144552614 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa0159da0 0x7f3fa00b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.995+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916680781 0 0) 0x7f3fa015ea70 con 0x7f3fa0069040 2023-10-09T06:22:19.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.995+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f8c003570 con 0x7f3fa0069040 2023-10-09T06:22:19.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 102162557 0 0) 0x7f3f8c003570 con 0x7f3fa0069040 2023-10-09T06:22:19.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa0159da0 msgr2=0x7f3fa00b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 --2- 172.21.15.31:0/2144552614 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa0159da0 0x7f3fa00b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 >> v2:172.21.15.158:3300/0 conn(0x7f3fa015a170 msgr2=0x7f3fa0068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 --2- 172.21.15.31:0/2144552614 >> v2:172.21.15.158:3300/0 conn(0x7f3fa015a170 0x7f3fa0068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa00b0b70 con 0x7f3fa0069040 2023-10-09T06:22:19.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f3f98001470 con 0x7f3fa0069040 2023-10-09T06:22:19.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9ffff700 1 --2- 172.21.15.31:0/2144552614 >> v2:172.21.15.158:3300/0 conn(0x7f3fa015a170 0x7f3fa0068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:22:19.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 >> v1:172.21.15.31:6789/0 conn(0x7f3fa0069040 legacy=0x7f3fa00af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 --2- 172.21.15.31:0/2144552614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f8c003a60 0x7f3f8c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 --2- 172.21.15.31:0/2144552614 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f8c004810 0x7f3f8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 --2- 172.21.15.31:0/2144552614 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa0159da0 0x7f3f8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00694e0 con 0x7f3f8c003a60 2023-10-09T06:22:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00b3990 con 0x7f3f8c004810 2023-10-09T06:22:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c00bae0 con 0x7f3fa0159da0 2023-10-09T06:22:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/2144552614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f8c003a60 0x7f3f8c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3f9ffff700 1 --2- 172.21.15.31:0/2144552614 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f8c004810 0x7f3f8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3fa50c9700 1 --2- 172.21.15.31:0/2144552614 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa0159da0 0x7f3f8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3fa48c8700 1 -- 172.21.15.31:0/2144552614 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa0159da0 msgr2=0x7f3f8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/2144552614 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fa0159da0 0x7f3f8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3fa48c8700 1 -- 172.21.15.31:0/2144552614 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f8c004810 msgr2=0x7f3f8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/2144552614 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f8c004810 0x7f3f8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3fa48c8700 1 -- 172.21.15.31:0/2144552614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c003570 con 0x7f3f8c003a60 2023-10-09T06:22:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.996+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/2144552614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f8c003a60 0x7f3f8c003e70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000e210 tx=0x7f3f9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bee527f271b8612 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.997+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000eac0 con 0x7f3f8c003a60 2023-10-09T06:22:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.997+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9000f040 con 0x7f3f8c003a60 2023-10-09T06:22:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.997+0000 7f3f9f7fe700 1 -- 172.21.15.31:0/2144552614 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000ee70 con 0x7f3f8c003a60 2023-10-09T06:22:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.997+0000 7f3fa58ca700 1 -- 172.21.15.31:0/2144552614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f8c003a60 msgr2=0x7f3f8c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.997+0000 7f3fa58ca700 1 --2- 172.21.15.31:0/2144552614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f8c003a60 0x7f3f8c003e70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000e210 tx=0x7f3f9000b040 comp rx=0 tx=0).stop 2023-10-09T06:22:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.997+0000 7f3fa50c9700 1 -- 172.21.15.31:0/2144552614 reap_dead start 2023-10-09T06:22:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.997+0000 7f3fa58ca700 1 -- 172.21.15.31:0/2144552614 shutdown_connections 2023-10-09T06:22:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.997+0000 7f3fa58ca700 1 -- 172.21.15.31:0/2144552614 >> 172.21.15.31:0/2144552614 conn(0x7f3fa00d0bc0 msgr2=0x7f3fa00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.997+0000 7f3fa58ca700 1 -- 172.21.15.31:0/2144552614 shutdown_connections 2023-10-09T06:22:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.997+0000 7f3fa58ca700 1 -- 172.21.15.31:0/2144552614 wait complete. 2023-10-09T06:22:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.998+0000 7f3fa58ca700 1 Processor -- start 2023-10-09T06:22:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.998+0000 7f3fa58ca700 1 -- start start 2023-10-09T06:22:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.999+0000 7f3fa58ca700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3f8c003a60 0x7f3fa015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.999+0000 7f3fa58ca700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fa0158140 0x7f3fa00cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.999+0000 7f3fa58ca700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa00ccd50 0x7f3fa016a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.999+0000 7f3fa58ca700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00a7840 con 0x7f3fa00ccd50 2023-10-09T06:22:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.999+0000 7f3fa58ca700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00cd1d0 con 0x7f3fa0158140 2023-10-09T06:22:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.999+0000 7f3fa58ca700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa015c3e0 con 0x7f3f8c003a60 2023-10-09T06:22:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.999+0000 7f3fa50c9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa00ccd50 0x7f3fa016a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.999+0000 7f3fa50c9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa00ccd50 0x7f3fa016a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35858/0 (socket says 172.21.15.31:35858) 2023-10-09T06:22:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.999+0000 7f3fa50c9700 1 -- 172.21.15.31:0/3289066406 learned_addr learned my addr 172.21.15.31:0/3289066406 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.999+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3f8c003a60 0x7f3fa015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:18.999+0000 7f3f9ffff700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fa0158140 0x7f3fa00cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.000+0000 7f3fa50c9700 1 -- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3f8c003a60 msgr2=0x7f3fa015cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.000+0000 7f3fa50c9700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3f8c003a60 0x7f3fa015cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.000+0000 7f3fa50c9700 1 -- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fa0158140 msgr2=0x7f3fa00cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.000+0000 7f3fa50c9700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fa0158140 0x7f3fa00cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.000+0000 7f3fa50c9700 1 -- 172.21.15.31:0/3289066406 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa016a280 con 0x7f3fa00ccd50 2023-10-09T06:22:19.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.000+0000 7f3fa50c9700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa00ccd50 0x7f3fa016a710 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3fa006b310 tx=0x7f3f98001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:19.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.000+0000 7f3f9cff9700 1 -- 172.21.15.31:0/3289066406 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98007740 con 0x7f3fa00ccd50 2023-10-09T06:22:19.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.000+0000 7f3f9cff9700 1 -- 172.21.15.31:0/3289066406 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9800f8a0 con 0x7f3fa00ccd50 2023-10-09T06:22:19.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.000+0000 7f3fa58ca700 1 -- 172.21.15.31:0/3289066406 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa015d530 con 0x7f3fa00ccd50 2023-10-09T06:22:19.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.000+0000 7f3f9cff9700 1 -- 172.21.15.31:0/3289066406 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9800fc60 con 0x7f3fa00ccd50 2023-10-09T06:22:19.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.000+0000 7f3fa58ca700 1 -- 172.21.15.31:0/3289066406 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa015be20 con 0x7f3fa00ccd50 2023-10-09T06:22:19.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.001+0000 7f3f9cff9700 1 -- 172.21.15.31:0/3289066406 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f9801d3b0 con 0x7f3fa00ccd50 2023-10-09T06:22:19.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.002+0000 7f3f9cff9700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3f80066f30 0x7f3f800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.002+0000 7f3f9cff9700 1 -- 172.21.15.31:0/3289066406 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f98083f10 con 0x7f3fa00ccd50 2023-10-09T06:22:19.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.002+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3f80066f30 0x7f3f800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.002+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3f80066f30 0x7f3f800693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000afd0 tx=0x7f3f9001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:19.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.004+0000 7f3fafe24b80 1 Processor -- start 2023-10-09T06:22:19.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.004+0000 7f3fafe24b80 1 -- start start 2023-10-09T06:22:19.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.004+0000 7f3fafe24b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18528b480 0x55c18526a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.004+0000 7f3fafe24b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 0x55c18528b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.004+0000 7f3fafe24b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c185240b80 0x55c185240ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.004+0000 7f3fafe24b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c185197a70 con 0x55c18523e5f0 2023-10-09T06:22:19.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.004+0000 7f3fafe24b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c185195270 con 0x55c18528b480 2023-10-09T06:22:19.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.004+0000 7f3fafe24b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c185191060 con 0x55c185240b80 2023-10-09T06:22:19.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.004+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 0x55c18528b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.004+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 0x55c18528b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35874/0 (socket says 172.21.15.31:35874) 2023-10-09T06:22:19.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.004+0000 7f3f9ffff700 1 -- 172.21.15.31:0/186807775 learned_addr learned my addr 172.21.15.31:0/186807775 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:19.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.004+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/186807775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18528b480 0x55c18526a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.004+0000 7f3fa50c9700 1 --2- 172.21.15.31:0/186807775 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c185240b80 0x55c185240ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.005+0000 7f3f9ffff700 1 -- 172.21.15.31:0/186807775 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c185240b80 msgr2=0x55c185240ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.005+0000 7f3f9ffff700 1 --2- 172.21.15.31:0/186807775 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c185240b80 0x55c185240ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.005+0000 7f3f9ffff700 1 -- 172.21.15.31:0/186807775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18528b480 msgr2=0x55c18526a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.005+0000 7f3f9ffff700 1 --2- 172.21.15.31:0/186807775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18528b480 0x55c18526a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.005+0000 7f3f9ffff700 1 -- 172.21.15.31:0/186807775 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c18502b270 con 0x55c18523e5f0 2023-10-09T06:22:19.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.005+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/186807775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18528b480 0x55c18526a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:19.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.005+0000 7f3f9ffff700 1 --2- 172.21.15.31:0/186807775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 0x55c18528b850 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009ea0 tx=0x7f3f880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1100761b269247e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:19.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.005+0000 7f3f95ffb700 1 -- 172.21.15.31:0/186807775 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88014c10 con 0x55c18523e5f0 2023-10-09T06:22:19.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.005+0000 7f3f95ffb700 1 -- 172.21.15.31:0/186807775 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f88014d70 con 0x55c18523e5f0 2023-10-09T06:22:19.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.005+0000 7f3f95ffb700 1 -- 172.21.15.31:0/186807775 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88014ee0 con 0x55c18523e5f0 2023-10-09T06:22:19.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.005+0000 7f3fafe24b80 1 -- 172.21.15.31:0/186807775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 msgr2=0x55c18528b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.005+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/186807775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 0x55c18528b850 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009ea0 tx=0x7f3f880091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.006+0000 7f3fafe24b80 1 -- 172.21.15.31:0/186807775 shutdown_connections 2023-10-09T06:22:19.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.006+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/186807775 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c185240b80 0x55c185240ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.006+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/186807775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18528b480 0x55c18526a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.006+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/186807775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 0x55c18528b850 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.006+0000 7f3fafe24b80 1 -- 172.21.15.31:0/186807775 >> 172.21.15.31:0/186807775 conn(0x55c1852420c0 msgr2=0x55c1852428f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:19.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.006+0000 7f3fafe24b80 1 -- 172.21.15.31:0/186807775 shutdown_connections 2023-10-09T06:22:19.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.006+0000 7f3fafe24b80 1 -- 172.21.15.31:0/186807775 wait complete. 2023-10-09T06:22:19.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.006+0000 7f3fafe24b80 1 -- start start 2023-10-09T06:22:19.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.006+0000 7f3fafe24b80 1 Processor -- start 2023-10-09T06:22:19.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.007+0000 7f3fafe24b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c18523e5f0 0x55c185287e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.007+0000 7f3fafe24b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 0x55c185270490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.007+0000 7f3fafe24b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18528b480 0x55c1852709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.007+0000 7f3fafe24b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18513c890 con 0x55c185240b80 2023-10-09T06:22:19.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.007+0000 7f3fafe24b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c185157ea0 con 0x55c18528b480 2023-10-09T06:22:19.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.007+0000 7f3fafe24b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c185013e30 con 0x55c18523e5f0 2023-10-09T06:22:19.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.007+0000 7f3fafe24b80 10 client.0 _ll_register_callbacks cb 0x55c1852042c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:22:19.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.007+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 0x55c185270490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.007+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 0x55c185270490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35882/0 (socket says 172.21.15.31:35882) 2023-10-09T06:22:19.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.007+0000 7f3f9ffff700 1 -- 172.21.15.31:0/2765722733 learned_addr learned my addr 172.21.15.31:0/2765722733 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:19.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.007+0000 7f3fa50c9700 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18528b480 0x55c1852709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.007+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c18523e5f0 0x55c185287e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3f9ffff700 1 -- 172.21.15.31:0/2765722733 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c18523e5f0 msgr2=0x55c185287e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3f9ffff700 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c18523e5f0 0x55c185287e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3f9ffff700 1 -- 172.21.15.31:0/2765722733 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18528b480 msgr2=0x55c1852709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3f9ffff700 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18528b480 0x55c1852709d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3f9ffff700 1 -- 172.21.15.31:0/2765722733 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f88009ba0 con 0x55c185240b80 2023-10-09T06:22:19.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c18523e5f0 0x55c185287e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:19.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3f9ffff700 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 0x55c185270490 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3f880091e0 tx=0x7f3f8801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74db35f3f4387ea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:19.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3f7effd700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:22:19.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3f7effd700 1 -- 172.21.15.31:0/2765722733 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88000c90 con 0x55c185240b80 2023-10-09T06:22:19.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3f7effd700 1 -- 172.21.15.31:0/2765722733 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f880158e0 con 0x55c185240b80 2023-10-09T06:22:19.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3fafe24b80 1 -- 172.21.15.31:0/2765722733 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c185235cd0 con 0x55c185240b80 2023-10-09T06:22:19.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3f7effd700 1 -- 172.21.15.31:0/2765722733 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f88015cf0 con 0x55c185240b80 2023-10-09T06:22:19.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3fafe24b80 10 client.5430 fetch_fsmap learned FSMap version 25 2023-10-09T06:22:19.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3fafe24b80 1 -- 172.21.15.31:0/2765722733 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55c184fcdfe0 con 0x55c185240b80 2023-10-09T06:22:19.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3f7effd700 1 -- 172.21.15.31:0/2765722733 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c185235cd0 con 0x55c185240b80 2023-10-09T06:22:19.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3f7effd700 1 -- 172.21.15.31:0/2765722733 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3f88025040 con 0x55c185240b80 2023-10-09T06:22:19.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3fafe24b80 10 client.5430 fetch_fsmap finished waiting for FSMap version 25 2023-10-09T06:22:19.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3fafe24b80 10 client.5430 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T06:22:19.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3fafe24b80 20 client.5430 populate_metadata read hostname 'smithi031' 2023-10-09T06:22:19.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.158:6834/1366477380,v1:172.21.15.158:6836/1366477380] conn(0x55c18526d4a0 0x55c18526d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3fafe24b80 4 client.5430 mds_command: new command op to 5307 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:22:19.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.008+0000 7f3fafe24b80 1 -- 172.21.15.31:0/2765722733 --> [v2:172.21.15.158:6834/1366477380,v1:172.21.15.158:6836/1366477380] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c185212aa0 con 0x55c18526d4a0 2023-10-09T06:22:19.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.009+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.158:6834/1366477380,v1:172.21.15.158:6836/1366477380] conn(0x55c18526d4a0 0x55c18526d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.009+0000 7f3f7effd700 10 client.5430 ms_handle_connect on v2:172.21.15.158:6834/1366477380 2023-10-09T06:22:19.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.009+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.158:6834/1366477380,v1:172.21.15.158:6836/1366477380] conn(0x55c18526d4a0 0x55c18526d870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d0ff04ace939f35 server_cookie=c911c879b8bd7e5b in_seq=0 out_seq=0 2023-10-09T06:22:19.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3f7effd700 1 -- 172.21.15.31:0/2765722733 <== mds.0 v2:172.21.15.158:6834/1366477380 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c185212aa0 con 0x55c18526d4a0 2023-10-09T06:22:19.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3f7effd700 10 client.5430 handle_command_reply: tid=0 2023-10-09T06:22:19.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3fafe24b80 1 client.5430 shutdown 2023-10-09T06:22:19.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3fafe24b80 1 -- 172.21.15.31:0/2765722733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 msgr2=0x55c185270490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 0x55c185270490 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3f880091e0 tx=0x7f3f8801c000 comp rx=0 tx=0).stop 2023-10-09T06:22:19.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3fafe24b80 1 -- 172.21.15.31:0/2765722733 shutdown_connections 2023-10-09T06:22:19.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.158:6834/1366477380,v1:172.21.15.158:6836/1366477380] conn(0x55c18526d4a0 0x55c18526d870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c18523e5f0 0x55c185287e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18528b480 0x55c1852709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3f7effd700 0 client.5430 ms_handle_reset on v2:172.21.15.158:6834/1366477380 2023-10-09T06:22:19.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/2765722733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 0x55c185270490 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3fafe24b80 1 -- 172.21.15.31:0/2765722733 >> 172.21.15.31:0/2765722733 conn(0x55c1852420c0 msgr2=0x55c1852428d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:19.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3fafe24b80 1 -- 172.21.15.31:0/2765722733 shutdown_connections 2023-10-09T06:22:19.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3fafe24b80 1 -- 172.21.15.31:0/2765722733 wait complete. 2023-10-09T06:22:19.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.010+0000 7f3fafe24b80 20 client.5430 trim_cache size 0 max 16384 2023-10-09T06:22:19.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.027+0000 7f3fafe24b80 1 Processor -- start 2023-10-09T06:22:19.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.027+0000 7f3fafe24b80 1 -- start start 2023-10-09T06:22:19.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.027+0000 7f3fafe24b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 0x55c185270930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fafe24b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c185240b80 0x55c18523dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fafe24b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18526d4a0 0x55c185296710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fafe24b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1852205b0 con 0x55c18523e5f0 2023-10-09T06:22:19.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fafe24b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1852399e0 con 0x55c18526d4a0 2023-10-09T06:22:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fafe24b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c18526cb00 con 0x55c185240b80 2023-10-09T06:22:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fa48c8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 0x55c185270930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fa48c8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 0x55c185270930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35894/0 (socket says 172.21.15.31:35894) 2023-10-09T06:22:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fa48c8700 1 -- 172.21.15.31:0/3133037580 learned_addr learned my addr 172.21.15.31:0/3133037580 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fa48c8700 1 -- 172.21.15.31:0/3133037580 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c185240b80 msgr2=0x55c18523dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/3133037580 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c185240b80 0x55c18523dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fa48c8700 1 -- 172.21.15.31:0/3133037580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18526d4a0 msgr2=0x55c185296710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/3133037580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18526d4a0 0x55c185296710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fa48c8700 1 -- 172.21.15.31:0/3133037580 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c18515f780 con 0x55c18523e5f0 2023-10-09T06:22:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/3133037580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 0x55c185270930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000c010 tx=0x7f3f9002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87d241b5da94ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3f967fc700 1 -- 172.21.15.31:0/3133037580 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90033040 con 0x55c18523e5f0 2023-10-09T06:22:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3f967fc700 1 -- 172.21.15.31:0/3133037580 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f90035040 con 0x55c18523e5f0 2023-10-09T06:22:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.028+0000 7f3f967fc700 1 -- 172.21.15.31:0/3133037580 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90024070 con 0x55c18523e5f0 2023-10-09T06:22:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.029+0000 7f3fafe24b80 1 -- 172.21.15.31:0/3133037580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 msgr2=0x55c185270930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.029+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/3133037580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 0x55c185270930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000c010 tx=0x7f3f9002c040 comp rx=0 tx=0).stop 2023-10-09T06:22:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.029+0000 7f3fafe24b80 1 -- 172.21.15.31:0/3133037580 shutdown_connections 2023-10-09T06:22:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.029+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/3133037580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18526d4a0 0x55c185296710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.029+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/3133037580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c18523e5f0 0x55c185270930 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.029+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/3133037580 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c185240b80 0x55c18523dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.029+0000 7f3fafe24b80 1 -- 172.21.15.31:0/3133037580 >> 172.21.15.31:0/3133037580 conn(0x55c1852420c0 msgr2=0x55c185266660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:19.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.029+0000 7f3fafe24b80 1 -- 172.21.15.31:0/3133037580 shutdown_connections 2023-10-09T06:22:19.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.029+0000 7f3fafe24b80 1 -- 172.21.15.31:0/3133037580 wait complete. 2023-10-09T06:22:19.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.029+0000 7f3fafe24b80 1 -- start start 2023-10-09T06:22:19.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.029+0000 7f3fafe24b80 1 Processor -- start 2023-10-09T06:22:19.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.030+0000 7f3fafe24b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18523e5f0 0x55c18526b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.030+0000 7f3fafe24b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 0x55c18526f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.030+0000 7f3fafe24b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c18526d4a0 0x55c185286950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.030+0000 7f3fafe24b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18526fa00 con 0x55c185240b80 2023-10-09T06:22:19.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.030+0000 7f3fafe24b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18526fe30 con 0x55c18523e5f0 2023-10-09T06:22:19.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.030+0000 7f3fafe24b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1852861e0 con 0x55c18526d4a0 2023-10-09T06:22:19.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.030+0000 7f3fafe24b80 10 client.0 _ll_register_callbacks cb 0x55c1852042c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:22:19.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.030+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 0x55c18526f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.030+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 0x55c18526f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35910/0 (socket says 172.21.15.31:35910) 2023-10-09T06:22:19.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.030+0000 7f3f9ffff700 1 -- 172.21.15.31:0/3904621834 learned_addr learned my addr 172.21.15.31:0/3904621834 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:19.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.030+0000 7f3fa50c9700 1 --2- 172.21.15.31:0/3904621834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c18526d4a0 0x55c185286950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.030+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/3904621834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18523e5f0 0x55c18526b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3f9ffff700 1 -- 172.21.15.31:0/3904621834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c18526d4a0 msgr2=0x55c185286950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3f9ffff700 1 --2- 172.21.15.31:0/3904621834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c18526d4a0 0x55c185286950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3f9ffff700 1 -- 172.21.15.31:0/3904621834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18523e5f0 msgr2=0x55c18526b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3f9ffff700 1 --2- 172.21.15.31:0/3904621834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18523e5f0 0x55c18526b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3f9ffff700 1 -- 172.21.15.31:0/3904621834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8c003570 con 0x55c185240b80 2023-10-09T06:22:19.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3f9ffff700 1 --2- 172.21.15.31:0/3904621834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 0x55c18526f4c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x55c18523ee40 tx=0x7f3f88026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55fc667b0367ef5a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:19.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3f7effd700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:22:19.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3f7effd700 1 -- 172.21.15.31:0/3904621834 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88014c10 con 0x55c185240b80 2023-10-09T06:22:19.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3f7effd700 1 -- 172.21.15.31:0/3904621834 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f88000bc0 con 0x55c185240b80 2023-10-09T06:22:19.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3fafe24b80 1 -- 172.21.15.31:0/3904621834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f88014d70 con 0x55c185240b80 2023-10-09T06:22:19.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3f7effd700 1 -- 172.21.15.31:0/3904621834 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f88006040 con 0x55c185240b80 2023-10-09T06:22:19.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3fafe24b80 10 client.5436 fetch_fsmap learned FSMap version 25 2023-10-09T06:22:19.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3fafe24b80 1 -- 172.21.15.31:0/3904621834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55c185146470 con 0x55c185240b80 2023-10-09T06:22:19.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3f7effd700 1 -- 172.21.15.31:0/3904621834 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f88014d70 con 0x55c185240b80 2023-10-09T06:22:19.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3f7effd700 1 -- 172.21.15.31:0/3904621834 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3f88014460 con 0x55c185240b80 2023-10-09T06:22:19.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3fafe24b80 10 client.5436 fetch_fsmap finished waiting for FSMap version 25 2023-10-09T06:22:19.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3fafe24b80 10 client.5436 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T06:22:19.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3fafe24b80 20 client.5436 populate_metadata read hostname 'smithi031' 2023-10-09T06:22:19.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/3904621834 >> [v2:172.21.15.158:6834/1366477380,v1:172.21.15.158:6836/1366477380] conn(0x55c18528b480 0x55c18528a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3fafe24b80 4 client.5436 mds_command: new command op to 5307 tid=0[{"prefix": "status"}] 2023-10-09T06:22:19.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.031+0000 7f3fafe24b80 1 -- 172.21.15.31:0/3904621834 --> [v2:172.21.15.158:6834/1366477380,v1:172.21.15.158:6836/1366477380] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c185133e00 con 0x55c18528b480 2023-10-09T06:22:19.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/3904621834 >> [v2:172.21.15.158:6834/1366477380,v1:172.21.15.158:6836/1366477380] conn(0x55c18528b480 0x55c18528a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3f7effd700 10 client.5436 ms_handle_connect on v2:172.21.15.158:6834/1366477380 2023-10-09T06:22:19.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3fa48c8700 1 --2- 172.21.15.31:0/3904621834 >> [v2:172.21.15.158:6834/1366477380,v1:172.21.15.158:6836/1366477380] conn(0x55c18528b480 0x55c18528a320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65a94cb305317544 server_cookie=fd234e843d665598 in_seq=0 out_seq=0 2023-10-09T06:22:19.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3f7effd700 1 -- 172.21.15.31:0/3904621834 <== mds.0 v2:172.21.15.158:6834/1366477380 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c185133e00 con 0x55c18528b480 2023-10-09T06:22:19.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3f7effd700 10 client.5436 handle_command_reply: tid=0 2023-10-09T06:22:19.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3fafe24b80 1 client.5436 shutdown 2023-10-09T06:22:19.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3fafe24b80 1 -- 172.21.15.31:0/3904621834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 msgr2=0x55c18526f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/3904621834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 0x55c18526f4c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x55c18523ee40 tx=0x7f3f88026000 comp rx=0 tx=0).stop 2023-10-09T06:22:19.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3fafe24b80 1 -- 172.21.15.31:0/3904621834 shutdown_connections 2023-10-09T06:22:19.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/3904621834 >> [v2:172.21.15.158:6834/1366477380,v1:172.21.15.158:6836/1366477380] conn(0x55c18528b480 0x55c18528a320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/3904621834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55c18526d4a0 0x55c185286950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3f7effd700 0 client.5436 ms_handle_reset on v2:172.21.15.158:6834/1366477380 2023-10-09T06:22:19.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/3904621834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c18523e5f0 0x55c18526b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3fafe24b80 1 --2- 172.21.15.31:0/3904621834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c185240b80 0x55c18526f4c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3fafe24b80 1 -- 172.21.15.31:0/3904621834 >> 172.21.15.31:0/3904621834 conn(0x55c1852420c0 msgr2=0x55c1852964e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:19.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3fafe24b80 1 -- 172.21.15.31:0/3904621834 shutdown_connections 2023-10-09T06:22:19.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.032+0000 7f3fafe24b80 1 -- 172.21.15.31:0/3904621834 wait complete. 2023-10-09T06:22:19.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.033+0000 7f3fafe24b80 20 client.5436 trim_cache size 0 max 16384 2023-10-09T06:22:19.042 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:22:19.042 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:22:19.042 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-10-09T06:22:19.042 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5307, 2023-10-09T06:22:19.042 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-10-09T06:22:19.042 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-10-09T06:22:19.042 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-10-09T06:22:19.042 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 5.9140515359999997, 2023-10-09T06:22:19.042 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 25, 2023-10-09T06:22:19.043 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 45, 2023-10-09T06:22:19.043 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 45, 2023-10-09T06:22:19.043 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 10.84693569 2023-10-09T06:22:19.043 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:22:19.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.033+0000 7f3fa58ca700 1 -- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3f80066f30 msgr2=0x7f3f800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.033+0000 7f3fa58ca700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3f80066f30 0x7f3f800693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000afd0 tx=0x7f3f9001a000 comp rx=0 tx=0).stop 2023-10-09T06:22:19.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.033+0000 7f3fa58ca700 1 -- 172.21.15.31:0/3289066406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa00ccd50 msgr2=0x7f3fa016a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.033+0000 7f3fa58ca700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa00ccd50 0x7f3fa016a710 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3fa006b310 tx=0x7f3f98001e90 comp rx=0 tx=0).stop 2023-10-09T06:22:19.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.033+0000 7f3fa58ca700 1 -- 172.21.15.31:0/3289066406 shutdown_connections 2023-10-09T06:22:19.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.033+0000 7f3fa58ca700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3f80066f30 0x7f3f800693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.033+0000 7f3fa58ca700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3f8c003a60 0x7f3fa015cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.033+0000 7f3fa58ca700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa00ccd50 0x7f3fa016a710 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.033+0000 7f3fa58ca700 1 --2- 172.21.15.31:0/3289066406 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fa0158140 0x7f3fa00cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.033+0000 7f3fa58ca700 1 -- 172.21.15.31:0/3289066406 >> 172.21.15.31:0/3289066406 conn(0x7f3fa00d0bc0 msgr2=0x7f3fa0159020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:19.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.033+0000 7f3fa58ca700 1 -- 172.21.15.31:0/3289066406 shutdown_connections 2023-10-09T06:22:19.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.033+0000 7f3fa58ca700 1 -- 172.21.15.31:0/3289066406 wait complete. 2023-10-09T06:22:19.046 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:22:19.094 INFO:tasks.ceph.mds.b.smithi158.stderr:2023-10-09T06:22:19.090+0000 7f4dd6819700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:22:19.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.166+0000 7f38ad187700 1 Processor -- start 2023-10-09T06:22:19.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.166+0000 7f38ad187700 1 -- start start 2023-10-09T06:22:19.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38ad187700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f38a8157870 0x7f38a815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38ad187700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f38a8157c40 0x7f38a8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38ad187700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a815cbb0 con 0x7f38a815a620 2023-10-09T06:22:19.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38ad187700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a815bfa0 con 0x7f38a8157870 2023-10-09T06:22:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38ad187700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a815c280 con 0x7f38a8157c40 2023-10-09T06:22:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38a6d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f38a8157870 0x7f38a815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38a6d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f38a8157870 0x7f38a815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35916/0 (socket says 172.21.15.31:35916) 2023-10-09T06:22:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38a6d9d700 1 -- 172.21.15.31:0/624122580 learned_addr learned my addr 172.21.15.31:0/624122580 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38a759e700 1 --2- 172.21.15.31:0/624122580 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f38a8157c40 0x7f38a8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38a6d9d700 1 -- 172.21.15.31:0/624122580 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f38a8157c40 msgr2=0x7f38a8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38a6d9d700 1 --2- 172.21.15.31:0/624122580 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f38a8157c40 0x7f38a8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38a6d9d700 1 -- 172.21.15.31:0/624122580 >> v1:172.21.15.158:6789/0 conn(0x7f38a815a620 legacy=0x7f38a815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38a6d9d700 1 -- 172.21.15.31:0/624122580 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a815c560 con 0x7f38a8157870 2023-10-09T06:22:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38a759e700 1 --2- 172.21.15.31:0/624122580 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f38a8157c40 0x7f38a8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38a6d9d700 1 --2- 172.21.15.31:0/624122580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a8157870 0x7f38a815b6a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3898009f20 tx=0x7f3898009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e55ad849cbcfc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38a5d9b700 1 -- 172.21.15.31:0/624122580 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389800e070 con 0x7f38a8157870 2023-10-09T06:22:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38a5d9b700 1 -- 172.21.15.31:0/624122580 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389800ba40 con 0x7f38a8157870 2023-10-09T06:22:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.167+0000 7f38a5d9b700 1 -- 172.21.15.31:0/624122580 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980092e0 con 0x7f38a8157870 2023-10-09T06:22:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.168+0000 7f38ad187700 1 -- 172.21.15.31:0/624122580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a8157870 msgr2=0x7f38a815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.168+0000 7f38ad187700 1 --2- 172.21.15.31:0/624122580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a8157870 0x7f38a815b6a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3898009f20 tx=0x7f3898009840 comp rx=0 tx=0).stop 2023-10-09T06:22:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.168+0000 7f38ad187700 1 -- 172.21.15.31:0/624122580 shutdown_connections 2023-10-09T06:22:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.168+0000 7f38ad187700 1 --2- 172.21.15.31:0/624122580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a8157870 0x7f38a815b6a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.168+0000 7f38ad187700 1 --2- 172.21.15.31:0/624122580 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f38a8157c40 0x7f38a8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.168+0000 7f38ad187700 1 -- 172.21.15.31:0/624122580 >> 172.21.15.31:0/624122580 conn(0x7f38a8068ce0 msgr2=0x7f38a80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:19.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.168+0000 7f38ad187700 1 -- 172.21.15.31:0/624122580 shutdown_connections 2023-10-09T06:22:19.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.168+0000 7f38ad187700 1 -- 172.21.15.31:0/624122580 wait complete. 2023-10-09T06:22:19.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.169+0000 7f38ad187700 1 Processor -- start 2023-10-09T06:22:19.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.169+0000 7f38ad187700 1 -- start start 2023-10-09T06:22:19.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38ad187700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a8157870 0x7f38a813d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38ad187700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f38a8157c40 0x7f38a8153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38ad187700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f38a815a620 0x7f38a80d0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38ad187700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a813dca0 con 0x7f38a8157870 2023-10-09T06:22:19.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38ad187700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8154660 con 0x7f38a8157c40 2023-10-09T06:22:19.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38ad187700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8154940 con 0x7f38a815a620 2023-10-09T06:22:19.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38a6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a8157870 0x7f38a813d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38a6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a8157870 0x7f38a813d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35926/0 (socket says 172.21.15.31:35926) 2023-10-09T06:22:19.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38a6d9d700 1 -- 172.21.15.31:0/3423179527 learned_addr learned my addr 172.21.15.31:0/3423179527 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:19.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38a759e700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f38a815a620 0x7f38a80d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38a659c700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f38a8157c40 0x7f38a8153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38a6d9d700 1 -- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f38a815a620 msgr2=0x7f38a80d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38a6d9d700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f38a815a620 0x7f38a80d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38a6d9d700 1 -- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f38a8157c40 msgr2=0x7f38a8153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38a6d9d700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f38a8157c40 0x7f38a8153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38a6d9d700 1 -- 172.21.15.31:0/3423179527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3898009ae0 con 0x7f38a8157870 2023-10-09T06:22:19.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.170+0000 7f38a6d9d700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a8157870 0x7f38a813d760 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f38a806b530 tx=0x7f3898017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:19.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.171+0000 7f389effd700 1 -- 172.21.15.31:0/3423179527 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980129a0 con 0x7f38a8157870 2023-10-09T06:22:19.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.171+0000 7f389effd700 1 -- 172.21.15.31:0/3423179527 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3898012b00 con 0x7f38a8157870 2023-10-09T06:22:19.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.171+0000 7f38ad187700 1 -- 172.21.15.31:0/3423179527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a8154c20 con 0x7f38a8157870 2023-10-09T06:22:19.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.171+0000 7f389effd700 1 -- 172.21.15.31:0/3423179527 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389801d420 con 0x7f38a8157870 2023-10-09T06:22:19.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.171+0000 7f38ad187700 1 -- 172.21.15.31:0/3423179527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a814e4f0 con 0x7f38a8157870 2023-10-09T06:22:19.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.172+0000 7f38ad187700 1 -- 172.21.15.31:0/3423179527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a804c3c0 con 0x7f38a8157870 2023-10-09T06:22:19.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.172+0000 7f389effd700 1 -- 172.21.15.31:0/3423179527 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f389801d850 con 0x7f38a8157870 2023-10-09T06:22:19.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.173+0000 7f389effd700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3888066f30 0x7f38880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:19.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.173+0000 7f389effd700 1 -- 172.21.15.31:0/3423179527 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3898085b20 con 0x7f38a8157870 2023-10-09T06:22:19.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.173+0000 7f38a659c700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3888066f30 0x7f38880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:19.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.173+0000 7f38a659c700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3888066f30 0x7f38880693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f38a815bdf0 tx=0x7f3890009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:19.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.177+0000 7f389effd700 1 -- 172.21.15.31:0/3423179527 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3898052d90 con 0x7f38a8157870 2023-10-09T06:22:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.417+0000 7f38ad187700 1 -- 172.21.15.31:0/3423179527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f38a815c840 con 0x7f38a8157870 2023-10-09T06:22:19.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.417+0000 7f389effd700 1 -- 172.21.15.31:0/3423179527 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f389802a060 con 0x7f38a8157870 2023-10-09T06:22:19.418 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:22:19.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.419+0000 7f38ad187700 1 -- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3888066f30 msgr2=0x7f38880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.419+0000 7f38ad187700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3888066f30 0x7f38880693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f38a815bdf0 tx=0x7f3890009060 comp rx=0 tx=0).stop 2023-10-09T06:22:19.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.419+0000 7f38ad187700 1 -- 172.21.15.31:0/3423179527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a8157870 msgr2=0x7f38a813d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.419+0000 7f38ad187700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a8157870 0x7f38a813d760 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f38a806b530 tx=0x7f3898017000 comp rx=0 tx=0).stop 2023-10-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.419+0000 7f38ad187700 1 -- 172.21.15.31:0/3423179527 shutdown_connections 2023-10-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.419+0000 7f38ad187700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3888066f30 0x7f38880693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.419+0000 7f38ad187700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f38a815a620 0x7f38a80d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.419+0000 7f38ad187700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a8157870 0x7f38a813d760 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.419+0000 7f38ad187700 1 --2- 172.21.15.31:0/3423179527 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f38a8157c40 0x7f38a8153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.419+0000 7f38ad187700 1 -- 172.21.15.31:0/3423179527 >> 172.21.15.31:0/3423179527 conn(0x7f38a8068ce0 msgr2=0x7f38a80b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.419+0000 7f38ad187700 1 -- 172.21.15.31:0/3423179527 shutdown_connections 2023-10-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:19.419+0000 7f38ad187700 1 -- 172.21.15.31:0/3423179527 wait complete. 2023-10-09T06:22:19.432 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:22:19.432 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:22:19.432 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-10-09T06:22:19.432 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:22:19.432 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:22:19.432 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:22:19.433 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:22:19.433 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:22:19.433 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:22:19.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:19.433 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-10-09T06:22:19.449 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:22:19.450 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:22:19.450 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:22:19.450 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:19.450 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:22:19.450 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:19.450 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:22:19.450 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T06:22:19.450 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-10-09T06:22:19.450 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:22:19.450 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T06:22:19.451 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-10-09T06:22:19.451 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:22:19.451 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-10-09T06:22:19.451 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-10-09T06:22:19.451 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T06:22:19.451 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42427sec preferred_lft 42427sec 2023-10-09T06:22:19.451 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-10-09T06:22:19.451 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:19.451 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:22:19.451 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:22:19.452 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-10-09T06:22:19.452 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:22:19.452 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:22:19.452 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:22:19.452 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:19.452 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::b4ad:53ff:fed3:a589/64 scope link 2023-10-09T06:22:19.452 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:19.452 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:22:19.452 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether f6:bf:b8:0f:49:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:22:19.452 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::f4bf:b8ff:fe0f:498b/64 scope link 2023-10-09T06:22:19.453 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:19.453 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:22:19.453 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:22:19.453 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::d8ab:b5ff:fe1d:e066/64 scope link 2023-10-09T06:22:19.453 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:19.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:19.453 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:22:19.514 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-10-09T06:22:19.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:19.515 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-10-09T06:22:19.575 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-10-09T06:22:19.575 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:22:19.575 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T06:22:19.575 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T06:22:19.576 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:22:19.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:19.576 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:22:19.576 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:22:19.576 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T06:22:19.577 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T06:22:19.577 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T06:22:19.577 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:22:19.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:19.678 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:22:19.693 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:22:19.693 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:22:19.694 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:22:19.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:19.694 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-10-09T06:22:19.760 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:22:19.760 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:22:19.819 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:22:19.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:22:19.819 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:22:19.877 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:22:19.877 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:22:19.877 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:22:19.961 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:22:19.961 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:22:19.981 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:22:19.981 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:22:19.981 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:22:19.981 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:22:19.982 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:22:19.982 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:22:19.982 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:22:19.982 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:22:20.002 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:22:20.002 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:22:20.003 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:22:20.003 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:22:20.003 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:22:20.003 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:22:20.003 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:22:20.003 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:22:20.003 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:22:20.003 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:22:20.003 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:22:20.004 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:22:20.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:20.005 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:22:20.071 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:22:20.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.232+0000 7f6f57f74700 1 Processor -- start 2023-10-09T06:22:20.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.233+0000 7f6f57f74700 1 -- start start 2023-10-09T06:22:20.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.233+0000 7f6f57f74700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f5015a2b0 0x7f6f500b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:20.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.233+0000 7f6f57f74700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500c5d80 con 0x7f6f500d1c30 2023-10-09T06:22:20.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f57f74700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500c6060 con 0x7f6f500cfe20 2023-10-09T06:22:20.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f57f74700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50068470 con 0x7f6f5015a2b0 2023-10-09T06:22:20.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f5550f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6f500d1c30 0x7f6f500cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42302/0 (socket says 172.21.15.31:42302) 2023-10-09T06:22:20.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f5550f700 1 -- 172.21.15.31:0/1946583734 learned_addr learned my addr 172.21.15.31:0/1946583734 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:20.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f55d10700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f5015a2b0 0x7f6f500b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:20.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568769103 0 0) 0x7f6f500c5d80 con 0x7f6f500d1c30 2023-10-09T06:22:20.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f38003570 con 0x7f6f500d1c30 2023-10-09T06:22:20.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055018060 0 0) 0x7f6f500c6060 con 0x7f6f500cfe20 2023-10-09T06:22:20.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f500c5d80 con 0x7f6f500cfe20 2023-10-09T06:22:20.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2423063889 0 0) 0x7f6f38003570 con 0x7f6f500d1c30 2023-10-09T06:22:20.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f5015a2b0 msgr2=0x7f6f500b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:20.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f5015a2b0 0x7f6f500b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:20.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 >> v1:172.21.15.158:6789/0 conn(0x7f6f500cfe20 legacy=0x7f6f500c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:20.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f500c6340 con 0x7f6f500d1c30 2023-10-09T06:22:20.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f6f44001470 con 0x7f6f500d1c30 2023-10-09T06:22:20.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 >> v1:172.21.15.31:6789/0 conn(0x7f6f500d1c30 legacy=0x7f6f500cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:20.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f38003c20 0x7f6f38004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:20.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f38004810 0x7f6f38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:20.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f5015a2b0 0x7f6f38005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:20.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50068470 con 0x7f6f38003c20 2023-10-09T06:22:20.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3800bbf0 con 0x7f6f38004810 2023-10-09T06:22:20.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3800bdb0 con 0x7f6f5015a2b0 2023-10-09T06:22:20.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f55d10700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f38003c20 0x7f6f38004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:20.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.234+0000 7f6f5550f700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f38004810 0x7f6f38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:20.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f56511700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f5015a2b0 0x7f6f38005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:20.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f55d10700 1 -- 172.21.15.31:0/1946583734 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f5015a2b0 msgr2=0x7f6f38005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:20.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f55d10700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f5015a2b0 0x7f6f38005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:20.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f55d10700 1 -- 172.21.15.31:0/1946583734 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f38004810 msgr2=0x7f6f38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:20.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f55d10700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f38004810 0x7f6f38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:20.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f55d10700 1 -- 172.21.15.31:0/1946583734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f38003570 con 0x7f6f38003c20 2023-10-09T06:22:20.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f56511700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f5015a2b0 0x7f6f38005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:20.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f5550f700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f38004810 0x7f6f38004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:20.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f55d10700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f38003c20 0x7f6f38004010 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009bf0 tx=0x7f6f48009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ab4cd321d69208 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:20.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f48005a00 con 0x7f6f38003c20 2023-10-09T06:22:20.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f48005b60 con 0x7f6f38003c20 2023-10-09T06:22:20.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f54d0e700 1 -- 172.21.15.31:0/1946583734 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4800e710 con 0x7f6f38003c20 2023-10-09T06:22:20.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f57f74700 1 -- 172.21.15.31:0/1946583734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f38003c20 msgr2=0x7f6f38004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:20.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f57f74700 1 --2- 172.21.15.31:0/1946583734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f38003c20 0x7f6f38004010 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009bf0 tx=0x7f6f48009120 comp rx=0 tx=0).stop 2023-10-09T06:22:20.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.235+0000 7f6f56511700 1 -- 172.21.15.31:0/1946583734 reap_dead start 2023-10-09T06:22:20.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.236+0000 7f6f57f74700 1 -- 172.21.15.31:0/1946583734 shutdown_connections 2023-10-09T06:22:20.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.236+0000 7f6f57f74700 1 -- 172.21.15.31:0/1946583734 >> 172.21.15.31:0/1946583734 conn(0x7f6f50067e40 msgr2=0x7f6f500d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:20.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.236+0000 7f6f57f74700 1 -- 172.21.15.31:0/1946583734 shutdown_connections 2023-10-09T06:22:20.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.236+0000 7f6f57f74700 1 -- 172.21.15.31:0/1946583734 wait complete. 2023-10-09T06:22:20.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.237+0000 7f6f57f74700 1 Processor -- start 2023-10-09T06:22:20.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.237+0000 7f6f57f74700 1 -- start start 2023-10-09T06:22:20.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.237+0000 7f6f57f74700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f38003c20 0x7f6f501581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:20.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.237+0000 7f6f57f74700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f50160170 0x7f6f501605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:20.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.237+0000 7f6f57f74700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5015cd90 0x7f6f5015d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:20.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f57f74700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50158700 con 0x7f6f5015cd90 2023-10-09T06:22:20.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f57f74700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50160b20 con 0x7f6f50160170 2023-10-09T06:22:20.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f57f74700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5016bf30 con 0x7f6f38003c20 2023-10-09T06:22:20.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f56511700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5015cd90 0x7f6f5015d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:20.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f56511700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5015cd90 0x7f6f5015d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34994/0 (socket says 172.21.15.31:34994) 2023-10-09T06:22:20.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f56511700 1 -- 172.21.15.31:0/2142050981 learned_addr learned my addr 172.21.15.31:0/2142050981 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:20.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f5550f700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f50160170 0x7f6f501605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:20.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f55d10700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f38003c20 0x7f6f501581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:20.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f56511700 1 -- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f38003c20 msgr2=0x7f6f501581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:20.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f56511700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f38003c20 0x7f6f501581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:20.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f56511700 1 -- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f50160170 msgr2=0x7f6f501605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:20.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f56511700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f50160170 0x7f6f501605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:20.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f56511700 1 -- 172.21.15.31:0/2142050981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5015d740 con 0x7f6f5015cd90 2023-10-09T06:22:20.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f56511700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5015cd90 0x7f6f5015d200 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6f500d0220 tx=0x7f6f40009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:20.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f4dffb700 1 -- 172.21.15.31:0/2142050981 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400032e0 con 0x7f6f5015cd90 2023-10-09T06:22:20.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f4dffb700 1 -- 172.21.15.31:0/2142050981 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f40003440 con 0x7f6f5015cd90 2023-10-09T06:22:20.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f57f74700 1 -- 172.21.15.31:0/2142050981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5016b900 con 0x7f6f5015cd90 2023-10-09T06:22:20.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.238+0000 7f6f4dffb700 1 -- 172.21.15.31:0/2142050981 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40006df0 con 0x7f6f5015cd90 2023-10-09T06:22:20.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.239+0000 7f6f57f74700 1 -- 172.21.15.31:0/2142050981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5015dcc0 con 0x7f6f5015cd90 2023-10-09T06:22:20.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.240+0000 7f6f57f74700 1 -- 172.21.15.31:0/2142050981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5004c3c0 con 0x7f6f5015cd90 2023-10-09T06:22:20.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.240+0000 7f6f4dffb700 1 -- 172.21.15.31:0/2142050981 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f400018f0 con 0x7f6f5015cd90 2023-10-09T06:22:20.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.240+0000 7f6f4dffb700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f3c066f60 0x7f6f3c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:20.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.240+0000 7f6f4dffb700 1 -- 172.21.15.31:0/2142050981 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f400837a0 con 0x7f6f5015cd90 2023-10-09T06:22:20.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.241+0000 7f6f55d10700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f3c066f60 0x7f6f3c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:20.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.241+0000 7f6f55d10700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f3c066f60 0x7f6f3c069410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009160 tx=0x7f6f48019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:20.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.244+0000 7f6f4dffb700 1 -- 172.21.15.31:0/2142050981 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f40050970 con 0x7f6f5015cd90 2023-10-09T06:22:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.484+0000 7f6f57f74700 1 -- 172.21.15.31:0/2142050981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6f5016c070 con 0x7f6f5015cd90 2023-10-09T06:22:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.485+0000 7f6f4dffb700 1 -- 172.21.15.31:0/2142050981 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6f40019070 con 0x7f6f5015cd90 2023-10-09T06:22:20.485 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:22:20.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.486+0000 7f6f57f74700 1 -- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f3c066f60 msgr2=0x7f6f3c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:20.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.486+0000 7f6f57f74700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f3c066f60 0x7f6f3c069410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009160 tx=0x7f6f48019000 comp rx=0 tx=0).stop 2023-10-09T06:22:20.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.486+0000 7f6f57f74700 1 -- 172.21.15.31:0/2142050981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5015cd90 msgr2=0x7f6f5015d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:20.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.486+0000 7f6f57f74700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5015cd90 0x7f6f5015d200 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6f500d0220 tx=0x7f6f40009040 comp rx=0 tx=0).stop 2023-10-09T06:22:20.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.486+0000 7f6f57f74700 1 -- 172.21.15.31:0/2142050981 shutdown_connections 2023-10-09T06:22:20.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.486+0000 7f6f57f74700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f3c066f60 0x7f6f3c069410 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:20.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.486+0000 7f6f57f74700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f38003c20 0x7f6f501581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:20.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.486+0000 7f6f57f74700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5015cd90 0x7f6f5015d200 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:20.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.486+0000 7f6f57f74700 1 --2- 172.21.15.31:0/2142050981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f50160170 0x7f6f501605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:20.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.486+0000 7f6f57f74700 1 -- 172.21.15.31:0/2142050981 >> 172.21.15.31:0/2142050981 conn(0x7f6f50067e40 msgr2=0x7f6f500d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:20.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.487+0000 7f6f57f74700 1 -- 172.21.15.31:0/2142050981 shutdown_connections 2023-10-09T06:22:20.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:20.487+0000 7f6f57f74700 1 -- 172.21.15.31:0/2142050981 wait complete. 2023-10-09T06:22:20.498 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:22:20.498 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:22:20.498 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-09T06:22:20.498 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T06:22:20.499 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T06:22:20.499 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:22:20.499 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:22:20.499 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:22:20.499 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:22:20.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:20.499 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-09T06:22:20.518 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:22:20.518 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:22:20.518 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:22:20.518 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:20.518 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:22:20.518 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:20.519 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:22:20.519 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:22:20.519 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-09T06:22:20.519 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:22:20.519 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:22:20.519 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-09T06:22:20.519 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:22:20.519 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-09T06:22:20.519 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:22:20.519 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:22:20.519 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:22:20.520 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42453sec preferred_lft 42453sec 2023-10-09T06:22:20.520 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-09T06:22:20.520 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:20.520 INFO:teuthology.orchestra.run.smithi158.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:22:20.520 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:22:20.520 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:22:20.521 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:20.521 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::c5:35ff:fec9:1844/64 scope link 2023-10-09T06:22:20.521 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:20.521 INFO:teuthology.orchestra.run.smithi158.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:22:20.521 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether e6:10:14:7c:a4:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:22:20.521 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::e410:14ff:fe7c:a4d7/64 scope link 2023-10-09T06:22:20.521 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:20.522 INFO:teuthology.orchestra.run.smithi158.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:22:20.522 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T06:22:20.522 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::44a9:f1ff:fe2b:babb/64 scope link 2023-10-09T06:22:20.522 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:22:20.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:20.523 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:22:20.587 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-09T06:22:20.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:20.589 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-09T06:22:20.648 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-09T06:22:20.648 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:22:20.649 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:22:20.649 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:22:20.649 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:22:20.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:20.649 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:22:20.649 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:22:20.649 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:22:20.649 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:22:20.649 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:22:20.650 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:22:20.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:20.758 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:22:20.774 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T06:22:20.775 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T06:22:20.775 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:22:20.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:20.775 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-09T06:22:20.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:22:20.843 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T06:22:20.899 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:22:20.899 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:22:20.899 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:22:20.955 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T06:22:20.956 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:22:20.956 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:22:21.037 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:22:21.037 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:22:21.056 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:22:21.057 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:22:21.058 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:22:21.058 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:22:21.058 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:22:21.059 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:22:21.059 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:22:21.060 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:22:21.077 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:22:21.077 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:22:21.077 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:22:21.078 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:22:21.078 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:22:21.078 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:22:21.078 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:22:21.079 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:22:21.079 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:22:21.079 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:22:21.079 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:22:21.081 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:22:21.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:21.082 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:22:21.147 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:22:21.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.267+0000 7f21c200a700 1 Processor -- start 2023-10-09T06:22:21.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.268+0000 7f21c200a700 1 -- start start 2023-10-09T06:22:21.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.268+0000 7f21c200a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f21bc0b50c0 0x7f21bc15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:21.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.268+0000 7f21c200a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21bc0cf810 0x7f21bc0cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:21.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.268+0000 7f21c200a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc0d1960 con 0x7f21bc15a030 2023-10-09T06:22:21.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.268+0000 7f21c200a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc0d0610 con 0x7f21bc0b50c0 2023-10-09T06:22:21.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.268+0000 7f21c200a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc15a940 con 0x7f21bc0cf810 2023-10-09T06:22:21.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21c1008700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f21bc15a030 0x7f21bc0cf100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42316/0 (socket says 172.21.15.31:42316) 2023-10-09T06:22:21.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21c1008700 1 -- 172.21.15.31:0/409558593 learned_addr learned my addr 172.21.15.31:0/409558593 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:21.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21c1809700 1 --2- 172.21.15.31:0/409558593 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21bc0cf810 0x7f21bc0cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:21.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21c0807700 1 --2- 172.21.15.31:0/409558593 >> v2:172.21.15.158:3300/0 conn(0x7f21bc0b50c0 0x7f21bc15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:21.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21bbfff700 1 -- 172.21.15.31:0/409558593 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433093146 0 0) 0x7f21bc0d1960 con 0x7f21bc15a030 2023-10-09T06:22:21.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21bbfff700 1 -- 172.21.15.31:0/409558593 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21a4003570 con 0x7f21bc15a030 2023-10-09T06:22:21.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21c1809700 1 -- 172.21.15.31:0/409558593 >> v2:172.21.15.158:3300/0 conn(0x7f21bc0b50c0 msgr2=0x7f21bc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:21.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21c1809700 1 --2- 172.21.15.31:0/409558593 >> v2:172.21.15.158:3300/0 conn(0x7f21bc0b50c0 0x7f21bc15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:21.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21c1809700 1 -- 172.21.15.31:0/409558593 >> v1:172.21.15.31:6789/0 conn(0x7f21bc15a030 legacy=0x7f21bc0cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:21.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21c1809700 1 -- 172.21.15.31:0/409558593 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc0cfd70 con 0x7f21bc0cf810 2023-10-09T06:22:21.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21c0807700 1 --2- 172.21.15.31:0/409558593 >> v2:172.21.15.158:3300/0 conn(0x7f21bc0b50c0 0x7f21bc15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:22:21.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21c1809700 1 --2- 172.21.15.31:0/409558593 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21bc0cf810 0x7f21bc0cb1c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21b40098e0 tx=0x7f21b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e38fbc6954f9ece8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:21.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21bbfff700 1 -- 172.21.15.31:0/409558593 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b4011630 con 0x7f21bc0cf810 2023-10-09T06:22:21.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21bbfff700 1 -- 172.21.15.31:0/409558593 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b4011790 con 0x7f21bc0cf810 2023-10-09T06:22:21.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.269+0000 7f21bbfff700 1 -- 172.21.15.31:0/409558593 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b4011b30 con 0x7f21bc0cf810 2023-10-09T06:22:21.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.270+0000 7f21c200a700 1 -- 172.21.15.31:0/409558593 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21bc0cf810 msgr2=0x7f21bc0cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:21.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.270+0000 7f21c200a700 1 --2- 172.21.15.31:0/409558593 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21bc0cf810 0x7f21bc0cb1c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21b40098e0 tx=0x7f21b40091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:21.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.270+0000 7f21c200a700 1 -- 172.21.15.31:0/409558593 shutdown_connections 2023-10-09T06:22:21.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.270+0000 7f21c200a700 1 --2- 172.21.15.31:0/409558593 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21bc0cf810 0x7f21bc0cb1c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:21.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.270+0000 7f21c200a700 1 --2- 172.21.15.31:0/409558593 >> v2:172.21.15.158:3300/0 conn(0x7f21bc0b50c0 0x7f21bc15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:21.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.270+0000 7f21c200a700 1 -- 172.21.15.31:0/409558593 >> 172.21.15.31:0/409558593 conn(0x7f21bc067e40 msgr2=0x7f21bc0d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:21.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.270+0000 7f21c200a700 1 -- 172.21.15.31:0/409558593 shutdown_connections 2023-10-09T06:22:21.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.270+0000 7f21c200a700 1 -- 172.21.15.31:0/409558593 wait complete. 2023-10-09T06:22:21.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.271+0000 7f21c200a700 1 Processor -- start 2023-10-09T06:22:21.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.271+0000 7f21c200a700 1 -- start start 2023-10-09T06:22:21.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c200a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21bc0b50c0 0x7f21bc0c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:21.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c200a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21bc0cf810 0x7f21bc0ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:21.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c200a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21bc15a030 0x7f21bc0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:21.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c200a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc16ab70 con 0x7f21bc0cf810 2023-10-09T06:22:21.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c200a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0caef0 con 0x7f21bc0b50c0 2023-10-09T06:22:21.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c200a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0c8420 con 0x7f21bc15a030 2023-10-09T06:22:21.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c0807700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21bc0cf810 0x7f21bc0ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:21.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c0807700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21bc0cf810 0x7f21bc0ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35002/0 (socket says 172.21.15.31:35002) 2023-10-09T06:22:21.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c0807700 1 -- 172.21.15.31:0/1046229996 learned_addr learned my addr 172.21.15.31:0/1046229996 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:21.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c1008700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21bc0b50c0 0x7f21bc0c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:21.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c1809700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21bc15a030 0x7f21bc0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:21.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c0807700 1 -- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21bc15a030 msgr2=0x7f21bc0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:21.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c0807700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21bc15a030 0x7f21bc0cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:21.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c0807700 1 -- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21bc0b50c0 msgr2=0x7f21bc0c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:21.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c0807700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21bc0b50c0 0x7f21bc0c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:21.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.272+0000 7f21c0807700 1 -- 172.21.15.31:0/1046229996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0009420 con 0x7f21bc0cf810 2023-10-09T06:22:21.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.273+0000 7f21c0807700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21bc0cf810 0x7f21bc0ca9b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f21b000ec80 tx=0x7f21b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:21.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.273+0000 7f21b97fa700 1 -- 172.21.15.31:0/1046229996 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000c920 con 0x7f21bc0cf810 2023-10-09T06:22:21.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.273+0000 7f21b97fa700 1 -- 172.21.15.31:0/1046229996 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b000ca80 con 0x7f21bc0cf810 2023-10-09T06:22:21.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.273+0000 7f21c200a700 1 -- 172.21.15.31:0/1046229996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b4009420 con 0x7f21bc0cf810 2023-10-09T06:22:21.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.273+0000 7f21b97fa700 1 -- 172.21.15.31:0/1046229996 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000ce00 con 0x7f21bc0cf810 2023-10-09T06:22:21.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.273+0000 7f21c200a700 1 -- 172.21.15.31:0/1046229996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc0c7dd0 con 0x7f21bc0cf810 2023-10-09T06:22:21.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.274+0000 7f21c200a700 1 -- 172.21.15.31:0/1046229996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc0c7c30 con 0x7f21bc0cf810 2023-10-09T06:22:21.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.274+0000 7f21b97fa700 1 -- 172.21.15.31:0/1046229996 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21b0013680 con 0x7f21bc0cf810 2023-10-09T06:22:21.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.275+0000 7f21b97fa700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21a8066f30 0x7f21a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:21.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.275+0000 7f21b97fa700 1 -- 172.21.15.31:0/1046229996 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21b00849b0 con 0x7f21bc0cf810 2023-10-09T06:22:21.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.275+0000 7f21c1008700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21a8066f30 0x7f21a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:21.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.275+0000 7f21c1008700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21a8066f30 0x7f21a80693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f21bc09d150 tx=0x7f21ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:21.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.279+0000 7f21b97fa700 1 -- 172.21.15.31:0/1046229996 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21bc0c7c30 con 0x7f21bc0cf810 2023-10-09T06:22:21.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.516+0000 7f21c200a700 1 -- 172.21.15.31:0/1046229996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21bc0c7c30 con 0x7f21bc0cf810 2023-10-09T06:22:21.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.517+0000 7f21b97fa700 1 -- 172.21.15.31:0/1046229996 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f21bc0c7c30 con 0x7f21bc0cf810 2023-10-09T06:22:21.517 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:21.517 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2970905850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2970905850},{"type":"v1","addr":"172.21.15.158:6837","nonce":2970905850}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5119,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1945558670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1945558670},{"type":"v1","addr":"172.21.15.31:6835","nonce":1945558670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3853703125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3853703125},{"type":"v1","addr":"172.21.15.31:6834","nonce":3853703125}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:22:12.504027+0000","modified":"2023-10-09T06:22:16.130642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/1366477380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1366477380},{"type":"v1","addr":"172.21.15.158:6836","nonce":1366477380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:22:21.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.519+0000 7f21c200a700 1 -- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21a8066f30 msgr2=0x7f21a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:21.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.519+0000 7f21c200a700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21a8066f30 0x7f21a80693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f21bc09d150 tx=0x7f21ac009040 comp rx=0 tx=0).stop 2023-10-09T06:22:21.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.519+0000 7f21c200a700 1 -- 172.21.15.31:0/1046229996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21bc0cf810 msgr2=0x7f21bc0ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:21.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.519+0000 7f21c200a700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21bc0cf810 0x7f21bc0ca9b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f21b000ec80 tx=0x7f21b00091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:21.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.519+0000 7f21c200a700 1 -- 172.21.15.31:0/1046229996 shutdown_connections 2023-10-09T06:22:21.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.519+0000 7f21c200a700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21a8066f30 0x7f21a80693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:21.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.519+0000 7f21c200a700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21bc15a030 0x7f21bc0cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:21.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.519+0000 7f21c200a700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21bc0b50c0 0x7f21bc0c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:21.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.519+0000 7f21c200a700 1 --2- 172.21.15.31:0/1046229996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21bc0cf810 0x7f21bc0ca9b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:21.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.519+0000 7f21c200a700 1 -- 172.21.15.31:0/1046229996 >> 172.21.15.31:0/1046229996 conn(0x7f21bc067e40 msgr2=0x7f21bc0b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:21.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.519+0000 7f21c200a700 1 -- 172.21.15.31:0/1046229996 shutdown_connections 2023-10-09T06:22:21.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:21.519+0000 7f21c200a700 1 -- 172.21.15.31:0/1046229996 wait complete. 2023-10-09T06:22:21.520 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 25 2023-10-09T06:22:21.533 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-09T06:22:21.666 INFO:teuthology.orchestra.run.smithi158.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":5307,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5385017780000005,"mdsmap_epoch":25,"osdmap_epoch":45,"osdmap_epoch_barrier":45,"uptime":13.471385533999999} 2023-10-09T06:22:21.666 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 5307, "mdsmap_epoch": 25, "osdmap_epoch": 45, "osdmap_epoch_barrier": 45, "rank_uptime": 8.538501778, "state": "up:active", "uptime": 13.471385534, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:22:21.667 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T06:22:21.801 INFO:teuthology.orchestra.run.smithi031.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T06:22:21.802 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T06:22:21.802 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-09T06:22:21.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:22:21.802 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-09T06:22:23.185 INFO:teuthology.orchestra.run.smithi031.stderr:265+0 records in 2023-10-09T06:22:23.185 INFO:teuthology.orchestra.run.smithi031.stderr:265+0 records out 2023-10-09T06:22:23.185 INFO:teuthology.orchestra.run.smithi031.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.3649 s, 204 MB/s 2023-10-09T06:22:23.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:22:23.186 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-09T06:22:24.762 INFO:teuthology.orchestra.run.smithi031.stderr:292+0 records in 2023-10-09T06:22:24.763 INFO:teuthology.orchestra.run.smithi031.stderr:292+0 records out 2023-10-09T06:22:24.763 INFO:teuthology.orchestra.run.smithi031.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.55986 s, 196 MB/s 2023-10-09T06:22:24.764 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-09T06:22:24.764 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:22:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.882+0000 7faa8359e700 1 Processor -- start 2023-10-09T06:22:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.882+0000 7faa8359e700 1 -- start start 2023-10-09T06:22:24.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa840cd6e0 0x7faa840cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:24.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8359e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa840cdab0 0x7faa8415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:24.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faa8415dda0 0x7faa8415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:24.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8415e850 con 0x7faa840cd6e0 2023-10-09T06:22:24.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8359e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa840cd030 con 0x7faa8415dda0 2023-10-09T06:22:24.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8359e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa840cb7c0 con 0x7faa840cdab0 2023-10-09T06:22:24.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa840cd6e0 0x7faa840cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:24.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa840cd6e0 0x7faa840cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35004/0 (socket says 172.21.15.31:35004) 2023-10-09T06:22:24.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8259c700 1 -- 172.21.15.31:0/3944582255 learned_addr learned my addr 172.21.15.31:0/3944582255 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:24.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa82d9d700 1 --2- 172.21.15.31:0/3944582255 >> v2:172.21.15.158:3300/0 conn(0x7faa8415dda0 0x7faa8415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:24.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa81d9b700 1 --2- 172.21.15.31:0/3944582255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa840cdab0 0x7faa8415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:24.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8259c700 1 -- 172.21.15.31:0/3944582255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa840cdab0 msgr2=0x7faa8415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8259c700 1 --2- 172.21.15.31:0/3944582255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa840cdab0 0x7faa8415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8259c700 1 -- 172.21.15.31:0/3944582255 >> v2:172.21.15.158:3300/0 conn(0x7faa8415dda0 msgr2=0x7faa8415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8259c700 1 --2- 172.21.15.31:0/3944582255 >> v2:172.21.15.158:3300/0 conn(0x7faa8415dda0 0x7faa8415cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.883+0000 7faa8259c700 1 -- 172.21.15.31:0/3944582255 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8415e290 con 0x7faa840cd6e0 2023-10-09T06:22:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.884+0000 7faa8259c700 1 --2- 172.21.15.31:0/3944582255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa840cd6e0 0x7faa840cbc50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7faa84089ac0 tx=0x7faa74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f3912bcfb33e01 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.884+0000 7faa8159a700 1 -- 172.21.15.31:0/3944582255 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400e070 con 0x7faa840cd6e0 2023-10-09T06:22:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.884+0000 7faa8159a700 1 -- 172.21.15.31:0/3944582255 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7400ba50 con 0x7faa840cd6e0 2023-10-09T06:22:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.884+0000 7faa8159a700 1 -- 172.21.15.31:0/3944582255 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa740092e0 con 0x7faa840cd6e0 2023-10-09T06:22:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.884+0000 7faa8359e700 1 -- 172.21.15.31:0/3944582255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa840cd6e0 msgr2=0x7faa840cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.884+0000 7faa8359e700 1 --2- 172.21.15.31:0/3944582255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa840cd6e0 0x7faa840cbc50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7faa84089ac0 tx=0x7faa74009840 comp rx=0 tx=0).stop 2023-10-09T06:22:24.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.884+0000 7faa8359e700 1 -- 172.21.15.31:0/3944582255 shutdown_connections 2023-10-09T06:22:24.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.884+0000 7faa8359e700 1 --2- 172.21.15.31:0/3944582255 >> v2:172.21.15.158:3300/0 conn(0x7faa8415dda0 0x7faa8415cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:24.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.884+0000 7faa8359e700 1 --2- 172.21.15.31:0/3944582255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa840cd6e0 0x7faa840cbc50 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:24.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.884+0000 7faa8359e700 1 --2- 172.21.15.31:0/3944582255 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa840cdab0 0x7faa8415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:24.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.884+0000 7faa8359e700 1 -- 172.21.15.31:0/3944582255 >> 172.21.15.31:0/3944582255 conn(0x7faa84067660 msgr2=0x7faa84067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:24.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.884+0000 7faa8359e700 1 -- 172.21.15.31:0/3944582255 shutdown_connections 2023-10-09T06:22:24.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.884+0000 7faa8359e700 1 -- 172.21.15.31:0/3944582255 wait complete. 2023-10-09T06:22:24.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.885+0000 7faa8359e700 1 Processor -- start 2023-10-09T06:22:24.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.885+0000 7faa8359e700 1 -- start start 2023-10-09T06:22:24.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.886+0000 7faa8359e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa840cd6e0 0x7faa84147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:24.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.886+0000 7faa8359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa840cdab0 0x7faa840b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:24.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.886+0000 7faa8359e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa8415dda0 0x7faa841590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:24.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.886+0000 7faa8359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa84147cb0 con 0x7faa840cdab0 2023-10-09T06:22:24.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.886+0000 7faa8359e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa840c8be0 con 0x7faa840cd6e0 2023-10-09T06:22:24.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.886+0000 7faa8359e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa840c91a0 con 0x7faa8415dda0 2023-10-09T06:22:24.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.886+0000 7faa81d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa840cdab0 0x7faa840b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:24.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.886+0000 7faa81d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa840cdab0 0x7faa840b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35016/0 (socket says 172.21.15.31:35016) 2023-10-09T06:22:24.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.886+0000 7faa81d9b700 1 -- 172.21.15.31:0/2535005207 learned_addr learned my addr 172.21.15.31:0/2535005207 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:24.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.886+0000 7faa8259c700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa840cd6e0 0x7faa84147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:24.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.886+0000 7faa82d9d700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa8415dda0 0x7faa841590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:24.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.887+0000 7faa81d9b700 1 -- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa8415dda0 msgr2=0x7faa841590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:24.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.887+0000 7faa81d9b700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa8415dda0 0x7faa841590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:24.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.887+0000 7faa81d9b700 1 -- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa840cd6e0 msgr2=0x7faa84147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:24.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.887+0000 7faa81d9b700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa840cd6e0 0x7faa84147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:24.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.887+0000 7faa81d9b700 1 -- 172.21.15.31:0/2535005207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa74009ae0 con 0x7faa840cdab0 2023-10-09T06:22:24.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.887+0000 7faa81d9b700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa840cdab0 0x7faa840b1bf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00d8c0 tx=0x7faa6c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:24.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.887+0000 7faa7a7fc700 1 -- 172.21.15.31:0/2535005207 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0125f0 con 0x7faa840cdab0 2023-10-09T06:22:24.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.887+0000 7faa7a7fc700 1 -- 172.21.15.31:0/2535005207 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c012750 con 0x7faa840cdab0 2023-10-09T06:22:24.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.887+0000 7faa8359e700 1 -- 172.21.15.31:0/2535005207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa840b2690 con 0x7faa840cdab0 2023-10-09T06:22:24.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.887+0000 7faa7a7fc700 1 -- 172.21.15.31:0/2535005207 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c012af0 con 0x7faa840cdab0 2023-10-09T06:22:24.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.887+0000 7faa8359e700 1 -- 172.21.15.31:0/2535005207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa840c8e30 con 0x7faa840cdab0 2023-10-09T06:22:24.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.888+0000 7faa8359e700 1 -- 172.21.15.31:0/2535005207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa840c9330 con 0x7faa840cdab0 2023-10-09T06:22:24.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.888+0000 7faa7a7fc700 1 -- 172.21.15.31:0/2535005207 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa6c01e460 con 0x7faa840cdab0 2023-10-09T06:22:24.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.889+0000 7faa7a7fc700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faa64066f30 0x7faa640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:24.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.889+0000 7faa7a7fc700 1 -- 172.21.15.31:0/2535005207 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa6c084a70 con 0x7faa840cdab0 2023-10-09T06:22:24.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.889+0000 7faa8259c700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faa64066f30 0x7faa640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:24.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.889+0000 7faa8259c700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faa64066f30 0x7faa640693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faa74009880 tx=0x7faa74018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:24.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:24.893+0000 7faa7a7fc700 1 -- 172.21.15.31:0/2535005207 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa6c051ce0 con 0x7faa840cdab0 2023-10-09T06:22:25.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.085+0000 7faa8359e700 1 -- 172.21.15.31:0/2535005207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7faa8415e570 con 0x7faa840cdab0 2023-10-09T06:22:25.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.086+0000 7faa7a7fc700 1 -- 172.21.15.31:0/2535005207 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v45) v1 ==== 81+0+32260 (secure 0 0 0) 0x7faa6c055300 con 0x7faa840cdab0 2023-10-09T06:22:25.087 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:25.087 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:22:25.087 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 45, 2023-10-09T06:22:25.087 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:22:25.087 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:22:25.087 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:22:14.102446+0000", 2023-10-09T06:22:25.088 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:22:25.088 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:22:25.088 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:22:25.088 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:22:25.088 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:22:25.088 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:22:25.088 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:22:25.088 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:22:25.088 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:22:25.088 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:25.088 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:22:25.089 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:22:25.089 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:22:25.089 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:22:25.089 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:22:25.089 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 7, 2023-10-09T06:22:25.089 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:22:25.089 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:22:25.089 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:22:25.089 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:22:25.089 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:22:25.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.089 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:22:25.090 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:22:25.090 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:22:25.090 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:22:25.090 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:22:25.090 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:25.090 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:25.090 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:25.090 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:25.090 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:25.090 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:25.090 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:25.091 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:25.091 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:25.091 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:25.091 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:22:25.091 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:22:25.091 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:22:25.091 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:22:25.091 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:22:25.091 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:25.092 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:25.092 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:25.092 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:25.092 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:25.092 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:25.092 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:25.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.092 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "16", 2023-10-09T06:22:25.092 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:25.092 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:25.092 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:25.092 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:25.093 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:25.093 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:25.093 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:25.093 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:25.093 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:25.093 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:25.093 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:25.093 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:25.093 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:25.093 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:25.093 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:25.093 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:25.094 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:25.094 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:25.094 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:25.094 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:25.094 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:25.094 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:25.094 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:25.094 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:25.094 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:25.095 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:25.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.095 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:25.095 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:25.095 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:25.095 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:25.095 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:25.095 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:25.095 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:25.095 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:25.095 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:25.095 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:25.096 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:25.096 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:25.096 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:22:25.096 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:22:25.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.096 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:25.096 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:22:25.096 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.096 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 6, 2023-10-09T06:22:25.096 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:22:25.097 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:10.914998+0000", 2023-10-09T06:22:25.097 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:22:25.097 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:22:25.097 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:25.097 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:25.097 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:25.097 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:25.097 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:25.097 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:25.097 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:25.097 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:25.097 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:25.098 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:25.098 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:22:25.098 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:22:25.098 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:22:25.098 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:22:25.098 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:22:25.098 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:25.098 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:25.098 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:25.098 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:25.098 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:25.099 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:25.099 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:25.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.099 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "44", 2023-10-09T06:22:25.099 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:25.099 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:25.099 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:25.099 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:25.099 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:25.099 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:25.099 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:25.099 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:25.100 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:25.100 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:25.100 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:25.100 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:25.100 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:25.100 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:25.100 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:25.100 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:25.100 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:25.101 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:25.101 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:25.101 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:25.101 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:25.101 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:25.101 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:25.101 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:25.101 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:25.101 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:25.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.101 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:25.101 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:25.102 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:25.102 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:25.102 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:25.102 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:25.102 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:25.102 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:25.102 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:25.102 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:25.102 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:25.103 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:25.103 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:22:25.103 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:22:25.103 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:22:25.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.103 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:25.103 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:25.103 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:22:25.103 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.103 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.104 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 7, 2023-10-09T06:22:25.104 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:22:25.104 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:11.476116+0000", 2023-10-09T06:22:25.104 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:22:25.104 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:22:25.104 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:25.104 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:25.104 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:25.104 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:25.104 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:25.104 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:25.105 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:25.105 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:25.105 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:25.105 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:25.105 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:22:25.105 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:22:25.105 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:22:25.105 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:22:25.105 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:22:25.105 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:25.105 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:25.105 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:25.106 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:25.106 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:25.106 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:25.106 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:25.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.106 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "45", 2023-10-09T06:22:25.106 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:25.106 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:25.106 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:25.106 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:25.106 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:25.106 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:25.107 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:25.107 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:25.107 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:25.107 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:25.107 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:25.107 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:25.107 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:25.107 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:25.107 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:25.107 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:25.107 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:25.107 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:25.108 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:25.108 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:25.108 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:25.108 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:25.108 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:25.108 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:25.108 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:25.108 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:25.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.108 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:25.108 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:25.108 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:25.109 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:25.109 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:25.109 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:25.109 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:25.109 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:25.109 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:25.109 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:25.109 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:25.109 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:25.109 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:22:25.109 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:22:25.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.110 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:25.110 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:25.110 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:22:25.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.110 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:25.110 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:22:25.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.110 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:25.110 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:25.111 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:25.111 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:25.111 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:25.111 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:25.111 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:25.111 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:25.111 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:25.111 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:25.111 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:25.111 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:25.111 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:25.112 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.112 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.112 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:22:25.112 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:25.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.112 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.112 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:22:25.113 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:25.113 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.113 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.113 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:25.113 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.113 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.113 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:22:25.114 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:25.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.114 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.114 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:22:25.114 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:25.114 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.114 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.114 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:25.115 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.115 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.115 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:22:25.115 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:25.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.115 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.115 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:22:25.115 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:25.115 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.115 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.116 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:25.116 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.116 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.116 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:22:25.116 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:25.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.116 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.116 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:22:25.116 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:25.116 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.117 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.117 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:22:25.117 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:22:25.117 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:22:25.117 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:22:25.117 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:25.117 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:25.117 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:25.117 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.118 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:25.118 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:25.118 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:25.118 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:25.118 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:25.118 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:25.118 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:25.118 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:25.118 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:25.118 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:25.118 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:25.118 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:25.119 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:25.119 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.119 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.119 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:22:25.119 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:25.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.119 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.120 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:22:25.120 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:25.120 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.120 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.120 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:25.120 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.120 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.121 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:22:25.121 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:25.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.121 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.121 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:22:25.121 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:25.121 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.121 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.121 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:25.121 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.122 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.122 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:22:25.122 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:25.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.122 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.122 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:22:25.122 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:25.122 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.122 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.123 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:25.123 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.123 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.123 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:22:25.123 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:25.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.123 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.123 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:22:25.123 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:25.123 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.124 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.124 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:22:25.124 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:22:25.124 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:22:25.124 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:22:25.124 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:25.124 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:25.124 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:25.124 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.124 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:25.125 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:25.125 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:25.125 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:25.125 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:25.125 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:25.125 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:25.125 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:25.125 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:25.125 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:25.125 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:25.125 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:25.125 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:25.126 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.126 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.126 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:22:25.126 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:25.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.126 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.126 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:22:25.126 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:25.126 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.126 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.127 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:25.127 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.127 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.127 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:22:25.127 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:25.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.127 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.127 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:22:25.127 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:25.128 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.128 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.128 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:25.128 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.128 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.128 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:22:25.128 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:25.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.128 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.129 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:22:25.129 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:25.129 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.129 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.129 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:25.129 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.129 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.129 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:22:25.129 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:25.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.130 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.130 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:22:25.130 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:25.130 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.130 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.130 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:22:25.130 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:22:25.130 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:22:25.130 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:22:25.130 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:25.131 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:25.131 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:25.131 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.131 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:25.131 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:25.131 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:25.131 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:25.131 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:25.131 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:25.132 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:25.132 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:25.132 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:25.132 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:25.132 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:25.132 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:25.132 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:25.132 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.133 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.133 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:22:25.133 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:25.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.133 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.133 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:22:25.133 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:25.133 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.134 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.134 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:25.134 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.134 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.134 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:22:25.134 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:25.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.135 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.135 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:22:25.135 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:25.135 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.135 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.135 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:25.135 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.135 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.135 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:22:25.136 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:25.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.136 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.136 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:22:25.136 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:25.136 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.136 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.136 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:25.136 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.137 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.137 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:22:25.137 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:25.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.137 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.137 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:22:25.137 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:25.137 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.137 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.137 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:22:25.138 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:22:25.138 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:22:25.138 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:22:25.138 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:25.138 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:25.139 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:25.139 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.139 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:25.140 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:25.140 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:25.140 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:25.140 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:25.140 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:25.140 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:25.140 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:25.140 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:25.140 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:25.140 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:25.141 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:25.141 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:25.141 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.141 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.141 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:22:25.141 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:25.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.142 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.142 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:22:25.142 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:25.142 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.142 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.142 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:25.142 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.143 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.143 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:22:25.143 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:25.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.143 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.143 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:22:25.144 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:25.144 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.144 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.144 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:25.144 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.144 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.144 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.144 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:22:25.145 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:25.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.145 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.145 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:22:25.145 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:25.145 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.145 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.146 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:25.146 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.146 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.146 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:22:25.146 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:25.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.147 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.147 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:22:25.147 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:25.147 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.147 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.147 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:22:25.148 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:22:25.148 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:22:25.148 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:22:25.148 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:25.148 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:25.148 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:25.148 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:22:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:22:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:22:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:22:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:22:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:22:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:22:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:22:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:22:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:22:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:22:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:22:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:22:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:22:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:22:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:22:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:22:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:22:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:22:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:22:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:22:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:22:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:22:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:22:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:22:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:22:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:22:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:22:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:22:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:22:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:22:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:22:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:22:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:22:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:22:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:22:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:22:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:22:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:22:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:22:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:22:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:22:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:22:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:22:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:22:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:22:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:22:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:22:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:22:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:22:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:22:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:22:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:22:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:22:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:22:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:22:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:22:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:22:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:22:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:22:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:22:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:22:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:22:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:22:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:22:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:22:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:22:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:22:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:22:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:25.190 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:22:25.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.088+0000 7faa8359e700 1 -- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faa64066f30 msgr2=0x7faa640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:25.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.088+0000 7faa8359e700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faa64066f30 0x7faa640693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faa74009880 tx=0x7faa74018000 comp rx=0 tx=0).stop 2023-10-09T06:22:25.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.088+0000 7faa8359e700 1 -- 172.21.15.31:0/2535005207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa840cdab0 msgr2=0x7faa840b1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:25.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.088+0000 7faa8359e700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa840cdab0 0x7faa840b1bf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00d8c0 tx=0x7faa6c008040 comp rx=0 tx=0).stop 2023-10-09T06:22:25.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.088+0000 7faa8359e700 1 -- 172.21.15.31:0/2535005207 shutdown_connections 2023-10-09T06:22:25.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.088+0000 7faa8359e700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faa64066f30 0x7faa640693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:25.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.088+0000 7faa8359e700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faa8415dda0 0x7faa841590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:25.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.088+0000 7faa8359e700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa840cd6e0 0x7faa84147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:25.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.088+0000 7faa8359e700 1 --2- 172.21.15.31:0/2535005207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa840cdab0 0x7faa840b1bf0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:25.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.088+0000 7faa8359e700 1 -- 172.21.15.31:0/2535005207 >> 172.21.15.31:0/2535005207 conn(0x7faa84067660 msgr2=0x7faa84156850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:25.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.088+0000 7faa8359e700 1 -- 172.21.15.31:0/2535005207 shutdown_connections 2023-10-09T06:22:25.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:25.088+0000 7faa8359e700 1 -- 172.21.15.31:0/2535005207 wait complete. 2023-10-09T06:22:25.195 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:22:25.775 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:22:25.778 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:22:26.597 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:22:26.597+0000 7fc5eaab7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-09T06:22:30.197 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:22:30.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.329+0000 7fb4f35a7700 1 Processor -- start 2023-10-09T06:22:30.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.329+0000 7fb4f35a7700 1 -- start start 2023-10-09T06:22:30.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4f35a7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4ec159e10 0x7fb4ec0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:30.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4f35a7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb4ec15a1e0 0x7fb4ec0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:30.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4f35a7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ec15db80 con 0x7fb4ec0b1610 2023-10-09T06:22:30.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4f35a7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ec15e800 con 0x7fb4ec159e10 2023-10-09T06:22:30.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4f35a7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ec15de60 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4f1343700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4ec159e10 0x7fb4ec0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:30.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4f1b44700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb4ec0b1610 0x7fb4ec0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54264/0 (socket says 172.21.15.31:54264) 2023-10-09T06:22:30.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4f1b44700 1 -- 172.21.15.31:0/3555873367 learned_addr learned my addr 172.21.15.31:0/3555873367 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:30.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4f0b42700 1 --2- 172.21.15.31:0/3555873367 >> v2:172.21.15.158:3300/0 conn(0x7fb4ec15a1e0 0x7fb4ec0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:30.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4f1343700 1 -- 172.21.15.31:0/3555873367 >> v2:172.21.15.158:3300/0 conn(0x7fb4ec15a1e0 msgr2=0x7fb4ec0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:30.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4f1343700 1 --2- 172.21.15.31:0/3555873367 >> v2:172.21.15.158:3300/0 conn(0x7fb4ec15a1e0 0x7fb4ec0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:30.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4f1343700 1 -- 172.21.15.31:0/3555873367 >> v1:172.21.15.31:6789/0 conn(0x7fb4ec0b1610 legacy=0x7fb4ec0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:30.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4ebfff700 1 -- 172.21.15.31:0/3555873367 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115049277 0 0) 0x7fb4ec15db80 con 0x7fb4ec0b1610 2023-10-09T06:22:30.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.330+0000 7fb4f1343700 1 -- 172.21.15.31:0/3555873367 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec15e140 con 0x7fb4ec159e10 2023-10-09T06:22:30.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.331+0000 7fb4f1343700 1 --2- 172.21.15.31:0/3555873367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ec159e10 0x7fb4ec0b2d20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec068580 tx=0x7fb4dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efb0884e9eef410 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:30.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.331+0000 7fb4ebfff700 1 -- 172.21.15.31:0/3555873367 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00e070 con 0x7fb4ec159e10 2023-10-09T06:22:30.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.331+0000 7fb4ebfff700 1 -- 172.21.15.31:0/3555873367 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc00bc30 con 0x7fb4ec159e10 2023-10-09T06:22:30.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.331+0000 7fb4ebfff700 1 -- 172.21.15.31:0/3555873367 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc012430 con 0x7fb4ec159e10 2023-10-09T06:22:30.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.331+0000 7fb4f35a7700 1 -- 172.21.15.31:0/3555873367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ec159e10 msgr2=0x7fb4ec0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:30.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.331+0000 7fb4f35a7700 1 --2- 172.21.15.31:0/3555873367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ec159e10 0x7fb4ec0b2d20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec068580 tx=0x7fb4dc009780 comp rx=0 tx=0).stop 2023-10-09T06:22:30.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.331+0000 7fb4f35a7700 1 -- 172.21.15.31:0/3555873367 shutdown_connections 2023-10-09T06:22:30.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.331+0000 7fb4f35a7700 1 --2- 172.21.15.31:0/3555873367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ec159e10 0x7fb4ec0b2d20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:30.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.331+0000 7fb4f35a7700 1 --2- 172.21.15.31:0/3555873367 >> v2:172.21.15.158:3300/0 conn(0x7fb4ec15a1e0 0x7fb4ec0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:30.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.331+0000 7fb4f35a7700 1 -- 172.21.15.31:0/3555873367 >> 172.21.15.31:0/3555873367 conn(0x7fb4ec067660 msgr2=0x7fb4ec067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:30.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.331+0000 7fb4f35a7700 1 -- 172.21.15.31:0/3555873367 shutdown_connections 2023-10-09T06:22:30.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.331+0000 7fb4f35a7700 1 -- 172.21.15.31:0/3555873367 wait complete. 2023-10-09T06:22:30.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.332+0000 7fb4f35a7700 1 Processor -- start 2023-10-09T06:22:30.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.333+0000 7fb4f35a7700 1 -- start start 2023-10-09T06:22:30.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.333+0000 7fb4f35a7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb4ec0b1610 0x7fb4ec0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:30.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.333+0000 7fb4f35a7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4ec159e10 0x7fb4ec0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:30.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.333+0000 7fb4f35a7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ec15a1e0 0x7fb4ec0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:30.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.333+0000 7fb4f35a7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0ca2c0 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.333+0000 7fb4f35a7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0c9410 con 0x7fb4ec159e10 2023-10-09T06:22:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.333+0000 7fb4f35a7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0c96b0 con 0x7fb4ec0b1610 2023-10-09T06:22:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.333+0000 7fb4f1b44700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ec15a1e0 0x7fb4ec0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4f1b44700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ec15a1e0 0x7fb4ec0ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49068/0 (socket says 172.21.15.31:49068) 2023-10-09T06:22:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4f1b44700 1 -- 172.21.15.31:0/4010501686 learned_addr learned my addr 172.21.15.31:0/4010501686 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4f1343700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb4ec0b1610 0x7fb4ec0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4f0b42700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4ec159e10 0x7fb4ec0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4f1b44700 1 -- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb4ec0b1610 msgr2=0x7fb4ec0d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4f1b44700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb4ec0b1610 0x7fb4ec0d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4f1b44700 1 -- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4ec159e10 msgr2=0x7fb4ec0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4f1b44700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4ec159e10 0x7fb4ec0c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4f1b44700 1 -- 172.21.15.31:0/4010501686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc009a20 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4f1b44700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ec15a1e0 0x7fb4ec0ce870 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400c810 tx=0x7fb4e4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4e97fa700 1 -- 172.21.15.31:0/4010501686 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4005c00 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4e97fa700 1 -- 172.21.15.31:0/4010501686 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e4005d60 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4e97fa700 1 -- 172.21.15.31:0/4010501686 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4007320 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4f35a7700 1 -- 172.21.15.31:0/4010501686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ec0c9990 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.334+0000 7fb4f35a7700 1 -- 172.21.15.31:0/4010501686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec0c9f50 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.335+0000 7fb4f35a7700 1 -- 172.21.15.31:0/4010501686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ec04c3c0 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.336+0000 7fb4e97fa700 1 -- 172.21.15.31:0/4010501686 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4e401b3b0 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.336+0000 7fb4e97fa700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb4d8066f30 0x7fb4d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:30.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.336+0000 7fb4e97fa700 1 -- 172.21.15.31:0/4010501686 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb4e40839f0 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.336+0000 7fb4e97fa700 1 -- 172.21.15.31:0/4010501686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=49}) v3 -- 0x7fb4d806ea50 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.336+0000 7fb4f1343700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb4d8066f30 0x7fb4d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:30.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.337+0000 7fb4f1343700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb4d8066f30 0x7fb4d80693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec068580 tx=0x7fb4dc019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:30.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.341+0000 7fb4e97fa700 1 -- 172.21.15.31:0/4010501686 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4e4017070 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.536+0000 7fb4f35a7700 1 -- 172.21.15.31:0/4010501686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb4ec15e420 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.537+0000 7fb4e97fa700 1 -- 172.21.15.31:0/4010501686 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+32403 (secure 0 0 0) 0x7fb4e4050c60 con 0x7fb4ec15a1e0 2023-10-09T06:22:30.538 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:30.539 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:22:30.539 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 48, 2023-10-09T06:22:30.539 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:22:30.539 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:22:30.539 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:22:28.679925+0000", 2023-10-09T06:22:30.539 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:22:30.539 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:22:30.539 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:22:30.539 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:22:30.540 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:22:30.540 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:22:30.540 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:22:30.540 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:22:30.540 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:22:30.540 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:30.540 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:22:30.540 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:22:30.540 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:22:30.541 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:22:30.541 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:22:30.541 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 7, 2023-10-09T06:22:30.541 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:22:30.541 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:22:30.541 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:22:30.541 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:22:30.541 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:22:30.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.541 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:22:30.542 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:22:30.542 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:22:30.542 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:22:30.542 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:22:30.542 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:30.542 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:30.542 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:30.542 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:30.542 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:30.542 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:30.543 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:30.543 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:30.543 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:30.543 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:30.543 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:22:30.543 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:22:30.543 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:22:30.543 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:22:30.543 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:22:30.544 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:30.544 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:30.544 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:30.544 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:30.544 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:30.544 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:30.544 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:30.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.544 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "46", 2023-10-09T06:22:30.545 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:30.545 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:30.545 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:30.545 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:30.545 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:30.545 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:30.545 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:30.545 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:30.546 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:30.546 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:30.546 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:30.546 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:30.546 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:30.546 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:30.546 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:30.546 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:30.546 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:22:30.549 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:22:30.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.549 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:30.549 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:22:30.549 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.549 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 6, 2023-10-09T06:22:30.549 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:22:30.549 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:10.914998+0000", 2023-10-09T06:22:30.549 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:22:30.549 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:22:30.550 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:30.550 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:30.550 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:30.550 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:30.550 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:30.550 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:30.550 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:30.550 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:30.550 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:30.550 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:30.550 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:22:30.551 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:22:30.551 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:22:30.551 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:22:30.552 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:22:30.552 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:30.552 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:30.552 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:30.552 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:30.552 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:30.552 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:30.552 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:30.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.552 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "46", 2023-10-09T06:22:30.552 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:30.553 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:30.553 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:30.553 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:30.553 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:30.553 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:30.553 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:30.553 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:30.553 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:30.553 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:30.553 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:30.553 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:30.554 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:30.554 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:30.554 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:30.554 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:30.554 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:30.554 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:30.554 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:30.554 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:30.554 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:30.554 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:30.554 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:30.554 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:30.555 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:30.555 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:30.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.555 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:30.555 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:30.555 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:30.555 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:30.555 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:30.555 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:30.555 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:30.555 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:30.555 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:30.556 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:30.556 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:30.556 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:30.556 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:22:30.556 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:22:30.556 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:22:30.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.556 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:30.556 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:30.556 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:22:30.556 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.556 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.557 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 7, 2023-10-09T06:22:30.557 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:22:30.557 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:11.476116+0000", 2023-10-09T06:22:30.557 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:22:30.557 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:22:30.557 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:30.557 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:30.557 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:30.557 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:30.557 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:30.557 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:30.558 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:30.558 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:30.558 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:30.558 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:30.558 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:22:30.558 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:22:30.558 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:22:30.558 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:22:30.558 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:22:30.558 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:30.558 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:30.558 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:30.559 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:30.559 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:30.559 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:30.559 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:30.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.559 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "46", 2023-10-09T06:22:30.559 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:30.559 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:30.559 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:30.559 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:30.559 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:30.559 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:30.560 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:30.560 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:30.560 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:30.560 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:30.560 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:30.560 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:30.560 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:30.560 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:30.560 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:30.560 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:30.560 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:30.560 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:30.561 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:30.561 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:30.561 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:30.561 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:30.561 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:30.561 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:30.561 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:30.561 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:30.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.561 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:30.561 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:30.562 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:30.562 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:30.562 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:30.562 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:30.562 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:30.562 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:30.562 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:30.562 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:30.562 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:30.562 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:30.562 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:22:30.563 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:22:30.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.563 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:30.563 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:30.563 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:22:30.563 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.563 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.563 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.563 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:30.563 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:22:30.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.563 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:30.564 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:30.564 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:30.564 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:30.564 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:30.564 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:30.564 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:30.564 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:30.564 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:30.564 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:30.564 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:30.564 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:30.565 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:30.565 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.565 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.565 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:22:30.565 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:30.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.565 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.565 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:22:30.565 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:30.566 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.566 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.566 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:30.566 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.566 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.566 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:22:30.566 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:30.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.567 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.567 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:22:30.567 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:30.567 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.567 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.567 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:30.567 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.568 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.568 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:22:30.568 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:30.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.568 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.568 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:22:30.568 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:30.568 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.568 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.569 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:30.569 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.569 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.569 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:22:30.569 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:30.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.570 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.570 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:22:30.570 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:30.570 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.570 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.570 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:22:30.570 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:22:30.570 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:22:30.570 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:22:30.570 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:30.571 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:30.571 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:30.571 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:30.571 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.571 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:30.571 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:30.571 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:30.571 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:30.571 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:30.571 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:30.571 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:30.572 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:30.572 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:30.572 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:30.572 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:30.572 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:30.572 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:30.572 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.572 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.572 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:22:30.572 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:30.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.573 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.573 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:22:30.573 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:30.573 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.573 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.573 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:30.574 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.574 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.574 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:22:30.574 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:30.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.574 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.574 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:22:30.574 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:30.574 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.575 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.575 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:30.575 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.575 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.575 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:22:30.575 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:30.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.576 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.576 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:22:30.576 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:30.576 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.576 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.576 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:30.576 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.576 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.577 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:22:30.577 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:30.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.577 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.577 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:22:30.577 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:30.577 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.577 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.578 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:22:30.578 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:22:30.578 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:22:30.578 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:22:30.578 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:30.578 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:30.578 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:30.578 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.579 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:30.579 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:30.579 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:30.579 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:30.579 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:30.579 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:30.579 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:30.579 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:30.579 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:30.580 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:30.580 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:30.580 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:30.580 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:30.580 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.580 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.580 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:22:30.580 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:30.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.581 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.581 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:22:30.581 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:30.581 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.581 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.581 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:30.582 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.582 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.582 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:22:30.582 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:30.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.582 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.582 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:22:30.582 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:30.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.583 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.583 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:30.583 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.583 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.583 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:22:30.583 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:30.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.583 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.583 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:22:30.584 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:30.584 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.584 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.584 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:30.584 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.584 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.584 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:22:30.584 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:30.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.585 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.585 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:22:30.585 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:30.585 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.585 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.585 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:22:30.585 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:22:30.585 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:22:30.585 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:22:30.585 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:30.586 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:30.586 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:30.586 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:30.586 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.586 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:30.586 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:30.586 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:30.586 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:30.586 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:30.586 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:30.587 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:30.587 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:30.587 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:30.587 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:30.587 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:30.587 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:30.587 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:30.587 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.587 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.587 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:22:30.588 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:30.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.588 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.588 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:22:30.588 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:30.588 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.588 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.588 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:30.588 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.589 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.589 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:22:30.589 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:30.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.589 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.589 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:22:30.589 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:30.589 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.589 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.589 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:30.590 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.590 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.590 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:22:30.590 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:30.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.590 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.590 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:22:30.590 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:30.590 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.590 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.591 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:30.591 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.591 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.591 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:22:30.591 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:30.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.591 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.591 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:22:30.592 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:30.592 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.592 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.592 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:22:30.592 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:22:30.592 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:22:30.592 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:22:30.592 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:30.593 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull", 2023-10-09T06:22:30.593 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:30.593 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:30.593 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.593 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:30.593 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:30.593 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:30.593 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:30.593 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:30.594 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:30.594 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:30.594 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:30.594 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:30.594 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:30.594 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:30.594 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:30.594 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:30.594 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.594 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.594 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:22:30.595 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:30.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.595 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.595 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:22:30.595 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:30.595 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.595 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.595 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:30.595 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.596 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.596 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:22:30.596 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:30.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.596 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.596 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:22:30.596 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:30.596 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.596 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.597 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:30.597 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.597 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.597 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:22:30.597 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:30.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.597 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.597 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:22:30.597 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:30.598 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.598 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.598 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:30.598 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.598 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.598 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:22:30.598 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:30.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.598 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.599 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:22:30.599 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:30.599 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.599 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.599 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:22:30.599 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:22:30.599 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:22:30.599 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:22:30.599 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:30.599 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:30.600 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:30.600 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.600 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:30.600 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:30.600 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:30.600 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:30.600 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:30.600 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:30.600 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:30.600 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:30.601 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:30.601 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:30.601 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:30.601 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:30.601 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:30.601 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.601 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.601 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:22:30.601 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:30.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.602 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.602 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:22:30.602 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:30.602 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.602 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.602 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:30.602 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.603 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.603 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:22:30.603 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:30.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.603 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.603 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:22:30.603 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:30.603 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.603 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.603 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:30.604 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.604 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.604 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:22:30.604 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:30.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.604 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.605 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:22:30.605 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:30.605 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.605 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.605 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:30.605 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.605 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.605 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:22:30.605 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:30.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.606 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.606 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:22:30.606 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:30.606 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.606 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.606 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:22:30.607 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:22:30.607 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:22:30.607 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:22:30.607 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:30.607 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:30.607 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:30.607 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.607 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:30.608 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:30.608 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:30.608 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:30.608 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:30.608 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:30.608 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:30.608 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:30.608 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:30.609 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:30.609 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:30.609 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:30.609 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:30.609 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.609 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.609 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:22:30.609 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:30.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.610 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.610 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:22:30.610 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:30.610 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.610 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.610 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:30.610 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.611 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.611 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:22:30.611 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:30.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.611 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.611 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:22:30.611 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:30.611 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.612 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.612 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:30.612 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.612 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.612 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:22:30.612 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:30.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.613 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.613 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:22:30.613 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:30.613 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.613 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.613 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:30.613 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.614 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.614 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:22:30.614 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:30.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.614 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.614 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:22:30.615 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:30.615 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.615 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.615 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:22:30.615 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:22:30.615 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:22:30.615 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:22:30.615 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:30.615 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:30.615 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:30.616 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:30.616 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.616 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:30.616 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:30.616 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:30.616 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:30.616 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:30.616 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:30.616 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:30.617 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:30.617 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:30.617 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:30.617 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:30.617 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:30.617 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:30.617 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.617 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.617 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:22:30.618 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:30.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.618 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.618 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:22:30.618 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:30.618 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.618 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.618 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:30.618 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.619 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.619 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:22:30.619 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:30.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.619 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.619 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:22:30.619 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:30.619 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.620 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.620 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:30.620 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.620 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.620 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:22:30.620 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:30.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.620 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.621 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:22:30.621 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:30.621 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.621 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.621 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:30.621 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:30.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.621 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:30.621 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:22:30.621 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:30.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.622 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:30.622 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:22:30.622 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:30.622 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.622 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.622 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:22:30.622 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:22:30.622 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:22:30.622 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:22:30.623 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:30.623 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:30.623 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:30.623 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:30.623 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:30.623 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.623 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:30.623 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:22:30.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.623 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:30.623 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:30.623 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:30.624 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:30.624 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:30.624 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:30.624 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:22:30.624 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:30.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.624 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:30.624 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:30.624 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:30.624 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:30.624 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:30.625 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:30.625 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:22:30.625 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:30.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.625 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:30.625 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:30.625 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:30.625 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:30.625 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:30.625 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:30.625 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:22:30.626 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:30.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.626 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.626 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:30.626 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:30.626 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:30.626 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:30.626 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:30.626 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:30.626 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:22:30.626 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:30.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.627 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:30.627 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:30.627 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:30.627 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:30.627 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:30.627 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:30.627 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:22:30.627 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:30.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.628 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:30.628 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:30.628 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:30.628 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:30.628 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:30.628 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:30.628 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:22:30.628 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:30.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.628 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:30.628 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:30.628 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:30.629 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:30.629 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:30.629 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:30.629 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:22:30.629 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:30.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:30.629 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:30.629 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:30.629 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:30.629 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:30.630 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:30.630 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:30.630 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:22:30.630 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:30.630 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.630 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:30.630 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:22:30.630 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:22:30.630 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:22:30.630 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:22:30.630 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:22:30.630 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:22:30.631 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:22:30.631 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:22:30.631 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:22:30.631 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:22:30.631 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:22:30.631 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:22:30.631 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:22:30.631 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:30.631 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:22:30.631 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:22:30.631 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:22:30.632 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:22:30.632 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:22:30.632 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:22:30.632 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:22:30.632 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:22:30.632 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:22:30.632 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:22:30.632 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:22:30.632 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:30.632 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:22:30.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.539+0000 7fb4f35a7700 1 -- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb4d8066f30 msgr2=0x7fb4d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:30.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.539+0000 7fb4f35a7700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb4d8066f30 0x7fb4d80693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec068580 tx=0x7fb4dc019000 comp rx=0 tx=0).stop 2023-10-09T06:22:30.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.539+0000 7fb4f35a7700 1 -- 172.21.15.31:0/4010501686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ec15a1e0 msgr2=0x7fb4ec0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:30.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.539+0000 7fb4f35a7700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ec15a1e0 0x7fb4ec0ce870 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400c810 tx=0x7fb4e4007d90 comp rx=0 tx=0).stop 2023-10-09T06:22:30.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.540+0000 7fb4f35a7700 1 -- 172.21.15.31:0/4010501686 shutdown_connections 2023-10-09T06:22:30.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.540+0000 7fb4f35a7700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb4d8066f30 0x7fb4d80693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:30.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.540+0000 7fb4f35a7700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb4ec0b1610 0x7fb4ec0d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:30.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.540+0000 7fb4f35a7700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ec15a1e0 0x7fb4ec0ce870 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:30.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.540+0000 7fb4f35a7700 1 --2- 172.21.15.31:0/4010501686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4ec159e10 0x7fb4ec0c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:30.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.540+0000 7fb4f35a7700 1 -- 172.21.15.31:0/4010501686 >> 172.21.15.31:0/4010501686 conn(0x7fb4ec067660 msgr2=0x7fb4ec15a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:30.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.540+0000 7fb4f35a7700 1 -- 172.21.15.31:0/4010501686 shutdown_connections 2023-10-09T06:22:30.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:30.540+0000 7fb4f35a7700 1 -- 172.21.15.31:0/4010501686 wait complete. 2023-10-09T06:22:30.636 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-09T06:22:30.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:22:30.636 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-09T06:22:30.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:22:30.894 INFO:teuthology.orchestra.run.smithi031.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-09T06:22:30.894 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records in 2023-10-09T06:22:30.894 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records out 2023-10-09T06:22:30.894 INFO:teuthology.orchestra.run.smithi031.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.236287 s, 222 MB/s 2023-10-09T06:22:30.895 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:22:31.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.017+0000 7f48a5465700 1 Processor -- start 2023-10-09T06:22:31.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.017+0000 7f48a5465700 1 -- start start 2023-10-09T06:22:31.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.018+0000 7f48a5465700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f48a00abae0 0x7f48a00c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.018+0000 7f48a5465700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48a00c8b10 0x7f48a00c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.018+0000 7f48a5465700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a00c9cb0 con 0x7f48a00abeb0 2023-10-09T06:22:31.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.018+0000 7f48a5465700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a00c90a0 con 0x7f48a00abae0 2023-10-09T06:22:31.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.018+0000 7f48a5465700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00c9380 con 0x7f48a00c8b10 2023-10-09T06:22:31.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.018+0000 7f489e7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f48a00abeb0 0x7f48a00c8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54276/0 (socket says 172.21.15.31:54276) 2023-10-09T06:22:31.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.018+0000 7f489e7fc700 1 -- 172.21.15.31:0/170092253 learned_addr learned my addr 172.21.15.31:0/170092253 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.018+0000 7f489f7fe700 1 --2- 172.21.15.31:0/170092253 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48a00c8b10 0x7f48a00c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.018+0000 7f489effd700 1 --2- 172.21.15.31:0/170092253 >> v2:172.21.15.158:3300/0 conn(0x7f48a00abae0 0x7f48a00c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.018+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641782432 0 0) 0x7f48a00c9cb0 con 0x7f48a00abeb0 2023-10-09T06:22:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.018+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f488c003570 con 0x7f48a00abeb0 2023-10-09T06:22:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.018+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 146917609 0 0) 0x7f488c003570 con 0x7f48a00abeb0 2023-10-09T06:22:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.018+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48a00c8b10 msgr2=0x7f48a00c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 --2- 172.21.15.31:0/170092253 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48a00c8b10 0x7f48a00c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 >> v2:172.21.15.158:3300/0 conn(0x7f48a00abae0 msgr2=0x7f48a00c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 --2- 172.21.15.31:0/170092253 >> v2:172.21.15.158:3300/0 conn(0x7f48a00abae0 0x7f48a00c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a00c9660 con 0x7f48a00abeb0 2023-10-09T06:22:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f4888001470 con 0x7f48a00abeb0 2023-10-09T06:22:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 >> v1:172.21.15.31:6789/0 conn(0x7f48a00abeb0 legacy=0x7f48a00c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 --2- 172.21.15.31:0/170092253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488c003a60 0x7f488c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 --2- 172.21.15.31:0/170092253 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f488c004810 0x7f488c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 --2- 172.21.15.31:0/170092253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f488c0051c0 0x7f488c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00c90a0 con 0x7f488c003a60 2023-10-09T06:22:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00c9380 con 0x7f488c0051c0 2023-10-09T06:22:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c00c050 con 0x7f488c004810 2023-10-09T06:22:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489f7fe700 1 --2- 172.21.15.31:0/170092253 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48a00c8b10 0x7f48a00c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489effd700 1 --2- 172.21.15.31:0/170092253 >> v2:172.21.15.158:3300/0 conn(0x7f48a00abae0 0x7f48a00c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489effd700 1 --2- 172.21.15.31:0/170092253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488c003a60 0x7f488c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489e7fc700 1 --2- 172.21.15.31:0/170092253 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f488c004810 0x7f488c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489f7fe700 1 --2- 172.21.15.31:0/170092253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f488c0051c0 0x7f488c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489effd700 1 -- 172.21.15.31:0/170092253 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f488c004810 msgr2=0x7f488c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:31.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489effd700 1 --2- 172.21.15.31:0/170092253 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f488c004810 0x7f488c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489effd700 1 -- 172.21.15.31:0/170092253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f488c0051c0 msgr2=0x7f488c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:31.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489effd700 1 --2- 172.21.15.31:0/170092253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f488c0051c0 0x7f488c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489effd700 1 -- 172.21.15.31:0/170092253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c003570 con 0x7f488c003a60 2023-10-09T06:22:31.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489effd700 1 --2- 172.21.15.31:0/170092253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488c003a60 0x7f488c003e70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4898009ba0 tx=0x7f4898008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87c7ab7a6cabdae server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:31.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489800c070 con 0x7f488c003a60 2023-10-09T06:22:31.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489800e5e0 con 0x7f488c003a60 2023-10-09T06:22:31.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.019+0000 7f489dffb700 1 -- 172.21.15.31:0/170092253 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489800e790 con 0x7f488c003a60 2023-10-09T06:22:31.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.020+0000 7f48a5465700 1 -- 172.21.15.31:0/170092253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488c003a60 msgr2=0x7f488c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:31.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.020+0000 7f48a5465700 1 --2- 172.21.15.31:0/170092253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488c003a60 0x7f488c003e70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4898009ba0 tx=0x7f4898008040 comp rx=0 tx=0).stop 2023-10-09T06:22:31.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.020+0000 7f489f7fe700 1 -- 172.21.15.31:0/170092253 reap_dead start 2023-10-09T06:22:31.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.020+0000 7f48a5465700 1 -- 172.21.15.31:0/170092253 shutdown_connections 2023-10-09T06:22:31.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.020+0000 7f48a5465700 1 -- 172.21.15.31:0/170092253 >> 172.21.15.31:0/170092253 conn(0x7f48a0067660 msgr2=0x7f48a0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:31.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.020+0000 7f48a5465700 1 -- 172.21.15.31:0/170092253 shutdown_connections 2023-10-09T06:22:31.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.020+0000 7f48a5465700 1 -- 172.21.15.31:0/170092253 wait complete. 2023-10-09T06:22:31.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.021+0000 7f48a5465700 1 Processor -- start 2023-10-09T06:22:31.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.021+0000 7f48a5465700 1 -- start start 2023-10-09T06:22:31.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f48a5465700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488c003a60 0x7f48a00b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f48a5465700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48a00c02d0 0x7f48a00c0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f48a5465700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48a01583a0 0x7f48a0158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f48a5465700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a01654f0 con 0x7f488c003a60 2023-10-09T06:22:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f48a5465700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00c0d50 con 0x7f48a01583a0 2023-10-09T06:22:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f48a5465700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00c1030 con 0x7f48a00c02d0 2023-10-09T06:22:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f489effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488c003a60 0x7f48a00b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f489effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488c003a60 0x7f48a00b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49088/0 (socket says 172.21.15.31:49088) 2023-10-09T06:22:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f489effd700 1 -- 172.21.15.31:0/112677609 learned_addr learned my addr 172.21.15.31:0/112677609 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f489e7fc700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48a00c02d0 0x7f48a00c0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f489f7fe700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48a01583a0 0x7f48a0158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f489effd700 1 -- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48a00c02d0 msgr2=0x7f48a00c0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f489effd700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48a00c02d0 0x7f48a00c0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f489effd700 1 -- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48a01583a0 msgr2=0x7f48a0158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f489effd700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48a01583a0 0x7f48a0158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f489effd700 1 -- 172.21.15.31:0/112677609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a00c1310 con 0x7f488c003a60 2023-10-09T06:22:31.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.022+0000 7f489f7fe700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48a01583a0 0x7f48a0158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:31.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.023+0000 7f489effd700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488c003a60 0x7f48a00b13d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f488c00bfa0 tx=0x7f489801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:31.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.023+0000 7f4896ffd700 1 -- 172.21.15.31:0/112677609 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489800e750 con 0x7f488c003a60 2023-10-09T06:22:31.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.023+0000 7f4896ffd700 1 -- 172.21.15.31:0/112677609 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489801c440 con 0x7f488c003a60 2023-10-09T06:22:31.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.023+0000 7f48a5465700 1 -- 172.21.15.31:0/112677609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a00c1850 con 0x7f488c003a60 2023-10-09T06:22:31.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.023+0000 7f4896ffd700 1 -- 172.21.15.31:0/112677609 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489801c800 con 0x7f488c003a60 2023-10-09T06:22:31.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.023+0000 7f48a5465700 1 -- 172.21.15.31:0/112677609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a0158d50 con 0x7f488c003a60 2023-10-09T06:22:31.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.024+0000 7f48a5465700 1 -- 172.21.15.31:0/112677609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a00ab6d0 con 0x7f488c003a60 2023-10-09T06:22:31.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.024+0000 7f4896ffd700 1 -- 172.21.15.31:0/112677609 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f489801cc30 con 0x7f488c003a60 2023-10-09T06:22:31.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.025+0000 7f4896ffd700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4880066f30 0x7f48800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.025+0000 7f4896ffd700 1 -- 172.21.15.31:0/112677609 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4898085eb0 con 0x7f488c003a60 2023-10-09T06:22:31.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.025+0000 7f4896ffd700 1 -- 172.21.15.31:0/112677609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=49}) v3 -- 0x7f488006ea50 con 0x7f488c003a60 2023-10-09T06:22:31.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.025+0000 7f489e7fc700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4880066f30 0x7f48800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.025+0000 7f489e7fc700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4880066f30 0x7f48800693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f48a00c87a0 tx=0x7f4888001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:31.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.029+0000 7f4896ffd700 1 -- 172.21.15.31:0/112677609 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4898053120 con 0x7f488c003a60 2023-10-09T06:22:31.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.220+0000 7f48a5465700 1 -- 172.21.15.31:0/112677609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f48a004c3c0 con 0x7f488c003a60 2023-10-09T06:22:31.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.221+0000 7f4896ffd700 1 -- 172.21.15.31:0/112677609 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+32403 (secure 0 0 0) 0x7f489802a090 con 0x7f488c003a60 2023-10-09T06:22:31.222 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:31.222 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:22:31.223 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 48, 2023-10-09T06:22:31.223 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:22:31.223 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:22:31.223 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:22:28.679925+0000", 2023-10-09T06:22:31.223 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:22:31.223 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:22:31.223 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:22:31.223 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:22:31.223 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:22:31.223 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:22:31.223 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:22:31.224 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:22:31.224 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:22:31.224 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:31.224 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:22:31.224 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:22:31.224 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:22:31.224 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:22:31.224 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:22:31.224 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 7, 2023-10-09T06:22:31.224 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:22:31.224 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:22:31.224 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:22:31.225 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:22:31.225 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:22:31.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.225 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:22:31.225 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:22:31.225 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:22:31.225 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:22:31.225 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:22:31.225 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:31.225 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:31.226 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:31.226 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:31.226 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:31.226 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:31.226 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:31.226 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:31.226 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:31.226 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:31.226 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:22:31.226 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:22:31.227 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:22:31.227 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:22:31.227 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:22:31.227 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:31.227 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:31.227 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:31.227 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:31.227 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:31.227 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:31.227 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:31.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.228 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "46", 2023-10-09T06:22:31.228 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:31.228 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:31.228 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:31.228 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:31.228 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:31.228 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:31.228 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:31.228 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:31.229 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:31.229 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:31.229 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:31.229 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:31.229 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:31.229 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:31.229 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:31.229 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:31.230 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:31.230 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:31.230 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:31.230 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:31.230 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:31.230 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:31.230 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:31.230 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:31.230 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:31.231 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:31.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.231 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:31.231 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:31.231 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:31.231 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:31.231 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:31.231 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:31.232 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:31.232 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:31.232 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:31.232 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:31.232 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:31.232 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:31.232 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:22:31.232 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:22:31.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.233 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:31.233 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:22:31.233 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.233 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 6, 2023-10-09T06:22:31.233 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:22:31.233 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:10.914998+0000", 2023-10-09T06:22:31.233 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:22:31.233 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:22:31.233 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:31.233 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:31.234 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:31.234 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:31.234 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:31.234 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:31.234 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:31.234 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:31.234 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:31.234 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:31.234 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:22:31.234 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:22:31.234 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:22:31.235 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:22:31.235 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:22:31.235 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:31.235 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:31.235 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:31.235 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:31.235 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:31.235 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:31.235 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:31.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.235 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "46", 2023-10-09T06:22:31.235 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:31.236 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:31.236 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:31.236 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:31.236 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:31.236 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:31.236 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:31.236 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:31.236 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:31.236 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:31.236 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:31.236 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:31.236 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:31.237 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:31.237 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:31.237 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:31.237 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:31.237 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:31.237 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:31.237 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:31.237 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:31.237 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:31.237 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:31.237 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:31.238 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:31.238 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:31.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.238 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:31.238 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:31.238 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:31.238 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:31.238 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:31.238 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:31.238 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:31.238 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:31.238 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:31.239 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:31.239 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:31.239 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:31.239 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:22:31.239 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:22:31.239 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:22:31.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.239 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:31.239 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:31.239 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:22:31.239 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.239 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.240 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 7, 2023-10-09T06:22:31.240 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:22:31.240 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:11.476116+0000", 2023-10-09T06:22:31.240 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:22:31.240 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:22:31.240 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:31.240 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:31.240 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:31.240 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:31.241 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:31.241 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:31.241 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:31.241 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:31.241 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:31.241 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:31.241 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:22:31.241 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:22:31.241 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:22:31.241 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:22:31.241 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:22:31.241 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:31.241 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:31.242 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:31.242 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:31.242 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:31.242 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:31.242 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:31.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.242 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "46", 2023-10-09T06:22:31.242 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:31.242 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:31.242 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:31.242 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:31.242 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:31.243 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:31.243 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:31.243 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:31.243 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:31.243 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:31.243 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:31.243 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:31.243 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:31.243 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:31.243 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:31.243 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:31.243 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:31.244 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:31.244 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:31.244 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:31.244 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:31.244 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:31.244 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:31.244 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:31.244 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:31.244 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:31.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.244 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:31.245 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:31.245 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:31.245 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:31.245 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:31.245 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:31.245 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:31.245 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:31.245 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:31.245 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:31.245 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:31.245 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:31.245 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:22:31.245 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:22:31.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.246 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:31.246 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:31.246 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:22:31.246 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.246 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.246 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.246 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:31.246 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:22:31.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.246 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:31.246 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:31.247 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:31.247 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:31.247 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:31.247 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:31.247 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:31.247 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:31.247 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:31.247 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:31.247 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:31.247 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:31.247 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:31.247 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.248 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.248 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:22:31.248 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:31.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.248 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.248 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:22:31.248 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:31.248 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.248 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.249 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:31.249 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.249 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:22:31.249 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:31.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.249 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:22:31.249 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:31.249 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.250 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.250 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:31.250 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.250 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.250 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:22:31.250 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:31.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.250 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.251 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:22:31.251 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:31.251 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.251 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.251 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:31.251 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.251 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.251 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:22:31.251 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:31.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.252 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.252 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:22:31.252 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:31.252 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.252 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.252 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:22:31.252 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:22:31.252 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:22:31.252 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:22:31.253 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:31.253 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:31.253 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:31.253 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:31.253 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.253 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:31.253 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:31.253 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:31.253 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:31.254 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:31.254 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:31.254 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:31.254 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:31.254 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:31.254 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:31.254 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:31.254 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:31.254 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:31.254 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.255 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.255 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:22:31.255 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:31.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.255 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.255 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:22:31.255 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:31.255 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.256 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.256 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:31.256 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.256 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.256 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:22:31.256 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:31.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.256 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.257 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:22:31.257 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:31.257 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.257 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.257 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:31.257 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.257 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.257 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:22:31.257 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:31.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.258 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.258 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:22:31.258 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:31.258 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.258 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.258 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:31.259 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.259 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.259 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:22:31.259 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:31.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.259 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.259 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:22:31.259 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:31.259 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.259 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.260 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:22:31.260 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:22:31.260 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:22:31.260 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:22:31.260 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:31.260 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:31.260 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:31.260 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.261 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:31.261 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:31.261 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:31.261 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:31.261 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:31.261 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:31.261 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:31.261 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:31.261 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:31.262 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:31.262 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:31.262 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:31.262 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:31.262 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.262 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.262 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:22:31.262 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:31.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.263 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.263 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:22:31.263 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:31.263 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.263 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.263 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:31.263 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.264 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.264 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:22:31.264 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:31.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.264 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.264 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:22:31.264 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:31.264 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.264 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.265 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:31.265 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.265 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.265 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:22:31.265 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:31.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.265 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.266 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:22:31.266 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:31.266 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.266 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.266 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:31.266 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.266 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.267 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:22:31.267 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:31.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.267 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.267 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:22:31.267 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:31.267 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.267 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.268 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:22:31.268 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:22:31.268 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:22:31.268 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:22:31.268 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:31.268 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:31.268 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:31.269 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:31.269 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.269 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:31.269 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:31.269 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:31.269 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:31.270 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:31.270 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:31.270 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:31.270 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:31.270 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:31.270 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:31.270 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:31.270 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:31.270 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:31.270 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.271 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.271 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:22:31.271 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:31.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.271 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.271 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:22:31.271 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:31.271 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.271 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.271 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:31.272 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.272 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.272 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:22:31.272 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:31.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.272 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.272 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:22:31.272 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:31.272 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.272 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.273 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:31.273 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.273 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.273 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:22:31.273 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:31.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.273 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.273 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:22:31.273 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:31.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.274 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.274 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:31.274 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.274 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.274 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:22:31.274 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:31.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.274 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.275 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:22:31.275 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:31.275 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.275 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.275 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:22:31.275 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:22:31.275 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:22:31.275 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:22:31.275 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:31.275 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull", 2023-10-09T06:22:31.275 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:31.276 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:31.276 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.276 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:31.276 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:31.276 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:31.276 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:31.276 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:31.276 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:31.276 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:31.276 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:31.277 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:31.277 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:31.277 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:31.277 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:31.277 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:31.277 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.277 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.277 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:22:31.277 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:31.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.278 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.278 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:22:31.278 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:31.278 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.278 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.278 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:31.278 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.278 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.278 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:22:31.279 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:31.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.279 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.279 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:22:31.279 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:31.279 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.279 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.279 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:31.279 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.280 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.280 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:22:31.280 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:31.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.280 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.280 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:22:31.280 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:31.280 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.280 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.280 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:31.280 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.281 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.281 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:22:31.281 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:31.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.281 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.281 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:22:31.281 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:31.281 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.281 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.282 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:22:31.282 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:22:31.282 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:22:31.282 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:22:31.282 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:31.282 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:31.282 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:31.282 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.282 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:31.282 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:31.283 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:31.283 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:31.283 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:31.283 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:31.283 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:31.283 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:31.283 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:31.283 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:31.283 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:31.283 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:31.283 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:31.284 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.284 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.284 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:22:31.284 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:31.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.284 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.284 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:22:31.284 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:31.284 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.284 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.285 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:31.285 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.285 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.285 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:22:31.285 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:31.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.285 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.286 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:22:31.286 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:31.286 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.286 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.286 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:31.286 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.286 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.286 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:22:31.286 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:31.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.287 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.287 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:22:31.287 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:31.287 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.287 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.287 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:31.287 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.288 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.288 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:22:31.288 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:31.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.288 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.288 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:22:31.288 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:31.288 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.288 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.289 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:22:31.289 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:22:31.289 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:22:31.289 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:22:31.289 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:31.289 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:31.289 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:31.289 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.290 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:31.290 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:31.290 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:31.290 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:31.290 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:31.290 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:31.290 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:31.291 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:31.291 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:31.291 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:31.291 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:31.291 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:31.291 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:31.291 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.291 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.292 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:22:31.292 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:31.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.292 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.292 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:22:31.292 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:31.292 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.293 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.293 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:31.293 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.293 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.293 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:22:31.293 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:31.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.294 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.294 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:22:31.294 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:31.294 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.294 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.295 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:31.295 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.295 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.295 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:22:31.295 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:31.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.296 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.296 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:22:31.296 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:31.296 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.296 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.296 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:31.296 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.297 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.297 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:22:31.297 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:31.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.297 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.297 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:22:31.297 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:31.298 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.298 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.298 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:22:31.298 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:22:31.298 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:22:31.298 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:22:31.298 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:31.298 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:31.298 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:31.299 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:31.299 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.299 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:31.299 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:31.299 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:31.299 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:31.299 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:31.300 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:31.300 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:31.300 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:31.300 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:31.300 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:31.300 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:31.300 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:31.300 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:31.300 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.300 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.300 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:22:31.301 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:31.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.301 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.301 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:22:31.301 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:31.301 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.301 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.301 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:31.301 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.302 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.302 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:22:31.302 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:31.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.302 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.302 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:22:31.302 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:31.302 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.302 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.302 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:31.303 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.303 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.303 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:22:31.303 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:31.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.303 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.303 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:22:31.304 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:31.304 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.304 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.304 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:31.304 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:31.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.304 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:31.304 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:22:31.304 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:31.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.305 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:31.305 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:22:31.305 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:31.305 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.305 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.305 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:22:31.306 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:22:31.306 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:22:31.306 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:22:31.306 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:31.306 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:31.306 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:31.306 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:31.306 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:31.307 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.307 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:31.307 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:22:31.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.307 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:31.307 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:31.307 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:31.307 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:31.307 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:31.308 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:31.308 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:22:31.308 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:31.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.308 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:31.308 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:31.308 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:31.308 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:31.309 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:31.309 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:31.309 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:22:31.309 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:31.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.309 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:31.309 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:31.309 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:31.309 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:31.309 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:31.310 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:31.310 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:22:31.310 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:31.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.310 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:31.310 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:31.310 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:31.310 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:31.310 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:31.310 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:31.310 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:22:31.311 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:31.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.311 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:31.311 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:31.311 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:31.311 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:31.311 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:31.311 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:31.312 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:22:31.312 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:31.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.312 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:31.312 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:31.312 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:31.312 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:31.312 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:31.313 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:31.313 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:22:31.313 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:31.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.313 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:31.313 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:31.313 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:31.313 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:31.313 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:31.314 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:31.314 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:22:31.314 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:31.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:31.314 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:31.314 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:31.314 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:31.314 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:31.315 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:31.315 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:31.315 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:22:31.315 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:31.315 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.315 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:31.315 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:22:31.315 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:22:31.315 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:22:31.315 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:22:31.316 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:22:31.316 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:22:31.316 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:22:31.316 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:22:31.316 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:22:31.316 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:22:31.316 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:22:31.316 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:22:31.316 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:22:31.317 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:31.317 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:22:31.317 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:22:31.317 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:22:31.317 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:22:31.317 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:22:31.317 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:22:31.317 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:22:31.317 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:22:31.318 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:22:31.318 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:22:31.318 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:22:31.318 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:31.318 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:22:31.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.223+0000 7f48a5465700 1 -- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4880066f30 msgr2=0x7f48800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:31.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.223+0000 7f48a5465700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4880066f30 0x7f48800693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f48a00c87a0 tx=0x7f4888001e90 comp rx=0 tx=0).stop 2023-10-09T06:22:31.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.223+0000 7f48a5465700 1 -- 172.21.15.31:0/112677609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488c003a60 msgr2=0x7f48a00b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:31.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.223+0000 7f48a5465700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488c003a60 0x7f48a00b13d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f488c00bfa0 tx=0x7f489801a000 comp rx=0 tx=0).stop 2023-10-09T06:22:31.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.223+0000 7f48a5465700 1 -- 172.21.15.31:0/112677609 shutdown_connections 2023-10-09T06:22:31.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.223+0000 7f48a5465700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4880066f30 0x7f48800693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.223+0000 7f48a5465700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48a01583a0 0x7f48a0158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.223+0000 7f48a5465700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488c003a60 0x7f48a00b13d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.223+0000 7f48a5465700 1 --2- 172.21.15.31:0/112677609 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48a00c02d0 0x7f48a00c0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.223+0000 7f48a5465700 1 -- 172.21.15.31:0/112677609 >> 172.21.15.31:0/112677609 conn(0x7f48a0067660 msgr2=0x7f48a00c4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:31.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.223+0000 7f48a5465700 1 -- 172.21.15.31:0/112677609 shutdown_connections 2023-10-09T06:22:31.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.223+0000 7f48a5465700 1 -- 172.21.15.31:0/112677609 wait complete. 2023-10-09T06:22:31.321 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:22:31.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.439+0000 7fcb5686d700 1 Processor -- start 2023-10-09T06:22:31.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.439+0000 7fcb5686d700 1 -- start start 2023-10-09T06:22:31.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.440+0000 7fcb5686d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcb50157c40 0x7fcb50158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.440+0000 7fcb5686d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5015cbb0 con 0x7fcb5015a620 2023-10-09T06:22:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.440+0000 7fcb5686d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5015bfa0 con 0x7fcb50157870 2023-10-09T06:22:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.440+0000 7fcb5686d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5015bdb0 con 0x7fcb50157c40 2023-10-09T06:22:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.440+0000 7fcb4f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcb5015a620 0x7fcb5015d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54278/0 (socket says 172.21.15.31:54278) 2023-10-09T06:22:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.440+0000 7fcb4f7fe700 1 -- 172.21.15.31:0/3250966931 learned_addr learned my addr 172.21.15.31:0/3250966931 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435194510 0 0) 0x7fcb5015cbb0 con 0x7fcb5015a620 2023-10-09T06:22:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb54e0a700 1 --2- 172.21.15.31:0/3250966931 >> v2:172.21.15.158:3300/0 conn(0x7fcb50157c40 0x7fcb50158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb38003570 con 0x7fcb5015a620 2023-10-09T06:22:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 762328943 0 0) 0x7fcb38003570 con 0x7fcb5015a620 2023-10-09T06:22:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 >> v2:172.21.15.158:3300/0 conn(0x7fcb50157c40 msgr2=0x7fcb50158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 --2- 172.21.15.31:0/3250966931 >> v2:172.21.15.158:3300/0 conn(0x7fcb50157c40 0x7fcb50158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 >> v1:172.21.15.158:6789/0 conn(0x7fcb50157870 legacy=0x7fcb5015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5015c280 con 0x7fcb5015a620 2023-10-09T06:22:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fcb44001470 con 0x7fcb5015a620 2023-10-09T06:22:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 >> v1:172.21.15.31:6789/0 conn(0x7fcb5015a620 legacy=0x7fcb5015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 --2- 172.21.15.31:0/3250966931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb38003a60 0x7fcb38003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 --2- 172.21.15.31:0/3250966931 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcb38004810 0x7fcb38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 --2- 172.21.15.31:0/3250966931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb380051c0 0x7fcb3800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3800c130 con 0x7fcb380051c0 2023-10-09T06:22:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3800c2a0 con 0x7fcb38003a60 2023-10-09T06:22:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3800c460 con 0x7fcb38004810 2023-10-09T06:22:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb54e0a700 1 --2- 172.21.15.31:0/3250966931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb380051c0 0x7fcb3800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4ffff700 1 --2- 172.21.15.31:0/3250966931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb38003a60 0x7fcb38003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.441+0000 7fcb4f7fe700 1 --2- 172.21.15.31:0/3250966931 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcb38004810 0x7fcb38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb54e0a700 1 -- 172.21.15.31:0/3250966931 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcb38004810 msgr2=0x7fcb38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb54e0a700 1 --2- 172.21.15.31:0/3250966931 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcb38004810 0x7fcb38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb54e0a700 1 -- 172.21.15.31:0/3250966931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb38003a60 msgr2=0x7fcb38003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:31.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb54e0a700 1 --2- 172.21.15.31:0/3250966931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb38003a60 0x7fcb38003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb54e0a700 1 -- 172.21.15.31:0/3250966931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38003570 con 0x7fcb380051c0 2023-10-09T06:22:31.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb4f7fe700 1 --2- 172.21.15.31:0/3250966931 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcb38004810 0x7fcb38004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:31.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb54e0a700 1 -- 172.21.15.31:0/3250966931 reap_dead start 2023-10-09T06:22:31.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb54e0a700 1 --2- 172.21.15.31:0/3250966931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb380051c0 0x7fcb3800ba60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcb501580c0 tx=0x7fcb4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7452989c63f9f24d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:31.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4800ea90 con 0x7fcb380051c0 2023-10-09T06:22:31.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4800f040 con 0x7fcb380051c0 2023-10-09T06:22:31.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb4effd700 1 -- 172.21.15.31:0/3250966931 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4800ee60 con 0x7fcb380051c0 2023-10-09T06:22:31.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb5686d700 1 -- 172.21.15.31:0/3250966931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb380051c0 msgr2=0x7fcb3800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:31.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb5686d700 1 --2- 172.21.15.31:0/3250966931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb380051c0 0x7fcb3800ba60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcb501580c0 tx=0x7fcb4800b040 comp rx=0 tx=0).stop 2023-10-09T06:22:31.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb5686d700 1 -- 172.21.15.31:0/3250966931 shutdown_connections 2023-10-09T06:22:31.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb5686d700 1 --2- 172.21.15.31:0/3250966931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb380051c0 0x7fcb3800ba60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb5686d700 1 -- 172.21.15.31:0/3250966931 >> 172.21.15.31:0/3250966931 conn(0x7fcb50068ce0 msgr2=0x7fcb500690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:31.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.442+0000 7fcb5686d700 1 -- 172.21.15.31:0/3250966931 shutdown_connections 2023-10-09T06:22:31.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.443+0000 7fcb5686d700 1 -- 172.21.15.31:0/3250966931 wait complete. 2023-10-09T06:22:31.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.444+0000 7fcb5686d700 1 Processor -- start 2023-10-09T06:22:31.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.444+0000 7fcb5686d700 1 -- start start 2023-10-09T06:22:31.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.444+0000 7fcb5686d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcb380051c0 0x7fcb5014b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.444+0000 7fcb5686d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb500af720 0x7fcb5016dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.444+0000 7fcb5686d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb5014be90 0x7fcb5016e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.444+0000 7fcb5686d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb501502f0 con 0x7fcb5014be90 2023-10-09T06:22:31.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.444+0000 7fcb5686d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb50152ae0 con 0x7fcb500af720 2023-10-09T06:22:31.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb5686d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5014fa50 con 0x7fcb380051c0 2023-10-09T06:22:31.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb54e0a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb5014be90 0x7fcb5016e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb54e0a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb5014be90 0x7fcb5016e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49118/0 (socket says 172.21.15.31:49118) 2023-10-09T06:22:31.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb54e0a700 1 -- 172.21.15.31:0/116857684 learned_addr learned my addr 172.21.15.31:0/116857684 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:31.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb4ffff700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcb380051c0 0x7fcb5014b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb4f7fe700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb500af720 0x7fcb5016dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb54e0a700 1 -- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcb380051c0 msgr2=0x7fcb5014b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:31.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb54e0a700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcb380051c0 0x7fcb5014b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb54e0a700 1 -- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb500af720 msgr2=0x7fcb5016dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:31.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb54e0a700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb500af720 0x7fcb5016dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb54e0a700 1 -- 172.21.15.31:0/116857684 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5014fd30 con 0x7fcb5014be90 2023-10-09T06:22:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb4ffff700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcb380051c0 0x7fcb5014b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb4f7fe700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb500af720 0x7fcb5016dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb54e0a700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb5014be90 0x7fcb5016e1f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800afd0 tx=0x7fcb4801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb37fff700 1 -- 172.21.15.31:0/116857684 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4800ee90 con 0x7fcb5014be90 2023-10-09T06:22:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb37fff700 1 -- 172.21.15.31:0/116857684 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4801d630 con 0x7fcb5014be90 2023-10-09T06:22:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb5686d700 1 -- 172.21.15.31:0/116857684 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb50150010 con 0x7fcb5014be90 2023-10-09T06:22:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb37fff700 1 -- 172.21.15.31:0/116857684 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4801d9f0 con 0x7fcb5014be90 2023-10-09T06:22:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.445+0000 7fcb5686d700 1 -- 172.21.15.31:0/116857684 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5016e730 con 0x7fcb5014be90 2023-10-09T06:22:31.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.446+0000 7fcb5686d700 1 -- 172.21.15.31:0/116857684 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb300052b0 con 0x7fcb5014be90 2023-10-09T06:22:31.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.447+0000 7fcb37fff700 1 -- 172.21.15.31:0/116857684 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb480323f0 con 0x7fcb5014be90 2023-10-09T06:22:31.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.447+0000 7fcb37fff700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcb3c066f30 0x7fcb3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:31.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.447+0000 7fcb37fff700 1 -- 172.21.15.31:0/116857684 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb480866f0 con 0x7fcb5014be90 2023-10-09T06:22:31.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.448+0000 7fcb4ffff700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcb3c066f30 0x7fcb3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:31.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.448+0000 7fcb37fff700 1 -- 172.21.15.31:0/116857684 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=49}) v3 -- 0x7fcb3c06ea50 con 0x7fcb5014be90 2023-10-09T06:22:31.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.448+0000 7fcb4ffff700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcb3c066f30 0x7fcb3c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcb40007e40 tx=0x7fcb40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:31.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.452+0000 7fcb37fff700 1 -- 172.21.15.31:0/116857684 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb48018020 con 0x7fcb5014be90 2023-10-09T06:22:31.673 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:22:31.672+0000 7fc5eaab7700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-09T06:22:31.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.695+0000 7fcb5686d700 1 -- 172.21.15.31:0/116857684 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb30005560 con 0x7fcb5014be90 2023-10-09T06:22:31.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.695+0000 7fcb37fff700 1 -- 172.21.15.31:0/116857684 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fcb48053960 con 0x7fcb5014be90 2023-10-09T06:22:31.696 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:31.696 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2970905850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2970905850},{"type":"v1","addr":"172.21.15.158:6837","nonce":2970905850}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5119,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1945558670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1945558670},{"type":"v1","addr":"172.21.15.31:6835","nonce":1945558670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3853703125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3853703125},{"type":"v1","addr":"172.21.15.31:6834","nonce":3853703125}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:22:12.504027+0000","modified":"2023-10-09T06:22:16.130642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/1366477380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1366477380},{"type":"v1","addr":"172.21.15.158:6836","nonce":1366477380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:22:31.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.697+0000 7fcb5686d700 1 -- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcb3c066f30 msgr2=0x7fcb3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:31.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.697+0000 7fcb5686d700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcb3c066f30 0x7fcb3c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcb40007e40 tx=0x7fcb40009040 comp rx=0 tx=0).stop 2023-10-09T06:22:31.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.697+0000 7fcb5686d700 1 -- 172.21.15.31:0/116857684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb5014be90 msgr2=0x7fcb5016e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:31.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.697+0000 7fcb5686d700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb5014be90 0x7fcb5016e1f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800afd0 tx=0x7fcb4801a000 comp rx=0 tx=0).stop 2023-10-09T06:22:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.697+0000 7fcb5686d700 1 -- 172.21.15.31:0/116857684 shutdown_connections 2023-10-09T06:22:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.697+0000 7fcb5686d700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcb3c066f30 0x7fcb3c0693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.697+0000 7fcb5686d700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcb380051c0 0x7fcb5014b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.697+0000 7fcb5686d700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb5014be90 0x7fcb5016e1f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.697+0000 7fcb5686d700 1 --2- 172.21.15.31:0/116857684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb500af720 0x7fcb5016dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.697+0000 7fcb5686d700 1 -- 172.21.15.31:0/116857684 >> 172.21.15.31:0/116857684 conn(0x7fcb50068ce0 msgr2=0x7fcb500b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.698+0000 7fcb5686d700 1 -- 172.21.15.31:0/116857684 shutdown_connections 2023-10-09T06:22:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:31.698+0000 7fcb5686d700 1 -- 172.21.15.31:0/116857684 wait complete. 2023-10-09T06:22:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 25 2023-10-09T06:22:31.710 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-09T06:22:31.855 INFO:teuthology.orchestra.run.smithi158.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":5307,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.727067259999998,"mdsmap_epoch":25,"osdmap_epoch":48,"osdmap_epoch_barrier":48,"uptime":23.659954904999999} 2023-10-09T06:22:31.856 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 5307, "mdsmap_epoch": 25, "osdmap_epoch": 48, "osdmap_epoch_barrier": 48, "rank_uptime": 18.72706726, "state": "up:active", "uptime": 23.659954905, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:22:31.856 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T06:22:31.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:22:31.856 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T06:22:31.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:22:31.872 INFO:teuthology.orchestra.run.smithi031.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-09T06:22:31.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:22:31.873 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-09T06:22:31.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:22:31.929 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-09T06:22:31.988 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:22:32.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.147+0000 7ff1b11ee700 1 Processor -- start 2023-10-09T06:22:32.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.147+0000 7ff1b11ee700 1 -- start start 2023-10-09T06:22:32.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.148+0000 7ff1b11ee700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff1ac157870 0x7ff1ac15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:32.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.148+0000 7ff1b11ee700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1ac157c40 0x7ff1ac158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:32.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.148+0000 7ff1b11ee700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ac15cbb0 con 0x7ff1ac15a620 2023-10-09T06:22:32.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.148+0000 7ff1b11ee700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac15bfa0 con 0x7ff1ac157870 2023-10-09T06:22:32.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.148+0000 7ff1b11ee700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac15c280 con 0x7ff1ac157c40 2023-10-09T06:22:32.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.148+0000 7ff1aa59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff1ac15a620 0x7ff1ac15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54286/0 (socket says 172.21.15.31:54286) 2023-10-09T06:22:32.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.148+0000 7ff1aa59c700 1 -- 172.21.15.31:0/4241858323 learned_addr learned my addr 172.21.15.31:0/4241858323 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:32.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.148+0000 7ff1ab59e700 1 --2- 172.21.15.31:0/4241858323 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1ac157c40 0x7ff1ac158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:32.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.148+0000 7ff1aad9d700 1 --2- 172.21.15.31:0/4241858323 >> v2:172.21.15.158:3300/0 conn(0x7ff1ac157870 0x7ff1ac15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:32.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.148+0000 7ff1a9d9b700 1 -- 172.21.15.31:0/4241858323 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256018878 0 0) 0x7ff1ac15cbb0 con 0x7ff1ac15a620 2023-10-09T06:22:32.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.149+0000 7ff1a9d9b700 1 -- 172.21.15.31:0/4241858323 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff198003570 con 0x7ff1ac15a620 2023-10-09T06:22:32.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.149+0000 7ff1ab59e700 1 -- 172.21.15.31:0/4241858323 >> v2:172.21.15.158:3300/0 conn(0x7ff1ac157870 msgr2=0x7ff1ac15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:32.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.149+0000 7ff1ab59e700 1 --2- 172.21.15.31:0/4241858323 >> v2:172.21.15.158:3300/0 conn(0x7ff1ac157870 0x7ff1ac15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:32.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.149+0000 7ff1ab59e700 1 -- 172.21.15.31:0/4241858323 >> v1:172.21.15.31:6789/0 conn(0x7ff1ac15a620 legacy=0x7ff1ac15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:32.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.149+0000 7ff1ab59e700 1 -- 172.21.15.31:0/4241858323 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac15c560 con 0x7ff1ac157c40 2023-10-09T06:22:32.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.149+0000 7ff1aad9d700 1 --2- 172.21.15.31:0/4241858323 >> v2:172.21.15.158:3300/0 conn(0x7ff1ac157870 0x7ff1ac15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:22:32.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.149+0000 7ff1ab59e700 1 --2- 172.21.15.31:0/4241858323 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1ac157c40 0x7ff1ac158110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40098e0 tx=0x7ff1a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=150abe1d94646443 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:32.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.149+0000 7ff1a9d9b700 1 -- 172.21.15.31:0/4241858323 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4011630 con 0x7ff1ac157c40 2023-10-09T06:22:32.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.149+0000 7ff1a9d9b700 1 -- 172.21.15.31:0/4241858323 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a4011790 con 0x7ff1ac157c40 2023-10-09T06:22:32.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.149+0000 7ff1a9d9b700 1 -- 172.21.15.31:0/4241858323 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4011b30 con 0x7ff1ac157c40 2023-10-09T06:22:32.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.149+0000 7ff1b11ee700 1 -- 172.21.15.31:0/4241858323 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1ac157c40 msgr2=0x7ff1ac158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:32.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.149+0000 7ff1b11ee700 1 --2- 172.21.15.31:0/4241858323 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1ac157c40 0x7ff1ac158110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40098e0 tx=0x7ff1a40091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:32.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.150+0000 7ff1b11ee700 1 -- 172.21.15.31:0/4241858323 shutdown_connections 2023-10-09T06:22:32.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.150+0000 7ff1b11ee700 1 --2- 172.21.15.31:0/4241858323 >> v2:172.21.15.158:3300/0 conn(0x7ff1ac157870 0x7ff1ac15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:32.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.150+0000 7ff1b11ee700 1 --2- 172.21.15.31:0/4241858323 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1ac157c40 0x7ff1ac158110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:32.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.150+0000 7ff1b11ee700 1 -- 172.21.15.31:0/4241858323 >> 172.21.15.31:0/4241858323 conn(0x7ff1ac068ce0 msgr2=0x7ff1ac0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:32.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.150+0000 7ff1b11ee700 1 -- 172.21.15.31:0/4241858323 shutdown_connections 2023-10-09T06:22:32.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.150+0000 7ff1b11ee700 1 -- 172.21.15.31:0/4241858323 wait complete. 2023-10-09T06:22:32.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.151+0000 7ff1b11ee700 1 Processor -- start 2023-10-09T06:22:32.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.151+0000 7ff1b11ee700 1 -- start start 2023-10-09T06:22:32.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.151+0000 7ff1b11ee700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ac157870 0x7ff1ac0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:32.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.151+0000 7ff1b11ee700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1ac157c40 0x7ff1ac16d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:32.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1b11ee700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1ac15a620 0x7ff1ac16db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:32.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1b11ee700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac150d00 con 0x7ff1ac157870 2023-10-09T06:22:32.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1b11ee700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0b3040 con 0x7ff1ac157c40 2023-10-09T06:22:32.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1b11ee700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0b2a80 con 0x7ff1ac15a620 2023-10-09T06:22:32.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1aad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ac157870 0x7ff1ac0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:32.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1aad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ac157870 0x7ff1ac0b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49122/0 (socket says 172.21.15.31:49122) 2023-10-09T06:22:32.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1aad9d700 1 -- 172.21.15.31:0/3316659186 learned_addr learned my addr 172.21.15.31:0/3316659186 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:32.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1aad9d700 1 -- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1ac15a620 msgr2=0x7ff1ac16db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:32.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1aa59c700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1ac157c40 0x7ff1ac16d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:32.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1ab59e700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1ac15a620 0x7ff1ac16db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:32.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1aad9d700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1ac15a620 0x7ff1ac16db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:32.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1aad9d700 1 -- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1ac157c40 msgr2=0x7ff1ac16d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:32.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1aad9d700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1ac157c40 0x7ff1ac16d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:32.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1aad9d700 1 -- 172.21.15.31:0/3316659186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c009a20 con 0x7ff1ac157870 2023-10-09T06:22:32.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1aad9d700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ac157870 0x7ff1ac0b2050 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00c170 tx=0x7ff19c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:32.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1a2ffd700 1 -- 172.21.15.31:0/3316659186 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00cdb0 con 0x7ff1ac157870 2023-10-09T06:22:32.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1a2ffd700 1 -- 172.21.15.31:0/3316659186 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c00f040 con 0x7ff1ac157870 2023-10-09T06:22:32.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1b11ee700 1 -- 172.21.15.31:0/3316659186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a4009420 con 0x7ff1ac157870 2023-10-09T06:22:32.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1a2ffd700 1 -- 172.21.15.31:0/3316659186 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c014690 con 0x7ff1ac157870 2023-10-09T06:22:32.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.152+0000 7ff1b11ee700 1 -- 172.21.15.31:0/3316659186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac14e340 con 0x7ff1ac157870 2023-10-09T06:22:32.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.153+0000 7ff1b11ee700 1 -- 172.21.15.31:0/3316659186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ac14e1a0 con 0x7ff1ac157870 2023-10-09T06:22:32.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.154+0000 7ff1a2ffd700 1 -- 172.21.15.31:0/3316659186 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff19c014a00 con 0x7ff1ac157870 2023-10-09T06:22:32.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.154+0000 7ff1a2ffd700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff18c066f30 0x7ff18c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:32.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.154+0000 7ff1a2ffd700 1 -- 172.21.15.31:0/3316659186 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff19c0853f0 con 0x7ff1ac157870 2023-10-09T06:22:32.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.154+0000 7ff1a2ffd700 1 -- 172.21.15.31:0/3316659186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=49}) v3 -- 0x7ff18c06ea50 con 0x7ff1ac157870 2023-10-09T06:22:32.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.154+0000 7ff1aa59c700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff18c066f30 0x7ff18c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:32.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.155+0000 7ff1aa59c700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff18c066f30 0x7ff18c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff1940058d0 tx=0x7ff194009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:32.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.158+0000 7ff1a2ffd700 1 -- 172.21.15.31:0/3316659186 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1ac14e1a0 con 0x7ff1ac157870 2023-10-09T06:22:32.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.351+0000 7ff1b11ee700 1 -- 172.21.15.31:0/3316659186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff1ac14e1a0 con 0x7ff1ac157870 2023-10-09T06:22:32.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.352+0000 7ff1a2ffd700 1 -- 172.21.15.31:0/3316659186 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+32403 (secure 0 0 0) 0x7ff1ac14e1a0 con 0x7ff1ac157870 2023-10-09T06:22:32.353 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:32.354 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:22:32.354 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 48, 2023-10-09T06:22:32.354 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:22:32.354 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:22:32.354 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:22:28.679925+0000", 2023-10-09T06:22:32.354 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:22:32.354 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:22:32.354 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:22:32.354 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:22:32.355 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:22:32.355 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:22:32.355 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:22:32.355 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:22:32.355 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:22:32.355 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:32.355 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:22:32.355 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:22:32.355 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:22:32.355 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:22:32.356 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:22:32.356 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 7, 2023-10-09T06:22:32.356 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:22:32.356 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:22:32.356 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:22:32.356 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:22:32.356 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:22:32.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.356 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:22:32.356 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:22:32.356 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:22:32.357 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:22:32.357 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:22:32.357 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:32.357 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:32.357 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:32.357 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:32.357 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:32.357 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:32.357 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:32.357 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:32.358 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:32.358 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:32.358 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:22:32.358 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:22:32.358 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:22:32.358 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:22:32.358 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:22:32.358 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:32.358 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:32.358 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:32.358 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:32.358 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:32.359 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:32.359 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:32.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.359 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "46", 2023-10-09T06:22:32.359 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:32.359 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:32.359 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:32.359 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:32.359 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:32.359 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:32.359 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:32.361 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:32.361 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:32.361 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:32.361 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:32.361 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:32.361 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:32.361 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:32.361 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:32.362 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:32.362 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:32.362 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:32.362 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:32.362 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:32.362 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:32.362 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:32.362 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:32.362 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:32.362 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:32.363 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:32.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.363 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:32.363 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:32.363 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:32.363 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:32.363 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:32.363 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:32.363 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:32.363 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:32.364 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:32.364 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:32.364 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:32.364 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:32.364 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:22:32.364 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:22:32.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.364 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:32.364 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:22:32.364 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.365 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 6, 2023-10-09T06:22:32.365 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:22:32.365 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:10.914998+0000", 2023-10-09T06:22:32.365 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:22:32.365 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:22:32.365 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:32.365 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:32.365 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:32.365 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:32.365 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:32.366 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:32.366 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:32.366 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:32.366 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:32.366 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:32.366 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:22:32.366 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:22:32.366 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:22:32.366 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:22:32.366 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:22:32.366 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:32.367 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:32.367 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:32.367 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:32.367 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:32.367 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:32.367 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:32.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.367 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "46", 2023-10-09T06:22:32.367 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:32.367 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:32.368 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:32.368 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:32.368 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:32.368 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:32.368 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:32.368 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:32.368 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:32.368 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:32.368 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:32.368 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:32.368 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:32.369 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:32.369 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:32.369 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:32.369 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:32.369 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:32.369 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:32.369 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:32.369 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:32.369 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:32.369 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:32.369 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:32.370 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:32.370 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:32.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.370 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:32.370 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:32.370 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:32.370 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:32.370 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:32.370 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:32.370 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:32.370 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:32.371 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:32.371 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:32.371 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:32.371 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:32.371 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:22:32.371 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:22:32.371 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:22:32.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.371 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:32.371 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:32.371 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:22:32.372 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.372 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.372 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 7, 2023-10-09T06:22:32.372 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:22:32.372 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:11.476116+0000", 2023-10-09T06:22:32.372 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:22:32.372 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:22:32.372 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:32.372 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:32.372 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:32.373 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:32.373 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:32.373 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:32.373 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:32.373 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:32.373 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:32.373 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:32.373 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:22:32.373 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:22:32.373 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:22:32.373 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:22:32.373 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:22:32.374 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:32.374 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:32.374 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:32.374 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:32.374 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:32.374 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:32.374 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:32.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.374 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "46", 2023-10-09T06:22:32.374 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:32.374 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:32.375 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:32.375 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:32.375 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:32.375 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:32.375 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:32.375 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:32.375 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:32.375 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:32.375 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:32.375 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:32.375 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:32.375 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:32.376 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:32.376 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:32.376 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:32.376 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:32.376 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:32.376 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:32.376 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:32.376 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:32.376 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:32.376 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:32.376 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:32.376 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:32.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.377 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:32.377 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:32.377 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:32.377 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:32.377 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:32.377 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:32.377 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:32.377 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:32.377 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:32.377 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:32.377 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:22:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:22:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:22:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:32.379 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:22:32.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.379 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:32.379 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:32.379 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:32.379 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:32.379 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:32.379 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:32.379 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:32.379 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:32.379 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:32.380 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:32.380 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:32.380 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:32.380 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:32.380 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.380 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.380 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:22:32.380 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:32.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.380 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.381 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:22:32.381 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:32.381 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.381 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.381 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:32.381 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.381 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.381 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:22:32.381 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:32.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.382 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.382 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:22:32.382 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:32.382 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.382 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.382 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:32.382 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.382 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.383 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:22:32.383 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:32.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.383 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.383 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:22:32.383 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:32.383 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.383 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.383 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:32.383 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.384 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.384 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:22:32.384 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:32.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.384 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.384 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:22:32.384 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:32.384 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.384 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.385 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:22:32.385 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:22:32.385 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:22:32.385 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:22:32.385 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:32.385 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:32.385 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:32.385 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:32.385 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.386 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:32.386 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:32.386 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:32.386 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:32.386 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:32.386 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:32.386 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:32.386 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:32.386 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:32.386 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:32.386 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:32.387 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:32.387 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:32.387 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.387 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.387 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:22:32.387 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:32.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.387 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.387 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:22:32.388 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:32.388 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.388 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.388 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:32.388 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.388 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.388 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:22:32.388 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:32.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.389 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.389 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:22:32.389 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:32.389 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.389 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.389 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:32.389 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.389 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.389 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:22:32.389 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:32.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.390 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.390 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:22:32.390 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:32.390 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.390 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.390 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:32.390 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.390 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.391 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:22:32.391 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:32.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.391 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.391 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:22:32.391 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:32.391 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.391 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.391 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:22:32.392 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:22:32.392 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:22:32.392 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:22:32.392 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:32.392 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:32.392 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:32.392 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.392 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:32.392 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:32.392 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:32.393 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:32.393 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:32.393 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:32.393 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:32.393 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:32.393 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:32.393 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:32.393 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:32.393 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:32.393 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:32.393 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.394 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.394 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:22:32.394 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:32.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.394 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.394 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:22:32.394 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:32.394 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.394 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.395 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:32.395 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.395 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.395 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:22:32.395 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:32.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.395 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.395 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:22:32.395 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:32.395 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.396 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.396 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:32.396 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.396 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.396 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:22:32.396 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:32.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.396 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.396 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:22:32.397 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:32.397 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.397 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.397 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:32.397 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.397 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.397 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:22:32.397 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:32.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.398 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.398 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:22:32.398 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:32.398 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.398 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.398 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:22:32.398 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:22:32.398 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:22:32.398 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:22:32.398 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:32.399 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:32.399 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:32.399 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:32.399 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.399 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:32.399 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:32.399 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:32.399 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:32.399 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:32.399 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:32.400 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:32.400 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:32.400 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:32.400 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:32.400 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:32.400 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:32.400 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:32.400 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.400 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.400 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:22:32.401 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:32.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.401 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.401 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:22:32.401 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:32.401 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.401 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.401 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:32.401 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.402 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.402 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:22:32.402 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:32.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.402 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.402 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:22:32.402 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:32.402 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.402 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.402 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:32.403 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.403 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.403 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:22:32.403 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:32.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.403 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.403 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:22:32.403 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:32.403 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.404 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.404 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:32.404 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.404 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.404 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:22:32.404 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:32.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.404 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.405 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:22:32.405 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:32.405 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.405 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.405 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:22:32.405 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:22:32.405 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:22:32.405 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:22:32.405 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:32.405 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull", 2023-10-09T06:22:32.405 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:32.406 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:32.406 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.406 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:32.406 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:32.406 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:32.406 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:32.406 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:32.406 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:32.406 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:32.407 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:32.407 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:32.407 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:32.407 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:32.407 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:32.407 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:32.407 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.407 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.407 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:22:32.407 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:32.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.408 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.408 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:22:32.408 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:32.408 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.408 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.408 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:32.408 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.408 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.409 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:22:32.409 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:32.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.409 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.409 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:22:32.409 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:32.409 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.409 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.409 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:32.409 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.410 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.410 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:22:32.410 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:32.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.410 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.410 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:22:32.410 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:32.410 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.410 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.411 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:32.411 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.411 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.411 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:22:32.411 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:32.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.411 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.411 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:22:32.411 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:32.412 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.412 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.412 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:22:32.412 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:22:32.412 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:22:32.412 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:22:32.412 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:32.412 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:32.412 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:32.412 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.413 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:32.413 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:32.413 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:32.413 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:32.413 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:32.413 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:32.413 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:32.413 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:32.413 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:32.413 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:32.414 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:32.414 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:32.414 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:32.414 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.414 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.414 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:22:32.414 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:32.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.414 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.415 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:22:32.415 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:32.415 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.415 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.415 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:32.415 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.415 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.415 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:22:32.415 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:32.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.416 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.416 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.416 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:22:32.416 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:32.416 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.416 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.416 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:32.416 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.416 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.417 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.417 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:22:32.417 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:32.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.417 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.417 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:22:32.417 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:32.417 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.417 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.418 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:32.418 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.418 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.418 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:22:32.418 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:32.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.418 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.418 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:22:32.418 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:32.418 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.419 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.419 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:22:32.419 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:22:32.419 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:22:32.419 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:22:32.419 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:32.419 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:32.419 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:32.419 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.420 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:32.420 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:32.420 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:32.420 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:32.420 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:32.420 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:32.420 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:32.420 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:32.420 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:32.420 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:32.420 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:32.421 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:32.421 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:32.421 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.421 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.421 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:22:32.421 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:32.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.421 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.421 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:22:32.422 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:32.422 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.422 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.422 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:32.422 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.422 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.422 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:22:32.422 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:32.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.423 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.423 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.423 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:22:32.423 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:32.423 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.423 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.423 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.423 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:32.423 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.423 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.423 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.423 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:22:32.424 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:32.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.424 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.424 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.424 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:22:32.424 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:32.424 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.424 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.424 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:32.424 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.425 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.425 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:22:32.425 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:32.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.425 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.425 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:22:32.425 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:32.425 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.425 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.426 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:22:32.426 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:22:32.426 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:22:32.426 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:22:32.426 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:32.426 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:32.426 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:32.426 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:32.426 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.427 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:32.427 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:32.427 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:32.427 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:32.427 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:32.427 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:32.427 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:32.427 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:32.427 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:32.427 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:32.427 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:32.428 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:32.428 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:32.428 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.428 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.428 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:22:32.428 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:32.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.428 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.428 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:22:32.429 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:32.429 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.429 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.429 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:32.429 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.429 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.429 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:22:32.429 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:32.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.430 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.430 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:22:32.430 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:32.430 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.430 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.430 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:32.430 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.430 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.430 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:22:32.431 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:32.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.431 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.431 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:22:32.431 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:32.431 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.431 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.431 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:32.431 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:32.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.432 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:32.432 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:22:32.432 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:32.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.432 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:32.432 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:22:32.432 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:32.432 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.432 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.433 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:22:32.433 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:22:32.433 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:22:32.433 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:22:32.433 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:32.433 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:32.433 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:32.433 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:32.433 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:32.433 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.434 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:32.434 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:22:32.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.434 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:32.434 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:32.434 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:32.434 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:32.434 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:32.434 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:32.434 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:22:32.434 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:32.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.435 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:32.435 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:32.435 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:32.435 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:32.435 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:32.435 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:32.435 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:22:32.435 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:32.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.436 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:32.436 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:32.436 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:32.436 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:32.436 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:32.436 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:32.436 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:22:32.436 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:32.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.436 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:32.436 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:32.437 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:32.437 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:32.437 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:32.437 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:32.437 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:22:32.437 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:32.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.437 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:32.437 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:32.437 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:32.438 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:32.438 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:32.438 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:32.438 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:22:32.438 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:32.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.438 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:32.438 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:32.438 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:32.438 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:32.438 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:32.439 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:32.439 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:22:32.439 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:32.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.439 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:32.439 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:32.439 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:32.439 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:32.439 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:32.439 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:32.440 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:22:32.440 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:32.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:32.440 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:32.440 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:32.440 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:32.440 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:32.440 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:32.440 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:32.440 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:22:32.440 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:32.441 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.441 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:32.441 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:22:32.441 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:22:32.441 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:22:32.441 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:22:32.441 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:22:32.441 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:22:32.441 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:22:32.441 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:22:32.441 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:22:32.441 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:22:32.442 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:22:32.442 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:22:32.442 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:22:32.442 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:32.442 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:22:32.442 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:22:32.442 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:22:32.442 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:22:32.442 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:22:32.442 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:22:32.443 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:22:32.443 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:22:32.443 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:22:32.443 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:22:32.443 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:22:32.443 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:32.443 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:22:32.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.354+0000 7ff1b11ee700 1 -- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff18c066f30 msgr2=0x7ff18c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:32.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.354+0000 7ff1b11ee700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff18c066f30 0x7ff18c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff1940058d0 tx=0x7ff194009040 comp rx=0 tx=0).stop 2023-10-09T06:22:32.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.354+0000 7ff1b11ee700 1 -- 172.21.15.31:0/3316659186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ac157870 msgr2=0x7ff1ac0b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:32.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.354+0000 7ff1b11ee700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ac157870 0x7ff1ac0b2050 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00c170 tx=0x7ff19c00b040 comp rx=0 tx=0).stop 2023-10-09T06:22:32.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.354+0000 7ff1b11ee700 1 -- 172.21.15.31:0/3316659186 shutdown_connections 2023-10-09T06:22:32.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.354+0000 7ff1b11ee700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff18c066f30 0x7ff18c0693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:32.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.354+0000 7ff1b11ee700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1ac15a620 0x7ff1ac16db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:32.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.354+0000 7ff1b11ee700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ac157870 0x7ff1ac0b2050 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:32.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.354+0000 7ff1b11ee700 1 --2- 172.21.15.31:0/3316659186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1ac157c40 0x7ff1ac16d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:32.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.354+0000 7ff1b11ee700 1 -- 172.21.15.31:0/3316659186 >> 172.21.15.31:0/3316659186 conn(0x7ff1ac068ce0 msgr2=0x7ff1ac0cf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:32.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.354+0000 7ff1b11ee700 1 -- 172.21.15.31:0/3316659186 shutdown_connections 2023-10-09T06:22:32.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:32.354+0000 7ff1b11ee700 1 -- 172.21.15.31:0/3316659186 wait complete. 2023-10-09T06:22:32.446 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:22:37.447 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:22:37.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.576+0000 7ff716915700 1 Processor -- start 2023-10-09T06:22:37.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.576+0000 7ff716915700 1 -- start start 2023-10-09T06:22:37.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.577+0000 7ff716915700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff710159f10 0x7ff7100c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:37.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.577+0000 7ff716915700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff71015a2e0 0x7ff7100cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:37.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.577+0000 7ff716915700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff7100cc240 0x7ff7100ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:37.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.577+0000 7ff716915700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71015a730 con 0x7ff710159f10 2023-10-09T06:22:37.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.577+0000 7ff716915700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7100ae320 con 0x7ff7100cc240 2023-10-09T06:22:37.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.577+0000 7ff716915700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100ad710 con 0x7ff71015a2e0 2023-10-09T06:22:37.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.577+0000 7ff715913700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff710159f10 0x7ff7100c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:37.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.577+0000 7ff715913700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff710159f10 0x7ff7100c59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49124/0 (socket says 172.21.15.31:49124) 2023-10-09T06:22:37.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.577+0000 7ff715913700 1 -- 172.21.15.31:0/435254969 learned_addr learned my addr 172.21.15.31:0/435254969 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:37.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.577+0000 7ff716114700 1 --2- 172.21.15.31:0/435254969 >> v2:172.21.15.158:3300/0 conn(0x7ff7100cc240 0x7ff7100ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:37.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.577+0000 7ff715112700 1 --2- 172.21.15.31:0/435254969 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff71015a2e0 0x7ff7100cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:37.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.578+0000 7ff715913700 1 -- 172.21.15.31:0/435254969 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff71015a2e0 msgr2=0x7ff7100cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:37.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.578+0000 7ff715913700 1 --2- 172.21.15.31:0/435254969 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff71015a2e0 0x7ff7100cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:37.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.578+0000 7ff715913700 1 -- 172.21.15.31:0/435254969 >> v2:172.21.15.158:3300/0 conn(0x7ff7100cc240 msgr2=0x7ff7100ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:37.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.578+0000 7ff715913700 1 --2- 172.21.15.31:0/435254969 >> v2:172.21.15.158:3300/0 conn(0x7ff7100cc240 0x7ff7100ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:37.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.578+0000 7ff715913700 1 -- 172.21.15.31:0/435254969 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7100ad9f0 con 0x7ff710159f10 2023-10-09T06:22:37.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.578+0000 7ff716114700 1 --2- 172.21.15.31:0/435254969 >> v2:172.21.15.158:3300/0 conn(0x7ff7100cc240 0x7ff7100ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:37.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.578+0000 7ff715112700 1 --2- 172.21.15.31:0/435254969 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff71015a2e0 0x7ff7100cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:37.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.578+0000 7ff715913700 1 --2- 172.21.15.31:0/435254969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff710159f10 0x7ff7100c59e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff7100cbc50 tx=0x7ff70c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5424d43f2b77c7c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:37.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.578+0000 7ff714911700 1 -- 172.21.15.31:0/435254969 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00e070 con 0x7ff710159f10 2023-10-09T06:22:37.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.578+0000 7ff714911700 1 -- 172.21.15.31:0/435254969 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c00ba50 con 0x7ff710159f10 2023-10-09T06:22:37.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.578+0000 7ff714911700 1 -- 172.21.15.31:0/435254969 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0092e0 con 0x7ff710159f10 2023-10-09T06:22:37.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.578+0000 7ff716915700 1 -- 172.21.15.31:0/435254969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff710159f10 msgr2=0x7ff7100c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:37.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.578+0000 7ff716915700 1 --2- 172.21.15.31:0/435254969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff710159f10 0x7ff7100c59e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff7100cbc50 tx=0x7ff70c009840 comp rx=0 tx=0).stop 2023-10-09T06:22:37.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.579+0000 7ff716915700 1 -- 172.21.15.31:0/435254969 shutdown_connections 2023-10-09T06:22:37.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.579+0000 7ff716915700 1 --2- 172.21.15.31:0/435254969 >> v2:172.21.15.158:3300/0 conn(0x7ff7100cc240 0x7ff7100ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:37.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.579+0000 7ff716915700 1 --2- 172.21.15.31:0/435254969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff710159f10 0x7ff7100c59e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:37.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.579+0000 7ff716915700 1 --2- 172.21.15.31:0/435254969 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff71015a2e0 0x7ff7100cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:37.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.579+0000 7ff716915700 1 -- 172.21.15.31:0/435254969 >> 172.21.15.31:0/435254969 conn(0x7ff710067e40 msgr2=0x7ff7100d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:37.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.579+0000 7ff716915700 1 -- 172.21.15.31:0/435254969 shutdown_connections 2023-10-09T06:22:37.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.579+0000 7ff716915700 1 -- 172.21.15.31:0/435254969 wait complete. 2023-10-09T06:22:37.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.580+0000 7ff716915700 1 Processor -- start 2023-10-09T06:22:37.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.580+0000 7ff716915700 1 -- start start 2023-10-09T06:22:37.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.580+0000 7ff716915700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7100cc240 0x7ff710155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:37.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.580+0000 7ff716915700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff710159f10 0x7ff7100c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:37.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.580+0000 7ff716915700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff71015a2e0 0x7ff7100c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:37.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff716915700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100c8bb0 con 0x7ff710159f10 2023-10-09T06:22:37.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff716915700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7101565a0 con 0x7ff7100cc240 2023-10-09T06:22:37.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff716915700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100b59f0 con 0x7ff71015a2e0 2023-10-09T06:22:37.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff715112700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff710159f10 0x7ff7100c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:37.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff715112700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff710159f10 0x7ff7100c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49140/0 (socket says 172.21.15.31:49140) 2023-10-09T06:22:37.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff715112700 1 -- 172.21.15.31:0/1239148650 learned_addr learned my addr 172.21.15.31:0/1239148650 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:37.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff715913700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7100cc240 0x7ff710155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:37.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff716114700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff71015a2e0 0x7ff7100c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:37.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff715112700 1 -- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff71015a2e0 msgr2=0x7ff7100c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:37.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff715112700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff71015a2e0 0x7ff7100c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:37.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff715112700 1 -- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7100cc240 msgr2=0x7ff710155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:37.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff715112700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7100cc240 0x7ff710155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:37.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff715112700 1 -- 172.21.15.31:0/1239148650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c009ae0 con 0x7ff710159f10 2023-10-09T06:22:37.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff715112700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff710159f10 0x7ff7100c7cf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff70000d860 tx=0x7ff700008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:37.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff705ffb700 1 -- 172.21.15.31:0/1239148650 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000125f0 con 0x7ff710159f10 2023-10-09T06:22:37.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff705ffb700 1 -- 172.21.15.31:0/1239148650 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff700012750 con 0x7ff710159f10 2023-10-09T06:22:37.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff716915700 1 -- 172.21.15.31:0/1239148650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff710155fa0 con 0x7ff710159f10 2023-10-09T06:22:37.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.581+0000 7ff705ffb700 1 -- 172.21.15.31:0/1239148650 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700012af0 con 0x7ff710159f10 2023-10-09T06:22:37.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.582+0000 7ff716915700 1 -- 172.21.15.31:0/1239148650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7100b53a0 con 0x7ff710159f10 2023-10-09T06:22:37.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.582+0000 7ff716915700 1 -- 172.21.15.31:0/1239148650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7100b5200 con 0x7ff710159f10 2023-10-09T06:22:37.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.583+0000 7ff705ffb700 1 -- 172.21.15.31:0/1239148650 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff700014430 con 0x7ff710159f10 2023-10-09T06:22:37.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.583+0000 7ff705ffb700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff6f4066f30 0x7ff6f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:37.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.583+0000 7ff705ffb700 1 -- 172.21.15.31:0/1239148650 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff700084920 con 0x7ff710159f10 2023-10-09T06:22:37.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.583+0000 7ff705ffb700 1 -- 172.21.15.31:0/1239148650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=49}) v3 -- 0x7ff6f406ea50 con 0x7ff710159f10 2023-10-09T06:22:37.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.584+0000 7ff715913700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff6f4066f30 0x7ff6f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:37.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.584+0000 7ff715913700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff6f4066f30 0x7ff6f40693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009880 tx=0x7ff70c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:37.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.588+0000 7ff705ffb700 1 -- 172.21.15.31:0/1239148650 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7100b5200 con 0x7ff710159f10 2023-10-09T06:22:37.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.783+0000 7ff716915700 1 -- 172.21.15.31:0/1239148650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff7100b5200 con 0x7ff710159f10 2023-10-09T06:22:37.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.784+0000 7ff705ffb700 1 -- 172.21.15.31:0/1239148650 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+32403 (secure 0 0 0) 0x7ff7100b5200 con 0x7ff710159f10 2023-10-09T06:22:37.785 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:37.786 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:22:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 48, 2023-10-09T06:22:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:22:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:22:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:22:28.679925+0000", 2023-10-09T06:22:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:22:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:22:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:22:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:22:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:22:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:22:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:22:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:22:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:22:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:22:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:22:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:22:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:22:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:22:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 7, 2023-10-09T06:22:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:22:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:22:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:22:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:22:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:22:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:22:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:22:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:22:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:22:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:22:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:22:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:22:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:22:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:22:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:22:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "46", 2023-10-09T06:22:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:22:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:22:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:22:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 6, 2023-10-09T06:22:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:22:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:10.914998+0000", 2023-10-09T06:22:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:22:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:22:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:22:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:22:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:22:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:22:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:22:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "46", 2023-10-09T06:22:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:22:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:22:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:22:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:22:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 7, 2023-10-09T06:22:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:22:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:11.476116+0000", 2023-10-09T06:22:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:22:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:22:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:22:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:22:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:22:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:22:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:22:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "46", 2023-10-09T06:22:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:22:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:22:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:22:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:22:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:22:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:22:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:22:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:22:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:22:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:22:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:22:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:22:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:22:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:22:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:22:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:22:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:22:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:22:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:22:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:22:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:22:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:22:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:22:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:22:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:22:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:22:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:22:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:22:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:22:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:22:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:22:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:22:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:22:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:22:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:22:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:22:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:22:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:22:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:22:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:22:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:22:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:22:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:22:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:22:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:22:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:22:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:22:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:22:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:22:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:22:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:22:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:22:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull", 2023-10-09T06:22:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:22:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:22:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:22:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:22:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:22:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:22:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:22:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:22:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:22:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:22:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:22:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:22:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:22:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:22:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:37.846 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.846 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.846 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:37.846 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.846 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.846 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:22:37.846 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:37.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.846 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.847 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:22:37.847 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:37.847 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.847 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.847 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:37.847 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.847 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.847 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:22:37.847 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:37.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.848 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.848 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:22:37.848 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:37.848 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.848 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.848 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:37.848 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.848 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.848 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:22:37.849 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:37.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.849 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.849 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:22:37.849 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:37.849 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.849 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.849 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:22:37.849 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:22:37.849 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:22:37.850 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:22:37.850 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:37.850 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:37.850 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:37.850 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.850 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:37.850 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:37.850 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:37.850 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:37.851 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:37.851 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:37.851 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:37.851 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:37.851 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:37.851 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:37.851 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:37.851 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:37.851 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:37.851 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.851 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.852 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:22:37.852 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:37.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.852 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.852 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:22:37.852 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:37.852 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.852 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.852 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:22:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:22:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.854 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:37.854 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.854 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.854 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:22:37.854 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:37.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.854 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.854 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:22:37.855 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:37.855 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.855 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.855 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:37.855 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.855 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.855 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:22:37.855 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:37.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.856 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.856 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:22:37.856 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:37.856 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.856 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.856 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:22:37.856 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:22:37.856 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:22:37.856 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:22:37.856 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:37.857 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:37.857 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:37.857 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:37.857 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.857 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:37.857 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:37.857 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:37.857 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:37.857 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:37.858 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:37.858 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:37.858 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:37.858 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:37.858 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:37.858 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:37.858 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:37.858 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:37.858 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.858 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:22:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:22:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.860 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.860 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:22:37.860 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:37.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.860 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.860 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:22:37.860 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:37.860 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.860 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.861 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:37.861 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.861 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.861 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:22:37.861 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:37.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.861 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.861 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:22:37.861 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:37.862 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.862 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.862 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:37.862 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:37.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.862 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:37.862 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:22:37.862 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:37.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.862 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:37.863 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:22:37.863 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:37.863 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.863 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.863 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:22:37.863 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:22:37.863 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:22:37.863 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:22:37.863 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:37.863 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:37.863 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:22:37.864 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:37.864 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:37.864 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.864 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:37.864 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:22:37.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.864 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:37.864 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:37.864 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:37.864 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:37.864 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:37.865 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:37.865 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:22:37.865 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:37.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.865 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:37.865 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:37.865 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:37.865 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:37.865 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:37.865 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:37.865 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:22:37.866 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:37.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.866 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:37.866 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:37.866 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:37.866 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:37.866 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:37.866 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:37.866 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:22:37.866 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:37.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.867 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:37.867 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:37.867 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:37.867 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:37.867 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:37.867 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:37.867 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:22:37.867 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:37.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.867 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:37.869 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:37.869 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:37.869 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:37.869 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:37.869 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:37.869 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:22:37.869 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:37.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.870 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:37.870 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:37.870 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:37.870 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:37.870 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:37.870 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:37.870 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:22:37.870 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:37.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.871 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:37.871 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:37.871 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:37.871 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:37.871 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:37.871 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:37.871 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:22:37.871 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:37.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:37.871 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:37.872 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:37.872 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:37.872 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:37.872 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:37.872 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:37.872 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:22:37.872 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:37.872 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.872 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:37.872 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:22:37.872 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:22:37.872 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:22:37.873 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:22:37.873 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:22:37.873 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:22:37.873 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:22:37.873 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:22:37.873 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:22:37.873 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:22:37.873 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:22:37.873 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:22:37.873 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:22:37.873 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:37.874 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:22:37.874 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:22:37.874 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:22:37.874 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:22:37.874 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:22:37.874 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:22:37.874 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:22:37.874 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:22:37.874 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:22:37.874 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:22:37.874 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:22:37.874 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:37.875 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:22:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.786+0000 7ff716915700 1 -- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff6f4066f30 msgr2=0x7ff6f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.786+0000 7ff716915700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff6f4066f30 0x7ff6f40693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009880 tx=0x7ff70c018000 comp rx=0 tx=0).stop 2023-10-09T06:22:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.786+0000 7ff716915700 1 -- 172.21.15.31:0/1239148650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff710159f10 msgr2=0x7ff7100c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.786+0000 7ff716915700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff710159f10 0x7ff7100c7cf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff70000d860 tx=0x7ff700008040 comp rx=0 tx=0).stop 2023-10-09T06:22:37.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.787+0000 7ff716915700 1 -- 172.21.15.31:0/1239148650 shutdown_connections 2023-10-09T06:22:37.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.787+0000 7ff716915700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff6f4066f30 0x7ff6f40693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:37.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.787+0000 7ff716915700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff71015a2e0 0x7ff7100c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:37.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.787+0000 7ff716915700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7100cc240 0x7ff710155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:37.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.787+0000 7ff716915700 1 --2- 172.21.15.31:0/1239148650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff710159f10 0x7ff7100c7cf0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:37.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.787+0000 7ff716915700 1 -- 172.21.15.31:0/1239148650 >> 172.21.15.31:0/1239148650 conn(0x7ff710067e40 msgr2=0x7ff7101580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:37.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.787+0000 7ff716915700 1 -- 172.21.15.31:0/1239148650 shutdown_connections 2023-10-09T06:22:37.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:37.787+0000 7ff716915700 1 -- 172.21.15.31:0/1239148650 wait complete. 2023-10-09T06:22:37.878 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:22:39.706 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:22:39.705+0000 7fc5eaab7700 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-10-09T06:22:42.879 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:22:43.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.011+0000 7f6a19dc6700 1 Processor -- start 2023-10-09T06:22:43.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.011+0000 7f6a19dc6700 1 -- start start 2023-10-09T06:22:43.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.012+0000 7f6a19dc6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a141577d0 0x7f6a140cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.012+0000 7f6a19dc6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1415c360 con 0x7f6a14157ba0 2023-10-09T06:22:43.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.012+0000 7f6a19dc6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1415b790 con 0x7f6a1406ac30 2023-10-09T06:22:43.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.012+0000 7f6a19dc6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1415ba30 con 0x7f6a141577d0 2023-10-09T06:22:43.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.012+0000 7f6a12ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6a14157ba0 0x7f6a1406a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53086/0 (socket says 172.21.15.31:53086) 2023-10-09T06:22:43.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.012+0000 7f6a12ffd700 1 -- 172.21.15.31:0/1173644068 learned_addr learned my addr 172.21.15.31:0/1173644068 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:43.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a137fe700 1 --2- 172.21.15.31:0/1173644068 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a141577d0 0x7f6a140cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:43.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945044557 0 0) 0x7f6a1415c360 con 0x7f6a14157ba0 2023-10-09T06:22:43.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69fc003570 con 0x7f6a14157ba0 2023-10-09T06:22:43.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216837777 0 0) 0x7f6a1415b790 con 0x7f6a1406ac30 2023-10-09T06:22:43.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a1415c360 con 0x7f6a1406ac30 2023-10-09T06:22:43.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 471743874 0 0) 0x7f69fc003570 con 0x7f6a14157ba0 2023-10-09T06:22:43.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a141577d0 msgr2=0x7f6a140cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:43.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 --2- 172.21.15.31:0/1173644068 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a141577d0 0x7f6a140cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 >> v1:172.21.15.158:6789/0 conn(0x7f6a1406ac30 legacy=0x7f6a1415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:43.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1415bd10 con 0x7f6a14157ba0 2023-10-09T06:22:43.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f6a08001470 con 0x7f6a14157ba0 2023-10-09T06:22:43.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a137fe700 1 --2- 172.21.15.31:0/1173644068 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a141577d0 0x7f6a140cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:22:43.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 >> v1:172.21.15.31:6789/0 conn(0x7f6a14157ba0 legacy=0x7f6a1406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:43.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 --2- 172.21.15.31:0/1173644068 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a141577d0 0x7f69fc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 --2- 172.21.15.31:0/1173644068 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69fc004160 0x7f69fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 --2- 172.21.15.31:0/1173644068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69fc004d50 0x7f69fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1415ba30 con 0x7f69fc004d50 2023-10-09T06:22:43.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc00bba0 con 0x7f69fc004160 2023-10-09T06:22:43.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc00bd60 con 0x7f6a141577d0 2023-10-09T06:22:43.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a13fff700 1 --2- 172.21.15.31:0/1173644068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69fc004d50 0x7f69fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:43.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a12ffd700 1 --2- 172.21.15.31:0/1173644068 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69fc004160 0x7f69fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:43.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.013+0000 7f6a137fe700 1 --2- 172.21.15.31:0/1173644068 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a141577d0 0x7f69fc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:43.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a13fff700 1 -- 172.21.15.31:0/1173644068 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a141577d0 msgr2=0x7f69fc003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:43.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a13fff700 1 --2- 172.21.15.31:0/1173644068 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a141577d0 0x7f69fc003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a13fff700 1 -- 172.21.15.31:0/1173644068 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69fc004160 msgr2=0x7f69fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:43.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a13fff700 1 --2- 172.21.15.31:0/1173644068 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69fc004160 0x7f69fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a13fff700 1 -- 172.21.15.31:0/1173644068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a04009420 con 0x7f69fc004d50 2023-10-09T06:22:43.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a13fff700 1 --2- 172.21.15.31:0/1173644068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69fc004d50 0x7f69fc0051c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0020f0 tx=0x7f6a0c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3589a9c9ebae2c9b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:43.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c00c8b0 con 0x7f69fc004d50 2023-10-09T06:22:43.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c00ca10 con 0x7f69fc004d50 2023-10-09T06:22:43.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a127fc700 1 -- 172.21.15.31:0/1173644068 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c00cdb0 con 0x7f69fc004d50 2023-10-09T06:22:43.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a19dc6700 1 -- 172.21.15.31:0/1173644068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69fc004d50 msgr2=0x7f69fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:43.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a19dc6700 1 --2- 172.21.15.31:0/1173644068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69fc004d50 0x7f69fc0051c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0020f0 tx=0x7f6a0c0017a0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a13fff700 1 -- 172.21.15.31:0/1173644068 reap_dead start 2023-10-09T06:22:43.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a19dc6700 1 -- 172.21.15.31:0/1173644068 shutdown_connections 2023-10-09T06:22:43.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a19dc6700 1 -- 172.21.15.31:0/1173644068 >> 172.21.15.31:0/1173644068 conn(0x7f6a14068ce0 msgr2=0x7f6a140690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:43.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a19dc6700 1 -- 172.21.15.31:0/1173644068 shutdown_connections 2023-10-09T06:22:43.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.014+0000 7f6a19dc6700 1 -- 172.21.15.31:0/1173644068 wait complete. 2023-10-09T06:22:43.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.016+0000 7f6a19dc6700 1 Processor -- start 2023-10-09T06:22:43.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.016+0000 7f6a19dc6700 1 -- start start 2023-10-09T06:22:43.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.016+0000 7f6a19dc6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6a140cd330 0x7f6a140ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a19dc6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a140cd700 0x7f6a140ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a19dc6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140a7730 0x7f6a140a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a19dc6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140a90e0 con 0x7f6a140cd700 2023-10-09T06:22:43.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a19dc6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140a84d0 con 0x7f6a140cd330 2023-10-09T06:22:43.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a19dc6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140a87b0 con 0x7f6a140a7730 2023-10-09T06:22:43.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a12ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a140cd700 0x7f6a140ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:43.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a12ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a140cd700 0x7f6a140ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55240/0 (socket says 172.21.15.31:55240) 2023-10-09T06:22:43.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a12ffd700 1 -- 172.21.15.31:0/3505163279 learned_addr learned my addr 172.21.15.31:0/3505163279 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:43.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a137fe700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6a140cd330 0x7f6a140ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:43.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a13fff700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140a7730 0x7f6a140a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:43.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a12ffd700 1 -- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140a7730 msgr2=0x7f6a140a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:43.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a12ffd700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140a7730 0x7f6a140a7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a12ffd700 1 -- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6a140cd330 msgr2=0x7f6a140ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:43.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a12ffd700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6a140cd330 0x7f6a140ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a12ffd700 1 -- 172.21.15.31:0/3505163279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140a8a90 con 0x7f6a140cd700 2023-10-09T06:22:43.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a13fff700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140a7730 0x7f6a140a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:43.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a12ffd700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a140cd700 0x7f6a140ac9d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6a080073c0 tx=0x7f6a08001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:43.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f69fb7fe700 1 -- 172.21.15.31:0/3505163279 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08018030 con 0x7f6a140cd700 2023-10-09T06:22:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f69fb7fe700 1 -- 172.21.15.31:0/3505163279 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0800f6c0 con 0x7f6a140cd700 2023-10-09T06:22:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a19dc6700 1 -- 172.21.15.31:0/3505163279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a140a8d70 con 0x7f6a140cd700 2023-10-09T06:22:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f69fb7fe700 1 -- 172.21.15.31:0/3505163279 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0800faa0 con 0x7f6a140cd700 2023-10-09T06:22:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.017+0000 7f6a19dc6700 1 -- 172.21.15.31:0/3505163279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a140ae4b0 con 0x7f6a140cd700 2023-10-09T06:22:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.018+0000 7f6a19dc6700 1 -- 172.21.15.31:0/3505163279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1404c3c0 con 0x7f6a140cd700 2023-10-09T06:22:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.019+0000 7f69fb7fe700 1 -- 172.21.15.31:0/3505163279 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a0801b070 con 0x7f6a140cd700 2023-10-09T06:22:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.019+0000 7f69fb7fe700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6a00066f30 0x7f6a000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.019+0000 7f69fb7fe700 1 -- 172.21.15.31:0/3505163279 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f6a08019070 con 0x7f6a140cd700 2023-10-09T06:22:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.019+0000 7f6a137fe700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6a00066f30 0x7f6a000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.020+0000 7f6a137fe700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6a00066f30 0x7f6a000693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6a04006f00 tx=0x7f6a040091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:43.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.024+0000 7f69fb7fe700 1 -- 172.21.15.31:0/3505163279 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a08051600 con 0x7f6a140cd700 2023-10-09T06:22:43.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.219+0000 7f6a19dc6700 1 -- 172.21.15.31:0/3505163279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6a1415bff0 con 0x7f6a140cd700 2023-10-09T06:22:43.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.220+0000 7f69fb7fe700 1 -- 172.21.15.31:0/3505163279 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) v1 ==== 81+0+32635 (secure 0 0 0) 0x7f6a08054c20 con 0x7f6a140cd700 2023-10-09T06:22:43.221 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:43.221 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:22:43.221 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 52, 2023-10-09T06:22:43.222 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:22:43.222 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:22:43.222 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:22:42.723970+0000", 2023-10-09T06:22:43.222 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:22:43.222 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:22:43.222 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:22:43.222 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:22:43.222 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:22:43.222 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:22:43.222 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:22:43.222 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:22:43.223 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:22:43.223 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:43.223 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:22:43.223 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:22:43.223 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:22:43.223 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:22:43.223 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:22:43.223 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 7, 2023-10-09T06:22:43.223 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:22:43.223 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:22:43.223 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "luminous", 2023-10-09T06:22:43.223 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:22:43.223 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:22:43.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.224 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:22:43.224 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:22:43.224 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:22:43.224 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:22:43.224 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:22:43.224 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:43.224 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:43.224 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:43.224 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:43.224 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:43.225 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:43.225 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:43.225 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:43.225 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:43.225 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:43.225 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:22:43.225 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:22:43.225 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:22:43.225 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:22:43.225 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:22:43.225 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:43.225 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:43.226 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:43.226 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:43.226 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:43.226 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:43.226 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:43.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.226 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "52", 2023-10-09T06:22:43.226 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:43.226 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:43.226 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:43.226 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:43.226 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:43.227 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:43.227 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:43.227 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:43.227 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:43.227 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:43.227 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:43.227 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:43.227 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:43.227 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:43.227 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:43.227 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:43.228 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:43.228 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:43.228 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:43.228 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:43.228 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:43.228 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:43.228 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:43.228 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:43.228 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:43.228 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:43.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.229 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:43.229 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:43.229 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:43.229 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:43.229 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:43.229 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:43.229 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:43.229 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:43.229 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:43.229 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:43.229 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:43.230 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:43.230 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:22:43.230 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:22:43.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.230 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:43.230 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:22:43.230 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.230 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 6, 2023-10-09T06:22:43.230 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:22:43.231 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:10.914998+0000", 2023-10-09T06:22:43.231 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:22:43.231 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:22:43.231 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:43.231 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:43.231 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:43.231 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:43.231 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:43.231 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:43.231 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:43.231 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:43.231 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:43.232 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:43.232 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:22:43.232 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:22:43.232 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:22:43.232 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:22:43.232 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:22:43.232 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:43.232 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:43.232 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:43.232 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:43.232 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:43.232 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:43.233 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:43.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.233 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "52", 2023-10-09T06:22:43.233 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:43.233 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:43.233 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:43.233 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:43.233 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:43.233 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:43.233 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:43.233 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:43.233 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:43.234 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:43.234 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:43.234 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:43.234 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:43.234 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:43.234 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:43.234 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:43.234 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:43.234 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:43.234 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:43.234 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:43.235 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:43.235 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:43.235 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:43.235 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:43.235 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:43.235 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:43.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.235 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:43.235 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:43.235 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:43.235 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:43.235 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:43.235 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:43.236 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:43.236 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:43.236 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:43.236 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:43.236 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:43.236 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:43.236 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:22:43.236 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:22:43.236 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:22:43.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.236 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:43.237 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:43.237 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:22:43.237 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.237 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.237 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 7, 2023-10-09T06:22:43.237 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:22:43.237 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:11.476116+0000", 2023-10-09T06:22:43.237 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:22:43.237 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:22:43.237 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:43.237 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:43.238 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:43.238 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:43.238 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:43.238 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:43.238 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:43.238 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:43.238 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:43.238 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:43.238 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:22:43.238 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:22:43.238 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:22:43.239 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:22:43.239 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:22:43.239 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:43.239 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:43.239 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:43.239 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:43.239 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:43.239 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:43.239 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:43.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.239 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "52", 2023-10-09T06:22:43.239 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:43.240 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:43.240 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:43.240 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:43.240 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:43.240 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:43.240 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:43.240 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:43.240 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:43.240 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:43.240 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:43.240 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:43.240 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:43.241 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:43.241 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:43.241 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:43.241 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:43.241 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:43.241 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:43.241 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:43.241 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:43.241 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:43.241 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:43.241 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:43.241 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:43.242 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:43.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.242 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:43.242 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:43.242 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:43.242 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:43.242 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:43.242 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:43.242 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:43.242 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:43.242 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:43.242 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:43.243 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:43.243 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:43.243 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:22:43.243 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:22:43.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.243 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:43.243 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:43.243 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:22:43.243 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.243 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.243 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.243 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:43.244 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:22:43.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.244 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:43.244 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.244 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.244 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.244 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.244 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.244 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.244 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.244 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.245 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.245 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.245 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.245 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.245 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.245 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.245 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:22:43.245 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.245 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.246 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:22:43.246 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.246 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.246 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.246 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.246 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.246 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.246 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:22:43.246 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.247 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.247 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:22:43.247 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.247 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.247 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.247 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.247 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.247 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.247 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:22:43.248 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.248 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.248 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:22:43.248 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.248 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.248 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.248 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.248 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.249 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:22:43.249 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.249 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:22:43.249 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.249 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.249 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.249 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:22:43.250 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:22:43.250 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:22:43.250 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:22:43.250 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.250 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.250 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.250 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.250 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:43.250 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.251 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.251 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.251 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.251 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.251 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.251 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.251 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.251 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.251 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.251 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.251 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.251 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.252 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.252 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:22:43.252 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.252 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.252 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:22:43.252 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.252 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.252 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.253 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.253 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.253 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.253 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:22:43.253 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.253 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.253 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:22:43.253 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.253 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.254 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.254 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.254 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.254 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.254 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:22:43.254 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.254 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.255 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:22:43.255 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.255 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.255 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.255 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.255 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.255 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.255 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:22:43.255 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:22:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:22:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:22:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:22:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:22:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.257 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.257 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.257 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:43.257 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.257 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.257 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.257 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.257 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.257 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.258 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.258 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.258 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.258 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.258 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.258 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.258 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.258 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.258 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:22:43.258 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.259 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.259 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:22:43.259 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.259 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.259 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.259 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.259 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.259 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.259 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:22:43.260 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.260 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.260 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:22:43.260 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.260 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.260 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.260 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.260 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.261 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.261 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:22:43.261 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.261 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.261 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:22:43.261 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.261 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.261 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.261 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.262 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.262 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.262 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:22:43.262 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.262 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.262 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:22:43.262 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.262 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.262 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.263 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:22:43.263 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:22:43.263 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:22:43.263 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:22:43.263 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.263 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.263 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.263 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.264 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:43.264 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.264 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.264 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.264 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.264 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.264 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.264 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.264 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.264 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.264 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.264 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.265 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.265 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.265 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.265 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:22:43.265 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.265 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.265 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:22:43.265 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.265 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.266 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.266 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.266 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.266 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.266 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:22:43.266 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.266 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.267 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:22:43.267 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.267 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.267 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.267 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.267 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.267 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.267 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:22:43.267 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.268 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.268 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:22:43.268 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.268 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.268 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.268 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.268 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.268 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.268 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:22:43.269 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.269 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.269 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:22:43.269 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.269 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.269 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.269 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:22:43.269 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:22:43.269 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:22:43.270 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:22:43.270 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.270 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.270 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.270 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.270 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:43.270 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.270 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.270 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.270 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.271 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.271 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.271 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.271 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.271 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.271 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.271 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.271 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.271 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.271 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.271 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:22:43.272 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.272 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.272 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:22:43.272 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.272 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.272 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.272 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.272 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.273 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.273 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:22:43.273 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.273 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.273 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:22:43.273 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.273 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.273 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.274 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.274 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.274 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.274 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:22:43.274 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.274 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.274 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:22:43.275 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.275 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.275 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.275 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.275 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.275 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.275 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:22:43.275 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.276 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.276 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:22:43.276 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.276 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.276 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.276 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:22:43.276 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:22:43.276 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:22:43.276 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:22:43.276 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.276 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.277 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.277 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.277 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:43.277 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.277 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.277 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.277 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.277 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.277 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.277 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.278 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.278 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.278 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.278 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.278 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.278 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.278 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.278 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:22:43.278 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.279 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.279 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:22:43.279 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.279 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.279 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.279 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.279 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.279 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.280 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:22:43.280 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.280 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.280 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:22:43.280 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.280 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.280 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.280 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.280 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.281 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.281 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:22:43.281 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.281 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.281 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:22:43.281 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.282 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.282 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.282 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.282 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.282 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.282 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:22:43.283 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.283 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.283 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:22:43.283 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.283 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.283 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.283 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:22:43.283 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:22:43.283 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:22:43.284 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:22:43.284 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.284 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.284 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.284 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.284 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:43.284 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.284 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.284 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.284 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.285 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.285 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.285 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.285 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.285 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.285 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.285 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.285 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.285 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.285 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.286 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:22:43.286 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.286 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.286 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:22:43.286 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.286 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.286 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.286 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.287 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.287 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.287 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:22:43.287 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.287 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.287 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:22:43.287 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.288 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.288 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.288 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.288 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.288 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.288 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:22:43.288 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.288 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.289 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:22:43.289 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.289 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.289 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.289 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.289 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.289 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.289 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:22:43.289 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.290 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.290 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:22:43.290 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.290 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.290 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.290 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:22:43.290 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:22:43.290 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:22:43.290 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:22:43.291 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.291 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.291 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.291 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.291 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:43.291 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.291 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.291 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.291 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.291 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.292 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.292 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.292 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.292 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.292 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.292 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.292 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.292 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.292 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.292 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:22:43.292 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.293 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.293 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:22:43.293 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.293 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.293 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.293 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.293 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.293 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.294 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:22:43.294 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.294 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.294 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:22:43.294 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.294 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.294 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.294 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.295 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.295 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.295 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:22:43.295 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.295 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.295 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:22:43.295 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.295 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.295 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.296 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.296 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.296 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.296 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:22:43.296 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.296 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.296 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:22:43.297 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.297 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.297 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.297 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:22:43.297 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:22:43.297 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:22:43.297 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:22:43.297 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.297 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.297 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.297 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.298 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.298 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:43.298 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:22:43.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.298 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:43.298 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.298 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.298 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.298 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.298 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.298 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:22:43.298 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.299 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:43.299 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.299 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.299 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.299 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.299 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.299 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:22:43.299 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.300 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:43.300 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.300 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.300 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.300 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.300 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.300 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:22:43.300 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.300 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:43.301 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.301 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.301 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.301 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.301 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.301 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:22:43.301 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.301 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:43.301 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.301 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.302 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.302 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.302 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.302 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:22:43.302 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.302 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:43.302 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.302 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.302 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.302 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.303 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.303 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:22:43.303 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.303 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:43.303 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.303 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.303 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.303 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.303 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.304 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:22:43.304 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.304 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:43.304 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.304 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.304 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.304 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.304 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.304 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:22:43.304 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.305 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.305 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:43.305 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:22:43.305 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [ 2023-10-09T06:22:43.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.305 INFO:teuthology.orchestra.run.smithi031.stdout: "pgid": "7.36", 2023-10-09T06:22:43.305 INFO:teuthology.orchestra.run.smithi031.stdout: "mappings": [ 2023-10-09T06:22:43.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.305 INFO:teuthology.orchestra.run.smithi031.stdout: "from": 0, 2023-10-09T06:22:43.305 INFO:teuthology.orchestra.run.smithi031.stdout: "to": 5 2023-10-09T06:22:43.305 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.305 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.306 INFO:teuthology.orchestra.run.smithi031.stdout: "pgid": "7.37", 2023-10-09T06:22:43.306 INFO:teuthology.orchestra.run.smithi031.stdout: "mappings": [ 2023-10-09T06:22:43.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.306 INFO:teuthology.orchestra.run.smithi031.stdout: "from": 0, 2023-10-09T06:22:43.306 INFO:teuthology.orchestra.run.smithi031.stdout: "to": 4 2023-10-09T06:22:43.306 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.306 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.306 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.306 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:43.306 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:22:43.307 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:22:43.307 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:22:43.307 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:22:43.307 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:22:43.307 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:22:43.307 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:22:43.307 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:22:43.307 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:22:43.307 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:22:43.307 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:22:43.307 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.308 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:22:43.308 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:22:43.308 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:22:43.308 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:22:43.308 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:22:43.308 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:22:43.308 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:22:43.308 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:22:43.308 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:22:43.308 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:22:43.308 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:22:43.309 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.309 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:22:43.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.222+0000 7f6a19dc6700 1 -- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6a00066f30 msgr2=0x7f6a000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:43.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.222+0000 7f6a19dc6700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6a00066f30 0x7f6a000693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6a04006f00 tx=0x7f6a040091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.222+0000 7f6a19dc6700 1 -- 172.21.15.31:0/3505163279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a140cd700 msgr2=0x7f6a140ac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.222+0000 7f6a19dc6700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a140cd700 0x7f6a140ac9d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6a080073c0 tx=0x7f6a08001df0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.222+0000 7f6a19dc6700 1 -- 172.21.15.31:0/3505163279 shutdown_connections 2023-10-09T06:22:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.222+0000 7f6a19dc6700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6a00066f30 0x7f6a000693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.222+0000 7f6a19dc6700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6a140a7730 0x7f6a140a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.222+0000 7f6a19dc6700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6a140cd330 0x7f6a140ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.222+0000 7f6a19dc6700 1 --2- 172.21.15.31:0/3505163279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a140cd700 0x7f6a140ac9d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.222+0000 7f6a19dc6700 1 -- 172.21.15.31:0/3505163279 >> 172.21.15.31:0/3505163279 conn(0x7f6a14068ce0 msgr2=0x7f6a14159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.222+0000 7f6a19dc6700 1 -- 172.21.15.31:0/3505163279 shutdown_connections 2023-10-09T06:22:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.223+0000 7f6a19dc6700 1 -- 172.21.15.31:0/3505163279 wait complete. 2023-10-09T06:22:43.312 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-09T06:22:43.312 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:22:43.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.430+0000 7fb30615f700 1 Processor -- start 2023-10-09T06:22:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.430+0000 7fb30615f700 1 -- start start 2023-10-09T06:22:43.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.430+0000 7fb30615f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb3000b0890 0x7fb3000cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.430+0000 7fb30615f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb3000cbd40 0x7fb300067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.430+0000 7fb30615f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb30006c630 0x7fb300067ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.430+0000 7fb30615f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3000cb370 con 0x7fb3000b0890 2023-10-09T06:22:43.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.430+0000 7fb30615f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3000b0c60 con 0x7fb3000cbd40 2023-10-09T06:22:43.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.430+0000 7fb30615f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30006a1e0 con 0x7fb30006c630 2023-10-09T06:22:43.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.430+0000 7fb2ff7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb3000b0890 0x7fb3000cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:43.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2ff7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb3000b0890 0x7fb3000cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55242/0 (socket says 172.21.15.31:55242) 2023-10-09T06:22:43.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2ff7fe700 1 -- 172.21.15.31:0/1935942232 learned_addr learned my addr 172.21.15.31:0/1935942232 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:43.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2feffd700 1 --2- 172.21.15.31:0/1935942232 >> v2:172.21.15.158:3300/0 conn(0x7fb3000cbd40 0x7fb300067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:43.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2fffff700 1 --2- 172.21.15.31:0/1935942232 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb30006c630 0x7fb300067ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:43.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2ff7fe700 1 -- 172.21.15.31:0/1935942232 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb30006c630 msgr2=0x7fb300067ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:43.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2ff7fe700 1 --2- 172.21.15.31:0/1935942232 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb30006c630 0x7fb300067ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2ff7fe700 1 -- 172.21.15.31:0/1935942232 >> v2:172.21.15.158:3300/0 conn(0x7fb3000cbd40 msgr2=0x7fb300067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:43.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2ff7fe700 1 --2- 172.21.15.31:0/1935942232 >> v2:172.21.15.158:3300/0 conn(0x7fb3000cbd40 0x7fb300067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2ff7fe700 1 -- 172.21.15.31:0/1935942232 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30006cb80 con 0x7fb3000b0890 2023-10-09T06:22:43.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2feffd700 1 --2- 172.21.15.31:0/1935942232 >> v2:172.21.15.158:3300/0 conn(0x7fb3000cbd40 0x7fb300067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:43.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2fffff700 1 --2- 172.21.15.31:0/1935942232 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb30006c630 0x7fb300067ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:43.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2ff7fe700 1 --2- 172.21.15.31:0/1935942232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3000b0890 0x7fb3000cb800 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb300064ae0 tx=0x7fb2f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16c73d1a8a061d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:43.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2fe7fc700 1 -- 172.21.15.31:0/1935942232 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000b860 con 0x7fb3000b0890 2023-10-09T06:22:43.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2fe7fc700 1 -- 172.21.15.31:0/1935942232 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000b9c0 con 0x7fb3000b0890 2023-10-09T06:22:43.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.431+0000 7fb2fe7fc700 1 -- 172.21.15.31:0/1935942232 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000bd60 con 0x7fb3000b0890 2023-10-09T06:22:43.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.432+0000 7fb30615f700 1 -- 172.21.15.31:0/1935942232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3000b0890 msgr2=0x7fb3000cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:43.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.432+0000 7fb30615f700 1 --2- 172.21.15.31:0/1935942232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3000b0890 0x7fb3000cb800 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb300064ae0 tx=0x7fb2f0009250 comp rx=0 tx=0).stop 2023-10-09T06:22:43.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.432+0000 7fb30615f700 1 -- 172.21.15.31:0/1935942232 shutdown_connections 2023-10-09T06:22:43.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.432+0000 7fb30615f700 1 --2- 172.21.15.31:0/1935942232 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb30006c630 0x7fb300067ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.432+0000 7fb30615f700 1 --2- 172.21.15.31:0/1935942232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3000b0890 0x7fb3000cb800 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.432+0000 7fb30615f700 1 --2- 172.21.15.31:0/1935942232 >> v2:172.21.15.158:3300/0 conn(0x7fb3000cbd40 0x7fb300067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.432+0000 7fb30615f700 1 -- 172.21.15.31:0/1935942232 >> 172.21.15.31:0/1935942232 conn(0x7fb30006fe50 msgr2=0x7fb300069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:43.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.432+0000 7fb30615f700 1 -- 172.21.15.31:0/1935942232 shutdown_connections 2023-10-09T06:22:43.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.432+0000 7fb30615f700 1 -- 172.21.15.31:0/1935942232 wait complete. 2023-10-09T06:22:43.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.433+0000 7fb30615f700 1 Processor -- start 2023-10-09T06:22:43.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.433+0000 7fb30615f700 1 -- start start 2023-10-09T06:22:43.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb30615f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30006c630 0x7fb3000c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb30615f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3000b0890 0x7fb30015b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb30615f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3000cbd40 0x7fb300068130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb30615f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c6bc0 con 0x7fb30006c630 2023-10-09T06:22:43.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb30615f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c5240 con 0x7fb3000b0890 2023-10-09T06:22:43.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb30615f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c6df0 con 0x7fb3000cbd40 2023-10-09T06:22:43.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb2ff7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30006c630 0x7fb3000c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:43.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb2ff7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30006c630 0x7fb3000c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55246/0 (socket says 172.21.15.31:55246) 2023-10-09T06:22:43.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb2ff7fe700 1 -- 172.21.15.31:0/822179703 learned_addr learned my addr 172.21.15.31:0/822179703 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:43.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb2ff7fe700 1 -- 172.21.15.31:0/822179703 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3000cbd40 msgr2=0x7fb300068130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:43.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb2ff7fe700 1 --2- 172.21.15.31:0/822179703 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3000cbd40 0x7fb300068130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb2ff7fe700 1 -- 172.21.15.31:0/822179703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3000b0890 msgr2=0x7fb30015b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:43.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb2ff7fe700 1 --2- 172.21.15.31:0/822179703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3000b0890 0x7fb30015b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb2ff7fe700 1 -- 172.21.15.31:0/822179703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f00094f0 con 0x7fb30006c630 2023-10-09T06:22:43.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb2ff7fe700 1 --2- 172.21.15.31:0/822179703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30006c630 0x7fb3000c7bb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb30006ab60 tx=0x7fb2f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:43.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.434+0000 7fb2e77fe700 1 -- 172.21.15.31:0/822179703 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0024440 con 0x7fb30006c630 2023-10-09T06:22:43.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.435+0000 7fb2e77fe700 1 -- 172.21.15.31:0/822179703 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f00245a0 con 0x7fb30006c630 2023-10-09T06:22:43.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.435+0000 7fb30615f700 1 -- 172.21.15.31:0/822179703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3000c70d0 con 0x7fb30006c630 2023-10-09T06:22:43.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.435+0000 7fb2e77fe700 1 -- 172.21.15.31:0/822179703 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0024960 con 0x7fb30006c630 2023-10-09T06:22:43.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.435+0000 7fb30615f700 1 -- 172.21.15.31:0/822179703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3000c7690 con 0x7fb30006c630 2023-10-09T06:22:43.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.435+0000 7fb30615f700 1 -- 172.21.15.31:0/822179703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3000c78b0 con 0x7fb30006c630 2023-10-09T06:22:43.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.436+0000 7fb2e77fe700 1 -- 172.21.15.31:0/822179703 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2f0024d50 con 0x7fb30006c630 2023-10-09T06:22:43.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.436+0000 7fb2e77fe700 1 --2- 172.21.15.31:0/822179703 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb2ec066f60 0x7fb2ec069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:43.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.436+0000 7fb2e77fe700 1 -- 172.21.15.31:0/822179703 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb2f0086200 con 0x7fb30006c630 2023-10-09T06:22:43.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.437+0000 7fb2feffd700 1 --2- 172.21.15.31:0/822179703 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb2ec066f60 0x7fb2ec069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:43.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.437+0000 7fb2feffd700 1 --2- 172.21.15.31:0/822179703 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb2ec066f60 0x7fb2ec069410 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4006fd0 tx=0x7fb2f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:43.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.441+0000 7fb2e77fe700 1 -- 172.21.15.31:0/822179703 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2f0053430 con 0x7fb30006c630 2023-10-09T06:22:43.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.634+0000 7fb30615f700 1 -- 172.21.15.31:0/822179703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb30004c3c0 con 0x7fb30006c630 2023-10-09T06:22:43.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.634+0000 7fb2e77fe700 1 -- 172.21.15.31:0/822179703 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) v1 ==== 81+0+32635 (secure 0 0 0) 0x7fb2f002b340 con 0x7fb30006c630 2023-10-09T06:22:43.823 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:43.823 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:22:43.823 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 52, 2023-10-09T06:22:43.823 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:22:43.823 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:22:43.824 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:22:42.723970+0000", 2023-10-09T06:22:43.824 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:22:43.825 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:22:43.825 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:22:43.825 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:22:43.825 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:22:43.825 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:22:43.826 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:22:43.826 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:22:43.826 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:22:43.826 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:43.826 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:22:43.827 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:22:43.827 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:22:43.827 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:22:43.827 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:22:43.827 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 7, 2023-10-09T06:22:43.828 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:22:43.828 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:22:43.828 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "luminous", 2023-10-09T06:22:43.828 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:22:43.828 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:22:43.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.829 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:22:43.829 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:22:43.829 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:22:43.829 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:22:43.830 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:22:43.830 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:43.830 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:43.830 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:43.830 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:43.831 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:43.831 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:43.831 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:43.831 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:43.831 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:43.832 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:43.832 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:22:43.832 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:22:43.832 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:22:43.832 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:22:43.832 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:22:43.833 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:43.833 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:43.833 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:43.833 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:43.833 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:43.833 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:43.834 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:43.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.834 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "52", 2023-10-09T06:22:43.834 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:43.834 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:43.834 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:43.834 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:43.834 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:43.834 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:43.835 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:43.835 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:43.835 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:43.835 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:43.835 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:43.835 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:43.835 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:43.835 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:43.835 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:43.835 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:43.836 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:43.836 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:43.836 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:43.836 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:43.836 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:43.836 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:43.836 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:43.836 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:43.836 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:43.837 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:43.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.837 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:43.837 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:43.837 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:43.837 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:43.837 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:43.837 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:43.837 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:43.837 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:43.838 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:43.838 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:43.838 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:43.838 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:43.838 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:22:43.838 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:22:43.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.838 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:43.838 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:22:43.839 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.839 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 6, 2023-10-09T06:22:43.839 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:22:43.839 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:10.914998+0000", 2023-10-09T06:22:43.839 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:22:43.839 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:22:43.839 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:43.839 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:43.839 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:43.840 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:43.840 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:43.840 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:43.840 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:43.840 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:43.840 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:43.840 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:43.840 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:22:43.840 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:22:43.840 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:22:43.841 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:22:43.841 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:22:43.841 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:43.841 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:43.841 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:43.841 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:43.841 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:43.841 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:43.841 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:43.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.842 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "52", 2023-10-09T06:22:43.842 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:43.842 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:43.842 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:43.842 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:43.842 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:43.842 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:43.842 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:43.842 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:43.842 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:43.842 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:43.843 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:43.843 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:43.843 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:43.843 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:43.843 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:43.843 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:43.843 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:43.843 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:43.843 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:43.843 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:43.843 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:43.843 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:43.844 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:43.844 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:43.844 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:43.844 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:43.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.844 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:43.844 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:43.844 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:43.844 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:43.844 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:43.845 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:43.845 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:43.845 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:43.845 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:43.845 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:43.845 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:43.845 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:43.845 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:22:43.845 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:22:43.845 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:22:43.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.846 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:43.846 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:43.846 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:22:43.846 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.846 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.846 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 7, 2023-10-09T06:22:43.847 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:22:43.847 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:22:11.476116+0000", 2023-10-09T06:22:43.847 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:22:43.847 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:22:43.847 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:22:43.847 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:22:43.847 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:22:43.847 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:22:43.847 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:22:43.847 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:22:43.848 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:22:43.848 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:22:43.848 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:22:43.848 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:22:43.848 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:22:43.848 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:22:43.848 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:22:43.848 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:22:43.848 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:22:43.848 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:22:43.849 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:22:43.849 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:22:43.849 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:22:43.849 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:22:43.849 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:22:43.849 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:22:43.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.849 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "52", 2023-10-09T06:22:43.849 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:22:43.849 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:22:43.850 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:22:43.850 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:22:43.850 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:22:43.850 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:22:43.850 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:22:43.850 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:22:43.850 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:22:43.850 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:22:43.850 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:22:43.850 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:22:43.851 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:22:43.851 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:22:43.851 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:22:43.851 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:22:43.851 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:22:43.851 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:22:43.851 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:22:43.851 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:22:43.851 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:22:43.851 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:22:43.851 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:22:43.852 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:22:43.852 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:22:43.852 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:22:43.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.852 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:22:43.852 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:22:43.852 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:22:43.852 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:22:43.852 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:22:43.853 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:22:43.853 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:22:43.853 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:22:43.853 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:22:43.853 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:22:43.853 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:22:43.853 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:22:43.853 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:22:43.853 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:22:43.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.853 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:22:43.854 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:22:43.854 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:22:43.854 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.854 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.854 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.854 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:43.854 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:22:43.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.854 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:43.854 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.855 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.855 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.855 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.855 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.855 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.855 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.855 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.855 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.855 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.855 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.856 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.856 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.856 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.856 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:22:43.856 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.856 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.856 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:22:43.856 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.857 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.857 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.857 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.857 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.857 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.857 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:22:43.857 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.858 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.858 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:22:43.858 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.858 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.858 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.858 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.858 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.859 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.859 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:22:43.859 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.859 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.859 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:22:43.859 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.859 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.859 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.860 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.860 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.860 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.860 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:22:43.860 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.860 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.860 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:22:43.861 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:22:43.861 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.861 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.861 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:22:43.861 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:22:43.861 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:22:43.861 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:22:43.861 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.861 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.862 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.862 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.862 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:43.862 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.862 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.862 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.862 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.862 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.863 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.863 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.863 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.863 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.863 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.863 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.863 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.863 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.863 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.864 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:22:43.864 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.864 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.864 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:22:43.864 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.864 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.864 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.865 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.865 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.865 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.865 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:22:43.865 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.865 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.865 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:22:43.866 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.866 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.866 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.866 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.866 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.866 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.866 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:22:43.866 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.867 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.867 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:22:43.867 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.867 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.867 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.867 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.867 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.868 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.868 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:22:43.868 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.868 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.868 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:22:43.868 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:22:43.868 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.868 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.869 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:22:43.869 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:22:43.869 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:22:43.869 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:22:43.869 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.869 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.869 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.869 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.869 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:43.870 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.870 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.870 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.870 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.870 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.870 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.870 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.870 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.870 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.870 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.871 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.871 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.871 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.871 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.871 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:22:43.871 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.871 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.872 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:22:43.872 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.872 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.872 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.872 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.872 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.872 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.872 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:22:43.873 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.873 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.873 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:22:43.873 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.873 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.873 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.873 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:22:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:22:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:22:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:22:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:22:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:22:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:22:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:22:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:22:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:22:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:22:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:22:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:22:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:22:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:22:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:22:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:22:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:22:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:22:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:22:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:22:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:22:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:22:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:22:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:22:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:22:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:22:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:22:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:22:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:22:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:22:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:22:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:22:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:22:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:22:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:22:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:22:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:22:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:22:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:22:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:22:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:22:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:22:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:22:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:22:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:22:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:22:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:22:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:22:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:22:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:22:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:22:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:22:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:22:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:22:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:22:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:22:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:22:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:22:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:22:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:22:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:22:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:22:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:22:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:22:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:22:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:22:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:22:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:22:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 43, 2023-10-09T06:22:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:22:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:22:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:22:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:22:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:22:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:22:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:22:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:22:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:22:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:22:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:22:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:22:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:22:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:22:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:22:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:22:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:22:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:22:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:22:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:22:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:22:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:22:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:22:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:22:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:22:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:22:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:22:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:22:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:22:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:22:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:22:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:22:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:22:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:22:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:22:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:22:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:22:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:22:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:22:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:22:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:22:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:22:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:22:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:22:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:22:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:22:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:22:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:22:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:22:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [ 2023-10-09T06:22:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "pgid": "7.36", 2023-10-09T06:22:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "mappings": [ 2023-10-09T06:22:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "from": 0, 2023-10-09T06:22:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "to": 5 2023-10-09T06:22:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "pgid": "7.37", 2023-10-09T06:22:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "mappings": [ 2023-10-09T06:22:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:22:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "from": 0, 2023-10-09T06:22:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "to": 4 2023-10-09T06:22:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:22:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:22:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:22:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:22:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:22:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:22:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:22:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:22:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:22:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:22:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:22:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:22:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:22:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:22:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:22:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:22:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:22:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:22:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:22:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:22:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:22:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:22:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:22:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:22:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:22:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:22:43.923 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:22:43.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.637+0000 7fb30615f700 1 -- 172.21.15.31:0/822179703 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb2ec066f60 msgr2=0x7fb2ec069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:43.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.637+0000 7fb30615f700 1 --2- 172.21.15.31:0/822179703 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb2ec066f60 0x7fb2ec069410 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4006fd0 tx=0x7fb2f4008040 comp rx=0 tx=0).stop 2023-10-09T06:22:43.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.637+0000 7fb30615f700 1 -- 172.21.15.31:0/822179703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30006c630 msgr2=0x7fb3000c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:43.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.637+0000 7fb30615f700 1 --2- 172.21.15.31:0/822179703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30006c630 0x7fb3000c7bb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb30006ab60 tx=0x7fb2f0017000 comp rx=0 tx=0).stop 2023-10-09T06:22:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.637+0000 7fb30615f700 1 -- 172.21.15.31:0/822179703 shutdown_connections 2023-10-09T06:22:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.637+0000 7fb30615f700 1 --2- 172.21.15.31:0/822179703 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb2ec066f60 0x7fb2ec069410 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.637+0000 7fb30615f700 1 --2- 172.21.15.31:0/822179703 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3000cbd40 0x7fb300068130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.637+0000 7fb30615f700 1 --2- 172.21.15.31:0/822179703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30006c630 0x7fb3000c7bb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.637+0000 7fb30615f700 1 --2- 172.21.15.31:0/822179703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3000b0890 0x7fb30015b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.637+0000 7fb30615f700 1 -- 172.21.15.31:0/822179703 >> 172.21.15.31:0/822179703 conn(0x7fb30006fe50 msgr2=0x7fb30015be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.637+0000 7fb30615f700 1 -- 172.21.15.31:0/822179703 shutdown_connections 2023-10-09T06:22:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:43.637+0000 7fb30615f700 1 -- 172.21.15.31:0/822179703 wait complete. 2023-10-09T06:22:43.926 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:22:44.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.046+0000 7f6f3f611700 1 Processor -- start 2023-10-09T06:22:44.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.046+0000 7f6f3f611700 1 -- start start 2023-10-09T06:22:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3f611700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f3815a2b0 0x7f6f380b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3f611700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6f380d1c30 0x7f6f380cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3f611700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6f3815a680 0x7f6f380cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3f611700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f38068470 con 0x7f6f380d1c30 2023-10-09T06:22:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3f611700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f380c5d80 con 0x7f6f3815a680 2023-10-09T06:22:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3f611700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380c6060 con 0x7f6f3815a2b0 2023-10-09T06:22:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3cbac700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6f380d1c30 0x7f6f380cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3cbac700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6f380d1c30 0x7f6f380cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55248/0 (socket says 172.21.15.31:55248) 2023-10-09T06:22:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3cbac700 1 -- 172.21.15.31:0/339341092 learned_addr learned my addr 172.21.15.31:0/339341092 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3dbae700 1 --2- 172.21.15.31:0/339341092 >> v2:172.21.15.158:3300/0 conn(0x7f6f3815a680 0x7f6f380cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3d3ad700 1 --2- 172.21.15.31:0/339341092 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f3815a2b0 0x7f6f380b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3cbac700 1 -- 172.21.15.31:0/339341092 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f3815a2b0 msgr2=0x7f6f380b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3cbac700 1 --2- 172.21.15.31:0/339341092 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f3815a2b0 0x7f6f380b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3cbac700 1 -- 172.21.15.31:0/339341092 >> v2:172.21.15.158:3300/0 conn(0x7f6f3815a680 msgr2=0x7f6f380cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3cbac700 1 --2- 172.21.15.31:0/339341092 >> v2:172.21.15.158:3300/0 conn(0x7f6f3815a680 0x7f6f380cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3cbac700 1 -- 172.21.15.31:0/339341092 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f380c6340 con 0x7f6f380d1c30 2023-10-09T06:22:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f3cbac700 1 --2- 172.21.15.31:0/339341092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f380d1c30 0x7f6f380cf710 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6f3808a810 tx=0x7f6f2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8842f831a85f6a1f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f37fff700 1 -- 172.21.15.31:0/339341092 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c00b860 con 0x7f6f380d1c30 2023-10-09T06:22:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f37fff700 1 -- 172.21.15.31:0/339341092 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c00b9c0 con 0x7f6f380d1c30 2023-10-09T06:22:44.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.047+0000 7f6f37fff700 1 -- 172.21.15.31:0/339341092 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c00bd60 con 0x7f6f380d1c30 2023-10-09T06:22:44.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.048+0000 7f6f3f611700 1 -- 172.21.15.31:0/339341092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f380d1c30 msgr2=0x7f6f380cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:44.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.048+0000 7f6f3f611700 1 --2- 172.21.15.31:0/339341092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f380d1c30 0x7f6f380cf710 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6f3808a810 tx=0x7f6f2c009250 comp rx=0 tx=0).stop 2023-10-09T06:22:44.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.048+0000 7f6f3f611700 1 -- 172.21.15.31:0/339341092 shutdown_connections 2023-10-09T06:22:44.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.048+0000 7f6f3f611700 1 --2- 172.21.15.31:0/339341092 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f3815a2b0 0x7f6f380b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:44.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.048+0000 7f6f3f611700 1 --2- 172.21.15.31:0/339341092 >> v2:172.21.15.158:3300/0 conn(0x7f6f3815a680 0x7f6f380cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:44.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.048+0000 7f6f3f611700 1 --2- 172.21.15.31:0/339341092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f380d1c30 0x7f6f380cf710 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:44.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.048+0000 7f6f3f611700 1 -- 172.21.15.31:0/339341092 >> 172.21.15.31:0/339341092 conn(0x7f6f38067e40 msgr2=0x7f6f380d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:44.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.048+0000 7f6f3f611700 1 -- 172.21.15.31:0/339341092 shutdown_connections 2023-10-09T06:22:44.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.048+0000 7f6f3f611700 1 -- 172.21.15.31:0/339341092 wait complete. 2023-10-09T06:22:44.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.049+0000 7f6f3f611700 1 Processor -- start 2023-10-09T06:22:44.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.049+0000 7f6f3f611700 1 -- start start 2023-10-09T06:22:44.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3f611700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f380d1c30 0x7f6f380c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:44.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3f611700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f3815a2b0 0x7f6f3815d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:44.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3f611700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f3815a680 0x7f6f3815f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:44.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3f611700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380ca720 con 0x7f6f3815a2b0 2023-10-09T06:22:44.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3f611700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380c9b10 con 0x7f6f380d1c30 2023-10-09T06:22:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3f611700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380c9df0 con 0x7f6f3815a680 2023-10-09T06:22:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3cbac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f3815a2b0 0x7f6f3815d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3cbac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f3815a2b0 0x7f6f3815d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55260/0 (socket says 172.21.15.31:55260) 2023-10-09T06:22:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3cbac700 1 -- 172.21.15.31:0/2956328655 learned_addr learned my addr 172.21.15.31:0/2956328655 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3d3ad700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f380d1c30 0x7f6f380c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3dbae700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f3815a680 0x7f6f3815f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3cbac700 1 -- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f3815a680 msgr2=0x7f6f3815f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3cbac700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f3815a680 0x7f6f3815f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3cbac700 1 -- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f380d1c30 msgr2=0x7f6f380c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3cbac700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f380d1c30 0x7f6f380c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.050+0000 7f6f3cbac700 1 -- 172.21.15.31:0/2956328655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c0094f0 con 0x7f6f3815a2b0 2023-10-09T06:22:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.051+0000 7f6f3dbae700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f3815a680 0x7f6f3815f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.051+0000 7f6f3d3ad700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f380d1c30 0x7f6f380c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.051+0000 7f6f3cbac700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f3815a2b0 0x7f6f3815d650 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6f38089120 tx=0x7f6f2c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.051+0000 7f6f357fa700 1 -- 172.21.15.31:0/2956328655 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c024440 con 0x7f6f3815a2b0 2023-10-09T06:22:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.051+0000 7f6f357fa700 1 -- 172.21.15.31:0/2956328655 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c0245a0 con 0x7f6f3815a2b0 2023-10-09T06:22:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.051+0000 7f6f3f611700 1 -- 172.21.15.31:0/2956328655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f380ca0d0 con 0x7f6f3815a2b0 2023-10-09T06:22:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.051+0000 7f6f357fa700 1 -- 172.21.15.31:0/2956328655 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c024960 con 0x7f6f3815a2b0 2023-10-09T06:22:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.051+0000 7f6f3f611700 1 -- 172.21.15.31:0/2956328655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f380c9820 con 0x7f6f3815a2b0 2023-10-09T06:22:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.052+0000 7f6f3f611700 1 -- 172.21.15.31:0/2956328655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3804c3c0 con 0x7f6f3815a2b0 2023-10-09T06:22:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.052+0000 7f6f357fa700 1 -- 172.21.15.31:0/2956328655 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f2c01a420 con 0x7f6f3815a2b0 2023-10-09T06:22:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.053+0000 7f6f357fa700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f24066f30 0x7f6f240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:44.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.053+0000 7f6f357fa700 1 -- 172.21.15.31:0/2956328655 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f6f2c0862d0 con 0x7f6f3815a2b0 2023-10-09T06:22:44.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.053+0000 7f6f3d3ad700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f24066f30 0x7f6f240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:44.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.054+0000 7f6f3d3ad700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f24066f30 0x7f6f240693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6f28007580 tx=0x7f6f28009790 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:44.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.057+0000 7f6f357fa700 1 -- 172.21.15.31:0/2956328655 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f2c053500 con 0x7f6f3815a2b0 2023-10-09T06:22:44.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.295+0000 7f6f3f611700 1 -- 172.21.15.31:0/2956328655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f38064a00 con 0x7f6f3815a2b0 2023-10-09T06:22:44.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.295+0000 7f6f357fa700 1 -- 172.21.15.31:0/2956328655 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f6f2c056b20 con 0x7f6f3815a2b0 2023-10-09T06:22:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:44.296 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2970905850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2970905850},{"type":"v1","addr":"172.21.15.158:6837","nonce":2970905850}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5119,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1945558670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1945558670},{"type":"v1","addr":"172.21.15.31:6835","nonce":1945558670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3853703125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3853703125},{"type":"v1","addr":"172.21.15.31:6834","nonce":3853703125}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:22:12.504027+0000","modified":"2023-10-09T06:22:16.130642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/1366477380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1366477380},{"type":"v1","addr":"172.21.15.158:6836","nonce":1366477380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:22:44.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.297+0000 7f6f3f611700 1 -- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f24066f30 msgr2=0x7f6f240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:44.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.297+0000 7f6f3f611700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f24066f30 0x7f6f240693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6f28007580 tx=0x7f6f28009790 comp rx=0 tx=0).stop 2023-10-09T06:22:44.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.297+0000 7f6f3f611700 1 -- 172.21.15.31:0/2956328655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f3815a2b0 msgr2=0x7f6f3815d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:44.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.297+0000 7f6f3f611700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f3815a2b0 0x7f6f3815d650 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6f38089120 tx=0x7f6f2c017000 comp rx=0 tx=0).stop 2023-10-09T06:22:44.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.297+0000 7f6f3f611700 1 -- 172.21.15.31:0/2956328655 shutdown_connections 2023-10-09T06:22:44.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.297+0000 7f6f3f611700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f24066f30 0x7f6f240693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:44.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.297+0000 7f6f3f611700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f3815a680 0x7f6f3815f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:44.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.297+0000 7f6f3f611700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f380d1c30 0x7f6f380c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:44.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.297+0000 7f6f3f611700 1 --2- 172.21.15.31:0/2956328655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f3815a2b0 0x7f6f3815d650 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:44.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.297+0000 7f6f3f611700 1 -- 172.21.15.31:0/2956328655 >> 172.21.15.31:0/2956328655 conn(0x7f6f38067e40 msgr2=0x7f6f380cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:44.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.297+0000 7f6f3f611700 1 -- 172.21.15.31:0/2956328655 shutdown_connections 2023-10-09T06:22:44.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:44.297+0000 7f6f3f611700 1 -- 172.21.15.31:0/2956328655 wait complete. 2023-10-09T06:22:44.299 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 25 2023-10-09T06:22:44.310 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-09T06:22:44.455 INFO:teuthology.orchestra.run.smithi158.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":5307,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":31.327655287999999,"mdsmap_epoch":25,"osdmap_epoch":53,"osdmap_epoch_barrier":48,"uptime":36.260542438999998} 2023-10-09T06:22:44.456 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 5307, "mdsmap_epoch": 25, "osdmap_epoch": 53, "osdmap_epoch_barrier": 48, "rank_uptime": 31.327655288, "state": "up:active", "uptime": 36.260542439, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:22:44.456 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T06:22:44.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:22:44.456 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-09T06:22:44.744 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records in 2023-10-09T06:22:44.745 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records out 2023-10-09T06:22:44.745 INFO:teuthology.orchestra.run.smithi031.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.271082 s, 193 MB/s 2023-10-09T06:22:44.745 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:22:44.745 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:22:44.781 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:22:44.820 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:22:44.820 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:22:44.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:22:44.820 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:22:44.887 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:22:44.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:44.888 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:22:44.907 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T06:22:44.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:22:44.907 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T06:22:44.952 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:22:44.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:22:44.952 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T06:22:44.967 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:22:45.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.085+0000 7f83ccf1d700 1 Processor -- start 2023-10-09T06:22:45.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.085+0000 7f83ccf1d700 1 -- start start 2023-10-09T06:22:45.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.086+0000 7f83ccf1d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f83c806ac30 0x7f83c8164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.086+0000 7f83ccf1d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c815c360 con 0x7f83c81577d0 2023-10-09T06:22:45.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.086+0000 7f83ccf1d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c815b790 con 0x7f83c8157ba0 2023-10-09T06:22:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.086+0000 7f83ccf1d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c815d800 con 0x7f83c806ac30 2023-10-09T06:22:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.086+0000 7f83c659c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f83c81577d0 0x7f83c80cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53088/0 (socket says 172.21.15.31:53088) 2023-10-09T06:22:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.086+0000 7f83c659c700 1 -- 172.21.15.31:0/2184223901 learned_addr learned my addr 172.21.15.31:0/2184223901 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.087+0000 7f83c6d9d700 1 --2- 172.21.15.31:0/2184223901 >> v2:172.21.15.158:3300/0 conn(0x7f83c806ac30 0x7f83c8164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.087+0000 7f83c559a700 1 -- 172.21.15.31:0/2184223901 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667743222 0 0) 0x7f83c815c360 con 0x7f83c81577d0 2023-10-09T06:22:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.087+0000 7f83c559a700 1 -- 172.21.15.31:0/2184223901 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b4003570 con 0x7f83c81577d0 2023-10-09T06:22:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.087+0000 7f83c6d9d700 1 -- 172.21.15.31:0/2184223901 >> v1:172.21.15.158:6789/0 conn(0x7f83c8157ba0 legacy=0x7f83c806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.087+0000 7f83c6d9d700 1 -- 172.21.15.31:0/2184223901 >> v1:172.21.15.31:6789/0 conn(0x7f83c81577d0 legacy=0x7f83c80cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.087+0000 7f83c6d9d700 1 -- 172.21.15.31:0/2184223901 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c815ba30 con 0x7f83c806ac30 2023-10-09T06:22:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.087+0000 7f83c6d9d700 1 --2- 172.21.15.31:0/2184223901 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83c806ac30 0x7f83c8164e30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009e60 tx=0x7f83c0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3afb4bea247db116 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.087+0000 7f83c559a700 1 -- 172.21.15.31:0/2184223901 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c000e070 con 0x7f83c806ac30 2023-10-09T06:22:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.087+0000 7f83c559a700 1 -- 172.21.15.31:0/2184223901 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c000bb60 con 0x7f83c806ac30 2023-10-09T06:22:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.087+0000 7f83c559a700 1 -- 172.21.15.31:0/2184223901 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0012430 con 0x7f83c806ac30 2023-10-09T06:22:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.088+0000 7f83ccf1d700 1 -- 172.21.15.31:0/2184223901 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83c806ac30 msgr2=0x7f83c8164e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.088+0000 7f83ccf1d700 1 --2- 172.21.15.31:0/2184223901 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83c806ac30 0x7f83c8164e30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009e60 tx=0x7f83c0009780 comp rx=0 tx=0).stop 2023-10-09T06:22:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.088+0000 7f83ccf1d700 1 -- 172.21.15.31:0/2184223901 shutdown_connections 2023-10-09T06:22:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.088+0000 7f83ccf1d700 1 --2- 172.21.15.31:0/2184223901 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83c806ac30 0x7f83c8164e30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.088+0000 7f83ccf1d700 1 -- 172.21.15.31:0/2184223901 >> 172.21.15.31:0/2184223901 conn(0x7f83c8068ce0 msgr2=0x7f83c80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.088+0000 7f83ccf1d700 1 -- 172.21.15.31:0/2184223901 shutdown_connections 2023-10-09T06:22:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.088+0000 7f83ccf1d700 1 -- 172.21.15.31:0/2184223901 wait complete. 2023-10-09T06:22:45.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.089+0000 7f83ccf1d700 1 Processor -- start 2023-10-09T06:22:45.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.089+0000 7f83ccf1d700 1 -- start start 2023-10-09T06:22:45.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83ccf1d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83c806ac30 0x7f83c813e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83ccf1d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83c81577d0 0x7f83c80b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83ccf1d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83c8157ba0 0x7f83c80b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83ccf1d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c816b5a0 con 0x7f83c8157ba0 2023-10-09T06:22:45.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83ccf1d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c813ecb0 con 0x7f83c806ac30 2023-10-09T06:22:45.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83ccf1d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8159320 con 0x7f83c81577d0 2023-10-09T06:22:45.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83c6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83c8157ba0 0x7f83c80b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83c6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83c8157ba0 0x7f83c80b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55276/0 (socket says 172.21.15.31:55276) 2023-10-09T06:22:45.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83c6d9d700 1 -- 172.21.15.31:0/1991931589 learned_addr learned my addr 172.21.15.31:0/1991931589 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:45.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83c659c700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83c806ac30 0x7f83c813e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83c6d9d700 1 -- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83c81577d0 msgr2=0x7f83c80b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83c5d9b700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83c81577d0 0x7f83c80b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83c6d9d700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83c81577d0 0x7f83c80b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83c6d9d700 1 -- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83c806ac30 msgr2=0x7f83c813e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83c6d9d700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83c806ac30 0x7f83c813e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83c6d9d700 1 -- 172.21.15.31:0/1991931589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c0009a20 con 0x7f83c8157ba0 2023-10-09T06:22:45.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83c659c700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83c806ac30 0x7f83c813e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:45.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83c5d9b700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83c81577d0 0x7f83c80b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:45.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.090+0000 7f83c6d9d700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83c8157ba0 0x7f83c80b1470 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f83c0013000 tx=0x7f83c0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:45.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.091+0000 7f83be7fc700 1 -- 172.21.15.31:0/1991931589 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0012e40 con 0x7f83c8157ba0 2023-10-09T06:22:45.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.091+0000 7f83be7fc700 1 -- 172.21.15.31:0/1991931589 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c001d630 con 0x7f83c8157ba0 2023-10-09T06:22:45.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.091+0000 7f83ccf1d700 1 -- 172.21.15.31:0/1991931589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c8159600 con 0x7f83c8157ba0 2023-10-09T06:22:45.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.091+0000 7f83be7fc700 1 -- 172.21.15.31:0/1991931589 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c001d9f0 con 0x7f83c8157ba0 2023-10-09T06:22:45.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.091+0000 7f83ccf1d700 1 -- 172.21.15.31:0/1991931589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c8159bc0 con 0x7f83c8157ba0 2023-10-09T06:22:45.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.091+0000 7f83ccf1d700 1 -- 172.21.15.31:0/1991931589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c8159db0 con 0x7f83c8157ba0 2023-10-09T06:22:45.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.092+0000 7f83be7fc700 1 -- 172.21.15.31:0/1991931589 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83c0024070 con 0x7f83c8157ba0 2023-10-09T06:22:45.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.092+0000 7f83be7fc700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f83a8066f30 0x7f83a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.092+0000 7f83be7fc700 1 -- 172.21.15.31:0/1991931589 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f83c0086d00 con 0x7f83c8157ba0 2023-10-09T06:22:45.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.093+0000 7f83c659c700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f83a8066f30 0x7f83a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.093+0000 7f83c659c700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f83a8066f30 0x7f83a80693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f83b80058d0 tx=0x7f83b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:45.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.097+0000 7f83be7fc700 1 -- 172.21.15.31:0/1991931589 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83c0053f30 con 0x7f83c8157ba0 2023-10-09T06:22:45.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.341+0000 7f83ccf1d700 1 -- 172.21.15.31:0/1991931589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83c804c3c0 con 0x7f83c8157ba0 2023-10-09T06:22:45.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.341+0000 7f83be7fc700 1 -- 172.21.15.31:0/1991931589 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f83c0057550 con 0x7f83c8157ba0 2023-10-09T06:22:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:45.342 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2970905850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2970905850},{"type":"v1","addr":"172.21.15.158:6837","nonce":2970905850}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5119,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1945558670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1945558670},{"type":"v1","addr":"172.21.15.31:6835","nonce":1945558670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3853703125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3853703125},{"type":"v1","addr":"172.21.15.31:6834","nonce":3853703125}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:22:12.504027+0000","modified":"2023-10-09T06:22:16.130642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/1366477380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1366477380},{"type":"v1","addr":"172.21.15.158:6836","nonce":1366477380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:22:45.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.343+0000 7f83ccf1d700 1 -- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f83a8066f30 msgr2=0x7f83a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.343+0000 7f83ccf1d700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f83a8066f30 0x7f83a80693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f83b80058d0 tx=0x7f83b8009040 comp rx=0 tx=0).stop 2023-10-09T06:22:45.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.344+0000 7f83ccf1d700 1 -- 172.21.15.31:0/1991931589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83c8157ba0 msgr2=0x7f83c80b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.344+0000 7f83ccf1d700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83c8157ba0 0x7f83c80b1470 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f83c0013000 tx=0x7f83c0019000 comp rx=0 tx=0).stop 2023-10-09T06:22:45.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.344+0000 7f83ccf1d700 1 -- 172.21.15.31:0/1991931589 shutdown_connections 2023-10-09T06:22:45.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.344+0000 7f83ccf1d700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f83a8066f30 0x7f83a80693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.344+0000 7f83ccf1d700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83c8157ba0 0x7f83c80b1470 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.344+0000 7f83ccf1d700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f83c806ac30 0x7f83c813e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.344+0000 7f83ccf1d700 1 --2- 172.21.15.31:0/1991931589 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f83c81577d0 0x7f83c80b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.344+0000 7f83ccf1d700 1 -- 172.21.15.31:0/1991931589 >> 172.21.15.31:0/1991931589 conn(0x7f83c8068ce0 msgr2=0x7f83c8156710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:45.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.344+0000 7f83ccf1d700 1 -- 172.21.15.31:0/1991931589 shutdown_connections 2023-10-09T06:22:45.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.344+0000 7f83ccf1d700 1 -- 172.21.15.31:0/1991931589 wait complete. 2023-10-09T06:22:45.346 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 25 2023-10-09T06:22:45.357 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:22:45.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.476+0000 7f5551d37700 1 Processor -- start 2023-10-09T06:22:45.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.476+0000 7f5551d37700 1 -- start start 2023-10-09T06:22:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f5551d37700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f554c0c9560 0x7f554c157a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f5551d37700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f554c0c9930 0x7f554c15c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f5551d37700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c069060 con 0x7f554c069de0 2023-10-09T06:22:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f5551d37700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c069300 con 0x7f554c0c9560 2023-10-09T06:22:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f5551d37700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0695e0 con 0x7f554c0c9930 2023-10-09T06:22:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f554b7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f554c0c9560 0x7f554c157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f554bfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f554c0c9930 0x7f554c15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f554b7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f554c0c9560 0x7f554c157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:59212/0 (socket says 172.21.15.31:59212) 2023-10-09T06:22:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f554affd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f554c069de0 0x7f554c15bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:35234/0 (socket says 172.21.15.31:35234) 2023-10-09T06:22:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f554b7fe700 1 -- 172.21.15.31:0/3673584393 learned_addr learned my addr 172.21.15.31:0/3673584393 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f554bfff700 1 -- 172.21.15.31:0/3673584393 >> v2:172.21.15.158:3300/0 conn(0x7f554c0c9560 msgr2=0x7f554c157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f554bfff700 1 --2- 172.21.15.31:0/3673584393 >> v2:172.21.15.158:3300/0 conn(0x7f554c0c9560 0x7f554c157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f554bfff700 1 -- 172.21.15.31:0/3673584393 >> v1:172.21.15.158:6789/0 conn(0x7f554c069de0 legacy=0x7f554c15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f554bfff700 1 -- 172.21.15.31:0/3673584393 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0698c0 con 0x7f554c0c9930 2023-10-09T06:22:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f554b7fe700 1 --2- 172.21.15.31:0/3673584393 >> v2:172.21.15.158:3300/0 conn(0x7f554c0c9560 0x7f554c157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:22:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.477+0000 7f554bfff700 1 --2- 172.21.15.31:0/3673584393 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f554c0c9930 0x7f554c15c370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5544009e60 tx=0x7f5544009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d03bffb06532a09b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.478+0000 7f554a7fc700 1 -- 172.21.15.31:0/3673584393 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400e070 con 0x7f554c0c9930 2023-10-09T06:22:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.478+0000 7f554a7fc700 1 -- 172.21.15.31:0/3673584393 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554400bb60 con 0x7f554c0c9930 2023-10-09T06:22:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.478+0000 7f554a7fc700 1 -- 172.21.15.31:0/3673584393 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544012430 con 0x7f554c0c9930 2023-10-09T06:22:45.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.478+0000 7f5551d37700 1 -- 172.21.15.31:0/3673584393 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f554c0c9930 msgr2=0x7f554c15c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.478+0000 7f5551d37700 1 --2- 172.21.15.31:0/3673584393 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f554c0c9930 0x7f554c15c370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5544009e60 tx=0x7f5544009780 comp rx=0 tx=0).stop 2023-10-09T06:22:45.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.478+0000 7f5551d37700 1 -- 172.21.15.31:0/3673584393 shutdown_connections 2023-10-09T06:22:45.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.478+0000 7f5551d37700 1 --2- 172.21.15.31:0/3673584393 >> v2:172.21.15.158:3300/0 conn(0x7f554c0c9560 0x7f554c157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.478+0000 7f5551d37700 1 --2- 172.21.15.31:0/3673584393 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f554c0c9930 0x7f554c15c370 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.478+0000 7f5551d37700 1 -- 172.21.15.31:0/3673584393 >> 172.21.15.31:0/3673584393 conn(0x7f554c067660 msgr2=0x7f554c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:45.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.478+0000 7f5551d37700 1 -- 172.21.15.31:0/3673584393 shutdown_connections 2023-10-09T06:22:45.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.478+0000 7f5551d37700 1 -- 172.21.15.31:0/3673584393 wait complete. 2023-10-09T06:22:45.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.479+0000 7f5551d37700 1 Processor -- start 2023-10-09T06:22:45.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.479+0000 7f5551d37700 1 -- start start 2023-10-09T06:22:45.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.480+0000 7f5551d37700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f554c069de0 0x7f554c0ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.480+0000 7f5551d37700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f554c0c9560 0x7f554c155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.480+0000 7f5551d37700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f554c0c9930 0x7f554c0c2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.480+0000 7f5551d37700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0aa880 con 0x7f554c0c9560 2023-10-09T06:22:45.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.480+0000 7f5551d37700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0ab390 con 0x7f554c069de0 2023-10-09T06:22:45.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.480+0000 7f5551d37700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0aaa60 con 0x7f554c0c9930 2023-10-09T06:22:45.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.480+0000 7f554affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f554c0c9560 0x7f554c155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.480+0000 7f554b7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f554c069de0 0x7f554c0ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.480+0000 7f554affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f554c0c9560 0x7f554c155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55280/0 (socket says 172.21.15.31:55280) 2023-10-09T06:22:45.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.480+0000 7f554affd700 1 -- 172.21.15.31:0/3471610481 learned_addr learned my addr 172.21.15.31:0/3471610481 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:45.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.480+0000 7f554bfff700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f554c0c9930 0x7f554c0c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.481+0000 7f554b7fe700 1 -- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f554c0c9930 msgr2=0x7f554c0c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.481+0000 7f554b7fe700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f554c0c9930 0x7f554c0c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.481+0000 7f554b7fe700 1 -- 172.21.15.31:0/3471610481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f554c0c9560 msgr2=0x7f554c155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.481+0000 7f554b7fe700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f554c0c9560 0x7f554c155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.481+0000 7f554b7fe700 1 -- 172.21.15.31:0/3471610481 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c0094f0 con 0x7f554c069de0 2023-10-09T06:22:45.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.481+0000 7f554affd700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f554c0c9560 0x7f554c155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:22:45.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.481+0000 7f554b7fe700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f554c069de0 0x7f554c0ab820 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f553c006fd0 tx=0x7f553c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:45.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.481+0000 7f55337fe700 1 -- 172.21.15.31:0/3471610481 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c00c850 con 0x7f554c069de0 2023-10-09T06:22:45.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.481+0000 7f55337fe700 1 -- 172.21.15.31:0/3471610481 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c00c9b0 con 0x7f554c069de0 2023-10-09T06:22:45.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.481+0000 7f5551d37700 1 -- 172.21.15.31:0/3471610481 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5544009a20 con 0x7f554c069de0 2023-10-09T06:22:45.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.481+0000 7f55337fe700 1 -- 172.21.15.31:0/3471610481 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c00cd30 con 0x7f554c069de0 2023-10-09T06:22:45.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.481+0000 7f5551d37700 1 -- 172.21.15.31:0/3471610481 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c0ab020 con 0x7f554c069de0 2023-10-09T06:22:45.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.482+0000 7f5551d37700 1 -- 172.21.15.31:0/3471610481 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c04c3c0 con 0x7f554c069de0 2023-10-09T06:22:45.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.482+0000 7f55337fe700 1 -- 172.21.15.31:0/3471610481 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f553c013680 con 0x7f554c069de0 2023-10-09T06:22:45.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.483+0000 7f55337fe700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5538066f30 0x7f55380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.483+0000 7f55337fe700 1 -- 172.21.15.31:0/3471610481 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f553c084730 con 0x7f554c069de0 2023-10-09T06:22:45.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.483+0000 7f554affd700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5538066f30 0x7f55380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.483+0000 7f554affd700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5538066f30 0x7f55380693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f554c0ae2c0 tx=0x7f5540007f40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:45.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.488+0000 7f55337fe700 1 -- 172.21.15.31:0/3471610481 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f553c051960 con 0x7f554c069de0 2023-10-09T06:22:45.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.682+0000 7f5551d37700 1 -- 172.21.15.31:0/3471610481 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f554c15c9b0 con 0x7f554c069de0 2023-10-09T06:22:45.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.683+0000 7f55337fe700 1 -- 172.21.15.31:0/3471610481 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+15446 (secure 0 0 0) 0x7f553c054f80 con 0x7f554c069de0 2023-10-09T06:22:45.684 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:45.684 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":53,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:22:43.728259+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:22:10.914998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T06:22:11.476116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.36","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:22:45.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.685+0000 7f5551d37700 1 -- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5538066f30 msgr2=0x7f55380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.685+0000 7f5551d37700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5538066f30 0x7f55380693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f554c0ae2c0 tx=0x7f5540007f40 comp rx=0 tx=0).stop 2023-10-09T06:22:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.685+0000 7f5551d37700 1 -- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f554c069de0 msgr2=0x7f554c0ab820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.685+0000 7f5551d37700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f554c069de0 0x7f554c0ab820 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f553c006fd0 tx=0x7f553c009250 comp rx=0 tx=0).stop 2023-10-09T06:22:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.685+0000 7f5551d37700 1 -- 172.21.15.31:0/3471610481 shutdown_connections 2023-10-09T06:22:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.685+0000 7f5551d37700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5538066f30 0x7f55380693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.685+0000 7f5551d37700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f554c0c9930 0x7f554c0c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.685+0000 7f5551d37700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f554c069de0 0x7f554c0ab820 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.685+0000 7f5551d37700 1 --2- 172.21.15.31:0/3471610481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f554c0c9560 0x7f554c155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.685+0000 7f5551d37700 1 -- 172.21.15.31:0/3471610481 >> 172.21.15.31:0/3471610481 conn(0x7f554c067660 msgr2=0x7f554c15ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.685+0000 7f5551d37700 1 -- 172.21.15.31:0/3471610481 shutdown_connections 2023-10-09T06:22:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.686+0000 7f5551d37700 1 -- 172.21.15.31:0/3471610481 wait complete. 2023-10-09T06:22:45.698 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:22:10.914998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:22:11.476116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:22:45.699 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:22:45.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.820+0000 7f188359e700 1 Processor -- start 2023-10-09T06:22:45.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.820+0000 7f188359e700 1 -- start start 2023-10-09T06:22:45.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.821+0000 7f188359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f188406aa00 0x7f1884164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.821+0000 7f188359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18840b4d70 con 0x7f18840cce30 2023-10-09T06:22:45.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.821+0000 7f188359e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188415b3b0 con 0x7f18840b6580 2023-10-09T06:22:45.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.821+0000 7f188359e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18840cd8d0 con 0x7f188406aa00 2023-10-09T06:22:45.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.821+0000 7f188259c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f18840cce30 0x7f188415aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53096/0 (socket says 172.21.15.31:53096) 2023-10-09T06:22:45.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.821+0000 7f188259c700 1 -- 172.21.15.31:0/4078370235 learned_addr learned my addr 172.21.15.31:0/4078370235 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:45.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.821+0000 7f1882d9d700 1 --2- 172.21.15.31:0/4078370235 >> v2:172.21.15.158:3300/0 conn(0x7f188406aa00 0x7f1884164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.821+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009251352 0 0) 0x7f18840b4d70 con 0x7f18840cce30 2023-10-09T06:22:45.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.821+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1870003570 con 0x7f18840cce30 2023-10-09T06:22:45.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870750722 0 0) 0x7f188415b3b0 con 0x7f18840b6580 2023-10-09T06:22:45.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18840b4d70 con 0x7f18840b6580 2023-10-09T06:22:45.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 446951880 0 0) 0x7f1870003570 con 0x7f18840cce30 2023-10-09T06:22:45.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 >> v2:172.21.15.158:3300/0 conn(0x7f188406aa00 msgr2=0x7f1884164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:45.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 --2- 172.21.15.31:0/4078370235 >> v2:172.21.15.158:3300/0 conn(0x7f188406aa00 0x7f1884164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 >> v1:172.21.15.158:6789/0 conn(0x7f18840b6580 legacy=0x7f188406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18840b4440 con 0x7f18840cce30 2023-10-09T06:22:45.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f187c0017f0 con 0x7f18840cce30 2023-10-09T06:22:45.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f1882d9d700 1 --2- 172.21.15.31:0/4078370235 >> v2:172.21.15.158:3300/0 conn(0x7f188406aa00 0x7f1884164c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:22:45.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 >> v1:172.21.15.31:6789/0 conn(0x7f18840cce30 legacy=0x7f188415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 --2- 172.21.15.31:0/4078370235 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1870003bf0 0x7f1870003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 --2- 172.21.15.31:0/4078370235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1870004810 0x7f1870004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 --2- 172.21.15.31:0/4078370235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18700051c0 0x7f187000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18840cd8d0 con 0x7f18700051c0 2023-10-09T06:22:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187000c160 con 0x7f1870003bf0 2023-10-09T06:22:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187000c320 con 0x7f1870004810 2023-10-09T06:22:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f1882d9d700 1 --2- 172.21.15.31:0/4078370235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18700051c0 0x7f187000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188259c700 1 --2- 172.21.15.31:0/4078370235 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1870003bf0 0x7f1870003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f1881d9b700 1 --2- 172.21.15.31:0/4078370235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1870004810 0x7f1870004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f1882d9d700 1 -- 172.21.15.31:0/4078370235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1870004810 msgr2=0x7f1870004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f1882d9d700 1 --2- 172.21.15.31:0/4078370235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1870004810 0x7f1870004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f1882d9d700 1 -- 172.21.15.31:0/4078370235 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1870003bf0 msgr2=0x7f1870003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f1882d9d700 1 --2- 172.21.15.31:0/4078370235 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1870003bf0 0x7f1870003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f1882d9d700 1 -- 172.21.15.31:0/4078370235 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870003570 con 0x7f18700051c0 2023-10-09T06:22:45.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f1882d9d700 1 -- 172.21.15.31:0/4078370235 reap_dead start 2023-10-09T06:22:45.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f1882d9d700 1 --2- 172.21.15.31:0/4078370235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18700051c0 0x7f187000ba60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1874006f00 tx=0x7f18740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ee6393a1ddf8a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:45.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18740097e0 con 0x7f18700051c0 2023-10-09T06:22:45.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187400e8f0 con 0x7f18700051c0 2023-10-09T06:22:45.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.822+0000 7f188159a700 1 -- 172.21.15.31:0/4078370235 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187400ecb0 con 0x7f18700051c0 2023-10-09T06:22:45.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.823+0000 7f188359e700 1 -- 172.21.15.31:0/4078370235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18700051c0 msgr2=0x7f187000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.823+0000 7f188359e700 1 --2- 172.21.15.31:0/4078370235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18700051c0 0x7f187000ba60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1874006f00 tx=0x7f18740091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.823+0000 7f188359e700 1 -- 172.21.15.31:0/4078370235 shutdown_connections 2023-10-09T06:22:45.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.823+0000 7f188359e700 1 --2- 172.21.15.31:0/4078370235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18700051c0 0x7f187000ba60 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.823+0000 7f188359e700 1 -- 172.21.15.31:0/4078370235 >> 172.21.15.31:0/4078370235 conn(0x7f1884068cb0 msgr2=0x7f18840690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:45.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.823+0000 7f188359e700 1 -- 172.21.15.31:0/4078370235 shutdown_connections 2023-10-09T06:22:45.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.823+0000 7f188359e700 1 -- 172.21.15.31:0/4078370235 wait complete. 2023-10-09T06:22:45.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.824+0000 7f188359e700 1 Processor -- start 2023-10-09T06:22:45.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.824+0000 7f188359e700 1 -- start start 2023-10-09T06:22:45.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f188359e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18700051c0 0x7f188414e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f188359e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18840cc1d0 0x7f18840cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f188359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840d0ae0 0x7f18840d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f188359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18840d1490 con 0x7f18840d0ae0 2023-10-09T06:22:45.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f188359e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18840c7940 con 0x7f18700051c0 2023-10-09T06:22:45.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f188359e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18840c6a50 con 0x7f18840cc1d0 2023-10-09T06:22:45.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f1882d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840d0ae0 0x7f18840d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f1882d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840d0ae0 0x7f18840d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55296/0 (socket says 172.21.15.31:55296) 2023-10-09T06:22:45.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f1882d9d700 1 -- 172.21.15.31:0/817213124 learned_addr learned my addr 172.21.15.31:0/817213124 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:45.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f188259c700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18700051c0 0x7f188414e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f1881d9b700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18840cc1d0 0x7f18840cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f1882d9d700 1 -- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18840cc1d0 msgr2=0x7f18840cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f1882d9d700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18840cc1d0 0x7f18840cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f1882d9d700 1 -- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18700051c0 msgr2=0x7f188414e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f1882d9d700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18700051c0 0x7f188414e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.825+0000 7f1882d9d700 1 -- 172.21.15.31:0/817213124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18840c6d30 con 0x7f18840d0ae0 2023-10-09T06:22:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.826+0000 7f1882d9d700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840d0ae0 0x7f18840d0f50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f18840ce7f0 tx=0x7f187401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.826+0000 7f187a7fc700 1 -- 172.21.15.31:0/817213124 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874022070 con 0x7f18840d0ae0 2023-10-09T06:22:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.826+0000 7f187a7fc700 1 -- 172.21.15.31:0/817213124 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1874013e30 con 0x7f18840d0ae0 2023-10-09T06:22:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.826+0000 7f188359e700 1 -- 172.21.15.31:0/817213124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18840c7010 con 0x7f18840d0ae0 2023-10-09T06:22:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.826+0000 7f187a7fc700 1 -- 172.21.15.31:0/817213124 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187401c890 con 0x7f18840d0ae0 2023-10-09T06:22:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.826+0000 7f188359e700 1 -- 172.21.15.31:0/817213124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18840c75d0 con 0x7f18840d0ae0 2023-10-09T06:22:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.827+0000 7f188359e700 1 -- 172.21.15.31:0/817213124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18840c7af0 con 0x7f18840d0ae0 2023-10-09T06:22:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.827+0000 7f187a7fc700 1 -- 172.21.15.31:0/817213124 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f187401ccc0 con 0x7f18840d0ae0 2023-10-09T06:22:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.828+0000 7f187a7fc700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1864066f30 0x7f18640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:45.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.828+0000 7f187a7fc700 1 -- 172.21.15.31:0/817213124 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1874085e40 con 0x7f18840d0ae0 2023-10-09T06:22:45.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.828+0000 7f188259c700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1864066f30 0x7f18640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:45.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.828+0000 7f188259c700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1864066f30 0x7f18640693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f187c001580 tx=0x7f187c002190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:45.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:45.832+0000 7f187a7fc700 1 -- 172.21.15.31:0/817213124 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18840c7af0 con 0x7f18840d0ae0 2023-10-09T06:22:46.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.023+0000 7f188359e700 1 -- 172.21.15.31:0/817213124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18840c7ab0 con 0x7f18840d0ae0 2023-10-09T06:22:46.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.024+0000 7f187a7fc700 1 -- 172.21.15.31:0/817213124 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f187402b0a0 con 0x7f18840d0ae0 2023-10-09T06:22:46.025 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:22:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.026+0000 7f188359e700 1 -- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1864066f30 msgr2=0x7f18640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.026+0000 7f188359e700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1864066f30 0x7f18640693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f187c001580 tx=0x7f187c002190 comp rx=0 tx=0).stop 2023-10-09T06:22:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.026+0000 7f188359e700 1 -- 172.21.15.31:0/817213124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840d0ae0 msgr2=0x7f18840d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.026+0000 7f188359e700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840d0ae0 0x7f18840d0f50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f18840ce7f0 tx=0x7f187401a000 comp rx=0 tx=0).stop 2023-10-09T06:22:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.026+0000 7f188359e700 1 -- 172.21.15.31:0/817213124 shutdown_connections 2023-10-09T06:22:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.026+0000 7f188359e700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1864066f30 0x7f18640693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.026+0000 7f188359e700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18840d0ae0 0x7f18840d0f50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.026+0000 7f188359e700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18700051c0 0x7f188414e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.026+0000 7f188359e700 1 --2- 172.21.15.31:0/817213124 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f18840cc1d0 0x7f18840cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.026+0000 7f188359e700 1 -- 172.21.15.31:0/817213124 >> 172.21.15.31:0/817213124 conn(0x7f1884068cb0 msgr2=0x7f188415bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.026+0000 7f188359e700 1 -- 172.21.15.31:0/817213124 shutdown_connections 2023-10-09T06:22:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.026+0000 7f188359e700 1 -- 172.21.15.31:0/817213124 wait complete. 2023-10-09T06:22:46.039 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:22:46.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.160+0000 7f3a1e4e8700 1 Processor -- start 2023-10-09T06:22:46.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.160+0000 7f3a1e4e8700 1 -- start start 2023-10-09T06:22:46.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a1e4e8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3a18157200 0x7f3a180c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a1e4e8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a18153ba0 0x7f3a180c7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a1e4e8700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1815a720 con 0x7f3a181537d0 2023-10-09T06:22:46.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a1e4e8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a180c7a40 con 0x7f3a18153ba0 2023-10-09T06:22:46.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a1e4e8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a18159b10 con 0x7f3a18157200 2023-10-09T06:22:46.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a1ca85700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a18153ba0 0x7f3a180c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a1ca85700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a18153ba0 0x7f3a180c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55302/0 (socket says 172.21.15.31:55302) 2023-10-09T06:22:46.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a1ca85700 1 -- 172.21.15.31:0/1886149503 learned_addr learned my addr 172.21.15.31:0/1886149503 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:46.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a177fe700 1 --2- 172.21.15.31:0/1886149503 >> v2:172.21.15.158:3300/0 conn(0x7f3a18157200 0x7f3a180c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a1ca85700 1 -- 172.21.15.31:0/1886149503 >> v2:172.21.15.158:3300/0 conn(0x7f3a18157200 msgr2=0x7f3a180c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:46.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a1ca85700 1 --2- 172.21.15.31:0/1886149503 >> v2:172.21.15.158:3300/0 conn(0x7f3a18157200 0x7f3a180c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a1ca85700 1 -- 172.21.15.31:0/1886149503 >> v1:172.21.15.158:6789/0 conn(0x7f3a181537d0 legacy=0x7f3a180c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:46.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a1ca85700 1 -- 172.21.15.31:0/1886149503 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a18159df0 con 0x7f3a18153ba0 2023-10-09T06:22:46.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a177fe700 1 --2- 172.21.15.31:0/1886149503 >> v2:172.21.15.158:3300/0 conn(0x7f3a18157200 0x7f3a180c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:46.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a1ca85700 1 --2- 172.21.15.31:0/1886149503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a18153ba0 0x7f3a180c7500 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3a180c2d10 tx=0x7f3a10007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731d0709213b23 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:46.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a16ffd700 1 -- 172.21.15.31:0/1886149503 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000f070 con 0x7f3a18153ba0 2023-10-09T06:22:46.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a16ffd700 1 -- 172.21.15.31:0/1886149503 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1000a2e0 con 0x7f3a18153ba0 2023-10-09T06:22:46.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.161+0000 7f3a16ffd700 1 -- 172.21.15.31:0/1886149503 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000a680 con 0x7f3a18153ba0 2023-10-09T06:22:46.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.162+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/1886149503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a18153ba0 msgr2=0x7f3a180c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.162+0000 7f3a1e4e8700 1 --2- 172.21.15.31:0/1886149503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a18153ba0 0x7f3a180c7500 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3a180c2d10 tx=0x7f3a10007820 comp rx=0 tx=0).stop 2023-10-09T06:22:46.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.162+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/1886149503 shutdown_connections 2023-10-09T06:22:46.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.162+0000 7f3a1e4e8700 1 --2- 172.21.15.31:0/1886149503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a18153ba0 0x7f3a180c7500 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.162+0000 7f3a1e4e8700 1 --2- 172.21.15.31:0/1886149503 >> v2:172.21.15.158:3300/0 conn(0x7f3a18157200 0x7f3a180c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.162+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/1886149503 >> 172.21.15.31:0/1886149503 conn(0x7f3a18067660 msgr2=0x7f3a18067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:46.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.162+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/1886149503 shutdown_connections 2023-10-09T06:22:46.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.162+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/1886149503 wait complete. 2023-10-09T06:22:46.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.163+0000 7f3a1e4e8700 1 Processor -- start 2023-10-09T06:22:46.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.163+0000 7f3a1e4e8700 1 -- start start 2023-10-09T06:22:46.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a1e4e8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a181537d0 0x7f3a180c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a1e4e8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a18153ba0 0x7f3a181443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a1e4e8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a18157200 0x7f3a180af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a1e4e8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180b0c00 con 0x7f3a18153ba0 2023-10-09T06:22:46.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a1e4e8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180b0ee0 con 0x7f3a181537d0 2023-10-09T06:22:46.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a1e4e8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180b00c0 con 0x7f3a18157200 2023-10-09T06:22:46.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a177fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a18153ba0 0x7f3a181443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a177fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a18153ba0 0x7f3a181443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55306/0 (socket says 172.21.15.31:55306) 2023-10-09T06:22:46.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a177fe700 1 -- 172.21.15.31:0/2856744498 learned_addr learned my addr 172.21.15.31:0/2856744498 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:46.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a17fff700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a181537d0 0x7f3a180c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a1ca85700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a18157200 0x7f3a180af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a177fe700 1 -- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a18157200 msgr2=0x7f3a180af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a177fe700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a18157200 0x7f3a180af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a177fe700 1 -- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a181537d0 msgr2=0x7f3a180c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a177fe700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a181537d0 0x7f3a180c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a177fe700 1 -- 172.21.15.31:0/2856744498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1000c050 con 0x7f3a18153ba0 2023-10-09T06:22:46.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.164+0000 7f3a177fe700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a18153ba0 0x7f3a181443b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c830 tx=0x7f3a0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:46.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.165+0000 7f39fffff700 1 -- 172.21.15.31:0/2856744498 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c011600 con 0x7f3a18153ba0 2023-10-09T06:22:46.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.165+0000 7f39fffff700 1 -- 172.21.15.31:0/2856744498 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c011760 con 0x7f3a18153ba0 2023-10-09T06:22:46.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.165+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/2856744498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a180b03a0 con 0x7f3a18153ba0 2023-10-09T06:22:46.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.165+0000 7f39fffff700 1 -- 172.21.15.31:0/2856744498 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c011ae0 con 0x7f3a18153ba0 2023-10-09T06:22:46.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.165+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/2856744498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a181448f0 con 0x7f3a18153ba0 2023-10-09T06:22:46.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.166+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/2856744498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a180b1070 con 0x7f3a18153ba0 2023-10-09T06:22:46.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.166+0000 7f39fffff700 1 -- 172.21.15.31:0/2856744498 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a0c0223a0 con 0x7f3a18153ba0 2023-10-09T06:22:46.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.166+0000 7f39fffff700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3a04066f30 0x7f3a040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.167+0000 7f39fffff700 1 -- 172.21.15.31:0/2856744498 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f3a0c084840 con 0x7f3a18153ba0 2023-10-09T06:22:46.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.167+0000 7f3a17fff700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3a04066f30 0x7f3a040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.167+0000 7f3a17fff700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3a04066f30 0x7f3a040693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3a08003870 tx=0x7f3a08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:46.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.171+0000 7f39fffff700 1 -- 172.21.15.31:0/2856744498 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a0c051a70 con 0x7f3a18153ba0 2023-10-09T06:22:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.361+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/2856744498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a1804c3c0 con 0x7f3a18153ba0 2023-10-09T06:22:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.361+0000 7f39fffff700 1 -- 172.21.15.31:0/2856744498 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a0c055090 con 0x7f3a18153ba0 2023-10-09T06:22:46.363 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:22:46.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.363+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3a04066f30 msgr2=0x7f3a040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.363+0000 7f3a1e4e8700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3a04066f30 0x7f3a040693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3a08003870 tx=0x7f3a08009040 comp rx=0 tx=0).stop 2023-10-09T06:22:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.363+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/2856744498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a18153ba0 msgr2=0x7f3a181443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.363+0000 7f3a1e4e8700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a18153ba0 0x7f3a181443b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c830 tx=0x7f3a0c008040 comp rx=0 tx=0).stop 2023-10-09T06:22:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.363+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/2856744498 shutdown_connections 2023-10-09T06:22:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.363+0000 7f3a1e4e8700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3a04066f30 0x7f3a040693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.363+0000 7f3a1e4e8700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a18157200 0x7f3a180af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.363+0000 7f3a1e4e8700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a181537d0 0x7f3a180c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.363+0000 7f3a1e4e8700 1 --2- 172.21.15.31:0/2856744498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a18153ba0 0x7f3a181443b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.363+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/2856744498 >> 172.21.15.31:0/2856744498 conn(0x7f3a18067660 msgr2=0x7f3a18158a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.363+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/2856744498 shutdown_connections 2023-10-09T06:22:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.363+0000 7f3a1e4e8700 1 -- 172.21.15.31:0/2856744498 wait complete. 2023-10-09T06:22:46.376 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:22:46.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.497+0000 7f1a9ac80700 1 Processor -- start 2023-10-09T06:22:46.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.497+0000 7f1a9ac80700 1 -- start start 2023-10-09T06:22:46.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.498+0000 7f1a9ac80700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1a94069e90 0x7f1a941551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.498+0000 7f1a9ac80700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1a94155730 0x7f1a94159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.498+0000 7f1a9ac80700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a940cb080 con 0x7f1a94069ac0 2023-10-09T06:22:46.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.498+0000 7f1a9ac80700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a941592e0 con 0x7f1a94155730 2023-10-09T06:22:46.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.498+0000 7f1a9ac80700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94155bb0 con 0x7f1a94069e90 2023-10-09T06:22:46.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.498+0000 7f1a9a47f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1a94155730 0x7f1a94159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.498+0000 7f1a9947d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1a94069e90 0x7f1a941551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.498+0000 7f1a9a47f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1a94155730 0x7f1a94159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:59268/0 (socket says 172.21.15.31:59268) 2023-10-09T06:22:46.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.498+0000 7f1a9947d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1a94069e90 0x7f1a941551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:54992/0 (socket says 172.21.15.31:54992) 2023-10-09T06:22:46.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.498+0000 7f1a9a47f700 1 -- 172.21.15.31:0/1386127990 learned_addr learned my addr 172.21.15.31:0/1386127990 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:46.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.498+0000 7f1a99c7e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f1a94069ac0 0x7f1a940ca5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:35266/0 (socket says 172.21.15.31:35266) 2023-10-09T06:22:46.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.499+0000 7f1a9947d700 1 -- 172.21.15.31:0/1386127990 >> v2:172.21.15.158:3300/0 conn(0x7f1a94155730 msgr2=0x7f1a94159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:46.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.499+0000 7f1a9947d700 1 --2- 172.21.15.31:0/1386127990 >> v2:172.21.15.158:3300/0 conn(0x7f1a94155730 0x7f1a94159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.499+0000 7f1a9947d700 1 -- 172.21.15.31:0/1386127990 >> v1:172.21.15.158:6789/0 conn(0x7f1a94069ac0 legacy=0x7f1a940ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.499+0000 7f1a9947d700 1 -- 172.21.15.31:0/1386127990 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a941594f0 con 0x7f1a94069e90 2023-10-09T06:22:46.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.499+0000 7f1a9947d700 1 --2- 172.21.15.31:0/1386127990 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1a94069e90 0x7f1a941551f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1a880098e0 tx=0x7f1a880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2597cf338d2318e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:46.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.499+0000 7f1a98c7c700 1 -- 172.21.15.31:0/1386127990 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800b640 con 0x7f1a94069e90 2023-10-09T06:22:46.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.499+0000 7f1a98c7c700 1 -- 172.21.15.31:0/1386127990 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8800b7a0 con 0x7f1a94069e90 2023-10-09T06:22:46.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.499+0000 7f1a98c7c700 1 -- 172.21.15.31:0/1386127990 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800bb40 con 0x7f1a94069e90 2023-10-09T06:22:46.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.500+0000 7f1a9ac80700 1 -- 172.21.15.31:0/1386127990 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1a94069e90 msgr2=0x7f1a941551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.500+0000 7f1a9ac80700 1 --2- 172.21.15.31:0/1386127990 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1a94069e90 0x7f1a941551f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1a880098e0 tx=0x7f1a880091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.500+0000 7f1a9ac80700 1 -- 172.21.15.31:0/1386127990 shutdown_connections 2023-10-09T06:22:46.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.500+0000 7f1a9ac80700 1 --2- 172.21.15.31:0/1386127990 >> v2:172.21.15.158:3300/0 conn(0x7f1a94155730 0x7f1a94159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.500+0000 7f1a9ac80700 1 --2- 172.21.15.31:0/1386127990 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1a94069e90 0x7f1a941551f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.500+0000 7f1a9ac80700 1 -- 172.21.15.31:0/1386127990 >> 172.21.15.31:0/1386127990 conn(0x7f1a9406f350 msgr2=0x7f1a9406f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:46.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.500+0000 7f1a9ac80700 1 -- 172.21.15.31:0/1386127990 shutdown_connections 2023-10-09T06:22:46.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.500+0000 7f1a9ac80700 1 -- 172.21.15.31:0/1386127990 wait complete. 2023-10-09T06:22:46.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.501+0000 7f1a9ac80700 1 Processor -- start 2023-10-09T06:22:46.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.501+0000 7f1a9ac80700 1 -- start start 2023-10-09T06:22:46.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.501+0000 7f1a9ac80700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1a94069ac0 0x7f1a940b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9ac80700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94069e90 0x7f1a940cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9ac80700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1a94155730 0x7f1a9416ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9ac80700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940cf840 con 0x7f1a94069e90 2023-10-09T06:22:46.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9ac80700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940b42d0 con 0x7f1a94155730 2023-10-09T06:22:46.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9ac80700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940cba80 con 0x7f1a94069ac0 2023-10-09T06:22:46.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9947d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94069e90 0x7f1a940cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9947d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94069e90 0x7f1a940cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55314/0 (socket says 172.21.15.31:55314) 2023-10-09T06:22:46.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9947d700 1 -- 172.21.15.31:0/294372306 learned_addr learned my addr 172.21.15.31:0/294372306 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:46.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a99c7e700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1a94069ac0 0x7f1a940b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9a47f700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1a94155730 0x7f1a9416ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9947d700 1 -- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1a94069ac0 msgr2=0x7f1a940b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9947d700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1a94069ac0 0x7f1a940b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9947d700 1 -- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1a94155730 msgr2=0x7f1a9416ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9947d700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1a94155730 0x7f1a9416ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9947d700 1 -- 172.21.15.31:0/294372306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88009420 con 0x7f1a94069e90 2023-10-09T06:22:46.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9947d700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94069e90 0x7f1a940cf300 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1a94159420 tx=0x7f1a88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:46.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a91ffb700 1 -- 172.21.15.31:0/294372306 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8801bc40 con 0x7f1a94069e90 2023-10-09T06:22:46.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a91ffb700 1 -- 172.21.15.31:0/294372306 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8801bdc0 con 0x7f1a94069e90 2023-10-09T06:22:46.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a91ffb700 1 -- 172.21.15.31:0/294372306 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88011670 con 0x7f1a94069e90 2023-10-09T06:22:46.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.502+0000 7f1a9ac80700 1 -- 172.21.15.31:0/294372306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a940cbd60 con 0x7f1a94069e90 2023-10-09T06:22:46.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.503+0000 7f1a9ac80700 1 -- 172.21.15.31:0/294372306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a940b45b0 con 0x7f1a94069e90 2023-10-09T06:22:46.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.504+0000 7f1a9ac80700 1 -- 172.21.15.31:0/294372306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a940cc280 con 0x7f1a94069e90 2023-10-09T06:22:46.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.504+0000 7f1a91ffb700 1 -- 172.21.15.31:0/294372306 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a88011a20 con 0x7f1a94069e90 2023-10-09T06:22:46.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.504+0000 7f1a91ffb700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1a80066f30 0x7f1a800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.504+0000 7f1a91ffb700 1 -- 172.21.15.31:0/294372306 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1a88085b70 con 0x7f1a94069e90 2023-10-09T06:22:46.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.505+0000 7f1a99c7e700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1a80066f30 0x7f1a800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.505+0000 7f1a99c7e700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1a80066f30 0x7f1a800693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c004fd0 tx=0x7f1a8c007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:46.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.509+0000 7f1a91ffb700 1 -- 172.21.15.31:0/294372306 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a940cc280 con 0x7f1a94069e90 2023-10-09T06:22:46.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.703+0000 7f1a9ac80700 1 -- 172.21.15.31:0/294372306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a940cc280 con 0x7f1a94069e90 2023-10-09T06:22:46.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.703+0000 7f1a91ffb700 1 -- 172.21.15.31:0/294372306 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a940cc280 con 0x7f1a94069e90 2023-10-09T06:22:46.705 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:22:46.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.705+0000 7f1a9ac80700 1 -- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1a80066f30 msgr2=0x7f1a800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.705+0000 7f1a9ac80700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1a80066f30 0x7f1a800693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c004fd0 tx=0x7f1a8c007eb0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.705+0000 7f1a9ac80700 1 -- 172.21.15.31:0/294372306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94069e90 msgr2=0x7f1a940cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.705+0000 7f1a9ac80700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94069e90 0x7f1a940cf300 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1a94159420 tx=0x7f1a88017000 comp rx=0 tx=0).stop 2023-10-09T06:22:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.705+0000 7f1a9ac80700 1 -- 172.21.15.31:0/294372306 shutdown_connections 2023-10-09T06:22:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.705+0000 7f1a9ac80700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1a80066f30 0x7f1a800693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.705+0000 7f1a9ac80700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1a94069ac0 0x7f1a940b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.705+0000 7f1a9ac80700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1a94155730 0x7f1a9416ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.705+0000 7f1a9ac80700 1 --2- 172.21.15.31:0/294372306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94069e90 0x7f1a940cf300 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.705+0000 7f1a9ac80700 1 -- 172.21.15.31:0/294372306 >> 172.21.15.31:0/294372306 conn(0x7f1a9406f350 msgr2=0x7f1a94154660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.705+0000 7f1a9ac80700 1 -- 172.21.15.31:0/294372306 shutdown_connections 2023-10-09T06:22:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.705+0000 7f1a9ac80700 1 -- 172.21.15.31:0/294372306 wait complete. 2023-10-09T06:22:46.718 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:22:46.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.840+0000 7fadc5a2c700 1 Processor -- start 2023-10-09T06:22:46.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.840+0000 7fadc5a2c700 1 -- start start 2023-10-09T06:22:46.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.841+0000 7fadc5a2c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fadc00d1c30 0x7fadc00ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.841+0000 7fadc5a2c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00c5d80 con 0x7fadc015a2b0 2023-10-09T06:22:46.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.841+0000 7fadc5a2c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00c6060 con 0x7fadc015a680 2023-10-09T06:22:46.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.841+0000 7fadc5a2c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc0068470 con 0x7fadc00d1c30 2023-10-09T06:22:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.841+0000 7fadbe7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fadc00d1c30 0x7fadc00ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.841+0000 7fadbeffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fadc015a2b0 0x7fadc00b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53100/0 (socket says 172.21.15.31:53100) 2023-10-09T06:22:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.841+0000 7fadbeffd700 1 -- 172.21.15.31:0/3176191576 learned_addr learned my addr 172.21.15.31:0/3176191576 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.841+0000 7fadbe7fc700 1 -- 172.21.15.31:0/3176191576 >> v1:172.21.15.158:6789/0 conn(0x7fadc015a680 legacy=0x7fadc00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.841+0000 7fadbe7fc700 1 -- 172.21.15.31:0/3176191576 >> v1:172.21.15.31:6789/0 conn(0x7fadc015a2b0 legacy=0x7fadc00b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.841+0000 7fadbe7fc700 1 -- 172.21.15.31:0/3176191576 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00c6340 con 0x7fadc00d1c30 2023-10-09T06:22:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.841+0000 7fadbdffb700 1 -- 172.21.15.31:0/3176191576 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260846528 0 0) 0x7fadc00c5d80 con 0x7fadc015a2b0 2023-10-09T06:22:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.841+0000 7fadbe7fc700 1 --2- 172.21.15.31:0/3176191576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc00d1c30 0x7fadc00ccdd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fada80098e0 tx=0x7fada80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d4bce018279bee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.842+0000 7fadbdffb700 1 -- 172.21.15.31:0/3176191576 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8009e80 con 0x7fadc00d1c30 2023-10-09T06:22:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.842+0000 7fadbdffb700 1 -- 172.21.15.31:0/3176191576 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada800b820 con 0x7fadc00d1c30 2023-10-09T06:22:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.842+0000 7fadbdffb700 1 -- 172.21.15.31:0/3176191576 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada800bba0 con 0x7fadc00d1c30 2023-10-09T06:22:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.842+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3176191576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc00d1c30 msgr2=0x7fadc00ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.842+0000 7fadc5a2c700 1 --2- 172.21.15.31:0/3176191576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc00d1c30 0x7fadc00ccdd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fada80098e0 tx=0x7fada80091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.842+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3176191576 shutdown_connections 2023-10-09T06:22:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.842+0000 7fadc5a2c700 1 --2- 172.21.15.31:0/3176191576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc00d1c30 0x7fadc00ccdd0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.842+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3176191576 >> 172.21.15.31:0/3176191576 conn(0x7fadc0067e40 msgr2=0x7fadc00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.842+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3176191576 shutdown_connections 2023-10-09T06:22:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.842+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3176191576 wait complete. 2023-10-09T06:22:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.843+0000 7fadc5a2c700 1 Processor -- start 2023-10-09T06:22:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.843+0000 7fadc5a2c700 1 -- start start 2023-10-09T06:22:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.844+0000 7fadc5a2c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadc00d1c30 0x7fadc015ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.844+0000 7fadc5a2c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc015a2b0 0x7fadc00cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.844+0000 7fadc5a2c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fadc015a680 0x7fadc00cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.844+0000 7fadc5a2c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc016e8f0 con 0x7fadc015a2b0 2023-10-09T06:22:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.844+0000 7fadc5a2c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc016dce0 con 0x7fadc015a680 2023-10-09T06:22:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.844+0000 7fadc5a2c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc016dfc0 con 0x7fadc00d1c30 2023-10-09T06:22:46.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.844+0000 7fadbe7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc015a2b0 0x7fadc00cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.844+0000 7fadbe7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc015a2b0 0x7fadc00cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55328/0 (socket says 172.21.15.31:55328) 2023-10-09T06:22:46.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.844+0000 7fadbe7fc700 1 -- 172.21.15.31:0/3967246497 learned_addr learned my addr 172.21.15.31:0/3967246497 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:46.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.844+0000 7fadbeffd700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadc00d1c30 0x7fadc015ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.844+0000 7fadbf7fe700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fadc015a680 0x7fadc00cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.845+0000 7fadbe7fc700 1 -- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadc00d1c30 msgr2=0x7fadc015ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.845+0000 7fadbe7fc700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadc00d1c30 0x7fadc015ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.845+0000 7fadbe7fc700 1 -- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fadc015a680 msgr2=0x7fadc00cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:46.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.845+0000 7fadbe7fc700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fadc015a680 0x7fadc00cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:46.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.845+0000 7fadbe7fc700 1 -- 172.21.15.31:0/3967246497 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada8009420 con 0x7fadc015a2b0 2023-10-09T06:22:46.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.845+0000 7fadbf7fe700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fadc015a680 0x7fadc00cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:46.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.845+0000 7fadbe7fc700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc015a2b0 0x7fadc00cda50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fada80030c0 tx=0x7fada8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:46.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.845+0000 7fadb6ffd700 1 -- 172.21.15.31:0/3967246497 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada800b990 con 0x7fadc015a2b0 2023-10-09T06:22:46.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.845+0000 7fadb6ffd700 1 -- 172.21.15.31:0/3967246497 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada8020070 con 0x7fadc015a2b0 2023-10-09T06:22:46.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.845+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3967246497 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc016e2a0 con 0x7fadc015a2b0 2023-10-09T06:22:46.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.845+0000 7fadb6ffd700 1 -- 172.21.15.31:0/3967246497 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada801b450 con 0x7fadc015a2b0 2023-10-09T06:22:46.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.845+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3967246497 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc0155320 con 0x7fadc015a2b0 2023-10-09T06:22:46.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.846+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3967246497 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc016e740 con 0x7fadc015a2b0 2023-10-09T06:22:46.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.846+0000 7fadb6ffd700 1 -- 172.21.15.31:0/3967246497 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fada8022030 con 0x7fadc015a2b0 2023-10-09T06:22:46.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.847+0000 7fadb6ffd700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fada0066f30 0x7fada00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:46.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.847+0000 7fadb6ffd700 1 -- 172.21.15.31:0/3967246497 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fada8086560 con 0x7fadc015a2b0 2023-10-09T06:22:46.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.847+0000 7fadbeffd700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fada0066f30 0x7fada00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:46.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.848+0000 7fadbeffd700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fada0066f30 0x7fada00693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fadc0070b40 tx=0x7fadb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:46.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:46.851+0000 7fadb6ffd700 1 -- 172.21.15.31:0/3967246497 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fada80536f0 con 0x7fadc015a2b0 2023-10-09T06:22:47.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.090+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3967246497 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadc016e740 con 0x7fadc015a2b0 2023-10-09T06:22:47.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.091+0000 7fadb6ffd700 1 -- 172.21.15.31:0/3967246497 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fada8056d10 con 0x7fadc015a2b0 2023-10-09T06:22:47.092 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:47.092 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2970905850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2970905850},{"type":"v1","addr":"172.21.15.158:6837","nonce":2970905850}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5119,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1945558670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1945558670},{"type":"v1","addr":"172.21.15.31:6835","nonce":1945558670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3853703125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3853703125},{"type":"v1","addr":"172.21.15.31:6834","nonce":3853703125}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:22:12.504027+0000","modified":"2023-10-09T06:22:16.130642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/1366477380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1366477380},{"type":"v1","addr":"172.21.15.158:6836","nonce":1366477380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:22:47.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.092+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fada0066f30 msgr2=0x7fada00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.092+0000 7fadc5a2c700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fada0066f30 0x7fada00693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fadc0070b40 tx=0x7fadb0009040 comp rx=0 tx=0).stop 2023-10-09T06:22:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.092+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3967246497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc015a2b0 msgr2=0x7fadc00cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.092+0000 7fadc5a2c700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc015a2b0 0x7fadc00cda50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fada80030c0 tx=0x7fada8016000 comp rx=0 tx=0).stop 2023-10-09T06:22:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.093+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3967246497 shutdown_connections 2023-10-09T06:22:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.093+0000 7fadc5a2c700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fada0066f30 0x7fada00693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.093+0000 7fadc5a2c700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadc00d1c30 0x7fadc015ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.093+0000 7fadc5a2c700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fadc015a680 0x7fadc00cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.093+0000 7fadc5a2c700 1 --2- 172.21.15.31:0/3967246497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc015a2b0 0x7fadc00cda50 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.093+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3967246497 >> 172.21.15.31:0/3967246497 conn(0x7fadc0067e40 msgr2=0x7fadc0155dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.093+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3967246497 shutdown_connections 2023-10-09T06:22:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.093+0000 7fadc5a2c700 1 -- 172.21.15.31:0/3967246497 wait complete. 2023-10-09T06:22:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 25 2023-10-09T06:22:47.106 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:22:47.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.225+0000 7fa425b99700 1 Processor -- start 2023-10-09T06:22:47.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.225+0000 7fa425b99700 1 -- start start 2023-10-09T06:22:47.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.225+0000 7fa425b99700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa4201523e0 0x7fa42006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.225+0000 7fa425b99700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42006c010 con 0x7fa420158e50 2023-10-09T06:22:47.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.225+0000 7fa425b99700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42006bd10 con 0x7fa420152010 2023-10-09T06:22:47.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.225+0000 7fa425b99700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42015c060 con 0x7fa4201523e0 2023-10-09T06:22:47.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa420158e50 0x7fa4200cdf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53106/0 (socket says 172.21.15.31:53106) 2023-10-09T06:22:47.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41ffff700 1 -- 172.21.15.31:0/1953118172 learned_addr learned my addr 172.21.15.31:0/1953118172 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:47.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260142243 0 0) 0x7fa42006c010 con 0x7fa420158e50 2023-10-09T06:22:47.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41effd700 1 --2- 172.21.15.31:0/1953118172 >> v2:172.21.15.158:3300/0 conn(0x7fa4201523e0 0x7fa42006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa408003570 con 0x7fa420158e50 2023-10-09T06:22:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 241737550 0 0) 0x7fa408003570 con 0x7fa420158e50 2023-10-09T06:22:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 >> v2:172.21.15.158:3300/0 conn(0x7fa4201523e0 msgr2=0x7fa42006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 --2- 172.21.15.31:0/1953118172 >> v2:172.21.15.158:3300/0 conn(0x7fa4201523e0 0x7fa42006c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 >> v1:172.21.15.158:6789/0 conn(0x7fa420152010 legacy=0x7fa42015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42015c340 con 0x7fa420158e50 2023-10-09T06:22:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fa418001470 con 0x7fa420158e50 2023-10-09T06:22:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 >> v1:172.21.15.31:6789/0 conn(0x7fa420158e50 legacy=0x7fa4200cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 --2- 172.21.15.31:0/1953118172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa408003a60 0x7fa408003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 --2- 172.21.15.31:0/1953118172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa408004810 0x7fa408004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 --2- 172.21.15.31:0/1953118172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4080051c0 0x7fa40800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42015c060 con 0x7fa408003a60 2023-10-09T06:22:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40800c0d0 con 0x7fa4080051c0 2023-10-09T06:22:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40800c290 con 0x7fa408004810 2023-10-09T06:22:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41f7fe700 1 --2- 172.21.15.31:0/1953118172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa408003a60 0x7fa408003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41effd700 1 --2- 172.21.15.31:0/1953118172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa408004810 0x7fa408004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.226+0000 7fa41ffff700 1 --2- 172.21.15.31:0/1953118172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4080051c0 0x7fa40800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.227+0000 7fa41f7fe700 1 -- 172.21.15.31:0/1953118172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa408004810 msgr2=0x7fa408004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.227+0000 7fa41f7fe700 1 --2- 172.21.15.31:0/1953118172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa408004810 0x7fa408004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.227+0000 7fa41f7fe700 1 -- 172.21.15.31:0/1953118172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4080051c0 msgr2=0x7fa40800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.227+0000 7fa41f7fe700 1 --2- 172.21.15.31:0/1953118172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4080051c0 0x7fa40800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.227+0000 7fa41ffff700 1 -- 172.21.15.31:0/1953118172 reap_dead start 2023-10-09T06:22:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.227+0000 7fa41f7fe700 1 -- 172.21.15.31:0/1953118172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa408003570 con 0x7fa408003a60 2023-10-09T06:22:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.227+0000 7fa41f7fe700 1 --2- 172.21.15.31:0/1953118172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa408003a60 0x7fa408003e70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa410001fc0 tx=0x7fa410001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5c89d8974bac90 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.227+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410001950 con 0x7fa408003a60 2023-10-09T06:22:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.227+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41000c8b0 con 0x7fa408003a60 2023-10-09T06:22:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.227+0000 7fa41e7fc700 1 -- 172.21.15.31:0/1953118172 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41000cc50 con 0x7fa408003a60 2023-10-09T06:22:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.227+0000 7fa425b99700 1 -- 172.21.15.31:0/1953118172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa408003a60 msgr2=0x7fa408003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.227+0000 7fa425b99700 1 --2- 172.21.15.31:0/1953118172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa408003a60 0x7fa408003e70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa410001fc0 tx=0x7fa410001640 comp rx=0 tx=0).stop 2023-10-09T06:22:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.228+0000 7fa425b99700 1 -- 172.21.15.31:0/1953118172 shutdown_connections 2023-10-09T06:22:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.228+0000 7fa425b99700 1 --2- 172.21.15.31:0/1953118172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa408003a60 0x7fa408003e70 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.228+0000 7fa425b99700 1 -- 172.21.15.31:0/1953118172 >> 172.21.15.31:0/1953118172 conn(0x7fa420069870 msgr2=0x7fa420069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.228+0000 7fa425b99700 1 -- 172.21.15.31:0/1953118172 shutdown_connections 2023-10-09T06:22:47.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.228+0000 7fa425b99700 1 -- 172.21.15.31:0/1953118172 wait complete. 2023-10-09T06:22:47.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.229+0000 7fa425b99700 1 Processor -- start 2023-10-09T06:22:47.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.229+0000 7fa425b99700 1 -- start start 2023-10-09T06:22:47.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa425b99700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa408003a60 0x7fa420159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa425b99700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa42015dd90 0x7fa4201502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa425b99700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa42015cae0 0x7fa42015cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa425b99700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42015a210 con 0x7fa408003a60 2023-10-09T06:22:47.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa425b99700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42015a4f0 con 0x7fa42015dd90 2023-10-09T06:22:47.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa425b99700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42015a7d0 con 0x7fa42015cae0 2023-10-09T06:22:47.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa41f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa408003a60 0x7fa420159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa41f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa408003a60 0x7fa420159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55348/0 (socket says 172.21.15.31:55348) 2023-10-09T06:22:47.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa41f7fe700 1 -- 172.21.15.31:0/703034147 learned_addr learned my addr 172.21.15.31:0/703034147 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:47.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa41effd700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa42015dd90 0x7fa4201502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa41f7fe700 1 -- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa42015cae0 msgr2=0x7fa42015cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa41f7fe700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa42015cae0 0x7fa42015cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa41f7fe700 1 -- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa42015dd90 msgr2=0x7fa4201502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa41f7fe700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa42015dd90 0x7fa4201502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa41f7fe700 1 -- 172.21.15.31:0/703034147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42015aab0 con 0x7fa408003a60 2023-10-09T06:22:47.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa41effd700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa42015dd90 0x7fa4201502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:47.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa41f7fe700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa408003a60 0x7fa420159c30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa40800c0a0 tx=0x7fa410015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:47.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa4077fe700 1 -- 172.21.15.31:0/703034147 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410001950 con 0x7fa408003a60 2023-10-09T06:22:47.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa4077fe700 1 -- 172.21.15.31:0/703034147 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41000c6d0 con 0x7fa408003a60 2023-10-09T06:22:47.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa425b99700 1 -- 172.21.15.31:0/703034147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4200c6390 con 0x7fa408003a60 2023-10-09T06:22:47.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa4077fe700 1 -- 172.21.15.31:0/703034147 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41001e860 con 0x7fa408003a60 2023-10-09T06:22:47.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.230+0000 7fa425b99700 1 -- 172.21.15.31:0/703034147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa420150810 con 0x7fa408003a60 2023-10-09T06:22:47.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.231+0000 7fa425b99700 1 -- 172.21.15.31:0/703034147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa420150a30 con 0x7fa408003a60 2023-10-09T06:22:47.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.232+0000 7fa4077fe700 1 -- 172.21.15.31:0/703034147 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa410019030 con 0x7fa408003a60 2023-10-09T06:22:47.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.232+0000 7fa4077fe700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa40c066f30 0x7fa40c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.232+0000 7fa4077fe700 1 -- 172.21.15.31:0/703034147 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fa410086420 con 0x7fa408003a60 2023-10-09T06:22:47.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.232+0000 7fa41effd700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa40c066f30 0x7fa40c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.233+0000 7fa41effd700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa40c066f30 0x7fa40c0693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa414006dc0 tx=0x7fa414008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:47.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.237+0000 7fa4077fe700 1 -- 172.21.15.31:0/703034147 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa410053650 con 0x7fa408003a60 2023-10-09T06:22:47.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.428+0000 7fa425b99700 1 -- 172.21.15.31:0/703034147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4200c61f0 con 0x7fa408003a60 2023-10-09T06:22:47.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.428+0000 7fa4077fe700 1 -- 172.21.15.31:0/703034147 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+15446 (secure 0 0 0) 0x7fa4200c61f0 con 0x7fa408003a60 2023-10-09T06:22:47.429 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:47.429 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":53,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:22:43.728259+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:22:10.914998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T06:22:11.476116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.36","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:22:47.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.431+0000 7fa425b99700 1 -- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa40c066f30 msgr2=0x7fa40c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.431+0000 7fa425b99700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa40c066f30 0x7fa40c0693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa414006dc0 tx=0x7fa414008040 comp rx=0 tx=0).stop 2023-10-09T06:22:47.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.431+0000 7fa425b99700 1 -- 172.21.15.31:0/703034147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa408003a60 msgr2=0x7fa420159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.431+0000 7fa425b99700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa408003a60 0x7fa420159c30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa40800c0a0 tx=0x7fa410015000 comp rx=0 tx=0).stop 2023-10-09T06:22:47.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.431+0000 7fa425b99700 1 -- 172.21.15.31:0/703034147 shutdown_connections 2023-10-09T06:22:47.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.431+0000 7fa425b99700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa40c066f30 0x7fa40c0693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.431+0000 7fa425b99700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa42015cae0 0x7fa42015cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.431+0000 7fa425b99700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa408003a60 0x7fa420159c30 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.431+0000 7fa425b99700 1 --2- 172.21.15.31:0/703034147 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa42015dd90 0x7fa4201502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.431+0000 7fa425b99700 1 -- 172.21.15.31:0/703034147 >> 172.21.15.31:0/703034147 conn(0x7fa420069870 msgr2=0x7fa420069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:47.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.431+0000 7fa425b99700 1 -- 172.21.15.31:0/703034147 shutdown_connections 2023-10-09T06:22:47.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.431+0000 7fa425b99700 1 -- 172.21.15.31:0/703034147 wait complete. 2023-10-09T06:22:47.444 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:22:47.444 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:22:47.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.561+0000 7efdcec6f700 1 Processor -- start 2023-10-09T06:22:47.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.561+0000 7efdcec6f700 1 -- start start 2023-10-09T06:22:47.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.562+0000 7efdcec6f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efdc80cba20 0x7efdc815d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.562+0000 7efdcec6f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc815ddf0 con 0x7efdc8159e80 2023-10-09T06:22:47.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.562+0000 7efdcec6f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc80cf2d0 con 0x7efdc80af990 2023-10-09T06:22:47.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.562+0000 7efdcec6f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc80cf060 con 0x7efdc80cba20 2023-10-09T06:22:47.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.562+0000 7efdce46e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efdc8159e80 0x7efdc80cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53108/0 (socket says 172.21.15.31:53108) 2023-10-09T06:22:47.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.562+0000 7efdce46e700 1 -- 172.21.15.31:0/3552215318 learned_addr learned my addr 172.21.15.31:0/3552215318 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:47.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.562+0000 7efdcd46c700 1 --2- 172.21.15.31:0/3552215318 >> v2:172.21.15.158:3300/0 conn(0x7efdc80cba20 0x7efdc815d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.562+0000 7efdccc6b700 1 -- 172.21.15.31:0/3552215318 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719691448 0 0) 0x7efdc815ddf0 con 0x7efdc8159e80 2023-10-09T06:22:47.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.562+0000 7efdccc6b700 1 -- 172.21.15.31:0/3552215318 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb0003570 con 0x7efdc8159e80 2023-10-09T06:22:47.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.562+0000 7efdccc6b700 1 -- 172.21.15.31:0/3552215318 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124715939 0 0) 0x7efdc80cf2d0 con 0x7efdc80af990 2023-10-09T06:22:47.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.563+0000 7efdccc6b700 1 -- 172.21.15.31:0/3552215318 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdc815ddf0 con 0x7efdc80af990 2023-10-09T06:22:47.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.563+0000 7efdcd46c700 1 -- 172.21.15.31:0/3552215318 >> v1:172.21.15.158:6789/0 conn(0x7efdc80af990 legacy=0x7efdc8159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.563+0000 7efdcd46c700 1 -- 172.21.15.31:0/3552215318 >> v1:172.21.15.31:6789/0 conn(0x7efdc8159e80 legacy=0x7efdc80cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.563+0000 7efdcd46c700 1 -- 172.21.15.31:0/3552215318 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc815e020 con 0x7efdc80cba20 2023-10-09T06:22:47.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.563+0000 7efdcd46c700 1 --2- 172.21.15.31:0/3552215318 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc80cba20 0x7efdc815d8b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0098e0 tx=0x7efdbc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f51e071638525d92 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:47.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.563+0000 7efdccc6b700 1 -- 172.21.15.31:0/3552215318 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc011630 con 0x7efdc80cba20 2023-10-09T06:22:47.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.563+0000 7efdccc6b700 1 -- 172.21.15.31:0/3552215318 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc011790 con 0x7efdc80cba20 2023-10-09T06:22:47.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.563+0000 7efdccc6b700 1 -- 172.21.15.31:0/3552215318 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc011b30 con 0x7efdc80cba20 2023-10-09T06:22:47.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.564+0000 7efdcec6f700 1 -- 172.21.15.31:0/3552215318 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc80cba20 msgr2=0x7efdc815d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.564+0000 7efdcec6f700 1 --2- 172.21.15.31:0/3552215318 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc80cba20 0x7efdc815d8b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0098e0 tx=0x7efdbc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.564+0000 7efdcec6f700 1 -- 172.21.15.31:0/3552215318 shutdown_connections 2023-10-09T06:22:47.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.564+0000 7efdcec6f700 1 --2- 172.21.15.31:0/3552215318 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc80cba20 0x7efdc815d8b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.564+0000 7efdcec6f700 1 -- 172.21.15.31:0/3552215318 >> 172.21.15.31:0/3552215318 conn(0x7efdc8068bf0 msgr2=0x7efdc8068ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:47.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.564+0000 7efdcec6f700 1 -- 172.21.15.31:0/3552215318 shutdown_connections 2023-10-09T06:22:47.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.564+0000 7efdcec6f700 1 -- 172.21.15.31:0/3552215318 wait complete. 2023-10-09T06:22:47.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.565+0000 7efdcec6f700 1 Processor -- start 2023-10-09T06:22:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.565+0000 7efdcec6f700 1 -- start start 2023-10-09T06:22:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.565+0000 7efdcec6f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdc80af990 0x7efdc8155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.565+0000 7efdcec6f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdc80cba20 0x7efdc80c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.565+0000 7efdcec6f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8159e80 0x7efdc80b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcec6f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc815c6c0 con 0x7efdc80af990 2023-10-09T06:22:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcec6f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc815b4c0 con 0x7efdc8159e80 2023-10-09T06:22:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcec6f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc815b7a0 con 0x7efdc80cba20 2023-10-09T06:22:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcdc6d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdc80af990 0x7efdc8155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcdc6d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdc80af990 0x7efdc8155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55362/0 (socket says 172.21.15.31:55362) 2023-10-09T06:22:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcdc6d700 1 -- 172.21.15.31:0/1709952210 learned_addr learned my addr 172.21.15.31:0/1709952210 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcd46c700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdc80cba20 0x7efdc80c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdce46e700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8159e80 0x7efdc80b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcdc6d700 1 -- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdc80cba20 msgr2=0x7efdc80c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcdc6d700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdc80cba20 0x7efdc80c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcdc6d700 1 -- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8159e80 msgr2=0x7efdc80b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcdc6d700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8159e80 0x7efdc80b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcdc6d700 1 -- 172.21.15.31:0/1709952210 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc009420 con 0x7efdc80af990 2023-10-09T06:22:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcdc6d700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdc80af990 0x7efdc8155ee0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efdc000cb10 tx=0x7efdc0002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdc5ffb700 1 -- 172.21.15.31:0/1709952210 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000a760 con 0x7efdc80af990 2023-10-09T06:22:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdc5ffb700 1 -- 172.21.15.31:0/1709952210 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc000a8c0 con 0x7efdc80af990 2023-10-09T06:22:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcec6f700 1 -- 172.21.15.31:0/1709952210 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc80c8e00 con 0x7efdc80af990 2023-10-09T06:22:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdc5ffb700 1 -- 172.21.15.31:0/1709952210 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000ac60 con 0x7efdc80af990 2023-10-09T06:22:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.566+0000 7efdcec6f700 1 -- 172.21.15.31:0/1709952210 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc80c9b40 con 0x7efdc80af990 2023-10-09T06:22:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.567+0000 7efdcec6f700 1 -- 172.21.15.31:0/1709952210 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc80c9d90 con 0x7efdc80af990 2023-10-09T06:22:47.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.568+0000 7efdc5ffb700 1 -- 172.21.15.31:0/1709952210 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efdc0012630 con 0x7efdc80af990 2023-10-09T06:22:47.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.568+0000 7efdc5ffb700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efdb4066f30 0x7efdb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.568+0000 7efdc5ffb700 1 -- 172.21.15.31:0/1709952210 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7efdc0084a60 con 0x7efdc80af990 2023-10-09T06:22:47.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.568+0000 7efdcd46c700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efdb4066f30 0x7efdb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.569+0000 7efdcd46c700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efdb4066f30 0x7efdb40693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0093f0 tx=0x7efdbc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:47.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.572+0000 7efdc5ffb700 1 -- 172.21.15.31:0/1709952210 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdc80c9d90 con 0x7efdc80af990 2023-10-09T06:22:47.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.811+0000 7efdcec6f700 1 -- 172.21.15.31:0/1709952210 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdc80c8c60 con 0x7efdc80af990 2023-10-09T06:22:47.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.811+0000 7efdc5ffb700 1 -- 172.21.15.31:0/1709952210 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7efdc80c8c60 con 0x7efdc80af990 2023-10-09T06:22:47.812 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:47.812 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2970905850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2970905850},{"type":"v1","addr":"172.21.15.158:6837","nonce":2970905850}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5119,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1945558670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1945558670},{"type":"v1","addr":"172.21.15.31:6835","nonce":1945558670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3853703125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3853703125},{"type":"v1","addr":"172.21.15.31:6834","nonce":3853703125}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:22:12.504027+0000","modified":"2023-10-09T06:22:16.130642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/1366477380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1366477380},{"type":"v1","addr":"172.21.15.158:6836","nonce":1366477380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:22:47.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.813+0000 7efdcec6f700 1 -- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efdb4066f30 msgr2=0x7efdb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.814+0000 7efdcec6f700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efdb4066f30 0x7efdb40693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0093f0 tx=0x7efdbc017000 comp rx=0 tx=0).stop 2023-10-09T06:22:47.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.814+0000 7efdcec6f700 1 -- 172.21.15.31:0/1709952210 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdc80af990 msgr2=0x7efdc8155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.814+0000 7efdcec6f700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdc80af990 0x7efdc8155ee0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efdc000cb10 tx=0x7efdc0002820 comp rx=0 tx=0).stop 2023-10-09T06:22:47.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.814+0000 7efdcec6f700 1 -- 172.21.15.31:0/1709952210 shutdown_connections 2023-10-09T06:22:47.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.814+0000 7efdcec6f700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efdb4066f30 0x7efdb40693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.814+0000 7efdcec6f700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8159e80 0x7efdc80b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.814+0000 7efdcec6f700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdc80af990 0x7efdc8155ee0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.814+0000 7efdcec6f700 1 --2- 172.21.15.31:0/1709952210 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdc80cba20 0x7efdc80c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.814+0000 7efdcec6f700 1 -- 172.21.15.31:0/1709952210 >> 172.21.15.31:0/1709952210 conn(0x7efdc8068bf0 msgr2=0x7efdc8158870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:47.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.814+0000 7efdcec6f700 1 -- 172.21.15.31:0/1709952210 shutdown_connections 2023-10-09T06:22:47.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.814+0000 7efdcec6f700 1 -- 172.21.15.31:0/1709952210 wait complete. 2023-10-09T06:22:47.816 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 25 2023-10-09T06:22:47.826 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:22:47.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.944+0000 7fdc451f6700 1 Processor -- start 2023-10-09T06:22:47.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.944+0000 7fdc451f6700 1 -- start start 2023-10-09T06:22:47.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.945+0000 7fdc451f6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc400ac9c0 0x7fdc4015b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.945+0000 7fdc451f6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdc400acd90 0x7fdc40068880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.945+0000 7fdc451f6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc40068f80 con 0x7fdc400adc40 2023-10-09T06:22:47.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.945+0000 7fdc451f6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4015a840 con 0x7fdc400acd90 2023-10-09T06:22:47.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.945+0000 7fdc451f6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4006ec10 con 0x7fdc400ac9c0 2023-10-09T06:22:47.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.945+0000 7fdc3e59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdc400acd90 0x7fdc40068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.945+0000 7fdc3e59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdc400acd90 0x7fdc40068880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55374/0 (socket says 172.21.15.31:55374) 2023-10-09T06:22:47.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.945+0000 7fdc3e59c700 1 -- 172.21.15.31:0/3739732175 learned_addr learned my addr 172.21.15.31:0/3739732175 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:47.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.945+0000 7fdc3ed9d700 1 --2- 172.21.15.31:0/3739732175 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc400ac9c0 0x7fdc4015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.945+0000 7fdc3e59c700 1 -- 172.21.15.31:0/3739732175 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc400ac9c0 msgr2=0x7fdc4015b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:47.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.945+0000 7fdc3e59c700 1 --2- 172.21.15.31:0/3739732175 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc400ac9c0 0x7fdc4015b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc3e59c700 1 -- 172.21.15.31:0/3739732175 >> v1:172.21.15.158:6789/0 conn(0x7fdc400adc40 legacy=0x7fdc4006f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc3e59c700 1 -- 172.21.15.31:0/3739732175 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4006e2e0 con 0x7fdc400acd90 2023-10-09T06:22:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc3ed9d700 1 --2- 172.21.15.31:0/3739732175 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc400ac9c0 0x7fdc4015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc3e59c700 1 --2- 172.21.15.31:0/3739732175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc400acd90 0x7fdc40068880 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdc280099b0 tx=0x7fdc28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8b7af6a03f55ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc3dd9b700 1 -- 172.21.15.31:0/3739732175 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800b820 con 0x7fdc400acd90 2023-10-09T06:22:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc3dd9b700 1 -- 172.21.15.31:0/3739732175 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2800b980 con 0x7fdc400acd90 2023-10-09T06:22:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc3dd9b700 1 -- 172.21.15.31:0/3739732175 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800bd20 con 0x7fdc400acd90 2023-10-09T06:22:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc451f6700 1 -- 172.21.15.31:0/3739732175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc400acd90 msgr2=0x7fdc40068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc451f6700 1 --2- 172.21.15.31:0/3739732175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc400acd90 0x7fdc40068880 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdc280099b0 tx=0x7fdc28009250 comp rx=0 tx=0).stop 2023-10-09T06:22:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc451f6700 1 -- 172.21.15.31:0/3739732175 shutdown_connections 2023-10-09T06:22:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc451f6700 1 --2- 172.21.15.31:0/3739732175 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc400ac9c0 0x7fdc4015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc451f6700 1 --2- 172.21.15.31:0/3739732175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc400acd90 0x7fdc40068880 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc451f6700 1 -- 172.21.15.31:0/3739732175 >> 172.21.15.31:0/3739732175 conn(0x7fdc400ce4c0 msgr2=0x7fdc400ca460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:47.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc451f6700 1 -- 172.21.15.31:0/3739732175 shutdown_connections 2023-10-09T06:22:47.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.946+0000 7fdc451f6700 1 -- 172.21.15.31:0/3739732175 wait complete. 2023-10-09T06:22:47.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.948+0000 7fdc451f6700 1 Processor -- start 2023-10-09T06:22:47.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.948+0000 7fdc451f6700 1 -- start start 2023-10-09T06:22:47.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.948+0000 7fdc451f6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc400ac9c0 0x7fdc400b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.948+0000 7fdc451f6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc400acd90 0x7fdc40158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.948+0000 7fdc451f6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc400adc40 0x7fdc400c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.948+0000 7fdc451f6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400b2740 con 0x7fdc400ac9c0 2023-10-09T06:22:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc451f6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400b1b30 con 0x7fdc400acd90 2023-10-09T06:22:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc451f6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400b1e10 con 0x7fdc400adc40 2023-10-09T06:22:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc3ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc400ac9c0 0x7fdc400b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc3ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc400ac9c0 0x7fdc400b2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55378/0 (socket says 172.21.15.31:55378) 2023-10-09T06:22:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc3ed9d700 1 -- 172.21.15.31:0/3703915663 learned_addr learned my addr 172.21.15.31:0/3703915663 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc3e59c700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc400acd90 0x7fdc40158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc3f59e700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc400adc40 0x7fdc400c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc3ed9d700 1 -- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc400adc40 msgr2=0x7fdc400c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc3ed9d700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc400adc40 0x7fdc400c1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc3ed9d700 1 -- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc400acd90 msgr2=0x7fdc40158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:47.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc3ed9d700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc400acd90 0x7fdc40158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:47.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc3ed9d700 1 -- 172.21.15.31:0/3703915663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc280094f0 con 0x7fdc400ac9c0 2023-10-09T06:22:47.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc3ed9d700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc400ac9c0 0x7fdc400b2bd0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000c830 tx=0x7fdc30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:47.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc36ffd700 1 -- 172.21.15.31:0/3703915663 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30011600 con 0x7fdc400ac9c0 2023-10-09T06:22:47.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc36ffd700 1 -- 172.21.15.31:0/3703915663 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc30011760 con 0x7fdc400ac9c0 2023-10-09T06:22:47.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc451f6700 1 -- 172.21.15.31:0/3703915663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc400b20f0 con 0x7fdc400ac9c0 2023-10-09T06:22:47.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc36ffd700 1 -- 172.21.15.31:0/3703915663 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30011b20 con 0x7fdc400ac9c0 2023-10-09T06:22:47.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.949+0000 7fdc451f6700 1 -- 172.21.15.31:0/3703915663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc40158ca0 con 0x7fdc400ac9c0 2023-10-09T06:22:47.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.950+0000 7fdc451f6700 1 -- 172.21.15.31:0/3703915663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc40158ef0 con 0x7fdc400ac9c0 2023-10-09T06:22:47.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.951+0000 7fdc36ffd700 1 -- 172.21.15.31:0/3703915663 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc3000a3e0 con 0x7fdc400ac9c0 2023-10-09T06:22:47.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.951+0000 7fdc36ffd700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdc20066f30 0x7fdc200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:47.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.951+0000 7fdc36ffd700 1 -- 172.21.15.31:0/3703915663 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fdc30084a30 con 0x7fdc400ac9c0 2023-10-09T06:22:47.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.951+0000 7fdc3e59c700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdc20066f30 0x7fdc200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:47.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.952+0000 7fdc3e59c700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdc20066f30 0x7fdc200693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdc400ad200 tx=0x7fdc28016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:47.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:47.955+0000 7fdc36ffd700 1 -- 172.21.15.31:0/3703915663 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc30051c60 con 0x7fdc400ac9c0 2023-10-09T06:22:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.191+0000 7fdc451f6700 1 -- 172.21.15.31:0/3703915663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc400cb5c0 con 0x7fdc400ac9c0 2023-10-09T06:22:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.191+0000 7fdc36ffd700 1 -- 172.21.15.31:0/3703915663 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fdc30015090 con 0x7fdc400ac9c0 2023-10-09T06:22:48.192 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2970905850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2970905850},{"type":"v1","addr":"172.21.15.158:6837","nonce":2970905850}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5119,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1945558670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1945558670},{"type":"v1","addr":"172.21.15.31:6835","nonce":1945558670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3853703125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3853703125},{"type":"v1","addr":"172.21.15.31:6834","nonce":3853703125}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:22:12.504027+0000","modified":"2023-10-09T06:22:16.130642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/1366477380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1366477380},{"type":"v1","addr":"172.21.15.158:6836","nonce":1366477380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:22:48.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.193+0000 7fdc451f6700 1 -- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdc20066f30 msgr2=0x7fdc200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.193+0000 7fdc451f6700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdc20066f30 0x7fdc200693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdc400ad200 tx=0x7fdc28016000 comp rx=0 tx=0).stop 2023-10-09T06:22:48.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.193+0000 7fdc451f6700 1 -- 172.21.15.31:0/3703915663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc400ac9c0 msgr2=0x7fdc400b2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.193+0000 7fdc451f6700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc400ac9c0 0x7fdc400b2bd0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000c830 tx=0x7fdc30008040 comp rx=0 tx=0).stop 2023-10-09T06:22:48.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.193+0000 7fdc451f6700 1 -- 172.21.15.31:0/3703915663 shutdown_connections 2023-10-09T06:22:48.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.193+0000 7fdc451f6700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdc20066f30 0x7fdc200693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.193+0000 7fdc451f6700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc400adc40 0x7fdc400c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.193+0000 7fdc451f6700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc400ac9c0 0x7fdc400b2bd0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.193+0000 7fdc451f6700 1 --2- 172.21.15.31:0/3703915663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc400acd90 0x7fdc40158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.193+0000 7fdc451f6700 1 -- 172.21.15.31:0/3703915663 >> 172.21.15.31:0/3703915663 conn(0x7fdc400ce4c0 msgr2=0x7fdc400ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:48.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.193+0000 7fdc451f6700 1 -- 172.21.15.31:0/3703915663 shutdown_connections 2023-10-09T06:22:48.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.193+0000 7fdc451f6700 1 -- 172.21.15.31:0/3703915663 wait complete. 2023-10-09T06:22:48.195 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 25 2023-10-09T06:22:48.206 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:22:48.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.324+0000 7f3994a57700 1 Processor -- start 2023-10-09T06:22:48.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.324+0000 7f3994a57700 1 -- start start 2023-10-09T06:22:48.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.324+0000 7f3994a57700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3990068de0 0x7f39900cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:48.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.324+0000 7f3994a57700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39900cf920 con 0x7f3990067660 2023-10-09T06:22:48.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.324+0000 7f3994a57700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3990069450 con 0x7f3990159f80 2023-10-09T06:22:48.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.324+0000 7f3994a57700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399015a350 con 0x7f3990068de0 2023-10-09T06:22:48.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.325+0000 7f398e59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3990068de0 0x7f39900cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:48.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.325+0000 7f398f59e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3990067660 0x7f3990067a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53112/0 (socket says 172.21.15.31:53112) 2023-10-09T06:22:48.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.325+0000 7f398f59e700 1 -- 172.21.15.31:0/972989837 learned_addr learned my addr 172.21.15.31:0/972989837 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:48.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.325+0000 7f398e59c700 1 -- 172.21.15.31:0/972989837 >> v1:172.21.15.158:6789/0 conn(0x7f3990159f80 legacy=0x7f39900cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:48.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.325+0000 7f398e59c700 1 -- 172.21.15.31:0/972989837 >> v1:172.21.15.31:6789/0 conn(0x7f3990067660 legacy=0x7f3990067a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.325+0000 7f398dd9b700 1 -- 172.21.15.31:0/972989837 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467581358 0 0) 0x7f39900cf920 con 0x7f3990067660 2023-10-09T06:22:48.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.325+0000 7f398e59c700 1 -- 172.21.15.31:0/972989837 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39900cb580 con 0x7f3990068de0 2023-10-09T06:22:48.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.325+0000 7f398e59c700 1 --2- 172.21.15.31:0/972989837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3990068de0 0x7f39900cf3e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f39780098e0 tx=0x7f39780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c94ff98a1dea334 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:48.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.325+0000 7f398dd9b700 1 -- 172.21.15.31:0/972989837 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978009e80 con 0x7f3990068de0 2023-10-09T06:22:48.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.325+0000 7f398dd9b700 1 -- 172.21.15.31:0/972989837 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397800b820 con 0x7f3990068de0 2023-10-09T06:22:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.325+0000 7f398dd9b700 1 -- 172.21.15.31:0/972989837 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800bba0 con 0x7f3990068de0 2023-10-09T06:22:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.326+0000 7f3994a57700 1 -- 172.21.15.31:0/972989837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3990068de0 msgr2=0x7f39900cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.326+0000 7f3994a57700 1 --2- 172.21.15.31:0/972989837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3990068de0 0x7f39900cf3e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f39780098e0 tx=0x7f39780091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.326+0000 7f3994a57700 1 -- 172.21.15.31:0/972989837 shutdown_connections 2023-10-09T06:22:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.326+0000 7f3994a57700 1 --2- 172.21.15.31:0/972989837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3990068de0 0x7f39900cf3e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.326+0000 7f3994a57700 1 -- 172.21.15.31:0/972989837 >> 172.21.15.31:0/972989837 conn(0x7f399006c700 msgr2=0x7f3990069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.326+0000 7f3994a57700 1 -- 172.21.15.31:0/972989837 shutdown_connections 2023-10-09T06:22:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.326+0000 7f3994a57700 1 -- 172.21.15.31:0/972989837 wait complete. 2023-10-09T06:22:48.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.327+0000 7f3994a57700 1 Processor -- start 2023-10-09T06:22:48.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.327+0000 7f3994a57700 1 -- start start 2023-10-09T06:22:48.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f3994a57700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3990067660 0x7f39901462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:48.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f3994a57700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3990068de0 0x7f399015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:48.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f3994a57700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3990159f80 0x7f3990159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:48.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f3994a57700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3990069730 con 0x7f3990067660 2023-10-09T06:22:48.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f3994a57700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39901467e0 con 0x7f3990068de0 2023-10-09T06:22:48.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f3994a57700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399015c6f0 con 0x7f3990159f80 2023-10-09T06:22:48.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f398ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3990067660 0x7f39901462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:48.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f398ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3990067660 0x7f39901462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55398/0 (socket says 172.21.15.31:55398) 2023-10-09T06:22:48.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f398ed9d700 1 -- 172.21.15.31:0/3796036455 learned_addr learned my addr 172.21.15.31:0/3796036455 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:48.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f398e59c700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3990068de0 0x7f399015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:48.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f398ed9d700 1 -- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3990159f80 msgr2=0x7f3990159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f398f59e700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3990159f80 0x7f3990159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:48.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f398ed9d700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3990159f80 0x7f3990159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f398ed9d700 1 -- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3990068de0 msgr2=0x7f399015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f398ed9d700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3990068de0 0x7f399015cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f398ed9d700 1 -- 172.21.15.31:0/3796036455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3978009420 con 0x7f3990067660 2023-10-09T06:22:48.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f398e59c700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3990068de0 0x7f399015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:48.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f398f59e700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3990159f80 0x7f3990159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:48.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.328+0000 7f398ed9d700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3990067660 0x7f39901462a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f398800b5e0 tx=0x7f3988009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:48.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.329+0000 7f3986ffd700 1 -- 172.21.15.31:0/3796036455 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398800f510 con 0x7f3990067660 2023-10-09T06:22:48.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.329+0000 7f3986ffd700 1 -- 172.21.15.31:0/3796036455 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398800f670 con 0x7f3990067660 2023-10-09T06:22:48.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.329+0000 7f3986ffd700 1 -- 172.21.15.31:0/3796036455 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398800fa30 con 0x7f3990067660 2023-10-09T06:22:48.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.329+0000 7f3994a57700 1 -- 172.21.15.31:0/3796036455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399015bae0 con 0x7f3990067660 2023-10-09T06:22:48.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.329+0000 7f3994a57700 1 -- 172.21.15.31:0/3796036455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399015c0a0 con 0x7f3990067660 2023-10-09T06:22:48.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.330+0000 7f3994a57700 1 -- 172.21.15.31:0/3796036455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3990069dc0 con 0x7f3990067660 2023-10-09T06:22:48.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.330+0000 7f3986ffd700 1 -- 172.21.15.31:0/3796036455 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f398801a400 con 0x7f3990067660 2023-10-09T06:22:48.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.330+0000 7f3986ffd700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3970066f30 0x7f39700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:48.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.330+0000 7f3986ffd700 1 -- 172.21.15.31:0/3796036455 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f3988084080 con 0x7f3990067660 2023-10-09T06:22:48.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.331+0000 7f398e59c700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3970066f30 0x7f39700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:48.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.331+0000 7f398e59c700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3970066f30 0x7f39700693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f39780030c0 tx=0x7f3978016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:48.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.335+0000 7f3986ffd700 1 -- 172.21.15.31:0/3796036455 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3988051330 con 0x7f3990067660 2023-10-09T06:22:48.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.531+0000 7f3994a57700 1 -- 172.21.15.31:0/3796036455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f399004bb80 con 0x7f3990067660 2023-10-09T06:22:48.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.531+0000 7f3986ffd700 1 -- 172.21.15.31:0/3796036455 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+15446 (secure 0 0 0) 0x7f3988054950 con 0x7f3990067660 2023-10-09T06:22:48.532 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:48.532 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":53,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:22:43.728259+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:22:10.914998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T06:22:11.476116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.36","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:22:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.533+0000 7f3994a57700 1 -- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3970066f30 msgr2=0x7f39700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.533+0000 7f3994a57700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3970066f30 0x7f39700693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f39780030c0 tx=0x7f3978016000 comp rx=0 tx=0).stop 2023-10-09T06:22:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.533+0000 7f3994a57700 1 -- 172.21.15.31:0/3796036455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3990067660 msgr2=0x7f39901462a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.534+0000 7f3994a57700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3990067660 0x7f39901462a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f398800b5e0 tx=0x7f3988009120 comp rx=0 tx=0).stop 2023-10-09T06:22:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.534+0000 7f3994a57700 1 -- 172.21.15.31:0/3796036455 shutdown_connections 2023-10-09T06:22:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.534+0000 7f3994a57700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3970066f30 0x7f39700693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.534+0000 7f3994a57700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3990159f80 0x7f3990159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.534+0000 7f3994a57700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3990067660 0x7f39901462a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.534+0000 7f3994a57700 1 --2- 172.21.15.31:0/3796036455 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3990068de0 0x7f399015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.534+0000 7f3994a57700 1 -- 172.21.15.31:0/3796036455 >> 172.21.15.31:0/3796036455 conn(0x7f399006c700 msgr2=0x7f39900cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.534+0000 7f3994a57700 1 -- 172.21.15.31:0/3796036455 shutdown_connections 2023-10-09T06:22:48.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.534+0000 7f3994a57700 1 -- 172.21.15.31:0/3796036455 wait complete. 2023-10-09T06:22:48.547 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:22:48.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.665+0000 7f4184383700 1 Processor -- start 2023-10-09T06:22:48.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.665+0000 7f4184383700 1 -- start start 2023-10-09T06:22:48.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.666+0000 7f4184383700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c0d1c30 0x7f417c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:48.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.666+0000 7f4184383700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f417c15a680 0x7f417c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:48.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.666+0000 7f4184383700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417c0c5d80 con 0x7f417c15a2b0 2023-10-09T06:22:48.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.666+0000 7f4184383700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c068470 con 0x7f417c15a680 2023-10-09T06:22:48.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.666+0000 7f4184383700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0c6060 con 0x7f417c0d1c30 2023-10-09T06:22:48.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.666+0000 7f4182920700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f417c15a680 0x7f417c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:48.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.666+0000 7f418191e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c0d1c30 0x7f417c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:48.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.666+0000 7f418211f700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f417c15a2b0 0x7f417c0b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:35310/0 (socket says 172.21.15.31:35310) 2023-10-09T06:22:48.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.666+0000 7f418211f700 1 -- 172.21.15.31:0/3406013533 learned_addr learned my addr 172.21.15.31:0/3406013533 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:48.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.667+0000 7f4182920700 1 -- 172.21.15.31:0/3406013533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c0d1c30 msgr2=0x7f417c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:48.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.667+0000 7f4182920700 1 --2- 172.21.15.31:0/3406013533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c0d1c30 0x7f417c0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.667+0000 7f4182920700 1 -- 172.21.15.31:0/3406013533 >> v1:172.21.15.158:6789/0 conn(0x7f417c15a2b0 legacy=0x7f417c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.667+0000 7f4182920700 1 -- 172.21.15.31:0/3406013533 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c0c6340 con 0x7f417c15a680 2023-10-09T06:22:48.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.667+0000 7f418191e700 1 --2- 172.21.15.31:0/3406013533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c0d1c30 0x7f417c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:22:48.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.667+0000 7f4182920700 1 --2- 172.21.15.31:0/3406013533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c15a680 0x7f417c0cf710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f41740098e0 tx=0x7f41740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73120f958133bffe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.667+0000 7f418111d700 1 -- 172.21.15.31:0/3406013533 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417400b640 con 0x7f417c15a680 2023-10-09T06:22:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.667+0000 7f418111d700 1 -- 172.21.15.31:0/3406013533 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417400b7a0 con 0x7f417c15a680 2023-10-09T06:22:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.667+0000 7f418111d700 1 -- 172.21.15.31:0/3406013533 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417400bb40 con 0x7f417c15a680 2023-10-09T06:22:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.668+0000 7f4184383700 1 -- 172.21.15.31:0/3406013533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c15a680 msgr2=0x7f417c0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.668+0000 7f4184383700 1 --2- 172.21.15.31:0/3406013533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c15a680 0x7f417c0cf710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f41740098e0 tx=0x7f41740091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.668+0000 7f4184383700 1 -- 172.21.15.31:0/3406013533 shutdown_connections 2023-10-09T06:22:48.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.668+0000 7f4184383700 1 --2- 172.21.15.31:0/3406013533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c15a680 0x7f417c0cf710 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.668+0000 7f4184383700 1 --2- 172.21.15.31:0/3406013533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c0d1c30 0x7f417c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.668+0000 7f4184383700 1 -- 172.21.15.31:0/3406013533 >> 172.21.15.31:0/3406013533 conn(0x7f417c067e40 msgr2=0x7f417c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:48.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.668+0000 7f4184383700 1 -- 172.21.15.31:0/3406013533 shutdown_connections 2023-10-09T06:22:48.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.668+0000 7f4184383700 1 -- 172.21.15.31:0/3406013533 wait complete. 2023-10-09T06:22:48.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.669+0000 7f4184383700 1 Processor -- start 2023-10-09T06:22:48.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.669+0000 7f4184383700 1 -- start start 2023-10-09T06:22:48.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f4184383700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c0d1c30 0x7f417c155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:48.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f4184383700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c15a2b0 0x7f417c157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:48.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f4184383700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c15a680 0x7f417c15ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:48.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f4184383700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c1571e0 con 0x7f417c0d1c30 2023-10-09T06:22:48.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f4184383700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c1565d0 con 0x7f417c15a680 2023-10-09T06:22:48.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f4184383700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c1568b0 con 0x7f417c15a2b0 2023-10-09T06:22:48.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f418211f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c0d1c30 0x7f417c155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:48.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f418211f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c0d1c30 0x7f417c155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55404/0 (socket says 172.21.15.31:55404) 2023-10-09T06:22:48.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f418211f700 1 -- 172.21.15.31:0/3632360988 learned_addr learned my addr 172.21.15.31:0/3632360988 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:48.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f418191e700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c15a2b0 0x7f417c157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:48.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f4182920700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c15a680 0x7f417c15ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:48.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f418211f700 1 -- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c15a2b0 msgr2=0x7f417c157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f418211f700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c15a2b0 0x7f417c157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f418211f700 1 -- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c15a680 msgr2=0x7f417c15ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f418211f700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c15a680 0x7f417c15ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f418211f700 1 -- 172.21.15.31:0/3632360988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170009420 con 0x7f417c0d1c30 2023-10-09T06:22:48.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f418211f700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c0d1c30 0x7f417c155ad0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f416c00cbc0 tx=0x7f416c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:48.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f417a7fc700 1 -- 172.21.15.31:0/3632360988 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c00a940 con 0x7f417c0d1c30 2023-10-09T06:22:48.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f417a7fc700 1 -- 172.21.15.31:0/3632360988 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c00aaa0 con 0x7f417c0d1c30 2023-10-09T06:22:48.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f4184383700 1 -- 172.21.15.31:0/3632360988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4174009420 con 0x7f417c0d1c30 2023-10-09T06:22:48.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f417a7fc700 1 -- 172.21.15.31:0/3632360988 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c00ae60 con 0x7f417c0d1c30 2023-10-09T06:22:48.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.670+0000 7f4184383700 1 -- 172.21.15.31:0/3632360988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c156e70 con 0x7f417c0d1c30 2023-10-09T06:22:48.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.671+0000 7f4184383700 1 -- 172.21.15.31:0/3632360988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c04c3c0 con 0x7f417c0d1c30 2023-10-09T06:22:48.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.672+0000 7f417a7fc700 1 -- 172.21.15.31:0/3632360988 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f416c007300 con 0x7f417c0d1c30 2023-10-09T06:22:48.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.672+0000 7f417a7fc700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4168066f30 0x7f41680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:48.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.672+0000 7f417a7fc700 1 -- 172.21.15.31:0/3632360988 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f416c084690 con 0x7f417c0d1c30 2023-10-09T06:22:48.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.672+0000 7f418191e700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4168066f30 0x7f41680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:48.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.673+0000 7f418191e700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4168066f30 0x7f41680693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41700093f0 tx=0x7f4170008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:48.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.676+0000 7f417a7fc700 1 -- 172.21.15.31:0/3632360988 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f416c051940 con 0x7f417c0d1c30 2023-10-09T06:22:48.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.917+0000 7f4184383700 1 -- 172.21.15.31:0/3632360988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f417c064a00 con 0x7f417c0d1c30 2023-10-09T06:22:48.918 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:22:48.918+0000 7fc5e82b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:22:48.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.921+0000 7f417a7fc700 1 -- 172.21.15.31:0/3632360988 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f416c054f60 con 0x7f417c0d1c30 2023-10-09T06:22:48.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.923+0000 7f4184383700 1 -- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4168066f30 msgr2=0x7f41680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.923+0000 7f4184383700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4168066f30 0x7f41680693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41700093f0 tx=0x7f4170008040 comp rx=0 tx=0).stop 2023-10-09T06:22:48.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.923+0000 7f4184383700 1 -- 172.21.15.31:0/3632360988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c0d1c30 msgr2=0x7f417c155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:48.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.923+0000 7f4184383700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c0d1c30 0x7f417c155ad0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f416c00cbc0 tx=0x7f416c001a20 comp rx=0 tx=0).stop 2023-10-09T06:22:48.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.923+0000 7f4184383700 1 -- 172.21.15.31:0/3632360988 shutdown_connections 2023-10-09T06:22:48.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.923+0000 7f4184383700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4168066f30 0x7f41680693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.923+0000 7f4184383700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c15a680 0x7f417c15ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.923+0000 7f4184383700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c0d1c30 0x7f417c155ad0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.923+0000 7f4184383700 1 --2- 172.21.15.31:0/3632360988 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c15a2b0 0x7f417c157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:48.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.923+0000 7f4184383700 1 -- 172.21.15.31:0/3632360988 >> 172.21.15.31:0/3632360988 conn(0x7f417c067e40 msgr2=0x7f417c158880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:48.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.923+0000 7f4184383700 1 -- 172.21.15.31:0/3632360988 shutdown_connections 2023-10-09T06:22:48.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:48.923+0000 7f4184383700 1 -- 172.21.15.31:0/3632360988 wait complete. 2023-10-09T06:22:48.925 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:22:48.927 INFO:tasks.ceph.mds.b.smithi158.stderr: -9005> 2023-10-09T06:22:19.090+0000 7f4dd6819700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:22:48.935 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:22:48.956 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:22:49.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.056+0000 7f582d239700 1 Processor -- start 2023-10-09T06:22:49.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.056+0000 7f582d239700 1 -- start start 2023-10-09T06:22:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f582d239700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f582806aa00 0x7f5828164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f582d239700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58280b4d70 con 0x7f58280b6580 2023-10-09T06:22:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f582d239700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582815b3b0 con 0x7f58280cce30 2023-10-09T06:22:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f582d239700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58280cd8d0 con 0x7f582806aa00 2023-10-09T06:22:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f58277fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f58280b6580 0x7f582806a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53120/0 (socket says 172.21.15.31:53120) 2023-10-09T06:22:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f58277fe700 1 -- 172.21.15.31:0/1521386998 learned_addr learned my addr 172.21.15.31:0/1521386998 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f582ca38700 1 --2- 172.21.15.31:0/1521386998 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f582806aa00 0x7f5828164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f5826ffd700 1 -- 172.21.15.31:0/1521386998 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403995597 0 0) 0x7f58280b4d70 con 0x7f58280b6580 2023-10-09T06:22:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f5826ffd700 1 -- 172.21.15.31:0/1521386998 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5814003570 con 0x7f58280b6580 2023-10-09T06:22:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f5826ffd700 1 -- 172.21.15.31:0/1521386998 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406641854 0 0) 0x7f582815b3b0 con 0x7f58280cce30 2023-10-09T06:22:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f5826ffd700 1 -- 172.21.15.31:0/1521386998 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58280b4d70 con 0x7f58280cce30 2023-10-09T06:22:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f582ca38700 1 -- 172.21.15.31:0/1521386998 >> v1:172.21.15.158:6789/0 conn(0x7f58280cce30 legacy=0x7f582815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f582ca38700 1 -- 172.21.15.31:0/1521386998 >> v1:172.21.15.31:6789/0 conn(0x7f58280b6580 legacy=0x7f582806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.057+0000 7f582ca38700 1 -- 172.21.15.31:0/1521386998 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280b4440 con 0x7f582806aa00 2023-10-09T06:22:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.058+0000 7f582ca38700 1 --2- 172.21.15.31:0/1521386998 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f582806aa00 0x7f5828164c20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5820009e90 tx=0x7f5820009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bffdf4b473aef2b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.058+0000 7f5826ffd700 1 -- 172.21.15.31:0/1521386998 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000e070 con 0x7f582806aa00 2023-10-09T06:22:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.058+0000 7f5826ffd700 1 -- 172.21.15.31:0/1521386998 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582000bb80 con 0x7f582806aa00 2023-10-09T06:22:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.058+0000 7f5826ffd700 1 -- 172.21.15.31:0/1521386998 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820012430 con 0x7f582806aa00 2023-10-09T06:22:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.058+0000 7f582d239700 1 -- 172.21.15.31:0/1521386998 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f582806aa00 msgr2=0x7f5828164c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.058+0000 7f582d239700 1 --2- 172.21.15.31:0/1521386998 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f582806aa00 0x7f5828164c20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5820009e90 tx=0x7f5820009780 comp rx=0 tx=0).stop 2023-10-09T06:22:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.058+0000 7f582d239700 1 -- 172.21.15.31:0/1521386998 shutdown_connections 2023-10-09T06:22:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.058+0000 7f582d239700 1 --2- 172.21.15.31:0/1521386998 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f582806aa00 0x7f5828164c20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.058+0000 7f582d239700 1 -- 172.21.15.31:0/1521386998 >> 172.21.15.31:0/1521386998 conn(0x7f5828068cb0 msgr2=0x7f58280690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.058+0000 7f582d239700 1 -- 172.21.15.31:0/1521386998 shutdown_connections 2023-10-09T06:22:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.058+0000 7f582d239700 1 -- 172.21.15.31:0/1521386998 wait complete. 2023-10-09T06:22:49.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.059+0000 7f582d239700 1 Processor -- start 2023-10-09T06:22:49.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.060+0000 7f582d239700 1 -- start start 2023-10-09T06:22:49.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.060+0000 7f582d239700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f582806aa00 0x7f582815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:49.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.060+0000 7f582d239700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58280b6580 0x7f58280d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:49.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.060+0000 7f582d239700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58280cce30 0x7f58281492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:49.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.060+0000 7f582d239700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582815d3d0 con 0x7f58280cce30 2023-10-09T06:22:49.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.060+0000 7f582d239700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5828152050 con 0x7f58280b6580 2023-10-09T06:22:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.060+0000 7f582d239700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5828152330 con 0x7f582806aa00 2023-10-09T06:22:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.060+0000 7f582ca38700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58280cce30 0x7f58281492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.060+0000 7f582ca38700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58280cce30 0x7f58281492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55408/0 (socket says 172.21.15.31:55408) 2023-10-09T06:22:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.060+0000 7f582ca38700 1 -- 172.21.15.31:0/2686654846 learned_addr learned my addr 172.21.15.31:0/2686654846 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.060+0000 7f58277fe700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58280b6580 0x7f58280d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.060+0000 7f5827fff700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f582806aa00 0x7f582815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.061+0000 7f582ca38700 1 -- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f582806aa00 msgr2=0x7f582815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.061+0000 7f582ca38700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f582806aa00 0x7f582815ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.061+0000 7f582ca38700 1 -- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58280b6580 msgr2=0x7f58280d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.061+0000 7f582ca38700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58280b6580 0x7f58280d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.061+0000 7f582ca38700 1 -- 172.21.15.31:0/2686654846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820009a20 con 0x7f58280cce30 2023-10-09T06:22:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.061+0000 7f582ca38700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58280cce30 0x7f58281492f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5820013000 tx=0x7f5820019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.061+0000 7f581ffff700 1 -- 172.21.15.31:0/2686654846 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820012e30 con 0x7f58280cce30 2023-10-09T06:22:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.061+0000 7f581ffff700 1 -- 172.21.15.31:0/2686654846 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582001b420 con 0x7f58280cce30 2023-10-09T06:22:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.061+0000 7f582d239700 1 -- 172.21.15.31:0/2686654846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5828152610 con 0x7f58280cce30 2023-10-09T06:22:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.061+0000 7f581ffff700 1 -- 172.21.15.31:0/2686654846 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582001b7e0 con 0x7f58280cce30 2023-10-09T06:22:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.061+0000 7f582d239700 1 -- 172.21.15.31:0/2686654846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5828152bd0 con 0x7f58280cce30 2023-10-09T06:22:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.062+0000 7f582d239700 1 -- 172.21.15.31:0/2686654846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5828089550 con 0x7f58280cce30 2023-10-09T06:22:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.062+0000 7f581ffff700 1 -- 172.21.15.31:0/2686654846 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f582001bb50 con 0x7f58280cce30 2023-10-09T06:22:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.063+0000 7f581ffff700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5808066f30 0x7f58080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.063+0000 7f581ffff700 1 -- 172.21.15.31:0/2686654846 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f58200861f0 con 0x7f58280cce30 2023-10-09T06:22:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.063+0000 7f5827fff700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5808066f30 0x7f58080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:49.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.064+0000 7f5827fff700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5808066f30 0x7f58080693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5810007fd0 tx=0x7f5810007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:49.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.067+0000 7f581ffff700 1 -- 172.21.15.31:0/2686654846 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5820056e60 con 0x7f58280cce30 2023-10-09T06:22:49.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.303+0000 7f582d239700 1 -- 172.21.15.31:0/2686654846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f58280b4720 con 0x7f58280cce30 2023-10-09T06:22:49.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.922+0000 7f581ffff700 1 -- 172.21.15.31:0/2686654846 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f58200569f0 con 0x7f58280cce30 2023-10-09T06:22:49.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.925+0000 7f582d239700 1 -- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5808066f30 msgr2=0x7f58080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:49.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.925+0000 7f582d239700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5808066f30 0x7f58080693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5810007fd0 tx=0x7f5810007d10 comp rx=0 tx=0).stop 2023-10-09T06:22:49.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.925+0000 7f582d239700 1 -- 172.21.15.31:0/2686654846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58280cce30 msgr2=0x7f58281492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:49.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.925+0000 7f582d239700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58280cce30 0x7f58281492f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5820013000 tx=0x7f5820019000 comp rx=0 tx=0).stop 2023-10-09T06:22:49.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.925+0000 7f582d239700 1 -- 172.21.15.31:0/2686654846 shutdown_connections 2023-10-09T06:22:49.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.925+0000 7f582d239700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5808066f30 0x7f58080693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:49.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.925+0000 7f582d239700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f582806aa00 0x7f582815ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:49.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.925+0000 7f582d239700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58280cce30 0x7f58281492f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.925+0000 7f582d239700 1 --2- 172.21.15.31:0/2686654846 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58280b6580 0x7f58280d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.925+0000 7f582d239700 1 -- 172.21.15.31:0/2686654846 >> 172.21.15.31:0/2686654846 conn(0x7f5828068cb0 msgr2=0x7f58280af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.925+0000 7f582d239700 1 -- 172.21.15.31:0/2686654846 shutdown_connections 2023-10-09T06:22:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:49.925+0000 7f582d239700 1 -- 172.21.15.31:0/2686654846 wait complete. 2023-10-09T06:22:49.941 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:22:50.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.071+0000 7f60ffca3700 1 Processor -- start 2023-10-09T06:22:50.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.071+0000 7f60ffca3700 1 -- start start 2023-10-09T06:22:50.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.072+0000 7f60ffca3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f60f8067d70 0x7f60f815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:50.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.072+0000 7f60ffca3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60f815aee0 0x7f60f80cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:50.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.072+0000 7f60ffca3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f80cf350 con 0x7f60f8157b10 2023-10-09T06:22:50.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.072+0000 7f60ffca3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f815e9e0 con 0x7f60f8067d70 2023-10-09T06:22:50.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.072+0000 7f60ffca3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8157ee0 con 0x7f60f815aee0 2023-10-09T06:22:50.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.072+0000 7f60fda3f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f60f8157b10 0x7f60f8067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60236/0 (socket says 172.21.15.31:60236) 2023-10-09T06:22:50.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.072+0000 7f60fd23e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f60f8067d70 0x7f60f815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:50.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.072+0000 7f60fda3f700 1 -- 172.21.15.31:0/528567778 learned_addr learned my addr 172.21.15.31:0/528567778 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:50.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.073+0000 7f60fe240700 1 --2- 172.21.15.31:0/528567778 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60f815aee0 0x7f60f80cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:50.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.073+0000 7f60fd23e700 1 -- 172.21.15.31:0/528567778 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60f815aee0 msgr2=0x7f60f80cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:50.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.073+0000 7f60fd23e700 1 --2- 172.21.15.31:0/528567778 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60f815aee0 0x7f60f80cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:50.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.073+0000 7f60fd23e700 1 -- 172.21.15.31:0/528567778 >> v1:172.21.15.31:6789/0 conn(0x7f60f8157b10 legacy=0x7f60f8067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:50.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.073+0000 7f60fd23e700 1 -- 172.21.15.31:0/528567778 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f815b360 con 0x7f60f8067d70 2023-10-09T06:22:50.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.073+0000 7f60fca3d700 1 -- 172.21.15.31:0/528567778 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025788293 0 0) 0x7f60f80cf350 con 0x7f60f8157b10 2023-10-09T06:22:50.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.073+0000 7f60fd23e700 1 --2- 172.21.15.31:0/528567778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60f8067d70 0x7f60f815dab0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009910 tx=0x7f60ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41dc3fd53e55bcb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:50.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.073+0000 7f60fca3d700 1 -- 172.21.15.31:0/528567778 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00b820 con 0x7f60f8067d70 2023-10-09T06:22:50.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.073+0000 7f60fca3d700 1 -- 172.21.15.31:0/528567778 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec00b980 con 0x7f60f8067d70 2023-10-09T06:22:50.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.073+0000 7f60fca3d700 1 -- 172.21.15.31:0/528567778 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00bd20 con 0x7f60f8067d70 2023-10-09T06:22:50.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.073+0000 7f60ffca3700 1 -- 172.21.15.31:0/528567778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60f8067d70 msgr2=0x7f60f815dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:50.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.073+0000 7f60ffca3700 1 --2- 172.21.15.31:0/528567778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60f8067d70 0x7f60f815dab0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009910 tx=0x7f60ec0091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:50.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.074+0000 7f60ffca3700 1 -- 172.21.15.31:0/528567778 shutdown_connections 2023-10-09T06:22:50.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.074+0000 7f60ffca3700 1 --2- 172.21.15.31:0/528567778 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60f815aee0 0x7f60f80cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:50.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.074+0000 7f60ffca3700 1 --2- 172.21.15.31:0/528567778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60f8067d70 0x7f60f815dab0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:50.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.074+0000 7f60ffca3700 1 -- 172.21.15.31:0/528567778 >> 172.21.15.31:0/528567778 conn(0x7f60f80d0de0 msgr2=0x7f60f80d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:50.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.074+0000 7f60ffca3700 1 -- 172.21.15.31:0/528567778 shutdown_connections 2023-10-09T06:22:50.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.074+0000 7f60ffca3700 1 -- 172.21.15.31:0/528567778 wait complete. 2023-10-09T06:22:50.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.075+0000 7f60ffca3700 1 Processor -- start 2023-10-09T06:22:50.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.075+0000 7f60ffca3700 1 -- start start 2023-10-09T06:22:50.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.075+0000 7f60ffca3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60f8067d70 0x7f60f80d0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:50.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.075+0000 7f60ffca3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60f8157b10 0x7f60f8154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:50.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60ffca3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60f815aee0 0x7f60f8156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:50.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60ffca3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f80c9080 con 0x7f60f8067d70 2023-10-09T06:22:50.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60ffca3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f816ae10 con 0x7f60f8157b10 2023-10-09T06:22:50.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60ffca3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f816b0f0 con 0x7f60f815aee0 2023-10-09T06:22:50.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60fda3f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60f8067d70 0x7f60f80d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:50.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60fda3f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60f8067d70 0x7f60f80d0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49842/0 (socket says 172.21.15.31:49842) 2023-10-09T06:22:50.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60fda3f700 1 -- 172.21.15.31:0/1377717225 learned_addr learned my addr 172.21.15.31:0/1377717225 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:50.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60fd23e700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60f8157b10 0x7f60f8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:50.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60fe240700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60f815aee0 0x7f60f8156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:50.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60fda3f700 1 -- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60f815aee0 msgr2=0x7f60f8156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:50.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60fda3f700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60f815aee0 0x7f60f8156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:50.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60fda3f700 1 -- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60f8157b10 msgr2=0x7f60f8154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:50.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60fda3f700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60f8157b10 0x7f60f8154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:50.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60fda3f700 1 -- 172.21.15.31:0/1377717225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec009420 con 0x7f60f8067d70 2023-10-09T06:22:50.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60fda3f700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60f8067d70 0x7f60f80d0420 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f60e800cd80 tx=0x7f60e8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:50.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60f5ffb700 1 -- 172.21.15.31:0/1377717225 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e800ab10 con 0x7f60f8067d70 2023-10-09T06:22:50.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60f5ffb700 1 -- 172.21.15.31:0/1377717225 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e800ac70 con 0x7f60f8067d70 2023-10-09T06:22:50.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60ffca3700 1 -- 172.21.15.31:0/1377717225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f816b3d0 con 0x7f60f8067d70 2023-10-09T06:22:50.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60f5ffb700 1 -- 172.21.15.31:0/1377717225 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e80070f0 con 0x7f60f8067d70 2023-10-09T06:22:50.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.076+0000 7f60ffca3700 1 -- 172.21.15.31:0/1377717225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f80d0960 con 0x7f60f8067d70 2023-10-09T06:22:50.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.078+0000 7f60ffca3700 1 -- 172.21.15.31:0/1377717225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f804c3c0 con 0x7f60f8067d70 2023-10-09T06:22:50.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.078+0000 7f60f5ffb700 1 -- 172.21.15.31:0/1377717225 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60e80074e0 con 0x7f60f8067d70 2023-10-09T06:22:50.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.078+0000 7f60f5ffb700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f60e4066f30 0x7f60e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:50.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.078+0000 7f60f5ffb700 1 -- 172.21.15.31:0/1377717225 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f60e8084b50 con 0x7f60f8067d70 2023-10-09T06:22:50.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.078+0000 7f60fd23e700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f60e4066f30 0x7f60e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:50.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.079+0000 7f60fd23e700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f60e4066f30 0x7f60e40693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009910 tx=0x7f60ec017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:50.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.082+0000 7f60f5ffb700 1 -- 172.21.15.31:0/1377717225 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60e8051db0 con 0x7f60f8067d70 2023-10-09T06:22:50.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.274+0000 7f60ffca3700 1 -- 172.21.15.31:0/1377717225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f60f80c91c0 con 0x7f60f8067d70 2023-10-09T06:22:50.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.925+0000 7f60f5ffb700 1 -- 172.21.15.31:0/1377717225 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7f60e80553d0 con 0x7f60f8067d70 2023-10-09T06:22:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.928+0000 7f60ffca3700 1 -- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f60e4066f30 msgr2=0x7f60e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.928+0000 7f60ffca3700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f60e4066f30 0x7f60e40693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009910 tx=0x7f60ec017000 comp rx=0 tx=0).stop 2023-10-09T06:22:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.928+0000 7f60ffca3700 1 -- 172.21.15.31:0/1377717225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60f8067d70 msgr2=0x7f60f80d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.928+0000 7f60ffca3700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60f8067d70 0x7f60f80d0420 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f60e800cd80 tx=0x7f60e8001ae0 comp rx=0 tx=0).stop 2023-10-09T06:22:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.928+0000 7f60ffca3700 1 -- 172.21.15.31:0/1377717225 shutdown_connections 2023-10-09T06:22:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.928+0000 7f60ffca3700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f60e4066f30 0x7f60e40693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.928+0000 7f60ffca3700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f60f815aee0 0x7f60f8156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.928+0000 7f60ffca3700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60f8067d70 0x7f60f80d0420 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:50.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.928+0000 7f60ffca3700 1 --2- 172.21.15.31:0/1377717225 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60f8157b10 0x7f60f8154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:50.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.928+0000 7f60ffca3700 1 -- 172.21.15.31:0/1377717225 >> 172.21.15.31:0/1377717225 conn(0x7f60f80d0de0 msgr2=0x7f60f8155270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:50.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.928+0000 7f60ffca3700 1 -- 172.21.15.31:0/1377717225 shutdown_connections 2023-10-09T06:22:50.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:50.928+0000 7f60ffca3700 1 -- 172.21.15.31:0/1377717225 wait complete. 2023-10-09T06:22:50.949 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:22:50.953 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:22:51.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.080+0000 7f03988d8700 1 Processor -- start 2023-10-09T06:22:51.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.080+0000 7f03988d8700 1 -- start start 2023-10-09T06:22:51.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.081+0000 7f03988d8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0394068ec0 0x7f03940b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:51.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.081+0000 7f03988d8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03940b1950 0x7f03940af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:51.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.081+0000 7f03988d8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03940aff80 con 0x7f0394068af0 2023-10-09T06:22:51.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.081+0000 7f03988d8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03940b15c0 con 0x7f03940b1950 2023-10-09T06:22:51.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.081+0000 7f03988d8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039415b5f0 con 0x7f0394068ec0 2023-10-09T06:22:51.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.081+0000 7f0392d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03940b1950 0x7f03940af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:51.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.082+0000 7f0392d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03940b1950 0x7f03940af0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49844/0 (socket says 172.21.15.31:49844) 2023-10-09T06:22:51.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.082+0000 7f039259c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0394068af0 0x7f039415aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60246/0 (socket says 172.21.15.31:60246) 2023-10-09T06:22:51.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.082+0000 7f0392d9d700 1 -- 172.21.15.31:0/1323531551 learned_addr learned my addr 172.21.15.31:0/1323531551 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:51.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.082+0000 7f0391d9b700 1 --2- 172.21.15.31:0/1323531551 >> v2:172.21.15.158:3300/0 conn(0x7f0394068ec0 0x7f03940b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:51.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.082+0000 7f0392d9d700 1 -- 172.21.15.31:0/1323531551 >> v2:172.21.15.158:3300/0 conn(0x7f0394068ec0 msgr2=0x7f03940b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:51.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.082+0000 7f0392d9d700 1 --2- 172.21.15.31:0/1323531551 >> v2:172.21.15.158:3300/0 conn(0x7f0394068ec0 0x7f03940b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:51.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.082+0000 7f0392d9d700 1 -- 172.21.15.31:0/1323531551 >> v1:172.21.15.31:6789/0 conn(0x7f0394068af0 legacy=0x7f039415aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:51.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.082+0000 7f039159a700 1 -- 172.21.15.31:0/1323531551 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717577942 0 0) 0x7f03940aff80 con 0x7f0394068af0 2023-10-09T06:22:51.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.082+0000 7f0392d9d700 1 -- 172.21.15.31:0/1323531551 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03940b0350 con 0x7f03940b1950 2023-10-09T06:22:51.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.082+0000 7f0392d9d700 1 --2- 172.21.15.31:0/1323531551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03940b1950 0x7f03940af0f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f039415b760 tx=0x7f038c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a662745e7a088f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:51.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.082+0000 7f039159a700 1 -- 172.21.15.31:0/1323531551 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c00b860 con 0x7f03940b1950 2023-10-09T06:22:51.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.082+0000 7f039159a700 1 -- 172.21.15.31:0/1323531551 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c00b9c0 con 0x7f03940b1950 2023-10-09T06:22:51.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.082+0000 7f039159a700 1 -- 172.21.15.31:0/1323531551 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c00bd60 con 0x7f03940b1950 2023-10-09T06:22:51.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.083+0000 7f03988d8700 1 -- 172.21.15.31:0/1323531551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03940b1950 msgr2=0x7f03940af0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:51.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.083+0000 7f03988d8700 1 --2- 172.21.15.31:0/1323531551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03940b1950 0x7f03940af0f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f039415b760 tx=0x7f038c009250 comp rx=0 tx=0).stop 2023-10-09T06:22:51.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.083+0000 7f03988d8700 1 -- 172.21.15.31:0/1323531551 shutdown_connections 2023-10-09T06:22:51.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.083+0000 7f03988d8700 1 --2- 172.21.15.31:0/1323531551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03940b1950 0x7f03940af0f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:51.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.083+0000 7f03988d8700 1 --2- 172.21.15.31:0/1323531551 >> v2:172.21.15.158:3300/0 conn(0x7f0394068ec0 0x7f03940b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:51.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.083+0000 7f03988d8700 1 -- 172.21.15.31:0/1323531551 >> 172.21.15.31:0/1323531551 conn(0x7f0394069870 msgr2=0x7f0394069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:51.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.083+0000 7f03988d8700 1 -- 172.21.15.31:0/1323531551 shutdown_connections 2023-10-09T06:22:51.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.083+0000 7f03988d8700 1 -- 172.21.15.31:0/1323531551 wait complete. 2023-10-09T06:22:51.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.084+0000 7f03988d8700 1 Processor -- start 2023-10-09T06:22:51.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.084+0000 7f03988d8700 1 -- start start 2023-10-09T06:22:51.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f03988d8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0394068af0 0x7f03940c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:51.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f03988d8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0394068ec0 0x7f0394158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:51.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f03988d8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03940b1950 0x7f039406cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:51.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f03988d8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03940c85a0 con 0x7f03940b1950 2023-10-09T06:22:51.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f03988d8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03940c87f0 con 0x7f0394068ec0 2023-10-09T06:22:51.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f03988d8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03940c8ad0 con 0x7f0394068af0 2023-10-09T06:22:51.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f0392d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03940b1950 0x7f039406cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:51.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f0392d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03940b1950 0x7f039406cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49858/0 (socket says 172.21.15.31:49858) 2023-10-09T06:22:51.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f0392d9d700 1 -- 172.21.15.31:0/3783503455 learned_addr learned my addr 172.21.15.31:0/3783503455 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:51.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f0391d9b700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0394068ec0 0x7f0394158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:51.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f039259c700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0394068af0 0x7f03940c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:51.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f0392d9d700 1 -- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0394068af0 msgr2=0x7f03940c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:51.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f0392d9d700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0394068af0 0x7f03940c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:51.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f0392d9d700 1 -- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0394068ec0 msgr2=0x7f0394158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:51.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f0392d9d700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0394068ec0 0x7f0394158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:51.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f0392d9d700 1 -- 172.21.15.31:0/3783503455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0094f0 con 0x7f03940b1950 2023-10-09T06:22:51.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f039259c700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0394068af0 0x7f03940c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:51.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f0391d9b700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0394068ec0 0x7f0394158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:51.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f0392d9d700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03940b1950 0x7f039406cc70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f039406edb0 tx=0x7f038c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:51.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f038a7fc700 1 -- 172.21.15.31:0/3783503455 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c01a630 con 0x7f03940b1950 2023-10-09T06:22:51.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f038a7fc700 1 -- 172.21.15.31:0/3783503455 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c01a7d0 con 0x7f03940b1950 2023-10-09T06:22:51.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f038a7fc700 1 -- 172.21.15.31:0/3783503455 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c01ab90 con 0x7f03940b1950 2023-10-09T06:22:51.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.085+0000 7f03988d8700 1 -- 172.21.15.31:0/3783503455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03940c8db0 con 0x7f03940b1950 2023-10-09T06:22:51.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.086+0000 7f03988d8700 1 -- 172.21.15.31:0/3783503455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03940c9370 con 0x7f03940b1950 2023-10-09T06:22:51.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.086+0000 7f03988d8700 1 -- 172.21.15.31:0/3783503455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039406b900 con 0x7f03940b1950 2023-10-09T06:22:51.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.087+0000 7f038a7fc700 1 -- 172.21.15.31:0/3783503455 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f038c02d440 con 0x7f03940b1950 2023-10-09T06:22:51.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.087+0000 7f038a7fc700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0374066f30 0x7f03740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:51.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.087+0000 7f038a7fc700 1 -- 172.21.15.31:0/3783503455 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f038c086060 con 0x7f03940b1950 2023-10-09T06:22:51.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.087+0000 7f039259c700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0374066f30 0x7f03740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:51.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.088+0000 7f039259c700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0374066f30 0x7f03740693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0384001560 tx=0x7f0384005c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:51.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.091+0000 7f038a7fc700 1 -- 172.21.15.31:0/3783503455 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f038c0533f0 con 0x7f03940b1950 2023-10-09T06:22:51.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.283+0000 7f03988d8700 1 -- 172.21.15.31:0/3783503455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f039404c3c0 con 0x7f03940b1950 2023-10-09T06:22:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.931+0000 7f038a7fc700 1 -- 172.21.15.31:0/3783503455 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7f038c056a10 con 0x7f03940b1950 2023-10-09T06:22:51.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.934+0000 7f03988d8700 1 -- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0374066f30 msgr2=0x7f03740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:51.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.934+0000 7f03988d8700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0374066f30 0x7f03740693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0384001560 tx=0x7f0384005c90 comp rx=0 tx=0).stop 2023-10-09T06:22:51.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.934+0000 7f03988d8700 1 -- 172.21.15.31:0/3783503455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03940b1950 msgr2=0x7f039406cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:51.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.934+0000 7f03988d8700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03940b1950 0x7f039406cc70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f039406edb0 tx=0x7f038c017000 comp rx=0 tx=0).stop 2023-10-09T06:22:51.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.934+0000 7f03988d8700 1 -- 172.21.15.31:0/3783503455 shutdown_connections 2023-10-09T06:22:51.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.934+0000 7f03988d8700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0374066f30 0x7f03740693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:51.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.934+0000 7f03988d8700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0394068af0 0x7f03940c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:51.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.934+0000 7f03988d8700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03940b1950 0x7f039406cc70 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:51.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.934+0000 7f03988d8700 1 --2- 172.21.15.31:0/3783503455 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0394068ec0 0x7f0394158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:51.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.934+0000 7f03988d8700 1 -- 172.21.15.31:0/3783503455 >> 172.21.15.31:0/3783503455 conn(0x7f0394069870 msgr2=0x7f039415c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:51.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.934+0000 7f03988d8700 1 -- 172.21.15.31:0/3783503455 shutdown_connections 2023-10-09T06:22:51.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:51.934+0000 7f03988d8700 1 -- 172.21.15.31:0/3783503455 wait complete. 2023-10-09T06:22:51.937 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2023-10-09T06:22:51.949 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:22:52.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.073+0000 7f796982c700 1 Processor -- start 2023-10-09T06:22:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.073+0000 7f796982c700 1 -- start start 2023-10-09T06:22:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.074+0000 7f796982c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7964159a90 0x7f7964159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.074+0000 7f796982c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796415a450 0x7f796415a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.074+0000 7f796982c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796415d930 con 0x7f79640cd460 2023-10-09T06:22:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.074+0000 7f796982c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79640cdff0 con 0x7f7964159a90 2023-10-09T06:22:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.074+0000 7f796982c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796415b1c0 con 0x7f796415a450 2023-10-09T06:22:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.074+0000 7f7962ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7964159a90 0x7f7964159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.074+0000 7f79627fc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796415a450 0x7f796415a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:52.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.074+0000 7f79637fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f79640cd460 0x7f79640cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:53266/0 (socket says 172.21.15.31:53266) 2023-10-09T06:22:52.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.074+0000 7f79637fe700 1 -- 172.21.15.31:0/1221027891 learned_addr learned my addr 172.21.15.31:0/1221027891 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:52.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.075+0000 7f7962ffd700 1 -- 172.21.15.31:0/1221027891 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796415a450 msgr2=0x7f796415a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:52.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.075+0000 7f7962ffd700 1 --2- 172.21.15.31:0/1221027891 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796415a450 0x7f796415a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.075+0000 7f7962ffd700 1 -- 172.21.15.31:0/1221027891 >> v1:172.21.15.158:6789/0 conn(0x7f79640cd460 legacy=0x7f79640cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:52.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.075+0000 7f7962ffd700 1 -- 172.21.15.31:0/1221027891 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796415dbd0 con 0x7f7964159a90 2023-10-09T06:22:52.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.075+0000 7f7961ffb700 1 -- 172.21.15.31:0/1221027891 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663124122 0 0) 0x7f796415d930 con 0x7f79640cd460 2023-10-09T06:22:52.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.075+0000 7f7962ffd700 1 --2- 172.21.15.31:0/1221027891 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7964159a90 0x7f7964159e60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7954009e60 tx=0x7f7954009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a95907f782dc2bf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:52.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.075+0000 7f7961ffb700 1 -- 172.21.15.31:0/1221027891 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795400e070 con 0x7f7964159a90 2023-10-09T06:22:52.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.075+0000 7f7961ffb700 1 -- 172.21.15.31:0/1221027891 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795400bb60 con 0x7f7964159a90 2023-10-09T06:22:52.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.075+0000 7f7961ffb700 1 -- 172.21.15.31:0/1221027891 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7954012430 con 0x7f7964159a90 2023-10-09T06:22:52.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.076+0000 7f796982c700 1 -- 172.21.15.31:0/1221027891 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7964159a90 msgr2=0x7f7964159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:52.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.076+0000 7f796982c700 1 --2- 172.21.15.31:0/1221027891 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7964159a90 0x7f7964159e60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7954009e60 tx=0x7f7954009780 comp rx=0 tx=0).stop 2023-10-09T06:22:52.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.076+0000 7f796982c700 1 -- 172.21.15.31:0/1221027891 shutdown_connections 2023-10-09T06:22:52.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.076+0000 7f796982c700 1 --2- 172.21.15.31:0/1221027891 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7964159a90 0x7f7964159e60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.076+0000 7f796982c700 1 --2- 172.21.15.31:0/1221027891 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f796415a450 0x7f796415a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.076+0000 7f796982c700 1 -- 172.21.15.31:0/1221027891 >> 172.21.15.31:0/1221027891 conn(0x7f7964067660 msgr2=0x7f7964067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:52.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.076+0000 7f796982c700 1 -- 172.21.15.31:0/1221027891 shutdown_connections 2023-10-09T06:22:52.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.076+0000 7f796982c700 1 -- 172.21.15.31:0/1221027891 wait complete. 2023-10-09T06:22:52.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.077+0000 7f796982c700 1 Processor -- start 2023-10-09T06:22:52.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.077+0000 7f796982c700 1 -- start start 2023-10-09T06:22:52.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f796982c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79640cd460 0x7f79640d0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:52.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f796982c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7964159a90 0x7f79640c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:52.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f796982c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f796415a450 0x7f7964155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:52.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f796982c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79640d1550 con 0x7f7964159a90 2023-10-09T06:22:52.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f796982c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79640c8b20 con 0x7f796415a450 2023-10-09T06:22:52.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f796982c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79640d0f90 con 0x7f79640cd460 2023-10-09T06:22:52.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f79627fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7964159a90 0x7f79640c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:52.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f79627fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7964159a90 0x7f79640c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49868/0 (socket says 172.21.15.31:49868) 2023-10-09T06:22:52.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f79627fc700 1 -- 172.21.15.31:0/2502479295 learned_addr learned my addr 172.21.15.31:0/2502479295 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:52.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f7962ffd700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79640cd460 0x7f79640d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:52.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f79637fe700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f796415a450 0x7f7964155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:52.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f79627fc700 1 -- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79640cd460 msgr2=0x7f79640d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f79627fc700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79640cd460 0x7f79640d0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f79627fc700 1 -- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f796415a450 msgr2=0x7f7964155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f79627fc700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f796415a450 0x7f7964155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f79627fc700 1 -- 172.21.15.31:0/2502479295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954009a20 con 0x7f7964159a90 2023-10-09T06:22:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f7962ffd700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79640cd460 0x7f79640d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f79637fe700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f796415a450 0x7f7964155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:22:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f79627fc700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7964159a90 0x7f79640c85e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f794c00e930 tx=0x7f794c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.078+0000 7f795affd700 1 -- 172.21.15.31:0/2502479295 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c009510 con 0x7f7964159a90 2023-10-09T06:22:52.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.079+0000 7f795affd700 1 -- 172.21.15.31:0/2502479295 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c00c850 con 0x7f7964159a90 2023-10-09T06:22:52.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.079+0000 7f795affd700 1 -- 172.21.15.31:0/2502479295 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c00cc10 con 0x7f7964159a90 2023-10-09T06:22:52.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.079+0000 7f796982c700 1 -- 172.21.15.31:0/2502479295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79640d1270 con 0x7f7964159a90 2023-10-09T06:22:52.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.079+0000 7f796982c700 1 -- 172.21.15.31:0/2502479295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796415cce0 con 0x7f7964159a90 2023-10-09T06:22:52.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.080+0000 7f796982c700 1 -- 172.21.15.31:0/2502479295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796415cf00 con 0x7f7964159a90 2023-10-09T06:22:52.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.080+0000 7f795affd700 1 -- 172.21.15.31:0/2502479295 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f794c013470 con 0x7f7964159a90 2023-10-09T06:22:52.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.080+0000 7f795affd700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7944066f30 0x7f79440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:52.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.080+0000 7f795affd700 1 -- 172.21.15.31:0/2502479295 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f794c084370 con 0x7f7964159a90 2023-10-09T06:22:52.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.080+0000 7f7962ffd700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7944066f30 0x7f79440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:52.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.081+0000 7f7962ffd700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7944066f30 0x7f79440693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f79540097c0 tx=0x7f7954019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:52.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.085+0000 7f795affd700 1 -- 172.21.15.31:0/2502479295 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f794c0518e0 con 0x7f7964159a90 2023-10-09T06:22:52.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.283+0000 7f796982c700 1 -- 172.21.15.31:0/2502479295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f796415deb0 con 0x7f7964159a90 2023-10-09T06:22:52.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.286+0000 7f795affd700 1 -- 172.21.15.31:0/2502479295 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f794c054f00 con 0x7f7964159a90 2023-10-09T06:22:52.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.288+0000 7f796982c700 1 -- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7944066f30 msgr2=0x7f79440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:52.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.288+0000 7f796982c700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7944066f30 0x7f79440693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f79540097c0 tx=0x7f7954019000 comp rx=0 tx=0).stop 2023-10-09T06:22:52.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.288+0000 7f796982c700 1 -- 172.21.15.31:0/2502479295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7964159a90 msgr2=0x7f79640c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:52.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.288+0000 7f796982c700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7964159a90 0x7f79640c85e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f794c00e930 tx=0x7f794c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.288+0000 7f796982c700 1 -- 172.21.15.31:0/2502479295 shutdown_connections 2023-10-09T06:22:52.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.288+0000 7f796982c700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7944066f30 0x7f79440693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.288+0000 7f796982c700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79640cd460 0x7f79640d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.288+0000 7f796982c700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f796415a450 0x7f7964155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.288+0000 7f796982c700 1 --2- 172.21.15.31:0/2502479295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7964159a90 0x7f79640c85e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.288+0000 7f796982c700 1 -- 172.21.15.31:0/2502479295 >> 172.21.15.31:0/2502479295 conn(0x7f7964067660 msgr2=0x7f79640b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.288+0000 7f796982c700 1 -- 172.21.15.31:0/2502479295 shutdown_connections 2023-10-09T06:22:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.288+0000 7f796982c700 1 -- 172.21.15.31:0/2502479295 wait complete. 2023-10-09T06:22:52.301 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-09T06:22:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.425+0000 7f8b8d3d9700 1 Processor -- start 2023-10-09T06:22:52.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.425+0000 7f8b8d3d9700 1 -- start start 2023-10-09T06:22:52.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.426+0000 7f8b8d3d9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8b88157a90 0x7f8b880b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:52.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.426+0000 7f8b8d3d9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8b8806fef0 0x7f8b880ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:52.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.426+0000 7f8b8d3d9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b880cb0b0 con 0x7f8b88157e60 2023-10-09T06:22:52.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.426+0000 7f8b8d3d9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b880b0ad0 con 0x7f8b8806fef0 2023-10-09T06:22:52.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.426+0000 7f8b8d3d9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b880b4970 con 0x7f8b88157a90 2023-10-09T06:22:52.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.427+0000 7f8b8cbd8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8b8806fef0 0x7f8b880ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:52.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.427+0000 7f8b8cbd8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8b8806fef0 0x7f8b880ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:44250/0 (socket says 172.21.15.31:44250) 2023-10-09T06:22:52.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.427+0000 7f8b8cbd8700 1 -- 172.21.15.31:0/408307101 learned_addr learned my addr 172.21.15.31:0/408307101 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:52.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.427+0000 7f8b877fe700 1 --1- 172.21.15.31:0/408307101 >> v1:172.21.15.158:6789/0 conn(0x7f8b88157e60 0x7f8b880b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:53276/0 (socket says 172.21.15.31:53276) 2023-10-09T06:22:52.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.427+0000 7f8b87fff700 1 --2- 172.21.15.31:0/408307101 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8b88157a90 0x7f8b880b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:52.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.427+0000 7f8b8cbd8700 1 -- 172.21.15.31:0/408307101 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8b88157a90 msgr2=0x7f8b880b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:52.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.427+0000 7f8b8cbd8700 1 --2- 172.21.15.31:0/408307101 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8b88157a90 0x7f8b880b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.427+0000 7f8b8cbd8700 1 -- 172.21.15.31:0/408307101 >> v1:172.21.15.158:6789/0 conn(0x7f8b88157e60 legacy=0x7f8b880b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:52.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.427+0000 7f8b8cbd8700 1 -- 172.21.15.31:0/408307101 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b880b0830 con 0x7f8b8806fef0 2023-10-09T06:22:52.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.427+0000 7f8b8cbd8700 1 --2- 172.21.15.31:0/408307101 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8806fef0 0x7f8b880ce950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009f20 tx=0x7f8b80009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59217b5e65d066d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:52.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.427+0000 7f8b86ffd700 1 -- 172.21.15.31:0/408307101 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8000e070 con 0x7f8b8806fef0 2023-10-09T06:22:52.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.427+0000 7f8b86ffd700 1 -- 172.21.15.31:0/408307101 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8000b9d0 con 0x7f8b8806fef0 2023-10-09T06:22:52.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.427+0000 7f8b86ffd700 1 -- 172.21.15.31:0/408307101 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b800092e0 con 0x7f8b8806fef0 2023-10-09T06:22:52.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.428+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/408307101 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8806fef0 msgr2=0x7f8b880ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:52.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.428+0000 7f8b8d3d9700 1 --2- 172.21.15.31:0/408307101 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8806fef0 0x7f8b880ce950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009f20 tx=0x7f8b80009840 comp rx=0 tx=0).stop 2023-10-09T06:22:52.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.428+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/408307101 shutdown_connections 2023-10-09T06:22:52.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.428+0000 7f8b8d3d9700 1 --2- 172.21.15.31:0/408307101 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8806fef0 0x7f8b880ce950 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.428+0000 7f8b8d3d9700 1 --2- 172.21.15.31:0/408307101 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8b88157a90 0x7f8b880b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.428+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/408307101 >> 172.21.15.31:0/408307101 conn(0x7f8b8806bc70 msgr2=0x7f8b8806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:52.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.428+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/408307101 shutdown_connections 2023-10-09T06:22:52.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.428+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/408307101 wait complete. 2023-10-09T06:22:52.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.429+0000 7f8b8d3d9700 1 Processor -- start 2023-10-09T06:22:52.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.429+0000 7f8b8d3d9700 1 -- start start 2023-10-09T06:22:52.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.430+0000 7f8b8d3d9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8806fef0 0x7f8b881680f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:52.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.430+0000 7f8b8d3d9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b88157a90 0x7f8b8814ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:52.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.430+0000 7f8b8d3d9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8b88157e60 0x7f8b880b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:52.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.430+0000 7f8b8d3d9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b88168630 con 0x7f8b88157a90 2023-10-09T06:22:52.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.430+0000 7f8b8d3d9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b881504a0 con 0x7f8b8806fef0 2023-10-09T06:22:52.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.430+0000 7f8b8d3d9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8815b280 con 0x7f8b88157e60 2023-10-09T06:22:52.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.430+0000 7f8b877fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b88157a90 0x7f8b8814ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:52.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.430+0000 7f8b877fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b88157a90 0x7f8b8814ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49872/0 (socket says 172.21.15.31:49872) 2023-10-09T06:22:52.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.430+0000 7f8b877fe700 1 -- 172.21.15.31:0/2778771763 learned_addr learned my addr 172.21.15.31:0/2778771763 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:52.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.430+0000 7f8b87fff700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8806fef0 0x7f8b881680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:52.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.430+0000 7f8b8cbd8700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8b88157e60 0x7f8b880b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:52.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.431+0000 7f8b877fe700 1 -- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8b88157e60 msgr2=0x7f8b880b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:52.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.431+0000 7f8b877fe700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8b88157e60 0x7f8b880b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.431+0000 7f8b877fe700 1 -- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8806fef0 msgr2=0x7f8b881680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:52.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.431+0000 7f8b877fe700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8806fef0 0x7f8b881680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.431+0000 7f8b877fe700 1 -- 172.21.15.31:0/2778771763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b80009ae0 con 0x7f8b88157a90 2023-10-09T06:22:52.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.431+0000 7f8b877fe700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b88157a90 0x7f8b8814ff60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000c560 tx=0x7f8b70007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:52.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.431+0000 7f8b7ffff700 1 -- 172.21.15.31:0/2778771763 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70005a70 con 0x7f8b88157a90 2023-10-09T06:22:52.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.431+0000 7f8b7ffff700 1 -- 172.21.15.31:0/2778771763 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b70005bd0 con 0x7f8b88157a90 2023-10-09T06:22:52.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.431+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/2778771763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8815b6f0 con 0x7f8b88157a90 2023-10-09T06:22:52.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.431+0000 7f8b7ffff700 1 -- 172.21.15.31:0/2778771763 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b700070d0 con 0x7f8b88157a90 2023-10-09T06:22:52.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.431+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/2778771763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8815bcb0 con 0x7f8b88157a90 2023-10-09T06:22:52.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.432+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/2778771763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8806e3e0 con 0x7f8b88157a90 2023-10-09T06:22:52.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.432+0000 7f8b7ffff700 1 -- 172.21.15.31:0/2778771763 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b70007480 con 0x7f8b88157a90 2023-10-09T06:22:52.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.433+0000 7f8b7ffff700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8b68066f30 0x7f8b680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:52.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.433+0000 7f8b7ffff700 1 -- 172.21.15.31:0/2778771763 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8b700835d0 con 0x7f8b88157a90 2023-10-09T06:22:52.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.433+0000 7f8b87fff700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8b68066f30 0x7f8b680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:52.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.433+0000 7f8b87fff700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8b68066f30 0x7f8b680693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8b88156080 tx=0x7f8b780091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:52.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.437+0000 7f8b7ffff700 1 -- 172.21.15.31:0/2778771763 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b70050b40 con 0x7f8b88157a90 2023-10-09T06:22:52.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.710+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/2778771763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f8b880ca780 con 0x7f8b88157a90 2023-10-09T06:22:52.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.932+0000 7f8b7ffff700 1 -- 172.21.15.31:0/2778771763 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v130) v1 ==== 142+0+0 (secure 0 0 0) 0x7f8b70017020 con 0x7f8b88157a90 2023-10-09T06:22:52.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.934+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8b68066f30 msgr2=0x7f8b680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:52.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.934+0000 7f8b8d3d9700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8b68066f30 0x7f8b680693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8b88156080 tx=0x7f8b780091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.934+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/2778771763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b88157a90 msgr2=0x7f8b8814ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:52.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.934+0000 7f8b8d3d9700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b88157a90 0x7f8b8814ff60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000c560 tx=0x7f8b70007f70 comp rx=0 tx=0).stop 2023-10-09T06:22:52.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.934+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/2778771763 shutdown_connections 2023-10-09T06:22:52.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.934+0000 7f8b8d3d9700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8b68066f30 0x7f8b680693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.934+0000 7f8b8d3d9700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8b88157e60 0x7f8b880b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.934+0000 7f8b8d3d9700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8806fef0 0x7f8b881680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.934+0000 7f8b8d3d9700 1 --2- 172.21.15.31:0/2778771763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b88157a90 0x7f8b8814ff60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:52.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.934+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/2778771763 >> 172.21.15.31:0/2778771763 conn(0x7f8b8806bc70 msgr2=0x7f8b88156120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:52.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.935+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/2778771763 shutdown_connections 2023-10-09T06:22:52.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:52.935+0000 7f8b8d3d9700 1 -- 172.21.15.31:0/2778771763 wait complete. 2023-10-09T06:22:52.948 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-09T06:22:52.948 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-10-09T06:22:52.948 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-09T06:22:53.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.072+0000 7fa743cd2700 1 Processor -- start 2023-10-09T06:22:53.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.073+0000 7fa743cd2700 1 -- start start 2023-10-09T06:22:53.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.073+0000 7fa743cd2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa73c15a2b0 0x7fa73c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:53.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.073+0000 7fa743cd2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa73c0d1c30 0x7fa73c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:53.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.073+0000 7fa743cd2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa73c15a680 0x7fa73c0cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:53.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.073+0000 7fa743cd2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c068470 con 0x7fa73c15a680 2023-10-09T06:22:53.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.073+0000 7fa743cd2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0c5d80 con 0x7fa73c15a2b0 2023-10-09T06:22:53.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.073+0000 7fa743cd2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0c6060 con 0x7fa73c0d1c30 2023-10-09T06:22:53.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa74226f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa73c15a680 0x7fa73c0cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:53.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa74226f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa73c15a680 0x7fa73c0cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49878/0 (socket says 172.21.15.31:49878) 2023-10-09T06:22:53.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa74226f700 1 -- 172.21.15.31:0/3305160283 learned_addr learned my addr 172.21.15.31:0/3305160283 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:53.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa74126d700 1 --2- 172.21.15.31:0/3305160283 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa73c0d1c30 0x7fa73c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:53.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa741a6e700 1 --2- 172.21.15.31:0/3305160283 >> v2:172.21.15.158:3300/0 conn(0x7fa73c15a2b0 0x7fa73c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:53.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa74226f700 1 -- 172.21.15.31:0/3305160283 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa73c0d1c30 msgr2=0x7fa73c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:53.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa74226f700 1 --2- 172.21.15.31:0/3305160283 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa73c0d1c30 0x7fa73c0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:53.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa74226f700 1 -- 172.21.15.31:0/3305160283 >> v2:172.21.15.158:3300/0 conn(0x7fa73c15a2b0 msgr2=0x7fa73c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:53.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa74226f700 1 --2- 172.21.15.31:0/3305160283 >> v2:172.21.15.158:3300/0 conn(0x7fa73c15a2b0 0x7fa73c0b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:53.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa74226f700 1 -- 172.21.15.31:0/3305160283 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0c6340 con 0x7fa73c15a680 2023-10-09T06:22:53.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa74226f700 1 --2- 172.21.15.31:0/3305160283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa73c15a680 0x7fa73c0cfc50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa73c089220 tx=0x7fa72c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d973f112afe3d809 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:53.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa740a6c700 1 -- 172.21.15.31:0/3305160283 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00e070 con 0x7fa73c15a680 2023-10-09T06:22:53.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa740a6c700 1 -- 172.21.15.31:0/3305160283 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c00b970 con 0x7fa73c15a680 2023-10-09T06:22:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.074+0000 7fa740a6c700 1 -- 172.21.15.31:0/3305160283 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0092e0 con 0x7fa73c15a680 2023-10-09T06:22:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.075+0000 7fa743cd2700 1 -- 172.21.15.31:0/3305160283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa73c15a680 msgr2=0x7fa73c0cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.075+0000 7fa743cd2700 1 --2- 172.21.15.31:0/3305160283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa73c15a680 0x7fa73c0cfc50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa73c089220 tx=0x7fa72c009840 comp rx=0 tx=0).stop 2023-10-09T06:22:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.075+0000 7fa743cd2700 1 -- 172.21.15.31:0/3305160283 shutdown_connections 2023-10-09T06:22:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.075+0000 7fa743cd2700 1 --2- 172.21.15.31:0/3305160283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa73c15a680 0x7fa73c0cfc50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.075+0000 7fa743cd2700 1 --2- 172.21.15.31:0/3305160283 >> v2:172.21.15.158:3300/0 conn(0x7fa73c15a2b0 0x7fa73c0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.075+0000 7fa743cd2700 1 --2- 172.21.15.31:0/3305160283 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa73c0d1c30 0x7fa73c0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.075+0000 7fa743cd2700 1 -- 172.21.15.31:0/3305160283 >> 172.21.15.31:0/3305160283 conn(0x7fa73c067e40 msgr2=0x7fa73c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.075+0000 7fa743cd2700 1 -- 172.21.15.31:0/3305160283 shutdown_connections 2023-10-09T06:22:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.075+0000 7fa743cd2700 1 -- 172.21.15.31:0/3305160283 wait complete. 2023-10-09T06:22:53.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.076+0000 7fa743cd2700 1 Processor -- start 2023-10-09T06:22:53.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.076+0000 7fa743cd2700 1 -- start start 2023-10-09T06:22:53.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa743cd2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa73c0d1c30 0x7fa73c15d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:53.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa743cd2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa73c15a2b0 0x7fa73c0c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:53.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa743cd2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa73c15a680 0x7fa73c0c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:53.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa743cd2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0c9480 con 0x7fa73c15a680 2023-10-09T06:22:53.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa743cd2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0c85d0 con 0x7fa73c0d1c30 2023-10-09T06:22:53.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa743cd2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0c8870 con 0x7fa73c15a2b0 2023-10-09T06:22:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa74226f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa73c15a680 0x7fa73c0c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa74226f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa73c15a680 0x7fa73c0c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49880/0 (socket says 172.21.15.31:49880) 2023-10-09T06:22:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa74226f700 1 -- 172.21.15.31:0/3393092245 learned_addr learned my addr 172.21.15.31:0/3393092245 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa74126d700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa73c15a2b0 0x7fa73c0c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa741a6e700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa73c0d1c30 0x7fa73c15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa74226f700 1 -- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa73c15a2b0 msgr2=0x7fa73c0c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa74226f700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa73c15a2b0 0x7fa73c0c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa74226f700 1 -- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa73c0d1c30 msgr2=0x7fa73c15d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa74226f700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa73c0d1c30 0x7fa73c15d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa74226f700 1 -- 172.21.15.31:0/3393092245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c009ae0 con 0x7fa73c15a680 2023-10-09T06:22:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa74126d700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa73c15a2b0 0x7fa73c0c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:22:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa74226f700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa73c15a680 0x7fa73c0c9910 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa73c089120 tx=0x7fa72c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa739ffb700 1 -- 172.21.15.31:0/3393092245 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c008b80 con 0x7fa73c15a680 2023-10-09T06:22:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa739ffb700 1 -- 172.21.15.31:0/3393092245 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c008ce0 con 0x7fa73c15a680 2023-10-09T06:22:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa739ffb700 1 -- 172.21.15.31:0/3393092245 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c01c660 con 0x7fa73c15a680 2023-10-09T06:22:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.077+0000 7fa743cd2700 1 -- 172.21.15.31:0/3393092245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c0c8b50 con 0x7fa73c15a680 2023-10-09T06:22:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.078+0000 7fa743cd2700 1 -- 172.21.15.31:0/3393092245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c0c9110 con 0x7fa73c15a680 2023-10-09T06:22:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.079+0000 7fa743cd2700 1 -- 172.21.15.31:0/3393092245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c0c9630 con 0x7fa73c15a680 2023-10-09T06:22:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.079+0000 7fa739ffb700 1 -- 172.21.15.31:0/3393092245 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa72c003040 con 0x7fa73c15a680 2023-10-09T06:22:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.079+0000 7fa739ffb700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa728066f30 0x7fa7280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.079+0000 7fa739ffb700 1 -- 172.21.15.31:0/3393092245 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa72c085a00 con 0x7fa73c15a680 2023-10-09T06:22:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.080+0000 7fa741a6e700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa728066f30 0x7fa7280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.080+0000 7fa741a6e700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa728066f30 0x7fa7280693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa734009390 tx=0x7fa734008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.084+0000 7fa739ffb700 1 -- 172.21.15.31:0/3393092245 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa73c0c9630 con 0x7fa73c15a680 2023-10-09T06:22:53.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.355+0000 7fa743cd2700 1 -- 172.21.15.31:0/3393092245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7fa73c04c3c0 con 0x7fa73c15a680 2023-10-09T06:22:53.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.936+0000 7fa739ffb700 1 -- 172.21.15.31:0/3393092245 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v131) v1 ==== 137+0+0 (secure 0 0 0) 0x7fa72c052f70 con 0x7fa73c15a680 2023-10-09T06:22:53.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.938+0000 7fa743cd2700 1 -- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa728066f30 msgr2=0x7fa7280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:53.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.938+0000 7fa743cd2700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa728066f30 0x7fa7280693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa734009390 tx=0x7fa734008040 comp rx=0 tx=0).stop 2023-10-09T06:22:53.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.938+0000 7fa743cd2700 1 -- 172.21.15.31:0/3393092245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa73c15a680 msgr2=0x7fa73c0c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:53.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.938+0000 7fa743cd2700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa73c15a680 0x7fa73c0c9910 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa73c089120 tx=0x7fa72c018000 comp rx=0 tx=0).stop 2023-10-09T06:22:53.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.938+0000 7fa743cd2700 1 -- 172.21.15.31:0/3393092245 shutdown_connections 2023-10-09T06:22:53.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.938+0000 7fa743cd2700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa728066f30 0x7fa7280693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:53.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.938+0000 7fa743cd2700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa73c15a680 0x7fa73c0c9910 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:53.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.938+0000 7fa743cd2700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa73c0d1c30 0x7fa73c15d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:53.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.938+0000 7fa743cd2700 1 --2- 172.21.15.31:0/3393092245 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa73c15a2b0 0x7fa73c0c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:53.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.938+0000 7fa743cd2700 1 -- 172.21.15.31:0/3393092245 >> 172.21.15.31:0/3393092245 conn(0x7fa73c067e40 msgr2=0x7fa73c0b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:53.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.938+0000 7fa743cd2700 1 -- 172.21.15.31:0/3393092245 shutdown_connections 2023-10-09T06:22:53.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:53.938+0000 7fa743cd2700 1 -- 172.21.15.31:0/3393092245 wait complete. 2023-10-09T06:22:53.951 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-09T06:22:54.087 INFO:teuthology.orchestra.run.smithi031.stdout:{"osd_objectstore":"memstore"} 2023-10-09T06:22:54.087 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-09T06:22:54.087 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:22:54.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.208+0000 7fec184e8700 1 Processor -- start 2023-10-09T06:22:54.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.208+0000 7fec184e8700 1 -- start start 2023-10-09T06:22:54.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.209+0000 7fec184e8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec1015a290 0x7fec1006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.209+0000 7fec184e8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec100b0790 con 0x7fec1006aae0 2023-10-09T06:22:54.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.209+0000 7fec184e8700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec100ce1f0 con 0x7fec10159ec0 2023-10-09T06:22:54.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.209+0000 7fec184e8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1006af60 con 0x7fec1015a290 2023-10-09T06:22:54.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.209+0000 7fec16a85700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fec1006aae0 0x7fec100cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60250/0 (socket says 172.21.15.31:60250) 2023-10-09T06:22:54.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.209+0000 7fec16a85700 1 -- 172.21.15.31:0/151681816 learned_addr learned my addr 172.21.15.31:0/151681816 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:54.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15a83700 1 --2- 172.21.15.31:0/151681816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec1015a290 0x7fec1006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635619807 0 0) 0x7fec100b0790 con 0x7fec1006aae0 2023-10-09T06:22:54.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febf8003570 con 0x7fec1006aae0 2023-10-09T06:22:54.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1950889001 0 0) 0x7febf8003570 con 0x7fec1006aae0 2023-10-09T06:22:54.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec1015a290 msgr2=0x7fec1006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:54.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 --2- 172.21.15.31:0/151681816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec1015a290 0x7fec1006a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 >> v1:172.21.15.158:6789/0 conn(0x7fec10159ec0 legacy=0x7fec100af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:54.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100b0b20 con 0x7fec1006aae0 2023-10-09T06:22:54.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fec08001470 con 0x7fec1006aae0 2023-10-09T06:22:54.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 >> v1:172.21.15.31:6789/0 conn(0x7fec1006aae0 legacy=0x7fec100cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:54.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 --2- 172.21.15.31:0/151681816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec1015a290 0x7febf8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 --2- 172.21.15.31:0/151681816 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febf8004010 0x7febf8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 --2- 172.21.15.31:0/151681816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febf8004d50 0x7febf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1006af60 con 0x7febf8004d50 2023-10-09T06:22:54.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf800bbf0 con 0x7febf8004010 2023-10-09T06:22:54.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf800bdb0 con 0x7fec1015a290 2023-10-09T06:22:54.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec16a85700 1 --2- 172.21.15.31:0/151681816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febf8004d50 0x7febf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec15a83700 1 --2- 172.21.15.31:0/151681816 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febf8004010 0x7febf8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.210+0000 7fec16284700 1 --2- 172.21.15.31:0/151681816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec1015a290 0x7febf8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec16a85700 1 -- 172.21.15.31:0/151681816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec1015a290 msgr2=0x7febf8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:54.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec16a85700 1 --2- 172.21.15.31:0/151681816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec1015a290 0x7febf8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec16a85700 1 -- 172.21.15.31:0/151681816 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febf8004010 msgr2=0x7febf8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:54.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec16a85700 1 --2- 172.21.15.31:0/151681816 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febf8004010 0x7febf8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec16a85700 1 -- 172.21.15.31:0/151681816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf8003570 con 0x7febf8004d50 2023-10-09T06:22:54.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec16a85700 1 --2- 172.21.15.31:0/151681816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febf8004d50 0x7febf80051c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fec0800c390 tx=0x7fec08001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2287f4348d441b65 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:54.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800cc60 con 0x7febf8004d50 2023-10-09T06:22:54.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0800cdc0 con 0x7febf8004d50 2023-10-09T06:22:54.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec15282700 1 -- 172.21.15.31:0/151681816 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08005b70 con 0x7febf8004d50 2023-10-09T06:22:54.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec184e8700 1 -- 172.21.15.31:0/151681816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febf8004d50 msgr2=0x7febf80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:54.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec184e8700 1 --2- 172.21.15.31:0/151681816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febf8004d50 0x7febf80051c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fec0800c390 tx=0x7fec08001e50 comp rx=0 tx=0).stop 2023-10-09T06:22:54.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec16a85700 1 -- 172.21.15.31:0/151681816 reap_dead start 2023-10-09T06:22:54.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec184e8700 1 -- 172.21.15.31:0/151681816 shutdown_connections 2023-10-09T06:22:54.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec184e8700 1 -- 172.21.15.31:0/151681816 >> 172.21.15.31:0/151681816 conn(0x7fec100d1880 msgr2=0x7fec100cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:54.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.211+0000 7fec184e8700 1 -- 172.21.15.31:0/151681816 shutdown_connections 2023-10-09T06:22:54.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.212+0000 7fec184e8700 1 -- 172.21.15.31:0/151681816 wait complete. 2023-10-09T06:22:54.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.213+0000 7fec184e8700 1 Processor -- start 2023-10-09T06:22:54.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.213+0000 7fec184e8700 1 -- start start 2023-10-09T06:22:54.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.213+0000 7fec184e8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febf8004d50 0x7fec1015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.213+0000 7fec184e8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec100c7e60 0x7fec1015b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.213+0000 7fec184e8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec1015bb70 0x7fec1015bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.213+0000 7fec184e8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1015d000 con 0x7febf8004d50 2023-10-09T06:22:54.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.213+0000 7fec184e8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec10156820 con 0x7fec1015bb70 2023-10-09T06:22:54.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.213+0000 7fec184e8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1016a5a0 con 0x7fec100c7e60 2023-10-09T06:22:54.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.213+0000 7fec16284700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febf8004d50 0x7fec1015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.213+0000 7fec16284700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febf8004d50 0x7fec1015cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49896/0 (socket says 172.21.15.31:49896) 2023-10-09T06:22:54.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.213+0000 7fec16284700 1 -- 172.21.15.31:0/22433683 learned_addr learned my addr 172.21.15.31:0/22433683 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:54.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.213+0000 7fec16a85700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec1015bb70 0x7fec1015bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.213+0000 7fec15a83700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec100c7e60 0x7fec1015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.214+0000 7fec16284700 1 -- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec100c7e60 msgr2=0x7fec1015b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:54.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.214+0000 7fec16284700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec100c7e60 0x7fec1015b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.214+0000 7fec16284700 1 -- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec1015bb70 msgr2=0x7fec1015bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:54.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.214+0000 7fec16284700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec1015bb70 0x7fec1015bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.214+0000 7fec16284700 1 -- 172.21.15.31:0/22433683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec101594e0 con 0x7febf8004d50 2023-10-09T06:22:54.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.214+0000 7fec16284700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febf8004d50 0x7fec1015cac0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fec0000eb10 tx=0x7fec00001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:54.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.214+0000 7fec0e7fc700 1 -- 172.21.15.31:0/22433683 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000c7e0 con 0x7febf8004d50 2023-10-09T06:22:54.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.214+0000 7fec0e7fc700 1 -- 172.21.15.31:0/22433683 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0000c940 con 0x7febf8004d50 2023-10-09T06:22:54.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.214+0000 7fec0e7fc700 1 -- 172.21.15.31:0/22433683 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000cd00 con 0x7febf8004d50 2023-10-09T06:22:54.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.214+0000 7fec184e8700 1 -- 172.21.15.31:0/22433683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec100cace0 con 0x7febf8004d50 2023-10-09T06:22:54.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.214+0000 7fec184e8700 1 -- 172.21.15.31:0/22433683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec10156a70 con 0x7febf8004d50 2023-10-09T06:22:54.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.215+0000 7fec184e8700 1 -- 172.21.15.31:0/22433683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1004c3c0 con 0x7febf8004d50 2023-10-09T06:22:54.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.215+0000 7fec0e7fc700 1 -- 172.21.15.31:0/22433683 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec00013630 con 0x7febf8004d50 2023-10-09T06:22:54.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.216+0000 7fec0e7fc700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7febfc066f30 0x7febfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.216+0000 7fec0e7fc700 1 -- 172.21.15.31:0/22433683 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fec00084660 con 0x7febf8004d50 2023-10-09T06:22:54.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.216+0000 7fec15a83700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7febfc066f30 0x7febfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.216+0000 7fec15a83700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7febfc066f30 0x7febfc0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fec10156790 tx=0x7fec040091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:54.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.220+0000 7fec0e7fc700 1 -- 172.21.15.31:0/22433683 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec00051c50 con 0x7febf8004d50 2023-10-09T06:22:54.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.417+0000 7fec184e8700 1 -- 172.21.15.31:0/22433683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fec100b04b0 con 0x7febf8004d50 2023-10-09T06:22:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.421+0000 7fec0e7fc700 1 -- 172.21.15.31:0/22433683 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fec0000ce60 con 0x7febf8004d50 2023-10-09T06:22:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.423+0000 7fec184e8700 1 -- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7febfc066f30 msgr2=0x7febfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.423+0000 7fec184e8700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7febfc066f30 0x7febfc0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fec10156790 tx=0x7fec040091a0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.423+0000 7fec184e8700 1 -- 172.21.15.31:0/22433683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febf8004d50 msgr2=0x7fec1015cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.423+0000 7fec184e8700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febf8004d50 0x7fec1015cac0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fec0000eb10 tx=0x7fec00001640 comp rx=0 tx=0).stop 2023-10-09T06:22:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.423+0000 7fec184e8700 1 -- 172.21.15.31:0/22433683 shutdown_connections 2023-10-09T06:22:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.423+0000 7fec184e8700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7febfc066f30 0x7febfc0693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.423+0000 7fec184e8700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec1015bb70 0x7fec1015bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.423+0000 7fec184e8700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febf8004d50 0x7fec1015cac0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.423+0000 7fec184e8700 1 --2- 172.21.15.31:0/22433683 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec100c7e60 0x7fec1015b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.423+0000 7fec184e8700 1 -- 172.21.15.31:0/22433683 >> 172.21.15.31:0/22433683 conn(0x7fec100d1880 msgr2=0x7fec10155860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:54.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.424+0000 7fec184e8700 1 -- 172.21.15.31:0/22433683 shutdown_connections 2023-10-09T06:22:54.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.424+0000 7fec184e8700 1 -- 172.21.15.31:0/22433683 wait complete. 2023-10-09T06:22:54.436 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:22:54.436 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:22:54.472 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:22:54.516 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:22:54.516 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:22:54.516 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:22:54.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.634+0000 7fea01699700 1 Processor -- start 2023-10-09T06:22:54.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.634+0000 7fea01699700 1 -- start start 2023-10-09T06:22:54.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.635+0000 7fea01699700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9fc0cdab0 0x7fe9fc15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.635+0000 7fea01699700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe9fc15dda0 0x7fe9fc15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.635+0000 7fea01699700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc0cb7c0 con 0x7fe9fc0cd6e0 2023-10-09T06:22:54.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.635+0000 7fea01699700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc15e850 con 0x7fe9fc15dda0 2023-10-09T06:22:54.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.635+0000 7fea01699700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0cc360 con 0x7fe9fc0cdab0 2023-10-09T06:22:54.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.635+0000 7fe9fb7fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9fc0cdab0 0x7fe9fc15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.635+0000 7fea00e98700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe9fc15dda0 0x7fe9fc15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.635+0000 7fe9fbfff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fe9fc0cd6e0 0x7fe9fc0cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:53288/0 (socket says 172.21.15.31:53288) 2023-10-09T06:22:54.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.635+0000 7fe9fbfff700 1 -- 172.21.15.31:0/993133126 learned_addr learned my addr 172.21.15.31:0/993133126 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:22:54.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.636+0000 7fe9faffd700 1 -- 172.21.15.31:0/993133126 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482841263 0 0) 0x7fe9fc0cb7c0 con 0x7fe9fc0cd6e0 2023-10-09T06:22:54.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.636+0000 7fe9faffd700 1 -- 172.21.15.31:0/993133126 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e8003570 con 0x7fe9fc0cd6e0 2023-10-09T06:22:54.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.636+0000 7fea00e98700 1 -- 172.21.15.31:0/993133126 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9fc0cdab0 msgr2=0x7fe9fc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:22:54.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.636+0000 7fea00e98700 1 --2- 172.21.15.31:0/993133126 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9fc0cdab0 0x7fe9fc15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.636+0000 7fea00e98700 1 -- 172.21.15.31:0/993133126 >> v1:172.21.15.158:6789/0 conn(0x7fe9fc0cd6e0 legacy=0x7fe9fc0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:54.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.636+0000 7fea00e98700 1 -- 172.21.15.31:0/993133126 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc15e290 con 0x7fe9fc15dda0 2023-10-09T06:22:54.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.636+0000 7fe9fb7fe700 1 --2- 172.21.15.31:0/993133126 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9fc0cdab0 0x7fe9fc15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:22:54.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.636+0000 7fea00e98700 1 --2- 172.21.15.31:0/993133126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9fc15dda0 0x7fe9fc15cbd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009e60 tx=0x7fe9f4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab172fe9d23b12ae server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:54.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.636+0000 7fe9faffd700 1 -- 172.21.15.31:0/993133126 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f400e070 con 0x7fe9fc15dda0 2023-10-09T06:22:54.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.636+0000 7fe9faffd700 1 -- 172.21.15.31:0/993133126 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f400bab0 con 0x7fe9fc15dda0 2023-10-09T06:22:54.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.636+0000 7fe9faffd700 1 -- 172.21.15.31:0/993133126 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f400be70 con 0x7fe9fc15dda0 2023-10-09T06:22:54.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.637+0000 7fea01699700 1 -- 172.21.15.31:0/993133126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9fc15dda0 msgr2=0x7fe9fc15cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:54.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.637+0000 7fea01699700 1 --2- 172.21.15.31:0/993133126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9fc15dda0 0x7fe9fc15cbd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009e60 tx=0x7fe9f4009780 comp rx=0 tx=0).stop 2023-10-09T06:22:54.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.637+0000 7fea01699700 1 -- 172.21.15.31:0/993133126 shutdown_connections 2023-10-09T06:22:54.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.637+0000 7fea01699700 1 --2- 172.21.15.31:0/993133126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9fc15dda0 0x7fe9fc15cbd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.637+0000 7fea01699700 1 --2- 172.21.15.31:0/993133126 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9fc0cdab0 0x7fe9fc15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.637+0000 7fea01699700 1 -- 172.21.15.31:0/993133126 >> 172.21.15.31:0/993133126 conn(0x7fe9fc067660 msgr2=0x7fe9fc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:54.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.637+0000 7fea01699700 1 -- 172.21.15.31:0/993133126 shutdown_connections 2023-10-09T06:22:54.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.637+0000 7fea01699700 1 -- 172.21.15.31:0/993133126 wait complete. 2023-10-09T06:22:54.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.638+0000 7fea01699700 1 Processor -- start 2023-10-09T06:22:54.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.638+0000 7fea01699700 1 -- start start 2023-10-09T06:22:54.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea01699700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9fc0cd6e0 0x7fe9fc16e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea01699700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9fc0cdab0 0x7fe9fc0b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea01699700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9fc15dda0 0x7fe9fc14c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea01699700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0b5190 con 0x7fe9fc15dda0 2023-10-09T06:22:54.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea01699700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0b5700 con 0x7fe9fc0cd6e0 2023-10-09T06:22:54.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea01699700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0c80d0 con 0x7fe9fc0cdab0 2023-10-09T06:22:54.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea00e98700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9fc15dda0 0x7fe9fc14c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea00e98700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9fc15dda0 0x7fe9fc14c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49898/0 (socket says 172.21.15.31:49898) 2023-10-09T06:22:54.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea00e98700 1 -- 172.21.15.31:0/1838240205 learned_addr learned my addr 172.21.15.31:0/1838240205 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:22:54.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fe9fbfff700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9fc0cd6e0 0x7fe9fc16e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fe9fb7fe700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9fc0cdab0 0x7fe9fc0b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea00e98700 1 -- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9fc0cdab0 msgr2=0x7fe9fc0b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:54.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea00e98700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9fc0cdab0 0x7fe9fc0b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea00e98700 1 -- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9fc0cd6e0 msgr2=0x7fe9fc16e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:54.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea00e98700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9fc0cd6e0 0x7fe9fc16e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea00e98700 1 -- 172.21.15.31:0/1838240205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4009420 con 0x7fe9fc15dda0 2023-10-09T06:22:54.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.639+0000 7fea00e98700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9fc15dda0 0x7fe9fc14c7c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0c7b10 tx=0x7fe9f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:54.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.640+0000 7fe9f3fff700 1 -- 172.21.15.31:0/1838240205 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4027470 con 0x7fe9fc15dda0 2023-10-09T06:22:54.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.640+0000 7fea01699700 1 -- 172.21.15.31:0/1838240205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f4009a20 con 0x7fe9fc15dda0 2023-10-09T06:22:54.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.640+0000 7fe9f3fff700 1 -- 172.21.15.31:0/1838240205 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f40275f0 con 0x7fe9fc15dda0 2023-10-09T06:22:54.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.640+0000 7fe9f3fff700 1 -- 172.21.15.31:0/1838240205 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40279b0 con 0x7fe9fc15dda0 2023-10-09T06:22:54.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.640+0000 7fea01699700 1 -- 172.21.15.31:0/1838240205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc0b5390 con 0x7fe9fc15dda0 2023-10-09T06:22:54.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.640+0000 7fea01699700 1 -- 172.21.15.31:0/1838240205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9fc089280 con 0x7fe9fc15dda0 2023-10-09T06:22:54.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.641+0000 7fe9f3fff700 1 -- 172.21.15.31:0/1838240205 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9f4024070 con 0x7fe9fc15dda0 2023-10-09T06:22:54.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.641+0000 7fe9f3fff700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe9dc066f30 0x7fe9dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:22:54.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.642+0000 7fe9f3fff700 1 -- 172.21.15.31:0/1838240205 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe9f4086a70 con 0x7fe9fc15dda0 2023-10-09T06:22:54.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.642+0000 7fe9fbfff700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe9dc066f30 0x7fe9dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:22:54.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.642+0000 7fe9fbfff700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe9dc066f30 0x7fe9dc0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0b68a0 tx=0x7fe9ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:22:54.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.646+0000 7fe9f3fff700 1 -- 172.21.15.31:0/1838240205 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9f4053fe0 con 0x7fe9fc15dda0 2023-10-09T06:22:54.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.881+0000 7fea01699700 1 -- 172.21.15.31:0/1838240205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9fc156970 con 0x7fe9fc15dda0 2023-10-09T06:22:54.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.881+0000 7fe9f3fff700 1 -- 172.21.15.31:0/1838240205 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fe9f402cde0 con 0x7fe9fc15dda0 2023-10-09T06:22:54.883 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:22:54.883 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2970905850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2970905850},{"type":"v1","addr":"172.21.15.158:6837","nonce":2970905850}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5093,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/1959997615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1959997615},{"type":"v1","addr":"172.21.15.158:6836","nonce":1959997615}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5119,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1945558670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1945558670},{"type":"v1","addr":"172.21.15.31:6835","nonce":1945558670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3853703125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3853703125},{"type":"v1","addr":"172.21.15.31:6834","nonce":3853703125}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[]} 2023-10-09T06:22:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.884+0000 7fea01699700 1 -- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe9dc066f30 msgr2=0x7fe9dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.884+0000 7fea01699700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe9dc066f30 0x7fe9dc0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0b68a0 tx=0x7fe9ec009040 comp rx=0 tx=0).stop 2023-10-09T06:22:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.884+0000 7fea01699700 1 -- 172.21.15.31:0/1838240205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9fc15dda0 msgr2=0x7fe9fc14c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:22:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.884+0000 7fea01699700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9fc15dda0 0x7fe9fc14c7c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0c7b10 tx=0x7fe9f4019000 comp rx=0 tx=0).stop 2023-10-09T06:22:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.884+0000 7fea01699700 1 -- 172.21.15.31:0/1838240205 shutdown_connections 2023-10-09T06:22:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.884+0000 7fea01699700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe9dc066f30 0x7fe9dc0693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.884+0000 7fea01699700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9fc15dda0 0x7fe9fc14c7c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.884+0000 7fea01699700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9fc0cd6e0 0x7fe9fc16e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.884+0000 7fea01699700 1 --2- 172.21.15.31:0/1838240205 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9fc0cdab0 0x7fe9fc0b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:22:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.884+0000 7fea01699700 1 -- 172.21.15.31:0/1838240205 >> 172.21.15.31:0/1838240205 conn(0x7fe9fc067660 msgr2=0x7fe9fc14d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:22:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.884+0000 7fea01699700 1 -- 172.21.15.31:0/1838240205 shutdown_connections 2023-10-09T06:22:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:22:54.884+0000 7fea01699700 1 -- 172.21.15.31:0/1838240205 wait complete. 2023-10-09T06:22:54.887 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 27 2023-10-09T06:22:54.897 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:22:54.897 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:22:54.897 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:22:54.897 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:22:54.897 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:22:54.897 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:22:54.898 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:22:54.898 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:22:54.898 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:22:54.898 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:22:54.898 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:22:54.898 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:22:54.898 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:22:54.898 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:22:54.899 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:22:54.899 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:22:54.905 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:22:54.906 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:22:54.906 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:22:54.907 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:22:54.910 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:22:54.910 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:22:54.948 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:22:54.948 DEBUG:teuthology.parallel:result is None 2023-10-09T06:22:54.949 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:22:54.949 DEBUG:teuthology.parallel:result is None 2023-10-09T06:22:54.952 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:22:54.952 DEBUG:teuthology.parallel:result is None 2023-10-09T06:22:55.022 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:22:55.022 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-10-09T06:22:55.033 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-09T06:22:55.827 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:22:55.830 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:23:00.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-09T06:23:00.910 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:23:00.910 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:23:00.913 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:23:00.913 DEBUG:teuthology.parallel:result is None 2023-10-09T06:23:00.914 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:23:00.994 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:23:01.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.038+0000 7f4ee80d8700 1 Processor -- start 2023-10-09T06:23:01.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.038+0000 7f4ee80d8700 1 -- start start 2023-10-09T06:23:01.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.039+0000 7f4ee80d8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ee015a2b0 0x7f4ee00b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:01.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.039+0000 7f4ee80d8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ee00d1c30 0x7f4ee00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:01.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.039+0000 7f4ee80d8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ee015a680 0x7f4ee00cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:01.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.039+0000 7f4ee80d8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee0068470 con 0x7f4ee015a680 2023-10-09T06:23:01.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.039+0000 7f4ee80d8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee00c5d80 con 0x7f4ee015a2b0 2023-10-09T06:23:01.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.039+0000 7f4ee80d8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00c6060 con 0x7f4ee00d1c30 2023-10-09T06:23:01.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.039+0000 7f4ee6675700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ee015a680 0x7f4ee00cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:01.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.039+0000 7f4ee6675700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ee015a680 0x7f4ee00cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60492/0 (socket says 172.21.15.31:60492) 2023-10-09T06:23:01.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.039+0000 7f4ee6675700 1 -- 172.21.15.31:0/4034954860 learned_addr learned my addr 172.21.15.31:0/4034954860 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:01.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.039+0000 7f4ee5673700 1 --2- 172.21.15.31:0/4034954860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ee00d1c30 0x7f4ee00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:01.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.039+0000 7f4ee5e74700 1 --2- 172.21.15.31:0/4034954860 >> v2:172.21.15.158:3300/0 conn(0x7f4ee015a2b0 0x7f4ee00b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:01.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.040+0000 7f4ee6675700 1 -- 172.21.15.31:0/4034954860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ee00d1c30 msgr2=0x7f4ee00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:01.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.040+0000 7f4ee6675700 1 --2- 172.21.15.31:0/4034954860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ee00d1c30 0x7f4ee00cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:01.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.040+0000 7f4ee6675700 1 -- 172.21.15.31:0/4034954860 >> v2:172.21.15.158:3300/0 conn(0x7f4ee015a2b0 msgr2=0x7f4ee00b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.040+0000 7f4ee6675700 1 --2- 172.21.15.31:0/4034954860 >> v2:172.21.15.158:3300/0 conn(0x7f4ee015a2b0 0x7f4ee00b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.040+0000 7f4ee6675700 1 -- 172.21.15.31:0/4034954860 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee00c6340 con 0x7f4ee015a680 2023-10-09T06:23:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.040+0000 7f4ee6675700 1 --2- 172.21.15.31:0/4034954860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee015a680 0x7f4ee00cfc50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0089220 tx=0x7f4ed8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7af702d3f53fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.040+0000 7f4ee4e72700 1 -- 172.21.15.31:0/4034954860 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800b640 con 0x7f4ee015a680 2023-10-09T06:23:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.040+0000 7f4ee4e72700 1 -- 172.21.15.31:0/4034954860 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed800b7a0 con 0x7f4ee015a680 2023-10-09T06:23:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.040+0000 7f4ee4e72700 1 -- 172.21.15.31:0/4034954860 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800bb60 con 0x7f4ee015a680 2023-10-09T06:23:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.041+0000 7f4ee80d8700 1 -- 172.21.15.31:0/4034954860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee015a680 msgr2=0x7f4ee00cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.041+0000 7f4ee80d8700 1 --2- 172.21.15.31:0/4034954860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee015a680 0x7f4ee00cfc50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0089220 tx=0x7f4ed8009250 comp rx=0 tx=0).stop 2023-10-09T06:23:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.041+0000 7f4ee80d8700 1 -- 172.21.15.31:0/4034954860 shutdown_connections 2023-10-09T06:23:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.041+0000 7f4ee80d8700 1 --2- 172.21.15.31:0/4034954860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee015a680 0x7f4ee00cfc50 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.041+0000 7f4ee80d8700 1 --2- 172.21.15.31:0/4034954860 >> v2:172.21.15.158:3300/0 conn(0x7f4ee015a2b0 0x7f4ee00b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.041+0000 7f4ee80d8700 1 --2- 172.21.15.31:0/4034954860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ee00d1c30 0x7f4ee00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.041+0000 7f4ee80d8700 1 -- 172.21.15.31:0/4034954860 >> 172.21.15.31:0/4034954860 conn(0x7f4ee0067e40 msgr2=0x7f4ee00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.041+0000 7f4ee80d8700 1 -- 172.21.15.31:0/4034954860 shutdown_connections 2023-10-09T06:23:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.041+0000 7f4ee80d8700 1 -- 172.21.15.31:0/4034954860 wait complete. 2023-10-09T06:23:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.042+0000 7f4ee80d8700 1 Processor -- start 2023-10-09T06:23:01.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.042+0000 7f4ee80d8700 1 -- start start 2023-10-09T06:23:01.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee80d8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ee00d1c30 0x7f4ee015d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:01.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee80d8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ee015a2b0 0x7f4ee00c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:01.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee80d8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee015a680 0x7f4ee00c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:01.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee80d8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00c9480 con 0x7f4ee015a680 2023-10-09T06:23:01.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee80d8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00c85d0 con 0x7f4ee00d1c30 2023-10-09T06:23:01.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee80d8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00c8870 con 0x7f4ee015a2b0 2023-10-09T06:23:01.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee6675700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee015a680 0x7f4ee00c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:01.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee6675700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee015a680 0x7f4ee00c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60500/0 (socket says 172.21.15.31:60500) 2023-10-09T06:23:01.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee6675700 1 -- 172.21.15.31:0/977359904 learned_addr learned my addr 172.21.15.31:0/977359904 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:01.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee5e74700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ee00d1c30 0x7f4ee015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:01.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee5673700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ee015a2b0 0x7f4ee00c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:01.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee6675700 1 -- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ee015a2b0 msgr2=0x7f4ee00c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:01.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee6675700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ee015a2b0 0x7f4ee00c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:01.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee6675700 1 -- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ee00d1c30 msgr2=0x7f4ee015d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:01.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee6675700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ee00d1c30 0x7f4ee015d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:01.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee6675700 1 -- 172.21.15.31:0/977359904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed80094f0 con 0x7f4ee015a680 2023-10-09T06:23:01.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee6675700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee015a680 0x7f4ee00c9910 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80094c0 tx=0x7f4ed8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:01.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4eddffb700 1 -- 172.21.15.31:0/977359904 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800bb20 con 0x7f4ee015a680 2023-10-09T06:23:01.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4eddffb700 1 -- 172.21.15.31:0/977359904 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed8011420 con 0x7f4ee015a680 2023-10-09T06:23:01.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4ee80d8700 1 -- 172.21.15.31:0/977359904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee00c8b50 con 0x7f4ee015a680 2023-10-09T06:23:01.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.043+0000 7f4eddffb700 1 -- 172.21.15.31:0/977359904 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80117e0 con 0x7f4ee015a680 2023-10-09T06:23:01.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.044+0000 7f4ee80d8700 1 -- 172.21.15.31:0/977359904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee00c9110 con 0x7f4ee015a680 2023-10-09T06:23:01.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.045+0000 7f4ee80d8700 1 -- 172.21.15.31:0/977359904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee00c95f0 con 0x7f4ee015a680 2023-10-09T06:23:01.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.045+0000 7f4eddffb700 1 -- 172.21.15.31:0/977359904 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ed8011b50 con 0x7f4ee015a680 2023-10-09T06:23:01.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.045+0000 7f4eddffb700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ecc066f30 0x7f4ecc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:01.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.045+0000 7f4eddffb700 1 -- 172.21.15.31:0/977359904 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4ed8085b80 con 0x7f4ee015a680 2023-10-09T06:23:01.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.046+0000 7f4ee5e74700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ecc066f30 0x7f4ecc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:01.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.046+0000 7f4ee5e74700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ecc066f30 0x7f4ecc0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000f510 tx=0x7f4ed000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:01.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.050+0000 7f4eddffb700 1 -- 172.21.15.31:0/977359904 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ed80530d0 con 0x7f4ee015a680 2023-10-09T06:23:01.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:01.258+0000 7f4ee80d8700 1 -- 172.21.15.31:0/977359904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4ee004c3c0 con 0x7f4ee015a680 2023-10-09T06:23:02.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.684+0000 7f4eddffb700 1 -- 172.21.15.31:0/977359904 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4ed80566f0 con 0x7f4ee015a680 2023-10-09T06:23:02.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.686+0000 7f4ee80d8700 1 -- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ecc066f30 msgr2=0x7f4ecc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:02.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.686+0000 7f4ee80d8700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ecc066f30 0x7f4ecc0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000f510 tx=0x7f4ed000b040 comp rx=0 tx=0).stop 2023-10-09T06:23:02.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.686+0000 7f4ee80d8700 1 -- 172.21.15.31:0/977359904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee015a680 msgr2=0x7f4ee00c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:02.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.686+0000 7f4ee80d8700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee015a680 0x7f4ee00c9910 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80094c0 tx=0x7f4ed8017000 comp rx=0 tx=0).stop 2023-10-09T06:23:02.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.687+0000 7f4ee80d8700 1 -- 172.21.15.31:0/977359904 shutdown_connections 2023-10-09T06:23:02.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.687+0000 7f4ee80d8700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ecc066f30 0x7f4ecc0693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:02.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.687+0000 7f4ee80d8700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee015a680 0x7f4ee00c9910 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:02.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.687+0000 7f4ee80d8700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ee00d1c30 0x7f4ee015d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:02.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.687+0000 7f4ee80d8700 1 --2- 172.21.15.31:0/977359904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ee015a2b0 0x7f4ee00c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:02.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.687+0000 7f4ee80d8700 1 -- 172.21.15.31:0/977359904 >> 172.21.15.31:0/977359904 conn(0x7f4ee0067e40 msgr2=0x7f4ee00b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:02.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.687+0000 7f4ee80d8700 1 -- 172.21.15.31:0/977359904 shutdown_connections 2023-10-09T06:23:02.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.687+0000 7f4ee80d8700 1 -- 172.21.15.31:0/977359904 wait complete. 2023-10-09T06:23:02.689 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2023-10-09T06:23:02.702 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:23:02.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.828+0000 7fa84a3c1700 1 Processor -- start 2023-10-09T06:23:02.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.828+0000 7fa84a3c1700 1 -- start start 2023-10-09T06:23:02.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.829+0000 7fa84a3c1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa844159cf0 0x7fa84415e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:02.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.829+0000 7fa84a3c1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa84415a0c0 0x7fa8440ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.829+0000 7fa84a3c1700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8440cca20 con 0x7fa8440ce1a0 2023-10-09T06:23:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.829+0000 7fa84a3c1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84415ea40 con 0x7fa84415a0c0 2023-10-09T06:23:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.829+0000 7fa84a3c1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa844067660 con 0x7fa844159cf0 2023-10-09T06:23:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.829+0000 7fa8437fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa84415a0c0 0x7fa8440ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.829+0000 7fa8437fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa84415a0c0 0x7fa8440ceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60506/0 (socket says 172.21.15.31:60506) 2023-10-09T06:23:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.829+0000 7fa8437fe700 1 -- 172.21.15.31:0/2389001021 learned_addr learned my addr 172.21.15.31:0/2389001021 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa8437fe700 1 -- 172.21.15.31:0/2389001021 >> v2:172.21.15.158:3300/0 conn(0x7fa844159cf0 msgr2=0x7fa84415e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa8437fe700 1 --2- 172.21.15.31:0/2389001021 >> v2:172.21.15.158:3300/0 conn(0x7fa844159cf0 0x7fa84415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa8437fe700 1 -- 172.21.15.31:0/2389001021 >> v1:172.21.15.158:6789/0 conn(0x7fa8440ce1a0 legacy=0x7fa8440cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa8437fe700 1 -- 172.21.15.31:0/2389001021 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa844067f00 con 0x7fa84415a0c0 2023-10-09T06:23:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa8437fe700 1 --2- 172.21.15.31:0/2389001021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa84415a0c0 0x7fa8440ceab0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa8440777e0 tx=0x7fa82c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c88fae3781338f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa842ffd700 1 -- 172.21.15.31:0/2389001021 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00b820 con 0x7fa84415a0c0 2023-10-09T06:23:02.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa842ffd700 1 -- 172.21.15.31:0/2389001021 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c00b980 con 0x7fa84415a0c0 2023-10-09T06:23:02.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa842ffd700 1 -- 172.21.15.31:0/2389001021 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00bd20 con 0x7fa84415a0c0 2023-10-09T06:23:02.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa84a3c1700 1 -- 172.21.15.31:0/2389001021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa84415a0c0 msgr2=0x7fa8440ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:02.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa84a3c1700 1 --2- 172.21.15.31:0/2389001021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa84415a0c0 0x7fa8440ceab0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa8440777e0 tx=0x7fa82c009250 comp rx=0 tx=0).stop 2023-10-09T06:23:02.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa84a3c1700 1 -- 172.21.15.31:0/2389001021 shutdown_connections 2023-10-09T06:23:02.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa84a3c1700 1 --2- 172.21.15.31:0/2389001021 >> v2:172.21.15.158:3300/0 conn(0x7fa844159cf0 0x7fa84415e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:02.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa84a3c1700 1 --2- 172.21.15.31:0/2389001021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa84415a0c0 0x7fa8440ceab0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:02.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa84a3c1700 1 -- 172.21.15.31:0/2389001021 >> 172.21.15.31:0/2389001021 conn(0x7fa84406c6e0 msgr2=0x7fa844069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:02.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.830+0000 7fa84a3c1700 1 -- 172.21.15.31:0/2389001021 shutdown_connections 2023-10-09T06:23:02.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.831+0000 7fa84a3c1700 1 -- 172.21.15.31:0/2389001021 wait complete. 2023-10-09T06:23:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.832+0000 7fa84a3c1700 1 Processor -- start 2023-10-09T06:23:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.832+0000 7fa84a3c1700 1 -- start start 2023-10-09T06:23:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.832+0000 7fa84a3c1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8440ce1a0 0x7fa84414d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.832+0000 7fa84a3c1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa844159cf0 0x7fa8440c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.832+0000 7fa84a3c1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa84415a0c0 0x7fa844155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.832+0000 7fa84a3c1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440b3760 con 0x7fa844159cf0 2023-10-09T06:23:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.832+0000 7fa84a3c1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440c75b0 con 0x7fa8440ce1a0 2023-10-09T06:23:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.832+0000 7fa84a3c1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440c69a0 con 0x7fa84415a0c0 2023-10-09T06:23:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa8437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa844159cf0 0x7fa8440c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa8437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa844159cf0 0x7fa8440c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60512/0 (socket says 172.21.15.31:60512) 2023-10-09T06:23:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa8437fe700 1 -- 172.21.15.31:0/1328205400 learned_addr learned my addr 172.21.15.31:0/1328205400 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa843fff700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8440ce1a0 0x7fa84414d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa84895e700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa84415a0c0 0x7fa844155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa8437fe700 1 -- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa84415a0c0 msgr2=0x7fa844155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa8437fe700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa84415a0c0 0x7fa844155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa8437fe700 1 -- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8440ce1a0 msgr2=0x7fa84414d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa8437fe700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8440ce1a0 0x7fa84414d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa8437fe700 1 -- 172.21.15.31:0/1328205400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c0094f0 con 0x7fa844159cf0 2023-10-09T06:23:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa84895e700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa84415a0c0 0x7fa844155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:23:02.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa843fff700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8440ce1a0 0x7fa84414d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:23:02.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa8437fe700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa844159cf0 0x7fa8440c7a40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0090b0 tx=0x7fa82c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:02.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa83bfff700 1 -- 172.21.15.31:0/1328205400 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c011e60 con 0x7fa844159cf0 2023-10-09T06:23:02.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa83bfff700 1 -- 172.21.15.31:0/1328205400 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c020070 con 0x7fa844159cf0 2023-10-09T06:23:02.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa84a3c1700 1 -- 172.21.15.31:0/1328205400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8440c6c80 con 0x7fa844159cf0 2023-10-09T06:23:02.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa83bfff700 1 -- 172.21.15.31:0/1328205400 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c01b6a0 con 0x7fa844159cf0 2023-10-09T06:23:02.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.833+0000 7fa84a3c1700 1 -- 172.21.15.31:0/1328205400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8440c72c0 con 0x7fa844159cf0 2023-10-09T06:23:02.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.834+0000 7fa84a3c1700 1 -- 172.21.15.31:0/1328205400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8440c7720 con 0x7fa844159cf0 2023-10-09T06:23:02.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.835+0000 7fa83bfff700 1 -- 172.21.15.31:0/1328205400 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa82c022030 con 0x7fa844159cf0 2023-10-09T06:23:02.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.835+0000 7fa83bfff700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa824066f30 0x7fa8240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:02.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.835+0000 7fa83bfff700 1 -- 172.21.15.31:0/1328205400 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa82c086140 con 0x7fa844159cf0 2023-10-09T06:23:02.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.835+0000 7fa843fff700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa824066f30 0x7fa8240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:02.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.836+0000 7fa843fff700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa824066f30 0x7fa8240693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa8441548c0 tx=0x7fa834008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:02.839+0000 7fa83bfff700 1 -- 172.21.15.31:0/1328205400 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa82c053700 con 0x7fa844159cf0 2023-10-09T06:23:03.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.112+0000 7fa84a3c1700 1 -- 172.21.15.31:0/1328205400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa8440c7720 con 0x7fa844159cf0 2023-10-09T06:23:03.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.112+0000 7fa83bfff700 1 -- 172.21.15.31:0/1328205400 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa82c056d20 con 0x7fa844159cf0 2023-10-09T06:23:03.113 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:23:03.113 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:23:03.114 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2023-10-09T06:23:03.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.114 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2023-10-09T06:23:03.114 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl/nWKAxAA1kcqjt4lPGPkmDivDpIVjQ==", 2023-10-09T06:23:03.114 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.114 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:23:03.114 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:23:03.114 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:23:03.114 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.114 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.115 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2023-10-09T06:23:03.115 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl9xYEDxAAQJeaqz7lkrArv45vLGb34g==", 2023-10-09T06:23:03.115 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.115 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:23:03.115 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:23:03.115 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:23:03.115 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.115 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.116 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2023-10-09T06:23:03.116 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlJOp0ChAADGiI4SX7ZLvDrtjDtU905A==", 2023-10-09T06:23:03.116 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.116 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:23:03.116 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:23:03.116 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:23:03.116 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.116 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.116 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2023-10-09T06:23:03.116 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlbnnJFRAAO+XoxRQDaHv0ZicyggniLQ==", 2023-10-09T06:23:03.117 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.117 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:23:03.117 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:23:03.117 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:23:03.117 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.117 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.117 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2023-10-09T06:23:03.117 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNloyZ+LxAApAHpPxV7R1OVE2wlIaU+PA==", 2023-10-09T06:23:03.117 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.117 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:23:03.118 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:23:03.118 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.118 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.118 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2023-10-09T06:23:03.118 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNlvHeUNhAAXblIEmmsc5eTo5VcZVirfA==", 2023-10-09T06:23:03.118 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.118 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:23:03.118 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:23:03.118 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.119 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.119 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2023-10-09T06:23:03.119 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlxfIaBBAAE8WbXh4Q4SxaW2k7MkSTHg==", 2023-10-09T06:23:03.119 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.119 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:23:03.119 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:23:03.119 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.119 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.120 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2023-10-09T06:23:03.120 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlUtX3DRAA5NEq+lFMzqhu1GF1ZWT2ag==", 2023-10-09T06:23:03.120 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.120 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:23:03.120 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:23:03.120 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.120 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.120 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2023-10-09T06:23:03.120 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlcWc5IBAA5e62AwhIuHdw4dTjnNS8hQ==", 2023-10-09T06:23:03.121 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.121 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:23:03.121 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:23:03.121 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.121 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.121 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2023-10-09T06:23:03.121 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlX5S6JhAAzvzO2YEqEtq2fJ3FW9Fddg==", 2023-10-09T06:23:03.121 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.121 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:23:03.121 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:23:03.122 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.122 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.122 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2023-10-09T06:23:03.122 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl9jy5LxAAxgMslSN6ayxB2MFRf2dwNQ==", 2023-10-09T06:23:03.122 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.122 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:23:03.122 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:23:03.122 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.122 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.123 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2023-10-09T06:23:03.123 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl8M+TOBAARhk2wEaXO9Pi4TP9d+L5Gg==", 2023-10-09T06:23:03.123 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.123 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:23:03.123 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:23:03.123 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.123 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.123 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2023-10-09T06:23:03.124 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlfsC2GRAAlm37QI8DkNclcBpD5ZBR7A==", 2023-10-09T06:23:03.124 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.124 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:23:03.124 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2023-10-09T06:23:03.124 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T06:23:03.124 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.124 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2023-10-09T06:23:03.124 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlapIxIhAAiBZUkpnf6tyFHwySGKhRpQ==", 2023-10-09T06:23:03.125 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.125 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:23:03.125 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:23:03.125 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:23:03.125 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:23:03.125 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.125 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.125 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2023-10-09T06:23:03.125 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEZYuHxAA7WEH0vXmAEH5Wki8ESrDBg==", 2023-10-09T06:23:03.125 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.125 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:23:03.126 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:23:03.126 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:23:03.126 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:23:03.126 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.126 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2023-10-09T06:23:03.126 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlFvuIJxAAGuTp4gsXrvUzDd1B7d5vcg==", 2023-10-09T06:23:03.126 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.126 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:23:03.126 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:23:03.127 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:23:03.127 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:23:03.127 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.127 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2023-10-09T06:23:03.127 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlS8AlJBAAg8lLRVasKHyhbFlOTfgt9g==", 2023-10-09T06:23:03.127 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.128 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:23:03.128 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:23:03.128 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:23:03.128 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.128 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.128 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2023-10-09T06:23:03.128 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEE9eABAAHbJ1yvlmOUNo6n2uAhPrnw==", 2023-10-09T06:23:03.128 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.129 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:23:03.129 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:23:03.129 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.129 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:23:03.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:03.129 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2023-10-09T06:23:03.129 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlhol5OBAAZSZ+PbojVwsOJtLlTl6wAA==", 2023-10-09T06:23:03.129 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:23:03.129 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:23:03.129 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:23:03.130 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:23:03.130 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.130 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:03.130 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:23:03.130 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:23:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.114+0000 7fa84a3c1700 1 -- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa824066f30 msgr2=0x7fa8240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.114+0000 7fa84a3c1700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa824066f30 0x7fa8240693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa8441548c0 tx=0x7fa834008040 comp rx=0 tx=0).stop 2023-10-09T06:23:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.114+0000 7fa84a3c1700 1 -- 172.21.15.31:0/1328205400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa844159cf0 msgr2=0x7fa8440c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.114+0000 7fa84a3c1700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa844159cf0 0x7fa8440c7a40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0090b0 tx=0x7fa82c016000 comp rx=0 tx=0).stop 2023-10-09T06:23:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.114+0000 7fa84a3c1700 1 -- 172.21.15.31:0/1328205400 shutdown_connections 2023-10-09T06:23:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.114+0000 7fa84a3c1700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa824066f30 0x7fa8240693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.114+0000 7fa84a3c1700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa84415a0c0 0x7fa844155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.114+0000 7fa84a3c1700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8440ce1a0 0x7fa84414d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.114+0000 7fa84a3c1700 1 --2- 172.21.15.31:0/1328205400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa844159cf0 0x7fa8440c7a40 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.114+0000 7fa84a3c1700 1 -- 172.21.15.31:0/1328205400 >> 172.21.15.31:0/1328205400 conn(0x7fa84406c6e0 msgr2=0x7fa8441555a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:03.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.114+0000 7fa84a3c1700 1 -- 172.21.15.31:0/1328205400 shutdown_connections 2023-10-09T06:23:03.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.114+0000 7fa84a3c1700 1 -- 172.21.15.31:0/1328205400 wait complete. 2023-10-09T06:23:03.133 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:23:03.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.251+0000 7f2268248700 1 Processor -- start 2023-10-09T06:23:03.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.252+0000 7f2268248700 1 -- start start 2023-10-09T06:23:03.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.252+0000 7f2268248700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f22601523e0 0x7f226006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.252+0000 7f2268248700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2260158e50 0x7f22600cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.252+0000 7f2268248700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226006c010 con 0x7f2260152010 2023-10-09T06:23:03.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.252+0000 7f2268248700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226006bd10 con 0x7f22601523e0 2023-10-09T06:23:03.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.252+0000 7f2268248700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226015c060 con 0x7f2260158e50 2023-10-09T06:23:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f22657e3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f22601523e0 0x7f226006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f22657e3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f22601523e0 0x7f226006c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60518/0 (socket says 172.21.15.31:60518) 2023-10-09T06:23:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f2265fe4700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2260152010 0x7f226015b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53826/0 (socket says 172.21.15.31:53826) 2023-10-09T06:23:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f22657e3700 1 -- 172.21.15.31:0/1755283772 learned_addr learned my addr 172.21.15.31:0/1755283772 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f22667e5700 1 --2- 172.21.15.31:0/1755283772 >> v2:172.21.15.158:3300/0 conn(0x7f2260158e50 0x7f22600cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f22657e3700 1 -- 172.21.15.31:0/1755283772 >> v2:172.21.15.158:3300/0 conn(0x7f2260158e50 msgr2=0x7f22600cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:03.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f22657e3700 1 --2- 172.21.15.31:0/1755283772 >> v2:172.21.15.158:3300/0 conn(0x7f2260158e50 0x7f22600cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f22657e3700 1 -- 172.21.15.31:0/1755283772 >> v1:172.21.15.31:6789/0 conn(0x7f2260152010 legacy=0x7f226015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f22657e3700 1 -- 172.21.15.31:0/1755283772 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226015c340 con 0x7f22601523e0 2023-10-09T06:23:03.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f2264fe2700 1 -- 172.21.15.31:0/1755283772 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754362633 0 0) 0x7f226006c010 con 0x7f2260152010 2023-10-09T06:23:03.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f22657e3700 1 --2- 172.21.15.31:0/1755283772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22601523e0 0x7f226006c4a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f226006f170 tx=0x7f2254009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81dde4c396367bc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:03.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f2264fe2700 1 -- 172.21.15.31:0/1755283772 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225400b860 con 0x7f22601523e0 2023-10-09T06:23:03.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f2264fe2700 1 -- 172.21.15.31:0/1755283772 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225400b9c0 con 0x7f22601523e0 2023-10-09T06:23:03.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.253+0000 7f2264fe2700 1 -- 172.21.15.31:0/1755283772 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225400bd60 con 0x7f22601523e0 2023-10-09T06:23:03.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.254+0000 7f2268248700 1 -- 172.21.15.31:0/1755283772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22601523e0 msgr2=0x7f226006c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.254+0000 7f2268248700 1 --2- 172.21.15.31:0/1755283772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22601523e0 0x7f226006c4a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f226006f170 tx=0x7f2254009250 comp rx=0 tx=0).stop 2023-10-09T06:23:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.254+0000 7f2268248700 1 -- 172.21.15.31:0/1755283772 shutdown_connections 2023-10-09T06:23:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.254+0000 7f2268248700 1 --2- 172.21.15.31:0/1755283772 >> v2:172.21.15.158:3300/0 conn(0x7f2260158e50 0x7f22600cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.254+0000 7f2268248700 1 --2- 172.21.15.31:0/1755283772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22601523e0 0x7f226006c4a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.254+0000 7f2268248700 1 -- 172.21.15.31:0/1755283772 >> 172.21.15.31:0/1755283772 conn(0x7f2260069870 msgr2=0x7f2260069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.254+0000 7f2268248700 1 -- 172.21.15.31:0/1755283772 shutdown_connections 2023-10-09T06:23:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.254+0000 7f2268248700 1 -- 172.21.15.31:0/1755283772 wait complete. 2023-10-09T06:23:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.255+0000 7f2268248700 1 Processor -- start 2023-10-09T06:23:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.255+0000 7f2268248700 1 -- start start 2023-10-09T06:23:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f2268248700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2260152010 0x7f22600b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f2268248700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22601523e0 0x7f226013f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f2268248700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2260158e50 0x7f2260151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f2268248700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2260152800 con 0x7f22601523e0 2023-10-09T06:23:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f2268248700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2260152a50 con 0x7f2260158e50 2023-10-09T06:23:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f2268248700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2260152d30 con 0x7f2260152010 2023-10-09T06:23:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f22657e3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22601523e0 0x7f226013f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f22657e3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22601523e0 0x7f226013f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60534/0 (socket says 172.21.15.31:60534) 2023-10-09T06:23:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f22657e3700 1 -- 172.21.15.31:0/4050687776 learned_addr learned my addr 172.21.15.31:0/4050687776 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f22657e3700 1 -- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2260152010 msgr2=0x7f22600b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f22657e3700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2260152010 0x7f22600b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f22657e3700 1 -- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2260158e50 msgr2=0x7f2260151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f22667e5700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2260158e50 0x7f2260151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f22657e3700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2260158e50 0x7f2260151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f22657e3700 1 -- 172.21.15.31:0/4050687776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22540094f0 con 0x7f22601523e0 2023-10-09T06:23:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f22667e5700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2260158e50 0x7f2260151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:23:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f22657e3700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22601523e0 0x7f226013f3b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2254006f50 tx=0x7f2254017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f225dffb700 1 -- 172.21.15.31:0/4050687776 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254024440 con 0x7f22601523e0 2023-10-09T06:23:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.256+0000 7f225dffb700 1 -- 172.21.15.31:0/4050687776 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22540245e0 con 0x7f22601523e0 2023-10-09T06:23:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.257+0000 7f225dffb700 1 -- 172.21.15.31:0/4050687776 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540249a0 con 0x7f22601523e0 2023-10-09T06:23:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.257+0000 7f2268248700 1 -- 172.21.15.31:0/4050687776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2260153010 con 0x7f22601523e0 2023-10-09T06:23:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.257+0000 7f2268248700 1 -- 172.21.15.31:0/4050687776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22600b1e20 con 0x7f22601523e0 2023-10-09T06:23:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.258+0000 7f2268248700 1 -- 172.21.15.31:0/4050687776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2260153530 con 0x7f22601523e0 2023-10-09T06:23:03.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.258+0000 7f225dffb700 1 -- 172.21.15.31:0/4050687776 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2254024d50 con 0x7f22601523e0 2023-10-09T06:23:03.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.258+0000 7f225dffb700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f224c066f30 0x7f224c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.258+0000 7f225dffb700 1 -- 172.21.15.31:0/4050687776 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2254085fb0 con 0x7f22601523e0 2023-10-09T06:23:03.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.259+0000 7f2265fe4700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f224c066f30 0x7f224c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.259+0000 7f2265fe4700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f224c066f30 0x7f224c0693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2258001660 tx=0x7f2258007b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:03.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.263+0000 7f225dffb700 1 -- 172.21.15.31:0/4050687776 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2260153530 con 0x7f22601523e0 2023-10-09T06:23:03.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.456+0000 7f2268248700 1 -- 172.21.15.31:0/4050687776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2260153530 con 0x7f22601523e0 2023-10-09T06:23:03.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.456+0000 7f225dffb700 1 -- 172.21.15.31:0/4050687776 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f2260153530 con 0x7f22601523e0 2023-10-09T06:23:03.457 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:23:03.457 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":61,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:23:02.681292+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:23:03.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.458+0000 7f2268248700 1 -- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f224c066f30 msgr2=0x7f224c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.458+0000 7f2268248700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f224c066f30 0x7f224c0693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2258001660 tx=0x7f2258007b70 comp rx=0 tx=0).stop 2023-10-09T06:23:03.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.458+0000 7f2268248700 1 -- 172.21.15.31:0/4050687776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22601523e0 msgr2=0x7f226013f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.458+0000 7f2268248700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22601523e0 0x7f226013f3b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2254006f50 tx=0x7f2254017000 comp rx=0 tx=0).stop 2023-10-09T06:23:03.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.459+0000 7f2268248700 1 -- 172.21.15.31:0/4050687776 shutdown_connections 2023-10-09T06:23:03.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.459+0000 7f2268248700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f224c066f30 0x7f224c0693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.459+0000 7f2268248700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2260152010 0x7f22600b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.459+0000 7f2268248700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2260158e50 0x7f2260151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.459+0000 7f2268248700 1 --2- 172.21.15.31:0/4050687776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22601523e0 0x7f226013f3b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.459+0000 7f2268248700 1 -- 172.21.15.31:0/4050687776 >> 172.21.15.31:0/4050687776 conn(0x7f2260069870 msgr2=0x7f226014f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:03.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.459+0000 7f2268248700 1 -- 172.21.15.31:0/4050687776 shutdown_connections 2023-10-09T06:23:03.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.459+0000 7f2268248700 1 -- 172.21.15.31:0/4050687776 wait complete. 2023-10-09T06:23:03.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:23:03.471 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:23:03.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.592+0000 7fb381948700 1 Processor -- start 2023-10-09T06:23:03.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.592+0000 7fb381948700 1 -- start start 2023-10-09T06:23:03.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.593+0000 7fb381948700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb37c143970 0x7fb37c069e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.593+0000 7fb381948700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37c15e380 con 0x7fb37c070e10 2023-10-09T06:23:03.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.593+0000 7fb381948700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37c06ab70 con 0x7fb37c1435a0 2023-10-09T06:23:03.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.593+0000 7fb381948700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37c06fb70 con 0x7fb37c143970 2023-10-09T06:23:03.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.593+0000 7fb37a7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb37c143970 0x7fb37c069e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.593+0000 7fb37b7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb37c070e10 0x7fb37c06a380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53834/0 (socket says 172.21.15.31:53834) 2023-10-09T06:23:03.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.593+0000 7fb37b7fe700 1 -- 172.21.15.31:0/1308139790 learned_addr learned my addr 172.21.15.31:0/1308139790 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:23:03.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.594+0000 7fb37a7fc700 1 -- 172.21.15.31:0/1308139790 >> v1:172.21.15.158:6789/0 conn(0x7fb37c1435a0 legacy=0x7fb37c070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.594+0000 7fb37a7fc700 1 -- 172.21.15.31:0/1308139790 >> v1:172.21.15.31:6789/0 conn(0x7fb37c070e10 legacy=0x7fb37c06a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.594+0000 7fb379ffb700 1 -- 172.21.15.31:0/1308139790 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637924044 0 0) 0x7fb37c15e380 con 0x7fb37c070e10 2023-10-09T06:23:03.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.594+0000 7fb37a7fc700 1 -- 172.21.15.31:0/1308139790 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c15da50 con 0x7fb37c143970 2023-10-09T06:23:03.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.594+0000 7fb37a7fc700 1 --2- 172.21.15.31:0/1308139790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb37c143970 0x7fb37c069e40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb3640098e0 tx=0x7fb3640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be0a37f2299f004 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:03.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.594+0000 7fb379ffb700 1 -- 172.21.15.31:0/1308139790 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364009e80 con 0x7fb37c143970 2023-10-09T06:23:03.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.594+0000 7fb379ffb700 1 -- 172.21.15.31:0/1308139790 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36400b860 con 0x7fb37c143970 2023-10-09T06:23:03.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.594+0000 7fb379ffb700 1 -- 172.21.15.31:0/1308139790 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36400bbe0 con 0x7fb37c143970 2023-10-09T06:23:03.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.595+0000 7fb381948700 1 -- 172.21.15.31:0/1308139790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb37c143970 msgr2=0x7fb37c069e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.595+0000 7fb381948700 1 --2- 172.21.15.31:0/1308139790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb37c143970 0x7fb37c069e40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb3640098e0 tx=0x7fb3640091a0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.595+0000 7fb381948700 1 -- 172.21.15.31:0/1308139790 shutdown_connections 2023-10-09T06:23:03.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.595+0000 7fb381948700 1 --2- 172.21.15.31:0/1308139790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb37c143970 0x7fb37c069e40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.595+0000 7fb381948700 1 -- 172.21.15.31:0/1308139790 >> 172.21.15.31:0/1308139790 conn(0x7fb37c0ca520 msgr2=0x7fb37c0ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:03.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.595+0000 7fb381948700 1 -- 172.21.15.31:0/1308139790 shutdown_connections 2023-10-09T06:23:03.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.595+0000 7fb381948700 1 -- 172.21.15.31:0/1308139790 wait complete. 2023-10-09T06:23:03.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.596+0000 7fb381948700 1 Processor -- start 2023-10-09T06:23:03.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.596+0000 7fb381948700 1 -- start start 2023-10-09T06:23:03.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb381948700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb37c070e10 0x7fb37c1597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb381948700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb37c1435a0 0x7fb37c0b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb381948700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb37c143970 0x7fb37c0ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb381948700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c159d20 con 0x7fb37c143970 2023-10-09T06:23:03.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb381948700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c15a500 con 0x7fb37c070e10 2023-10-09T06:23:03.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb381948700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0b12f0 con 0x7fb37c1435a0 2023-10-09T06:23:03.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb37b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb37c143970 0x7fb37c0ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb37b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb37c143970 0x7fb37c0ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60544/0 (socket says 172.21.15.31:60544) 2023-10-09T06:23:03.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb37b7fe700 1 -- 172.21.15.31:0/2073312080 learned_addr learned my addr 172.21.15.31:0/2073312080 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:03.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb37a7fc700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb37c1435a0 0x7fb37c0b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb37affd700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb37c070e10 0x7fb37c1597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb37b7fe700 1 -- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb37c1435a0 msgr2=0x7fb37c0b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb37b7fe700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb37c1435a0 0x7fb37c0b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb37b7fe700 1 -- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb37c070e10 msgr2=0x7fb37c1597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb37b7fe700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb37c070e10 0x7fb37c1597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb37b7fe700 1 -- 172.21.15.31:0/2073312080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb364009420 con 0x7fb37c143970 2023-10-09T06:23:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb37affd700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb37c070e10 0x7fb37c1597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:23:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb37a7fc700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb37c1435a0 0x7fb37c0b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:23:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb37b7fe700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb37c143970 0x7fb37c0ab250 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00ccf0 tx=0x7fb36c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb372ffd700 1 -- 172.21.15.31:0/2073312080 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c00aad0 con 0x7fb37c143970 2023-10-09T06:23:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb372ffd700 1 -- 172.21.15.31:0/2073312080 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c00ac30 con 0x7fb37c143970 2023-10-09T06:23:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb372ffd700 1 -- 172.21.15.31:0/2073312080 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c0070f0 con 0x7fb37c143970 2023-10-09T06:23:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.597+0000 7fb381948700 1 -- 172.21.15.31:0/2073312080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37c0ab790 con 0x7fb37c143970 2023-10-09T06:23:03.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.598+0000 7fb381948700 1 -- 172.21.15.31:0/2073312080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37c15aab0 con 0x7fb37c143970 2023-10-09T06:23:03.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.599+0000 7fb381948700 1 -- 172.21.15.31:0/2073312080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37c067870 con 0x7fb37c143970 2023-10-09T06:23:03.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.599+0000 7fb372ffd700 1 -- 172.21.15.31:0/2073312080 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb36c007520 con 0x7fb37c143970 2023-10-09T06:23:03.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.599+0000 7fb372ffd700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb35c066f30 0x7fb35c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.599+0000 7fb372ffd700 1 -- 172.21.15.31:0/2073312080 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb36c084650 con 0x7fb37c143970 2023-10-09T06:23:03.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.600+0000 7fb37affd700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb35c066f30 0x7fb35c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.600+0000 7fb37affd700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb35c066f30 0x7fb35c0693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb374007fd0 tx=0x7fb374009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:03.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.604+0000 7fb372ffd700 1 -- 172.21.15.31:0/2073312080 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb36c051c90 con 0x7fb37c143970 2023-10-09T06:23:03.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.797+0000 7fb381948700 1 -- 172.21.15.31:0/2073312080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb37c04c3c0 con 0x7fb37c143970 2023-10-09T06:23:03.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.797+0000 7fb372ffd700 1 -- 172.21.15.31:0/2073312080 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb36c0552b0 con 0x7fb37c143970 2023-10-09T06:23:03.798 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:23:03.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.800+0000 7fb381948700 1 -- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb35c066f30 msgr2=0x7fb35c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.800+0000 7fb381948700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb35c066f30 0x7fb35c0693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb374007fd0 tx=0x7fb374009040 comp rx=0 tx=0).stop 2023-10-09T06:23:03.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.800+0000 7fb381948700 1 -- 172.21.15.31:0/2073312080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb37c143970 msgr2=0x7fb37c0ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.800+0000 7fb381948700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb37c143970 0x7fb37c0ab250 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00ccf0 tx=0x7fb36c001a20 comp rx=0 tx=0).stop 2023-10-09T06:23:03.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.800+0000 7fb381948700 1 -- 172.21.15.31:0/2073312080 shutdown_connections 2023-10-09T06:23:03.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.800+0000 7fb381948700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb35c066f30 0x7fb35c0693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.800+0000 7fb381948700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb37c143970 0x7fb37c0ab250 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.800+0000 7fb381948700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb37c070e10 0x7fb37c1597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.800+0000 7fb381948700 1 --2- 172.21.15.31:0/2073312080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb37c1435a0 0x7fb37c0b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.800+0000 7fb381948700 1 -- 172.21.15.31:0/2073312080 >> 172.21.15.31:0/2073312080 conn(0x7fb37c0ca520 msgr2=0x7fb37c070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:03.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.800+0000 7fb381948700 1 -- 172.21.15.31:0/2073312080 shutdown_connections 2023-10-09T06:23:03.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.800+0000 7fb381948700 1 -- 172.21.15.31:0/2073312080 wait complete. 2023-10-09T06:23:03.812 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:23:03.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.930+0000 7fc32565a700 1 Processor -- start 2023-10-09T06:23:03.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.930+0000 7fc32565a700 1 -- start start 2023-10-09T06:23:03.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.931+0000 7fc32565a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc320156350 0x7fc3201567d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.931+0000 7fc32565a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc320068340 con 0x7fc3200cbfa0 2023-10-09T06:23:03.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.931+0000 7fc32565a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32006f040 con 0x7fc3200cc370 2023-10-09T06:23:03.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.931+0000 7fc32565a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32006abd0 con 0x7fc320156350 2023-10-09T06:23:03.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.931+0000 7fc31ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc3200cbfa0 0x7fc3200687d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53838/0 (socket says 172.21.15.31:53838) 2023-10-09T06:23:03.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.931+0000 7fc31ffff700 1 -- 172.21.15.31:0/4222051241 learned_addr learned my addr 172.21.15.31:0/4222051241 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:23:03.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572356982 0 0) 0x7fc320068340 con 0x7fc3200cbfa0 2023-10-09T06:23:03.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc324e59700 1 --2- 172.21.15.31:0/4222051241 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc320156350 0x7fc3201567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc30c003570 con 0x7fc3200cbfa0 2023-10-09T06:23:03.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2105275614 0 0) 0x7fc30c003570 con 0x7fc3200cbfa0 2023-10-09T06:23:03.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc320156350 msgr2=0x7fc3201567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:03.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 --2- 172.21.15.31:0/4222051241 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc320156350 0x7fc3201567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 >> v1:172.21.15.158:6789/0 conn(0x7fc3200cc370 legacy=0x7fc32006a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc320067a10 con 0x7fc3200cbfa0 2023-10-09T06:23:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fc310001470 con 0x7fc3200cbfa0 2023-10-09T06:23:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 >> v1:172.21.15.31:6789/0 conn(0x7fc3200cbfa0 legacy=0x7fc3200687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 --2- 172.21.15.31:0/4222051241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc30c003a90 0x7fc30c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 --2- 172.21.15.31:0/4222051241 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc320156350 0x7fc30c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 --2- 172.21.15.31:0/4222051241 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc30c004d50 0x7fc30c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32006abd0 con 0x7fc30c003a90 2023-10-09T06:23:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c00bb40 con 0x7fc30c004d50 2023-10-09T06:23:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c00df10 con 0x7fc320156350 2023-10-09T06:23:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31ffff700 1 --2- 172.21.15.31:0/4222051241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc30c003a90 0x7fc30c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc324e59700 1 --2- 172.21.15.31:0/4222051241 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc30c004d50 0x7fc30c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31f7fe700 1 --2- 172.21.15.31:0/4222051241 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc320156350 0x7fc30c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.932+0000 7fc31ffff700 1 -- 172.21.15.31:0/4222051241 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc320156350 msgr2=0x7fc30c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:03.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc31ffff700 1 --2- 172.21.15.31:0/4222051241 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc320156350 0x7fc30c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc31ffff700 1 -- 172.21.15.31:0/4222051241 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc30c004d50 msgr2=0x7fc30c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc31ffff700 1 --2- 172.21.15.31:0/4222051241 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc30c004d50 0x7fc30c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc31ffff700 1 -- 172.21.15.31:0/4222051241 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c003570 con 0x7fc30c003a90 2023-10-09T06:23:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc31ffff700 1 --2- 172.21.15.31:0/4222051241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc30c003a90 0x7fc30c003e60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c2d0 tx=0x7fc310001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512f8471c883f8d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31000cba0 con 0x7fc30c003a90 2023-10-09T06:23:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31000cd20 con 0x7fc30c003a90 2023-10-09T06:23:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc31effd700 1 -- 172.21.15.31:0/4222051241 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310005b70 con 0x7fc30c003a90 2023-10-09T06:23:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc32565a700 1 -- 172.21.15.31:0/4222051241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc30c003a90 msgr2=0x7fc30c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc32565a700 1 --2- 172.21.15.31:0/4222051241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc30c003a90 0x7fc30c003e60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c2d0 tx=0x7fc310001da0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc324e59700 1 -- 172.21.15.31:0/4222051241 reap_dead start 2023-10-09T06:23:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc32565a700 1 -- 172.21.15.31:0/4222051241 shutdown_connections 2023-10-09T06:23:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc32565a700 1 -- 172.21.15.31:0/4222051241 >> 172.21.15.31:0/4222051241 conn(0x7fc3200cd8f0 msgr2=0x7fc3200cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc32565a700 1 -- 172.21.15.31:0/4222051241 shutdown_connections 2023-10-09T06:23:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.933+0000 7fc32565a700 1 -- 172.21.15.31:0/4222051241 wait complete. 2023-10-09T06:23:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.934+0000 7fc32565a700 1 Processor -- start 2023-10-09T06:23:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.935+0000 7fc32565a700 1 -- start start 2023-10-09T06:23:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.935+0000 7fc32565a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc30c003a90 0x7fc3200c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.935+0000 7fc32565a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3201465d0 0x7fc32015a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.935+0000 7fc32565a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3200c9210 0x7fc3200c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.935+0000 7fc32565a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc320068ee0 con 0x7fc3201465d0 2023-10-09T06:23:03.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.935+0000 7fc32565a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32015a8d0 con 0x7fc30c003a90 2023-10-09T06:23:03.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.935+0000 7fc32565a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200c9bc0 con 0x7fc3200c9210 2023-10-09T06:23:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.935+0000 7fc31f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3201465d0 0x7fc32015a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc31f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3201465d0 0x7fc32015a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60568/0 (socket says 172.21.15.31:60568) 2023-10-09T06:23:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc31f7fe700 1 -- 172.21.15.31:0/2189898760 learned_addr learned my addr 172.21.15.31:0/2189898760 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc31ffff700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc30c003a90 0x7fc3200c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc324e59700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3200c9210 0x7fc3200c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc31f7fe700 1 -- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3200c9210 msgr2=0x7fc3200c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc31f7fe700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3200c9210 0x7fc3200c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc31f7fe700 1 -- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc30c003a90 msgr2=0x7fc3200c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc31f7fe700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc30c003a90 0x7fc3200c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc31f7fe700 1 -- 172.21.15.31:0/2189898760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc320156880 con 0x7fc3201465d0 2023-10-09T06:23:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc31f7fe700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3201465d0 0x7fc32015a390 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc308002b40 tx=0x7fc308007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc317fff700 1 -- 172.21.15.31:0/2189898760 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30800f8d0 con 0x7fc3201465d0 2023-10-09T06:23:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc317fff700 1 -- 172.21.15.31:0/2189898760 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30800fa50 con 0x7fc3201465d0 2023-10-09T06:23:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc32565a700 1 -- 172.21.15.31:0/2189898760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32015aae0 con 0x7fc3201465d0 2023-10-09T06:23:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc317fff700 1 -- 172.21.15.31:0/2189898760 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30800fe10 con 0x7fc3201465d0 2023-10-09T06:23:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.936+0000 7fc32565a700 1 -- 172.21.15.31:0/2189898760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32015b0a0 con 0x7fc3201465d0 2023-10-09T06:23:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.937+0000 7fc32565a700 1 -- 172.21.15.31:0/2189898760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc320156a10 con 0x7fc3201465d0 2023-10-09T06:23:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.937+0000 7fc317fff700 1 -- 172.21.15.31:0/2189898760 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc308013600 con 0x7fc3201465d0 2023-10-09T06:23:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.938+0000 7fc317fff700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc300066f30 0x7fc3000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.938+0000 7fc317fff700 1 -- 172.21.15.31:0/2189898760 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc308084770 con 0x7fc3201465d0 2023-10-09T06:23:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.938+0000 7fc31ffff700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc300066f30 0x7fc3000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.939+0000 7fc31ffff700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc300066f30 0x7fc3000693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc310007c20 tx=0x7fc310015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:03.942+0000 7fc317fff700 1 -- 172.21.15.31:0/2189898760 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc308051d30 con 0x7fc3201465d0 2023-10-09T06:23:04.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.137+0000 7fc32565a700 1 -- 172.21.15.31:0/2189898760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc320067cf0 con 0x7fc3201465d0 2023-10-09T06:23:04.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.138+0000 7fc317fff700 1 -- 172.21.15.31:0/2189898760 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc308017060 con 0x7fc3201465d0 2023-10-09T06:23:04.138 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:23:04.139 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-10-09T06:23:04.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:23:04.139 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-10-09T06:23:04.139 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-10-09T06:23:04.139 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:23:04.139 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-10-09T06:23:04.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.140+0000 7fc32565a700 1 -- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc300066f30 msgr2=0x7fc3000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:04.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.140+0000 7fc32565a700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc300066f30 0x7fc3000693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc310007c20 tx=0x7fc310015000 comp rx=0 tx=0).stop 2023-10-09T06:23:04.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.140+0000 7fc32565a700 1 -- 172.21.15.31:0/2189898760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3201465d0 msgr2=0x7fc32015a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:04.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.140+0000 7fc32565a700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3201465d0 0x7fc32015a390 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc308002b40 tx=0x7fc308007d10 comp rx=0 tx=0).stop 2023-10-09T06:23:04.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.140+0000 7fc32565a700 1 -- 172.21.15.31:0/2189898760 shutdown_connections 2023-10-09T06:23:04.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.140+0000 7fc32565a700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc300066f30 0x7fc3000693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.140+0000 7fc32565a700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3200c9210 0x7fc3200c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.140+0000 7fc32565a700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc30c003a90 0x7fc3200c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.140+0000 7fc32565a700 1 --2- 172.21.15.31:0/2189898760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3201465d0 0x7fc32015a390 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.140+0000 7fc32565a700 1 -- 172.21.15.31:0/2189898760 >> 172.21.15.31:0/2189898760 conn(0x7fc3200cd8f0 msgr2=0x7fc3200b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:04.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.140+0000 7fc32565a700 1 -- 172.21.15.31:0/2189898760 shutdown_connections 2023-10-09T06:23:04.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.140+0000 7fc32565a700 1 -- 172.21.15.31:0/2189898760 wait complete. 2023-10-09T06:23:04.152 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:23:04.152 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:23:04.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.274+0000 7fbcf73e9700 1 Processor -- start 2023-10-09T06:23:04.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.274+0000 7fbcf73e9700 1 -- start start 2023-10-09T06:23:04.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.275+0000 7fbcf73e9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbcf00cd7d0 0x7fbcf00d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:04.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.275+0000 7fbcf73e9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbcf006a5c0 0x7fbcf006aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:04.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.275+0000 7fbcf73e9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf00cfda0 con 0x7fbcf0157960 2023-10-09T06:23:04.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.275+0000 7fbcf73e9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf006af80 con 0x7fbcf006a5c0 2023-10-09T06:23:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.275+0000 7fbcf73e9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00ce050 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.275+0000 7fbcf4984700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbcf00cd7d0 0x7fbcf00d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.275+0000 7fbcf5986700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbcf006a5c0 0x7fbcf006aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.275+0000 7fbcf5185700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fbcf0157960 0x7fbcf015ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:33604/0 (socket says 172.21.15.31:33604) 2023-10-09T06:23:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.275+0000 7fbcf5185700 1 -- 172.21.15.31:0/2087254923 learned_addr learned my addr 172.21.15.31:0/2087254923 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:23:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.275+0000 7fbcf5986700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbcf006a5c0 0x7fbcf006aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:52976/0 (socket says 172.21.15.31:52976) 2023-10-09T06:23:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.275+0000 7fbcf4984700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbcf00cd7d0 0x7fbcf00d0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:34222/0 (socket says 172.21.15.31:34222) 2023-10-09T06:23:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.276+0000 7fbcf5986700 1 -- 172.21.15.31:0/2087254923 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbcf00cd7d0 msgr2=0x7fbcf00d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.276+0000 7fbcf5986700 1 --2- 172.21.15.31:0/2087254923 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbcf00cd7d0 0x7fbcf00d0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.276+0000 7fbcf5986700 1 -- 172.21.15.31:0/2087254923 >> v1:172.21.15.158:6789/0 conn(0x7fbcf0157960 legacy=0x7fbcf015ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:04.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.276+0000 7fbcf5986700 1 -- 172.21.15.31:0/2087254923 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf00cf4b0 con 0x7fbcf006a5c0 2023-10-09T06:23:04.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.276+0000 7fbceffff700 1 -- 172.21.15.31:0/2087254923 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375275074 0 0) 0x7fbcf00cfda0 con 0x7fbcf0157960 2023-10-09T06:23:04.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.276+0000 7fbcf5986700 1 --2- 172.21.15.31:0/2087254923 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbcf006a5c0 0x7fbcf006aa40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009e60 tx=0x7fbce0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f8531d5a50306f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:04.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.276+0000 7fbceffff700 1 -- 172.21.15.31:0/2087254923 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce000e070 con 0x7fbcf006a5c0 2023-10-09T06:23:04.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.276+0000 7fbceffff700 1 -- 172.21.15.31:0/2087254923 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce000bb60 con 0x7fbcf006a5c0 2023-10-09T06:23:04.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.276+0000 7fbceffff700 1 -- 172.21.15.31:0/2087254923 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0012430 con 0x7fbcf006a5c0 2023-10-09T06:23:04.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.277+0000 7fbcf73e9700 1 -- 172.21.15.31:0/2087254923 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbcf006a5c0 msgr2=0x7fbcf006aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:04.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.277+0000 7fbcf73e9700 1 --2- 172.21.15.31:0/2087254923 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbcf006a5c0 0x7fbcf006aa40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009e60 tx=0x7fbce0009780 comp rx=0 tx=0).stop 2023-10-09T06:23:04.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.277+0000 7fbcf73e9700 1 -- 172.21.15.31:0/2087254923 shutdown_connections 2023-10-09T06:23:04.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.277+0000 7fbcf73e9700 1 --2- 172.21.15.31:0/2087254923 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbcf006a5c0 0x7fbcf006aa40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.277+0000 7fbcf73e9700 1 --2- 172.21.15.31:0/2087254923 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbcf00cd7d0 0x7fbcf00d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.277+0000 7fbcf73e9700 1 -- 172.21.15.31:0/2087254923 >> 172.21.15.31:0/2087254923 conn(0x7fbcf00d18a0 msgr2=0x7fbcf00b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:04.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.277+0000 7fbcf73e9700 1 -- 172.21.15.31:0/2087254923 shutdown_connections 2023-10-09T06:23:04.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.277+0000 7fbcf73e9700 1 -- 172.21.15.31:0/2087254923 wait complete. 2023-10-09T06:23:04.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.278+0000 7fbcf73e9700 1 Processor -- start 2023-10-09T06:23:04.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.278+0000 7fbcf73e9700 1 -- start start 2023-10-09T06:23:04.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf73e9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbcf006a5c0 0x7fbcf015ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:04.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf73e9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbcf00cd7d0 0x7fbcf014c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:04.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf73e9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0157960 0x7fbcf015d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:04.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf73e9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf015f2d0 con 0x7fbcf0157960 2023-10-09T06:23:04.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf73e9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf015dcf0 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf73e9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf015dfd0 con 0x7fbcf006a5c0 2023-10-09T06:23:04.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf5986700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0157960 0x7fbcf015d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf4984700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbcf00cd7d0 0x7fbcf014c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf5986700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0157960 0x7fbcf015d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60580/0 (socket says 172.21.15.31:60580) 2023-10-09T06:23:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf5986700 1 -- 172.21.15.31:0/611873345 learned_addr learned my addr 172.21.15.31:0/611873345 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf5185700 1 --2- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbcf006a5c0 0x7fbcf015ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf4984700 1 -- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbcf006a5c0 msgr2=0x7fbcf015ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf4984700 1 --2- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbcf006a5c0 0x7fbcf015ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf4984700 1 -- 172.21.15.31:0/611873345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0157960 msgr2=0x7fbcf015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf4984700 1 --2- 172.21.15.31:0/611873345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0157960 0x7fbcf015d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.279+0000 7fbcf4984700 1 -- 172.21.15.31:0/611873345 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0009a20 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.280+0000 7fbcf4984700 1 --2- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbcf00cd7d0 0x7fbcf014c920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbce400ea80 tx=0x7fbce40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.280+0000 7fbced7fa700 1 -- 172.21.15.31:0/611873345 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce400eec0 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.280+0000 7fbced7fa700 1 -- 172.21.15.31:0/611873345 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce400c7f0 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.280+0000 7fbcf73e9700 1 -- 172.21.15.31:0/611873345 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf015e2b0 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.280+0000 7fbced7fa700 1 -- 172.21.15.31:0/611873345 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce400cb70 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.280+0000 7fbcf73e9700 1 -- 172.21.15.31:0/611873345 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf0154d40 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.281+0000 7fbcf73e9700 1 -- 172.21.15.31:0/611873345 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf015eab0 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.281+0000 7fbced7fa700 1 -- 172.21.15.31:0/611873345 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbce4013470 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.281+0000 7fbced7fa700 1 --2- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbcdc066f30 0x7fbcdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.282+0000 7fbced7fa700 1 -- 172.21.15.31:0/611873345 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbce4084320 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.282+0000 7fbcf5185700 1 --2- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbcdc066f30 0x7fbcdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.282+0000 7fbcf5185700 1 --2- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbcdc066f30 0x7fbcdc0693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00b15a0 tx=0x7fbce8007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.286+0000 7fbced7fa700 1 -- 172.21.15.31:0/611873345 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcf015eab0 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.477+0000 7fbcf73e9700 1 -- 172.21.15.31:0/611873345 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbcf015eab0 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.965+0000 7fbced7fa700 1 -- 172.21.15.31:0/611873345 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbcf015eab0 con 0x7fbcf00cd7d0 2023-10-09T06:23:04.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.969+0000 7fbcf73e9700 1 -- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbcdc066f30 msgr2=0x7fbcdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:04.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.969+0000 7fbcf73e9700 1 --2- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbcdc066f30 0x7fbcdc0693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00b15a0 tx=0x7fbce8007f50 comp rx=0 tx=0).stop 2023-10-09T06:23:04.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.969+0000 7fbcf73e9700 1 -- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbcf00cd7d0 msgr2=0x7fbcf014c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:04.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.969+0000 7fbcf73e9700 1 --2- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbcf00cd7d0 0x7fbcf014c920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbce400ea80 tx=0x7fbce40091a0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.969+0000 7fbcf73e9700 1 -- 172.21.15.31:0/611873345 shutdown_connections 2023-10-09T06:23:04.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.969+0000 7fbcf73e9700 1 --2- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbcdc066f30 0x7fbcdc0693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.969+0000 7fbcf73e9700 1 --2- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbcf006a5c0 0x7fbcf015ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.969+0000 7fbcf73e9700 1 --2- 172.21.15.31:0/611873345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0157960 0x7fbcf015d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.969+0000 7fbcf73e9700 1 --2- 172.21.15.31:0/611873345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbcf00cd7d0 0x7fbcf014c920 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:04.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.969+0000 7fbcf73e9700 1 -- 172.21.15.31:0/611873345 >> 172.21.15.31:0/611873345 conn(0x7fbcf00d18a0 msgr2=0x7fbcf0156700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:04.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.969+0000 7fbcf73e9700 1 -- 172.21.15.31:0/611873345 shutdown_connections 2023-10-09T06:23:04.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:04.969+0000 7fbcf73e9700 1 -- 172.21.15.31:0/611873345 wait complete. 2023-10-09T06:23:04.971 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-10-09T06:23:04.983 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:23:05.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.110+0000 7fcd90c1c700 1 Processor -- start 2023-10-09T06:23:05.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.110+0000 7fcd90c1c700 1 -- start start 2023-10-09T06:23:05.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.110+0000 7fcd90c1c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcd8c159e60 0x7fcd8c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:05.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.110+0000 7fcd90c1c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd8c15a230 0x7fcd8c0690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:05.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd90c1c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcd8c0695f0 0x7fcd8c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:05.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd90c1c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8c0d1cf0 con 0x7fcd8c159e60 2023-10-09T06:23:05.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd90c1c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8c069a70 con 0x7fcd8c0695f0 2023-10-09T06:23:05.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd90c1c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c15ea90 con 0x7fcd8c15a230 2023-10-09T06:23:05.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcd8c159e60 0x7fcd8c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:05.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcd8c159e60 0x7fcd8c15e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60588/0 (socket says 172.21.15.31:60588) 2023-10-09T06:23:05.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8a59c700 1 -- 172.21.15.31:0/4192256670 learned_addr learned my addr 172.21.15.31:0/4192256670 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:05.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8ad9d700 1 --2- 172.21.15.31:0/4192256670 >> v2:172.21.15.158:3300/0 conn(0x7fcd8c0695f0 0x7fcd8c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:05.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd89d9b700 1 --2- 172.21.15.31:0/4192256670 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd8c15a230 0x7fcd8c0690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:05.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8a59c700 1 -- 172.21.15.31:0/4192256670 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd8c15a230 msgr2=0x7fcd8c0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:05.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8a59c700 1 --2- 172.21.15.31:0/4192256670 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd8c15a230 0x7fcd8c0690b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:05.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8a59c700 1 -- 172.21.15.31:0/4192256670 >> v2:172.21.15.158:3300/0 conn(0x7fcd8c0695f0 msgr2=0x7fcd8c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:05.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8a59c700 1 --2- 172.21.15.31:0/4192256670 >> v2:172.21.15.158:3300/0 conn(0x7fcd8c0695f0 0x7fcd8c0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:05.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8a59c700 1 -- 172.21.15.31:0/4192256670 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c0b3100 con 0x7fcd8c159e60 2023-10-09T06:23:05.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8ad9d700 1 --2- 172.21.15.31:0/4192256670 >> v2:172.21.15.158:3300/0 conn(0x7fcd8c0695f0 0x7fcd8c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:23:05.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd89d9b700 1 --2- 172.21.15.31:0/4192256670 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd8c15a230 0x7fcd8c0690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:23:05.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8a59c700 1 --2- 172.21.15.31:0/4192256670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd8c159e60 0x7fcd8c15e550 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0c7d30 tx=0x7fcd7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa14ea03ddce6ccf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:05.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8959a700 1 -- 172.21.15.31:0/4192256670 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c00b820 con 0x7fcd8c159e60 2023-10-09T06:23:05.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8959a700 1 -- 172.21.15.31:0/4192256670 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c00b980 con 0x7fcd8c159e60 2023-10-09T06:23:05.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.111+0000 7fcd8959a700 1 -- 172.21.15.31:0/4192256670 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c00bd20 con 0x7fcd8c159e60 2023-10-09T06:23:05.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.112+0000 7fcd90c1c700 1 -- 172.21.15.31:0/4192256670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd8c159e60 msgr2=0x7fcd8c15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:05.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.112+0000 7fcd90c1c700 1 --2- 172.21.15.31:0/4192256670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd8c159e60 0x7fcd8c15e550 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0c7d30 tx=0x7fcd7c009250 comp rx=0 tx=0).stop 2023-10-09T06:23:05.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.112+0000 7fcd90c1c700 1 -- 172.21.15.31:0/4192256670 shutdown_connections 2023-10-09T06:23:05.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.112+0000 7fcd90c1c700 1 --2- 172.21.15.31:0/4192256670 >> v2:172.21.15.158:3300/0 conn(0x7fcd8c0695f0 0x7fcd8c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:05.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.112+0000 7fcd90c1c700 1 --2- 172.21.15.31:0/4192256670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd8c159e60 0x7fcd8c15e550 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:05.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.112+0000 7fcd90c1c700 1 --2- 172.21.15.31:0/4192256670 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd8c15a230 0x7fcd8c0690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:05.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.112+0000 7fcd90c1c700 1 -- 172.21.15.31:0/4192256670 >> 172.21.15.31:0/4192256670 conn(0x7fcd8c070700 msgr2=0x7fcd8c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:05.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.112+0000 7fcd90c1c700 1 -- 172.21.15.31:0/4192256670 shutdown_connections 2023-10-09T06:23:05.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.112+0000 7fcd90c1c700 1 -- 172.21.15.31:0/4192256670 wait complete. 2023-10-09T06:23:05.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.113+0000 7fcd90c1c700 1 Processor -- start 2023-10-09T06:23:05.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.113+0000 7fcd90c1c700 1 -- start start 2023-10-09T06:23:05.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd90c1c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd8c0695f0 0x7fcd8c0cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:05.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd90c1c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd8c159e60 0x7fcd8c0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:05.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd90c1c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd8c15a230 0x7fcd8c0b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:05.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd90c1c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c0c88d0 con 0x7fcd8c15a230 2023-10-09T06:23:05.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd90c1c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c15ab30 con 0x7fcd8c159e60 2023-10-09T06:23:05.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd90c1c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c0c8310 con 0x7fcd8c0695f0 2023-10-09T06:23:05.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd8ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd8c15a230 0x7fcd8c0b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:05.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd8ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd8c15a230 0x7fcd8c0b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60598/0 (socket says 172.21.15.31:60598) 2023-10-09T06:23:05.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd8ad9d700 1 -- 172.21.15.31:0/874241394 learned_addr learned my addr 172.21.15.31:0/874241394 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd8a59c700 1 --2- 172.21.15.31:0/874241394 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd8c0695f0 0x7fcd8c0cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd8ad9d700 1 -- 172.21.15.31:0/874241394 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd8c0695f0 msgr2=0x7fcd8c0cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd8ad9d700 1 --2- 172.21.15.31:0/874241394 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd8c0695f0 0x7fcd8c0cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd8ad9d700 1 -- 172.21.15.31:0/874241394 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd8c159e60 msgr2=0x7fcd8c0b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd8ad9d700 1 --2- 172.21.15.31:0/874241394 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd8c159e60 0x7fcd8c0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd8ad9d700 1 -- 172.21.15.31:0/874241394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0094f0 con 0x7fcd8c15a230 2023-10-09T06:23:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.114+0000 7fcd8ad9d700 1 --2- 172.21.15.31:0/874241394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd8c15a230 0x7fcd8c0b5520 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400ce70 tx=0x7fcd840077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.115+0000 7fcd827fc700 1 -- 172.21.15.31:0/874241394 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8400ada0 con 0x7fcd8c15a230 2023-10-09T06:23:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.115+0000 7fcd827fc700 1 -- 172.21.15.31:0/874241394 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84016420 con 0x7fcd8c15a230 2023-10-09T06:23:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.115+0000 7fcd90c1c700 1 -- 172.21.15.31:0/874241394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c0c85f0 con 0x7fcd8c15a230 2023-10-09T06:23:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.115+0000 7fcd827fc700 1 -- 172.21.15.31:0/874241394 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd840167e0 con 0x7fcd8c15a230 2023-10-09T06:23:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.115+0000 7fcd90c1c700 1 -- 172.21.15.31:0/874241394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c0cb1a0 con 0x7fcd8c15a230 2023-10-09T06:23:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.116+0000 7fcd90c1c700 1 -- 172.21.15.31:0/874241394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8c04c3c0 con 0x7fcd8c15a230 2023-10-09T06:23:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.116+0000 7fcd827fc700 1 -- 172.21.15.31:0/874241394 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd84016b50 con 0x7fcd8c15a230 2023-10-09T06:23:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.117+0000 7fcd827fc700 1 --2- 172.21.15.31:0/874241394 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd6c066f30 0x7fcd6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.117+0000 7fcd827fc700 1 -- 172.21.15.31:0/874241394 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fcd84012070 con 0x7fcd8c15a230 2023-10-09T06:23:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.117+0000 7fcd8a59c700 1 --2- 172.21.15.31:0/874241394 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd6c066f30 0x7fcd6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.118+0000 7fcd8a59c700 1 --2- 172.21.15.31:0/874241394 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd6c066f30 0x7fcd6c0693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0c7d30 tx=0x7fcd7c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:05.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.121+0000 7fcd827fc700 1 -- 172.21.15.31:0/874241394 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd8404e5a0 con 0x7fcd8c15a230 2023-10-09T06:23:05.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.316+0000 7fcd90c1c700 1 -- 172.21.15.31:0/874241394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcd8c0b0f80 con 0x7fcd8c15a230 2023-10-09T06:23:05.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.968+0000 7fcd827fc700 1 -- 172.21.15.31:0/874241394 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcd84052020 con 0x7fcd8c15a230 2023-10-09T06:23:05.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.972+0000 7fcd90c1c700 1 -- 172.21.15.31:0/874241394 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd6c066f30 msgr2=0x7fcd6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:05.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.972+0000 7fcd90c1c700 1 --2- 172.21.15.31:0/874241394 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd6c066f30 0x7fcd6c0693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0c7d30 tx=0x7fcd7c017000 comp rx=0 tx=0).stop 2023-10-09T06:23:05.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.972+0000 7fcd90c1c700 1 -- 172.21.15.31:0/874241394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd8c15a230 msgr2=0x7fcd8c0b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:05.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.972+0000 7fcd90c1c700 1 --2- 172.21.15.31:0/874241394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd8c15a230 0x7fcd8c0b5520 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400ce70 tx=0x7fcd840077d0 comp rx=0 tx=0).stop 2023-10-09T06:23:05.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.973+0000 7fcd90c1c700 1 -- 172.21.15.31:0/874241394 shutdown_connections 2023-10-09T06:23:05.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.973+0000 7fcd90c1c700 1 --2- 172.21.15.31:0/874241394 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd6c066f30 0x7fcd6c0693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:05.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.973+0000 7fcd90c1c700 1 --2- 172.21.15.31:0/874241394 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd8c0695f0 0x7fcd8c0cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:05.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.973+0000 7fcd90c1c700 1 --2- 172.21.15.31:0/874241394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd8c15a230 0x7fcd8c0b5520 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:05.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.973+0000 7fcd90c1c700 1 --2- 172.21.15.31:0/874241394 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd8c159e60 0x7fcd8c0b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:05.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.973+0000 7fcd90c1c700 1 -- 172.21.15.31:0/874241394 >> 172.21.15.31:0/874241394 conn(0x7fcd8c070700 msgr2=0x7fcd8c159490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:05.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.978+0000 7fcd90c1c700 1 -- 172.21.15.31:0/874241394 shutdown_connections 2023-10-09T06:23:05.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:05.979+0000 7fcd90c1c700 1 -- 172.21.15.31:0/874241394 wait complete. 2023-10-09T06:23:05.982 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-10-09T06:23:05.995 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:23:06.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.120+0000 7f964857f700 1 Processor -- start 2023-10-09T06:23:06.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.120+0000 7f964857f700 1 -- start start 2023-10-09T06:23:06.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.121+0000 7f964857f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9640159ec0 0x7f96400af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:06.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.121+0000 7f964857f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f964015a290 0x7f96400afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:06.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.121+0000 7f964857f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964006a5a0 0x7f964006aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:06.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.121+0000 7f964857f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964006af60 con 0x7f964015a290 2023-10-09T06:23:06.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.121+0000 7f964857f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96400b0790 con 0x7f9640159ec0 2023-10-09T06:23:06.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.121+0000 7f964857f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96400ce1f0 con 0x7f964006a5a0 2023-10-09T06:23:06.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.121+0000 7f9645b1a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f964015a290 0x7f96400afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:06.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.121+0000 7f9645b1a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f964015a290 0x7f96400afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60608/0 (socket says 172.21.15.31:60608) 2023-10-09T06:23:06.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.121+0000 7f9645b1a700 1 -- 172.21.15.31:0/3775944653 learned_addr learned my addr 172.21.15.31:0/3775944653 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:06.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.121+0000 7f964631b700 1 --2- 172.21.15.31:0/3775944653 >> v2:172.21.15.158:3300/0 conn(0x7f9640159ec0 0x7f96400af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.121+0000 7f9646b1c700 1 --2- 172.21.15.31:0/3775944653 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964006a5a0 0x7f964006aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f9645b1a700 1 -- 172.21.15.31:0/3775944653 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964006a5a0 msgr2=0x7f964006aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f9645b1a700 1 --2- 172.21.15.31:0/3775944653 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964006a5a0 0x7f964006aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f9645b1a700 1 -- 172.21.15.31:0/3775944653 >> v2:172.21.15.158:3300/0 conn(0x7f9640159ec0 msgr2=0x7f96400af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f9645b1a700 1 --2- 172.21.15.31:0/3775944653 >> v2:172.21.15.158:3300/0 conn(0x7f9640159ec0 0x7f96400af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f9645b1a700 1 -- 172.21.15.31:0/3775944653 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96400b0b20 con 0x7f964015a290 2023-10-09T06:23:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f9645b1a700 1 --2- 172.21.15.31:0/3775944653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f964015a290 0x7f96400afe80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f96400898e0 tx=0x7f9634009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ba2ef6cfdf7eb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f9645319700 1 -- 172.21.15.31:0/3775944653 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963400b860 con 0x7f964015a290 2023-10-09T06:23:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f9645319700 1 -- 172.21.15.31:0/3775944653 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963400b9c0 con 0x7f964015a290 2023-10-09T06:23:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f9645319700 1 -- 172.21.15.31:0/3775944653 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963400bd60 con 0x7f964015a290 2023-10-09T06:23:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f964857f700 1 -- 172.21.15.31:0/3775944653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f964015a290 msgr2=0x7f96400afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f964857f700 1 --2- 172.21.15.31:0/3775944653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f964015a290 0x7f96400afe80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f96400898e0 tx=0x7f9634009250 comp rx=0 tx=0).stop 2023-10-09T06:23:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f964857f700 1 -- 172.21.15.31:0/3775944653 shutdown_connections 2023-10-09T06:23:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f964857f700 1 --2- 172.21.15.31:0/3775944653 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964006a5a0 0x7f964006aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f964857f700 1 --2- 172.21.15.31:0/3775944653 >> v2:172.21.15.158:3300/0 conn(0x7f9640159ec0 0x7f96400af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f964857f700 1 --2- 172.21.15.31:0/3775944653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f964015a290 0x7f96400afe80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:06.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f964857f700 1 -- 172.21.15.31:0/3775944653 >> 172.21.15.31:0/3775944653 conn(0x7f96400d1880 msgr2=0x7f96400cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:06.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f964857f700 1 -- 172.21.15.31:0/3775944653 shutdown_connections 2023-10-09T06:23:06.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.122+0000 7f964857f700 1 -- 172.21.15.31:0/3775944653 wait complete. 2023-10-09T06:23:06.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.124+0000 7f964857f700 1 Processor -- start 2023-10-09T06:23:06.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.124+0000 7f964857f700 1 -- start start 2023-10-09T06:23:06.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.124+0000 7f964857f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964006a5a0 0x7f964015ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:06.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.124+0000 7f964857f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9640159ec0 0x7f964015cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:06.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.124+0000 7f964857f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f964015a290 0x7f964016d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:06.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.124+0000 7f964857f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96400b6a70 con 0x7f9640159ec0 2023-10-09T06:23:06.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.124+0000 7f964857f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964015e8d0 con 0x7f964015a290 2023-10-09T06:23:06.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.124+0000 7f964857f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964015dcc0 con 0x7f964006a5a0 2023-10-09T06:23:06.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.124+0000 7f9645b1a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9640159ec0 0x7f964015cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:06.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.124+0000 7f9645b1a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9640159ec0 0x7f964015cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60624/0 (socket says 172.21.15.31:60624) 2023-10-09T06:23:06.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.124+0000 7f9645b1a700 1 -- 172.21.15.31:0/3836690215 learned_addr learned my addr 172.21.15.31:0/3836690215 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:06.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.124+0000 7f964631b700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964006a5a0 0x7f964015ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:06.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.125+0000 7f9646b1c700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f964015a290 0x7f964016d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:06.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.125+0000 7f9645b1a700 1 -- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964006a5a0 msgr2=0x7f964015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:06.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.125+0000 7f9645b1a700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964006a5a0 0x7f964015ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.125+0000 7f9645b1a700 1 -- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f964015a290 msgr2=0x7f964016d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.125+0000 7f9645b1a700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f964015a290 0x7f964016d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.125+0000 7f9645b1a700 1 -- 172.21.15.31:0/3836690215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96340094f0 con 0x7f9640159ec0 2023-10-09T06:23:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.125+0000 7f9646b1c700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f964015a290 0x7f964016d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:23:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.125+0000 7f9645b1a700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9640159ec0 0x7f964015cec0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9640071eb0 tx=0x7f9634017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.125+0000 7f963e7fc700 1 -- 172.21.15.31:0/3836690215 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963401a450 con 0x7f9640159ec0 2023-10-09T06:23:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.125+0000 7f963e7fc700 1 -- 172.21.15.31:0/3836690215 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963401a5b0 con 0x7f9640159ec0 2023-10-09T06:23:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.125+0000 7f964857f700 1 -- 172.21.15.31:0/3836690215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964015dfa0 con 0x7f9640159ec0 2023-10-09T06:23:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.125+0000 7f963e7fc700 1 -- 172.21.15.31:0/3836690215 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963401a970 con 0x7f9640159ec0 2023-10-09T06:23:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.125+0000 7f964857f700 1 -- 172.21.15.31:0/3836690215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964015e560 con 0x7f9640159ec0 2023-10-09T06:23:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.126+0000 7f964857f700 1 -- 172.21.15.31:0/3836690215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964015ea60 con 0x7f9640159ec0 2023-10-09T06:23:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.127+0000 7f963e7fc700 1 -- 172.21.15.31:0/3836690215 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f963401ad20 con 0x7f9640159ec0 2023-10-09T06:23:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.127+0000 7f963e7fc700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f962c066f30 0x7f962c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.127+0000 7f963e7fc700 1 -- 172.21.15.31:0/3836690215 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f9634086090 con 0x7f9640159ec0 2023-10-09T06:23:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.127+0000 7f964631b700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f962c066f30 0x7f962c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.128+0000 7f964631b700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f962c066f30 0x7f962c0693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9638009fd0 tx=0x7f9638009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.132+0000 7f963e7fc700 1 -- 172.21.15.31:0/3836690215 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9634053360 con 0x7f9640159ec0 2023-10-09T06:23:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.368+0000 7f964857f700 1 -- 172.21.15.31:0/3836690215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f964004c3c0 con 0x7f9640159ec0 2023-10-09T06:23:06.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-09T06:23:06.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.973+0000 7f963e7fc700 1 -- 172.21.15.31:0/3836690215 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v30) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9634056980 con 0x7f9640159ec0 2023-10-09T06:23:06.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.978+0000 7f964857f700 1 -- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f962c066f30 msgr2=0x7f962c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:06.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.978+0000 7f964857f700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f962c066f30 0x7f962c0693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9638009fd0 tx=0x7f9638009880 comp rx=0 tx=0).stop 2023-10-09T06:23:06.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.978+0000 7f964857f700 1 -- 172.21.15.31:0/3836690215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9640159ec0 msgr2=0x7f964015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:06.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.978+0000 7f964857f700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9640159ec0 0x7f964015cec0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9640071eb0 tx=0x7f9634017000 comp rx=0 tx=0).stop 2023-10-09T06:23:06.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.979+0000 7f964857f700 1 -- 172.21.15.31:0/3836690215 shutdown_connections 2023-10-09T06:23:06.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.979+0000 7f964857f700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f962c066f30 0x7f962c0693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:06.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.979+0000 7f964857f700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f964006a5a0 0x7f964015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:06.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.979+0000 7f964857f700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f964015a290 0x7f964016d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:06.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.979+0000 7f964857f700 1 --2- 172.21.15.31:0/3836690215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9640159ec0 0x7f964015cec0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:06.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.979+0000 7f964857f700 1 -- 172.21.15.31:0/3836690215 >> 172.21.15.31:0/3836690215 conn(0x7f96400d1880 msgr2=0x7f96400cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:06.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.979+0000 7f964857f700 1 -- 172.21.15.31:0/3836690215 shutdown_connections 2023-10-09T06:23:06.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:06.979+0000 7f964857f700 1 -- 172.21.15.31:0/3836690215 wait complete. 2023-10-09T06:23:06.981 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 8 and data pool 9 2023-10-09T06:23:06.993 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:23:07.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.113+0000 7fe11b039700 1 Processor -- start 2023-10-09T06:23:07.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.113+0000 7fe11b039700 1 -- start start 2023-10-09T06:23:07.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe11b039700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe11415a2b0 0x7fe1140b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe11b039700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1140d1c30 0x7fe1140cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe11b039700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe11415a680 0x7fe1140cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe11b039700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe114068470 con 0x7fe11415a2b0 2023-10-09T06:23:07.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe11b039700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1140c5d80 con 0x7fe11415a680 2023-10-09T06:23:07.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe11b039700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1140c6060 con 0x7fe1140d1c30 2023-10-09T06:23:07.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe118dd5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe11415a2b0 0x7fe1140b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe118dd5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe11415a2b0 0x7fe1140b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60640/0 (socket says 172.21.15.31:60640) 2023-10-09T06:23:07.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe118dd5700 1 -- 172.21.15.31:0/52413703 learned_addr learned my addr 172.21.15.31:0/52413703 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:07.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe1195d6700 1 --2- 172.21.15.31:0/52413703 >> v2:172.21.15.158:3300/0 conn(0x7fe11415a680 0x7fe1140cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe113fff700 1 --2- 172.21.15.31:0/52413703 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1140d1c30 0x7fe1140cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe118dd5700 1 -- 172.21.15.31:0/52413703 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1140d1c30 msgr2=0x7fe1140cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:07.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe118dd5700 1 --2- 172.21.15.31:0/52413703 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1140d1c30 0x7fe1140cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe118dd5700 1 -- 172.21.15.31:0/52413703 >> v2:172.21.15.158:3300/0 conn(0x7fe11415a680 msgr2=0x7fe1140cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:07.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe118dd5700 1 --2- 172.21.15.31:0/52413703 >> v2:172.21.15.158:3300/0 conn(0x7fe11415a680 0x7fe1140cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe118dd5700 1 -- 172.21.15.31:0/52413703 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1140c6340 con 0x7fe11415a2b0 2023-10-09T06:23:07.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe1195d6700 1 --2- 172.21.15.31:0/52413703 >> v2:172.21.15.158:3300/0 conn(0x7fe11415a680 0x7fe1140cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:23:07.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.114+0000 7fe118dd5700 1 --2- 172.21.15.31:0/52413703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe11415a2b0 0x7fe1140b3da0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe11408a810 tx=0x7fe108009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3c423a7d4fc829 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:07.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.115+0000 7fe1137fe700 1 -- 172.21.15.31:0/52413703 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108005c10 con 0x7fe11415a2b0 2023-10-09T06:23:07.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.115+0000 7fe1137fe700 1 -- 172.21.15.31:0/52413703 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe108005d70 con 0x7fe11415a2b0 2023-10-09T06:23:07.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.115+0000 7fe1137fe700 1 -- 172.21.15.31:0/52413703 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10800b880 con 0x7fe11415a2b0 2023-10-09T06:23:07.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.115+0000 7fe11b039700 1 -- 172.21.15.31:0/52413703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe11415a2b0 msgr2=0x7fe1140b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.115+0000 7fe11b039700 1 --2- 172.21.15.31:0/52413703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe11415a2b0 0x7fe1140b3da0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe11408a810 tx=0x7fe108009220 comp rx=0 tx=0).stop 2023-10-09T06:23:07.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.115+0000 7fe11b039700 1 -- 172.21.15.31:0/52413703 shutdown_connections 2023-10-09T06:23:07.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.115+0000 7fe11b039700 1 --2- 172.21.15.31:0/52413703 >> v2:172.21.15.158:3300/0 conn(0x7fe11415a680 0x7fe1140cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.115+0000 7fe11b039700 1 --2- 172.21.15.31:0/52413703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe11415a2b0 0x7fe1140b3da0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.115+0000 7fe11b039700 1 --2- 172.21.15.31:0/52413703 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe1140d1c30 0x7fe1140cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.115+0000 7fe11b039700 1 -- 172.21.15.31:0/52413703 >> 172.21.15.31:0/52413703 conn(0x7fe114067e40 msgr2=0x7fe1140d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:07.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.115+0000 7fe11b039700 1 -- 172.21.15.31:0/52413703 shutdown_connections 2023-10-09T06:23:07.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.115+0000 7fe11b039700 1 -- 172.21.15.31:0/52413703 wait complete. 2023-10-09T06:23:07.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.116+0000 7fe11b039700 1 Processor -- start 2023-10-09T06:23:07.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.116+0000 7fe11b039700 1 -- start start 2023-10-09T06:23:07.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.117+0000 7fe11b039700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1140d1c30 0x7fe1140c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.117+0000 7fe11b039700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe11415a2b0 0x7fe1140c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.117+0000 7fe11b039700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe11415a680 0x7fe1140ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.117+0000 7fe11b039700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11415d530 con 0x7fe11415a2b0 2023-10-09T06:23:07.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.117+0000 7fe11b039700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe114160590 con 0x7fe1140d1c30 2023-10-09T06:23:07.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.117+0000 7fe11b039700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11415c920 con 0x7fe11415a680 2023-10-09T06:23:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.117+0000 7fe113fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe11415a2b0 0x7fe1140c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.117+0000 7fe113fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe11415a2b0 0x7fe1140c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60648/0 (socket says 172.21.15.31:60648) 2023-10-09T06:23:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.117+0000 7fe113fff700 1 -- 172.21.15.31:0/305590974 learned_addr learned my addr 172.21.15.31:0/305590974 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.117+0000 7fe118dd5700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1140d1c30 0x7fe1140c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.117+0000 7fe1195d6700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe11415a680 0x7fe1140ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.118+0000 7fe113fff700 1 -- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe11415a680 msgr2=0x7fe1140ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.118+0000 7fe113fff700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe11415a680 0x7fe1140ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.118+0000 7fe113fff700 1 -- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1140d1c30 msgr2=0x7fe1140c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.118+0000 7fe113fff700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1140d1c30 0x7fe1140c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.118+0000 7fe113fff700 1 -- 172.21.15.31:0/305590974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108009480 con 0x7fe11415a2b0 2023-10-09T06:23:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.118+0000 7fe113fff700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe11415a2b0 0x7fe1140c9bf0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe10000c880 tx=0x7fe100008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:07.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.118+0000 7fe110ff9700 1 -- 172.21.15.31:0/305590974 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100011600 con 0x7fe11415a2b0 2023-10-09T06:23:07.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.118+0000 7fe110ff9700 1 -- 172.21.15.31:0/305590974 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe100011760 con 0x7fe11415a2b0 2023-10-09T06:23:07.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.118+0000 7fe11b039700 1 -- 172.21.15.31:0/305590974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11415cc00 con 0x7fe11415a2b0 2023-10-09T06:23:07.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.118+0000 7fe110ff9700 1 -- 172.21.15.31:0/305590974 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100011b20 con 0x7fe11415a2b0 2023-10-09T06:23:07.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.118+0000 7fe11b039700 1 -- 172.21.15.31:0/305590974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11415d1c0 con 0x7fe11415a2b0 2023-10-09T06:23:07.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.119+0000 7fe11b039700 1 -- 172.21.15.31:0/305590974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11404c3c0 con 0x7fe11415a2b0 2023-10-09T06:23:07.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.120+0000 7fe110ff9700 1 -- 172.21.15.31:0/305590974 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1000193b0 con 0x7fe11415a2b0 2023-10-09T06:23:07.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.120+0000 7fe110ff9700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe0f8066f30 0x7fe0f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.120+0000 7fe110ff9700 1 -- 172.21.15.31:0/305590974 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe100084700 con 0x7fe11415a2b0 2023-10-09T06:23:07.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.120+0000 7fe118dd5700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe0f8066f30 0x7fe0f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.121+0000 7fe118dd5700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe0f8066f30 0x7fe0f80693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe108009260 tx=0x7fe108016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:07.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.124+0000 7fe110ff9700 1 -- 172.21.15.31:0/305590974 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe100051970 con 0x7fe11415a2b0 2023-10-09T06:23:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.317+0000 7fe11b039700 1 -- 172.21.15.31:0/305590974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1140d0480 con 0x7fe11415a2b0 2023-10-09T06:23:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.318+0000 7fe110ff9700 1 -- 172.21.15.31:0/305590974 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fe100054f90 con 0x7fe11415a2b0 2023-10-09T06:23:07.319 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:23:07.319 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":64,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:23:06.369752+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:23:04.509059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T06:23:05.346720+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:23:07.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.320+0000 7fe11b039700 1 -- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe0f8066f30 msgr2=0x7fe0f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.320+0000 7fe11b039700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe0f8066f30 0x7fe0f80693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe108009260 tx=0x7fe108016000 comp rx=0 tx=0).stop 2023-10-09T06:23:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.320+0000 7fe11b039700 1 -- 172.21.15.31:0/305590974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe11415a2b0 msgr2=0x7fe1140c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.320+0000 7fe11b039700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe11415a2b0 0x7fe1140c9bf0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe10000c880 tx=0x7fe100008040 comp rx=0 tx=0).stop 2023-10-09T06:23:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.320+0000 7fe11b039700 1 -- 172.21.15.31:0/305590974 shutdown_connections 2023-10-09T06:23:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.320+0000 7fe11b039700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe0f8066f30 0x7fe0f80693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.320+0000 7fe11b039700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe11415a680 0x7fe1140ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.320+0000 7fe11b039700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1140d1c30 0x7fe1140c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.320+0000 7fe11b039700 1 --2- 172.21.15.31:0/305590974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe11415a2b0 0x7fe1140c9bf0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.320+0000 7fe11b039700 1 -- 172.21.15.31:0/305590974 >> 172.21.15.31:0/305590974 conn(0x7fe114067e40 msgr2=0x7fe1140d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.320+0000 7fe11b039700 1 -- 172.21.15.31:0/305590974 shutdown_connections 2023-10-09T06:23:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.320+0000 7fe11b039700 1 -- 172.21.15.31:0/305590974 wait complete. 2023-10-09T06:23:07.333 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:23:07.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.451+0000 7fac513a2700 1 Processor -- start 2023-10-09T06:23:07.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.451+0000 7fac513a2700 1 -- start start 2023-10-09T06:23:07.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.452+0000 7fac513a2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fac4c0c75c0 0x7fac4c0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.452+0000 7fac513a2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fac4c0abeb0 0x7fac4c0c8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.452+0000 7fac513a2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4c0c9cb0 con 0x7fac4c0abae0 2023-10-09T06:23:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.452+0000 7fac513a2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4c0c8e80 con 0x7fac4c0c75c0 2023-10-09T06:23:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.452+0000 7fac513a2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4c0c90a0 con 0x7fac4c0abeb0 2023-10-09T06:23:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.452+0000 7fac4a7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fac4c0c75c0 0x7fac4c0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.452+0000 7fac4affd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fac4c0abae0 0x7fac4c0c6eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53846/0 (socket says 172.21.15.31:53846) 2023-10-09T06:23:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.452+0000 7fac4affd700 1 -- 172.21.15.31:0/802102672 learned_addr learned my addr 172.21.15.31:0/802102672 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:23:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.452+0000 7fac4a7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fac4c0c75c0 0x7fac4c0c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60658/0 (socket says 172.21.15.31:60658) 2023-10-09T06:23:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.453+0000 7fac4b7fe700 1 --2- 172.21.15.31:0/802102672 >> v2:172.21.15.158:3300/0 conn(0x7fac4c0abeb0 0x7fac4c0c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.453+0000 7fac4a7fc700 1 -- 172.21.15.31:0/802102672 >> v2:172.21.15.158:3300/0 conn(0x7fac4c0abeb0 msgr2=0x7fac4c0c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.453+0000 7fac4a7fc700 1 --2- 172.21.15.31:0/802102672 >> v2:172.21.15.158:3300/0 conn(0x7fac4c0abeb0 0x7fac4c0c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.453+0000 7fac4a7fc700 1 -- 172.21.15.31:0/802102672 >> v1:172.21.15.31:6789/0 conn(0x7fac4c0abae0 legacy=0x7fac4c0c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.453+0000 7fac4a7fc700 1 -- 172.21.15.31:0/802102672 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c0c9380 con 0x7fac4c0c75c0 2023-10-09T06:23:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.453+0000 7fac49ffb700 1 -- 172.21.15.31:0/802102672 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764808242 0 0) 0x7fac4c0c9cb0 con 0x7fac4c0abae0 2023-10-09T06:23:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.453+0000 7fac4a7fc700 1 --2- 172.21.15.31:0/802102672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4c0c75c0 0x7fac4c0c8400 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fac4c06ccd0 tx=0x7fac340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb33f433b2ff06d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.453+0000 7fac49ffb700 1 -- 172.21.15.31:0/802102672 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3400b6b0 con 0x7fac4c0c75c0 2023-10-09T06:23:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.453+0000 7fac49ffb700 1 -- 172.21.15.31:0/802102672 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3400b810 con 0x7fac4c0c75c0 2023-10-09T06:23:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.453+0000 7fac49ffb700 1 -- 172.21.15.31:0/802102672 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3400bbb0 con 0x7fac4c0c75c0 2023-10-09T06:23:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.453+0000 7fac513a2700 1 -- 172.21.15.31:0/802102672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4c0c75c0 msgr2=0x7fac4c0c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.453+0000 7fac513a2700 1 --2- 172.21.15.31:0/802102672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4c0c75c0 0x7fac4c0c8400 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fac4c06ccd0 tx=0x7fac340091a0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.454+0000 7fac513a2700 1 -- 172.21.15.31:0/802102672 shutdown_connections 2023-10-09T06:23:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.454+0000 7fac513a2700 1 --2- 172.21.15.31:0/802102672 >> v2:172.21.15.158:3300/0 conn(0x7fac4c0abeb0 0x7fac4c0c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.454+0000 7fac513a2700 1 --2- 172.21.15.31:0/802102672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4c0c75c0 0x7fac4c0c8400 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.454+0000 7fac513a2700 1 -- 172.21.15.31:0/802102672 >> 172.21.15.31:0/802102672 conn(0x7fac4c067660 msgr2=0x7fac4c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.454+0000 7fac513a2700 1 -- 172.21.15.31:0/802102672 shutdown_connections 2023-10-09T06:23:07.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.454+0000 7fac513a2700 1 -- 172.21.15.31:0/802102672 wait complete. 2023-10-09T06:23:07.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.455+0000 7fac513a2700 1 Processor -- start 2023-10-09T06:23:07.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.455+0000 7fac513a2700 1 -- start start 2023-10-09T06:23:07.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac513a2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fac4c0abae0 0x7fac4c1458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac513a2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4c0abeb0 0x7fac4c0c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac513a2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac4c0c75c0 0x7fac4c0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac513a2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0c4d20 con 0x7fac4c0abeb0 2023-10-09T06:23:07.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac513a2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0c2bc0 con 0x7fac4c0c75c0 2023-10-09T06:23:07.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac513a2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0c2ea0 con 0x7fac4c0abae0 2023-10-09T06:23:07.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac4a7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4c0abeb0 0x7fac4c0c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac4a7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4c0abeb0 0x7fac4c0c21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60662/0 (socket says 172.21.15.31:60662) 2023-10-09T06:23:07.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac4a7fc700 1 -- 172.21.15.31:0/2334718179 learned_addr learned my addr 172.21.15.31:0/2334718179 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:07.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac4b7fe700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac4c0c75c0 0x7fac4c0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac4a7fc700 1 -- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fac4c0abae0 msgr2=0x7fac4c1458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac4affd700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fac4c0abae0 0x7fac4c1458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac4a7fc700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fac4c0abae0 0x7fac4c1458e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac4a7fc700 1 -- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac4c0c75c0 msgr2=0x7fac4c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac4a7fc700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac4c0c75c0 0x7fac4c0b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac4a7fc700 1 -- 172.21.15.31:0/2334718179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac34009420 con 0x7fac4c0abeb0 2023-10-09T06:23:07.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac4a7fc700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4c0abeb0 0x7fac4c0c21e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fac34013000 tx=0x7fac34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac42ffd700 1 -- 172.21.15.31:0/2334718179 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34011420 con 0x7fac4c0abeb0 2023-10-09T06:23:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac42ffd700 1 -- 172.21.15.31:0/2334718179 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac34011580 con 0x7fac4c0abeb0 2023-10-09T06:23:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac513a2700 1 -- 172.21.15.31:0/2334718179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c0c3180 con 0x7fac4c0abeb0 2023-10-09T06:23:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac42ffd700 1 -- 172.21.15.31:0/2334718179 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34011940 con 0x7fac4c0abeb0 2023-10-09T06:23:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.456+0000 7fac513a2700 1 -- 172.21.15.31:0/2334718179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4c145e20 con 0x7fac4c0abeb0 2023-10-09T06:23:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.457+0000 7fac513a2700 1 -- 172.21.15.31:0/2334718179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4c0c4ed0 con 0x7fac4c0abeb0 2023-10-09T06:23:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.458+0000 7fac42ffd700 1 -- 172.21.15.31:0/2334718179 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac34011d30 con 0x7fac4c0abeb0 2023-10-09T06:23:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.458+0000 7fac42ffd700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fac2c066f30 0x7fac2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.458+0000 7fac42ffd700 1 -- 172.21.15.31:0/2334718179 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac34085f80 con 0x7fac4c0abeb0 2023-10-09T06:23:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.458+0000 7fac4affd700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fac2c066f30 0x7fac2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.459+0000 7fac4affd700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fac2c066f30 0x7fac2c0693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fac3c002180 tx=0x7fac3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:07.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.462+0000 7fac42ffd700 1 -- 172.21.15.31:0/2334718179 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac340b75a0 con 0x7fac4c0abeb0 2023-10-09T06:23:07.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.655+0000 7fac513a2700 1 -- 172.21.15.31:0/2334718179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac4c04c3c0 con 0x7fac4c0abeb0 2023-10-09T06:23:07.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.656+0000 7fac42ffd700 1 -- 172.21.15.31:0/2334718179 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fac4c0c4ed0 con 0x7fac4c0abeb0 2023-10-09T06:23:07.658 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:23:07.658 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":64,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:23:06.369752+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:23:04.509059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T06:23:05.346720+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:23:07.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.658+0000 7fac513a2700 1 -- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fac2c066f30 msgr2=0x7fac2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.658+0000 7fac513a2700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fac2c066f30 0x7fac2c0693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fac3c002180 tx=0x7fac3c009040 comp rx=0 tx=0).stop 2023-10-09T06:23:07.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.658+0000 7fac513a2700 1 -- 172.21.15.31:0/2334718179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4c0abeb0 msgr2=0x7fac4c0c21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.658+0000 7fac513a2700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4c0abeb0 0x7fac4c0c21e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fac34013000 tx=0x7fac34017000 comp rx=0 tx=0).stop 2023-10-09T06:23:07.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.658+0000 7fac513a2700 1 -- 172.21.15.31:0/2334718179 shutdown_connections 2023-10-09T06:23:07.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.658+0000 7fac513a2700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fac2c066f30 0x7fac2c0693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.658+0000 7fac513a2700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fac4c0abae0 0x7fac4c1458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.658+0000 7fac513a2700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac4c0c75c0 0x7fac4c0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.658+0000 7fac513a2700 1 --2- 172.21.15.31:0/2334718179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4c0abeb0 0x7fac4c0c21e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.658+0000 7fac513a2700 1 -- 172.21.15.31:0/2334718179 >> 172.21.15.31:0/2334718179 conn(0x7fac4c067660 msgr2=0x7fac4c159b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:07.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.658+0000 7fac513a2700 1 -- 172.21.15.31:0/2334718179 shutdown_connections 2023-10-09T06:23:07.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.658+0000 7fac513a2700 1 -- 172.21.15.31:0/2334718179 wait complete. 2023-10-09T06:23:07.672 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:23:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.793+0000 7f1d03d32700 1 Processor -- start 2023-10-09T06:23:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.793+0000 7f1d03d32700 1 -- start start 2023-10-09T06:23:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.794+0000 7f1d03d32700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1cfc0b3570 0x7f1cfc15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.794+0000 7f1d03d32700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cfc0b14f0 con 0x7f1cfc0b4860 2023-10-09T06:23:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.794+0000 7f1d03d32700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cfc0b17d0 con 0x7f1cfc0b4c30 2023-10-09T06:23:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.794+0000 7f1d03d32700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cfc0b1ab0 con 0x7f1cfc0b3570 2023-10-09T06:23:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.794+0000 7f1d01ace700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1cfc0b4860 0x7f1cfc159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53856/0 (socket says 172.21.15.31:53856) 2023-10-09T06:23:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.794+0000 7f1d01ace700 1 -- 172.21.15.31:0/1201276345 learned_addr learned my addr 172.21.15.31:0/1201276345 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:23:07.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.794+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759509888 0 0) 0x7f1cfc0b14f0 con 0x7f1cfc0b4860 2023-10-09T06:23:07.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce4003570 con 0x7f1cfc0b4860 2023-10-09T06:23:07.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d012cd700 1 --2- 172.21.15.31:0/1201276345 >> v2:172.21.15.158:3300/0 conn(0x7f1cfc0b3570 0x7f1cfc15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3702848896 0 0) 0x7f1ce4003570 con 0x7f1cfc0b4860 2023-10-09T06:23:07.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 >> v2:172.21.15.158:3300/0 conn(0x7f1cfc0b3570 msgr2=0x7f1cfc15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:07.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 --2- 172.21.15.31:0/1201276345 >> v2:172.21.15.158:3300/0 conn(0x7f1cfc0b3570 0x7f1cfc15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 >> v1:172.21.15.158:6789/0 conn(0x7f1cfc0b4c30 legacy=0x7f1cfc0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc0b1d90 con 0x7f1cfc0b4860 2023-10-09T06:23:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f1cf40015f0 con 0x7f1cfc0b4860 2023-10-09T06:23:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 >> v1:172.21.15.31:6789/0 conn(0x7f1cfc0b4860 legacy=0x7f1cfc159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 --2- 172.21.15.31:0/1201276345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ce4003a60 0x7f1ce4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 --2- 172.21.15.31:0/1201276345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ce4004810 0x7f1ce4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 --2- 172.21.15.31:0/1201276345 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ce40052e0 0x7f1ce400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc0b1ab0 con 0x7f1ce4003a60 2023-10-09T06:23:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce400c190 con 0x7f1ce4004810 2023-10-09T06:23:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce400c350 con 0x7f1ce40052e0 2023-10-09T06:23:07.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d012cd700 1 --2- 172.21.15.31:0/1201276345 >> v2:172.21.15.158:3300/0 conn(0x7f1cfc0b3570 0x7f1cfc15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:23:07.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d01ace700 1 --2- 172.21.15.31:0/1201276345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ce4003a60 0x7f1ce4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d012cd700 1 --2- 172.21.15.31:0/1201276345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ce4004810 0x7f1ce4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d022cf700 1 --2- 172.21.15.31:0/1201276345 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ce40052e0 0x7f1ce400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d01ace700 1 -- 172.21.15.31:0/1201276345 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ce40052e0 msgr2=0x7f1ce400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:07.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d01ace700 1 --2- 172.21.15.31:0/1201276345 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ce40052e0 0x7f1ce400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d01ace700 1 -- 172.21.15.31:0/1201276345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ce4004810 msgr2=0x7f1ce4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:07.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d01ace700 1 --2- 172.21.15.31:0/1201276345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ce4004810 0x7f1ce4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d01ace700 1 -- 172.21.15.31:0/1201276345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4003570 con 0x7f1ce4003a60 2023-10-09T06:23:07.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d012cd700 1 --2- 172.21.15.31:0/1201276345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ce4004810 0x7f1ce4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:23:07.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d022cf700 1 -- 172.21.15.31:0/1201276345 reap_dead start 2023-10-09T06:23:07.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.795+0000 7f1d01ace700 1 --2- 172.21.15.31:0/1201276345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ce4003a60 0x7f1ce4003e70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400c3c0 tx=0x7f1cf4007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe11106e2c5b2230 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:07.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.796+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400cc90 con 0x7f1ce4003a60 2023-10-09T06:23:07.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.796+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf400ce10 con 0x7f1ce4003a60 2023-10-09T06:23:07.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.796+0000 7f1d00acc700 1 -- 172.21.15.31:0/1201276345 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4007320 con 0x7f1ce4003a60 2023-10-09T06:23:07.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.796+0000 7f1d03d32700 1 -- 172.21.15.31:0/1201276345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ce4003a60 msgr2=0x7f1ce4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.796+0000 7f1d03d32700 1 --2- 172.21.15.31:0/1201276345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ce4003a60 0x7f1ce4003e70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400c3c0 tx=0x7f1cf4007920 comp rx=0 tx=0).stop 2023-10-09T06:23:07.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.796+0000 7f1d03d32700 1 -- 172.21.15.31:0/1201276345 shutdown_connections 2023-10-09T06:23:07.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.796+0000 7f1d03d32700 1 --2- 172.21.15.31:0/1201276345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ce4003a60 0x7f1ce4003e70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.796+0000 7f1d03d32700 1 -- 172.21.15.31:0/1201276345 >> 172.21.15.31:0/1201276345 conn(0x7f1cfc09a0f0 msgr2=0x7f1cfc067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:07.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.796+0000 7f1d03d32700 1 -- 172.21.15.31:0/1201276345 shutdown_connections 2023-10-09T06:23:07.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.796+0000 7f1d03d32700 1 -- 172.21.15.31:0/1201276345 wait complete. 2023-10-09T06:23:07.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.797+0000 7f1d03d32700 1 Processor -- start 2023-10-09T06:23:07.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.797+0000 7f1d03d32700 1 -- start start 2023-10-09T06:23:07.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d03d32700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ce4003a60 0x7f1cfc0adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d03d32700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cfc0afd30 0x7f1cfc09d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d03d32700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cfc0aa6c0 0x7f1cfc15bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d03d32700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc09d080 con 0x7f1ce4003a60 2023-10-09T06:23:07.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d03d32700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc0ae700 con 0x7f1cfc0aa6c0 2023-10-09T06:23:07.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d03d32700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc0ae140 con 0x7f1cfc0afd30 2023-10-09T06:23:07.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d01ace700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ce4003a60 0x7f1cfc0adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d01ace700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ce4003a60 0x7f1cfc0adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60690/0 (socket says 172.21.15.31:60690) 2023-10-09T06:23:07.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d01ace700 1 -- 172.21.15.31:0/2952611917 learned_addr learned my addr 172.21.15.31:0/2952611917 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:07.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d01ace700 1 -- 172.21.15.31:0/2952611917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cfc0afd30 msgr2=0x7f1cfc09d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d01ace700 1 --2- 172.21.15.31:0/2952611917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cfc0afd30 0x7f1cfc09d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d022cf700 1 --2- 172.21.15.31:0/2952611917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cfc0aa6c0 0x7f1cfc15bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d01ace700 1 -- 172.21.15.31:0/2952611917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cfc0aa6c0 msgr2=0x7f1cfc15bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:07.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d01ace700 1 --2- 172.21.15.31:0/2952611917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cfc0aa6c0 0x7f1cfc15bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:07.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.798+0000 7f1d01ace700 1 -- 172.21.15.31:0/2952611917 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc0ae420 con 0x7f1ce4003a60 2023-10-09T06:23:07.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.799+0000 7f1d01ace700 1 --2- 172.21.15.31:0/2952611917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ce4003a60 0x7f1cfc0adb40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400c9b0 tx=0x7f1cf4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:07.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.799+0000 7f1cf9ffb700 1 -- 172.21.15.31:0/2952611917 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4022070 con 0x7f1ce4003a60 2023-10-09T06:23:07.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.799+0000 7f1cf9ffb700 1 -- 172.21.15.31:0/2952611917 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf400cc90 con 0x7f1ce4003a60 2023-10-09T06:23:07.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.799+0000 7f1d03d32700 1 -- 172.21.15.31:0/2952611917 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cfc09cd10 con 0x7f1ce4003a60 2023-10-09T06:23:07.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.799+0000 7f1cf9ffb700 1 -- 172.21.15.31:0/2952611917 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4005c50 con 0x7f1ce4003a60 2023-10-09T06:23:07.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.799+0000 7f1d03d32700 1 -- 172.21.15.31:0/2952611917 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cfc09da50 con 0x7f1ce4003a60 2023-10-09T06:23:07.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.800+0000 7f1d03d32700 1 -- 172.21.15.31:0/2952611917 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cfc09cb70 con 0x7f1ce4003a60 2023-10-09T06:23:07.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.800+0000 7f1cf9ffb700 1 -- 172.21.15.31:0/2952611917 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cf401e430 con 0x7f1ce4003a60 2023-10-09T06:23:07.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.801+0000 7f1cf9ffb700 1 --2- 172.21.15.31:0/2952611917 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ce8066f30 0x7f1ce80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:07.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.801+0000 7f1cf9ffb700 1 -- 172.21.15.31:0/2952611917 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1cf4085780 con 0x7f1ce4003a60 2023-10-09T06:23:07.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.801+0000 7f1d012cd700 1 --2- 172.21.15.31:0/2952611917 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ce8066f30 0x7f1ce80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:07.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.802+0000 7f1d012cd700 1 --2- 172.21.15.31:0/2952611917 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ce8066f30 0x7f1ce80693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0006dc0 tx=0x7f1cf0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:07.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:07.805+0000 7f1cf9ffb700 1 -- 172.21.15.31:0/2952611917 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cfc09cb70 con 0x7f1ce4003a60 2023-10-09T06:23:08.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.048+0000 7f1d03d32700 1 -- 172.21.15.31:0/2952611917 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1cfc09cb70 con 0x7f1ce4003a60 2023-10-09T06:23:08.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.981+0000 7f1cf9ffb700 1 -- 172.21.15.31:0/2952611917 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1cfc09cb70 con 0x7f1ce4003a60 2023-10-09T06:23:08.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.984+0000 7f1d03d32700 1 -- 172.21.15.31:0/2952611917 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ce8066f30 msgr2=0x7f1ce80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:08.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.984+0000 7f1d03d32700 1 --2- 172.21.15.31:0/2952611917 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ce8066f30 0x7f1ce80693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0006dc0 tx=0x7f1cf0008040 comp rx=0 tx=0).stop 2023-10-09T06:23:08.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.984+0000 7f1d03d32700 1 -- 172.21.15.31:0/2952611917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ce4003a60 msgr2=0x7f1cfc0adb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:08.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.984+0000 7f1d03d32700 1 --2- 172.21.15.31:0/2952611917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ce4003a60 0x7f1cfc0adb40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400c9b0 tx=0x7f1cf4015000 comp rx=0 tx=0).stop 2023-10-09T06:23:08.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.984+0000 7f1d03d32700 1 -- 172.21.15.31:0/2952611917 shutdown_connections 2023-10-09T06:23:08.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.984+0000 7f1d03d32700 1 --2- 172.21.15.31:0/2952611917 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ce8066f30 0x7f1ce80693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:08.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.984+0000 7f1d03d32700 1 --2- 172.21.15.31:0/2952611917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cfc0aa6c0 0x7f1cfc15bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:08.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.984+0000 7f1d03d32700 1 --2- 172.21.15.31:0/2952611917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ce4003a60 0x7f1cfc0adb40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:08.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.984+0000 7f1d03d32700 1 --2- 172.21.15.31:0/2952611917 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1cfc0afd30 0x7f1cfc09d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:08.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.984+0000 7f1d03d32700 1 -- 172.21.15.31:0/2952611917 >> 172.21.15.31:0/2952611917 conn(0x7f1cfc09a0f0 msgr2=0x7f1cfc1562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:08.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.984+0000 7f1d03d32700 1 -- 172.21.15.31:0/2952611917 shutdown_connections 2023-10-09T06:23:08.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:08.984+0000 7f1d03d32700 1 -- 172.21.15.31:0/2952611917 wait complete. 2023-10-09T06:23:08.999 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:23:09.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.125+0000 7f541da3f700 1 Processor -- start 2023-10-09T06:23:09.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.125+0000 7f541da3f700 1 -- start start 2023-10-09T06:23:09.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.126+0000 7f541da3f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54180ad910 0x7f54180cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:09.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.126+0000 7f541da3f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5418067f00 0x7f5418068350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:09.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.126+0000 7f541da3f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54180ae150 con 0x7f54180adce0 2023-10-09T06:23:09.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.126+0000 7f541da3f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54180b18c0 con 0x7f5418067f00 2023-10-09T06:23:09.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.126+0000 7f541da3f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54180b1ba0 con 0x7f54180ad910 2023-10-09T06:23:09.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.126+0000 7f54177fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5418067f00 0x7f5418068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:09.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.126+0000 7f54167fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f54180adce0 0x7f541815e2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53870/0 (socket says 172.21.15.31:53870) 2023-10-09T06:23:09.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.126+0000 7f54167fc700 1 -- 172.21.15.31:0/3884524408 learned_addr learned my addr 172.21.15.31:0/3884524408 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:23:09.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.126+0000 7f5416ffd700 1 --2- 172.21.15.31:0/3884524408 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54180ad910 0x7f54180cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:09.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f54177fe700 1 -- 172.21.15.31:0/3884524408 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54180ad910 msgr2=0x7f54180cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:09.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f54177fe700 1 --2- 172.21.15.31:0/3884524408 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54180ad910 0x7f54180cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:09.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f54177fe700 1 -- 172.21.15.31:0/3884524408 >> v1:172.21.15.31:6789/0 conn(0x7f54180adce0 legacy=0x7f541815e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:09.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f54177fe700 1 -- 172.21.15.31:0/3884524408 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54180b1e80 con 0x7f5418067f00 2023-10-09T06:23:09.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f5416ffd700 1 --2- 172.21.15.31:0/3884524408 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54180ad910 0x7f54180cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:23:09.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f54177fe700 1 --2- 172.21.15.31:0/3884524408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5418067f00 0x7f5418068350 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5408009e60 tx=0x7f5408009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488a0e4e9d3b9f32 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:09.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f5415ffb700 1 -- 172.21.15.31:0/3884524408 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540800e070 con 0x7f5418067f00 2023-10-09T06:23:09.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f5415ffb700 1 -- 172.21.15.31:0/3884524408 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540800bc30 con 0x7f5418067f00 2023-10-09T06:23:09.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f5415ffb700 1 -- 172.21.15.31:0/3884524408 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408012430 con 0x7f5418067f00 2023-10-09T06:23:09.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f541da3f700 1 -- 172.21.15.31:0/3884524408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5418067f00 msgr2=0x7f5418068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:09.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f541da3f700 1 --2- 172.21.15.31:0/3884524408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5418067f00 0x7f5418068350 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5408009e60 tx=0x7f5408009780 comp rx=0 tx=0).stop 2023-10-09T06:23:09.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f541da3f700 1 -- 172.21.15.31:0/3884524408 shutdown_connections 2023-10-09T06:23:09.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f541da3f700 1 --2- 172.21.15.31:0/3884524408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5418067f00 0x7f5418068350 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:09.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f541da3f700 1 --2- 172.21.15.31:0/3884524408 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54180ad910 0x7f54180cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:09.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f541da3f700 1 -- 172.21.15.31:0/3884524408 >> 172.21.15.31:0/3884524408 conn(0x7f541806bc70 msgr2=0x7f541806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:09.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f541da3f700 1 -- 172.21.15.31:0/3884524408 shutdown_connections 2023-10-09T06:23:09.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.127+0000 7f541da3f700 1 -- 172.21.15.31:0/3884524408 wait complete. 2023-10-09T06:23:09.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.129+0000 7f541da3f700 1 Processor -- start 2023-10-09T06:23:09.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.129+0000 7f541da3f700 1 -- start start 2023-10-09T06:23:09.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.129+0000 7f541da3f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5418067f00 0x7f54181455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:09.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.129+0000 7f541da3f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54180ad910 0x7f54180c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:09.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.129+0000 7f541da3f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54180adce0 0x7f541816d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:09.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.129+0000 7f541da3f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54180afbc0 con 0x7f54180ad910 2023-10-09T06:23:09.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.129+0000 7f541da3f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54180b0140 con 0x7f54180adce0 2023-10-09T06:23:09.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.129+0000 7f541da3f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541816e440 con 0x7f5418067f00 2023-10-09T06:23:09.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.129+0000 7f54167fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54180ad910 0x7f54180c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:09.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f54167fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54180ad910 0x7f54180c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60704/0 (socket says 172.21.15.31:60704) 2023-10-09T06:23:09.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f54167fc700 1 -- 172.21.15.31:0/746634492 learned_addr learned my addr 172.21.15.31:0/746634492 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:09.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f54177fe700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54180adce0 0x7f541816d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:09.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f5416ffd700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5418067f00 0x7f54181455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:09.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f54167fc700 1 -- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5418067f00 msgr2=0x7f54181455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:09.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f54167fc700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5418067f00 0x7f54181455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:09.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f54167fc700 1 -- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54180adce0 msgr2=0x7f541816d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:09.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f54167fc700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54180adce0 0x7f541816d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:09.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f54167fc700 1 -- 172.21.15.31:0/746634492 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5408009a20 con 0x7f54180ad910 2023-10-09T06:23:09.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f54167fc700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54180ad910 0x7f54180c7c10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f540000c560 tx=0x7f5400001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:09.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f540effd700 1 -- 172.21.15.31:0/746634492 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400005b30 con 0x7f54180ad910 2023-10-09T06:23:09.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f540effd700 1 -- 172.21.15.31:0/746634492 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5400005cb0 con 0x7f54180ad910 2023-10-09T06:23:09.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f541da3f700 1 -- 172.21.15.31:0/746634492 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541816e720 con 0x7f54180ad910 2023-10-09T06:23:09.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f540effd700 1 -- 172.21.15.31:0/746634492 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400007320 con 0x7f54180ad910 2023-10-09T06:23:09.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.130+0000 7f541da3f700 1 -- 172.21.15.31:0/746634492 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54180c8150 con 0x7f54180ad910 2023-10-09T06:23:09.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.131+0000 7f541da3f700 1 -- 172.21.15.31:0/746634492 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54180b02f0 con 0x7f54180ad910 2023-10-09T06:23:09.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.132+0000 7f540effd700 1 -- 172.21.15.31:0/746634492 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f540001b3b0 con 0x7f54180ad910 2023-10-09T06:23:09.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.132+0000 7f540effd700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f53f8066f30 0x7f53f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:09.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.132+0000 7f540effd700 1 -- 172.21.15.31:0/746634492 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5400083a70 con 0x7f54180ad910 2023-10-09T06:23:09.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.132+0000 7f5416ffd700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f53f8066f30 0x7f53f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:09.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.133+0000 7f5416ffd700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f53f8066f30 0x7f53f80693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f541000ac00 tx=0x7f5410006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:09.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.136+0000 7f540effd700 1 -- 172.21.15.31:0/746634492 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54180b02f0 con 0x7f54180ad910 2023-10-09T06:23:09.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.373+0000 7f541da3f700 1 -- 172.21.15.31:0/746634492 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f54180b02b0 con 0x7f54180ad910 2023-10-09T06:23:09.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.986+0000 7f540effd700 1 -- 172.21.15.31:0/746634492 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f54000170c0 con 0x7f54180ad910 2023-10-09T06:23:09.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.989+0000 7f541da3f700 1 -- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f53f8066f30 msgr2=0x7f53f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:09.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.989+0000 7f541da3f700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f53f8066f30 0x7f53f80693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f541000ac00 tx=0x7f5410006f90 comp rx=0 tx=0).stop 2023-10-09T06:23:09.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.989+0000 7f541da3f700 1 -- 172.21.15.31:0/746634492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54180ad910 msgr2=0x7f54180c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:09.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.989+0000 7f541da3f700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54180ad910 0x7f54180c7c10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f540000c560 tx=0x7f5400001020 comp rx=0 tx=0).stop 2023-10-09T06:23:09.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.989+0000 7f541da3f700 1 -- 172.21.15.31:0/746634492 shutdown_connections 2023-10-09T06:23:09.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.989+0000 7f541da3f700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f53f8066f30 0x7f53f80693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:09.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.989+0000 7f541da3f700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5418067f00 0x7f54181455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:09.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.989+0000 7f541da3f700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54180adce0 0x7f541816d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:09.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.989+0000 7f541da3f700 1 --2- 172.21.15.31:0/746634492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54180ad910 0x7f54180c7c10 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:09.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.989+0000 7f541da3f700 1 -- 172.21.15.31:0/746634492 >> 172.21.15.31:0/746634492 conn(0x7f541806bc70 msgr2=0x7f54180b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:09.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.989+0000 7f541da3f700 1 -- 172.21.15.31:0/746634492 shutdown_connections 2023-10-09T06:23:09.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:09.989+0000 7f541da3f700 1 -- 172.21.15.31:0/746634492 wait complete. 2023-10-09T06:23:10.002 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:23:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.122+0000 7f73a14ca700 1 Processor -- start 2023-10-09T06:23:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.122+0000 7f73a14ca700 1 -- start start 2023-10-09T06:23:10.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.123+0000 7f73a14ca700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f739c159ae0 0x7f739c0ae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.123+0000 7f73a14ca700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f739c159eb0 0x7f739c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.123+0000 7f73a14ca700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739c15dcb0 con 0x7f739c069410 2023-10-09T06:23:10.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.123+0000 7f73a14ca700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739c0c9140 con 0x7f739c159ae0 2023-10-09T06:23:10.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.123+0000 7f73a14ca700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c15df90 con 0x7f739c159eb0 2023-10-09T06:23:10.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.123+0000 7f739a7fc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f739c159eb0 0x7f739c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.123+0000 7f739affd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f739c159ae0 0x7f739c0ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.123+0000 7f739b7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f739c069410 0x7f739c069a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:41084/0 (socket says 172.21.15.31:41084) 2023-10-09T06:23:10.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.123+0000 7f739b7fe700 1 -- 172.21.15.31:0/2881606594 learned_addr learned my addr 172.21.15.31:0/2881606594 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:23:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.123+0000 7f739affd700 1 --2- 172.21.15.31:0/2881606594 >> v2:172.21.15.158:3300/0 conn(0x7f739c159ae0 0x7f739c0ae250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:42172/0 (socket says 172.21.15.31:42172) 2023-10-09T06:23:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.124+0000 7f739affd700 1 -- 172.21.15.31:0/2881606594 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f739c159eb0 msgr2=0x7f739c068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.124+0000 7f739affd700 1 --2- 172.21.15.31:0/2881606594 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f739c159eb0 0x7f739c068ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.124+0000 7f739affd700 1 -- 172.21.15.31:0/2881606594 >> v1:172.21.15.158:6789/0 conn(0x7f739c069410 legacy=0x7f739c069a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.124+0000 7f739affd700 1 -- 172.21.15.31:0/2881606594 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c15e270 con 0x7f739c159ae0 2023-10-09T06:23:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.124+0000 7f7399ffb700 1 -- 172.21.15.31:0/2881606594 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298213152 0 0) 0x7f739c15dcb0 con 0x7f739c069410 2023-10-09T06:23:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.124+0000 7f739a7fc700 1 --2- 172.21.15.31:0/2881606594 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f739c159eb0 0x7f739c068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:23:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.124+0000 7f739affd700 1 --2- 172.21.15.31:0/2881606594 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f739c159ae0 0x7f739c0ae250 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f73940098e0 tx=0x7f73940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29d068b1bbd1c5ff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.124+0000 7f7399ffb700 1 -- 172.21.15.31:0/2881606594 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739400b640 con 0x7f739c159ae0 2023-10-09T06:23:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.124+0000 7f7399ffb700 1 -- 172.21.15.31:0/2881606594 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739400b7a0 con 0x7f739c159ae0 2023-10-09T06:23:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.124+0000 7f7399ffb700 1 -- 172.21.15.31:0/2881606594 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739400bb40 con 0x7f739c159ae0 2023-10-09T06:23:10.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.125+0000 7f73a14ca700 1 -- 172.21.15.31:0/2881606594 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f739c159ae0 msgr2=0x7f739c0ae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.125+0000 7f73a14ca700 1 --2- 172.21.15.31:0/2881606594 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f739c159ae0 0x7f739c0ae250 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f73940098e0 tx=0x7f73940091a0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.125+0000 7f73a14ca700 1 -- 172.21.15.31:0/2881606594 shutdown_connections 2023-10-09T06:23:10.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.125+0000 7f73a14ca700 1 --2- 172.21.15.31:0/2881606594 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f739c159ae0 0x7f739c0ae250 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.125+0000 7f73a14ca700 1 --2- 172.21.15.31:0/2881606594 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f739c159eb0 0x7f739c068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.125+0000 7f73a14ca700 1 -- 172.21.15.31:0/2881606594 >> 172.21.15.31:0/2881606594 conn(0x7f739c070700 msgr2=0x7f739c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:10.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.125+0000 7f73a14ca700 1 -- 172.21.15.31:0/2881606594 shutdown_connections 2023-10-09T06:23:10.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.125+0000 7f73a14ca700 1 -- 172.21.15.31:0/2881606594 wait complete. 2023-10-09T06:23:10.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.126+0000 7f73a14ca700 1 Processor -- start 2023-10-09T06:23:10.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.126+0000 7f73a14ca700 1 -- start start 2023-10-09T06:23:10.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f73a14ca700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f739c069410 0x7f739c15bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f73a14ca700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f739c159ae0 0x7f739c156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f73a14ca700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f739c159eb0 0x7f739c067a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f73a14ca700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c15c460 con 0x7f739c159ae0 2023-10-09T06:23:10.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f73a14ca700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c15c6e0 con 0x7f739c069410 2023-10-09T06:23:10.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f73a14ca700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c15c9c0 con 0x7f739c159eb0 2023-10-09T06:23:10.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f739a7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f739c159ae0 0x7f739c156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f739a7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f739c159ae0 0x7f739c156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40648/0 (socket says 172.21.15.31:40648) 2023-10-09T06:23:10.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f739a7fc700 1 -- 172.21.15.31:0/1737351095 learned_addr learned my addr 172.21.15.31:0/1737351095 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:10.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f739affd700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f739c069410 0x7f739c15bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f739a7fc700 1 -- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f739c159eb0 msgr2=0x7f739c067a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f739a7fc700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f739c159eb0 0x7f739c067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f739a7fc700 1 -- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f739c069410 msgr2=0x7f739c15bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f739a7fc700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f739c069410 0x7f739c15bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f739a7fc700 1 -- 172.21.15.31:0/1737351095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7384009420 con 0x7f739c159ae0 2023-10-09T06:23:10.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f739affd700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f739c069410 0x7f739c15bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:23:10.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f739a7fc700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f739c159ae0 0x7f739c156d70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f738400ec80 tx=0x7f73840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:10.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.127+0000 7f7392ffd700 1 -- 172.21.15.31:0/1737351095 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400c9d0 con 0x7f739c159ae0 2023-10-09T06:23:10.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.128+0000 7f7392ffd700 1 -- 172.21.15.31:0/1737351095 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738400cb30 con 0x7f739c159ae0 2023-10-09T06:23:10.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.128+0000 7f73a14ca700 1 -- 172.21.15.31:0/1737351095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7394009420 con 0x7f739c159ae0 2023-10-09T06:23:10.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.128+0000 7f7392ffd700 1 -- 172.21.15.31:0/1737351095 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400ceb0 con 0x7f739c159ae0 2023-10-09T06:23:10.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.128+0000 7f73a14ca700 1 -- 172.21.15.31:0/1737351095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739c15cf80 con 0x7f739c159ae0 2023-10-09T06:23:10.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.129+0000 7f73a14ca700 1 -- 172.21.15.31:0/1737351095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739c0ce530 con 0x7f739c159ae0 2023-10-09T06:23:10.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.129+0000 7f7392ffd700 1 -- 172.21.15.31:0/1737351095 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7384013680 con 0x7f739c159ae0 2023-10-09T06:23:10.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.129+0000 7f7392ffd700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f737c066f30 0x7f737c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.129+0000 7f7392ffd700 1 -- 172.21.15.31:0/1737351095 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7384084910 con 0x7f739c159ae0 2023-10-09T06:23:10.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.130+0000 7f739affd700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f737c066f30 0x7f737c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.130+0000 7f739affd700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f737c066f30 0x7f737c0693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7394003080 tx=0x7f7394017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:10.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.133+0000 7f7392ffd700 1 -- 172.21.15.31:0/1737351095 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7384051b80 con 0x7f739c159ae0 2023-10-09T06:23:10.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.374+0000 7f73a14ca700 1 -- 172.21.15.31:0/1737351095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f739c15e550 con 0x7f739c159ae0 2023-10-09T06:23:10.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.375+0000 7f7392ffd700 1 -- 172.21.15.31:0/1737351095 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f73840551a0 con 0x7f739c159ae0 2023-10-09T06:23:10.376 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:23:10.376 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/4067940888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":4067940888},{"type":"v1","addr":"172.21.15.158:6835","nonce":4067940888}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/169747435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":169747435},{"type":"v1","addr":"172.21.15.158:6837","nonce":169747435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3769789034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3769789034},{"type":"v1","addr":"172.21.15.31:6834","nonce":3769789034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:23:06.370069+0000","modified":"2023-10-09T06:23:09.985664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/2596093897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2596093897},{"type":"v1","addr":"172.21.15.31:6835","nonce":2596093897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T06:23:10.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.377+0000 7f73a14ca700 1 -- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f737c066f30 msgr2=0x7f737c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.377+0000 7f73a14ca700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f737c066f30 0x7f737c0693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7394003080 tx=0x7f7394017000 comp rx=0 tx=0).stop 2023-10-09T06:23:10.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.377+0000 7f73a14ca700 1 -- 172.21.15.31:0/1737351095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f739c159ae0 msgr2=0x7f739c156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.377+0000 7f73a14ca700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f739c159ae0 0x7f739c156d70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f738400ec80 tx=0x7f73840091a0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.377+0000 7f73a14ca700 1 -- 172.21.15.31:0/1737351095 shutdown_connections 2023-10-09T06:23:10.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.377+0000 7f73a14ca700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f737c066f30 0x7f737c0693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.377+0000 7f73a14ca700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f739c159eb0 0x7f739c067a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.377+0000 7f73a14ca700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f739c069410 0x7f739c15bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.377+0000 7f73a14ca700 1 --2- 172.21.15.31:0/1737351095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f739c159ae0 0x7f739c156d70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.377+0000 7f73a14ca700 1 -- 172.21.15.31:0/1737351095 >> 172.21.15.31:0/1737351095 conn(0x7f739c070700 msgr2=0x7f739c069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:10.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.377+0000 7f73a14ca700 1 -- 172.21.15.31:0/1737351095 shutdown_connections 2023-10-09T06:23:10.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.377+0000 7f73a14ca700 1 -- 172.21.15.31:0/1737351095 wait complete. 2023-10-09T06:23:10.379 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 34 2023-10-09T06:23:10.390 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:23:10.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.509+0000 7f99204a9700 1 Processor -- start 2023-10-09T06:23:10.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.509+0000 7f99204a9700 1 -- start start 2023-10-09T06:23:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f99204a9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f991815a620 0x7f991815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f99204a9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991815cbb0 con 0x7f9918157870 2023-10-09T06:23:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f99204a9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991815bfa0 con 0x7f991815d580 2023-10-09T06:23:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f99204a9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991815bdb0 con 0x7f991815a620 2023-10-09T06:23:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f991da44700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f991815a620 0x7f991815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f991e245700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9918157870 0x7f991815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32780/0 (socket says 172.21.15.31:32780) 2023-10-09T06:23:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f991e245700 1 -- 172.21.15.31:0/430866363 learned_addr learned my addr 172.21.15.31:0/430866363 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:23:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f991da44700 1 -- 172.21.15.31:0/430866363 >> v1:172.21.15.158:6789/0 conn(0x7f991815d580 legacy=0x7f9918158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f991da44700 1 -- 172.21.15.31:0/430866363 >> v1:172.21.15.31:6789/0 conn(0x7f9918157870 legacy=0x7f991815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f991da44700 1 -- 172.21.15.31:0/430866363 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991815c280 con 0x7f991815a620 2023-10-09T06:23:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f991d243700 1 -- 172.21.15.31:0/430866363 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665505628 0 0) 0x7f991815cbb0 con 0x7f9918157870 2023-10-09T06:23:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f991da44700 1 --2- 172.21.15.31:0/430866363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991815a620 0x7f991815d040 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f99080098e0 tx=0x7f99080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec997d44efa71d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f991d243700 1 -- 172.21.15.31:0/430866363 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908009e80 con 0x7f991815a620 2023-10-09T06:23:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f991d243700 1 -- 172.21.15.31:0/430866363 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990800b860 con 0x7f991815a620 2023-10-09T06:23:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f991d243700 1 -- 172.21.15.31:0/430866363 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800bbe0 con 0x7f991815a620 2023-10-09T06:23:10.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f99204a9700 1 -- 172.21.15.31:0/430866363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991815a620 msgr2=0x7f991815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f99204a9700 1 --2- 172.21.15.31:0/430866363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991815a620 0x7f991815d040 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f99080098e0 tx=0x7f99080091a0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f99204a9700 1 -- 172.21.15.31:0/430866363 shutdown_connections 2023-10-09T06:23:10.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f99204a9700 1 --2- 172.21.15.31:0/430866363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991815a620 0x7f991815d040 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f99204a9700 1 -- 172.21.15.31:0/430866363 >> 172.21.15.31:0/430866363 conn(0x7f9918068ce0 msgr2=0x7f99180690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:10.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f99204a9700 1 -- 172.21.15.31:0/430866363 shutdown_connections 2023-10-09T06:23:10.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.510+0000 7f99204a9700 1 -- 172.21.15.31:0/430866363 wait complete. 2023-10-09T06:23:10.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.511+0000 7f99204a9700 1 Processor -- start 2023-10-09T06:23:10.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.511+0000 7f99204a9700 1 -- start start 2023-10-09T06:23:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f99204a9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9918157870 0x7f991814c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f99204a9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991815a620 0x7f9918155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f99204a9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f991815d580 0x7f99180d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f99204a9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991814dde0 con 0x7f991815a620 2023-10-09T06:23:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f99204a9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991814f500 con 0x7f991815d580 2023-10-09T06:23:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f99204a9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991814cf30 con 0x7f9918157870 2023-10-09T06:23:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f991da44700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991815a620 0x7f9918155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f991da44700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991815a620 0x7f9918155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40674/0 (socket says 172.21.15.31:40674) 2023-10-09T06:23:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f991da44700 1 -- 172.21.15.31:0/869298745 learned_addr learned my addr 172.21.15.31:0/869298745 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f991ea46700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f991815d580 0x7f99180d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f991e245700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9918157870 0x7f991814c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f991da44700 1 -- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9918157870 msgr2=0x7f991814c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f991da44700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9918157870 0x7f991814c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f991da44700 1 -- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f991815d580 msgr2=0x7f99180d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f991da44700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f991815d580 0x7f99180d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f991da44700 1 -- 172.21.15.31:0/869298745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9908009420 con 0x7f991815a620 2023-10-09T06:23:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.512+0000 7f991ea46700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f991815d580 0x7f99180d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:23:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.513+0000 7f991da44700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991815a620 0x7f9918155850 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9908013000 tx=0x7f9908017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.513+0000 7f990e7fc700 1 -- 172.21.15.31:0/869298745 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990801f070 con 0x7f991815a620 2023-10-09T06:23:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.513+0000 7f990e7fc700 1 -- 172.21.15.31:0/869298745 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990800b9d0 con 0x7f991815a620 2023-10-09T06:23:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.513+0000 7f990e7fc700 1 -- 172.21.15.31:0/869298745 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908025670 con 0x7f991815a620 2023-10-09T06:23:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.513+0000 7f99204a9700 1 -- 172.21.15.31:0/869298745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991814d160 con 0x7f991815a620 2023-10-09T06:23:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.513+0000 7f99204a9700 1 -- 172.21.15.31:0/869298745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991814d720 con 0x7f991815a620 2023-10-09T06:23:10.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.514+0000 7f99204a9700 1 -- 172.21.15.31:0/869298745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99180d1760 con 0x7f991815a620 2023-10-09T06:23:10.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.514+0000 7f990e7fc700 1 -- 172.21.15.31:0/869298745 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9908023070 con 0x7f991815a620 2023-10-09T06:23:10.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.514+0000 7f990e7fc700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98fc066f30 0x7f98fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.515+0000 7f990e7fc700 1 -- 172.21.15.31:0/869298745 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9908085b60 con 0x7f991815a620 2023-10-09T06:23:10.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.515+0000 7f991e245700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98fc066f30 0x7f98fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.515+0000 7f991e245700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98fc066f30 0x7f98fc0693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f99140011e0 tx=0x7f9914009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:10.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.520+0000 7f990e7fc700 1 -- 172.21.15.31:0/869298745 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9908052dd0 con 0x7f991815a620 2023-10-09T06:23:10.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.711+0000 7f99204a9700 1 -- 172.21.15.31:0/869298745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f991804c3c0 con 0x7f991815a620 2023-10-09T06:23:10.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.712+0000 7f990e7fc700 1 -- 172.21.15.31:0/869298745 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f9908015090 con 0x7f991815a620 2023-10-09T06:23:10.713 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:23:10.713 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":65,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:23:07.682133+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:23:04.509059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T06:23:05.346720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:23:10.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.715+0000 7f99204a9700 1 -- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98fc066f30 msgr2=0x7f98fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.715+0000 7f99204a9700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98fc066f30 0x7f98fc0693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f99140011e0 tx=0x7f9914009040 comp rx=0 tx=0).stop 2023-10-09T06:23:10.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.715+0000 7f99204a9700 1 -- 172.21.15.31:0/869298745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991815a620 msgr2=0x7f9918155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.715+0000 7f99204a9700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991815a620 0x7f9918155850 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9908013000 tx=0x7f9908017000 comp rx=0 tx=0).stop 2023-10-09T06:23:10.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.715+0000 7f99204a9700 1 -- 172.21.15.31:0/869298745 shutdown_connections 2023-10-09T06:23:10.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.715+0000 7f99204a9700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98fc066f30 0x7f98fc0693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.715+0000 7f99204a9700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9918157870 0x7f991814c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.715+0000 7f99204a9700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f991815d580 0x7f99180d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.715+0000 7f99204a9700 1 --2- 172.21.15.31:0/869298745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991815a620 0x7f9918155850 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.715+0000 7f99204a9700 1 -- 172.21.15.31:0/869298745 >> 172.21.15.31:0/869298745 conn(0x7f9918068ce0 msgr2=0x7f9918159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:10.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.715+0000 7f99204a9700 1 -- 172.21.15.31:0/869298745 shutdown_connections 2023-10-09T06:23:10.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.715+0000 7f99204a9700 1 -- 172.21.15.31:0/869298745 wait complete. 2023-10-09T06:23:10.727 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:23:10.727 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:23:10.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.845+0000 7fec7b006700 1 Processor -- start 2023-10-09T06:23:10.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.845+0000 7fec7b006700 1 -- start start 2023-10-09T06:23:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.846+0000 7fec7b006700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740cdab0 0x7fec7415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.846+0000 7fec7b006700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec740cb7c0 con 0x7fec7415dda0 2023-10-09T06:23:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.846+0000 7fec7b006700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7415e290 con 0x7fec740cd6e0 2023-10-09T06:23:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.846+0000 7fec7b006700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7415e850 con 0x7fec740cdab0 2023-10-09T06:23:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.846+0000 7fec7a805700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fec7415dda0 0x7fec7415cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32782/0 (socket says 172.21.15.31:32782) 2023-10-09T06:23:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.846+0000 7fec7a805700 1 -- 172.21.15.31:0/1418984886 learned_addr learned my addr 172.21.15.31:0/1418984886 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:23:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.846+0000 7fec79803700 1 --2- 172.21.15.31:0/1418984886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740cdab0 0x7fec7415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.846+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745677653 0 0) 0x7fec740cb7c0 con 0x7fec7415dda0 2023-10-09T06:23:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.846+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec5c003570 con 0x7fec7415dda0 2023-10-09T06:23:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.846+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275334559 0 0) 0x7fec7415e290 con 0x7fec740cd6e0 2023-10-09T06:23:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.846+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec740cb7c0 con 0x7fec740cd6e0 2023-10-09T06:23:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 631670806 0 0) 0x7fec5c003570 con 0x7fec7415dda0 2023-10-09T06:23:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740cdab0 msgr2=0x7fec7415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79002700 1 --2- 172.21.15.31:0/1418984886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740cdab0 0x7fec7415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 >> v1:172.21.15.158:6789/0 conn(0x7fec740cd6e0 legacy=0x7fec740cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7415e570 con 0x7fec7415dda0 2023-10-09T06:23:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fec6c001470 con 0x7fec7415dda0 2023-10-09T06:23:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79803700 1 --2- 172.21.15.31:0/1418984886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740cdab0 0x7fec7415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:23:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 >> v1:172.21.15.31:6789/0 conn(0x7fec7415dda0 legacy=0x7fec7415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79002700 1 --2- 172.21.15.31:0/1418984886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c003c20 0x7fec5c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79002700 1 --2- 172.21.15.31:0/1418984886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c004810 0x7fec5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79002700 1 --2- 172.21.15.31:0/1418984886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740cdab0 0x7fec5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7415e850 con 0x7fec5c004810 2023-10-09T06:23:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c00bb40 con 0x7fec5c003c20 2023-10-09T06:23:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c00bd00 con 0x7fec740cdab0 2023-10-09T06:23:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79803700 1 --2- 172.21.15.31:0/1418984886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c004810 0x7fec5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec7a805700 1 --2- 172.21.15.31:0/1418984886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740cdab0 0x7fec5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec7a004700 1 --2- 172.21.15.31:0/1418984886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c003c20 0x7fec5c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79803700 1 -- 172.21.15.31:0/1418984886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740cdab0 msgr2=0x7fec5c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:10.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79803700 1 --2- 172.21.15.31:0/1418984886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740cdab0 0x7fec5c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79803700 1 -- 172.21.15.31:0/1418984886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c003c20 msgr2=0x7fec5c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:10.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79803700 1 --2- 172.21.15.31:0/1418984886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c003c20 0x7fec5c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79803700 1 -- 172.21.15.31:0/1418984886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec68009420 con 0x7fec5c004810 2023-10-09T06:23:10.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.847+0000 7fec79803700 1 --2- 172.21.15.31:0/1418984886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c004810 0x7fec5c004c80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fec68009df0 tx=0x7fec680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c947ec95fcde8450 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:10.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.848+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68009740 con 0x7fec5c004810 2023-10-09T06:23:10.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.848+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6800e920 con 0x7fec5c004810 2023-10-09T06:23:10.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.848+0000 7fec79002700 1 -- 172.21.15.31:0/1418984886 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6800ece0 con 0x7fec5c004810 2023-10-09T06:23:10.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.848+0000 7fec7b006700 1 -- 172.21.15.31:0/1418984886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c004810 msgr2=0x7fec5c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.848+0000 7fec7b006700 1 --2- 172.21.15.31:0/1418984886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c004810 0x7fec5c004c80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fec68009df0 tx=0x7fec680091a0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.848+0000 7fec7a805700 1 -- 172.21.15.31:0/1418984886 reap_dead start 2023-10-09T06:23:10.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.848+0000 7fec7b006700 1 -- 172.21.15.31:0/1418984886 shutdown_connections 2023-10-09T06:23:10.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.848+0000 7fec7b006700 1 -- 172.21.15.31:0/1418984886 >> 172.21.15.31:0/1418984886 conn(0x7fec74067660 msgr2=0x7fec74067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:10.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.848+0000 7fec7b006700 1 -- 172.21.15.31:0/1418984886 shutdown_connections 2023-10-09T06:23:10.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.848+0000 7fec7b006700 1 -- 172.21.15.31:0/1418984886 wait complete. 2023-10-09T06:23:10.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.850+0000 7fec7b006700 1 Processor -- start 2023-10-09T06:23:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.850+0000 7fec7b006700 1 -- start start 2023-10-09T06:23:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.850+0000 7fec7b006700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c004810 0x7fec74158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.850+0000 7fec7b006700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740affc0 0x7fec74155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.850+0000 7fec7b006700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec740b4e20 0x7fec740b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.850+0000 7fec7b006700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec740cc360 con 0x7fec740b4e20 2023-10-09T06:23:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.850+0000 7fec7b006700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec740c8ee0 con 0x7fec5c004810 2023-10-09T06:23:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.850+0000 7fec7b006700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec740c8930 con 0x7fec740affc0 2023-10-09T06:23:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.850+0000 7fec7a805700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec740b4e20 0x7fec740b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.850+0000 7fec7a805700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec740b4e20 0x7fec740b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40684/0 (socket says 172.21.15.31:40684) 2023-10-09T06:23:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.850+0000 7fec7a805700 1 -- 172.21.15.31:0/2572440350 learned_addr learned my addr 172.21.15.31:0/2572440350 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.850+0000 7fec7a004700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c004810 0x7fec74158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.851+0000 7fec79803700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740affc0 0x7fec74155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.851+0000 7fec7a805700 1 -- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740affc0 msgr2=0x7fec74155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.851+0000 7fec7a805700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740affc0 0x7fec74155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.851+0000 7fec7a805700 1 -- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c004810 msgr2=0x7fec74158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.851+0000 7fec7a805700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c004810 0x7fec74158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.851+0000 7fec7a805700 1 -- 172.21.15.31:0/2572440350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec740b57b0 con 0x7fec740b4e20 2023-10-09T06:23:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.851+0000 7fec7a805700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec740b4e20 0x7fec740b5270 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fec740c7cd0 tx=0x7fec6c001010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.851+0000 7fec727fc700 1 -- 172.21.15.31:0/2572440350 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c010520 con 0x7fec740b4e20 2023-10-09T06:23:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.851+0000 7fec727fc700 1 -- 172.21.15.31:0/2572440350 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c0106a0 con 0x7fec740b4e20 2023-10-09T06:23:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.851+0000 7fec7b006700 1 -- 172.21.15.31:0/2572440350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec740c7d20 con 0x7fec740b4e20 2023-10-09T06:23:10.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.851+0000 7fec727fc700 1 -- 172.21.15.31:0/2572440350 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c010a60 con 0x7fec740b4e20 2023-10-09T06:23:10.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.851+0000 7fec7b006700 1 -- 172.21.15.31:0/2572440350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec740c82e0 con 0x7fec740b4e20 2023-10-09T06:23:10.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.852+0000 7fec7b006700 1 -- 172.21.15.31:0/2572440350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec740c8ac0 con 0x7fec740b4e20 2023-10-09T06:23:10.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.852+0000 7fec727fc700 1 -- 172.21.15.31:0/2572440350 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec6c0133e0 con 0x7fec740b4e20 2023-10-09T06:23:10.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.853+0000 7fec727fc700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fec60066f30 0x7fec600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:10.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.853+0000 7fec727fc700 1 -- 172.21.15.31:0/2572440350 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fec6c083c80 con 0x7fec740b4e20 2023-10-09T06:23:10.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.853+0000 7fec7a004700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fec60066f30 0x7fec600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:10.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.854+0000 7fec7a004700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fec60066f30 0x7fec600693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fec64007fd0 tx=0x7fec64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:10.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:10.857+0000 7fec727fc700 1 -- 172.21.15.31:0/2572440350 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec6c050f70 con 0x7fec740b4e20 2023-10-09T06:23:10.942 INFO:tasks.ceph.mds.c.smithi031.stderr:2023-10-09T06:23:10.941+0000 7fcc061d6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:23:11.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.045+0000 7fec7b006700 1 -- 172.21.15.31:0/2572440350 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec740d18b0 con 0x7fec60066f30 2023-10-09T06:23:11.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.055+0000 7fec727fc700 1 -- 172.21.15.31:0/2572440350 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284658 (secure 0 0 0) 0x7fec740d18b0 con 0x7fec60066f30 2023-10-09T06:23:11.058 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:23:11.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.059+0000 7fec7b006700 1 -- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fec60066f30 msgr2=0x7fec600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.059+0000 7fec7b006700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fec60066f30 0x7fec600693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fec64007fd0 tx=0x7fec64009040 comp rx=0 tx=0).stop 2023-10-09T06:23:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.059+0000 7fec7b006700 1 -- 172.21.15.31:0/2572440350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec740b4e20 msgr2=0x7fec740b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.059+0000 7fec7b006700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec740b4e20 0x7fec740b5270 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fec740c7cd0 tx=0x7fec6c001010 comp rx=0 tx=0).stop 2023-10-09T06:23:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.059+0000 7fec7b006700 1 -- 172.21.15.31:0/2572440350 shutdown_connections 2023-10-09T06:23:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.059+0000 7fec7b006700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fec60066f30 0x7fec600693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.059+0000 7fec7b006700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec740b4e20 0x7fec740b5270 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.059+0000 7fec7b006700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c004810 0x7fec74158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.059+0000 7fec7b006700 1 --2- 172.21.15.31:0/2572440350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec740affc0 0x7fec74155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.059+0000 7fec7b006700 1 -- 172.21.15.31:0/2572440350 >> 172.21.15.31:0/2572440350 conn(0x7fec74067660 msgr2=0x7fec740cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.059+0000 7fec7b006700 1 -- 172.21.15.31:0/2572440350 shutdown_connections 2023-10-09T06:23:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.059+0000 7fec7b006700 1 -- 172.21.15.31:0/2572440350 wait complete. 2023-10-09T06:23:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:23:11.071 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-10-09T06:23:10.549974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3723,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558776,"statfs":{"total":1600000000,"available":1596186892,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.586771"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.697348+0000","last_change":"2023-10-09T06:23:06.697348+0000","last_active":"2023-10-09T06:23:06.697348+0000","last_peered":"2023-10-09T06:23:06.697348+0000","last_clean":"2023-10-09T06:23:06.697348+0000","last_became_active":"2023-10-09T06:23:06.697111+0000","last_became_peered":"2023-10-09T06:23:06.697111+0000","last_unstale":"2023-10-09T06:23:06.697348+0000","last_undegraded":"2023-10-09T06:23:06.697348+0000","last_fullsized":"2023-10-09T06:23:06.697348+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:38.854130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691223+0000","last_change":"2023-10-09T06:23:06.691223+0000","last_active":"2023-10-09T06:23:06.691223+0000","last_peered":"2023-10-09T06:23:06.691223+0000","last_clean":"2023-10-09T06:23:06.691223+0000","last_became_active":"2023-10-09T06:23:06.690875+0000","last_became_peered":"2023-10-09T06:23:06.690875+0000","last_unstale":"2023-10-09T06:23:06.691223+0000","last_undegraded":"2023-10-09T06:23:06.691223+0000","last_fullsized":"2023-10-09T06:23:06.691223+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:42.962968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694202+0000","last_change":"2023-10-09T06:23:06.694071+0000","last_active":"2023-10-09T06:23:06.694202+0000","last_peered":"2023-10-09T06:23:06.694202+0000","last_clean":"2023-10-09T06:23:06.694202+0000","last_became_active":"2023-10-09T06:23:06.693786+0000","last_became_peered":"2023-10-09T06:23:06.693786+0000","last_unstale":"2023-10-09T06:23:06.694202+0000","last_undegraded":"2023-10-09T06:23:06.694202+0000","last_fullsized":"2023-10-09T06:23:06.694202+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:49.275500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.693689+0000","last_change":"2023-10-09T06:23:06.693689+0000","last_active":"2023-10-09T06:23:06.693689+0000","last_peered":"2023-10-09T06:23:06.693689+0000","last_clean":"2023-10-09T06:23:06.693689+0000","last_became_active":"2023-10-09T06:23:06.693445+0000","last_became_peered":"2023-10-09T06:23:06.693445+0000","last_unstale":"2023-10-09T06:23:06.693689+0000","last_undegraded":"2023-10-09T06:23:06.693689+0000","last_fullsized":"2023-10-09T06:23:06.693689+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:16:32.933584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.690963+0000","last_change":"2023-10-09T06:23:06.690963+0000","last_active":"2023-10-09T06:23:06.690963+0000","last_peered":"2023-10-09T06:23:06.690963+0000","last_clean":"2023-10-09T06:23:06.690963+0000","last_became_active":"2023-10-09T06:23:06.690754+0000","last_became_peered":"2023-10-09T06:23:06.690754+0000","last_unstale":"2023-10-09T06:23:06.690963+0000","last_undegraded":"2023-10-09T06:23:06.690963+0000","last_fullsized":"2023-10-09T06:23:06.690963+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:06.393103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.697509+0000","last_change":"2023-10-09T06:23:06.697509+0000","last_active":"2023-10-09T06:23:06.697509+0000","last_peered":"2023-10-09T06:23:06.697509+0000","last_clean":"2023-10-09T06:23:06.697509+0000","last_became_active":"2023-10-09T06:23:06.695043+0000","last_became_peered":"2023-10-09T06:23:06.695043+0000","last_unstale":"2023-10-09T06:23:06.697509+0000","last_undegraded":"2023-10-09T06:23:06.697509+0000","last_fullsized":"2023-10-09T06:23:06.697509+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:40.055429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692094+0000","last_change":"2023-10-09T06:23:06.691919+0000","last_active":"2023-10-09T06:23:06.692094+0000","last_peered":"2023-10-09T06:23:06.692094+0000","last_clean":"2023-10-09T06:23:06.692094+0000","last_became_active":"2023-10-09T06:23:06.691362+0000","last_became_peered":"2023-10-09T06:23:06.691362+0000","last_unstale":"2023-10-09T06:23:06.692094+0000","last_undegraded":"2023-10-09T06:23:06.692094+0000","last_fullsized":"2023-10-09T06:23:06.692094+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:44:08.391255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.687924+0000","last_change":"2023-10-09T06:23:06.687924+0000","last_active":"2023-10-09T06:23:06.687924+0000","last_peered":"2023-10-09T06:23:06.687924+0000","last_clean":"2023-10-09T06:23:06.687924+0000","last_became_active":"2023-10-09T06:23:06.687581+0000","last_became_peered":"2023-10-09T06:23:06.687581+0000","last_unstale":"2023-10-09T06:23:06.687924+0000","last_undegraded":"2023-10-09T06:23:06.687924+0000","last_fullsized":"2023-10-09T06:23:06.687924+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:42.075495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694908+0000","last_change":"2023-10-09T06:23:06.694845+0000","last_active":"2023-10-09T06:23:06.694908+0000","last_peered":"2023-10-09T06:23:06.694908+0000","last_clean":"2023-10-09T06:23:06.694908+0000","last_became_active":"2023-10-09T06:23:06.694626+0000","last_became_peered":"2023-10-09T06:23:06.694626+0000","last_unstale":"2023-10-09T06:23:06.694908+0000","last_undegraded":"2023-10-09T06:23:06.694908+0000","last_fullsized":"2023-10-09T06:23:06.694908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:35.500010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.690931+0000","last_change":"2023-10-09T06:23:06.690931+0000","last_active":"2023-10-09T06:23:06.690931+0000","last_peered":"2023-10-09T06:23:06.690931+0000","last_clean":"2023-10-09T06:23:06.690931+0000","last_became_active":"2023-10-09T06:23:06.690373+0000","last_became_peered":"2023-10-09T06:23:06.690373+0000","last_unstale":"2023-10-09T06:23:06.690931+0000","last_undegraded":"2023-10-09T06:23:06.690931+0000","last_fullsized":"2023-10-09T06:23:06.690931+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:22.304821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.689015+0000","last_change":"2023-10-09T06:23:06.689015+0000","last_active":"2023-10-09T06:23:06.689015+0000","last_peered":"2023-10-09T06:23:06.689015+0000","last_clean":"2023-10-09T06:23:06.689015+0000","last_became_active":"2023-10-09T06:23:06.688745+0000","last_became_peered":"2023-10-09T06:23:06.688745+0000","last_unstale":"2023-10-09T06:23:06.689015+0000","last_undegraded":"2023-10-09T06:23:06.689015+0000","last_fullsized":"2023-10-09T06:23:06.689015+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:11.251967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695497+0000","last_change":"2023-10-09T06:23:06.695497+0000","last_active":"2023-10-09T06:23:06.695497+0000","last_peered":"2023-10-09T06:23:06.695497+0000","last_clean":"2023-10-09T06:23:06.695497+0000","last_became_active":"2023-10-09T06:23:06.695141+0000","last_became_peered":"2023-10-09T06:23:06.695141+0000","last_unstale":"2023-10-09T06:23:06.695497+0000","last_undegraded":"2023-10-09T06:23:06.695497+0000","last_fullsized":"2023-10-09T06:23:06.695497+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:02.861322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.696094+0000","last_change":"2023-10-09T06:23:06.695692+0000","last_active":"2023-10-09T06:23:06.696094+0000","last_peered":"2023-10-09T06:23:06.696094+0000","last_clean":"2023-10-09T06:23:06.696094+0000","last_became_active":"2023-10-09T06:23:06.695473+0000","last_became_peered":"2023-10-09T06:23:06.695473+0000","last_unstale":"2023-10-09T06:23:06.696094+0000","last_undegraded":"2023-10-09T06:23:06.696094+0000","last_fullsized":"2023-10-09T06:23:06.696094+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:22.304821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.688273+0000","last_change":"2023-10-09T06:23:06.688148+0000","last_active":"2023-10-09T06:23:06.688273+0000","last_peered":"2023-10-09T06:23:06.688273+0000","last_clean":"2023-10-09T06:23:06.688273+0000","last_became_active":"2023-10-09T06:23:06.687913+0000","last_became_peered":"2023-10-09T06:23:06.687913+0000","last_unstale":"2023-10-09T06:23:06.688273+0000","last_undegraded":"2023-10-09T06:23:06.688273+0000","last_fullsized":"2023-10-09T06:23:06.688273+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:50.917637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691727+0000","last_change":"2023-10-09T06:23:06.691661+0000","last_active":"2023-10-09T06:23:06.691727+0000","last_peered":"2023-10-09T06:23:06.691727+0000","last_clean":"2023-10-09T06:23:06.691727+0000","last_became_active":"2023-10-09T06:23:06.691283+0000","last_became_peered":"2023-10-09T06:23:06.691283+0000","last_unstale":"2023-10-09T06:23:06.691727+0000","last_undegraded":"2023-10-09T06:23:06.691727+0000","last_fullsized":"2023-10-09T06:23:06.691727+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:52.652292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695272+0000","last_change":"2023-10-09T06:23:06.695272+0000","last_active":"2023-10-09T06:23:06.695272+0000","last_peered":"2023-10-09T06:23:06.695272+0000","last_clean":"2023-10-09T06:23:06.695272+0000","last_became_active":"2023-10-09T06:23:06.694398+0000","last_became_peered":"2023-10-09T06:23:06.694398+0000","last_unstale":"2023-10-09T06:23:06.695272+0000","last_undegraded":"2023-10-09T06:23:06.695272+0000","last_fullsized":"2023-10-09T06:23:06.695272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:53.098429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.685444+0000","last_change":"2023-10-09T06:23:06.685444+0000","last_active":"2023-10-09T06:23:06.685444+0000","last_peered":"2023-10-09T06:23:06.685444+0000","last_clean":"2023-10-09T06:23:06.685444+0000","last_became_active":"2023-10-09T06:23:06.685228+0000","last_became_peered":"2023-10-09T06:23:06.685228+0000","last_unstale":"2023-10-09T06:23:06.685444+0000","last_undegraded":"2023-10-09T06:23:06.685444+0000","last_fullsized":"2023-10-09T06:23:06.685444+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:59:40.191593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.698565+0000","last_change":"2023-10-09T06:23:06.698522+0000","last_active":"2023-10-09T06:23:06.698565+0000","last_peered":"2023-10-09T06:23:06.698565+0000","last_clean":"2023-10-09T06:23:06.698565+0000","last_became_active":"2023-10-09T06:23:06.697943+0000","last_became_peered":"2023-10-09T06:23:06.697943+0000","last_unstale":"2023-10-09T06:23:06.698565+0000","last_undegraded":"2023-10-09T06:23:06.698565+0000","last_fullsized":"2023-10-09T06:23:06.698565+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:40.009089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692917+0000","last_change":"2023-10-09T06:23:06.692917+0000","last_active":"2023-10-09T06:23:06.692917+0000","last_peered":"2023-10-09T06:23:06.692917+0000","last_clean":"2023-10-09T06:23:06.692917+0000","last_became_active":"2023-10-09T06:23:06.692144+0000","last_became_peered":"2023-10-09T06:23:06.692144+0000","last_unstale":"2023-10-09T06:23:06.692917+0000","last_undegraded":"2023-10-09T06:23:06.692917+0000","last_fullsized":"2023-10-09T06:23:06.692917+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:21.931777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.696064+0000","last_change":"2023-10-09T06:23:06.696064+0000","last_active":"2023-10-09T06:23:06.696064+0000","last_peered":"2023-10-09T06:23:06.696064+0000","last_clean":"2023-10-09T06:23:06.696064+0000","last_became_active":"2023-10-09T06:23:06.695818+0000","last_became_peered":"2023-10-09T06:23:06.695818+0000","last_unstale":"2023-10-09T06:23:06.696064+0000","last_undegraded":"2023-10-09T06:23:06.696064+0000","last_fullsized":"2023-10-09T06:23:06.696064+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:47.384180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692666+0000","last_change":"2023-10-09T06:23:06.692611+0000","last_active":"2023-10-09T06:23:06.692666+0000","last_peered":"2023-10-09T06:23:06.692666+0000","last_clean":"2023-10-09T06:23:06.692666+0000","last_became_active":"2023-10-09T06:23:06.692062+0000","last_became_peered":"2023-10-09T06:23:06.692062+0000","last_unstale":"2023-10-09T06:23:06.692666+0000","last_undegraded":"2023-10-09T06:23:06.692666+0000","last_fullsized":"2023-10-09T06:23:06.692666+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:17.576807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.689805+0000","last_change":"2023-10-09T06:23:06.689805+0000","last_active":"2023-10-09T06:23:06.689805+0000","last_peered":"2023-10-09T06:23:06.689805+0000","last_clean":"2023-10-09T06:23:06.689805+0000","last_became_active":"2023-10-09T06:23:06.688846+0000","last_became_peered":"2023-10-09T06:23:06.688846+0000","last_unstale":"2023-10-09T06:23:06.689805+0000","last_undegraded":"2023-10-09T06:23:06.689805+0000","last_fullsized":"2023-10-09T06:23:06.689805+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:02:44.955809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.698731+0000","last_change":"2023-10-09T06:23:06.698658+0000","last_active":"2023-10-09T06:23:06.698731+0000","last_peered":"2023-10-09T06:23:06.698731+0000","last_clean":"2023-10-09T06:23:06.698731+0000","last_became_active":"2023-10-09T06:23:06.698227+0000","last_became_peered":"2023-10-09T06:23:06.698227+0000","last_unstale":"2023-10-09T06:23:06.698731+0000","last_undegraded":"2023-10-09T06:23:06.698731+0000","last_fullsized":"2023-10-09T06:23:06.698731+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:24.430154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695282+0000","last_change":"2023-10-09T06:23:06.695187+0000","last_active":"2023-10-09T06:23:06.695282+0000","last_peered":"2023-10-09T06:23:06.695282+0000","last_clean":"2023-10-09T06:23:06.695282+0000","last_became_active":"2023-10-09T06:23:06.694963+0000","last_became_peered":"2023-10-09T06:23:06.694963+0000","last_unstale":"2023-10-09T06:23:06.695282+0000","last_undegraded":"2023-10-09T06:23:06.695282+0000","last_fullsized":"2023-10-09T06:23:06.695282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:43.110652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.690542+0000","last_change":"2023-10-09T06:23:06.690542+0000","last_active":"2023-10-09T06:23:06.690542+0000","last_peered":"2023-10-09T06:23:06.690542+0000","last_clean":"2023-10-09T06:23:06.690542+0000","last_became_active":"2023-10-09T06:23:06.690320+0000","last_became_peered":"2023-10-09T06:23:06.690320+0000","last_unstale":"2023-10-09T06:23:06.690542+0000","last_undegraded":"2023-10-09T06:23:06.690542+0000","last_fullsized":"2023-10-09T06:23:06.690542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:46:00.526366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691211+0000","last_change":"2023-10-09T06:23:06.691211+0000","last_active":"2023-10-09T06:23:06.691211+0000","last_peered":"2023-10-09T06:23:06.691211+0000","last_clean":"2023-10-09T06:23:06.691211+0000","last_became_active":"2023-10-09T06:23:06.690738+0000","last_became_peered":"2023-10-09T06:23:06.690738+0000","last_unstale":"2023-10-09T06:23:06.691211+0000","last_undegraded":"2023-10-09T06:23:06.691211+0000","last_fullsized":"2023-10-09T06:23:06.691211+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:06.551729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.693620+0000","last_change":"2023-10-09T06:23:06.693620+0000","last_active":"2023-10-09T06:23:06.693620+0000","last_peered":"2023-10-09T06:23:06.693620+0000","last_clean":"2023-10-09T06:23:06.693620+0000","last_became_active":"2023-10-09T06:23:06.693389+0000","last_became_peered":"2023-10-09T06:23:06.693389+0000","last_unstale":"2023-10-09T06:23:06.693620+0000","last_undegraded":"2023-10-09T06:23:06.693620+0000","last_fullsized":"2023-10-09T06:23:06.693620+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:43:14.884324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692900+0000","last_change":"2023-10-09T06:23:06.692900+0000","last_active":"2023-10-09T06:23:06.692900+0000","last_peered":"2023-10-09T06:23:06.692900+0000","last_clean":"2023-10-09T06:23:06.692900+0000","last_became_active":"2023-10-09T06:23:06.692642+0000","last_became_peered":"2023-10-09T06:23:06.692642+0000","last_unstale":"2023-10-09T06:23:06.692900+0000","last_undegraded":"2023-10-09T06:23:06.692900+0000","last_fullsized":"2023-10-09T06:23:06.692900+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:59.113323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.697512+0000","last_change":"2023-10-09T06:23:06.697512+0000","last_active":"2023-10-09T06:23:06.697512+0000","last_peered":"2023-10-09T06:23:06.697512+0000","last_clean":"2023-10-09T06:23:06.697512+0000","last_became_active":"2023-10-09T06:23:06.697067+0000","last_became_peered":"2023-10-09T06:23:06.697067+0000","last_unstale":"2023-10-09T06:23:06.697512+0000","last_undegraded":"2023-10-09T06:23:06.697512+0000","last_fullsized":"2023-10-09T06:23:06.697512+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:25.447726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694178+0000","last_change":"2023-10-09T06:23:06.693528+0000","last_active":"2023-10-09T06:23:06.694178+0000","last_peered":"2023-10-09T06:23:06.694178+0000","last_clean":"2023-10-09T06:23:06.694178+0000","last_became_active":"2023-10-09T06:23:06.691925+0000","last_became_peered":"2023-10-09T06:23:06.691925+0000","last_unstale":"2023-10-09T06:23:06.694178+0000","last_undegraded":"2023-10-09T06:23:06.694178+0000","last_fullsized":"2023-10-09T06:23:06.694178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:48.982575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692398+0000","last_change":"2023-10-09T06:23:06.692398+0000","last_active":"2023-10-09T06:23:06.692398+0000","last_peered":"2023-10-09T06:23:06.692398+0000","last_clean":"2023-10-09T06:23:06.692398+0000","last_became_active":"2023-10-09T06:23:06.691707+0000","last_became_peered":"2023-10-09T06:23:06.691707+0000","last_unstale":"2023-10-09T06:23:06.692398+0000","last_undegraded":"2023-10-09T06:23:06.692398+0000","last_fullsized":"2023-10-09T06:23:06.692398+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:41.912698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694178+0000","last_change":"2023-10-09T06:23:06.694178+0000","last_active":"2023-10-09T06:23:06.694178+0000","last_peered":"2023-10-09T06:23:06.694178+0000","last_clean":"2023-10-09T06:23:06.694178+0000","last_became_active":"2023-10-09T06:23:06.693931+0000","last_became_peered":"2023-10-09T06:23:06.693931+0000","last_unstale":"2023-10-09T06:23:06.694178+0000","last_undegraded":"2023-10-09T06:23:06.694178+0000","last_fullsized":"2023-10-09T06:23:06.694178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:49.275500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695667+0000","last_change":"2023-10-09T06:23:06.695667+0000","last_active":"2023-10-09T06:23:06.695667+0000","last_peered":"2023-10-09T06:23:06.695667+0000","last_clean":"2023-10-09T06:23:06.695667+0000","last_became_active":"2023-10-09T06:23:06.695242+0000","last_became_peered":"2023-10-09T06:23:06.695242+0000","last_unstale":"2023-10-09T06:23:06.695667+0000","last_undegraded":"2023-10-09T06:23:06.695667+0000","last_fullsized":"2023-10-09T06:23:06.695667+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:16:32.933584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"64'4","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.980186+0000","last_change":"2023-10-09T06:23:05.981971+0000","last_active":"2023-10-09T06:23:06.980186+0000","last_peered":"2023-10-09T06:23:06.980186+0000","last_clean":"2023-10-09T06:23:06.980186+0000","last_became_active":"2023-10-09T06:23:05.981124+0000","last_became_peered":"2023-10-09T06:23:05.981124+0000","last_unstale":"2023-10-09T06:23:06.980186+0000","last_undegraded":"2023-10-09T06:23:06.980186+0000","last_fullsized":"2023-10-09T06:23:06.980186+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:07.158118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.697072+0000","last_change":"2023-10-09T06:23:06.697072+0000","last_active":"2023-10-09T06:23:06.697072+0000","last_peered":"2023-10-09T06:23:06.697072+0000","last_clean":"2023-10-09T06:23:06.697072+0000","last_became_active":"2023-10-09T06:23:06.696814+0000","last_became_peered":"2023-10-09T06:23:06.696814+0000","last_unstale":"2023-10-09T06:23:06.697072+0000","last_undegraded":"2023-10-09T06:23:06.697072+0000","last_fullsized":"2023-10-09T06:23:06.697072+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:43.530603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"64'1","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.683378+0000","last_change":"2023-10-09T06:23:05.980162+0000","last_active":"2023-10-09T06:23:06.683378+0000","last_peered":"2023-10-09T06:23:06.683378+0000","last_clean":"2023-10-09T06:23:06.683378+0000","last_became_active":"2023-10-09T06:23:05.978811+0000","last_became_peered":"2023-10-09T06:23:05.978811+0000","last_unstale":"2023-10-09T06:23:06.683378+0000","last_undegraded":"2023-10-09T06:23:06.683378+0000","last_fullsized":"2023-10-09T06:23:06.683378+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:52.093922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695413+0000","last_change":"2023-10-09T06:23:06.695413+0000","last_active":"2023-10-09T06:23:06.695413+0000","last_peered":"2023-10-09T06:23:06.695413+0000","last_clean":"2023-10-09T06:23:06.695413+0000","last_became_active":"2023-10-09T06:23:06.694742+0000","last_became_peered":"2023-10-09T06:23:06.694742+0000","last_unstale":"2023-10-09T06:23:06.695413+0000","last_undegraded":"2023-10-09T06:23:06.695413+0000","last_fullsized":"2023-10-09T06:23:06.695413+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:07:05.280951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"64'2","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.979660+0000","last_change":"2023-10-09T06:23:05.978991+0000","last_active":"2023-10-09T06:23:06.979660+0000","last_peered":"2023-10-09T06:23:06.979660+0000","last_clean":"2023-10-09T06:23:06.979660+0000","last_became_active":"2023-10-09T06:23:05.978573+0000","last_became_peered":"2023-10-09T06:23:05.978573+0000","last_unstale":"2023-10-09T06:23:06.979660+0000","last_undegraded":"2023-10-09T06:23:06.979660+0000","last_fullsized":"2023-10-09T06:23:06.979660+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:17:53.747188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695568+0000","last_change":"2023-10-09T06:23:06.695568+0000","last_active":"2023-10-09T06:23:06.695568+0000","last_peered":"2023-10-09T06:23:06.695568+0000","last_clean":"2023-10-09T06:23:06.695568+0000","last_became_active":"2023-10-09T06:23:06.693922+0000","last_became_peered":"2023-10-09T06:23:06.693922+0000","last_unstale":"2023-10-09T06:23:06.695568+0000","last_undegraded":"2023-10-09T06:23:06.695568+0000","last_fullsized":"2023-10-09T06:23:06.695568+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:48.982575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"64'2","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.978390+0000","last_change":"2023-10-09T06:23:05.980953+0000","last_active":"2023-10-09T06:23:06.978390+0000","last_peered":"2023-10-09T06:23:06.978390+0000","last_clean":"2023-10-09T06:23:06.978390+0000","last_became_active":"2023-10-09T06:23:05.980691+0000","last_became_peered":"2023-10-09T06:23:05.980691+0000","last_unstale":"2023-10-09T06:23:06.978390+0000","last_undegraded":"2023-10-09T06:23:06.978390+0000","last_fullsized":"2023-10-09T06:23:06.978390+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:34.495503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.688361+0000","last_change":"2023-10-09T06:23:06.688361+0000","last_active":"2023-10-09T06:23:06.688361+0000","last_peered":"2023-10-09T06:23:06.688361+0000","last_clean":"2023-10-09T06:23:06.688361+0000","last_became_active":"2023-10-09T06:23:06.688144+0000","last_became_peered":"2023-10-09T06:23:06.688144+0000","last_unstale":"2023-10-09T06:23:06.688361+0000","last_undegraded":"2023-10-09T06:23:06.688361+0000","last_fullsized":"2023-10-09T06:23:06.688361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:41.348895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.978917+0000","last_change":"2023-10-09T06:23:05.973403+0000","last_active":"2023-10-09T06:23:06.978917+0000","last_peered":"2023-10-09T06:23:06.978917+0000","last_clean":"2023-10-09T06:23:06.978917+0000","last_became_active":"2023-10-09T06:23:05.973184+0000","last_became_peered":"2023-10-09T06:23:05.973184+0000","last_unstale":"2023-10-09T06:23:06.978917+0000","last_undegraded":"2023-10-09T06:23:06.978917+0000","last_fullsized":"2023-10-09T06:23:06.978917+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:42.106145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695569+0000","last_change":"2023-10-09T06:23:06.695569+0000","last_active":"2023-10-09T06:23:06.695569+0000","last_peered":"2023-10-09T06:23:06.695569+0000","last_clean":"2023-10-09T06:23:06.695569+0000","last_became_active":"2023-10-09T06:23:06.695370+0000","last_became_peered":"2023-10-09T06:23:06.695370+0000","last_unstale":"2023-10-09T06:23:06.695569+0000","last_undegraded":"2023-10-09T06:23:06.695569+0000","last_fullsized":"2023-10-09T06:23:06.695569+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:42.818953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"64'1","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694033+0000","last_change":"2023-10-09T06:23:05.982277+0000","last_active":"2023-10-09T06:23:06.694033+0000","last_peered":"2023-10-09T06:23:06.694033+0000","last_clean":"2023-10-09T06:23:06.694033+0000","last_became_active":"2023-10-09T06:23:05.981743+0000","last_became_peered":"2023-10-09T06:23:05.981743+0000","last_unstale":"2023-10-09T06:23:06.694033+0000","last_undegraded":"2023-10-09T06:23:06.694033+0000","last_fullsized":"2023-10-09T06:23:06.694033+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:52:33.804162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.693222+0000","last_change":"2023-10-09T06:23:06.693008+0000","last_active":"2023-10-09T06:23:06.693222+0000","last_peered":"2023-10-09T06:23:06.693222+0000","last_clean":"2023-10-09T06:23:06.693222+0000","last_became_active":"2023-10-09T06:23:06.692650+0000","last_became_peered":"2023-10-09T06:23:06.692650+0000","last_unstale":"2023-10-09T06:23:06.693222+0000","last_undegraded":"2023-10-09T06:23:06.693222+0000","last_fullsized":"2023-10-09T06:23:06.693222+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:01.847031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.977258+0000","last_change":"2023-10-09T06:23:05.977195+0000","last_active":"2023-10-09T06:23:05.977258+0000","last_peered":"2023-10-09T06:23:05.977258+0000","last_clean":"2023-10-09T06:23:05.977258+0000","last_became_active":"2023-10-09T06:23:05.976963+0000","last_became_peered":"2023-10-09T06:23:05.976963+0000","last_unstale":"2023-10-09T06:23:05.977258+0000","last_undegraded":"2023-10-09T06:23:05.977258+0000","last_fullsized":"2023-10-09T06:23:05.977258+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:03.155156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.687674+0000","last_change":"2023-10-09T06:23:06.687674+0000","last_active":"2023-10-09T06:23:06.687674+0000","last_peered":"2023-10-09T06:23:06.687674+0000","last_clean":"2023-10-09T06:23:06.687674+0000","last_became_active":"2023-10-09T06:23:06.687426+0000","last_became_peered":"2023-10-09T06:23:06.687426+0000","last_unstale":"2023-10-09T06:23:06.687674+0000","last_undegraded":"2023-10-09T06:23:06.687674+0000","last_fullsized":"2023-10-09T06:23:06.687674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:29.508341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.686326+0000","last_change":"2023-10-09T06:23:05.974593+0000","last_active":"2023-10-09T06:23:06.686326+0000","last_peered":"2023-10-09T06:23:06.686326+0000","last_clean":"2023-10-09T06:23:06.686326+0000","last_became_active":"2023-10-09T06:23:05.974305+0000","last_became_peered":"2023-10-09T06:23:05.974305+0000","last_unstale":"2023-10-09T06:23:06.686326+0000","last_undegraded":"2023-10-09T06:23:06.686326+0000","last_fullsized":"2023-10-09T06:23:06.686326+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:10.247461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692153+0000","last_change":"2023-10-09T06:23:06.692074+0000","last_active":"2023-10-09T06:23:06.692153+0000","last_peered":"2023-10-09T06:23:06.692153+0000","last_clean":"2023-10-09T06:23:06.692153+0000","last_became_active":"2023-10-09T06:23:06.691686+0000","last_became_peered":"2023-10-09T06:23:06.691686+0000","last_unstale":"2023-10-09T06:23:06.692153+0000","last_undegraded":"2023-10-09T06:23:06.692153+0000","last_fullsized":"2023-10-09T06:23:06.692153+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:15:47.215754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691186+0000","last_change":"2023-10-09T06:23:05.978641+0000","last_active":"2023-10-09T06:23:06.691186+0000","last_peered":"2023-10-09T06:23:06.691186+0000","last_clean":"2023-10-09T06:23:06.691186+0000","last_became_active":"2023-10-09T06:23:05.978195+0000","last_became_peered":"2023-10-09T06:23:05.978195+0000","last_unstale":"2023-10-09T06:23:06.691186+0000","last_undegraded":"2023-10-09T06:23:06.691186+0000","last_fullsized":"2023-10-09T06:23:06.691186+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:03.155156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692603+0000","last_change":"2023-10-09T06:23:06.692293+0000","last_active":"2023-10-09T06:23:06.692603+0000","last_peered":"2023-10-09T06:23:06.692603+0000","last_clean":"2023-10-09T06:23:06.692603+0000","last_became_active":"2023-10-09T06:23:06.691464+0000","last_became_peered":"2023-10-09T06:23:06.691464+0000","last_unstale":"2023-10-09T06:23:06.692603+0000","last_undegraded":"2023-10-09T06:23:06.692603+0000","last_fullsized":"2023-10-09T06:23:06.692603+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:40.055429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.979387+0000","last_change":"2023-10-09T06:23:05.978341+0000","last_active":"2023-10-09T06:23:05.979387+0000","last_peered":"2023-10-09T06:23:05.979387+0000","last_clean":"2023-10-09T06:23:05.979387+0000","last_became_active":"2023-10-09T06:23:05.978031+0000","last_became_peered":"2023-10-09T06:23:05.978031+0000","last_unstale":"2023-10-09T06:23:05.979387+0000","last_undegraded":"2023-10-09T06:23:05.979387+0000","last_fullsized":"2023-10-09T06:23:05.979387+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:43:13.879817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692080+0000","last_change":"2023-10-09T06:23:06.692080+0000","last_active":"2023-10-09T06:23:06.692080+0000","last_peered":"2023-10-09T06:23:06.692080+0000","last_clean":"2023-10-09T06:23:06.692080+0000","last_became_active":"2023-10-09T06:23:06.691291+0000","last_became_peered":"2023-10-09T06:23:06.691291+0000","last_unstale":"2023-10-09T06:23:06.692080+0000","last_undegraded":"2023-10-09T06:23:06.692080+0000","last_fullsized":"2023-10-09T06:23:06.692080+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:43.110652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.982613+0000","last_change":"2023-10-09T06:23:05.976182+0000","last_active":"2023-10-09T06:23:06.982613+0000","last_peered":"2023-10-09T06:23:06.982613+0000","last_clean":"2023-10-09T06:23:06.982613+0000","last_became_active":"2023-10-09T06:23:05.975965+0000","last_became_peered":"2023-10-09T06:23:05.975965+0000","last_unstale":"2023-10-09T06:23:06.982613+0000","last_undegraded":"2023-10-09T06:23:06.982613+0000","last_fullsized":"2023-10-09T06:23:06.982613+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:17:53.747188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.698467+0000","last_change":"2023-10-09T06:23:06.698405+0000","last_active":"2023-10-09T06:23:06.698467+0000","last_peered":"2023-10-09T06:23:06.698467+0000","last_clean":"2023-10-09T06:23:06.698467+0000","last_became_active":"2023-10-09T06:23:06.697617+0000","last_became_peered":"2023-10-09T06:23:06.697617+0000","last_unstale":"2023-10-09T06:23:06.698467+0000","last_undegraded":"2023-10-09T06:23:06.698467+0000","last_fullsized":"2023-10-09T06:23:06.698467+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:16:32.933584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"64'6","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.981321+0000","last_change":"2023-10-09T06:23:05.975671+0000","last_active":"2023-10-09T06:23:06.981321+0000","last_peered":"2023-10-09T06:23:06.981321+0000","last_clean":"2023-10-09T06:23:06.981321+0000","last_became_active":"2023-10-09T06:23:05.975456+0000","last_became_peered":"2023-10-09T06:23:05.975456+0000","last_unstale":"2023-10-09T06:23:06.981321+0000","last_undegraded":"2023-10-09T06:23:06.981321+0000","last_fullsized":"2023-10-09T06:23:06.981321+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:21.300314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.696043+0000","last_change":"2023-10-09T06:23:06.696043+0000","last_active":"2023-10-09T06:23:06.696043+0000","last_peered":"2023-10-09T06:23:06.696043+0000","last_clean":"2023-10-09T06:23:06.696043+0000","last_became_active":"2023-10-09T06:23:06.695810+0000","last_became_peered":"2023-10-09T06:23:06.695810+0000","last_unstale":"2023-10-09T06:23:06.696043+0000","last_undegraded":"2023-10-09T06:23:06.696043+0000","last_fullsized":"2023-10-09T06:23:06.696043+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:53.098429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"64'2","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.977843+0000","last_change":"2023-10-09T06:23:05.979523+0000","last_active":"2023-10-09T06:23:06.977843+0000","last_peered":"2023-10-09T06:23:06.977843+0000","last_clean":"2023-10-09T06:23:06.977843+0000","last_became_active":"2023-10-09T06:23:05.979279+0000","last_became_peered":"2023-10-09T06:23:05.979279+0000","last_unstale":"2023-10-09T06:23:06.977843+0000","last_undegraded":"2023-10-09T06:23:06.977843+0000","last_fullsized":"2023-10-09T06:23:06.977843+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:05.547222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694719+0000","last_change":"2023-10-09T06:23:06.694255+0000","last_active":"2023-10-09T06:23:06.694719+0000","last_peered":"2023-10-09T06:23:06.694719+0000","last_clean":"2023-10-09T06:23:06.694719+0000","last_became_active":"2023-10-09T06:23:06.692996+0000","last_became_peered":"2023-10-09T06:23:06.692996+0000","last_unstale":"2023-10-09T06:23:06.694719+0000","last_undegraded":"2023-10-09T06:23:06.694719+0000","last_fullsized":"2023-10-09T06:23:06.694719+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:07:05.280951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.684975+0000","last_change":"2023-10-09T06:23:05.980958+0000","last_active":"2023-10-09T06:23:06.684975+0000","last_peered":"2023-10-09T06:23:06.684975+0000","last_clean":"2023-10-09T06:23:06.684975+0000","last_became_active":"2023-10-09T06:23:05.980699+0000","last_became_peered":"2023-10-09T06:23:05.980699+0000","last_unstale":"2023-10-09T06:23:06.684975+0000","last_undegraded":"2023-10-09T06:23:06.684975+0000","last_fullsized":"2023-10-09T06:23:06.684975+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:41.829161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.696063+0000","last_change":"2023-10-09T06:23:06.696000+0000","last_active":"2023-10-09T06:23:06.696063+0000","last_peered":"2023-10-09T06:23:06.696063+0000","last_clean":"2023-10-09T06:23:06.696063+0000","last_became_active":"2023-10-09T06:23:06.695581+0000","last_became_peered":"2023-10-09T06:23:06.695581+0000","last_unstale":"2023-10-09T06:23:06.696063+0000","last_undegraded":"2023-10-09T06:23:06.696063+0000","last_fullsized":"2023-10-09T06:23:06.696063+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:46:26.867430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.978656+0000","last_change":"2023-10-09T06:23:05.977968+0000","last_active":"2023-10-09T06:23:05.978656+0000","last_peered":"2023-10-09T06:23:05.978656+0000","last_clean":"2023-10-09T06:23:05.978656+0000","last_became_active":"2023-10-09T06:23:05.977733+0000","last_became_peered":"2023-10-09T06:23:05.977733+0000","last_unstale":"2023-10-09T06:23:05.978656+0000","last_undegraded":"2023-10-09T06:23:05.978656+0000","last_fullsized":"2023-10-09T06:23:05.978656+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:24.510117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694750+0000","last_change":"2023-10-09T06:23:06.694461+0000","last_active":"2023-10-09T06:23:06.694750+0000","last_peered":"2023-10-09T06:23:06.694750+0000","last_clean":"2023-10-09T06:23:06.694750+0000","last_became_active":"2023-10-09T06:23:06.694133+0000","last_became_peered":"2023-10-09T06:23:06.694133+0000","last_unstale":"2023-10-09T06:23:06.694750+0000","last_undegraded":"2023-10-09T06:23:06.694750+0000","last_fullsized":"2023-10-09T06:23:06.694750+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:54.271638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"64'8","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.981666+0000","last_change":"2023-10-09T06:23:05.977966+0000","last_active":"2023-10-09T06:23:06.981666+0000","last_peered":"2023-10-09T06:23:06.981666+0000","last_clean":"2023-10-09T06:23:06.981666+0000","last_became_active":"2023-10-09T06:23:05.977728+0000","last_became_peered":"2023-10-09T06:23:05.977728+0000","last_unstale":"2023-10-09T06:23:06.981666+0000","last_undegraded":"2023-10-09T06:23:06.981666+0000","last_fullsized":"2023-10-09T06:23:06.981666+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:52:33.804162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694735+0000","last_change":"2023-10-09T06:23:06.694400+0000","last_active":"2023-10-09T06:23:06.694735+0000","last_peered":"2023-10-09T06:23:06.694735+0000","last_clean":"2023-10-09T06:23:06.694735+0000","last_became_active":"2023-10-09T06:23:06.693296+0000","last_became_peered":"2023-10-09T06:23:06.693296+0000","last_unstale":"2023-10-09T06:23:06.694735+0000","last_undegraded":"2023-10-09T06:23:06.694735+0000","last_fullsized":"2023-10-09T06:23:06.694735+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:53.098429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"64'1","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.683471+0000","last_change":"2023-10-09T06:23:05.980472+0000","last_active":"2023-10-09T06:23:06.683471+0000","last_peered":"2023-10-09T06:23:06.683471+0000","last_clean":"2023-10-09T06:23:06.683471+0000","last_became_active":"2023-10-09T06:23:05.979677+0000","last_became_peered":"2023-10-09T06:23:05.979677+0000","last_unstale":"2023-10-09T06:23:06.683471+0000","last_undegraded":"2023-10-09T06:23:06.683471+0000","last_fullsized":"2023-10-09T06:23:06.683471+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:39.050922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695338+0000","last_change":"2023-10-09T06:23:06.695338+0000","last_active":"2023-10-09T06:23:06.695338+0000","last_peered":"2023-10-09T06:23:06.695338+0000","last_clean":"2023-10-09T06:23:06.695338+0000","last_became_active":"2023-10-09T06:23:06.694777+0000","last_became_peered":"2023-10-09T06:23:06.694777+0000","last_unstale":"2023-10-09T06:23:06.695338+0000","last_undegraded":"2023-10-09T06:23:06.695338+0000","last_fullsized":"2023-10-09T06:23:06.695338+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:48.982575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"64'2","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.980060+0000","last_change":"2023-10-09T06:23:05.981215+0000","last_active":"2023-10-09T06:23:06.980060+0000","last_peered":"2023-10-09T06:23:06.980060+0000","last_clean":"2023-10-09T06:23:06.980060+0000","last_became_active":"2023-10-09T06:23:05.981016+0000","last_became_peered":"2023-10-09T06:23:05.981016+0000","last_unstale":"2023-10-09T06:23:06.980060+0000","last_undegraded":"2023-10-09T06:23:06.980060+0000","last_fullsized":"2023-10-09T06:23:06.980060+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:40.113032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.689944+0000","last_change":"2023-10-09T06:23:06.689944+0000","last_active":"2023-10-09T06:23:06.689944+0000","last_peered":"2023-10-09T06:23:06.689944+0000","last_clean":"2023-10-09T06:23:06.689944+0000","last_became_active":"2023-10-09T06:23:06.689160+0000","last_became_peered":"2023-10-09T06:23:06.689160+0000","last_unstale":"2023-10-09T06:23:06.689944+0000","last_undegraded":"2023-10-09T06:23:06.689944+0000","last_fullsized":"2023-10-09T06:23:06.689944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:07.687016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"64'1","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.689653+0000","last_change":"2023-10-09T06:23:05.980467+0000","last_active":"2023-10-09T06:23:06.689653+0000","last_peered":"2023-10-09T06:23:06.689653+0000","last_clean":"2023-10-09T06:23:06.689653+0000","last_became_active":"2023-10-09T06:23:05.980145+0000","last_became_peered":"2023-10-09T06:23:05.980145+0000","last_unstale":"2023-10-09T06:23:06.689653+0000","last_undegraded":"2023-10-09T06:23:06.689653+0000","last_fullsized":"2023-10-09T06:23:06.689653+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:49.913130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692643+0000","last_change":"2023-10-09T06:23:06.692454+0000","last_active":"2023-10-09T06:23:06.692643+0000","last_peered":"2023-10-09T06:23:06.692643+0000","last_clean":"2023-10-09T06:23:06.692643+0000","last_became_active":"2023-10-09T06:23:06.691754+0000","last_became_peered":"2023-10-09T06:23:06.691754+0000","last_unstale":"2023-10-09T06:23:06.692643+0000","last_undegraded":"2023-10-09T06:23:06.692643+0000","last_fullsized":"2023-10-09T06:23:06.692643+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:17:01.541693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.982716+0000","last_change":"2023-10-09T06:23:05.982617+0000","last_active":"2023-10-09T06:23:05.982716+0000","last_peered":"2023-10-09T06:23:05.982716+0000","last_clean":"2023-10-09T06:23:05.982716+0000","last_became_active":"2023-10-09T06:23:05.982348+0000","last_became_peered":"2023-10-09T06:23:05.982348+0000","last_unstale":"2023-10-09T06:23:05.982716+0000","last_undegraded":"2023-10-09T06:23:05.982716+0000","last_fullsized":"2023-10-09T06:23:05.982716+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:03.155156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695492+0000","last_change":"2023-10-09T06:23:06.695492+0000","last_active":"2023-10-09T06:23:06.695492+0000","last_peered":"2023-10-09T06:23:06.695492+0000","last_clean":"2023-10-09T06:23:06.695492+0000","last_became_active":"2023-10-09T06:23:06.695100+0000","last_became_peered":"2023-10-09T06:23:06.695100+0000","last_unstale":"2023-10-09T06:23:06.695492+0000","last_undegraded":"2023-10-09T06:23:06.695492+0000","last_fullsized":"2023-10-09T06:23:06.695492+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:07:05.280951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"64'2","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.980089+0000","last_change":"2023-10-09T06:23:05.976532+0000","last_active":"2023-10-09T06:23:06.980089+0000","last_peered":"2023-10-09T06:23:06.980089+0000","last_clean":"2023-10-09T06:23:06.980089+0000","last_became_active":"2023-10-09T06:23:05.976303+0000","last_became_peered":"2023-10-09T06:23:05.976303+0000","last_unstale":"2023-10-09T06:23:06.980089+0000","last_undegraded":"2023-10-09T06:23:06.980089+0000","last_fullsized":"2023-10-09T06:23:06.980089+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:07:04.276445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.696759+0000","last_change":"2023-10-09T06:23:06.696759+0000","last_active":"2023-10-09T06:23:06.696759+0000","last_peered":"2023-10-09T06:23:06.696759+0000","last_clean":"2023-10-09T06:23:06.696759+0000","last_became_active":"2023-10-09T06:23:06.696296+0000","last_became_peered":"2023-10-09T06:23:06.696296+0000","last_unstale":"2023-10-09T06:23:06.696759+0000","last_undegraded":"2023-10-09T06:23:06.696759+0000","last_fullsized":"2023-10-09T06:23:06.696759+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:40.009089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.973811+0000","last_change":"2023-10-09T06:23:05.973742+0000","last_active":"2023-10-09T06:23:05.973811+0000","last_peered":"2023-10-09T06:23:05.973811+0000","last_clean":"2023-10-09T06:23:05.973811+0000","last_became_active":"2023-10-09T06:23:05.973499+0000","last_became_peered":"2023-10-09T06:23:05.973499+0000","last_unstale":"2023-10-09T06:23:05.973811+0000","last_undegraded":"2023-10-09T06:23:05.973811+0000","last_fullsized":"2023-10-09T06:23:05.973811+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:58.108816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695698+0000","last_change":"2023-10-09T06:23:06.695698+0000","last_active":"2023-10-09T06:23:06.695698+0000","last_peered":"2023-10-09T06:23:06.695698+0000","last_clean":"2023-10-09T06:23:06.695698+0000","last_became_active":"2023-10-09T06:23:06.695332+0000","last_became_peered":"2023-10-09T06:23:06.695332+0000","last_unstale":"2023-10-09T06:23:06.695698+0000","last_undegraded":"2023-10-09T06:23:06.695698+0000","last_fullsized":"2023-10-09T06:23:06.695698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:02.861322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.976185+0000","last_change":"2023-10-09T06:23:05.976120+0000","last_active":"2023-10-09T06:23:05.976185+0000","last_peered":"2023-10-09T06:23:05.976185+0000","last_clean":"2023-10-09T06:23:05.976185+0000","last_became_active":"2023-10-09T06:23:05.975803+0000","last_became_peered":"2023-10-09T06:23:05.975803+0000","last_unstale":"2023-10-09T06:23:05.976185+0000","last_undegraded":"2023-10-09T06:23:05.976185+0000","last_fullsized":"2023-10-09T06:23:05.976185+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:52:33.804162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692536+0000","last_change":"2023-10-09T06:23:06.692536+0000","last_active":"2023-10-09T06:23:06.692536+0000","last_peered":"2023-10-09T06:23:06.692536+0000","last_clean":"2023-10-09T06:23:06.692536+0000","last_became_active":"2023-10-09T06:23:06.692314+0000","last_became_peered":"2023-10-09T06:23:06.692314+0000","last_unstale":"2023-10-09T06:23:06.692536+0000","last_undegraded":"2023-10-09T06:23:06.692536+0000","last_fullsized":"2023-10-09T06:23:06.692536+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:40.055429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"64'2","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.979560+0000","last_change":"2023-10-09T06:23:05.974823+0000","last_active":"2023-10-09T06:23:06.979560+0000","last_peered":"2023-10-09T06:23:06.979560+0000","last_clean":"2023-10-09T06:23:06.979560+0000","last_became_active":"2023-10-09T06:23:05.974238+0000","last_became_peered":"2023-10-09T06:23:05.974238+0000","last_unstale":"2023-10-09T06:23:06.979560+0000","last_undegraded":"2023-10-09T06:23:06.979560+0000","last_fullsized":"2023-10-09T06:23:06.979560+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:05.388597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695363+0000","last_change":"2023-10-09T06:23:06.695363+0000","last_active":"2023-10-09T06:23:06.695363+0000","last_peered":"2023-10-09T06:23:06.695363+0000","last_clean":"2023-10-09T06:23:06.695363+0000","last_became_active":"2023-10-09T06:23:06.694816+0000","last_became_peered":"2023-10-09T06:23:06.694816+0000","last_unstale":"2023-10-09T06:23:06.695363+0000","last_undegraded":"2023-10-09T06:23:06.695363+0000","last_fullsized":"2023-10-09T06:23:06.695363+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:43:14.884324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.982412+0000","last_change":"2023-10-09T06:23:05.982114+0000","last_active":"2023-10-09T06:23:05.982412+0000","last_peered":"2023-10-09T06:23:05.982412+0000","last_clean":"2023-10-09T06:23:05.982412+0000","last_became_active":"2023-10-09T06:23:05.981441+0000","last_became_peered":"2023-10-09T06:23:05.981441+0000","last_unstale":"2023-10-09T06:23:05.982412+0000","last_undegraded":"2023-10-09T06:23:05.982412+0000","last_fullsized":"2023-10-09T06:23:05.982412+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:29.677786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691097+0000","last_change":"2023-10-09T06:23:06.691097+0000","last_active":"2023-10-09T06:23:06.691097+0000","last_peered":"2023-10-09T06:23:06.691097+0000","last_clean":"2023-10-09T06:23:06.691097+0000","last_became_active":"2023-10-09T06:23:06.690672+0000","last_became_peered":"2023-10-09T06:23:06.690672+0000","last_unstale":"2023-10-09T06:23:06.691097+0000","last_undegraded":"2023-10-09T06:23:06.691097+0000","last_fullsized":"2023-10-09T06:23:06.691097+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:52.509565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.685837+0000","last_change":"2023-10-09T06:23:05.973166+0000","last_active":"2023-10-09T06:23:06.685837+0000","last_peered":"2023-10-09T06:23:06.685837+0000","last_clean":"2023-10-09T06:23:06.685837+0000","last_became_active":"2023-10-09T06:23:05.972938+0000","last_became_peered":"2023-10-09T06:23:05.972938+0000","last_unstale":"2023-10-09T06:23:06.685837+0000","last_undegraded":"2023-10-09T06:23:06.685837+0000","last_fullsized":"2023-10-09T06:23:06.685837+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:07.765495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695519+0000","last_change":"2023-10-09T06:23:06.695519+0000","last_active":"2023-10-09T06:23:06.695519+0000","last_peered":"2023-10-09T06:23:06.695519+0000","last_clean":"2023-10-09T06:23:06.695519+0000","last_became_active":"2023-10-09T06:23:06.694464+0000","last_became_peered":"2023-10-09T06:23:06.694464+0000","last_unstale":"2023-10-09T06:23:06.695519+0000","last_undegraded":"2023-10-09T06:23:06.695519+0000","last_fullsized":"2023-10-09T06:23:06.695519+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:38.467482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.979058+0000","last_change":"2023-10-09T06:23:05.978995+0000","last_active":"2023-10-09T06:23:05.979058+0000","last_peered":"2023-10-09T06:23:05.979058+0000","last_clean":"2023-10-09T06:23:05.979058+0000","last_became_active":"2023-10-09T06:23:05.977781+0000","last_became_peered":"2023-10-09T06:23:05.977781+0000","last_unstale":"2023-10-09T06:23:05.979058+0000","last_undegraded":"2023-10-09T06:23:05.979058+0000","last_fullsized":"2023-10-09T06:23:05.979058+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:07.158118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691089+0000","last_change":"2023-10-09T06:23:06.691089+0000","last_active":"2023-10-09T06:23:06.691089+0000","last_peered":"2023-10-09T06:23:06.691089+0000","last_clean":"2023-10-09T06:23:06.691089+0000","last_became_active":"2023-10-09T06:23:06.690590+0000","last_became_peered":"2023-10-09T06:23:06.690590+0000","last_unstale":"2023-10-09T06:23:06.691089+0000","last_undegraded":"2023-10-09T06:23:06.691089+0000","last_fullsized":"2023-10-09T06:23:06.691089+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:10:10.761210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.979176+0000","last_change":"2023-10-09T06:23:05.979114+0000","last_active":"2023-10-09T06:23:05.979176+0000","last_peered":"2023-10-09T06:23:05.979176+0000","last_clean":"2023-10-09T06:23:05.979176+0000","last_became_active":"2023-10-09T06:23:05.978887+0000","last_became_peered":"2023-10-09T06:23:05.978887+0000","last_unstale":"2023-10-09T06:23:05.979176+0000","last_undegraded":"2023-10-09T06:23:05.979176+0000","last_fullsized":"2023-10-09T06:23:05.979176+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:20.927270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.697254+0000","last_change":"2023-10-09T06:23:06.697195+0000","last_active":"2023-10-09T06:23:06.697254+0000","last_peered":"2023-10-09T06:23:06.697254+0000","last_clean":"2023-10-09T06:23:06.697254+0000","last_became_active":"2023-10-09T06:23:06.696987+0000","last_became_peered":"2023-10-09T06:23:06.696987+0000","last_unstale":"2023-10-09T06:23:06.697254+0000","last_undegraded":"2023-10-09T06:23:06.697254+0000","last_fullsized":"2023-10-09T06:23:06.697254+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:02.861322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.686311+0000","last_change":"2023-10-09T06:23:05.979305+0000","last_active":"2023-10-09T06:23:06.686311+0000","last_peered":"2023-10-09T06:23:06.686311+0000","last_clean":"2023-10-09T06:23:06.686311+0000","last_became_active":"2023-10-09T06:23:05.979062+0000","last_became_peered":"2023-10-09T06:23:05.979062+0000","last_unstale":"2023-10-09T06:23:06.686311+0000","last_undegraded":"2023-10-09T06:23:06.686311+0000","last_fullsized":"2023-10-09T06:23:06.686311+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:42.526096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691944+0000","last_change":"2023-10-09T06:23:06.691944+0000","last_active":"2023-10-09T06:23:06.691944+0000","last_peered":"2023-10-09T06:23:06.691944+0000","last_clean":"2023-10-09T06:23:06.691944+0000","last_became_active":"2023-10-09T06:23:06.690990+0000","last_became_peered":"2023-10-09T06:23:06.690990+0000","last_unstale":"2023-10-09T06:23:06.691944+0000","last_undegraded":"2023-10-09T06:23:06.691944+0000","last_fullsized":"2023-10-09T06:23:06.691944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:01.847031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.978754+0000","last_change":"2023-10-09T06:23:05.978533+0000","last_active":"2023-10-09T06:23:05.978754+0000","last_peered":"2023-10-09T06:23:05.978754+0000","last_clean":"2023-10-09T06:23:05.978754+0000","last_became_active":"2023-10-09T06:23:05.978306+0000","last_became_peered":"2023-10-09T06:23:05.978306+0000","last_unstale":"2023-10-09T06:23:05.978754+0000","last_undegraded":"2023-10-09T06:23:05.978754+0000","last_fullsized":"2023-10-09T06:23:05.978754+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:16.128210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.687804+0000","last_change":"2023-10-09T06:23:06.687804+0000","last_active":"2023-10-09T06:23:06.687804+0000","last_peered":"2023-10-09T06:23:06.687804+0000","last_clean":"2023-10-09T06:23:06.687804+0000","last_became_active":"2023-10-09T06:23:06.687275+0000","last_became_peered":"2023-10-09T06:23:06.687275+0000","last_unstale":"2023-10-09T06:23:06.687804+0000","last_undegraded":"2023-10-09T06:23:06.687804+0000","last_fullsized":"2023-10-09T06:23:06.687804+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:10:07.982971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.980611+0000","last_change":"2023-10-09T06:23:05.980330+0000","last_active":"2023-10-09T06:23:05.980611+0000","last_peered":"2023-10-09T06:23:05.980611+0000","last_clean":"2023-10-09T06:23:05.980611+0000","last_became_active":"2023-10-09T06:23:05.979347+0000","last_became_peered":"2023-10-09T06:23:05.979347+0000","last_unstale":"2023-10-09T06:23:05.980611+0000","last_undegraded":"2023-10-09T06:23:05.980611+0000","last_fullsized":"2023-10-09T06:23:05.980611+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:19:03.344304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.696600+0000","last_change":"2023-10-09T06:23:06.696600+0000","last_active":"2023-10-09T06:23:06.696600+0000","last_peered":"2023-10-09T06:23:06.696600+0000","last_clean":"2023-10-09T06:23:06.696600+0000","last_became_active":"2023-10-09T06:23:06.696341+0000","last_became_peered":"2023-10-09T06:23:06.696341+0000","last_unstale":"2023-10-09T06:23:06.696600+0000","last_undegraded":"2023-10-09T06:23:06.696600+0000","last_fullsized":"2023-10-09T06:23:06.696600+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:46.352272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.685140+0000","last_change":"2023-10-09T06:23:05.977119+0000","last_active":"2023-10-09T06:23:06.685140+0000","last_peered":"2023-10-09T06:23:06.685140+0000","last_clean":"2023-10-09T06:23:06.685140+0000","last_became_active":"2023-10-09T06:23:05.976901+0000","last_became_peered":"2023-10-09T06:23:05.976901+0000","last_unstale":"2023-10-09T06:23:06.685140+0000","last_undegraded":"2023-10-09T06:23:06.685140+0000","last_fullsized":"2023-10-09T06:23:06.685140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:33.042645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.686595+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:23:06.686595+0000","last_peered":"2023-10-09T06:23:06.686595+0000","last_clean":"2023-10-09T06:23:06.686595+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:23:06.686595+0000","last_undegraded":"2023-10-09T06:23:06.686595+0000","last_fullsized":"2023-10-09T06:23:06.686595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":902,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194410,"statfs":{"total":200000000,"available":199076286,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64200000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.5},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.68200000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.66600000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70799999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.72699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.35799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41799999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78800000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.378},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.45700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194987,"statfs":{"total":200000000,"available":199666814,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.78700000000000003,"15min":0.83299999999999996},"min":{"1min":0.35099999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.72099999999999997,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.76200000000000001,"5min":1.133,"15min":1.133},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.754,"5min":1.155,"15min":1.155},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.378,"5min":0.317,"15min":0.317},"max":{"1min":0.79300000000000004,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.63}]},{"osd":2,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.41199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86499999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.79800000000000004,"15min":0.83999999999999997},"min":{"1min":0.35999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.60299999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81599999999999995,"5min":1.337,"15min":1.337},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90400000000000003,"5min":1.206,"15min":1.206},"last":0.61699999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.32700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.5,"15min":0.498},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.40899999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33400000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73199999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.437}]},{"osd":7,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.52100000000000002},"min":{"1min":0.36299999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54800000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.52400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":319,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194993,"statfs":{"total":200000000,"available":199673012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.36799999999999999,"15min":0.372},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.32300000000000001,"15min":0.32100000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.28699999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.374,"15min":0.377},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.35299999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.40100000000000002},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.37}]},{"osd":4,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.748,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.82499999999999996,"15min":0.86299999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0309999999999999,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.42599999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.66800000000000004},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93799999999999994,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64600000000000002,"15min":0.65100000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97599999999999998,"5min":1.49,"15min":1.49},"last":0.61799999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47299999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":897,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194414,"statfs":{"total":200000000,"available":199080644,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.41599999999999998,"15min":0.42799999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.50700000000000001,"5min":1.226,"15min":1.226},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42399999999999999,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60599999999999998,"5min":1.131,"15min":1.131},"last":0.39000000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":1.048,"15min":1.1579999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.65200000000000002,"5min":12.929,"15min":12.929},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.57599999999999996,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.46700000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47499999999999998,"15min":0.48299999999999998},"min":{"1min":0.314,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66500000000000004,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.48799999999999999,"15min":0.501},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.628,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.41699999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.72599999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.436,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86299999999999999,"5min":1.335,"15min":1.335},"last":0.67300000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.621,"15min":0.624},"min":{"1min":0.45500000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.74199999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.61299999999999999},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.73299999999999998,"5min":0.999,"15min":0.999},"last":0.65900000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76200000000000001,"5min":0.998,"15min":0.998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.68100000000000005,"15min":0.68799999999999994},"min":{"1min":0.47599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81299999999999994,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.81699999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68000000000000005,"15min":0.68700000000000006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79400000000000004,"5min":1.262,"15min":1.262},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.51600000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.74199999999999999,"5min":1.103,"15min":1.103},"last":0.77200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":319,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194993,"statfs":{"total":200000000,"available":199673046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.92500000000000004,"15min":1.0269999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47999999999999998,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.69499999999999995,"15min":0.751},"min":{"1min":0.24099999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54100000000000004,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.24299999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.64900000000000002,"15min":0.70499999999999996},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.45900000000000002,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.74099999999999999,"15min":0.77300000000000002},"min":{"1min":0.25600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":4.6870000000000003,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.28499999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.71899999999999997,"15min":0.77400000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55900000000000005,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.97999999999999998,"15min":1.0780000000000001},"min":{"1min":0.28799999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52200000000000002,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.433}]},{"osd":4,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":1.1850000000000001,"15min":1.284},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82999999999999996,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.94799999999999995,"15min":1.0069999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78200000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.53700000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.91900000000000004,"15min":0.97499999999999998},"min":{"1min":0.376,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85899999999999999,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.92500000000000004,"15min":0.97999999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84599999999999997,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.57499999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.90900000000000003,"15min":0.96099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79600000000000004,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.628},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.177,"15min":1.274},"min":{"1min":0.40000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.878,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.90300000000000002,"15min":0.95899999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.92000000000000004,"15min":0.97399999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77400000000000002,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.50700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":319,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194993,"statfs":{"total":200000000,"available":199673046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.318,"15min":0.31900000000000001},"min":{"1min":0.21199999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.39800000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.36599999999999999,"15min":0.36499999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.35499999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.32000000000000001,"15min":0.316},"min":{"1min":0.25,"5min":0.215,"15min":0.215},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.27300000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.47499999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.47499999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40500000000000003,"15min":0.40400000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.38900000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79500000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.502},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69299999999999995,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.372}]},{"osd":5,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.44600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81799999999999995,"5min":0.872,"15min":0.872},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.435}]},{"osd":6,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42999999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.76100000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.441,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78000000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.48799999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.438,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.49199999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194991,"statfs":{"total":200000000,"available":199671566,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.33000000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57199999999999995}]},{"osd":1,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51100000000000001,"15min":0.50700000000000001},"min":{"1min":0.36499999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.74399999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.72799999999999998,"15min":0.75},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5680000000000001,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.54500000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.72199999999999998,"15min":0.74099999999999999},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.7110000000000001,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":1.1180000000000001,"15min":1.214},"min":{"1min":0.40100000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72599999999999998,"5min":11.715,"15min":11.715},"last":0.50800000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.439,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.59299999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.497,"15min":0.499},"min":{"1min":0.32700000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.375},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51600000000000001,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60999999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.44700000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.502,"15min":0.502},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40799999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.35099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.49099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":319,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194992,"statfs":{"total":200000000,"available":199672478,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50700000000000001},"min":{"1min":0.40400000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.41299999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51300000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.377,"15min":0.377},"max":{"1min":0.748,"5min":0.752,"15min":0.752},"last":0.495},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.58299999999999996}]},{"osd":2,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.50700000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66900000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.78300000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.36199999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45300000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.745,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.499,"15min":0.50600000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.65200000000000002,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.629}]},{"osd":6,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.53400000000000003,"15min":0.54600000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80000000000000004,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.315,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.59899999999999998,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.753}]}]}],"pool_statfs":[]}} 2023-10-09T06:23:11.078 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:23:11.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.231+0000 7f864cc2f700 1 Processor -- start 2023-10-09T06:23:11.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.231+0000 7f864cc2f700 1 -- start start 2023-10-09T06:23:11.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f864cc2f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86481557b0 0x7f8648162a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:11.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f864cc2f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864815c450 con 0x7f8648070e80 2023-10-09T06:23:11.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f864cc2f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864815b840 con 0x7f86480687b0 2023-10-09T06:23:11.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f864cc2f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864815bb20 con 0x7f86481557b0 2023-10-09T06:23:11.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f8647fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86481557b0 0x7f8648162a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:11.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f8646ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8648070e80 0x7f86481550a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32786/0 (socket says 172.21.15.31:32786) 2023-10-09T06:23:11.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f8647fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86481557b0 0x7f8648162a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40698/0 (socket says 172.21.15.31:40698) 2023-10-09T06:23:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f8646ffd700 1 -- 172.21.15.31:0/545709313 learned_addr learned my addr 172.21.15.31:0/545709313 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:23:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f8647fff700 1 -- 172.21.15.31:0/545709313 >> v1:172.21.15.158:6789/0 conn(0x7f86480687b0 legacy=0x7f8648070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f8647fff700 1 -- 172.21.15.31:0/545709313 >> v1:172.21.15.31:6789/0 conn(0x7f8648070e80 legacy=0x7f86481550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f8647fff700 1 -- 172.21.15.31:0/545709313 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864815be00 con 0x7f86481557b0 2023-10-09T06:23:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f86467fc700 1 -- 172.21.15.31:0/545709313 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898767530 0 0) 0x7f864815c450 con 0x7f8648070e80 2023-10-09T06:23:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f8647fff700 1 --2- 172.21.15.31:0/545709313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86481557b0 0x7f8648162a40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8640009e60 tx=0x7f8640009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380e6eba96d62e35 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f86467fc700 1 -- 172.21.15.31:0/545709313 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864000e070 con 0x7f86481557b0 2023-10-09T06:23:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f86467fc700 1 -- 172.21.15.31:0/545709313 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864000bc30 con 0x7f86481557b0 2023-10-09T06:23:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f86467fc700 1 -- 172.21.15.31:0/545709313 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640012430 con 0x7f86481557b0 2023-10-09T06:23:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f864cc2f700 1 -- 172.21.15.31:0/545709313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86481557b0 msgr2=0x7f8648162a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f864cc2f700 1 --2- 172.21.15.31:0/545709313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86481557b0 0x7f8648162a40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8640009e60 tx=0x7f8640009780 comp rx=0 tx=0).stop 2023-10-09T06:23:11.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f864cc2f700 1 -- 172.21.15.31:0/545709313 shutdown_connections 2023-10-09T06:23:11.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f864cc2f700 1 --2- 172.21.15.31:0/545709313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86481557b0 0x7f8648162a40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f864cc2f700 1 -- 172.21.15.31:0/545709313 >> 172.21.15.31:0/545709313 conn(0x7f86480cd970 msgr2=0x7f86480cdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:11.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f864cc2f700 1 -- 172.21.15.31:0/545709313 shutdown_connections 2023-10-09T06:23:11.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.232+0000 7f864cc2f700 1 -- 172.21.15.31:0/545709313 wait complete. 2023-10-09T06:23:11.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.233+0000 7f864cc2f700 1 Processor -- start 2023-10-09T06:23:11.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.233+0000 7f864cc2f700 1 -- start start 2023-10-09T06:23:11.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.234+0000 7f864cc2f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86480687b0 0x7f864813f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:11.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.234+0000 7f864cc2f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8648070e80 0x7f864815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:11.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.234+0000 7f864cc2f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86481557b0 0x7f864815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:11.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.234+0000 7f864cc2f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864816d8c0 con 0x7f86480687b0 2023-10-09T06:23:11.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.234+0000 7f864cc2f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864816dba0 con 0x7f8648070e80 2023-10-09T06:23:11.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.234+0000 7f864cc2f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864816de80 con 0x7f86481557b0 2023-10-09T06:23:11.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.234+0000 7f86477fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86480687b0 0x7f864813f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:11.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.234+0000 7f86477fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86480687b0 0x7f864813f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40710/0 (socket says 172.21.15.31:40710) 2023-10-09T06:23:11.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.234+0000 7f86477fe700 1 -- 172.21.15.31:0/2557929370 learned_addr learned my addr 172.21.15.31:0/2557929370 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:11.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.234+0000 7f8646ffd700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8648070e80 0x7f864815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.234+0000 7f8647fff700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86481557b0 0x7f864815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.235+0000 7f86477fe700 1 -- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86481557b0 msgr2=0x7f864815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.235+0000 7f86477fe700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86481557b0 0x7f864815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.235+0000 7f86477fe700 1 -- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8648070e80 msgr2=0x7f864815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.235+0000 7f86477fe700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8648070e80 0x7f864815a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.235+0000 7f86477fe700 1 -- 172.21.15.31:0/2557929370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8640009a20 con 0x7f86480687b0 2023-10-09T06:23:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.235+0000 7f86477fe700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86480687b0 0x7f864813f2b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f863c00c590 tx=0x7f863c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.235+0000 7f862f7fe700 1 -- 172.21.15.31:0/2557929370 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c012630 con 0x7f86480687b0 2023-10-09T06:23:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.235+0000 7f862f7fe700 1 -- 172.21.15.31:0/2557929370 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c012790 con 0x7f86480687b0 2023-10-09T06:23:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.235+0000 7f864cc2f700 1 -- 172.21.15.31:0/2557929370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864816e160 con 0x7f86480687b0 2023-10-09T06:23:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.235+0000 7f862f7fe700 1 -- 172.21.15.31:0/2557929370 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c012b50 con 0x7f86480687b0 2023-10-09T06:23:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.235+0000 7f864cc2f700 1 -- 172.21.15.31:0/2557929370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86480c88a0 con 0x7f86480687b0 2023-10-09T06:23:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.236+0000 7f864cc2f700 1 -- 172.21.15.31:0/2557929370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864806d6f0 con 0x7f86480687b0 2023-10-09T06:23:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.238+0000 7f862f7fe700 1 -- 172.21.15.31:0/2557929370 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f863c01b400 con 0x7f86480687b0 2023-10-09T06:23:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.238+0000 7f862f7fe700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8634066f30 0x7f86340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.238+0000 7f862f7fe700 1 -- 172.21.15.31:0/2557929370 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f863c0841a0 con 0x7f86480687b0 2023-10-09T06:23:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.238+0000 7f8646ffd700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8634066f30 0x7f86340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.238+0000 7f8646ffd700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8634066f30 0x7f86340693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8648154a60 tx=0x7f8638009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.241+0000 7f862f7fe700 1 -- 172.21.15.31:0/2557929370 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f863c051410 con 0x7f86480687b0 2023-10-09T06:23:11.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.432+0000 7f864cc2f700 1 -- 172.21.15.31:0/2557929370 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f864815c0e0 con 0x7f8634066f30 2023-10-09T06:23:11.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.441+0000 7f862f7fe700 1 -- 172.21.15.31:0/2557929370 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284658 (secure 0 0 0) 0x7f864815c0e0 con 0x7f8634066f30 2023-10-09T06:23:11.444 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:23:11.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.444+0000 7f864cc2f700 1 -- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8634066f30 msgr2=0x7f86340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.444+0000 7f864cc2f700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8634066f30 0x7f86340693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8648154a60 tx=0x7f8638009040 comp rx=0 tx=0).stop 2023-10-09T06:23:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.444+0000 7f864cc2f700 1 -- 172.21.15.31:0/2557929370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86480687b0 msgr2=0x7f864813f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.444+0000 7f864cc2f700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86480687b0 0x7f864813f2b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f863c00c590 tx=0x7f863c00c950 comp rx=0 tx=0).stop 2023-10-09T06:23:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.444+0000 7f864cc2f700 1 -- 172.21.15.31:0/2557929370 shutdown_connections 2023-10-09T06:23:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.444+0000 7f864cc2f700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8634066f30 0x7f86340693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.444+0000 7f864cc2f700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86481557b0 0x7f864815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.444+0000 7f864cc2f700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86480687b0 0x7f864813f2b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.444+0000 7f864cc2f700 1 --2- 172.21.15.31:0/2557929370 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8648070e80 0x7f864815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.444+0000 7f864cc2f700 1 -- 172.21.15.31:0/2557929370 >> 172.21.15.31:0/2557929370 conn(0x7f86480cd970 msgr2=0x7f864814c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.444+0000 7f864cc2f700 1 -- 172.21.15.31:0/2557929370 shutdown_connections 2023-10-09T06:23:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.444+0000 7f864cc2f700 1 -- 172.21.15.31:0/2557929370 wait complete. 2023-10-09T06:23:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:23:11.456 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-10-09T06:23:10.549974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3723,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558776,"statfs":{"total":1600000000,"available":1596186892,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.586771"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.697348+0000","last_change":"2023-10-09T06:23:06.697348+0000","last_active":"2023-10-09T06:23:06.697348+0000","last_peered":"2023-10-09T06:23:06.697348+0000","last_clean":"2023-10-09T06:23:06.697348+0000","last_became_active":"2023-10-09T06:23:06.697111+0000","last_became_peered":"2023-10-09T06:23:06.697111+0000","last_unstale":"2023-10-09T06:23:06.697348+0000","last_undegraded":"2023-10-09T06:23:06.697348+0000","last_fullsized":"2023-10-09T06:23:06.697348+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:38.854130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691223+0000","last_change":"2023-10-09T06:23:06.691223+0000","last_active":"2023-10-09T06:23:06.691223+0000","last_peered":"2023-10-09T06:23:06.691223+0000","last_clean":"2023-10-09T06:23:06.691223+0000","last_became_active":"2023-10-09T06:23:06.690875+0000","last_became_peered":"2023-10-09T06:23:06.690875+0000","last_unstale":"2023-10-09T06:23:06.691223+0000","last_undegraded":"2023-10-09T06:23:06.691223+0000","last_fullsized":"2023-10-09T06:23:06.691223+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:42.962968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694202+0000","last_change":"2023-10-09T06:23:06.694071+0000","last_active":"2023-10-09T06:23:06.694202+0000","last_peered":"2023-10-09T06:23:06.694202+0000","last_clean":"2023-10-09T06:23:06.694202+0000","last_became_active":"2023-10-09T06:23:06.693786+0000","last_became_peered":"2023-10-09T06:23:06.693786+0000","last_unstale":"2023-10-09T06:23:06.694202+0000","last_undegraded":"2023-10-09T06:23:06.694202+0000","last_fullsized":"2023-10-09T06:23:06.694202+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:49.275500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.693689+0000","last_change":"2023-10-09T06:23:06.693689+0000","last_active":"2023-10-09T06:23:06.693689+0000","last_peered":"2023-10-09T06:23:06.693689+0000","last_clean":"2023-10-09T06:23:06.693689+0000","last_became_active":"2023-10-09T06:23:06.693445+0000","last_became_peered":"2023-10-09T06:23:06.693445+0000","last_unstale":"2023-10-09T06:23:06.693689+0000","last_undegraded":"2023-10-09T06:23:06.693689+0000","last_fullsized":"2023-10-09T06:23:06.693689+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:16:32.933584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.690963+0000","last_change":"2023-10-09T06:23:06.690963+0000","last_active":"2023-10-09T06:23:06.690963+0000","last_peered":"2023-10-09T06:23:06.690963+0000","last_clean":"2023-10-09T06:23:06.690963+0000","last_became_active":"2023-10-09T06:23:06.690754+0000","last_became_peered":"2023-10-09T06:23:06.690754+0000","last_unstale":"2023-10-09T06:23:06.690963+0000","last_undegraded":"2023-10-09T06:23:06.690963+0000","last_fullsized":"2023-10-09T06:23:06.690963+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:06.393103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.697509+0000","last_change":"2023-10-09T06:23:06.697509+0000","last_active":"2023-10-09T06:23:06.697509+0000","last_peered":"2023-10-09T06:23:06.697509+0000","last_clean":"2023-10-09T06:23:06.697509+0000","last_became_active":"2023-10-09T06:23:06.695043+0000","last_became_peered":"2023-10-09T06:23:06.695043+0000","last_unstale":"2023-10-09T06:23:06.697509+0000","last_undegraded":"2023-10-09T06:23:06.697509+0000","last_fullsized":"2023-10-09T06:23:06.697509+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:40.055429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692094+0000","last_change":"2023-10-09T06:23:06.691919+0000","last_active":"2023-10-09T06:23:06.692094+0000","last_peered":"2023-10-09T06:23:06.692094+0000","last_clean":"2023-10-09T06:23:06.692094+0000","last_became_active":"2023-10-09T06:23:06.691362+0000","last_became_peered":"2023-10-09T06:23:06.691362+0000","last_unstale":"2023-10-09T06:23:06.692094+0000","last_undegraded":"2023-10-09T06:23:06.692094+0000","last_fullsized":"2023-10-09T06:23:06.692094+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:44:08.391255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.687924+0000","last_change":"2023-10-09T06:23:06.687924+0000","last_active":"2023-10-09T06:23:06.687924+0000","last_peered":"2023-10-09T06:23:06.687924+0000","last_clean":"2023-10-09T06:23:06.687924+0000","last_became_active":"2023-10-09T06:23:06.687581+0000","last_became_peered":"2023-10-09T06:23:06.687581+0000","last_unstale":"2023-10-09T06:23:06.687924+0000","last_undegraded":"2023-10-09T06:23:06.687924+0000","last_fullsized":"2023-10-09T06:23:06.687924+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:42.075495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694908+0000","last_change":"2023-10-09T06:23:06.694845+0000","last_active":"2023-10-09T06:23:06.694908+0000","last_peered":"2023-10-09T06:23:06.694908+0000","last_clean":"2023-10-09T06:23:06.694908+0000","last_became_active":"2023-10-09T06:23:06.694626+0000","last_became_peered":"2023-10-09T06:23:06.694626+0000","last_unstale":"2023-10-09T06:23:06.694908+0000","last_undegraded":"2023-10-09T06:23:06.694908+0000","last_fullsized":"2023-10-09T06:23:06.694908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:35.500010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.690931+0000","last_change":"2023-10-09T06:23:06.690931+0000","last_active":"2023-10-09T06:23:06.690931+0000","last_peered":"2023-10-09T06:23:06.690931+0000","last_clean":"2023-10-09T06:23:06.690931+0000","last_became_active":"2023-10-09T06:23:06.690373+0000","last_became_peered":"2023-10-09T06:23:06.690373+0000","last_unstale":"2023-10-09T06:23:06.690931+0000","last_undegraded":"2023-10-09T06:23:06.690931+0000","last_fullsized":"2023-10-09T06:23:06.690931+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:22.304821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.689015+0000","last_change":"2023-10-09T06:23:06.689015+0000","last_active":"2023-10-09T06:23:06.689015+0000","last_peered":"2023-10-09T06:23:06.689015+0000","last_clean":"2023-10-09T06:23:06.689015+0000","last_became_active":"2023-10-09T06:23:06.688745+0000","last_became_peered":"2023-10-09T06:23:06.688745+0000","last_unstale":"2023-10-09T06:23:06.689015+0000","last_undegraded":"2023-10-09T06:23:06.689015+0000","last_fullsized":"2023-10-09T06:23:06.689015+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:11.251967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695497+0000","last_change":"2023-10-09T06:23:06.695497+0000","last_active":"2023-10-09T06:23:06.695497+0000","last_peered":"2023-10-09T06:23:06.695497+0000","last_clean":"2023-10-09T06:23:06.695497+0000","last_became_active":"2023-10-09T06:23:06.695141+0000","last_became_peered":"2023-10-09T06:23:06.695141+0000","last_unstale":"2023-10-09T06:23:06.695497+0000","last_undegraded":"2023-10-09T06:23:06.695497+0000","last_fullsized":"2023-10-09T06:23:06.695497+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:02.861322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.696094+0000","last_change":"2023-10-09T06:23:06.695692+0000","last_active":"2023-10-09T06:23:06.696094+0000","last_peered":"2023-10-09T06:23:06.696094+0000","last_clean":"2023-10-09T06:23:06.696094+0000","last_became_active":"2023-10-09T06:23:06.695473+0000","last_became_peered":"2023-10-09T06:23:06.695473+0000","last_unstale":"2023-10-09T06:23:06.696094+0000","last_undegraded":"2023-10-09T06:23:06.696094+0000","last_fullsized":"2023-10-09T06:23:06.696094+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:22.304821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.688273+0000","last_change":"2023-10-09T06:23:06.688148+0000","last_active":"2023-10-09T06:23:06.688273+0000","last_peered":"2023-10-09T06:23:06.688273+0000","last_clean":"2023-10-09T06:23:06.688273+0000","last_became_active":"2023-10-09T06:23:06.687913+0000","last_became_peered":"2023-10-09T06:23:06.687913+0000","last_unstale":"2023-10-09T06:23:06.688273+0000","last_undegraded":"2023-10-09T06:23:06.688273+0000","last_fullsized":"2023-10-09T06:23:06.688273+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:50.917637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691727+0000","last_change":"2023-10-09T06:23:06.691661+0000","last_active":"2023-10-09T06:23:06.691727+0000","last_peered":"2023-10-09T06:23:06.691727+0000","last_clean":"2023-10-09T06:23:06.691727+0000","last_became_active":"2023-10-09T06:23:06.691283+0000","last_became_peered":"2023-10-09T06:23:06.691283+0000","last_unstale":"2023-10-09T06:23:06.691727+0000","last_undegraded":"2023-10-09T06:23:06.691727+0000","last_fullsized":"2023-10-09T06:23:06.691727+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:52.652292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695272+0000","last_change":"2023-10-09T06:23:06.695272+0000","last_active":"2023-10-09T06:23:06.695272+0000","last_peered":"2023-10-09T06:23:06.695272+0000","last_clean":"2023-10-09T06:23:06.695272+0000","last_became_active":"2023-10-09T06:23:06.694398+0000","last_became_peered":"2023-10-09T06:23:06.694398+0000","last_unstale":"2023-10-09T06:23:06.695272+0000","last_undegraded":"2023-10-09T06:23:06.695272+0000","last_fullsized":"2023-10-09T06:23:06.695272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:53.098429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.685444+0000","last_change":"2023-10-09T06:23:06.685444+0000","last_active":"2023-10-09T06:23:06.685444+0000","last_peered":"2023-10-09T06:23:06.685444+0000","last_clean":"2023-10-09T06:23:06.685444+0000","last_became_active":"2023-10-09T06:23:06.685228+0000","last_became_peered":"2023-10-09T06:23:06.685228+0000","last_unstale":"2023-10-09T06:23:06.685444+0000","last_undegraded":"2023-10-09T06:23:06.685444+0000","last_fullsized":"2023-10-09T06:23:06.685444+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:59:40.191593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.698565+0000","last_change":"2023-10-09T06:23:06.698522+0000","last_active":"2023-10-09T06:23:06.698565+0000","last_peered":"2023-10-09T06:23:06.698565+0000","last_clean":"2023-10-09T06:23:06.698565+0000","last_became_active":"2023-10-09T06:23:06.697943+0000","last_became_peered":"2023-10-09T06:23:06.697943+0000","last_unstale":"2023-10-09T06:23:06.698565+0000","last_undegraded":"2023-10-09T06:23:06.698565+0000","last_fullsized":"2023-10-09T06:23:06.698565+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:40.009089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692917+0000","last_change":"2023-10-09T06:23:06.692917+0000","last_active":"2023-10-09T06:23:06.692917+0000","last_peered":"2023-10-09T06:23:06.692917+0000","last_clean":"2023-10-09T06:23:06.692917+0000","last_became_active":"2023-10-09T06:23:06.692144+0000","last_became_peered":"2023-10-09T06:23:06.692144+0000","last_unstale":"2023-10-09T06:23:06.692917+0000","last_undegraded":"2023-10-09T06:23:06.692917+0000","last_fullsized":"2023-10-09T06:23:06.692917+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:21.931777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.696064+0000","last_change":"2023-10-09T06:23:06.696064+0000","last_active":"2023-10-09T06:23:06.696064+0000","last_peered":"2023-10-09T06:23:06.696064+0000","last_clean":"2023-10-09T06:23:06.696064+0000","last_became_active":"2023-10-09T06:23:06.695818+0000","last_became_peered":"2023-10-09T06:23:06.695818+0000","last_unstale":"2023-10-09T06:23:06.696064+0000","last_undegraded":"2023-10-09T06:23:06.696064+0000","last_fullsized":"2023-10-09T06:23:06.696064+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:47.384180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692666+0000","last_change":"2023-10-09T06:23:06.692611+0000","last_active":"2023-10-09T06:23:06.692666+0000","last_peered":"2023-10-09T06:23:06.692666+0000","last_clean":"2023-10-09T06:23:06.692666+0000","last_became_active":"2023-10-09T06:23:06.692062+0000","last_became_peered":"2023-10-09T06:23:06.692062+0000","last_unstale":"2023-10-09T06:23:06.692666+0000","last_undegraded":"2023-10-09T06:23:06.692666+0000","last_fullsized":"2023-10-09T06:23:06.692666+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:17.576807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.689805+0000","last_change":"2023-10-09T06:23:06.689805+0000","last_active":"2023-10-09T06:23:06.689805+0000","last_peered":"2023-10-09T06:23:06.689805+0000","last_clean":"2023-10-09T06:23:06.689805+0000","last_became_active":"2023-10-09T06:23:06.688846+0000","last_became_peered":"2023-10-09T06:23:06.688846+0000","last_unstale":"2023-10-09T06:23:06.689805+0000","last_undegraded":"2023-10-09T06:23:06.689805+0000","last_fullsized":"2023-10-09T06:23:06.689805+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:02:44.955809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.698731+0000","last_change":"2023-10-09T06:23:06.698658+0000","last_active":"2023-10-09T06:23:06.698731+0000","last_peered":"2023-10-09T06:23:06.698731+0000","last_clean":"2023-10-09T06:23:06.698731+0000","last_became_active":"2023-10-09T06:23:06.698227+0000","last_became_peered":"2023-10-09T06:23:06.698227+0000","last_unstale":"2023-10-09T06:23:06.698731+0000","last_undegraded":"2023-10-09T06:23:06.698731+0000","last_fullsized":"2023-10-09T06:23:06.698731+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:24.430154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695282+0000","last_change":"2023-10-09T06:23:06.695187+0000","last_active":"2023-10-09T06:23:06.695282+0000","last_peered":"2023-10-09T06:23:06.695282+0000","last_clean":"2023-10-09T06:23:06.695282+0000","last_became_active":"2023-10-09T06:23:06.694963+0000","last_became_peered":"2023-10-09T06:23:06.694963+0000","last_unstale":"2023-10-09T06:23:06.695282+0000","last_undegraded":"2023-10-09T06:23:06.695282+0000","last_fullsized":"2023-10-09T06:23:06.695282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:43.110652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.690542+0000","last_change":"2023-10-09T06:23:06.690542+0000","last_active":"2023-10-09T06:23:06.690542+0000","last_peered":"2023-10-09T06:23:06.690542+0000","last_clean":"2023-10-09T06:23:06.690542+0000","last_became_active":"2023-10-09T06:23:06.690320+0000","last_became_peered":"2023-10-09T06:23:06.690320+0000","last_unstale":"2023-10-09T06:23:06.690542+0000","last_undegraded":"2023-10-09T06:23:06.690542+0000","last_fullsized":"2023-10-09T06:23:06.690542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:46:00.526366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691211+0000","last_change":"2023-10-09T06:23:06.691211+0000","last_active":"2023-10-09T06:23:06.691211+0000","last_peered":"2023-10-09T06:23:06.691211+0000","last_clean":"2023-10-09T06:23:06.691211+0000","last_became_active":"2023-10-09T06:23:06.690738+0000","last_became_peered":"2023-10-09T06:23:06.690738+0000","last_unstale":"2023-10-09T06:23:06.691211+0000","last_undegraded":"2023-10-09T06:23:06.691211+0000","last_fullsized":"2023-10-09T06:23:06.691211+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:06.551729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.693620+0000","last_change":"2023-10-09T06:23:06.693620+0000","last_active":"2023-10-09T06:23:06.693620+0000","last_peered":"2023-10-09T06:23:06.693620+0000","last_clean":"2023-10-09T06:23:06.693620+0000","last_became_active":"2023-10-09T06:23:06.693389+0000","last_became_peered":"2023-10-09T06:23:06.693389+0000","last_unstale":"2023-10-09T06:23:06.693620+0000","last_undegraded":"2023-10-09T06:23:06.693620+0000","last_fullsized":"2023-10-09T06:23:06.693620+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:43:14.884324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692900+0000","last_change":"2023-10-09T06:23:06.692900+0000","last_active":"2023-10-09T06:23:06.692900+0000","last_peered":"2023-10-09T06:23:06.692900+0000","last_clean":"2023-10-09T06:23:06.692900+0000","last_became_active":"2023-10-09T06:23:06.692642+0000","last_became_peered":"2023-10-09T06:23:06.692642+0000","last_unstale":"2023-10-09T06:23:06.692900+0000","last_undegraded":"2023-10-09T06:23:06.692900+0000","last_fullsized":"2023-10-09T06:23:06.692900+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:59.113323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.697512+0000","last_change":"2023-10-09T06:23:06.697512+0000","last_active":"2023-10-09T06:23:06.697512+0000","last_peered":"2023-10-09T06:23:06.697512+0000","last_clean":"2023-10-09T06:23:06.697512+0000","last_became_active":"2023-10-09T06:23:06.697067+0000","last_became_peered":"2023-10-09T06:23:06.697067+0000","last_unstale":"2023-10-09T06:23:06.697512+0000","last_undegraded":"2023-10-09T06:23:06.697512+0000","last_fullsized":"2023-10-09T06:23:06.697512+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:25.447726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694178+0000","last_change":"2023-10-09T06:23:06.693528+0000","last_active":"2023-10-09T06:23:06.694178+0000","last_peered":"2023-10-09T06:23:06.694178+0000","last_clean":"2023-10-09T06:23:06.694178+0000","last_became_active":"2023-10-09T06:23:06.691925+0000","last_became_peered":"2023-10-09T06:23:06.691925+0000","last_unstale":"2023-10-09T06:23:06.694178+0000","last_undegraded":"2023-10-09T06:23:06.694178+0000","last_fullsized":"2023-10-09T06:23:06.694178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:48.982575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692398+0000","last_change":"2023-10-09T06:23:06.692398+0000","last_active":"2023-10-09T06:23:06.692398+0000","last_peered":"2023-10-09T06:23:06.692398+0000","last_clean":"2023-10-09T06:23:06.692398+0000","last_became_active":"2023-10-09T06:23:06.691707+0000","last_became_peered":"2023-10-09T06:23:06.691707+0000","last_unstale":"2023-10-09T06:23:06.692398+0000","last_undegraded":"2023-10-09T06:23:06.692398+0000","last_fullsized":"2023-10-09T06:23:06.692398+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:41.912698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694178+0000","last_change":"2023-10-09T06:23:06.694178+0000","last_active":"2023-10-09T06:23:06.694178+0000","last_peered":"2023-10-09T06:23:06.694178+0000","last_clean":"2023-10-09T06:23:06.694178+0000","last_became_active":"2023-10-09T06:23:06.693931+0000","last_became_peered":"2023-10-09T06:23:06.693931+0000","last_unstale":"2023-10-09T06:23:06.694178+0000","last_undegraded":"2023-10-09T06:23:06.694178+0000","last_fullsized":"2023-10-09T06:23:06.694178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:49.275500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695667+0000","last_change":"2023-10-09T06:23:06.695667+0000","last_active":"2023-10-09T06:23:06.695667+0000","last_peered":"2023-10-09T06:23:06.695667+0000","last_clean":"2023-10-09T06:23:06.695667+0000","last_became_active":"2023-10-09T06:23:06.695242+0000","last_became_peered":"2023-10-09T06:23:06.695242+0000","last_unstale":"2023-10-09T06:23:06.695667+0000","last_undegraded":"2023-10-09T06:23:06.695667+0000","last_fullsized":"2023-10-09T06:23:06.695667+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:16:32.933584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"64'4","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.980186+0000","last_change":"2023-10-09T06:23:05.981971+0000","last_active":"2023-10-09T06:23:06.980186+0000","last_peered":"2023-10-09T06:23:06.980186+0000","last_clean":"2023-10-09T06:23:06.980186+0000","last_became_active":"2023-10-09T06:23:05.981124+0000","last_became_peered":"2023-10-09T06:23:05.981124+0000","last_unstale":"2023-10-09T06:23:06.980186+0000","last_undegraded":"2023-10-09T06:23:06.980186+0000","last_fullsized":"2023-10-09T06:23:06.980186+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:07.158118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.697072+0000","last_change":"2023-10-09T06:23:06.697072+0000","last_active":"2023-10-09T06:23:06.697072+0000","last_peered":"2023-10-09T06:23:06.697072+0000","last_clean":"2023-10-09T06:23:06.697072+0000","last_became_active":"2023-10-09T06:23:06.696814+0000","last_became_peered":"2023-10-09T06:23:06.696814+0000","last_unstale":"2023-10-09T06:23:06.697072+0000","last_undegraded":"2023-10-09T06:23:06.697072+0000","last_fullsized":"2023-10-09T06:23:06.697072+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:43.530603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"64'1","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.683378+0000","last_change":"2023-10-09T06:23:05.980162+0000","last_active":"2023-10-09T06:23:06.683378+0000","last_peered":"2023-10-09T06:23:06.683378+0000","last_clean":"2023-10-09T06:23:06.683378+0000","last_became_active":"2023-10-09T06:23:05.978811+0000","last_became_peered":"2023-10-09T06:23:05.978811+0000","last_unstale":"2023-10-09T06:23:06.683378+0000","last_undegraded":"2023-10-09T06:23:06.683378+0000","last_fullsized":"2023-10-09T06:23:06.683378+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:52.093922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695413+0000","last_change":"2023-10-09T06:23:06.695413+0000","last_active":"2023-10-09T06:23:06.695413+0000","last_peered":"2023-10-09T06:23:06.695413+0000","last_clean":"2023-10-09T06:23:06.695413+0000","last_became_active":"2023-10-09T06:23:06.694742+0000","last_became_peered":"2023-10-09T06:23:06.694742+0000","last_unstale":"2023-10-09T06:23:06.695413+0000","last_undegraded":"2023-10-09T06:23:06.695413+0000","last_fullsized":"2023-10-09T06:23:06.695413+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:07:05.280951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"64'2","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.979660+0000","last_change":"2023-10-09T06:23:05.978991+0000","last_active":"2023-10-09T06:23:06.979660+0000","last_peered":"2023-10-09T06:23:06.979660+0000","last_clean":"2023-10-09T06:23:06.979660+0000","last_became_active":"2023-10-09T06:23:05.978573+0000","last_became_peered":"2023-10-09T06:23:05.978573+0000","last_unstale":"2023-10-09T06:23:06.979660+0000","last_undegraded":"2023-10-09T06:23:06.979660+0000","last_fullsized":"2023-10-09T06:23:06.979660+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:17:53.747188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695568+0000","last_change":"2023-10-09T06:23:06.695568+0000","last_active":"2023-10-09T06:23:06.695568+0000","last_peered":"2023-10-09T06:23:06.695568+0000","last_clean":"2023-10-09T06:23:06.695568+0000","last_became_active":"2023-10-09T06:23:06.693922+0000","last_became_peered":"2023-10-09T06:23:06.693922+0000","last_unstale":"2023-10-09T06:23:06.695568+0000","last_undegraded":"2023-10-09T06:23:06.695568+0000","last_fullsized":"2023-10-09T06:23:06.695568+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:48.982575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"64'2","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.978390+0000","last_change":"2023-10-09T06:23:05.980953+0000","last_active":"2023-10-09T06:23:06.978390+0000","last_peered":"2023-10-09T06:23:06.978390+0000","last_clean":"2023-10-09T06:23:06.978390+0000","last_became_active":"2023-10-09T06:23:05.980691+0000","last_became_peered":"2023-10-09T06:23:05.980691+0000","last_unstale":"2023-10-09T06:23:06.978390+0000","last_undegraded":"2023-10-09T06:23:06.978390+0000","last_fullsized":"2023-10-09T06:23:06.978390+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:34.495503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.688361+0000","last_change":"2023-10-09T06:23:06.688361+0000","last_active":"2023-10-09T06:23:06.688361+0000","last_peered":"2023-10-09T06:23:06.688361+0000","last_clean":"2023-10-09T06:23:06.688361+0000","last_became_active":"2023-10-09T06:23:06.688144+0000","last_became_peered":"2023-10-09T06:23:06.688144+0000","last_unstale":"2023-10-09T06:23:06.688361+0000","last_undegraded":"2023-10-09T06:23:06.688361+0000","last_fullsized":"2023-10-09T06:23:06.688361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:41.348895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.978917+0000","last_change":"2023-10-09T06:23:05.973403+0000","last_active":"2023-10-09T06:23:06.978917+0000","last_peered":"2023-10-09T06:23:06.978917+0000","last_clean":"2023-10-09T06:23:06.978917+0000","last_became_active":"2023-10-09T06:23:05.973184+0000","last_became_peered":"2023-10-09T06:23:05.973184+0000","last_unstale":"2023-10-09T06:23:06.978917+0000","last_undegraded":"2023-10-09T06:23:06.978917+0000","last_fullsized":"2023-10-09T06:23:06.978917+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:42.106145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695569+0000","last_change":"2023-10-09T06:23:06.695569+0000","last_active":"2023-10-09T06:23:06.695569+0000","last_peered":"2023-10-09T06:23:06.695569+0000","last_clean":"2023-10-09T06:23:06.695569+0000","last_became_active":"2023-10-09T06:23:06.695370+0000","last_became_peered":"2023-10-09T06:23:06.695370+0000","last_unstale":"2023-10-09T06:23:06.695569+0000","last_undegraded":"2023-10-09T06:23:06.695569+0000","last_fullsized":"2023-10-09T06:23:06.695569+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:42.818953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"64'1","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694033+0000","last_change":"2023-10-09T06:23:05.982277+0000","last_active":"2023-10-09T06:23:06.694033+0000","last_peered":"2023-10-09T06:23:06.694033+0000","last_clean":"2023-10-09T06:23:06.694033+0000","last_became_active":"2023-10-09T06:23:05.981743+0000","last_became_peered":"2023-10-09T06:23:05.981743+0000","last_unstale":"2023-10-09T06:23:06.694033+0000","last_undegraded":"2023-10-09T06:23:06.694033+0000","last_fullsized":"2023-10-09T06:23:06.694033+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:52:33.804162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.693222+0000","last_change":"2023-10-09T06:23:06.693008+0000","last_active":"2023-10-09T06:23:06.693222+0000","last_peered":"2023-10-09T06:23:06.693222+0000","last_clean":"2023-10-09T06:23:06.693222+0000","last_became_active":"2023-10-09T06:23:06.692650+0000","last_became_peered":"2023-10-09T06:23:06.692650+0000","last_unstale":"2023-10-09T06:23:06.693222+0000","last_undegraded":"2023-10-09T06:23:06.693222+0000","last_fullsized":"2023-10-09T06:23:06.693222+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:01.847031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.977258+0000","last_change":"2023-10-09T06:23:05.977195+0000","last_active":"2023-10-09T06:23:05.977258+0000","last_peered":"2023-10-09T06:23:05.977258+0000","last_clean":"2023-10-09T06:23:05.977258+0000","last_became_active":"2023-10-09T06:23:05.976963+0000","last_became_peered":"2023-10-09T06:23:05.976963+0000","last_unstale":"2023-10-09T06:23:05.977258+0000","last_undegraded":"2023-10-09T06:23:05.977258+0000","last_fullsized":"2023-10-09T06:23:05.977258+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:03.155156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.687674+0000","last_change":"2023-10-09T06:23:06.687674+0000","last_active":"2023-10-09T06:23:06.687674+0000","last_peered":"2023-10-09T06:23:06.687674+0000","last_clean":"2023-10-09T06:23:06.687674+0000","last_became_active":"2023-10-09T06:23:06.687426+0000","last_became_peered":"2023-10-09T06:23:06.687426+0000","last_unstale":"2023-10-09T06:23:06.687674+0000","last_undegraded":"2023-10-09T06:23:06.687674+0000","last_fullsized":"2023-10-09T06:23:06.687674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:29.508341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.686326+0000","last_change":"2023-10-09T06:23:05.974593+0000","last_active":"2023-10-09T06:23:06.686326+0000","last_peered":"2023-10-09T06:23:06.686326+0000","last_clean":"2023-10-09T06:23:06.686326+0000","last_became_active":"2023-10-09T06:23:05.974305+0000","last_became_peered":"2023-10-09T06:23:05.974305+0000","last_unstale":"2023-10-09T06:23:06.686326+0000","last_undegraded":"2023-10-09T06:23:06.686326+0000","last_fullsized":"2023-10-09T06:23:06.686326+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:10.247461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692153+0000","last_change":"2023-10-09T06:23:06.692074+0000","last_active":"2023-10-09T06:23:06.692153+0000","last_peered":"2023-10-09T06:23:06.692153+0000","last_clean":"2023-10-09T06:23:06.692153+0000","last_became_active":"2023-10-09T06:23:06.691686+0000","last_became_peered":"2023-10-09T06:23:06.691686+0000","last_unstale":"2023-10-09T06:23:06.692153+0000","last_undegraded":"2023-10-09T06:23:06.692153+0000","last_fullsized":"2023-10-09T06:23:06.692153+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:15:47.215754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691186+0000","last_change":"2023-10-09T06:23:05.978641+0000","last_active":"2023-10-09T06:23:06.691186+0000","last_peered":"2023-10-09T06:23:06.691186+0000","last_clean":"2023-10-09T06:23:06.691186+0000","last_became_active":"2023-10-09T06:23:05.978195+0000","last_became_peered":"2023-10-09T06:23:05.978195+0000","last_unstale":"2023-10-09T06:23:06.691186+0000","last_undegraded":"2023-10-09T06:23:06.691186+0000","last_fullsized":"2023-10-09T06:23:06.691186+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:03.155156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692603+0000","last_change":"2023-10-09T06:23:06.692293+0000","last_active":"2023-10-09T06:23:06.692603+0000","last_peered":"2023-10-09T06:23:06.692603+0000","last_clean":"2023-10-09T06:23:06.692603+0000","last_became_active":"2023-10-09T06:23:06.691464+0000","last_became_peered":"2023-10-09T06:23:06.691464+0000","last_unstale":"2023-10-09T06:23:06.692603+0000","last_undegraded":"2023-10-09T06:23:06.692603+0000","last_fullsized":"2023-10-09T06:23:06.692603+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:40.055429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.979387+0000","last_change":"2023-10-09T06:23:05.978341+0000","last_active":"2023-10-09T06:23:05.979387+0000","last_peered":"2023-10-09T06:23:05.979387+0000","last_clean":"2023-10-09T06:23:05.979387+0000","last_became_active":"2023-10-09T06:23:05.978031+0000","last_became_peered":"2023-10-09T06:23:05.978031+0000","last_unstale":"2023-10-09T06:23:05.979387+0000","last_undegraded":"2023-10-09T06:23:05.979387+0000","last_fullsized":"2023-10-09T06:23:05.979387+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:43:13.879817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692080+0000","last_change":"2023-10-09T06:23:06.692080+0000","last_active":"2023-10-09T06:23:06.692080+0000","last_peered":"2023-10-09T06:23:06.692080+0000","last_clean":"2023-10-09T06:23:06.692080+0000","last_became_active":"2023-10-09T06:23:06.691291+0000","last_became_peered":"2023-10-09T06:23:06.691291+0000","last_unstale":"2023-10-09T06:23:06.692080+0000","last_undegraded":"2023-10-09T06:23:06.692080+0000","last_fullsized":"2023-10-09T06:23:06.692080+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:43.110652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.982613+0000","last_change":"2023-10-09T06:23:05.976182+0000","last_active":"2023-10-09T06:23:06.982613+0000","last_peered":"2023-10-09T06:23:06.982613+0000","last_clean":"2023-10-09T06:23:06.982613+0000","last_became_active":"2023-10-09T06:23:05.975965+0000","last_became_peered":"2023-10-09T06:23:05.975965+0000","last_unstale":"2023-10-09T06:23:06.982613+0000","last_undegraded":"2023-10-09T06:23:06.982613+0000","last_fullsized":"2023-10-09T06:23:06.982613+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:17:53.747188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.698467+0000","last_change":"2023-10-09T06:23:06.698405+0000","last_active":"2023-10-09T06:23:06.698467+0000","last_peered":"2023-10-09T06:23:06.698467+0000","last_clean":"2023-10-09T06:23:06.698467+0000","last_became_active":"2023-10-09T06:23:06.697617+0000","last_became_peered":"2023-10-09T06:23:06.697617+0000","last_unstale":"2023-10-09T06:23:06.698467+0000","last_undegraded":"2023-10-09T06:23:06.698467+0000","last_fullsized":"2023-10-09T06:23:06.698467+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:16:32.933584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"64'6","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.981321+0000","last_change":"2023-10-09T06:23:05.975671+0000","last_active":"2023-10-09T06:23:06.981321+0000","last_peered":"2023-10-09T06:23:06.981321+0000","last_clean":"2023-10-09T06:23:06.981321+0000","last_became_active":"2023-10-09T06:23:05.975456+0000","last_became_peered":"2023-10-09T06:23:05.975456+0000","last_unstale":"2023-10-09T06:23:06.981321+0000","last_undegraded":"2023-10-09T06:23:06.981321+0000","last_fullsized":"2023-10-09T06:23:06.981321+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:21.300314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.696043+0000","last_change":"2023-10-09T06:23:06.696043+0000","last_active":"2023-10-09T06:23:06.696043+0000","last_peered":"2023-10-09T06:23:06.696043+0000","last_clean":"2023-10-09T06:23:06.696043+0000","last_became_active":"2023-10-09T06:23:06.695810+0000","last_became_peered":"2023-10-09T06:23:06.695810+0000","last_unstale":"2023-10-09T06:23:06.696043+0000","last_undegraded":"2023-10-09T06:23:06.696043+0000","last_fullsized":"2023-10-09T06:23:06.696043+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:53.098429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"64'2","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.977843+0000","last_change":"2023-10-09T06:23:05.979523+0000","last_active":"2023-10-09T06:23:06.977843+0000","last_peered":"2023-10-09T06:23:06.977843+0000","last_clean":"2023-10-09T06:23:06.977843+0000","last_became_active":"2023-10-09T06:23:05.979279+0000","last_became_peered":"2023-10-09T06:23:05.979279+0000","last_unstale":"2023-10-09T06:23:06.977843+0000","last_undegraded":"2023-10-09T06:23:06.977843+0000","last_fullsized":"2023-10-09T06:23:06.977843+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:05.547222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694719+0000","last_change":"2023-10-09T06:23:06.694255+0000","last_active":"2023-10-09T06:23:06.694719+0000","last_peered":"2023-10-09T06:23:06.694719+0000","last_clean":"2023-10-09T06:23:06.694719+0000","last_became_active":"2023-10-09T06:23:06.692996+0000","last_became_peered":"2023-10-09T06:23:06.692996+0000","last_unstale":"2023-10-09T06:23:06.694719+0000","last_undegraded":"2023-10-09T06:23:06.694719+0000","last_fullsized":"2023-10-09T06:23:06.694719+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:07:05.280951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.684975+0000","last_change":"2023-10-09T06:23:05.980958+0000","last_active":"2023-10-09T06:23:06.684975+0000","last_peered":"2023-10-09T06:23:06.684975+0000","last_clean":"2023-10-09T06:23:06.684975+0000","last_became_active":"2023-10-09T06:23:05.980699+0000","last_became_peered":"2023-10-09T06:23:05.980699+0000","last_unstale":"2023-10-09T06:23:06.684975+0000","last_undegraded":"2023-10-09T06:23:06.684975+0000","last_fullsized":"2023-10-09T06:23:06.684975+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:41.829161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.696063+0000","last_change":"2023-10-09T06:23:06.696000+0000","last_active":"2023-10-09T06:23:06.696063+0000","last_peered":"2023-10-09T06:23:06.696063+0000","last_clean":"2023-10-09T06:23:06.696063+0000","last_became_active":"2023-10-09T06:23:06.695581+0000","last_became_peered":"2023-10-09T06:23:06.695581+0000","last_unstale":"2023-10-09T06:23:06.696063+0000","last_undegraded":"2023-10-09T06:23:06.696063+0000","last_fullsized":"2023-10-09T06:23:06.696063+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:46:26.867430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.978656+0000","last_change":"2023-10-09T06:23:05.977968+0000","last_active":"2023-10-09T06:23:05.978656+0000","last_peered":"2023-10-09T06:23:05.978656+0000","last_clean":"2023-10-09T06:23:05.978656+0000","last_became_active":"2023-10-09T06:23:05.977733+0000","last_became_peered":"2023-10-09T06:23:05.977733+0000","last_unstale":"2023-10-09T06:23:05.978656+0000","last_undegraded":"2023-10-09T06:23:05.978656+0000","last_fullsized":"2023-10-09T06:23:05.978656+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:24.510117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694750+0000","last_change":"2023-10-09T06:23:06.694461+0000","last_active":"2023-10-09T06:23:06.694750+0000","last_peered":"2023-10-09T06:23:06.694750+0000","last_clean":"2023-10-09T06:23:06.694750+0000","last_became_active":"2023-10-09T06:23:06.694133+0000","last_became_peered":"2023-10-09T06:23:06.694133+0000","last_unstale":"2023-10-09T06:23:06.694750+0000","last_undegraded":"2023-10-09T06:23:06.694750+0000","last_fullsized":"2023-10-09T06:23:06.694750+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:54.271638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"64'8","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.981666+0000","last_change":"2023-10-09T06:23:05.977966+0000","last_active":"2023-10-09T06:23:06.981666+0000","last_peered":"2023-10-09T06:23:06.981666+0000","last_clean":"2023-10-09T06:23:06.981666+0000","last_became_active":"2023-10-09T06:23:05.977728+0000","last_became_peered":"2023-10-09T06:23:05.977728+0000","last_unstale":"2023-10-09T06:23:06.981666+0000","last_undegraded":"2023-10-09T06:23:06.981666+0000","last_fullsized":"2023-10-09T06:23:06.981666+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:52:33.804162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.694735+0000","last_change":"2023-10-09T06:23:06.694400+0000","last_active":"2023-10-09T06:23:06.694735+0000","last_peered":"2023-10-09T06:23:06.694735+0000","last_clean":"2023-10-09T06:23:06.694735+0000","last_became_active":"2023-10-09T06:23:06.693296+0000","last_became_peered":"2023-10-09T06:23:06.693296+0000","last_unstale":"2023-10-09T06:23:06.694735+0000","last_undegraded":"2023-10-09T06:23:06.694735+0000","last_fullsized":"2023-10-09T06:23:06.694735+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:53.098429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"64'1","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.683471+0000","last_change":"2023-10-09T06:23:05.980472+0000","last_active":"2023-10-09T06:23:06.683471+0000","last_peered":"2023-10-09T06:23:06.683471+0000","last_clean":"2023-10-09T06:23:06.683471+0000","last_became_active":"2023-10-09T06:23:05.979677+0000","last_became_peered":"2023-10-09T06:23:05.979677+0000","last_unstale":"2023-10-09T06:23:06.683471+0000","last_undegraded":"2023-10-09T06:23:06.683471+0000","last_fullsized":"2023-10-09T06:23:06.683471+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:39.050922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695338+0000","last_change":"2023-10-09T06:23:06.695338+0000","last_active":"2023-10-09T06:23:06.695338+0000","last_peered":"2023-10-09T06:23:06.695338+0000","last_clean":"2023-10-09T06:23:06.695338+0000","last_became_active":"2023-10-09T06:23:06.694777+0000","last_became_peered":"2023-10-09T06:23:06.694777+0000","last_unstale":"2023-10-09T06:23:06.695338+0000","last_undegraded":"2023-10-09T06:23:06.695338+0000","last_fullsized":"2023-10-09T06:23:06.695338+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:48.982575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"64'2","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.980060+0000","last_change":"2023-10-09T06:23:05.981215+0000","last_active":"2023-10-09T06:23:06.980060+0000","last_peered":"2023-10-09T06:23:06.980060+0000","last_clean":"2023-10-09T06:23:06.980060+0000","last_became_active":"2023-10-09T06:23:05.981016+0000","last_became_peered":"2023-10-09T06:23:05.981016+0000","last_unstale":"2023-10-09T06:23:06.980060+0000","last_undegraded":"2023-10-09T06:23:06.980060+0000","last_fullsized":"2023-10-09T06:23:06.980060+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:40.113032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.689944+0000","last_change":"2023-10-09T06:23:06.689944+0000","last_active":"2023-10-09T06:23:06.689944+0000","last_peered":"2023-10-09T06:23:06.689944+0000","last_clean":"2023-10-09T06:23:06.689944+0000","last_became_active":"2023-10-09T06:23:06.689160+0000","last_became_peered":"2023-10-09T06:23:06.689160+0000","last_unstale":"2023-10-09T06:23:06.689944+0000","last_undegraded":"2023-10-09T06:23:06.689944+0000","last_fullsized":"2023-10-09T06:23:06.689944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:07.687016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"64'1","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.689653+0000","last_change":"2023-10-09T06:23:05.980467+0000","last_active":"2023-10-09T06:23:06.689653+0000","last_peered":"2023-10-09T06:23:06.689653+0000","last_clean":"2023-10-09T06:23:06.689653+0000","last_became_active":"2023-10-09T06:23:05.980145+0000","last_became_peered":"2023-10-09T06:23:05.980145+0000","last_unstale":"2023-10-09T06:23:06.689653+0000","last_undegraded":"2023-10-09T06:23:06.689653+0000","last_fullsized":"2023-10-09T06:23:06.689653+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:49.913130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692643+0000","last_change":"2023-10-09T06:23:06.692454+0000","last_active":"2023-10-09T06:23:06.692643+0000","last_peered":"2023-10-09T06:23:06.692643+0000","last_clean":"2023-10-09T06:23:06.692643+0000","last_became_active":"2023-10-09T06:23:06.691754+0000","last_became_peered":"2023-10-09T06:23:06.691754+0000","last_unstale":"2023-10-09T06:23:06.692643+0000","last_undegraded":"2023-10-09T06:23:06.692643+0000","last_fullsized":"2023-10-09T06:23:06.692643+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:17:01.541693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.982716+0000","last_change":"2023-10-09T06:23:05.982617+0000","last_active":"2023-10-09T06:23:05.982716+0000","last_peered":"2023-10-09T06:23:05.982716+0000","last_clean":"2023-10-09T06:23:05.982716+0000","last_became_active":"2023-10-09T06:23:05.982348+0000","last_became_peered":"2023-10-09T06:23:05.982348+0000","last_unstale":"2023-10-09T06:23:05.982716+0000","last_undegraded":"2023-10-09T06:23:05.982716+0000","last_fullsized":"2023-10-09T06:23:05.982716+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:03.155156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695492+0000","last_change":"2023-10-09T06:23:06.695492+0000","last_active":"2023-10-09T06:23:06.695492+0000","last_peered":"2023-10-09T06:23:06.695492+0000","last_clean":"2023-10-09T06:23:06.695492+0000","last_became_active":"2023-10-09T06:23:06.695100+0000","last_became_peered":"2023-10-09T06:23:06.695100+0000","last_unstale":"2023-10-09T06:23:06.695492+0000","last_undegraded":"2023-10-09T06:23:06.695492+0000","last_fullsized":"2023-10-09T06:23:06.695492+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:07:05.280951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"64'2","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.980089+0000","last_change":"2023-10-09T06:23:05.976532+0000","last_active":"2023-10-09T06:23:06.980089+0000","last_peered":"2023-10-09T06:23:06.980089+0000","last_clean":"2023-10-09T06:23:06.980089+0000","last_became_active":"2023-10-09T06:23:05.976303+0000","last_became_peered":"2023-10-09T06:23:05.976303+0000","last_unstale":"2023-10-09T06:23:06.980089+0000","last_undegraded":"2023-10-09T06:23:06.980089+0000","last_fullsized":"2023-10-09T06:23:06.980089+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:07:04.276445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.696759+0000","last_change":"2023-10-09T06:23:06.696759+0000","last_active":"2023-10-09T06:23:06.696759+0000","last_peered":"2023-10-09T06:23:06.696759+0000","last_clean":"2023-10-09T06:23:06.696759+0000","last_became_active":"2023-10-09T06:23:06.696296+0000","last_became_peered":"2023-10-09T06:23:06.696296+0000","last_unstale":"2023-10-09T06:23:06.696759+0000","last_undegraded":"2023-10-09T06:23:06.696759+0000","last_fullsized":"2023-10-09T06:23:06.696759+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:40.009089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.973811+0000","last_change":"2023-10-09T06:23:05.973742+0000","last_active":"2023-10-09T06:23:05.973811+0000","last_peered":"2023-10-09T06:23:05.973811+0000","last_clean":"2023-10-09T06:23:05.973811+0000","last_became_active":"2023-10-09T06:23:05.973499+0000","last_became_peered":"2023-10-09T06:23:05.973499+0000","last_unstale":"2023-10-09T06:23:05.973811+0000","last_undegraded":"2023-10-09T06:23:05.973811+0000","last_fullsized":"2023-10-09T06:23:05.973811+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:58.108816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695698+0000","last_change":"2023-10-09T06:23:06.695698+0000","last_active":"2023-10-09T06:23:06.695698+0000","last_peered":"2023-10-09T06:23:06.695698+0000","last_clean":"2023-10-09T06:23:06.695698+0000","last_became_active":"2023-10-09T06:23:06.695332+0000","last_became_peered":"2023-10-09T06:23:06.695332+0000","last_unstale":"2023-10-09T06:23:06.695698+0000","last_undegraded":"2023-10-09T06:23:06.695698+0000","last_fullsized":"2023-10-09T06:23:06.695698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:02.861322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.976185+0000","last_change":"2023-10-09T06:23:05.976120+0000","last_active":"2023-10-09T06:23:05.976185+0000","last_peered":"2023-10-09T06:23:05.976185+0000","last_clean":"2023-10-09T06:23:05.976185+0000","last_became_active":"2023-10-09T06:23:05.975803+0000","last_became_peered":"2023-10-09T06:23:05.975803+0000","last_unstale":"2023-10-09T06:23:05.976185+0000","last_undegraded":"2023-10-09T06:23:05.976185+0000","last_fullsized":"2023-10-09T06:23:05.976185+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:52:33.804162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.692536+0000","last_change":"2023-10-09T06:23:06.692536+0000","last_active":"2023-10-09T06:23:06.692536+0000","last_peered":"2023-10-09T06:23:06.692536+0000","last_clean":"2023-10-09T06:23:06.692536+0000","last_became_active":"2023-10-09T06:23:06.692314+0000","last_became_peered":"2023-10-09T06:23:06.692314+0000","last_unstale":"2023-10-09T06:23:06.692536+0000","last_undegraded":"2023-10-09T06:23:06.692536+0000","last_fullsized":"2023-10-09T06:23:06.692536+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:40.055429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"64'2","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.979560+0000","last_change":"2023-10-09T06:23:05.974823+0000","last_active":"2023-10-09T06:23:06.979560+0000","last_peered":"2023-10-09T06:23:06.979560+0000","last_clean":"2023-10-09T06:23:06.979560+0000","last_became_active":"2023-10-09T06:23:05.974238+0000","last_became_peered":"2023-10-09T06:23:05.974238+0000","last_unstale":"2023-10-09T06:23:06.979560+0000","last_undegraded":"2023-10-09T06:23:06.979560+0000","last_fullsized":"2023-10-09T06:23:06.979560+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:05.388597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695363+0000","last_change":"2023-10-09T06:23:06.695363+0000","last_active":"2023-10-09T06:23:06.695363+0000","last_peered":"2023-10-09T06:23:06.695363+0000","last_clean":"2023-10-09T06:23:06.695363+0000","last_became_active":"2023-10-09T06:23:06.694816+0000","last_became_peered":"2023-10-09T06:23:06.694816+0000","last_unstale":"2023-10-09T06:23:06.695363+0000","last_undegraded":"2023-10-09T06:23:06.695363+0000","last_fullsized":"2023-10-09T06:23:06.695363+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:43:14.884324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.982412+0000","last_change":"2023-10-09T06:23:05.982114+0000","last_active":"2023-10-09T06:23:05.982412+0000","last_peered":"2023-10-09T06:23:05.982412+0000","last_clean":"2023-10-09T06:23:05.982412+0000","last_became_active":"2023-10-09T06:23:05.981441+0000","last_became_peered":"2023-10-09T06:23:05.981441+0000","last_unstale":"2023-10-09T06:23:05.982412+0000","last_undegraded":"2023-10-09T06:23:05.982412+0000","last_fullsized":"2023-10-09T06:23:05.982412+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:29.677786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691097+0000","last_change":"2023-10-09T06:23:06.691097+0000","last_active":"2023-10-09T06:23:06.691097+0000","last_peered":"2023-10-09T06:23:06.691097+0000","last_clean":"2023-10-09T06:23:06.691097+0000","last_became_active":"2023-10-09T06:23:06.690672+0000","last_became_peered":"2023-10-09T06:23:06.690672+0000","last_unstale":"2023-10-09T06:23:06.691097+0000","last_undegraded":"2023-10-09T06:23:06.691097+0000","last_fullsized":"2023-10-09T06:23:06.691097+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:52.509565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.685837+0000","last_change":"2023-10-09T06:23:05.973166+0000","last_active":"2023-10-09T06:23:06.685837+0000","last_peered":"2023-10-09T06:23:06.685837+0000","last_clean":"2023-10-09T06:23:06.685837+0000","last_became_active":"2023-10-09T06:23:05.972938+0000","last_became_peered":"2023-10-09T06:23:05.972938+0000","last_unstale":"2023-10-09T06:23:06.685837+0000","last_undegraded":"2023-10-09T06:23:06.685837+0000","last_fullsized":"2023-10-09T06:23:06.685837+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:07.765495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.695519+0000","last_change":"2023-10-09T06:23:06.695519+0000","last_active":"2023-10-09T06:23:06.695519+0000","last_peered":"2023-10-09T06:23:06.695519+0000","last_clean":"2023-10-09T06:23:06.695519+0000","last_became_active":"2023-10-09T06:23:06.694464+0000","last_became_peered":"2023-10-09T06:23:06.694464+0000","last_unstale":"2023-10-09T06:23:06.695519+0000","last_undegraded":"2023-10-09T06:23:06.695519+0000","last_fullsized":"2023-10-09T06:23:06.695519+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:38.467482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.979058+0000","last_change":"2023-10-09T06:23:05.978995+0000","last_active":"2023-10-09T06:23:05.979058+0000","last_peered":"2023-10-09T06:23:05.979058+0000","last_clean":"2023-10-09T06:23:05.979058+0000","last_became_active":"2023-10-09T06:23:05.977781+0000","last_became_peered":"2023-10-09T06:23:05.977781+0000","last_unstale":"2023-10-09T06:23:05.979058+0000","last_undegraded":"2023-10-09T06:23:05.979058+0000","last_fullsized":"2023-10-09T06:23:05.979058+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:07.158118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691089+0000","last_change":"2023-10-09T06:23:06.691089+0000","last_active":"2023-10-09T06:23:06.691089+0000","last_peered":"2023-10-09T06:23:06.691089+0000","last_clean":"2023-10-09T06:23:06.691089+0000","last_became_active":"2023-10-09T06:23:06.690590+0000","last_became_peered":"2023-10-09T06:23:06.690590+0000","last_unstale":"2023-10-09T06:23:06.691089+0000","last_undegraded":"2023-10-09T06:23:06.691089+0000","last_fullsized":"2023-10-09T06:23:06.691089+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:10:10.761210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.979176+0000","last_change":"2023-10-09T06:23:05.979114+0000","last_active":"2023-10-09T06:23:05.979176+0000","last_peered":"2023-10-09T06:23:05.979176+0000","last_clean":"2023-10-09T06:23:05.979176+0000","last_became_active":"2023-10-09T06:23:05.978887+0000","last_became_peered":"2023-10-09T06:23:05.978887+0000","last_unstale":"2023-10-09T06:23:05.979176+0000","last_undegraded":"2023-10-09T06:23:05.979176+0000","last_fullsized":"2023-10-09T06:23:05.979176+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:20.927270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.697254+0000","last_change":"2023-10-09T06:23:06.697195+0000","last_active":"2023-10-09T06:23:06.697254+0000","last_peered":"2023-10-09T06:23:06.697254+0000","last_clean":"2023-10-09T06:23:06.697254+0000","last_became_active":"2023-10-09T06:23:06.696987+0000","last_became_peered":"2023-10-09T06:23:06.696987+0000","last_unstale":"2023-10-09T06:23:06.697254+0000","last_undegraded":"2023-10-09T06:23:06.697254+0000","last_fullsized":"2023-10-09T06:23:06.697254+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:02.861322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.686311+0000","last_change":"2023-10-09T06:23:05.979305+0000","last_active":"2023-10-09T06:23:06.686311+0000","last_peered":"2023-10-09T06:23:06.686311+0000","last_clean":"2023-10-09T06:23:06.686311+0000","last_became_active":"2023-10-09T06:23:05.979062+0000","last_became_peered":"2023-10-09T06:23:05.979062+0000","last_unstale":"2023-10-09T06:23:06.686311+0000","last_undegraded":"2023-10-09T06:23:06.686311+0000","last_fullsized":"2023-10-09T06:23:06.686311+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:42.526096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.691944+0000","last_change":"2023-10-09T06:23:06.691944+0000","last_active":"2023-10-09T06:23:06.691944+0000","last_peered":"2023-10-09T06:23:06.691944+0000","last_clean":"2023-10-09T06:23:06.691944+0000","last_became_active":"2023-10-09T06:23:06.690990+0000","last_became_peered":"2023-10-09T06:23:06.690990+0000","last_unstale":"2023-10-09T06:23:06.691944+0000","last_undegraded":"2023-10-09T06:23:06.691944+0000","last_fullsized":"2023-10-09T06:23:06.691944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:01.847031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.978754+0000","last_change":"2023-10-09T06:23:05.978533+0000","last_active":"2023-10-09T06:23:05.978754+0000","last_peered":"2023-10-09T06:23:05.978754+0000","last_clean":"2023-10-09T06:23:05.978754+0000","last_became_active":"2023-10-09T06:23:05.978306+0000","last_became_peered":"2023-10-09T06:23:05.978306+0000","last_unstale":"2023-10-09T06:23:05.978754+0000","last_undegraded":"2023-10-09T06:23:05.978754+0000","last_fullsized":"2023-10-09T06:23:05.978754+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:16.128210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.687804+0000","last_change":"2023-10-09T06:23:06.687804+0000","last_active":"2023-10-09T06:23:06.687804+0000","last_peered":"2023-10-09T06:23:06.687804+0000","last_clean":"2023-10-09T06:23:06.687804+0000","last_became_active":"2023-10-09T06:23:06.687275+0000","last_became_peered":"2023-10-09T06:23:06.687275+0000","last_unstale":"2023-10-09T06:23:06.687804+0000","last_undegraded":"2023-10-09T06:23:06.687804+0000","last_fullsized":"2023-10-09T06:23:06.687804+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:10:07.982971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T06:23:05.980611+0000","last_change":"2023-10-09T06:23:05.980330+0000","last_active":"2023-10-09T06:23:05.980611+0000","last_peered":"2023-10-09T06:23:05.980611+0000","last_clean":"2023-10-09T06:23:05.980611+0000","last_became_active":"2023-10-09T06:23:05.979347+0000","last_became_peered":"2023-10-09T06:23:05.979347+0000","last_unstale":"2023-10-09T06:23:05.980611+0000","last_undegraded":"2023-10-09T06:23:05.980611+0000","last_fullsized":"2023-10-09T06:23:05.980611+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:19:03.344304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.696600+0000","last_change":"2023-10-09T06:23:06.696600+0000","last_active":"2023-10-09T06:23:06.696600+0000","last_peered":"2023-10-09T06:23:06.696600+0000","last_clean":"2023-10-09T06:23:06.696600+0000","last_became_active":"2023-10-09T06:23:06.696341+0000","last_became_peered":"2023-10-09T06:23:06.696341+0000","last_unstale":"2023-10-09T06:23:06.696600+0000","last_undegraded":"2023-10-09T06:23:06.696600+0000","last_fullsized":"2023-10-09T06:23:06.696600+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:05.962885+0000","last_clean_scrub_stamp":"2023-10-09T06:23:05.962885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:46.352272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.685140+0000","last_change":"2023-10-09T06:23:05.977119+0000","last_active":"2023-10-09T06:23:06.685140+0000","last_peered":"2023-10-09T06:23:06.685140+0000","last_clean":"2023-10-09T06:23:06.685140+0000","last_became_active":"2023-10-09T06:23:05.976901+0000","last_became_peered":"2023-10-09T06:23:05.976901+0000","last_unstale":"2023-10-09T06:23:06.685140+0000","last_undegraded":"2023-10-09T06:23:06.685140+0000","last_fullsized":"2023-10-09T06:23:06.685140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:23:04.958378+0000","last_clean_scrub_stamp":"2023-10-09T06:23:04.958378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:33.042645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-09T06:23:06.686595+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:23:06.686595+0000","last_peered":"2023-10-09T06:23:06.686595+0000","last_clean":"2023-10-09T06:23:06.686595+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:23:06.686595+0000","last_undegraded":"2023-10-09T06:23:06.686595+0000","last_fullsized":"2023-10-09T06:23:06.686595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":902,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194410,"statfs":{"total":200000000,"available":199076286,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64200000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.5},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.68200000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.66600000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70799999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.72699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.35799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41799999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78800000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.378},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.45700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194987,"statfs":{"total":200000000,"available":199666814,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.78700000000000003,"15min":0.83299999999999996},"min":{"1min":0.35099999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.72099999999999997,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.76200000000000001,"5min":1.133,"15min":1.133},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.754,"5min":1.155,"15min":1.155},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.378,"5min":0.317,"15min":0.317},"max":{"1min":0.79300000000000004,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.63}]},{"osd":2,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.41199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86499999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.79800000000000004,"15min":0.83999999999999997},"min":{"1min":0.35999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.60299999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81599999999999995,"5min":1.337,"15min":1.337},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90400000000000003,"5min":1.206,"15min":1.206},"last":0.61699999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.32700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.5,"15min":0.498},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.40899999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33400000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73199999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.437}]},{"osd":7,"last update":"Mon Oct 9 06:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.52100000000000002},"min":{"1min":0.36299999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54800000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.52400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":319,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194993,"statfs":{"total":200000000,"available":199673012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.36799999999999999,"15min":0.372},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.32300000000000001,"15min":0.32100000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.28699999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.374,"15min":0.377},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.35299999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.40100000000000002},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.37}]},{"osd":4,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.748,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.82499999999999996,"15min":0.86299999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0309999999999999,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.42599999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.66800000000000004},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93799999999999994,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64600000000000002,"15min":0.65100000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97599999999999998,"5min":1.49,"15min":1.49},"last":0.61799999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47299999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":897,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194414,"statfs":{"total":200000000,"available":199080644,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.41599999999999998,"15min":0.42799999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.50700000000000001,"5min":1.226,"15min":1.226},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42399999999999999,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60599999999999998,"5min":1.131,"15min":1.131},"last":0.39000000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":1.048,"15min":1.1579999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.65200000000000002,"5min":12.929,"15min":12.929},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.57599999999999996,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.46700000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47499999999999998,"15min":0.48299999999999998},"min":{"1min":0.314,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66500000000000004,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.48799999999999999,"15min":0.501},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.628,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.41699999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.72599999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.436,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86299999999999999,"5min":1.335,"15min":1.335},"last":0.67300000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.621,"15min":0.624},"min":{"1min":0.45500000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.74199999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.61299999999999999},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.73299999999999998,"5min":0.999,"15min":0.999},"last":0.65900000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76200000000000001,"5min":0.998,"15min":0.998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.68100000000000005,"15min":0.68799999999999994},"min":{"1min":0.47599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81299999999999994,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.81699999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68000000000000005,"15min":0.68700000000000006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79400000000000004,"5min":1.262,"15min":1.262},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.51600000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.74199999999999999,"5min":1.103,"15min":1.103},"last":0.77200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":319,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194993,"statfs":{"total":200000000,"available":199673046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.92500000000000004,"15min":1.0269999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47999999999999998,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.69499999999999995,"15min":0.751},"min":{"1min":0.24099999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54100000000000004,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.24299999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.64900000000000002,"15min":0.70499999999999996},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.45900000000000002,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.74099999999999999,"15min":0.77300000000000002},"min":{"1min":0.25600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":4.6870000000000003,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.28499999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.71899999999999997,"15min":0.77400000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55900000000000005,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.97999999999999998,"15min":1.0780000000000001},"min":{"1min":0.28799999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52200000000000002,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.433}]},{"osd":4,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":1.1850000000000001,"15min":1.284},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82999999999999996,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.94799999999999995,"15min":1.0069999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78200000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.53700000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.91900000000000004,"15min":0.97499999999999998},"min":{"1min":0.376,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85899999999999999,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.92500000000000004,"15min":0.97999999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84599999999999997,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.57499999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.90900000000000003,"15min":0.96099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79600000000000004,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.628},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.177,"15min":1.274},"min":{"1min":0.40000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.878,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.90300000000000002,"15min":0.95899999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.92000000000000004,"15min":0.97399999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77400000000000002,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.50700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":319,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194993,"statfs":{"total":200000000,"available":199673046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.318,"15min":0.31900000000000001},"min":{"1min":0.21199999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.39800000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.36599999999999999,"15min":0.36499999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.35499999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.32000000000000001,"15min":0.316},"min":{"1min":0.25,"5min":0.215,"15min":0.215},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.27300000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.47499999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.47499999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40500000000000003,"15min":0.40400000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.38900000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79500000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.502},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69299999999999995,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.372}]},{"osd":5,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.44600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81799999999999995,"5min":0.872,"15min":0.872},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.435}]},{"osd":6,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42999999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.76100000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.441,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78000000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.48799999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.438,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.49199999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194991,"statfs":{"total":200000000,"available":199671566,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.33000000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57199999999999995}]},{"osd":1,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51100000000000001,"15min":0.50700000000000001},"min":{"1min":0.36499999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.74399999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.72799999999999998,"15min":0.75},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5680000000000001,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.54500000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.72199999999999998,"15min":0.74099999999999999},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.7110000000000001,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":1.1180000000000001,"15min":1.214},"min":{"1min":0.40100000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72599999999999998,"5min":11.715,"15min":11.715},"last":0.50800000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.439,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.59299999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.497,"15min":0.499},"min":{"1min":0.32700000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.375},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51600000000000001,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60999999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.44700000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.502,"15min":0.502},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40799999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.35099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.49099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":319,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194992,"statfs":{"total":200000000,"available":199672478,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50700000000000001},"min":{"1min":0.40400000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.41299999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51300000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.377,"15min":0.377},"max":{"1min":0.748,"5min":0.752,"15min":0.752},"last":0.495},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.58299999999999996}]},{"osd":2,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.50700000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66900000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.78300000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.36199999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45300000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.745,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.499,"15min":0.50600000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.65200000000000002,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.629}]},{"osd":6,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.53400000000000003,"15min":0.54600000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80000000000000004,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.315,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.59899999999999998,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.753}]}]}],"pool_statfs":[]}} 2023-10-09T06:23:11.463 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:23:11.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:23:11.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.623+0000 7fa23e936700 1 Processor -- start 2023-10-09T06:23:11.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.623+0000 7fa23e936700 1 -- start start 2023-10-09T06:23:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23e936700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2381542a0 0x7fa2380b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23e936700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa23806aa00 0x7fa23815c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23e936700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23806b0a0 con 0x7fa2380cd630 2023-10-09T06:23:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23e936700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23815b2e0 con 0x7fa23806aa00 2023-10-09T06:23:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23e936700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23815ad20 con 0x7fa2381542a0 2023-10-09T06:23:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23e135700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa23806aa00 0x7fa23815c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23d133700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa2380cd630 0x7fa23806a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32792/0 (socket says 172.21.15.31:32792) 2023-10-09T06:23:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23d133700 1 -- 172.21.15.31:0/4080785954 learned_addr learned my addr 172.21.15.31:0/4080785954 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:23:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23d934700 1 --2- 172.21.15.31:0/4080785954 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2381542a0 0x7fa2380b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23e135700 1 -- 172.21.15.31:0/4080785954 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2381542a0 msgr2=0x7fa2380b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23e135700 1 --2- 172.21.15.31:0/4080785954 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2381542a0 0x7fa2380b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23e135700 1 -- 172.21.15.31:0/4080785954 >> v1:172.21.15.31:6789/0 conn(0x7fa2380cd630 legacy=0x7fa23806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23e135700 1 -- 172.21.15.31:0/4080785954 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23815b000 con 0x7fa23806aa00 2023-10-09T06:23:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.624+0000 7fa23c932700 1 -- 172.21.15.31:0/4080785954 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248035661 0 0) 0x7fa23806b0a0 con 0x7fa2380cd630 2023-10-09T06:23:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.625+0000 7fa23e135700 1 --2- 172.21.15.31:0/4080785954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa23806aa00 0x7fa23815c140 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa228009e60 tx=0x7fa228009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cba1f89ebffa89 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.625+0000 7fa23c932700 1 -- 172.21.15.31:0/4080785954 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22800e070 con 0x7fa23806aa00 2023-10-09T06:23:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.625+0000 7fa23c932700 1 -- 172.21.15.31:0/4080785954 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22800bc30 con 0x7fa23806aa00 2023-10-09T06:23:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.625+0000 7fa23c932700 1 -- 172.21.15.31:0/4080785954 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228012430 con 0x7fa23806aa00 2023-10-09T06:23:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.625+0000 7fa23e936700 1 -- 172.21.15.31:0/4080785954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa23806aa00 msgr2=0x7fa23815c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.625+0000 7fa23e936700 1 --2- 172.21.15.31:0/4080785954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa23806aa00 0x7fa23815c140 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa228009e60 tx=0x7fa228009780 comp rx=0 tx=0).stop 2023-10-09T06:23:11.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.625+0000 7fa23e936700 1 -- 172.21.15.31:0/4080785954 shutdown_connections 2023-10-09T06:23:11.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.625+0000 7fa23e936700 1 --2- 172.21.15.31:0/4080785954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa23806aa00 0x7fa23815c140 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.625+0000 7fa23e936700 1 --2- 172.21.15.31:0/4080785954 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa2381542a0 0x7fa2380b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.625+0000 7fa23e936700 1 -- 172.21.15.31:0/4080785954 >> 172.21.15.31:0/4080785954 conn(0x7fa238068cb0 msgr2=0x7fa2380690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:11.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.625+0000 7fa23e936700 1 -- 172.21.15.31:0/4080785954 shutdown_connections 2023-10-09T06:23:11.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.625+0000 7fa23e936700 1 -- 172.21.15.31:0/4080785954 wait complete. 2023-10-09T06:23:11.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.626+0000 7fa23e936700 1 Processor -- start 2023-10-09T06:23:11.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.626+0000 7fa23e936700 1 -- start start 2023-10-09T06:23:11.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.627+0000 7fa23e936700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa23806aa00 0x7fa23814ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:11.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.627+0000 7fa23e936700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2380cd630 0x7fa2381518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:11.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.627+0000 7fa23e936700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2381542a0 0x7fa238151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:11.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.627+0000 7fa23e936700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380b3160 con 0x7fa2381542a0 2023-10-09T06:23:11.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.627+0000 7fa23e936700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380b2550 con 0x7fa2380cd630 2023-10-09T06:23:11.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.627+0000 7fa23e936700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380b2830 con 0x7fa23806aa00 2023-10-09T06:23:11.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.627+0000 7fa23e135700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2381542a0 0x7fa238151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:11.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.627+0000 7fa23e135700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2381542a0 0x7fa238151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40740/0 (socket says 172.21.15.31:40740) 2023-10-09T06:23:11.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.627+0000 7fa23e135700 1 -- 172.21.15.31:0/626847873 learned_addr learned my addr 172.21.15.31:0/626847873 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:11.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa23d934700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa23806aa00 0x7fa23814ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:11.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa23d133700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2380cd630 0x7fa2381518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:11.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa23e135700 1 -- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa23806aa00 msgr2=0x7fa23814ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa23e135700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa23806aa00 0x7fa23814ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa23e135700 1 -- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2380cd630 msgr2=0x7fa2381518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa23e135700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2380cd630 0x7fa2381518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa23e135700 1 -- 172.21.15.31:0/626847873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa228009a20 con 0x7fa2381542a0 2023-10-09T06:23:11.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa23d133700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2380cd630 0x7fa2381518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:23:11.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa23d934700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa23806aa00 0x7fa23814ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:23:11.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa23e135700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2381542a0 0x7fa238151e00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa228013000 tx=0x7fa228019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:11.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa235ffb700 1 -- 172.21.15.31:0/626847873 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22801d630 con 0x7fa2381542a0 2023-10-09T06:23:11.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa235ffb700 1 -- 172.21.15.31:0/626847873 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22801d790 con 0x7fa2381542a0 2023-10-09T06:23:11.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa23e936700 1 -- 172.21.15.31:0/626847873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2380b2b10 con 0x7fa2381542a0 2023-10-09T06:23:11.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa235ffb700 1 -- 172.21.15.31:0/626847873 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22801db50 con 0x7fa2381542a0 2023-10-09T06:23:11.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.628+0000 7fa23e936700 1 -- 172.21.15.31:0/626847873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa238150520 con 0x7fa2381542a0 2023-10-09T06:23:11.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.629+0000 7fa23e936700 1 -- 172.21.15.31:0/626847873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2380b3310 con 0x7fa2381542a0 2023-10-09T06:23:11.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.630+0000 7fa235ffb700 1 -- 172.21.15.31:0/626847873 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa228024070 con 0x7fa2381542a0 2023-10-09T06:23:11.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.630+0000 7fa235ffb700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa224066f30 0x7fa2240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:11.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.630+0000 7fa235ffb700 1 -- 172.21.15.31:0/626847873 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa228086e50 con 0x7fa2381542a0 2023-10-09T06:23:11.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.630+0000 7fa23d934700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa224066f30 0x7fa2240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:11.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.631+0000 7fa23d934700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa224066f30 0x7fa2240693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa230006aa0 tx=0x7fa230008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:11.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.634+0000 7fa235ffb700 1 -- 172.21.15.31:0/626847873 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2380b3310 con 0x7fa2381542a0 2023-10-09T06:23:11.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.912+0000 7fa23e936700 1 -- 172.21.15.31:0/626847873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa2380b3310 con 0x7fa2381542a0 2023-10-09T06:23:11.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.918+0000 7fa235ffb700 1 -- 172.21.15.31:0/626847873 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa2380b3310 con 0x7fa2381542a0 2023-10-09T06:23:11.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.920+0000 7fa23e936700 1 -- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa224066f30 msgr2=0x7fa2240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.920+0000 7fa23e936700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa224066f30 0x7fa2240693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa230006aa0 tx=0x7fa230008040 comp rx=0 tx=0).stop 2023-10-09T06:23:11.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.920+0000 7fa23e936700 1 -- 172.21.15.31:0/626847873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2381542a0 msgr2=0x7fa238151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:11.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.920+0000 7fa23e936700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2381542a0 0x7fa238151e00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa228013000 tx=0x7fa228019000 comp rx=0 tx=0).stop 2023-10-09T06:23:11.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.920+0000 7fa23e936700 1 -- 172.21.15.31:0/626847873 shutdown_connections 2023-10-09T06:23:11.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.920+0000 7fa23e936700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa224066f30 0x7fa2240693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.920+0000 7fa23e936700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa23806aa00 0x7fa23814ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.920+0000 7fa23e936700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2381542a0 0x7fa238151e00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.920+0000 7fa23e936700 1 --2- 172.21.15.31:0/626847873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2380cd630 0x7fa2381518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:11.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.920+0000 7fa23e936700 1 -- 172.21.15.31:0/626847873 >> 172.21.15.31:0/626847873 conn(0x7fa238068cb0 msgr2=0x7fa2380d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:11.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.920+0000 7fa23e936700 1 -- 172.21.15.31:0/626847873 shutdown_connections 2023-10-09T06:23:11.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:11.920+0000 7fa23e936700 1 -- 172.21.15.31:0/626847873 wait complete. 2023-10-09T06:23:11.921 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2023-10-09T06:23:11.932 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:23:12.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.051+0000 7f03aadf4700 1 Processor -- start 2023-10-09T06:23:12.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.051+0000 7f03aadf4700 1 -- start start 2023-10-09T06:23:12.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aadf4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f03a41556c0 0x7f03a41581e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aadf4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03a4069f80 0x7f03a40afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aadf4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03a40b0160 0x7f03a40ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aadf4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a4158720 con 0x7f03a40b0160 2023-10-09T06:23:12.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aadf4700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a41591f0 con 0x7f03a41556c0 2023-10-09T06:23:12.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aadf4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a40ae520 con 0x7f03a4069f80 2023-10-09T06:23:12.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aa5f3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03a40b0160 0x7f03a40ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aa5f3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03a40b0160 0x7f03a40ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40746/0 (socket says 172.21.15.31:40746) 2023-10-09T06:23:12.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aa5f3700 1 -- 172.21.15.31:0/3501565836 learned_addr learned my addr 172.21.15.31:0/3501565836 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:12.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03a9df2700 1 --2- 172.21.15.31:0/3501565836 >> v2:172.21.15.158:3300/0 conn(0x7f03a41556c0 0x7f03a41581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03a95f1700 1 --2- 172.21.15.31:0/3501565836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03a4069f80 0x7f03a40afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aa5f3700 1 -- 172.21.15.31:0/3501565836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03a4069f80 msgr2=0x7f03a40afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:12.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aa5f3700 1 --2- 172.21.15.31:0/3501565836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03a4069f80 0x7f03a40afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aa5f3700 1 -- 172.21.15.31:0/3501565836 >> v2:172.21.15.158:3300/0 conn(0x7f03a41556c0 msgr2=0x7f03a41581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:12.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aa5f3700 1 --2- 172.21.15.31:0/3501565836 >> v2:172.21.15.158:3300/0 conn(0x7f03a41556c0 0x7f03a41581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03aa5f3700 1 -- 172.21.15.31:0/3501565836 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a40cf580 con 0x7f03a40b0160 2023-10-09T06:23:12.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03a9df2700 1 --2- 172.21.15.31:0/3501565836 >> v2:172.21.15.158:3300/0 conn(0x7f03a41556c0 0x7f03a41581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:23:12.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.052+0000 7f03a95f1700 1 --2- 172.21.15.31:0/3501565836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03a4069f80 0x7f03a40afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:23:12.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.053+0000 7f03aa5f3700 1 --2- 172.21.15.31:0/3501565836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03a40b0160 0x7f03a40ae9b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f03a40b14f0 tx=0x7f0394009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acda780f42991fd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:12.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.053+0000 7f03a8df0700 1 -- 172.21.15.31:0/3501565836 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039400b860 con 0x7f03a40b0160 2023-10-09T06:23:12.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.053+0000 7f03a8df0700 1 -- 172.21.15.31:0/3501565836 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039400b9c0 con 0x7f03a40b0160 2023-10-09T06:23:12.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.053+0000 7f03a8df0700 1 -- 172.21.15.31:0/3501565836 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039400bd60 con 0x7f03a40b0160 2023-10-09T06:23:12.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.053+0000 7f03aadf4700 1 -- 172.21.15.31:0/3501565836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03a40b0160 msgr2=0x7f03a40ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.053+0000 7f03aadf4700 1 --2- 172.21.15.31:0/3501565836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03a40b0160 0x7f03a40ae9b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f03a40b14f0 tx=0x7f0394009250 comp rx=0 tx=0).stop 2023-10-09T06:23:12.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.053+0000 7f03aadf4700 1 -- 172.21.15.31:0/3501565836 shutdown_connections 2023-10-09T06:23:12.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.053+0000 7f03aadf4700 1 --2- 172.21.15.31:0/3501565836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03a40b0160 0x7f03a40ae9b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.053+0000 7f03aadf4700 1 --2- 172.21.15.31:0/3501565836 >> v2:172.21.15.158:3300/0 conn(0x7f03a41556c0 0x7f03a41581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.053+0000 7f03aadf4700 1 --2- 172.21.15.31:0/3501565836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03a4069f80 0x7f03a40afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.053+0000 7f03aadf4700 1 -- 172.21.15.31:0/3501565836 >> 172.21.15.31:0/3501565836 conn(0x7f03a406c740 msgr2=0x7f03a4069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:12.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.054+0000 7f03aadf4700 1 -- 172.21.15.31:0/3501565836 shutdown_connections 2023-10-09T06:23:12.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.054+0000 7f03aadf4700 1 -- 172.21.15.31:0/3501565836 wait complete. 2023-10-09T06:23:12.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.055+0000 7f03aadf4700 1 Processor -- start 2023-10-09T06:23:12.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.055+0000 7f03aadf4700 1 -- start start 2023-10-09T06:23:12.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.055+0000 7f03aadf4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03a4069f80 0x7f03a40a6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.055+0000 7f03aadf4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03a40b0160 0x7f03a4146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.055+0000 7f03aadf4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03a41556c0 0x7f03a40a7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.055+0000 7f03aadf4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4146a80 con 0x7f03a4069f80 2023-10-09T06:23:12.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.055+0000 7f03aadf4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4159d10 con 0x7f03a41556c0 2023-10-09T06:23:12.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.055+0000 7f03aadf4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a415a880 con 0x7f03a40b0160 2023-10-09T06:23:12.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03a9df2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03a4069f80 0x7f03a40a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03a9df2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03a4069f80 0x7f03a40a6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40748/0 (socket says 172.21.15.31:40748) 2023-10-09T06:23:12.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03a9df2700 1 -- 172.21.15.31:0/715503189 learned_addr learned my addr 172.21.15.31:0/715503189 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:12.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03aa5f3700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03a41556c0 0x7f03a40a7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03a95f1700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03a40b0160 0x7f03a4146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03a9df2700 1 -- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03a40b0160 msgr2=0x7f03a4146540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03a9df2700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03a40b0160 0x7f03a4146540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03a9df2700 1 -- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03a41556c0 msgr2=0x7f03a40a7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03a9df2700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03a41556c0 0x7f03a40a7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03a9df2700 1 -- 172.21.15.31:0/715503189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03940094f0 con 0x7f03a4069f80 2023-10-09T06:23:12.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03a9df2700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03a4069f80 0x7f03a40a6630 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f039c00cfb0 tx=0x7f039c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:12.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03a1ffb700 1 -- 172.21.15.31:0/715503189 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c00ae80 con 0x7f03a4069f80 2023-10-09T06:23:12.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03a1ffb700 1 -- 172.21.15.31:0/715503189 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039c016420 con 0x7f03a4069f80 2023-10-09T06:23:12.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03aadf4700 1 -- 172.21.15.31:0/715503189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a4159f50 con 0x7f03a4069f80 2023-10-09T06:23:12.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03a1ffb700 1 -- 172.21.15.31:0/715503189 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c0167c0 con 0x7f03a4069f80 2023-10-09T06:23:12.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.056+0000 7f03aadf4700 1 -- 172.21.15.31:0/715503189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a415a510 con 0x7f03a4069f80 2023-10-09T06:23:12.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.057+0000 7f03aadf4700 1 -- 172.21.15.31:0/715503189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a406df20 con 0x7f03a4069f80 2023-10-09T06:23:12.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.058+0000 7f03a1ffb700 1 -- 172.21.15.31:0/715503189 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f039c016b70 con 0x7f03a4069f80 2023-10-09T06:23:12.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.058+0000 7f03a1ffb700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0390066f60 0x7f0390069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.058+0000 7f03a1ffb700 1 -- 172.21.15.31:0/715503189 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f039c012070 con 0x7f03a4069f80 2023-10-09T06:23:12.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.058+0000 7f03a95f1700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0390066f60 0x7f0390069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.059+0000 7f03a95f1700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0390066f60 0x7f0390069410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f03a40a6b70 tx=0x7f0398008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:12.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.062+0000 7f03a1ffb700 1 -- 172.21.15.31:0/715503189 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f039c04e5a0 con 0x7f03a4069f80 2023-10-09T06:23:12.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.296+0000 7f03aadf4700 1 -- 172.21.15.31:0/715503189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03a415d220 con 0x7f03a4069f80 2023-10-09T06:23:12.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.297+0000 7f03a1ffb700 1 -- 172.21.15.31:0/715503189 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f039c08a020 con 0x7f03a4069f80 2023-10-09T06:23:12.297 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:23:12.297 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/4067940888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":4067940888},{"type":"v1","addr":"172.21.15.158:6835","nonce":4067940888}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/169747435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":169747435},{"type":"v1","addr":"172.21.15.158:6837","nonce":169747435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3769789034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3769789034},{"type":"v1","addr":"172.21.15.31:6834","nonce":3769789034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:23:06.370069+0000","modified":"2023-10-09T06:23:09.985664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/2596093897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2596093897},{"type":"v1","addr":"172.21.15.31:6835","nonce":2596093897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T06:23:12.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.299+0000 7f03aadf4700 1 -- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0390066f60 msgr2=0x7f0390069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.299+0000 7f03aadf4700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0390066f60 0x7f0390069410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f03a40a6b70 tx=0x7f0398008040 comp rx=0 tx=0).stop 2023-10-09T06:23:12.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.299+0000 7f03aadf4700 1 -- 172.21.15.31:0/715503189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03a4069f80 msgr2=0x7f03a40a6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.299+0000 7f03aadf4700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03a4069f80 0x7f03a40a6630 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f039c00cfb0 tx=0x7f039c007870 comp rx=0 tx=0).stop 2023-10-09T06:23:12.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.299+0000 7f03aadf4700 1 -- 172.21.15.31:0/715503189 shutdown_connections 2023-10-09T06:23:12.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.299+0000 7f03aadf4700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0390066f60 0x7f0390069410 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.299+0000 7f03aadf4700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03a41556c0 0x7f03a40a7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.299+0000 7f03aadf4700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03a4069f80 0x7f03a40a6630 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.299+0000 7f03aadf4700 1 --2- 172.21.15.31:0/715503189 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03a40b0160 0x7f03a4146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.299+0000 7f03aadf4700 1 -- 172.21.15.31:0/715503189 >> 172.21.15.31:0/715503189 conn(0x7f03a406c740 msgr2=0x7f03a4153ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:12.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.299+0000 7f03aadf4700 1 -- 172.21.15.31:0/715503189 shutdown_connections 2023-10-09T06:23:12.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.299+0000 7f03aadf4700 1 -- 172.21.15.31:0/715503189 wait complete. 2023-10-09T06:23:12.300 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 34 2023-10-09T06:23:12.713 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:23:06.370069+0000', 'modified': '2023-10-09T06:23:09.985664+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5643}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5643': {'gid': 5643, 'name': 'c', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6835/2596093897', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 2596093897}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 2596093897}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:23:12.713 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:23:12.714 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T06:23:12.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.836+0000 7f7ccb040700 1 Processor -- start 2023-10-09T06:23:12.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.836+0000 7f7ccb040700 1 -- start start 2023-10-09T06:23:12.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7ccb040700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7cc4157870 0x7f7cc415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7ccb040700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cc4157c40 0x7f7cc4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7ccb040700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc415cbb0 con 0x7f7cc415a620 2023-10-09T06:23:12.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7ccb040700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc415bfa0 con 0x7f7cc4157870 2023-10-09T06:23:12.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7ccb040700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc415c280 con 0x7f7cc4157c40 2023-10-09T06:23:12.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7cc95dd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cc4157c40 0x7f7cc4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7cc8ddc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7cc4157870 0x7f7cc415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7cc8ddc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7cc4157870 0x7f7cc415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:42268/0 (socket says 172.21.15.31:42268) 2023-10-09T06:23:12.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7cc95dd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cc4157c40 0x7f7cc4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:44198/0 (socket says 172.21.15.31:44198) 2023-10-09T06:23:12.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7cc8ddc700 1 -- 172.21.15.31:0/51865707 learned_addr learned my addr 172.21.15.31:0/51865707 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:12.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7cc8ddc700 1 -- 172.21.15.31:0/51865707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cc4157c40 msgr2=0x7f7cc4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:12.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/51865707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cc4157c40 0x7f7cc4158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7cc8ddc700 1 -- 172.21.15.31:0/51865707 >> v1:172.21.15.158:6789/0 conn(0x7f7cc415a620 legacy=0x7f7cc415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7cc8ddc700 1 -- 172.21.15.31:0/51865707 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc415c560 con 0x7f7cc4157870 2023-10-09T06:23:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.837+0000 7f7cc95dd700 1 --2- 172.21.15.31:0/51865707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cc4157c40 0x7f7cc4158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:23:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.838+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/51865707 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cc4157870 0x7f7cc415b6a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009f20 tx=0x7f7cb4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67e3c32094b1bbb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.838+0000 7f7cc37fe700 1 -- 172.21.15.31:0/51865707 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb400e070 con 0x7f7cc4157870 2023-10-09T06:23:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.838+0000 7f7cc37fe700 1 -- 172.21.15.31:0/51865707 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb400b9d0 con 0x7f7cc4157870 2023-10-09T06:23:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.838+0000 7f7cc37fe700 1 -- 172.21.15.31:0/51865707 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb40092e0 con 0x7f7cc4157870 2023-10-09T06:23:12.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.838+0000 7f7ccb040700 1 -- 172.21.15.31:0/51865707 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cc4157870 msgr2=0x7f7cc415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.838+0000 7f7ccb040700 1 --2- 172.21.15.31:0/51865707 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cc4157870 0x7f7cc415b6a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009f20 tx=0x7f7cb4009840 comp rx=0 tx=0).stop 2023-10-09T06:23:12.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.838+0000 7f7ccb040700 1 -- 172.21.15.31:0/51865707 shutdown_connections 2023-10-09T06:23:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.838+0000 7f7ccb040700 1 --2- 172.21.15.31:0/51865707 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cc4157870 0x7f7cc415b6a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.838+0000 7f7ccb040700 1 --2- 172.21.15.31:0/51865707 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cc4157c40 0x7f7cc4158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.838+0000 7f7ccb040700 1 -- 172.21.15.31:0/51865707 >> 172.21.15.31:0/51865707 conn(0x7f7cc4068ce0 msgr2=0x7f7cc40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.838+0000 7f7ccb040700 1 -- 172.21.15.31:0/51865707 shutdown_connections 2023-10-09T06:23:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.838+0000 7f7ccb040700 1 -- 172.21.15.31:0/51865707 wait complete. 2023-10-09T06:23:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.840+0000 7f7ccb040700 1 Processor -- start 2023-10-09T06:23:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.840+0000 7f7ccb040700 1 -- start start 2023-10-09T06:23:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.840+0000 7f7ccb040700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cc4157870 0x7f7cc40b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.840+0000 7f7ccb040700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cc4157c40 0x7f7cc4151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.840+0000 7f7ccb040700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cc415a620 0x7f7cc4150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.840+0000 7f7ccb040700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4152800 con 0x7f7cc4157c40 2023-10-09T06:23:12.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.840+0000 7f7ccb040700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4151950 con 0x7f7cc415a620 2023-10-09T06:23:12.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.840+0000 7f7ccb040700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4151b80 con 0x7f7cc4157870 2023-10-09T06:23:12.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cc4157c40 0x7f7cc4151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cc4157c40 0x7f7cc4151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40764/0 (socket says 172.21.15.31:40764) 2023-10-09T06:23:12.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc3fff700 1 -- 172.21.15.31:0/3061751198 learned_addr learned my addr 172.21.15.31:0/3061751198 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:12.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cc4157870 0x7f7cc40b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc95dd700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cc415a620 0x7f7cc4150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc3fff700 1 -- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cc4157870 msgr2=0x7f7cc40b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc3fff700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cc4157870 0x7f7cc40b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc3fff700 1 -- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cc415a620 msgr2=0x7f7cc4150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc3fff700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cc415a620 0x7f7cc4150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc3fff700 1 -- 172.21.15.31:0/3061751198 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc009420 con 0x7f7cc4157c40 2023-10-09T06:23:12.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc95dd700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cc415a620 0x7f7cc4150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:23:12.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc3fff700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cc4157c40 0x7f7cc4151410 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00c590 tx=0x7f7cac007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:12.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc0ff9700 1 -- 172.21.15.31:0/3061751198 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac011590 con 0x7f7cc4157c40 2023-10-09T06:23:12.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc0ff9700 1 -- 172.21.15.31:0/3061751198 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac011710 con 0x7f7cc4157c40 2023-10-09T06:23:12.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7ccb040700 1 -- 172.21.15.31:0/3061751198 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb4009ae0 con 0x7f7cc4157c40 2023-10-09T06:23:12.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7cc0ff9700 1 -- 172.21.15.31:0/3061751198 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac011ad0 con 0x7f7cc4157c40 2023-10-09T06:23:12.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.841+0000 7f7ccb040700 1 -- 172.21.15.31:0/3061751198 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc4152140 con 0x7f7cc4157c40 2023-10-09T06:23:12.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.843+0000 7f7cc0ff9700 1 -- 172.21.15.31:0/3061751198 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cac01b3b0 con 0x7f7cc4157c40 2023-10-09T06:23:12.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.843+0000 7f7cc0ff9700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7ca4066f30 0x7f7ca40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.843+0000 7f7cc0ff9700 1 -- 172.21.15.31:0/3061751198 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7cac083980 con 0x7f7cc4157c40 2023-10-09T06:23:12.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.844+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7ca4066f30 0x7f7ca40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.844+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7ca4066f30 0x7f7ca40693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009880 tx=0x7f7cb4018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:12.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.845+0000 7f7cd4338b80 1 Processor -- start 2023-10-09T06:23:12.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.845+0000 7f7cd4338b80 1 -- start start 2023-10-09T06:23:12.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cd4338b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6d85a50 0x55d2a6d85e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cd4338b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6dcfd00 0x55d2a6daea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cd4338b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6daef60 0x55d2a6d81cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cd4338b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a6cdca70 con 0x55d2a6d85a50 2023-10-09T06:23:12.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cd4338b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a6cda270 con 0x55d2a6dcfd00 2023-10-09T06:23:12.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cd4338b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2a6cd6060 con 0x55d2a6daef60 2023-10-09T06:23:12.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cc8ddc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6d85a50 0x55d2a6d85e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cc8ddc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6d85a50 0x55d2a6d85e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40778/0 (socket says 172.21.15.31:40778) 2023-10-09T06:23:12.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cc8ddc700 1 -- 172.21.15.31:0/3793160214 learned_addr learned my addr 172.21.15.31:0/3793160214 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:12.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cc3fff700 1 --2- 172.21.15.31:0/3793160214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6dcfd00 0x55d2a6daea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cc95dd700 1 --2- 172.21.15.31:0/3793160214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6daef60 0x55d2a6d81cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cc8ddc700 1 -- 172.21.15.31:0/3793160214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6daef60 msgr2=0x55d2a6d81cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/3793160214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6daef60 0x55d2a6d81cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cc8ddc700 1 -- 172.21.15.31:0/3793160214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6dcfd00 msgr2=0x55d2a6daea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/3793160214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6dcfd00 0x55d2a6daea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.846+0000 7f7cc8ddc700 1 -- 172.21.15.31:0/3793160214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2a6b70270 con 0x55d2a6d85a50 2023-10-09T06:23:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.847+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/3793160214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6d85a50 0x55d2a6d85e20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7cb401e4b0 tx=0x7f7cb4020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43ae6ff5d3e9c7b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.847+0000 7f7cb9ffb700 1 -- 172.21.15.31:0/3793160214 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4027480 con 0x55d2a6d85a50 2023-10-09T06:23:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.847+0000 7f7cb9ffb700 1 -- 172.21.15.31:0/3793160214 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb40275e0 con 0x55d2a6d85a50 2023-10-09T06:23:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.847+0000 7f7cb9ffb700 1 -- 172.21.15.31:0/3793160214 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4027960 con 0x55d2a6d85a50 2023-10-09T06:23:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.847+0000 7f7cd4338b80 1 -- 172.21.15.31:0/3793160214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6d85a50 msgr2=0x55d2a6d85e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.847+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/3793160214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6d85a50 0x55d2a6d85e20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7cb401e4b0 tx=0x7f7cb4020040 comp rx=0 tx=0).stop 2023-10-09T06:23:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.847+0000 7f7cd4338b80 1 -- 172.21.15.31:0/3793160214 shutdown_connections 2023-10-09T06:23:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.847+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/3793160214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6daef60 0x55d2a6d81cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.847+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/3793160214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6d85a50 0x55d2a6d85e20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.847+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/3793160214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6dcfd00 0x55d2a6daea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.847+0000 7f7cd4338b80 1 -- 172.21.15.31:0/3793160214 >> 172.21.15.31:0/3793160214 conn(0x55d2a6d87370 msgr2=0x55d2a6d87740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.847+0000 7f7cd4338b80 1 -- 172.21.15.31:0/3793160214 shutdown_connections 2023-10-09T06:23:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.847+0000 7f7cd4338b80 1 -- 172.21.15.31:0/3793160214 wait complete. 2023-10-09T06:23:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.848+0000 7f7cd4338b80 1 -- start start 2023-10-09T06:23:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.848+0000 7f7cd4338b80 1 Processor -- start 2023-10-09T06:23:12.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cd4338b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6d85a50 0x55d2a6dc8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cd4338b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6daef60 0x55d2a6ddc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cd4338b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 0x55d2a6dc4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cd4338b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a6c81890 con 0x55d2a6dcfd00 2023-10-09T06:23:12.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cd4338b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a6c9cea0 con 0x55d2a6d85a50 2023-10-09T06:23:12.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cd4338b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2a6b58e30 con 0x55d2a6daef60 2023-10-09T06:23:12.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cd4338b80 10 client.0 _ll_register_callbacks cb 0x55d2a6d49110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:23:12.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cc95dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 0x55d2a6dc4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cc95dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 0x55d2a6dc4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40780/0 (socket says 172.21.15.31:40780) 2023-10-09T06:23:12.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cc95dd700 1 -- 172.21.15.31:0/2845829542 learned_addr learned my addr 172.21.15.31:0/2845829542 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:12.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/2845829542 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6d85a50 0x55d2a6dc8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cc3fff700 1 --2- 172.21.15.31:0/2845829542 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6daef60 0x55d2a6ddc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cc95dd700 1 -- 172.21.15.31:0/2845829542 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6daef60 msgr2=0x55d2a6ddc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:12.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cc95dd700 1 --2- 172.21.15.31:0/2845829542 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6daef60 0x55d2a6ddc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cc95dd700 1 -- 172.21.15.31:0/2845829542 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6d85a50 msgr2=0x55d2a6dc8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:12.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cc95dd700 1 --2- 172.21.15.31:0/2845829542 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6d85a50 0x55d2a6dc8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.849+0000 7f7cc95dd700 1 -- 172.21.15.31:0/2845829542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc415c560 con 0x55d2a6dcfd00 2023-10-09T06:23:12.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7cc95dd700 1 --2- 172.21.15.31:0/2845829542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 0x55d2a6dc4fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc013610 tx=0x7f7cbc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b79b12196d3b2cb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:12.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7ca2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:23:12.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7ca2ffd700 1 -- 172.21.15.31:0/2845829542 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc016460 con 0x55d2a6dcfd00 2023-10-09T06:23:12.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7ca2ffd700 1 -- 172.21.15.31:0/2845829542 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7cbc0165c0 con 0x55d2a6dcfd00 2023-10-09T06:23:12.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2845829542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2a6d7ab70 con 0x55d2a6dcfd00 2023-10-09T06:23:12.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7ca2ffd700 1 -- 172.21.15.31:0/2845829542 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cbc005a00 con 0x55d2a6dcfd00 2023-10-09T06:23:12.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7cd4338b80 10 client.5790 fetch_fsmap learned FSMap version 34 2023-10-09T06:23:12.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2845829542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55d2a6b12fe0 con 0x55d2a6dcfd00 2023-10-09T06:23:12.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7ca2ffd700 1 -- 172.21.15.31:0/2845829542 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc025070 con 0x55d2a6dcfd00 2023-10-09T06:23:12.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7ca2ffd700 1 -- 172.21.15.31:0/2845829542 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7cbc005b60 con 0x55d2a6dcfd00 2023-10-09T06:23:12.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7cd4338b80 10 client.5790 fetch_fsmap finished waiting for FSMap version 34 2023-10-09T06:23:12.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7cd4338b80 10 client.5790 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T06:23:12.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7cd4338b80 20 client.5790 populate_metadata read hostname 'smithi031' 2023-10-09T06:23:12.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/2845829542 >> [v2:172.21.15.31:6833/2596093897,v1:172.21.15.31:6835/2596093897] conn(0x55d2a6d82780 0x55d2a6d82b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7cd4338b80 4 client.5790 mds_command: new command op to 5643 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:23:12.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2845829542 --> [v2:172.21.15.31:6833/2596093897,v1:172.21.15.31:6835/2596093897] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2a6d57aa0 con 0x55d2a6d82780 2023-10-09T06:23:12.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.850+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/2845829542 >> [v2:172.21.15.31:6833/2596093897,v1:172.21.15.31:6835/2596093897] conn(0x55d2a6d82780 0x55d2a6d82b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/2845829542 >> [v2:172.21.15.31:6833/2596093897,v1:172.21.15.31:6835/2596093897] conn(0x55d2a6d82780 0x55d2a6d82b50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbcd47cb5517b7bf server_cookie=4f35835f47b6857 in_seq=0 out_seq=0 2023-10-09T06:23:12.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7ca2ffd700 10 client.5790 ms_handle_connect on v2:172.21.15.31:6833/2596093897 2023-10-09T06:23:12.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7ca2ffd700 1 -- 172.21.15.31:0/2845829542 <== mds.0 v2:172.21.15.31:6833/2596093897 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d2a6d57aa0 con 0x55d2a6d82780 2023-10-09T06:23:12.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7ca2ffd700 10 client.5790 handle_command_reply: tid=0 2023-10-09T06:23:12.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7cd4338b80 1 client.5790 shutdown 2023-10-09T06:23:12.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2845829542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 msgr2=0x55d2a6dc4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/2845829542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 0x55d2a6dc4fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc013610 tx=0x7f7cbc008040 comp rx=0 tx=0).stop 2023-10-09T06:23:12.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2845829542 shutdown_connections 2023-10-09T06:23:12.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/2845829542 >> [v2:172.21.15.31:6833/2596093897,v1:172.21.15.31:6835/2596093897] conn(0x55d2a6d82780 0x55d2a6d82b50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/2845829542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 0x55d2a6dc4fb0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7ca2ffd700 0 client.5790 ms_handle_reset on v2:172.21.15.31:6833/2596093897 2023-10-09T06:23:12.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/2845829542 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6d85a50 0x55d2a6dc8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/2845829542 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6daef60 0x55d2a6ddc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.851+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2845829542 >> 172.21.15.31:0/2845829542 conn(0x55d2a6d87370 msgr2=0x55d2a6dcb550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:12.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.852+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2845829542 shutdown_connections 2023-10-09T06:23:12.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.852+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2845829542 wait complete. 2023-10-09T06:23:12.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.852+0000 7f7cd4338b80 20 client.5790 trim_cache size 0 max 16384 2023-10-09T06:23:12.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.869+0000 7f7cd4338b80 1 Processor -- start 2023-10-09T06:23:12.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.869+0000 7f7cd4338b80 1 -- start start 2023-10-09T06:23:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.869+0000 7f7cd4338b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6d85a50 0x55d2a6d880b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.869+0000 7f7cd4338b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6daef60 0x55d2a6dc70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cd4338b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6dcfd00 0x55d2a6e29340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cd4338b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a6d7e5c0 con 0x55d2a6daef60 2023-10-09T06:23:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cd4338b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a6dc7b60 con 0x55d2a6d85a50 2023-10-09T06:23:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cd4338b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2a6dc7950 con 0x55d2a6dcfd00 2023-10-09T06:23:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cc3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6daef60 0x55d2a6dc70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cc3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6daef60 0x55d2a6dc70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40784/0 (socket says 172.21.15.31:40784) 2023-10-09T06:23:12.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cc3fff700 1 -- 172.21.15.31:0/1419430894 learned_addr learned my addr 172.21.15.31:0/1419430894 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:12.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cc3fff700 1 -- 172.21.15.31:0/1419430894 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6dcfd00 msgr2=0x55d2a6e29340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:12.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cc3fff700 1 --2- 172.21.15.31:0/1419430894 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6dcfd00 0x55d2a6e29340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cc3fff700 1 -- 172.21.15.31:0/1419430894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6d85a50 msgr2=0x55d2a6d880b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:12.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cc3fff700 1 --2- 172.21.15.31:0/1419430894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6d85a50 0x55d2a6d880b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cc3fff700 1 -- 172.21.15.31:0/1419430894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2a6ca4780 con 0x55d2a6daef60 2023-10-09T06:23:12.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cc3fff700 1 --2- 172.21.15.31:0/1419430894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6daef60 0x55d2a6dc70b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00cc30 tx=0x7f7cac014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9765aad0cd593e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:12.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cba7fc700 1 -- 172.21.15.31:0/1419430894 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac057a60 con 0x55d2a6daef60 2023-10-09T06:23:12.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cba7fc700 1 -- 172.21.15.31:0/1419430894 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac05b7b0 con 0x55d2a6daef60 2023-10-09T06:23:12.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.870+0000 7f7cba7fc700 1 -- 172.21.15.31:0/1419430894 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac011e80 con 0x55d2a6daef60 2023-10-09T06:23:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.871+0000 7f7cd4338b80 1 -- 172.21.15.31:0/1419430894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6daef60 msgr2=0x55d2a6dc70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.871+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/1419430894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6daef60 0x55d2a6dc70b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00cc30 tx=0x7f7cac014040 comp rx=0 tx=0).stop 2023-10-09T06:23:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.871+0000 7f7cd4338b80 1 -- 172.21.15.31:0/1419430894 shutdown_connections 2023-10-09T06:23:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.871+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/1419430894 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6dcfd00 0x55d2a6e29340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.871+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/1419430894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6d85a50 0x55d2a6d880b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.871+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/1419430894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6daef60 0x55d2a6dc70b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.871+0000 7f7cd4338b80 1 -- 172.21.15.31:0/1419430894 >> 172.21.15.31:0/1419430894 conn(0x55d2a6d87370 msgr2=0x55d2a6d82b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.871+0000 7f7cd4338b80 1 -- 172.21.15.31:0/1419430894 shutdown_connections 2023-10-09T06:23:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.871+0000 7f7cd4338b80 1 -- 172.21.15.31:0/1419430894 wait complete. 2023-10-09T06:23:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.871+0000 7f7cd4338b80 1 -- start start 2023-10-09T06:23:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.871+0000 7f7cd4338b80 1 Processor -- start 2023-10-09T06:23:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.872+0000 7f7cd4338b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6d85a50 0x55d2a6dcb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.872+0000 7f7cd4338b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6daef60 0x55d2a6dcba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.872+0000 7f7cd4338b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 0x55d2a6dc2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.872+0000 7f7cd4338b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a6dceed0 con 0x55d2a6dcfd00 2023-10-09T06:23:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.872+0000 7f7cd4338b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a6dc86e0 con 0x55d2a6daef60 2023-10-09T06:23:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.872+0000 7f7cd4338b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2a6e272a0 con 0x55d2a6d85a50 2023-10-09T06:23:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.872+0000 7f7cd4338b80 10 client.0 _ll_register_callbacks cb 0x55d2a6d49110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:23:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.872+0000 7f7cc95dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 0x55d2a6dc2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.872+0000 7f7cc95dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 0x55d2a6dc2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40786/0 (socket says 172.21.15.31:40786) 2023-10-09T06:23:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.872+0000 7f7cc95dd700 1 -- 172.21.15.31:0/2367293723 learned_addr learned my addr 172.21.15.31:0/2367293723 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cc3fff700 1 --2- 172.21.15.31:0/2367293723 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6daef60 0x55d2a6dcba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/2367293723 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6d85a50 0x55d2a6dcb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cc95dd700 1 -- 172.21.15.31:0/2367293723 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6d85a50 msgr2=0x55d2a6dcb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cc95dd700 1 --2- 172.21.15.31:0/2367293723 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6d85a50 0x55d2a6dcb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cc95dd700 1 -- 172.21.15.31:0/2367293723 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6daef60 msgr2=0x55d2a6dcba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cc95dd700 1 --2- 172.21.15.31:0/2367293723 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6daef60 0x55d2a6dcba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cc95dd700 1 -- 172.21.15.31:0/2367293723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc4152140 con 0x55d2a6dcfd00 2023-10-09T06:23:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cc95dd700 1 --2- 172.21.15.31:0/2367293723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 0x55d2a6dc2560 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc013610 tx=0x7f7cbc01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6953fdbe6d2188da server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7ca2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:23:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7ca2ffd700 1 -- 172.21.15.31:0/2367293723 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc001d20 con 0x55d2a6dcfd00 2023-10-09T06:23:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7ca2ffd700 1 -- 172.21.15.31:0/2367293723 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7cbc005a00 con 0x55d2a6dcfd00 2023-10-09T06:23:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2367293723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7cb40275e0 con 0x55d2a6dcfd00 2023-10-09T06:23:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7ca2ffd700 1 -- 172.21.15.31:0/2367293723 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cbc016990 con 0x55d2a6dcfd00 2023-10-09T06:23:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cd4338b80 10 client.5796 fetch_fsmap learned FSMap version 34 2023-10-09T06:23:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2367293723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55d2a6c8b470 con 0x55d2a6dcfd00 2023-10-09T06:23:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7ca2ffd700 1 -- 172.21.15.31:0/2367293723 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb40275e0 con 0x55d2a6dcfd00 2023-10-09T06:23:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7ca2ffd700 1 -- 172.21.15.31:0/2367293723 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7cbc016af0 con 0x55d2a6dcfd00 2023-10-09T06:23:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cd4338b80 10 client.5796 fetch_fsmap finished waiting for FSMap version 34 2023-10-09T06:23:12.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cd4338b80 10 client.5796 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T06:23:12.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cd4338b80 20 client.5796 populate_metadata read hostname 'smithi031' 2023-10-09T06:23:12.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/2367293723 >> [v2:172.21.15.31:6833/2596093897,v1:172.21.15.31:6835/2596093897] conn(0x55d2a6dc2d00 0x55d2a6dcdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:12.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cd4338b80 4 client.5796 mds_command: new command op to 5643 tid=0[{"prefix": "status"}] 2023-10-09T06:23:12.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.873+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2367293723 --> [v2:172.21.15.31:6833/2596093897,v1:172.21.15.31:6835/2596093897] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d2a6c78e00 con 0x55d2a6dc2d00 2023-10-09T06:23:12.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/2367293723 >> [v2:172.21.15.31:6833/2596093897,v1:172.21.15.31:6835/2596093897] conn(0x55d2a6dc2d00 0x55d2a6dcdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:12.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7cc8ddc700 1 --2- 172.21.15.31:0/2367293723 >> [v2:172.21.15.31:6833/2596093897,v1:172.21.15.31:6835/2596093897] conn(0x55d2a6dc2d00 0x55d2a6dcdb90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11ec9589bee92bee server_cookie=f43d80eb92c3933d in_seq=0 out_seq=0 2023-10-09T06:23:12.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7ca2ffd700 10 client.5796 ms_handle_connect on v2:172.21.15.31:6833/2596093897 2023-10-09T06:23:12.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7ca2ffd700 1 -- 172.21.15.31:0/2367293723 <== mds.0 v2:172.21.15.31:6833/2596093897 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55d2a6c78e00 con 0x55d2a6dc2d00 2023-10-09T06:23:12.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7ca2ffd700 10 client.5796 handle_command_reply: tid=0 2023-10-09T06:23:12.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7cd4338b80 1 client.5796 shutdown 2023-10-09T06:23:12.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2367293723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 msgr2=0x55d2a6dc2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/2367293723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 0x55d2a6dc2560 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc013610 tx=0x7f7cbc01e000 comp rx=0 tx=0).stop 2023-10-09T06:23:12.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2367293723 shutdown_connections 2023-10-09T06:23:12.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/2367293723 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55d2a6d85a50 0x55d2a6dcb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/2367293723 >> [v2:172.21.15.31:6833/2596093897,v1:172.21.15.31:6835/2596093897] conn(0x55d2a6dc2d00 0x55d2a6dcdb90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/2367293723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d2a6dcfd00 0x55d2a6dc2560 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7ca2ffd700 0 client.5796 ms_handle_reset on v2:172.21.15.31:6833/2596093897 2023-10-09T06:23:12.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7cd4338b80 1 --2- 172.21.15.31:0/2367293723 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d2a6daef60 0x55d2a6dcba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2367293723 >> 172.21.15.31:0/2367293723 conn(0x55d2a6d87370 msgr2=0x55d2a6d88a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:12.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2367293723 shutdown_connections 2023-10-09T06:23:12.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.874+0000 7f7cd4338b80 1 -- 172.21.15.31:0/2367293723 wait complete. 2023-10-09T06:23:12.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.875+0000 7f7cd4338b80 20 client.5796 trim_cache size 0 max 16384 2023-10-09T06:23:12.882 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:23:12.882 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:23:12.883 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-10-09T06:23:12.883 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5643, 2023-10-09T06:23:12.883 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-10-09T06:23:12.883 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-10-09T06:23:12.883 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-10-09T06:23:12.883 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 5.9021786079999998, 2023-10-09T06:23:12.883 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 34, 2023-10-09T06:23:12.883 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 65, 2023-10-09T06:23:12.883 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 65, 2023-10-09T06:23:12.884 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 17.85031261 2023-10-09T06:23:12.884 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:23:12.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.875+0000 7f7ccb040700 1 -- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7ca4066f30 msgr2=0x7f7ca40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.875+0000 7f7ccb040700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7ca4066f30 0x7f7ca40693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009880 tx=0x7f7cb4018000 comp rx=0 tx=0).stop 2023-10-09T06:23:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.875+0000 7f7ccb040700 1 -- 172.21.15.31:0/3061751198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cc4157c40 msgr2=0x7f7cc4151410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.875+0000 7f7ccb040700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cc4157c40 0x7f7cc4151410 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00c590 tx=0x7f7cac007f50 comp rx=0 tx=0).stop 2023-10-09T06:23:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.875+0000 7f7ccb040700 1 -- 172.21.15.31:0/3061751198 shutdown_connections 2023-10-09T06:23:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.875+0000 7f7ccb040700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7ca4066f30 0x7f7ca40693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.875+0000 7f7ccb040700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7cc4157870 0x7f7cc40b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.875+0000 7f7ccb040700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7cc415a620 0x7f7cc4150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.875+0000 7f7ccb040700 1 --2- 172.21.15.31:0/3061751198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cc4157c40 0x7f7cc4151410 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.875+0000 7f7ccb040700 1 -- 172.21.15.31:0/3061751198 >> 172.21.15.31:0/3061751198 conn(0x7f7cc4068ce0 msgr2=0x7f7cc40cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.875+0000 7f7ccb040700 1 -- 172.21.15.31:0/3061751198 shutdown_connections 2023-10-09T06:23:12.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:12.875+0000 7f7ccb040700 1 -- 172.21.15.31:0/3061751198 wait complete. 2023-10-09T06:23:12.886 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:23:13.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.007+0000 7ff4facc5700 1 Processor -- start 2023-10-09T06:23:13.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.007+0000 7ff4facc5700 1 -- start start 2023-10-09T06:23:13.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4facc5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff4f4157870 0x7ff4f415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:13.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4facc5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff4f415a620 0x7ff4f415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:13.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4facc5700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f415cbb0 con 0x7ff4f415d580 2023-10-09T06:23:13.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4facc5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f415bfa0 con 0x7ff4f415a620 2023-10-09T06:23:13.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4facc5700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f415c280 con 0x7ff4f4157870 2023-10-09T06:23:13.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4f3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff4f415a620 0x7ff4f415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:13.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4f3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff4f415a620 0x7ff4f415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40802/0 (socket says 172.21.15.31:40802) 2023-10-09T06:23:13.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4f3fff700 1 -- 172.21.15.31:0/2846393767 learned_addr learned my addr 172.21.15.31:0/2846393767 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:13.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4f8a61700 1 --2- 172.21.15.31:0/2846393767 >> v2:172.21.15.158:3300/0 conn(0x7ff4f4157870 0x7ff4f415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:13.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4f3fff700 1 -- 172.21.15.31:0/2846393767 >> v2:172.21.15.158:3300/0 conn(0x7ff4f4157870 msgr2=0x7ff4f415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:13.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4f3fff700 1 --2- 172.21.15.31:0/2846393767 >> v2:172.21.15.158:3300/0 conn(0x7ff4f4157870 0x7ff4f415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:13.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4f3fff700 1 -- 172.21.15.31:0/2846393767 >> v1:172.21.15.158:6789/0 conn(0x7ff4f415d580 legacy=0x7ff4f4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:13.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4f3fff700 1 -- 172.21.15.31:0/2846393767 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f415c560 con 0x7ff4f415a620 2023-10-09T06:23:13.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4f3fff700 1 --2- 172.21.15.31:0/2846393767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f415a620 0x7ff4f415d040 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4069d80 tx=0x7ff4e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9ce2ae17599471 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:13.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4f37fe700 1 -- 172.21.15.31:0/2846393767 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400e070 con 0x7ff4f415a620 2023-10-09T06:23:13.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4f37fe700 1 -- 172.21.15.31:0/2846393767 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e400ba10 con 0x7ff4f415a620 2023-10-09T06:23:13.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.008+0000 7ff4f37fe700 1 -- 172.21.15.31:0/2846393767 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40092e0 con 0x7ff4f415a620 2023-10-09T06:23:13.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.009+0000 7ff4facc5700 1 -- 172.21.15.31:0/2846393767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f415a620 msgr2=0x7ff4f415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:13.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.009+0000 7ff4facc5700 1 --2- 172.21.15.31:0/2846393767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f415a620 0x7ff4f415d040 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4069d80 tx=0x7ff4e4009840 comp rx=0 tx=0).stop 2023-10-09T06:23:13.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.009+0000 7ff4facc5700 1 -- 172.21.15.31:0/2846393767 shutdown_connections 2023-10-09T06:23:13.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.009+0000 7ff4facc5700 1 --2- 172.21.15.31:0/2846393767 >> v2:172.21.15.158:3300/0 conn(0x7ff4f4157870 0x7ff4f415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:13.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.009+0000 7ff4facc5700 1 --2- 172.21.15.31:0/2846393767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f415a620 0x7ff4f415d040 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:13.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.009+0000 7ff4facc5700 1 -- 172.21.15.31:0/2846393767 >> 172.21.15.31:0/2846393767 conn(0x7ff4f4068ce0 msgr2=0x7ff4f40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:13.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.009+0000 7ff4facc5700 1 -- 172.21.15.31:0/2846393767 shutdown_connections 2023-10-09T06:23:13.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.009+0000 7ff4facc5700 1 -- 172.21.15.31:0/2846393767 wait complete. 2023-10-09T06:23:13.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.010+0000 7ff4facc5700 1 Processor -- start 2023-10-09T06:23:13.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.010+0000 7ff4facc5700 1 -- start start 2023-10-09T06:23:13.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4facc5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4f4157870 0x7ff4f414fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:13.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4facc5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f415a620 0x7ff4f414a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4facc5700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4f415d580 0x7ff4f414e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4facc5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f416e470 con 0x7ff4f415a620 2023-10-09T06:23:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4facc5700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4155f80 con 0x7ff4f415d580 2023-10-09T06:23:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4facc5700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4150240 con 0x7ff4f4157870 2023-10-09T06:23:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4f3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f415a620 0x7ff4f414a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4f3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f415a620 0x7ff4f414a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40810/0 (socket says 172.21.15.31:40810) 2023-10-09T06:23:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4f3fff700 1 -- 172.21.15.31:0/254975216 learned_addr learned my addr 172.21.15.31:0/254975216 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4f8a61700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4f4157870 0x7ff4f414fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4f9262700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4f415d580 0x7ff4f414e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4f3fff700 1 -- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4f4157870 msgr2=0x7ff4f414fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4f3fff700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4f4157870 0x7ff4f414fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4f3fff700 1 -- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4f415d580 msgr2=0x7ff4f414e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4f3fff700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4f415d580 0x7ff4f414e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4f3fff700 1 -- 172.21.15.31:0/254975216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e4009ae0 con 0x7ff4f415a620 2023-10-09T06:23:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.011+0000 7ff4f8a61700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4f4157870 0x7ff4f414fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:23:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.012+0000 7ff4f3fff700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f415a620 0x7ff4f414a830 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4003000 tx=0x7ff4e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.012+0000 7ff4f0ff9700 1 -- 172.21.15.31:0/254975216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4012950 con 0x7ff4f415a620 2023-10-09T06:23:13.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.012+0000 7ff4f0ff9700 1 -- 172.21.15.31:0/254975216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4012ab0 con 0x7ff4f415a620 2023-10-09T06:23:13.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.012+0000 7ff4facc5700 1 -- 172.21.15.31:0/254975216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f41556e0 con 0x7ff4f415a620 2023-10-09T06:23:13.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.012+0000 7ff4f0ff9700 1 -- 172.21.15.31:0/254975216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4012e50 con 0x7ff4f415a620 2023-10-09T06:23:13.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.012+0000 7ff4facc5700 1 -- 172.21.15.31:0/254975216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f4155ca0 con 0x7ff4f415a620 2023-10-09T06:23:13.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.013+0000 7ff4facc5700 1 -- 172.21.15.31:0/254975216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f416e240 con 0x7ff4f415a620 2023-10-09T06:23:13.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.013+0000 7ff4f0ff9700 1 -- 172.21.15.31:0/254975216 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4e401d630 con 0x7ff4f415a620 2023-10-09T06:23:13.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.013+0000 7ff4f0ff9700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4d4066f30 0x7ff4d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:13.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.014+0000 7ff4f0ff9700 1 -- 172.21.15.31:0/254975216 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4e4085e60 con 0x7ff4f415a620 2023-10-09T06:23:13.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.014+0000 7ff4f8a61700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4d4066f30 0x7ff4d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:13.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.014+0000 7ff4f8a61700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4d4066f30 0x7ff4d40693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc006fd0 tx=0x7ff4dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:13.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.018+0000 7ff4f0ff9700 1 -- 172.21.15.31:0/254975216 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4f416e240 con 0x7ff4f415a620 2023-10-09T06:23:13.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.252+0000 7ff4facc5700 1 -- 172.21.15.31:0/254975216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff4f416e240 con 0x7ff4f415a620 2023-10-09T06:23:13.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.253+0000 7ff4f0ff9700 1 -- 172.21.15.31:0/254975216 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff4f416e240 con 0x7ff4f415a620 2023-10-09T06:23:13.253 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:23:13.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.255+0000 7ff4facc5700 1 -- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4d4066f30 msgr2=0x7ff4d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:13.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.255+0000 7ff4facc5700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4d4066f30 0x7ff4d40693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc006fd0 tx=0x7ff4dc008040 comp rx=0 tx=0).stop 2023-10-09T06:23:13.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.255+0000 7ff4facc5700 1 -- 172.21.15.31:0/254975216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f415a620 msgr2=0x7ff4f414a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:13.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.255+0000 7ff4facc5700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f415a620 0x7ff4f414a830 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4003000 tx=0x7ff4e4017000 comp rx=0 tx=0).stop 2023-10-09T06:23:13.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.255+0000 7ff4facc5700 1 -- 172.21.15.31:0/254975216 shutdown_connections 2023-10-09T06:23:13.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.255+0000 7ff4facc5700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4d4066f30 0x7ff4d40693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:13.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.255+0000 7ff4facc5700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4f4157870 0x7ff4f414fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:13.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.255+0000 7ff4facc5700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4f415d580 0x7ff4f414e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:13.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.255+0000 7ff4facc5700 1 --2- 172.21.15.31:0/254975216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f415a620 0x7ff4f414a830 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:13.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.255+0000 7ff4facc5700 1 -- 172.21.15.31:0/254975216 >> 172.21.15.31:0/254975216 conn(0x7ff4f4068ce0 msgr2=0x7ff4f4156780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:13.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.255+0000 7ff4facc5700 1 -- 172.21.15.31:0/254975216 shutdown_connections 2023-10-09T06:23:13.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:13.255+0000 7ff4facc5700 1 -- 172.21.15.31:0/254975216 wait complete. 2023-10-09T06:23:13.266 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:23:13.267 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:23:13.267 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-10-09T06:23:13.267 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:23:13.267 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:23:13.267 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:23:13.267 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:23:13.267 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:23:13.267 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:23:13.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:13.268 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-10-09T06:23:13.283 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:23:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:23:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:23:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:23:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:13.284 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:23:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T06:23:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-10-09T06:23:13.284 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:23:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T06:23:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-10-09T06:23:13.284 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:23:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-10-09T06:23:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-10-09T06:23:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T06:23:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42374sec preferred_lft 42374sec 2023-10-09T06:23:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-10-09T06:23:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:13.285 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:23:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:23:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-10-09T06:23:13.286 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:23:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:23:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:23:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::b4ad:53ff:fed3:a589/64 scope link 2023-10-09T06:23:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:13.286 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:23:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether f6:bf:b8:0f:49:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:23:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::f4bf:b8ff:fe0f:498b/64 scope link 2023-10-09T06:23:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:13.287 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:23:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:23:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::d8ab:b5ff:fe1d:e066/64 scope link 2023-10-09T06:23:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:13.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:13.288 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:23:13.347 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-10-09T06:23:13.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:13.349 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-10-09T06:23:13.406 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-10-09T06:23:13.406 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:23:13.406 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T06:23:13.407 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T06:23:13.407 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:23:13.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:13.407 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:23:13.407 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:23:13.407 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T06:23:13.408 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T06:23:13.408 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T06:23:13.408 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:23:13.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:13.509 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:23:13.524 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:23:13.524 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:23:13.525 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:23:13.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:13.525 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-10-09T06:23:13.590 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:23:13.590 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:23:13.645 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:23:13.646 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:23:13.646 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:23:13.700 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:23:13.700 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:23:13.700 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:23:13.781 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:23:13.781 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:23:13.801 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:23:13.801 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:23:13.801 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:23:13.801 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:23:13.801 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:23:13.802 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:23:13.802 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:23:13.802 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:23:13.822 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:23:13.823 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:23:13.823 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:23:13.823 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:23:13.823 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:23:13.823 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:23:13.823 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:23:13.823 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:23:13.823 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:23:13.823 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:23:13.823 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:23:13.824 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:23:13.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:13.825 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:23:13.892 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:23:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.053+0000 7f2242183700 1 Processor -- start 2023-10-09T06:23:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.053+0000 7f2242183700 1 -- start start 2023-10-09T06:23:14.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.053+0000 7f2242183700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f223c0aa870 0x7f223c0cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.053+0000 7f2242183700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f223c15a310 0x7f223c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.053+0000 7f2242183700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f223c0aac40 0x7f223c0ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.053+0000 7f2242183700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c0ac650 con 0x7f223c0aa870 2023-10-09T06:23:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f2242183700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c0ad4b0 con 0x7f223c15a310 2023-10-09T06:23:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f2242183700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0ac8a0 con 0x7f223c0aac40 2023-10-09T06:23:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f223c0aa870 0x7f223c0cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f223c0aa870 0x7f223c0cd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40816/0 (socket says 172.21.15.31:40816) 2023-10-09T06:23:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223b7fe700 1 -- 172.21.15.31:0/2878476888 learned_addr learned my addr 172.21.15.31:0/2878476888 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223affd700 1 --2- 172.21.15.31:0/2878476888 >> v2:172.21.15.158:3300/0 conn(0x7f223c15a310 0x7f223c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223bfff700 1 --2- 172.21.15.31:0/2878476888 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f223c0aac40 0x7f223c0ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223b7fe700 1 -- 172.21.15.31:0/2878476888 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f223c0aac40 msgr2=0x7f223c0ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223b7fe700 1 --2- 172.21.15.31:0/2878476888 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f223c0aac40 0x7f223c0ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223b7fe700 1 -- 172.21.15.31:0/2878476888 >> v2:172.21.15.158:3300/0 conn(0x7f223c15a310 msgr2=0x7f223c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223b7fe700 1 --2- 172.21.15.31:0/2878476888 >> v2:172.21.15.158:3300/0 conn(0x7f223c15a310 0x7f223c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223b7fe700 1 -- 172.21.15.31:0/2878476888 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c0acb80 con 0x7f223c0aa870 2023-10-09T06:23:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223b7fe700 1 --2- 172.21.15.31:0/2878476888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f223c0aa870 0x7f223c0cd4b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f223c063e40 tx=0x7f2230009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9cb5d8225b1981 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223a7fc700 1 -- 172.21.15.31:0/2878476888 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000b6d0 con 0x7f223c0aa870 2023-10-09T06:23:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223a7fc700 1 -- 172.21.15.31:0/2878476888 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223000b830 con 0x7f223c0aa870 2023-10-09T06:23:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.054+0000 7f223a7fc700 1 -- 172.21.15.31:0/2878476888 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000bbf0 con 0x7f223c0aa870 2023-10-09T06:23:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.055+0000 7f2242183700 1 -- 172.21.15.31:0/2878476888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f223c0aa870 msgr2=0x7f223c0cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.055+0000 7f2242183700 1 --2- 172.21.15.31:0/2878476888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f223c0aa870 0x7f223c0cd4b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f223c063e40 tx=0x7f2230009250 comp rx=0 tx=0).stop 2023-10-09T06:23:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.055+0000 7f2242183700 1 -- 172.21.15.31:0/2878476888 shutdown_connections 2023-10-09T06:23:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.055+0000 7f2242183700 1 --2- 172.21.15.31:0/2878476888 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f223c0aac40 0x7f223c0ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.055+0000 7f2242183700 1 --2- 172.21.15.31:0/2878476888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f223c0aa870 0x7f223c0cd4b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.055+0000 7f2242183700 1 --2- 172.21.15.31:0/2878476888 >> v2:172.21.15.158:3300/0 conn(0x7f223c15a310 0x7f223c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.055+0000 7f2242183700 1 -- 172.21.15.31:0/2878476888 >> 172.21.15.31:0/2878476888 conn(0x7f223c0680f0 msgr2=0x7f223c0ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.055+0000 7f2242183700 1 -- 172.21.15.31:0/2878476888 shutdown_connections 2023-10-09T06:23:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.055+0000 7f2242183700 1 -- 172.21.15.31:0/2878476888 wait complete. 2023-10-09T06:23:14.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.056+0000 7f2242183700 1 Processor -- start 2023-10-09T06:23:14.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.056+0000 7f2242183700 1 -- start start 2023-10-09T06:23:14.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f2242183700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f223c0aa870 0x7f223c0b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:14.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f2242183700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f223c0aac40 0x7f223c157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:14.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f2242183700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f223c15a310 0x7f223c16a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:14.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f2242183700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0cb850 con 0x7f223c0aa870 2023-10-09T06:23:14.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f2242183700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c157a50 con 0x7f223c15a310 2023-10-09T06:23:14.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f2242183700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c15e040 con 0x7f223c0aac40 2023-10-09T06:23:14.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f223b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f223c0aa870 0x7f223c0b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:14.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f223b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f223c0aa870 0x7f223c0b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40822/0 (socket says 172.21.15.31:40822) 2023-10-09T06:23:14.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f223b7fe700 1 -- 172.21.15.31:0/2359997170 learned_addr learned my addr 172.21.15.31:0/2359997170 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:14.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f223affd700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f223c0aac40 0x7f223c157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:14.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f223bfff700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f223c15a310 0x7f223c16a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:14.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f223b7fe700 1 -- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f223c0aac40 msgr2=0x7f223c157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:14.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f223b7fe700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f223c0aac40 0x7f223c157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:14.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f223b7fe700 1 -- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f223c15a310 msgr2=0x7f223c16a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:14.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f223b7fe700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f223c15a310 0x7f223c16a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:14.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f223b7fe700 1 -- 172.21.15.31:0/2359997170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22300094f0 con 0x7f223c0aa870 2023-10-09T06:23:14.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f223bfff700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f223c15a310 0x7f223c16a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:23:14.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f223affd700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f223c0aac40 0x7f223c157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:23:14.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f223b7fe700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f223c0aa870 0x7f223c0b0290 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f223c068c40 tx=0x7f2230017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:14.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.057+0000 7f22237fe700 1 -- 172.21.15.31:0/2359997170 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000bbb0 con 0x7f223c0aa870 2023-10-09T06:23:14.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.058+0000 7f22237fe700 1 -- 172.21.15.31:0/2359997170 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2230011420 con 0x7f223c0aa870 2023-10-09T06:23:14.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.058+0000 7f2242183700 1 -- 172.21.15.31:0/2359997170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c16a600 con 0x7f223c0aa870 2023-10-09T06:23:14.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.058+0000 7f22237fe700 1 -- 172.21.15.31:0/2359997170 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22300117c0 con 0x7f223c0aa870 2023-10-09T06:23:14.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.058+0000 7f2242183700 1 -- 172.21.15.31:0/2359997170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c15d9f0 con 0x7f223c0aa870 2023-10-09T06:23:14.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.059+0000 7f2242183700 1 -- 172.21.15.31:0/2359997170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c04c3c0 con 0x7f223c0aa870 2023-10-09T06:23:14.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.059+0000 7f22237fe700 1 -- 172.21.15.31:0/2359997170 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2230011b30 con 0x7f223c0aa870 2023-10-09T06:23:14.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.059+0000 7f22237fe700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2228066f30 0x7f22280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:14.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.059+0000 7f22237fe700 1 -- 172.21.15.31:0/2359997170 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2230085dc0 con 0x7f223c0aa870 2023-10-09T06:23:14.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.059+0000 7f223affd700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2228066f30 0x7f22280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:14.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.060+0000 7f223affd700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2228066f30 0x7f22280693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f223c0ab540 tx=0x7f222c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:14.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.063+0000 7f22237fe700 1 -- 172.21.15.31:0/2359997170 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2230053030 con 0x7f223c0aa870 2023-10-09T06:23:14.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.301+0000 7f2242183700 1 -- 172.21.15.31:0/2359997170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f223c0ace60 con 0x7f223c0aa870 2023-10-09T06:23:14.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.302+0000 7f22237fe700 1 -- 172.21.15.31:0/2359997170 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2230015060 con 0x7f223c0aa870 2023-10-09T06:23:14.301 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:23:14.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.303+0000 7f2242183700 1 -- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2228066f30 msgr2=0x7f22280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:14.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.303+0000 7f2242183700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2228066f30 0x7f22280693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f223c0ab540 tx=0x7f222c008040 comp rx=0 tx=0).stop 2023-10-09T06:23:14.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.303+0000 7f2242183700 1 -- 172.21.15.31:0/2359997170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f223c0aa870 msgr2=0x7f223c0b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:14.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.303+0000 7f2242183700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f223c0aa870 0x7f223c0b0290 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f223c068c40 tx=0x7f2230017000 comp rx=0 tx=0).stop 2023-10-09T06:23:14.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.303+0000 7f2242183700 1 -- 172.21.15.31:0/2359997170 shutdown_connections 2023-10-09T06:23:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.303+0000 7f2242183700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2228066f30 0x7f22280693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.303+0000 7f2242183700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f223c15a310 0x7f223c16a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.303+0000 7f2242183700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f223c0aa870 0x7f223c0b0290 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.303+0000 7f2242183700 1 --2- 172.21.15.31:0/2359997170 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f223c0aac40 0x7f223c157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.303+0000 7f2242183700 1 -- 172.21.15.31:0/2359997170 >> 172.21.15.31:0/2359997170 conn(0x7f223c0680f0 msgr2=0x7f223c0ad940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.304+0000 7f2242183700 1 -- 172.21.15.31:0/2359997170 shutdown_connections 2023-10-09T06:23:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:14.304+0000 7f2242183700 1 -- 172.21.15.31:0/2359997170 wait complete. 2023-10-09T06:23:14.315 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:23:14.315 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:23:14.315 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-09T06:23:14.315 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T06:23:14.315 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T06:23:14.316 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:23:14.316 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:23:14.316 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:23:14.316 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:23:14.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:14.316 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-09T06:23:14.335 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:23:14.335 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:23:14.335 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:23:14.335 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:14.335 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:23:14.335 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:14.335 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:23:14.335 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:23:14.336 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-09T06:23:14.336 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:23:14.336 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:23:14.336 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-09T06:23:14.336 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:23:14.336 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-09T06:23:14.336 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:23:14.336 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:23:14.336 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:23:14.336 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42399sec preferred_lft 42399sec 2023-10-09T06:23:14.336 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-09T06:23:14.336 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:14.337 INFO:teuthology.orchestra.run.smithi158.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:23:14.337 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:23:14.337 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:23:14.337 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:14.337 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::c5:35ff:fec9:1844/64 scope link 2023-10-09T06:23:14.337 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:14.337 INFO:teuthology.orchestra.run.smithi158.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:23:14.337 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether e6:10:14:7c:a4:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:23:14.337 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::e410:14ff:fe7c:a4d7/64 scope link 2023-10-09T06:23:14.337 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:14.337 INFO:teuthology.orchestra.run.smithi158.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:23:14.337 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T06:23:14.338 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::44a9:f1ff:fe2b:babb/64 scope link 2023-10-09T06:23:14.338 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:23:14.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:14.338 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:23:14.403 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-09T06:23:14.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:14.404 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-09T06:23:14.461 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-09T06:23:14.462 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:23:14.462 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:23:14.462 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:23:14.462 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:23:14.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:14.462 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:23:14.462 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:23:14.462 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:23:14.463 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:23:14.463 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:23:14.463 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:23:14.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:14.569 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:23:14.584 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T06:23:14.584 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T06:23:14.584 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:23:14.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:14.584 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-09T06:23:14.649 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:23:14.649 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T06:23:14.704 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:23:14.704 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:23:14.704 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:23:14.758 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T06:23:14.758 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:23:14.758 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:23:14.837 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:23:14.837 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:23:14.856 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:23:14.856 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:23:14.856 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:23:14.857 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:23:14.857 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:23:14.857 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:23:14.857 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:23:14.857 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:23:14.878 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:23:14.878 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:23:14.878 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:23:14.879 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:23:14.879 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:23:14.879 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:23:14.879 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:23:14.879 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:23:14.880 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:23:14.880 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:23:14.880 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:23:14.881 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:23:14.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:23:14.881 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:23:14.945 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:23:15.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.066+0000 7f9d81579700 1 Processor -- start 2023-10-09T06:23:15.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.066+0000 7f9d81579700 1 -- start start 2023-10-09T06:23:15.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d81579700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d7c0abae0 0x7f9d7c0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:15.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d81579700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d7c0abeb0 0x7f9d7c0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:15.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d81579700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c0c9cb0 con 0x7f9d7c0c8400 2023-10-09T06:23:15.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d81579700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c0c90a0 con 0x7f9d7c0abeb0 2023-10-09T06:23:15.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d81579700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0c9380 con 0x7f9d7c0abae0 2023-10-09T06:23:15.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d7a7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d7c0abeb0 0x7f9d7c0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:15.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d7a7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d7c0abeb0 0x7f9d7c0c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40838/0 (socket says 172.21.15.31:40838) 2023-10-09T06:23:15.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d7a7fc700 1 -- 172.21.15.31:0/2135986225 learned_addr learned my addr 172.21.15.31:0/2135986225 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:15.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d7affd700 1 --2- 172.21.15.31:0/2135986225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d7c0abae0 0x7f9d7c0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:15.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d7a7fc700 1 -- 172.21.15.31:0/2135986225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d7c0abae0 msgr2=0x7f9d7c0c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:23:15.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d7a7fc700 1 --2- 172.21.15.31:0/2135986225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d7c0abae0 0x7f9d7c0c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:15.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d7a7fc700 1 -- 172.21.15.31:0/2135986225 >> v1:172.21.15.158:6789/0 conn(0x7f9d7c0c8400 legacy=0x7f9d7c0c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:15.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d7a7fc700 1 -- 172.21.15.31:0/2135986225 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c0c9660 con 0x7f9d7c0abeb0 2023-10-09T06:23:15.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.067+0000 7f9d7a7fc700 1 --2- 172.21.15.31:0/2135986225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d7c0abeb0 0x7f9d7c0c73f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400bc50 tx=0x7f9d6400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa3fc883da24cf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:15.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.068+0000 7f9d79ffb700 1 -- 172.21.15.31:0/2135986225 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400be60 con 0x7f9d7c0abeb0 2023-10-09T06:23:15.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.068+0000 7f9d79ffb700 1 -- 172.21.15.31:0/2135986225 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6400de00 con 0x7f9d7c0abeb0 2023-10-09T06:23:15.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.068+0000 7f9d79ffb700 1 -- 172.21.15.31:0/2135986225 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d640196b0 con 0x7f9d7c0abeb0 2023-10-09T06:23:15.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.068+0000 7f9d81579700 1 -- 172.21.15.31:0/2135986225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d7c0abeb0 msgr2=0x7f9d7c0c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:15.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.068+0000 7f9d81579700 1 --2- 172.21.15.31:0/2135986225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d7c0abeb0 0x7f9d7c0c73f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400bc50 tx=0x7f9d6400b4f0 comp rx=0 tx=0).stop 2023-10-09T06:23:15.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.068+0000 7f9d81579700 1 -- 172.21.15.31:0/2135986225 shutdown_connections 2023-10-09T06:23:15.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.068+0000 7f9d81579700 1 --2- 172.21.15.31:0/2135986225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d7c0abae0 0x7f9d7c0c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:15.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.068+0000 7f9d81579700 1 --2- 172.21.15.31:0/2135986225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d7c0abeb0 0x7f9d7c0c73f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:15.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.068+0000 7f9d81579700 1 -- 172.21.15.31:0/2135986225 >> 172.21.15.31:0/2135986225 conn(0x7f9d7c067660 msgr2=0x7f9d7c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:15.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.068+0000 7f9d81579700 1 -- 172.21.15.31:0/2135986225 shutdown_connections 2023-10-09T06:23:15.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.068+0000 7f9d81579700 1 -- 172.21.15.31:0/2135986225 wait complete. 2023-10-09T06:23:15.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.069+0000 7f9d81579700 1 Processor -- start 2023-10-09T06:23:15.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.070+0000 7f9d81579700 1 -- start start 2023-10-09T06:23:15.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.070+0000 7f9d81579700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d7c0abae0 0x7f9d7c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:15.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.070+0000 7f9d81579700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d7c0abeb0 0x7f9d7c153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:15.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.070+0000 7f9d81579700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d7c0c8400 0x7f9d7c0c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:15.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.070+0000 7f9d81579700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c154280 con 0x7f9d7c0c8400 2023-10-09T06:23:15.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.070+0000 7f9d81579700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c154560 con 0x7f9d7c0abae0 2023-10-09T06:23:15.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.070+0000 7f9d81579700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c154840 con 0x7f9d7c0abeb0 2023-10-09T06:23:15.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.070+0000 7f9d7b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d7c0c8400 0x7f9d7c0c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:15.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.070+0000 7f9d7b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d7c0c8400 0x7f9d7c0c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40846/0 (socket says 172.21.15.31:40846) 2023-10-09T06:23:15.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.070+0000 7f9d7b7fe700 1 -- 172.21.15.31:0/3030524424 learned_addr learned my addr 172.21.15.31:0/3030524424 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:23:15.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.070+0000 7f9d7affd700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d7c0abae0 0x7f9d7c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:15.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.071+0000 7f9d7a7fc700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d7c0abeb0 0x7f9d7c153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:15.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.071+0000 7f9d7b7fe700 1 -- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d7c0abeb0 msgr2=0x7f9d7c153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:15.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.071+0000 7f9d7b7fe700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d7c0abeb0 0x7f9d7c153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:15.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.071+0000 7f9d7b7fe700 1 -- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d7c0abae0 msgr2=0x7f9d7c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:15.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.071+0000 7f9d7b7fe700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d7c0abae0 0x7f9d7c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:15.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.071+0000 7f9d7b7fe700 1 -- 172.21.15.31:0/3030524424 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6400b790 con 0x7f9d7c0c8400 2023-10-09T06:23:15.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.071+0000 7f9d7b7fe700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d7c0c8400 0x7f9d7c0c5750 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00c560 tx=0x7f9d6c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:15.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.071+0000 7f9d72ffd700 1 -- 172.21.15.31:0/3030524424 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c011590 con 0x7f9d7c0c8400 2023-10-09T06:23:15.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.071+0000 7f9d72ffd700 1 -- 172.21.15.31:0/3030524424 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c0116f0 con 0x7f9d7c0c8400 2023-10-09T06:23:15.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.071+0000 7f9d81579700 1 -- 172.21.15.31:0/3030524424 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c154b20 con 0x7f9d7c0c8400 2023-10-09T06:23:15.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.071+0000 7f9d72ffd700 1 -- 172.21.15.31:0/3030524424 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c011ab0 con 0x7f9d7c0c8400 2023-10-09T06:23:15.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.071+0000 7f9d81579700 1 -- 172.21.15.31:0/3030524424 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c1522d0 con 0x7f9d7c0c8400 2023-10-09T06:23:15.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.072+0000 7f9d81579700 1 -- 172.21.15.31:0/3030524424 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c155040 con 0x7f9d7c0c8400 2023-10-09T06:23:15.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.072+0000 7f9d72ffd700 1 -- 172.21.15.31:0/3030524424 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d6c01b3b0 con 0x7f9d7c0c8400 2023-10-09T06:23:15.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.073+0000 7f9d72ffd700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9d5c066f30 0x7f9d5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:23:15.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.073+0000 7f9d72ffd700 1 -- 172.21.15.31:0/3030524424 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d6c0839b0 con 0x7f9d7c0c8400 2023-10-09T06:23:15.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.073+0000 7f9d7affd700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9d5c066f30 0x7f9d5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:23:15.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.073+0000 7f9d7affd700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9d5c066f30 0x7f9d5c0693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9d740075a0 tx=0x7f9d740097b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:23:15.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.077+0000 7f9d72ffd700 1 -- 172.21.15.31:0/3030524424 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d7c155040 con 0x7f9d7c0c8400 2023-10-09T06:23:15.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.313+0000 7f9d81579700 1 -- 172.21.15.31:0/3030524424 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d7c155040 con 0x7f9d7c0c8400 2023-10-09T06:23:15.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.313+0000 7f9d72ffd700 1 -- 172.21.15.31:0/3030524424 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f9d7c155040 con 0x7f9d7c0c8400 2023-10-09T06:23:15.338 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:23:15.339 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/4067940888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":4067940888},{"type":"v1","addr":"172.21.15.158:6835","nonce":4067940888}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/169747435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":169747435},{"type":"v1","addr":"172.21.15.158:6837","nonce":169747435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3769789034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3769789034},{"type":"v1","addr":"172.21.15.31:6834","nonce":3769789034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:23:06.370069+0000","modified":"2023-10-09T06:23:09.985664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/2596093897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2596093897},{"type":"v1","addr":"172.21.15.31:6835","nonce":2596093897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T06:23:15.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.315+0000 7f9d81579700 1 -- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9d5c066f30 msgr2=0x7f9d5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:15.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.315+0000 7f9d81579700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9d5c066f30 0x7f9d5c0693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9d740075a0 tx=0x7f9d740097b0 comp rx=0 tx=0).stop 2023-10-09T06:23:15.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.315+0000 7f9d81579700 1 -- 172.21.15.31:0/3030524424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d7c0c8400 msgr2=0x7f9d7c0c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:23:15.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.315+0000 7f9d81579700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d7c0c8400 0x7f9d7c0c5750 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00c560 tx=0x7f9d6c007ef0 comp rx=0 tx=0).stop 2023-10-09T06:23:15.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.315+0000 7f9d81579700 1 -- 172.21.15.31:0/3030524424 shutdown_connections 2023-10-09T06:23:15.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.315+0000 7f9d81579700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9d5c066f30 0x7f9d5c0693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.315+0000 7f9d81579700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d7c0c8400 0x7f9d7c0c5750 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.315+0000 7f9d81579700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d7c0abae0 0x7f9d7c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.315+0000 7f9d81579700 1 --2- 172.21.15.31:0/3030524424 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d7c0abeb0 0x7f9d7c153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:23:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.315+0000 7f9d81579700 1 -- 172.21.15.31:0/3030524424 >> 172.21.15.31:0/3030524424 conn(0x7f9d7c067660 msgr2=0x7f9d7c0c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:23:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.315+0000 7f9d81579700 1 -- 172.21.15.31:0/3030524424 shutdown_connections 2023-10-09T06:23:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:23:15.315+0000 7f9d81579700 1 -- 172.21.15.31:0/3030524424 wait complete. 2023-10-09T06:23:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 34 2023-10-09T06:23:15.341 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-09T06:23:15.484 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":5643,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5023152349999993,"mdsmap_epoch":34,"osdmap_epoch":65,"osdmap_epoch_barrier":65,"uptime":20.450451790999999} 2023-10-09T06:23:15.484 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 5643, "mdsmap_epoch": 34, "osdmap_epoch": 65, "osdmap_epoch_barrier": 65, "rank_uptime": 8.502315235, "state": "up:active", "uptime": 20.450451791, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:23:15.485 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T06:23:15.619 INFO:teuthology.orchestra.run.smithi031.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T06:23:15.620 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T06:23:15.620 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-09T06:23:15.746 INFO:teuthology.orchestra.run.smithi031.stdout:{"mon_tick_interval":"5"} 2023-10-09T06:23:15.747 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-09T06:23:15.747 INFO:tasks.cephfs.test_full:pool capacity 557082176, 531MB should be enough to fill it 2023-10-09T06:23:15.747 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T06:23:15.747 DEBUG:teuthology.orchestra.run.smithi031:> import time 2023-10-09T06:23:15.747 DEBUG:teuthology.orchestra.run.smithi031:> import datetime 2023-10-09T06:23:15.747 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2023-10-09T06:23:15.747 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-10-09T06:23:15.747 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:23:15.747 DEBUG:teuthology.orchestra.run.smithi031:> # Write some buffered data through before going full, all should be well 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> print("writing some data through which we expect to succeed") 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> bytes = 0 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(f) 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> # buffered IO, the error should always only appear from fsync and not 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> # from write 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> full = False 2023-10-09T06:23:15.748 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:23:15.749 DEBUG:teuthology.orchestra.run.smithi031:> for n in range(0, int(531 * 0.9)): 2023-10-09T06:23:15.749 DEBUG:teuthology.orchestra.run.smithi031:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-09T06:23:15.749 DEBUG:teuthology.orchestra.run.smithi031:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-09T06:23:15.749 DEBUG:teuthology.orchestra.run.smithi031:> print("done writing {0} bytes".format(bytes)) 2023-10-09T06:23:15.749 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:23:15.749 DEBUG:teuthology.orchestra.run.smithi031:> # OK, now we should sneak in under the full condition 2023-10-09T06:23:15.749 DEBUG:teuthology.orchestra.run.smithi031:> # due to the time it takes the OSDs to report to the 2023-10-09T06:23:15.749 DEBUG:teuthology.orchestra.run.smithi031:> # mons, and get a successful fsync on our full-making data 2023-10-09T06:23:15.749 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(f) 2023-10-09T06:23:15.749 DEBUG:teuthology.orchestra.run.smithi031:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-09T06:23:15.749 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:23:15.749 DEBUG:teuthology.orchestra.run.smithi031:> # buffered write, add more dirty data to the buffer 2023-10-09T06:23:15.749 DEBUG:teuthology.orchestra.run.smithi031:> print("starting buffered write") 2023-10-09T06:23:15.750 DEBUG:teuthology.orchestra.run.smithi031:> try: 2023-10-09T06:23:15.750 DEBUG:teuthology.orchestra.run.smithi031:> for n in range(0, int(531 * 0.2)): 2023-10-09T06:23:15.750 DEBUG:teuthology.orchestra.run.smithi031:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-09T06:23:15.750 DEBUG:teuthology.orchestra.run.smithi031:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-09T06:23:15.750 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(15.0) 2023-10-09T06:23:15.750 DEBUG:teuthology.orchestra.run.smithi031:> except OSError: 2023-10-09T06:23:15.750 DEBUG:teuthology.orchestra.run.smithi031:> pass; 2023-10-09T06:23:15.750 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:23:15.750 DEBUG:teuthology.orchestra.run.smithi031:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-09T06:23:15.750 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:23:15.750 DEBUG:teuthology.orchestra.run.smithi031:> # Wait long enough for a background flush that should fail 2023-10-09T06:23:15.750 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(30) 2023-10-09T06:23:15.751 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:23:15.751 DEBUG:teuthology.orchestra.run.smithi031:> if False: 2023-10-09T06:23:15.751 DEBUG:teuthology.orchestra.run.smithi031:> # ...and check that the failed background flush is reflected in fclose 2023-10-09T06:23:15.751 DEBUG:teuthology.orchestra.run.smithi031:> try: 2023-10-09T06:23:15.751 DEBUG:teuthology.orchestra.run.smithi031:> os.close(f) 2023-10-09T06:23:15.751 DEBUG:teuthology.orchestra.run.smithi031:> except OSError: 2023-10-09T06:23:15.751 DEBUG:teuthology.orchestra.run.smithi031:> print("close() returned an error as expected") 2023-10-09T06:23:15.751 DEBUG:teuthology.orchestra.run.smithi031:> else: 2023-10-09T06:23:15.751 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("close() failed to raise error") 2023-10-09T06:23:15.751 DEBUG:teuthology.orchestra.run.smithi031:> else: 2023-10-09T06:23:15.751 DEBUG:teuthology.orchestra.run.smithi031:> # The kernel cephfs client does not raise errors on fclose 2023-10-09T06:23:15.752 DEBUG:teuthology.orchestra.run.smithi031:> os.close(f) 2023-10-09T06:23:15.752 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:23:15.752 DEBUG:teuthology.orchestra.run.smithi031:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-09T06:23:15.752 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-10-09T06:23:20.104 INFO:teuthology.orchestra.run.smithi031.stdout:writing some data through which we expect to succeed 2023-10-09T06:23:20.104 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-09T06:23:20.104 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-09T06:23:20.104 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-09T06:23:20.104 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-09T06:23:20.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-09T06:23:20.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-09T06:23:20.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-09T06:23:20.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-09T06:23:20.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-09T06:23:20.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-09T06:23:20.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-09T06:23:20.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-09T06:23:20.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-09T06:23:20.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-09T06:23:20.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-09T06:23:20.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-09T06:23:20.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-09T06:23:20.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-09T06:23:20.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-09T06:23:20.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-09T06:23:20.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-09T06:23:20.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-09T06:23:20.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-09T06:23:20.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-09T06:23:20.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-09T06:23:20.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-09T06:23:20.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-09T06:23:20.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-09T06:23:20.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-09T06:23:20.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-10-09T06:23:20.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-10-09T06:23:20.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-10-09T06:23:20.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-10-09T06:23:20.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-10-09T06:23:20.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-10-09T06:23:20.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-10-09T06:23:20.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-10-09T06:23:20.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-10-09T06:23:20.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-10-09T06:23:20.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-10-09T06:23:20.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-10-09T06:23:20.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-10-09T06:23:20.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-10-09T06:23:20.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-10-09T06:23:20.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-10-09T06:23:20.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-10-09T06:23:20.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-10-09T06:23:20.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-10-09T06:23:20.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-10-09T06:23:20.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-10-09T06:23:20.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-10-09T06:23:20.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-10-09T06:23:20.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-10-09T06:23:20.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-10-09T06:23:20.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-10-09T06:23:20.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-10-09T06:23:20.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-10-09T06:23:20.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-10-09T06:23:20.110 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-10-09T06:23:20.110 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-10-09T06:23:20.110 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-10-09T06:23:20.110 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-10-09T06:23:20.110 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-10-09T06:23:20.110 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-10-09T06:23:20.110 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-10-09T06:23:20.110 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-10-09T06:23:20.110 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-10-09T06:23:20.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-10-09T06:23:20.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-10-09T06:23:20.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-10-09T06:23:20.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-10-09T06:23:20.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-10-09T06:23:20.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-10-09T06:23:20.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-10-09T06:23:20.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-10-09T06:23:20.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-10-09T06:23:20.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-10-09T06:23:20.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-10-09T06:23:20.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-10-09T06:23:20.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-10-09T06:23:20.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-10-09T06:23:20.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-10-09T06:23:20.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-10-09T06:23:20.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-10-09T06:23:20.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-10-09T06:23:20.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-10-09T06:23:20.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-10-09T06:23:20.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-10-09T06:23:20.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-10-09T06:23:20.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-10-09T06:23:20.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-10-09T06:23:20.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-10-09T06:23:20.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-10-09T06:23:20.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-10-09T06:23:20.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-10-09T06:23:20.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-10-09T06:23:20.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-10-09T06:23:20.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-10-09T06:23:20.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-10-09T06:23:20.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-10-09T06:23:20.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-10-09T06:23:20.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-10-09T06:23:20.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-10-09T06:23:20.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-10-09T06:23:20.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-10-09T06:23:20.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-10-09T06:23:20.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-10-09T06:23:20.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-10-09T06:23:20.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-10-09T06:23:20.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-10-09T06:23:20.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-10-09T06:23:20.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-10-09T06:23:20.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-10-09T06:23:20.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-10-09T06:23:20.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-10-09T06:23:20.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-10-09T06:23:20.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-10-09T06:23:20.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-10-09T06:23:20.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-10-09T06:23:20.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-10-09T06:23:20.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-10-09T06:23:20.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-10-09T06:23:20.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-10-09T06:23:20.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-10-09T06:23:20.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-10-09T06:23:20.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-10-09T06:23:20.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-10-09T06:23:20.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-10-09T06:23:20.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-10-09T06:23:20.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-10-09T06:23:20.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-10-09T06:23:20.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-10-09T06:23:20.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-10-09T06:23:20.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-10-09T06:23:20.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-10-09T06:23:20.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-10-09T06:23:20.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-10-09T06:23:20.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-10-09T06:23:20.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-10-09T06:23:20.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-10-09T06:23:20.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-10-09T06:23:20.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-10-09T06:23:20.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-10-09T06:23:20.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-10-09T06:23:20.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-10-09T06:23:20.118 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-10-09T06:23:20.118 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-10-09T06:23:20.118 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-10-09T06:23:20.118 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-10-09T06:23:20.118 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-10-09T06:23:20.118 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-10-09T06:23:20.118 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-10-09T06:23:20.118 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-10-09T06:23:20.118 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-10-09T06:23:20.118 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-10-09T06:23:20.158 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-10-09T06:23:20.158 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-10-09T06:23:20.159 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-10-09T06:23:20.159 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-10-09T06:23:20.159 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-10-09T06:23:20.159 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-10-09T06:23:20.159 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-10-09T06:23:20.160 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-10-09T06:23:20.160 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-10-09T06:23:20.160 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-10-09T06:23:20.160 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-10-09T06:23:20.161 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-10-09T06:23:20.161 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-10-09T06:23:20.161 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-10-09T06:23:20.161 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-10-09T06:23:20.161 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-10-09T06:23:20.161 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-10-09T06:23:20.161 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-10-09T06:23:20.161 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-10-09T06:23:20.161 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-10-09T06:23:20.161 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-10-09T06:23:20.162 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-10-09T06:23:20.162 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-10-09T06:23:20.162 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-10-09T06:23:20.162 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-10-09T06:23:20.162 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-10-09T06:23:20.162 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-10-09T06:23:20.162 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-10-09T06:23:20.162 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-10-09T06:23:20.162 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-10-09T06:23:20.162 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-10-09T06:23:20.162 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-10-09T06:23:20.162 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-10-09T06:23:20.163 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-10-09T06:23:20.163 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-10-09T06:23:20.163 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-10-09T06:23:20.163 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-10-09T06:23:20.163 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-10-09T06:23:20.163 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-10-09T06:23:20.163 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-10-09T06:23:20.163 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-10-09T06:23:20.163 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-10-09T06:23:20.163 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-10-09T06:23:20.163 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-10-09T06:23:20.163 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-10-09T06:23:20.163 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-10-09T06:23:20.164 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-10-09T06:23:20.164 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-10-09T06:23:20.164 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-10-09T06:23:20.164 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-10-09T06:23:20.164 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-10-09T06:23:20.164 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-10-09T06:23:20.164 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-10-09T06:23:20.164 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-10-09T06:23:20.164 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-10-09T06:23:20.164 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-10-09T06:23:20.164 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-10-09T06:23:20.165 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-10-09T06:23:20.165 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-10-09T06:23:20.165 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-10-09T06:23:20.165 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-10-09T06:23:20.165 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-10-09T06:23:20.165 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-10-09T06:23:20.165 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-10-09T06:23:20.165 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-10-09T06:23:20.165 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-10-09T06:23:20.165 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-10-09T06:23:20.165 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-10-09T06:23:20.165 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-10-09T06:23:20.166 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-10-09T06:23:20.166 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-10-09T06:23:20.166 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-10-09T06:23:20.166 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-10-09T06:23:20.166 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-10-09T06:23:20.166 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-10-09T06:23:20.166 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-10-09T06:23:20.166 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-10-09T06:23:20.166 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-10-09T06:23:20.166 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-10-09T06:23:20.166 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-10-09T06:23:20.167 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-10-09T06:23:20.167 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-10-09T06:23:20.167 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-10-09T06:23:20.167 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-10-09T06:23:20.167 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-10-09T06:23:20.167 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-10-09T06:23:20.167 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-10-09T06:23:20.167 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-10-09T06:23:20.167 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-10-09T06:23:20.167 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-10-09T06:23:20.167 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-10-09T06:23:20.168 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-10-09T06:23:20.168 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-10-09T06:23:20.168 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-10-09T06:23:20.168 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-10-09T06:23:20.168 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-10-09T06:23:20.168 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-10-09T06:23:20.168 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-10-09T06:23:20.168 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-10-09T06:23:20.168 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-10-09T06:23:20.168 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-10-09T06:23:20.168 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-10-09T06:23:20.168 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-10-09T06:23:20.169 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-10-09T06:23:20.169 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-10-09T06:23:20.169 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-10-09T06:23:20.169 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-10-09T06:23:20.169 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-10-09T06:23:20.169 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-10-09T06:23:20.169 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-10-09T06:23:20.169 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-10-09T06:23:20.169 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-10-09T06:23:20.169 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-10-09T06:23:20.169 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-10-09T06:23:20.169 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-10-09T06:23:20.170 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-10-09T06:23:20.170 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-10-09T06:23:20.170 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-10-09T06:23:20.170 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-10-09T06:23:20.170 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-10-09T06:23:20.170 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-10-09T06:23:20.170 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-10-09T06:23:20.170 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-10-09T06:23:20.170 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-10-09T06:23:20.170 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-10-09T06:23:20.170 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-10-09T06:23:20.171 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-10-09T06:23:20.171 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-10-09T06:23:20.171 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-10-09T06:23:20.171 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-10-09T06:23:20.171 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-10-09T06:23:20.171 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-10-09T06:23:20.171 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-10-09T06:23:20.171 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-10-09T06:23:20.171 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-10-09T06:23:20.171 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-10-09T06:23:20.171 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-10-09T06:23:20.172 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-10-09T06:23:20.172 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-10-09T06:23:20.172 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-10-09T06:23:20.172 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-10-09T06:23:20.172 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-10-09T06:23:20.172 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-10-09T06:23:20.172 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-10-09T06:23:20.172 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-10-09T06:23:20.172 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-10-09T06:23:20.172 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-10-09T06:23:20.172 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-10-09T06:23:20.173 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-10-09T06:23:20.173 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-10-09T06:23:20.173 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-10-09T06:23:20.173 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-10-09T06:23:20.173 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-10-09T06:23:20.173 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-10-09T06:23:20.173 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-10-09T06:23:20.208 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-10-09T06:23:20.209 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-10-09T06:23:20.209 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-10-09T06:23:20.209 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-10-09T06:23:20.209 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-10-09T06:23:20.209 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-10-09T06:23:20.209 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-10-09T06:23:20.209 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-10-09T06:23:20.209 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-10-09T06:23:20.209 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-10-09T06:23:20.209 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-10-09T06:23:20.209 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-10-09T06:23:20.209 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-10-09T06:23:20.210 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-10-09T06:23:20.210 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-10-09T06:23:20.210 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-10-09T06:23:20.210 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-10-09T06:23:20.210 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-10-09T06:23:20.210 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-10-09T06:23:20.210 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-10-09T06:23:20.210 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-10-09T06:23:20.210 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-10-09T06:23:20.210 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-10-09T06:23:20.210 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-10-09T06:23:20.211 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-10-09T06:23:20.211 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-10-09T06:23:20.211 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-10-09T06:23:20.211 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-10-09T06:23:20.211 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-10-09T06:23:20.211 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-10-09T06:23:20.211 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-10-09T06:23:20.211 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-10-09T06:23:20.211 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-10-09T06:23:20.211 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-10-09T06:23:20.211 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-10-09T06:23:20.211 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-10-09T06:23:20.212 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-10-09T06:23:20.212 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-10-09T06:23:20.212 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-10-09T06:23:20.212 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-10-09T06:23:20.212 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-10-09T06:23:20.212 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-10-09T06:23:20.212 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-10-09T06:23:20.212 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-10-09T06:23:20.212 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-10-09T06:23:20.212 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-10-09T06:23:20.212 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-10-09T06:23:20.213 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-10-09T06:23:20.213 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-10-09T06:23:20.213 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-10-09T06:23:20.213 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-10-09T06:23:20.213 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-10-09T06:23:20.213 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-10-09T06:23:20.213 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-10-09T06:23:20.213 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-10-09T06:23:20.213 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-10-09T06:23:20.213 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-10-09T06:23:20.213 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-10-09T06:23:20.213 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-10-09T06:23:20.214 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-10-09T06:23:20.214 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-10-09T06:23:20.214 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-10-09T06:23:20.214 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-10-09T06:23:20.214 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-10-09T06:23:20.214 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-10-09T06:23:20.214 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-10-09T06:23:20.214 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-10-09T06:23:20.214 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-10-09T06:23:20.214 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-10-09T06:23:20.214 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-10-09T06:23:20.214 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-10-09T06:23:20.215 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-10-09T06:23:20.215 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-10-09T06:23:20.215 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-10-09T06:23:20.215 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-10-09T06:23:20.215 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-10-09T06:23:20.215 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-10-09T06:23:20.215 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-10-09T06:23:20.215 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-10-09T06:23:20.215 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-10-09T06:23:20.215 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-10-09T06:23:20.215 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-10-09T06:23:20.215 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-10-09T06:23:20.216 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-10-09T06:23:20.216 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-10-09T06:23:20.216 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-10-09T06:23:20.216 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-10-09T06:23:20.216 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-10-09T06:23:20.216 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-10-09T06:23:20.216 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-10-09T06:23:20.216 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-10-09T06:23:20.216 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-10-09T06:23:20.216 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-10-09T06:23:20.216 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-10-09T06:23:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-10-09T06:23:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-10-09T06:23:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-10-09T06:23:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-10-09T06:23:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-10-09T06:23:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-10-09T06:23:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-10-09T06:23:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-10-09T06:23:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-10-09T06:23:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-10-09T06:23:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-10-09T06:23:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-10-09T06:23:20.218 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-10-09T06:23:20.218 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-10-09T06:23:20.218 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-10-09T06:23:20.218 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-10-09T06:23:20.218 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-10-09T06:23:20.218 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-10-09T06:23:20.218 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-10-09T06:23:20.218 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-10-09T06:23:20.218 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-10-09T06:23:20.218 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-10-09T06:23:20.218 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-10-09T06:23:20.219 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-10-09T06:23:20.219 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-10-09T06:23:20.219 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-10-09T06:23:20.219 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-10-09T06:23:20.219 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-10-09T06:23:20.219 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-10-09T06:23:20.219 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-10-09T06:23:20.219 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-10-09T06:23:20.219 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-10-09T06:23:20.219 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-10-09T06:23:20.219 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-10-09T06:23:20.219 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-10-09T06:23:20.220 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-10-09T06:23:20.220 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-10-09T06:23:20.220 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-10-09T06:23:20.220 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-10-09T06:23:20.220 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-10-09T06:23:20.220 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-10-09T06:23:20.220 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-10-09T06:23:20.220 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-10-09T06:23:20.220 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-10-09T06:23:20.220 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-10-09T06:23:20.220 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-10-09T06:23:20.220 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-10-09T06:23:20.220 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-10-09T06:23:20.221 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-10-09T06:23:20.221 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-10-09T06:23:20.221 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-10-09T06:23:20.221 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-10-09T06:23:20.221 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-10-09T06:23:20.221 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-10-09T06:23:20.221 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-10-09T06:23:20.221 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-10-09T06:23:20.221 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-10-09T06:23:20.221 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-10-09T06:23:20.221 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-10-09T06:23:20.222 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-10-09T06:23:20.222 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-10-09T06:23:22.931 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:23:22.930+0000 7fc5eaab7700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-10-09T06:23:25.885 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:23:25.888 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:23:31.684 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:23:31.683+0000 7fc5eaab7700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-09T06:23:55.953 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:23:55.956 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:24:26.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:24:26.019 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:24:35.675 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-10-09T06:24:35.676 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-10-09T06:24:35.676 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-10-09T06:24:35.676 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-10-09T06:24:35.676 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-10-09T06:24:35.676 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-10-09T06:24:35.676 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-10-09T06:24:35.676 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-10-09T06:24:35.676 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-10-09T06:24:35.676 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-10-09T06:24:35.677 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-10-09T06:24:35.677 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-10-09T06:24:35.677 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-10-09T06:24:35.677 INFO:teuthology.orchestra.run.smithi031.stdout:done writing 500695040 bytes 2023-10-09T06:24:35.677 INFO:teuthology.orchestra.run.smithi031.stdout:successfully fsync'ed prior to getting full state reported 2023-10-09T06:24:35.677 INFO:teuthology.orchestra.run.smithi031.stdout:starting buffered write 2023-10-09T06:24:35.677 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:24:35.677 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:24:35.677 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:24:35.677 INFO:teuthology.orchestra.run.smithi031.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-09T06:24:35.719 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:24:35.720 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:24:35.763 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:24:35.808 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:24:35.808 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:24:35.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:24:35.809 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:24:35.856 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:24:35.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:35.856 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:24:35.872 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T06:24:35.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:24:35.873 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T06:24:35.918 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:24:35.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:35.919 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T06:24:35.934 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:24:36.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.090+0000 7f4e469d6700 1 Processor -- start 2023-10-09T06:24:36.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.090+0000 7f4e469d6700 1 -- start start 2023-10-09T06:24:36.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.091+0000 7f4e469d6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e40156f50 0x7f4e400ac950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.091+0000 7f4e469d6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4006db70 con 0x7f4e400ccad0 2023-10-09T06:24:36.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.091+0000 7f4e469d6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e400c8670 con 0x7f4e400ccea0 2023-10-09T06:24:36.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.091+0000 7f4e469d6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4006d520 con 0x7f4e40156f50 2023-10-09T06:24:36.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.091+0000 7f4e3ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4e400ccad0 0x7f4e4006e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55266/0 (socket says 172.21.15.31:55266) 2023-10-09T06:24:36.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.091+0000 7f4e3ffff700 1 -- 172.21.15.31:0/2339193308 learned_addr learned my addr 172.21.15.31:0/2339193308 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:36.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.091+0000 7f4e44f73700 1 --2- 172.21.15.31:0/2339193308 >> v2:172.21.15.31:3300/0 conn(0x7f4e40156f50 0x7f4e400ac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.092+0000 7f4e3effd700 1 -- 172.21.15.31:0/2339193308 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922079605 0 0) 0x7f4e4006db70 con 0x7f4e400ccad0 2023-10-09T06:24:36.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.092+0000 7f4e3effd700 1 -- 172.21.15.31:0/2339193308 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e28003570 con 0x7f4e400ccad0 2023-10-09T06:24:36.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.092+0000 7f4e3effd700 1 -- 172.21.15.31:0/2339193308 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218588776 0 0) 0x7f4e400c8670 con 0x7f4e400ccea0 2023-10-09T06:24:36.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.092+0000 7f4e44f73700 1 -- 172.21.15.31:0/2339193308 >> v1:172.21.15.158:6789/0 conn(0x7f4e400ccea0 legacy=0x7f4e40156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.092+0000 7f4e44f73700 1 -- 172.21.15.31:0/2339193308 >> v1:172.21.15.31:6789/0 conn(0x7f4e400ccad0 legacy=0x7f4e4006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.092+0000 7f4e44f73700 1 -- 172.21.15.31:0/2339193308 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4006d800 con 0x7f4e40156f50 2023-10-09T06:24:36.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.092+0000 7f4e44f73700 1 --2- 172.21.15.31:0/2339193308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e40156f50 0x7f4e400ac950 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800d0d0 tx=0x7f4e3800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44834436fa05bb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:36.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.092+0000 7f4e3effd700 1 -- 172.21.15.31:0/2339193308 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e38010070 con 0x7f4e40156f50 2023-10-09T06:24:36.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.092+0000 7f4e3effd700 1 -- 172.21.15.31:0/2339193308 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3800b0d0 con 0x7f4e40156f50 2023-10-09T06:24:36.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.092+0000 7f4e3effd700 1 -- 172.21.15.31:0/2339193308 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e340013f0 con 0x7f4e40156f50 2023-10-09T06:24:36.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.093+0000 7f4e469d6700 1 -- 172.21.15.31:0/2339193308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e40156f50 msgr2=0x7f4e400ac950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.093+0000 7f4e469d6700 1 --2- 172.21.15.31:0/2339193308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e40156f50 0x7f4e400ac950 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800d0d0 tx=0x7f4e3800b990 comp rx=0 tx=0).stop 2023-10-09T06:24:36.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.093+0000 7f4e469d6700 1 -- 172.21.15.31:0/2339193308 shutdown_connections 2023-10-09T06:24:36.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.093+0000 7f4e469d6700 1 --2- 172.21.15.31:0/2339193308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e40156f50 0x7f4e400ac950 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.093+0000 7f4e469d6700 1 -- 172.21.15.31:0/2339193308 >> 172.21.15.31:0/2339193308 conn(0x7f4e40070700 msgr2=0x7f4e40070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:36.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.094+0000 7f4e469d6700 1 -- 172.21.15.31:0/2339193308 shutdown_connections 2023-10-09T06:24:36.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.094+0000 7f4e469d6700 1 -- 172.21.15.31:0/2339193308 wait complete. 2023-10-09T06:24:36.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.095+0000 7f4e469d6700 1 Processor -- start 2023-10-09T06:24:36.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.096+0000 7f4e469d6700 1 -- start start 2023-10-09T06:24:36.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.097+0000 7f4e469d6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e400ccad0 0x7f4e400c1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.097+0000 7f4e469d6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e400ccea0 0x7f4e400af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.097+0000 7f4e469d6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e40156f50 0x7f4e400afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.097+0000 7f4e469d6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400c26f0 con 0x7f4e400ccea0 2023-10-09T06:24:36.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.097+0000 7f4e469d6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400c1840 con 0x7f4e400ccad0 2023-10-09T06:24:36.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.097+0000 7f4e469d6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400c1ae0 con 0x7f4e40156f50 2023-10-09T06:24:36.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.098+0000 7f4e3f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e400ccea0 0x7f4e400af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.098+0000 7f4e44f73700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e40156f50 0x7f4e400afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.098+0000 7f4e3f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e400ccea0 0x7f4e400af6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41484/0 (socket says 172.21.15.31:41484) 2023-10-09T06:24:36.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.098+0000 7f4e44f73700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e40156f50 0x7f4e400afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:38472/0 (socket says 172.21.15.31:38472) 2023-10-09T06:24:36.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.098+0000 7f4e3f7fe700 1 -- 172.21.15.31:0/3986045443 learned_addr learned my addr 172.21.15.31:0/3986045443 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:36.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.098+0000 7f4e3f7fe700 1 -- 172.21.15.31:0/3986045443 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e40156f50 msgr2=0x7f4e400afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.098+0000 7f4e3f7fe700 1 --2- 172.21.15.31:0/3986045443 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e40156f50 0x7f4e400afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.098+0000 7f4e3f7fe700 1 -- 172.21.15.31:0/3986045443 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e400ccad0 msgr2=0x7f4e400c1300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:24:36.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.098+0000 7f4e3f7fe700 1 --2- 172.21.15.31:0/3986045443 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e400ccad0 0x7f4e400c1300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.098+0000 7f4e3f7fe700 1 -- 172.21.15.31:0/3986045443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3800bc30 con 0x7f4e400ccea0 2023-10-09T06:24:36.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.099+0000 7f4e3f7fe700 1 --2- 172.21.15.31:0/3986045443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e400ccea0 0x7f4e400af6c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000c7c0 tx=0x7f4e30007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:36.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.099+0000 7f4e27fff700 1 -- 172.21.15.31:0/3986045443 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30012630 con 0x7f4e400ccea0 2023-10-09T06:24:36.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.099+0000 7f4e27fff700 1 -- 172.21.15.31:0/3986045443 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e300127b0 con 0x7f4e400ccea0 2023-10-09T06:24:36.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.099+0000 7f4e27fff700 1 -- 172.21.15.31:0/3986045443 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30012b70 con 0x7f4e400ccea0 2023-10-09T06:24:36.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.099+0000 7f4e469d6700 1 -- 172.21.15.31:0/3986045443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e400c1dc0 con 0x7f4e400ccea0 2023-10-09T06:24:36.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.100+0000 7f4e469d6700 1 -- 172.21.15.31:0/3986045443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e400c2380 con 0x7f4e400ccea0 2023-10-09T06:24:36.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.101+0000 7f4e469d6700 1 -- 172.21.15.31:0/3986045443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e40069fd0 con 0x7f4e400ccea0 2023-10-09T06:24:36.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.101+0000 7f4e27fff700 1 -- 172.21.15.31:0/3986045443 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e3001b400 con 0x7f4e400ccea0 2023-10-09T06:24:36.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.102+0000 7f4e27fff700 1 --2- 172.21.15.31:0/3986045443 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e2c066f30 0x7f4e2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.102+0000 7f4e27fff700 1 -- 172.21.15.31:0/3986045443 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e30084160 con 0x7f4e400ccea0 2023-10-09T06:24:36.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.102+0000 7f4e27fff700 1 -- 172.21.15.31:0/3986045443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7f4e2c06ea50 con 0x7f4e400ccea0 2023-10-09T06:24:36.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.102+0000 7f4e3ffff700 1 --2- 172.21.15.31:0/3986045443 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e2c066f30 0x7f4e2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.103+0000 7f4e3ffff700 1 --2- 172.21.15.31:0/3986045443 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e2c066f30 0x7f4e2c0693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4e340011e0 tx=0x7f4e34000fe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.110+0000 7f4e27fff700 1 -- 172.21.15.31:0/3986045443 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e300513d0 con 0x7f4e400ccea0 2023-10-09T06:24:36.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.361+0000 7f4e469d6700 1 -- 172.21.15.31:0/3986045443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e4004c3c0 con 0x7f4e400ccea0 2023-10-09T06:24:36.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.362+0000 7f4e27fff700 1 -- 172.21.15.31:0/3986045443 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f4e300549f0 con 0x7f4e400ccea0 2023-10-09T06:24:36.362 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:36.363 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/4067940888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":4067940888},{"type":"v1","addr":"172.21.15.158:6835","nonce":4067940888}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/169747435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":169747435},{"type":"v1","addr":"172.21.15.158:6837","nonce":169747435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3769789034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3769789034},{"type":"v1","addr":"172.21.15.31:6834","nonce":3769789034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:23:06.370069+0000","modified":"2023-10-09T06:23:09.985664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/2596093897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2596093897},{"type":"v1","addr":"172.21.15.31:6835","nonce":2596093897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T06:24:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.364+0000 7f4e469d6700 1 -- 172.21.15.31:0/3986045443 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e2c066f30 msgr2=0x7f4e2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.364+0000 7f4e469d6700 1 --2- 172.21.15.31:0/3986045443 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e2c066f30 0x7f4e2c0693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4e340011e0 tx=0x7f4e34000fe0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.364+0000 7f4e469d6700 1 -- 172.21.15.31:0/3986045443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e400ccea0 msgr2=0x7f4e400af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.364+0000 7f4e469d6700 1 --2- 172.21.15.31:0/3986045443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e400ccea0 0x7f4e400af6c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000c7c0 tx=0x7f4e30007e20 comp rx=0 tx=0).stop 2023-10-09T06:24:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.364+0000 7f4e469d6700 1 -- 172.21.15.31:0/3986045443 shutdown_connections 2023-10-09T06:24:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.364+0000 7f4e469d6700 1 --2- 172.21.15.31:0/3986045443 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e2c066f30 0x7f4e2c0693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.364+0000 7f4e469d6700 1 --2- 172.21.15.31:0/3986045443 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e40156f50 0x7f4e400afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.364+0000 7f4e469d6700 1 --2- 172.21.15.31:0/3986045443 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e400ccad0 0x7f4e400c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.364+0000 7f4e469d6700 1 --2- 172.21.15.31:0/3986045443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e400ccea0 0x7f4e400af6c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.364+0000 7f4e469d6700 1 -- 172.21.15.31:0/3986045443 >> 172.21.15.31:0/3986045443 conn(0x7f4e40070700 msgr2=0x7f4e400c8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.364+0000 7f4e469d6700 1 -- 172.21.15.31:0/3986045443 shutdown_connections 2023-10-09T06:24:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.364+0000 7f4e469d6700 1 -- 172.21.15.31:0/3986045443 wait complete. 2023-10-09T06:24:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 34 2023-10-09T06:24:36.377 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:24:36.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.495+0000 7f5a0359e700 1 Processor -- start 2023-10-09T06:24:36.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.495+0000 7f5a0359e700 1 -- start start 2023-10-09T06:24:36.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.496+0000 7f5a0359e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a040cd6e0 0x7f5a040cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.496+0000 7f5a0359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5a0415cbd0 0x7f5a0415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.496+0000 7f5a0359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a040cb7c0 con 0x7f5a040cdab0 2023-10-09T06:24:36.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.496+0000 7f5a0359e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0415e850 con 0x7f5a0415cbd0 2023-10-09T06:24:36.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.496+0000 7f5a0359e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040cd030 con 0x7f5a040cd6e0 2023-10-09T06:24:36.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.496+0000 7f5a01d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5a040cdab0 0x7f5a0415d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55268/0 (socket says 172.21.15.31:55268) 2023-10-09T06:24:36.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.496+0000 7f5a01d9b700 1 -- 172.21.15.31:0/3943982976 learned_addr learned my addr 172.21.15.31:0/3943982976 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:36.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.496+0000 7f5a02d9d700 1 --2- 172.21.15.31:0/3943982976 >> v2:172.21.15.158:3300/0 conn(0x7f5a0415cbd0 0x7f5a0415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.496+0000 7f5a0259c700 1 --2- 172.21.15.31:0/3943982976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a040cd6e0 0x7f5a040cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.496+0000 7f5a0159a700 1 -- 172.21.15.31:0/3943982976 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120363961 0 0) 0x7f5a040cb7c0 con 0x7f5a040cdab0 2023-10-09T06:24:36.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.497+0000 7f5a0159a700 1 -- 172.21.15.31:0/3943982976 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59f0003570 con 0x7f5a040cdab0 2023-10-09T06:24:36.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.497+0000 7f5a02d9d700 1 -- 172.21.15.31:0/3943982976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a040cd6e0 msgr2=0x7f5a040cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:36.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.497+0000 7f5a02d9d700 1 --2- 172.21.15.31:0/3943982976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a040cd6e0 0x7f5a040cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.497+0000 7f5a02d9d700 1 -- 172.21.15.31:0/3943982976 >> v1:172.21.15.31:6789/0 conn(0x7f5a040cdab0 legacy=0x7f5a0415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.497+0000 7f5a02d9d700 1 -- 172.21.15.31:0/3943982976 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0415e290 con 0x7f5a0415cbd0 2023-10-09T06:24:36.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.497+0000 7f5a0259c700 1 --2- 172.21.15.31:0/3943982976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a040cd6e0 0x7f5a040cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:24:36.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.497+0000 7f5a02d9d700 1 --2- 172.21.15.31:0/3943982976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a0415cbd0 0x7f5a0415d020 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f59fc009e60 tx=0x7f59fc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62719eee992da9aa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:36.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.497+0000 7f5a0159a700 1 -- 172.21.15.31:0/3943982976 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc00e070 con 0x7f5a0415cbd0 2023-10-09T06:24:36.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.497+0000 7f5a0159a700 1 -- 172.21.15.31:0/3943982976 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc00bab0 con 0x7f5a0415cbd0 2023-10-09T06:24:36.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.497+0000 7f5a0159a700 1 -- 172.21.15.31:0/3943982976 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc00be70 con 0x7f5a0415cbd0 2023-10-09T06:24:36.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.497+0000 7f5a0359e700 1 -- 172.21.15.31:0/3943982976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a0415cbd0 msgr2=0x7f5a0415d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.497+0000 7f5a0359e700 1 --2- 172.21.15.31:0/3943982976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a0415cbd0 0x7f5a0415d020 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f59fc009e60 tx=0x7f59fc009780 comp rx=0 tx=0).stop 2023-10-09T06:24:36.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.498+0000 7f5a0359e700 1 -- 172.21.15.31:0/3943982976 shutdown_connections 2023-10-09T06:24:36.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.498+0000 7f5a0359e700 1 --2- 172.21.15.31:0/3943982976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a0415cbd0 0x7f5a0415d020 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.498+0000 7f5a0359e700 1 --2- 172.21.15.31:0/3943982976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a040cd6e0 0x7f5a040cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.498+0000 7f5a0359e700 1 -- 172.21.15.31:0/3943982976 >> 172.21.15.31:0/3943982976 conn(0x7f5a04067660 msgr2=0x7f5a04067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:36.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.498+0000 7f5a0359e700 1 -- 172.21.15.31:0/3943982976 shutdown_connections 2023-10-09T06:24:36.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.498+0000 7f5a0359e700 1 -- 172.21.15.31:0/3943982976 wait complete. 2023-10-09T06:24:36.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.499+0000 7f5a0359e700 1 Processor -- start 2023-10-09T06:24:36.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.499+0000 7f5a0359e700 1 -- start start 2023-10-09T06:24:36.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.499+0000 7f5a0359e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a040cd6e0 0x7f5a040b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.499+0000 7f5a0359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a040cdab0 0x7f5a040c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.499+0000 7f5a0359e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a0415cbd0 0x7f5a040c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.499+0000 7f5a0359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040b1d60 con 0x7f5a040cdab0 2023-10-09T06:24:36.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.499+0000 7f5a0359e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040b5be0 con 0x7f5a0415cbd0 2023-10-09T06:24:36.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.499+0000 7f5a0359e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040b5ec0 con 0x7f5a040cd6e0 2023-10-09T06:24:36.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a01d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a040cdab0 0x7f5a040c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a01d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a040cdab0 0x7f5a040c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41488/0 (socket says 172.21.15.31:41488) 2023-10-09T06:24:36.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a01d9b700 1 -- 172.21.15.31:0/526009240 learned_addr learned my addr 172.21.15.31:0/526009240 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:36.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a02d9d700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a0415cbd0 0x7f5a040c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a0259c700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a040cd6e0 0x7f5a040b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a01d9b700 1 -- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a040cd6e0 msgr2=0x7f5a040b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a01d9b700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a040cd6e0 0x7f5a040b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a01d9b700 1 -- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a0415cbd0 msgr2=0x7f5a040c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a01d9b700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a0415cbd0 0x7f5a040c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a01d9b700 1 -- 172.21.15.31:0/526009240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f4009420 con 0x7f5a040cdab0 2023-10-09T06:24:36.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a02d9d700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a0415cbd0 0x7f5a040c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:24:36.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a01d9b700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a040cdab0 0x7f5a040c7d20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00c7c0 tx=0x7f59ec007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:36.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f59fa7fc700 1 -- 172.21.15.31:0/526009240 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec005cd0 con 0x7f5a040cdab0 2023-10-09T06:24:36.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f59fa7fc700 1 -- 172.21.15.31:0/526009240 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ec005e30 con 0x7f5a040cdab0 2023-10-09T06:24:36.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a0359e700 1 -- 172.21.15.31:0/526009240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59fc009a20 con 0x7f5a040cdab0 2023-10-09T06:24:36.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f59fa7fc700 1 -- 172.21.15.31:0/526009240 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec007320 con 0x7f5a040cdab0 2023-10-09T06:24:36.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.500+0000 7f5a0359e700 1 -- 172.21.15.31:0/526009240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a040b19f0 con 0x7f5a040cdab0 2023-10-09T06:24:36.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.501+0000 7f5a0359e700 1 -- 172.21.15.31:0/526009240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a040b1ed0 con 0x7f5a040cdab0 2023-10-09T06:24:36.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.502+0000 7f59fa7fc700 1 -- 172.21.15.31:0/526009240 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59ec01b3b0 con 0x7f5a040cdab0 2023-10-09T06:24:36.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.502+0000 7f59fa7fc700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f59e4066f30 0x7f59e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.502+0000 7f59fa7fc700 1 -- 172.21.15.31:0/526009240 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59ec083ba0 con 0x7f5a040cdab0 2023-10-09T06:24:36.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.502+0000 7f59fa7fc700 1 -- 172.21.15.31:0/526009240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7f59e406ea50 con 0x7f5a040cdab0 2023-10-09T06:24:36.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.502+0000 7f5a0259c700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f59e4066f30 0x7f59e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.503+0000 7f5a0259c700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f59e4066f30 0x7f59e40693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009ea0 tx=0x7f59f40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:36.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.506+0000 7f59fa7fc700 1 -- 172.21.15.31:0/526009240 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59ec017070 con 0x7f5a040cdab0 2023-10-09T06:24:36.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.702+0000 7f5a0359e700 1 -- 172.21.15.31:0/526009240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a0415e570 con 0x7f5a040cdab0 2023-10-09T06:24:36.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.703+0000 7f59fa7fc700 1 -- 172.21.15.31:0/526009240 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+15408 (secure 0 0 0) 0x7f59ec050e10 con 0x7f5a040cdab0 2023-10-09T06:24:36.704 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:36.704 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":68,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:23:24.987691+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:23:04.509059+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T06:23:05.346720+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:24:36.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.705+0000 7f5a0359e700 1 -- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f59e4066f30 msgr2=0x7f59e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.705+0000 7f5a0359e700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f59e4066f30 0x7f59e40693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009ea0 tx=0x7f59f40091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.705+0000 7f5a0359e700 1 -- 172.21.15.31:0/526009240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a040cdab0 msgr2=0x7f5a040c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.705+0000 7f5a0359e700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a040cdab0 0x7f5a040c7d20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00c7c0 tx=0x7f59ec007e00 comp rx=0 tx=0).stop 2023-10-09T06:24:36.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.705+0000 7f5a0359e700 1 -- 172.21.15.31:0/526009240 shutdown_connections 2023-10-09T06:24:36.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.705+0000 7f5a0359e700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f59e4066f30 0x7f59e40693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.705+0000 7f5a0359e700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a040cd6e0 0x7f5a040b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.705+0000 7f5a0359e700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a0415cbd0 0x7f5a040c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.705+0000 7f5a0359e700 1 --2- 172.21.15.31:0/526009240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a040cdab0 0x7f5a040c7d20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.705+0000 7f5a0359e700 1 -- 172.21.15.31:0/526009240 >> 172.21.15.31:0/526009240 conn(0x7f5a04067660 msgr2=0x7f5a04156cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:36.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.705+0000 7f5a0359e700 1 -- 172.21.15.31:0/526009240 shutdown_connections 2023-10-09T06:24:36.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.705+0000 7f5a0359e700 1 -- 172.21.15.31:0/526009240 wait complete. 2023-10-09T06:24:36.718 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:23:04.509059+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:23:05.346720+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:24:36.719 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:24:36.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.840+0000 7f58a984d700 1 Processor -- start 2023-10-09T06:24:36.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.840+0000 7f58a984d700 1 -- start start 2023-10-09T06:24:36.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.841+0000 7f58a984d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58a40cd300 0x7f58a415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.841+0000 7f58a984d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f58a40b6760 0x7f58a40d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.841+0000 7f58a984d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a41513f0 con 0x7f58a40d12a0 2023-10-09T06:24:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.841+0000 7f58a984d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a415e7a0 con 0x7f58a40cd300 2023-10-09T06:24:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.841+0000 7f58a984d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a40d1700 con 0x7f58a40b6760 2023-10-09T06:24:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.841+0000 7f58a2ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58a40cd300 0x7f58a415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.841+0000 7f58a2ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58a40cd300 0x7f58a415afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41492/0 (socket says 172.21.15.31:41492) 2023-10-09T06:24:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.841+0000 7f58a2ffd700 1 -- 172.21.15.31:0/2739809258 learned_addr learned my addr 172.21.15.31:0/2739809258 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.842+0000 7f58a2ffd700 1 -- 172.21.15.31:0/2739809258 >> v2:172.21.15.158:3300/0 conn(0x7f58a40b6760 msgr2=0x7f58a40d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.842+0000 7f58a27fc700 1 --2- 172.21.15.31:0/2739809258 >> v2:172.21.15.158:3300/0 conn(0x7f58a40b6760 0x7f58a40d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.842+0000 7f58a2ffd700 1 --2- 172.21.15.31:0/2739809258 >> v2:172.21.15.158:3300/0 conn(0x7f58a40b6760 0x7f58a40d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.842+0000 7f58a2ffd700 1 -- 172.21.15.31:0/2739809258 >> v1:172.21.15.158:6789/0 conn(0x7f58a40d12a0 legacy=0x7f58a406a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.842+0000 7f58a2ffd700 1 -- 172.21.15.31:0/2739809258 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a415db20 con 0x7f58a40cd300 2023-10-09T06:24:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.842+0000 7f58a27fc700 1 --2- 172.21.15.31:0/2739809258 >> v2:172.21.15.158:3300/0 conn(0x7f58a40b6760 0x7f58a40d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.842+0000 7f58a2ffd700 1 --2- 172.21.15.31:0/2739809258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a40cd300 0x7f58a415afb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f58a40b3fe0 tx=0x7f589c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe895b6ddd9a6ef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.842+0000 7f58a1ffb700 1 -- 172.21.15.31:0/2739809258 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c00e070 con 0x7f58a40cd300 2023-10-09T06:24:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.842+0000 7f58a1ffb700 1 -- 172.21.15.31:0/2739809258 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c00ba10 con 0x7f58a40cd300 2023-10-09T06:24:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.842+0000 7f58a1ffb700 1 -- 172.21.15.31:0/2739809258 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c0092e0 con 0x7f58a40cd300 2023-10-09T06:24:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.843+0000 7f58a984d700 1 -- 172.21.15.31:0/2739809258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a40cd300 msgr2=0x7f58a415afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.843+0000 7f58a984d700 1 --2- 172.21.15.31:0/2739809258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a40cd300 0x7f58a415afb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f58a40b3fe0 tx=0x7f589c009840 comp rx=0 tx=0).stop 2023-10-09T06:24:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.843+0000 7f58a984d700 1 -- 172.21.15.31:0/2739809258 shutdown_connections 2023-10-09T06:24:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.843+0000 7f58a984d700 1 --2- 172.21.15.31:0/2739809258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a40cd300 0x7f58a415afb0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.843+0000 7f58a984d700 1 --2- 172.21.15.31:0/2739809258 >> v2:172.21.15.158:3300/0 conn(0x7f58a40b6760 0x7f58a40d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.843+0000 7f58a984d700 1 -- 172.21.15.31:0/2739809258 >> 172.21.15.31:0/2739809258 conn(0x7f58a4068d90 msgr2=0x7f58a4069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:36.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.843+0000 7f58a984d700 1 -- 172.21.15.31:0/2739809258 shutdown_connections 2023-10-09T06:24:36.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.843+0000 7f58a984d700 1 -- 172.21.15.31:0/2739809258 wait complete. 2023-10-09T06:24:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.844+0000 7f58a984d700 1 Processor -- start 2023-10-09T06:24:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.844+0000 7f58a984d700 1 -- start start 2023-10-09T06:24:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a984d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58a40b6760 0x7f58a416a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a984d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58a40cd300 0x7f58a416d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a984d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a40d12a0 0x7f58a416d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a984d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4169f60 con 0x7f58a40d12a0 2023-10-09T06:24:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a984d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a416b490 con 0x7f58a40cd300 2023-10-09T06:24:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a984d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a416abc0 con 0x7f58a40b6760 2023-10-09T06:24:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a40d12a0 0x7f58a416d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a40d12a0 0x7f58a416d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41506/0 (socket says 172.21.15.31:41506) 2023-10-09T06:24:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a37fe700 1 -- 172.21.15.31:0/3632628649 learned_addr learned my addr 172.21.15.31:0/3632628649 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a27fc700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58a40cd300 0x7f58a416d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a2ffd700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58a40b6760 0x7f58a416a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a37fe700 1 -- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58a40b6760 msgr2=0x7f58a416a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a37fe700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58a40b6760 0x7f58a416a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a37fe700 1 -- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58a40cd300 msgr2=0x7f58a416d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a37fe700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58a40cd300 0x7f58a416d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a37fe700 1 -- 172.21.15.31:0/3632628649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c009ae0 con 0x7f58a40d12a0 2023-10-09T06:24:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a37fe700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a40d12a0 0x7f58a416d720 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f589400c5e0 tx=0x7f5894007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f589affd700 1 -- 172.21.15.31:0/3632628649 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894011590 con 0x7f58a40d12a0 2023-10-09T06:24:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f589affd700 1 -- 172.21.15.31:0/3632628649 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5894011710 con 0x7f58a40d12a0 2023-10-09T06:24:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a984d700 1 -- 172.21.15.31:0/3632628649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a416ddc0 con 0x7f58a40d12a0 2023-10-09T06:24:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f589affd700 1 -- 172.21.15.31:0/3632628649 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894011ad0 con 0x7f58a40d12a0 2023-10-09T06:24:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.845+0000 7f58a984d700 1 -- 172.21.15.31:0/3632628649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a416b120 con 0x7f58a40d12a0 2023-10-09T06:24:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.846+0000 7f58a984d700 1 -- 172.21.15.31:0/3632628649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a404c3c0 con 0x7f58a40d12a0 2023-10-09T06:24:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.847+0000 7f589affd700 1 -- 172.21.15.31:0/3632628649 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f589401c460 con 0x7f58a40d12a0 2023-10-09T06:24:36.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.847+0000 7f589affd700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5884066f30 0x7f58840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:36.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.847+0000 7f589affd700 1 -- 172.21.15.31:0/3632628649 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5894084050 con 0x7f58a40d12a0 2023-10-09T06:24:36.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.847+0000 7f58a2ffd700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5884066f30 0x7f58840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:36.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.847+0000 7f589affd700 1 -- 172.21.15.31:0/3632628649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7f588406ea50 con 0x7f58a40d12a0 2023-10-09T06:24:36.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.848+0000 7f58a2ffd700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5884066f30 0x7f58840693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f589c009880 tx=0x7f589c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:36.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:36.851+0000 7f589affd700 1 -- 172.21.15.31:0/3632628649 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58940512c0 con 0x7f58a40d12a0 2023-10-09T06:24:37.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.043+0000 7f58a984d700 1 -- 172.21.15.31:0/3632628649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58a40b4010 con 0x7f58a40d12a0 2023-10-09T06:24:37.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.043+0000 7f589affd700 1 -- 172.21.15.31:0/3632628649 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58940548e0 con 0x7f58a40d12a0 2023-10-09T06:24:37.044 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:24:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.045+0000 7f58a984d700 1 -- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5884066f30 msgr2=0x7f58840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.045+0000 7f58a984d700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5884066f30 0x7f58840693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f589c009880 tx=0x7f589c017000 comp rx=0 tx=0).stop 2023-10-09T06:24:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.045+0000 7f58a984d700 1 -- 172.21.15.31:0/3632628649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a40d12a0 msgr2=0x7f58a416d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.045+0000 7f58a984d700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a40d12a0 0x7f58a416d720 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f589400c5e0 tx=0x7f5894007f60 comp rx=0 tx=0).stop 2023-10-09T06:24:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.045+0000 7f58a984d700 1 -- 172.21.15.31:0/3632628649 shutdown_connections 2023-10-09T06:24:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.045+0000 7f58a984d700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5884066f30 0x7f58840693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.045+0000 7f58a984d700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f58a40b6760 0x7f58a416a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.045+0000 7f58a984d700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58a40d12a0 0x7f58a416d720 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.045+0000 7f58a984d700 1 --2- 172.21.15.31:0/3632628649 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58a40cd300 0x7f58a416d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.045+0000 7f58a984d700 1 -- 172.21.15.31:0/3632628649 >> 172.21.15.31:0/3632628649 conn(0x7f58a4068d90 msgr2=0x7f58a40b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.045+0000 7f58a984d700 1 -- 172.21.15.31:0/3632628649 shutdown_connections 2023-10-09T06:24:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.045+0000 7f58a984d700 1 -- 172.21.15.31:0/3632628649 wait complete. 2023-10-09T06:24:37.058 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:24:37.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.179+0000 7f526d360700 1 Processor -- start 2023-10-09T06:24:37.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.179+0000 7f526d360700 1 -- start start 2023-10-09T06:24:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f526d360700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5268159ec0 0x7f52680af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f526d360700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f526806acb0 0x7f52680afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f526d360700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52680b0790 con 0x7f526815a290 2023-10-09T06:24:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f526d360700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680ce1f0 con 0x7f5268159ec0 2023-10-09T06:24:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f526d360700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680b0b20 con 0x7f526806acb0 2023-10-09T06:24:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f5266ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5268159ec0 0x7f52680af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f5266ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5268159ec0 0x7f52680af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41510/0 (socket says 172.21.15.31:41510) 2023-10-09T06:24:37.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f5266ffd700 1 -- 172.21.15.31:0/4166233844 learned_addr learned my addr 172.21.15.31:0/4166233844 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:37.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f52677fe700 1 --2- 172.21.15.31:0/4166233844 >> v2:172.21.15.158:3300/0 conn(0x7f526806acb0 0x7f52680afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f5266ffd700 1 -- 172.21.15.31:0/4166233844 >> v2:172.21.15.158:3300/0 conn(0x7f526806acb0 msgr2=0x7f52680afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:37.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f5266ffd700 1 --2- 172.21.15.31:0/4166233844 >> v2:172.21.15.158:3300/0 conn(0x7f526806acb0 0x7f52680afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f5266ffd700 1 -- 172.21.15.31:0/4166233844 >> v1:172.21.15.158:6789/0 conn(0x7f526815a290 legacy=0x7f526806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:37.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f5266ffd700 1 -- 172.21.15.31:0/4166233844 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680b04b0 con 0x7f5268159ec0 2023-10-09T06:24:37.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f5266ffd700 1 --2- 172.21.15.31:0/4166233844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5268159ec0 0x7f52680af940 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f52680711f0 tx=0x7f5258009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00b51324dd563ee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:37.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f5265ffb700 1 -- 172.21.15.31:0/4166233844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525800e070 con 0x7f5268159ec0 2023-10-09T06:24:37.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f5265ffb700 1 -- 172.21.15.31:0/4166233844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525800ba10 con 0x7f5268159ec0 2023-10-09T06:24:37.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.180+0000 7f5265ffb700 1 -- 172.21.15.31:0/4166233844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580092e0 con 0x7f5268159ec0 2023-10-09T06:24:37.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.181+0000 7f526d360700 1 -- 172.21.15.31:0/4166233844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5268159ec0 msgr2=0x7f52680af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.181+0000 7f526d360700 1 --2- 172.21.15.31:0/4166233844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5268159ec0 0x7f52680af940 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f52680711f0 tx=0x7f5258009840 comp rx=0 tx=0).stop 2023-10-09T06:24:37.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.181+0000 7f526d360700 1 -- 172.21.15.31:0/4166233844 shutdown_connections 2023-10-09T06:24:37.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.181+0000 7f526d360700 1 --2- 172.21.15.31:0/4166233844 >> v2:172.21.15.158:3300/0 conn(0x7f526806acb0 0x7f52680afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.181+0000 7f526d360700 1 --2- 172.21.15.31:0/4166233844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5268159ec0 0x7f52680af940 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.181+0000 7f526d360700 1 -- 172.21.15.31:0/4166233844 >> 172.21.15.31:0/4166233844 conn(0x7f52680d1880 msgr2=0x7f52680cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:37.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.181+0000 7f526d360700 1 -- 172.21.15.31:0/4166233844 shutdown_connections 2023-10-09T06:24:37.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.181+0000 7f526d360700 1 -- 172.21.15.31:0/4166233844 wait complete. 2023-10-09T06:24:37.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.182+0000 7f526d360700 1 Processor -- start 2023-10-09T06:24:37.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.182+0000 7f526d360700 1 -- start start 2023-10-09T06:24:37.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f526d360700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f526806acb0 0x7f526815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f526d360700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5268159ec0 0x7f526816b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f526d360700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f526815a290 0x7f526815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f526d360700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526815b050 con 0x7f526815a290 2023-10-09T06:24:37.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f526d360700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526815b2a0 con 0x7f526806acb0 2023-10-09T06:24:37.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f526d360700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526815b580 con 0x7f5268159ec0 2023-10-09T06:24:37.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f52677fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f526815a290 0x7f526815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f52677fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f526815a290 0x7f526815cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41518/0 (socket says 172.21.15.31:41518) 2023-10-09T06:24:37.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f52677fe700 1 -- 172.21.15.31:0/469922018 learned_addr learned my addr 172.21.15.31:0/469922018 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:37.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f5266ffd700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f526806acb0 0x7f526815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f52667fc700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5268159ec0 0x7f526816b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f52677fe700 1 -- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5268159ec0 msgr2=0x7f526816b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f52677fe700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5268159ec0 0x7f526816b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f52677fe700 1 -- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f526806acb0 msgr2=0x7f526815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f52677fe700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f526806acb0 0x7f526815a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f52677fe700 1 -- 172.21.15.31:0/469922018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5258009ae0 con 0x7f526815a290 2023-10-09T06:24:37.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.183+0000 7f52667fc700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5268159ec0 0x7f526816b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:37.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.184+0000 7f52677fe700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f526815a290 0x7f526815cfe0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f526000d860 tx=0x7f5260008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:37.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.184+0000 7f525effd700 1 -- 172.21.15.31:0/469922018 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52600125f0 con 0x7f526815a290 2023-10-09T06:24:37.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.184+0000 7f525effd700 1 -- 172.21.15.31:0/469922018 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5260012770 con 0x7f526815a290 2023-10-09T06:24:37.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.184+0000 7f526d360700 1 -- 172.21.15.31:0/469922018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526815b860 con 0x7f526815a290 2023-10-09T06:24:37.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.184+0000 7f525effd700 1 -- 172.21.15.31:0/469922018 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260012b30 con 0x7f526815a290 2023-10-09T06:24:37.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.184+0000 7f526d360700 1 -- 172.21.15.31:0/469922018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526815be20 con 0x7f526815a290 2023-10-09T06:24:37.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.185+0000 7f526d360700 1 -- 172.21.15.31:0/469922018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526804c3c0 con 0x7f526815a290 2023-10-09T06:24:37.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.185+0000 7f525effd700 1 -- 172.21.15.31:0/469922018 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f526001e460 con 0x7f526815a290 2023-10-09T06:24:37.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.186+0000 7f525effd700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5248066f30 0x7f52480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.186+0000 7f525effd700 1 -- 172.21.15.31:0/469922018 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5260084ad0 con 0x7f526815a290 2023-10-09T06:24:37.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.186+0000 7f525effd700 1 -- 172.21.15.31:0/469922018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7f524806ea50 con 0x7f526815a290 2023-10-09T06:24:37.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.186+0000 7f5266ffd700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5248066f30 0x7f52480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.186+0000 7f5266ffd700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5248066f30 0x7f52480693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5258009880 tx=0x7f5258017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:37.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.190+0000 7f525effd700 1 -- 172.21.15.31:0/469922018 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5260051d40 con 0x7f526815a290 2023-10-09T06:24:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.382+0000 7f526d360700 1 -- 172.21.15.31:0/469922018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52680ceab0 con 0x7f526815a290 2023-10-09T06:24:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.382+0000 7f525effd700 1 -- 172.21.15.31:0/469922018 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5260055360 con 0x7f526815a290 2023-10-09T06:24:37.383 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:24:37.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.384+0000 7f526d360700 1 -- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5248066f30 msgr2=0x7f52480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.384+0000 7f526d360700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5248066f30 0x7f52480693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5258009880 tx=0x7f5258017000 comp rx=0 tx=0).stop 2023-10-09T06:24:37.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.384+0000 7f526d360700 1 -- 172.21.15.31:0/469922018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f526815a290 msgr2=0x7f526815cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.384+0000 7f526d360700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f526815a290 0x7f526815cfe0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f526000d860 tx=0x7f5260008040 comp rx=0 tx=0).stop 2023-10-09T06:24:37.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.384+0000 7f526d360700 1 -- 172.21.15.31:0/469922018 shutdown_connections 2023-10-09T06:24:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.384+0000 7f526d360700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5248066f30 0x7f52480693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.384+0000 7f526d360700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f526815a290 0x7f526815cfe0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.384+0000 7f526d360700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f526806acb0 0x7f526815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.384+0000 7f526d360700 1 --2- 172.21.15.31:0/469922018 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5268159ec0 0x7f526816b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.384+0000 7f526d360700 1 -- 172.21.15.31:0/469922018 >> 172.21.15.31:0/469922018 conn(0x7f52680d1880 msgr2=0x7f52680cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.384+0000 7f526d360700 1 -- 172.21.15.31:0/469922018 shutdown_connections 2023-10-09T06:24:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.384+0000 7f526d360700 1 -- 172.21.15.31:0/469922018 wait complete. 2023-10-09T06:24:37.397 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:24:37.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.517+0000 7fba37647700 1 Processor -- start 2023-10-09T06:24:37.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.517+0000 7fba37647700 1 -- start start 2023-10-09T06:24:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.518+0000 7fba37647700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba300697c0 0x7fba3015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.518+0000 7fba37647700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fba3015a230 0x7fba300af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.518+0000 7fba37647700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3015ea90 con 0x7fba30159e60 2023-10-09T06:24:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.518+0000 7fba37647700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba300d1cf0 con 0x7fba3015a230 2023-10-09T06:24:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.518+0000 7fba37647700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba300b3100 con 0x7fba300697c0 2023-10-09T06:24:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.518+0000 7fba35be4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fba3015a230 0x7fba300af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.518+0000 7fba353e3700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fba30159e60 0x7fba300690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55276/0 (socket says 172.21.15.31:55276) 2023-10-09T06:24:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.518+0000 7fba353e3700 1 -- 172.21.15.31:0/3390886369 learned_addr learned my addr 172.21.15.31:0/3390886369 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.519+0000 7fba34be2700 1 --2- 172.21.15.31:0/3390886369 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba300697c0 0x7fba3015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.519+0000 7fba2ffff700 1 -- 172.21.15.31:0/3390886369 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142558717 0 0) 0x7fba3015ea90 con 0x7fba30159e60 2023-10-09T06:24:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.519+0000 7fba2ffff700 1 -- 172.21.15.31:0/3390886369 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba18003570 con 0x7fba30159e60 2023-10-09T06:24:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.519+0000 7fba35be4700 1 -- 172.21.15.31:0/3390886369 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba300697c0 msgr2=0x7fba3015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.519+0000 7fba35be4700 1 --2- 172.21.15.31:0/3390886369 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba300697c0 0x7fba3015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.519+0000 7fba35be4700 1 -- 172.21.15.31:0/3390886369 >> v1:172.21.15.31:6789/0 conn(0x7fba30159e60 legacy=0x7fba300690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.519+0000 7fba35be4700 1 -- 172.21.15.31:0/3390886369 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba300d10e0 con 0x7fba3015a230 2023-10-09T06:24:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.519+0000 7fba35be4700 1 --2- 172.21.15.31:0/3390886369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba3015a230 0x7fba300af730 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fba200098e0 tx=0x7fba200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c646434744c02364 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.519+0000 7fba2ffff700 1 -- 172.21.15.31:0/3390886369 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20011630 con 0x7fba3015a230 2023-10-09T06:24:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.519+0000 7fba2ffff700 1 -- 172.21.15.31:0/3390886369 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba20011790 con 0x7fba3015a230 2023-10-09T06:24:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.519+0000 7fba2ffff700 1 -- 172.21.15.31:0/3390886369 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20011b30 con 0x7fba3015a230 2023-10-09T06:24:37.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.520+0000 7fba37647700 1 -- 172.21.15.31:0/3390886369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba3015a230 msgr2=0x7fba300af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.520+0000 7fba37647700 1 --2- 172.21.15.31:0/3390886369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba3015a230 0x7fba300af730 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fba200098e0 tx=0x7fba200091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.520+0000 7fba37647700 1 -- 172.21.15.31:0/3390886369 shutdown_connections 2023-10-09T06:24:37.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.520+0000 7fba37647700 1 --2- 172.21.15.31:0/3390886369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba3015a230 0x7fba300af730 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.520+0000 7fba37647700 1 --2- 172.21.15.31:0/3390886369 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba300697c0 0x7fba3015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.520+0000 7fba37647700 1 -- 172.21.15.31:0/3390886369 >> 172.21.15.31:0/3390886369 conn(0x7fba30070700 msgr2=0x7fba30070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:37.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.520+0000 7fba37647700 1 -- 172.21.15.31:0/3390886369 shutdown_connections 2023-10-09T06:24:37.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.520+0000 7fba37647700 1 -- 172.21.15.31:0/3390886369 wait complete. 2023-10-09T06:24:37.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.521+0000 7fba37647700 1 Processor -- start 2023-10-09T06:24:37.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.521+0000 7fba37647700 1 -- start start 2023-10-09T06:24:37.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba37647700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba300697c0 0x7fba30158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba37647700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba30159e60 0x7fba3015c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba37647700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba3015a230 0x7fba3015c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba37647700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba300c4920 con 0x7fba30159e60 2023-10-09T06:24:37.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba37647700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3016dce0 con 0x7fba3015a230 2023-10-09T06:24:37.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba37647700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3016dfc0 con 0x7fba300697c0 2023-10-09T06:24:37.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba34be2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba30159e60 0x7fba3015c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba34be2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba30159e60 0x7fba3015c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41536/0 (socket says 172.21.15.31:41536) 2023-10-09T06:24:37.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba34be2700 1 -- 172.21.15.31:0/2904622060 learned_addr learned my addr 172.21.15.31:0/2904622060 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:37.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba35be4700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba3015a230 0x7fba3015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba34be2700 1 -- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba300697c0 msgr2=0x7fba30158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba353e3700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba300697c0 0x7fba30158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba34be2700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba300697c0 0x7fba30158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba34be2700 1 -- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba3015a230 msgr2=0x7fba3015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba34be2700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba3015a230 0x7fba3015c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba34be2700 1 -- 172.21.15.31:0/2904622060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba20009420 con 0x7fba30159e60 2023-10-09T06:24:37.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba353e3700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba300697c0 0x7fba30158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:37.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba35be4700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba3015a230 0x7fba3015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:37.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.522+0000 7fba34be2700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba30159e60 0x7fba3015c050 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fba2400e930 tx=0x7fba240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.523+0000 7fba2d7fa700 1 -- 172.21.15.31:0/2904622060 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2400eed0 con 0x7fba30159e60 2023-10-09T06:24:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.523+0000 7fba2d7fa700 1 -- 172.21.15.31:0/2904622060 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2400c850 con 0x7fba30159e60 2023-10-09T06:24:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.523+0000 7fba2d7fa700 1 -- 172.21.15.31:0/2904622060 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2400cbf0 con 0x7fba30159e60 2023-10-09T06:24:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.523+0000 7fba37647700 1 -- 172.21.15.31:0/2904622060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3016e2a0 con 0x7fba30159e60 2023-10-09T06:24:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.523+0000 7fba37647700 1 -- 172.21.15.31:0/2904622060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba30159500 con 0x7fba30159e60 2023-10-09T06:24:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.524+0000 7fba37647700 1 -- 172.21.15.31:0/2904622060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba300c4a90 con 0x7fba30159e60 2023-10-09T06:24:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.524+0000 7fba2d7fa700 1 -- 172.21.15.31:0/2904622060 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba24013470 con 0x7fba30159e60 2023-10-09T06:24:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.524+0000 7fba2d7fa700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fba1c066f30 0x7fba1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.525+0000 7fba2d7fa700 1 -- 172.21.15.31:0/2904622060 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba24084760 con 0x7fba30159e60 2023-10-09T06:24:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.525+0000 7fba353e3700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fba1c066f30 0x7fba1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.525+0000 7fba2d7fa700 1 -- 172.21.15.31:0/2904622060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7fba1c06ea50 con 0x7fba30159e60 2023-10-09T06:24:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.525+0000 7fba353e3700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fba1c066f30 0x7fba1c0693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fba28005c50 tx=0x7fba28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.529+0000 7fba2d7fa700 1 -- 172.21.15.31:0/2904622060 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba24021060 con 0x7fba30159e60 2023-10-09T06:24:37.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.721+0000 7fba37647700 1 -- 172.21.15.31:0/2904622060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fba3004c3c0 con 0x7fba30159e60 2023-10-09T06:24:37.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.721+0000 7fba2d7fa700 1 -- 172.21.15.31:0/2904622060 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7fba24055460 con 0x7fba30159e60 2023-10-09T06:24:37.722 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:24:37.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.723+0000 7fba37647700 1 -- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fba1c066f30 msgr2=0x7fba1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.723+0000 7fba37647700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fba1c066f30 0x7fba1c0693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fba28005c50 tx=0x7fba28009040 comp rx=0 tx=0).stop 2023-10-09T06:24:37.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.723+0000 7fba37647700 1 -- 172.21.15.31:0/2904622060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba30159e60 msgr2=0x7fba3015c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.723+0000 7fba37647700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba30159e60 0x7fba3015c050 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fba2400e930 tx=0x7fba240091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.724+0000 7fba37647700 1 -- 172.21.15.31:0/2904622060 shutdown_connections 2023-10-09T06:24:37.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.724+0000 7fba37647700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fba1c066f30 0x7fba1c0693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.724+0000 7fba37647700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba300697c0 0x7fba30158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.724+0000 7fba37647700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba3015a230 0x7fba3015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.724+0000 7fba37647700 1 --2- 172.21.15.31:0/2904622060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba30159e60 0x7fba3015c050 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.724+0000 7fba37647700 1 -- 172.21.15.31:0/2904622060 >> 172.21.15.31:0/2904622060 conn(0x7fba30070700 msgr2=0x7fba3015db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:37.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.724+0000 7fba37647700 1 -- 172.21.15.31:0/2904622060 shutdown_connections 2023-10-09T06:24:37.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.724+0000 7fba37647700 1 -- 172.21.15.31:0/2904622060 wait complete. 2023-10-09T06:24:37.736 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:24:37.792 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:24:37.791+0000 7fc5eaab7700 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-10-09T06:24:37.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.857+0000 7f26f8f62700 1 Processor -- start 2023-10-09T06:24:37.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.857+0000 7f26f8f62700 1 -- start start 2023-10-09T06:24:37.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.858+0000 7f26f8f62700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f26f40d1c30 0x7f26f40ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.858+0000 7f26f8f62700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26f415a680 0x7f26f40cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.858+0000 7f26f8f62700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f40c5d80 con 0x7f26f415a2b0 2023-10-09T06:24:37.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.858+0000 7f26f8f62700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f4068470 con 0x7f26f40d1c30 2023-10-09T06:24:37.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.858+0000 7f26f8f62700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f40c6060 con 0x7f26f415a680 2023-10-09T06:24:37.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.858+0000 7f26f1d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f26f40d1c30 0x7f26f40ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.858+0000 7f26f259c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f26f415a2b0 0x7f26f40b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55278/0 (socket says 172.21.15.31:55278) 2023-10-09T06:24:37.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.858+0000 7f26f259c700 1 -- 172.21.15.31:0/3385633423 learned_addr learned my addr 172.21.15.31:0/3385633423 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:37.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.858+0000 7f26f1d9b700 1 -- 172.21.15.31:0/3385633423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26f415a680 msgr2=0x7f26f40cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:37.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.858+0000 7f26f1d9b700 1 --2- 172.21.15.31:0/3385633423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26f415a680 0x7f26f40cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.858+0000 7f26f1d9b700 1 -- 172.21.15.31:0/3385633423 >> v1:172.21.15.31:6789/0 conn(0x7f26f415a2b0 legacy=0x7f26f40b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.858+0000 7f26f1d9b700 1 -- 172.21.15.31:0/3385633423 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f40c6340 con 0x7f26f40d1c30 2023-10-09T06:24:37.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.858+0000 7f26f159a700 1 -- 172.21.15.31:0/3385633423 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484682718 0 0) 0x7f26f40c5d80 con 0x7f26f415a2b0 2023-10-09T06:24:37.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.859+0000 7f26f1d9b700 1 --2- 172.21.15.31:0/3385633423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40d1c30 0x7f26f40ccdd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0098e0 tx=0x7f26dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e947707c7d39fae9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:37.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.859+0000 7f26f159a700 1 -- 172.21.15.31:0/3385633423 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc009e80 con 0x7f26f40d1c30 2023-10-09T06:24:37.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.859+0000 7f26f159a700 1 -- 172.21.15.31:0/3385633423 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc00b860 con 0x7f26f40d1c30 2023-10-09T06:24:37.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.859+0000 7f26f159a700 1 -- 172.21.15.31:0/3385633423 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc00bbe0 con 0x7f26f40d1c30 2023-10-09T06:24:37.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.859+0000 7f26f8f62700 1 -- 172.21.15.31:0/3385633423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40d1c30 msgr2=0x7f26f40ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.859+0000 7f26f8f62700 1 --2- 172.21.15.31:0/3385633423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40d1c30 0x7f26f40ccdd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0098e0 tx=0x7f26dc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.859+0000 7f26f8f62700 1 -- 172.21.15.31:0/3385633423 shutdown_connections 2023-10-09T06:24:37.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.859+0000 7f26f8f62700 1 --2- 172.21.15.31:0/3385633423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26f415a680 0x7f26f40cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.859+0000 7f26f8f62700 1 --2- 172.21.15.31:0/3385633423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40d1c30 0x7f26f40ccdd0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.859+0000 7f26f8f62700 1 -- 172.21.15.31:0/3385633423 >> 172.21.15.31:0/3385633423 conn(0x7f26f4067e40 msgr2=0x7f26f40d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:37.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.859+0000 7f26f8f62700 1 -- 172.21.15.31:0/3385633423 shutdown_connections 2023-10-09T06:24:37.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.859+0000 7f26f8f62700 1 -- 172.21.15.31:0/3385633423 wait complete. 2023-10-09T06:24:37.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.860+0000 7f26f8f62700 1 Processor -- start 2023-10-09T06:24:37.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.861+0000 7f26f8f62700 1 -- start start 2023-10-09T06:24:37.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.861+0000 7f26f8f62700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40d1c30 0x7f26f415da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.861+0000 7f26f8f62700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26f415a2b0 0x7f26f4154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.861+0000 7f26f8f62700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26f415a680 0x7f26f40691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.861+0000 7f26f8f62700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f416ec10 con 0x7f26f40d1c30 2023-10-09T06:24:37.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.861+0000 7f26f8f62700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f415ca90 con 0x7f26f415a2b0 2023-10-09T06:24:37.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.861+0000 7f26f8f62700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f415d5f0 con 0x7f26f415a680 2023-10-09T06:24:37.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.861+0000 7f26f259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40d1c30 0x7f26f415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.861+0000 7f26f259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40d1c30 0x7f26f415da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41558/0 (socket says 172.21.15.31:41558) 2023-10-09T06:24:37.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.861+0000 7f26f259c700 1 -- 172.21.15.31:0/2428698709 learned_addr learned my addr 172.21.15.31:0/2428698709 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:37.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.861+0000 7f26f2d9d700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26f415a680 0x7f26f40691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26f1d9b700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26f415a2b0 0x7f26f4154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26f259c700 1 -- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26f415a680 msgr2=0x7f26f40691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26f259c700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26f415a680 0x7f26f40691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26f259c700 1 -- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26f415a2b0 msgr2=0x7f26f4154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:37.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26f259c700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26f415a2b0 0x7f26f4154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:37.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26f259c700 1 -- 172.21.15.31:0/2428698709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc009420 con 0x7f26f40d1c30 2023-10-09T06:24:37.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26f2d9d700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26f415a680 0x7f26f40691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:37.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26f1d9b700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26f415a2b0 0x7f26f4154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:37.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26f259c700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40d1c30 0x7f26f415da80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f26e400c930 tx=0x7f26e40016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:37.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26ea7fc700 1 -- 172.21.15.31:0/2428698709 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4005d80 con 0x7f26f40d1c30 2023-10-09T06:24:37.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26ea7fc700 1 -- 172.21.15.31:0/2428698709 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e400a5d0 con 0x7f26f40d1c30 2023-10-09T06:24:37.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26f8f62700 1 -- 172.21.15.31:0/2428698709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f415ccc0 con 0x7f26f40d1c30 2023-10-09T06:24:37.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26ea7fc700 1 -- 172.21.15.31:0/2428698709 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e400a990 con 0x7f26f40d1c30 2023-10-09T06:24:37.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.862+0000 7f26f8f62700 1 -- 172.21.15.31:0/2428698709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f415d280 con 0x7f26f40d1c30 2023-10-09T06:24:37.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.863+0000 7f26f8f62700 1 -- 172.21.15.31:0/2428698709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f404c3c0 con 0x7f26f40d1c30 2023-10-09T06:24:37.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.863+0000 7f26ea7fc700 1 -- 172.21.15.31:0/2428698709 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26e40070f0 con 0x7f26f40d1c30 2023-10-09T06:24:37.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.864+0000 7f26ea7fc700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26d4066f30 0x7f26d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:37.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.864+0000 7f26ea7fc700 1 -- 172.21.15.31:0/2428698709 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f26e4084370 con 0x7f26f40d1c30 2023-10-09T06:24:37.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.864+0000 7f26ea7fc700 1 -- 172.21.15.31:0/2428698709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f26d406ea50 con 0x7f26f40d1c30 2023-10-09T06:24:37.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.864+0000 7f26f1d9b700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26d4066f30 0x7f26d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:37.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.865+0000 7f26f1d9b700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26d4066f30 0x7f26d40693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f26f40d2000 tx=0x7f26dc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:37.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:37.868+0000 7f26ea7fc700 1 -- 172.21.15.31:0/2428698709 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26e4051660 con 0x7f26f40d1c30 2023-10-09T06:24:38.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.107+0000 7f26f8f62700 1 -- 172.21.15.31:0/2428698709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26f415d8d0 con 0x7f26f40d1c30 2023-10-09T06:24:38.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.107+0000 7f26ea7fc700 1 -- 172.21.15.31:0/2428698709 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f26e4054c80 con 0x7f26f40d1c30 2023-10-09T06:24:38.108 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:38.108 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/4067940888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":4067940888},{"type":"v1","addr":"172.21.15.158:6835","nonce":4067940888}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/169747435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":169747435},{"type":"v1","addr":"172.21.15.158:6837","nonce":169747435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3769789034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3769789034},{"type":"v1","addr":"172.21.15.31:6834","nonce":3769789034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:23:06.370069+0000","modified":"2023-10-09T06:23:09.985664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/2596093897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2596093897},{"type":"v1","addr":"172.21.15.31:6835","nonce":2596093897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T06:24:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.109+0000 7f26f8f62700 1 -- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26d4066f30 msgr2=0x7f26d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.109+0000 7f26f8f62700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26d4066f30 0x7f26d40693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f26f40d2000 tx=0x7f26dc017000 comp rx=0 tx=0).stop 2023-10-09T06:24:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.109+0000 7f26f8f62700 1 -- 172.21.15.31:0/2428698709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40d1c30 msgr2=0x7f26f415da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.109+0000 7f26f8f62700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40d1c30 0x7f26f415da80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f26e400c930 tx=0x7f26e40016f0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.109+0000 7f26f8f62700 1 -- 172.21.15.31:0/2428698709 shutdown_connections 2023-10-09T06:24:38.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.109+0000 7f26f8f62700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26d4066f30 0x7f26d40693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.109+0000 7f26f8f62700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26f415a680 0x7f26f40691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.109+0000 7f26f8f62700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40d1c30 0x7f26f415da80 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.109+0000 7f26f8f62700 1 --2- 172.21.15.31:0/2428698709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26f415a2b0 0x7f26f4154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.109+0000 7f26f8f62700 1 -- 172.21.15.31:0/2428698709 >> 172.21.15.31:0/2428698709 conn(0x7f26f4067e40 msgr2=0x7f26f4159340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:38.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.109+0000 7f26f8f62700 1 -- 172.21.15.31:0/2428698709 shutdown_connections 2023-10-09T06:24:38.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.109+0000 7f26f8f62700 1 -- 172.21.15.31:0/2428698709 wait complete. 2023-10-09T06:24:38.111 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 34 2023-10-09T06:24:38.122 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:24:38.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.239+0000 7f2d31117700 1 Processor -- start 2023-10-09T06:24:38.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.239+0000 7f2d31117700 1 -- start start 2023-10-09T06:24:38.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.240+0000 7f2d31117700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2d2c157870 0x7f2d2c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.240+0000 7f2d31117700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d2c15a620 0x7f2d2c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.240+0000 7f2d31117700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2c15cbb0 con 0x7f2d2c15d580 2023-10-09T06:24:38.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.240+0000 7f2d31117700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c15bfa0 con 0x7f2d2c157870 2023-10-09T06:24:38.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.240+0000 7f2d31117700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c15c280 con 0x7f2d2c15a620 2023-10-09T06:24:38.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.240+0000 7f2d2b59e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2d2c15d580 0x7f2d2c158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55284/0 (socket says 172.21.15.31:55284) 2023-10-09T06:24:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.240+0000 7f2d2b59e700 1 -- 172.21.15.31:0/1189351198 learned_addr learned my addr 172.21.15.31:0/1189351198 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.240+0000 7f2d2ad9d700 1 --2- 172.21.15.31:0/1189351198 >> v2:172.21.15.158:3300/0 conn(0x7f2d2c157870 0x7f2d2c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.240+0000 7f2d2a59c700 1 --2- 172.21.15.31:0/1189351198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d2c15a620 0x7f2d2c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.241+0000 7f2d29d9b700 1 -- 172.21.15.31:0/1189351198 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397450902 0 0) 0x7f2d2c15cbb0 con 0x7f2d2c15d580 2023-10-09T06:24:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.241+0000 7f2d29d9b700 1 -- 172.21.15.31:0/1189351198 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d18003570 con 0x7f2d2c15d580 2023-10-09T06:24:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.241+0000 7f2d2ad9d700 1 -- 172.21.15.31:0/1189351198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d2c15a620 msgr2=0x7f2d2c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.241+0000 7f2d2ad9d700 1 --2- 172.21.15.31:0/1189351198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d2c15a620 0x7f2d2c15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.241+0000 7f2d2ad9d700 1 -- 172.21.15.31:0/1189351198 >> v1:172.21.15.31:6789/0 conn(0x7f2d2c15d580 legacy=0x7f2d2c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.241+0000 7f2d29d9b700 1 -- 172.21.15.31:0/1189351198 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4251884910 0 0) 0x7f2d18003570 con 0x7f2d2c15d580 2023-10-09T06:24:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.241+0000 7f2d2ad9d700 1 -- 172.21.15.31:0/1189351198 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c15c560 con 0x7f2d2c157870 2023-10-09T06:24:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.241+0000 7f2d2a59c700 1 --2- 172.21.15.31:0/1189351198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d2c15a620 0x7f2d2c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:24:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.241+0000 7f2d2ad9d700 1 --2- 172.21.15.31:0/1189351198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d2c157870 0x7f2d2c15b6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0098e0 tx=0x7f2d1c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d32c94215ab35f49 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.241+0000 7f2d29d9b700 1 -- 172.21.15.31:0/1189351198 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d240017f0 con 0x7f2d2c157870 2023-10-09T06:24:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.241+0000 7f2d29d9b700 1 -- 172.21.15.31:0/1189351198 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c011420 con 0x7f2d2c157870 2023-10-09T06:24:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.241+0000 7f2d29d9b700 1 -- 172.21.15.31:0/1189351198 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0117c0 con 0x7f2d2c157870 2023-10-09T06:24:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.242+0000 7f2d31117700 1 -- 172.21.15.31:0/1189351198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d2c157870 msgr2=0x7f2d2c15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.242+0000 7f2d31117700 1 --2- 172.21.15.31:0/1189351198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d2c157870 0x7f2d2c15b6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0098e0 tx=0x7f2d1c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.242+0000 7f2d31117700 1 -- 172.21.15.31:0/1189351198 shutdown_connections 2023-10-09T06:24:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.242+0000 7f2d31117700 1 --2- 172.21.15.31:0/1189351198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d2c157870 0x7f2d2c15b6a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.242+0000 7f2d31117700 1 --2- 172.21.15.31:0/1189351198 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d2c15a620 0x7f2d2c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.242+0000 7f2d31117700 1 -- 172.21.15.31:0/1189351198 >> 172.21.15.31:0/1189351198 conn(0x7f2d2c068ce0 msgr2=0x7f2d2c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.242+0000 7f2d31117700 1 -- 172.21.15.31:0/1189351198 shutdown_connections 2023-10-09T06:24:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.242+0000 7f2d31117700 1 -- 172.21.15.31:0/1189351198 wait complete. 2023-10-09T06:24:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.243+0000 7f2d31117700 1 Processor -- start 2023-10-09T06:24:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.243+0000 7f2d31117700 1 -- start start 2023-10-09T06:24:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d31117700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d2c157870 0x7f2d2c14c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d31117700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d2c15a620 0x7f2d2c152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d31117700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d2c15d580 0x7f2d2c14fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d31117700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c153a10 con 0x7f2d2c15a620 2023-10-09T06:24:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d31117700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0b1c30 con 0x7f2d2c15d580 2023-10-09T06:24:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d31117700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c153730 con 0x7f2d2c157870 2023-10-09T06:24:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d2a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d2c15a620 0x7f2d2c152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d2a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d2c15a620 0x7f2d2c152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41570/0 (socket says 172.21.15.31:41570) 2023-10-09T06:24:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d2a59c700 1 -- 172.21.15.31:0/1313799437 learned_addr learned my addr 172.21.15.31:0/1313799437 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d2ad9d700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d2c157870 0x7f2d2c14c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d2b59e700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d2c15d580 0x7f2d2c14fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d2a59c700 1 -- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d2c157870 msgr2=0x7f2d2c14c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d2a59c700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d2c157870 0x7f2d2c14c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d2a59c700 1 -- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d2c15d580 msgr2=0x7f2d2c14fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d2a59c700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d2c15d580 0x7f2d2c14fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d2a59c700 1 -- 172.21.15.31:0/1313799437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d14009420 con 0x7f2d2c15a620 2023-10-09T06:24:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d2a59c700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d2c15a620 0x7f2d2c152c50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400ec80 tx=0x7f2d140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d22ffd700 1 -- 172.21.15.31:0/1313799437 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400c850 con 0x7f2d2c15a620 2023-10-09T06:24:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d22ffd700 1 -- 172.21.15.31:0/1313799437 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1400c9b0 con 0x7f2d2c15a620 2023-10-09T06:24:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d31117700 1 -- 172.21.15.31:0/1313799437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c009420 con 0x7f2d2c15a620 2023-10-09T06:24:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.244+0000 7f2d22ffd700 1 -- 172.21.15.31:0/1313799437 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400cd50 con 0x7f2d2c15a620 2023-10-09T06:24:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.245+0000 7f2d31117700 1 -- 172.21.15.31:0/1313799437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c0b18c0 con 0x7f2d2c15a620 2023-10-09T06:24:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.245+0000 7f2d31117700 1 -- 172.21.15.31:0/1313799437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2c0b1440 con 0x7f2d2c15a620 2023-10-09T06:24:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.246+0000 7f2d22ffd700 1 -- 172.21.15.31:0/1313799437 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d14013680 con 0x7f2d2c15a620 2023-10-09T06:24:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.246+0000 7f2d22ffd700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d0c066f30 0x7f2d0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.246+0000 7f2d22ffd700 1 -- 172.21.15.31:0/1313799437 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d14084a10 con 0x7f2d2c15a620 2023-10-09T06:24:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.246+0000 7f2d22ffd700 1 -- 172.21.15.31:0/1313799437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f2d0c06ea50 con 0x7f2d2c15a620 2023-10-09T06:24:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.247+0000 7f2d2ad9d700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d0c066f30 0x7f2d0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.247+0000 7f2d2ad9d700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d0c066f30 0x7f2d0c0693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0030c0 tx=0x7f2d1c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.250+0000 7f2d22ffd700 1 -- 172.21.15.31:0/1313799437 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d14017060 con 0x7f2d2c15a620 2023-10-09T06:24:38.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.442+0000 7f2d31117700 1 -- 172.21.15.31:0/1313799437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d2c04c3c0 con 0x7f2d2c15a620 2023-10-09T06:24:38.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.443+0000 7f2d22ffd700 1 -- 172.21.15.31:0/1313799437 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+15401 (secure 0 0 0) 0x7f2d14021020 con 0x7f2d2c15a620 2023-10-09T06:24:38.446 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:38.446 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":69,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:24:37.792777+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:23:04.509059+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T06:23:05.346720+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:24:38.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.445+0000 7f2d31117700 1 -- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d0c066f30 msgr2=0x7f2d0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.445+0000 7f2d31117700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d0c066f30 0x7f2d0c0693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0030c0 tx=0x7f2d1c016000 comp rx=0 tx=0).stop 2023-10-09T06:24:38.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.445+0000 7f2d31117700 1 -- 172.21.15.31:0/1313799437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d2c15a620 msgr2=0x7f2d2c152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.445+0000 7f2d31117700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d2c15a620 0x7f2d2c152c50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400ec80 tx=0x7f2d140091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.445+0000 7f2d31117700 1 -- 172.21.15.31:0/1313799437 shutdown_connections 2023-10-09T06:24:38.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.445+0000 7f2d31117700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d0c066f30 0x7f2d0c0693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.445+0000 7f2d31117700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2d2c157870 0x7f2d2c14c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.445+0000 7f2d31117700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2d2c15d580 0x7f2d2c14fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.445+0000 7f2d31117700 1 --2- 172.21.15.31:0/1313799437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d2c15a620 0x7f2d2c152c50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.445+0000 7f2d31117700 1 -- 172.21.15.31:0/1313799437 >> 172.21.15.31:0/1313799437 conn(0x7f2d2c068ce0 msgr2=0x7f2d2c0afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:38.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.445+0000 7f2d31117700 1 -- 172.21.15.31:0/1313799437 shutdown_connections 2023-10-09T06:24:38.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.445+0000 7f2d31117700 1 -- 172.21.15.31:0/1313799437 wait complete. 2023-10-09T06:24:38.458 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:24:38.458 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:24:38.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.577+0000 7f0254040700 1 Processor -- start 2023-10-09T06:24:38.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.577+0000 7f0254040700 1 -- start start 2023-10-09T06:24:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f0254040700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f024c15a620 0x7f024c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f0254040700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f024c15d580 0x7f024c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f0254040700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024c15cbb0 con 0x7f024c157870 2023-10-09T06:24:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f0254040700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f024c15bdb0 con 0x7f024c15d580 2023-10-09T06:24:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f0254040700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024c15bfa0 con 0x7f024c15a620 2023-10-09T06:24:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f0251ddc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f024c157870 0x7f024c15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55288/0 (socket says 172.21.15.31:55288) 2023-10-09T06:24:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f0251ddc700 1 -- 172.21.15.31:0/280456076 learned_addr learned my addr 172.21.15.31:0/280456076 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f02515db700 1 --2- 172.21.15.31:0/280456076 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f024c15a620 0x7f024c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f02525dd700 1 --2- 172.21.15.31:0/280456076 >> v2:172.21.15.158:3300/0 conn(0x7f024c15d580 0x7f024c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f0250dda700 1 -- 172.21.15.31:0/280456076 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354988418 0 0) 0x7f024c15cbb0 con 0x7f024c157870 2023-10-09T06:24:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f0250dda700 1 -- 172.21.15.31:0/280456076 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0234003570 con 0x7f024c157870 2023-10-09T06:24:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f0250dda700 1 -- 172.21.15.31:0/280456076 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1018004688 0 0) 0x7f0234003570 con 0x7f024c157870 2023-10-09T06:24:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f02515db700 1 -- 172.21.15.31:0/280456076 >> v2:172.21.15.158:3300/0 conn(0x7f024c15d580 msgr2=0x7f024c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f02515db700 1 --2- 172.21.15.31:0/280456076 >> v2:172.21.15.158:3300/0 conn(0x7f024c15d580 0x7f024c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f02515db700 1 -- 172.21.15.31:0/280456076 >> v1:172.21.15.31:6789/0 conn(0x7f024c157870 legacy=0x7f024c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f02515db700 1 -- 172.21.15.31:0/280456076 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c15c280 con 0x7f024c15a620 2023-10-09T06:24:38.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.578+0000 7f02515db700 1 --2- 172.21.15.31:0/280456076 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f024c15a620 0x7f024c15d040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f02400098e0 tx=0x7f02400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=187132fe7dd153ca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:38.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.579+0000 7f0250dda700 1 -- 172.21.15.31:0/280456076 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c001470 con 0x7f024c15a620 2023-10-09T06:24:38.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.579+0000 7f0250dda700 1 -- 172.21.15.31:0/280456076 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0240011420 con 0x7f024c15a620 2023-10-09T06:24:38.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.579+0000 7f0250dda700 1 -- 172.21.15.31:0/280456076 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02400117c0 con 0x7f024c15a620 2023-10-09T06:24:38.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.579+0000 7f0254040700 1 -- 172.21.15.31:0/280456076 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f024c15a620 msgr2=0x7f024c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.579+0000 7f0254040700 1 --2- 172.21.15.31:0/280456076 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f024c15a620 0x7f024c15d040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f02400098e0 tx=0x7f02400091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.579+0000 7f0254040700 1 -- 172.21.15.31:0/280456076 shutdown_connections 2023-10-09T06:24:38.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.579+0000 7f0254040700 1 --2- 172.21.15.31:0/280456076 >> v2:172.21.15.158:3300/0 conn(0x7f024c15d580 0x7f024c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.579+0000 7f0254040700 1 --2- 172.21.15.31:0/280456076 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f024c15a620 0x7f024c15d040 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.579+0000 7f0254040700 1 -- 172.21.15.31:0/280456076 >> 172.21.15.31:0/280456076 conn(0x7f024c068ce0 msgr2=0x7f024c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:38.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.579+0000 7f0254040700 1 -- 172.21.15.31:0/280456076 shutdown_connections 2023-10-09T06:24:38.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.579+0000 7f0254040700 1 -- 172.21.15.31:0/280456076 wait complete. 2023-10-09T06:24:38.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.580+0000 7f0254040700 1 Processor -- start 2023-10-09T06:24:38.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.580+0000 7f0254040700 1 -- start start 2023-10-09T06:24:38.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.581+0000 7f0254040700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f024c157870 0x7f024c1602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.581+0000 7f0254040700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f024c15a620 0x7f024c14d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.581+0000 7f0254040700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f024c15d580 0x7f024c14dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.581+0000 7f0254040700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c15e6e0 con 0x7f024c15d580 2023-10-09T06:24:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.581+0000 7f0254040700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c0cfd10 con 0x7f024c15a620 2023-10-09T06:24:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.581+0000 7f0254040700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024c0cf3e0 con 0x7f024c157870 2023-10-09T06:24:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.581+0000 7f02525dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f024c15d580 0x7f024c14dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.581+0000 7f02525dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f024c15d580 0x7f024c14dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41578/0 (socket says 172.21.15.31:41578) 2023-10-09T06:24:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.581+0000 7f02525dd700 1 -- 172.21.15.31:0/1958353492 learned_addr learned my addr 172.21.15.31:0/1958353492 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.581+0000 7f0251ddc700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f024c157870 0x7f024c1602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.581+0000 7f02515db700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f024c15a620 0x7f024c14d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.582+0000 7f02525dd700 1 -- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f024c157870 msgr2=0x7f024c1602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.582+0000 7f02525dd700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f024c157870 0x7f024c1602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.582+0000 7f02525dd700 1 -- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f024c15a620 msgr2=0x7f024c14d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.582+0000 7f02525dd700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f024c15a620 0x7f024c14d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.582+0000 7f02525dd700 1 -- 172.21.15.31:0/1958353492 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0240009420 con 0x7f024c15d580 2023-10-09T06:24:38.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.582+0000 7f02525dd700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f024c15d580 0x7f024c14dea0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0244009d70 tx=0x7f024400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:38.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.582+0000 7f0249ffb700 1 -- 172.21.15.31:0/1958353492 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024400caa0 con 0x7f024c15d580 2023-10-09T06:24:38.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.582+0000 7f0249ffb700 1 -- 172.21.15.31:0/1958353492 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024400f040 con 0x7f024c15d580 2023-10-09T06:24:38.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.582+0000 7f0254040700 1 -- 172.21.15.31:0/1958353492 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024c0cf6c0 con 0x7f024c15d580 2023-10-09T06:24:38.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.582+0000 7f0249ffb700 1 -- 172.21.15.31:0/1958353492 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024400ce50 con 0x7f024c15d580 2023-10-09T06:24:38.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.582+0000 7f0254040700 1 -- 172.21.15.31:0/1958353492 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024c1607f0 con 0x7f024c15d580 2023-10-09T06:24:38.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.583+0000 7f0254040700 1 -- 172.21.15.31:0/1958353492 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f024c0cfe80 con 0x7f024c15d580 2023-10-09T06:24:38.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.584+0000 7f0249ffb700 1 -- 172.21.15.31:0/1958353492 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0244014690 con 0x7f024c15d580 2023-10-09T06:24:38.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.584+0000 7f0249ffb700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0238066f30 0x7f02380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.584+0000 7f0249ffb700 1 -- 172.21.15.31:0/1958353492 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f02440855a0 con 0x7f024c15d580 2023-10-09T06:24:38.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.585+0000 7f0249ffb700 1 -- 172.21.15.31:0/1958353492 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f023806ea50 con 0x7f024c15d580 2023-10-09T06:24:38.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.585+0000 7f0251ddc700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0238066f30 0x7f02380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.585+0000 7f0251ddc700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0238066f30 0x7f02380693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f023c0011e0 tx=0x7f023c001aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:38.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.588+0000 7f0249ffb700 1 -- 172.21.15.31:0/1958353492 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0244052890 con 0x7f024c15d580 2023-10-09T06:24:38.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.804+0000 7f0249ffb700 1 -- 172.21.15.31:0/1958353492 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(70..70 src has 1..70) v4 ==== 296+0+0 (secure 0 0 0) 0x7f0244056c50 con 0x7f024c15d580 2023-10-09T06:24:38.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.804+0000 7f0249ffb700 1 -- 172.21.15.31:0/1958353492 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f023806f3d0 con 0x7f024c15d580 2023-10-09T06:24:38.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.824+0000 7f0254040700 1 -- 172.21.15.31:0/1958353492 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f024c04c3c0 con 0x7f024c15d580 2023-10-09T06:24:38.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.825+0000 7f0249ffb700 1 -- 172.21.15.31:0/1958353492 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f0244018070 con 0x7f024c15d580 2023-10-09T06:24:38.825 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:38.825 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/4067940888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":4067940888},{"type":"v1","addr":"172.21.15.158:6835","nonce":4067940888}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/169747435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":169747435},{"type":"v1","addr":"172.21.15.158:6837","nonce":169747435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3769789034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3769789034},{"type":"v1","addr":"172.21.15.31:6834","nonce":3769789034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:23:06.370069+0000","modified":"2023-10-09T06:23:09.985664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/2596093897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2596093897},{"type":"v1","addr":"172.21.15.31:6835","nonce":2596093897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T06:24:38.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.827+0000 7f0254040700 1 -- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0238066f30 msgr2=0x7f02380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.827+0000 7f0254040700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0238066f30 0x7f02380693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f023c0011e0 tx=0x7f023c001aa0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.827+0000 7f0254040700 1 -- 172.21.15.31:0/1958353492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f024c15d580 msgr2=0x7f024c14dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.827+0000 7f0254040700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f024c15d580 0x7f024c14dea0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0244009d70 tx=0x7f024400b040 comp rx=0 tx=0).stop 2023-10-09T06:24:38.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.827+0000 7f0254040700 1 -- 172.21.15.31:0/1958353492 shutdown_connections 2023-10-09T06:24:38.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.827+0000 7f0254040700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0238066f30 0x7f02380693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.827+0000 7f0254040700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f024c157870 0x7f024c1602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.827+0000 7f0254040700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f024c15d580 0x7f024c14dea0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.827+0000 7f0254040700 1 --2- 172.21.15.31:0/1958353492 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f024c15a620 0x7f024c14d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.827+0000 7f0254040700 1 -- 172.21.15.31:0/1958353492 >> 172.21.15.31:0/1958353492 conn(0x7f024c068ce0 msgr2=0x7f024c0afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:38.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.827+0000 7f0254040700 1 -- 172.21.15.31:0/1958353492 shutdown_connections 2023-10-09T06:24:38.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.827+0000 7f0254040700 1 -- 172.21.15.31:0/1958353492 wait complete. 2023-10-09T06:24:38.829 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 34 2023-10-09T06:24:38.839 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:24:38.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.958+0000 7f150aebd700 1 Processor -- start 2023-10-09T06:24:38.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.958+0000 7f150aebd700 1 -- start start 2023-10-09T06:24:38.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.958+0000 7f150aebd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f150406c630 0x7f1504067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.958+0000 7f150aebd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15040cb370 con 0x7f15040b0890 2023-10-09T06:24:38.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f150aebd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1504067fa0 con 0x7f1504067ba0 2023-10-09T06:24:38.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f150aebd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15040b0c60 con 0x7f150406c630 2023-10-09T06:24:38.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f1503fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f150406c630 0x7f1504067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f1503fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f150406c630 0x7f1504067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41582/0 (socket says 172.21.15.31:41582) 2023-10-09T06:24:38.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f1503fff700 1 -- 172.21.15.31:0/4211927615 learned_addr learned my addr 172.21.15.31:0/4211927615 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:38.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f1508c59700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f15040b0890 0x7f15040cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55294/0 (socket says 172.21.15.31:55294) 2023-10-09T06:24:38.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f1503fff700 1 -- 172.21.15.31:0/4211927615 >> v1:172.21.15.158:6789/0 conn(0x7f1504067ba0 legacy=0x7f1504159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f1503fff700 1 -- 172.21.15.31:0/4211927615 >> v1:172.21.15.31:6789/0 conn(0x7f15040b0890 legacy=0x7f15040cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f1503fff700 1 -- 172.21.15.31:0/4211927615 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150406a1e0 con 0x7f150406c630 2023-10-09T06:24:38.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f15037fe700 1 -- 172.21.15.31:0/4211927615 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983475984 0 0) 0x7f15040cb370 con 0x7f15040b0890 2023-10-09T06:24:38.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f1503fff700 1 --2- 172.21.15.31:0/4211927615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f150406c630 0x7f1504067660 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f14f40099b0 tx=0x7f14f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9193d0f0b8db21a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:38.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f15037fe700 1 -- 172.21.15.31:0/4211927615 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f400b860 con 0x7f150406c630 2023-10-09T06:24:38.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f15037fe700 1 -- 172.21.15.31:0/4211927615 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f400b9c0 con 0x7f150406c630 2023-10-09T06:24:38.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.959+0000 7f15037fe700 1 -- 172.21.15.31:0/4211927615 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f400bd60 con 0x7f150406c630 2023-10-09T06:24:38.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.960+0000 7f150aebd700 1 -- 172.21.15.31:0/4211927615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f150406c630 msgr2=0x7f1504067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.960+0000 7f150aebd700 1 --2- 172.21.15.31:0/4211927615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f150406c630 0x7f1504067660 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f14f40099b0 tx=0x7f14f4009250 comp rx=0 tx=0).stop 2023-10-09T06:24:38.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.960+0000 7f150aebd700 1 -- 172.21.15.31:0/4211927615 shutdown_connections 2023-10-09T06:24:38.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.960+0000 7f150aebd700 1 --2- 172.21.15.31:0/4211927615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f150406c630 0x7f1504067660 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.960+0000 7f150aebd700 1 -- 172.21.15.31:0/4211927615 >> 172.21.15.31:0/4211927615 conn(0x7f150406fe50 msgr2=0x7f1504069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:38.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.960+0000 7f150aebd700 1 -- 172.21.15.31:0/4211927615 shutdown_connections 2023-10-09T06:24:38.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.960+0000 7f150aebd700 1 -- 172.21.15.31:0/4211927615 wait complete. 2023-10-09T06:24:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.961+0000 7f150aebd700 1 Processor -- start 2023-10-09T06:24:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.961+0000 7f150aebd700 1 -- start start 2023-10-09T06:24:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f150aebd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1504067ba0 0x7f150415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f150aebd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f150406c630 0x7f15040c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f150aebd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f15040b0890 0x7f15040b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f150aebd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15040c52b0 con 0x7f1504067ba0 2023-10-09T06:24:38.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f150aebd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15040b2970 con 0x7f150406c630 2023-10-09T06:24:38.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f150aebd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150415c290 con 0x7f15040b0890 2023-10-09T06:24:38.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f1508c59700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1504067ba0 0x7f150415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f1508c59700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1504067ba0 0x7f150415bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41584/0 (socket says 172.21.15.31:41584) 2023-10-09T06:24:38.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f1508c59700 1 -- 172.21.15.31:0/558674398 learned_addr learned my addr 172.21.15.31:0/558674398 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:38.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f1503fff700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f150406c630 0x7f15040c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f150945a700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f15040b0890 0x7f15040b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f1508c59700 1 -- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f15040b0890 msgr2=0x7f15040b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f1508c59700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f15040b0890 0x7f15040b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f1508c59700 1 -- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f150406c630 msgr2=0x7f15040c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:38.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f1508c59700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f150406c630 0x7f15040c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f1508c59700 1 -- 172.21.15.31:0/558674398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f40094f0 con 0x7f1504067ba0 2023-10-09T06:24:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f1503fff700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f150406c630 0x7f15040c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f150945a700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f15040b0890 0x7f15040b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.962+0000 7f1508c59700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1504067ba0 0x7f150415bd50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00c840 tx=0x7f14ec007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.963+0000 7f1500ff9700 1 -- 172.21.15.31:0/558674398 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec0073d0 con 0x7f1504067ba0 2023-10-09T06:24:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.963+0000 7f1500ff9700 1 -- 172.21.15.31:0/558674398 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec007550 con 0x7f1504067ba0 2023-10-09T06:24:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.963+0000 7f150aebd700 1 -- 172.21.15.31:0/558674398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15040b1d60 con 0x7f1504067ba0 2023-10-09T06:24:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.963+0000 7f1500ff9700 1 -- 172.21.15.31:0/558674398 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec004a80 con 0x7f1504067ba0 2023-10-09T06:24:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.963+0000 7f150aebd700 1 -- 172.21.15.31:0/558674398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15040b23a0 con 0x7f1504067ba0 2023-10-09T06:24:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.964+0000 7f150aebd700 1 -- 172.21.15.31:0/558674398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15040b2750 con 0x7f1504067ba0 2023-10-09T06:24:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.964+0000 7f1500ff9700 1 -- 172.21.15.31:0/558674398 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14ec01c3b0 con 0x7f1504067ba0 2023-10-09T06:24:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.964+0000 7f1500ff9700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f14e4066f30 0x7f14e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:38.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.965+0000 7f1500ff9700 1 -- 172.21.15.31:0/558674398 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14ec083b40 con 0x7f1504067ba0 2023-10-09T06:24:38.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.965+0000 7f1503fff700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f14e4066f30 0x7f14e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:38.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.965+0000 7f1500ff9700 1 -- 172.21.15.31:0/558674398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f14e406ea50 con 0x7f1504067ba0 2023-10-09T06:24:38.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.965+0000 7f1503fff700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f14e4066f30 0x7f14e40693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f14f40099b0 tx=0x7f14f4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:38.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:38.969+0000 7f1500ff9700 1 -- 172.21.15.31:0/558674398 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14ec018020 con 0x7f1504067ba0 2023-10-09T06:24:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.204+0000 7f150aebd700 1 -- 172.21.15.31:0/558674398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15040b2c50 con 0x7f1504067ba0 2023-10-09T06:24:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.205+0000 7f1500ff9700 1 -- 172.21.15.31:0/558674398 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f14ec050d90 con 0x7f1504067ba0 2023-10-09T06:24:39.206 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:39.206 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/4067940888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":4067940888},{"type":"v1","addr":"172.21.15.158:6835","nonce":4067940888}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/169747435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":169747435},{"type":"v1","addr":"172.21.15.158:6837","nonce":169747435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3769789034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3769789034},{"type":"v1","addr":"172.21.15.31:6834","nonce":3769789034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:23:06.370069+0000","modified":"2023-10-09T06:23:09.985664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/2596093897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2596093897},{"type":"v1","addr":"172.21.15.31:6835","nonce":2596093897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T06:24:39.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.207+0000 7f150aebd700 1 -- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f14e4066f30 msgr2=0x7f14e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.207+0000 7f150aebd700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f14e4066f30 0x7f14e40693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f14f40099b0 tx=0x7f14f4017000 comp rx=0 tx=0).stop 2023-10-09T06:24:39.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.207+0000 7f150aebd700 1 -- 172.21.15.31:0/558674398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1504067ba0 msgr2=0x7f150415bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.207+0000 7f150aebd700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1504067ba0 0x7f150415bd50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00c840 tx=0x7f14ec007d90 comp rx=0 tx=0).stop 2023-10-09T06:24:39.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.207+0000 7f150aebd700 1 -- 172.21.15.31:0/558674398 shutdown_connections 2023-10-09T06:24:39.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.207+0000 7f150aebd700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f14e4066f30 0x7f14e40693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.207+0000 7f150aebd700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f15040b0890 0x7f15040b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.207+0000 7f150aebd700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1504067ba0 0x7f150415bd50 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.207+0000 7f150aebd700 1 --2- 172.21.15.31:0/558674398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f150406c630 0x7f15040c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.207+0000 7f150aebd700 1 -- 172.21.15.31:0/558674398 >> 172.21.15.31:0/558674398 conn(0x7f150406fe50 msgr2=0x7f150406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.207+0000 7f150aebd700 1 -- 172.21.15.31:0/558674398 shutdown_connections 2023-10-09T06:24:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.207+0000 7f150aebd700 1 -- 172.21.15.31:0/558674398 wait complete. 2023-10-09T06:24:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 34 2023-10-09T06:24:39.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:24:39.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.338+0000 7f0a692a2700 1 Processor -- start 2023-10-09T06:24:39.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.338+0000 7f0a692a2700 1 -- start start 2023-10-09T06:24:39.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.338+0000 7f0a692a2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0a640cfe20 0x7f0a640ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.338+0000 7f0a692a2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a640c5d80 con 0x7f0a6415a2b0 2023-10-09T06:24:39.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.338+0000 7f0a692a2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a640c6060 con 0x7f0a640d1c30 2023-10-09T06:24:39.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.338+0000 7f0a692a2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a64068470 con 0x7f0a640cfe20 2023-10-09T06:24:39.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a62ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0a6415a2b0 0x7f0a640b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55298/0 (socket says 172.21.15.31:55298) 2023-10-09T06:24:39.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a62ffd700 1 -- 172.21.15.31:0/4206048270 learned_addr learned my addr 172.21.15.31:0/4206048270 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:39.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a637fe700 1 --2- 172.21.15.31:0/4206048270 >> v2:172.21.15.158:3300/0 conn(0x7f0a640cfe20 0x7f0a640ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469699963 0 0) 0x7f0a640c5d80 con 0x7f0a6415a2b0 2023-10-09T06:24:39.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a50003570 con 0x7f0a6415a2b0 2023-10-09T06:24:39.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009083296 0 0) 0x7f0a640c6060 con 0x7f0a640d1c30 2023-10-09T06:24:39.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a640c5d80 con 0x7f0a640d1c30 2023-10-09T06:24:39.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 735304883 0 0) 0x7f0a50003570 con 0x7f0a6415a2b0 2023-10-09T06:24:39.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 >> v2:172.21.15.158:3300/0 conn(0x7f0a640cfe20 msgr2=0x7f0a640ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:39.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 --2- 172.21.15.31:0/4206048270 >> v2:172.21.15.158:3300/0 conn(0x7f0a640cfe20 0x7f0a640ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 >> v1:172.21.15.158:6789/0 conn(0x7f0a640d1c30 legacy=0x7f0a640cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a640c6340 con 0x7f0a6415a2b0 2023-10-09T06:24:39.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f0a5c0015f0 con 0x7f0a6415a2b0 2023-10-09T06:24:39.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 >> v1:172.21.15.31:6789/0 conn(0x7f0a6415a2b0 legacy=0x7f0a640b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 --2- 172.21.15.31:0/4206048270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a50003bf0 0x7f0a50003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 --2- 172.21.15.31:0/4206048270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a50004810 0x7f0a50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 --2- 172.21.15.31:0/4206048270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a500051c0 0x7f0a5000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64068470 con 0x7f0a50004810 2023-10-09T06:24:39.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5000c0b0 con 0x7f0a50003bf0 2023-10-09T06:24:39.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5000c270 con 0x7f0a500051c0 2023-10-09T06:24:39.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a627fc700 1 --2- 172.21.15.31:0/4206048270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a50004810 0x7f0a50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a62ffd700 1 --2- 172.21.15.31:0/4206048270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a50003bf0 0x7f0a50003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.339+0000 7f0a637fe700 1 --2- 172.21.15.31:0/4206048270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a500051c0 0x7f0a5000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a627fc700 1 -- 172.21.15.31:0/4206048270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a500051c0 msgr2=0x7f0a5000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:39.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a627fc700 1 --2- 172.21.15.31:0/4206048270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a500051c0 0x7f0a5000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a627fc700 1 -- 172.21.15.31:0/4206048270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a50003bf0 msgr2=0x7f0a50003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:39.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a627fc700 1 --2- 172.21.15.31:0/4206048270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a50003bf0 0x7f0a50003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a627fc700 1 -- 172.21.15.31:0/4206048270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a50003570 con 0x7f0a50004810 2023-10-09T06:24:39.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a637fe700 1 --2- 172.21.15.31:0/4206048270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a500051c0 0x7f0a5000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:39.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a637fe700 1 -- 172.21.15.31:0/4206048270 reap_dead start 2023-10-09T06:24:39.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a627fc700 1 --2- 172.21.15.31:0/4206048270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a50004810 0x7f0a50004c80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0019e0 tx=0x7f0a4c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42999b28dacdde1e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:39.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00c5d0 con 0x7f0a50004810 2023-10-09T06:24:39.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c00c730 con 0x7f0a50004810 2023-10-09T06:24:39.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a61ffb700 1 -- 172.21.15.31:0/4206048270 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00caf0 con 0x7f0a50004810 2023-10-09T06:24:39.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a692a2700 1 -- 172.21.15.31:0/4206048270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a50004810 msgr2=0x7f0a50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a692a2700 1 --2- 172.21.15.31:0/4206048270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a50004810 0x7f0a50004c80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0019e0 tx=0x7f0a4c007d30 comp rx=0 tx=0).stop 2023-10-09T06:24:39.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a692a2700 1 -- 172.21.15.31:0/4206048270 shutdown_connections 2023-10-09T06:24:39.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a692a2700 1 --2- 172.21.15.31:0/4206048270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a50004810 0x7f0a50004c80 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.340+0000 7f0a692a2700 1 -- 172.21.15.31:0/4206048270 >> 172.21.15.31:0/4206048270 conn(0x7f0a64067e40 msgr2=0x7f0a640d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:39.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.341+0000 7f0a692a2700 1 -- 172.21.15.31:0/4206048270 shutdown_connections 2023-10-09T06:24:39.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.341+0000 7f0a692a2700 1 -- 172.21.15.31:0/4206048270 wait complete. 2023-10-09T06:24:39.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.342+0000 7f0a692a2700 1 Processor -- start 2023-10-09T06:24:39.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.342+0000 7f0a692a2700 1 -- start start 2023-10-09T06:24:39.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.342+0000 7f0a692a2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a50004810 0x7f0a6415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.342+0000 7f0a692a2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6415b280 0x7f0a6416a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a692a2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a6416a7c0 0x7f0a6416ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a692a2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640c90f0 con 0x7f0a50004810 2023-10-09T06:24:39.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a692a2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6416b170 con 0x7f0a6416a7c0 2023-10-09T06:24:39.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a692a2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6415c400 con 0x7f0a6415b280 2023-10-09T06:24:39.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a62ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a50004810 0x7f0a6415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a62ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a50004810 0x7f0a6415d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41610/0 (socket says 172.21.15.31:41610) 2023-10-09T06:24:39.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a62ffd700 1 -- 172.21.15.31:0/4197033756 learned_addr learned my addr 172.21.15.31:0/4197033756 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:39.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a627fc700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6415b280 0x7f0a6416a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a637fe700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a6416a7c0 0x7f0a6416ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a62ffd700 1 -- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6415b280 msgr2=0x7f0a6416a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a62ffd700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6415b280 0x7f0a6416a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a62ffd700 1 -- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a6416a7c0 msgr2=0x7f0a6416ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a62ffd700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a6416a7c0 0x7f0a6416ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a62ffd700 1 -- 172.21.15.31:0/4197033756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6415c6e0 con 0x7f0a50004810 2023-10-09T06:24:39.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a637fe700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a6416a7c0 0x7f0a6416ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:39.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a62ffd700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a50004810 0x7f0a6415d7b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00fc30 tx=0x7f0a5c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:39.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a5affd700 1 -- 172.21.15.31:0/4197033756 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0072e0 con 0x7f0a50004810 2023-10-09T06:24:39.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a5affd700 1 -- 172.21.15.31:0/4197033756 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c007440 con 0x7f0a50004810 2023-10-09T06:24:39.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a692a2700 1 -- 172.21.15.31:0/4197033756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6415c9c0 con 0x7f0a50004810 2023-10-09T06:24:39.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a5affd700 1 -- 172.21.15.31:0/4197033756 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0057f0 con 0x7f0a50004810 2023-10-09T06:24:39.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.343+0000 7f0a692a2700 1 -- 172.21.15.31:0/4197033756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6415dcf0 con 0x7f0a50004810 2023-10-09T06:24:39.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.344+0000 7f0a692a2700 1 -- 172.21.15.31:0/4197033756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6404c3c0 con 0x7f0a50004810 2023-10-09T06:24:39.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.345+0000 7f0a5affd700 1 -- 172.21.15.31:0/4197033756 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a5c005c00 con 0x7f0a50004810 2023-10-09T06:24:39.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.345+0000 7f0a5affd700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0a44066f30 0x7f0a440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.345+0000 7f0a5affd700 1 -- 172.21.15.31:0/4197033756 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a5c0847b0 con 0x7f0a50004810 2023-10-09T06:24:39.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.345+0000 7f0a5affd700 1 -- 172.21.15.31:0/4197033756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f0a4406ea50 con 0x7f0a50004810 2023-10-09T06:24:39.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.345+0000 7f0a627fc700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0a44066f30 0x7f0a440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.346+0000 7f0a627fc700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0a44066f30 0x7f0a440693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c000c00 tx=0x7f0a4c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:39.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.349+0000 7f0a5affd700 1 -- 172.21.15.31:0/4197033756 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a5c051a20 con 0x7f0a50004810 2023-10-09T06:24:39.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.542+0000 7f0a692a2700 1 -- 172.21.15.31:0/4197033756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a6415b730 con 0x7f0a50004810 2023-10-09T06:24:39.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.543+0000 7f0a5affd700 1 -- 172.21.15.31:0/4197033756 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+15387 (secure 0 0 0) 0x7f0a5c055040 con 0x7f0a50004810 2023-10-09T06:24:39.544 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:39.544 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":70,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:24:38.798452+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:23:04.509059+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T06:23:05.346720+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:24:39.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.545+0000 7f0a692a2700 1 -- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0a44066f30 msgr2=0x7f0a440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.545+0000 7f0a692a2700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0a44066f30 0x7f0a440693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c000c00 tx=0x7f0a4c015000 comp rx=0 tx=0).stop 2023-10-09T06:24:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.545+0000 7f0a692a2700 1 -- 172.21.15.31:0/4197033756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a50004810 msgr2=0x7f0a6415d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.545+0000 7f0a692a2700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a50004810 0x7f0a6415d7b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00fc30 tx=0x7f0a5c009040 comp rx=0 tx=0).stop 2023-10-09T06:24:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.545+0000 7f0a692a2700 1 -- 172.21.15.31:0/4197033756 shutdown_connections 2023-10-09T06:24:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.545+0000 7f0a692a2700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0a44066f30 0x7f0a440693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.545+0000 7f0a692a2700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a6416a7c0 0x7f0a6416ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.545+0000 7f0a692a2700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a50004810 0x7f0a6415d7b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.545+0000 7f0a692a2700 1 --2- 172.21.15.31:0/4197033756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0a6415b280 0x7f0a6416a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.545+0000 7f0a692a2700 1 -- 172.21.15.31:0/4197033756 >> 172.21.15.31:0/4197033756 conn(0x7f0a64067e40 msgr2=0x7f0a640b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.546+0000 7f0a692a2700 1 -- 172.21.15.31:0/4197033756 shutdown_connections 2023-10-09T06:24:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.546+0000 7f0a692a2700 1 -- 172.21.15.31:0/4197033756 wait complete. 2023-10-09T06:24:39.558 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:24:39.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.677+0000 7f02a4cbe700 1 Processor -- start 2023-10-09T06:24:39.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.677+0000 7f02a4cbe700 1 -- start start 2023-10-09T06:24:39.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.678+0000 7f02a4cbe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a015a170 0x7f02a0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.678+0000 7f02a4cbe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02a0069040 0x7f02a00af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.678+0000 7f02a4cbe700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a015ea70 con 0x7f02a0159da0 2023-10-09T06:24:39.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.678+0000 7f02a4cbe700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a00b34b0 con 0x7f02a0069040 2023-10-09T06:24:39.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.678+0000 7f02a4cbe700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00694e0 con 0x7f02a015a170 2023-10-09T06:24:39.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.678+0000 7f029ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02a0069040 0x7f02a00af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.678+0000 7f029ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02a0069040 0x7f02a00af4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47848/0 (socket says 172.21.15.31:47848) 2023-10-09T06:24:39.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.678+0000 7f029ffff700 1 -- 172.21.15.31:0/2260679111 learned_addr learned my addr 172.21.15.31:0/2260679111 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:39.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.678+0000 7f029effd700 1 --2- 172.21.15.31:0/2260679111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a015a170 0x7f02a0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.679+0000 7f029ffff700 1 -- 172.21.15.31:0/2260679111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a015a170 msgr2=0x7f02a0068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:39.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.679+0000 7f029ffff700 1 --2- 172.21.15.31:0/2260679111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a015a170 0x7f02a0068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.679+0000 7f029e7fc700 1 -- 172.21.15.31:0/2260679111 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340218588 0 0) 0x7f02a015ea70 con 0x7f02a0159da0 2023-10-09T06:24:39.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.679+0000 7f029ffff700 1 -- 172.21.15.31:0/2260679111 >> v1:172.21.15.158:6789/0 conn(0x7f02a0159da0 legacy=0x7f02a00b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.679+0000 7f029ffff700 1 -- 172.21.15.31:0/2260679111 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a00b3990 con 0x7f02a0069040 2023-10-09T06:24:39.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.679+0000 7f029ffff700 1 --2- 172.21.15.31:0/2260679111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a0069040 0x7f02a00af4a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0298009f20 tx=0x7f0298009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3158a4131f95dc68 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:39.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.679+0000 7f029e7fc700 1 -- 172.21.15.31:0/2260679111 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029800e070 con 0x7f02a0069040 2023-10-09T06:24:39.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.679+0000 7f029e7fc700 1 -- 172.21.15.31:0/2260679111 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029800b9d0 con 0x7f02a0069040 2023-10-09T06:24:39.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.679+0000 7f029e7fc700 1 -- 172.21.15.31:0/2260679111 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02980092e0 con 0x7f02a0069040 2023-10-09T06:24:39.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.680+0000 7f02a4cbe700 1 -- 172.21.15.31:0/2260679111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a0069040 msgr2=0x7f02a00af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.680+0000 7f02a4cbe700 1 --2- 172.21.15.31:0/2260679111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a0069040 0x7f02a00af4a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0298009f20 tx=0x7f0298009840 comp rx=0 tx=0).stop 2023-10-09T06:24:39.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.680+0000 7f02a4cbe700 1 -- 172.21.15.31:0/2260679111 shutdown_connections 2023-10-09T06:24:39.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.680+0000 7f02a4cbe700 1 --2- 172.21.15.31:0/2260679111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a0069040 0x7f02a00af4a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.680+0000 7f02a4cbe700 1 --2- 172.21.15.31:0/2260679111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a015a170 0x7f02a0068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.680+0000 7f02a4cbe700 1 -- 172.21.15.31:0/2260679111 >> 172.21.15.31:0/2260679111 conn(0x7f02a00d0bc0 msgr2=0x7f02a00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:39.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.680+0000 7f02a4cbe700 1 -- 172.21.15.31:0/2260679111 shutdown_connections 2023-10-09T06:24:39.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.680+0000 7f02a4cbe700 1 -- 172.21.15.31:0/2260679111 wait complete. 2023-10-09T06:24:39.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.681+0000 7f02a4cbe700 1 Processor -- start 2023-10-09T06:24:39.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.681+0000 7f02a4cbe700 1 -- start start 2023-10-09T06:24:39.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f02a4cbe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a0069040 0x7f02a015a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f02a4cbe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02a0159da0 0x7f02a00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f02a4cbe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015a170 0x7f02a00b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f02a4cbe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a015d560 con 0x7f02a015a170 2023-10-09T06:24:39.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f02a4cbe700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a016a000 con 0x7f02a0159da0 2023-10-09T06:24:39.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f02a4cbe700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a015bf80 con 0x7f02a0069040 2023-10-09T06:24:39.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f029ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015a170 0x7f02a00b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f029ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015a170 0x7f02a00b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47860/0 (socket says 172.21.15.31:47860) 2023-10-09T06:24:39.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f029ffff700 1 -- 172.21.15.31:0/3546268801 learned_addr learned my addr 172.21.15.31:0/3546268801 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:39.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f029effd700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02a0159da0 0x7f02a00b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f029f7fe700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a0069040 0x7f02a015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f029ffff700 1 -- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a0069040 msgr2=0x7f02a015a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f029ffff700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a0069040 0x7f02a015a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f029ffff700 1 -- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02a0159da0 msgr2=0x7f02a00b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f029ffff700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02a0159da0 0x7f02a00b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f029ffff700 1 -- 172.21.15.31:0/3546268801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0298009ae0 con 0x7f02a015a170 2023-10-09T06:24:39.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f029f7fe700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a0069040 0x7f02a015a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:39.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f029ffff700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015a170 0x7f02a00b5230 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f02a006b5c0 tx=0x7f0298018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:39.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f02877fe700 1 -- 172.21.15.31:0/3546268801 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298007bf0 con 0x7f02a015a170 2023-10-09T06:24:39.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f02877fe700 1 -- 172.21.15.31:0/3546268801 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0298007d50 con 0x7f02a015a170 2023-10-09T06:24:39.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f02a4cbe700 1 -- 172.21.15.31:0/3546268801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a015c260 con 0x7f02a015a170 2023-10-09T06:24:39.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f02877fe700 1 -- 172.21.15.31:0/3546268801 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029801d670 con 0x7f02a015a170 2023-10-09T06:24:39.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.682+0000 7f02a4cbe700 1 -- 172.21.15.31:0/3546268801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a016a540 con 0x7f02a015a170 2023-10-09T06:24:39.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.683+0000 7f02a4cbe700 1 -- 172.21.15.31:0/3546268801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a015c3f0 con 0x7f02a015a170 2023-10-09T06:24:39.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.684+0000 7f02877fe700 1 -- 172.21.15.31:0/3546268801 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0298003050 con 0x7f02a015a170 2023-10-09T06:24:39.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.684+0000 7f02877fe700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f028c066f30 0x7f028c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:39.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.684+0000 7f02877fe700 1 -- 172.21.15.31:0/3546268801 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0298086260 con 0x7f02a015a170 2023-10-09T06:24:39.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.684+0000 7f02877fe700 1 -- 172.21.15.31:0/3546268801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f028c06ea50 con 0x7f02a015a170 2023-10-09T06:24:39.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.684+0000 7f029f7fe700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f028c066f30 0x7f028c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:39.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.685+0000 7f029f7fe700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f028c066f30 0x7f028c0693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f02900011e0 tx=0x7f0290009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:39.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.688+0000 7f02877fe700 1 -- 172.21.15.31:0/3546268801 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02980534d0 con 0x7f02a015a170 2023-10-09T06:24:39.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.806+0000 7f02877fe700 1 -- 172.21.15.31:0/3546268801 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(71..71 src has 1..71) v4 ==== 1460+0+0 (secure 0 0 0) 0x7f0298057890 con 0x7f02a015a170 2023-10-09T06:24:39.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.806+0000 7f02877fe700 1 -- 172.21.15.31:0/3546268801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f028c06fc40 con 0x7f02a015a170 2023-10-09T06:24:39.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.927+0000 7f02a4cbe700 1 -- 172.21.15.31:0/3546268801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f02a016a760 con 0x7f02a015a170 2023-10-09T06:24:39.928 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:24:39.928+0000 7fc5e82b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:24:39.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.930+0000 7f02877fe700 1 -- 172.21.15.31:0/3546268801 <== mon.0 v2:172.21.15.31:3300/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 366+0+0 (secure 0 0 0) 0x7f029802ee30 con 0x7f02a015a170 2023-10-09T06:24:39.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.933+0000 7f02877fe700 1 -- 172.21.15.31:0/3546268801 <== mon.0 v2:172.21.15.31:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7f029802a020 con 0x7f02a015a170 2023-10-09T06:24:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.936+0000 7f02a4cbe700 1 -- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f028c066f30 msgr2=0x7f028c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.936+0000 7f02a4cbe700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f028c066f30 0x7f028c0693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f02900011e0 tx=0x7f0290009040 comp rx=0 tx=0).stop 2023-10-09T06:24:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.936+0000 7f02a4cbe700 1 -- 172.21.15.31:0/3546268801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015a170 msgr2=0x7f02a00b5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.936+0000 7f02a4cbe700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015a170 0x7f02a00b5230 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f02a006b5c0 tx=0x7f0298018000 comp rx=0 tx=0).stop 2023-10-09T06:24:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.936+0000 7f02a4cbe700 1 -- 172.21.15.31:0/3546268801 shutdown_connections 2023-10-09T06:24:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.936+0000 7f02a4cbe700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f028c066f30 0x7f028c0693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.936+0000 7f02a4cbe700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a0069040 0x7f02a015a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.936+0000 7f02a4cbe700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015a170 0x7f02a00b5230 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.936+0000 7f02a4cbe700 1 --2- 172.21.15.31:0/3546268801 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02a0159da0 0x7f02a00b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.936+0000 7f02a4cbe700 1 -- 172.21.15.31:0/3546268801 >> 172.21.15.31:0/3546268801 conn(0x7f02a00d0bc0 msgr2=0x7f02a00ced00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.936+0000 7f02a4cbe700 1 -- 172.21.15.31:0/3546268801 shutdown_connections 2023-10-09T06:24:39.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:39.936+0000 7f02a4cbe700 1 -- 172.21.15.31:0/3546268801 wait complete. 2023-10-09T06:24:39.938 INFO:tasks.ceph.mds.c.smithi031.stderr: -9316> 2023-10-09T06:23:10.941+0000 7fcc061d6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:24:39.939 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:24:39.953 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:24:39.974 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-10-09T06:24:40.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.075+0000 7f8968fba700 1 Processor -- start 2023-10-09T06:24:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.075+0000 7f8968fba700 1 -- start start 2023-10-09T06:24:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8968fba700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8964152300 0x7f896415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8968fba700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8964158df0 0x7f89640caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8968fba700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f896406d370 0x7f896406d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8968fba700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89640b1400 con 0x7f896406d370 2023-10-09T06:24:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8968fba700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896415c8d0 con 0x7f8964152300 2023-10-09T06:24:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8968fba700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c9370 con 0x7f8964158df0 2023-10-09T06:24:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8962d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f896406d370 0x7f896406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8962d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f896406d370 0x7f896406d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47886/0 (socket says 172.21.15.31:47886) 2023-10-09T06:24:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8962d9d700 1 -- 172.21.15.31:0/1173002961 learned_addr learned my addr 172.21.15.31:0/1173002961 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f896259c700 1 --2- 172.21.15.31:0/1173002961 >> v2:172.21.15.158:3300/0 conn(0x7f8964152300 0x7f896415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8961d9b700 1 --2- 172.21.15.31:0/1173002961 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8964158df0 0x7f89640caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8962d9d700 1 -- 172.21.15.31:0/1173002961 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8964158df0 msgr2=0x7f89640caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8962d9d700 1 --2- 172.21.15.31:0/1173002961 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8964158df0 0x7f89640caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8962d9d700 1 -- 172.21.15.31:0/1173002961 >> v2:172.21.15.158:3300/0 conn(0x7f8964152300 msgr2=0x7f896415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8962d9d700 1 --2- 172.21.15.31:0/1173002961 >> v2:172.21.15.158:3300/0 conn(0x7f8964152300 0x7f896415b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8962d9d700 1 -- 172.21.15.31:0/1173002961 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896415c030 con 0x7f896406d370 2023-10-09T06:24:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f896259c700 1 --2- 172.21.15.31:0/1173002961 >> v2:172.21.15.158:3300/0 conn(0x7f8964152300 0x7f896415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f8962d9d700 1 --2- 172.21.15.31:0/1173002961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896406d370 0x7f896406d790 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f89640cdc10 tx=0x7f895c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1dfa40a1bcbb08 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.076+0000 7f896159a700 1 -- 172.21.15.31:0/1173002961 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00e070 con 0x7f896406d370 2023-10-09T06:24:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.077+0000 7f896159a700 1 -- 172.21.15.31:0/1173002961 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c00ba20 con 0x7f896406d370 2023-10-09T06:24:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.077+0000 7f896159a700 1 -- 172.21.15.31:0/1173002961 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c0092e0 con 0x7f896406d370 2023-10-09T06:24:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.077+0000 7f8968fba700 1 -- 172.21.15.31:0/1173002961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896406d370 msgr2=0x7f896406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.077+0000 7f8968fba700 1 --2- 172.21.15.31:0/1173002961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896406d370 0x7f896406d790 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f89640cdc10 tx=0x7f895c009840 comp rx=0 tx=0).stop 2023-10-09T06:24:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.077+0000 7f8968fba700 1 -- 172.21.15.31:0/1173002961 shutdown_connections 2023-10-09T06:24:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.077+0000 7f8968fba700 1 --2- 172.21.15.31:0/1173002961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896406d370 0x7f896406d790 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.077+0000 7f8968fba700 1 --2- 172.21.15.31:0/1173002961 >> v2:172.21.15.158:3300/0 conn(0x7f8964152300 0x7f896415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.077+0000 7f8968fba700 1 --2- 172.21.15.31:0/1173002961 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8964158df0 0x7f89640caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.077+0000 7f8968fba700 1 -- 172.21.15.31:0/1173002961 >> 172.21.15.31:0/1173002961 conn(0x7f8964069870 msgr2=0x7f8964069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.077+0000 7f8968fba700 1 -- 172.21.15.31:0/1173002961 shutdown_connections 2023-10-09T06:24:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.077+0000 7f8968fba700 1 -- 172.21.15.31:0/1173002961 wait complete. 2023-10-09T06:24:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.078+0000 7f8968fba700 1 Processor -- start 2023-10-09T06:24:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.078+0000 7f8968fba700 1 -- start start 2023-10-09T06:24:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8968fba700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f896406d370 0x7f89640b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8968fba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8964152300 0x7f896414dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8968fba700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8964158df0 0x7f89640c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8968fba700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c7760 con 0x7f8964152300 2023-10-09T06:24:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8968fba700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c6b50 con 0x7f896406d370 2023-10-09T06:24:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8968fba700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c6e30 con 0x7f8964158df0 2023-10-09T06:24:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8961d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8964152300 0x7f896414dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8961d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8964152300 0x7f896414dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47900/0 (socket says 172.21.15.31:47900) 2023-10-09T06:24:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8961d9b700 1 -- 172.21.15.31:0/3754877447 learned_addr learned my addr 172.21.15.31:0/3754877447 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f896259c700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f896406d370 0x7f89640b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8962d9d700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8964158df0 0x7f89640c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8961d9b700 1 -- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8964158df0 msgr2=0x7f89640c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8961d9b700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8964158df0 0x7f89640c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8961d9b700 1 -- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f896406d370 msgr2=0x7f89640b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8961d9b700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f896406d370 0x7f89640b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8961d9b700 1 -- 172.21.15.31:0/3754877447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c009ae0 con 0x7f8964152300 2023-10-09T06:24:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.079+0000 7f8962d9d700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8964158df0 0x7f89640c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.080+0000 7f8961d9b700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8964152300 0x7f896414dd70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f895800ec80 tx=0x7f89580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.080+0000 7f89527fc700 1 -- 172.21.15.31:0/3754877447 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800c9d0 con 0x7f8964152300 2023-10-09T06:24:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.080+0000 7f89527fc700 1 -- 172.21.15.31:0/3754877447 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895800cb50 con 0x7f8964152300 2023-10-09T06:24:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.080+0000 7f8968fba700 1 -- 172.21.15.31:0/3754877447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89640c7110 con 0x7f8964152300 2023-10-09T06:24:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.080+0000 7f89527fc700 1 -- 172.21.15.31:0/3754877447 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958013470 con 0x7f8964152300 2023-10-09T06:24:40.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.080+0000 7f8968fba700 1 -- 172.21.15.31:0/3754877447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896414e2b0 con 0x7f8964152300 2023-10-09T06:24:40.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.081+0000 7f8968fba700 1 -- 172.21.15.31:0/3754877447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89640c7910 con 0x7f8964152300 2023-10-09T06:24:40.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.081+0000 7f89527fc700 1 -- 172.21.15.31:0/3754877447 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8958013860 con 0x7f8964152300 2023-10-09T06:24:40.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.082+0000 7f89527fc700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8944066f60 0x7f8944069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:40.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.082+0000 7f89527fc700 1 -- 172.21.15.31:0/3754877447 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f89580848b0 con 0x7f8964152300 2023-10-09T06:24:40.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.082+0000 7f896259c700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8944066f60 0x7f8944069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:40.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.083+0000 7f896259c700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8944066f60 0x7f8944069410 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8954006f00 tx=0x7f8954008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:40.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.086+0000 7f89527fc700 1 -- 172.21.15.31:0/3754877447 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89640c7910 con 0x7f8964152300 2023-10-09T06:24:40.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.324+0000 7f8968fba700 1 -- 172.21.15.31:0/3754877447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f896404c3c0 con 0x7f8964152300 2023-10-09T06:24:40.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.934+0000 7f89527fc700 1 -- 172.21.15.31:0/3754877447 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8958051ad0 con 0x7f8964152300 2023-10-09T06:24:40.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.937+0000 7f8968fba700 1 -- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8944066f60 msgr2=0x7f8944069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:40.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.937+0000 7f8968fba700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8944066f60 0x7f8944069410 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8954006f00 tx=0x7f8954008040 comp rx=0 tx=0).stop 2023-10-09T06:24:40.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.937+0000 7f8968fba700 1 -- 172.21.15.31:0/3754877447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8964152300 msgr2=0x7f896414dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:40.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.937+0000 7f8968fba700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8964152300 0x7f896414dd70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f895800ec80 tx=0x7f89580091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:40.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.937+0000 7f8968fba700 1 -- 172.21.15.31:0/3754877447 shutdown_connections 2023-10-09T06:24:40.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.937+0000 7f8968fba700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8944066f60 0x7f8944069410 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:40.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.937+0000 7f8968fba700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8964158df0 0x7f89640c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:40.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.937+0000 7f8968fba700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f896406d370 0x7f89640b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:40.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.937+0000 7f8968fba700 1 --2- 172.21.15.31:0/3754877447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8964152300 0x7f896414dd70 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:40.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.937+0000 7f8968fba700 1 -- 172.21.15.31:0/3754877447 >> 172.21.15.31:0/3754877447 conn(0x7f8964069870 msgr2=0x7f8964159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:40.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.937+0000 7f8968fba700 1 -- 172.21.15.31:0/3754877447 shutdown_connections 2023-10-09T06:24:40.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:40.937+0000 7f8968fba700 1 -- 172.21.15.31:0/3754877447 wait complete. 2023-10-09T06:24:40.952 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:24:41.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.122+0000 7f07a2a68700 1 Processor -- start 2023-10-09T06:24:41.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.122+0000 7f07a2a68700 1 -- start start 2023-10-09T06:24:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.123+0000 7f07a2a68700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f079c15dfd0 0x7f079c159d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.123+0000 7f07a2a68700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079c15e5b0 con 0x7f079c0cd7f0 2023-10-09T06:24:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.123+0000 7f07a2a68700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079c0ceea0 con 0x7f079c0cdbc0 2023-10-09T06:24:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.123+0000 7f07a2a68700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c15e890 con 0x7f079c15dfd0 2023-10-09T06:24:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.123+0000 7f07a2267700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f079c15dfd0 0x7f079c159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.123+0000 7f07a1a66700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f079c0cd7f0 0x7f079c15d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55712/0 (socket says 172.21.15.31:55712) 2023-10-09T06:24:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.123+0000 7f07a1a66700 1 -- 172.21.15.31:0/3595921777 learned_addr learned my addr 172.21.15.31:0/3595921777 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.123+0000 7f07a2267700 1 -- 172.21.15.31:0/3595921777 >> v1:172.21.15.158:6789/0 conn(0x7f079c0cdbc0 legacy=0x7f079c1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:41.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.123+0000 7f07a2267700 1 -- 172.21.15.31:0/3595921777 >> v1:172.21.15.31:6789/0 conn(0x7f079c0cd7f0 legacy=0x7f079c15d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:41.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.123+0000 7f07a2267700 1 -- 172.21.15.31:0/3595921777 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c0cf180 con 0x7f079c15dfd0 2023-10-09T06:24:41.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.123+0000 7f07a0a64700 1 -- 172.21.15.31:0/3595921777 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457269252 0 0) 0x7f079c15e5b0 con 0x7f079c0cd7f0 2023-10-09T06:24:41.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.124+0000 7f07a2267700 1 --2- 172.21.15.31:0/3595921777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079c15dfd0 0x7f079c159d00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0794009e60 tx=0x7f0794009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d19f121f01ed06 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:41.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.124+0000 7f07a0a64700 1 -- 172.21.15.31:0/3595921777 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079400e070 con 0x7f079c15dfd0 2023-10-09T06:24:41.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.124+0000 7f07a0a64700 1 -- 172.21.15.31:0/3595921777 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079400bc30 con 0x7f079c15dfd0 2023-10-09T06:24:41.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.124+0000 7f07a0a64700 1 -- 172.21.15.31:0/3595921777 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794012430 con 0x7f079c15dfd0 2023-10-09T06:24:41.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.124+0000 7f07a2a68700 1 -- 172.21.15.31:0/3595921777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079c15dfd0 msgr2=0x7f079c159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:41.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.124+0000 7f07a2a68700 1 --2- 172.21.15.31:0/3595921777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079c15dfd0 0x7f079c159d00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0794009e60 tx=0x7f0794009780 comp rx=0 tx=0).stop 2023-10-09T06:24:41.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.124+0000 7f07a2a68700 1 -- 172.21.15.31:0/3595921777 shutdown_connections 2023-10-09T06:24:41.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.124+0000 7f07a2a68700 1 --2- 172.21.15.31:0/3595921777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079c15dfd0 0x7f079c159d00 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:41.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.124+0000 7f07a2a68700 1 -- 172.21.15.31:0/3595921777 >> 172.21.15.31:0/3595921777 conn(0x7f079c068bf0 msgr2=0x7f079c068ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:41.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.124+0000 7f07a2a68700 1 -- 172.21.15.31:0/3595921777 shutdown_connections 2023-10-09T06:24:41.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.124+0000 7f07a2a68700 1 -- 172.21.15.31:0/3595921777 wait complete. 2023-10-09T06:24:41.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.125+0000 7f07a2a68700 1 Processor -- start 2023-10-09T06:24:41.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.125+0000 7f07a2a68700 1 -- start start 2023-10-09T06:24:41.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.126+0000 7f07a2a68700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f079c0cd7f0 0x7f079c150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:41.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.126+0000 7f07a2a68700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f079c0cdbc0 0x7f079c0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:41.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.126+0000 7f07a2a68700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079c15dfd0 0x7f079c0c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:41.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.126+0000 7f07a2a68700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c0ca630 con 0x7f079c15dfd0 2023-10-09T06:24:41.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.126+0000 7f07a2a68700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c0caac0 con 0x7f079c0cd7f0 2023-10-09T06:24:41.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.126+0000 7f07a2a68700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c0c9a20 con 0x7f079c0cdbc0 2023-10-09T06:24:41.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.126+0000 7f07a2267700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079c15dfd0 0x7f079c0c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:41.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.126+0000 7f07a2267700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079c15dfd0 0x7f079c0c59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47926/0 (socket says 172.21.15.31:47926) 2023-10-09T06:24:41.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.126+0000 7f07a2267700 1 -- 172.21.15.31:0/782949981 learned_addr learned my addr 172.21.15.31:0/782949981 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:41.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.126+0000 7f07a1a66700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f079c0cd7f0 0x7f079c150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:41.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.126+0000 7f07a1265700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f079c0cdbc0 0x7f079c0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:41.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.127+0000 7f07a2267700 1 -- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f079c0cdbc0 msgr2=0x7f079c0c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:41.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.127+0000 7f07a2267700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f079c0cdbc0 0x7f079c0c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:41.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.127+0000 7f07a2267700 1 -- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f079c0cd7f0 msgr2=0x7f079c150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:41.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.127+0000 7f07a2267700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f079c0cd7f0 0x7f079c150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:41.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.127+0000 7f07a2267700 1 -- 172.21.15.31:0/782949981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0794009a20 con 0x7f079c15dfd0 2023-10-09T06:24:41.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.127+0000 7f07a1265700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f079c0cdbc0 0x7f079c0c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:41.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.127+0000 7f07a2267700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079c15dfd0 0x7f079c0c59a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0794013000 tx=0x7f0794019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:41.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.127+0000 7f0791ffb700 1 -- 172.21.15.31:0/782949981 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794012e60 con 0x7f079c15dfd0 2023-10-09T06:24:41.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.127+0000 7f0791ffb700 1 -- 172.21.15.31:0/782949981 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079401b630 con 0x7f079c15dfd0 2023-10-09T06:24:41.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.127+0000 7f07a2a68700 1 -- 172.21.15.31:0/782949981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c0c9d00 con 0x7f079c15dfd0 2023-10-09T06:24:41.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.127+0000 7f0791ffb700 1 -- 172.21.15.31:0/782949981 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079401b9d0 con 0x7f079c15dfd0 2023-10-09T06:24:41.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.127+0000 7f07a2a68700 1 -- 172.21.15.31:0/782949981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c0ca2c0 con 0x7f079c15dfd0 2023-10-09T06:24:41.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.128+0000 7f07a2a68700 1 -- 172.21.15.31:0/782949981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079c0ca7c0 con 0x7f079c15dfd0 2023-10-09T06:24:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.128+0000 7f0791ffb700 1 -- 172.21.15.31:0/782949981 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f079401bd40 con 0x7f079c15dfd0 2023-10-09T06:24:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.129+0000 7f0791ffb700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0780066f30 0x7f07800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.129+0000 7f0791ffb700 1 -- 172.21.15.31:0/782949981 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f0794086540 con 0x7f079c15dfd0 2023-10-09T06:24:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.129+0000 7f07a1a66700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0780066f30 0x7f07800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.130+0000 7f07a1a66700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0780066f30 0x7f07800693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0798007fd0 tx=0x7f0798007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.133+0000 7f0791ffb700 1 -- 172.21.15.31:0/782949981 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07940536c0 con 0x7f079c15dfd0 2023-10-09T06:24:41.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.330+0000 7f07a2a68700 1 -- 172.21.15.31:0/782949981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f079c089520 con 0x7f079c15dfd0 2023-10-09T06:24:41.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.936+0000 7f0791ffb700 1 -- 172.21.15.31:0/782949981 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0794009880 con 0x7f079c15dfd0 2023-10-09T06:24:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.939+0000 7f07a2a68700 1 -- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0780066f30 msgr2=0x7f07800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.939+0000 7f07a2a68700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0780066f30 0x7f07800693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0798007fd0 tx=0x7f0798007d30 comp rx=0 tx=0).stop 2023-10-09T06:24:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.939+0000 7f07a2a68700 1 -- 172.21.15.31:0/782949981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079c15dfd0 msgr2=0x7f079c0c59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.939+0000 7f07a2a68700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079c15dfd0 0x7f079c0c59a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0794013000 tx=0x7f0794019000 comp rx=0 tx=0).stop 2023-10-09T06:24:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.939+0000 7f07a2a68700 1 -- 172.21.15.31:0/782949981 shutdown_connections 2023-10-09T06:24:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.939+0000 7f07a2a68700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0780066f30 0x7f07800693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.939+0000 7f07a2a68700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079c15dfd0 0x7f079c0c59a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.939+0000 7f07a2a68700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f079c0cd7f0 0x7f079c150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.939+0000 7f07a2a68700 1 --2- 172.21.15.31:0/782949981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f079c0cdbc0 0x7f079c0c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.939+0000 7f07a2a68700 1 -- 172.21.15.31:0/782949981 >> 172.21.15.31:0/782949981 conn(0x7f079c068bf0 msgr2=0x7f079c158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:41.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.939+0000 7f07a2a68700 1 -- 172.21.15.31:0/782949981 shutdown_connections 2023-10-09T06:24:41.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:41.939+0000 7f07a2a68700 1 -- 172.21.15.31:0/782949981 wait complete. 2023-10-09T06:24:41.941 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:24:41.953 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:24:42.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.078+0000 7ff76a074700 1 Processor -- start 2023-10-09T06:24:42.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.078+0000 7ff76a074700 1 -- start start 2023-10-09T06:24:42.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.079+0000 7ff76a074700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7640b4e00 0x7ff76415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:42.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.079+0000 7ff76a074700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7640b17b0 con 0x7ff7640b6a10 2023-10-09T06:24:42.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.079+0000 7ff76a074700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7640b1a60 con 0x7ff764159ef0 2023-10-09T06:24:42.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.079+0000 7ff76a074700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640b1d40 con 0x7ff7640b4e00 2023-10-09T06:24:42.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.079+0000 7ff762ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff7640b6a10 0x7ff7640b46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55718/0 (socket says 172.21.15.31:55718) 2023-10-09T06:24:42.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.079+0000 7ff762ffd700 1 -- 172.21.15.31:0/2663596264 learned_addr learned my addr 172.21.15.31:0/2663596264 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:42.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff763fff700 1 --2- 172.21.15.31:0/2663596264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7640b4e00 0x7ff76415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:42.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581205354 0 0) 0x7ff7640b17b0 con 0x7ff7640b6a10 2023-10-09T06:24:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff74c003570 con 0x7ff7640b6a10 2023-10-09T06:24:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142906225 0 0) 0x7ff7640b1a60 con 0x7ff764159ef0 2023-10-09T06:24:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7640b17b0 con 0x7ff764159ef0 2023-10-09T06:24:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2264284526 0 0) 0x7ff74c003570 con 0x7ff7640b6a10 2023-10-09T06:24:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7640b4e00 msgr2=0x7ff76415a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 --2- 172.21.15.31:0/2663596264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7640b4e00 0x7ff76415a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 >> v1:172.21.15.158:6789/0 conn(0x7ff764159ef0 legacy=0x7ff7640b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640b2020 con 0x7ff7640b6a10 2023-10-09T06:24:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7ff758001470 con 0x7ff7640b6a10 2023-10-09T06:24:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 >> v1:172.21.15.31:6789/0 conn(0x7ff7640b6a10 legacy=0x7ff7640b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 --2- 172.21.15.31:0/2663596264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7640b4e00 0x7ff74c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 --2- 172.21.15.31:0/2663596264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff74c0041d0 0x7ff74c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 --2- 172.21.15.31:0/2663596264 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff74c004d50 0x7ff74c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640b1d40 con 0x7ff74c0041d0 2023-10-09T06:24:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c00bbf0 con 0x7ff74c004d50 2023-10-09T06:24:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c00bdb0 con 0x7ff7640b4e00 2023-10-09T06:24:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff762ffd700 1 --2- 172.21.15.31:0/2663596264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff74c0041d0 0x7ff74c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff7637fe700 1 --2- 172.21.15.31:0/2663596264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7640b4e00 0x7ff74c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff763fff700 1 --2- 172.21.15.31:0/2663596264 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff74c004d50 0x7ff74c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff762ffd700 1 -- 172.21.15.31:0/2663596264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7640b4e00 msgr2=0x7ff74c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff762ffd700 1 --2- 172.21.15.31:0/2663596264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff7640b4e00 0x7ff74c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff762ffd700 1 -- 172.21.15.31:0/2663596264 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff74c004d50 msgr2=0x7ff74c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff762ffd700 1 --2- 172.21.15.31:0/2663596264 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff74c004d50 0x7ff74c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff762ffd700 1 -- 172.21.15.31:0/2663596264 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c003570 con 0x7ff74c0041d0 2023-10-09T06:24:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.080+0000 7ff763fff700 1 --2- 172.21.15.31:0/2663596264 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff74c004d50 0x7ff74c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.081+0000 7ff762ffd700 1 --2- 172.21.15.31:0/2663596264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff74c0041d0 0x7ff74c004810 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff758007fd0 tx=0x7ff758001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9220dca90e6e70e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.081+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800ca80 con 0x7ff74c0041d0 2023-10-09T06:24:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.081+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75800cbe0 con 0x7ff74c0041d0 2023-10-09T06:24:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.081+0000 7ff7627fc700 1 -- 172.21.15.31:0/2663596264 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758005920 con 0x7ff74c0041d0 2023-10-09T06:24:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.081+0000 7ff76a074700 1 -- 172.21.15.31:0/2663596264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff74c0041d0 msgr2=0x7ff74c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.081+0000 7ff76a074700 1 --2- 172.21.15.31:0/2663596264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff74c0041d0 0x7ff74c004810 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff758007fd0 tx=0x7ff758001d40 comp rx=0 tx=0).stop 2023-10-09T06:24:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.081+0000 7ff763fff700 1 -- 172.21.15.31:0/2663596264 reap_dead start 2023-10-09T06:24:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.081+0000 7ff76a074700 1 -- 172.21.15.31:0/2663596264 shutdown_connections 2023-10-09T06:24:42.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.081+0000 7ff76a074700 1 -- 172.21.15.31:0/2663596264 >> 172.21.15.31:0/2663596264 conn(0x7ff76409a0a0 msgr2=0x7ff764067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:42.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.081+0000 7ff76a074700 1 -- 172.21.15.31:0/2663596264 shutdown_connections 2023-10-09T06:24:42.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.081+0000 7ff76a074700 1 -- 172.21.15.31:0/2663596264 wait complete. 2023-10-09T06:24:42.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.083+0000 7ff76a074700 1 Processor -- start 2023-10-09T06:24:42.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.083+0000 7ff76a074700 1 -- start start 2023-10-09T06:24:42.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.083+0000 7ff76a074700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff74c0041d0 0x7ff76416a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:42.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.083+0000 7ff76a074700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7641573a0 0x7ff7640acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:42.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.083+0000 7ff76a074700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff764158950 0x7ff764158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:42.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.083+0000 7ff76a074700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640ac230 con 0x7ff764158950 2023-10-09T06:24:42.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.083+0000 7ff76a074700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff764159330 con 0x7ff7641573a0 2023-10-09T06:24:42.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.083+0000 7ff76a074700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76416d9e0 con 0x7ff74c0041d0 2023-10-09T06:24:42.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff763fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff764158950 0x7ff764158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:42.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff763fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff764158950 0x7ff764158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47944/0 (socket says 172.21.15.31:47944) 2023-10-09T06:24:42.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff763fff700 1 -- 172.21.15.31:0/2603532321 learned_addr learned my addr 172.21.15.31:0/2603532321 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:42.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff7637fe700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff74c0041d0 0x7ff76416a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:42.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff762ffd700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7641573a0 0x7ff7640acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff763fff700 1 -- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff74c0041d0 msgr2=0x7ff76416a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff763fff700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff74c0041d0 0x7ff76416a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff763fff700 1 -- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7641573a0 msgr2=0x7ff7640acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff763fff700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7641573a0 0x7ff7640acf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff763fff700 1 -- 172.21.15.31:0/2603532321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76416a8f0 con 0x7ff764158950 2023-10-09T06:24:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff763fff700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff764158950 0x7ff764158df0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff7640b5200 tx=0x7ff75c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff74b7fe700 1 -- 172.21.15.31:0/2603532321 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00e030 con 0x7ff764158950 2023-10-09T06:24:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff74b7fe700 1 -- 172.21.15.31:0/2603532321 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c011b80 con 0x7ff764158950 2023-10-09T06:24:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff76a074700 1 -- 172.21.15.31:0/2603532321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76416ab80 con 0x7ff764158950 2023-10-09T06:24:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff74b7fe700 1 -- 172.21.15.31:0/2603532321 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c016470 con 0x7ff764158950 2023-10-09T06:24:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.084+0000 7ff76a074700 1 -- 172.21.15.31:0/2603532321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76416b140 con 0x7ff764158950 2023-10-09T06:24:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.085+0000 7ff76a074700 1 -- 172.21.15.31:0/2603532321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76404c3c0 con 0x7ff764158950 2023-10-09T06:24:42.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.086+0000 7ff74b7fe700 1 -- 172.21.15.31:0/2603532321 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff75c016860 con 0x7ff764158950 2023-10-09T06:24:42.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.086+0000 7ff74b7fe700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff750066f60 0x7ff750069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:42.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.086+0000 7ff74b7fe700 1 -- 172.21.15.31:0/2603532321 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5353+0+0 (secure 0 0 0) 0x7ff75c00f070 con 0x7ff764158950 2023-10-09T06:24:42.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.086+0000 7ff7637fe700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff750066f60 0x7ff750069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:42.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.087+0000 7ff7637fe700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff750066f60 0x7ff750069410 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff754000c00 tx=0x7ff754007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:42.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.090+0000 7ff74b7fe700 1 -- 172.21.15.31:0/2603532321 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff75c051ec0 con 0x7ff764158950 2023-10-09T06:24:42.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.283+0000 7ff76a074700 1 -- 172.21.15.31:0/2603532321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff7640ab430 con 0x7ff764158950 2023-10-09T06:24:42.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.941+0000 7ff74b7fe700 1 -- 172.21.15.31:0/2603532321 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff75c0554e0 con 0x7ff764158950 2023-10-09T06:24:42.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.943+0000 7ff76a074700 1 -- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff750066f60 msgr2=0x7ff750069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:42.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.943+0000 7ff76a074700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff750066f60 0x7ff750069410 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff754000c00 tx=0x7ff754007d80 comp rx=0 tx=0).stop 2023-10-09T06:24:42.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.943+0000 7ff76a074700 1 -- 172.21.15.31:0/2603532321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff764158950 msgr2=0x7ff764158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:42.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.943+0000 7ff76a074700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff764158950 0x7ff764158df0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff7640b5200 tx=0x7ff75c00b040 comp rx=0 tx=0).stop 2023-10-09T06:24:42.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.943+0000 7ff76a074700 1 -- 172.21.15.31:0/2603532321 shutdown_connections 2023-10-09T06:24:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.943+0000 7ff76a074700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff750066f60 0x7ff750069410 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.943+0000 7ff76a074700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff74c0041d0 0x7ff76416a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.943+0000 7ff76a074700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff764158950 0x7ff764158df0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.943+0000 7ff76a074700 1 --2- 172.21.15.31:0/2603532321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7641573a0 0x7ff7640acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.943+0000 7ff76a074700 1 -- 172.21.15.31:0/2603532321 >> 172.21.15.31:0/2603532321 conn(0x7ff76409a0a0 msgr2=0x7ff76415b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.943+0000 7ff76a074700 1 -- 172.21.15.31:0/2603532321 shutdown_connections 2023-10-09T06:24:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:42.943+0000 7ff76a074700 1 -- 172.21.15.31:0/2603532321 wait complete. 2023-10-09T06:24:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2023-10-09T06:24:42.957 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:24:43.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.080+0000 7fcc9e5f9700 1 Processor -- start 2023-10-09T06:24:43.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.080+0000 7fcc9e5f9700 1 -- start start 2023-10-09T06:24:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.081+0000 7fcc9e5f9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc9815a290 0x7fcc9806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.081+0000 7fcc9e5f9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcc9806aae0 0x7fcc980cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.081+0000 7fcc9e5f9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc980b0790 con 0x7fcc98159ec0 2023-10-09T06:24:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.081+0000 7fcc9e5f9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9806af60 con 0x7fcc9806aae0 2023-10-09T06:24:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.081+0000 7fcc9e5f9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc980ce1f0 con 0x7fcc9815a290 2023-10-09T06:24:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.081+0000 7fcc97fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcc98159ec0 0x7fcc980af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55732/0 (socket says 172.21.15.31:55732) 2023-10-09T06:24:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.081+0000 7fcc97fff700 1 -- 172.21.15.31:0/720933038 learned_addr learned my addr 172.21.15.31:0/720933038 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc9cb96700 1 --2- 172.21.15.31:0/720933038 >> v2:172.21.15.158:3300/0 conn(0x7fcc9806aae0 0x7fcc980cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc977fe700 1 --2- 172.21.15.31:0/720933038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc9815a290 0x7fcc9806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479362318 0 0) 0x7fcc980b0790 con 0x7fcc98159ec0 2023-10-09T06:24:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc84003570 con 0x7fcc98159ec0 2023-10-09T06:24:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3969487973 0 0) 0x7fcc84003570 con 0x7fcc98159ec0 2023-10-09T06:24:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc9815a290 msgr2=0x7fcc9806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 --2- 172.21.15.31:0/720933038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc9815a290 0x7fcc9806a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 >> v2:172.21.15.158:3300/0 conn(0x7fcc9806aae0 msgr2=0x7fcc980cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 --2- 172.21.15.31:0/720933038 >> v2:172.21.15.158:3300/0 conn(0x7fcc9806aae0 0x7fcc980cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc980b0b20 con 0x7fcc98159ec0 2023-10-09T06:24:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fcc88001470 con 0x7fcc98159ec0 2023-10-09T06:24:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc977fe700 1 --2- 172.21.15.31:0/720933038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc9815a290 0x7fcc9806a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:24:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc9cb96700 1 --2- 172.21.15.31:0/720933038 >> v2:172.21.15.158:3300/0 conn(0x7fcc9806aae0 0x7fcc980cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:24:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 >> v1:172.21.15.31:6789/0 conn(0x7fcc98159ec0 legacy=0x7fcc980af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:43.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 --2- 172.21.15.31:0/720933038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc9815a290 0x7fcc84003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 --2- 172.21.15.31:0/720933038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc84003fa0 0x7fcc84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 --2- 172.21.15.31:0/720933038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc84004d50 0x7fcc840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9806af60 con 0x7fcc84004d50 2023-10-09T06:24:43.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc980ce1f0 con 0x7fcc84003fa0 2023-10-09T06:24:43.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8400ba60 con 0x7fcc9815a290 2023-10-09T06:24:43.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc9cb96700 1 --2- 172.21.15.31:0/720933038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc84004d50 0x7fcc840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc97fff700 1 --2- 172.21.15.31:0/720933038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc9815a290 0x7fcc84003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.082+0000 7fcc977fe700 1 --2- 172.21.15.31:0/720933038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc84003fa0 0x7fcc84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc9cb96700 1 -- 172.21.15.31:0/720933038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc9815a290 msgr2=0x7fcc84003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:43.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc9cb96700 1 --2- 172.21.15.31:0/720933038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc9815a290 0x7fcc84003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc9cb96700 1 -- 172.21.15.31:0/720933038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc84003fa0 msgr2=0x7fcc84004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:43.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc9cb96700 1 --2- 172.21.15.31:0/720933038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc84003fa0 0x7fcc84004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc9cb96700 1 -- 172.21.15.31:0/720933038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc80009420 con 0x7fcc84004d50 2023-10-09T06:24:43.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc9cb96700 1 --2- 172.21.15.31:0/720933038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc84004d50 0x7fcc840051c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000e3c0 tx=0x7fcc9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22a511e87c1c871 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:43.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9000ec70 con 0x7fcc84004d50 2023-10-09T06:24:43.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9000f040 con 0x7fcc84004d50 2023-10-09T06:24:43.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc96ffd700 1 -- 172.21.15.31:0/720933038 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90014480 con 0x7fcc84004d50 2023-10-09T06:24:43.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/720933038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc84004d50 msgr2=0x7fcc840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:43.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc9e5f9700 1 --2- 172.21.15.31:0/720933038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc84004d50 0x7fcc840051c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000e3c0 tx=0x7fcc9000b040 comp rx=0 tx=0).stop 2023-10-09T06:24:43.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc9cb96700 1 -- 172.21.15.31:0/720933038 reap_dead start 2023-10-09T06:24:43.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/720933038 shutdown_connections 2023-10-09T06:24:43.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/720933038 >> 172.21.15.31:0/720933038 conn(0x7fcc980d1880 msgr2=0x7fcc980cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:43.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/720933038 shutdown_connections 2023-10-09T06:24:43.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.083+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/720933038 wait complete. 2023-10-09T06:24:43.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.084+0000 7fcc9e5f9700 1 Processor -- start 2023-10-09T06:24:43.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.085+0000 7fcc9e5f9700 1 -- start start 2023-10-09T06:24:43.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.085+0000 7fcc9e5f9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84004d50 0x7fcc9815a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.085+0000 7fcc9e5f9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc9815fbd0 0x7fcc98158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.085+0000 7fcc9e5f9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc98158dd0 0x7fcc981555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.085+0000 7fcc9e5f9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9815eea0 con 0x7fcc9815fbd0 2023-10-09T06:24:43.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.085+0000 7fcc9e5f9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc981575a0 con 0x7fcc98158dd0 2023-10-09T06:24:43.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.085+0000 7fcc9e5f9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc981577f0 con 0x7fcc84004d50 2023-10-09T06:24:43.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.085+0000 7fcc977fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc9815fbd0 0x7fcc98158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.085+0000 7fcc977fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc9815fbd0 0x7fcc98158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47964/0 (socket says 172.21.15.31:47964) 2023-10-09T06:24:43.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.085+0000 7fcc977fe700 1 -- 172.21.15.31:0/1756252922 learned_addr learned my addr 172.21.15.31:0/1756252922 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:43.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.086+0000 7fcc97fff700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84004d50 0x7fcc9815a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.086+0000 7fcc9cb96700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc98158dd0 0x7fcc981555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.086+0000 7fcc977fe700 1 -- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84004d50 msgr2=0x7fcc9815a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:43.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.086+0000 7fcc977fe700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84004d50 0x7fcc9815a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.086+0000 7fcc977fe700 1 -- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc98158dd0 msgr2=0x7fcc981555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:43.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.086+0000 7fcc977fe700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc98158dd0 0x7fcc981555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.086+0000 7fcc977fe700 1 -- 172.21.15.31:0/1756252922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98157ad0 con 0x7fcc9815fbd0 2023-10-09T06:24:43.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.086+0000 7fcc977fe700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc9815fbd0 0x7fcc98158890 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fcc80011d70 tx=0x7fcc800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:43.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.086+0000 7fcc8ffff700 1 -- 172.21.15.31:0/1756252922 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80011e70 con 0x7fcc9815fbd0 2023-10-09T06:24:43.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.086+0000 7fcc8ffff700 1 -- 172.21.15.31:0/1756252922 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8000fc20 con 0x7fcc9815fbd0 2023-10-09T06:24:43.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.086+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/1756252922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc98157db0 con 0x7fcc9815fbd0 2023-10-09T06:24:43.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.086+0000 7fcc8ffff700 1 -- 172.21.15.31:0/1756252922 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8001d480 con 0x7fcc9815fbd0 2023-10-09T06:24:43.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.086+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/1756252922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc98158370 con 0x7fcc9815fbd0 2023-10-09T06:24:43.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.087+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/1756252922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc981586e0 con 0x7fcc9815fbd0 2023-10-09T06:24:43.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.087+0000 7fcc8ffff700 1 -- 172.21.15.31:0/1756252922 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc8001d870 con 0x7fcc9815fbd0 2023-10-09T06:24:43.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.088+0000 7fcc8ffff700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc78066f30 0x7fcc780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.088+0000 7fcc8ffff700 1 -- 172.21.15.31:0/1756252922 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcc80018070 con 0x7fcc9815fbd0 2023-10-09T06:24:43.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.088+0000 7fcc97fff700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc78066f30 0x7fcc780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.088+0000 7fcc97fff700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc78066f30 0x7fcc780693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcc880079e0 tx=0x7fcc88001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:43.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.092+0000 7fcc8ffff700 1 -- 172.21.15.31:0/1756252922 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc800525e0 con 0x7fcc9815fbd0 2023-10-09T06:24:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.285+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/1756252922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcc9804c3c0 con 0x7fcc9815fbd0 2023-10-09T06:24:43.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.288+0000 7fcc8ffff700 1 -- 172.21.15.31:0/1756252922 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcc80055c00 con 0x7fcc9815fbd0 2023-10-09T06:24:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.290+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc78066f30 msgr2=0x7fcc780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.290+0000 7fcc9e5f9700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc78066f30 0x7fcc780693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcc880079e0 tx=0x7fcc88001e90 comp rx=0 tx=0).stop 2023-10-09T06:24:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.290+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/1756252922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc9815fbd0 msgr2=0x7fcc98158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.290+0000 7fcc9e5f9700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc9815fbd0 0x7fcc98158890 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fcc80011d70 tx=0x7fcc800091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.290+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/1756252922 shutdown_connections 2023-10-09T06:24:43.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.290+0000 7fcc9e5f9700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc78066f30 0x7fcc780693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.290+0000 7fcc9e5f9700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84004d50 0x7fcc9815a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.290+0000 7fcc9e5f9700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc98158dd0 0x7fcc981555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.290+0000 7fcc9e5f9700 1 --2- 172.21.15.31:0/1756252922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc9815fbd0 0x7fcc98158890 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.290+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/1756252922 >> 172.21.15.31:0/1756252922 conn(0x7fcc980d1880 msgr2=0x7fcc980b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:43.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.290+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/1756252922 shutdown_connections 2023-10-09T06:24:43.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.290+0000 7fcc9e5f9700 1 -- 172.21.15.31:0/1756252922 wait complete. 2023-10-09T06:24:43.303 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-09T06:24:43.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.422+0000 7ff70275b700 1 Processor -- start 2023-10-09T06:24:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.422+0000 7ff70275b700 1 -- start start 2023-10-09T06:24:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.422+0000 7ff70275b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff6fc159e10 0x7ff6fc0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.422+0000 7ff70275b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff6fc15a1e0 0x7ff6fc0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.422+0000 7ff70275b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6fc0b1610 0x7ff6fc0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff70275b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc15e800 con 0x7ff6fc15a1e0 2023-10-09T06:24:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff70275b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc15db80 con 0x7ff6fc159e10 2023-10-09T06:24:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff70275b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc15de60 con 0x7ff6fc0b1610 2023-10-09T06:24:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff6fb7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff6fc15a1e0 0x7ff6fc0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff6fb7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff6fc15a1e0 0x7ff6fc0b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47966/0 (socket says 172.21.15.31:47966) 2023-10-09T06:24:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff6fb7fe700 1 -- 172.21.15.31:0/358355021 learned_addr learned my addr 172.21.15.31:0/358355021 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff6fb7fe700 1 -- 172.21.15.31:0/358355021 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6fc0b1610 msgr2=0x7ff6fc0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff6fb7fe700 1 --2- 172.21.15.31:0/358355021 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6fc0b1610 0x7ff6fc0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff6fb7fe700 1 -- 172.21.15.31:0/358355021 >> v2:172.21.15.158:3300/0 conn(0x7ff6fc159e10 msgr2=0x7ff6fc0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff6fbfff700 1 --2- 172.21.15.31:0/358355021 >> v2:172.21.15.158:3300/0 conn(0x7ff6fc159e10 0x7ff6fc0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff6fb7fe700 1 --2- 172.21.15.31:0/358355021 >> v2:172.21.15.158:3300/0 conn(0x7ff6fc159e10 0x7ff6fc0b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff6fb7fe700 1 -- 172.21.15.31:0/358355021 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc15e140 con 0x7ff6fc15a1e0 2023-10-09T06:24:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff6fb7fe700 1 --2- 172.21.15.31:0/358355021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6fc15a1e0 0x7ff6fc0b3260 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc068a60 tx=0x7ff6ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d2db10b30f7ea1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff6faffd700 1 -- 172.21.15.31:0/358355021 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00b860 con 0x7ff6fc15a1e0 2023-10-09T06:24:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff6faffd700 1 -- 172.21.15.31:0/358355021 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec00b9c0 con 0x7ff6fc15a1e0 2023-10-09T06:24:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.423+0000 7ff6faffd700 1 -- 172.21.15.31:0/358355021 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00bd60 con 0x7ff6fc15a1e0 2023-10-09T06:24:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.424+0000 7ff70275b700 1 -- 172.21.15.31:0/358355021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6fc15a1e0 msgr2=0x7ff6fc0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.424+0000 7ff70275b700 1 --2- 172.21.15.31:0/358355021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6fc15a1e0 0x7ff6fc0b3260 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc068a60 tx=0x7ff6ec009250 comp rx=0 tx=0).stop 2023-10-09T06:24:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.424+0000 7ff70275b700 1 -- 172.21.15.31:0/358355021 shutdown_connections 2023-10-09T06:24:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.424+0000 7ff70275b700 1 --2- 172.21.15.31:0/358355021 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6fc0b1610 0x7ff6fc0cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.424+0000 7ff70275b700 1 --2- 172.21.15.31:0/358355021 >> v2:172.21.15.158:3300/0 conn(0x7ff6fc159e10 0x7ff6fc0b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.424+0000 7ff70275b700 1 --2- 172.21.15.31:0/358355021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6fc15a1e0 0x7ff6fc0b3260 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.424+0000 7ff70275b700 1 -- 172.21.15.31:0/358355021 >> 172.21.15.31:0/358355021 conn(0x7ff6fc067660 msgr2=0x7ff6fc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.424+0000 7ff70275b700 1 -- 172.21.15.31:0/358355021 shutdown_connections 2023-10-09T06:24:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.424+0000 7ff70275b700 1 -- 172.21.15.31:0/358355021 wait complete. 2023-10-09T06:24:43.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.425+0000 7ff70275b700 1 Processor -- start 2023-10-09T06:24:43.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.425+0000 7ff70275b700 1 -- start start 2023-10-09T06:24:43.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff70275b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6fc0b1610 0x7ff6fc157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff70275b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6fc159e10 0x7ff6fc0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff70275b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6fc15a1e0 0x7ff6fc0c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff70275b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc157bb0 con 0x7ff6fc159e10 2023-10-09T06:24:43.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff70275b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0c6430 con 0x7ff6fc0b1610 2023-10-09T06:24:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff70275b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0c5820 con 0x7ff6fc15a1e0 2023-10-09T06:24:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff6fb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6fc159e10 0x7ff6fc0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff6fb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6fc159e10 0x7ff6fc0caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47970/0 (socket says 172.21.15.31:47970) 2023-10-09T06:24:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff6fb7fe700 1 -- 172.21.15.31:0/745837342 learned_addr learned my addr 172.21.15.31:0/745837342 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff6fbfff700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6fc0b1610 0x7ff6fc157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff700cf8700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6fc15a1e0 0x7ff6fc0c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff6fb7fe700 1 -- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6fc15a1e0 msgr2=0x7ff6fc0c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff6fb7fe700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6fc15a1e0 0x7ff6fc0c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff6fb7fe700 1 -- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6fc0b1610 msgr2=0x7ff6fc157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff6fb7fe700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6fc0b1610 0x7ff6fc157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff6fb7fe700 1 -- 172.21.15.31:0/745837342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec0094f0 con 0x7ff6fc159e10 2023-10-09T06:24:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff6fbfff700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6fc0b1610 0x7ff6fc157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff700cf8700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6fc15a1e0 0x7ff6fc0c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.426+0000 7ff6fb7fe700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6fc159e10 0x7ff6fc0caa50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009290 tx=0x7ff6ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.427+0000 7ff6f3fff700 1 -- 172.21.15.31:0/745837342 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec026480 con 0x7ff6fc159e10 2023-10-09T06:24:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.427+0000 7ff6f3fff700 1 -- 172.21.15.31:0/745837342 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec01f070 con 0x7ff6fc159e10 2023-10-09T06:24:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.427+0000 7ff70275b700 1 -- 172.21.15.31:0/745837342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc0c5b00 con 0x7ff6fc159e10 2023-10-09T06:24:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.427+0000 7ff6f3fff700 1 -- 172.21.15.31:0/745837342 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec026830 con 0x7ff6fc159e10 2023-10-09T06:24:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.427+0000 7ff70275b700 1 -- 172.21.15.31:0/745837342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc0c60c0 con 0x7ff6fc159e10 2023-10-09T06:24:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.428+0000 7ff70275b700 1 -- 172.21.15.31:0/745837342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc04c3c0 con 0x7ff6fc159e10 2023-10-09T06:24:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.428+0000 7ff6f3fff700 1 -- 172.21.15.31:0/745837342 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6ec026ba0 con 0x7ff6fc159e10 2023-10-09T06:24:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.428+0000 7ff6f3fff700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff6dc066f30 0x7ff6dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:43.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.428+0000 7ff6f3fff700 1 -- 172.21.15.31:0/745837342 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff6ec021070 con 0x7ff6fc159e10 2023-10-09T06:24:43.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.429+0000 7ff6fbfff700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff6dc066f30 0x7ff6dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:43.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.429+0000 7ff6fbfff700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff6dc066f30 0x7ff6dc0693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4008a80 tx=0x7ff6e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:43.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.433+0000 7ff6f3fff700 1 -- 172.21.15.31:0/745837342 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6ec053650 con 0x7ff6fc159e10 2023-10-09T06:24:43.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.714+0000 7ff70275b700 1 -- 172.21.15.31:0/745837342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7ff6fc0c6570 con 0x7ff6fc159e10 2023-10-09T06:24:43.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.942+0000 7ff6f3fff700 1 -- 172.21.15.31:0/745837342 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v199) v1 ==== 134+0+0 (secure 0 0 0) 0x7ff6ec056c70 con 0x7ff6fc159e10 2023-10-09T06:24:43.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.944+0000 7ff70275b700 1 -- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff6dc066f30 msgr2=0x7ff6dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:43.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.944+0000 7ff70275b700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff6dc066f30 0x7ff6dc0693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4008a80 tx=0x7ff6e4008040 comp rx=0 tx=0).stop 2023-10-09T06:24:43.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.944+0000 7ff70275b700 1 -- 172.21.15.31:0/745837342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6fc159e10 msgr2=0x7ff6fc0caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:43.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.944+0000 7ff70275b700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6fc159e10 0x7ff6fc0caa50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009290 tx=0x7ff6ec017000 comp rx=0 tx=0).stop 2023-10-09T06:24:43.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.944+0000 7ff70275b700 1 -- 172.21.15.31:0/745837342 shutdown_connections 2023-10-09T06:24:43.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.944+0000 7ff70275b700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff6dc066f30 0x7ff6dc0693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.944+0000 7ff70275b700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6fc15a1e0 0x7ff6fc0c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.944+0000 7ff70275b700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6fc0b1610 0x7ff6fc157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.944+0000 7ff70275b700 1 --2- 172.21.15.31:0/745837342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6fc159e10 0x7ff6fc0caa50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:43.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.944+0000 7ff70275b700 1 -- 172.21.15.31:0/745837342 >> 172.21.15.31:0/745837342 conn(0x7ff6fc067660 msgr2=0x7ff6fc15d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:43.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.945+0000 7ff70275b700 1 -- 172.21.15.31:0/745837342 shutdown_connections 2023-10-09T06:24:43.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:43.945+0000 7ff70275b700 1 -- 172.21.15.31:0/745837342 wait complete. 2023-10-09T06:24:43.958 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-09T06:24:43.958 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-10-09T06:24:43.958 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-10-09T06:24:43.958 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-09T06:24:44.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.078+0000 7f4dfca4e700 1 Processor -- start 2023-10-09T06:24:44.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.078+0000 7f4dfca4e700 1 -- start start 2023-10-09T06:24:44.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.079+0000 7f4dfca4e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4df80afd90 0x7f4df80c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:44.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.079+0000 7f4dfca4e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4df806f1a0 0x7f4df815b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:44.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.079+0000 7f4dfca4e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df80ca270 con 0x7f4df80b0160 2023-10-09T06:24:44.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.079+0000 7f4dfca4e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df80c87c0 con 0x7f4df80afd90 2023-10-09T06:24:44.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.079+0000 7f4dfca4e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df815b770 con 0x7f4df806f1a0 2023-10-09T06:24:44.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.079+0000 7f4df5d9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4df806f1a0 0x7f4df815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:44.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.079+0000 7f4df659c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4df80afd90 0x7f4df80c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:44.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.079+0000 7f4df5d9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4df806f1a0 0x7f4df815b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:60218/0 (socket says 172.21.15.31:60218) 2023-10-09T06:24:44.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.079+0000 7f4df6d9d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f4df80b0160 0x7f4df8070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:48378/0 (socket says 172.21.15.31:48378) 2023-10-09T06:24:44.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.079+0000 7f4df5d9b700 1 -- 172.21.15.31:0/2806165131 learned_addr learned my addr 172.21.15.31:0/2806165131 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:44.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.080+0000 7f4df5d9b700 1 -- 172.21.15.31:0/2806165131 >> v2:172.21.15.158:3300/0 conn(0x7f4df80afd90 msgr2=0x7f4df80c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:44.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.080+0000 7f4df5d9b700 1 --2- 172.21.15.31:0/2806165131 >> v2:172.21.15.158:3300/0 conn(0x7f4df80afd90 0x7f4df80c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:44.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.080+0000 7f4df5d9b700 1 -- 172.21.15.31:0/2806165131 >> v1:172.21.15.158:6789/0 conn(0x7f4df80b0160 legacy=0x7f4df8070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:44.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.080+0000 7f4df5d9b700 1 -- 172.21.15.31:0/2806165131 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df806e3e0 con 0x7f4df806f1a0 2023-10-09T06:24:44.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.080+0000 7f4df5d9b700 1 --2- 172.21.15.31:0/2806165131 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4df806f1a0 0x7f4df815b230 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4de00099b0 tx=0x7f4de0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=744ad792e9f44906 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:44.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.080+0000 7f4df559a700 1 -- 172.21.15.31:0/2806165131 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de0009ea0 con 0x7f4df806f1a0 2023-10-09T06:24:44.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.080+0000 7f4df559a700 1 -- 172.21.15.31:0/2806165131 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de000b860 con 0x7f4df806f1a0 2023-10-09T06:24:44.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.080+0000 7f4df559a700 1 -- 172.21.15.31:0/2806165131 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000bc00 con 0x7f4df806f1a0 2023-10-09T06:24:44.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.080+0000 7f4dfca4e700 1 -- 172.21.15.31:0/2806165131 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4df806f1a0 msgr2=0x7f4df815b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:44.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.080+0000 7f4dfca4e700 1 --2- 172.21.15.31:0/2806165131 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4df806f1a0 0x7f4df815b230 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4de00099b0 tx=0x7f4de0009250 comp rx=0 tx=0).stop 2023-10-09T06:24:44.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.081+0000 7f4dfca4e700 1 -- 172.21.15.31:0/2806165131 shutdown_connections 2023-10-09T06:24:44.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.081+0000 7f4dfca4e700 1 --2- 172.21.15.31:0/2806165131 >> v2:172.21.15.158:3300/0 conn(0x7f4df80afd90 0x7f4df80c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:44.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.081+0000 7f4dfca4e700 1 --2- 172.21.15.31:0/2806165131 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4df806f1a0 0x7f4df815b230 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:44.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.081+0000 7f4dfca4e700 1 -- 172.21.15.31:0/2806165131 >> 172.21.15.31:0/2806165131 conn(0x7f4df80ca4f0 msgr2=0x7f4df80ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:44.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.081+0000 7f4dfca4e700 1 -- 172.21.15.31:0/2806165131 shutdown_connections 2023-10-09T06:24:44.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.081+0000 7f4dfca4e700 1 -- 172.21.15.31:0/2806165131 wait complete. 2023-10-09T06:24:44.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.082+0000 7f4dfca4e700 1 Processor -- start 2023-10-09T06:24:44.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.082+0000 7f4dfca4e700 1 -- start start 2023-10-09T06:24:44.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.082+0000 7f4dfca4e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4df806f1a0 0x7f4df8159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:44.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.082+0000 7f4dfca4e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80afd90 0x7f4df81553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:44.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4dfca4e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4df80b0160 0x7f4df815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:44.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4dfca4e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df81594a0 con 0x7f4df80afd90 2023-10-09T06:24:44.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4dfca4e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df8158890 con 0x7f4df806f1a0 2023-10-09T06:24:44.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4dfca4e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df8158b70 con 0x7f4df80b0160 2023-10-09T06:24:44.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4df5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80afd90 0x7f4df81553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:44.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4df5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80afd90 0x7f4df81553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47982/0 (socket says 172.21.15.31:47982) 2023-10-09T06:24:44.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4df5d9b700 1 -- 172.21.15.31:0/1974184593 learned_addr learned my addr 172.21.15.31:0/1974184593 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:44.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4df659c700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4df806f1a0 0x7f4df8159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:44.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4df6d9d700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4df80b0160 0x7f4df815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:44.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4df5d9b700 1 -- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4df80b0160 msgr2=0x7f4df815edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:44.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4df5d9b700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4df80b0160 0x7f4df815edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:44.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4df5d9b700 1 -- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4df806f1a0 msgr2=0x7f4df8159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:44.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4df5d9b700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4df806f1a0 0x7f4df8159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:44.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4df5d9b700 1 -- 172.21.15.31:0/1974184593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de00094f0 con 0x7f4df80afd90 2023-10-09T06:24:44.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4df659c700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4df806f1a0 0x7f4df8159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:44.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4df5d9b700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80afd90 0x7f4df81553a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4df815b8b0 tx=0x7f4de0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:44.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4dee7fc700 1 -- 172.21.15.31:0/1974184593 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000bbe0 con 0x7f4df80afd90 2023-10-09T06:24:44.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4dee7fc700 1 -- 172.21.15.31:0/1974184593 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de0011420 con 0x7f4df80afd90 2023-10-09T06:24:44.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4dfca4e700 1 -- 172.21.15.31:0/1974184593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df8158e50 con 0x7f4df80afd90 2023-10-09T06:24:44.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4dee7fc700 1 -- 172.21.15.31:0/1974184593 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de00117c0 con 0x7f4df80afd90 2023-10-09T06:24:44.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.083+0000 7f4dfca4e700 1 -- 172.21.15.31:0/1974184593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df8159e70 con 0x7f4df80afd90 2023-10-09T06:24:44.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.084+0000 7f4dfca4e700 1 -- 172.21.15.31:0/1974184593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df8159650 con 0x7f4df80afd90 2023-10-09T06:24:44.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.085+0000 7f4dee7fc700 1 -- 172.21.15.31:0/1974184593 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4de0011bf0 con 0x7f4df80afd90 2023-10-09T06:24:44.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.085+0000 7f4dee7fc700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4dd8066f30 0x7f4dd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:44.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.085+0000 7f4dee7fc700 1 -- 172.21.15.31:0/1974184593 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4de0085b30 con 0x7f4df80afd90 2023-10-09T06:24:44.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.085+0000 7f4df659c700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4dd8066f30 0x7f4dd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:44.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.086+0000 7f4df659c700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4dd8066f30 0x7f4dd80693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009d80 tx=0x7f4df0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:44.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.089+0000 7f4dee7fc700 1 -- 172.21.15.31:0/1974184593 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4df8159650 con 0x7f4df80afd90 2023-10-09T06:24:44.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.361+0000 7f4dfca4e700 1 -- 172.21.15.31:0/1974184593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f4df804c3c0 con 0x7f4df80afd90 2023-10-09T06:24:44.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.946+0000 7f4dee7fc700 1 -- 172.21.15.31:0/1974184593 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v200) v1 ==== 136+0+0 (secure 0 0 0) 0x7f4de00530a0 con 0x7f4df80afd90 2023-10-09T06:24:44.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.948+0000 7f4dfca4e700 1 -- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4dd8066f30 msgr2=0x7f4dd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:44.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.948+0000 7f4dfca4e700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4dd8066f30 0x7f4dd80693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009d80 tx=0x7f4df0008040 comp rx=0 tx=0).stop 2023-10-09T06:24:44.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.948+0000 7f4dfca4e700 1 -- 172.21.15.31:0/1974184593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80afd90 msgr2=0x7f4df81553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:44.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.948+0000 7f4dfca4e700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80afd90 0x7f4df81553a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4df815b8b0 tx=0x7f4de0017000 comp rx=0 tx=0).stop 2023-10-09T06:24:44.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.948+0000 7f4dfca4e700 1 -- 172.21.15.31:0/1974184593 shutdown_connections 2023-10-09T06:24:44.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.948+0000 7f4dfca4e700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4dd8066f30 0x7f4dd80693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:44.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.948+0000 7f4dfca4e700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4df80b0160 0x7f4df815edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:44.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.948+0000 7f4dfca4e700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4df806f1a0 0x7f4df8159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:44.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.948+0000 7f4dfca4e700 1 --2- 172.21.15.31:0/1974184593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80afd90 0x7f4df81553a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:44.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.948+0000 7f4dfca4e700 1 -- 172.21.15.31:0/1974184593 >> 172.21.15.31:0/1974184593 conn(0x7f4df80ca4f0 msgr2=0x7f4df815b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:44.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.948+0000 7f4dfca4e700 1 -- 172.21.15.31:0/1974184593 shutdown_connections 2023-10-09T06:24:44.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:44.948+0000 7f4dfca4e700 1 -- 172.21.15.31:0/1974184593 wait complete. 2023-10-09T06:24:44.962 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-09T06:24:45.100 INFO:teuthology.orchestra.run.smithi031.stdout:{"osd_objectstore":"memstore"} 2023-10-09T06:24:45.100 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-09T06:24:45.101 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:24:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.222+0000 7f7c4728e700 1 Processor -- start 2023-10-09T06:24:45.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.222+0000 7f7c4728e700 1 -- start start 2023-10-09T06:24:45.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c4728e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c4015b9a0 0x7f7c400caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:45.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c4728e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7c4006d370 0x7f7c4006d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:45.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c4728e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4015bdf0 con 0x7f7c40152300 2023-10-09T06:24:45.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c4728e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c400b1400 con 0x7f7c4006d370 2023-10-09T06:24:45.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c4728e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4015c8d0 con 0x7f7c4015b9a0 2023-10-09T06:24:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c44829700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c4015b9a0 0x7f7c400caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c4582b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7c4006d370 0x7f7c4006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c4502a700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f7c40152300 0x7f7c40158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:48390/0 (socket says 172.21.15.31:48390) 2023-10-09T06:24:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c4502a700 1 -- 172.21.15.31:0/3512719307 learned_addr learned my addr 172.21.15.31:0/3512719307 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c4582b700 1 -- 172.21.15.31:0/3512719307 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c4015b9a0 msgr2=0x7f7c400caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c4582b700 1 --2- 172.21.15.31:0/3512719307 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c4015b9a0 0x7f7c400caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c4582b700 1 -- 172.21.15.31:0/3512719307 >> v1:172.21.15.158:6789/0 conn(0x7f7c40152300 legacy=0x7f7c40158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c4582b700 1 -- 172.21.15.31:0/3512719307 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c400c9370 con 0x7f7c4006d370 2023-10-09T06:24:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.223+0000 7f7c44829700 1 --2- 172.21.15.31:0/3512719307 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c4015b9a0 0x7f7c400caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:24:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.224+0000 7f7c4582b700 1 --2- 172.21.15.31:0/3512719307 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c4006d370 0x7f7c4006d790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009e60 tx=0x7f7c38009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54e4d7c4a49149fa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.224+0000 7f7c37fff700 1 -- 172.21.15.31:0/3512719307 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800e070 con 0x7f7c4006d370 2023-10-09T06:24:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.224+0000 7f7c37fff700 1 -- 172.21.15.31:0/3512719307 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3800bb60 con 0x7f7c4006d370 2023-10-09T06:24:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.224+0000 7f7c37fff700 1 -- 172.21.15.31:0/3512719307 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38012430 con 0x7f7c4006d370 2023-10-09T06:24:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.224+0000 7f7c4728e700 1 -- 172.21.15.31:0/3512719307 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c4006d370 msgr2=0x7f7c4006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.224+0000 7f7c4728e700 1 --2- 172.21.15.31:0/3512719307 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c4006d370 0x7f7c4006d790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009e60 tx=0x7f7c38009780 comp rx=0 tx=0).stop 2023-10-09T06:24:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.224+0000 7f7c4728e700 1 -- 172.21.15.31:0/3512719307 shutdown_connections 2023-10-09T06:24:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.224+0000 7f7c4728e700 1 --2- 172.21.15.31:0/3512719307 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c4006d370 0x7f7c4006d790 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.224+0000 7f7c4728e700 1 --2- 172.21.15.31:0/3512719307 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c4015b9a0 0x7f7c400caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.224+0000 7f7c4728e700 1 -- 172.21.15.31:0/3512719307 >> 172.21.15.31:0/3512719307 conn(0x7f7c40069870 msgr2=0x7f7c40069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.224+0000 7f7c4728e700 1 -- 172.21.15.31:0/3512719307 shutdown_connections 2023-10-09T06:24:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.224+0000 7f7c4728e700 1 -- 172.21.15.31:0/3512719307 wait complete. 2023-10-09T06:24:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.225+0000 7f7c4728e700 1 Processor -- start 2023-10-09T06:24:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.226+0000 7f7c4728e700 1 -- start start 2023-10-09T06:24:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.226+0000 7f7c4728e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c4006d370 0x7f7c40168190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.226+0000 7f7c4728e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c40152300 0x7f7c401530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.226+0000 7f7c4728e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4015b9a0 0x7f7c400b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.226+0000 7f7c4728e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c40152a20 con 0x7f7c4015b9a0 2023-10-09T06:24:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.226+0000 7f7c4728e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400c7500 con 0x7f7c40152300 2023-10-09T06:24:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.226+0000 7f7c4728e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400b3060 con 0x7f7c4006d370 2023-10-09T06:24:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c4582b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4015b9a0 0x7f7c400b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c4582b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4015b9a0 0x7f7c400b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47992/0 (socket says 172.21.15.31:47992) 2023-10-09T06:24:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c4582b700 1 -- 172.21.15.31:0/505170176 learned_addr learned my addr 172.21.15.31:0/505170176 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c4502a700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c4006d370 0x7f7c40168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c44829700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c40152300 0x7f7c401530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c4582b700 1 -- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c4006d370 msgr2=0x7f7c40168190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c4582b700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c4006d370 0x7f7c40168190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c4582b700 1 -- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c40152300 msgr2=0x7f7c401530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c4582b700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c40152300 0x7f7c401530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c4582b700 1 -- 172.21.15.31:0/505170176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c30009420 con 0x7f7c4015b9a0 2023-10-09T06:24:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c4582b700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4015b9a0 0x7f7c400b34f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800b6c0 tx=0x7f7c38019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c357fa700 1 -- 172.21.15.31:0/505170176 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38012e70 con 0x7f7c4015b9a0 2023-10-09T06:24:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c357fa700 1 -- 172.21.15.31:0/505170176 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3801d630 con 0x7f7c4015b9a0 2023-10-09T06:24:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c4728e700 1 -- 172.21.15.31:0/505170176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c38009a20 con 0x7f7c4015b9a0 2023-10-09T06:24:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c357fa700 1 -- 172.21.15.31:0/505170176 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3801da10 con 0x7f7c4015b9a0 2023-10-09T06:24:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.227+0000 7f7c4728e700 1 -- 172.21.15.31:0/505170176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c400b2a10 con 0x7f7c4015b9a0 2023-10-09T06:24:45.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.228+0000 7f7c4728e700 1 -- 172.21.15.31:0/505170176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c400cd410 con 0x7f7c4015b9a0 2023-10-09T06:24:45.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.229+0000 7f7c357fa700 1 -- 172.21.15.31:0/505170176 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c38024070 con 0x7f7c4015b9a0 2023-10-09T06:24:45.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.229+0000 7f7c357fa700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7c24066f30 0x7f7c240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:45.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.229+0000 7f7c357fa700 1 -- 172.21.15.31:0/505170176 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7c38086ae0 con 0x7f7c4015b9a0 2023-10-09T06:24:45.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.229+0000 7f7c4502a700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7c24066f30 0x7f7c240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:45.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.230+0000 7f7c4502a700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7c24066f30 0x7f7c240693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c001820 tx=0x7f7c3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:45.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.233+0000 7f7c357fa700 1 -- 172.21.15.31:0/505170176 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c38054050 con 0x7f7c4015b9a0 2023-10-09T06:24:45.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.428+0000 7f7c4728e700 1 -- 172.21.15.31:0/505170176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7c4006c9e0 con 0x7f7c4015b9a0 2023-10-09T06:24:45.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.432+0000 7f7c357fa700 1 -- 172.21.15.31:0/505170176 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7c38057670 con 0x7f7c4015b9a0 2023-10-09T06:24:45.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.434+0000 7f7c4728e700 1 -- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7c24066f30 msgr2=0x7f7c240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:45.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.434+0000 7f7c4728e700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7c24066f30 0x7f7c240693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c001820 tx=0x7f7c3c009040 comp rx=0 tx=0).stop 2023-10-09T06:24:45.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.434+0000 7f7c4728e700 1 -- 172.21.15.31:0/505170176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4015b9a0 msgr2=0x7f7c400b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:45.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.434+0000 7f7c4728e700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4015b9a0 0x7f7c400b34f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800b6c0 tx=0x7f7c38019000 comp rx=0 tx=0).stop 2023-10-09T06:24:45.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.434+0000 7f7c4728e700 1 -- 172.21.15.31:0/505170176 shutdown_connections 2023-10-09T06:24:45.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.434+0000 7f7c4728e700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7c24066f30 0x7f7c240693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.434+0000 7f7c4728e700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c4006d370 0x7f7c40168190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.434+0000 7f7c4728e700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4015b9a0 0x7f7c400b34f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.434+0000 7f7c4728e700 1 --2- 172.21.15.31:0/505170176 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c40152300 0x7f7c401530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.434+0000 7f7c4728e700 1 -- 172.21.15.31:0/505170176 >> 172.21.15.31:0/505170176 conn(0x7f7c40069870 msgr2=0x7f7c400cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:45.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.434+0000 7f7c4728e700 1 -- 172.21.15.31:0/505170176 shutdown_connections 2023-10-09T06:24:45.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.434+0000 7f7c4728e700 1 -- 172.21.15.31:0/505170176 wait complete. 2023-10-09T06:24:45.447 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:24:45.447 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:24:45.483 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:24:45.526 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:24:45.526 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:24:45.526 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:24:45.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.644+0000 7fd775c0f700 1 Processor -- start 2023-10-09T06:24:45.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.644+0000 7fd775c0f700 1 -- start start 2023-10-09T06:24:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.644+0000 7fd775c0f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd7700b0890 0x7fd7700cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.644+0000 7fd775c0f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd7700cbd40 0x7fd770067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.644+0000 7fd775c0f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7700cb370 con 0x7fd77006c630 2023-10-09T06:24:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.644+0000 7fd775c0f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7700b0c60 con 0x7fd7700b0890 2023-10-09T06:24:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.644+0000 7fd775c0f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77006a1e0 con 0x7fd7700cbd40 2023-10-09T06:24:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.645+0000 7fd76ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd77006c630 0x7fd77015dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55738/0 (socket says 172.21.15.31:55738) 2023-10-09T06:24:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.645+0000 7fd76ffff700 1 -- 172.21.15.31:0/3769267164 learned_addr learned my addr 172.21.15.31:0/3769267164 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.645+0000 7fd76f7fe700 1 --2- 172.21.15.31:0/3769267164 >> v2:172.21.15.158:3300/0 conn(0x7fd7700b0890 0x7fd7700cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.645+0000 7fd766ffd700 1 --2- 172.21.15.31:0/3769267164 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd7700cbd40 0x7fd770067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.645+0000 7fd76effd700 1 -- 172.21.15.31:0/3769267164 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189930533 0 0) 0x7fd7700cb370 con 0x7fd77006c630 2023-10-09T06:24:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.645+0000 7fd76effd700 1 -- 172.21.15.31:0/3769267164 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd75c003570 con 0x7fd77006c630 2023-10-09T06:24:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.645+0000 7fd76f7fe700 1 -- 172.21.15.31:0/3769267164 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd7700cbd40 msgr2=0x7fd770067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.645+0000 7fd76f7fe700 1 --2- 172.21.15.31:0/3769267164 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd7700cbd40 0x7fd770067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.645+0000 7fd76f7fe700 1 -- 172.21.15.31:0/3769267164 >> v1:172.21.15.31:6789/0 conn(0x7fd77006c630 legacy=0x7fd77015dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.645+0000 7fd76f7fe700 1 -- 172.21.15.31:0/3769267164 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77006cb80 con 0x7fd7700b0890 2023-10-09T06:24:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.645+0000 7fd766ffd700 1 --2- 172.21.15.31:0/3769267164 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd7700cbd40 0x7fd770067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:24:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.645+0000 7fd76f7fe700 1 --2- 172.21.15.31:0/3769267164 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd7700b0890 0x7fd7700cb800 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd7600098e0 tx=0x7fd7600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb5a08c1ba849b72 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.646+0000 7fd76effd700 1 -- 172.21.15.31:0/3769267164 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760011630 con 0x7fd7700b0890 2023-10-09T06:24:45.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.646+0000 7fd76effd700 1 -- 172.21.15.31:0/3769267164 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd760011790 con 0x7fd7700b0890 2023-10-09T06:24:45.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.646+0000 7fd76effd700 1 -- 172.21.15.31:0/3769267164 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760011b30 con 0x7fd7700b0890 2023-10-09T06:24:45.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.646+0000 7fd775c0f700 1 -- 172.21.15.31:0/3769267164 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd7700b0890 msgr2=0x7fd7700cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:45.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.646+0000 7fd775c0f700 1 --2- 172.21.15.31:0/3769267164 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd7700b0890 0x7fd7700cb800 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd7600098e0 tx=0x7fd7600091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.646+0000 7fd775c0f700 1 -- 172.21.15.31:0/3769267164 shutdown_connections 2023-10-09T06:24:45.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.646+0000 7fd775c0f700 1 --2- 172.21.15.31:0/3769267164 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd7700b0890 0x7fd7700cb800 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.646+0000 7fd775c0f700 1 --2- 172.21.15.31:0/3769267164 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd7700cbd40 0x7fd770067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.646+0000 7fd775c0f700 1 -- 172.21.15.31:0/3769267164 >> 172.21.15.31:0/3769267164 conn(0x7fd77006fe50 msgr2=0x7fd770069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:45.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.646+0000 7fd775c0f700 1 -- 172.21.15.31:0/3769267164 shutdown_connections 2023-10-09T06:24:45.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.646+0000 7fd775c0f700 1 -- 172.21.15.31:0/3769267164 wait complete. 2023-10-09T06:24:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.647+0000 7fd775c0f700 1 Processor -- start 2023-10-09T06:24:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.648+0000 7fd775c0f700 1 -- start start 2023-10-09T06:24:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.648+0000 7fd775c0f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd77006c630 0x7fd7700b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.648+0000 7fd775c0f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd7700b0890 0x7fd7700b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.648+0000 7fd775c0f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7700cbd40 0x7fd77015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.648+0000 7fd775c0f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700b4070 con 0x7fd7700cbd40 2023-10-09T06:24:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.648+0000 7fd775c0f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700b2750 con 0x7fd77006c630 2023-10-09T06:24:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.648+0000 7fd775c0f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77016dca0 con 0x7fd7700b0890 2023-10-09T06:24:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.648+0000 7fd76ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7700cbd40 0x7fd77015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.648+0000 7fd76ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7700cbd40 0x7fd77015b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47998/0 (socket says 172.21.15.31:47998) 2023-10-09T06:24:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.648+0000 7fd76ffff700 1 -- 172.21.15.31:0/1345534186 learned_addr learned my addr 172.21.15.31:0/1345534186 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.648+0000 7fd76f7fe700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd77006c630 0x7fd7700b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.648+0000 7fd766ffd700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd7700b0890 0x7fd7700b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.649+0000 7fd76ffff700 1 -- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd7700b0890 msgr2=0x7fd7700b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.649+0000 7fd76ffff700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd7700b0890 0x7fd7700b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.649+0000 7fd76ffff700 1 -- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd77006c630 msgr2=0x7fd7700b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.649+0000 7fd76ffff700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd77006c630 0x7fd7700b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.649+0000 7fd76ffff700 1 -- 172.21.15.31:0/1345534186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758009420 con 0x7fd7700cbd40 2023-10-09T06:24:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.649+0000 7fd76ffff700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7700cbd40 0x7fd77015b550 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd76800cc40 tx=0x7fd768001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.649+0000 7fd767fff700 1 -- 172.21.15.31:0/1345534186 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76800a830 con 0x7fd7700cbd40 2023-10-09T06:24:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.649+0000 7fd767fff700 1 -- 172.21.15.31:0/1345534186 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76800a990 con 0x7fd7700cbd40 2023-10-09T06:24:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.649+0000 7fd775c0f700 1 -- 172.21.15.31:0/1345534186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd760009420 con 0x7fd7700cbd40 2023-10-09T06:24:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.649+0000 7fd767fff700 1 -- 172.21.15.31:0/1345534186 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76800ad10 con 0x7fd7700cbd40 2023-10-09T06:24:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.649+0000 7fd775c0f700 1 -- 172.21.15.31:0/1345534186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7700b1eb0 con 0x7fd7700cbd40 2023-10-09T06:24:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.650+0000 7fd775c0f700 1 -- 172.21.15.31:0/1345534186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77004c3c0 con 0x7fd7700cbd40 2023-10-09T06:24:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.650+0000 7fd767fff700 1 -- 172.21.15.31:0/1345534186 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd768007300 con 0x7fd7700cbd40 2023-10-09T06:24:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.651+0000 7fd767fff700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd750066f30 0x7fd7500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.651+0000 7fd767fff700 1 -- 172.21.15.31:0/1345534186 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd7680844c0 con 0x7fd7700cbd40 2023-10-09T06:24:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.651+0000 7fd76f7fe700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd750066f30 0x7fd7500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.652+0000 7fd76f7fe700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd750066f30 0x7fd7500693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd7600091e0 tx=0x7fd760017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:45.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.655+0000 7fd767fff700 1 -- 172.21.15.31:0/1345534186 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd768051ab0 con 0x7fd7700cbd40 2023-10-09T06:24:45.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.894+0000 7fd775c0f700 1 -- 172.21.15.31:0/1345534186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd77016dde0 con 0x7fd7700cbd40 2023-10-09T06:24:45.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.894+0000 7fd767fff700 1 -- 172.21.15.31:0/1345534186 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fd7680550d0 con 0x7fd7700cbd40 2023-10-09T06:24:45.895 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:45.896 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/4067940888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":4067940888},{"type":"v1","addr":"172.21.15.158:6835","nonce":4067940888}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/169747435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":169747435},{"type":"v1","addr":"172.21.15.158:6837","nonce":169747435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3769789034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3769789034},{"type":"v1","addr":"172.21.15.31:6834","nonce":3769789034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5904,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3227738677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3227738677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3227738677}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[]} 2023-10-09T06:24:45.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.896+0000 7fd775c0f700 1 -- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd750066f30 msgr2=0x7fd7500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:45.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.896+0000 7fd775c0f700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd750066f30 0x7fd7500693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd7600091e0 tx=0x7fd760017000 comp rx=0 tx=0).stop 2023-10-09T06:24:45.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.896+0000 7fd775c0f700 1 -- 172.21.15.31:0/1345534186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7700cbd40 msgr2=0x7fd77015b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:45.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.896+0000 7fd775c0f700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7700cbd40 0x7fd77015b550 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd76800cc40 tx=0x7fd768001a40 comp rx=0 tx=0).stop 2023-10-09T06:24:45.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.896+0000 7fd775c0f700 1 -- 172.21.15.31:0/1345534186 shutdown_connections 2023-10-09T06:24:45.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.896+0000 7fd775c0f700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd750066f30 0x7fd7500693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.896+0000 7fd775c0f700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7700cbd40 0x7fd77015b550 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.896+0000 7fd775c0f700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd77006c630 0x7fd7700b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.896+0000 7fd775c0f700 1 --2- 172.21.15.31:0/1345534186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd7700b0890 0x7fd7700b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:45.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.897+0000 7fd775c0f700 1 -- 172.21.15.31:0/1345534186 >> 172.21.15.31:0/1345534186 conn(0x7fd77006fe50 msgr2=0x7fd77015bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:45.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.897+0000 7fd775c0f700 1 -- 172.21.15.31:0/1345534186 shutdown_connections 2023-10-09T06:24:45.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:45.897+0000 7fd775c0f700 1 -- 172.21.15.31:0/1345534186 wait complete. 2023-10-09T06:24:45.899 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 36 2023-10-09T06:24:45.909 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:24:45.910 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:24:45.910 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:24:45.910 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:24:45.910 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:24:45.910 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:24:45.911 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:24:45.911 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:24:45.911 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:24:45.911 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:24:45.911 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:24:45.911 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:24:45.911 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:24:45.912 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:24:45.912 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:24:45.912 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:24:45.918 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:24:45.918 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:24:45.919 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:24:45.919 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:24:45.922 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:24:45.923 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:24:45.923 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:24:45.924 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:24:45.961 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:24:45.961 DEBUG:teuthology.parallel:result is None 2023-10-09T06:24:45.962 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:24:45.962 DEBUG:teuthology.parallel:result is None 2023-10-09T06:24:45.965 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:24:45.965 DEBUG:teuthology.parallel:result is None 2023-10-09T06:24:45.966 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:24:45.966 DEBUG:teuthology.parallel:result is None 2023-10-09T06:24:45.966 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:24:46.037 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:24:46.037 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-10-09T06:24:46.045 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:24:46.045 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-09T06:24:46.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.090+0000 7f922f1e4700 1 Processor -- start 2023-10-09T06:24:46.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.090+0000 7f922f1e4700 1 -- start start 2023-10-09T06:24:46.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.090+0000 7f922f1e4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9228157870 0x7f922815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:46.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.090+0000 7f922f1e4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f922815a620 0x7f922815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:46.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.090+0000 7f922f1e4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922815cbb0 con 0x7f922815d580 2023-10-09T06:24:46.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.090+0000 7f922f1e4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922815bfa0 con 0x7f9228157870 2023-10-09T06:24:46.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.090+0000 7f922f1e4700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922815c280 con 0x7f922815a620 2023-10-09T06:24:46.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f922cf80700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9228157870 0x7f922815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:46.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f922d781700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f922815d580 0x7f9228158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55756/0 (socket says 172.21.15.31:55756) 2023-10-09T06:24:46.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f922d781700 1 -- 172.21.15.31:0/1256901779 learned_addr learned my addr 172.21.15.31:0/1256901779 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:46.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f9227fff700 1 --2- 172.21.15.31:0/1256901779 >> v2:172.21.15.158:3300/0 conn(0x7f922815a620 0x7f922815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:46.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f92277fe700 1 -- 172.21.15.31:0/1256901779 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602245545 0 0) 0x7f922815cbb0 con 0x7f922815d580 2023-10-09T06:24:46.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f92277fe700 1 -- 172.21.15.31:0/1256901779 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9210003570 con 0x7f922815d580 2023-10-09T06:24:46.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f922cf80700 1 -- 172.21.15.31:0/1256901779 >> v2:172.21.15.158:3300/0 conn(0x7f922815a620 msgr2=0x7f922815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:46.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f922cf80700 1 --2- 172.21.15.31:0/1256901779 >> v2:172.21.15.158:3300/0 conn(0x7f922815a620 0x7f922815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:46.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f922cf80700 1 -- 172.21.15.31:0/1256901779 >> v1:172.21.15.31:6789/0 conn(0x7f922815d580 legacy=0x7f9228158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:46.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f922cf80700 1 -- 172.21.15.31:0/1256901779 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922815c560 con 0x7f9228157870 2023-10-09T06:24:46.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f922cf80700 1 --2- 172.21.15.31:0/1256901779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9228157870 0x7f922815b6a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f922815cb20 tx=0x7f92180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89560362b6d3251 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:46.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f92277fe700 1 -- 172.21.15.31:0/1256901779 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218011630 con 0x7f9228157870 2023-10-09T06:24:46.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f92277fe700 1 -- 172.21.15.31:0/1256901779 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92180117b0 con 0x7f9228157870 2023-10-09T06:24:46.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.091+0000 7f92277fe700 1 -- 172.21.15.31:0/1256901779 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218011b70 con 0x7f9228157870 2023-10-09T06:24:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.092+0000 7f922f1e4700 1 -- 172.21.15.31:0/1256901779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9228157870 msgr2=0x7f922815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.092+0000 7f922f1e4700 1 --2- 172.21.15.31:0/1256901779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9228157870 0x7f922815b6a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f922815cb20 tx=0x7f92180091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.092+0000 7f922f1e4700 1 -- 172.21.15.31:0/1256901779 shutdown_connections 2023-10-09T06:24:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.092+0000 7f922f1e4700 1 --2- 172.21.15.31:0/1256901779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9228157870 0x7f922815b6a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.092+0000 7f922f1e4700 1 --2- 172.21.15.31:0/1256901779 >> v2:172.21.15.158:3300/0 conn(0x7f922815a620 0x7f922815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.092+0000 7f922f1e4700 1 -- 172.21.15.31:0/1256901779 >> 172.21.15.31:0/1256901779 conn(0x7f9228068ce0 msgr2=0x7f92280690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.092+0000 7f922f1e4700 1 -- 172.21.15.31:0/1256901779 shutdown_connections 2023-10-09T06:24:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.092+0000 7f922f1e4700 1 -- 172.21.15.31:0/1256901779 wait complete. 2023-10-09T06:24:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.093+0000 7f922f1e4700 1 Processor -- start 2023-10-09T06:24:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.093+0000 7f922f1e4700 1 -- start start 2023-10-09T06:24:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f922f1e4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9228157870 0x7f92281478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f922f1e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f922815a620 0x7f92280d0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f922f1e4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f922815d580 0x7f92280d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f922f1e4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92280b3110 con 0x7f922815a620 2023-10-09T06:24:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f922f1e4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92280b35a0 con 0x7f922815d580 2023-10-09T06:24:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f922f1e4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92280b2500 con 0x7f9228157870 2023-10-09T06:24:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f9227fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f922815a620 0x7f92280d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f9227fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f922815a620 0x7f92280d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48034/0 (socket says 172.21.15.31:48034) 2023-10-09T06:24:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f9227fff700 1 -- 172.21.15.31:0/2791014544 learned_addr learned my addr 172.21.15.31:0/2791014544 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f922cf80700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9228157870 0x7f92281478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f922d781700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f922815d580 0x7f92280d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f9227fff700 1 -- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9228157870 msgr2=0x7f92281478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f9227fff700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9228157870 0x7f92281478e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f9227fff700 1 -- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f922815d580 msgr2=0x7f92280d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f9227fff700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f922815d580 0x7f92280d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.094+0000 7f9227fff700 1 -- 172.21.15.31:0/2791014544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9218009420 con 0x7f922815a620 2023-10-09T06:24:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.095+0000 7f9227fff700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f922815a620 0x7f92280d0280 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f921c00ec50 tx=0x7f921c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.095+0000 7f9224ff9700 1 -- 172.21.15.31:0/2791014544 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c00c9d0 con 0x7f922815a620 2023-10-09T06:24:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.095+0000 7f9224ff9700 1 -- 172.21.15.31:0/2791014544 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c00cb30 con 0x7f922815a620 2023-10-09T06:24:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.095+0000 7f922f1e4700 1 -- 172.21.15.31:0/2791014544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92280b27e0 con 0x7f922815a620 2023-10-09T06:24:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.095+0000 7f9224ff9700 1 -- 172.21.15.31:0/2791014544 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c013470 con 0x7f922815a620 2023-10-09T06:24:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.095+0000 7f922f1e4700 1 -- 172.21.15.31:0/2791014544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92280b2da0 con 0x7f922815a620 2023-10-09T06:24:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.096+0000 7f922f1e4700 1 -- 172.21.15.31:0/2791014544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92280b32c0 con 0x7f922815a620 2023-10-09T06:24:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.096+0000 7f9224ff9700 1 -- 172.21.15.31:0/2791014544 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f921c013860 con 0x7f922815a620 2023-10-09T06:24:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.097+0000 7f9224ff9700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9214066f30 0x7f92140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.097+0000 7f9224ff9700 1 -- 172.21.15.31:0/2791014544 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f921c084550 con 0x7f922815a620 2023-10-09T06:24:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.097+0000 7f922cf80700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9214066f30 0x7f92140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:46.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.098+0000 7f922cf80700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9214066f30 0x7f92140693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f922815cb20 tx=0x7f9218017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:46.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.101+0000 7f9224ff9700 1 -- 172.21.15.31:0/2791014544 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92280b32c0 con 0x7f922815a620 2023-10-09T06:24:46.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:46.312+0000 7f922f1e4700 1 -- 172.21.15.31:0/2791014544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f922804c3c0 con 0x7f922815a620 2023-10-09T06:24:47.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.713+0000 7f9224ff9700 1 -- 172.21.15.31:0/2791014544 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v80) v1 ==== 97+0+0 (secure 0 0 0) 0x7f921c051ac0 con 0x7f922815a620 2023-10-09T06:24:47.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.716+0000 7f922f1e4700 1 -- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9214066f30 msgr2=0x7f92140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:47.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.716+0000 7f922f1e4700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9214066f30 0x7f92140693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f922815cb20 tx=0x7f9218017000 comp rx=0 tx=0).stop 2023-10-09T06:24:47.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.716+0000 7f922f1e4700 1 -- 172.21.15.31:0/2791014544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f922815a620 msgr2=0x7f92280d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:47.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.716+0000 7f922f1e4700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f922815a620 0x7f92280d0280 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f921c00ec50 tx=0x7f921c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:47.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.716+0000 7f922f1e4700 1 -- 172.21.15.31:0/2791014544 shutdown_connections 2023-10-09T06:24:47.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.716+0000 7f922f1e4700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9214066f30 0x7f92140693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:47.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.716+0000 7f922f1e4700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9228157870 0x7f92281478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:47.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.716+0000 7f922f1e4700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f922815d580 0x7f92280d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:47.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.716+0000 7f922f1e4700 1 --2- 172.21.15.31:0/2791014544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f922815a620 0x7f92280d0280 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:47.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.716+0000 7f922f1e4700 1 -- 172.21.15.31:0/2791014544 >> 172.21.15.31:0/2791014544 conn(0x7f9228068ce0 msgr2=0x7f9228155710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:47.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.716+0000 7f922f1e4700 1 -- 172.21.15.31:0/2791014544 shutdown_connections 2023-10-09T06:24:47.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.716+0000 7f922f1e4700 1 -- 172.21.15.31:0/2791014544 wait complete. 2023-10-09T06:24:47.718 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2023-10-09T06:24:47.732 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:24:47.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.857+0000 7f9d5d290700 1 Processor -- start 2023-10-09T06:24:47.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.857+0000 7f9d5d290700 1 -- start start 2023-10-09T06:24:47.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.858+0000 7f9d5d290700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9d58157870 0x7f9d5815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:47.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.858+0000 7f9d5d290700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5815cbb0 con 0x7f9d5815a620 2023-10-09T06:24:47.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.858+0000 7f9d5d290700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5815bfa0 con 0x7f9d58157c40 2023-10-09T06:24:47.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.858+0000 7f9d5d290700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5815c280 con 0x7f9d58157870 2023-10-09T06:24:47.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.858+0000 7f9d567fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9d5815a620 0x7f9d5815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55770/0 (socket says 172.21.15.31:55770) 2023-10-09T06:24:47.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.858+0000 7f9d567fc700 1 -- 172.21.15.31:0/2202191510 learned_addr learned my addr 172.21.15.31:0/2202191510 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:47.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.858+0000 7f9d56ffd700 1 --2- 172.21.15.31:0/2202191510 >> v2:172.21.15.158:3300/0 conn(0x7f9d58157870 0x7f9d5815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:47.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.858+0000 7f9d55ffb700 1 -- 172.21.15.31:0/2202191510 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000271780 0 0) 0x7f9d5815cbb0 con 0x7f9d5815a620 2023-10-09T06:24:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.858+0000 7f9d55ffb700 1 -- 172.21.15.31:0/2202191510 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d44003570 con 0x7f9d5815a620 2023-10-09T06:24:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d56ffd700 1 -- 172.21.15.31:0/2202191510 >> v1:172.21.15.158:6789/0 conn(0x7f9d58157c40 legacy=0x7f9d58158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d55ffb700 1 -- 172.21.15.31:0/2202191510 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177101942 0 0) 0x7f9d5815bfa0 con 0x7f9d58157c40 2023-10-09T06:24:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d56ffd700 1 -- 172.21.15.31:0/2202191510 >> v1:172.21.15.31:6789/0 conn(0x7f9d5815a620 legacy=0x7f9d5815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d56ffd700 1 -- 172.21.15.31:0/2202191510 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5815c560 con 0x7f9d58157870 2023-10-09T06:24:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d56ffd700 1 --2- 172.21.15.31:0/2202191510 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d58157870 0x7f9d5815b6a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009e60 tx=0x7f9d48009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ded35c0e9137be64 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d55ffb700 1 -- 172.21.15.31:0/2202191510 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4800e070 con 0x7f9d58157870 2023-10-09T06:24:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d55ffb700 1 -- 172.21.15.31:0/2202191510 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4800bb60 con 0x7f9d58157870 2023-10-09T06:24:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d55ffb700 1 -- 172.21.15.31:0/2202191510 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48012430 con 0x7f9d58157870 2023-10-09T06:24:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d5d290700 1 -- 172.21.15.31:0/2202191510 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d58157870 msgr2=0x7f9d5815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d5d290700 1 --2- 172.21.15.31:0/2202191510 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d58157870 0x7f9d5815b6a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009e60 tx=0x7f9d48009780 comp rx=0 tx=0).stop 2023-10-09T06:24:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d5d290700 1 -- 172.21.15.31:0/2202191510 shutdown_connections 2023-10-09T06:24:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d5d290700 1 --2- 172.21.15.31:0/2202191510 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d58157870 0x7f9d5815b6a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d5d290700 1 -- 172.21.15.31:0/2202191510 >> 172.21.15.31:0/2202191510 conn(0x7f9d58068ce0 msgr2=0x7f9d580690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d5d290700 1 -- 172.21.15.31:0/2202191510 shutdown_connections 2023-10-09T06:24:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.859+0000 7f9d5d290700 1 -- 172.21.15.31:0/2202191510 wait complete. 2023-10-09T06:24:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.861+0000 7f9d5d290700 1 Processor -- start 2023-10-09T06:24:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.861+0000 7f9d5d290700 1 -- start start 2023-10-09T06:24:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.861+0000 7f9d5d290700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d58157870 0x7f9d581604f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.861+0000 7f9d5d290700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d58157c40 0x7f9d580b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.861+0000 7f9d5d290700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d5815a620 0x7f9d58150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d5d290700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5814eab0 con 0x7f9d58157870 2023-10-09T06:24:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d5d290700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5814e780 con 0x7f9d58157c40 2023-10-09T06:24:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d5d290700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58160a30 con 0x7f9d5815a620 2023-10-09T06:24:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d56ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d58157870 0x7f9d581604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d56ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d58157870 0x7f9d581604f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48046/0 (socket says 172.21.15.31:48046) 2023-10-09T06:24:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d56ffd700 1 -- 172.21.15.31:0/1965129655 learned_addr learned my addr 172.21.15.31:0/1965129655 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d567fc700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d58157c40 0x7f9d580b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d577fe700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d5815a620 0x7f9d58150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d56ffd700 1 -- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d5815a620 msgr2=0x7f9d58150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d56ffd700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d5815a620 0x7f9d58150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d56ffd700 1 -- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d58157c40 msgr2=0x7f9d580b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d56ffd700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d58157c40 0x7f9d580b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d56ffd700 1 -- 172.21.15.31:0/1965129655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48009a20 con 0x7f9d58157870 2023-10-09T06:24:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d567fc700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d58157c40 0x7f9d580b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d577fe700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d5815a620 0x7f9d58150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d56ffd700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d58157870 0x7f9d581604f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9d5806b530 tx=0x7f9d48019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d4effd700 1 -- 172.21.15.31:0/1965129655 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48012e30 con 0x7f9d58157870 2023-10-09T06:24:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d4effd700 1 -- 172.21.15.31:0/1965129655 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d48026480 con 0x7f9d58157870 2023-10-09T06:24:47.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d5d290700 1 -- 172.21.15.31:0/1965129655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d580b29b0 con 0x7f9d58157870 2023-10-09T06:24:47.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d4effd700 1 -- 172.21.15.31:0/1965129655 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48026840 con 0x7f9d58157870 2023-10-09T06:24:47.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.862+0000 7f9d5d290700 1 -- 172.21.15.31:0/1965129655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d580b2f70 con 0x7f9d58157870 2023-10-09T06:24:47.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.863+0000 7f9d5d290700 1 -- 172.21.15.31:0/1965129655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5804c3c0 con 0x7f9d58157870 2023-10-09T06:24:47.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.864+0000 7f9d4effd700 1 -- 172.21.15.31:0/1965129655 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d4801c400 con 0x7f9d58157870 2023-10-09T06:24:47.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.864+0000 7f9d4effd700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9d38066f30 0x7f9d380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:47.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.864+0000 7f9d4effd700 1 -- 172.21.15.31:0/1965129655 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9d480860d0 con 0x7f9d58157870 2023-10-09T06:24:47.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.864+0000 7f9d567fc700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9d38066f30 0x7f9d380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:47.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.865+0000 7f9d567fc700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9d38066f30 0x7f9d380693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9d5806a090 tx=0x7f9d40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:47.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:47.869+0000 7f9d4effd700 1 -- 172.21.15.31:0/1965129655 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d48053690 con 0x7f9d58157870 2023-10-09T06:24:48.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.144+0000 7f9d5d290700 1 -- 172.21.15.31:0/1965129655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9d5815c840 con 0x7f9d58157870 2023-10-09T06:24:48.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.144+0000 7f9d4effd700 1 -- 172.21.15.31:0/1965129655 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9d48056cb0 con 0x7f9d58157870 2023-10-09T06:24:48.146 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:24:48.146 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2023-10-09T06:24:48.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.147 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2023-10-09T06:24:48.147 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl/nWKAxAA1kcqjt4lPGPkmDivDpIVjQ==", 2023-10-09T06:24:48.147 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.147 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:24:48.147 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:24:48.148 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:24:48.148 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.148 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.149 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2023-10-09T06:24:48.149 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl9xYEDxAAQJeaqz7lkrArv45vLGb34g==", 2023-10-09T06:24:48.149 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.149 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:24:48.149 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:24:48.149 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:24:48.150 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.150 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.150 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2023-10-09T06:24:48.151 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlJOp0ChAADGiI4SX7ZLvDrtjDtU905A==", 2023-10-09T06:24:48.151 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.151 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:24:48.151 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:24:48.151 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:24:48.151 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.152 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.152 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2023-10-09T06:24:48.152 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlbnnJFRAAO+XoxRQDaHv0ZicyggniLQ==", 2023-10-09T06:24:48.152 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.153 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:24:48.153 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:24:48.153 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:24:48.153 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.153 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.154 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2023-10-09T06:24:48.154 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNloyZ+LxAApAHpPxV7R1OVE2wlIaU+PA==", 2023-10-09T06:24:48.154 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.154 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:24:48.155 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:24:48.155 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.155 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.155 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2023-10-09T06:24:48.156 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNlvHeUNhAAXblIEmmsc5eTo5VcZVirfA==", 2023-10-09T06:24:48.156 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.156 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:24:48.156 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:24:48.156 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.156 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.157 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2023-10-09T06:24:48.157 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlxfIaBBAAE8WbXh4Q4SxaW2k7MkSTHg==", 2023-10-09T06:24:48.157 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.157 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:24:48.158 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:24:48.158 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.158 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.158 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2023-10-09T06:24:48.159 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlUtX3DRAA5NEq+lFMzqhu1GF1ZWT2ag==", 2023-10-09T06:24:48.159 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.159 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:24:48.159 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:24:48.159 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.160 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.160 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2023-10-09T06:24:48.160 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlcWc5IBAA5e62AwhIuHdw4dTjnNS8hQ==", 2023-10-09T06:24:48.160 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.161 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:24:48.161 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:24:48.161 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.161 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.162 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2023-10-09T06:24:48.162 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlX5S6JhAAzvzO2YEqEtq2fJ3FW9Fddg==", 2023-10-09T06:24:48.162 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.162 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:24:48.162 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:24:48.163 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.163 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.163 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2023-10-09T06:24:48.163 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl9jy5LxAAxgMslSN6ayxB2MFRf2dwNQ==", 2023-10-09T06:24:48.164 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.164 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:24:48.164 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:24:48.164 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.164 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.165 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2023-10-09T06:24:48.165 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl8M+TOBAARhk2wEaXO9Pi4TP9d+L5Gg==", 2023-10-09T06:24:48.165 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.165 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:24:48.165 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:24:48.166 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.166 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.167 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2023-10-09T06:24:48.167 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlfsC2GRAAlm37QI8DkNclcBpD5ZBR7A==", 2023-10-09T06:24:48.167 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.167 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:24:48.168 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2023-10-09T06:24:48.168 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T06:24:48.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.169 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2023-10-09T06:24:48.169 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlapIxIhAAiBZUkpnf6tyFHwySGKhRpQ==", 2023-10-09T06:24:48.169 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.169 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:24:48.170 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:24:48.170 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:24:48.170 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:24:48.170 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.171 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2023-10-09T06:24:48.171 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEZYuHxAA7WEH0vXmAEH5Wki8ESrDBg==", 2023-10-09T06:24:48.171 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.172 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:24:48.172 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:24:48.172 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:24:48.172 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:24:48.173 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.173 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2023-10-09T06:24:48.173 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlFvuIJxAAGuTp4gsXrvUzDd1B7d5vcg==", 2023-10-09T06:24:48.174 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.174 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:24:48.174 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:24:48.174 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:24:48.175 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:24:48.175 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.176 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2023-10-09T06:24:48.176 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlS8AlJBAAg8lLRVasKHyhbFlOTfgt9g==", 2023-10-09T06:24:48.176 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.176 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:24:48.177 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:24:48.177 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:24:48.177 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.178 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2023-10-09T06:24:48.178 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEE9eABAAHbJ1yvlmOUNo6n2uAhPrnw==", 2023-10-09T06:24:48.178 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.179 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:24:48.179 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:24:48.179 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.179 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:24:48.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:48.180 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2023-10-09T06:24:48.180 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlhol5OBAAZSZ+PbojVwsOJtLlTl6wAA==", 2023-10-09T06:24:48.180 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:24:48.181 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:24:48.181 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:24:48.181 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:24:48.181 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.181 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:48.182 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:24:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:24:48.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.147+0000 7f9d5d290700 1 -- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9d38066f30 msgr2=0x7f9d380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.147+0000 7f9d5d290700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9d38066f30 0x7f9d380693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9d5806a090 tx=0x7f9d40009040 comp rx=0 tx=0).stop 2023-10-09T06:24:48.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.147+0000 7f9d5d290700 1 -- 172.21.15.31:0/1965129655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d58157870 msgr2=0x7f9d581604f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.147+0000 7f9d5d290700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d58157870 0x7f9d581604f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9d5806b530 tx=0x7f9d48019000 comp rx=0 tx=0).stop 2023-10-09T06:24:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.147+0000 7f9d5d290700 1 -- 172.21.15.31:0/1965129655 shutdown_connections 2023-10-09T06:24:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.147+0000 7f9d5d290700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9d38066f30 0x7f9d380693e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.147+0000 7f9d5d290700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9d5815a620 0x7f9d58150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.147+0000 7f9d5d290700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d58157870 0x7f9d581604f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.147+0000 7f9d5d290700 1 --2- 172.21.15.31:0/1965129655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d58157c40 0x7f9d580b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.147+0000 7f9d5d290700 1 -- 172.21.15.31:0/1965129655 >> 172.21.15.31:0/1965129655 conn(0x7f9d58068ce0 msgr2=0x7f9d580b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.147+0000 7f9d5d290700 1 -- 172.21.15.31:0/1965129655 shutdown_connections 2023-10-09T06:24:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.147+0000 7f9d5d290700 1 -- 172.21.15.31:0/1965129655 wait complete. 2023-10-09T06:24:48.188 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:24:48.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.307+0000 7f7d0e2f6700 1 Processor -- start 2023-10-09T06:24:48.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.307+0000 7f7d0e2f6700 1 -- start start 2023-10-09T06:24:48.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.308+0000 7f7d0e2f6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7d080cdab0 0x7f7d0815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.308+0000 7f7d0e2f6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d0815dda0 0x7f7d0815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.308+0000 7f7d0e2f6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d080cb7c0 con 0x7f7d080cd6e0 2023-10-09T06:24:48.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.308+0000 7f7d0e2f6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0815e850 con 0x7f7d080cdab0 2023-10-09T06:24:48.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.308+0000 7f7d0e2f6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080cc360 con 0x7f7d0815dda0 2023-10-09T06:24:48.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.308+0000 7f7d0caf3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7d080cdab0 0x7f7d0815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.308+0000 7f7d0caf3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7d080cdab0 0x7f7d0815d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48060/0 (socket says 172.21.15.31:48060) 2023-10-09T06:24:48.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.308+0000 7f7d0caf3700 1 -- 172.21.15.31:0/644206867 learned_addr learned my addr 172.21.15.31:0/644206867 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:48.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.308+0000 7f7d0caf3700 1 -- 172.21.15.31:0/644206867 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d0815dda0 msgr2=0x7f7d0815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:48.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.308+0000 7f7d0daf5700 1 --2- 172.21.15.31:0/644206867 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d0815dda0 0x7f7d0815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.308+0000 7f7d0caf3700 1 --2- 172.21.15.31:0/644206867 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d0815dda0 0x7f7d0815cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.308+0000 7f7d0caf3700 1 -- 172.21.15.31:0/644206867 >> v1:172.21.15.158:6789/0 conn(0x7f7d080cd6e0 legacy=0x7f7d080cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:48.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.308+0000 7f7d0caf3700 1 -- 172.21.15.31:0/644206867 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0815e290 con 0x7f7d080cdab0 2023-10-09T06:24:48.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.309+0000 7f7d0caf3700 1 --2- 172.21.15.31:0/644206867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d080cdab0 0x7f7d0815d860 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0099b0 tx=0x7f7cfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5f95cbbb4a7bde server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:48.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.309+0000 7f7d07fff700 1 -- 172.21.15.31:0/644206867 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00b820 con 0x7f7d080cdab0 2023-10-09T06:24:48.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.309+0000 7f7d07fff700 1 -- 172.21.15.31:0/644206867 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00b980 con 0x7f7d080cdab0 2023-10-09T06:24:48.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.309+0000 7f7d07fff700 1 -- 172.21.15.31:0/644206867 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00bd20 con 0x7f7d080cdab0 2023-10-09T06:24:48.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.309+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/644206867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d080cdab0 msgr2=0x7f7d0815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.309+0000 7f7d0e2f6700 1 --2- 172.21.15.31:0/644206867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d080cdab0 0x7f7d0815d860 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0099b0 tx=0x7f7cfc009250 comp rx=0 tx=0).stop 2023-10-09T06:24:48.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.309+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/644206867 shutdown_connections 2023-10-09T06:24:48.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.309+0000 7f7d0e2f6700 1 --2- 172.21.15.31:0/644206867 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d0815dda0 0x7f7d0815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.309+0000 7f7d0e2f6700 1 --2- 172.21.15.31:0/644206867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d080cdab0 0x7f7d0815d860 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.309+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/644206867 >> 172.21.15.31:0/644206867 conn(0x7f7d08067660 msgr2=0x7f7d08067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:48.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.309+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/644206867 shutdown_connections 2023-10-09T06:24:48.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.309+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/644206867 wait complete. 2023-10-09T06:24:48.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.310+0000 7f7d0e2f6700 1 Processor -- start 2023-10-09T06:24:48.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.311+0000 7f7d0e2f6700 1 -- start start 2023-10-09T06:24:48.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.311+0000 7f7d0e2f6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d080cd6e0 0x7f7d08155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.311+0000 7f7d0e2f6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d080cdab0 0x7f7d080b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.311+0000 7f7d0e2f6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d0815dda0 0x7f7d080b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.311+0000 7f7d0e2f6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080c8dc0 con 0x7f7d080cdab0 2023-10-09T06:24:48.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.311+0000 7f7d0e2f6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080c8930 con 0x7f7d0815dda0 2023-10-09T06:24:48.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.311+0000 7f7d0e2f6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080c7d20 con 0x7f7d080cd6e0 2023-10-09T06:24:48.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0caf3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d080cdab0 0x7f7d080b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0caf3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d080cdab0 0x7f7d080b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48074/0 (socket says 172.21.15.31:48074) 2023-10-09T06:24:48.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0caf3700 1 -- 172.21.15.31:0/1645307464 learned_addr learned my addr 172.21.15.31:0/1645307464 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:48.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0daf5700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d0815dda0 0x7f7d080b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0d2f4700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d080cd6e0 0x7f7d08155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0caf3700 1 -- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d080cd6e0 msgr2=0x7f7d08155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0caf3700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d080cd6e0 0x7f7d08155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0caf3700 1 -- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d0815dda0 msgr2=0x7f7d080b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0caf3700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d0815dda0 0x7f7d080b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0caf3700 1 -- 172.21.15.31:0/1645307464 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc0094f0 con 0x7f7d080cdab0 2023-10-09T06:24:48.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0daf5700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d0815dda0 0x7f7d080b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:48.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0caf3700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d080cdab0 0x7f7d080b5050 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009290 tx=0x7f7cfc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d057fa700 1 -- 172.21.15.31:0/1645307464 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc011d70 con 0x7f7d080cdab0 2023-10-09T06:24:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d057fa700 1 -- 172.21.15.31:0/1645307464 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc020070 con 0x7f7d080cdab0 2023-10-09T06:24:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d057fa700 1 -- 172.21.15.31:0/1645307464 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc01b6a0 con 0x7f7d080cdab0 2023-10-09T06:24:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/1645307464 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d080c8000 con 0x7f7d080cdab0 2023-10-09T06:24:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.312+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/1645307464 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d080c85c0 con 0x7f7d080cdab0 2023-10-09T06:24:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.313+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/1645307464 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d080c8ac0 con 0x7f7d080cdab0 2023-10-09T06:24:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.314+0000 7f7d057fa700 1 -- 172.21.15.31:0/1645307464 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cfc022030 con 0x7f7d080cdab0 2023-10-09T06:24:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.314+0000 7f7d057fa700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7cf4066f30 0x7f7cf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.314+0000 7f7d057fa700 1 -- 172.21.15.31:0/1645307464 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7cfc0861d0 con 0x7f7d080cdab0 2023-10-09T06:24:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.314+0000 7f7d0d2f4700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7cf4066f30 0x7f7cf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.315+0000 7f7d0d2f4700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7cf4066f30 0x7f7cf40693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009fd0 tx=0x7f7d00009620 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.318+0000 7f7d057fa700 1 -- 172.21.15.31:0/1645307464 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cfc053790 con 0x7f7d080cdab0 2023-10-09T06:24:48.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.511+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/1645307464 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d080c8ac0 con 0x7f7d080cdab0 2023-10-09T06:24:48.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.512+0000 7f7d057fa700 1 -- 172.21.15.31:0/1645307464 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f7cfc084e60 con 0x7f7d080cdab0 2023-10-09T06:24:48.513 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:48.513 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":80,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:24:47.711288+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:24:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.514+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7cf4066f30 msgr2=0x7f7cf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.514+0000 7f7d0e2f6700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7cf4066f30 0x7f7cf40693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009fd0 tx=0x7f7d00009620 comp rx=0 tx=0).stop 2023-10-09T06:24:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.514+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/1645307464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d080cdab0 msgr2=0x7f7d080b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.514+0000 7f7d0e2f6700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d080cdab0 0x7f7d080b5050 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009290 tx=0x7f7cfc016000 comp rx=0 tx=0).stop 2023-10-09T06:24:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.514+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/1645307464 shutdown_connections 2023-10-09T06:24:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.514+0000 7f7d0e2f6700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7cf4066f30 0x7f7cf40693e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.514+0000 7f7d0e2f6700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d080cd6e0 0x7f7d08155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.514+0000 7f7d0e2f6700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d0815dda0 0x7f7d080b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.514+0000 7f7d0e2f6700 1 --2- 172.21.15.31:0/1645307464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d080cdab0 0x7f7d080b5050 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.514+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/1645307464 >> 172.21.15.31:0/1645307464 conn(0x7f7d08067660 msgr2=0x7f7d0815c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:48.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.514+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/1645307464 shutdown_connections 2023-10-09T06:24:48.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.514+0000 7f7d0e2f6700 1 -- 172.21.15.31:0/1645307464 wait complete. 2023-10-09T06:24:48.527 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:24:48.527 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:24:48.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.648+0000 7ff40759e700 1 Processor -- start 2023-10-09T06:24:48.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.648+0000 7ff40759e700 1 -- start start 2023-10-09T06:24:48.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff40759e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4080cce30 0x7ff40815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff40759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff4080b6580 0x7ff40806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff40759e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff40806a830 0x7ff40815d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff40759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4080b4d70 con 0x7ff4080b6580 2023-10-09T06:24:48.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff40759e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40806ac70 con 0x7ff40806a830 2023-10-09T06:24:48.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff40759e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080cd8d0 con 0x7ff4080cce30 2023-10-09T06:24:48.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff405d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff4080b6580 0x7ff40806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff405d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff4080b6580 0x7ff40806a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48084/0 (socket says 172.21.15.31:48084) 2023-10-09T06:24:48.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff405d9b700 1 -- 172.21.15.31:0/3621139716 learned_addr learned my addr 172.21.15.31:0/3621139716 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff406d9d700 1 --2- 172.21.15.31:0/3621139716 >> v2:172.21.15.158:3300/0 conn(0x7ff40806a830 0x7ff40815d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff40659c700 1 --2- 172.21.15.31:0/3621139716 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4080cce30 0x7ff40815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff405d9b700 1 -- 172.21.15.31:0/3621139716 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4080cce30 msgr2=0x7ff40815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff405d9b700 1 --2- 172.21.15.31:0/3621139716 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4080cce30 0x7ff40815aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff405d9b700 1 -- 172.21.15.31:0/3621139716 >> v2:172.21.15.158:3300/0 conn(0x7ff40806a830 msgr2=0x7ff40815d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff405d9b700 1 --2- 172.21.15.31:0/3621139716 >> v2:172.21.15.158:3300/0 conn(0x7ff40806a830 0x7ff40815d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff405d9b700 1 -- 172.21.15.31:0/3621139716 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080b4440 con 0x7ff4080b6580 2023-10-09T06:24:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.649+0000 7ff406d9d700 1 --2- 172.21.15.31:0/3621139716 >> v2:172.21.15.158:3300/0 conn(0x7ff40806a830 0x7ff40815d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.650+0000 7ff405d9b700 1 --2- 172.21.15.31:0/3621139716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4080b6580 0x7ff40806a2f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff40815a280 tx=0x7ff3fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388576ff2279e1a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.650+0000 7ff40559a700 1 -- 172.21.15.31:0/3621139716 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc00b860 con 0x7ff4080b6580 2023-10-09T06:24:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.650+0000 7ff40559a700 1 -- 172.21.15.31:0/3621139716 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc00b9c0 con 0x7ff4080b6580 2023-10-09T06:24:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.650+0000 7ff40559a700 1 -- 172.21.15.31:0/3621139716 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc00bd60 con 0x7ff4080b6580 2023-10-09T06:24:48.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.650+0000 7ff40759e700 1 -- 172.21.15.31:0/3621139716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4080b6580 msgr2=0x7ff40806a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.650+0000 7ff40759e700 1 --2- 172.21.15.31:0/3621139716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4080b6580 0x7ff40806a2f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff40815a280 tx=0x7ff3fc009250 comp rx=0 tx=0).stop 2023-10-09T06:24:48.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.650+0000 7ff40759e700 1 -- 172.21.15.31:0/3621139716 shutdown_connections 2023-10-09T06:24:48.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.650+0000 7ff40759e700 1 --2- 172.21.15.31:0/3621139716 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4080cce30 0x7ff40815aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.650+0000 7ff40759e700 1 --2- 172.21.15.31:0/3621139716 >> v2:172.21.15.158:3300/0 conn(0x7ff40806a830 0x7ff40815d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.650+0000 7ff40759e700 1 --2- 172.21.15.31:0/3621139716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4080b6580 0x7ff40806a2f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.650+0000 7ff40759e700 1 -- 172.21.15.31:0/3621139716 >> 172.21.15.31:0/3621139716 conn(0x7ff408068cb0 msgr2=0x7ff4080690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:48.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.650+0000 7ff40759e700 1 -- 172.21.15.31:0/3621139716 shutdown_connections 2023-10-09T06:24:48.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.650+0000 7ff40759e700 1 -- 172.21.15.31:0/3621139716 wait complete. 2023-10-09T06:24:48.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.651+0000 7ff40759e700 1 Processor -- start 2023-10-09T06:24:48.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.651+0000 7ff40759e700 1 -- start start 2023-10-09T06:24:48.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.652+0000 7ff40759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40806a830 0x7ff40814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.652+0000 7ff40759e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4080b6580 0x7ff4080af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.652+0000 7ff40759e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4080cce30 0x7ff4080afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.652+0000 7ff40759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff408151370 con 0x7ff40806a830 2023-10-09T06:24:48.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.652+0000 7ff40759e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40814fac0 con 0x7ff4080cce30 2023-10-09T06:24:48.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.652+0000 7ff40759e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff408157570 con 0x7ff4080b6580 2023-10-09T06:24:48.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.652+0000 7ff40659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40806a830 0x7ff40814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.652+0000 7ff40659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40806a830 0x7ff40814f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48098/0 (socket says 172.21.15.31:48098) 2023-10-09T06:24:48.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.652+0000 7ff40659c700 1 -- 172.21.15.31:0/3338467669 learned_addr learned my addr 172.21.15.31:0/3338467669 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:48.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.652+0000 7ff405d9b700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4080b6580 0x7ff4080af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.652+0000 7ff406d9d700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4080cce30 0x7ff4080afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.653+0000 7ff40659c700 1 -- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4080b6580 msgr2=0x7ff4080af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.653+0000 7ff40659c700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4080b6580 0x7ff4080af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.653+0000 7ff40659c700 1 -- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4080cce30 msgr2=0x7ff4080afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.653+0000 7ff40659c700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4080cce30 0x7ff4080afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.653+0000 7ff40659c700 1 -- 172.21.15.31:0/3338467669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0094f0 con 0x7ff40806a830 2023-10-09T06:24:48.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.653+0000 7ff406d9d700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4080cce30 0x7ff4080afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:48.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.653+0000 7ff405d9b700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4080b6580 0x7ff4080af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.653+0000 7ff40659c700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40806a830 0x7ff40814f580 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff400009fa0 tx=0x7ff400009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.653+0000 7ff3f67fc700 1 -- 172.21.15.31:0/3338467669 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000ed20 con 0x7ff40806a830 2023-10-09T06:24:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.653+0000 7ff3f67fc700 1 -- 172.21.15.31:0/3338467669 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40000ee80 con 0x7ff40806a830 2023-10-09T06:24:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.653+0000 7ff40759e700 1 -- 172.21.15.31:0/3338467669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4081577e0 con 0x7ff40806a830 2023-10-09T06:24:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.653+0000 7ff3f67fc700 1 -- 172.21.15.31:0/3338467669 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400014670 con 0x7ff40806a830 2023-10-09T06:24:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.653+0000 7ff40759e700 1 -- 172.21.15.31:0/3338467669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4080b2340 con 0x7ff40806a830 2023-10-09T06:24:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.654+0000 7ff40759e700 1 -- 172.21.15.31:0/3338467669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff408151610 con 0x7ff40806a830 2023-10-09T06:24:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.654+0000 7ff3f67fc700 1 -- 172.21.15.31:0/3338467669 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4000149e0 con 0x7ff40806a830 2023-10-09T06:24:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.655+0000 7ff3f67fc700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff3e8066f30 0x7ff3e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.655+0000 7ff3f67fc700 1 -- 172.21.15.31:0/3338467669 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff400084970 con 0x7ff40806a830 2023-10-09T06:24:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.655+0000 7ff405d9b700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff3e8066f30 0x7ff3e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.656+0000 7ff405d9b700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff3e8066f30 0x7ff3e80693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff40815a280 tx=0x7ff3fc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:48.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.659+0000 7ff3f67fc700 1 -- 172.21.15.31:0/3338467669 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff400051f30 con 0x7ff40806a830 2023-10-09T06:24:48.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.850+0000 7ff40759e700 1 -- 172.21.15.31:0/3338467669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4080b4720 con 0x7ff40806a830 2023-10-09T06:24:48.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.850+0000 7ff3f67fc700 1 -- 172.21.15.31:0/3338467669 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff400055550 con 0x7ff40806a830 2023-10-09T06:24:48.851 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:24:48.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.852+0000 7ff40759e700 1 -- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff3e8066f30 msgr2=0x7ff3e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.852+0000 7ff40759e700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff3e8066f30 0x7ff3e80693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff40815a280 tx=0x7ff3fc017000 comp rx=0 tx=0).stop 2023-10-09T06:24:48.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.852+0000 7ff40759e700 1 -- 172.21.15.31:0/3338467669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40806a830 msgr2=0x7ff40814f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.852+0000 7ff40759e700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40806a830 0x7ff40814f580 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff400009fa0 tx=0x7ff400009880 comp rx=0 tx=0).stop 2023-10-09T06:24:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.852+0000 7ff40759e700 1 -- 172.21.15.31:0/3338467669 shutdown_connections 2023-10-09T06:24:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.852+0000 7ff40759e700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff3e8066f30 0x7ff3e80693e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.852+0000 7ff40759e700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4080cce30 0x7ff4080afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.852+0000 7ff40759e700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40806a830 0x7ff40814f580 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.852+0000 7ff40759e700 1 --2- 172.21.15.31:0/3338467669 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4080b6580 0x7ff4080af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.852+0000 7ff40759e700 1 -- 172.21.15.31:0/3338467669 >> 172.21.15.31:0/3338467669 conn(0x7ff408068cb0 msgr2=0x7ff408157e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.852+0000 7ff40759e700 1 -- 172.21.15.31:0/3338467669 shutdown_connections 2023-10-09T06:24:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.852+0000 7ff40759e700 1 -- 172.21.15.31:0/3338467669 wait complete. 2023-10-09T06:24:48.865 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:24:48.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.985+0000 7f816bfb2700 1 Processor -- start 2023-10-09T06:24:48.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.985+0000 7f816bfb2700 1 -- start start 2023-10-09T06:24:48.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816bfb2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8164157870 0x7f816415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816bfb2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f816415a620 0x7f816415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816bfb2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f816415d580 0x7f8164158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816bfb2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f816415cbb0 con 0x7f816415a620 2023-10-09T06:24:48.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816bfb2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f816415bfa0 con 0x7f8164157870 2023-10-09T06:24:48.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816bfb2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816415c280 con 0x7f816415d580 2023-10-09T06:24:48.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816954d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f816415a620 0x7f816415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816954d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f816415a620 0x7f816415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48114/0 (socket says 172.21.15.31:48114) 2023-10-09T06:24:48.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816954d700 1 -- 172.21.15.31:0/1503940902 learned_addr learned my addr 172.21.15.31:0/1503940902 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:48.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816a54f700 1 --2- 172.21.15.31:0/1503940902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f816415d580 0x7f8164158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f8169d4e700 1 --2- 172.21.15.31:0/1503940902 >> v2:172.21.15.158:3300/0 conn(0x7f8164157870 0x7f816415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816954d700 1 -- 172.21.15.31:0/1503940902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f816415d580 msgr2=0x7f8164158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:48.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816954d700 1 --2- 172.21.15.31:0/1503940902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f816415d580 0x7f8164158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816954d700 1 -- 172.21.15.31:0/1503940902 >> v2:172.21.15.158:3300/0 conn(0x7f8164157870 msgr2=0x7f816415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:48.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816954d700 1 --2- 172.21.15.31:0/1503940902 >> v2:172.21.15.158:3300/0 conn(0x7f8164157870 0x7f816415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816954d700 1 -- 172.21.15.31:0/1503940902 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816415c560 con 0x7f816415a620 2023-10-09T06:24:48.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816a54f700 1 --2- 172.21.15.31:0/1503940902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f816415d580 0x7f8164158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:48.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f8169d4e700 1 --2- 172.21.15.31:0/1503940902 >> v2:172.21.15.158:3300/0 conn(0x7f8164157870 0x7f816415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:48.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f816954d700 1 --2- 172.21.15.31:0/1503940902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f816415a620 0x7f816415d040 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8164069d80 tx=0x7f8154009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50930a988919462 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f8168d4c700 1 -- 172.21.15.31:0/1503940902 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815400b860 con 0x7f816415a620 2023-10-09T06:24:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f8168d4c700 1 -- 172.21.15.31:0/1503940902 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815400b9c0 con 0x7f816415a620 2023-10-09T06:24:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.986+0000 7f8168d4c700 1 -- 172.21.15.31:0/1503940902 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815400bd60 con 0x7f816415a620 2023-10-09T06:24:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.987+0000 7f816bfb2700 1 -- 172.21.15.31:0/1503940902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f816415a620 msgr2=0x7f816415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.987+0000 7f816bfb2700 1 --2- 172.21.15.31:0/1503940902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f816415a620 0x7f816415d040 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8164069d80 tx=0x7f8154009250 comp rx=0 tx=0).stop 2023-10-09T06:24:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.987+0000 7f816bfb2700 1 -- 172.21.15.31:0/1503940902 shutdown_connections 2023-10-09T06:24:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.987+0000 7f816bfb2700 1 --2- 172.21.15.31:0/1503940902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f816415d580 0x7f8164158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.987+0000 7f816bfb2700 1 --2- 172.21.15.31:0/1503940902 >> v2:172.21.15.158:3300/0 conn(0x7f8164157870 0x7f816415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.987+0000 7f816bfb2700 1 --2- 172.21.15.31:0/1503940902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f816415a620 0x7f816415d040 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.987+0000 7f816bfb2700 1 -- 172.21.15.31:0/1503940902 >> 172.21.15.31:0/1503940902 conn(0x7f8164068ce0 msgr2=0x7f81640690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:48.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.987+0000 7f816bfb2700 1 -- 172.21.15.31:0/1503940902 shutdown_connections 2023-10-09T06:24:48.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.987+0000 7f816bfb2700 1 -- 172.21.15.31:0/1503940902 wait complete. 2023-10-09T06:24:48.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.988+0000 7f816bfb2700 1 Processor -- start 2023-10-09T06:24:48.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.988+0000 7f816bfb2700 1 -- start start 2023-10-09T06:24:48.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f816bfb2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8164157870 0x7f816415f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f816bfb2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f816415a620 0x7f81640c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f816bfb2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f816415d580 0x7f816416daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f816bfb2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816415ec30 con 0x7f8164157870 2023-10-09T06:24:48.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f816bfb2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81640b2f10 con 0x7f816415d580 2023-10-09T06:24:48.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f816bfb2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81640b31f0 con 0x7f816415a620 2023-10-09T06:24:48.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f8169d4e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8164157870 0x7f816415f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f8169d4e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8164157870 0x7f816415f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48122/0 (socket says 172.21.15.31:48122) 2023-10-09T06:24:48.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f8169d4e700 1 -- 172.21.15.31:0/281244341 learned_addr learned my addr 172.21.15.31:0/281244341 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:48.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f816954d700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f816415a620 0x7f81640c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f816a54f700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f816415d580 0x7f816416daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f8169d4e700 1 -- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f816415a620 msgr2=0x7f81640c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f8169d4e700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f816415a620 0x7f81640c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f8169d4e700 1 -- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f816415d580 msgr2=0x7f816416daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f8169d4e700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f816415d580 0x7f816416daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.989+0000 7f8169d4e700 1 -- 172.21.15.31:0/281244341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81540094f0 con 0x7f8164157870 2023-10-09T06:24:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.990+0000 7f8169d4e700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8164157870 0x7f816415f0c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f816000c880 tx=0x7f8160008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.990+0000 7f8159ffb700 1 -- 172.21.15.31:0/281244341 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160011600 con 0x7f8164157870 2023-10-09T06:24:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.990+0000 7f8159ffb700 1 -- 172.21.15.31:0/281244341 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8160011760 con 0x7f8164157870 2023-10-09T06:24:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.990+0000 7f816bfb2700 1 -- 172.21.15.31:0/281244341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816415e8c0 con 0x7f8164157870 2023-10-09T06:24:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.990+0000 7f8159ffb700 1 -- 172.21.15.31:0/281244341 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160011ae0 con 0x7f8164157870 2023-10-09T06:24:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.990+0000 7f816bfb2700 1 -- 172.21.15.31:0/281244341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81640b34d0 con 0x7f8164157870 2023-10-09T06:24:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.991+0000 7f816bfb2700 1 -- 172.21.15.31:0/281244341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f816404c3c0 con 0x7f8164157870 2023-10-09T06:24:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.991+0000 7f8159ffb700 1 -- 172.21.15.31:0/281244341 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8160018350 con 0x7f8164157870 2023-10-09T06:24:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.992+0000 7f8159ffb700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8148066f30 0x7f81480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.992+0000 7f8159ffb700 1 -- 172.21.15.31:0/281244341 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8160084030 con 0x7f8164157870 2023-10-09T06:24:48.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.992+0000 7f816954d700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8148066f30 0x7f81480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:48.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.992+0000 7f816954d700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8148066f30 0x7f81480693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8164069d80 tx=0x7f8154017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:48.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:48.996+0000 7f8159ffb700 1 -- 172.21.15.31:0/281244341 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8160055080 con 0x7f8164157870 2023-10-09T06:24:49.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.191+0000 7f816bfb2700 1 -- 172.21.15.31:0/281244341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f816415ef10 con 0x7f8164157870 2023-10-09T06:24:49.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.191+0000 7f8159ffb700 1 -- 172.21.15.31:0/281244341 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8160054c10 con 0x7f8164157870 2023-10-09T06:24:49.192 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:49.192 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-10-09T06:24:49.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:24:49.193 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-10-09T06:24:49.193 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-10-09T06:24:49.193 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:24:49.193 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-10-09T06:24:49.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.194+0000 7f816bfb2700 1 -- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8148066f30 msgr2=0x7f81480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:49.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.194+0000 7f816bfb2700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8148066f30 0x7f81480693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8164069d80 tx=0x7f8154017000 comp rx=0 tx=0).stop 2023-10-09T06:24:49.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.194+0000 7f816bfb2700 1 -- 172.21.15.31:0/281244341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8164157870 msgr2=0x7f816415f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:49.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.194+0000 7f816bfb2700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8164157870 0x7f816415f0c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f816000c880 tx=0x7f8160008040 comp rx=0 tx=0).stop 2023-10-09T06:24:49.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.194+0000 7f816bfb2700 1 -- 172.21.15.31:0/281244341 shutdown_connections 2023-10-09T06:24:49.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.194+0000 7f816bfb2700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8148066f30 0x7f81480693e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.194+0000 7f816bfb2700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f816415d580 0x7f816416daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.194+0000 7f816bfb2700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8164157870 0x7f816415f0c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.194+0000 7f816bfb2700 1 --2- 172.21.15.31:0/281244341 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f816415a620 0x7f81640c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.194+0000 7f816bfb2700 1 -- 172.21.15.31:0/281244341 >> 172.21.15.31:0/281244341 conn(0x7f8164068ce0 msgr2=0x7f8164155840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:49.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.194+0000 7f816bfb2700 1 -- 172.21.15.31:0/281244341 shutdown_connections 2023-10-09T06:24:49.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.194+0000 7f816bfb2700 1 -- 172.21.15.31:0/281244341 wait complete. 2023-10-09T06:24:49.207 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:24:49.207 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:24:49.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.329+0000 7f52dc84b700 1 Processor -- start 2023-10-09T06:24:49.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.329+0000 7f52dc84b700 1 -- start start 2023-10-09T06:24:49.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.330+0000 7f52dc84b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52d80b11f0 0x7f52d80b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:49.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.330+0000 7f52dc84b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d8068cb0 0x7f52d8069130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:49.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.330+0000 7f52dc84b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d80b0d60 con 0x7f52d8159e50 2023-10-09T06:24:49.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.330+0000 7f52dc84b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d8069670 con 0x7f52d80b11f0 2023-10-09T06:24:49.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.330+0000 7f52dc84b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80b3540 con 0x7f52d8068cb0 2023-10-09T06:24:49.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.330+0000 7f52d5d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52d80b11f0 0x7f52d80b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:49.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.330+0000 7f52d659c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f52d8159e50 0x7f52d80b2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55782/0 (socket says 172.21.15.31:55782) 2023-10-09T06:24:49.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.330+0000 7f52d659c700 1 -- 172.21.15.31:0/1089313081 learned_addr learned my addr 172.21.15.31:0/1089313081 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:49.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.330+0000 7f52d6d9d700 1 --2- 172.21.15.31:0/1089313081 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d8068cb0 0x7f52d8069130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:49.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.330+0000 7f52d559a700 1 -- 172.21.15.31:0/1089313081 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066435246 0 0) 0x7f52d80b0d60 con 0x7f52d8159e50 2023-10-09T06:24:49.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.331+0000 7f52d559a700 1 -- 172.21.15.31:0/1089313081 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c0003570 con 0x7f52d8159e50 2023-10-09T06:24:49.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.331+0000 7f52d5d9b700 1 -- 172.21.15.31:0/1089313081 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d8068cb0 msgr2=0x7f52d8069130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:49.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.331+0000 7f52d5d9b700 1 --2- 172.21.15.31:0/1089313081 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d8068cb0 0x7f52d8069130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.331+0000 7f52d5d9b700 1 -- 172.21.15.31:0/1089313081 >> v1:172.21.15.31:6789/0 conn(0x7f52d8159e50 legacy=0x7f52d80b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:49.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.331+0000 7f52d5d9b700 1 -- 172.21.15.31:0/1089313081 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80d15b0 con 0x7f52d80b11f0 2023-10-09T06:24:49.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.331+0000 7f52d5d9b700 1 --2- 172.21.15.31:0/1089313081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d80b11f0 0x7f52d80b1660 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0098e0 tx=0x7f52cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79912d146e4231c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:49.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.331+0000 7f52d559a700 1 -- 172.21.15.31:0/1089313081 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00b640 con 0x7f52d80b11f0 2023-10-09T06:24:49.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.331+0000 7f52d559a700 1 -- 172.21.15.31:0/1089313081 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc00b7a0 con 0x7f52d80b11f0 2023-10-09T06:24:49.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.331+0000 7f52d559a700 1 -- 172.21.15.31:0/1089313081 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00bb40 con 0x7f52d80b11f0 2023-10-09T06:24:49.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.331+0000 7f52dc84b700 1 -- 172.21.15.31:0/1089313081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d80b11f0 msgr2=0x7f52d80b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:49.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.331+0000 7f52dc84b700 1 --2- 172.21.15.31:0/1089313081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d80b11f0 0x7f52d80b1660 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0098e0 tx=0x7f52cc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.332+0000 7f52dc84b700 1 -- 172.21.15.31:0/1089313081 shutdown_connections 2023-10-09T06:24:49.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.332+0000 7f52dc84b700 1 --2- 172.21.15.31:0/1089313081 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d8068cb0 0x7f52d8069130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.332+0000 7f52dc84b700 1 --2- 172.21.15.31:0/1089313081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d80b11f0 0x7f52d80b1660 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.332+0000 7f52dc84b700 1 -- 172.21.15.31:0/1089313081 >> 172.21.15.31:0/1089313081 conn(0x7f52d8068130 msgr2=0x7f52d80d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:49.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.332+0000 7f52dc84b700 1 -- 172.21.15.31:0/1089313081 shutdown_connections 2023-10-09T06:24:49.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.332+0000 7f52dc84b700 1 -- 172.21.15.31:0/1089313081 wait complete. 2023-10-09T06:24:49.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.333+0000 7f52dc84b700 1 Processor -- start 2023-10-09T06:24:49.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.333+0000 7f52dc84b700 1 -- start start 2023-10-09T06:24:49.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.333+0000 7f52dc84b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d8068cb0 0x7f52d8157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:49.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.333+0000 7f52dc84b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d80b11f0 0x7f52d815eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:49.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.333+0000 7f52dc84b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d8159e50 0x7f52d815f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:49.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.333+0000 7f52dc84b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d816d870 con 0x7f52d8159e50 2023-10-09T06:24:49.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.333+0000 7f52dc84b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d816e110 con 0x7f52d80b11f0 2023-10-09T06:24:49.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.333+0000 7f52dc84b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d816b0c0 con 0x7f52d8068cb0 2023-10-09T06:24:49.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.333+0000 7f52d6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d8159e50 0x7f52d815f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:49.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52d6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d8159e50 0x7f52d815f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48136/0 (socket says 172.21.15.31:48136) 2023-10-09T06:24:49.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52d6d9d700 1 -- 172.21.15.31:0/539087272 learned_addr learned my addr 172.21.15.31:0/539087272 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:49.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52d5d9b700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d80b11f0 0x7f52d815eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:49.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52d659c700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d8068cb0 0x7f52d8157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:49.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52d6d9d700 1 -- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d8068cb0 msgr2=0x7f52d8157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:49.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52d6d9d700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d8068cb0 0x7f52d8157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52d6d9d700 1 -- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d80b11f0 msgr2=0x7f52d815eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:49.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52d6d9d700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d80b11f0 0x7f52d815eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52d6d9d700 1 -- 172.21.15.31:0/539087272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc009420 con 0x7f52d8159e50 2023-10-09T06:24:49.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52d6d9d700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d8159e50 0x7f52d815f2e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009fa0 tx=0x7f52d0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:49.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52c67fc700 1 -- 172.21.15.31:0/539087272 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d000ebc0 con 0x7f52d8159e50 2023-10-09T06:24:49.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52c67fc700 1 -- 172.21.15.31:0/539087272 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d000ed20 con 0x7f52d8159e50 2023-10-09T06:24:49.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52dc84b700 1 -- 172.21.15.31:0/539087272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d816dac0 con 0x7f52d8159e50 2023-10-09T06:24:49.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52c67fc700 1 -- 172.21.15.31:0/539087272 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0014670 con 0x7f52d8159e50 2023-10-09T06:24:49.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.334+0000 7f52dc84b700 1 -- 172.21.15.31:0/539087272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d8158500 con 0x7f52d8159e50 2023-10-09T06:24:49.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.335+0000 7f52dc84b700 1 -- 172.21.15.31:0/539087272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d804c3c0 con 0x7f52d8159e50 2023-10-09T06:24:49.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.336+0000 7f52c67fc700 1 -- 172.21.15.31:0/539087272 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52d00149e0 con 0x7f52d8159e50 2023-10-09T06:24:49.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.336+0000 7f52c67fc700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52b8066f30 0x7f52b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:49.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.336+0000 7f52c67fc700 1 -- 172.21.15.31:0/539087272 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f52d0084880 con 0x7f52d8159e50 2023-10-09T06:24:49.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.336+0000 7f52d659c700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52b8066f30 0x7f52b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:49.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.336+0000 7f52d659c700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52b8066f30 0x7f52b80693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f52c8007fd0 tx=0x7f52c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:49.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.340+0000 7f52c67fc700 1 -- 172.21.15.31:0/539087272 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52d0051e40 con 0x7f52d8159e50 2023-10-09T06:24:49.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.534+0000 7f52dc84b700 1 -- 172.21.15.31:0/539087272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f52d816df60 con 0x7f52d8159e50 2023-10-09T06:24:49.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.966+0000 7f52c67fc700 1 -- 172.21.15.31:0/539087272 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7f52d0055460 con 0x7f52d8159e50 2023-10-09T06:24:49.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.969+0000 7f52dc84b700 1 -- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52b8066f30 msgr2=0x7f52b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:49.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.969+0000 7f52dc84b700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52b8066f30 0x7f52b80693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f52c8007fd0 tx=0x7f52c8009040 comp rx=0 tx=0).stop 2023-10-09T06:24:49.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.969+0000 7f52dc84b700 1 -- 172.21.15.31:0/539087272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d8159e50 msgr2=0x7f52d815f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:49.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.969+0000 7f52dc84b700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d8159e50 0x7f52d815f2e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009fa0 tx=0x7f52d0009900 comp rx=0 tx=0).stop 2023-10-09T06:24:49.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.970+0000 7f52dc84b700 1 -- 172.21.15.31:0/539087272 shutdown_connections 2023-10-09T06:24:49.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.970+0000 7f52dc84b700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52b8066f30 0x7f52b80693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.970+0000 7f52dc84b700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52d8068cb0 0x7f52d8157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.970+0000 7f52dc84b700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52d8159e50 0x7f52d815f2e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.970+0000 7f52dc84b700 1 --2- 172.21.15.31:0/539087272 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52d80b11f0 0x7f52d815eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:49.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.970+0000 7f52dc84b700 1 -- 172.21.15.31:0/539087272 >> 172.21.15.31:0/539087272 conn(0x7f52d8068130 msgr2=0x7f52d80b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:49.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.970+0000 7f52dc84b700 1 -- 172.21.15.31:0/539087272 shutdown_connections 2023-10-09T06:24:49.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:49.970+0000 7f52dc84b700 1 -- 172.21.15.31:0/539087272 wait complete. 2023-10-09T06:24:49.972 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-10-09T06:24:49.984 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:24:50.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.110+0000 7f0487aac700 1 Processor -- start 2023-10-09T06:24:50.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.110+0000 7f0487aac700 1 -- start start 2023-10-09T06:24:50.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.111+0000 7f0487aac700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f048015b9a0 0x7f04800caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:50.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.111+0000 7f0487aac700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f048006d370 0x7f048006d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:50.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.111+0000 7f0487aac700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048015c8d0 con 0x7f0480152300 2023-10-09T06:24:50.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.111+0000 7f0487aac700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04800b1400 con 0x7f048015b9a0 2023-10-09T06:24:50.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.111+0000 7f0487aac700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048015be20 con 0x7f048006d370 2023-10-09T06:24:50.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0485047700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f048015b9a0 0x7f04800caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:50.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0486049700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f048006d370 0x7f048006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:50.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0485848700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f0480152300 0x7f0480158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:56490/0 (socket says 172.21.15.31:56490) 2023-10-09T06:24:50.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0485047700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f048015b9a0 0x7f04800caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:36834/0 (socket says 172.21.15.31:36834) 2023-10-09T06:24:50.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0485848700 1 -- 172.21.15.31:0/1750972390 learned_addr learned my addr 172.21.15.31:0/1750972390 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:50.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0486049700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f048006d370 0x7f048006d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:38752/0 (socket says 172.21.15.31:38752) 2023-10-09T06:24:50.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0486049700 1 -- 172.21.15.31:0/1750972390 >> v2:172.21.15.158:3300/0 conn(0x7f048015b9a0 msgr2=0x7f04800caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:50.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0486049700 1 --2- 172.21.15.31:0/1750972390 >> v2:172.21.15.158:3300/0 conn(0x7f048015b9a0 0x7f04800caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:50.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0486049700 1 -- 172.21.15.31:0/1750972390 >> v1:172.21.15.158:6789/0 conn(0x7f0480152300 legacy=0x7f0480158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:50.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0486049700 1 -- 172.21.15.31:0/1750972390 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04800c9370 con 0x7f048006d370 2023-10-09T06:24:50.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0485047700 1 --2- 172.21.15.31:0/1750972390 >> v2:172.21.15.158:3300/0 conn(0x7f048015b9a0 0x7f04800caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:24:50.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0486049700 1 --2- 172.21.15.31:0/1750972390 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f048006d370 0x7f048006d790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0470009e60 tx=0x7f0470009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5120b302af0f6009 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:50.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0484846700 1 -- 172.21.15.31:0/1750972390 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047000e070 con 0x7f048006d370 2023-10-09T06:24:50.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0484846700 1 -- 172.21.15.31:0/1750972390 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047000bb60 con 0x7f048006d370 2023-10-09T06:24:50.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.112+0000 7f0484846700 1 -- 172.21.15.31:0/1750972390 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470012430 con 0x7f048006d370 2023-10-09T06:24:50.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.113+0000 7f0487aac700 1 -- 172.21.15.31:0/1750972390 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f048006d370 msgr2=0x7f048006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:50.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.113+0000 7f0487aac700 1 --2- 172.21.15.31:0/1750972390 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f048006d370 0x7f048006d790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0470009e60 tx=0x7f0470009780 comp rx=0 tx=0).stop 2023-10-09T06:24:50.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.113+0000 7f0487aac700 1 -- 172.21.15.31:0/1750972390 shutdown_connections 2023-10-09T06:24:50.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.113+0000 7f0487aac700 1 --2- 172.21.15.31:0/1750972390 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f048006d370 0x7f048006d790 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:50.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.113+0000 7f0487aac700 1 --2- 172.21.15.31:0/1750972390 >> v2:172.21.15.158:3300/0 conn(0x7f048015b9a0 0x7f04800caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:50.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.113+0000 7f0487aac700 1 -- 172.21.15.31:0/1750972390 >> 172.21.15.31:0/1750972390 conn(0x7f0480069870 msgr2=0x7f0480069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:50.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.113+0000 7f0487aac700 1 -- 172.21.15.31:0/1750972390 shutdown_connections 2023-10-09T06:24:50.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.113+0000 7f0487aac700 1 -- 172.21.15.31:0/1750972390 wait complete. 2023-10-09T06:24:50.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.114+0000 7f0487aac700 1 Processor -- start 2023-10-09T06:24:50.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.114+0000 7f0487aac700 1 -- start start 2023-10-09T06:24:50.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0487aac700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f048006d370 0x7f0480150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:50.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0487aac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0480152300 0x7f048016a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:50.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0487aac700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f048015b9a0 0x7f04800b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:50.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0487aac700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04800b2680 con 0x7f0480152300 2023-10-09T06:24:50.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0487aac700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0480150960 con 0x7f048015b9a0 2023-10-09T06:24:50.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0487aac700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0480069680 con 0x7f048006d370 2023-10-09T06:24:50.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0485047700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0480152300 0x7f048016a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:50.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0485047700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0480152300 0x7f048016a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59438/0 (socket says 172.21.15.31:59438) 2023-10-09T06:24:50.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0485047700 1 -- 172.21.15.31:0/836115753 learned_addr learned my addr 172.21.15.31:0/836115753 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:50.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0485848700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f048006d370 0x7f0480150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:50.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0486049700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f048015b9a0 0x7f04800b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:50.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0485047700 1 -- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f048006d370 msgr2=0x7f0480150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:50.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0485047700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f048006d370 0x7f0480150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:50.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0485047700 1 -- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f048015b9a0 msgr2=0x7f04800b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:50.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0485047700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f048015b9a0 0x7f04800b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:50.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0485047700 1 -- 172.21.15.31:0/836115753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0474009420 con 0x7f0480152300 2023-10-09T06:24:50.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f0485047700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0480152300 0x7f048016a000 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f047400ec80 tx=0x7f04740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:50.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.115+0000 7f047dffb700 1 -- 172.21.15.31:0/836115753 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047400c9d0 con 0x7f0480152300 2023-10-09T06:24:50.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.116+0000 7f047dffb700 1 -- 172.21.15.31:0/836115753 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047400cb30 con 0x7f0480152300 2023-10-09T06:24:50.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.116+0000 7f0487aac700 1 -- 172.21.15.31:0/836115753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0470009a20 con 0x7f0480152300 2023-10-09T06:24:50.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.116+0000 7f047dffb700 1 -- 172.21.15.31:0/836115753 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047400ced0 con 0x7f0480152300 2023-10-09T06:24:50.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.116+0000 7f0487aac700 1 -- 172.21.15.31:0/836115753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04800c7050 con 0x7f0480152300 2023-10-09T06:24:50.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.117+0000 7f0487aac700 1 -- 172.21.15.31:0/836115753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048004c3c0 con 0x7f0480152300 2023-10-09T06:24:50.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.117+0000 7f047dffb700 1 -- 172.21.15.31:0/836115753 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0474013680 con 0x7f0480152300 2023-10-09T06:24:50.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.117+0000 7f047dffb700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f046c066f30 0x7f046c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:50.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.118+0000 7f047dffb700 1 -- 172.21.15.31:0/836115753 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f0474084620 con 0x7f0480152300 2023-10-09T06:24:50.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.118+0000 7f0485848700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f046c066f30 0x7f046c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:50.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.118+0000 7f0485848700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f046c066f30 0x7f046c0693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0478001820 tx=0x7f0478009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:50.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.122+0000 7f047dffb700 1 -- 172.21.15.31:0/836115753 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0474051a70 con 0x7f0480152300 2023-10-09T06:24:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.314+0000 7f0487aac700 1 -- 172.21.15.31:0/836115753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f04800cdf10 con 0x7f0480152300 2023-10-09T06:24:50.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.974+0000 7f047dffb700 1 -- 172.21.15.31:0/836115753 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0474055090 con 0x7f0480152300 2023-10-09T06:24:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.985+0000 7f0487aac700 1 -- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f046c066f30 msgr2=0x7f046c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.985+0000 7f0487aac700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f046c066f30 0x7f046c0693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0478001820 tx=0x7f0478009040 comp rx=0 tx=0).stop 2023-10-09T06:24:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.985+0000 7f0487aac700 1 -- 172.21.15.31:0/836115753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0480152300 msgr2=0x7f048016a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.985+0000 7f0487aac700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0480152300 0x7f048016a000 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f047400ec80 tx=0x7f04740091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.985+0000 7f0487aac700 1 -- 172.21.15.31:0/836115753 shutdown_connections 2023-10-09T06:24:50.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.985+0000 7f0487aac700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f046c066f30 0x7f046c0693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:50.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.985+0000 7f0487aac700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f048006d370 0x7f0480150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:50.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.985+0000 7f0487aac700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f048015b9a0 0x7f04800b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:50.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.985+0000 7f0487aac700 1 --2- 172.21.15.31:0/836115753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0480152300 0x7f048016a000 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:50.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.985+0000 7f0487aac700 1 -- 172.21.15.31:0/836115753 >> 172.21.15.31:0/836115753 conn(0x7f0480069870 msgr2=0x7f04800cac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:50.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.985+0000 7f0487aac700 1 -- 172.21.15.31:0/836115753 shutdown_connections 2023-10-09T06:24:50.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:50.985+0000 7f0487aac700 1 -- 172.21.15.31:0/836115753 wait complete. 2023-10-09T06:24:50.987 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-10-09T06:24:51.000 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:24:51.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.126+0000 7f5ae6ccb700 1 Processor -- start 2023-10-09T06:24:51.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.126+0000 7f5ae6ccb700 1 -- start start 2023-10-09T06:24:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5ae6ccb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5ae015a290 0x7f5ae006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5ae6ccb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae00b0790 con 0x7f5ae0159ec0 2023-10-09T06:24:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5ae6ccb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae006af20 con 0x7f5ae006aae0 2023-10-09T06:24:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5ae6ccb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae00ce1f0 con 0x7f5ae015a290 2023-10-09T06:24:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5ae4a67700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5ae0159ec0 0x7f5ae00af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54660/0 (socket says 172.21.15.31:54660) 2023-10-09T06:24:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5ae4a67700 1 -- 172.21.15.31:0/2857973522 learned_addr learned my addr 172.21.15.31:0/2857973522 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5adffff700 1 --2- 172.21.15.31:0/2857973522 >> v2:172.21.15.158:3300/0 conn(0x7f5ae015a290 0x7f5ae006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5adf7fe700 1 -- 172.21.15.31:0/2857973522 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200397808 0 0) 0x7f5ae00b0790 con 0x7f5ae0159ec0 2023-10-09T06:24:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5adf7fe700 1 -- 172.21.15.31:0/2857973522 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac8003570 con 0x7f5ae0159ec0 2023-10-09T06:24:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5adf7fe700 1 -- 172.21.15.31:0/2857973522 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080489790 0 0) 0x7f5ae006af20 con 0x7f5ae006aae0 2023-10-09T06:24:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5adf7fe700 1 -- 172.21.15.31:0/2857973522 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae00b0790 con 0x7f5ae006aae0 2023-10-09T06:24:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5adf7fe700 1 -- 172.21.15.31:0/2857973522 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2448297625 0 0) 0x7f5ac8003570 con 0x7f5ae0159ec0 2023-10-09T06:24:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5adffff700 1 -- 172.21.15.31:0/2857973522 >> v1:172.21.15.158:6789/0 conn(0x7f5ae006aae0 legacy=0x7f5ae00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5adffff700 1 -- 172.21.15.31:0/2857973522 >> v1:172.21.15.31:6789/0 conn(0x7f5ae0159ec0 legacy=0x7f5ae00af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.127+0000 7f5adffff700 1 -- 172.21.15.31:0/2857973522 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae00b0b20 con 0x7f5ae015a290 2023-10-09T06:24:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.128+0000 7f5adffff700 1 --2- 172.21.15.31:0/2857973522 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ae015a290 0x7f5ae006a5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40098e0 tx=0x7f5ad40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4309915cc627a599 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.128+0000 7f5adf7fe700 1 -- 172.21.15.31:0/2857973522 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0001470 con 0x7f5ae015a290 2023-10-09T06:24:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.128+0000 7f5adf7fe700 1 -- 172.21.15.31:0/2857973522 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad4011420 con 0x7f5ae015a290 2023-10-09T06:24:51.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.128+0000 7f5adf7fe700 1 -- 172.21.15.31:0/2857973522 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40117c0 con 0x7f5ae015a290 2023-10-09T06:24:51.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.128+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2857973522 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ae015a290 msgr2=0x7f5ae006a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:51.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.128+0000 7f5ae6ccb700 1 --2- 172.21.15.31:0/2857973522 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ae015a290 0x7f5ae006a5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40098e0 tx=0x7f5ad40091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:51.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.128+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2857973522 shutdown_connections 2023-10-09T06:24:51.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.128+0000 7f5ae6ccb700 1 --2- 172.21.15.31:0/2857973522 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ae015a290 0x7f5ae006a5a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:51.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.128+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2857973522 >> 172.21.15.31:0/2857973522 conn(0x7f5ae00d1880 msgr2=0x7f5ae00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:51.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.128+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2857973522 shutdown_connections 2023-10-09T06:24:51.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.128+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2857973522 wait complete. 2023-10-09T06:24:51.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.129+0000 7f5ae6ccb700 1 Processor -- start 2023-10-09T06:24:51.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.130+0000 7f5ae6ccb700 1 -- start start 2023-10-09T06:24:51.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.130+0000 7f5ae6ccb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5ae006aae0 0x7f5ae00b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:51.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.130+0000 7f5ae6ccb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ae0159ec0 0x7f5ae015a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:51.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.130+0000 7f5ae6ccb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ae015a290 0x7f5ae01639b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:51.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.130+0000 7f5ae6ccb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00b64c0 con 0x7f5ae015a290 2023-10-09T06:24:51.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.130+0000 7f5ae6ccb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00b5420 con 0x7f5ae0159ec0 2023-10-09T06:24:51.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.130+0000 7f5ae6ccb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00b5700 con 0x7f5ae006aae0 2023-10-09T06:24:51.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.130+0000 7f5ae5268700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ae015a290 0x7f5ae01639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:51.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.130+0000 7f5ae5268700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ae015a290 0x7f5ae01639b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59442/0 (socket says 172.21.15.31:59442) 2023-10-09T06:24:51.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.130+0000 7f5ae5268700 1 -- 172.21.15.31:0/2967933969 learned_addr learned my addr 172.21.15.31:0/2967933969 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:51.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.131+0000 7f5ae4a67700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5ae006aae0 0x7f5ae00b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:51.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.131+0000 7f5adffff700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ae0159ec0 0x7f5ae015a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:51.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.131+0000 7f5ae5268700 1 -- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5ae006aae0 msgr2=0x7f5ae00b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:51.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.131+0000 7f5ae5268700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5ae006aae0 0x7f5ae00b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:51.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.131+0000 7f5ae5268700 1 -- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ae0159ec0 msgr2=0x7f5ae015a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:51.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.131+0000 7f5ae5268700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ae0159ec0 0x7f5ae015a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:51.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.131+0000 7f5ae5268700 1 -- 172.21.15.31:0/2967933969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad4009420 con 0x7f5ae015a290 2023-10-09T06:24:51.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.131+0000 7f5ae5268700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ae015a290 0x7f5ae01639b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800c910 tx=0x7f5ad80027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:51.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.131+0000 7f5adcff9700 1 -- 172.21.15.31:0/2967933969 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8012630 con 0x7f5ae015a290 2023-10-09T06:24:51.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.131+0000 7f5adcff9700 1 -- 172.21.15.31:0/2967933969 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad80127b0 con 0x7f5ae015a290 2023-10-09T06:24:51.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.131+0000 7f5adcff9700 1 -- 172.21.15.31:0/2967933969 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8012b70 con 0x7f5ae015a290 2023-10-09T06:24:51.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.131+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2967933969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae00b59e0 con 0x7f5ae015a290 2023-10-09T06:24:51.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.131+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2967933969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae00b5fa0 con 0x7f5ae015a290 2023-10-09T06:24:51.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.132+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2967933969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae004c3c0 con 0x7f5ae015a290 2023-10-09T06:24:51.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.133+0000 7f5adcff9700 1 -- 172.21.15.31:0/2967933969 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ad801b400 con 0x7f5ae015a290 2023-10-09T06:24:51.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.133+0000 7f5adcff9700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5acc066f30 0x7f5acc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:51.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.133+0000 7f5adcff9700 1 -- 172.21.15.31:0/2967933969 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f5ad80847c0 con 0x7f5ae015a290 2023-10-09T06:24:51.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.133+0000 7f5ae4a67700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5acc066f30 0x7f5acc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:51.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.134+0000 7f5ae4a67700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5acc066f30 0x7f5acc0693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00011e0 tx=0x7f5ad0000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:51.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.137+0000 7f5adcff9700 1 -- 172.21.15.31:0/2967933969 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ad8051a90 con 0x7f5ae015a290 2023-10-09T06:24:51.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.379+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2967933969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5ae00ccde0 con 0x7f5ae015a290 2023-10-09T06:24:51.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.975+0000 7f5adcff9700 1 -- 172.21.15.31:0/2967933969 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v38) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5ad80550b0 con 0x7f5ae015a290 2023-10-09T06:24:51.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.981+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5acc066f30 msgr2=0x7f5acc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:51.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.981+0000 7f5ae6ccb700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5acc066f30 0x7f5acc0693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00011e0 tx=0x7f5ad0000bc0 comp rx=0 tx=0).stop 2023-10-09T06:24:51.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.981+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2967933969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ae015a290 msgr2=0x7f5ae01639b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:51.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.981+0000 7f5ae6ccb700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ae015a290 0x7f5ae01639b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800c910 tx=0x7f5ad80027a0 comp rx=0 tx=0).stop 2023-10-09T06:24:51.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.981+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2967933969 shutdown_connections 2023-10-09T06:24:51.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.981+0000 7f5ae6ccb700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5acc066f30 0x7f5acc0693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:51.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.981+0000 7f5ae6ccb700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5ae006aae0 0x7f5ae00b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:51.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.981+0000 7f5ae6ccb700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ae015a290 0x7f5ae01639b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:51.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.981+0000 7f5ae6ccb700 1 --2- 172.21.15.31:0/2967933969 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ae0159ec0 0x7f5ae015a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:51.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.981+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2967933969 >> 172.21.15.31:0/2967933969 conn(0x7f5ae00d1880 msgr2=0x7f5ae00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:51.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.981+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2967933969 shutdown_connections 2023-10-09T06:24:51.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:51.981+0000 7f5ae6ccb700 1 -- 172.21.15.31:0/2967933969 wait complete. 2023-10-09T06:24:51.983 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 10 and data pool 11 2023-10-09T06:24:51.994 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:24:52.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.113+0000 7fab823d2700 1 Processor -- start 2023-10-09T06:24:52.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.113+0000 7fab823d2700 1 -- start start 2023-10-09T06:24:52.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.113+0000 7fab823d2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fab7c0cf1c0 0x7fab7c15e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.113+0000 7fab823d2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab7c15a0c0 0x7fab7c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.113+0000 7fab823d2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7c0cca20 con 0x7fab7c159cf0 2023-10-09T06:24:52.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab823d2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7c15ea40 con 0x7fab7c0cf1c0 2023-10-09T06:24:52.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab823d2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c067660 con 0x7fab7c15a0c0 2023-10-09T06:24:52.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab7bfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fab7c159cf0 0x7fab7c0ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54662/0 (socket says 172.21.15.31:54662) 2023-10-09T06:24:52.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab7bfff700 1 -- 172.21.15.31:0/2539279423 learned_addr learned my addr 172.21.15.31:0/2539279423 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:52.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab7b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fab7c0cf1c0 0x7fab7c15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab8096f700 1 --2- 172.21.15.31:0/2539279423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab7c15a0c0 0x7fab7c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab7b7fe700 1 -- 172.21.15.31:0/2539279423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab7c15a0c0 msgr2=0x7fab7c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:52.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab7b7fe700 1 --2- 172.21.15.31:0/2539279423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab7c15a0c0 0x7fab7c068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab7b7fe700 1 -- 172.21.15.31:0/2539279423 >> v1:172.21.15.31:6789/0 conn(0x7fab7c159cf0 legacy=0x7fab7c0ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab7affd700 1 -- 172.21.15.31:0/2539279423 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370180140 0 0) 0x7fab7c0cca20 con 0x7fab7c159cf0 2023-10-09T06:24:52.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab7b7fe700 1 -- 172.21.15.31:0/2539279423 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c067f00 con 0x7fab7c0cf1c0 2023-10-09T06:24:52.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab7b7fe700 1 --2- 172.21.15.31:0/2539279423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab7c0cf1c0 0x7fab7c15e500 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fab700098e0 tx=0x7fab700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e871caff6bdc26f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:52.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab7affd700 1 -- 172.21.15.31:0/2539279423 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70009e80 con 0x7fab7c0cf1c0 2023-10-09T06:24:52.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab7affd700 1 -- 172.21.15.31:0/2539279423 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7000b860 con 0x7fab7c0cf1c0 2023-10-09T06:24:52.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.114+0000 7fab7affd700 1 -- 172.21.15.31:0/2539279423 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7000bbe0 con 0x7fab7c0cf1c0 2023-10-09T06:24:52.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.115+0000 7fab823d2700 1 -- 172.21.15.31:0/2539279423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab7c0cf1c0 msgr2=0x7fab7c15e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.115+0000 7fab823d2700 1 --2- 172.21.15.31:0/2539279423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab7c0cf1c0 0x7fab7c15e500 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fab700098e0 tx=0x7fab700091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.115+0000 7fab823d2700 1 -- 172.21.15.31:0/2539279423 shutdown_connections 2023-10-09T06:24:52.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.115+0000 7fab823d2700 1 --2- 172.21.15.31:0/2539279423 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab7c15a0c0 0x7fab7c068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.115+0000 7fab823d2700 1 --2- 172.21.15.31:0/2539279423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab7c0cf1c0 0x7fab7c15e500 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.115+0000 7fab823d2700 1 -- 172.21.15.31:0/2539279423 >> 172.21.15.31:0/2539279423 conn(0x7fab7c06c6e0 msgr2=0x7fab7c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:52.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.115+0000 7fab823d2700 1 -- 172.21.15.31:0/2539279423 shutdown_connections 2023-10-09T06:24:52.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.115+0000 7fab823d2700 1 -- 172.21.15.31:0/2539279423 wait complete. 2023-10-09T06:24:52.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.116+0000 7fab823d2700 1 Processor -- start 2023-10-09T06:24:52.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.116+0000 7fab823d2700 1 -- start start 2023-10-09T06:24:52.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab823d2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab7c0cf1c0 0x7fab7c0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab823d2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab7c159cf0 0x7fab7c0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab823d2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab7c15a0c0 0x7fab7c153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab823d2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0aa870 con 0x7fab7c159cf0 2023-10-09T06:24:52.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab823d2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0ab110 con 0x7fab7c15a0c0 2023-10-09T06:24:52.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab823d2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0ad6d0 con 0x7fab7c0cf1c0 2023-10-09T06:24:52.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab7b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab7c159cf0 0x7fab7c0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab7b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab7c159cf0 0x7fab7c0c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59448/0 (socket says 172.21.15.31:59448) 2023-10-09T06:24:52.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab7b7fe700 1 -- 172.21.15.31:0/1312059604 learned_addr learned my addr 172.21.15.31:0/1312059604 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:52.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab8096f700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab7c15a0c0 0x7fab7c153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab7bfff700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab7c0cf1c0 0x7fab7c0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab7b7fe700 1 -- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab7c0cf1c0 msgr2=0x7fab7c0ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab7b7fe700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab7c0cf1c0 0x7fab7c0ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab7b7fe700 1 -- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab7c15a0c0 msgr2=0x7fab7c153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab7b7fe700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab7c15a0c0 0x7fab7c153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab7b7fe700 1 -- 172.21.15.31:0/1312059604 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70009420 con 0x7fab7c159cf0 2023-10-09T06:24:52.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.117+0000 7fab7bfff700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab7c0cf1c0 0x7fab7c0ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:52.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.118+0000 7fab7b7fe700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab7c159cf0 0x7fab7c0c7c90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fab7000b3c0 tx=0x7fab70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:52.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.118+0000 7fab63fff700 1 -- 172.21.15.31:0/1312059604 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7000bbe0 con 0x7fab7c159cf0 2023-10-09T06:24:52.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.118+0000 7fab63fff700 1 -- 172.21.15.31:0/1312059604 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab70011420 con 0x7fab7c159cf0 2023-10-09T06:24:52.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.118+0000 7fab823d2700 1 -- 172.21.15.31:0/1312059604 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7c0c8770 con 0x7fab7c159cf0 2023-10-09T06:24:52.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.118+0000 7fab63fff700 1 -- 172.21.15.31:0/1312059604 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab700117e0 con 0x7fab7c159cf0 2023-10-09T06:24:52.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.118+0000 7fab823d2700 1 -- 172.21.15.31:0/1312059604 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7c0aada0 con 0x7fab7c159cf0 2023-10-09T06:24:52.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.119+0000 7fab823d2700 1 -- 172.21.15.31:0/1312059604 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7c0ab2c0 con 0x7fab7c159cf0 2023-10-09T06:24:52.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.119+0000 7fab63fff700 1 -- 172.21.15.31:0/1312059604 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab70011bd0 con 0x7fab7c159cf0 2023-10-09T06:24:52.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.120+0000 7fab63fff700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fab68066f30 0x7fab680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.120+0000 7fab63fff700 1 -- 172.21.15.31:0/1312059604 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab70085e40 con 0x7fab7c159cf0 2023-10-09T06:24:52.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.120+0000 7fab7bfff700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fab68066f30 0x7fab680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.120+0000 7fab7bfff700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fab68066f30 0x7fab680693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0011e0 tx=0x7fab6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:52.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.124+0000 7fab63fff700 1 -- 172.21.15.31:0/1312059604 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab7c0ab2c0 con 0x7fab7c159cf0 2023-10-09T06:24:52.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.317+0000 7fab823d2700 1 -- 172.21.15.31:0/1312059604 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab7c0ab2c0 con 0x7fab7c159cf0 2023-10-09T06:24:52.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.317+0000 7fab63fff700 1 -- 172.21.15.31:0/1312059604 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+15366 (secure 0 0 0) 0x7fab7c0ab2c0 con 0x7fab7c159cf0 2023-10-09T06:24:52.318 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:52.318 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":83,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:24:51.380729+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:24:49.565040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T06:24:50.345838+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:24:52.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.319+0000 7fab823d2700 1 -- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fab68066f30 msgr2=0x7fab680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.319+0000 7fab823d2700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fab68066f30 0x7fab680693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0011e0 tx=0x7fab6c009040 comp rx=0 tx=0).stop 2023-10-09T06:24:52.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.319+0000 7fab823d2700 1 -- 172.21.15.31:0/1312059604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab7c159cf0 msgr2=0x7fab7c0c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.319+0000 7fab823d2700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab7c159cf0 0x7fab7c0c7c90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fab7000b3c0 tx=0x7fab70017000 comp rx=0 tx=0).stop 2023-10-09T06:24:52.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.320+0000 7fab823d2700 1 -- 172.21.15.31:0/1312059604 shutdown_connections 2023-10-09T06:24:52.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.320+0000 7fab823d2700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fab68066f30 0x7fab680693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.320+0000 7fab823d2700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fab7c0cf1c0 0x7fab7c0ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.320+0000 7fab823d2700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab7c15a0c0 0x7fab7c153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.320+0000 7fab823d2700 1 --2- 172.21.15.31:0/1312059604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab7c159cf0 0x7fab7c0c7c90 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.320+0000 7fab823d2700 1 -- 172.21.15.31:0/1312059604 >> 172.21.15.31:0/1312059604 conn(0x7fab7c06c6e0 msgr2=0x7fab7c069680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:52.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.320+0000 7fab823d2700 1 -- 172.21.15.31:0/1312059604 shutdown_connections 2023-10-09T06:24:52.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.320+0000 7fab823d2700 1 -- 172.21.15.31:0/1312059604 wait complete. 2023-10-09T06:24:52.333 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:24:52.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.451+0000 7f52ce0d5700 1 Processor -- start 2023-10-09T06:24:52.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.451+0000 7f52ce0d5700 1 -- start start 2023-10-09T06:24:52.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.452+0000 7f52ce0d5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52c80cd6e0 0x7f52c80cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.452+0000 7f52ce0d5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f52c80cdab0 0x7f52c815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.452+0000 7f52ce0d5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c80cb7c0 con 0x7f52c815dda0 2023-10-09T06:24:52.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.452+0000 7f52ce0d5700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c815e850 con 0x7f52c80cdab0 2023-10-09T06:24:52.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.452+0000 7f52ce0d5700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c80cd030 con 0x7f52c80cd6e0 2023-10-09T06:24:52.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.452+0000 7f52cd8d4700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f52c815dda0 0x7f52c815cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54678/0 (socket says 172.21.15.31:54678) 2023-10-09T06:24:52.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.452+0000 7f52cd8d4700 1 -- 172.21.15.31:0/1397157467 learned_addr learned my addr 172.21.15.31:0/1397157467 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:52.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.452+0000 7f52cd0d3700 1 --2- 172.21.15.31:0/1397157467 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52c80cd6e0 0x7f52c80cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.452+0000 7f52cc8d2700 1 --2- 172.21.15.31:0/1397157467 >> v2:172.21.15.158:3300/0 conn(0x7f52c80cdab0 0x7f52c815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.452+0000 7f52c7fff700 1 -- 172.21.15.31:0/1397157467 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862063207 0 0) 0x7f52c80cb7c0 con 0x7f52c815dda0 2023-10-09T06:24:52.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.452+0000 7f52c7fff700 1 -- 172.21.15.31:0/1397157467 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b0003570 con 0x7f52c815dda0 2023-10-09T06:24:52.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.453+0000 7f52c7fff700 1 -- 172.21.15.31:0/1397157467 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1375020038 0 0) 0x7f52b0003570 con 0x7f52c815dda0 2023-10-09T06:24:52.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.453+0000 7f52cd0d3700 1 -- 172.21.15.31:0/1397157467 >> v2:172.21.15.158:3300/0 conn(0x7f52c80cdab0 msgr2=0x7f52c815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:52.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.453+0000 7f52cd0d3700 1 --2- 172.21.15.31:0/1397157467 >> v2:172.21.15.158:3300/0 conn(0x7f52c80cdab0 0x7f52c815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.453+0000 7f52cd0d3700 1 -- 172.21.15.31:0/1397157467 >> v1:172.21.15.31:6789/0 conn(0x7f52c815dda0 legacy=0x7f52c815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.453+0000 7f52cd0d3700 1 -- 172.21.15.31:0/1397157467 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c815e290 con 0x7f52c80cd6e0 2023-10-09T06:24:52.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.453+0000 7f52cd0d3700 1 --2- 172.21.15.31:0/1397157467 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52c80cd6e0 0x7f52c80cbc50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f52b80098e0 tx=0x7f52b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=407e2c8eb5471571 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:52.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.453+0000 7f52c7fff700 1 -- 172.21.15.31:0/1397157467 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c00017f0 con 0x7f52c80cd6e0 2023-10-09T06:24:52.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.453+0000 7f52c7fff700 1 -- 172.21.15.31:0/1397157467 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b8011420 con 0x7f52c80cd6e0 2023-10-09T06:24:52.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.453+0000 7f52c7fff700 1 -- 172.21.15.31:0/1397157467 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80117c0 con 0x7f52c80cd6e0 2023-10-09T06:24:52.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.454+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1397157467 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52c80cd6e0 msgr2=0x7f52c80cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.454+0000 7f52ce0d5700 1 --2- 172.21.15.31:0/1397157467 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52c80cd6e0 0x7f52c80cbc50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f52b80098e0 tx=0x7f52b80091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.454+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1397157467 shutdown_connections 2023-10-09T06:24:52.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.454+0000 7f52ce0d5700 1 --2- 172.21.15.31:0/1397157467 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52c80cd6e0 0x7f52c80cbc50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.454+0000 7f52ce0d5700 1 --2- 172.21.15.31:0/1397157467 >> v2:172.21.15.158:3300/0 conn(0x7f52c80cdab0 0x7f52c815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.454+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1397157467 >> 172.21.15.31:0/1397157467 conn(0x7f52c8067660 msgr2=0x7f52c8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:52.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.454+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1397157467 shutdown_connections 2023-10-09T06:24:52.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.454+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1397157467 wait complete. 2023-10-09T06:24:52.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.455+0000 7f52ce0d5700 1 Processor -- start 2023-10-09T06:24:52.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.455+0000 7f52ce0d5700 1 -- start start 2023-10-09T06:24:52.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52ce0d5700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52c80cd6e0 0x7f52c80b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52ce0d5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52c80cdab0 0x7f52c814a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52ce0d5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c815dda0 0x7f52c80c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52ce0d5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c80b4f20 con 0x7f52c815dda0 2023-10-09T06:24:52.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52ce0d5700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c80b1640 con 0x7f52c80cd6e0 2023-10-09T06:24:52.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52ce0d5700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c80b18e0 con 0x7f52c80cdab0 2023-10-09T06:24:52.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52cd8d4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c815dda0 0x7f52c80c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52cd8d4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c815dda0 0x7f52c80c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59460/0 (socket says 172.21.15.31:59460) 2023-10-09T06:24:52.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52cd8d4700 1 -- 172.21.15.31:0/1070565396 learned_addr learned my addr 172.21.15.31:0/1070565396 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:52.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52cd0d3700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52c80cd6e0 0x7f52c80b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52cc8d2700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52c80cdab0 0x7f52c814a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52cd8d4700 1 -- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52c80cdab0 msgr2=0x7f52c814a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52cd8d4700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52c80cdab0 0x7f52c814a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52cd8d4700 1 -- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52c80cd6e0 msgr2=0x7f52c80b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52cd8d4700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52c80cd6e0 0x7f52c80b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52cd8d4700 1 -- 172.21.15.31:0/1070565396 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8009420 con 0x7f52c815dda0 2023-10-09T06:24:52.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52cd0d3700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52c80cd6e0 0x7f52c80b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:52.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52cc8d2700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52c80cdab0 0x7f52c814a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:52.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.456+0000 7f52cd8d4700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c815dda0 0x7f52c80c5ec0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f52c000cc20 tx=0x7f52c0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:52.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.457+0000 7f52c57fa700 1 -- 172.21.15.31:0/1070565396 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0004dc0 con 0x7f52c815dda0 2023-10-09T06:24:52.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.457+0000 7f52c57fa700 1 -- 172.21.15.31:0/1070565396 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c000a7b0 con 0x7f52c815dda0 2023-10-09T06:24:52.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.457+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1070565396 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c80b1bc0 con 0x7f52c815dda0 2023-10-09T06:24:52.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.457+0000 7f52c57fa700 1 -- 172.21.15.31:0/1070565396 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c000ab30 con 0x7f52c815dda0 2023-10-09T06:24:52.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.457+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1070565396 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c80b2180 con 0x7f52c815dda0 2023-10-09T06:24:52.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.458+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1070565396 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c80b50d0 con 0x7f52c815dda0 2023-10-09T06:24:52.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.458+0000 7f52c57fa700 1 -- 172.21.15.31:0/1070565396 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52c0007150 con 0x7f52c815dda0 2023-10-09T06:24:52.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.458+0000 7f52c57fa700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52b4066f30 0x7f52b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.458+0000 7f52c57fa700 1 -- 172.21.15.31:0/1070565396 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52c0084010 con 0x7f52c815dda0 2023-10-09T06:24:52.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.459+0000 7f52cd0d3700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52b4066f30 0x7f52b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.459+0000 7f52cd0d3700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52b4066f30 0x7f52b40693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f52b80093a0 tx=0x7f52b8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:52.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.463+0000 7f52c57fa700 1 -- 172.21.15.31:0/1070565396 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52c004c5a0 con 0x7f52c815dda0 2023-10-09T06:24:52.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.658+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1070565396 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52c8089320 con 0x7f52c815dda0 2023-10-09T06:24:52.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.659+0000 7f52c57fa700 1 -- 172.21.15.31:0/1070565396 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f52c8089320 con 0x7f52c815dda0 2023-10-09T06:24:52.660 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":83,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:24:51.380729+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:24:49.565040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T06:24:50.345838+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:24:52.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.661+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52b4066f30 msgr2=0x7f52b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.661+0000 7f52ce0d5700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52b4066f30 0x7f52b40693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f52b80093a0 tx=0x7f52b8016000 comp rx=0 tx=0).stop 2023-10-09T06:24:52.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.661+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1070565396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c815dda0 msgr2=0x7f52c80c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.661+0000 7f52ce0d5700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c815dda0 0x7f52c80c5ec0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f52c000cc20 tx=0x7f52c0001640 comp rx=0 tx=0).stop 2023-10-09T06:24:52.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.661+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1070565396 shutdown_connections 2023-10-09T06:24:52.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.661+0000 7f52ce0d5700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f52b4066f30 0x7f52b40693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.661+0000 7f52ce0d5700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c815dda0 0x7f52c80c5ec0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.661+0000 7f52ce0d5700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52c80cd6e0 0x7f52c80b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.661+0000 7f52ce0d5700 1 --2- 172.21.15.31:0/1070565396 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52c80cdab0 0x7f52c814a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.661+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1070565396 >> 172.21.15.31:0/1070565396 conn(0x7f52c8067660 msgr2=0x7f52c80c71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:52.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.661+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1070565396 shutdown_connections 2023-10-09T06:24:52.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.661+0000 7f52ce0d5700 1 -- 172.21.15.31:0/1070565396 wait complete. 2023-10-09T06:24:52.675 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:24:52.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.797+0000 7f918534b700 1 Processor -- start 2023-10-09T06:24:52.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.797+0000 7f918534b700 1 -- start start 2023-10-09T06:24:52.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.798+0000 7f918534b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91800cce30 0x7f918015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.798+0000 7f918534b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91800b4d70 con 0x7f91800b6580 2023-10-09T06:24:52.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.798+0000 7f918534b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91800cd8d0 con 0x7f918006aa00 2023-10-09T06:24:52.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.798+0000 7f918534b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91800b4440 con 0x7f91800cce30 2023-10-09T06:24:52.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.798+0000 7f917f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f91800b6580 0x7f918006a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54680/0 (socket says 172.21.15.31:54680) 2023-10-09T06:24:52.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.798+0000 7f917f7fe700 1 -- 172.21.15.31:0/2418822692 learned_addr learned my addr 172.21.15.31:0/2418822692 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:52.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.798+0000 7f917ffff700 1 --2- 172.21.15.31:0/2418822692 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91800cce30 0x7f918015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.798+0000 7f917effd700 1 -- 172.21.15.31:0/2418822692 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809647115 0 0) 0x7f91800b4d70 con 0x7f91800b6580 2023-10-09T06:24:52.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.798+0000 7f917effd700 1 -- 172.21.15.31:0/2418822692 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f916c003570 con 0x7f91800b6580 2023-10-09T06:24:52.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.799+0000 7f917effd700 1 -- 172.21.15.31:0/2418822692 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727200563 0 0) 0x7f91800cd8d0 con 0x7f918006aa00 2023-10-09T06:24:52.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.799+0000 7f917effd700 1 -- 172.21.15.31:0/2418822692 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91800b4d70 con 0x7f918006aa00 2023-10-09T06:24:52.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.799+0000 7f917ffff700 1 -- 172.21.15.31:0/2418822692 >> v1:172.21.15.158:6789/0 conn(0x7f918006aa00 legacy=0x7f91800b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.799+0000 7f917ffff700 1 -- 172.21.15.31:0/2418822692 >> v1:172.21.15.31:6789/0 conn(0x7f91800b6580 legacy=0x7f918006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.799+0000 7f917effd700 1 -- 172.21.15.31:0/2418822692 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1548383734 0 0) 0x7f916c003570 con 0x7f91800b6580 2023-10-09T06:24:52.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.799+0000 7f917ffff700 1 -- 172.21.15.31:0/2418822692 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91800b4720 con 0x7f91800cce30 2023-10-09T06:24:52.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.799+0000 7f917ffff700 1 --2- 172.21.15.31:0/2418822692 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91800cce30 0x7f918015aca0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9170009910 tx=0x7f91700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd19915abec96b0f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:52.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.799+0000 7f917effd700 1 -- 172.21.15.31:0/2418822692 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168001470 con 0x7f91800cce30 2023-10-09T06:24:52.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.799+0000 7f917effd700 1 -- 172.21.15.31:0/2418822692 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9170011420 con 0x7f91800cce30 2023-10-09T06:24:52.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.799+0000 7f917effd700 1 -- 172.21.15.31:0/2418822692 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91700117c0 con 0x7f91800cce30 2023-10-09T06:24:52.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.800+0000 7f918534b700 1 -- 172.21.15.31:0/2418822692 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91800cce30 msgr2=0x7f918015aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.800+0000 7f918534b700 1 --2- 172.21.15.31:0/2418822692 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91800cce30 0x7f918015aca0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9170009910 tx=0x7f91700091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.800+0000 7f918534b700 1 -- 172.21.15.31:0/2418822692 shutdown_connections 2023-10-09T06:24:52.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.800+0000 7f918534b700 1 --2- 172.21.15.31:0/2418822692 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91800cce30 0x7f918015aca0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.800+0000 7f918534b700 1 -- 172.21.15.31:0/2418822692 >> 172.21.15.31:0/2418822692 conn(0x7f9180068cb0 msgr2=0x7f91800690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:52.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.800+0000 7f918534b700 1 -- 172.21.15.31:0/2418822692 shutdown_connections 2023-10-09T06:24:52.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.800+0000 7f918534b700 1 -- 172.21.15.31:0/2418822692 wait complete. 2023-10-09T06:24:52.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.801+0000 7f918534b700 1 Processor -- start 2023-10-09T06:24:52.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.801+0000 7f918534b700 1 -- start start 2023-10-09T06:24:52.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f918534b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f918006aa00 0x7f91801493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f918534b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91800b6580 0x7f91801568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f918534b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91800cce30 0x7f918014e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f918534b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9180155960 con 0x7f918006aa00 2023-10-09T06:24:52.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f918534b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91801498f0 con 0x7f91800b6580 2023-10-09T06:24:52.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f918534b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9180154d50 con 0x7f91800cce30 2023-10-09T06:24:52.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f917ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f918006aa00 0x7f91801493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f917ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f918006aa00 0x7f91801493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59472/0 (socket says 172.21.15.31:59472) 2023-10-09T06:24:52.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f917ffff700 1 -- 172.21.15.31:0/2645872438 learned_addr learned my addr 172.21.15.31:0/2645872438 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:52.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f9184b4a700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91800cce30 0x7f918014e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f917f7fe700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91800b6580 0x7f91801568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f917ffff700 1 -- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91800cce30 msgr2=0x7f918014e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f917ffff700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91800cce30 0x7f918014e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f917ffff700 1 -- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91800b6580 msgr2=0x7f91801568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:52.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f917ffff700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91800b6580 0x7f91801568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:52.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f917ffff700 1 -- 172.21.15.31:0/2645872438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170009420 con 0x7f918006aa00 2023-10-09T06:24:52.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f917ffff700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f918006aa00 0x7f91801493b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f91700091e0 tx=0x7f9170016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:52.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f9177fff700 1 -- 172.21.15.31:0/2645872438 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917001cc90 con 0x7f918006aa00 2023-10-09T06:24:52.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f9177fff700 1 -- 172.21.15.31:0/2645872438 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917001cdf0 con 0x7f918006aa00 2023-10-09T06:24:52.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f918534b700 1 -- 172.21.15.31:0/2645872438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9180155030 con 0x7f918006aa00 2023-10-09T06:24:52.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f9177fff700 1 -- 172.21.15.31:0/2645872438 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917001a6a0 con 0x7f918006aa00 2023-10-09T06:24:52.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.802+0000 7f918534b700 1 -- 172.21.15.31:0/2645872438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91801555f0 con 0x7f918006aa00 2023-10-09T06:24:52.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.803+0000 7f918534b700 1 -- 172.21.15.31:0/2645872438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9180151ed0 con 0x7f918006aa00 2023-10-09T06:24:52.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.804+0000 7f9177fff700 1 -- 172.21.15.31:0/2645872438 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f917001aad0 con 0x7f918006aa00 2023-10-09T06:24:52.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.804+0000 7f9177fff700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9160066f30 0x7f91600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:52.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.804+0000 7f9177fff700 1 -- 172.21.15.31:0/2645872438 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91700863d0 con 0x7f918006aa00 2023-10-09T06:24:52.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.804+0000 7f917f7fe700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9160066f30 0x7f91600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:52.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.805+0000 7f917f7fe700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9160066f30 0x7f91600693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f918016d550 tx=0x7f9168009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:52.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:52.809+0000 7f9177fff700 1 -- 172.21.15.31:0/2645872438 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9170053640 con 0x7f918006aa00 2023-10-09T06:24:53.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.046+0000 7f918534b700 1 -- 172.21.15.31:0/2645872438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f91800b4a00 con 0x7f918006aa00 2023-10-09T06:24:53.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.985+0000 7f9177fff700 1 -- 172.21.15.31:0/2645872438 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9170056c60 con 0x7f918006aa00 2023-10-09T06:24:53.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.987+0000 7f918534b700 1 -- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9160066f30 msgr2=0x7f91600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:53.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.987+0000 7f918534b700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9160066f30 0x7f91600693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f918016d550 tx=0x7f9168009040 comp rx=0 tx=0).stop 2023-10-09T06:24:53.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.987+0000 7f918534b700 1 -- 172.21.15.31:0/2645872438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f918006aa00 msgr2=0x7f91801493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:53.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.987+0000 7f918534b700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f918006aa00 0x7f91801493b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f91700091e0 tx=0x7f9170016000 comp rx=0 tx=0).stop 2023-10-09T06:24:53.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.987+0000 7f918534b700 1 -- 172.21.15.31:0/2645872438 shutdown_connections 2023-10-09T06:24:53.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.987+0000 7f918534b700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9160066f30 0x7f91600693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:53.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.987+0000 7f918534b700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f91800cce30 0x7f918014e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:53.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.987+0000 7f918534b700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f918006aa00 0x7f91801493b0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:53.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.987+0000 7f918534b700 1 --2- 172.21.15.31:0/2645872438 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f91800b6580 0x7f91801568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:53.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.987+0000 7f918534b700 1 -- 172.21.15.31:0/2645872438 >> 172.21.15.31:0/2645872438 conn(0x7f9180068cb0 msgr2=0x7f91800d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:53.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.987+0000 7f918534b700 1 -- 172.21.15.31:0/2645872438 shutdown_connections 2023-10-09T06:24:53.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:53.987+0000 7f918534b700 1 -- 172.21.15.31:0/2645872438 wait complete. 2023-10-09T06:24:54.003 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:24:54.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.132+0000 7fc495cad700 1 Processor -- start 2023-10-09T06:24:54.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.132+0000 7fc495cad700 1 -- start start 2023-10-09T06:24:54.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc495cad700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4900678b0 0x7fc49015db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:54.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc495cad700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4900c9390 0x7fc49015a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:54.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc495cad700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4900cae70 con 0x7fc4900cbf10 2023-10-09T06:24:54.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc495cad700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4900cb150 con 0x7fc4900678b0 2023-10-09T06:24:54.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc495cad700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900cb430 con 0x7fc4900c9390 2023-10-09T06:24:54.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc48f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4900678b0 0x7fc49015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:54.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc48f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4900678b0 0x7fc49015db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59482/0 (socket says 172.21.15.31:59482) 2023-10-09T06:24:54.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc48effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc4900cbf10 0x7fc49015e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54686/0 (socket says 172.21.15.31:54686) 2023-10-09T06:24:54.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc48f7fe700 1 -- 172.21.15.31:0/2820725570 learned_addr learned my addr 172.21.15.31:0/2820725570 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:54.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc48ffff700 1 --2- 172.21.15.31:0/2820725570 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4900c9390 0x7fc49015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:54.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc48f7fe700 1 -- 172.21.15.31:0/2820725570 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4900c9390 msgr2=0x7fc49015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:54.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc48f7fe700 1 --2- 172.21.15.31:0/2820725570 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4900c9390 0x7fc49015a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:54.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc48f7fe700 1 -- 172.21.15.31:0/2820725570 >> v1:172.21.15.31:6789/0 conn(0x7fc4900cbf10 legacy=0x7fc49015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:54.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc48f7fe700 1 -- 172.21.15.31:0/2820725570 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4900cb710 con 0x7fc4900678b0 2023-10-09T06:24:54.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc48e7fc700 1 -- 172.21.15.31:0/2820725570 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284043899 0 0) 0x7fc4900cae70 con 0x7fc4900cbf10 2023-10-09T06:24:54.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.133+0000 7fc48ffff700 1 --2- 172.21.15.31:0/2820725570 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4900c9390 0x7fc49015a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:54.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.134+0000 7fc48f7fe700 1 --2- 172.21.15.31:0/2820725570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4900678b0 0x7fc49015db80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc4800099b0 tx=0x7fc480009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd0caea62320c10 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:54.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.134+0000 7fc48e7fc700 1 -- 172.21.15.31:0/2820725570 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48000b860 con 0x7fc4900678b0 2023-10-09T06:24:54.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.134+0000 7fc48e7fc700 1 -- 172.21.15.31:0/2820725570 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48000b9c0 con 0x7fc4900678b0 2023-10-09T06:24:54.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.134+0000 7fc48e7fc700 1 -- 172.21.15.31:0/2820725570 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48000bd60 con 0x7fc4900678b0 2023-10-09T06:24:54.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.134+0000 7fc495cad700 1 -- 172.21.15.31:0/2820725570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4900678b0 msgr2=0x7fc49015db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:54.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.134+0000 7fc495cad700 1 --2- 172.21.15.31:0/2820725570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4900678b0 0x7fc49015db80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc4800099b0 tx=0x7fc480009250 comp rx=0 tx=0).stop 2023-10-09T06:24:54.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.134+0000 7fc495cad700 1 -- 172.21.15.31:0/2820725570 shutdown_connections 2023-10-09T06:24:54.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.134+0000 7fc495cad700 1 --2- 172.21.15.31:0/2820725570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4900678b0 0x7fc49015db80 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:54.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.134+0000 7fc495cad700 1 --2- 172.21.15.31:0/2820725570 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4900c9390 0x7fc49015a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:54.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.134+0000 7fc495cad700 1 -- 172.21.15.31:0/2820725570 >> 172.21.15.31:0/2820725570 conn(0x7fc490069870 msgr2=0x7fc490069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:54.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.134+0000 7fc495cad700 1 -- 172.21.15.31:0/2820725570 shutdown_connections 2023-10-09T06:24:54.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.134+0000 7fc495cad700 1 -- 172.21.15.31:0/2820725570 wait complete. 2023-10-09T06:24:54.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.136+0000 7fc495cad700 1 Processor -- start 2023-10-09T06:24:54.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.136+0000 7fc495cad700 1 -- start start 2023-10-09T06:24:54.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.136+0000 7fc495cad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4900678b0 0x7fc4900cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:54.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.136+0000 7fc495cad700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc4900c9390 0x7fc4900c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:54.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.136+0000 7fc495cad700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4900cbf10 0x7fc49016d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:54.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.136+0000 7fc495cad700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900c8340 con 0x7fc4900678b0 2023-10-09T06:24:54.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.136+0000 7fc495cad700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900c8540 con 0x7fc4900c9390 2023-10-09T06:24:54.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.136+0000 7fc495cad700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900c8820 con 0x7fc4900cbf10 2023-10-09T06:24:54.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.136+0000 7fc48f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4900678b0 0x7fc4900cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:54.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.136+0000 7fc48f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4900678b0 0x7fc4900cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59490/0 (socket says 172.21.15.31:59490) 2023-10-09T06:24:54.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.136+0000 7fc48f7fe700 1 -- 172.21.15.31:0/4030403291 learned_addr learned my addr 172.21.15.31:0/4030403291 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:54.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.137+0000 7fc48ffff700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4900cbf10 0x7fc49016d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:54.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.137+0000 7fc48effd700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc4900c9390 0x7fc4900c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:54.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.137+0000 7fc48f7fe700 1 -- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4900cbf10 msgr2=0x7fc49016d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:54.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.137+0000 7fc48f7fe700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4900cbf10 0x7fc49016d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:54.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.137+0000 7fc48f7fe700 1 -- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc4900c9390 msgr2=0x7fc4900c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:54.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.137+0000 7fc48f7fe700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc4900c9390 0x7fc4900c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:54.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.137+0000 7fc48f7fe700 1 -- 172.21.15.31:0/4030403291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4800094f0 con 0x7fc4900678b0 2023-10-09T06:24:54.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.137+0000 7fc48f7fe700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4900678b0 0x7fc4900cf3c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc4800090b0 tx=0x7fc480017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:54.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.137+0000 7fc4777fe700 1 -- 172.21.15.31:0/4030403291 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc480026480 con 0x7fc4900678b0 2023-10-09T06:24:54.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.137+0000 7fc4777fe700 1 -- 172.21.15.31:0/4030403291 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48001f070 con 0x7fc4900678b0 2023-10-09T06:24:54.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.137+0000 7fc495cad700 1 -- 172.21.15.31:0/4030403291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4900c8b00 con 0x7fc4900678b0 2023-10-09T06:24:54.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.137+0000 7fc4777fe700 1 -- 172.21.15.31:0/4030403291 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc480026830 con 0x7fc4900678b0 2023-10-09T06:24:54.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.137+0000 7fc495cad700 1 -- 172.21.15.31:0/4030403291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4900cf900 con 0x7fc4900678b0 2023-10-09T06:24:54.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.138+0000 7fc495cad700 1 -- 172.21.15.31:0/4030403291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49004c3c0 con 0x7fc4900678b0 2023-10-09T06:24:54.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.139+0000 7fc4777fe700 1 -- 172.21.15.31:0/4030403291 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc480026c20 con 0x7fc4900678b0 2023-10-09T06:24:54.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.139+0000 7fc4777fe700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc47c066f30 0x7fc47c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:54.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.139+0000 7fc4777fe700 1 -- 172.21.15.31:0/4030403291 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc480021070 con 0x7fc4900678b0 2023-10-09T06:24:54.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.139+0000 7fc48effd700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc47c066f30 0x7fc47c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:54.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.140+0000 7fc48effd700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc47c066f30 0x7fc47c0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc4900b3ff0 tx=0x7fc484007bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:54.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.143+0000 7fc4777fe700 1 -- 172.21.15.31:0/4030403291 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4800535b0 con 0x7fc4900678b0 2023-10-09T06:24:54.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.383+0000 7fc495cad700 1 -- 172.21.15.31:0/4030403291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc49015a120 con 0x7fc4900678b0 2023-10-09T06:24:54.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.990+0000 7fc4777fe700 1 -- 172.21.15.31:0/4030403291 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v42) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc480056bd0 con 0x7fc4900678b0 2023-10-09T06:24:54.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.992+0000 7fc495cad700 1 -- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc47c066f30 msgr2=0x7fc47c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:54.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.992+0000 7fc495cad700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc47c066f30 0x7fc47c0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc4900b3ff0 tx=0x7fc484007bf0 comp rx=0 tx=0).stop 2023-10-09T06:24:54.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.992+0000 7fc495cad700 1 -- 172.21.15.31:0/4030403291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4900678b0 msgr2=0x7fc4900cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:54.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.992+0000 7fc495cad700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4900678b0 0x7fc4900cf3c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc4800090b0 tx=0x7fc480017000 comp rx=0 tx=0).stop 2023-10-09T06:24:54.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.992+0000 7fc495cad700 1 -- 172.21.15.31:0/4030403291 shutdown_connections 2023-10-09T06:24:54.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.992+0000 7fc495cad700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc47c066f30 0x7fc47c0693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:54.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.992+0000 7fc495cad700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4900cbf10 0x7fc49016d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:54.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.992+0000 7fc495cad700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4900678b0 0x7fc4900cf3c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:54.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.992+0000 7fc495cad700 1 --2- 172.21.15.31:0/4030403291 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc4900c9390 0x7fc4900c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:54.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.992+0000 7fc495cad700 1 -- 172.21.15.31:0/4030403291 >> 172.21.15.31:0/4030403291 conn(0x7fc490069870 msgr2=0x7fc4900b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:54.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.992+0000 7fc495cad700 1 -- 172.21.15.31:0/4030403291 shutdown_connections 2023-10-09T06:24:54.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:54.992+0000 7fc495cad700 1 -- 172.21.15.31:0/4030403291 wait complete. 2023-10-09T06:24:55.006 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:24:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.126+0000 7faae6a32700 1 Processor -- start 2023-10-09T06:24:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.126+0000 7faae6a32700 1 -- start start 2023-10-09T06:24:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.127+0000 7faae6a32700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faae0157870 0x7faae015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.127+0000 7faae6a32700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faae0157c40 0x7faae0158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.127+0000 7faae6a32700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae015cbb0 con 0x7faae015a620 2023-10-09T06:24:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.127+0000 7faae6a32700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae015bfa0 con 0x7faae0157870 2023-10-09T06:24:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.127+0000 7faae6a32700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae015c280 con 0x7faae0157c40 2023-10-09T06:24:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.127+0000 7faadffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faae0157870 0x7faae015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.127+0000 7faadffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faae0157870 0x7faae015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59498/0 (socket says 172.21.15.31:59498) 2023-10-09T06:24:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.127+0000 7faadffff700 1 -- 172.21.15.31:0/1887123473 learned_addr learned my addr 172.21.15.31:0/1887123473 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.128+0000 7faae4fcf700 1 --2- 172.21.15.31:0/1887123473 >> v2:172.21.15.158:3300/0 conn(0x7faae0157c40 0x7faae0158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.128+0000 7faadffff700 1 -- 172.21.15.31:0/1887123473 >> v2:172.21.15.158:3300/0 conn(0x7faae0157c40 msgr2=0x7faae0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.128+0000 7faadffff700 1 --2- 172.21.15.31:0/1887123473 >> v2:172.21.15.158:3300/0 conn(0x7faae0157c40 0x7faae0158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.128+0000 7faadffff700 1 -- 172.21.15.31:0/1887123473 >> v1:172.21.15.158:6789/0 conn(0x7faae015a620 legacy=0x7faae015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.128+0000 7faadffff700 1 -- 172.21.15.31:0/1887123473 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae015c560 con 0x7faae0157870 2023-10-09T06:24:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.128+0000 7faadffff700 1 --2- 172.21.15.31:0/1887123473 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faae0157870 0x7faae015b6a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7faae006b4e0 tx=0x7faac8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267f734a58d6dc2d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.128+0000 7faadeffd700 1 -- 172.21.15.31:0/1887123473 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac800b860 con 0x7faae0157870 2023-10-09T06:24:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.128+0000 7faadeffd700 1 -- 172.21.15.31:0/1887123473 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac800b9c0 con 0x7faae0157870 2023-10-09T06:24:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.128+0000 7faadeffd700 1 -- 172.21.15.31:0/1887123473 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac800bd60 con 0x7faae0157870 2023-10-09T06:24:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.129+0000 7faae6a32700 1 -- 172.21.15.31:0/1887123473 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faae0157870 msgr2=0x7faae015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.129+0000 7faae6a32700 1 --2- 172.21.15.31:0/1887123473 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faae0157870 0x7faae015b6a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7faae006b4e0 tx=0x7faac8009250 comp rx=0 tx=0).stop 2023-10-09T06:24:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.129+0000 7faae6a32700 1 -- 172.21.15.31:0/1887123473 shutdown_connections 2023-10-09T06:24:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.129+0000 7faae6a32700 1 --2- 172.21.15.31:0/1887123473 >> v2:172.21.15.158:3300/0 conn(0x7faae0157c40 0x7faae0158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.129+0000 7faae6a32700 1 --2- 172.21.15.31:0/1887123473 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faae0157870 0x7faae015b6a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.129+0000 7faae6a32700 1 -- 172.21.15.31:0/1887123473 >> 172.21.15.31:0/1887123473 conn(0x7faae0068ce0 msgr2=0x7faae00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.129+0000 7faae6a32700 1 -- 172.21.15.31:0/1887123473 shutdown_connections 2023-10-09T06:24:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.129+0000 7faae6a32700 1 -- 172.21.15.31:0/1887123473 wait complete. 2023-10-09T06:24:55.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.130+0000 7faae6a32700 1 Processor -- start 2023-10-09T06:24:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.130+0000 7faae6a32700 1 -- start start 2023-10-09T06:24:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faae6a32700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faae0157870 0x7faae014e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faae6a32700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faae0157c40 0x7faae0150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faae6a32700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faae015a620 0x7faae0150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faae6a32700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae013dd60 con 0x7faae0157c40 2023-10-09T06:24:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faae6a32700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae0150ab0 con 0x7faae0157870 2023-10-09T06:24:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faae6a32700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae014eba0 con 0x7faae015a620 2023-10-09T06:24:55.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faadf7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faae0157c40 0x7faae0150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faadf7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faae0157c40 0x7faae0150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59504/0 (socket says 172.21.15.31:59504) 2023-10-09T06:24:55.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faadf7fe700 1 -- 172.21.15.31:0/849328337 learned_addr learned my addr 172.21.15.31:0/849328337 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:55.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faadffff700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faae0157870 0x7faae014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faae4fcf700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faae015a620 0x7faae0150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faadf7fe700 1 -- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faae015a620 msgr2=0x7faae0150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faadf7fe700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faae015a620 0x7faae0150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faadf7fe700 1 -- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faae0157870 msgr2=0x7faae014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faadf7fe700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faae0157870 0x7faae014e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faadf7fe700 1 -- 172.21.15.31:0/849328337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac80094f0 con 0x7faae0157c40 2023-10-09T06:24:55.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faadf7fe700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faae0157c40 0x7faae0150030 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7faad000c590 tx=0x7faad0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:55.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faad7fff700 1 -- 172.21.15.31:0/849328337 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0011590 con 0x7faae0157c40 2023-10-09T06:24:55.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faad7fff700 1 -- 172.21.15.31:0/849328337 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad0011710 con 0x7faae0157c40 2023-10-09T06:24:55.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faae6a32700 1 -- 172.21.15.31:0/849328337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae00b2520 con 0x7faae0157c40 2023-10-09T06:24:55.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faad7fff700 1 -- 172.21.15.31:0/849328337 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0011ad0 con 0x7faae0157c40 2023-10-09T06:24:55.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.131+0000 7faae6a32700 1 -- 172.21.15.31:0/849328337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae00b2ae0 con 0x7faae0157c40 2023-10-09T06:24:55.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.132+0000 7faae6a32700 1 -- 172.21.15.31:0/849328337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae013df10 con 0x7faae0157c40 2023-10-09T06:24:55.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.133+0000 7faad7fff700 1 -- 172.21.15.31:0/849328337 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faad001a360 con 0x7faae0157c40 2023-10-09T06:24:55.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.133+0000 7faad7fff700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.133+0000 7faad7fff700 1 -- 172.21.15.31:0/849328337 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faad0083360 con 0x7faae0157c40 2023-10-09T06:24:55.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.133+0000 7faadffff700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.134+0000 7faadffff700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faac0066f30 0x7faac00693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faae006b4e0 tx=0x7faac8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:55.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.137+0000 7faad7fff700 1 -- 172.21.15.31:0/849328337 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faae013df10 con 0x7faae0157c40 2023-10-09T06:24:55.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.372+0000 7faae6a32700 1 -- 172.21.15.31:0/849328337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faae013dea0 con 0x7faae0157c40 2023-10-09T06:24:55.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.373+0000 7faad7fff700 1 -- 172.21.15.31:0/849328337 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4602 (secure 0 0 0) 0x7faad00505d0 con 0x7faae0157c40 2023-10-09T06:24:55.374 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:55.374 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2895057012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2895057012},{"type":"v1","addr":"172.21.15.158:6836","nonce":2895057012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5707,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/756230701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":756230701},{"type":"v1","addr":"172.21.15.158:6837","nonce":756230701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5961,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2803435352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2803435352},{"type":"v1","addr":"172.21.15.31:6834","nonce":2803435352}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:24:51.381116+0000","modified":"2023-10-09T06:24:54.984865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1373095674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1373095674},{"type":"v1","addr":"172.21.15.31:6835","nonce":1373095674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T06:24:55.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.375+0000 7faae6a32700 1 -- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faac0066f30 msgr2=0x7faac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.375+0000 7faae6a32700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faac0066f30 0x7faac00693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faae006b4e0 tx=0x7faac8017000 comp rx=0 tx=0).stop 2023-10-09T06:24:55.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.375+0000 7faae6a32700 1 -- 172.21.15.31:0/849328337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faae0157c40 msgr2=0x7faae0150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.375+0000 7faae6a32700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faae0157c40 0x7faae0150030 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7faad000c590 tx=0x7faad0007f50 comp rx=0 tx=0).stop 2023-10-09T06:24:55.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.375+0000 7faae6a32700 1 -- 172.21.15.31:0/849328337 shutdown_connections 2023-10-09T06:24:55.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.375+0000 7faae6a32700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.375+0000 7faae6a32700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faae015a620 0x7faae0150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.375+0000 7faae6a32700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faae0157870 0x7faae014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.375+0000 7faae6a32700 1 --2- 172.21.15.31:0/849328337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faae0157c40 0x7faae0150030 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.375+0000 7faae6a32700 1 -- 172.21.15.31:0/849328337 >> 172.21.15.31:0/849328337 conn(0x7faae0068ce0 msgr2=0x7faae0158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:55.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.375+0000 7faae6a32700 1 -- 172.21.15.31:0/849328337 shutdown_connections 2023-10-09T06:24:55.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.375+0000 7faae6a32700 1 -- 172.21.15.31:0/849328337 wait complete. 2023-10-09T06:24:55.377 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 42 2023-10-09T06:24:55.388 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:24:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.506+0000 7f508f59e700 1 Processor -- start 2023-10-09T06:24:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.506+0000 7f508f59e700 1 -- start start 2023-10-09T06:24:55.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.507+0000 7f508f59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f50900cd6e0 0x7f50900cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.507+0000 7f508f59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f509015cbd0 0x7f509015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.507+0000 7f508f59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50900cb7c0 con 0x7f50900cdab0 2023-10-09T06:24:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.507+0000 7f508f59e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509015e850 con 0x7f50900cd6e0 2023-10-09T06:24:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.507+0000 7f508f59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50900cd030 con 0x7f509015cbd0 2023-10-09T06:24:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.507+0000 7f508dd9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f50900cdab0 0x7f509015d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54700/0 (socket says 172.21.15.31:54700) 2023-10-09T06:24:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.507+0000 7f508dd9b700 1 -- 172.21.15.31:0/3319207067 learned_addr learned my addr 172.21.15.31:0/3319207067 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.507+0000 7f508e59c700 1 --2- 172.21.15.31:0/3319207067 >> v2:172.21.15.158:3300/0 conn(0x7f50900cd6e0 0x7f50900cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.507+0000 7f508ed9d700 1 --2- 172.21.15.31:0/3319207067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f509015cbd0 0x7f509015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.507+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796573320 0 0) 0x7f50900cb7c0 con 0x7f50900cdab0 2023-10-09T06:24:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.507+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f507c003570 con 0x7f50900cdab0 2023-10-09T06:24:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 807569880 0 0) 0x7f507c003570 con 0x7f50900cdab0 2023-10-09T06:24:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f509015cbd0 msgr2=0x7f509015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 --2- 172.21.15.31:0/3319207067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f509015cbd0 0x7f509015d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 >> v2:172.21.15.158:3300/0 conn(0x7f50900cd6e0 msgr2=0x7f50900cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 --2- 172.21.15.31:0/3319207067 >> v2:172.21.15.158:3300/0 conn(0x7f50900cd6e0 0x7f50900cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509015e290 con 0x7f50900cdab0 2023-10-09T06:24:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f5078001470 con 0x7f50900cdab0 2023-10-09T06:24:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 >> v1:172.21.15.31:6789/0 conn(0x7f50900cdab0 legacy=0x7f509015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 --2- 172.21.15.31:0/3319207067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f509015cbd0 0x7f507c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 --2- 172.21.15.31:0/3319207067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f507c003fe0 0x7f507c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 --2- 172.21.15.31:0/3319207067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507c004d50 0x7f507c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509015e850 con 0x7f507c004d50 2023-10-09T06:24:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900cd030 con 0x7f507c003fe0 2023-10-09T06:24:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c00ba90 con 0x7f509015cbd0 2023-10-09T06:24:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508ed9d700 1 --2- 172.21.15.31:0/3319207067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507c004d50 0x7f507c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508dd9b700 1 --2- 172.21.15.31:0/3319207067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f507c003fe0 0x7f507c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508e59c700 1 --2- 172.21.15.31:0/3319207067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f509015cbd0 0x7f507c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508ed9d700 1 -- 172.21.15.31:0/3319207067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f509015cbd0 msgr2=0x7f507c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508ed9d700 1 --2- 172.21.15.31:0/3319207067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f509015cbd0 0x7f507c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508ed9d700 1 -- 172.21.15.31:0/3319207067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f507c003fe0 msgr2=0x7f507c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508ed9d700 1 --2- 172.21.15.31:0/3319207067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f507c003fe0 0x7f507c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508ed9d700 1 -- 172.21.15.31:0/3319207067 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c003570 con 0x7f507c004d50 2023-10-09T06:24:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.508+0000 7f508ed9d700 1 --2- 172.21.15.31:0/3319207067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507c004d50 0x7f507c0051c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5088009c00 tx=0x7f50880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7925b7075191832e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.509+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508800e6b0 con 0x7f507c004d50 2023-10-09T06:24:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.509+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508800e810 con 0x7f507c004d50 2023-10-09T06:24:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.509+0000 7f508d59a700 1 -- 172.21.15.31:0/3319207067 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508800ebd0 con 0x7f507c004d50 2023-10-09T06:24:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.509+0000 7f508f59e700 1 -- 172.21.15.31:0/3319207067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507c004d50 msgr2=0x7f507c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.509+0000 7f508f59e700 1 --2- 172.21.15.31:0/3319207067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507c004d50 0x7f507c0051c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5088009c00 tx=0x7f50880091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.509+0000 7f508ed9d700 1 -- 172.21.15.31:0/3319207067 reap_dead start 2023-10-09T06:24:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.509+0000 7f508f59e700 1 -- 172.21.15.31:0/3319207067 shutdown_connections 2023-10-09T06:24:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.509+0000 7f508f59e700 1 -- 172.21.15.31:0/3319207067 >> 172.21.15.31:0/3319207067 conn(0x7f5090067660 msgr2=0x7f5090067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.509+0000 7f508f59e700 1 -- 172.21.15.31:0/3319207067 shutdown_connections 2023-10-09T06:24:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.509+0000 7f508f59e700 1 -- 172.21.15.31:0/3319207067 wait complete. 2023-10-09T06:24:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.510+0000 7f508f59e700 1 Processor -- start 2023-10-09T06:24:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.510+0000 7f508f59e700 1 -- start start 2023-10-09T06:24:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507c004d50 0x7f50901417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508f59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50900c8400 0x7f5090155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508f59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50900c8870 0x7f5090155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508f59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900b46c0 con 0x7f507c004d50 2023-10-09T06:24:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508f59e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5090141ce0 con 0x7f50900c8870 2023-10-09T06:24:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508f59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50900b3ab0 con 0x7f50900c8400 2023-10-09T06:24:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507c004d50 0x7f50901417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507c004d50 0x7f50901417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59526/0 (socket says 172.21.15.31:59526) 2023-10-09T06:24:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508e59c700 1 -- 172.21.15.31:0/580131867 learned_addr learned my addr 172.21.15.31:0/580131867 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508dd9b700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50900c8400 0x7f5090155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508ed9d700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50900c8870 0x7f5090155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508e59c700 1 -- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50900c8400 msgr2=0x7f5090155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508e59c700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50900c8400 0x7f5090155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508e59c700 1 -- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50900c8870 msgr2=0x7f5090155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508e59c700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50900c8870 0x7f5090155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.511+0000 7f508e59c700 1 -- 172.21.15.31:0/580131867 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50900b3d90 con 0x7f507c004d50 2023-10-09T06:24:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.512+0000 7f508e59c700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507c004d50 0x7f50901417a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5080009fc0 tx=0x7f508000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.512+0000 7f50867fc700 1 -- 172.21.15.31:0/580131867 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508000e030 con 0x7f507c004d50 2023-10-09T06:24:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.512+0000 7f50867fc700 1 -- 172.21.15.31:0/580131867 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5080011e40 con 0x7f507c004d50 2023-10-09T06:24:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.512+0000 7f508f59e700 1 -- 172.21.15.31:0/580131867 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50900b4070 con 0x7f507c004d50 2023-10-09T06:24:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.512+0000 7f50867fc700 1 -- 172.21.15.31:0/580131867 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800166c0 con 0x7f507c004d50 2023-10-09T06:24:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.512+0000 7f508f59e700 1 -- 172.21.15.31:0/580131867 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50900c7e70 con 0x7f507c004d50 2023-10-09T06:24:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.513+0000 7f508f59e700 1 -- 172.21.15.31:0/580131867 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5090089280 con 0x7f507c004d50 2023-10-09T06:24:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.513+0000 7f50867fc700 1 -- 172.21.15.31:0/580131867 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5080016a30 con 0x7f507c004d50 2023-10-09T06:24:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.513+0000 7f50867fc700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5070066f30 0x7f50700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.514+0000 7f50867fc700 1 -- 172.21.15.31:0/580131867 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f508000f070 con 0x7f507c004d50 2023-10-09T06:24:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.514+0000 7f508dd9b700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5070066f30 0x7f50700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.514+0000 7f508dd9b700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5070066f30 0x7f50700693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5078007fd0 tx=0x7f5078001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.518+0000 7f50867fc700 1 -- 172.21.15.31:0/580131867 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5080052700 con 0x7f507c004d50 2023-10-09T06:24:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.710+0000 7f508f59e700 1 -- 172.21.15.31:0/580131867 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f509015e570 con 0x7f507c004d50 2023-10-09T06:24:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.711+0000 7f50867fc700 1 -- 172.21.15.31:0/580131867 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f5080055d20 con 0x7f507c004d50 2023-10-09T06:24:55.712 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:55.712 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":84,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:24:52.702145+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:24:49.565040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T06:24:50.345838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:24:55.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.713+0000 7f508f59e700 1 -- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5070066f30 msgr2=0x7f50700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.713+0000 7f508f59e700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5070066f30 0x7f50700693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5078007fd0 tx=0x7f5078001e90 comp rx=0 tx=0).stop 2023-10-09T06:24:55.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.713+0000 7f508f59e700 1 -- 172.21.15.31:0/580131867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507c004d50 msgr2=0x7f50901417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.713+0000 7f508f59e700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507c004d50 0x7f50901417a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5080009fc0 tx=0x7f508000b040 comp rx=0 tx=0).stop 2023-10-09T06:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.713+0000 7f508f59e700 1 -- 172.21.15.31:0/580131867 shutdown_connections 2023-10-09T06:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.713+0000 7f508f59e700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5070066f30 0x7f50700693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.713+0000 7f508f59e700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50900c8870 0x7f5090155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.713+0000 7f508f59e700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507c004d50 0x7f50901417a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.713+0000 7f508f59e700 1 --2- 172.21.15.31:0/580131867 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50900c8400 0x7f5090155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.713+0000 7f508f59e700 1 -- 172.21.15.31:0/580131867 >> 172.21.15.31:0/580131867 conn(0x7f5090067660 msgr2=0x7f509014d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.713+0000 7f508f59e700 1 -- 172.21.15.31:0/580131867 shutdown_connections 2023-10-09T06:24:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.713+0000 7f508f59e700 1 -- 172.21.15.31:0/580131867 wait complete. 2023-10-09T06:24:55.727 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:24:55.727 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:24:55.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.846+0000 7fae8a095700 1 Processor -- start 2023-10-09T06:24:55.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.846+0000 7fae8a095700 1 -- start start 2023-10-09T06:24:55.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae8a095700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae84157870 0x7fae8415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae8a095700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fae8415a620 0x7fae8415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae8a095700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8415cbb0 con 0x7fae8415d580 2023-10-09T06:24:55.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae8a095700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8415bfa0 con 0x7fae84157870 2023-10-09T06:24:55.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae8a095700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8415c280 con 0x7fae8415a620 2023-10-09T06:24:55.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae837fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae84157870 0x7fae8415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae83fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fae8415d580 0x7fae84158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54712/0 (socket says 172.21.15.31:54712) 2023-10-09T06:24:55.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae83fff700 1 -- 172.21.15.31:0/1872800123 learned_addr learned my addr 172.21.15.31:0/1872800123 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:55.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae82ffd700 1 --2- 172.21.15.31:0/1872800123 >> v2:172.21.15.158:3300/0 conn(0x7fae8415a620 0x7fae8415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae837fe700 1 -- 172.21.15.31:0/1872800123 >> v2:172.21.15.158:3300/0 conn(0x7fae8415a620 msgr2=0x7fae8415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:55.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae837fe700 1 --2- 172.21.15.31:0/1872800123 >> v2:172.21.15.158:3300/0 conn(0x7fae8415a620 0x7fae8415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae837fe700 1 -- 172.21.15.31:0/1872800123 >> v1:172.21.15.31:6789/0 conn(0x7fae8415d580 legacy=0x7fae84158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae837fe700 1 -- 172.21.15.31:0/1872800123 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8415c560 con 0x7fae84157870 2023-10-09T06:24:55.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae827fc700 1 -- 172.21.15.31:0/1872800123 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282276394 0 0) 0x7fae8415cbb0 con 0x7fae8415d580 2023-10-09T06:24:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.847+0000 7fae837fe700 1 --2- 172.21.15.31:0/1872800123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae84157870 0x7fae8415b6a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fae8415cb20 tx=0x7fae740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d158dbacfc1c6e3c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.848+0000 7fae827fc700 1 -- 172.21.15.31:0/1872800123 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74011630 con 0x7fae84157870 2023-10-09T06:24:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.848+0000 7fae827fc700 1 -- 172.21.15.31:0/1872800123 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae74011790 con 0x7fae84157870 2023-10-09T06:24:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.848+0000 7fae827fc700 1 -- 172.21.15.31:0/1872800123 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74011b30 con 0x7fae84157870 2023-10-09T06:24:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.848+0000 7fae8a095700 1 -- 172.21.15.31:0/1872800123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae84157870 msgr2=0x7fae8415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.848+0000 7fae8a095700 1 --2- 172.21.15.31:0/1872800123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae84157870 0x7fae8415b6a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fae8415cb20 tx=0x7fae740091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.848+0000 7fae8a095700 1 -- 172.21.15.31:0/1872800123 shutdown_connections 2023-10-09T06:24:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.848+0000 7fae8a095700 1 --2- 172.21.15.31:0/1872800123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae84157870 0x7fae8415b6a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.848+0000 7fae8a095700 1 --2- 172.21.15.31:0/1872800123 >> v2:172.21.15.158:3300/0 conn(0x7fae8415a620 0x7fae8415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.848+0000 7fae8a095700 1 -- 172.21.15.31:0/1872800123 >> 172.21.15.31:0/1872800123 conn(0x7fae84068ce0 msgr2=0x7fae840690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.848+0000 7fae8a095700 1 -- 172.21.15.31:0/1872800123 shutdown_connections 2023-10-09T06:24:55.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.848+0000 7fae8a095700 1 -- 172.21.15.31:0/1872800123 wait complete. 2023-10-09T06:24:55.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.849+0000 7fae8a095700 1 Processor -- start 2023-10-09T06:24:55.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.849+0000 7fae8a095700 1 -- start start 2023-10-09T06:24:55.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.850+0000 7fae8a095700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae84157870 0x7fae8414bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.850+0000 7fae8a095700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae8415a620 0x7fae840b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.850+0000 7fae8a095700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fae8415d580 0x7fae84154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.850+0000 7fae8a095700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae84150760 con 0x7fae84157870 2023-10-09T06:24:55.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.850+0000 7fae8a095700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae840b1060 con 0x7fae8415a620 2023-10-09T06:24:55.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.850+0000 7fae8a095700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae840b1340 con 0x7fae8415d580 2023-10-09T06:24:55.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.850+0000 7fae837fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae84157870 0x7fae8414bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.850+0000 7fae837fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae84157870 0x7fae8414bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59550/0 (socket says 172.21.15.31:59550) 2023-10-09T06:24:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.850+0000 7fae837fe700 1 -- 172.21.15.31:0/1697069655 learned_addr learned my addr 172.21.15.31:0/1697069655 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.851+0000 7fae82ffd700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae8415a620 0x7fae840b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.851+0000 7fae83fff700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fae8415d580 0x7fae84154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.851+0000 7fae837fe700 1 -- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fae8415d580 msgr2=0x7fae84154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.851+0000 7fae837fe700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fae8415d580 0x7fae84154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.851+0000 7fae837fe700 1 -- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae8415a620 msgr2=0x7fae840b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.851+0000 7fae837fe700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae8415a620 0x7fae840b0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.851+0000 7fae837fe700 1 -- 172.21.15.31:0/1697069655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae74009420 con 0x7fae84157870 2023-10-09T06:24:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.851+0000 7fae837fe700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae84157870 0x7fae8414bc70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fae8406b530 tx=0x7fae74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.851+0000 7fae6b7fe700 1 -- 172.21.15.31:0/1697069655 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74011b10 con 0x7fae84157870 2023-10-09T06:24:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.851+0000 7fae6b7fe700 1 -- 172.21.15.31:0/1697069655 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae740253f0 con 0x7fae84157870 2023-10-09T06:24:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.851+0000 7fae8a095700 1 -- 172.21.15.31:0/1697069655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae840b1620 con 0x7fae84157870 2023-10-09T06:24:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.851+0000 7fae6b7fe700 1 -- 172.21.15.31:0/1697069655 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74025790 con 0x7fae84157870 2023-10-09T06:24:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.851+0000 7fae8a095700 1 -- 172.21.15.31:0/1697069655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae840cf590 con 0x7fae84157870 2023-10-09T06:24:55.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.852+0000 7fae8a095700 1 -- 172.21.15.31:0/1697069655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8404c3c0 con 0x7fae84157870 2023-10-09T06:24:55.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.852+0000 7fae6b7fe700 1 -- 172.21.15.31:0/1697069655 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae74025b80 con 0x7fae84157870 2023-10-09T06:24:55.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.853+0000 7fae6b7fe700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fae70066f30 0x7fae700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:55.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.853+0000 7fae6b7fe700 1 -- 172.21.15.31:0/1697069655 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fae74085e40 con 0x7fae84157870 2023-10-09T06:24:55.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.853+0000 7fae82ffd700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fae70066f30 0x7fae700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:55.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.853+0000 7fae82ffd700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fae70066f30 0x7fae700693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fae8415aa20 tx=0x7fae78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:55.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:55.857+0000 7fae6b7fe700 1 -- 172.21.15.31:0/1697069655 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae740530b0 con 0x7fae84157870 2023-10-09T06:24:56.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.051+0000 7fae8a095700 1 -- 172.21.15.31:0/1697069655 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae8415c840 con 0x7fae70066f30 2023-10-09T06:24:56.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.060+0000 7fae6b7fe700 1 -- 172.21.15.31:0/1697069655 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284651 (secure 0 0 0) 0x7fae8415c840 con 0x7fae70066f30 2023-10-09T06:24:56.061 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:56.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.063+0000 7fae8a095700 1 -- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fae70066f30 msgr2=0x7fae700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.063+0000 7fae8a095700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fae70066f30 0x7fae700693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fae8415aa20 tx=0x7fae78008040 comp rx=0 tx=0).stop 2023-10-09T06:24:56.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.063+0000 7fae8a095700 1 -- 172.21.15.31:0/1697069655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae84157870 msgr2=0x7fae8414bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.063+0000 7fae8a095700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae84157870 0x7fae8414bc70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fae8406b530 tx=0x7fae74017000 comp rx=0 tx=0).stop 2023-10-09T06:24:56.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.063+0000 7fae8a095700 1 -- 172.21.15.31:0/1697069655 shutdown_connections 2023-10-09T06:24:56.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.063+0000 7fae8a095700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fae70066f30 0x7fae700693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.063+0000 7fae8a095700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fae8415d580 0x7fae84154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.063+0000 7fae8a095700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae84157870 0x7fae8414bc70 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.063+0000 7fae8a095700 1 --2- 172.21.15.31:0/1697069655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae8415a620 0x7fae840b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.063+0000 7fae8a095700 1 -- 172.21.15.31:0/1697069655 >> 172.21.15.31:0/1697069655 conn(0x7fae84068ce0 msgr2=0x7fae8415b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:56.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.063+0000 7fae8a095700 1 -- 172.21.15.31:0/1697069655 shutdown_connections 2023-10-09T06:24:56.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.063+0000 7fae8a095700 1 -- 172.21.15.31:0/1697069655 wait complete. 2023-10-09T06:24:56.072 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:24:56.076 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2023-10-09T06:24:54.574998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557884,"statfs":{"total":1600000000,"available":1595273948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.601829"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712941+0000","last_change":"2023-10-09T06:24:51.712610+0000","last_active":"2023-10-09T06:24:51.712941+0000","last_peered":"2023-10-09T06:24:51.712941+0000","last_clean":"2023-10-09T06:24:51.712941+0000","last_became_active":"2023-10-09T06:24:51.711605+0000","last_became_peered":"2023-10-09T06:24:51.711605+0000","last_unstale":"2023-10-09T06:24:51.712941+0000","last_undegraded":"2023-10-09T06:24:51.712941+0000","last_fullsized":"2023-10-09T06:24:51.712941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:07.511844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714438+0000","last_change":"2023-10-09T06:24:51.714301+0000","last_active":"2023-10-09T06:24:51.714438+0000","last_peered":"2023-10-09T06:24:51.714438+0000","last_clean":"2023-10-09T06:24:51.714438+0000","last_became_active":"2023-10-09T06:24:51.713911+0000","last_became_peered":"2023-10-09T06:24:51.713911+0000","last_unstale":"2023-10-09T06:24:51.714438+0000","last_undegraded":"2023-10-09T06:24:51.714438+0000","last_fullsized":"2023-10-09T06:24:51.714438+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:07.518873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714695+0000","last_change":"2023-10-09T06:24:51.714695+0000","last_active":"2023-10-09T06:24:51.714695+0000","last_peered":"2023-10-09T06:24:51.714695+0000","last_clean":"2023-10-09T06:24:51.714695+0000","last_became_active":"2023-10-09T06:24:51.714467+0000","last_became_peered":"2023-10-09T06:24:51.714467+0000","last_unstale":"2023-10-09T06:24:51.714695+0000","last_undegraded":"2023-10-09T06:24:51.714695+0000","last_fullsized":"2023-10-09T06:24:51.714695+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:32.424213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715992+0000","last_change":"2023-10-09T06:24:51.715992+0000","last_active":"2023-10-09T06:24:51.715992+0000","last_peered":"2023-10-09T06:24:51.715992+0000","last_clean":"2023-10-09T06:24:51.715992+0000","last_became_active":"2023-10-09T06:24:51.715787+0000","last_became_peered":"2023-10-09T06:24:51.715787+0000","last_unstale":"2023-10-09T06:24:51.715992+0000","last_undegraded":"2023-10-09T06:24:51.715992+0000","last_fullsized":"2023-10-09T06:24:51.715992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:36:15.597805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713492+0000","last_change":"2023-10-09T06:24:51.713492+0000","last_active":"2023-10-09T06:24:51.713492+0000","last_peered":"2023-10-09T06:24:51.713492+0000","last_clean":"2023-10-09T06:24:51.713492+0000","last_became_active":"2023-10-09T06:24:51.713065+0000","last_became_peered":"2023-10-09T06:24:51.713065+0000","last_unstale":"2023-10-09T06:24:51.713492+0000","last_undegraded":"2023-10-09T06:24:51.713492+0000","last_fullsized":"2023-10-09T06:24:51.713492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:43.723406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713277+0000","last_change":"2023-10-09T06:24:51.712645+0000","last_active":"2023-10-09T06:24:51.713277+0000","last_peered":"2023-10-09T06:24:51.713277+0000","last_clean":"2023-10-09T06:24:51.713277+0000","last_became_active":"2023-10-09T06:24:51.712417+0000","last_became_peered":"2023-10-09T06:24:51.712417+0000","last_unstale":"2023-10-09T06:24:51.713277+0000","last_undegraded":"2023-10-09T06:24:51.713277+0000","last_fullsized":"2023-10-09T06:24:51.713277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:34:07.441514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715209+0000","last_change":"2023-10-09T06:24:51.715209+0000","last_active":"2023-10-09T06:24:51.715209+0000","last_peered":"2023-10-09T06:24:51.715209+0000","last_clean":"2023-10-09T06:24:51.715209+0000","last_became_active":"2023-10-09T06:24:51.714484+0000","last_became_peered":"2023-10-09T06:24:51.714484+0000","last_unstale":"2023-10-09T06:24:51.715209+0000","last_undegraded":"2023-10-09T06:24:51.715209+0000","last_fullsized":"2023-10-09T06:24:51.715209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:47:03.419308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.718895+0000","last_change":"2023-10-09T06:24:51.718441+0000","last_active":"2023-10-09T06:24:51.718895+0000","last_peered":"2023-10-09T06:24:51.718895+0000","last_clean":"2023-10-09T06:24:51.718895+0000","last_became_active":"2023-10-09T06:24:51.718212+0000","last_became_peered":"2023-10-09T06:24:51.718212+0000","last_unstale":"2023-10-09T06:24:51.718895+0000","last_undegraded":"2023-10-09T06:24:51.718895+0000","last_fullsized":"2023-10-09T06:24:51.718895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:15.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.709192+0000","last_change":"2023-10-09T06:24:51.709192+0000","last_active":"2023-10-09T06:24:51.709192+0000","last_peered":"2023-10-09T06:24:51.709192+0000","last_clean":"2023-10-09T06:24:51.709192+0000","last_became_active":"2023-10-09T06:24:51.709010+0000","last_became_peered":"2023-10-09T06:24:51.709010+0000","last_unstale":"2023-10-09T06:24:51.709192+0000","last_undegraded":"2023-10-09T06:24:51.709192+0000","last_fullsized":"2023-10-09T06:24:51.709192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:14.944717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.716749+0000","last_change":"2023-10-09T06:24:51.716749+0000","last_active":"2023-10-09T06:24:51.716749+0000","last_peered":"2023-10-09T06:24:51.716749+0000","last_clean":"2023-10-09T06:24:51.716749+0000","last_became_active":"2023-10-09T06:24:51.715838+0000","last_became_peered":"2023-10-09T06:24:51.715838+0000","last_unstale":"2023-10-09T06:24:51.716749+0000","last_undegraded":"2023-10-09T06:24:51.716749+0000","last_fullsized":"2023-10-09T06:24:51.716749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:56.150163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715363+0000","last_change":"2023-10-09T06:24:51.715310+0000","last_active":"2023-10-09T06:24:51.715363+0000","last_peered":"2023-10-09T06:24:51.715363+0000","last_clean":"2023-10-09T06:24:51.715363+0000","last_became_active":"2023-10-09T06:24:51.715035+0000","last_became_peered":"2023-10-09T06:24:51.715035+0000","last_unstale":"2023-10-09T06:24:51.715363+0000","last_undegraded":"2023-10-09T06:24:51.715363+0000","last_fullsized":"2023-10-09T06:24:51.715363+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:28.833123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711743+0000","last_change":"2023-10-09T06:24:51.711743+0000","last_active":"2023-10-09T06:24:51.711743+0000","last_peered":"2023-10-09T06:24:51.711743+0000","last_clean":"2023-10-09T06:24:51.711743+0000","last_became_active":"2023-10-09T06:24:51.710477+0000","last_became_peered":"2023-10-09T06:24:51.710477+0000","last_unstale":"2023-10-09T06:24:51.711743+0000","last_undegraded":"2023-10-09T06:24:51.711743+0000","last_fullsized":"2023-10-09T06:24:51.711743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:59.141284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714553+0000","last_change":"2023-10-09T06:24:51.714492+0000","last_active":"2023-10-09T06:24:51.714553+0000","last_peered":"2023-10-09T06:24:51.714553+0000","last_clean":"2023-10-09T06:24:51.714553+0000","last_became_active":"2023-10-09T06:24:51.714121+0000","last_became_peered":"2023-10-09T06:24:51.714121+0000","last_unstale":"2023-10-09T06:24:51.714553+0000","last_undegraded":"2023-10-09T06:24:51.714553+0000","last_fullsized":"2023-10-09T06:24:51.714553+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:28:08.421921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.709932+0000","last_change":"2023-10-09T06:24:51.709932+0000","last_active":"2023-10-09T06:24:51.709932+0000","last_peered":"2023-10-09T06:24:51.709932+0000","last_clean":"2023-10-09T06:24:51.709932+0000","last_became_active":"2023-10-09T06:24:51.709704+0000","last_became_peered":"2023-10-09T06:24:51.709704+0000","last_unstale":"2023-10-09T06:24:51.709932+0000","last_undegraded":"2023-10-09T06:24:51.709932+0000","last_fullsized":"2023-10-09T06:24:51.709932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:30.094243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712426+0000","last_change":"2023-10-09T06:24:51.712197+0000","last_active":"2023-10-09T06:24:51.712426+0000","last_peered":"2023-10-09T06:24:51.712426+0000","last_clean":"2023-10-09T06:24:51.712426+0000","last_became_active":"2023-10-09T06:24:51.711940+0000","last_became_peered":"2023-10-09T06:24:51.711940+0000","last_unstale":"2023-10-09T06:24:51.712426+0000","last_undegraded":"2023-10-09T06:24:51.712426+0000","last_fullsized":"2023-10-09T06:24:51.712426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:18:51.061585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713789+0000","last_change":"2023-10-09T06:24:51.713789+0000","last_active":"2023-10-09T06:24:51.713789+0000","last_peered":"2023-10-09T06:24:51.713789+0000","last_clean":"2023-10-09T06:24:51.713789+0000","last_became_active":"2023-10-09T06:24:51.713377+0000","last_became_peered":"2023-10-09T06:24:51.713377+0000","last_unstale":"2023-10-09T06:24:51.713789+0000","last_undegraded":"2023-10-09T06:24:51.713789+0000","last_fullsized":"2023-10-09T06:24:51.713789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:40:10.941098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711762+0000","last_change":"2023-10-09T06:24:51.711762+0000","last_active":"2023-10-09T06:24:51.711762+0000","last_peered":"2023-10-09T06:24:51.711762+0000","last_clean":"2023-10-09T06:24:51.711762+0000","last_became_active":"2023-10-09T06:24:51.711043+0000","last_became_peered":"2023-10-09T06:24:51.711043+0000","last_unstale":"2023-10-09T06:24:51.711762+0000","last_undegraded":"2023-10-09T06:24:51.711762+0000","last_fullsized":"2023-10-09T06:24:51.711762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:14:57.347200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.716599+0000","last_change":"2023-10-09T06:24:51.716599+0000","last_active":"2023-10-09T06:24:51.716599+0000","last_peered":"2023-10-09T06:24:51.716599+0000","last_clean":"2023-10-09T06:24:51.716599+0000","last_became_active":"2023-10-09T06:24:51.716301+0000","last_became_peered":"2023-10-09T06:24:51.716301+0000","last_unstale":"2023-10-09T06:24:51.716599+0000","last_undegraded":"2023-10-09T06:24:51.716599+0000","last_fullsized":"2023-10-09T06:24:51.716599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:32.473331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.719258+0000","last_change":"2023-10-09T06:24:51.719194+0000","last_active":"2023-10-09T06:24:51.719258+0000","last_peered":"2023-10-09T06:24:51.719258+0000","last_clean":"2023-10-09T06:24:51.719258+0000","last_became_active":"2023-10-09T06:24:51.718395+0000","last_became_peered":"2023-10-09T06:24:51.718395+0000","last_unstale":"2023-10-09T06:24:51.719258+0000","last_undegraded":"2023-10-09T06:24:51.719258+0000","last_fullsized":"2023-10-09T06:24:51.719258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:45.060045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715195+0000","last_change":"2023-10-09T06:24:51.715133+0000","last_active":"2023-10-09T06:24:51.715195+0000","last_peered":"2023-10-09T06:24:51.715195+0000","last_clean":"2023-10-09T06:24:51.715195+0000","last_became_active":"2023-10-09T06:24:51.714885+0000","last_became_peered":"2023-10-09T06:24:51.714885+0000","last_unstale":"2023-10-09T06:24:51.715195+0000","last_undegraded":"2023-10-09T06:24:51.715195+0000","last_fullsized":"2023-10-09T06:24:51.715195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:26:56.338821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713004+0000","last_change":"2023-10-09T06:24:51.713004+0000","last_active":"2023-10-09T06:24:51.713004+0000","last_peered":"2023-10-09T06:24:51.713004+0000","last_clean":"2023-10-09T06:24:51.713004+0000","last_became_active":"2023-10-09T06:24:51.712695+0000","last_became_peered":"2023-10-09T06:24:51.712695+0000","last_unstale":"2023-10-09T06:24:51.713004+0000","last_undegraded":"2023-10-09T06:24:51.713004+0000","last_fullsized":"2023-10-09T06:24:51.713004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:07.518873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712250+0000","last_change":"2023-10-09T06:24:51.712250+0000","last_active":"2023-10-09T06:24:51.712250+0000","last_peered":"2023-10-09T06:24:51.712250+0000","last_clean":"2023-10-09T06:24:51.712250+0000","last_became_active":"2023-10-09T06:24:51.711998+0000","last_became_peered":"2023-10-09T06:24:51.711998+0000","last_unstale":"2023-10-09T06:24:51.712250+0000","last_undegraded":"2023-10-09T06:24:51.712250+0000","last_fullsized":"2023-10-09T06:24:51.712250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:34:07.441514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714466+0000","last_change":"2023-10-09T06:24:51.713873+0000","last_active":"2023-10-09T06:24:51.714466+0000","last_peered":"2023-10-09T06:24:51.714466+0000","last_clean":"2023-10-09T06:24:51.714466+0000","last_became_active":"2023-10-09T06:24:51.713627+0000","last_became_peered":"2023-10-09T06:24:51.713627+0000","last_unstale":"2023-10-09T06:24:51.714466+0000","last_undegraded":"2023-10-09T06:24:51.714466+0000","last_fullsized":"2023-10-09T06:24:51.714466+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:27:49.485618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714793+0000","last_change":"2023-10-09T06:24:51.714608+0000","last_active":"2023-10-09T06:24:51.714793+0000","last_peered":"2023-10-09T06:24:51.714793+0000","last_clean":"2023-10-09T06:24:51.714793+0000","last_became_active":"2023-10-09T06:24:51.714363+0000","last_became_peered":"2023-10-09T06:24:51.714363+0000","last_unstale":"2023-10-09T06:24:51.714793+0000","last_undegraded":"2023-10-09T06:24:51.714793+0000","last_fullsized":"2023-10-09T06:24:51.714793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:32.424213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.717044+0000","last_change":"2023-10-09T06:24:51.717044+0000","last_active":"2023-10-09T06:24:51.717044+0000","last_peered":"2023-10-09T06:24:51.717044+0000","last_clean":"2023-10-09T06:24:51.717044+0000","last_became_active":"2023-10-09T06:24:51.716343+0000","last_became_peered":"2023-10-09T06:24:51.716343+0000","last_unstale":"2023-10-09T06:24:51.717044+0000","last_undegraded":"2023-10-09T06:24:51.717044+0000","last_fullsized":"2023-10-09T06:24:51.717044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:54.441056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.719366+0000","last_change":"2023-10-09T06:24:51.719366+0000","last_active":"2023-10-09T06:24:51.719366+0000","last_peered":"2023-10-09T06:24:51.719366+0000","last_clean":"2023-10-09T06:24:51.719366+0000","last_became_active":"2023-10-09T06:24:51.719078+0000","last_became_peered":"2023-10-09T06:24:51.719078+0000","last_unstale":"2023-10-09T06:24:51.719366+0000","last_undegraded":"2023-10-09T06:24:51.719366+0000","last_fullsized":"2023-10-09T06:24:51.719366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:08.419115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.710248+0000","last_change":"2023-10-09T06:24:51.710248+0000","last_active":"2023-10-09T06:24:51.710248+0000","last_peered":"2023-10-09T06:24:51.710248+0000","last_clean":"2023-10-09T06:24:51.710248+0000","last_became_active":"2023-10-09T06:24:51.708899+0000","last_became_peered":"2023-10-09T06:24:51.708899+0000","last_unstale":"2023-10-09T06:24:51.710248+0000","last_undegraded":"2023-10-09T06:24:51.710248+0000","last_fullsized":"2023-10-09T06:24:51.710248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:57.845175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.710115+0000","last_change":"2023-10-09T06:24:51.710115+0000","last_active":"2023-10-09T06:24:51.710115+0000","last_peered":"2023-10-09T06:24:51.710115+0000","last_clean":"2023-10-09T06:24:51.710115+0000","last_became_active":"2023-10-09T06:24:51.709882+0000","last_became_peered":"2023-10-09T06:24:51.709882+0000","last_unstale":"2023-10-09T06:24:51.710115+0000","last_undegraded":"2023-10-09T06:24:51.710115+0000","last_fullsized":"2023-10-09T06:24:51.710115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:28:07.814854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.709291+0000","last_change":"2023-10-09T06:24:51.709291+0000","last_active":"2023-10-09T06:24:51.709291+0000","last_peered":"2023-10-09T06:24:51.709291+0000","last_clean":"2023-10-09T06:24:51.709291+0000","last_became_active":"2023-10-09T06:24:51.709068+0000","last_became_peered":"2023-10-09T06:24:51.709068+0000","last_unstale":"2023-10-09T06:24:51.709291+0000","last_undegraded":"2023-10-09T06:24:51.709291+0000","last_fullsized":"2023-10-09T06:24:51.709291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:43.181797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.717986+0000","last_change":"2023-10-09T06:24:51.717986+0000","last_active":"2023-10-09T06:24:51.717986+0000","last_peered":"2023-10-09T06:24:51.717986+0000","last_clean":"2023-10-09T06:24:51.717986+0000","last_became_active":"2023-10-09T06:24:51.717784+0000","last_became_peered":"2023-10-09T06:24:51.717784+0000","last_unstale":"2023-10-09T06:24:51.717986+0000","last_undegraded":"2023-10-09T06:24:51.717986+0000","last_fullsized":"2023-10-09T06:24:51.717986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:40:10.941098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715085+0000","last_change":"2023-10-09T06:24:51.715085+0000","last_active":"2023-10-09T06:24:51.715085+0000","last_peered":"2023-10-09T06:24:51.715085+0000","last_clean":"2023-10-09T06:24:51.715085+0000","last_became_active":"2023-10-09T06:24:51.714823+0000","last_became_peered":"2023-10-09T06:24:51.714823+0000","last_unstale":"2023-10-09T06:24:51.715085+0000","last_undegraded":"2023-10-09T06:24:51.715085+0000","last_fullsized":"2023-10-09T06:24:51.715085+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:00:42.826134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714421+0000","last_change":"2023-10-09T06:24:51.714157+0000","last_active":"2023-10-09T06:24:51.714421+0000","last_peered":"2023-10-09T06:24:51.714421+0000","last_clean":"2023-10-09T06:24:51.714421+0000","last_became_active":"2023-10-09T06:24:51.713579+0000","last_became_peered":"2023-10-09T06:24:51.713579+0000","last_unstale":"2023-10-09T06:24:51.714421+0000","last_undegraded":"2023-10-09T06:24:51.714421+0000","last_fullsized":"2023-10-09T06:24:51.714421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:45.876940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712926+0000","last_change":"2023-10-09T06:24:51.712539+0000","last_active":"2023-10-09T06:24:51.712926+0000","last_peered":"2023-10-09T06:24:51.712926+0000","last_clean":"2023-10-09T06:24:51.712926+0000","last_became_active":"2023-10-09T06:24:51.712315+0000","last_became_peered":"2023-10-09T06:24:51.712315+0000","last_unstale":"2023-10-09T06:24:51.712926+0000","last_undegraded":"2023-10-09T06:24:51.712926+0000","last_fullsized":"2023-10-09T06:24:51.712926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:43.181797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"83'4","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.982411+0000","last_change":"2023-10-09T06:24:50.981287+0000","last_active":"2023-10-09T06:24:51.982411+0000","last_peered":"2023-10-09T06:24:51.982411+0000","last_clean":"2023-10-09T06:24:51.982411+0000","last_became_active":"2023-10-09T06:24:50.981024+0000","last_became_peered":"2023-10-09T06:24:50.981024+0000","last_unstale":"2023-10-09T06:24:51.982411+0000","last_undegraded":"2023-10-09T06:24:51.982411+0000","last_fullsized":"2023-10-09T06:24:51.982411+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:44.055527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712864+0000","last_change":"2023-10-09T06:24:51.712864+0000","last_active":"2023-10-09T06:24:51.712864+0000","last_peered":"2023-10-09T06:24:51.712864+0000","last_clean":"2023-10-09T06:24:51.712864+0000","last_became_active":"2023-10-09T06:24:51.712745+0000","last_became_peered":"2023-10-09T06:24:51.712745+0000","last_unstale":"2023-10-09T06:24:51.712864+0000","last_undegraded":"2023-10-09T06:24:51.712864+0000","last_fullsized":"2023-10-09T06:24:51.712864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:54:53.170200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.981967+0000","last_change":"2023-10-09T06:24:50.976818+0000","last_active":"2023-10-09T06:24:51.981967+0000","last_peered":"2023-10-09T06:24:51.981967+0000","last_clean":"2023-10-09T06:24:51.981967+0000","last_became_active":"2023-10-09T06:24:50.976562+0000","last_became_peered":"2023-10-09T06:24:50.976562+0000","last_unstale":"2023-10-09T06:24:51.981967+0000","last_undegraded":"2023-10-09T06:24:51.981967+0000","last_fullsized":"2023-10-09T06:24:51.981967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:06.514355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.717866+0000","last_change":"2023-10-09T06:24:51.717758+0000","last_active":"2023-10-09T06:24:51.717866+0000","last_peered":"2023-10-09T06:24:51.717866+0000","last_clean":"2023-10-09T06:24:51.717866+0000","last_became_active":"2023-10-09T06:24:51.717056+0000","last_became_peered":"2023-10-09T06:24:51.717056+0000","last_unstale":"2023-10-09T06:24:51.717866+0000","last_undegraded":"2023-10-09T06:24:51.717866+0000","last_fullsized":"2023-10-09T06:24:51.717866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:56.150163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.982581+0000","last_change":"2023-10-09T06:24:50.982438+0000","last_active":"2023-10-09T06:24:51.982581+0000","last_peered":"2023-10-09T06:24:51.982581+0000","last_clean":"2023-10-09T06:24:51.982581+0000","last_became_active":"2023-10-09T06:24:50.981576+0000","last_became_peered":"2023-10-09T06:24:50.981576+0000","last_unstale":"2023-10-09T06:24:51.982581+0000","last_undegraded":"2023-10-09T06:24:51.982581+0000","last_fullsized":"2023-10-09T06:24:51.982581+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:58.136766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714485+0000","last_change":"2023-10-09T06:24:51.714203+0000","last_active":"2023-10-09T06:24:51.714485+0000","last_peered":"2023-10-09T06:24:51.714485+0000","last_clean":"2023-10-09T06:24:51.714485+0000","last_became_active":"2023-10-09T06:24:51.713950+0000","last_became_peered":"2023-10-09T06:24:51.713950+0000","last_unstale":"2023-10-09T06:24:51.714485+0000","last_undegraded":"2023-10-09T06:24:51.714485+0000","last_fullsized":"2023-10-09T06:24:51.714485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:08.128479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.982140+0000","last_change":"2023-10-09T06:24:50.981025+0000","last_active":"2023-10-09T06:24:51.982140+0000","last_peered":"2023-10-09T06:24:51.982140+0000","last_clean":"2023-10-09T06:24:51.982140+0000","last_became_active":"2023-10-09T06:24:50.980230+0000","last_became_peered":"2023-10-09T06:24:50.980230+0000","last_unstale":"2023-10-09T06:24:51.982140+0000","last_undegraded":"2023-10-09T06:24:51.982140+0000","last_fullsized":"2023-10-09T06:24:51.982140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:05:46.582288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715233+0000","last_change":"2023-10-09T06:24:51.715233+0000","last_active":"2023-10-09T06:24:51.715233+0000","last_peered":"2023-10-09T06:24:51.715233+0000","last_clean":"2023-10-09T06:24:51.715233+0000","last_became_active":"2023-10-09T06:24:51.714756+0000","last_became_peered":"2023-10-09T06:24:51.714756+0000","last_unstale":"2023-10-09T06:24:51.715233+0000","last_undegraded":"2023-10-09T06:24:51.715233+0000","last_fullsized":"2023-10-09T06:24:51.715233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:18:51.061585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.706646+0000","last_change":"2023-10-09T06:24:50.982346+0000","last_active":"2023-10-09T06:24:51.706646+0000","last_peered":"2023-10-09T06:24:51.706646+0000","last_clean":"2023-10-09T06:24:51.706646+0000","last_became_active":"2023-10-09T06:24:50.982098+0000","last_became_peered":"2023-10-09T06:24:50.982098+0000","last_unstale":"2023-10-09T06:24:51.706646+0000","last_undegraded":"2023-10-09T06:24:51.706646+0000","last_fullsized":"2023-10-09T06:24:51.706646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:26.340147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.710854+0000","last_change":"2023-10-09T06:24:51.710854+0000","last_active":"2023-10-09T06:24:51.710854+0000","last_peered":"2023-10-09T06:24:51.710854+0000","last_clean":"2023-10-09T06:24:51.710854+0000","last_became_active":"2023-10-09T06:24:51.708868+0000","last_became_peered":"2023-10-09T06:24:51.708868+0000","last_unstale":"2023-10-09T06:24:51.710854+0000","last_undegraded":"2023-10-09T06:24:51.710854+0000","last_fullsized":"2023-10-09T06:24:51.710854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:45.060045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.985092+0000","last_change":"2023-10-09T06:24:50.978858+0000","last_active":"2023-10-09T06:24:51.985092+0000","last_peered":"2023-10-09T06:24:51.985092+0000","last_clean":"2023-10-09T06:24:51.985092+0000","last_became_active":"2023-10-09T06:24:50.978414+0000","last_became_peered":"2023-10-09T06:24:50.978414+0000","last_unstale":"2023-10-09T06:24:51.985092+0000","last_undegraded":"2023-10-09T06:24:51.985092+0000","last_fullsized":"2023-10-09T06:24:51.985092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:05:49.345235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711960+0000","last_change":"2023-10-09T06:24:51.711960+0000","last_active":"2023-10-09T06:24:51.711960+0000","last_peered":"2023-10-09T06:24:51.711960+0000","last_clean":"2023-10-09T06:24:51.711960+0000","last_became_active":"2023-10-09T06:24:51.711748+0000","last_became_peered":"2023-10-09T06:24:51.711748+0000","last_unstale":"2023-10-09T06:24:51.711960+0000","last_undegraded":"2023-10-09T06:24:51.711960+0000","last_fullsized":"2023-10-09T06:24:51.711960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:49.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.979385+0000","last_change":"2023-10-09T06:24:50.979315+0000","last_active":"2023-10-09T06:24:50.979385+0000","last_peered":"2023-10-09T06:24:50.979385+0000","last_clean":"2023-10-09T06:24:50.979385+0000","last_became_active":"2023-10-09T06:24:50.978837+0000","last_became_peered":"2023-10-09T06:24:50.978837+0000","last_unstale":"2023-10-09T06:24:50.979385+0000","last_undegraded":"2023-10-09T06:24:50.979385+0000","last_fullsized":"2023-10-09T06:24:50.979385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:29.089725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715316+0000","last_change":"2023-10-09T06:24:51.715266+0000","last_active":"2023-10-09T06:24:51.715316+0000","last_peered":"2023-10-09T06:24:51.715316+0000","last_clean":"2023-10-09T06:24:51.715316+0000","last_became_active":"2023-10-09T06:24:51.715097+0000","last_became_peered":"2023-10-09T06:24:51.715097+0000","last_unstale":"2023-10-09T06:24:51.715316+0000","last_undegraded":"2023-10-09T06:24:51.715316+0000","last_fullsized":"2023-10-09T06:24:51.715316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:47:09.038465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.981865+0000","last_change":"2023-10-09T06:24:50.981728+0000","last_active":"2023-10-09T06:24:50.981865+0000","last_peered":"2023-10-09T06:24:50.981865+0000","last_clean":"2023-10-09T06:24:50.981865+0000","last_became_active":"2023-10-09T06:24:50.981500+0000","last_became_peered":"2023-10-09T06:24:50.981500+0000","last_unstale":"2023-10-09T06:24:50.981865+0000","last_undegraded":"2023-10-09T06:24:50.981865+0000","last_fullsized":"2023-10-09T06:24:50.981865+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:22.499841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715343+0000","last_change":"2023-10-09T06:24:51.715343+0000","last_active":"2023-10-09T06:24:51.715343+0000","last_peered":"2023-10-09T06:24:51.715343+0000","last_clean":"2023-10-09T06:24:51.715343+0000","last_became_active":"2023-10-09T06:24:51.714815+0000","last_became_peered":"2023-10-09T06:24:51.714815+0000","last_unstale":"2023-10-09T06:24:51.715343+0000","last_undegraded":"2023-10-09T06:24:51.715343+0000","last_fullsized":"2023-10-09T06:24:51.715343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:25.572722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.979327+0000","last_change":"2023-10-09T06:24:50.979243+0000","last_active":"2023-10-09T06:24:50.979327+0000","last_peered":"2023-10-09T06:24:50.979327+0000","last_clean":"2023-10-09T06:24:50.979327+0000","last_became_active":"2023-10-09T06:24:50.979003+0000","last_became_peered":"2023-10-09T06:24:50.979003+0000","last_unstale":"2023-10-09T06:24:50.979327+0000","last_undegraded":"2023-10-09T06:24:50.979327+0000","last_fullsized":"2023-10-09T06:24:50.979327+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:51.733742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715261+0000","last_change":"2023-10-09T06:24:51.715204+0000","last_active":"2023-10-09T06:24:51.715261+0000","last_peered":"2023-10-09T06:24:51.715261+0000","last_clean":"2023-10-09T06:24:51.715261+0000","last_became_active":"2023-10-09T06:24:51.714692+0000","last_became_peered":"2023-10-09T06:24:51.714692+0000","last_unstale":"2023-10-09T06:24:51.715261+0000","last_undegraded":"2023-10-09T06:24:51.715261+0000","last_fullsized":"2023-10-09T06:24:51.715261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:46.459314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.705909+0000","last_change":"2023-10-09T06:24:50.983806+0000","last_active":"2023-10-09T06:24:51.705909+0000","last_peered":"2023-10-09T06:24:51.705909+0000","last_clean":"2023-10-09T06:24:51.705909+0000","last_became_active":"2023-10-09T06:24:50.983602+0000","last_became_peered":"2023-10-09T06:24:50.983602+0000","last_unstale":"2023-10-09T06:24:51.705909+0000","last_undegraded":"2023-10-09T06:24:51.705909+0000","last_fullsized":"2023-10-09T06:24:51.705909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:15.554739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713861+0000","last_change":"2023-10-09T06:24:51.713654+0000","last_active":"2023-10-09T06:24:51.713861+0000","last_peered":"2023-10-09T06:24:51.713861+0000","last_clean":"2023-10-09T06:24:51.713861+0000","last_became_active":"2023-10-09T06:24:51.713332+0000","last_became_peered":"2023-10-09T06:24:51.713332+0000","last_unstale":"2023-10-09T06:24:51.713861+0000","last_undegraded":"2023-10-09T06:24:51.713861+0000","last_fullsized":"2023-10-09T06:24:51.713861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:40:10.941098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"83'3","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.981043+0000","last_change":"2023-10-09T06:24:50.982935+0000","last_active":"2023-10-09T06:24:51.981043+0000","last_peered":"2023-10-09T06:24:51.981043+0000","last_clean":"2023-10-09T06:24:51.981043+0000","last_became_active":"2023-10-09T06:24:50.982702+0000","last_became_peered":"2023-10-09T06:24:50.982702+0000","last_unstale":"2023-10-09T06:24:51.981043+0000","last_undegraded":"2023-10-09T06:24:51.981043+0000","last_fullsized":"2023-10-09T06:24:51.981043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:58.948953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.710614+0000","last_change":"2023-10-09T06:24:51.710614+0000","last_active":"2023-10-09T06:24:51.710614+0000","last_peered":"2023-10-09T06:24:51.710614+0000","last_clean":"2023-10-09T06:24:51.710614+0000","last_became_active":"2023-10-09T06:24:51.710091+0000","last_became_peered":"2023-10-09T06:24:51.710091+0000","last_unstale":"2023-10-09T06:24:51.710614+0000","last_undegraded":"2023-10-09T06:24:51.710614+0000","last_fullsized":"2023-10-09T06:24:51.710614+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:54:12.530891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"83'6","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.981569+0000","last_change":"2023-10-09T06:24:50.982738+0000","last_active":"2023-10-09T06:24:51.981569+0000","last_peered":"2023-10-09T06:24:51.981569+0000","last_clean":"2023-10-09T06:24:51.981569+0000","last_became_active":"2023-10-09T06:24:50.982483+0000","last_became_peered":"2023-10-09T06:24:50.982483+0000","last_unstale":"2023-10-09T06:24:51.981569+0000","last_undegraded":"2023-10-09T06:24:51.981569+0000","last_fullsized":"2023-10-09T06:24:51.981569+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:13.940199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712977+0000","last_change":"2023-10-09T06:24:51.712755+0000","last_active":"2023-10-09T06:24:51.712977+0000","last_peered":"2023-10-09T06:24:51.712977+0000","last_clean":"2023-10-09T06:24:51.712977+0000","last_became_active":"2023-10-09T06:24:51.711914+0000","last_became_peered":"2023-10-09T06:24:51.711914+0000","last_unstale":"2023-10-09T06:24:51.712977+0000","last_undegraded":"2023-10-09T06:24:51.712977+0000","last_fullsized":"2023-10-09T06:24:51.712977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:35:51.976193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.981854+0000","last_change":"2023-10-09T06:24:50.978593+0000","last_active":"2023-10-09T06:24:51.981854+0000","last_peered":"2023-10-09T06:24:51.981854+0000","last_clean":"2023-10-09T06:24:51.981854+0000","last_became_active":"2023-10-09T06:24:50.978277+0000","last_became_peered":"2023-10-09T06:24:50.978277+0000","last_unstale":"2023-10-09T06:24:51.981854+0000","last_undegraded":"2023-10-09T06:24:51.981854+0000","last_fullsized":"2023-10-09T06:24:51.981854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:05:46.582288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713196+0000","last_change":"2023-10-09T06:24:51.713196+0000","last_active":"2023-10-09T06:24:51.713196+0000","last_peered":"2023-10-09T06:24:51.713196+0000","last_clean":"2023-10-09T06:24:51.713196+0000","last_became_active":"2023-10-09T06:24:51.712971+0000","last_became_peered":"2023-10-09T06:24:51.712971+0000","last_unstale":"2023-10-09T06:24:51.713196+0000","last_undegraded":"2023-10-09T06:24:51.713196+0000","last_fullsized":"2023-10-09T06:24:51.713196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:28:08.421921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.706892+0000","last_change":"2023-10-09T06:24:50.984393+0000","last_active":"2023-10-09T06:24:51.706892+0000","last_peered":"2023-10-09T06:24:51.706892+0000","last_clean":"2023-10-09T06:24:51.706892+0000","last_became_active":"2023-10-09T06:24:50.984167+0000","last_became_peered":"2023-10-09T06:24:50.984167+0000","last_unstale":"2023-10-09T06:24:51.706892+0000","last_undegraded":"2023-10-09T06:24:51.706892+0000","last_fullsized":"2023-10-09T06:24:51.706892+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:42.718888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714384+0000","last_change":"2023-10-09T06:24:51.714328+0000","last_active":"2023-10-09T06:24:51.714384+0000","last_peered":"2023-10-09T06:24:51.714384+0000","last_clean":"2023-10-09T06:24:51.714384+0000","last_became_active":"2023-10-09T06:24:51.713799+0000","last_became_peered":"2023-10-09T06:24:51.713799+0000","last_unstale":"2023-10-09T06:24:51.714384+0000","last_undegraded":"2023-10-09T06:24:51.714384+0000","last_fullsized":"2023-10-09T06:24:51.714384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:00:42.826134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.980772+0000","last_change":"2023-10-09T06:24:50.980695+0000","last_active":"2023-10-09T06:24:50.980772+0000","last_peered":"2023-10-09T06:24:50.980772+0000","last_clean":"2023-10-09T06:24:50.980772+0000","last_became_active":"2023-10-09T06:24:50.980416+0000","last_became_peered":"2023-10-09T06:24:50.980416+0000","last_unstale":"2023-10-09T06:24:50.980772+0000","last_undegraded":"2023-10-09T06:24:50.980772+0000","last_fullsized":"2023-10-09T06:24:50.980772+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:14.874167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711902+0000","last_change":"2023-10-09T06:24:51.711902+0000","last_active":"2023-10-09T06:24:51.711902+0000","last_peered":"2023-10-09T06:24:51.711902+0000","last_clean":"2023-10-09T06:24:51.711902+0000","last_became_active":"2023-10-09T06:24:51.711292+0000","last_became_peered":"2023-10-09T06:24:51.711292+0000","last_unstale":"2023-10-09T06:24:51.711902+0000","last_undegraded":"2023-10-09T06:24:51.711902+0000","last_fullsized":"2023-10-09T06:24:51.711902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:54.465881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"83'8","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.983255+0000","last_change":"2023-10-09T06:24:50.985550+0000","last_active":"2023-10-09T06:24:51.983255+0000","last_peered":"2023-10-09T06:24:51.983255+0000","last_clean":"2023-10-09T06:24:51.983255+0000","last_became_active":"2023-10-09T06:24:50.985238+0000","last_became_peered":"2023-10-09T06:24:50.985238+0000","last_unstale":"2023-10-09T06:24:51.983255+0000","last_undegraded":"2023-10-09T06:24:51.983255+0000","last_fullsized":"2023-10-09T06:24:51.983255+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:46.495942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711825+0000","last_change":"2023-10-09T06:24:51.711825+0000","last_active":"2023-10-09T06:24:51.711825+0000","last_peered":"2023-10-09T06:24:51.711825+0000","last_clean":"2023-10-09T06:24:51.711825+0000","last_became_active":"2023-10-09T06:24:51.710694+0000","last_became_peered":"2023-10-09T06:24:51.710694+0000","last_unstale":"2023-10-09T06:24:51.711825+0000","last_undegraded":"2023-10-09T06:24:51.711825+0000","last_fullsized":"2023-10-09T06:24:51.711825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:38.679141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.982134+0000","last_change":"2023-10-09T06:24:50.985919+0000","last_active":"2023-10-09T06:24:51.982134+0000","last_peered":"2023-10-09T06:24:51.982134+0000","last_clean":"2023-10-09T06:24:51.982134+0000","last_became_active":"2023-10-09T06:24:50.984897+0000","last_became_peered":"2023-10-09T06:24:50.984897+0000","last_unstale":"2023-10-09T06:24:51.982134+0000","last_undegraded":"2023-10-09T06:24:51.982134+0000","last_fullsized":"2023-10-09T06:24:51.982134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:43:44.959165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.708474+0000","last_change":"2023-10-09T06:24:51.708405+0000","last_active":"2023-10-09T06:24:51.708474+0000","last_peered":"2023-10-09T06:24:51.708474+0000","last_clean":"2023-10-09T06:24:51.708474+0000","last_became_active":"2023-10-09T06:24:51.708161+0000","last_became_peered":"2023-10-09T06:24:51.708161+0000","last_unstale":"2023-10-09T06:24:51.708474+0000","last_undegraded":"2023-10-09T06:24:51.708474+0000","last_fullsized":"2023-10-09T06:24:51.708474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:59.953471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.982989+0000","last_change":"2023-10-09T06:24:50.982330+0000","last_active":"2023-10-09T06:24:51.982989+0000","last_peered":"2023-10-09T06:24:51.982989+0000","last_clean":"2023-10-09T06:24:51.982989+0000","last_became_active":"2023-10-09T06:24:50.981345+0000","last_became_peered":"2023-10-09T06:24:50.981345+0000","last_unstale":"2023-10-09T06:24:51.982989+0000","last_undegraded":"2023-10-09T06:24:51.982989+0000","last_fullsized":"2023-10-09T06:24:51.982989+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:31.468813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711871+0000","last_change":"2023-10-09T06:24:51.711871+0000","last_active":"2023-10-09T06:24:51.711871+0000","last_peered":"2023-10-09T06:24:51.711871+0000","last_clean":"2023-10-09T06:24:51.711871+0000","last_became_active":"2023-10-09T06:24:51.710764+0000","last_became_peered":"2023-10-09T06:24:51.710764+0000","last_unstale":"2023-10-09T06:24:51.711871+0000","last_undegraded":"2023-10-09T06:24:51.711871+0000","last_fullsized":"2023-10-09T06:24:51.711871+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:52.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.983303+0000","last_change":"2023-10-09T06:24:50.981159+0000","last_active":"2023-10-09T06:24:51.983303+0000","last_peered":"2023-10-09T06:24:51.983303+0000","last_clean":"2023-10-09T06:24:51.983303+0000","last_became_active":"2023-10-09T06:24:50.980757+0000","last_became_peered":"2023-10-09T06:24:50.980757+0000","last_unstale":"2023-10-09T06:24:51.983303+0000","last_undegraded":"2023-10-09T06:24:51.983303+0000","last_fullsized":"2023-10-09T06:24:51.983303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:19.195680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711949+0000","last_change":"2023-10-09T06:24:51.711949+0000","last_active":"2023-10-09T06:24:51.711949+0000","last_peered":"2023-10-09T06:24:51.711949+0000","last_clean":"2023-10-09T06:24:51.711949+0000","last_became_active":"2023-10-09T06:24:51.711728+0000","last_became_peered":"2023-10-09T06:24:51.711728+0000","last_unstale":"2023-10-09T06:24:51.711949+0000","last_undegraded":"2023-10-09T06:24:51.711949+0000","last_fullsized":"2023-10-09T06:24:51.711949+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:05:47.586806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.703357+0000","last_change":"2023-10-09T06:24:50.981969+0000","last_active":"2023-10-09T06:24:51.703357+0000","last_peered":"2023-10-09T06:24:51.703357+0000","last_clean":"2023-10-09T06:24:51.703357+0000","last_became_active":"2023-10-09T06:24:50.981726+0000","last_became_peered":"2023-10-09T06:24:50.981726+0000","last_unstale":"2023-10-09T06:24:51.703357+0000","last_undegraded":"2023-10-09T06:24:51.703357+0000","last_fullsized":"2023-10-09T06:24:51.703357+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:40:09.936580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.709628+0000","last_change":"2023-10-09T06:24:51.709628+0000","last_active":"2023-10-09T06:24:51.709628+0000","last_peered":"2023-10-09T06:24:51.709628+0000","last_clean":"2023-10-09T06:24:51.709628+0000","last_became_active":"2023-10-09T06:24:51.708579+0000","last_became_peered":"2023-10-09T06:24:51.708579+0000","last_unstale":"2023-10-09T06:24:51.709628+0000","last_undegraded":"2023-10-09T06:24:51.709628+0000","last_fullsized":"2023-10-09T06:24:51.709628+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:28:41.369957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.705212+0000","last_change":"2023-10-09T06:24:50.985544+0000","last_active":"2023-10-09T06:24:51.705212+0000","last_peered":"2023-10-09T06:24:51.705212+0000","last_clean":"2023-10-09T06:24:51.705212+0000","last_became_active":"2023-10-09T06:24:50.984612+0000","last_became_peered":"2023-10-09T06:24:50.984612+0000","last_unstale":"2023-10-09T06:24:51.705212+0000","last_undegraded":"2023-10-09T06:24:51.705212+0000","last_fullsized":"2023-10-09T06:24:51.705212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:13.940199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713952+0000","last_change":"2023-10-09T06:24:51.713952+0000","last_active":"2023-10-09T06:24:51.713952+0000","last_peered":"2023-10-09T06:24:51.713952+0000","last_clean":"2023-10-09T06:24:51.713952+0000","last_became_active":"2023-10-09T06:24:51.713739+0000","last_became_peered":"2023-10-09T06:24:51.713739+0000","last_unstale":"2023-10-09T06:24:51.713952+0000","last_undegraded":"2023-10-09T06:24:51.713952+0000","last_fullsized":"2023-10-09T06:24:51.713952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:59.734373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.982305+0000","last_change":"2023-10-09T06:24:50.982065+0000","last_active":"2023-10-09T06:24:50.982305+0000","last_peered":"2023-10-09T06:24:50.982305+0000","last_clean":"2023-10-09T06:24:50.982305+0000","last_became_active":"2023-10-09T06:24:50.981817+0000","last_became_peered":"2023-10-09T06:24:50.981817+0000","last_unstale":"2023-10-09T06:24:50.982305+0000","last_undegraded":"2023-10-09T06:24:50.982305+0000","last_fullsized":"2023-10-09T06:24:50.982305+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:04.310452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715359+0000","last_change":"2023-10-09T06:24:51.715359+0000","last_active":"2023-10-09T06:24:51.715359+0000","last_peered":"2023-10-09T06:24:51.715359+0000","last_clean":"2023-10-09T06:24:51.715359+0000","last_became_active":"2023-10-09T06:24:51.715133+0000","last_became_peered":"2023-10-09T06:24:51.715133+0000","last_unstale":"2023-10-09T06:24:51.715359+0000","last_undegraded":"2023-10-09T06:24:51.715359+0000","last_fullsized":"2023-10-09T06:24:51.715359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:46.459314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.709170+0000","last_change":"2023-10-09T06:24:50.981990+0000","last_active":"2023-10-09T06:24:51.709170+0000","last_peered":"2023-10-09T06:24:51.709170+0000","last_clean":"2023-10-09T06:24:51.709170+0000","last_became_active":"2023-10-09T06:24:50.981795+0000","last_became_peered":"2023-10-09T06:24:50.981795+0000","last_unstale":"2023-10-09T06:24:51.709170+0000","last_undegraded":"2023-10-09T06:24:51.709170+0000","last_fullsized":"2023-10-09T06:24:51.709170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:14.874167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713217+0000","last_change":"2023-10-09T06:24:51.713068+0000","last_active":"2023-10-09T06:24:51.713217+0000","last_peered":"2023-10-09T06:24:51.713217+0000","last_clean":"2023-10-09T06:24:51.713217+0000","last_became_active":"2023-10-09T06:24:51.712721+0000","last_became_peered":"2023-10-09T06:24:51.712721+0000","last_unstale":"2023-10-09T06:24:51.713217+0000","last_undegraded":"2023-10-09T06:24:51.713217+0000","last_fullsized":"2023-10-09T06:24:51.713217+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:39:50.069024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.982089+0000","last_change":"2023-10-09T06:24:50.983357+0000","last_active":"2023-10-09T06:24:51.982089+0000","last_peered":"2023-10-09T06:24:51.982089+0000","last_clean":"2023-10-09T06:24:51.982089+0000","last_became_active":"2023-10-09T06:24:50.983118+0000","last_became_peered":"2023-10-09T06:24:50.983118+0000","last_unstale":"2023-10-09T06:24:51.982089+0000","last_undegraded":"2023-10-09T06:24:51.982089+0000","last_fullsized":"2023-10-09T06:24:51.982089+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:22.849369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715062+0000","last_change":"2023-10-09T06:24:51.715062+0000","last_active":"2023-10-09T06:24:51.715062+0000","last_peered":"2023-10-09T06:24:51.715062+0000","last_clean":"2023-10-09T06:24:51.715062+0000","last_became_active":"2023-10-09T06:24:51.714100+0000","last_became_peered":"2023-10-09T06:24:51.714100+0000","last_unstale":"2023-10-09T06:24:51.715062+0000","last_undegraded":"2023-10-09T06:24:51.715062+0000","last_fullsized":"2023-10-09T06:24:51.715062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:26:56.338821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.982384+0000","last_change":"2023-10-09T06:24:50.982316+0000","last_active":"2023-10-09T06:24:50.982384+0000","last_peered":"2023-10-09T06:24:50.982384+0000","last_clean":"2023-10-09T06:24:50.982384+0000","last_became_active":"2023-10-09T06:24:50.982085+0000","last_became_peered":"2023-10-09T06:24:50.982085+0000","last_unstale":"2023-10-09T06:24:50.982384+0000","last_undegraded":"2023-10-09T06:24:50.982384+0000","last_fullsized":"2023-10-09T06:24:50.982384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:44.872422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.708664+0000","last_change":"2023-10-09T06:24:51.708598+0000","last_active":"2023-10-09T06:24:51.708664+0000","last_peered":"2023-10-09T06:24:51.708664+0000","last_clean":"2023-10-09T06:24:51.708664+0000","last_became_active":"2023-10-09T06:24:51.708317+0000","last_became_peered":"2023-10-09T06:24:51.708317+0000","last_unstale":"2023-10-09T06:24:51.708664+0000","last_undegraded":"2023-10-09T06:24:51.708664+0000","last_fullsized":"2023-10-09T06:24:51.708664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:17.464256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.981620+0000","last_change":"2023-10-09T06:24:50.981181+0000","last_active":"2023-10-09T06:24:50.981620+0000","last_peered":"2023-10-09T06:24:50.981620+0000","last_clean":"2023-10-09T06:24:50.981620+0000","last_became_active":"2023-10-09T06:24:50.980787+0000","last_became_peered":"2023-10-09T06:24:50.980787+0000","last_unstale":"2023-10-09T06:24:50.981620+0000","last_undegraded":"2023-10-09T06:24:50.981620+0000","last_fullsized":"2023-10-09T06:24:50.981620+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:01.602623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712900+0000","last_change":"2023-10-09T06:24:51.711936+0000","last_active":"2023-10-09T06:24:51.712900+0000","last_peered":"2023-10-09T06:24:51.712900+0000","last_clean":"2023-10-09T06:24:51.712900+0000","last_became_active":"2023-10-09T06:24:51.710069+0000","last_became_peered":"2023-10-09T06:24:51.710069+0000","last_unstale":"2023-10-09T06:24:51.712900+0000","last_undegraded":"2023-10-09T06:24:51.712900+0000","last_fullsized":"2023-10-09T06:24:51.712900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:46:41.306685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.709382+0000","last_change":"2023-10-09T06:24:50.986277+0000","last_active":"2023-10-09T06:24:51.709382+0000","last_peered":"2023-10-09T06:24:51.709382+0000","last_clean":"2023-10-09T06:24:51.709382+0000","last_became_active":"2023-10-09T06:24:50.986034+0000","last_became_peered":"2023-10-09T06:24:50.986034+0000","last_unstale":"2023-10-09T06:24:51.709382+0000","last_undegraded":"2023-10-09T06:24:51.709382+0000","last_fullsized":"2023-10-09T06:24:51.709382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:44.872422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712034+0000","last_change":"2023-10-09T06:24:51.712034+0000","last_active":"2023-10-09T06:24:51.712034+0000","last_peered":"2023-10-09T06:24:51.712034+0000","last_clean":"2023-10-09T06:24:51.712034+0000","last_became_active":"2023-10-09T06:24:51.711585+0000","last_became_peered":"2023-10-09T06:24:51.711585+0000","last_unstale":"2023-10-09T06:24:51.712034+0000","last_undegraded":"2023-10-09T06:24:51.712034+0000","last_fullsized":"2023-10-09T06:24:51.712034+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:39.301606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.983506+0000","last_change":"2023-10-09T06:24:50.983411+0000","last_active":"2023-10-09T06:24:50.983506+0000","last_peered":"2023-10-09T06:24:50.983506+0000","last_clean":"2023-10-09T06:24:50.983506+0000","last_became_active":"2023-10-09T06:24:50.983143+0000","last_became_peered":"2023-10-09T06:24:50.983143+0000","last_unstale":"2023-10-09T06:24:50.983506+0000","last_undegraded":"2023-10-09T06:24:50.983506+0000","last_fullsized":"2023-10-09T06:24:50.983506+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:21:58.581202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.717850+0000","last_change":"2023-10-09T06:24:51.717629+0000","last_active":"2023-10-09T06:24:51.717850+0000","last_peered":"2023-10-09T06:24:51.717850+0000","last_clean":"2023-10-09T06:24:51.717850+0000","last_became_active":"2023-10-09T06:24:51.715922+0000","last_became_peered":"2023-10-09T06:24:51.715922+0000","last_unstale":"2023-10-09T06:24:51.717850+0000","last_undegraded":"2023-10-09T06:24:51.717850+0000","last_fullsized":"2023-10-09T06:24:51.717850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:38.679141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.979405+0000","last_change":"2023-10-09T06:24:50.979338+0000","last_active":"2023-10-09T06:24:50.979405+0000","last_peered":"2023-10-09T06:24:50.979405+0000","last_clean":"2023-10-09T06:24:50.979405+0000","last_became_active":"2023-10-09T06:24:50.979064+0000","last_became_peered":"2023-10-09T06:24:50.979064+0000","last_unstale":"2023-10-09T06:24:50.979405+0000","last_undegraded":"2023-10-09T06:24:50.979405+0000","last_fullsized":"2023-10-09T06:24:50.979405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:48.252691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.707551+0000","last_change":"2023-10-09T06:24:51.707551+0000","last_active":"2023-10-09T06:24:51.707551+0000","last_peered":"2023-10-09T06:24:51.707551+0000","last_clean":"2023-10-09T06:24:51.707551+0000","last_became_active":"2023-10-09T06:24:51.707253+0000","last_became_peered":"2023-10-09T06:24:51.707253+0000","last_unstale":"2023-10-09T06:24:51.707551+0000","last_undegraded":"2023-10-09T06:24:51.707551+0000","last_fullsized":"2023-10-09T06:24:51.707551+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:47.500460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.985495+0000","last_change":"2023-10-09T06:24:50.985438+0000","last_active":"2023-10-09T06:24:50.985495+0000","last_peered":"2023-10-09T06:24:50.985495+0000","last_clean":"2023-10-09T06:24:50.985495+0000","last_became_active":"2023-10-09T06:24:50.984947+0000","last_became_peered":"2023-10-09T06:24:50.984947+0000","last_unstale":"2023-10-09T06:24:50.985495+0000","last_undegraded":"2023-10-09T06:24:50.985495+0000","last_fullsized":"2023-10-09T06:24:50.985495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:22.849369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.717833+0000","last_change":"2023-10-09T06:24:51.716926+0000","last_active":"2023-10-09T06:24:51.717833+0000","last_peered":"2023-10-09T06:24:51.717833+0000","last_clean":"2023-10-09T06:24:51.717833+0000","last_became_active":"2023-10-09T06:24:51.716526+0000","last_became_peered":"2023-10-09T06:24:51.716526+0000","last_unstale":"2023-10-09T06:24:51.717833+0000","last_undegraded":"2023-10-09T06:24:51.717833+0000","last_fullsized":"2023-10-09T06:24:51.717833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:28:07.814854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.705311+0000","last_change":"2023-10-09T06:24:50.986087+0000","last_active":"2023-10-09T06:24:51.705311+0000","last_peered":"2023-10-09T06:24:51.705311+0000","last_clean":"2023-10-09T06:24:51.705311+0000","last_became_active":"2023-10-09T06:24:50.985255+0000","last_became_peered":"2023-10-09T06:24:50.985255+0000","last_unstale":"2023-10-09T06:24:51.705311+0000","last_undegraded":"2023-10-09T06:24:51.705311+0000","last_fullsized":"2023-10-09T06:24:51.705311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:29.089725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714585+0000","last_change":"2023-10-09T06:24:51.714585+0000","last_active":"2023-10-09T06:24:51.714585+0000","last_peered":"2023-10-09T06:24:51.714585+0000","last_clean":"2023-10-09T06:24:51.714585+0000","last_became_active":"2023-10-09T06:24:51.714372+0000","last_became_peered":"2023-10-09T06:24:51.714372+0000","last_unstale":"2023-10-09T06:24:51.714585+0000","last_undegraded":"2023-10-09T06:24:51.714585+0000","last_fullsized":"2023-10-09T06:24:51.714585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:47.447218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.984850+0000","last_change":"2023-10-09T06:24:50.980631+0000","last_active":"2023-10-09T06:24:51.984850+0000","last_peered":"2023-10-09T06:24:51.984850+0000","last_clean":"2023-10-09T06:24:51.984850+0000","last_became_active":"2023-10-09T06:24:50.980385+0000","last_became_peered":"2023-10-09T06:24:50.980385+0000","last_unstale":"2023-10-09T06:24:51.984850+0000","last_undegraded":"2023-10-09T06:24:51.984850+0000","last_fullsized":"2023-10-09T06:24:51.984850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:55.239035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":218,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.706414+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:24:51.706414+0000","last_peered":"2023-10-09T06:24:51.706414+0000","last_clean":"2023-10-09T06:24:51.706414+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:24:51.706414+0000","last_undegraded":"2023-10-09T06:24:51.706414+0000","last_fullsized":"2023-10-09T06:24:51.706414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82599999999999996,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.91200000000000003,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.91200000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76800000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53100000000000003,"15min":0.50600000000000001},"min":{"1min":0.35199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75800000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.45700000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.57399999999999995},"min":{"1min":0.44700000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81399999999999995,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.629},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.53600000000000003},"min":{"1min":0.45000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80600000000000005,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.64700000000000002,"15min":0.57899999999999996},"min":{"1min":0.45900000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.56299999999999994},"min":{"1min":0.46000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71299999999999997,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.56299999999999994}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46800000000000003,"15min":0.47299999999999998},"min":{"1min":0.27200000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.872},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.31900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.72699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.34000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.98699999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.60699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":436,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194876,"statfs":{"total":200000000,"available":199553390,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.66100000000000003,"15min":0.79100000000000004},"min":{"1min":0.35199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77100000000000002,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.442},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.38100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":1.133,"15min":1.133},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.47299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72699999999999998,"5min":1.155,"15min":1.155},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71599999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.39600000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72599999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.68000000000000005,"15min":0.80000000000000004},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.78900000000000003,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.42999999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58299999999999996,"15min":0.60099999999999998},"min":{"1min":0.46200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":1.337,"15min":1.337},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":1.206,"15min":1.206},"last":0.42199999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.497,"15min":0.497},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.35699999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47399999999999998},"min":{"1min":0.377,"5min":0.315,"15min":0.315},"max":{"1min":0.69499999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.312},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51200000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.498},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.38100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":431,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194880,"statfs":{"total":200000000,"available":199557646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.254,"5min":0.219,"15min":0.219},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.35999999999999999,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.247}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.26300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.39700000000000002,"15min":0.38500000000000001},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.375}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.436,"15min":0.41199999999999998},"min":{"1min":0.35899999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.442,"15min":0.42799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.29199999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.56000000000000005},"min":{"1min":0.43099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.72499999999999998,"15min":0.82899999999999996},"min":{"1min":0.47399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90200000000000002,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64500000000000002,"15min":0.625},"min":{"1min":0.47099999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66000000000000003,"15min":0.66800000000000004},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.175,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.47299999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64000000000000001,"15min":0.61799999999999999},"min":{"1min":0.51700000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.48599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0189999999999999,"5min":1.49,"15min":1.49},"last":0.51300000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.52300000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.503},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67200000000000004,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.41899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1012,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198963114,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39200000000000002,"15min":0.41999999999999998},"min":{"1min":0.22700000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.65800000000000003,"5min":1.226,"15min":1.226},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.42799999999999999},"min":{"1min":0.251,"5min":0.223,"15min":0.223},"max":{"1min":0.71899999999999997,"5min":1.131,"15min":1.131},"last":0.47999999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.72199999999999998,"15min":1.0489999999999999},"min":{"1min":0.26700000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64400000000000002,"5min":12.929,"15min":12.929},"last":0.37},{"interface":"front","average":{"1min":0.437,"5min":0.44900000000000001,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.68600000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.32700000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.47899999999999998},"min":{"1min":0.34699999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67400000000000004,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.314,"15min":0.314},"max":{"1min":0.69099999999999995,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.62,"15min":0.62},"min":{"1min":0.51100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.86299999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63900000000000001,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79500000000000004,"5min":1.335,"15min":1.335},"last":0.57399999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83999999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.80500000000000005,"5min":0.999,"15min":0.999},"last":0.55100000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.621,"15min":0.623},"min":{"1min":0.502,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78500000000000003,"5min":0.998,"15min":0.998},"last":0.623},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.68300000000000005},"min":{"1min":0.495,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81999999999999995,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66500000000000004,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91200000000000003,"5min":1.262,"15min":1.262},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.51800000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.89500000000000002,"5min":1.103,"15min":1.103},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":431,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194881,"statfs":{"total":200000000,"available":199558234,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.64700000000000002,"15min":0.93500000000000005},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.79000000000000004,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.54000000000000004,"15min":0.69999999999999996},"min":{"1min":0.33200000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56200000000000006,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.27900000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.51200000000000001,"15min":0.66000000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.73099999999999998,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.309},{"interface":"front","average":{"1min":0.496,"5min":0.60499999999999998,"15min":0.72699999999999998},"min":{"1min":0.312,"5min":0.254,"15min":0.254},"max":{"1min":0.84499999999999997,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.32900000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59199999999999997,"15min":0.73199999999999998},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84299999999999997,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.71799999999999997,"15min":0.99099999999999999},"min":{"1min":0.29999999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.87,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.91200000000000003,"15min":1.1930000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94899999999999995,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.79100000000000004,"15min":0.95499999999999996},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97199999999999998,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.55800000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.77600000000000002,"15min":0.92800000000000005},"min":{"1min":0.45200000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94199999999999995,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.78600000000000003,"15min":0.93400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.995,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.46200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.78100000000000003,"15min":0.91900000000000004},"min":{"1min":0.46100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.026,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.91300000000000003,"15min":1.1859999999999999},"min":{"1min":0.42699999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.98499999999999999,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.53400000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.76700000000000002,"15min":0.91300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0049999999999999,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.78400000000000003,"15min":0.92900000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93799999999999994,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.51300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":430,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194882,"statfs":{"total":200000000,"available":199559658,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.33800000000000002,"15min":0.32600000000000001},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.499,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39500000000000002,"15min":0.375},"min":{"1min":0.33100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33800000000000002,"15min":0.32200000000000001},"min":{"1min":0.255,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.255},{"interface":"front","average":{"1min":0.436,"5min":0.36899999999999999,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.378}]},{"osd":2,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.373,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.44,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64600000000000002,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.309}]},{"osd":4,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46800000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82399999999999995,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.53000000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.875,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.45100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.45100000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.73999999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80600000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48799999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.58199999999999996},"min":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":0.87,"15min":0.87},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.502}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194882,"statfs":{"total":200000000,"available":199559700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.51900000000000002,"15min":0.49399999999999999},"min":{"1min":0.46100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.40100000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.44400000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65100000000000002,"15min":0.72499999999999998},"min":{"1min":0.39500000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72899999999999998,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.39500000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.64200000000000002,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.68200000000000005,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.84899999999999998,"15min":1.125},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":11.715,"15min":11.715},"last":0.55400000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.56000000000000005,"15min":0.52400000000000002},"min":{"1min":0.53300000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.51700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73499999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65300000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50600000000000001,"15min":0.503},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":430,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194882,"statfs":{"total":200000000,"available":199559680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68899999999999995,"5min":1.093,"15min":1.093},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.51200000000000001},"min":{"1min":0.44400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.498}]},{"osd":2,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.376}]},{"osd":3,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76300000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.77600000000000002,"5min":1.071,"15min":1.071},"last":0.51800000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66000000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48399999999999999,"15min":0.501},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.624,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.45000000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.50600000000000001,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64400000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.36399999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.67800000000000005,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65400000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64600000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.57799999999999996}]}]}],"pool_statfs":[]}} 2023-10-09T06:24:56.085 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:24:56.086 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:24:56.124 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:24:56.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.238+0000 7f895c6bb700 1 Processor -- start 2023-10-09T06:24:56.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.239+0000 7f895c6bb700 1 -- start start 2023-10-09T06:24:56.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.239+0000 7f895c6bb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f895415a1e0 0x7f89540cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:56.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.239+0000 7f895c6bb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895415db80 con 0x7f8954159e10 2023-10-09T06:24:56.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.239+0000 7f895c6bb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895415de60 con 0x7f89540b3430 2023-10-09T06:24:56.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.239+0000 7f895c6bb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895415e800 con 0x7f895415a1e0 2023-10-09T06:24:56.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.240+0000 7f8959c56700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f895415a1e0 0x7f89540cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:56.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.240+0000 7f895a457700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8954159e10 0x7f89540b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54718/0 (socket says 172.21.15.31:54718) 2023-10-09T06:24:56.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.240+0000 7f895a457700 1 -- 172.21.15.31:0/555443316 learned_addr learned my addr 172.21.15.31:0/555443316 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:56.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.240+0000 7f8959455700 1 -- 172.21.15.31:0/555443316 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241803266 0 0) 0x7f895415db80 con 0x7f8954159e10 2023-10-09T06:24:56.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.240+0000 7f8959455700 1 -- 172.21.15.31:0/555443316 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f893c003570 con 0x7f8954159e10 2023-10-09T06:24:56.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.240+0000 7f8959c56700 1 -- 172.21.15.31:0/555443316 >> v1:172.21.15.158:6789/0 conn(0x7f89540b3430 legacy=0x7f89540cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.240+0000 7f8959c56700 1 -- 172.21.15.31:0/555443316 >> v1:172.21.15.31:6789/0 conn(0x7f8954159e10 legacy=0x7f89540b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.240+0000 7f8959c56700 1 -- 172.21.15.31:0/555443316 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895415e140 con 0x7f895415a1e0 2023-10-09T06:24:56.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.240+0000 7f8959c56700 1 --2- 172.21.15.31:0/555443316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895415a1e0 0x7f89540cd740 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f89480098e0 tx=0x7f89480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe1b0dc0cc0a26 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:56.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.240+0000 7f8959455700 1 -- 172.21.15.31:0/555443316 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894800b640 con 0x7f895415a1e0 2023-10-09T06:24:56.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.240+0000 7f8959455700 1 -- 172.21.15.31:0/555443316 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894800b7a0 con 0x7f895415a1e0 2023-10-09T06:24:56.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.240+0000 7f8959455700 1 -- 172.21.15.31:0/555443316 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894800bb40 con 0x7f895415a1e0 2023-10-09T06:24:56.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.241+0000 7f895c6bb700 1 -- 172.21.15.31:0/555443316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895415a1e0 msgr2=0x7f89540cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.241+0000 7f895c6bb700 1 --2- 172.21.15.31:0/555443316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895415a1e0 0x7f89540cd740 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f89480098e0 tx=0x7f89480091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.241+0000 7f895c6bb700 1 -- 172.21.15.31:0/555443316 shutdown_connections 2023-10-09T06:24:56.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.241+0000 7f895c6bb700 1 --2- 172.21.15.31:0/555443316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895415a1e0 0x7f89540cd740 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.241+0000 7f895c6bb700 1 -- 172.21.15.31:0/555443316 >> 172.21.15.31:0/555443316 conn(0x7f8954067660 msgr2=0x7f8954067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:56.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.241+0000 7f895c6bb700 1 -- 172.21.15.31:0/555443316 shutdown_connections 2023-10-09T06:24:56.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.241+0000 7f895c6bb700 1 -- 172.21.15.31:0/555443316 wait complete. 2023-10-09T06:24:56.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.242+0000 7f895c6bb700 1 Processor -- start 2023-10-09T06:24:56.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.242+0000 7f895c6bb700 1 -- start start 2023-10-09T06:24:56.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895c6bb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89540b3430 0x7f89540c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:56.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895c6bb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8954159e10 0x7f89540ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:56.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895c6bb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895415a1e0 0x7f895414b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:56.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895c6bb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89540cfc90 con 0x7f895415a1e0 2023-10-09T06:24:56.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895c6bb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89540cedb0 con 0x7f89540b3430 2023-10-09T06:24:56.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895c6bb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89540cf080 con 0x7f8954159e10 2023-10-09T06:24:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895ac58700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895415a1e0 0x7f895414b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895ac58700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895415a1e0 0x7f895414b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59564/0 (socket says 172.21.15.31:59564) 2023-10-09T06:24:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895ac58700 1 -- 172.21.15.31:0/506907108 learned_addr learned my addr 172.21.15.31:0/506907108 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f8959c56700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8954159e10 0x7f89540ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895a457700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89540b3430 0x7f89540c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895ac58700 1 -- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8954159e10 msgr2=0x7f89540ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895ac58700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8954159e10 0x7f89540ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895ac58700 1 -- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89540b3430 msgr2=0x7f89540c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895ac58700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89540b3430 0x7f89540c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895ac58700 1 -- 172.21.15.31:0/506907108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8948009420 con 0x7f895415a1e0 2023-10-09T06:24:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.243+0000 7f895ac58700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895415a1e0 0x7f895414b1f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f894c00c560 tx=0x7f894c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:56.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.244+0000 7f89527fc700 1 -- 172.21.15.31:0/506907108 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c011590 con 0x7f895415a1e0 2023-10-09T06:24:56.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.244+0000 7f89527fc700 1 -- 172.21.15.31:0/506907108 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c0116f0 con 0x7f895415a1e0 2023-10-09T06:24:56.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.244+0000 7f895c6bb700 1 -- 172.21.15.31:0/506907108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89540cf360 con 0x7f895415a1e0 2023-10-09T06:24:56.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.244+0000 7f89527fc700 1 -- 172.21.15.31:0/506907108 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c011ab0 con 0x7f895415a1e0 2023-10-09T06:24:56.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.244+0000 7f895c6bb700 1 -- 172.21.15.31:0/506907108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89540cf920 con 0x7f895415a1e0 2023-10-09T06:24:56.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.245+0000 7f895c6bb700 1 -- 172.21.15.31:0/506907108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89540cfe00 con 0x7f895415a1e0 2023-10-09T06:24:56.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.245+0000 7f89527fc700 1 -- 172.21.15.31:0/506907108 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f894c01b3b0 con 0x7f895415a1e0 2023-10-09T06:24:56.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.245+0000 7f89527fc700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8940066f60 0x7f8940069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:56.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.246+0000 7f89527fc700 1 -- 172.21.15.31:0/506907108 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f894c0839d0 con 0x7f895415a1e0 2023-10-09T06:24:56.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.246+0000 7f895a457700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8940066f60 0x7f8940069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:56.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.246+0000 7f895a457700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8940066f60 0x7f8940069410 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8944005c50 tx=0x7f8944009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:56.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.250+0000 7f89527fc700 1 -- 172.21.15.31:0/506907108 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f894c050c40 con 0x7f895415a1e0 2023-10-09T06:24:56.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.439+0000 7f895c6bb700 1 -- 172.21.15.31:0/506907108 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f895404c3c0 con 0x7f8940066f60 2023-10-09T06:24:56.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.448+0000 7f89527fc700 1 -- 172.21.15.31:0/506907108 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284651 (secure 0 0 0) 0x7f895404c3c0 con 0x7f8940066f60 2023-10-09T06:24:56.452 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:56.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.452+0000 7f895c6bb700 1 -- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8940066f60 msgr2=0x7f8940069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.452+0000 7f895c6bb700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8940066f60 0x7f8940069410 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8944005c50 tx=0x7f8944009040 comp rx=0 tx=0).stop 2023-10-09T06:24:56.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.452+0000 7f895c6bb700 1 -- 172.21.15.31:0/506907108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895415a1e0 msgr2=0x7f895414b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.452+0000 7f895c6bb700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895415a1e0 0x7f895414b1f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f894c00c560 tx=0x7f894c007ef0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.452+0000 7f895c6bb700 1 -- 172.21.15.31:0/506907108 shutdown_connections 2023-10-09T06:24:56.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.452+0000 7f895c6bb700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8940066f60 0x7f8940069410 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.452+0000 7f895c6bb700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895415a1e0 0x7f895414b1f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.452+0000 7f895c6bb700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89540b3430 0x7f89540c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.452+0000 7f895c6bb700 1 --2- 172.21.15.31:0/506907108 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8954159e10 0x7f89540ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.452+0000 7f895c6bb700 1 -- 172.21.15.31:0/506907108 >> 172.21.15.31:0/506907108 conn(0x7f8954067660 msgr2=0x7f895415a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:56.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.452+0000 7f895c6bb700 1 -- 172.21.15.31:0/506907108 shutdown_connections 2023-10-09T06:24:56.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.452+0000 7f895c6bb700 1 -- 172.21.15.31:0/506907108 wait complete. 2023-10-09T06:24:56.460 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:24:56.465 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2023-10-09T06:24:54.574998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557884,"statfs":{"total":1600000000,"available":1595273948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.601829"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712941+0000","last_change":"2023-10-09T06:24:51.712610+0000","last_active":"2023-10-09T06:24:51.712941+0000","last_peered":"2023-10-09T06:24:51.712941+0000","last_clean":"2023-10-09T06:24:51.712941+0000","last_became_active":"2023-10-09T06:24:51.711605+0000","last_became_peered":"2023-10-09T06:24:51.711605+0000","last_unstale":"2023-10-09T06:24:51.712941+0000","last_undegraded":"2023-10-09T06:24:51.712941+0000","last_fullsized":"2023-10-09T06:24:51.712941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:07.511844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714438+0000","last_change":"2023-10-09T06:24:51.714301+0000","last_active":"2023-10-09T06:24:51.714438+0000","last_peered":"2023-10-09T06:24:51.714438+0000","last_clean":"2023-10-09T06:24:51.714438+0000","last_became_active":"2023-10-09T06:24:51.713911+0000","last_became_peered":"2023-10-09T06:24:51.713911+0000","last_unstale":"2023-10-09T06:24:51.714438+0000","last_undegraded":"2023-10-09T06:24:51.714438+0000","last_fullsized":"2023-10-09T06:24:51.714438+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:07.518873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714695+0000","last_change":"2023-10-09T06:24:51.714695+0000","last_active":"2023-10-09T06:24:51.714695+0000","last_peered":"2023-10-09T06:24:51.714695+0000","last_clean":"2023-10-09T06:24:51.714695+0000","last_became_active":"2023-10-09T06:24:51.714467+0000","last_became_peered":"2023-10-09T06:24:51.714467+0000","last_unstale":"2023-10-09T06:24:51.714695+0000","last_undegraded":"2023-10-09T06:24:51.714695+0000","last_fullsized":"2023-10-09T06:24:51.714695+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:32.424213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715992+0000","last_change":"2023-10-09T06:24:51.715992+0000","last_active":"2023-10-09T06:24:51.715992+0000","last_peered":"2023-10-09T06:24:51.715992+0000","last_clean":"2023-10-09T06:24:51.715992+0000","last_became_active":"2023-10-09T06:24:51.715787+0000","last_became_peered":"2023-10-09T06:24:51.715787+0000","last_unstale":"2023-10-09T06:24:51.715992+0000","last_undegraded":"2023-10-09T06:24:51.715992+0000","last_fullsized":"2023-10-09T06:24:51.715992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:36:15.597805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713492+0000","last_change":"2023-10-09T06:24:51.713492+0000","last_active":"2023-10-09T06:24:51.713492+0000","last_peered":"2023-10-09T06:24:51.713492+0000","last_clean":"2023-10-09T06:24:51.713492+0000","last_became_active":"2023-10-09T06:24:51.713065+0000","last_became_peered":"2023-10-09T06:24:51.713065+0000","last_unstale":"2023-10-09T06:24:51.713492+0000","last_undegraded":"2023-10-09T06:24:51.713492+0000","last_fullsized":"2023-10-09T06:24:51.713492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:43.723406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713277+0000","last_change":"2023-10-09T06:24:51.712645+0000","last_active":"2023-10-09T06:24:51.713277+0000","last_peered":"2023-10-09T06:24:51.713277+0000","last_clean":"2023-10-09T06:24:51.713277+0000","last_became_active":"2023-10-09T06:24:51.712417+0000","last_became_peered":"2023-10-09T06:24:51.712417+0000","last_unstale":"2023-10-09T06:24:51.713277+0000","last_undegraded":"2023-10-09T06:24:51.713277+0000","last_fullsized":"2023-10-09T06:24:51.713277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:34:07.441514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715209+0000","last_change":"2023-10-09T06:24:51.715209+0000","last_active":"2023-10-09T06:24:51.715209+0000","last_peered":"2023-10-09T06:24:51.715209+0000","last_clean":"2023-10-09T06:24:51.715209+0000","last_became_active":"2023-10-09T06:24:51.714484+0000","last_became_peered":"2023-10-09T06:24:51.714484+0000","last_unstale":"2023-10-09T06:24:51.715209+0000","last_undegraded":"2023-10-09T06:24:51.715209+0000","last_fullsized":"2023-10-09T06:24:51.715209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:47:03.419308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.718895+0000","last_change":"2023-10-09T06:24:51.718441+0000","last_active":"2023-10-09T06:24:51.718895+0000","last_peered":"2023-10-09T06:24:51.718895+0000","last_clean":"2023-10-09T06:24:51.718895+0000","last_became_active":"2023-10-09T06:24:51.718212+0000","last_became_peered":"2023-10-09T06:24:51.718212+0000","last_unstale":"2023-10-09T06:24:51.718895+0000","last_undegraded":"2023-10-09T06:24:51.718895+0000","last_fullsized":"2023-10-09T06:24:51.718895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:15.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.709192+0000","last_change":"2023-10-09T06:24:51.709192+0000","last_active":"2023-10-09T06:24:51.709192+0000","last_peered":"2023-10-09T06:24:51.709192+0000","last_clean":"2023-10-09T06:24:51.709192+0000","last_became_active":"2023-10-09T06:24:51.709010+0000","last_became_peered":"2023-10-09T06:24:51.709010+0000","last_unstale":"2023-10-09T06:24:51.709192+0000","last_undegraded":"2023-10-09T06:24:51.709192+0000","last_fullsized":"2023-10-09T06:24:51.709192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:14.944717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.716749+0000","last_change":"2023-10-09T06:24:51.716749+0000","last_active":"2023-10-09T06:24:51.716749+0000","last_peered":"2023-10-09T06:24:51.716749+0000","last_clean":"2023-10-09T06:24:51.716749+0000","last_became_active":"2023-10-09T06:24:51.715838+0000","last_became_peered":"2023-10-09T06:24:51.715838+0000","last_unstale":"2023-10-09T06:24:51.716749+0000","last_undegraded":"2023-10-09T06:24:51.716749+0000","last_fullsized":"2023-10-09T06:24:51.716749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:56.150163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715363+0000","last_change":"2023-10-09T06:24:51.715310+0000","last_active":"2023-10-09T06:24:51.715363+0000","last_peered":"2023-10-09T06:24:51.715363+0000","last_clean":"2023-10-09T06:24:51.715363+0000","last_became_active":"2023-10-09T06:24:51.715035+0000","last_became_peered":"2023-10-09T06:24:51.715035+0000","last_unstale":"2023-10-09T06:24:51.715363+0000","last_undegraded":"2023-10-09T06:24:51.715363+0000","last_fullsized":"2023-10-09T06:24:51.715363+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:28.833123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711743+0000","last_change":"2023-10-09T06:24:51.711743+0000","last_active":"2023-10-09T06:24:51.711743+0000","last_peered":"2023-10-09T06:24:51.711743+0000","last_clean":"2023-10-09T06:24:51.711743+0000","last_became_active":"2023-10-09T06:24:51.710477+0000","last_became_peered":"2023-10-09T06:24:51.710477+0000","last_unstale":"2023-10-09T06:24:51.711743+0000","last_undegraded":"2023-10-09T06:24:51.711743+0000","last_fullsized":"2023-10-09T06:24:51.711743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:59.141284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714553+0000","last_change":"2023-10-09T06:24:51.714492+0000","last_active":"2023-10-09T06:24:51.714553+0000","last_peered":"2023-10-09T06:24:51.714553+0000","last_clean":"2023-10-09T06:24:51.714553+0000","last_became_active":"2023-10-09T06:24:51.714121+0000","last_became_peered":"2023-10-09T06:24:51.714121+0000","last_unstale":"2023-10-09T06:24:51.714553+0000","last_undegraded":"2023-10-09T06:24:51.714553+0000","last_fullsized":"2023-10-09T06:24:51.714553+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:28:08.421921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.709932+0000","last_change":"2023-10-09T06:24:51.709932+0000","last_active":"2023-10-09T06:24:51.709932+0000","last_peered":"2023-10-09T06:24:51.709932+0000","last_clean":"2023-10-09T06:24:51.709932+0000","last_became_active":"2023-10-09T06:24:51.709704+0000","last_became_peered":"2023-10-09T06:24:51.709704+0000","last_unstale":"2023-10-09T06:24:51.709932+0000","last_undegraded":"2023-10-09T06:24:51.709932+0000","last_fullsized":"2023-10-09T06:24:51.709932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:30.094243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712426+0000","last_change":"2023-10-09T06:24:51.712197+0000","last_active":"2023-10-09T06:24:51.712426+0000","last_peered":"2023-10-09T06:24:51.712426+0000","last_clean":"2023-10-09T06:24:51.712426+0000","last_became_active":"2023-10-09T06:24:51.711940+0000","last_became_peered":"2023-10-09T06:24:51.711940+0000","last_unstale":"2023-10-09T06:24:51.712426+0000","last_undegraded":"2023-10-09T06:24:51.712426+0000","last_fullsized":"2023-10-09T06:24:51.712426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:18:51.061585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713789+0000","last_change":"2023-10-09T06:24:51.713789+0000","last_active":"2023-10-09T06:24:51.713789+0000","last_peered":"2023-10-09T06:24:51.713789+0000","last_clean":"2023-10-09T06:24:51.713789+0000","last_became_active":"2023-10-09T06:24:51.713377+0000","last_became_peered":"2023-10-09T06:24:51.713377+0000","last_unstale":"2023-10-09T06:24:51.713789+0000","last_undegraded":"2023-10-09T06:24:51.713789+0000","last_fullsized":"2023-10-09T06:24:51.713789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:40:10.941098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711762+0000","last_change":"2023-10-09T06:24:51.711762+0000","last_active":"2023-10-09T06:24:51.711762+0000","last_peered":"2023-10-09T06:24:51.711762+0000","last_clean":"2023-10-09T06:24:51.711762+0000","last_became_active":"2023-10-09T06:24:51.711043+0000","last_became_peered":"2023-10-09T06:24:51.711043+0000","last_unstale":"2023-10-09T06:24:51.711762+0000","last_undegraded":"2023-10-09T06:24:51.711762+0000","last_fullsized":"2023-10-09T06:24:51.711762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:14:57.347200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.716599+0000","last_change":"2023-10-09T06:24:51.716599+0000","last_active":"2023-10-09T06:24:51.716599+0000","last_peered":"2023-10-09T06:24:51.716599+0000","last_clean":"2023-10-09T06:24:51.716599+0000","last_became_active":"2023-10-09T06:24:51.716301+0000","last_became_peered":"2023-10-09T06:24:51.716301+0000","last_unstale":"2023-10-09T06:24:51.716599+0000","last_undegraded":"2023-10-09T06:24:51.716599+0000","last_fullsized":"2023-10-09T06:24:51.716599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:32.473331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.719258+0000","last_change":"2023-10-09T06:24:51.719194+0000","last_active":"2023-10-09T06:24:51.719258+0000","last_peered":"2023-10-09T06:24:51.719258+0000","last_clean":"2023-10-09T06:24:51.719258+0000","last_became_active":"2023-10-09T06:24:51.718395+0000","last_became_peered":"2023-10-09T06:24:51.718395+0000","last_unstale":"2023-10-09T06:24:51.719258+0000","last_undegraded":"2023-10-09T06:24:51.719258+0000","last_fullsized":"2023-10-09T06:24:51.719258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:45.060045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715195+0000","last_change":"2023-10-09T06:24:51.715133+0000","last_active":"2023-10-09T06:24:51.715195+0000","last_peered":"2023-10-09T06:24:51.715195+0000","last_clean":"2023-10-09T06:24:51.715195+0000","last_became_active":"2023-10-09T06:24:51.714885+0000","last_became_peered":"2023-10-09T06:24:51.714885+0000","last_unstale":"2023-10-09T06:24:51.715195+0000","last_undegraded":"2023-10-09T06:24:51.715195+0000","last_fullsized":"2023-10-09T06:24:51.715195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:26:56.338821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713004+0000","last_change":"2023-10-09T06:24:51.713004+0000","last_active":"2023-10-09T06:24:51.713004+0000","last_peered":"2023-10-09T06:24:51.713004+0000","last_clean":"2023-10-09T06:24:51.713004+0000","last_became_active":"2023-10-09T06:24:51.712695+0000","last_became_peered":"2023-10-09T06:24:51.712695+0000","last_unstale":"2023-10-09T06:24:51.713004+0000","last_undegraded":"2023-10-09T06:24:51.713004+0000","last_fullsized":"2023-10-09T06:24:51.713004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:07.518873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712250+0000","last_change":"2023-10-09T06:24:51.712250+0000","last_active":"2023-10-09T06:24:51.712250+0000","last_peered":"2023-10-09T06:24:51.712250+0000","last_clean":"2023-10-09T06:24:51.712250+0000","last_became_active":"2023-10-09T06:24:51.711998+0000","last_became_peered":"2023-10-09T06:24:51.711998+0000","last_unstale":"2023-10-09T06:24:51.712250+0000","last_undegraded":"2023-10-09T06:24:51.712250+0000","last_fullsized":"2023-10-09T06:24:51.712250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:34:07.441514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714466+0000","last_change":"2023-10-09T06:24:51.713873+0000","last_active":"2023-10-09T06:24:51.714466+0000","last_peered":"2023-10-09T06:24:51.714466+0000","last_clean":"2023-10-09T06:24:51.714466+0000","last_became_active":"2023-10-09T06:24:51.713627+0000","last_became_peered":"2023-10-09T06:24:51.713627+0000","last_unstale":"2023-10-09T06:24:51.714466+0000","last_undegraded":"2023-10-09T06:24:51.714466+0000","last_fullsized":"2023-10-09T06:24:51.714466+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:27:49.485618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714793+0000","last_change":"2023-10-09T06:24:51.714608+0000","last_active":"2023-10-09T06:24:51.714793+0000","last_peered":"2023-10-09T06:24:51.714793+0000","last_clean":"2023-10-09T06:24:51.714793+0000","last_became_active":"2023-10-09T06:24:51.714363+0000","last_became_peered":"2023-10-09T06:24:51.714363+0000","last_unstale":"2023-10-09T06:24:51.714793+0000","last_undegraded":"2023-10-09T06:24:51.714793+0000","last_fullsized":"2023-10-09T06:24:51.714793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:32.424213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.717044+0000","last_change":"2023-10-09T06:24:51.717044+0000","last_active":"2023-10-09T06:24:51.717044+0000","last_peered":"2023-10-09T06:24:51.717044+0000","last_clean":"2023-10-09T06:24:51.717044+0000","last_became_active":"2023-10-09T06:24:51.716343+0000","last_became_peered":"2023-10-09T06:24:51.716343+0000","last_unstale":"2023-10-09T06:24:51.717044+0000","last_undegraded":"2023-10-09T06:24:51.717044+0000","last_fullsized":"2023-10-09T06:24:51.717044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:54.441056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.719366+0000","last_change":"2023-10-09T06:24:51.719366+0000","last_active":"2023-10-09T06:24:51.719366+0000","last_peered":"2023-10-09T06:24:51.719366+0000","last_clean":"2023-10-09T06:24:51.719366+0000","last_became_active":"2023-10-09T06:24:51.719078+0000","last_became_peered":"2023-10-09T06:24:51.719078+0000","last_unstale":"2023-10-09T06:24:51.719366+0000","last_undegraded":"2023-10-09T06:24:51.719366+0000","last_fullsized":"2023-10-09T06:24:51.719366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:08.419115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.710248+0000","last_change":"2023-10-09T06:24:51.710248+0000","last_active":"2023-10-09T06:24:51.710248+0000","last_peered":"2023-10-09T06:24:51.710248+0000","last_clean":"2023-10-09T06:24:51.710248+0000","last_became_active":"2023-10-09T06:24:51.708899+0000","last_became_peered":"2023-10-09T06:24:51.708899+0000","last_unstale":"2023-10-09T06:24:51.710248+0000","last_undegraded":"2023-10-09T06:24:51.710248+0000","last_fullsized":"2023-10-09T06:24:51.710248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:57.845175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.710115+0000","last_change":"2023-10-09T06:24:51.710115+0000","last_active":"2023-10-09T06:24:51.710115+0000","last_peered":"2023-10-09T06:24:51.710115+0000","last_clean":"2023-10-09T06:24:51.710115+0000","last_became_active":"2023-10-09T06:24:51.709882+0000","last_became_peered":"2023-10-09T06:24:51.709882+0000","last_unstale":"2023-10-09T06:24:51.710115+0000","last_undegraded":"2023-10-09T06:24:51.710115+0000","last_fullsized":"2023-10-09T06:24:51.710115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:28:07.814854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.709291+0000","last_change":"2023-10-09T06:24:51.709291+0000","last_active":"2023-10-09T06:24:51.709291+0000","last_peered":"2023-10-09T06:24:51.709291+0000","last_clean":"2023-10-09T06:24:51.709291+0000","last_became_active":"2023-10-09T06:24:51.709068+0000","last_became_peered":"2023-10-09T06:24:51.709068+0000","last_unstale":"2023-10-09T06:24:51.709291+0000","last_undegraded":"2023-10-09T06:24:51.709291+0000","last_fullsized":"2023-10-09T06:24:51.709291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:43.181797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.717986+0000","last_change":"2023-10-09T06:24:51.717986+0000","last_active":"2023-10-09T06:24:51.717986+0000","last_peered":"2023-10-09T06:24:51.717986+0000","last_clean":"2023-10-09T06:24:51.717986+0000","last_became_active":"2023-10-09T06:24:51.717784+0000","last_became_peered":"2023-10-09T06:24:51.717784+0000","last_unstale":"2023-10-09T06:24:51.717986+0000","last_undegraded":"2023-10-09T06:24:51.717986+0000","last_fullsized":"2023-10-09T06:24:51.717986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:40:10.941098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715085+0000","last_change":"2023-10-09T06:24:51.715085+0000","last_active":"2023-10-09T06:24:51.715085+0000","last_peered":"2023-10-09T06:24:51.715085+0000","last_clean":"2023-10-09T06:24:51.715085+0000","last_became_active":"2023-10-09T06:24:51.714823+0000","last_became_peered":"2023-10-09T06:24:51.714823+0000","last_unstale":"2023-10-09T06:24:51.715085+0000","last_undegraded":"2023-10-09T06:24:51.715085+0000","last_fullsized":"2023-10-09T06:24:51.715085+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:00:42.826134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714421+0000","last_change":"2023-10-09T06:24:51.714157+0000","last_active":"2023-10-09T06:24:51.714421+0000","last_peered":"2023-10-09T06:24:51.714421+0000","last_clean":"2023-10-09T06:24:51.714421+0000","last_became_active":"2023-10-09T06:24:51.713579+0000","last_became_peered":"2023-10-09T06:24:51.713579+0000","last_unstale":"2023-10-09T06:24:51.714421+0000","last_undegraded":"2023-10-09T06:24:51.714421+0000","last_fullsized":"2023-10-09T06:24:51.714421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:45.876940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712926+0000","last_change":"2023-10-09T06:24:51.712539+0000","last_active":"2023-10-09T06:24:51.712926+0000","last_peered":"2023-10-09T06:24:51.712926+0000","last_clean":"2023-10-09T06:24:51.712926+0000","last_became_active":"2023-10-09T06:24:51.712315+0000","last_became_peered":"2023-10-09T06:24:51.712315+0000","last_unstale":"2023-10-09T06:24:51.712926+0000","last_undegraded":"2023-10-09T06:24:51.712926+0000","last_fullsized":"2023-10-09T06:24:51.712926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:43.181797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"83'4","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.982411+0000","last_change":"2023-10-09T06:24:50.981287+0000","last_active":"2023-10-09T06:24:51.982411+0000","last_peered":"2023-10-09T06:24:51.982411+0000","last_clean":"2023-10-09T06:24:51.982411+0000","last_became_active":"2023-10-09T06:24:50.981024+0000","last_became_peered":"2023-10-09T06:24:50.981024+0000","last_unstale":"2023-10-09T06:24:51.982411+0000","last_undegraded":"2023-10-09T06:24:51.982411+0000","last_fullsized":"2023-10-09T06:24:51.982411+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:44.055527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712864+0000","last_change":"2023-10-09T06:24:51.712864+0000","last_active":"2023-10-09T06:24:51.712864+0000","last_peered":"2023-10-09T06:24:51.712864+0000","last_clean":"2023-10-09T06:24:51.712864+0000","last_became_active":"2023-10-09T06:24:51.712745+0000","last_became_peered":"2023-10-09T06:24:51.712745+0000","last_unstale":"2023-10-09T06:24:51.712864+0000","last_undegraded":"2023-10-09T06:24:51.712864+0000","last_fullsized":"2023-10-09T06:24:51.712864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:54:53.170200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.981967+0000","last_change":"2023-10-09T06:24:50.976818+0000","last_active":"2023-10-09T06:24:51.981967+0000","last_peered":"2023-10-09T06:24:51.981967+0000","last_clean":"2023-10-09T06:24:51.981967+0000","last_became_active":"2023-10-09T06:24:50.976562+0000","last_became_peered":"2023-10-09T06:24:50.976562+0000","last_unstale":"2023-10-09T06:24:51.981967+0000","last_undegraded":"2023-10-09T06:24:51.981967+0000","last_fullsized":"2023-10-09T06:24:51.981967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:06.514355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.717866+0000","last_change":"2023-10-09T06:24:51.717758+0000","last_active":"2023-10-09T06:24:51.717866+0000","last_peered":"2023-10-09T06:24:51.717866+0000","last_clean":"2023-10-09T06:24:51.717866+0000","last_became_active":"2023-10-09T06:24:51.717056+0000","last_became_peered":"2023-10-09T06:24:51.717056+0000","last_unstale":"2023-10-09T06:24:51.717866+0000","last_undegraded":"2023-10-09T06:24:51.717866+0000","last_fullsized":"2023-10-09T06:24:51.717866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:56.150163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.982581+0000","last_change":"2023-10-09T06:24:50.982438+0000","last_active":"2023-10-09T06:24:51.982581+0000","last_peered":"2023-10-09T06:24:51.982581+0000","last_clean":"2023-10-09T06:24:51.982581+0000","last_became_active":"2023-10-09T06:24:50.981576+0000","last_became_peered":"2023-10-09T06:24:50.981576+0000","last_unstale":"2023-10-09T06:24:51.982581+0000","last_undegraded":"2023-10-09T06:24:51.982581+0000","last_fullsized":"2023-10-09T06:24:51.982581+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:58.136766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714485+0000","last_change":"2023-10-09T06:24:51.714203+0000","last_active":"2023-10-09T06:24:51.714485+0000","last_peered":"2023-10-09T06:24:51.714485+0000","last_clean":"2023-10-09T06:24:51.714485+0000","last_became_active":"2023-10-09T06:24:51.713950+0000","last_became_peered":"2023-10-09T06:24:51.713950+0000","last_unstale":"2023-10-09T06:24:51.714485+0000","last_undegraded":"2023-10-09T06:24:51.714485+0000","last_fullsized":"2023-10-09T06:24:51.714485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:08.128479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.982140+0000","last_change":"2023-10-09T06:24:50.981025+0000","last_active":"2023-10-09T06:24:51.982140+0000","last_peered":"2023-10-09T06:24:51.982140+0000","last_clean":"2023-10-09T06:24:51.982140+0000","last_became_active":"2023-10-09T06:24:50.980230+0000","last_became_peered":"2023-10-09T06:24:50.980230+0000","last_unstale":"2023-10-09T06:24:51.982140+0000","last_undegraded":"2023-10-09T06:24:51.982140+0000","last_fullsized":"2023-10-09T06:24:51.982140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:05:46.582288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715233+0000","last_change":"2023-10-09T06:24:51.715233+0000","last_active":"2023-10-09T06:24:51.715233+0000","last_peered":"2023-10-09T06:24:51.715233+0000","last_clean":"2023-10-09T06:24:51.715233+0000","last_became_active":"2023-10-09T06:24:51.714756+0000","last_became_peered":"2023-10-09T06:24:51.714756+0000","last_unstale":"2023-10-09T06:24:51.715233+0000","last_undegraded":"2023-10-09T06:24:51.715233+0000","last_fullsized":"2023-10-09T06:24:51.715233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:18:51.061585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.706646+0000","last_change":"2023-10-09T06:24:50.982346+0000","last_active":"2023-10-09T06:24:51.706646+0000","last_peered":"2023-10-09T06:24:51.706646+0000","last_clean":"2023-10-09T06:24:51.706646+0000","last_became_active":"2023-10-09T06:24:50.982098+0000","last_became_peered":"2023-10-09T06:24:50.982098+0000","last_unstale":"2023-10-09T06:24:51.706646+0000","last_undegraded":"2023-10-09T06:24:51.706646+0000","last_fullsized":"2023-10-09T06:24:51.706646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:26.340147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.710854+0000","last_change":"2023-10-09T06:24:51.710854+0000","last_active":"2023-10-09T06:24:51.710854+0000","last_peered":"2023-10-09T06:24:51.710854+0000","last_clean":"2023-10-09T06:24:51.710854+0000","last_became_active":"2023-10-09T06:24:51.708868+0000","last_became_peered":"2023-10-09T06:24:51.708868+0000","last_unstale":"2023-10-09T06:24:51.710854+0000","last_undegraded":"2023-10-09T06:24:51.710854+0000","last_fullsized":"2023-10-09T06:24:51.710854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:45.060045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.985092+0000","last_change":"2023-10-09T06:24:50.978858+0000","last_active":"2023-10-09T06:24:51.985092+0000","last_peered":"2023-10-09T06:24:51.985092+0000","last_clean":"2023-10-09T06:24:51.985092+0000","last_became_active":"2023-10-09T06:24:50.978414+0000","last_became_peered":"2023-10-09T06:24:50.978414+0000","last_unstale":"2023-10-09T06:24:51.985092+0000","last_undegraded":"2023-10-09T06:24:51.985092+0000","last_fullsized":"2023-10-09T06:24:51.985092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:05:49.345235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711960+0000","last_change":"2023-10-09T06:24:51.711960+0000","last_active":"2023-10-09T06:24:51.711960+0000","last_peered":"2023-10-09T06:24:51.711960+0000","last_clean":"2023-10-09T06:24:51.711960+0000","last_became_active":"2023-10-09T06:24:51.711748+0000","last_became_peered":"2023-10-09T06:24:51.711748+0000","last_unstale":"2023-10-09T06:24:51.711960+0000","last_undegraded":"2023-10-09T06:24:51.711960+0000","last_fullsized":"2023-10-09T06:24:51.711960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:49.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.979385+0000","last_change":"2023-10-09T06:24:50.979315+0000","last_active":"2023-10-09T06:24:50.979385+0000","last_peered":"2023-10-09T06:24:50.979385+0000","last_clean":"2023-10-09T06:24:50.979385+0000","last_became_active":"2023-10-09T06:24:50.978837+0000","last_became_peered":"2023-10-09T06:24:50.978837+0000","last_unstale":"2023-10-09T06:24:50.979385+0000","last_undegraded":"2023-10-09T06:24:50.979385+0000","last_fullsized":"2023-10-09T06:24:50.979385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:29.089725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715316+0000","last_change":"2023-10-09T06:24:51.715266+0000","last_active":"2023-10-09T06:24:51.715316+0000","last_peered":"2023-10-09T06:24:51.715316+0000","last_clean":"2023-10-09T06:24:51.715316+0000","last_became_active":"2023-10-09T06:24:51.715097+0000","last_became_peered":"2023-10-09T06:24:51.715097+0000","last_unstale":"2023-10-09T06:24:51.715316+0000","last_undegraded":"2023-10-09T06:24:51.715316+0000","last_fullsized":"2023-10-09T06:24:51.715316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:47:09.038465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.981865+0000","last_change":"2023-10-09T06:24:50.981728+0000","last_active":"2023-10-09T06:24:50.981865+0000","last_peered":"2023-10-09T06:24:50.981865+0000","last_clean":"2023-10-09T06:24:50.981865+0000","last_became_active":"2023-10-09T06:24:50.981500+0000","last_became_peered":"2023-10-09T06:24:50.981500+0000","last_unstale":"2023-10-09T06:24:50.981865+0000","last_undegraded":"2023-10-09T06:24:50.981865+0000","last_fullsized":"2023-10-09T06:24:50.981865+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:22.499841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715343+0000","last_change":"2023-10-09T06:24:51.715343+0000","last_active":"2023-10-09T06:24:51.715343+0000","last_peered":"2023-10-09T06:24:51.715343+0000","last_clean":"2023-10-09T06:24:51.715343+0000","last_became_active":"2023-10-09T06:24:51.714815+0000","last_became_peered":"2023-10-09T06:24:51.714815+0000","last_unstale":"2023-10-09T06:24:51.715343+0000","last_undegraded":"2023-10-09T06:24:51.715343+0000","last_fullsized":"2023-10-09T06:24:51.715343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:25.572722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.979327+0000","last_change":"2023-10-09T06:24:50.979243+0000","last_active":"2023-10-09T06:24:50.979327+0000","last_peered":"2023-10-09T06:24:50.979327+0000","last_clean":"2023-10-09T06:24:50.979327+0000","last_became_active":"2023-10-09T06:24:50.979003+0000","last_became_peered":"2023-10-09T06:24:50.979003+0000","last_unstale":"2023-10-09T06:24:50.979327+0000","last_undegraded":"2023-10-09T06:24:50.979327+0000","last_fullsized":"2023-10-09T06:24:50.979327+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:51.733742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715261+0000","last_change":"2023-10-09T06:24:51.715204+0000","last_active":"2023-10-09T06:24:51.715261+0000","last_peered":"2023-10-09T06:24:51.715261+0000","last_clean":"2023-10-09T06:24:51.715261+0000","last_became_active":"2023-10-09T06:24:51.714692+0000","last_became_peered":"2023-10-09T06:24:51.714692+0000","last_unstale":"2023-10-09T06:24:51.715261+0000","last_undegraded":"2023-10-09T06:24:51.715261+0000","last_fullsized":"2023-10-09T06:24:51.715261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:46.459314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.705909+0000","last_change":"2023-10-09T06:24:50.983806+0000","last_active":"2023-10-09T06:24:51.705909+0000","last_peered":"2023-10-09T06:24:51.705909+0000","last_clean":"2023-10-09T06:24:51.705909+0000","last_became_active":"2023-10-09T06:24:50.983602+0000","last_became_peered":"2023-10-09T06:24:50.983602+0000","last_unstale":"2023-10-09T06:24:51.705909+0000","last_undegraded":"2023-10-09T06:24:51.705909+0000","last_fullsized":"2023-10-09T06:24:51.705909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:15.554739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713861+0000","last_change":"2023-10-09T06:24:51.713654+0000","last_active":"2023-10-09T06:24:51.713861+0000","last_peered":"2023-10-09T06:24:51.713861+0000","last_clean":"2023-10-09T06:24:51.713861+0000","last_became_active":"2023-10-09T06:24:51.713332+0000","last_became_peered":"2023-10-09T06:24:51.713332+0000","last_unstale":"2023-10-09T06:24:51.713861+0000","last_undegraded":"2023-10-09T06:24:51.713861+0000","last_fullsized":"2023-10-09T06:24:51.713861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:40:10.941098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"83'3","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.981043+0000","last_change":"2023-10-09T06:24:50.982935+0000","last_active":"2023-10-09T06:24:51.981043+0000","last_peered":"2023-10-09T06:24:51.981043+0000","last_clean":"2023-10-09T06:24:51.981043+0000","last_became_active":"2023-10-09T06:24:50.982702+0000","last_became_peered":"2023-10-09T06:24:50.982702+0000","last_unstale":"2023-10-09T06:24:51.981043+0000","last_undegraded":"2023-10-09T06:24:51.981043+0000","last_fullsized":"2023-10-09T06:24:51.981043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:58.948953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.710614+0000","last_change":"2023-10-09T06:24:51.710614+0000","last_active":"2023-10-09T06:24:51.710614+0000","last_peered":"2023-10-09T06:24:51.710614+0000","last_clean":"2023-10-09T06:24:51.710614+0000","last_became_active":"2023-10-09T06:24:51.710091+0000","last_became_peered":"2023-10-09T06:24:51.710091+0000","last_unstale":"2023-10-09T06:24:51.710614+0000","last_undegraded":"2023-10-09T06:24:51.710614+0000","last_fullsized":"2023-10-09T06:24:51.710614+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:54:12.530891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"83'6","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.981569+0000","last_change":"2023-10-09T06:24:50.982738+0000","last_active":"2023-10-09T06:24:51.981569+0000","last_peered":"2023-10-09T06:24:51.981569+0000","last_clean":"2023-10-09T06:24:51.981569+0000","last_became_active":"2023-10-09T06:24:50.982483+0000","last_became_peered":"2023-10-09T06:24:50.982483+0000","last_unstale":"2023-10-09T06:24:51.981569+0000","last_undegraded":"2023-10-09T06:24:51.981569+0000","last_fullsized":"2023-10-09T06:24:51.981569+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:13.940199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712977+0000","last_change":"2023-10-09T06:24:51.712755+0000","last_active":"2023-10-09T06:24:51.712977+0000","last_peered":"2023-10-09T06:24:51.712977+0000","last_clean":"2023-10-09T06:24:51.712977+0000","last_became_active":"2023-10-09T06:24:51.711914+0000","last_became_peered":"2023-10-09T06:24:51.711914+0000","last_unstale":"2023-10-09T06:24:51.712977+0000","last_undegraded":"2023-10-09T06:24:51.712977+0000","last_fullsized":"2023-10-09T06:24:51.712977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:35:51.976193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.981854+0000","last_change":"2023-10-09T06:24:50.978593+0000","last_active":"2023-10-09T06:24:51.981854+0000","last_peered":"2023-10-09T06:24:51.981854+0000","last_clean":"2023-10-09T06:24:51.981854+0000","last_became_active":"2023-10-09T06:24:50.978277+0000","last_became_peered":"2023-10-09T06:24:50.978277+0000","last_unstale":"2023-10-09T06:24:51.981854+0000","last_undegraded":"2023-10-09T06:24:51.981854+0000","last_fullsized":"2023-10-09T06:24:51.981854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:05:46.582288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713196+0000","last_change":"2023-10-09T06:24:51.713196+0000","last_active":"2023-10-09T06:24:51.713196+0000","last_peered":"2023-10-09T06:24:51.713196+0000","last_clean":"2023-10-09T06:24:51.713196+0000","last_became_active":"2023-10-09T06:24:51.712971+0000","last_became_peered":"2023-10-09T06:24:51.712971+0000","last_unstale":"2023-10-09T06:24:51.713196+0000","last_undegraded":"2023-10-09T06:24:51.713196+0000","last_fullsized":"2023-10-09T06:24:51.713196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:28:08.421921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.706892+0000","last_change":"2023-10-09T06:24:50.984393+0000","last_active":"2023-10-09T06:24:51.706892+0000","last_peered":"2023-10-09T06:24:51.706892+0000","last_clean":"2023-10-09T06:24:51.706892+0000","last_became_active":"2023-10-09T06:24:50.984167+0000","last_became_peered":"2023-10-09T06:24:50.984167+0000","last_unstale":"2023-10-09T06:24:51.706892+0000","last_undegraded":"2023-10-09T06:24:51.706892+0000","last_fullsized":"2023-10-09T06:24:51.706892+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:42.718888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714384+0000","last_change":"2023-10-09T06:24:51.714328+0000","last_active":"2023-10-09T06:24:51.714384+0000","last_peered":"2023-10-09T06:24:51.714384+0000","last_clean":"2023-10-09T06:24:51.714384+0000","last_became_active":"2023-10-09T06:24:51.713799+0000","last_became_peered":"2023-10-09T06:24:51.713799+0000","last_unstale":"2023-10-09T06:24:51.714384+0000","last_undegraded":"2023-10-09T06:24:51.714384+0000","last_fullsized":"2023-10-09T06:24:51.714384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:00:42.826134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.980772+0000","last_change":"2023-10-09T06:24:50.980695+0000","last_active":"2023-10-09T06:24:50.980772+0000","last_peered":"2023-10-09T06:24:50.980772+0000","last_clean":"2023-10-09T06:24:50.980772+0000","last_became_active":"2023-10-09T06:24:50.980416+0000","last_became_peered":"2023-10-09T06:24:50.980416+0000","last_unstale":"2023-10-09T06:24:50.980772+0000","last_undegraded":"2023-10-09T06:24:50.980772+0000","last_fullsized":"2023-10-09T06:24:50.980772+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:14.874167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711902+0000","last_change":"2023-10-09T06:24:51.711902+0000","last_active":"2023-10-09T06:24:51.711902+0000","last_peered":"2023-10-09T06:24:51.711902+0000","last_clean":"2023-10-09T06:24:51.711902+0000","last_became_active":"2023-10-09T06:24:51.711292+0000","last_became_peered":"2023-10-09T06:24:51.711292+0000","last_unstale":"2023-10-09T06:24:51.711902+0000","last_undegraded":"2023-10-09T06:24:51.711902+0000","last_fullsized":"2023-10-09T06:24:51.711902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:54.465881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"83'8","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.983255+0000","last_change":"2023-10-09T06:24:50.985550+0000","last_active":"2023-10-09T06:24:51.983255+0000","last_peered":"2023-10-09T06:24:51.983255+0000","last_clean":"2023-10-09T06:24:51.983255+0000","last_became_active":"2023-10-09T06:24:50.985238+0000","last_became_peered":"2023-10-09T06:24:50.985238+0000","last_unstale":"2023-10-09T06:24:51.983255+0000","last_undegraded":"2023-10-09T06:24:51.983255+0000","last_fullsized":"2023-10-09T06:24:51.983255+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:46.495942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711825+0000","last_change":"2023-10-09T06:24:51.711825+0000","last_active":"2023-10-09T06:24:51.711825+0000","last_peered":"2023-10-09T06:24:51.711825+0000","last_clean":"2023-10-09T06:24:51.711825+0000","last_became_active":"2023-10-09T06:24:51.710694+0000","last_became_peered":"2023-10-09T06:24:51.710694+0000","last_unstale":"2023-10-09T06:24:51.711825+0000","last_undegraded":"2023-10-09T06:24:51.711825+0000","last_fullsized":"2023-10-09T06:24:51.711825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:38.679141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.982134+0000","last_change":"2023-10-09T06:24:50.985919+0000","last_active":"2023-10-09T06:24:51.982134+0000","last_peered":"2023-10-09T06:24:51.982134+0000","last_clean":"2023-10-09T06:24:51.982134+0000","last_became_active":"2023-10-09T06:24:50.984897+0000","last_became_peered":"2023-10-09T06:24:50.984897+0000","last_unstale":"2023-10-09T06:24:51.982134+0000","last_undegraded":"2023-10-09T06:24:51.982134+0000","last_fullsized":"2023-10-09T06:24:51.982134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:43:44.959165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.708474+0000","last_change":"2023-10-09T06:24:51.708405+0000","last_active":"2023-10-09T06:24:51.708474+0000","last_peered":"2023-10-09T06:24:51.708474+0000","last_clean":"2023-10-09T06:24:51.708474+0000","last_became_active":"2023-10-09T06:24:51.708161+0000","last_became_peered":"2023-10-09T06:24:51.708161+0000","last_unstale":"2023-10-09T06:24:51.708474+0000","last_undegraded":"2023-10-09T06:24:51.708474+0000","last_fullsized":"2023-10-09T06:24:51.708474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:59.953471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.982989+0000","last_change":"2023-10-09T06:24:50.982330+0000","last_active":"2023-10-09T06:24:51.982989+0000","last_peered":"2023-10-09T06:24:51.982989+0000","last_clean":"2023-10-09T06:24:51.982989+0000","last_became_active":"2023-10-09T06:24:50.981345+0000","last_became_peered":"2023-10-09T06:24:50.981345+0000","last_unstale":"2023-10-09T06:24:51.982989+0000","last_undegraded":"2023-10-09T06:24:51.982989+0000","last_fullsized":"2023-10-09T06:24:51.982989+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:31.468813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711871+0000","last_change":"2023-10-09T06:24:51.711871+0000","last_active":"2023-10-09T06:24:51.711871+0000","last_peered":"2023-10-09T06:24:51.711871+0000","last_clean":"2023-10-09T06:24:51.711871+0000","last_became_active":"2023-10-09T06:24:51.710764+0000","last_became_peered":"2023-10-09T06:24:51.710764+0000","last_unstale":"2023-10-09T06:24:51.711871+0000","last_undegraded":"2023-10-09T06:24:51.711871+0000","last_fullsized":"2023-10-09T06:24:51.711871+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:52.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.983303+0000","last_change":"2023-10-09T06:24:50.981159+0000","last_active":"2023-10-09T06:24:51.983303+0000","last_peered":"2023-10-09T06:24:51.983303+0000","last_clean":"2023-10-09T06:24:51.983303+0000","last_became_active":"2023-10-09T06:24:50.980757+0000","last_became_peered":"2023-10-09T06:24:50.980757+0000","last_unstale":"2023-10-09T06:24:51.983303+0000","last_undegraded":"2023-10-09T06:24:51.983303+0000","last_fullsized":"2023-10-09T06:24:51.983303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:19.195680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.711949+0000","last_change":"2023-10-09T06:24:51.711949+0000","last_active":"2023-10-09T06:24:51.711949+0000","last_peered":"2023-10-09T06:24:51.711949+0000","last_clean":"2023-10-09T06:24:51.711949+0000","last_became_active":"2023-10-09T06:24:51.711728+0000","last_became_peered":"2023-10-09T06:24:51.711728+0000","last_unstale":"2023-10-09T06:24:51.711949+0000","last_undegraded":"2023-10-09T06:24:51.711949+0000","last_fullsized":"2023-10-09T06:24:51.711949+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:05:47.586806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.703357+0000","last_change":"2023-10-09T06:24:50.981969+0000","last_active":"2023-10-09T06:24:51.703357+0000","last_peered":"2023-10-09T06:24:51.703357+0000","last_clean":"2023-10-09T06:24:51.703357+0000","last_became_active":"2023-10-09T06:24:50.981726+0000","last_became_peered":"2023-10-09T06:24:50.981726+0000","last_unstale":"2023-10-09T06:24:51.703357+0000","last_undegraded":"2023-10-09T06:24:51.703357+0000","last_fullsized":"2023-10-09T06:24:51.703357+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:40:09.936580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.709628+0000","last_change":"2023-10-09T06:24:51.709628+0000","last_active":"2023-10-09T06:24:51.709628+0000","last_peered":"2023-10-09T06:24:51.709628+0000","last_clean":"2023-10-09T06:24:51.709628+0000","last_became_active":"2023-10-09T06:24:51.708579+0000","last_became_peered":"2023-10-09T06:24:51.708579+0000","last_unstale":"2023-10-09T06:24:51.709628+0000","last_undegraded":"2023-10-09T06:24:51.709628+0000","last_fullsized":"2023-10-09T06:24:51.709628+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:28:41.369957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.705212+0000","last_change":"2023-10-09T06:24:50.985544+0000","last_active":"2023-10-09T06:24:51.705212+0000","last_peered":"2023-10-09T06:24:51.705212+0000","last_clean":"2023-10-09T06:24:51.705212+0000","last_became_active":"2023-10-09T06:24:50.984612+0000","last_became_peered":"2023-10-09T06:24:50.984612+0000","last_unstale":"2023-10-09T06:24:51.705212+0000","last_undegraded":"2023-10-09T06:24:51.705212+0000","last_fullsized":"2023-10-09T06:24:51.705212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:13.940199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713952+0000","last_change":"2023-10-09T06:24:51.713952+0000","last_active":"2023-10-09T06:24:51.713952+0000","last_peered":"2023-10-09T06:24:51.713952+0000","last_clean":"2023-10-09T06:24:51.713952+0000","last_became_active":"2023-10-09T06:24:51.713739+0000","last_became_peered":"2023-10-09T06:24:51.713739+0000","last_unstale":"2023-10-09T06:24:51.713952+0000","last_undegraded":"2023-10-09T06:24:51.713952+0000","last_fullsized":"2023-10-09T06:24:51.713952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:59.734373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.982305+0000","last_change":"2023-10-09T06:24:50.982065+0000","last_active":"2023-10-09T06:24:50.982305+0000","last_peered":"2023-10-09T06:24:50.982305+0000","last_clean":"2023-10-09T06:24:50.982305+0000","last_became_active":"2023-10-09T06:24:50.981817+0000","last_became_peered":"2023-10-09T06:24:50.981817+0000","last_unstale":"2023-10-09T06:24:50.982305+0000","last_undegraded":"2023-10-09T06:24:50.982305+0000","last_fullsized":"2023-10-09T06:24:50.982305+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:04.310452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715359+0000","last_change":"2023-10-09T06:24:51.715359+0000","last_active":"2023-10-09T06:24:51.715359+0000","last_peered":"2023-10-09T06:24:51.715359+0000","last_clean":"2023-10-09T06:24:51.715359+0000","last_became_active":"2023-10-09T06:24:51.715133+0000","last_became_peered":"2023-10-09T06:24:51.715133+0000","last_unstale":"2023-10-09T06:24:51.715359+0000","last_undegraded":"2023-10-09T06:24:51.715359+0000","last_fullsized":"2023-10-09T06:24:51.715359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:46.459314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.709170+0000","last_change":"2023-10-09T06:24:50.981990+0000","last_active":"2023-10-09T06:24:51.709170+0000","last_peered":"2023-10-09T06:24:51.709170+0000","last_clean":"2023-10-09T06:24:51.709170+0000","last_became_active":"2023-10-09T06:24:50.981795+0000","last_became_peered":"2023-10-09T06:24:50.981795+0000","last_unstale":"2023-10-09T06:24:51.709170+0000","last_undegraded":"2023-10-09T06:24:51.709170+0000","last_fullsized":"2023-10-09T06:24:51.709170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:14.874167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.713217+0000","last_change":"2023-10-09T06:24:51.713068+0000","last_active":"2023-10-09T06:24:51.713217+0000","last_peered":"2023-10-09T06:24:51.713217+0000","last_clean":"2023-10-09T06:24:51.713217+0000","last_became_active":"2023-10-09T06:24:51.712721+0000","last_became_peered":"2023-10-09T06:24:51.712721+0000","last_unstale":"2023-10-09T06:24:51.713217+0000","last_undegraded":"2023-10-09T06:24:51.713217+0000","last_fullsized":"2023-10-09T06:24:51.713217+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:39:50.069024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.982089+0000","last_change":"2023-10-09T06:24:50.983357+0000","last_active":"2023-10-09T06:24:51.982089+0000","last_peered":"2023-10-09T06:24:51.982089+0000","last_clean":"2023-10-09T06:24:51.982089+0000","last_became_active":"2023-10-09T06:24:50.983118+0000","last_became_peered":"2023-10-09T06:24:50.983118+0000","last_unstale":"2023-10-09T06:24:51.982089+0000","last_undegraded":"2023-10-09T06:24:51.982089+0000","last_fullsized":"2023-10-09T06:24:51.982089+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:22.849369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.715062+0000","last_change":"2023-10-09T06:24:51.715062+0000","last_active":"2023-10-09T06:24:51.715062+0000","last_peered":"2023-10-09T06:24:51.715062+0000","last_clean":"2023-10-09T06:24:51.715062+0000","last_became_active":"2023-10-09T06:24:51.714100+0000","last_became_peered":"2023-10-09T06:24:51.714100+0000","last_unstale":"2023-10-09T06:24:51.715062+0000","last_undegraded":"2023-10-09T06:24:51.715062+0000","last_fullsized":"2023-10-09T06:24:51.715062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:26:56.338821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.982384+0000","last_change":"2023-10-09T06:24:50.982316+0000","last_active":"2023-10-09T06:24:50.982384+0000","last_peered":"2023-10-09T06:24:50.982384+0000","last_clean":"2023-10-09T06:24:50.982384+0000","last_became_active":"2023-10-09T06:24:50.982085+0000","last_became_peered":"2023-10-09T06:24:50.982085+0000","last_unstale":"2023-10-09T06:24:50.982384+0000","last_undegraded":"2023-10-09T06:24:50.982384+0000","last_fullsized":"2023-10-09T06:24:50.982384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:44.872422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.708664+0000","last_change":"2023-10-09T06:24:51.708598+0000","last_active":"2023-10-09T06:24:51.708664+0000","last_peered":"2023-10-09T06:24:51.708664+0000","last_clean":"2023-10-09T06:24:51.708664+0000","last_became_active":"2023-10-09T06:24:51.708317+0000","last_became_peered":"2023-10-09T06:24:51.708317+0000","last_unstale":"2023-10-09T06:24:51.708664+0000","last_undegraded":"2023-10-09T06:24:51.708664+0000","last_fullsized":"2023-10-09T06:24:51.708664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:17.464256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.981620+0000","last_change":"2023-10-09T06:24:50.981181+0000","last_active":"2023-10-09T06:24:50.981620+0000","last_peered":"2023-10-09T06:24:50.981620+0000","last_clean":"2023-10-09T06:24:50.981620+0000","last_became_active":"2023-10-09T06:24:50.980787+0000","last_became_peered":"2023-10-09T06:24:50.980787+0000","last_unstale":"2023-10-09T06:24:50.981620+0000","last_undegraded":"2023-10-09T06:24:50.981620+0000","last_fullsized":"2023-10-09T06:24:50.981620+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:01.602623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712900+0000","last_change":"2023-10-09T06:24:51.711936+0000","last_active":"2023-10-09T06:24:51.712900+0000","last_peered":"2023-10-09T06:24:51.712900+0000","last_clean":"2023-10-09T06:24:51.712900+0000","last_became_active":"2023-10-09T06:24:51.710069+0000","last_became_peered":"2023-10-09T06:24:51.710069+0000","last_unstale":"2023-10-09T06:24:51.712900+0000","last_undegraded":"2023-10-09T06:24:51.712900+0000","last_fullsized":"2023-10-09T06:24:51.712900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:46:41.306685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.709382+0000","last_change":"2023-10-09T06:24:50.986277+0000","last_active":"2023-10-09T06:24:51.709382+0000","last_peered":"2023-10-09T06:24:51.709382+0000","last_clean":"2023-10-09T06:24:51.709382+0000","last_became_active":"2023-10-09T06:24:50.986034+0000","last_became_peered":"2023-10-09T06:24:50.986034+0000","last_unstale":"2023-10-09T06:24:51.709382+0000","last_undegraded":"2023-10-09T06:24:51.709382+0000","last_fullsized":"2023-10-09T06:24:51.709382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:44.872422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.712034+0000","last_change":"2023-10-09T06:24:51.712034+0000","last_active":"2023-10-09T06:24:51.712034+0000","last_peered":"2023-10-09T06:24:51.712034+0000","last_clean":"2023-10-09T06:24:51.712034+0000","last_became_active":"2023-10-09T06:24:51.711585+0000","last_became_peered":"2023-10-09T06:24:51.711585+0000","last_unstale":"2023-10-09T06:24:51.712034+0000","last_undegraded":"2023-10-09T06:24:51.712034+0000","last_fullsized":"2023-10-09T06:24:51.712034+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:39.301606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.983506+0000","last_change":"2023-10-09T06:24:50.983411+0000","last_active":"2023-10-09T06:24:50.983506+0000","last_peered":"2023-10-09T06:24:50.983506+0000","last_clean":"2023-10-09T06:24:50.983506+0000","last_became_active":"2023-10-09T06:24:50.983143+0000","last_became_peered":"2023-10-09T06:24:50.983143+0000","last_unstale":"2023-10-09T06:24:50.983506+0000","last_undegraded":"2023-10-09T06:24:50.983506+0000","last_fullsized":"2023-10-09T06:24:50.983506+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:21:58.581202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.717850+0000","last_change":"2023-10-09T06:24:51.717629+0000","last_active":"2023-10-09T06:24:51.717850+0000","last_peered":"2023-10-09T06:24:51.717850+0000","last_clean":"2023-10-09T06:24:51.717850+0000","last_became_active":"2023-10-09T06:24:51.715922+0000","last_became_peered":"2023-10-09T06:24:51.715922+0000","last_unstale":"2023-10-09T06:24:51.717850+0000","last_undegraded":"2023-10-09T06:24:51.717850+0000","last_fullsized":"2023-10-09T06:24:51.717850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:38.679141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.979405+0000","last_change":"2023-10-09T06:24:50.979338+0000","last_active":"2023-10-09T06:24:50.979405+0000","last_peered":"2023-10-09T06:24:50.979405+0000","last_clean":"2023-10-09T06:24:50.979405+0000","last_became_active":"2023-10-09T06:24:50.979064+0000","last_became_peered":"2023-10-09T06:24:50.979064+0000","last_unstale":"2023-10-09T06:24:50.979405+0000","last_undegraded":"2023-10-09T06:24:50.979405+0000","last_fullsized":"2023-10-09T06:24:50.979405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:48.252691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.707551+0000","last_change":"2023-10-09T06:24:51.707551+0000","last_active":"2023-10-09T06:24:51.707551+0000","last_peered":"2023-10-09T06:24:51.707551+0000","last_clean":"2023-10-09T06:24:51.707551+0000","last_became_active":"2023-10-09T06:24:51.707253+0000","last_became_peered":"2023-10-09T06:24:51.707253+0000","last_unstale":"2023-10-09T06:24:51.707551+0000","last_undegraded":"2023-10-09T06:24:51.707551+0000","last_fullsized":"2023-10-09T06:24:51.707551+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:47.500460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-09T06:24:50.985495+0000","last_change":"2023-10-09T06:24:50.985438+0000","last_active":"2023-10-09T06:24:50.985495+0000","last_peered":"2023-10-09T06:24:50.985495+0000","last_clean":"2023-10-09T06:24:50.985495+0000","last_became_active":"2023-10-09T06:24:50.984947+0000","last_became_peered":"2023-10-09T06:24:50.984947+0000","last_unstale":"2023-10-09T06:24:50.985495+0000","last_undegraded":"2023-10-09T06:24:50.985495+0000","last_fullsized":"2023-10-09T06:24:50.985495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:22.849369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.717833+0000","last_change":"2023-10-09T06:24:51.716926+0000","last_active":"2023-10-09T06:24:51.717833+0000","last_peered":"2023-10-09T06:24:51.717833+0000","last_clean":"2023-10-09T06:24:51.717833+0000","last_became_active":"2023-10-09T06:24:51.716526+0000","last_became_peered":"2023-10-09T06:24:51.716526+0000","last_unstale":"2023-10-09T06:24:51.717833+0000","last_undegraded":"2023-10-09T06:24:51.717833+0000","last_fullsized":"2023-10-09T06:24:51.717833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:28:07.814854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.705311+0000","last_change":"2023-10-09T06:24:50.986087+0000","last_active":"2023-10-09T06:24:51.705311+0000","last_peered":"2023-10-09T06:24:51.705311+0000","last_clean":"2023-10-09T06:24:51.705311+0000","last_became_active":"2023-10-09T06:24:50.985255+0000","last_became_peered":"2023-10-09T06:24:50.985255+0000","last_unstale":"2023-10-09T06:24:51.705311+0000","last_undegraded":"2023-10-09T06:24:51.705311+0000","last_fullsized":"2023-10-09T06:24:51.705311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:29.089725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.714585+0000","last_change":"2023-10-09T06:24:51.714585+0000","last_active":"2023-10-09T06:24:51.714585+0000","last_peered":"2023-10-09T06:24:51.714585+0000","last_clean":"2023-10-09T06:24:51.714585+0000","last_became_active":"2023-10-09T06:24:51.714372+0000","last_became_peered":"2023-10-09T06:24:51.714372+0000","last_unstale":"2023-10-09T06:24:51.714585+0000","last_undegraded":"2023-10-09T06:24:51.714585+0000","last_fullsized":"2023-10-09T06:24:51.714585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:50.966297+0000","last_clean_scrub_stamp":"2023-10-09T06:24:50.966297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:47.447218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.984850+0000","last_change":"2023-10-09T06:24:50.980631+0000","last_active":"2023-10-09T06:24:51.984850+0000","last_peered":"2023-10-09T06:24:51.984850+0000","last_clean":"2023-10-09T06:24:51.984850+0000","last_became_active":"2023-10-09T06:24:50.980385+0000","last_became_peered":"2023-10-09T06:24:50.980385+0000","last_unstale":"2023-10-09T06:24:51.984850+0000","last_undegraded":"2023-10-09T06:24:51.984850+0000","last_fullsized":"2023-10-09T06:24:51.984850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:24:49.961779+0000","last_clean_scrub_stamp":"2023-10-09T06:24:49.961779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:55.239035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":218,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-09T06:24:51.706414+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:24:51.706414+0000","last_peered":"2023-10-09T06:24:51.706414+0000","last_clean":"2023-10-09T06:24:51.706414+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:24:51.706414+0000","last_undegraded":"2023-10-09T06:24:51.706414+0000","last_fullsized":"2023-10-09T06:24:51.706414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82599999999999996,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.91200000000000003,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.91200000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76800000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53100000000000003,"15min":0.50600000000000001},"min":{"1min":0.35199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75800000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.45700000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.57399999999999995},"min":{"1min":0.44700000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81399999999999995,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.629},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.53600000000000003},"min":{"1min":0.45000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80600000000000005,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.64700000000000002,"15min":0.57899999999999996},"min":{"1min":0.45900000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.56299999999999994},"min":{"1min":0.46000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71299999999999997,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.56299999999999994}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46800000000000003,"15min":0.47299999999999998},"min":{"1min":0.27200000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.872},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.31900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.72699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.34000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.98699999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.60699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":436,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194876,"statfs":{"total":200000000,"available":199553390,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.66100000000000003,"15min":0.79100000000000004},"min":{"1min":0.35199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77100000000000002,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.442},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.38100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":1.133,"15min":1.133},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.47299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72699999999999998,"5min":1.155,"15min":1.155},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71599999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.39600000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72599999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.68000000000000005,"15min":0.80000000000000004},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.78900000000000003,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.42999999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58299999999999996,"15min":0.60099999999999998},"min":{"1min":0.46200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":1.337,"15min":1.337},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":1.206,"15min":1.206},"last":0.42199999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.497,"15min":0.497},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.35699999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47399999999999998},"min":{"1min":0.377,"5min":0.315,"15min":0.315},"max":{"1min":0.69499999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.312},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51200000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.498},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.38100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":431,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194880,"statfs":{"total":200000000,"available":199557646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.254,"5min":0.219,"15min":0.219},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.35999999999999999,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.247}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.26300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.39700000000000002,"15min":0.38500000000000001},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.375}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.436,"15min":0.41199999999999998},"min":{"1min":0.35899999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.442,"15min":0.42799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.29199999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.56000000000000005},"min":{"1min":0.43099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.72499999999999998,"15min":0.82899999999999996},"min":{"1min":0.47399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90200000000000002,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64500000000000002,"15min":0.625},"min":{"1min":0.47099999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66000000000000003,"15min":0.66800000000000004},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.175,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.47299999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64000000000000001,"15min":0.61799999999999999},"min":{"1min":0.51700000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.48599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0189999999999999,"5min":1.49,"15min":1.49},"last":0.51300000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.52300000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.503},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67200000000000004,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.41899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1012,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198963114,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39200000000000002,"15min":0.41999999999999998},"min":{"1min":0.22700000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.65800000000000003,"5min":1.226,"15min":1.226},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.42799999999999999},"min":{"1min":0.251,"5min":0.223,"15min":0.223},"max":{"1min":0.71899999999999997,"5min":1.131,"15min":1.131},"last":0.47999999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.72199999999999998,"15min":1.0489999999999999},"min":{"1min":0.26700000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64400000000000002,"5min":12.929,"15min":12.929},"last":0.37},{"interface":"front","average":{"1min":0.437,"5min":0.44900000000000001,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.68600000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.32700000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.47899999999999998},"min":{"1min":0.34699999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67400000000000004,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.314,"15min":0.314},"max":{"1min":0.69099999999999995,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.62,"15min":0.62},"min":{"1min":0.51100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.86299999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63900000000000001,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79500000000000004,"5min":1.335,"15min":1.335},"last":0.57399999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83999999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.80500000000000005,"5min":0.999,"15min":0.999},"last":0.55100000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.621,"15min":0.623},"min":{"1min":0.502,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78500000000000003,"5min":0.998,"15min":0.998},"last":0.623},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.68300000000000005},"min":{"1min":0.495,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81999999999999995,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66500000000000004,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91200000000000003,"5min":1.262,"15min":1.262},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.51800000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.89500000000000002,"5min":1.103,"15min":1.103},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":431,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194881,"statfs":{"total":200000000,"available":199558234,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.64700000000000002,"15min":0.93500000000000005},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.79000000000000004,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.54000000000000004,"15min":0.69999999999999996},"min":{"1min":0.33200000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56200000000000006,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.27900000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.51200000000000001,"15min":0.66000000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.73099999999999998,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.309},{"interface":"front","average":{"1min":0.496,"5min":0.60499999999999998,"15min":0.72699999999999998},"min":{"1min":0.312,"5min":0.254,"15min":0.254},"max":{"1min":0.84499999999999997,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.32900000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59199999999999997,"15min":0.73199999999999998},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84299999999999997,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.71799999999999997,"15min":0.99099999999999999},"min":{"1min":0.29999999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.87,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.91200000000000003,"15min":1.1930000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94899999999999995,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.79100000000000004,"15min":0.95499999999999996},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97199999999999998,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.55800000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.77600000000000002,"15min":0.92800000000000005},"min":{"1min":0.45200000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94199999999999995,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.78600000000000003,"15min":0.93400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.995,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.46200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.78100000000000003,"15min":0.91900000000000004},"min":{"1min":0.46100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.026,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.91300000000000003,"15min":1.1859999999999999},"min":{"1min":0.42699999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.98499999999999999,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.53400000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.76700000000000002,"15min":0.91300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0049999999999999,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.78400000000000003,"15min":0.92900000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93799999999999994,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.51300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":430,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194882,"statfs":{"total":200000000,"available":199559658,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.33800000000000002,"15min":0.32600000000000001},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.499,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39500000000000002,"15min":0.375},"min":{"1min":0.33100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33800000000000002,"15min":0.32200000000000001},"min":{"1min":0.255,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.255},{"interface":"front","average":{"1min":0.436,"5min":0.36899999999999999,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.378}]},{"osd":2,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.373,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.44,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64600000000000002,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.309}]},{"osd":4,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46800000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82399999999999995,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.53000000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.875,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.45100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.45100000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.73999999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80600000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48799999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.58199999999999996},"min":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":0.87,"15min":0.87},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.502}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194882,"statfs":{"total":200000000,"available":199559700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.51900000000000002,"15min":0.49399999999999999},"min":{"1min":0.46100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.40100000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.44400000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65100000000000002,"15min":0.72499999999999998},"min":{"1min":0.39500000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72899999999999998,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.39500000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.64200000000000002,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.68200000000000005,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.84899999999999998,"15min":1.125},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":11.715,"15min":11.715},"last":0.55400000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.56000000000000005,"15min":0.52400000000000002},"min":{"1min":0.53300000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.51700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73499999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65300000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50600000000000001,"15min":0.503},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":430,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194882,"statfs":{"total":200000000,"available":199559680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68899999999999995,"5min":1.093,"15min":1.093},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.51200000000000001},"min":{"1min":0.44400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.498}]},{"osd":2,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.376}]},{"osd":3,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76300000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.77600000000000002,"5min":1.071,"15min":1.071},"last":0.51800000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66000000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48399999999999999,"15min":0.501},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.624,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.45000000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.50600000000000001,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64400000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.36399999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.67800000000000005,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65400000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64600000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.57799999999999996}]}]}],"pool_statfs":[]}} 2023-10-09T06:24:56.472 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:24:56.473 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:24:56.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.631+0000 7fb3a37fb700 1 Processor -- start 2023-10-09T06:24:56.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.632+0000 7fb3a37fb700 1 -- start start 2023-10-09T06:24:56.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.632+0000 7fb3a37fb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c15da90 0x7fb39c067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:56.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.632+0000 7fb3a37fb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb39c067ba0 0x7fb39c0cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:56.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.632+0000 7fb3a37fb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39c15e1e0 con 0x7fb39c154440 2023-10-09T06:24:56.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.632+0000 7fb3a37fb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39c068020 con 0x7fb39c067ba0 2023-10-09T06:24:56.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.632+0000 7fb3a37fb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c15e4c0 con 0x7fb39c15da90 2023-10-09T06:24:56.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.633+0000 7fb3a0d96700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c15da90 0x7fb39c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:56.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.633+0000 7fb3a1d98700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb39c067ba0 0x7fb39c0cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:56.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.633+0000 7fb3a1d98700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb39c067ba0 0x7fb39c0cfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:36972/0 (socket says 172.21.15.31:36972) 2023-10-09T06:24:56.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.633+0000 7fb3a0d96700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c15da90 0x7fb39c067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:38920/0 (socket says 172.21.15.31:38920) 2023-10-09T06:24:56.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.633+0000 7fb3a1d98700 1 -- 172.21.15.31:0/971196479 learned_addr learned my addr 172.21.15.31:0/971196479 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:56.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.633+0000 7fb3a0d96700 1 -- 172.21.15.31:0/971196479 >> v2:172.21.15.158:3300/0 conn(0x7fb39c067ba0 msgr2=0x7fb39c0cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.633+0000 7fb3a0d96700 1 --2- 172.21.15.31:0/971196479 >> v2:172.21.15.158:3300/0 conn(0x7fb39c067ba0 0x7fb39c0cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.633+0000 7fb3a0d96700 1 -- 172.21.15.31:0/971196479 >> v1:172.21.15.158:6789/0 conn(0x7fb39c154440 legacy=0x7fb39c15af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.633+0000 7fb3a0d96700 1 -- 172.21.15.31:0/971196479 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c15e7a0 con 0x7fb39c15da90 2023-10-09T06:24:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.633+0000 7fb3a0d96700 1 --2- 172.21.15.31:0/971196479 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c15da90 0x7fb39c067660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb3900098e0 tx=0x7fb3900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56d33b9cb091f20b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.634+0000 7fb39bfff700 1 -- 172.21.15.31:0/971196479 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39000b640 con 0x7fb39c15da90 2023-10-09T06:24:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.634+0000 7fb39bfff700 1 -- 172.21.15.31:0/971196479 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39000b7a0 con 0x7fb39c15da90 2023-10-09T06:24:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.634+0000 7fb39bfff700 1 -- 172.21.15.31:0/971196479 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39000bb40 con 0x7fb39c15da90 2023-10-09T06:24:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.634+0000 7fb3a37fb700 1 -- 172.21.15.31:0/971196479 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c15da90 msgr2=0x7fb39c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.634+0000 7fb3a37fb700 1 --2- 172.21.15.31:0/971196479 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c15da90 0x7fb39c067660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb3900098e0 tx=0x7fb3900091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.634+0000 7fb3a37fb700 1 -- 172.21.15.31:0/971196479 shutdown_connections 2023-10-09T06:24:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.634+0000 7fb3a37fb700 1 --2- 172.21.15.31:0/971196479 >> v2:172.21.15.158:3300/0 conn(0x7fb39c067ba0 0x7fb39c0cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.634+0000 7fb3a37fb700 1 --2- 172.21.15.31:0/971196479 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c15da90 0x7fb39c067660 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.634+0000 7fb3a37fb700 1 -- 172.21.15.31:0/971196479 >> 172.21.15.31:0/971196479 conn(0x7fb39c0d0dd0 msgr2=0x7fb39c0d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.634+0000 7fb3a37fb700 1 -- 172.21.15.31:0/971196479 shutdown_connections 2023-10-09T06:24:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.634+0000 7fb3a37fb700 1 -- 172.21.15.31:0/971196479 wait complete. 2023-10-09T06:24:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.635+0000 7fb3a37fb700 1 Processor -- start 2023-10-09T06:24:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.635+0000 7fb3a37fb700 1 -- start start 2023-10-09T06:24:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.636+0000 7fb3a37fb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c067ba0 0x7fb39c15b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.636+0000 7fb3a37fb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb39c154440 0x7fb39c157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.636+0000 7fb3a37fb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb39c15da90 0x7fb39c145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.636+0000 7fb3a37fb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c1551d0 con 0x7fb39c154440 2023-10-09T06:24:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.636+0000 7fb3a37fb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c1586d0 con 0x7fb39c15da90 2023-10-09T06:24:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.636+0000 7fb3a37fb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c155470 con 0x7fb39c067ba0 2023-10-09T06:24:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.636+0000 7fb3a0d96700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb39c154440 0x7fb39c157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.636+0000 7fb3a1597700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c067ba0 0x7fb39c15b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.636+0000 7fb3a1d98700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb39c15da90 0x7fb39c145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.636+0000 7fb3a1597700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c067ba0 0x7fb39c15b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:38932/0 (socket says 172.21.15.31:38932) 2023-10-09T06:24:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.636+0000 7fb3a1597700 1 -- 172.21.15.31:0/3974997201 learned_addr learned my addr 172.21.15.31:0/3974997201 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.636+0000 7fb3a1d98700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb39c15da90 0x7fb39c145350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:36976/0 (socket says 172.21.15.31:36976) 2023-10-09T06:24:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.637+0000 7fb3a1597700 1 -- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb39c15da90 msgr2=0x7fb39c145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.637+0000 7fb3a1597700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb39c15da90 0x7fb39c145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.637+0000 7fb3a1597700 1 -- 172.21.15.31:0/3974997201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb39c154440 msgr2=0x7fb39c157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.637+0000 7fb3a1597700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb39c154440 0x7fb39c157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.637+0000 7fb3a1597700 1 -- 172.21.15.31:0/3974997201 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb390009420 con 0x7fb39c067ba0 2023-10-09T06:24:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.637+0000 7fb3a0d96700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb39c154440 0x7fb39c157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:24:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.637+0000 7fb3a1d98700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb39c15da90 0x7fb39c145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:24:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.637+0000 7fb3a1597700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c067ba0 0x7fb39c15b9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb38c00c8e0 tx=0x7fb38c001710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.637+0000 7fb3997fa700 1 -- 172.21.15.31:0/3974997201 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c012630 con 0x7fb39c067ba0 2023-10-09T06:24:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.637+0000 7fb3997fa700 1 -- 172.21.15.31:0/3974997201 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c0127b0 con 0x7fb39c067ba0 2023-10-09T06:24:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.637+0000 7fb3a37fb700 1 -- 172.21.15.31:0/3974997201 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39c155750 con 0x7fb39c067ba0 2023-10-09T06:24:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.637+0000 7fb3997fa700 1 -- 172.21.15.31:0/3974997201 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c012b70 con 0x7fb39c067ba0 2023-10-09T06:24:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.637+0000 7fb3a37fb700 1 -- 172.21.15.31:0/3974997201 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39c15cd60 con 0x7fb39c067ba0 2023-10-09T06:24:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.638+0000 7fb3a37fb700 1 -- 172.21.15.31:0/3974997201 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39c04c3c0 con 0x7fb39c067ba0 2023-10-09T06:24:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.639+0000 7fb3997fa700 1 -- 172.21.15.31:0/3974997201 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb38c003030 con 0x7fb39c067ba0 2023-10-09T06:24:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.639+0000 7fb3997fa700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb388066f30 0x7fb3880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.639+0000 7fb3997fa700 1 -- 172.21.15.31:0/3974997201 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb38c084770 con 0x7fb39c067ba0 2023-10-09T06:24:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.639+0000 7fb3a0d96700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb388066f30 0x7fb3880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.640+0000 7fb3a0d96700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb388066f30 0x7fb3880693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb3900093f0 tx=0x7fb390017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:56.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.644+0000 7fb3997fa700 1 -- 172.21.15.31:0/3974997201 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb38c0554f0 con 0x7fb39c067ba0 2023-10-09T06:24:56.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.920+0000 7fb3a37fb700 1 -- 172.21.15.31:0/3974997201 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb39c0cdcd0 con 0x7fb39c067ba0 2023-10-09T06:24:56.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.925+0000 7fb3997fa700 1 -- 172.21.15.31:0/3974997201 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb38c055080 con 0x7fb39c067ba0 2023-10-09T06:24:56.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.927+0000 7fb3a37fb700 1 -- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb388066f30 msgr2=0x7fb3880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.927+0000 7fb3a37fb700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb388066f30 0x7fb3880693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb3900093f0 tx=0x7fb390017000 comp rx=0 tx=0).stop 2023-10-09T06:24:56.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.927+0000 7fb3a37fb700 1 -- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c067ba0 msgr2=0x7fb39c15b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:56.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.928+0000 7fb3a37fb700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c067ba0 0x7fb39c15b9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb38c00c8e0 tx=0x7fb38c001710 comp rx=0 tx=0).stop 2023-10-09T06:24:56.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.928+0000 7fb3a37fb700 1 -- 172.21.15.31:0/3974997201 shutdown_connections 2023-10-09T06:24:56.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.928+0000 7fb3a37fb700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb388066f30 0x7fb3880693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.928+0000 7fb3a37fb700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb39c067ba0 0x7fb39c15b9a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.928+0000 7fb3a37fb700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb39c15da90 0x7fb39c145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.928+0000 7fb3a37fb700 1 --2- 172.21.15.31:0/3974997201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb39c154440 0x7fb39c157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:56.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.928+0000 7fb3a37fb700 1 -- 172.21.15.31:0/3974997201 >> 172.21.15.31:0/3974997201 conn(0x7fb39c0d0dd0 msgr2=0x7fb39c1518b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:56.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.928+0000 7fb3a37fb700 1 -- 172.21.15.31:0/3974997201 shutdown_connections 2023-10-09T06:24:56.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:56.928+0000 7fb3a37fb700 1 -- 172.21.15.31:0/3974997201 wait complete. 2023-10-09T06:24:56.933 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2023-10-09T06:24:56.941 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:24:56.966 INFO:tasks.ceph.mds.a.smithi031.stderr:2023-10-09T06:24:56.963+0000 7fb5a92e2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:24:57.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.063+0000 7fcfbc376700 1 Processor -- start 2023-10-09T06:24:57.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.063+0000 7fcfbc376700 1 -- start start 2023-10-09T06:24:57.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.063+0000 7fcfbc376700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb4157870 0x7fcfb415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.063+0000 7fcfbc376700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfb415a620 0x7fcfb415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.063+0000 7fcfbc376700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcfb415d580 0x7fcfb4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.063+0000 7fcfbc376700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb415cbb0 con 0x7fcfb415a620 2023-10-09T06:24:57.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.063+0000 7fcfbc376700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb415bfa0 con 0x7fcfb415d580 2023-10-09T06:24:57.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.063+0000 7fcfbc376700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb415c280 con 0x7fcfb4157870 2023-10-09T06:24:57.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfb9911700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfb415a620 0x7fcfb415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfb9911700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfb415a620 0x7fcfb415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59572/0 (socket says 172.21.15.31:59572) 2023-10-09T06:24:57.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfb9911700 1 -- 172.21.15.31:0/3220412211 learned_addr learned my addr 172.21.15.31:0/3220412211 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:57.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfba112700 1 --2- 172.21.15.31:0/3220412211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb4157870 0x7fcfb415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfb9911700 1 -- 172.21.15.31:0/3220412211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb4157870 msgr2=0x7fcfb415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:57.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfba913700 1 --2- 172.21.15.31:0/3220412211 >> v2:172.21.15.158:3300/0 conn(0x7fcfb415d580 0x7fcfb4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfb9911700 1 --2- 172.21.15.31:0/3220412211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb4157870 0x7fcfb415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfb9911700 1 -- 172.21.15.31:0/3220412211 >> v2:172.21.15.158:3300/0 conn(0x7fcfb415d580 msgr2=0x7fcfb4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:57.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfb9911700 1 --2- 172.21.15.31:0/3220412211 >> v2:172.21.15.158:3300/0 conn(0x7fcfb415d580 0x7fcfb4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfb9911700 1 -- 172.21.15.31:0/3220412211 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb415c560 con 0x7fcfb415a620 2023-10-09T06:24:57.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfb9911700 1 --2- 172.21.15.31:0/3220412211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb415a620 0x7fcfb415d040 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40b03b0 tx=0x7fcfa8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27716e2ff22d15a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfb9110700 1 -- 172.21.15.31:0/3220412211 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa800b860 con 0x7fcfb415a620 2023-10-09T06:24:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfb9110700 1 -- 172.21.15.31:0/3220412211 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa800b9c0 con 0x7fcfb415a620 2023-10-09T06:24:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.064+0000 7fcfb9110700 1 -- 172.21.15.31:0/3220412211 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa800bd60 con 0x7fcfb415a620 2023-10-09T06:24:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.065+0000 7fcfbc376700 1 -- 172.21.15.31:0/3220412211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb415a620 msgr2=0x7fcfb415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.065+0000 7fcfbc376700 1 --2- 172.21.15.31:0/3220412211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb415a620 0x7fcfb415d040 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40b03b0 tx=0x7fcfa8009250 comp rx=0 tx=0).stop 2023-10-09T06:24:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.065+0000 7fcfbc376700 1 -- 172.21.15.31:0/3220412211 shutdown_connections 2023-10-09T06:24:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.065+0000 7fcfbc376700 1 --2- 172.21.15.31:0/3220412211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb4157870 0x7fcfb415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.065+0000 7fcfbc376700 1 --2- 172.21.15.31:0/3220412211 >> v2:172.21.15.158:3300/0 conn(0x7fcfb415d580 0x7fcfb4158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.065+0000 7fcfbc376700 1 --2- 172.21.15.31:0/3220412211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb415a620 0x7fcfb415d040 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.065+0000 7fcfbc376700 1 -- 172.21.15.31:0/3220412211 >> 172.21.15.31:0/3220412211 conn(0x7fcfb4068ce0 msgr2=0x7fcfb40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.065+0000 7fcfbc376700 1 -- 172.21.15.31:0/3220412211 shutdown_connections 2023-10-09T06:24:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.065+0000 7fcfbc376700 1 -- 172.21.15.31:0/3220412211 wait complete. 2023-10-09T06:24:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.066+0000 7fcfbc376700 1 Processor -- start 2023-10-09T06:24:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.066+0000 7fcfbc376700 1 -- start start 2023-10-09T06:24:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfbc376700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfb4157870 0x7fcfb40cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfbc376700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb415a620 0x7fcfb40b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfbc376700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb415d580 0x7fcfb40b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfbc376700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40d0ba0 con 0x7fcfb415a620 2023-10-09T06:24:57.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfbc376700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40d0020 con 0x7fcfb4157870 2023-10-09T06:24:57.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfbc376700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40d0300 con 0x7fcfb415d580 2023-10-09T06:24:57.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfb9911700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb415a620 0x7fcfb40b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfb9911700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb415a620 0x7fcfb40b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59586/0 (socket says 172.21.15.31:59586) 2023-10-09T06:24:57.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfb9911700 1 -- 172.21.15.31:0/485783270 learned_addr learned my addr 172.21.15.31:0/485783270 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:57.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfba112700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfb4157870 0x7fcfb40cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfba913700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb415d580 0x7fcfb40b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfb9911700 1 -- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb415d580 msgr2=0x7fcfb40b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfb9911700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb415d580 0x7fcfb40b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfb9911700 1 -- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfb4157870 msgr2=0x7fcfb40cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfb9911700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfb4157870 0x7fcfb40cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfb9911700 1 -- 172.21.15.31:0/485783270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa80094f0 con 0x7fcfb415a620 2023-10-09T06:24:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.067+0000 7fcfb9911700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb415a620 0x7fcfb40b0af0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcfb406b530 tx=0x7fcfa8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.068+0000 7fcfb27fc700 1 -- 172.21.15.31:0/485783270 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8011dc0 con 0x7fcfb415a620 2023-10-09T06:24:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.068+0000 7fcfb27fc700 1 -- 172.21.15.31:0/485783270 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa8024440 con 0x7fcfb415a620 2023-10-09T06:24:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.068+0000 7fcfbc376700 1 -- 172.21.15.31:0/485783270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb40d05e0 con 0x7fcfb415a620 2023-10-09T06:24:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.068+0000 7fcfb27fc700 1 -- 172.21.15.31:0/485783270 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8024800 con 0x7fcfb415a620 2023-10-09T06:24:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.068+0000 7fcfbc376700 1 -- 172.21.15.31:0/485783270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb40b1570 con 0x7fcfb415a620 2023-10-09T06:24:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.069+0000 7fcfbc376700 1 -- 172.21.15.31:0/485783270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb40b0810 con 0x7fcfb415a620 2023-10-09T06:24:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.069+0000 7fcfb27fc700 1 -- 172.21.15.31:0/485783270 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfa801a420 con 0x7fcfb415a620 2023-10-09T06:24:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.070+0000 7fcfb27fc700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfa0066f30 0x7fcfa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.070+0000 7fcfb27fc700 1 -- 172.21.15.31:0/485783270 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcfa8086350 con 0x7fcfb415a620 2023-10-09T06:24:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.070+0000 7fcfba112700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfa0066f30 0x7fcfa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.070+0000 7fcfba112700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfa0066f30 0x7fcfa00693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400f610 tx=0x7fcfa40077f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.074+0000 7fcfb27fc700 1 -- 172.21.15.31:0/485783270 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfb40b0810 con 0x7fcfb415a620 2023-10-09T06:24:57.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.312+0000 7fcfbc376700 1 -- 172.21.15.31:0/485783270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfb40b0810 con 0x7fcfb415a620 2023-10-09T06:24:57.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.313+0000 7fcfb27fc700 1 -- 172.21.15.31:0/485783270 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fcfb40b0810 con 0x7fcfb415a620 2023-10-09T06:24:57.314 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:24:57.314 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2895057012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2895057012},{"type":"v1","addr":"172.21.15.158:6836","nonce":2895057012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5707,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/756230701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":756230701},{"type":"v1","addr":"172.21.15.158:6837","nonce":756230701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5961,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2803435352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2803435352},{"type":"v1","addr":"172.21.15.31:6834","nonce":2803435352}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:24:51.381116+0000","modified":"2023-10-09T06:24:54.984865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1373095674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1373095674},{"type":"v1","addr":"172.21.15.31:6835","nonce":1373095674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T06:24:57.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.315+0000 7fcfbc376700 1 -- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfa0066f30 msgr2=0x7fcfa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.315+0000 7fcfbc376700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfa0066f30 0x7fcfa00693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400f610 tx=0x7fcfa40077f0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.315+0000 7fcfbc376700 1 -- 172.21.15.31:0/485783270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb415a620 msgr2=0x7fcfb40b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.315+0000 7fcfbc376700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb415a620 0x7fcfb40b0af0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcfb406b530 tx=0x7fcfa8017000 comp rx=0 tx=0).stop 2023-10-09T06:24:57.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.315+0000 7fcfbc376700 1 -- 172.21.15.31:0/485783270 shutdown_connections 2023-10-09T06:24:57.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.315+0000 7fcfbc376700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfa0066f30 0x7fcfa00693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.315+0000 7fcfbc376700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb415d580 0x7fcfb40b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.315+0000 7fcfbc376700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfb4157870 0x7fcfb40cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.315+0000 7fcfbc376700 1 --2- 172.21.15.31:0/485783270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb415a620 0x7fcfb40b0af0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.315+0000 7fcfbc376700 1 -- 172.21.15.31:0/485783270 >> 172.21.15.31:0/485783270 conn(0x7fcfb4068ce0 msgr2=0x7fcfb415da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:57.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.315+0000 7fcfbc376700 1 -- 172.21.15.31:0/485783270 shutdown_connections 2023-10-09T06:24:57.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.315+0000 7fcfbc376700 1 -- 172.21.15.31:0/485783270 wait complete. 2023-10-09T06:24:57.317 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 42 2023-10-09T06:24:57.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:24:51.381116+0000', 'modified': '2023-10-09T06:24:54.984865+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5964}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5964': {'gid': 5964, 'name': 'a', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/1373095674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 1373095674}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 1373095674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:24:57.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:24:57.732 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T06:24:57.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.853+0000 7f8beaf48700 1 Processor -- start 2023-10-09T06:24:57.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.853+0000 7f8beaf48700 1 -- start start 2023-10-09T06:24:57.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.853+0000 7f8beaf48700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8be415a620 0x7f8be415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.853+0000 7f8beaf48700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8be415d580 0x7f8be4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.853+0000 7f8beaf48700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be415cbb0 con 0x7f8be4157870 2023-10-09T06:24:57.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.853+0000 7f8beaf48700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be415bdb0 con 0x7f8be415a620 2023-10-09T06:24:57.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.853+0000 7f8beaf48700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be415bfa0 con 0x7f8be415d580 2023-10-09T06:24:57.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.854+0000 7f8be3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8be415a620 0x7f8be415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.854+0000 7f8be8ce4700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8be4157870 0x7f8be415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54726/0 (socket says 172.21.15.31:54726) 2023-10-09T06:24:57.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.854+0000 7f8be8ce4700 1 -- 172.21.15.31:0/3229758041 learned_addr learned my addr 172.21.15.31:0/3229758041 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:57.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.854+0000 7f8be94e5700 1 --2- 172.21.15.31:0/3229758041 >> v2:172.21.15.158:3300/0 conn(0x7f8be415d580 0x7f8be4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.854+0000 7f8be3fff700 1 -- 172.21.15.31:0/3229758041 >> v2:172.21.15.158:3300/0 conn(0x7f8be415d580 msgr2=0x7f8be4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:57.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.854+0000 7f8be3fff700 1 --2- 172.21.15.31:0/3229758041 >> v2:172.21.15.158:3300/0 conn(0x7f8be415d580 0x7f8be4158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.854+0000 7f8be3fff700 1 -- 172.21.15.31:0/3229758041 >> v1:172.21.15.31:6789/0 conn(0x7f8be4157870 legacy=0x7f8be415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.854+0000 7f8be3fff700 1 -- 172.21.15.31:0/3229758041 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be415c280 con 0x7f8be415a620 2023-10-09T06:24:57.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.854+0000 7f8be37fe700 1 -- 172.21.15.31:0/3229758041 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534450793 0 0) 0x7f8be415cbb0 con 0x7f8be4157870 2023-10-09T06:24:57.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.854+0000 7f8be3fff700 1 --2- 172.21.15.31:0/3229758041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be415a620 0x7f8be415d040 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8be406b4e0 tx=0x7f8bd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ebaa15ce2b8638 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:57.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.854+0000 7f8be37fe700 1 -- 172.21.15.31:0/3229758041 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd800b6b0 con 0x7f8be415a620 2023-10-09T06:24:57.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.854+0000 7f8be37fe700 1 -- 172.21.15.31:0/3229758041 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd800b810 con 0x7f8be415a620 2023-10-09T06:24:57.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.854+0000 7f8be37fe700 1 -- 172.21.15.31:0/3229758041 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd800bbb0 con 0x7f8be415a620 2023-10-09T06:24:57.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.855+0000 7f8beaf48700 1 -- 172.21.15.31:0/3229758041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be415a620 msgr2=0x7f8be415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.855+0000 7f8beaf48700 1 --2- 172.21.15.31:0/3229758041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be415a620 0x7f8be415d040 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8be406b4e0 tx=0x7f8bd80091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.855+0000 7f8beaf48700 1 -- 172.21.15.31:0/3229758041 shutdown_connections 2023-10-09T06:24:57.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.855+0000 7f8beaf48700 1 --2- 172.21.15.31:0/3229758041 >> v2:172.21.15.158:3300/0 conn(0x7f8be415d580 0x7f8be4158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.855+0000 7f8beaf48700 1 --2- 172.21.15.31:0/3229758041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be415a620 0x7f8be415d040 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.855+0000 7f8beaf48700 1 -- 172.21.15.31:0/3229758041 >> 172.21.15.31:0/3229758041 conn(0x7f8be4068ce0 msgr2=0x7f8be40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:57.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.855+0000 7f8beaf48700 1 -- 172.21.15.31:0/3229758041 shutdown_connections 2023-10-09T06:24:57.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.855+0000 7f8beaf48700 1 -- 172.21.15.31:0/3229758041 wait complete. 2023-10-09T06:24:57.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.856+0000 7f8beaf48700 1 Processor -- start 2023-10-09T06:24:57.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.856+0000 7f8beaf48700 1 -- start start 2023-10-09T06:24:57.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8beaf48700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4157870 0x7f8be414a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8beaf48700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8be415a620 0x7f8be40b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8beaf48700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be415d580 0x7f8be40b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8beaf48700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be40b2f00 con 0x7f8be415d580 2023-10-09T06:24:57.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8beaf48700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be40b22f0 con 0x7f8be415a620 2023-10-09T06:24:57.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8beaf48700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be40b25d0 con 0x7f8be4157870 2023-10-09T06:24:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8be94e5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be415d580 0x7f8be40b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8be94e5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be415d580 0x7f8be40b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59600/0 (socket says 172.21.15.31:59600) 2023-10-09T06:24:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8be94e5700 1 -- 172.21.15.31:0/1868623861 learned_addr learned my addr 172.21.15.31:0/1868623861 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8be8ce4700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4157870 0x7f8be414a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8be3fff700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8be415a620 0x7f8be40b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8be94e5700 1 -- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4157870 msgr2=0x7f8be414a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8be94e5700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4157870 0x7f8be414a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8be94e5700 1 -- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8be415a620 msgr2=0x7f8be40b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8be94e5700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8be415a620 0x7f8be40b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8be94e5700 1 -- 172.21.15.31:0/1868623861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd8009420 con 0x7f8be415d580 2023-10-09T06:24:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.857+0000 7f8be94e5700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be415d580 0x7f8be40b5330 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc007ef0 tx=0x7f8bdc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.858+0000 7f8be0ff9700 1 -- 172.21.15.31:0/1868623861 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00eb30 con 0x7f8be415d580 2023-10-09T06:24:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.858+0000 7f8be0ff9700 1 -- 172.21.15.31:0/1868623861 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc00ec90 con 0x7f8be415d580 2023-10-09T06:24:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.858+0000 7f8beaf48700 1 -- 172.21.15.31:0/1868623861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be40b28b0 con 0x7f8be415d580 2023-10-09T06:24:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.858+0000 7f8be0ff9700 1 -- 172.21.15.31:0/1868623861 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc014670 con 0x7f8be415d580 2023-10-09T06:24:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.858+0000 7f8beaf48700 1 -- 172.21.15.31:0/1868623861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be414ae70 con 0x7f8be415d580 2023-10-09T06:24:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.859+0000 7f8be0ff9700 1 -- 172.21.15.31:0/1868623861 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8bdc014a60 con 0x7f8be415d580 2023-10-09T06:24:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.860+0000 7f8be0ff9700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8bd0066f30 0x7f8bd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.860+0000 7f8be0ff9700 1 -- 172.21.15.31:0/1868623861 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bdc084b70 con 0x7f8be415d580 2023-10-09T06:24:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.860+0000 7f8be8ce4700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8bd0066f30 0x7f8bd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.860+0000 7f8be8ce4700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8bd0066f30 0x7f8bd00693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4007fd0 tx=0x7f8bd4007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.861+0000 7f8bf4240b80 1 Processor -- start 2023-10-09T06:24:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.861+0000 7f8bf4240b80 1 -- start start 2023-10-09T06:24:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.862+0000 7f8bf4240b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8518a50 0x560ce8518e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.862+0000 7f8bf4240b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce8541a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.862+0000 7f8bf4240b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8541f60 0x560ce8514cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.862+0000 7f8bf4240b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce846fa70 con 0x560ce8541f60 2023-10-09T06:24:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.862+0000 7f8bf4240b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce846d270 con 0x560ce8562d00 2023-10-09T06:24:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.862+0000 7f8bf4240b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ce8469060 con 0x560ce8518a50 2023-10-09T06:24:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.862+0000 7f8be94e5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8541f60 0x560ce8514cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.862+0000 7f8be94e5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8541f60 0x560ce8514cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59608/0 (socket says 172.21.15.31:59608) 2023-10-09T06:24:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.862+0000 7f8be94e5700 1 -- 172.21.15.31:0/2421056154 learned_addr learned my addr 172.21.15.31:0/2421056154 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.862+0000 7f8be3fff700 1 --2- 172.21.15.31:0/2421056154 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce8541a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.862+0000 7f8be8ce4700 1 --2- 172.21.15.31:0/2421056154 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8518a50 0x560ce8518e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8be94e5700 1 -- 172.21.15.31:0/2421056154 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8518a50 msgr2=0x560ce8518e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8be94e5700 1 --2- 172.21.15.31:0/2421056154 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8518a50 0x560ce8518e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8be94e5700 1 -- 172.21.15.31:0/2421056154 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 msgr2=0x560ce8541a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8be94e5700 1 --2- 172.21.15.31:0/2421056154 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce8541a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8be94e5700 1 -- 172.21.15.31:0/2421056154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ce8303270 con 0x560ce8541f60 2023-10-09T06:24:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8be3fff700 1 --2- 172.21.15.31:0/2421056154 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce8541a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8be94e5700 1 --2- 172.21.15.31:0/2421056154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8541f60 0x560ce8514cf0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc055990 tx=0x7f8bdc082f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ca9a7bd79e76ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8bc9ffb700 1 -- 172.21.15.31:0/2421056154 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc055a80 con 0x560ce8541f60 2023-10-09T06:24:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8bc9ffb700 1 -- 172.21.15.31:0/2421056154 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc058c50 con 0x560ce8541f60 2023-10-09T06:24:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8bc9ffb700 1 -- 172.21.15.31:0/2421056154 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc05c9a0 con 0x560ce8541f60 2023-10-09T06:24:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8bf4240b80 1 -- 172.21.15.31:0/2421056154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8541f60 msgr2=0x560ce8514cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/2421056154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8541f60 0x560ce8514cf0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc055990 tx=0x7f8bdc082f50 comp rx=0 tx=0).stop 2023-10-09T06:24:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8bf4240b80 1 -- 172.21.15.31:0/2421056154 shutdown_connections 2023-10-09T06:24:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/2421056154 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8518a50 0x560ce8518e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/2421056154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8541f60 0x560ce8514cf0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/2421056154 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce8541a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.863+0000 7f8bf4240b80 1 -- 172.21.15.31:0/2421056154 >> 172.21.15.31:0/2421056154 conn(0x560ce851a370 msgr2=0x560ce851a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:57.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.864+0000 7f8bf4240b80 1 -- 172.21.15.31:0/2421056154 shutdown_connections 2023-10-09T06:24:57.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.864+0000 7f8bf4240b80 1 -- 172.21.15.31:0/2421056154 wait complete. 2023-10-09T06:24:57.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.864+0000 7f8bf4240b80 1 -- start start 2023-10-09T06:24:57.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.864+0000 7f8bf4240b80 1 Processor -- start 2023-10-09T06:24:57.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8bf4240b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce856eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8bf4240b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8541f60 0x560ce8513f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8bf4240b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8562d00 0x560ce8514490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8bf4240b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce8414890 con 0x560ce8518a50 2023-10-09T06:24:57.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8bf4240b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce842fea0 con 0x560ce8541f60 2023-10-09T06:24:57.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8bf4240b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ce82ebe30 con 0x560ce8562d00 2023-10-09T06:24:57.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8bf4240b80 10 client.0 _ll_register_callbacks cb 0x560ce84dc110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:24:57.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8be8ce4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce856eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8be8ce4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce856eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59610/0 (socket says 172.21.15.31:59610) 2023-10-09T06:24:57.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8be8ce4700 1 -- 172.21.15.31:0/1266388085 learned_addr learned my addr 172.21.15.31:0/1266388085 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:57.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8be3fff700 1 --2- 172.21.15.31:0/1266388085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8541f60 0x560ce8513f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8be94e5700 1 --2- 172.21.15.31:0/1266388085 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8562d00 0x560ce8514490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8be8ce4700 1 -- 172.21.15.31:0/1266388085 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8562d00 msgr2=0x560ce8514490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:57.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8be8ce4700 1 --2- 172.21.15.31:0/1266388085 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8562d00 0x560ce8514490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8be8ce4700 1 -- 172.21.15.31:0/1266388085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8541f60 msgr2=0x560ce8513f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:57.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.865+0000 7f8be8ce4700 1 --2- 172.21.15.31:0/1266388085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8541f60 0x560ce8513f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8be8ce4700 1 -- 172.21.15.31:0/1266388085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be414ae70 con 0x560ce8518a50 2023-10-09T06:24:57.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8be8ce4700 1 --2- 172.21.15.31:0/1266388085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce856eef0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4014830 tx=0x7f8bd4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362e00733387f6c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:57.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bc2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:24:57.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bc2ffd700 1 -- 172.21.15.31:0/1266388085 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4014e80 con 0x560ce8518a50 2023-10-09T06:24:57.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bc2ffd700 1 -- 172.21.15.31:0/1266388085 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bd401c040 con 0x560ce8518a50 2023-10-09T06:24:57.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1266388085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ce850db70 con 0x560ce8518a50 2023-10-09T06:24:57.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bc2ffd700 1 -- 172.21.15.31:0/1266388085 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bd4001420 con 0x560ce8518a50 2023-10-09T06:24:57.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bf4240b80 10 client.6108 fetch_fsmap learned FSMap version 42 2023-10-09T06:24:57.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1266388085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x560ce82a5fe0 con 0x560ce8518a50 2023-10-09T06:24:57.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bc2ffd700 1 -- 172.21.15.31:0/1266388085 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560ce850db70 con 0x560ce8518a50 2023-10-09T06:24:57.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bc2ffd700 1 -- 172.21.15.31:0/1266388085 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8bd40058a0 con 0x560ce8518a50 2023-10-09T06:24:57.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bf4240b80 10 client.6108 fetch_fsmap finished waiting for FSMap version 42 2023-10-09T06:24:57.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bf4240b80 10 client.6108 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T06:24:57.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bf4240b80 20 client.6108 populate_metadata read hostname 'smithi031' 2023-10-09T06:24:57.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/1266388085 >> [v2:172.21.15.31:6833/1373095674,v1:172.21.15.31:6835/1373095674] conn(0x560ce8561a20 0x560ce8558e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bf4240b80 4 client.6108 mds_command: new command op to 5964 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:24:57.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.866+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1266388085 --> [v2:172.21.15.31:6833/1373095674,v1:172.21.15.31:6835/1373095674] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ce84eaaa0 con 0x560ce8561a20 2023-10-09T06:24:57.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.867+0000 7f8be3fff700 1 --2- 172.21.15.31:0/1266388085 >> [v2:172.21.15.31:6833/1373095674,v1:172.21.15.31:6835/1373095674] conn(0x560ce8561a20 0x560ce8558e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.867+0000 7f8bc2ffd700 10 client.6108 ms_handle_connect on v2:172.21.15.31:6833/1373095674 2023-10-09T06:24:57.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.867+0000 7f8be3fff700 1 --2- 172.21.15.31:0/1266388085 >> [v2:172.21.15.31:6833/1373095674,v1:172.21.15.31:6835/1373095674] conn(0x560ce8561a20 0x560ce8558e70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77ee7640b173350e server_cookie=6c725e785f68afd1 in_seq=0 out_seq=0 2023-10-09T06:24:57.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.867+0000 7f8bc2ffd700 1 -- 172.21.15.31:0/1266388085 <== mds.0 v2:172.21.15.31:6833/1373095674 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560ce84eaaa0 con 0x560ce8561a20 2023-10-09T06:24:57.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.867+0000 7f8bc2ffd700 10 client.6108 handle_command_reply: tid=0 2023-10-09T06:24:57.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.867+0000 7f8bf4240b80 1 client.6108 shutdown 2023-10-09T06:24:57.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.868+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1266388085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 msgr2=0x560ce856eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.868+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/1266388085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce856eef0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4014830 tx=0x7f8bd4015000 comp rx=0 tx=0).stop 2023-10-09T06:24:57.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.868+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1266388085 shutdown_connections 2023-10-09T06:24:57.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.868+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/1266388085 >> [v2:172.21.15.31:6833/1373095674,v1:172.21.15.31:6835/1373095674] conn(0x560ce8561a20 0x560ce8558e70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.868+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/1266388085 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8562d00 0x560ce8514490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.868+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/1266388085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce856eef0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.868+0000 7f8bc2ffd700 0 client.6108 ms_handle_reset on v2:172.21.15.31:6833/1373095674 2023-10-09T06:24:57.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.868+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/1266388085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8541f60 0x560ce8513f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.868+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1266388085 >> 172.21.15.31:0/1266388085 conn(0x560ce851a370 msgr2=0x560ce85158f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:57.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.868+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1266388085 shutdown_connections 2023-10-09T06:24:57.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.868+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1266388085 wait complete. 2023-10-09T06:24:57.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.868+0000 7f8bf4240b80 20 client.6108 trim_cache size 0 max 16384 2023-10-09T06:24:57.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.885+0000 7f8bf4240b80 1 Processor -- start 2023-10-09T06:24:57.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.885+0000 7f8bf4240b80 1 -- start start 2023-10-09T06:24:57.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.885+0000 7f8bf4240b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce85603b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.885+0000 7f8bf4240b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8541f60 0x560ce85bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.885+0000 7f8bf4240b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce85c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.885+0000 7f8bf4240b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce853e3a0 con 0x560ce8518a50 2023-10-09T06:24:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.885+0000 7f8bf4240b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce8560010 con 0x560ce8562d00 2023-10-09T06:24:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.885+0000 7f8bf4240b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ce8541b20 con 0x560ce8541f60 2023-10-09T06:24:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.885+0000 7f8be8ce4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce85603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.885+0000 7f8be8ce4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce85603b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59614/0 (socket says 172.21.15.31:59614) 2023-10-09T06:24:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.885+0000 7f8be8ce4700 1 -- 172.21.15.31:0/3080184995 learned_addr learned my addr 172.21.15.31:0/3080184995 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.886+0000 7f8be94e5700 1 --2- 172.21.15.31:0/3080184995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce85c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.886+0000 7f8be3fff700 1 --2- 172.21.15.31:0/3080184995 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8541f60 0x560ce85bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.886+0000 7f8be8ce4700 1 -- 172.21.15.31:0/3080184995 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8541f60 msgr2=0x560ce85bfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.886+0000 7f8be8ce4700 1 --2- 172.21.15.31:0/3080184995 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8541f60 0x560ce85bfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.886+0000 7f8be8ce4700 1 -- 172.21.15.31:0/3080184995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 msgr2=0x560ce85c00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.886+0000 7f8be8ce4700 1 --2- 172.21.15.31:0/3080184995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce85c00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.886+0000 7f8be8ce4700 1 -- 172.21.15.31:0/3080184995 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ce8437780 con 0x560ce8518a50 2023-10-09T06:24:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.886+0000 7f8be94e5700 1 --2- 172.21.15.31:0/3080184995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce85c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.886+0000 7f8be8ce4700 1 --2- 172.21.15.31:0/3080184995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce85603b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4001de0 tx=0x7f8bd4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb86e04219eba7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.886+0000 7f8bca7fc700 1 -- 172.21.15.31:0/3080184995 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4006d60 con 0x560ce8518a50 2023-10-09T06:24:57.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.886+0000 7f8bca7fc700 1 -- 172.21.15.31:0/3080184995 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd4001420 con 0x560ce8518a50 2023-10-09T06:24:57.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.886+0000 7f8bca7fc700 1 -- 172.21.15.31:0/3080184995 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40058a0 con 0x560ce8518a50 2023-10-09T06:24:57.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.887+0000 7f8bf4240b80 1 -- 172.21.15.31:0/3080184995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 msgr2=0x560ce85603b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.887+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/3080184995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce85603b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4001de0 tx=0x7f8bd4021000 comp rx=0 tx=0).stop 2023-10-09T06:24:57.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.887+0000 7f8bf4240b80 1 -- 172.21.15.31:0/3080184995 shutdown_connections 2023-10-09T06:24:57.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.887+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/3080184995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce85c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.887+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/3080184995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce85603b0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.887+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/3080184995 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8541f60 0x560ce85bfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.887+0000 7f8bf4240b80 1 -- 172.21.15.31:0/3080184995 >> 172.21.15.31:0/3080184995 conn(0x560ce851a370 msgr2=0x560ce856ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:57.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.887+0000 7f8bf4240b80 1 -- 172.21.15.31:0/3080184995 shutdown_connections 2023-10-09T06:24:57.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.887+0000 7f8bf4240b80 1 -- 172.21.15.31:0/3080184995 wait complete. 2023-10-09T06:24:57.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.887+0000 7f8bf4240b80 1 -- start start 2023-10-09T06:24:57.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.887+0000 7f8bf4240b80 1 Processor -- start 2023-10-09T06:24:57.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.888+0000 7f8bf4240b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce85ae450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.888+0000 7f8bf4240b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8541f60 0x560ce8513df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.888+0000 7f8bf4240b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce8514330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.888+0000 7f8bf4240b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce85c5fd0 con 0x560ce8518a50 2023-10-09T06:24:57.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.888+0000 7f8bf4240b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce8531d30 con 0x560ce8562d00 2023-10-09T06:24:57.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.888+0000 7f8bf4240b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ce8555be0 con 0x560ce8541f60 2023-10-09T06:24:57.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.888+0000 7f8bf4240b80 10 client.0 _ll_register_callbacks cb 0x560ce84dc110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:24:57.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.888+0000 7f8be8ce4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce85ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.888+0000 7f8be8ce4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce85ae450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59626/0 (socket says 172.21.15.31:59626) 2023-10-09T06:24:57.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.888+0000 7f8be8ce4700 1 -- 172.21.15.31:0/1025631008 learned_addr learned my addr 172.21.15.31:0/1025631008 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:57.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.888+0000 7f8be94e5700 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce8514330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.888+0000 7f8be3fff700 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8541f60 0x560ce8513df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.888+0000 7f8be8ce4700 1 -- 172.21.15.31:0/1025631008 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8541f60 msgr2=0x560ce8513df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:57.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8be8ce4700 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8541f60 0x560ce8513df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8be8ce4700 1 -- 172.21.15.31:0/1025631008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 msgr2=0x560ce8514330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:57.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8be8ce4700 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce8514330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8be8ce4700 1 -- 172.21.15.31:0/1025631008 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ce82a5fe0 con 0x560ce8518a50 2023-10-09T06:24:57.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8be3fff700 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8541f60 0x560ce8513df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:24:57.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8be8ce4700 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce85ae450 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4014830 tx=0x7f8bd4034070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f3c2fdd741d0b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:57.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bc2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:24:57.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bc2ffd700 1 -- 172.21.15.31:0/1025631008 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4040070 con 0x560ce8518a50 2023-10-09T06:24:57.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bc2ffd700 1 -- 172.21.15.31:0/1025631008 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bd4023700 con 0x560ce8518a50 2023-10-09T06:24:57.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1025631008 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8bdc058c50 con 0x560ce8518a50 2023-10-09T06:24:57.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bc2ffd700 1 -- 172.21.15.31:0/1025631008 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bd4014ce0 con 0x560ce8518a50 2023-10-09T06:24:57.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bf4240b80 10 client.6114 fetch_fsmap learned FSMap version 42 2023-10-09T06:24:57.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1025631008 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x560ce841e470 con 0x560ce8518a50 2023-10-09T06:24:57.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bc2ffd700 1 -- 172.21.15.31:0/1025631008 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc058c50 con 0x560ce8518a50 2023-10-09T06:24:57.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bc2ffd700 1 -- 172.21.15.31:0/1025631008 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8bd4023b10 con 0x560ce8518a50 2023-10-09T06:24:57.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bf4240b80 10 client.6114 fetch_fsmap finished waiting for FSMap version 42 2023-10-09T06:24:57.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bf4240b80 10 client.6114 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T06:24:57.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bf4240b80 20 client.6114 populate_metadata read hostname 'smithi031' 2023-10-09T06:24:57.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.31:6833/1373095674,v1:172.21.15.31:6835/1373095674] conn(0x560ce85c5120 0x560ce85c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:57.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bf4240b80 4 client.6114 mds_command: new command op to 5964 tid=0[{"prefix": "status"}] 2023-10-09T06:24:57.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1025631008 --> [v2:172.21.15.31:6833/1373095674,v1:172.21.15.31:6835/1373095674] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560ce840be00 con 0x560ce85c5120 2023-10-09T06:24:57.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.889+0000 7f8be3fff700 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.31:6833/1373095674,v1:172.21.15.31:6835/1373095674] conn(0x560ce85c5120 0x560ce85c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:57.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bc2ffd700 10 client.6114 ms_handle_connect on v2:172.21.15.31:6833/1373095674 2023-10-09T06:24:57.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8be3fff700 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.31:6833/1373095674,v1:172.21.15.31:6835/1373095674] conn(0x560ce85c5120 0x560ce85c54f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55770ac91eef575d server_cookie=eefc8e9051f9f53 in_seq=0 out_seq=0 2023-10-09T06:24:57.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bc2ffd700 1 -- 172.21.15.31:0/1025631008 <== mds.0 v2:172.21.15.31:6833/1373095674 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x560ce840be00 con 0x560ce85c5120 2023-10-09T06:24:57.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bc2ffd700 10 client.6114 handle_command_reply: tid=0 2023-10-09T06:24:57.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bf4240b80 1 client.6114 shutdown 2023-10-09T06:24:57.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1025631008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 msgr2=0x560ce85ae450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce85ae450 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4014830 tx=0x7f8bd4034070 comp rx=0 tx=0).stop 2023-10-09T06:24:57.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1025631008 shutdown_connections 2023-10-09T06:24:57.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.31:6833/1373095674,v1:172.21.15.31:6835/1373095674] conn(0x560ce85c5120 0x560ce85c54f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560ce8562d00 0x560ce8514330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560ce8518a50 0x560ce85ae450 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bc2ffd700 0 client.6114 ms_handle_reset on v2:172.21.15.31:6833/1373095674 2023-10-09T06:24:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bf4240b80 1 --2- 172.21.15.31:0/1025631008 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x560ce8541f60 0x560ce8513df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1025631008 >> 172.21.15.31:0/1025631008 conn(0x560ce851a370 msgr2=0x560ce85603b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1025631008 shutdown_connections 2023-10-09T06:24:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bf4240b80 1 -- 172.21.15.31:0/1025631008 wait complete. 2023-10-09T06:24:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.890+0000 7f8bf4240b80 20 client.6114 trim_cache size 0 max 16384 2023-10-09T06:24:57.912 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:24:57.912 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:24:57.912 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-10-09T06:24:57.912 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5964, 2023-10-09T06:24:57.912 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-10-09T06:24:57.912 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-10-09T06:24:57.913 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-10-09T06:24:57.913 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 5.9161111340000003, 2023-10-09T06:24:57.913 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 42, 2023-10-09T06:24:57.913 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 84, 2023-10-09T06:24:57.913 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 84, 2023-10-09T06:24:57.913 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 11.851948818 2023-10-09T06:24:57.913 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:24:57.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.891+0000 7f8beaf48700 1 -- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8bd0066f30 msgr2=0x7f8bd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.891+0000 7f8beaf48700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8bd0066f30 0x7f8bd00693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4007fd0 tx=0x7f8bd4007d30 comp rx=0 tx=0).stop 2023-10-09T06:24:57.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.891+0000 7f8beaf48700 1 -- 172.21.15.31:0/1868623861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be415d580 msgr2=0x7f8be40b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.891+0000 7f8beaf48700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be415d580 0x7f8be40b5330 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc007ef0 tx=0x7f8bdc009840 comp rx=0 tx=0).stop 2023-10-09T06:24:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.891+0000 7f8beaf48700 1 -- 172.21.15.31:0/1868623861 shutdown_connections 2023-10-09T06:24:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.891+0000 7f8beaf48700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8bd0066f30 0x7f8bd00693e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.891+0000 7f8beaf48700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4157870 0x7f8be414a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.891+0000 7f8beaf48700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be415d580 0x7f8be40b5330 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.891+0000 7f8beaf48700 1 --2- 172.21.15.31:0/1868623861 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8be415a620 0x7f8be40b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.891+0000 7f8beaf48700 1 -- 172.21.15.31:0/1868623861 >> 172.21.15.31:0/1868623861 conn(0x7f8be4068ce0 msgr2=0x7f8be414c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.891+0000 7f8beaf48700 1 -- 172.21.15.31:0/1868623861 shutdown_connections 2023-10-09T06:24:57.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:57.891+0000 7f8beaf48700 1 -- 172.21.15.31:0/1868623861 wait complete. 2023-10-09T06:24:57.917 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:24:58.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.080+0000 7f0d31913700 1 Processor -- start 2023-10-09T06:24:58.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.080+0000 7f0d31913700 1 -- start start 2023-10-09T06:24:58.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.081+0000 7f0d31913700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d2c0afe40 0x7f0d2c0b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:58.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.081+0000 7f0d31913700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d2c0d18d0 0x7f0d2c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:58.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.081+0000 7f0d31913700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2c0b0370 con 0x7f0d2c0afa70 2023-10-09T06:24:58.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.081+0000 7f0d31913700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b0f80 con 0x7f0d2c0d18d0 2023-10-09T06:24:58.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.081+0000 7f0d31913700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b0650 con 0x7f0d2c0afe40 2023-10-09T06:24:58.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.081+0000 7f0d2b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d2c0d18d0 0x7f0d2c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:58.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.081+0000 7f0d2b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d2c0d18d0 0x7f0d2c068cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59634/0 (socket says 172.21.15.31:59634) 2023-10-09T06:24:58.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.081+0000 7f0d2b7fe700 1 -- 172.21.15.31:0/2142195692 learned_addr learned my addr 172.21.15.31:0/2142195692 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:58.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.082+0000 7f0d2a7fc700 1 --2- 172.21.15.31:0/2142195692 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d2c0afe40 0x7f0d2c0b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:58.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.082+0000 7f0d2b7fe700 1 -- 172.21.15.31:0/2142195692 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d2c0afe40 msgr2=0x7f0d2c0b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:58.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.082+0000 7f0d2b7fe700 1 --2- 172.21.15.31:0/2142195692 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d2c0afe40 0x7f0d2c0b2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:58.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.082+0000 7f0d2b7fe700 1 -- 172.21.15.31:0/2142195692 >> v1:172.21.15.158:6789/0 conn(0x7f0d2c0afa70 legacy=0x7f0d2c0cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:58.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.082+0000 7f0d2b7fe700 1 -- 172.21.15.31:0/2142195692 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c0b0930 con 0x7f0d2c0d18d0 2023-10-09T06:24:58.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.082+0000 7f0d2a7fc700 1 --2- 172.21.15.31:0/2142195692 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d2c0afe40 0x7f0d2c0b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:58.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.082+0000 7f0d2b7fe700 1 --2- 172.21.15.31:0/2142195692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0d18d0 0x7f0d2c068cb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009f20 tx=0x7f0d24009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f44f75a3484ec84 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:58.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.082+0000 7f0d29ffb700 1 -- 172.21.15.31:0/2142195692 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400e070 con 0x7f0d2c0d18d0 2023-10-09T06:24:58.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.082+0000 7f0d29ffb700 1 -- 172.21.15.31:0/2142195692 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2400ba40 con 0x7f0d2c0d18d0 2023-10-09T06:24:58.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.082+0000 7f0d29ffb700 1 -- 172.21.15.31:0/2142195692 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240092e0 con 0x7f0d2c0d18d0 2023-10-09T06:24:58.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.082+0000 7f0d31913700 1 -- 172.21.15.31:0/2142195692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0d18d0 msgr2=0x7f0d2c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:58.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.082+0000 7f0d31913700 1 --2- 172.21.15.31:0/2142195692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0d18d0 0x7f0d2c068cb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009f20 tx=0x7f0d24009840 comp rx=0 tx=0).stop 2023-10-09T06:24:58.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.083+0000 7f0d31913700 1 -- 172.21.15.31:0/2142195692 shutdown_connections 2023-10-09T06:24:58.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.083+0000 7f0d31913700 1 --2- 172.21.15.31:0/2142195692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0d18d0 0x7f0d2c068cb0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:58.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.083+0000 7f0d31913700 1 --2- 172.21.15.31:0/2142195692 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d2c0afe40 0x7f0d2c0b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:58.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.083+0000 7f0d31913700 1 -- 172.21.15.31:0/2142195692 >> 172.21.15.31:0/2142195692 conn(0x7f0d2c068130 msgr2=0x7f0d2c0d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:58.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.083+0000 7f0d31913700 1 -- 172.21.15.31:0/2142195692 shutdown_connections 2023-10-09T06:24:58.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.083+0000 7f0d31913700 1 -- 172.21.15.31:0/2142195692 wait complete. 2023-10-09T06:24:58.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.084+0000 7f0d31913700 1 Processor -- start 2023-10-09T06:24:58.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.084+0000 7f0d31913700 1 -- start start 2023-10-09T06:24:58.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d31913700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0afa70 0x7f0d2c16e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:58.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d31913700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d2c0d18d0 0x7f0d2c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:58.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d31913700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d2c0b6130 0x7f0d2c16b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:58.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d31913700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c153ac0 con 0x7f0d2c0afa70 2023-10-09T06:24:58.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d31913700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b5760 con 0x7f0d2c0d18d0 2023-10-09T06:24:58.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d31913700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c16e590 con 0x7f0d2c0b6130 2023-10-09T06:24:58.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d2affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0afa70 0x7f0d2c16e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:58.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d2affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0afa70 0x7f0d2c16e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59644/0 (socket says 172.21.15.31:59644) 2023-10-09T06:24:58.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d2affd700 1 -- 172.21.15.31:0/1700068742 learned_addr learned my addr 172.21.15.31:0/1700068742 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:58.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d2b7fe700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d2c0b6130 0x7f0d2c16b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:58.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d2a7fc700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d2c0d18d0 0x7f0d2c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:58.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d2affd700 1 -- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d2c0b6130 msgr2=0x7f0d2c16b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:58.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d2affd700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d2c0b6130 0x7f0d2c16b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:58.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d2affd700 1 -- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d2c0d18d0 msgr2=0x7f0d2c0b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:58.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d2affd700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d2c0d18d0 0x7f0d2c0b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:58.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d2affd700 1 -- 172.21.15.31:0/1700068742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24009ae0 con 0x7f0d2c0afa70 2023-10-09T06:24:58.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d2b7fe700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d2c0b6130 0x7f0d2c16b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:58.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d2a7fc700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d2c0d18d0 0x7f0d2c0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:24:58.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d2affd700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0afa70 0x7f0d2c16e050 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c5d0 tx=0x7f0d1c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:58.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d22ffd700 1 -- 172.21.15.31:0/1700068742 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c011590 con 0x7f0d2c0afa70 2023-10-09T06:24:58.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d22ffd700 1 -- 172.21.15.31:0/1700068742 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c011710 con 0x7f0d2c0afa70 2023-10-09T06:24:58.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d31913700 1 -- 172.21.15.31:0/1700068742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2c0b4b50 con 0x7f0d2c0afa70 2023-10-09T06:24:58.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d22ffd700 1 -- 172.21.15.31:0/1700068742 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c011ad0 con 0x7f0d2c0afa70 2023-10-09T06:24:58.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.085+0000 7f0d31913700 1 -- 172.21.15.31:0/1700068742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2c0b5110 con 0x7f0d2c0afa70 2023-10-09T06:24:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.086+0000 7f0d31913700 1 -- 172.21.15.31:0/1700068742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2c0b5a40 con 0x7f0d2c0afa70 2023-10-09T06:24:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.087+0000 7f0d22ffd700 1 -- 172.21.15.31:0/1700068742 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d1c01c460 con 0x7f0d2c0afa70 2023-10-09T06:24:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.087+0000 7f0d22ffd700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d0c066f30 0x7f0d0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.087+0000 7f0d22ffd700 1 -- 172.21.15.31:0/1700068742 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d1c084330 con 0x7f0d2c0afa70 2023-10-09T06:24:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.087+0000 7f0d2a7fc700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d0c066f30 0x7f0d0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.088+0000 7f0d2a7fc700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d0c066f30 0x7f0d0c0693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0d14006fd0 tx=0x7f0d14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:58.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.091+0000 7f0d22ffd700 1 -- 172.21.15.31:0/1700068742 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d1c0515a0 con 0x7f0d2c0afa70 2023-10-09T06:24:58.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.330+0000 7f0d31913700 1 -- 172.21.15.31:0/1700068742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0d2c04c3c0 con 0x7f0d2c0afa70 2023-10-09T06:24:58.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.330+0000 7f0d22ffd700 1 -- 172.21.15.31:0/1700068742 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0d1c054bc0 con 0x7f0d2c0afa70 2023-10-09T06:24:58.331 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:24:58.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.332+0000 7f0d31913700 1 -- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d0c066f30 msgr2=0x7f0d0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:58.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.332+0000 7f0d31913700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d0c066f30 0x7f0d0c0693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0d14006fd0 tx=0x7f0d14008040 comp rx=0 tx=0).stop 2023-10-09T06:24:58.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.332+0000 7f0d31913700 1 -- 172.21.15.31:0/1700068742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0afa70 msgr2=0x7f0d2c16e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:58.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.332+0000 7f0d31913700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0afa70 0x7f0d2c16e050 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c5d0 tx=0x7f0d1c007f60 comp rx=0 tx=0).stop 2023-10-09T06:24:58.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.332+0000 7f0d31913700 1 -- 172.21.15.31:0/1700068742 shutdown_connections 2023-10-09T06:24:58.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.332+0000 7f0d31913700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d0c066f30 0x7f0d0c0693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:58.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.332+0000 7f0d31913700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d2c0b6130 0x7f0d2c16b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:58.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.332+0000 7f0d31913700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0afa70 0x7f0d2c16e050 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:58.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.332+0000 7f0d31913700 1 --2- 172.21.15.31:0/1700068742 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d2c0d18d0 0x7f0d2c0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:58.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.332+0000 7f0d31913700 1 -- 172.21.15.31:0/1700068742 >> 172.21.15.31:0/1700068742 conn(0x7f0d2c068130 msgr2=0x7f0d2c0cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:58.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.332+0000 7f0d31913700 1 -- 172.21.15.31:0/1700068742 shutdown_connections 2023-10-09T06:24:58.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:58.333+0000 7f0d31913700 1 -- 172.21.15.31:0/1700068742 wait complete. 2023-10-09T06:24:58.345 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:24:58.346 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:24:58.346 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-10-09T06:24:58.346 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:24:58.346 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:24:58.346 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:24:58.346 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:24:58.346 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:24:58.346 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:24:58.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:58.347 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-10-09T06:24:58.363 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:24:58.363 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:24:58.363 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:24:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:24:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:58.364 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:24:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T06:24:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-10-09T06:24:58.364 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:24:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T06:24:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-10-09T06:24:58.364 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:24:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-10-09T06:24:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-10-09T06:24:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T06:24:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42268sec preferred_lft 42268sec 2023-10-09T06:24:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-10-09T06:24:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:58.365 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:24:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:24:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-10-09T06:24:58.365 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:24:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:24:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:24:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::b4ad:53ff:fed3:a589/64 scope link 2023-10-09T06:24:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:58.366 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:24:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether f6:bf:b8:0f:49:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:24:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::f4bf:b8ff:fe0f:498b/64 scope link 2023-10-09T06:24:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:58.366 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:24:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:24:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::d8ab:b5ff:fe1d:e066/64 scope link 2023-10-09T06:24:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:58.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:58.367 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:24:58.436 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-10-09T06:24:58.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:58.437 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-10-09T06:24:58.501 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-10-09T06:24:58.501 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:24:58.502 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T06:24:58.502 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T06:24:58.502 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:24:58.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:58.502 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:24:58.502 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:24:58.502 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T06:24:58.502 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T06:24:58.503 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T06:24:58.503 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:24:58.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:58.607 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:24:58.627 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:24:58.627 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:24:58.628 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:24:58.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:58.628 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-10-09T06:24:58.697 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:24:58.698 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:24:58.759 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:24:58.759 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:24:58.759 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:24:58.817 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:24:58.818 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:24:58.818 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:24:58.905 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:24:58.906 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:24:58.924 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:24:58.925 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:24:58.925 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:24:58.925 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:24:58.925 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:24:58.925 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:24:58.926 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:24:58.926 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:24:58.946 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:24:58.946 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:24:58.946 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:24:58.946 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:24:58.946 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:24:58.946 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:24:58.946 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:24:58.946 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:24:58.946 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:24:58.947 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:24:58.947 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:24:58.948 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:24:58.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:58.949 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:24:59.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:24:59.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.176+0000 7f7bf8c8a700 1 Processor -- start 2023-10-09T06:24:59.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.176+0000 7f7bf8c8a700 1 -- start start 2023-10-09T06:24:59.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf8c8a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7bf40d1c30 0x7f7bf40ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:59.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf8c8a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf40c5d80 con 0x7f7bf415a680 2023-10-09T06:24:59.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf8c8a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf40c6060 con 0x7f7bf415a2b0 2023-10-09T06:24:59.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf8c8a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf4068470 con 0x7f7bf40d1c30 2023-10-09T06:24:59.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf2d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7bf415a680 0x7f7bf40cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54730/0 (socket says 172.21.15.31:54730) 2023-10-09T06:24:59.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf2d9d700 1 -- 172.21.15.31:0/3627283469 learned_addr learned my addr 172.21.15.31:0/3627283469 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:24:59.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf1d9b700 1 --2- 172.21.15.31:0/3627283469 >> v2:172.21.15.158:3300/0 conn(0x7f7bf40d1c30 0x7f7bf40ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:59.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027895788 0 0) 0x7f7bf40c5d80 con 0x7f7bf415a680 2023-10-09T06:24:59.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bdc003570 con 0x7f7bf415a680 2023-10-09T06:24:59.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807462050 0 0) 0x7f7bf40c6060 con 0x7f7bf415a2b0 2023-10-09T06:24:59.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf40c5d80 con 0x7f7bf415a2b0 2023-10-09T06:24:59.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 55785956 0 0) 0x7f7bdc003570 con 0x7f7bf415a680 2023-10-09T06:24:59.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 >> v2:172.21.15.158:3300/0 conn(0x7f7bf40d1c30 msgr2=0x7f7bf40ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:59.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf159a700 1 --2- 172.21.15.31:0/3627283469 >> v2:172.21.15.158:3300/0 conn(0x7f7bf40d1c30 0x7f7bf40ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:59.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.177+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 >> v1:172.21.15.158:6789/0 conn(0x7f7bf415a2b0 legacy=0x7f7bf40b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:59.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf40c6340 con 0x7f7bf415a680 2023-10-09T06:24:59.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f7bec0017f0 con 0x7f7bf415a680 2023-10-09T06:24:59.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf1d9b700 1 --2- 172.21.15.31:0/3627283469 >> v2:172.21.15.158:3300/0 conn(0x7f7bf40d1c30 0x7f7bf40ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:24:59.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 >> v1:172.21.15.31:6789/0 conn(0x7f7bf415a680 legacy=0x7f7bf40cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:59.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf159a700 1 --2- 172.21.15.31:0/3627283469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bdc003bf0 0x7f7bdc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:59.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf159a700 1 --2- 172.21.15.31:0/3627283469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bdc004810 0x7f7bdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:59.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf159a700 1 --2- 172.21.15.31:0/3627283469 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7bdc0051c0 0x7f7bdc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:59.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4068470 con 0x7f7bdc004810 2023-10-09T06:24:59.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc00c0b0 con 0x7f7bdc003bf0 2023-10-09T06:24:59.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc00c270 con 0x7f7bdc0051c0 2023-10-09T06:24:59.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf1d9b700 1 --2- 172.21.15.31:0/3627283469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bdc004810 0x7f7bdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:59.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf259c700 1 --2- 172.21.15.31:0/3627283469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bdc003bf0 0x7f7bdc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:59.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf2d9d700 1 --2- 172.21.15.31:0/3627283469 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7bdc0051c0 0x7f7bdc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:59.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf1d9b700 1 -- 172.21.15.31:0/3627283469 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7bdc0051c0 msgr2=0x7f7bdc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:59.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf1d9b700 1 --2- 172.21.15.31:0/3627283469 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7bdc0051c0 0x7f7bdc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:59.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf1d9b700 1 -- 172.21.15.31:0/3627283469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bdc003bf0 msgr2=0x7f7bdc003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:24:59.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf1d9b700 1 --2- 172.21.15.31:0/3627283469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bdc003bf0 0x7f7bdc003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:59.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf1d9b700 1 -- 172.21.15.31:0/3627283469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc003570 con 0x7f7bdc004810 2023-10-09T06:24:59.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf2d9d700 1 -- 172.21.15.31:0/3627283469 reap_dead start 2023-10-09T06:24:59.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf1d9b700 1 --2- 172.21.15.31:0/3627283469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bdc004810 0x7f7bdc004c80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40d2000 tx=0x7f7be80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00dee0e64dbb201 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:59.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8009740 con 0x7f7bdc004810 2023-10-09T06:24:59.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be800e920 con 0x7f7bdc004810 2023-10-09T06:24:59.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.178+0000 7f7bf159a700 1 -- 172.21.15.31:0/3627283469 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be800ece0 con 0x7f7bdc004810 2023-10-09T06:24:59.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.179+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/3627283469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bdc004810 msgr2=0x7f7bdc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:59.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.179+0000 7f7bf8c8a700 1 --2- 172.21.15.31:0/3627283469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bdc004810 0x7f7bdc004c80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40d2000 tx=0x7f7be80091a0 comp rx=0 tx=0).stop 2023-10-09T06:24:59.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.179+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/3627283469 shutdown_connections 2023-10-09T06:24:59.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.179+0000 7f7bf8c8a700 1 --2- 172.21.15.31:0/3627283469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bdc004810 0x7f7bdc004c80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:59.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.179+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/3627283469 >> 172.21.15.31:0/3627283469 conn(0x7f7bf4067e40 msgr2=0x7f7bf40d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:59.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.179+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/3627283469 shutdown_connections 2023-10-09T06:24:59.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.179+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/3627283469 wait complete. 2023-10-09T06:24:59.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.180+0000 7f7bf8c8a700 1 Processor -- start 2023-10-09T06:24:59.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.180+0000 7f7bf8c8a700 1 -- start start 2023-10-09T06:24:59.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf8c8a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bdc004810 0x7f7bf416b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:59.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf8c8a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7bf4156b70 0x7f7bf4156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:59.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf8c8a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf415aa80 0x7f7bf40c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:59.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf8c8a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf415d1f0 con 0x7f7bf415aa80 2023-10-09T06:24:59.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf8c8a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40c8090 con 0x7f7bdc004810 2023-10-09T06:24:59.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf8c8a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf416b7b0 con 0x7f7bf4156b70 2023-10-09T06:24:59.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf2d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf415aa80 0x7f7bf40c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:59.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf2d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf415aa80 0x7f7bf40c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59666/0 (socket says 172.21.15.31:59666) 2023-10-09T06:24:59.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf2d9d700 1 -- 172.21.15.31:0/470726172 learned_addr learned my addr 172.21.15.31:0/470726172 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:24:59.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf259c700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bdc004810 0x7f7bf416b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:59.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf1d9b700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7bf4156b70 0x7f7bf4156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:59.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf2d9d700 1 -- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7bf4156b70 msgr2=0x7f7bf4156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:59.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf2d9d700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7bf4156b70 0x7f7bf4156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:59.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf2d9d700 1 -- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bdc004810 msgr2=0x7f7bf416b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:59.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf2d9d700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bdc004810 0x7f7bf416b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:59.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf2d9d700 1 -- 172.21.15.31:0/470726172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf4156880 con 0x7f7bf415aa80 2023-10-09T06:24:59.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.181+0000 7f7bf2d9d700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf415aa80 0x7f7bf40c9ec0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40cb5a0 tx=0x7f7bec002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:59.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.182+0000 7f7be27fc700 1 -- 172.21.15.31:0/470726172 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec007b50 con 0x7f7bf415aa80 2023-10-09T06:24:59.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.182+0000 7f7be27fc700 1 -- 172.21.15.31:0/470726172 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec00eb10 con 0x7f7bf415aa80 2023-10-09T06:24:59.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.182+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/470726172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf415d440 con 0x7f7bf415aa80 2023-10-09T06:24:59.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.182+0000 7f7be27fc700 1 -- 172.21.15.31:0/470726172 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00eed0 con 0x7f7bf415aa80 2023-10-09T06:24:59.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.182+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/470726172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf40c82e0 con 0x7f7bf415aa80 2023-10-09T06:24:59.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.182+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/470726172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf404c3c0 con 0x7f7bf415aa80 2023-10-09T06:24:59.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.183+0000 7f7be27fc700 1 -- 172.21.15.31:0/470726172 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bec013630 con 0x7f7bf415aa80 2023-10-09T06:24:59.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.183+0000 7f7be27fc700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7bd4066f30 0x7f7bd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:24:59.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.183+0000 7f7be27fc700 1 -- 172.21.15.31:0/470726172 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7bec084970 con 0x7f7bf415aa80 2023-10-09T06:24:59.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.184+0000 7f7bf259c700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7bd4066f30 0x7f7bd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:24:59.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.184+0000 7f7bf259c700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7bd4066f30 0x7f7bd40693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7be4000c00 tx=0x7f7be4007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:24:59.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.188+0000 7f7be27fc700 1 -- 172.21.15.31:0/470726172 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bec051be0 con 0x7f7bf415aa80 2023-10-09T06:24:59.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.428+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/470726172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7bf404c3c0 con 0x7f7bf415aa80 2023-10-09T06:24:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.428+0000 7f7be27fc700 1 -- 172.21.15.31:0/470726172 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7bec055200 con 0x7f7bf415aa80 2023-10-09T06:24:59.429 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:24:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.430+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7bd4066f30 msgr2=0x7f7bd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.430+0000 7f7bf8c8a700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7bd4066f30 0x7f7bd40693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7be4000c00 tx=0x7f7be4007d80 comp rx=0 tx=0).stop 2023-10-09T06:24:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.430+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/470726172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf415aa80 msgr2=0x7f7bf40c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:24:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.430+0000 7f7bf8c8a700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf415aa80 0x7f7bf40c9ec0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40cb5a0 tx=0x7f7bec002170 comp rx=0 tx=0).stop 2023-10-09T06:24:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.431+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/470726172 shutdown_connections 2023-10-09T06:24:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.431+0000 7f7bf8c8a700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7bd4066f30 0x7f7bd40693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.431+0000 7f7bf8c8a700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf415aa80 0x7f7bf40c9ec0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.431+0000 7f7bf8c8a700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7bdc004810 0x7f7bf416b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.431+0000 7f7bf8c8a700 1 --2- 172.21.15.31:0/470726172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7bf4156b70 0x7f7bf4156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:24:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.431+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/470726172 >> 172.21.15.31:0/470726172 conn(0x7f7bf4067e40 msgr2=0x7f7bf4069020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:24:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.431+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/470726172 shutdown_connections 2023-10-09T06:24:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:24:59.431+0000 7f7bf8c8a700 1 -- 172.21.15.31:0/470726172 wait complete. 2023-10-09T06:24:59.443 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:24:59.443 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:24:59.443 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-09T06:24:59.443 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T06:24:59.443 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T06:24:59.443 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:24:59.444 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:24:59.444 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:24:59.444 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:24:59.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:59.444 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-09T06:24:59.462 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:24:59.462 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:24:59.462 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:24:59.462 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:59.463 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:24:59.463 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:59.463 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:24:59.463 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:24:59.463 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-09T06:24:59.463 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:24:59.463 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:24:59.463 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-09T06:24:59.463 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:24:59.463 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-09T06:24:59.463 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:24:59.464 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:24:59.464 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:24:59.464 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42294sec preferred_lft 42294sec 2023-10-09T06:24:59.464 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-09T06:24:59.464 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:59.464 INFO:teuthology.orchestra.run.smithi158.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:24:59.464 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:24:59.464 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:24:59.464 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:59.464 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::c5:35ff:fec9:1844/64 scope link 2023-10-09T06:24:59.464 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:59.465 INFO:teuthology.orchestra.run.smithi158.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:24:59.465 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether e6:10:14:7c:a4:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:24:59.465 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::e410:14ff:fe7c:a4d7/64 scope link 2023-10-09T06:24:59.465 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:59.465 INFO:teuthology.orchestra.run.smithi158.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:24:59.465 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T06:24:59.465 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::44a9:f1ff:fe2b:babb/64 scope link 2023-10-09T06:24:59.465 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:24:59.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:59.466 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:24:59.530 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-09T06:24:59.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:59.530 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-09T06:24:59.588 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-09T06:24:59.588 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:24:59.588 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:24:59.588 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:24:59.588 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:24:59.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:59.589 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:24:59.589 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:24:59.589 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:24:59.589 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:24:59.589 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:24:59.589 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:24:59.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:59.694 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:24:59.709 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T06:24:59.709 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T06:24:59.710 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:24:59.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:24:59.710 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-09T06:24:59.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:24:59.775 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T06:24:59.830 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:24:59.830 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:24:59.830 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:24:59.884 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T06:24:59.884 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:24:59.884 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:24:59.964 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:24:59.964 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:24:59.983 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:24:59.983 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:24:59.983 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:24:59.983 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:24:59.984 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:24:59.984 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:24:59.984 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:24:59.984 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:25:00.005 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:25:00.005 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:25:00.005 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:25:00.005 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:25:00.005 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:25:00.005 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:25:00.005 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:25:00.005 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:25:00.005 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:25:00.006 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:25:00.006 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:25:00.007 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:25:00.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:25:00.007 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:25:00.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:25:00.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.195+0000 7f810cc09700 1 Processor -- start 2023-10-09T06:25:00.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.195+0000 7f810cc09700 1 -- start start 2023-10-09T06:25:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.196+0000 7f810cc09700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8108159cf0 0x7f810815e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.196+0000 7f810cc09700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f81080cf1c0 0x7f8108068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.196+0000 7f810cc09700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81080cca20 con 0x7f810815a0c0 2023-10-09T06:25:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.196+0000 7f810cc09700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810815ea40 con 0x7f81080cf1c0 2023-10-09T06:25:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.196+0000 7f810cc09700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8108067660 con 0x7f8108159cf0 2023-10-09T06:25:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f8105d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f810815a0c0 0x7f81080ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44586/0 (socket says 172.21.15.31:44586) 2023-10-09T06:25:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f8105d9b700 1 -- 172.21.15.31:0/4249996942 learned_addr learned my addr 172.21.15.31:0/4249996942 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f810659c700 1 --2- 172.21.15.31:0/4249996942 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8108159cf0 0x7f810815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f8106d9d700 1 --2- 172.21.15.31:0/4249996942 >> v2:172.21.15.158:3300/0 conn(0x7f81080cf1c0 0x7f8108068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f810559a700 1 -- 172.21.15.31:0/4249996942 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259742791 0 0) 0x7f81080cca20 con 0x7f810815a0c0 2023-10-09T06:25:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f810559a700 1 -- 172.21.15.31:0/4249996942 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80f4003570 con 0x7f810815a0c0 2023-10-09T06:25:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f8106d9d700 1 -- 172.21.15.31:0/4249996942 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8108159cf0 msgr2=0x7f810815e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f810559a700 1 -- 172.21.15.31:0/4249996942 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 395142396 0 0) 0x7f80f4003570 con 0x7f810815a0c0 2023-10-09T06:25:00.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f8106d9d700 1 --2- 172.21.15.31:0/4249996942 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8108159cf0 0x7f810815e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:00.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f8106d9d700 1 -- 172.21.15.31:0/4249996942 >> v1:172.21.15.31:6789/0 conn(0x7f810815a0c0 legacy=0x7f81080ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:00.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f8106d9d700 1 -- 172.21.15.31:0/4249996942 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8108067f00 con 0x7f81080cf1c0 2023-10-09T06:25:00.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f810659c700 1 --2- 172.21.15.31:0/4249996942 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8108159cf0 0x7f810815e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:25:00.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f8106d9d700 1 --2- 172.21.15.31:0/4249996942 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f81080cf1c0 0x7f8108068390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f80f80098e0 tx=0x7f80f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4144848cedcb3f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:00.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.197+0000 7f810559a700 1 -- 172.21.15.31:0/4249996942 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0001470 con 0x7f81080cf1c0 2023-10-09T06:25:00.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.198+0000 7f810559a700 1 -- 172.21.15.31:0/4249996942 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f8011420 con 0x7f81080cf1c0 2023-10-09T06:25:00.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.198+0000 7f810559a700 1 -- 172.21.15.31:0/4249996942 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f80117c0 con 0x7f81080cf1c0 2023-10-09T06:25:00.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.198+0000 7f810cc09700 1 -- 172.21.15.31:0/4249996942 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f81080cf1c0 msgr2=0x7f8108068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:00.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.198+0000 7f810cc09700 1 --2- 172.21.15.31:0/4249996942 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f81080cf1c0 0x7f8108068390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f80f80098e0 tx=0x7f80f80091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:00.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.198+0000 7f810cc09700 1 -- 172.21.15.31:0/4249996942 shutdown_connections 2023-10-09T06:25:00.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.198+0000 7f810cc09700 1 --2- 172.21.15.31:0/4249996942 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f81080cf1c0 0x7f8108068390 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:00.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.198+0000 7f810cc09700 1 --2- 172.21.15.31:0/4249996942 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8108159cf0 0x7f810815e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:00.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.198+0000 7f810cc09700 1 -- 172.21.15.31:0/4249996942 >> 172.21.15.31:0/4249996942 conn(0x7f810806c6e0 msgr2=0x7f8108069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:00.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.198+0000 7f810cc09700 1 -- 172.21.15.31:0/4249996942 shutdown_connections 2023-10-09T06:25:00.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.198+0000 7f810cc09700 1 -- 172.21.15.31:0/4249996942 wait complete. 2023-10-09T06:25:00.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.199+0000 7f810cc09700 1 Processor -- start 2023-10-09T06:25:00.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.199+0000 7f810cc09700 1 -- start start 2023-10-09T06:25:00.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f810cc09700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f81080cf1c0 0x7f81080c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:00.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f810cc09700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8108159cf0 0x7f81080c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:00.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f810cc09700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f810815a0c0 0x7f81081583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:00.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f810cc09700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81080c83b0 con 0x7f8108159cf0 2023-10-09T06:25:00.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f810cc09700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81080c8bf0 con 0x7f810815a0c0 2023-10-09T06:25:00.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f810cc09700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810815a670 con 0x7f81080cf1c0 2023-10-09T06:25:00.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f8105d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8108159cf0 0x7f81080c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:00.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f8105d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8108159cf0 0x7f81080c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40056/0 (socket says 172.21.15.31:40056) 2023-10-09T06:25:00.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f8105d9b700 1 -- 172.21.15.31:0/3480109086 learned_addr learned my addr 172.21.15.31:0/3480109086 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:00.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f8106d9d700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f810815a0c0 0x7f81081583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:00.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f810659c700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f81080cf1c0 0x7f81080c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:00.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f8105d9b700 1 -- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f81080cf1c0 msgr2=0x7f81080c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:00.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f8105d9b700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f81080cf1c0 0x7f81080c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:00.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f8105d9b700 1 -- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f810815a0c0 msgr2=0x7f81081583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:00.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f8105d9b700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f810815a0c0 0x7f81081583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:00.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.200+0000 7f8105d9b700 1 -- 172.21.15.31:0/3480109086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100009a20 con 0x7f8108159cf0 2023-10-09T06:25:00.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.201+0000 7f8106d9d700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f810815a0c0 0x7f81081583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:25:00.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.201+0000 7f8105d9b700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8108159cf0 0x7f81080c7e70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c990 tx=0x7f80f0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:00.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.201+0000 7f80fe7fc700 1 -- 172.21.15.31:0/3480109086 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0005b30 con 0x7f8108159cf0 2023-10-09T06:25:00.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.201+0000 7f80fe7fc700 1 -- 172.21.15.31:0/3480109086 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0005c90 con 0x7f8108159cf0 2023-10-09T06:25:00.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.201+0000 7f810cc09700 1 -- 172.21.15.31:0/3480109086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f8009420 con 0x7f8108159cf0 2023-10-09T06:25:00.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.201+0000 7f80fe7fc700 1 -- 172.21.15.31:0/3480109086 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0007320 con 0x7f8108159cf0 2023-10-09T06:25:00.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.201+0000 7f810cc09700 1 -- 172.21.15.31:0/3480109086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810815ac30 con 0x7f8108159cf0 2023-10-09T06:25:00.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.202+0000 7f810cc09700 1 -- 172.21.15.31:0/3480109086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810804c3c0 con 0x7f8108159cf0 2023-10-09T06:25:00.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.202+0000 7f80fe7fc700 1 -- 172.21.15.31:0/3480109086 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80f001b400 con 0x7f8108159cf0 2023-10-09T06:25:00.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.203+0000 7f80fe7fc700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f80e8066f30 0x7f80e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:00.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.203+0000 7f80fe7fc700 1 -- 172.21.15.31:0/3480109086 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f80f0084320 con 0x7f8108159cf0 2023-10-09T06:25:00.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.203+0000 7f810659c700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f80e8066f30 0x7f80e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:00.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.203+0000 7f810659c700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f80e8066f30 0x7f80e80693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8100009fd0 tx=0x7f810000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:00.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.207+0000 7f80fe7fc700 1 -- 172.21.15.31:0/3480109086 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80f00514f0 con 0x7f8108159cf0 2023-10-09T06:25:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.450+0000 7f810cc09700 1 -- 172.21.15.31:0/3480109086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81080ce730 con 0x7f8108159cf0 2023-10-09T06:25:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.451+0000 7f80fe7fc700 1 -- 172.21.15.31:0/3480109086 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f80f0054b10 con 0x7f8108159cf0 2023-10-09T06:25:00.452 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:00.452 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2895057012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2895057012},{"type":"v1","addr":"172.21.15.158:6836","nonce":2895057012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5707,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/756230701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":756230701},{"type":"v1","addr":"172.21.15.158:6837","nonce":756230701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5961,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2803435352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2803435352},{"type":"v1","addr":"172.21.15.31:6834","nonce":2803435352}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:24:51.381116+0000","modified":"2023-10-09T06:24:54.984865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1373095674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1373095674},{"type":"v1","addr":"172.21.15.31:6835","nonce":1373095674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T06:25:00.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.453+0000 7f810cc09700 1 -- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f80e8066f30 msgr2=0x7f80e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:00.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.453+0000 7f810cc09700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f80e8066f30 0x7f80e80693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8100009fd0 tx=0x7f810000b040 comp rx=0 tx=0).stop 2023-10-09T06:25:00.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.453+0000 7f810cc09700 1 -- 172.21.15.31:0/3480109086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8108159cf0 msgr2=0x7f81080c7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:00.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.453+0000 7f810cc09700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8108159cf0 0x7f81080c7e70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c990 tx=0x7f80f0001a00 comp rx=0 tx=0).stop 2023-10-09T06:25:00.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.453+0000 7f810cc09700 1 -- 172.21.15.31:0/3480109086 shutdown_connections 2023-10-09T06:25:00.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.453+0000 7f810cc09700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f80e8066f30 0x7f80e80693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:00.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.453+0000 7f810cc09700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f81080cf1c0 0x7f81080c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:00.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.453+0000 7f810cc09700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f810815a0c0 0x7f81081583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:00.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.453+0000 7f810cc09700 1 --2- 172.21.15.31:0/3480109086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8108159cf0 0x7f81080c7e70 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:00.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.453+0000 7f810cc09700 1 -- 172.21.15.31:0/3480109086 >> 172.21.15.31:0/3480109086 conn(0x7f810806c6e0 msgr2=0x7f81080ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:00.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.453+0000 7f810cc09700 1 -- 172.21.15.31:0/3480109086 shutdown_connections 2023-10-09T06:25:00.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:00.453+0000 7f810cc09700 1 -- 172.21.15.31:0/3480109086 wait complete. 2023-10-09T06:25:00.455 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 42 2023-10-09T06:25:00.466 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-09T06:25:00.604 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":5964,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.6193221350000009,"mdsmap_epoch":42,"osdmap_epoch":84,"osdmap_epoch_barrier":84,"uptime":14.555160298000001} 2023-10-09T06:25:00.604 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 5964, "mdsmap_epoch": 42, "osdmap_epoch": 84, "osdmap_epoch_barrier": 84, "rank_uptime": 8.619322135, "state": "up:active", "uptime": 14.555160298, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:25:00.605 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T06:25:00.739 INFO:teuthology.orchestra.run.smithi031.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T06:25:00.740 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T06:25:00.740 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-09T06:25:00.866 INFO:teuthology.orchestra.run.smithi031.stdout:{"mon_tick_interval":"5"} 2023-10-09T06:25:00.867 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-09T06:25:00.867 INFO:tasks.cephfs.test_full:pool capacity 557082176, 531MB should be enough to fill it 2023-10-09T06:25:00.867 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T06:25:00.867 DEBUG:teuthology.orchestra.run.smithi031:> import time 2023-10-09T06:25:00.867 DEBUG:teuthology.orchestra.run.smithi031:> import datetime 2023-10-09T06:25:00.867 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2023-10-09T06:25:00.867 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-10-09T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi031:> # Write some buffered data through before going full, all should be well 2023-10-09T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi031:> print("writing some data through which we expect to succeed") 2023-10-09T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi031:> bytes = 0 2023-10-09T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi031:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-09T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi031:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-09T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi031:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-09T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(f) 2023-10-09T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi031:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-09T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi031:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-09T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi031:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-09T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi031:> # buffered IO, the error should always only appear from fsync and not 2023-10-09T06:25:00.869 DEBUG:teuthology.orchestra.run.smithi031:> # from write 2023-10-09T06:25:00.869 DEBUG:teuthology.orchestra.run.smithi031:> full = False 2023-10-09T06:25:00.869 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:25:00.869 DEBUG:teuthology.orchestra.run.smithi031:> for n in range(0, int(531 * 1.1)): 2023-10-09T06:25:00.869 DEBUG:teuthology.orchestra.run.smithi031:> try: 2023-10-09T06:25:00.869 DEBUG:teuthology.orchestra.run.smithi031:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-09T06:25:00.869 DEBUG:teuthology.orchestra.run.smithi031:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-09T06:25:00.869 DEBUG:teuthology.orchestra.run.smithi031:> except OSError as e: 2023-10-09T06:25:00.869 DEBUG:teuthology.orchestra.run.smithi031:> if False: 2023-10-09T06:25:00.869 DEBUG:teuthology.orchestra.run.smithi031:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-09T06:25:00.869 DEBUG:teuthology.orchestra.run.smithi031:> raise 2023-10-09T06:25:00.869 DEBUG:teuthology.orchestra.run.smithi031:> else: 2023-10-09T06:25:00.869 DEBUG:teuthology.orchestra.run.smithi031:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-09T06:25:00.870 DEBUG:teuthology.orchestra.run.smithi031:> full = True 2023-10-09T06:25:00.870 DEBUG:teuthology.orchestra.run.smithi031:> break 2023-10-09T06:25:00.870 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:25:00.870 DEBUG:teuthology.orchestra.run.smithi031:> try: 2023-10-09T06:25:00.870 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(f) 2023-10-09T06:25:00.870 DEBUG:teuthology.orchestra.run.smithi031:> print("fsync'"'"'ed successfully") 2023-10-09T06:25:00.870 DEBUG:teuthology.orchestra.run.smithi031:> except OSError as e: 2023-10-09T06:25:00.870 DEBUG:teuthology.orchestra.run.smithi031:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-09T06:25:00.870 DEBUG:teuthology.orchestra.run.smithi031:> full = True 2023-10-09T06:25:00.870 DEBUG:teuthology.orchestra.run.smithi031:> break 2023-10-09T06:25:00.870 DEBUG:teuthology.orchestra.run.smithi031:> else: 2023-10-09T06:25:00.870 DEBUG:teuthology.orchestra.run.smithi031:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-09T06:25:00.870 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi031:> if n > 531 * 0.9: 2023-10-09T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi031:> # Be cautious in the last region where we expect to hit 2023-10-09T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi031:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-09T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi031:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-09T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(15.0) 2023-10-09T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi031:> if not full: 2023-10-09T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-09T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi031:> # close() should not raise an error because we already caught it in 2023-10-09T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi031:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-09T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi031:> # since then because all IOs got cancelled on the full flag. 2023-10-09T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi031:> print("calling close") 2023-10-09T06:25:00.872 DEBUG:teuthology.orchestra.run.smithi031:> os.close(f) 2023-10-09T06:25:00.872 DEBUG:teuthology.orchestra.run.smithi031:> print("close() did not raise error") 2023-10-09T06:25:00.872 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:25:00.872 DEBUG:teuthology.orchestra.run.smithi031:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-09T06:25:00.872 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-10-09T06:25:01.262 INFO:teuthology.orchestra.run.smithi031.stdout:writing some data through which we expect to succeed 2023-10-09T06:25:01.263 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-09T06:25:01.263 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.263 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.263 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 1.00 MB 2023-10-09T06:25:01.263 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.263 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.263 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 2.00 MB 2023-10-09T06:25:01.263 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.263 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.264 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 3.00 MB 2023-10-09T06:25:01.264 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.264 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.264 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 4.00 MB 2023-10-09T06:25:01.264 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.264 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.264 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 5.00 MB 2023-10-09T06:25:01.264 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.264 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.264 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 6.00 MB 2023-10-09T06:25:01.264 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.265 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.265 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 7.00 MB 2023-10-09T06:25:01.265 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.265 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.265 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 8.00 MB 2023-10-09T06:25:01.265 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.265 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.265 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 9.00 MB 2023-10-09T06:25:01.265 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.265 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.265 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 10.00 MB 2023-10-09T06:25:01.265 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.266 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.266 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 11.00 MB 2023-10-09T06:25:01.266 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.266 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.266 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 12.00 MB 2023-10-09T06:25:01.266 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.266 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.266 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 13.00 MB 2023-10-09T06:25:01.266 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.266 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.266 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 14.00 MB 2023-10-09T06:25:01.267 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.267 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.267 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 15.00 MB 2023-10-09T06:25:01.267 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.267 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.267 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 16.00 MB 2023-10-09T06:25:01.267 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.267 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.268 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 17.00 MB 2023-10-09T06:25:01.268 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.268 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.268 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 18.00 MB 2023-10-09T06:25:01.268 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.268 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.268 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 19.00 MB 2023-10-09T06:25:01.268 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.268 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.268 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 20.00 MB 2023-10-09T06:25:01.268 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.268 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.269 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 21.00 MB 2023-10-09T06:25:01.269 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.269 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.269 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 22.00 MB 2023-10-09T06:25:01.269 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.269 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.269 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 23.00 MB 2023-10-09T06:25:01.269 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.269 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.269 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 24.00 MB 2023-10-09T06:25:01.269 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.269 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.270 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 25.00 MB 2023-10-09T06:25:01.270 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.270 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.270 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 26.00 MB 2023-10-09T06:25:01.270 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.270 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.270 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 27.00 MB 2023-10-09T06:25:01.270 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.270 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.270 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 28.00 MB 2023-10-09T06:25:01.270 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.270 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.271 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 29.00 MB 2023-10-09T06:25:01.271 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.271 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.271 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 30.00 MB 2023-10-09T06:25:01.271 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.271 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.271 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 31.00 MB 2023-10-09T06:25:01.271 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.271 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.271 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 32.00 MB 2023-10-09T06:25:01.271 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.272 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.272 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 33.00 MB 2023-10-09T06:25:01.272 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.272 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.272 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 34.00 MB 2023-10-09T06:25:01.272 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.272 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.272 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 35.00 MB 2023-10-09T06:25:01.272 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.272 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.272 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 36.00 MB 2023-10-09T06:25:01.272 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.273 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.273 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 37.00 MB 2023-10-09T06:25:01.273 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.273 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.273 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 38.00 MB 2023-10-09T06:25:01.273 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.273 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.273 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 39.00 MB 2023-10-09T06:25:01.273 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.273 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.273 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 40.00 MB 2023-10-09T06:25:01.273 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.274 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.274 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 41.00 MB 2023-10-09T06:25:01.274 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.274 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.274 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 42.00 MB 2023-10-09T06:25:01.274 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.274 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.274 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 43.00 MB 2023-10-09T06:25:01.275 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.275 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.275 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 44.00 MB 2023-10-09T06:25:01.275 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.275 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.275 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 45.00 MB 2023-10-09T06:25:01.275 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.275 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.275 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 46.00 MB 2023-10-09T06:25:01.275 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.276 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.276 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 47.00 MB 2023-10-09T06:25:01.276 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.276 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.276 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 48.00 MB 2023-10-09T06:25:01.276 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.276 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.276 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 49.00 MB 2023-10-09T06:25:01.276 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.276 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.276 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 50.00 MB 2023-10-09T06:25:01.277 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.277 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.277 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 51.00 MB 2023-10-09T06:25:01.277 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.277 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.277 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 52.00 MB 2023-10-09T06:25:01.277 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.277 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.277 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 53.00 MB 2023-10-09T06:25:01.277 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.278 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.278 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 54.00 MB 2023-10-09T06:25:01.278 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.278 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.278 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 55.00 MB 2023-10-09T06:25:01.278 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.278 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.278 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 56.00 MB 2023-10-09T06:25:01.278 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.278 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.278 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 57.00 MB 2023-10-09T06:25:01.279 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.279 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.279 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 58.00 MB 2023-10-09T06:25:01.279 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.279 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.279 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 59.00 MB 2023-10-09T06:25:01.279 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.279 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.279 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 60.00 MB 2023-10-09T06:25:01.280 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.280 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.280 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 61.00 MB 2023-10-09T06:25:01.280 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.280 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.280 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 62.00 MB 2023-10-09T06:25:01.280 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.280 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.280 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 63.00 MB 2023-10-09T06:25:01.280 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.280 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.280 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 64.00 MB 2023-10-09T06:25:01.281 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.281 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.281 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 65.00 MB 2023-10-09T06:25:01.281 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.281 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.281 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 66.00 MB 2023-10-09T06:25:01.281 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.281 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.281 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 67.00 MB 2023-10-09T06:25:01.281 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.281 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.281 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 68.00 MB 2023-10-09T06:25:01.282 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.282 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.282 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 69.00 MB 2023-10-09T06:25:01.282 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.282 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.282 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 70.00 MB 2023-10-09T06:25:01.282 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.282 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.282 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 71.00 MB 2023-10-09T06:25:01.282 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.282 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.283 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 72.00 MB 2023-10-09T06:25:01.283 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.283 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.283 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 73.00 MB 2023-10-09T06:25:01.283 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.283 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.283 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 74.00 MB 2023-10-09T06:25:01.283 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.283 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.283 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 75.00 MB 2023-10-09T06:25:01.283 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.283 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.284 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 76.00 MB 2023-10-09T06:25:01.284 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.284 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.284 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 77.00 MB 2023-10-09T06:25:01.284 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.284 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.284 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 78.00 MB 2023-10-09T06:25:01.284 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.284 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.284 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 79.00 MB 2023-10-09T06:25:01.284 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.284 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.285 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 80.00 MB 2023-10-09T06:25:01.475 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.475 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.475 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 81.00 MB 2023-10-09T06:25:01.476 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.476 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.476 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 82.00 MB 2023-10-09T06:25:01.476 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.476 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.476 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 83.00 MB 2023-10-09T06:25:01.476 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.476 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.476 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 84.00 MB 2023-10-09T06:25:01.476 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.476 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.476 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 85.00 MB 2023-10-09T06:25:01.477 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.477 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.477 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 86.00 MB 2023-10-09T06:25:01.477 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.477 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.477 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 87.00 MB 2023-10-09T06:25:01.477 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.477 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.477 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 88.00 MB 2023-10-09T06:25:01.477 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.477 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.477 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 89.00 MB 2023-10-09T06:25:01.477 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.478 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.478 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 90.00 MB 2023-10-09T06:25:01.478 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.478 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.478 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 91.00 MB 2023-10-09T06:25:01.478 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.478 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.478 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 92.00 MB 2023-10-09T06:25:01.478 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.478 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.478 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 93.00 MB 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 94.00 MB 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 95.00 MB 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 96.00 MB 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 97.00 MB 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.479 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.480 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 98.00 MB 2023-10-09T06:25:01.480 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.480 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.480 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 99.00 MB 2023-10-09T06:25:01.480 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.480 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.480 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 100.00 MB 2023-10-09T06:25:01.480 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.480 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.480 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 101.00 MB 2023-10-09T06:25:01.480 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.480 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.481 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 102.00 MB 2023-10-09T06:25:01.481 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.481 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.481 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 103.00 MB 2023-10-09T06:25:01.481 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.481 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.481 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 104.00 MB 2023-10-09T06:25:01.481 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.481 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.481 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 105.00 MB 2023-10-09T06:25:01.481 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.481 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.481 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 106.00 MB 2023-10-09T06:25:01.482 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.482 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.482 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 107.00 MB 2023-10-09T06:25:01.482 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.482 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.482 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 108.00 MB 2023-10-09T06:25:01.482 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.482 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.482 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 109.00 MB 2023-10-09T06:25:01.482 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.482 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.482 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 110.00 MB 2023-10-09T06:25:01.483 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.483 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.483 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 111.00 MB 2023-10-09T06:25:01.483 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.483 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.483 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 112.00 MB 2023-10-09T06:25:01.483 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.483 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.483 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 113.00 MB 2023-10-09T06:25:01.483 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.483 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.483 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 114.00 MB 2023-10-09T06:25:01.483 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.484 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.484 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 115.00 MB 2023-10-09T06:25:01.484 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.484 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.484 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 116.00 MB 2023-10-09T06:25:01.484 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.484 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.484 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 117.00 MB 2023-10-09T06:25:01.484 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.484 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.484 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 118.00 MB 2023-10-09T06:25:01.484 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.485 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.485 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 119.00 MB 2023-10-09T06:25:01.485 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.485 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.485 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 120.00 MB 2023-10-09T06:25:01.485 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.485 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.485 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 121.00 MB 2023-10-09T06:25:01.485 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.485 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.485 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 122.00 MB 2023-10-09T06:25:01.485 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.486 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.486 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 123.00 MB 2023-10-09T06:25:01.486 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.486 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.486 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 124.00 MB 2023-10-09T06:25:01.486 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.486 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.486 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 125.00 MB 2023-10-09T06:25:01.486 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.486 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.486 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 126.00 MB 2023-10-09T06:25:01.486 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.487 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.487 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 127.00 MB 2023-10-09T06:25:01.487 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.487 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.487 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 128.00 MB 2023-10-09T06:25:01.487 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.487 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.487 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 129.00 MB 2023-10-09T06:25:01.487 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.487 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.487 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 130.00 MB 2023-10-09T06:25:01.487 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.487 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.488 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 131.00 MB 2023-10-09T06:25:01.488 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.488 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.488 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 132.00 MB 2023-10-09T06:25:01.488 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.488 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.488 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 133.00 MB 2023-10-09T06:25:01.488 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.488 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.488 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 134.00 MB 2023-10-09T06:25:01.488 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.488 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.489 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 135.00 MB 2023-10-09T06:25:01.489 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.489 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.489 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 136.00 MB 2023-10-09T06:25:01.489 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.489 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.489 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 137.00 MB 2023-10-09T06:25:01.489 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.489 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.489 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 138.00 MB 2023-10-09T06:25:01.489 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.489 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.490 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 139.00 MB 2023-10-09T06:25:01.490 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.490 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.490 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 140.00 MB 2023-10-09T06:25:01.490 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.490 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.490 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 141.00 MB 2023-10-09T06:25:01.490 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.490 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.490 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 142.00 MB 2023-10-09T06:25:01.490 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.490 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.491 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 143.00 MB 2023-10-09T06:25:01.491 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.491 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.491 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 144.00 MB 2023-10-09T06:25:01.491 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.491 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.491 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 145.00 MB 2023-10-09T06:25:01.491 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.491 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.491 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 146.00 MB 2023-10-09T06:25:01.491 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.491 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.492 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 147.00 MB 2023-10-09T06:25:01.492 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.492 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.492 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 148.00 MB 2023-10-09T06:25:01.492 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.492 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.492 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 149.00 MB 2023-10-09T06:25:01.492 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.492 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.492 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 150.00 MB 2023-10-09T06:25:01.492 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.492 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.493 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 151.00 MB 2023-10-09T06:25:01.493 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.493 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.493 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 152.00 MB 2023-10-09T06:25:01.493 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.493 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.493 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 153.00 MB 2023-10-09T06:25:01.493 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.493 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.493 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 154.00 MB 2023-10-09T06:25:01.493 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.493 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.494 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 155.00 MB 2023-10-09T06:25:01.494 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.494 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.494 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 156.00 MB 2023-10-09T06:25:01.494 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.494 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.494 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 157.00 MB 2023-10-09T06:25:01.494 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.494 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.494 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 158.00 MB 2023-10-09T06:25:01.494 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.495 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.495 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 159.00 MB 2023-10-09T06:25:01.495 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.495 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.495 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 160.00 MB 2023-10-09T06:25:01.495 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.495 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.495 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 161.00 MB 2023-10-09T06:25:01.684 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.684 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.684 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 162.00 MB 2023-10-09T06:25:01.684 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.685 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.685 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 163.00 MB 2023-10-09T06:25:01.685 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.685 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.685 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 164.00 MB 2023-10-09T06:25:01.685 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.685 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.685 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 165.00 MB 2023-10-09T06:25:01.685 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.685 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.685 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 166.00 MB 2023-10-09T06:25:01.685 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.686 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.686 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 167.00 MB 2023-10-09T06:25:01.686 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.686 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.686 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 168.00 MB 2023-10-09T06:25:01.686 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.686 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.686 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 169.00 MB 2023-10-09T06:25:01.686 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.686 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 170.00 MB 2023-10-09T06:25:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 171.00 MB 2023-10-09T06:25:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 172.00 MB 2023-10-09T06:25:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 173.00 MB 2023-10-09T06:25:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.687 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.688 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 174.00 MB 2023-10-09T06:25:01.688 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.688 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.688 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 175.00 MB 2023-10-09T06:25:01.688 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.688 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.688 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 176.00 MB 2023-10-09T06:25:01.688 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.688 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.688 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 177.00 MB 2023-10-09T06:25:01.688 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.688 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.689 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 178.00 MB 2023-10-09T06:25:01.689 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.689 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.689 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 179.00 MB 2023-10-09T06:25:01.689 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.689 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.689 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 180.00 MB 2023-10-09T06:25:01.689 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.689 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.689 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 181.00 MB 2023-10-09T06:25:01.689 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.689 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.690 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 182.00 MB 2023-10-09T06:25:01.690 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.690 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.690 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 183.00 MB 2023-10-09T06:25:01.690 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.690 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.690 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 184.00 MB 2023-10-09T06:25:01.690 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.690 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.690 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 185.00 MB 2023-10-09T06:25:01.690 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.691 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.691 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 186.00 MB 2023-10-09T06:25:01.691 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.691 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.691 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 187.00 MB 2023-10-09T06:25:01.691 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.691 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.691 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 188.00 MB 2023-10-09T06:25:01.691 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.691 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.691 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 189.00 MB 2023-10-09T06:25:01.691 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 190.00 MB 2023-10-09T06:25:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 191.00 MB 2023-10-09T06:25:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 192.00 MB 2023-10-09T06:25:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 193.00 MB 2023-10-09T06:25:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.693 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 194.00 MB 2023-10-09T06:25:01.693 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.693 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.693 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 195.00 MB 2023-10-09T06:25:01.693 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.693 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.693 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 196.00 MB 2023-10-09T06:25:01.693 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.693 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.693 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 197.00 MB 2023-10-09T06:25:01.693 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.694 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.694 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 198.00 MB 2023-10-09T06:25:01.694 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.694 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.694 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 199.00 MB 2023-10-09T06:25:01.694 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.694 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.694 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 200.00 MB 2023-10-09T06:25:01.694 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.694 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.694 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 201.00 MB 2023-10-09T06:25:01.695 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.695 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.695 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 202.00 MB 2023-10-09T06:25:01.695 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.695 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.695 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 203.00 MB 2023-10-09T06:25:01.695 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.695 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.695 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 204.00 MB 2023-10-09T06:25:01.695 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.695 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.695 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 205.00 MB 2023-10-09T06:25:01.695 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.696 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.696 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 206.00 MB 2023-10-09T06:25:01.696 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.696 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.696 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 207.00 MB 2023-10-09T06:25:01.696 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.696 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.696 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 208.00 MB 2023-10-09T06:25:01.696 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.696 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.696 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 209.00 MB 2023-10-09T06:25:01.696 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.697 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.697 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 210.00 MB 2023-10-09T06:25:01.697 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.697 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.697 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 211.00 MB 2023-10-09T06:25:01.697 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.697 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.697 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 212.00 MB 2023-10-09T06:25:01.697 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.697 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.697 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 213.00 MB 2023-10-09T06:25:01.698 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.698 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.698 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 214.00 MB 2023-10-09T06:25:01.698 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.698 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.698 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 215.00 MB 2023-10-09T06:25:01.698 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.698 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.698 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 216.00 MB 2023-10-09T06:25:01.698 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.698 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.698 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 217.00 MB 2023-10-09T06:25:01.699 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.699 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.699 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 218.00 MB 2023-10-09T06:25:01.699 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.699 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.699 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 219.00 MB 2023-10-09T06:25:01.699 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.699 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.699 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 220.00 MB 2023-10-09T06:25:01.699 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.699 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.699 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 221.00 MB 2023-10-09T06:25:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 222.00 MB 2023-10-09T06:25:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 223.00 MB 2023-10-09T06:25:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 224.00 MB 2023-10-09T06:25:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 225.00 MB 2023-10-09T06:25:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 226.00 MB 2023-10-09T06:25:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 227.00 MB 2023-10-09T06:25:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 228.00 MB 2023-10-09T06:25:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.702 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 229.00 MB 2023-10-09T06:25:01.702 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.702 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.702 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 230.00 MB 2023-10-09T06:25:01.702 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.702 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.702 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 231.00 MB 2023-10-09T06:25:01.702 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.702 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.702 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 232.00 MB 2023-10-09T06:25:01.702 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.703 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.703 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 233.00 MB 2023-10-09T06:25:01.703 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.703 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.703 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 234.00 MB 2023-10-09T06:25:01.703 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.703 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.703 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 235.00 MB 2023-10-09T06:25:01.703 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.703 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.703 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 236.00 MB 2023-10-09T06:25:01.703 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.704 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.704 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 237.00 MB 2023-10-09T06:25:01.704 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.704 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.704 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 238.00 MB 2023-10-09T06:25:01.704 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.704 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.704 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 239.00 MB 2023-10-09T06:25:01.704 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.704 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.704 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 240.00 MB 2023-10-09T06:25:01.704 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.705 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.705 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 241.00 MB 2023-10-09T06:25:01.887 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.888 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.888 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 242.00 MB 2023-10-09T06:25:01.888 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.888 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.888 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 243.00 MB 2023-10-09T06:25:01.888 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.888 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.888 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 244.00 MB 2023-10-09T06:25:01.888 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.888 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.888 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 245.00 MB 2023-10-09T06:25:01.889 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.889 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.889 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 246.00 MB 2023-10-09T06:25:01.889 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.889 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.889 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 247.00 MB 2023-10-09T06:25:01.889 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.889 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.889 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 248.00 MB 2023-10-09T06:25:01.889 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.889 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.889 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 249.00 MB 2023-10-09T06:25:01.890 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.890 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.890 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 250.00 MB 2023-10-09T06:25:01.890 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.890 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.890 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 251.00 MB 2023-10-09T06:25:01.890 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.890 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.890 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 252.00 MB 2023-10-09T06:25:01.890 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.891 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.891 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 253.00 MB 2023-10-09T06:25:01.891 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.891 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.891 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 254.00 MB 2023-10-09T06:25:01.891 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.891 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.891 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 255.00 MB 2023-10-09T06:25:01.891 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.891 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.891 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 256.00 MB 2023-10-09T06:25:01.891 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.892 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.892 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 257.00 MB 2023-10-09T06:25:01.892 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.892 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.892 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 258.00 MB 2023-10-09T06:25:01.892 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.892 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.892 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 259.00 MB 2023-10-09T06:25:01.892 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.892 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.892 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 260.00 MB 2023-10-09T06:25:01.892 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.893 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.893 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 261.00 MB 2023-10-09T06:25:01.893 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.893 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.893 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 262.00 MB 2023-10-09T06:25:01.893 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.893 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.893 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 263.00 MB 2023-10-09T06:25:01.893 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.893 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.893 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 264.00 MB 2023-10-09T06:25:01.893 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.894 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.894 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 265.00 MB 2023-10-09T06:25:01.894 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.894 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.894 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 266.00 MB 2023-10-09T06:25:01.894 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.894 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.894 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 267.00 MB 2023-10-09T06:25:01.894 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.894 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.895 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 268.00 MB 2023-10-09T06:25:01.895 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.895 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.895 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 269.00 MB 2023-10-09T06:25:01.895 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.895 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.895 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 270.00 MB 2023-10-09T06:25:01.895 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.895 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.895 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 271.00 MB 2023-10-09T06:25:01.895 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.895 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.896 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 272.00 MB 2023-10-09T06:25:01.896 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.896 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.896 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 273.00 MB 2023-10-09T06:25:01.896 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.896 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.896 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 274.00 MB 2023-10-09T06:25:01.896 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.896 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.896 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 275.00 MB 2023-10-09T06:25:01.896 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.896 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.897 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 276.00 MB 2023-10-09T06:25:01.897 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.897 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.897 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 277.00 MB 2023-10-09T06:25:01.897 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.897 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.897 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 278.00 MB 2023-10-09T06:25:01.897 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.897 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.897 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 279.00 MB 2023-10-09T06:25:01.897 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.898 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.898 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 280.00 MB 2023-10-09T06:25:01.898 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.898 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.898 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 281.00 MB 2023-10-09T06:25:01.898 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.898 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.898 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 282.00 MB 2023-10-09T06:25:01.898 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.898 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.898 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 283.00 MB 2023-10-09T06:25:01.898 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.899 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.899 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 284.00 MB 2023-10-09T06:25:01.899 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.899 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.899 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 285.00 MB 2023-10-09T06:25:01.899 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.899 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.899 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 286.00 MB 2023-10-09T06:25:01.899 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.899 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.899 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 287.00 MB 2023-10-09T06:25:01.899 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 288.00 MB 2023-10-09T06:25:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 289.00 MB 2023-10-09T06:25:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 290.00 MB 2023-10-09T06:25:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 291.00 MB 2023-10-09T06:25:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.901 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.901 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 292.00 MB 2023-10-09T06:25:01.901 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.901 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.901 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 293.00 MB 2023-10-09T06:25:01.901 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.901 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.901 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 294.00 MB 2023-10-09T06:25:01.901 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.901 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.901 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 295.00 MB 2023-10-09T06:25:01.902 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.902 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.902 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 296.00 MB 2023-10-09T06:25:01.902 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.902 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.902 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 297.00 MB 2023-10-09T06:25:01.902 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.902 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.902 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 298.00 MB 2023-10-09T06:25:01.902 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.902 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.903 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 299.00 MB 2023-10-09T06:25:01.903 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.903 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.903 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 300.00 MB 2023-10-09T06:25:01.903 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.903 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.903 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 301.00 MB 2023-10-09T06:25:01.903 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.903 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.903 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 302.00 MB 2023-10-09T06:25:01.903 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.903 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.904 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 303.00 MB 2023-10-09T06:25:01.904 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.904 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.904 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 304.00 MB 2023-10-09T06:25:01.904 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.904 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.904 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 305.00 MB 2023-10-09T06:25:01.904 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.904 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.904 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 306.00 MB 2023-10-09T06:25:01.904 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.905 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.905 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 307.00 MB 2023-10-09T06:25:01.905 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.905 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.905 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 308.00 MB 2023-10-09T06:25:01.905 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.905 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.905 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 309.00 MB 2023-10-09T06:25:01.905 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.905 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.905 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 310.00 MB 2023-10-09T06:25:01.905 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.906 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.906 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 311.00 MB 2023-10-09T06:25:01.906 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.906 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.906 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 312.00 MB 2023-10-09T06:25:01.906 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.906 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.906 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 313.00 MB 2023-10-09T06:25:01.906 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.906 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.906 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 314.00 MB 2023-10-09T06:25:01.907 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.907 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.907 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 315.00 MB 2023-10-09T06:25:01.907 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.907 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.907 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 316.00 MB 2023-10-09T06:25:01.907 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.907 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.907 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 317.00 MB 2023-10-09T06:25:01.907 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.907 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.907 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 318.00 MB 2023-10-09T06:25:01.908 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.908 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.908 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 319.00 MB 2023-10-09T06:25:01.908 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.908 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.908 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 320.00 MB 2023-10-09T06:25:01.908 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.908 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:01.908 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 321.00 MB 2023-10-09T06:25:01.908 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:01.908 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.096 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 322.00 MB 2023-10-09T06:25:02.096 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.096 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.096 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 323.00 MB 2023-10-09T06:25:02.096 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.096 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.096 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 324.00 MB 2023-10-09T06:25:02.096 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.096 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.096 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 325.00 MB 2023-10-09T06:25:02.097 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.097 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.097 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 326.00 MB 2023-10-09T06:25:02.097 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.097 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.097 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 327.00 MB 2023-10-09T06:25:02.097 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.097 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.097 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 328.00 MB 2023-10-09T06:25:02.098 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.098 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.098 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 329.00 MB 2023-10-09T06:25:02.098 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.099 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.099 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 330.00 MB 2023-10-09T06:25:02.099 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.099 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.099 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 331.00 MB 2023-10-09T06:25:02.099 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.099 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.099 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 332.00 MB 2023-10-09T06:25:02.099 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.099 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.099 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 333.00 MB 2023-10-09T06:25:02.099 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.100 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.100 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 334.00 MB 2023-10-09T06:25:02.100 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.100 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.100 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 335.00 MB 2023-10-09T06:25:02.100 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.100 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.100 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 336.00 MB 2023-10-09T06:25:02.100 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.100 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.100 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 337.00 MB 2023-10-09T06:25:02.100 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.101 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.101 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 338.00 MB 2023-10-09T06:25:02.101 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.101 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.101 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 339.00 MB 2023-10-09T06:25:02.101 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.101 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.101 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 340.00 MB 2023-10-09T06:25:02.101 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.101 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.101 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 341.00 MB 2023-10-09T06:25:02.101 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.102 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.102 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 342.00 MB 2023-10-09T06:25:02.102 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.102 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.102 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 343.00 MB 2023-10-09T06:25:02.102 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.102 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.102 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 344.00 MB 2023-10-09T06:25:02.102 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.102 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.102 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 345.00 MB 2023-10-09T06:25:02.103 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.103 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.103 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 346.00 MB 2023-10-09T06:25:02.103 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.103 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.103 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 347.00 MB 2023-10-09T06:25:02.103 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.103 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.103 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 348.00 MB 2023-10-09T06:25:02.103 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.103 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.103 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 349.00 MB 2023-10-09T06:25:02.104 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.104 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.104 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 350.00 MB 2023-10-09T06:25:02.104 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.104 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.104 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 351.00 MB 2023-10-09T06:25:02.104 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.104 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.104 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 352.00 MB 2023-10-09T06:25:02.104 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.104 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.105 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 353.00 MB 2023-10-09T06:25:02.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.105 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.105 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 354.00 MB 2023-10-09T06:25:02.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.105 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.105 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 355.00 MB 2023-10-09T06:25:02.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.105 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.105 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 356.00 MB 2023-10-09T06:25:02.105 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.105 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.106 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 357.00 MB 2023-10-09T06:25:02.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.106 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.106 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 358.00 MB 2023-10-09T06:25:02.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.106 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.106 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 359.00 MB 2023-10-09T06:25:02.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.106 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.106 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 360.00 MB 2023-10-09T06:25:02.106 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.107 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.107 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 361.00 MB 2023-10-09T06:25:02.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.107 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.107 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 362.00 MB 2023-10-09T06:25:02.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.107 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.107 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 363.00 MB 2023-10-09T06:25:02.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.107 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.107 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 364.00 MB 2023-10-09T06:25:02.107 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.108 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.108 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 365.00 MB 2023-10-09T06:25:02.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.108 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.108 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 366.00 MB 2023-10-09T06:25:02.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.108 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.108 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 367.00 MB 2023-10-09T06:25:02.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.108 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.108 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 368.00 MB 2023-10-09T06:25:02.108 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.109 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.109 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 369.00 MB 2023-10-09T06:25:02.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.109 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.109 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 370.00 MB 2023-10-09T06:25:02.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.109 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.109 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 371.00 MB 2023-10-09T06:25:02.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.109 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.109 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 372.00 MB 2023-10-09T06:25:02.109 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.109 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.110 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 373.00 MB 2023-10-09T06:25:02.110 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.110 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.110 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 374.00 MB 2023-10-09T06:25:02.110 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.110 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.110 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 375.00 MB 2023-10-09T06:25:02.110 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.110 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.110 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 376.00 MB 2023-10-09T06:25:02.110 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.111 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.111 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 377.00 MB 2023-10-09T06:25:02.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.111 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.111 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 378.00 MB 2023-10-09T06:25:02.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.111 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.111 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 379.00 MB 2023-10-09T06:25:02.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.111 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.111 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 380.00 MB 2023-10-09T06:25:02.111 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.112 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.112 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 381.00 MB 2023-10-09T06:25:02.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.112 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.112 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 382.00 MB 2023-10-09T06:25:02.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.112 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.112 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 383.00 MB 2023-10-09T06:25:02.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.112 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.112 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 384.00 MB 2023-10-09T06:25:02.112 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.113 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.113 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 385.00 MB 2023-10-09T06:25:02.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.113 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.113 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 386.00 MB 2023-10-09T06:25:02.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.113 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.113 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 387.00 MB 2023-10-09T06:25:02.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.113 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.113 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 388.00 MB 2023-10-09T06:25:02.113 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.114 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.114 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 389.00 MB 2023-10-09T06:25:02.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.114 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.114 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 390.00 MB 2023-10-09T06:25:02.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.114 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.114 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 391.00 MB 2023-10-09T06:25:02.114 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.114 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.114 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 392.00 MB 2023-10-09T06:25:02.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.115 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.115 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 393.00 MB 2023-10-09T06:25:02.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.115 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.115 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 394.00 MB 2023-10-09T06:25:02.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.115 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.115 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 395.00 MB 2023-10-09T06:25:02.115 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.115 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.116 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 396.00 MB 2023-10-09T06:25:02.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.116 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.116 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 397.00 MB 2023-10-09T06:25:02.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.116 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.116 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 398.00 MB 2023-10-09T06:25:02.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.116 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.116 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 399.00 MB 2023-10-09T06:25:02.116 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.117 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.117 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 400.00 MB 2023-10-09T06:25:02.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.117 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.117 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 401.00 MB 2023-10-09T06:25:02.117 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:02.117 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:02.117 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 402.00 MB 2023-10-09T06:25:06.726 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:25:06.726+0000 7fc5eaab7700 -1 log_channel(cluster) log [ERR] : Health check failed: 3 full osd(s) (OSD_FULL) 2023-10-09T06:25:16.704 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:25:16.704+0000 7fc5eaab7700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-09T06:25:26.201 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:25:26.205 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:25:32.361 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.361 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.361 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 403.00 MB 2023-10-09T06:25:32.361 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.361 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.361 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 404.00 MB 2023-10-09T06:25:32.361 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.362 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.362 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 405.00 MB 2023-10-09T06:25:32.362 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.362 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.362 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 406.00 MB 2023-10-09T06:25:32.362 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.362 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.362 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 407.00 MB 2023-10-09T06:25:32.362 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.362 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.362 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 408.00 MB 2023-10-09T06:25:32.363 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.363 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.363 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 409.00 MB 2023-10-09T06:25:32.363 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.363 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.363 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 410.00 MB 2023-10-09T06:25:32.363 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.363 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.363 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 411.00 MB 2023-10-09T06:25:32.363 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.363 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.363 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 412.00 MB 2023-10-09T06:25:32.364 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.364 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.364 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 413.00 MB 2023-10-09T06:25:32.364 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.364 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.364 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 414.00 MB 2023-10-09T06:25:32.364 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.364 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.364 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 415.00 MB 2023-10-09T06:25:32.364 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.364 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.365 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 416.00 MB 2023-10-09T06:25:32.365 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.365 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.365 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 417.00 MB 2023-10-09T06:25:32.365 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.365 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.365 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 418.00 MB 2023-10-09T06:25:32.365 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.365 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.365 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 419.00 MB 2023-10-09T06:25:32.365 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.365 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.366 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 420.00 MB 2023-10-09T06:25:32.366 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.366 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.366 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 421.00 MB 2023-10-09T06:25:32.366 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.366 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.366 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 422.00 MB 2023-10-09T06:25:32.366 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.366 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.366 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 423.00 MB 2023-10-09T06:25:32.366 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.367 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.367 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 424.00 MB 2023-10-09T06:25:32.367 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.367 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.367 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 425.00 MB 2023-10-09T06:25:32.367 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.367 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.367 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 426.00 MB 2023-10-09T06:25:32.367 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.367 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.367 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 427.00 MB 2023-10-09T06:25:32.367 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 428.00 MB 2023-10-09T06:25:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 429.00 MB 2023-10-09T06:25:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 430.00 MB 2023-10-09T06:25:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 431.00 MB 2023-10-09T06:25:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.369 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.369 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 432.00 MB 2023-10-09T06:25:32.369 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.369 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.369 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 433.00 MB 2023-10-09T06:25:32.369 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.369 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.369 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 434.00 MB 2023-10-09T06:25:32.369 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.369 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.369 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 435.00 MB 2023-10-09T06:25:32.369 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.370 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.370 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 436.00 MB 2023-10-09T06:25:32.370 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.370 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.370 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 437.00 MB 2023-10-09T06:25:32.370 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.370 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.370 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 438.00 MB 2023-10-09T06:25:32.370 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.370 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.370 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 439.00 MB 2023-10-09T06:25:32.371 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.371 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.371 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 440.00 MB 2023-10-09T06:25:32.371 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.371 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.371 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 441.00 MB 2023-10-09T06:25:32.371 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.371 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.371 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 442.00 MB 2023-10-09T06:25:32.371 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.371 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.371 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 443.00 MB 2023-10-09T06:25:32.372 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.372 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.372 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 444.00 MB 2023-10-09T06:25:32.372 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.372 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.372 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 445.00 MB 2023-10-09T06:25:32.372 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.372 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.372 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 446.00 MB 2023-10-09T06:25:32.372 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.372 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.372 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 447.00 MB 2023-10-09T06:25:32.373 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.373 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.373 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 448.00 MB 2023-10-09T06:25:32.373 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.373 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.373 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 449.00 MB 2023-10-09T06:25:32.373 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.373 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.373 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 450.00 MB 2023-10-09T06:25:32.373 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.373 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.373 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 451.00 MB 2023-10-09T06:25:32.374 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.374 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.374 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 452.00 MB 2023-10-09T06:25:32.374 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.374 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.374 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 453.00 MB 2023-10-09T06:25:32.374 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.374 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.374 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 454.00 MB 2023-10-09T06:25:32.374 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.374 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.374 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 455.00 MB 2023-10-09T06:25:32.375 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.375 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.375 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 456.00 MB 2023-10-09T06:25:32.375 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.375 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.375 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 457.00 MB 2023-10-09T06:25:32.375 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.375 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.375 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 458.00 MB 2023-10-09T06:25:32.375 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.375 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 459.00 MB 2023-10-09T06:25:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 460.00 MB 2023-10-09T06:25:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 461.00 MB 2023-10-09T06:25:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 462.00 MB 2023-10-09T06:25:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.377 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 463.00 MB 2023-10-09T06:25:32.377 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.377 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.377 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 464.00 MB 2023-10-09T06:25:32.377 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.377 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.377 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 465.00 MB 2023-10-09T06:25:32.377 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.377 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.377 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 466.00 MB 2023-10-09T06:25:32.377 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.377 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.378 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 467.00 MB 2023-10-09T06:25:32.378 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.378 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.378 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 468.00 MB 2023-10-09T06:25:32.378 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.378 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.378 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 469.00 MB 2023-10-09T06:25:32.378 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.378 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.378 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 470.00 MB 2023-10-09T06:25:32.379 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.379 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.379 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 471.00 MB 2023-10-09T06:25:32.379 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.379 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.379 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 472.00 MB 2023-10-09T06:25:32.379 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.379 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.379 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 473.00 MB 2023-10-09T06:25:32.379 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.379 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.379 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 474.00 MB 2023-10-09T06:25:32.380 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.380 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.380 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 475.00 MB 2023-10-09T06:25:32.380 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.380 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.380 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 476.00 MB 2023-10-09T06:25:32.380 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.380 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.380 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 477.00 MB 2023-10-09T06:25:32.380 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.380 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.380 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 478.00 MB 2023-10-09T06:25:32.381 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.381 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.381 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 479.00 MB 2023-10-09T06:25:32.381 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:25:32.381 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:25:32.381 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:25:32.381 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 480.00 MB 2023-10-09T06:25:32.381 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:25:32.381 INFO:teuthology.orchestra.run.smithi031.stdout:Reached fullness after 480.00 MB 2023-10-09T06:25:32.381 INFO:teuthology.orchestra.run.smithi031.stdout:calling close 2023-10-09T06:25:32.381 INFO:teuthology.orchestra.run.smithi031.stdout:close() did not raise error 2023-10-09T06:25:32.573 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:25:32.573 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:25:32.623 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:25:32.666 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:25:32.666 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:25:32.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:25:32.666 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:25:32.716 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:25:32.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:25:32.717 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:25:32.733 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T06:25:32.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:25:32.733 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T06:25:32.782 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:25:32.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:25:32.783 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T06:25:32.799 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:25:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.923+0000 7f30d21b6700 1 Processor -- start 2023-10-09T06:25:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.923+0000 7f30d21b6700 1 -- start start 2023-10-09T06:25:32.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30d21b6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f30cc15a620 0x7f30cc15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:32.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30d21b6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f30cc15d580 0x7f30cc158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:32.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30d21b6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc15cbb0 con 0x7f30cc157870 2023-10-09T06:25:32.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30d21b6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30cc15bdb0 con 0x7f30cc15a620 2023-10-09T06:25:32.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30d21b6700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30cc15bfa0 con 0x7f30cc15d580 2023-10-09T06:25:32.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30caffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f30cc15a620 0x7f30cc15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:32.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30caffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f30cc15a620 0x7f30cc15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43984/0 (socket says 172.21.15.31:43984) 2023-10-09T06:25:32.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30caffd700 1 -- 172.21.15.31:0/3354921666 learned_addr learned my addr 172.21.15.31:0/3354921666 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:32.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30cbfff700 1 --2- 172.21.15.31:0/3354921666 >> v2:172.21.15.158:3300/0 conn(0x7f30cc15d580 0x7f30cc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:32.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30caffd700 1 -- 172.21.15.31:0/3354921666 >> v2:172.21.15.158:3300/0 conn(0x7f30cc15d580 msgr2=0x7f30cc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:32.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30caffd700 1 --2- 172.21.15.31:0/3354921666 >> v2:172.21.15.158:3300/0 conn(0x7f30cc15d580 0x7f30cc158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:32.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30caffd700 1 -- 172.21.15.31:0/3354921666 >> v1:172.21.15.158:6789/0 conn(0x7f30cc157870 legacy=0x7f30cc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:32.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30caffd700 1 -- 172.21.15.31:0/3354921666 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc15c280 con 0x7f30cc15a620 2023-10-09T06:25:32.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30caffd700 1 --2- 172.21.15.31:0/3354921666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30cc15a620 0x7f30cc15d040 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f30cc06b4e0 tx=0x7f30b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f8ae476312ac1d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:32.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.924+0000 7f30ca7fc700 1 -- 172.21.15.31:0/3354921666 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b400b860 con 0x7f30cc15a620 2023-10-09T06:25:32.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.925+0000 7f30ca7fc700 1 -- 172.21.15.31:0/3354921666 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b400b9c0 con 0x7f30cc15a620 2023-10-09T06:25:32.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.925+0000 7f30ca7fc700 1 -- 172.21.15.31:0/3354921666 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b400bd60 con 0x7f30cc15a620 2023-10-09T06:25:32.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.925+0000 7f30d21b6700 1 -- 172.21.15.31:0/3354921666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30cc15a620 msgr2=0x7f30cc15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:32.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.925+0000 7f30d21b6700 1 --2- 172.21.15.31:0/3354921666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30cc15a620 0x7f30cc15d040 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f30cc06b4e0 tx=0x7f30b4009250 comp rx=0 tx=0).stop 2023-10-09T06:25:32.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.925+0000 7f30d21b6700 1 -- 172.21.15.31:0/3354921666 shutdown_connections 2023-10-09T06:25:32.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.925+0000 7f30d21b6700 1 --2- 172.21.15.31:0/3354921666 >> v2:172.21.15.158:3300/0 conn(0x7f30cc15d580 0x7f30cc158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:32.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.925+0000 7f30d21b6700 1 --2- 172.21.15.31:0/3354921666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30cc15a620 0x7f30cc15d040 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:32.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.925+0000 7f30d21b6700 1 -- 172.21.15.31:0/3354921666 >> 172.21.15.31:0/3354921666 conn(0x7f30cc068ce0 msgr2=0x7f30cc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:32.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.925+0000 7f30d21b6700 1 -- 172.21.15.31:0/3354921666 shutdown_connections 2023-10-09T06:25:32.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.925+0000 7f30d21b6700 1 -- 172.21.15.31:0/3354921666 wait complete. 2023-10-09T06:25:32.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.926+0000 7f30d21b6700 1 Processor -- start 2023-10-09T06:25:32.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.926+0000 7f30d21b6700 1 -- start start 2023-10-09T06:25:32.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30d21b6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30cc157870 0x7f30cc14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:32.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30d21b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30cc15a620 0x7f30cc0d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:32.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30d21b6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f30cc15d580 0x7f30cc15e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:32.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30d21b6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0b2910 con 0x7f30cc15a620 2023-10-09T06:25:32.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30d21b6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0b1aa0 con 0x7f30cc157870 2023-10-09T06:25:32.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30d21b6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0b1d20 con 0x7f30cc15d580 2023-10-09T06:25:32.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30caffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30cc15a620 0x7f30cc0d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:32.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30caffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30cc15a620 0x7f30cc0d0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43990/0 (socket says 172.21.15.31:43990) 2023-10-09T06:25:32.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30caffd700 1 -- 172.21.15.31:0/2336012090 learned_addr learned my addr 172.21.15.31:0/2336012090 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:32.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30cb7fe700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30cc157870 0x7f30cc14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:32.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30cbfff700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f30cc15d580 0x7f30cc15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:32.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30caffd700 1 -- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f30cc15d580 msgr2=0x7f30cc15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30caffd700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f30cc15d580 0x7f30cc15e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30caffd700 1 -- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30cc157870 msgr2=0x7f30cc14e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30caffd700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30cc157870 0x7f30cc14e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.927+0000 7f30caffd700 1 -- 172.21.15.31:0/2336012090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b40094f0 con 0x7f30cc15a620 2023-10-09T06:25:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.928+0000 7f30caffd700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30cc15a620 0x7f30cc0d0ee0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f30cc06b530 tx=0x7f30b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.928+0000 7f30c37fe700 1 -- 172.21.15.31:0/2336012090 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4024440 con 0x7f30cc15a620 2023-10-09T06:25:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.928+0000 7f30c37fe700 1 -- 172.21.15.31:0/2336012090 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b40245a0 con 0x7f30cc15a620 2023-10-09T06:25:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.928+0000 7f30c37fe700 1 -- 172.21.15.31:0/2336012090 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4024960 con 0x7f30cc15a620 2023-10-09T06:25:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.928+0000 7f30d21b6700 1 -- 172.21.15.31:0/2336012090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30cc14f630 con 0x7f30cc15a620 2023-10-09T06:25:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.928+0000 7f30d21b6700 1 -- 172.21.15.31:0/2336012090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30cc0b22c0 con 0x7f30cc15a620 2023-10-09T06:25:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.929+0000 7f30d21b6700 1 -- 172.21.15.31:0/2336012090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30cc0b2ac0 con 0x7f30cc15a620 2023-10-09T06:25:32.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.929+0000 7f30c37fe700 1 -- 172.21.15.31:0/2336012090 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30b4024d50 con 0x7f30cc15a620 2023-10-09T06:25:32.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.930+0000 7f30c37fe700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f30ac066f30 0x7f30ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:32.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.930+0000 7f30c37fe700 1 -- 172.21.15.31:0/2336012090 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f30b4086250 con 0x7f30cc15a620 2023-10-09T06:25:32.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.930+0000 7f30c37fe700 1 -- 172.21.15.31:0/2336012090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7f30ac06ea50 con 0x7f30cc15a620 2023-10-09T06:25:32.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.930+0000 7f30cb7fe700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f30ac066f30 0x7f30ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:32.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.930+0000 7f30cb7fe700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f30ac066f30 0x7f30ac0693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f30bc003a80 tx=0x7f30bc007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:32.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:32.934+0000 7f30c37fe700 1 -- 172.21.15.31:0/2336012090 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30cc0b2ac0 con 0x7f30cc15a620 2023-10-09T06:25:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.236+0000 7f30d21b6700 1 -- 172.21.15.31:0/2336012090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30cc04c3c0 con 0x7f30cc15a620 2023-10-09T06:25:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.237+0000 7f30c37fe700 1 -- 172.21.15.31:0/2336012090 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f30b4015020 con 0x7f30cc15a620 2023-10-09T06:25:33.238 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:33.238 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2895057012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2895057012},{"type":"v1","addr":"172.21.15.158:6836","nonce":2895057012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5707,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/756230701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":756230701},{"type":"v1","addr":"172.21.15.158:6837","nonce":756230701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5961,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2803435352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2803435352},{"type":"v1","addr":"172.21.15.31:6834","nonce":2803435352}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:24:51.381116+0000","modified":"2023-10-09T06:24:54.984865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1373095674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1373095674},{"type":"v1","addr":"172.21.15.31:6835","nonce":1373095674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T06:25:33.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.239+0000 7f30d21b6700 1 -- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f30ac066f30 msgr2=0x7f30ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.239+0000 7f30d21b6700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f30ac066f30 0x7f30ac0693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f30bc003a80 tx=0x7f30bc007ec0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.239+0000 7f30d21b6700 1 -- 172.21.15.31:0/2336012090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30cc15a620 msgr2=0x7f30cc0d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.239+0000 7f30d21b6700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30cc15a620 0x7f30cc0d0ee0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f30cc06b530 tx=0x7f30b4017000 comp rx=0 tx=0).stop 2023-10-09T06:25:33.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.239+0000 7f30d21b6700 1 -- 172.21.15.31:0/2336012090 shutdown_connections 2023-10-09T06:25:33.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.239+0000 7f30d21b6700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f30ac066f30 0x7f30ac0693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.239+0000 7f30d21b6700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f30cc15d580 0x7f30cc15e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.239+0000 7f30d21b6700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30cc157870 0x7f30cc14e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.239+0000 7f30d21b6700 1 --2- 172.21.15.31:0/2336012090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30cc15a620 0x7f30cc0d0ee0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.239+0000 7f30d21b6700 1 -- 172.21.15.31:0/2336012090 >> 172.21.15.31:0/2336012090 conn(0x7f30cc068ce0 msgr2=0x7f30cc14fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:33.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.239+0000 7f30d21b6700 1 -- 172.21.15.31:0/2336012090 shutdown_connections 2023-10-09T06:25:33.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.239+0000 7f30d21b6700 1 -- 172.21.15.31:0/2336012090 wait complete. 2023-10-09T06:25:33.241 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 42 2023-10-09T06:25:33.252 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:25:33.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.370+0000 7fabf00f0700 1 Processor -- start 2023-10-09T06:25:33.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.370+0000 7fabf00f0700 1 -- start start 2023-10-09T06:25:33.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.371+0000 7fabf00f0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fabe815a620 0x7fabe815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:33.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.371+0000 7fabf00f0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fabe815d580 0x7fabe8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:33.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.371+0000 7fabf00f0700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe815cbb0 con 0x7fabe8157870 2023-10-09T06:25:33.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.371+0000 7fabf00f0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe815bdb0 con 0x7fabe815a620 2023-10-09T06:25:33.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.371+0000 7fabf00f0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe815bfa0 con 0x7fabe815d580 2023-10-09T06:25:33.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.371+0000 7fabee68d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fabe815d580 0x7fabe8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:33.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.371+0000 7fabed68b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fabe815a620 0x7fabe815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:33.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.371+0000 7fabede8c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fabe8157870 0x7fabe815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:58214/0 (socket says 172.21.15.31:58214) 2023-10-09T06:25:33.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.371+0000 7fabede8c700 1 -- 172.21.15.31:0/4234172610 learned_addr learned my addr 172.21.15.31:0/4234172610 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:33.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.372+0000 7fabed68b700 1 -- 172.21.15.31:0/4234172610 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fabe815d580 msgr2=0x7fabe8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:33.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.372+0000 7fabed68b700 1 --2- 172.21.15.31:0/4234172610 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fabe815d580 0x7fabe8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.372+0000 7fabed68b700 1 -- 172.21.15.31:0/4234172610 >> v1:172.21.15.158:6789/0 conn(0x7fabe8157870 legacy=0x7fabe815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.372+0000 7fabed68b700 1 -- 172.21.15.31:0/4234172610 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe815c280 con 0x7fabe815a620 2023-10-09T06:25:33.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.372+0000 7fabece8a700 1 -- 172.21.15.31:0/4234172610 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071998562 0 0) 0x7fabe815cbb0 con 0x7fabe8157870 2023-10-09T06:25:33.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.372+0000 7fabee68d700 1 --2- 172.21.15.31:0/4234172610 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fabe815d580 0x7fabe8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:25:33.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.372+0000 7fabed68b700 1 --2- 172.21.15.31:0/4234172610 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe815a620 0x7fabe815d040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0098e0 tx=0x7fabdc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2fa08878ea9129 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:33.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.372+0000 7fabece8a700 1 -- 172.21.15.31:0/4234172610 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc00b640 con 0x7fabe815a620 2023-10-09T06:25:33.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.372+0000 7fabece8a700 1 -- 172.21.15.31:0/4234172610 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc00b7a0 con 0x7fabe815a620 2023-10-09T06:25:33.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.372+0000 7fabece8a700 1 -- 172.21.15.31:0/4234172610 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc00bb40 con 0x7fabe815a620 2023-10-09T06:25:33.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.373+0000 7fabf00f0700 1 -- 172.21.15.31:0/4234172610 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe815a620 msgr2=0x7fabe815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.373+0000 7fabf00f0700 1 --2- 172.21.15.31:0/4234172610 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe815a620 0x7fabe815d040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0098e0 tx=0x7fabdc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.373+0000 7fabf00f0700 1 -- 172.21.15.31:0/4234172610 shutdown_connections 2023-10-09T06:25:33.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.373+0000 7fabf00f0700 1 --2- 172.21.15.31:0/4234172610 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fabe815d580 0x7fabe8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.373+0000 7fabf00f0700 1 --2- 172.21.15.31:0/4234172610 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe815a620 0x7fabe815d040 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.373+0000 7fabf00f0700 1 -- 172.21.15.31:0/4234172610 >> 172.21.15.31:0/4234172610 conn(0x7fabe8068ce0 msgr2=0x7fabe80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:33.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.373+0000 7fabf00f0700 1 -- 172.21.15.31:0/4234172610 shutdown_connections 2023-10-09T06:25:33.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.373+0000 7fabf00f0700 1 -- 172.21.15.31:0/4234172610 wait complete. 2023-10-09T06:25:33.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.374+0000 7fabf00f0700 1 Processor -- start 2023-10-09T06:25:33.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.374+0000 7fabf00f0700 1 -- start start 2023-10-09T06:25:33.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabf00f0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe8157870 0x7fabe80b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:33.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabf00f0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fabe815a620 0x7fabe814b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:33.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabf00f0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe815d580 0x7fabe80b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:33.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabf00f0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe814bf20 con 0x7fabe8157870 2023-10-09T06:25:33.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabf00f0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80b06c0 con 0x7fabe815d580 2023-10-09T06:25:33.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabf00f0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80b1520 con 0x7fabe815a620 2023-10-09T06:25:33.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabede8c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe8157870 0x7fabe80b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:33.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabede8c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe8157870 0x7fabe80b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43998/0 (socket says 172.21.15.31:43998) 2023-10-09T06:25:33.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabede8c700 1 -- 172.21.15.31:0/2200967264 learned_addr learned my addr 172.21.15.31:0/2200967264 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:33.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabed68b700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fabe815a620 0x7fabe814b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:33.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabee68d700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe815d580 0x7fabe80b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:33.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabede8c700 1 -- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fabe815a620 msgr2=0x7fabe814b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabede8c700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fabe815a620 0x7fabe814b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabede8c700 1 -- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe815d580 msgr2=0x7fabe80b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabede8c700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe815d580 0x7fabe80b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabede8c700 1 -- 172.21.15.31:0/2200967264 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe0009420 con 0x7fabe8157870 2023-10-09T06:25:33.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabede8c700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe8157870 0x7fabe80b19b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fabd800cdb0 tx=0x7fabd8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:33.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabe5ffb700 1 -- 172.21.15.31:0/2200967264 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd800aad0 con 0x7fabe8157870 2023-10-09T06:25:33.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabe5ffb700 1 -- 172.21.15.31:0/2200967264 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd800ac30 con 0x7fabe8157870 2023-10-09T06:25:33.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabf00f0700 1 -- 172.21.15.31:0/2200967264 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc009420 con 0x7fabe8157870 2023-10-09T06:25:33.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.375+0000 7fabe5ffb700 1 -- 172.21.15.31:0/2200967264 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80070f0 con 0x7fabe8157870 2023-10-09T06:25:33.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.376+0000 7fabf00f0700 1 -- 172.21.15.31:0/2200967264 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe80b0bf0 con 0x7fabe8157870 2023-10-09T06:25:33.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.376+0000 7fabf00f0700 1 -- 172.21.15.31:0/2200967264 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe804c3c0 con 0x7fabe8157870 2023-10-09T06:25:33.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.377+0000 7fabe5ffb700 1 -- 172.21.15.31:0/2200967264 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabd80074a0 con 0x7fabe8157870 2023-10-09T06:25:33.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.377+0000 7fabe5ffb700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fabd4066f30 0x7fabd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:33.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.377+0000 7fabe5ffb700 1 -- 172.21.15.31:0/2200967264 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fabd8084920 con 0x7fabe8157870 2023-10-09T06:25:33.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.377+0000 7fabed68b700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fabd4066f30 0x7fabd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:33.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.378+0000 7fabe5ffb700 1 -- 172.21.15.31:0/2200967264 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7fabd406ea50 con 0x7fabe8157870 2023-10-09T06:25:33.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.378+0000 7fabed68b700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fabd4066f30 0x7fabd40693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fabe815aa20 tx=0x7fabdc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:33.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.381+0000 7fabe5ffb700 1 -- 172.21.15.31:0/2200967264 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabd8051c30 con 0x7fabe8157870 2023-10-09T06:25:33.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.575+0000 7fabf00f0700 1 -- 172.21.15.31:0/2200967264 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabe815c560 con 0x7fabe8157870 2023-10-09T06:25:33.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.576+0000 7fabe5ffb700 1 -- 172.21.15.31:0/2200967264 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+15396 (secure 0 0 0) 0x7fabd8001c20 con 0x7fabe8157870 2023-10-09T06:25:33.578 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:33.578 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":87,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:25:09.708068+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:24:49.565040+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T06:24:50.345838+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:25:33.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.578+0000 7fabf00f0700 1 -- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fabd4066f30 msgr2=0x7fabd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.578+0000 7fabf00f0700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fabd4066f30 0x7fabd40693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fabe815aa20 tx=0x7fabdc017000 comp rx=0 tx=0).stop 2023-10-09T06:25:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.578+0000 7fabf00f0700 1 -- 172.21.15.31:0/2200967264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe8157870 msgr2=0x7fabe80b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.578+0000 7fabf00f0700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe8157870 0x7fabe80b19b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fabd800cdb0 tx=0x7fabd8001ae0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.579+0000 7fabf00f0700 1 -- 172.21.15.31:0/2200967264 shutdown_connections 2023-10-09T06:25:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.579+0000 7fabf00f0700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fabd4066f30 0x7fabd40693e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.579+0000 7fabf00f0700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe815d580 0x7fabe80b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.579+0000 7fabf00f0700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe8157870 0x7fabe80b19b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.579+0000 7fabf00f0700 1 --2- 172.21.15.31:0/2200967264 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fabe815a620 0x7fabe814b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.579+0000 7fabf00f0700 1 -- 172.21.15.31:0/2200967264 >> 172.21.15.31:0/2200967264 conn(0x7fabe8068ce0 msgr2=0x7fabe8158390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.579+0000 7fabf00f0700 1 -- 172.21.15.31:0/2200967264 shutdown_connections 2023-10-09T06:25:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.579+0000 7fabf00f0700 1 -- 172.21.15.31:0/2200967264 wait complete. 2023-10-09T06:25:33.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:24:49.565040+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:24:50.345838+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:25:33.592 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:25:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.713+0000 7fc7f9101700 1 Processor -- start 2023-10-09T06:25:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.713+0000 7fc7f9101700 1 -- start start 2023-10-09T06:25:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f9101700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7f415a290 0x7fc7f406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f9101700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc7f406aae0 0x7fc7f40cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f9101700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f40b0790 con 0x7fc7f4159ec0 2023-10-09T06:25:33.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f9101700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f406af20 con 0x7fc7f415a290 2023-10-09T06:25:33.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f9101700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f40ce1f0 con 0x7fc7f406aae0 2023-10-09T06:25:33.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7f415a290 0x7fc7f406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:33.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7f415a290 0x7fc7f406a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44002/0 (socket says 172.21.15.31:44002) 2023-10-09T06:25:33.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f259c700 1 -- 172.21.15.31:0/730270515 learned_addr learned my addr 172.21.15.31:0/730270515 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:33.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f359e700 1 --2- 172.21.15.31:0/730270515 >> v2:172.21.15.158:3300/0 conn(0x7fc7f406aae0 0x7fc7f40cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:33.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f259c700 1 -- 172.21.15.31:0/730270515 >> v2:172.21.15.158:3300/0 conn(0x7fc7f406aae0 msgr2=0x7fc7f40cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f259c700 1 --2- 172.21.15.31:0/730270515 >> v2:172.21.15.158:3300/0 conn(0x7fc7f406aae0 0x7fc7f40cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f259c700 1 -- 172.21.15.31:0/730270515 >> v1:172.21.15.158:6789/0 conn(0x7fc7f4159ec0 legacy=0x7fc7f40af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f259c700 1 -- 172.21.15.31:0/730270515 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f40b0b20 con 0x7fc7f415a290 2023-10-09T06:25:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f259c700 1 --2- 172.21.15.31:0/730270515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f415a290 0x7fc7f406a5a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40711f0 tx=0x7fc7dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42efef0f20b11298 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.714+0000 7fc7f1d9b700 1 -- 172.21.15.31:0/730270515 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc009e70 con 0x7fc7f415a290 2023-10-09T06:25:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.715+0000 7fc7f1d9b700 1 -- 172.21.15.31:0/730270515 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00b860 con 0x7fc7f415a290 2023-10-09T06:25:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.715+0000 7fc7f1d9b700 1 -- 172.21.15.31:0/730270515 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00bc00 con 0x7fc7f415a290 2023-10-09T06:25:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.715+0000 7fc7f9101700 1 -- 172.21.15.31:0/730270515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f415a290 msgr2=0x7fc7f406a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.715+0000 7fc7f9101700 1 --2- 172.21.15.31:0/730270515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f415a290 0x7fc7f406a5a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40711f0 tx=0x7fc7dc009250 comp rx=0 tx=0).stop 2023-10-09T06:25:33.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.715+0000 7fc7f9101700 1 -- 172.21.15.31:0/730270515 shutdown_connections 2023-10-09T06:25:33.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.715+0000 7fc7f9101700 1 --2- 172.21.15.31:0/730270515 >> v2:172.21.15.158:3300/0 conn(0x7fc7f406aae0 0x7fc7f40cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.715+0000 7fc7f9101700 1 --2- 172.21.15.31:0/730270515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f415a290 0x7fc7f406a5a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.715+0000 7fc7f9101700 1 -- 172.21.15.31:0/730270515 >> 172.21.15.31:0/730270515 conn(0x7fc7f40d1880 msgr2=0x7fc7f40cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:33.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.715+0000 7fc7f9101700 1 -- 172.21.15.31:0/730270515 shutdown_connections 2023-10-09T06:25:33.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.715+0000 7fc7f9101700 1 -- 172.21.15.31:0/730270515 wait complete. 2023-10-09T06:25:33.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.716+0000 7fc7f9101700 1 Processor -- start 2023-10-09T06:25:33.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.716+0000 7fc7f9101700 1 -- start start 2023-10-09T06:25:33.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.717+0000 7fc7f9101700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f406aae0 0x7fc7f40b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:33.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.717+0000 7fc7f9101700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7f4159ec0 0x7fc7f415c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:33.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.717+0000 7fc7f9101700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7f415a290 0x7fc7f41574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:33.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.717+0000 7fc7f9101700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f414f210 con 0x7fc7f406aae0 2023-10-09T06:25:33.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.717+0000 7fc7f9101700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f40b20d0 con 0x7fc7f415a290 2023-10-09T06:25:33.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.717+0000 7fc7f9101700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f415ca40 con 0x7fc7f4159ec0 2023-10-09T06:25:33.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.717+0000 7fc7f2d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f406aae0 0x7fc7f40b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:33.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.717+0000 7fc7f2d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f406aae0 0x7fc7f40b6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44016/0 (socket says 172.21.15.31:44016) 2023-10-09T06:25:33.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.717+0000 7fc7f2d9d700 1 -- 172.21.15.31:0/3096731590 learned_addr learned my addr 172.21.15.31:0/3096731590 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:33.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.717+0000 7fc7f359e700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7f415a290 0x7fc7f41574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:33.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.717+0000 7fc7f259c700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7f4159ec0 0x7fc7f415c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:33.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.718+0000 7fc7f2d9d700 1 -- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7f4159ec0 msgr2=0x7fc7f415c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.718+0000 7fc7f2d9d700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7f4159ec0 0x7fc7f415c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.718+0000 7fc7f2d9d700 1 -- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7f415a290 msgr2=0x7fc7f41574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.718+0000 7fc7f2d9d700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7f415a290 0x7fc7f41574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.718+0000 7fc7f2d9d700 1 -- 172.21.15.31:0/3096731590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc0094f0 con 0x7fc7f406aae0 2023-10-09T06:25:33.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.718+0000 7fc7f2d9d700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f406aae0 0x7fc7f40b6600 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400c5c0 tx=0x7fc7e400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:33.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.718+0000 7fc7eaffd700 1 -- 172.21.15.31:0/3096731590 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4011590 con 0x7fc7f406aae0 2023-10-09T06:25:33.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.718+0000 7fc7eaffd700 1 -- 172.21.15.31:0/3096731590 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e4011710 con 0x7fc7f406aae0 2023-10-09T06:25:33.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.718+0000 7fc7eaffd700 1 -- 172.21.15.31:0/3096731590 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4011ad0 con 0x7fc7f406aae0 2023-10-09T06:25:33.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.718+0000 7fc7f9101700 1 -- 172.21.15.31:0/3096731590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f40b1230 con 0x7fc7f406aae0 2023-10-09T06:25:33.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.718+0000 7fc7f9101700 1 -- 172.21.15.31:0/3096731590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f40b17f0 con 0x7fc7f406aae0 2023-10-09T06:25:33.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.719+0000 7fc7f9101700 1 -- 172.21.15.31:0/3096731590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f404c3c0 con 0x7fc7f406aae0 2023-10-09T06:25:33.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.719+0000 7fc7eaffd700 1 -- 172.21.15.31:0/3096731590 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7e401b3b0 con 0x7fc7f406aae0 2023-10-09T06:25:33.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.720+0000 7fc7eaffd700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc7d4066f30 0x7fc7d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:33.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.720+0000 7fc7eaffd700 1 -- 172.21.15.31:0/3096731590 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7e40839b0 con 0x7fc7f406aae0 2023-10-09T06:25:33.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.720+0000 7fc7f259c700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc7d4066f30 0x7fc7d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:33.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.720+0000 7fc7eaffd700 1 -- 172.21.15.31:0/3096731590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7fc7d406ea50 con 0x7fc7f406aae0 2023-10-09T06:25:33.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.720+0000 7fc7f259c700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc7d4066f30 0x7fc7d40693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40711f0 tx=0x7fc7dc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:33.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.724+0000 7fc7eaffd700 1 -- 172.21.15.31:0/3096731590 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7e4017070 con 0x7fc7f406aae0 2023-10-09T06:25:33.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.916+0000 7fc7f9101700 1 -- 172.21.15.31:0/3096731590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7f40b04b0 con 0x7fc7f406aae0 2023-10-09T06:25:33.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.916+0000 7fc7eaffd700 1 -- 172.21.15.31:0/3096731590 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7e4050c20 con 0x7fc7f406aae0 2023-10-09T06:25:33.917 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:25:33.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.918+0000 7fc7f9101700 1 -- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc7d4066f30 msgr2=0x7fc7d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.918+0000 7fc7f9101700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc7d4066f30 0x7fc7d40693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40711f0 tx=0x7fc7dc017000 comp rx=0 tx=0).stop 2023-10-09T06:25:33.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.918+0000 7fc7f9101700 1 -- 172.21.15.31:0/3096731590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f406aae0 msgr2=0x7fc7f40b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:33.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.918+0000 7fc7f9101700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f406aae0 0x7fc7f40b6600 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400c5c0 tx=0x7fc7e400c8d0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.918+0000 7fc7f9101700 1 -- 172.21.15.31:0/3096731590 shutdown_connections 2023-10-09T06:25:33.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.918+0000 7fc7f9101700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc7d4066f30 0x7fc7d40693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.918+0000 7fc7f9101700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7f415a290 0x7fc7f41574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.918+0000 7fc7f9101700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f406aae0 0x7fc7f40b6600 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.918+0000 7fc7f9101700 1 --2- 172.21.15.31:0/3096731590 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7f4159ec0 0x7fc7f415c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:33.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.918+0000 7fc7f9101700 1 -- 172.21.15.31:0/3096731590 >> 172.21.15.31:0/3096731590 conn(0x7fc7f40d1880 msgr2=0x7fc7f4159070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:33.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.918+0000 7fc7f9101700 1 -- 172.21.15.31:0/3096731590 shutdown_connections 2023-10-09T06:25:33.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:33.918+0000 7fc7f9101700 1 -- 172.21.15.31:0/3096731590 wait complete. 2023-10-09T06:25:33.931 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:25:34.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.053+0000 7f573e0a4700 1 Processor -- start 2023-10-09T06:25:34.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.053+0000 7f573e0a4700 1 -- start start 2023-10-09T06:25:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.053+0000 7f573e0a4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57380678b0 0x7f573815db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.053+0000 7f573e0a4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57380cbf10 0x7f573815e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.053+0000 7f573e0a4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57380cae70 con 0x7f57380c9390 2023-10-09T06:25:34.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.053+0000 7f573e0a4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57380cb150 con 0x7f57380cbf10 2023-10-09T06:25:34.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.053+0000 7f573e0a4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57380cb430 con 0x7f57380678b0 2023-10-09T06:25:34.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.054+0000 7f5736ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57380cbf10 0x7f573815e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.054+0000 7f5736ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57380cbf10 0x7f573815e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44024/0 (socket says 172.21.15.31:44024) 2023-10-09T06:25:34.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.054+0000 7f5736ffd700 1 -- 172.21.15.31:0/433716536 learned_addr learned my addr 172.21.15.31:0/433716536 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:34.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.054+0000 7f57377fe700 1 --2- 172.21.15.31:0/433716536 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57380678b0 0x7f573815db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.054+0000 7f5736ffd700 1 -- 172.21.15.31:0/433716536 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57380678b0 msgr2=0x7f573815db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:34.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.054+0000 7f5736ffd700 1 --2- 172.21.15.31:0/433716536 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57380678b0 0x7f573815db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.054+0000 7f5736ffd700 1 -- 172.21.15.31:0/433716536 >> v1:172.21.15.158:6789/0 conn(0x7f57380c9390 legacy=0x7f573806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.054+0000 7f5736ffd700 1 -- 172.21.15.31:0/433716536 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57380cb710 con 0x7f57380cbf10 2023-10-09T06:25:34.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.054+0000 7f57377fe700 1 --2- 172.21.15.31:0/433716536 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57380678b0 0x7f573815db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:34.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.054+0000 7f5736ffd700 1 --2- 172.21.15.31:0/433716536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57380cbf10 0x7f573815e0c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f572c0099b0 tx=0x7f572c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11e84e250d61a70 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:34.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.054+0000 7f57367fc700 1 -- 172.21.15.31:0/433716536 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00b860 con 0x7f57380cbf10 2023-10-09T06:25:34.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.054+0000 7f57367fc700 1 -- 172.21.15.31:0/433716536 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c00b9c0 con 0x7f57380cbf10 2023-10-09T06:25:34.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.054+0000 7f57367fc700 1 -- 172.21.15.31:0/433716536 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00bd60 con 0x7f57380cbf10 2023-10-09T06:25:34.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.055+0000 7f573e0a4700 1 -- 172.21.15.31:0/433716536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57380cbf10 msgr2=0x7f573815e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.055+0000 7f573e0a4700 1 --2- 172.21.15.31:0/433716536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57380cbf10 0x7f573815e0c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f572c0099b0 tx=0x7f572c009250 comp rx=0 tx=0).stop 2023-10-09T06:25:34.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.055+0000 7f573e0a4700 1 -- 172.21.15.31:0/433716536 shutdown_connections 2023-10-09T06:25:34.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.055+0000 7f573e0a4700 1 --2- 172.21.15.31:0/433716536 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57380678b0 0x7f573815db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.055+0000 7f573e0a4700 1 --2- 172.21.15.31:0/433716536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57380cbf10 0x7f573815e0c0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.055+0000 7f573e0a4700 1 -- 172.21.15.31:0/433716536 >> 172.21.15.31:0/433716536 conn(0x7f5738069870 msgr2=0x7f5738069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:34.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.055+0000 7f573e0a4700 1 -- 172.21.15.31:0/433716536 shutdown_connections 2023-10-09T06:25:34.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.055+0000 7f573e0a4700 1 -- 172.21.15.31:0/433716536 wait complete. 2023-10-09T06:25:34.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.056+0000 7f573e0a4700 1 Processor -- start 2023-10-09T06:25:34.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.056+0000 7f573e0a4700 1 -- start start 2023-10-09T06:25:34.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f573e0a4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57380678b0 0x7f5738153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f573e0a4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57380c9390 0x7f57380b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f573e0a4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57380cbf10 0x7f57380b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f573e0a4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573815f7c0 con 0x7f57380678b0 2023-10-09T06:25:34.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f573e0a4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573815eb40 con 0x7f57380cbf10 2023-10-09T06:25:34.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f573e0a4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573815ee20 con 0x7f57380c9390 2023-10-09T06:25:34.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f57377fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57380678b0 0x7f5738153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f57377fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57380678b0 0x7f5738153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44038/0 (socket says 172.21.15.31:44038) 2023-10-09T06:25:34.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f57377fe700 1 -- 172.21.15.31:0/2675666518 learned_addr learned my addr 172.21.15.31:0/2675666518 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:34.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f5736ffd700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57380c9390 0x7f57380b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f5737fff700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57380cbf10 0x7f57380b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f57377fe700 1 -- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57380c9390 msgr2=0x7f57380b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f57377fe700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57380c9390 0x7f57380b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f57377fe700 1 -- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57380cbf10 msgr2=0x7f57380b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f57377fe700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57380cbf10 0x7f57380b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f57377fe700 1 -- 172.21.15.31:0/2675666518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0094f0 con 0x7f57380678b0 2023-10-09T06:25:34.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f5736ffd700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57380c9390 0x7f57380b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:34.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f5737fff700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57380cbf10 0x7f57380b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:34.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.057+0000 7f57377fe700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57380678b0 0x7f5738153da0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f572800d1d0 tx=0x7f5728009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:34.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.058+0000 7f571f7fe700 1 -- 172.21.15.31:0/2675666518 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800de70 con 0x7f57380678b0 2023-10-09T06:25:34.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.058+0000 7f571f7fe700 1 -- 172.21.15.31:0/2675666518 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572800f040 con 0x7f57380678b0 2023-10-09T06:25:34.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.058+0000 7f571f7fe700 1 -- 172.21.15.31:0/2675666518 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728015670 con 0x7f57380678b0 2023-10-09T06:25:34.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.058+0000 7f573e0a4700 1 -- 172.21.15.31:0/2675666518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573815f100 con 0x7f57380678b0 2023-10-09T06:25:34.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.058+0000 7f573e0a4700 1 -- 172.21.15.31:0/2675666518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57380b2890 con 0x7f57380678b0 2023-10-09T06:25:34.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.059+0000 7f573e0a4700 1 -- 172.21.15.31:0/2675666518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57380c39a0 con 0x7f57380678b0 2023-10-09T06:25:34.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.059+0000 7f571f7fe700 1 -- 172.21.15.31:0/2675666518 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5728015a60 con 0x7f57380678b0 2023-10-09T06:25:34.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.059+0000 7f571f7fe700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5724066f30 0x7f57240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.060+0000 7f571f7fe700 1 -- 172.21.15.31:0/2675666518 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5728084a20 con 0x7f57380678b0 2023-10-09T06:25:34.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.060+0000 7f571f7fe700 1 -- 172.21.15.31:0/2675666518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7f572406ea50 con 0x7f57380678b0 2023-10-09T06:25:34.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.060+0000 7f5736ffd700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5724066f30 0x7f57240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.060+0000 7f5736ffd700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5724066f30 0x7f57240693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f572c0099b0 tx=0x7f572c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:34.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.064+0000 7f571f7fe700 1 -- 172.21.15.31:0/2675666518 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f572804e5a0 con 0x7f57380678b0 2023-10-09T06:25:34.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.256+0000 7f573e0a4700 1 -- 172.21.15.31:0/2675666518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f573804c3c0 con 0x7f57380678b0 2023-10-09T06:25:34.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.256+0000 7f571f7fe700 1 -- 172.21.15.31:0/2675666518 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f572801a060 con 0x7f57380678b0 2023-10-09T06:25:34.257 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:25:34.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.258+0000 7f573e0a4700 1 -- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5724066f30 msgr2=0x7f57240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.258+0000 7f573e0a4700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5724066f30 0x7f57240693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f572c0099b0 tx=0x7f572c017000 comp rx=0 tx=0).stop 2023-10-09T06:25:34.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.258+0000 7f573e0a4700 1 -- 172.21.15.31:0/2675666518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57380678b0 msgr2=0x7f5738153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.258+0000 7f573e0a4700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57380678b0 0x7f5738153da0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f572800d1d0 tx=0x7f5728009a90 comp rx=0 tx=0).stop 2023-10-09T06:25:34.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.258+0000 7f573e0a4700 1 -- 172.21.15.31:0/2675666518 shutdown_connections 2023-10-09T06:25:34.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.258+0000 7f573e0a4700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5724066f30 0x7f57240693e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.258+0000 7f573e0a4700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57380cbf10 0x7f57380b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.258+0000 7f573e0a4700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57380678b0 0x7f5738153da0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.258+0000 7f573e0a4700 1 --2- 172.21.15.31:0/2675666518 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57380c9390 0x7f57380b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.258+0000 7f573e0a4700 1 -- 172.21.15.31:0/2675666518 >> 172.21.15.31:0/2675666518 conn(0x7f5738069870 msgr2=0x7f5738158440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:34.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.258+0000 7f573e0a4700 1 -- 172.21.15.31:0/2675666518 shutdown_connections 2023-10-09T06:25:34.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.258+0000 7f573e0a4700 1 -- 172.21.15.31:0/2675666518 wait complete. 2023-10-09T06:25:34.271 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:25:34.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.392+0000 7fc6b79ee700 1 Processor -- start 2023-10-09T06:25:34.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.392+0000 7fc6b79ee700 1 -- start start 2023-10-09T06:25:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.393+0000 7fc6b79ee700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc6b015b9a0 0x7fc6b00caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.393+0000 7fc6b79ee700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6b006d370 0x7fc6b006d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.393+0000 7fc6b79ee700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b015c8d0 con 0x7fc6b0152300 2023-10-09T06:25:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.393+0000 7fc6b79ee700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b00b1400 con 0x7fc6b006d370 2023-10-09T06:25:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.393+0000 7fc6b79ee700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b015be20 con 0x7fc6b015b9a0 2023-10-09T06:25:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.393+0000 7fc6b5f8b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6b006d370 0x7fc6b006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.393+0000 7fc6b5f8b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6b006d370 0x7fc6b006d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44048/0 (socket says 172.21.15.31:44048) 2023-10-09T06:25:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.393+0000 7fc6b578a700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fc6b0152300 0x7fc6b0158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:58238/0 (socket says 172.21.15.31:58238) 2023-10-09T06:25:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.393+0000 7fc6b5f8b700 1 -- 172.21.15.31:0/3057008766 learned_addr learned my addr 172.21.15.31:0/3057008766 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.393+0000 7fc6b4f89700 1 --2- 172.21.15.31:0/3057008766 >> v2:172.21.15.158:3300/0 conn(0x7fc6b015b9a0 0x7fc6b00caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.394+0000 7fc6b5f8b700 1 -- 172.21.15.31:0/3057008766 >> v2:172.21.15.158:3300/0 conn(0x7fc6b015b9a0 msgr2=0x7fc6b00caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.394+0000 7fc6b5f8b700 1 --2- 172.21.15.31:0/3057008766 >> v2:172.21.15.158:3300/0 conn(0x7fc6b015b9a0 0x7fc6b00caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.394+0000 7fc6affff700 1 -- 172.21.15.31:0/3057008766 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113880308 0 0) 0x7fc6b015c8d0 con 0x7fc6b0152300 2023-10-09T06:25:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.394+0000 7fc6b5f8b700 1 -- 172.21.15.31:0/3057008766 >> v1:172.21.15.158:6789/0 conn(0x7fc6b0152300 legacy=0x7fc6b0158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.394+0000 7fc6b5f8b700 1 -- 172.21.15.31:0/3057008766 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b00c9370 con 0x7fc6b006d370 2023-10-09T06:25:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.394+0000 7fc6b5f8b700 1 --2- 172.21.15.31:0/3057008766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6b006d370 0x7fc6b006d790 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc6b006e8d0 tx=0x7fc6a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b04b5273847556 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.394+0000 7fc6affff700 1 -- 172.21.15.31:0/3057008766 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8009e70 con 0x7fc6b006d370 2023-10-09T06:25:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.394+0000 7fc6affff700 1 -- 172.21.15.31:0/3057008766 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a800b860 con 0x7fc6b006d370 2023-10-09T06:25:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.394+0000 7fc6affff700 1 -- 172.21.15.31:0/3057008766 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800bc00 con 0x7fc6b006d370 2023-10-09T06:25:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.395+0000 7fc6b79ee700 1 -- 172.21.15.31:0/3057008766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6b006d370 msgr2=0x7fc6b006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.395+0000 7fc6b79ee700 1 --2- 172.21.15.31:0/3057008766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6b006d370 0x7fc6b006d790 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc6b006e8d0 tx=0x7fc6a8009250 comp rx=0 tx=0).stop 2023-10-09T06:25:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.395+0000 7fc6b79ee700 1 -- 172.21.15.31:0/3057008766 shutdown_connections 2023-10-09T06:25:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.395+0000 7fc6b79ee700 1 --2- 172.21.15.31:0/3057008766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6b006d370 0x7fc6b006d790 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.395+0000 7fc6b79ee700 1 --2- 172.21.15.31:0/3057008766 >> v2:172.21.15.158:3300/0 conn(0x7fc6b015b9a0 0x7fc6b00caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.395+0000 7fc6b79ee700 1 -- 172.21.15.31:0/3057008766 >> 172.21.15.31:0/3057008766 conn(0x7fc6b0069870 msgr2=0x7fc6b0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.395+0000 7fc6b79ee700 1 -- 172.21.15.31:0/3057008766 shutdown_connections 2023-10-09T06:25:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.395+0000 7fc6b79ee700 1 -- 172.21.15.31:0/3057008766 wait complete. 2023-10-09T06:25:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.396+0000 7fc6b79ee700 1 Processor -- start 2023-10-09T06:25:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.396+0000 7fc6b79ee700 1 -- start start 2023-10-09T06:25:34.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b79ee700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6b006d370 0x7fc6b01516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b79ee700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6b0152300 0x7fc6b0152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b79ee700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6b015b9a0 0x7fc6b00b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b79ee700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00c6f40 con 0x7fc6b015b9a0 2023-10-09T06:25:34.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b79ee700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00c6250 con 0x7fc6b006d370 2023-10-09T06:25:34.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b79ee700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00c6530 con 0x7fc6b0152300 2023-10-09T06:25:34.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b5f8b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6b015b9a0 0x7fc6b00b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b578a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6b006d370 0x7fc6b01516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b5f8b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6b015b9a0 0x7fc6b00b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44062/0 (socket says 172.21.15.31:44062) 2023-10-09T06:25:34.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b578a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6b006d370 0x7fc6b01516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:36646/0 (socket says 172.21.15.31:36646) 2023-10-09T06:25:34.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b5f8b700 1 -- 172.21.15.31:0/1066839350 learned_addr learned my addr 172.21.15.31:0/1066839350 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:34.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b4f89700 1 --2- 172.21.15.31:0/1066839350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6b0152300 0x7fc6b0152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b5f8b700 1 -- 172.21.15.31:0/1066839350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6b0152300 msgr2=0x7fc6b0152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b5f8b700 1 --2- 172.21.15.31:0/1066839350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6b0152300 0x7fc6b0152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b5f8b700 1 -- 172.21.15.31:0/1066839350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6b006d370 msgr2=0x7fc6b01516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b5f8b700 1 --2- 172.21.15.31:0/1066839350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6b006d370 0x7fc6b01516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b5f8b700 1 -- 172.21.15.31:0/1066839350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a80094f0 con 0x7fc6b015b9a0 2023-10-09T06:25:34.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6b5f8b700 1 --2- 172.21.15.31:0/1066839350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6b015b9a0 0x7fc6b00b2970 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009290 tx=0x7fc6a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:34.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.397+0000 7fc6ad7fa700 1 -- 172.21.15.31:0/1066839350 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800b9d0 con 0x7fc6b015b9a0 2023-10-09T06:25:34.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.398+0000 7fc6ad7fa700 1 -- 172.21.15.31:0/1066839350 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a800bb70 con 0x7fc6b015b9a0 2023-10-09T06:25:34.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.398+0000 7fc6ad7fa700 1 -- 172.21.15.31:0/1066839350 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8025670 con 0x7fc6b015b9a0 2023-10-09T06:25:34.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.398+0000 7fc6b79ee700 1 -- 172.21.15.31:0/1066839350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b00c6810 con 0x7fc6b015b9a0 2023-10-09T06:25:34.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.398+0000 7fc6b79ee700 1 -- 172.21.15.31:0/1066839350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b0151c00 con 0x7fc6b015b9a0 2023-10-09T06:25:34.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.398+0000 7fc6b79ee700 1 -- 172.21.15.31:0/1066839350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b00c7140 con 0x7fc6b015b9a0 2023-10-09T06:25:34.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.399+0000 7fc6ad7fa700 1 -- 172.21.15.31:0/1066839350 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6a8023070 con 0x7fc6b015b9a0 2023-10-09T06:25:34.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.399+0000 7fc6ad7fa700 1 --2- 172.21.15.31:0/1066839350 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc69c066f30 0x7fc69c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.399+0000 7fc6ad7fa700 1 -- 172.21.15.31:0/1066839350 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6a8085a60 con 0x7fc6b015b9a0 2023-10-09T06:25:34.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.399+0000 7fc6b578a700 1 --2- 172.21.15.31:0/1066839350 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc69c066f30 0x7fc69c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.399+0000 7fc6ad7fa700 1 -- 172.21.15.31:0/1066839350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7fc69c06ea50 con 0x7fc6b015b9a0 2023-10-09T06:25:34.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.400+0000 7fc6b578a700 1 --2- 172.21.15.31:0/1066839350 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc69c066f30 0x7fc69c0693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0001560 tx=0x7fc6a0001b00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:34.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.403+0000 7fc6ad7fa700 1 -- 172.21.15.31:0/1066839350 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6a802a060 con 0x7fc6b015b9a0 2023-10-09T06:25:34.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.596+0000 7fc6b79ee700 1 -- 172.21.15.31:0/1066839350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6b006a6b0 con 0x7fc6b015b9a0 2023-10-09T06:25:34.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.597+0000 7fc6ad7fa700 1 -- 172.21.15.31:0/1066839350 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6a8015020 con 0x7fc6b015b9a0 2023-10-09T06:25:34.598 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:25:34.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.599+0000 7fc6b79ee700 1 -- 172.21.15.31:0/1066839350 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc69c066f30 msgr2=0x7fc69c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.599+0000 7fc6b79ee700 1 --2- 172.21.15.31:0/1066839350 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc69c066f30 0x7fc69c0693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0001560 tx=0x7fc6a0001b00 comp rx=0 tx=0).stop 2023-10-09T06:25:34.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.599+0000 7fc6b79ee700 1 -- 172.21.15.31:0/1066839350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6b015b9a0 msgr2=0x7fc6b00b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.599+0000 7fc6b79ee700 1 --2- 172.21.15.31:0/1066839350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6b015b9a0 0x7fc6b00b2970 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009290 tx=0x7fc6a8017000 comp rx=0 tx=0).stop 2023-10-09T06:25:34.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.599+0000 7fc6b79ee700 1 -- 172.21.15.31:0/1066839350 shutdown_connections 2023-10-09T06:25:34.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.599+0000 7fc6b79ee700 1 --2- 172.21.15.31:0/1066839350 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc69c066f30 0x7fc69c0693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.599+0000 7fc6b79ee700 1 --2- 172.21.15.31:0/1066839350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6b015b9a0 0x7fc6b00b2970 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.599+0000 7fc6b79ee700 1 --2- 172.21.15.31:0/1066839350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6b006d370 0x7fc6b01516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.599+0000 7fc6b79ee700 1 --2- 172.21.15.31:0/1066839350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc6b0152300 0x7fc6b0152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.599+0000 7fc6b79ee700 1 -- 172.21.15.31:0/1066839350 >> 172.21.15.31:0/1066839350 conn(0x7fc6b0069870 msgr2=0x7fc6b00caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:34.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.599+0000 7fc6b79ee700 1 -- 172.21.15.31:0/1066839350 shutdown_connections 2023-10-09T06:25:34.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.599+0000 7fc6b79ee700 1 -- 172.21.15.31:0/1066839350 wait complete. 2023-10-09T06:25:34.611 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:25:34.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.730+0000 7fe0397e6700 1 Processor -- start 2023-10-09T06:25:34.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.730+0000 7fe0397e6700 1 -- start start 2023-10-09T06:25:34.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.730+0000 7fe0397e6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe034157870 0x7fe03415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.730+0000 7fe0397e6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe034157c40 0x7fe034158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.730+0000 7fe0397e6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03415cbb0 con 0x7fe03415a620 2023-10-09T06:25:34.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.730+0000 7fe0397e6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03415bfa0 con 0x7fe034157870 2023-10-09T06:25:34.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe0397e6700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03415c280 con 0x7fe034157c40 2023-10-09T06:25:34.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe032ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe034157870 0x7fe03415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe032ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe034157870 0x7fe03415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44072/0 (socket says 172.21.15.31:44072) 2023-10-09T06:25:34.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe032ffd700 1 -- 172.21.15.31:0/16199108 learned_addr learned my addr 172.21.15.31:0/16199108 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:34.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe0337fe700 1 --2- 172.21.15.31:0/16199108 >> v2:172.21.15.158:3300/0 conn(0x7fe034157c40 0x7fe034158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe032ffd700 1 -- 172.21.15.31:0/16199108 >> v2:172.21.15.158:3300/0 conn(0x7fe034157c40 msgr2=0x7fe034158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:34.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe032ffd700 1 --2- 172.21.15.31:0/16199108 >> v2:172.21.15.158:3300/0 conn(0x7fe034157c40 0x7fe034158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe032ffd700 1 -- 172.21.15.31:0/16199108 >> v1:172.21.15.158:6789/0 conn(0x7fe03415a620 legacy=0x7fe03415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:34.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe032ffd700 1 -- 172.21.15.31:0/16199108 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03415c560 con 0x7fe034157870 2023-10-09T06:25:34.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe0337fe700 1 --2- 172.21.15.31:0/16199108 >> v2:172.21.15.158:3300/0 conn(0x7fe034157c40 0x7fe034158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:34.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe032ffd700 1 --2- 172.21.15.31:0/16199108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe034157870 0x7fe03415b6a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe03406b4e0 tx=0x7fe024009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282a7c4059dd56ff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:34.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe031ffb700 1 -- 172.21.15.31:0/16199108 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02400b820 con 0x7fe034157870 2023-10-09T06:25:34.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe031ffb700 1 -- 172.21.15.31:0/16199108 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02400b980 con 0x7fe034157870 2023-10-09T06:25:34.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.731+0000 7fe031ffb700 1 -- 172.21.15.31:0/16199108 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02400bd20 con 0x7fe034157870 2023-10-09T06:25:34.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.732+0000 7fe0397e6700 1 -- 172.21.15.31:0/16199108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe034157870 msgr2=0x7fe03415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.732+0000 7fe0397e6700 1 --2- 172.21.15.31:0/16199108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe034157870 0x7fe03415b6a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe03406b4e0 tx=0x7fe024009250 comp rx=0 tx=0).stop 2023-10-09T06:25:34.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.732+0000 7fe0397e6700 1 -- 172.21.15.31:0/16199108 shutdown_connections 2023-10-09T06:25:34.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.732+0000 7fe0397e6700 1 --2- 172.21.15.31:0/16199108 >> v2:172.21.15.158:3300/0 conn(0x7fe034157c40 0x7fe034158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.732+0000 7fe0397e6700 1 --2- 172.21.15.31:0/16199108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe034157870 0x7fe03415b6a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.732+0000 7fe0397e6700 1 -- 172.21.15.31:0/16199108 >> 172.21.15.31:0/16199108 conn(0x7fe034068ce0 msgr2=0x7fe0340690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:34.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.732+0000 7fe0397e6700 1 -- 172.21.15.31:0/16199108 shutdown_connections 2023-10-09T06:25:34.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.732+0000 7fe0397e6700 1 -- 172.21.15.31:0/16199108 wait complete. 2023-10-09T06:25:34.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.733+0000 7fe0397e6700 1 Processor -- start 2023-10-09T06:25:34.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.733+0000 7fe0397e6700 1 -- start start 2023-10-09T06:25:34.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe0397e6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe034157870 0x7fe03414d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe0397e6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe034157c40 0x7fe034151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe0397e6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe03415a620 0x7fe0341536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe0397e6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0341550c0 con 0x7fe034157870 2023-10-09T06:25:34.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe0397e6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe034155ec0 con 0x7fe034157c40 2023-10-09T06:25:34.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe0397e6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0341552b0 con 0x7fe03415a620 2023-10-09T06:25:34.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe032ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe034157870 0x7fe03414d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe032ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe034157870 0x7fe03414d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44078/0 (socket says 172.21.15.31:44078) 2023-10-09T06:25:34.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe032ffd700 1 -- 172.21.15.31:0/1200357569 learned_addr learned my addr 172.21.15.31:0/1200357569 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:34.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe0327fc700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe034157c40 0x7fe034151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe0337fe700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe03415a620 0x7fe0341536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe032ffd700 1 -- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe03415a620 msgr2=0x7fe0341536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe032ffd700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe03415a620 0x7fe0341536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe032ffd700 1 -- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe034157c40 msgr2=0x7fe034151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe032ffd700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe034157c40 0x7fe034151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe032ffd700 1 -- 172.21.15.31:0/1200357569 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0240094f0 con 0x7fe034157870 2023-10-09T06:25:34.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe032ffd700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe034157870 0x7fe03414d5a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe0240030c0 tx=0x7fe024016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:34.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.734+0000 7fe02affd700 1 -- 172.21.15.31:0/1200357569 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024011e60 con 0x7fe034157870 2023-10-09T06:25:34.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.735+0000 7fe02affd700 1 -- 172.21.15.31:0/1200357569 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02401b680 con 0x7fe034157870 2023-10-09T06:25:34.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.735+0000 7fe0397e6700 1 -- 172.21.15.31:0/1200357569 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe034155590 con 0x7fe034157870 2023-10-09T06:25:34.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.735+0000 7fe02affd700 1 -- 172.21.15.31:0/1200357569 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02401ba20 con 0x7fe034157870 2023-10-09T06:25:34.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.735+0000 7fe0397e6700 1 -- 172.21.15.31:0/1200357569 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe034155b50 con 0x7fe034157870 2023-10-09T06:25:34.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.735+0000 7fe0397e6700 1 -- 172.21.15.31:0/1200357569 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03404c3c0 con 0x7fe034157870 2023-10-09T06:25:34.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.736+0000 7fe02affd700 1 -- 172.21.15.31:0/1200357569 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe02401c450 con 0x7fe034157870 2023-10-09T06:25:34.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.736+0000 7fe02affd700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe014066f30 0x7fe0140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:34.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.736+0000 7fe02affd700 1 -- 172.21.15.31:0/1200357569 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe024086250 con 0x7fe034157870 2023-10-09T06:25:34.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.736+0000 7fe0327fc700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe014066f30 0x7fe0140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:34.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.736+0000 7fe02affd700 1 -- 172.21.15.31:0/1200357569 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7fe01406ea50 con 0x7fe034157870 2023-10-09T06:25:34.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.737+0000 7fe0327fc700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe014066f30 0x7fe0140693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe034153400 tx=0x7fe01c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:34.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.740+0000 7fe02affd700 1 -- 172.21.15.31:0/1200357569 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe02402a060 con 0x7fe034157870 2023-10-09T06:25:34.751 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:25:34.750+0000 7fc5eaab7700 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-10-09T06:25:34.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.754+0000 7fe02affd700 1 -- 172.21.15.31:0/1200357569 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(88..88 src has 1..88) v4 ==== 288+0+0 (secure 0 0 0) 0x7fe024057880 con 0x7fe034157870 2023-10-09T06:25:34.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.754+0000 7fe02affd700 1 -- 172.21.15.31:0/1200357569 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7fe01406f230 con 0x7fe034157870 2023-10-09T06:25:34.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.978+0000 7fe0397e6700 1 -- 172.21.15.31:0/1200357569 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe03415c840 con 0x7fe034157870 2023-10-09T06:25:34.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.979+0000 7fe02affd700 1 -- 172.21.15.31:0/1200357569 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fe0240534c0 con 0x7fe034157870 2023-10-09T06:25:34.979 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:34.979 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2895057012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2895057012},{"type":"v1","addr":"172.21.15.158:6836","nonce":2895057012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5707,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/756230701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":756230701},{"type":"v1","addr":"172.21.15.158:6837","nonce":756230701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5961,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2803435352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2803435352},{"type":"v1","addr":"172.21.15.31:6834","nonce":2803435352}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:24:51.381116+0000","modified":"2023-10-09T06:24:54.984865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1373095674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1373095674},{"type":"v1","addr":"172.21.15.31:6835","nonce":1373095674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T06:25:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.981+0000 7fe0397e6700 1 -- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe014066f30 msgr2=0x7fe0140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.981+0000 7fe0397e6700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe014066f30 0x7fe0140693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe034153400 tx=0x7fe01c008040 comp rx=0 tx=0).stop 2023-10-09T06:25:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.981+0000 7fe0397e6700 1 -- 172.21.15.31:0/1200357569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe034157870 msgr2=0x7fe03414d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.981+0000 7fe0397e6700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe034157870 0x7fe03414d5a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe0240030c0 tx=0x7fe024016000 comp rx=0 tx=0).stop 2023-10-09T06:25:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.981+0000 7fe0397e6700 1 -- 172.21.15.31:0/1200357569 shutdown_connections 2023-10-09T06:25:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.981+0000 7fe0397e6700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe014066f30 0x7fe0140693e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.981+0000 7fe0397e6700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe03415a620 0x7fe0341536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.981+0000 7fe0397e6700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe034157870 0x7fe03414d5a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.981+0000 7fe0397e6700 1 --2- 172.21.15.31:0/1200357569 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe034157c40 0x7fe034151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.981+0000 7fe0397e6700 1 -- 172.21.15.31:0/1200357569 >> 172.21.15.31:0/1200357569 conn(0x7fe034068ce0 msgr2=0x7fe0340690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:34.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.981+0000 7fe0397e6700 1 -- 172.21.15.31:0/1200357569 shutdown_connections 2023-10-09T06:25:34.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:34.981+0000 7fe0397e6700 1 -- 172.21.15.31:0/1200357569 wait complete. 2023-10-09T06:25:34.983 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 42 2023-10-09T06:25:34.994 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:25:35.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.111+0000 7fb85079e700 1 Processor -- start 2023-10-09T06:25:35.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.111+0000 7fb85079e700 1 -- start start 2023-10-09T06:25:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.112+0000 7fb85079e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb8480b1220 0x7fb8480c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.112+0000 7fb85079e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8480cb4f0 0x7fb8480cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.112+0000 7fb85079e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84815de60 con 0x7fb8480b0e50 2023-10-09T06:25:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.112+0000 7fb85079e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480cbed0 con 0x7fb8480b1220 2023-10-09T06:25:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.112+0000 7fb85079e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84815e140 con 0x7fb8480cb4f0 2023-10-09T06:25:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.112+0000 7fb84dd39700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb8480b1220 0x7fb8480c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.113+0000 7fb84dd39700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb8480b1220 0x7fb8480c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44084/0 (socket says 172.21.15.31:44084) 2023-10-09T06:25:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.113+0000 7fb84dd39700 1 -- 172.21.15.31:0/220128048 learned_addr learned my addr 172.21.15.31:0/220128048 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.113+0000 7fb84ed3b700 1 --2- 172.21.15.31:0/220128048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8480cb4f0 0x7fb8480cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.113+0000 7fb84dd39700 1 -- 172.21.15.31:0/220128048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8480cb4f0 msgr2=0x7fb8480cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:35.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.113+0000 7fb84dd39700 1 --2- 172.21.15.31:0/220128048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8480cb4f0 0x7fb8480cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.113+0000 7fb84dd39700 1 -- 172.21.15.31:0/220128048 >> v1:172.21.15.158:6789/0 conn(0x7fb8480b0e50 legacy=0x7fb84806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:35.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.113+0000 7fb84dd39700 1 -- 172.21.15.31:0/220128048 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84815e420 con 0x7fb8480b1220 2023-10-09T06:25:35.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.113+0000 7fb84dd39700 1 --2- 172.21.15.31:0/220128048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b1220 0x7fb8480c9180 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0099b0 tx=0x7fb83c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0fa0b7afc50add server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:35.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.113+0000 7fb84d538700 1 -- 172.21.15.31:0/220128048 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00b820 con 0x7fb8480b1220 2023-10-09T06:25:35.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.113+0000 7fb84d538700 1 -- 172.21.15.31:0/220128048 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c00b980 con 0x7fb8480b1220 2023-10-09T06:25:35.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.113+0000 7fb84d538700 1 -- 172.21.15.31:0/220128048 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00bd40 con 0x7fb8480b1220 2023-10-09T06:25:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.114+0000 7fb85079e700 1 -- 172.21.15.31:0/220128048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b1220 msgr2=0x7fb8480c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.114+0000 7fb85079e700 1 --2- 172.21.15.31:0/220128048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b1220 0x7fb8480c9180 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0099b0 tx=0x7fb83c009250 comp rx=0 tx=0).stop 2023-10-09T06:25:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.114+0000 7fb85079e700 1 -- 172.21.15.31:0/220128048 shutdown_connections 2023-10-09T06:25:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.114+0000 7fb85079e700 1 --2- 172.21.15.31:0/220128048 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8480cb4f0 0x7fb8480cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.114+0000 7fb85079e700 1 --2- 172.21.15.31:0/220128048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b1220 0x7fb8480c9180 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.114+0000 7fb85079e700 1 -- 172.21.15.31:0/220128048 >> 172.21.15.31:0/220128048 conn(0x7fb848069870 msgr2=0x7fb848069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.114+0000 7fb85079e700 1 -- 172.21.15.31:0/220128048 shutdown_connections 2023-10-09T06:25:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.114+0000 7fb85079e700 1 -- 172.21.15.31:0/220128048 wait complete. 2023-10-09T06:25:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.115+0000 7fb85079e700 1 Processor -- start 2023-10-09T06:25:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.115+0000 7fb85079e700 1 -- start start 2023-10-09T06:25:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb85079e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8480b0e50 0x7fb84816af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb85079e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b1220 0x7fb848155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb85079e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8480cb4f0 0x7fb8480c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb85079e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480b4800 con 0x7fb8480b1220 2023-10-09T06:25:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb85079e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480b2090 con 0x7fb8480cb4f0 2023-10-09T06:25:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb85079e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480b1a80 con 0x7fb8480b0e50 2023-10-09T06:25:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb84dd39700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b1220 0x7fb848155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb84dd39700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b1220 0x7fb848155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44098/0 (socket says 172.21.15.31:44098) 2023-10-09T06:25:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb84dd39700 1 -- 172.21.15.31:0/213828839 learned_addr learned my addr 172.21.15.31:0/213828839 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb84e53a700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8480b0e50 0x7fb84816af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb84ed3b700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8480cb4f0 0x7fb8480c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb84dd39700 1 -- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8480b0e50 msgr2=0x7fb84816af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb84dd39700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8480b0e50 0x7fb84816af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb84dd39700 1 -- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8480cb4f0 msgr2=0x7fb8480c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb84dd39700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8480cb4f0 0x7fb8480c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb84dd39700 1 -- 172.21.15.31:0/213828839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c0094f0 con 0x7fb8480b1220 2023-10-09T06:25:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb84ed3b700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8480cb4f0 0x7fb8480c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb84dd39700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b1220 0x7fb848155ba0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb8480c59e0 tx=0x7fb83c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb8467fc700 1 -- 172.21.15.31:0/213828839 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00b820 con 0x7fb8480b1220 2023-10-09T06:25:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb8467fc700 1 -- 172.21.15.31:0/213828839 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c020070 con 0x7fb8480b1220 2023-10-09T06:25:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb85079e700 1 -- 172.21.15.31:0/213828839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8480b4520 con 0x7fb8480b1220 2023-10-09T06:25:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.116+0000 7fb8467fc700 1 -- 172.21.15.31:0/213828839 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c011da0 con 0x7fb8480b1220 2023-10-09T06:25:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.117+0000 7fb85079e700 1 -- 172.21.15.31:0/213828839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb848156610 con 0x7fb8480b1220 2023-10-09T06:25:35.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.117+0000 7fb85079e700 1 -- 172.21.15.31:0/213828839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8480b18e0 con 0x7fb8480b1220 2023-10-09T06:25:35.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.118+0000 7fb8467fc700 1 -- 172.21.15.31:0/213828839 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb83c022030 con 0x7fb8480b1220 2023-10-09T06:25:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.118+0000 7fb8467fc700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb834066f30 0x7fb8340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.118+0000 7fb8467fc700 1 -- 172.21.15.31:0/213828839 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb83c086310 con 0x7fb8480b1220 2023-10-09T06:25:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.118+0000 7fb8467fc700 1 -- 172.21.15.31:0/213828839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7fb83406ea50 con 0x7fb8480b1220 2023-10-09T06:25:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.118+0000 7fb84e53a700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb834066f30 0x7fb8340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.119+0000 7fb84e53a700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb834066f30 0x7fb8340693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb840007560 tx=0x7fb840009760 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.122+0000 7fb8467fc700 1 -- 172.21.15.31:0/213828839 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8480b18e0 con 0x7fb8480b1220 2023-10-09T06:25:35.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.316+0000 7fb85079e700 1 -- 172.21.15.31:0/213828839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8480b18e0 con 0x7fb8480b1220 2023-10-09T06:25:35.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.317+0000 7fb8467fc700 1 -- 172.21.15.31:0/213828839 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+15389 (secure 0 0 0) 0x7fb8480b18e0 con 0x7fb8480b1220 2023-10-09T06:25:35.317 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:35.318 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":88,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:25:34.751912+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:24:49.565040+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T06:24:50.345838+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:25:35.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.318+0000 7fb85079e700 1 -- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb834066f30 msgr2=0x7fb8340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.318+0000 7fb85079e700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb834066f30 0x7fb8340693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb840007560 tx=0x7fb840009760 comp rx=0 tx=0).stop 2023-10-09T06:25:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.319+0000 7fb85079e700 1 -- 172.21.15.31:0/213828839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b1220 msgr2=0x7fb848155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.319+0000 7fb85079e700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b1220 0x7fb848155ba0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb8480c59e0 tx=0x7fb83c016000 comp rx=0 tx=0).stop 2023-10-09T06:25:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.319+0000 7fb85079e700 1 -- 172.21.15.31:0/213828839 shutdown_connections 2023-10-09T06:25:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.319+0000 7fb85079e700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb834066f30 0x7fb8340693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.319+0000 7fb85079e700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb8480b0e50 0x7fb84816af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.319+0000 7fb85079e700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8480cb4f0 0x7fb8480c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.319+0000 7fb85079e700 1 --2- 172.21.15.31:0/213828839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b1220 0x7fb848155ba0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.319+0000 7fb85079e700 1 -- 172.21.15.31:0/213828839 >> 172.21.15.31:0/213828839 conn(0x7fb848069870 msgr2=0x7fb848156fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.319+0000 7fb85079e700 1 -- 172.21.15.31:0/213828839 shutdown_connections 2023-10-09T06:25:35.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.319+0000 7fb85079e700 1 -- 172.21.15.31:0/213828839 wait complete. 2023-10-09T06:25:35.331 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:25:35.332 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:25:35.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.450+0000 7f16a2419700 1 Processor -- start 2023-10-09T06:25:35.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.450+0000 7f16a2419700 1 -- start start 2023-10-09T06:25:35.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.450+0000 7f16a2419700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f169c152010 0x7f169c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.450+0000 7f16a2419700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f169c158e50 0x7f169c0cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.450+0000 7f16a2419700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c06c010 con 0x7f169c1523e0 2023-10-09T06:25:35.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.450+0000 7f16a2419700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c06bd10 con 0x7f169c158e50 2023-10-09T06:25:35.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.450+0000 7f16a2419700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c15c060 con 0x7f169c152010 2023-10-09T06:25:35.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.450+0000 7f16a09b6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f169c158e50 0x7f169c0cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.451+0000 7f169b7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f169c1523e0 0x7f169c06c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47062/0 (socket says 172.21.15.31:47062) 2023-10-09T06:25:35.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.451+0000 7f169b7fe700 1 -- 172.21.15.31:0/2861082432 learned_addr learned my addr 172.21.15.31:0/2861082432 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:35.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.451+0000 7f169bfff700 1 --2- 172.21.15.31:0/2861082432 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f169c152010 0x7f169c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.451+0000 7f16a09b6700 1 -- 172.21.15.31:0/2861082432 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f169c152010 msgr2=0x7f169c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:35.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.451+0000 7f16a09b6700 1 --2- 172.21.15.31:0/2861082432 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f169c152010 0x7f169c15b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.451+0000 7f16a09b6700 1 -- 172.21.15.31:0/2861082432 >> v1:172.21.15.31:6789/0 conn(0x7f169c1523e0 legacy=0x7f169c06c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.451+0000 7f169affd700 1 -- 172.21.15.31:0/2861082432 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702822489 0 0) 0x7f169c06c010 con 0x7f169c1523e0 2023-10-09T06:25:35.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.451+0000 7f16a09b6700 1 -- 172.21.15.31:0/2861082432 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c15c340 con 0x7f169c158e50 2023-10-09T06:25:35.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.451+0000 7f169bfff700 1 --2- 172.21.15.31:0/2861082432 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f169c152010 0x7f169c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:35.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.451+0000 7f16a09b6700 1 --2- 172.21.15.31:0/2861082432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169c158e50 0x7f169c0cdf30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1694009e60 tx=0x7f1694009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f7f02641902f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:35.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.451+0000 7f169affd700 1 -- 172.21.15.31:0/2861082432 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169400e070 con 0x7f169c158e50 2023-10-09T06:25:35.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.451+0000 7f169affd700 1 -- 172.21.15.31:0/2861082432 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169400bc30 con 0x7f169c158e50 2023-10-09T06:25:35.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.451+0000 7f169affd700 1 -- 172.21.15.31:0/2861082432 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694012430 con 0x7f169c158e50 2023-10-09T06:25:35.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.452+0000 7f16a2419700 1 -- 172.21.15.31:0/2861082432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169c158e50 msgr2=0x7f169c0cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.452+0000 7f16a2419700 1 --2- 172.21.15.31:0/2861082432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169c158e50 0x7f169c0cdf30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1694009e60 tx=0x7f1694009780 comp rx=0 tx=0).stop 2023-10-09T06:25:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.452+0000 7f16a2419700 1 -- 172.21.15.31:0/2861082432 shutdown_connections 2023-10-09T06:25:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.452+0000 7f16a2419700 1 --2- 172.21.15.31:0/2861082432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169c158e50 0x7f169c0cdf30 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.452+0000 7f16a2419700 1 --2- 172.21.15.31:0/2861082432 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f169c152010 0x7f169c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.452+0000 7f16a2419700 1 -- 172.21.15.31:0/2861082432 >> 172.21.15.31:0/2861082432 conn(0x7f169c069870 msgr2=0x7f169c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.452+0000 7f16a2419700 1 -- 172.21.15.31:0/2861082432 shutdown_connections 2023-10-09T06:25:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.452+0000 7f16a2419700 1 -- 172.21.15.31:0/2861082432 wait complete. 2023-10-09T06:25:35.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.453+0000 7f16a2419700 1 Processor -- start 2023-10-09T06:25:35.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.453+0000 7f16a2419700 1 -- start start 2023-10-09T06:25:35.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a2419700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f169c152010 0x7f169c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a2419700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f169c1523e0 0x7f169c0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a2419700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169c158e50 0x7f169c1494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a2419700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0c7010 con 0x7f169c158e50 2023-10-09T06:25:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a2419700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0c6130 con 0x7f169c152010 2023-10-09T06:25:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a2419700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0c6400 con 0x7f169c1523e0 2023-10-09T06:25:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a09b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169c158e50 0x7f169c1494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a09b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169c158e50 0x7f169c1494e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44116/0 (socket says 172.21.15.31:44116) 2023-10-09T06:25:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a09b6700 1 -- 172.21.15.31:0/1173064460 learned_addr learned my addr 172.21.15.31:0/1173064460 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f169bfff700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f169c152010 0x7f169c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a09b6700 1 -- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f169c1523e0 msgr2=0x7f169c0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f169b7fe700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f169c1523e0 0x7f169c0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a09b6700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f169c1523e0 0x7f169c0c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a09b6700 1 -- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f169c152010 msgr2=0x7f169c0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a09b6700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f169c152010 0x7f169c0c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a09b6700 1 -- 172.21.15.31:0/1173064460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694009a20 con 0x7f169c158e50 2023-10-09T06:25:35.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f169bfff700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f169c152010 0x7f169c0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:35.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f169b7fe700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f169c1523e0 0x7f169c0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:35.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f16a09b6700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169c158e50 0x7f169c1494e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1694013000 tx=0x7f1694019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:35.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.454+0000 7f1683fff700 1 -- 172.21.15.31:0/1173064460 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169401e630 con 0x7f169c158e50 2023-10-09T06:25:35.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.455+0000 7f1683fff700 1 -- 172.21.15.31:0/1173064460 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169401e7b0 con 0x7f169c158e50 2023-10-09T06:25:35.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.455+0000 7f16a2419700 1 -- 172.21.15.31:0/1173064460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c0c66e0 con 0x7f169c158e50 2023-10-09T06:25:35.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.455+0000 7f1683fff700 1 -- 172.21.15.31:0/1173064460 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169401eb70 con 0x7f169c158e50 2023-10-09T06:25:35.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.455+0000 7f16a2419700 1 -- 172.21.15.31:0/1173064460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c0c6ca0 con 0x7f169c158e50 2023-10-09T06:25:35.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.456+0000 7f16a2419700 1 -- 172.21.15.31:0/1173064460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c0b12f0 con 0x7f169c158e50 2023-10-09T06:25:35.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.456+0000 7f1683fff700 1 -- 172.21.15.31:0/1173064460 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1694024070 con 0x7f169c158e50 2023-10-09T06:25:35.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.456+0000 7f1683fff700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1688066f30 0x7f16880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.457+0000 7f1683fff700 1 -- 172.21.15.31:0/1173064460 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1694086f60 con 0x7f169c158e50 2023-10-09T06:25:35.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.457+0000 7f169bfff700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1688066f30 0x7f16880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.457+0000 7f1683fff700 1 -- 172.21.15.31:0/1173064460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f168806ea50 con 0x7f169c158e50 2023-10-09T06:25:35.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.457+0000 7f169bfff700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1688066f30 0x7f16880693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f168c008b20 tx=0x7f168c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:35.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.461+0000 7f1683fff700 1 -- 172.21.15.31:0/1173064460 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16940541d0 con 0x7f169c158e50 2023-10-09T06:25:35.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.698+0000 7f16a2419700 1 -- 172.21.15.31:0/1173064460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f169c04c3c0 con 0x7f169c158e50 2023-10-09T06:25:35.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.699+0000 7f1683fff700 1 -- 172.21.15.31:0/1173064460 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f16940577f0 con 0x7f169c158e50 2023-10-09T06:25:35.700 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:35.700 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2895057012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2895057012},{"type":"v1","addr":"172.21.15.158:6836","nonce":2895057012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5707,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/756230701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":756230701},{"type":"v1","addr":"172.21.15.158:6837","nonce":756230701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5961,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2803435352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2803435352},{"type":"v1","addr":"172.21.15.31:6834","nonce":2803435352}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:24:51.381116+0000","modified":"2023-10-09T06:24:54.984865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1373095674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1373095674},{"type":"v1","addr":"172.21.15.31:6835","nonce":1373095674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T06:25:35.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.701+0000 7f16a2419700 1 -- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1688066f30 msgr2=0x7f16880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.701+0000 7f16a2419700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1688066f30 0x7f16880693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f168c008b20 tx=0x7f168c008040 comp rx=0 tx=0).stop 2023-10-09T06:25:35.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.701+0000 7f16a2419700 1 -- 172.21.15.31:0/1173064460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169c158e50 msgr2=0x7f169c1494e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.701+0000 7f16a2419700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169c158e50 0x7f169c1494e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1694013000 tx=0x7f1694019000 comp rx=0 tx=0).stop 2023-10-09T06:25:35.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.701+0000 7f16a2419700 1 -- 172.21.15.31:0/1173064460 shutdown_connections 2023-10-09T06:25:35.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.701+0000 7f16a2419700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1688066f30 0x7f16880693e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.701+0000 7f16a2419700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169c158e50 0x7f169c1494e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.701+0000 7f16a2419700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f169c152010 0x7f169c0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.701+0000 7f16a2419700 1 --2- 172.21.15.31:0/1173064460 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f169c1523e0 0x7f169c0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.701+0000 7f16a2419700 1 -- 172.21.15.31:0/1173064460 >> 172.21.15.31:0/1173064460 conn(0x7f169c069870 msgr2=0x7f169c069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:35.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.701+0000 7f16a2419700 1 -- 172.21.15.31:0/1173064460 shutdown_connections 2023-10-09T06:25:35.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.701+0000 7f16a2419700 1 -- 172.21.15.31:0/1173064460 wait complete. 2023-10-09T06:25:35.704 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 42 2023-10-09T06:25:35.714 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:25:35.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.832+0000 7f3f40dbc700 1 Processor -- start 2023-10-09T06:25:35.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.832+0000 7f3f40dbc700 1 -- start start 2023-10-09T06:25:35.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.833+0000 7f3f40dbc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3f3c152010 0x7f3f3c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.833+0000 7f3f40dbc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f3c158e50 0x7f3f3c0cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.833+0000 7f3f40dbc700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3c06c010 con 0x7f3f3c1523e0 2023-10-09T06:25:35.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.833+0000 7f3f40dbc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c06bd10 con 0x7f3f3c158e50 2023-10-09T06:25:35.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.833+0000 7f3f40dbc700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c15c060 con 0x7f3f3c152010 2023-10-09T06:25:35.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.833+0000 7f3f3ad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f3c158e50 0x7f3f3c0cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.833+0000 7f3f39d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3f3c1523e0 0x7f3f3c06c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47066/0 (socket says 172.21.15.31:47066) 2023-10-09T06:25:35.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.833+0000 7f3f39d9b700 1 -- 172.21.15.31:0/1332539802 learned_addr learned my addr 172.21.15.31:0/1332539802 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:35.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.834+0000 7f3f3a59c700 1 --2- 172.21.15.31:0/1332539802 >> v2:172.21.15.158:3300/0 conn(0x7f3f3c152010 0x7f3f3c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.834+0000 7f3f3ad9d700 1 -- 172.21.15.31:0/1332539802 >> v2:172.21.15.158:3300/0 conn(0x7f3f3c152010 msgr2=0x7f3f3c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:35.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.834+0000 7f3f3ad9d700 1 --2- 172.21.15.31:0/1332539802 >> v2:172.21.15.158:3300/0 conn(0x7f3f3c152010 0x7f3f3c15b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.834+0000 7f3f3ad9d700 1 -- 172.21.15.31:0/1332539802 >> v1:172.21.15.31:6789/0 conn(0x7f3f3c1523e0 legacy=0x7f3f3c06c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.834+0000 7f3f3ad9d700 1 -- 172.21.15.31:0/1332539802 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c15c340 con 0x7f3f3c158e50 2023-10-09T06:25:35.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.834+0000 7f3f3959a700 1 -- 172.21.15.31:0/1332539802 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945661951 0 0) 0x7f3f3c06c010 con 0x7f3f3c1523e0 2023-10-09T06:25:35.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.834+0000 7f3f3ad9d700 1 --2- 172.21.15.31:0/1332539802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f3c158e50 0x7f3f3c0cdf30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0cc680 tx=0x7f3f34009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d270818c66d2fb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:35.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.834+0000 7f3f3959a700 1 -- 172.21.15.31:0/1332539802 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3400e070 con 0x7f3f3c158e50 2023-10-09T06:25:35.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.834+0000 7f3f3959a700 1 -- 172.21.15.31:0/1332539802 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3400bc30 con 0x7f3f3c158e50 2023-10-09T06:25:35.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.834+0000 7f3f3959a700 1 -- 172.21.15.31:0/1332539802 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34012430 con 0x7f3f3c158e50 2023-10-09T06:25:35.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.834+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1332539802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f3c158e50 msgr2=0x7f3f3c0cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.834+0000 7f3f40dbc700 1 --2- 172.21.15.31:0/1332539802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f3c158e50 0x7f3f3c0cdf30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0cc680 tx=0x7f3f34009780 comp rx=0 tx=0).stop 2023-10-09T06:25:35.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.835+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1332539802 shutdown_connections 2023-10-09T06:25:35.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.835+0000 7f3f40dbc700 1 --2- 172.21.15.31:0/1332539802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f3c158e50 0x7f3f3c0cdf30 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.835+0000 7f3f40dbc700 1 --2- 172.21.15.31:0/1332539802 >> v2:172.21.15.158:3300/0 conn(0x7f3f3c152010 0x7f3f3c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.835+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1332539802 >> 172.21.15.31:0/1332539802 conn(0x7f3f3c069870 msgr2=0x7f3f3c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:35.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.835+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1332539802 shutdown_connections 2023-10-09T06:25:35.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.835+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1332539802 wait complete. 2023-10-09T06:25:35.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.836+0000 7f3f40dbc700 1 Processor -- start 2023-10-09T06:25:35.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.836+0000 7f3f40dbc700 1 -- start start 2023-10-09T06:25:35.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.836+0000 7f3f40dbc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3f3c152010 0x7f3f3c0b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.836+0000 7f3f40dbc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f3c1523e0 0x7f3f3c0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.836+0000 7f3f40dbc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f3c158e50 0x7f3f3c143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.836+0000 7f3f40dbc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0c6d90 con 0x7f3f3c1523e0 2023-10-09T06:25:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.836+0000 7f3f40dbc700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0c6440 con 0x7f3f3c158e50 2023-10-09T06:25:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.836+0000 7f3f40dbc700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0c6720 con 0x7f3f3c152010 2023-10-09T06:25:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f39d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f3c1523e0 0x7f3f3c0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f39d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f3c1523e0 0x7f3f3c0c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44140/0 (socket says 172.21.15.31:44140) 2023-10-09T06:25:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f39d9b700 1 -- 172.21.15.31:0/1872310597 learned_addr learned my addr 172.21.15.31:0/1872310597 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f3ad9d700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f3c158e50 0x7f3f3c143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f3a59c700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3f3c152010 0x7f3f3c0b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f39d9b700 1 -- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3f3c152010 msgr2=0x7f3f3c0b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f39d9b700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3f3c152010 0x7f3f3c0b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f39d9b700 1 -- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f3c158e50 msgr2=0x7f3f3c143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f39d9b700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f3c158e50 0x7f3f3c143380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f39d9b700 1 -- 172.21.15.31:0/1872310597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f34009a20 con 0x7f3f3c1523e0 2023-10-09T06:25:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f39d9b700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f3c1523e0 0x7f3f3c0c5bf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c7e0 tx=0x7f3f30007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f2a7fc700 1 -- 172.21.15.31:0/1872310597 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f30005b30 con 0x7f3f3c1523e0 2023-10-09T06:25:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f2a7fc700 1 -- 172.21.15.31:0/1872310597 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f30005c90 con 0x7f3f3c1523e0 2023-10-09T06:25:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1872310597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3c0c6a00 con 0x7f3f3c1523e0 2023-10-09T06:25:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f2a7fc700 1 -- 172.21.15.31:0/1872310597 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f30007300 con 0x7f3f3c1523e0 2023-10-09T06:25:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.837+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1872310597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3c0c6130 con 0x7f3f3c1523e0 2023-10-09T06:25:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.838+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1872310597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3c0c7220 con 0x7f3f3c1523e0 2023-10-09T06:25:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.839+0000 7f3f2a7fc700 1 -- 172.21.15.31:0/1872310597 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f3001b400 con 0x7f3f3c1523e0 2023-10-09T06:25:35.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.839+0000 7f3f2a7fc700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3f1c066f30 0x7f3f1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:35.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.839+0000 7f3f2a7fc700 1 -- 172.21.15.31:0/1872310597 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f30084040 con 0x7f3f3c1523e0 2023-10-09T06:25:35.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.839+0000 7f3f2a7fc700 1 -- 172.21.15.31:0/1872310597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f3f1c06ea50 con 0x7f3f3c1523e0 2023-10-09T06:25:35.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.839+0000 7f3f3a59c700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3f1c066f30 0x7f3f1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:35.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.840+0000 7f3f3a59c700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3f1c066f30 0x7f3f1c0693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c006fd0 tx=0x7f3f2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:35.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:35.843+0000 7f3f2a7fc700 1 -- 172.21.15.31:0/1872310597 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f3c0c7220 con 0x7f3f3c1523e0 2023-10-09T06:25:36.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.082+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1872310597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f3c0c7220 con 0x7f3f3c1523e0 2023-10-09T06:25:36.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.083+0000 7f3f2a7fc700 1 -- 172.21.15.31:0/1872310597 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f3f3c0c7220 con 0x7f3f3c1523e0 2023-10-09T06:25:36.084 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:36.084 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2895057012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2895057012},{"type":"v1","addr":"172.21.15.158:6836","nonce":2895057012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5707,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/756230701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":756230701},{"type":"v1","addr":"172.21.15.158:6837","nonce":756230701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5961,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2803435352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2803435352},{"type":"v1","addr":"172.21.15.31:6834","nonce":2803435352}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:24:51.381116+0000","modified":"2023-10-09T06:24:54.984865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1373095674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1373095674},{"type":"v1","addr":"172.21.15.31:6835","nonce":1373095674}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T06:25:36.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.085+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3f1c066f30 msgr2=0x7f3f1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.085+0000 7f3f40dbc700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3f1c066f30 0x7f3f1c0693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c006fd0 tx=0x7f3f2c008040 comp rx=0 tx=0).stop 2023-10-09T06:25:36.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.085+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1872310597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f3c1523e0 msgr2=0x7f3f3c0c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.085+0000 7f3f40dbc700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f3c1523e0 0x7f3f3c0c5bf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c7e0 tx=0x7f3f30007df0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.085+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1872310597 shutdown_connections 2023-10-09T06:25:36.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.085+0000 7f3f40dbc700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3f1c066f30 0x7f3f1c0693e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.085+0000 7f3f40dbc700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3f3c152010 0x7f3f3c0b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.085+0000 7f3f40dbc700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f3c158e50 0x7f3f3c143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.085+0000 7f3f40dbc700 1 --2- 172.21.15.31:0/1872310597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f3c1523e0 0x7f3f3c0c5bf0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.085+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1872310597 >> 172.21.15.31:0/1872310597 conn(0x7f3f3c069870 msgr2=0x7f3f3c151060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:36.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.085+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1872310597 shutdown_connections 2023-10-09T06:25:36.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.085+0000 7f3f40dbc700 1 -- 172.21.15.31:0/1872310597 wait complete. 2023-10-09T06:25:36.087 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 42 2023-10-09T06:25:36.098 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.215+0000 7fc249d0b700 1 Processor -- start 2023-10-09T06:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.215+0000 7fc249d0b700 1 -- start start 2023-10-09T06:25:36.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.216+0000 7fc249d0b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc244156ea0 0x7fc2440c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.216+0000 7fc249d0b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc244157270 0x7fc24406f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.216+0000 7fc249d0b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc24406e2b0 0x7fc24406e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.216+0000 7fc249d0b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24406ec50 con 0x7fc244157270 2023-10-09T06:25:36.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.216+0000 7fc249d0b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2440c42b0 con 0x7fc244156ea0 2023-10-09T06:25:36.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.216+0000 7fc249d0b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c36a0 con 0x7fc24406e2b0 2023-10-09T06:25:36.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.216+0000 7fc242ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc244157270 0x7fc24406f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.217+0000 7fc242ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc244157270 0x7fc24406f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44156/0 (socket says 172.21.15.31:44156) 2023-10-09T06:25:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.217+0000 7fc242ffd700 1 -- 172.21.15.31:0/2339884086 learned_addr learned my addr 172.21.15.31:0/2339884086 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.217+0000 7fc2437fe700 1 --2- 172.21.15.31:0/2339884086 >> v2:172.21.15.158:3300/0 conn(0x7fc244156ea0 0x7fc2440c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.217+0000 7fc243fff700 1 --2- 172.21.15.31:0/2339884086 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc24406e2b0 0x7fc24406e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.217+0000 7fc242ffd700 1 -- 172.21.15.31:0/2339884086 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc24406e2b0 msgr2=0x7fc24406e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.217+0000 7fc242ffd700 1 --2- 172.21.15.31:0/2339884086 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc24406e2b0 0x7fc24406e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.217+0000 7fc242ffd700 1 -- 172.21.15.31:0/2339884086 >> v2:172.21.15.158:3300/0 conn(0x7fc244156ea0 msgr2=0x7fc2440c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.217+0000 7fc242ffd700 1 --2- 172.21.15.31:0/2339884086 >> v2:172.21.15.158:3300/0 conn(0x7fc244156ea0 0x7fc2440c30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.217+0000 7fc242ffd700 1 -- 172.21.15.31:0/2339884086 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2440c3980 con 0x7fc244157270 2023-10-09T06:25:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.217+0000 7fc242ffd700 1 --2- 172.21.15.31:0/2339884086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc244157270 0x7fc24406f3b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc2440cb600 tx=0x7fc238009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be8766705cb5a3d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.217+0000 7fc2427fc700 1 -- 172.21.15.31:0/2339884086 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23800b860 con 0x7fc244157270 2023-10-09T06:25:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.217+0000 7fc2427fc700 1 -- 172.21.15.31:0/2339884086 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23800b9c0 con 0x7fc244157270 2023-10-09T06:25:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.217+0000 7fc2427fc700 1 -- 172.21.15.31:0/2339884086 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23800bd60 con 0x7fc244157270 2023-10-09T06:25:36.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.218+0000 7fc249d0b700 1 -- 172.21.15.31:0/2339884086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc244157270 msgr2=0x7fc24406f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.218+0000 7fc249d0b700 1 --2- 172.21.15.31:0/2339884086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc244157270 0x7fc24406f3b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc2440cb600 tx=0x7fc238009250 comp rx=0 tx=0).stop 2023-10-09T06:25:36.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.218+0000 7fc249d0b700 1 -- 172.21.15.31:0/2339884086 shutdown_connections 2023-10-09T06:25:36.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.218+0000 7fc249d0b700 1 --2- 172.21.15.31:0/2339884086 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc24406e2b0 0x7fc24406e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.218+0000 7fc249d0b700 1 --2- 172.21.15.31:0/2339884086 >> v2:172.21.15.158:3300/0 conn(0x7fc244156ea0 0x7fc2440c30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.218+0000 7fc249d0b700 1 --2- 172.21.15.31:0/2339884086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc244157270 0x7fc24406f3b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.218+0000 7fc249d0b700 1 -- 172.21.15.31:0/2339884086 >> 172.21.15.31:0/2339884086 conn(0x7fc2440ca4f0 msgr2=0x7fc2440ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:36.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.218+0000 7fc249d0b700 1 -- 172.21.15.31:0/2339884086 shutdown_connections 2023-10-09T06:25:36.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.218+0000 7fc249d0b700 1 -- 172.21.15.31:0/2339884086 wait complete. 2023-10-09T06:25:36.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.219+0000 7fc249d0b700 1 Processor -- start 2023-10-09T06:25:36.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.219+0000 7fc249d0b700 1 -- start start 2023-10-09T06:25:36.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc249d0b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc24406e2b0 0x7fc2440b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc249d0b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc244156ea0 0x7fc244155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc249d0b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc244157270 0x7fc2440c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc249d0b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440b2f50 con 0x7fc24406e2b0 2023-10-09T06:25:36.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc249d0b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440b2340 con 0x7fc244156ea0 2023-10-09T06:25:36.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc249d0b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440b2620 con 0x7fc244157270 2023-10-09T06:25:36.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc2437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc24406e2b0 0x7fc2440b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc2437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc24406e2b0 0x7fc2440b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44160/0 (socket says 172.21.15.31:44160) 2023-10-09T06:25:36.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc2437fe700 1 -- 172.21.15.31:0/2458885130 learned_addr learned my addr 172.21.15.31:0/2458885130 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:36.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc2437fe700 1 -- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc244157270 msgr2=0x7fc2440c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc2437fe700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc244157270 0x7fc2440c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc2437fe700 1 -- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc244156ea0 msgr2=0x7fc244155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc242ffd700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc244156ea0 0x7fc244155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc2437fe700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc244156ea0 0x7fc244155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc2437fe700 1 -- 172.21.15.31:0/2458885130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2380094f0 con 0x7fc24406e2b0 2023-10-09T06:25:36.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc242ffd700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc244156ea0 0x7fc244155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:36.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.220+0000 7fc2437fe700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc24406e2b0 0x7fc2440b1d60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc23400d890 tx=0x7fc234008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:36.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.221+0000 7fc22b7fe700 1 -- 172.21.15.31:0/2458885130 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23400b600 con 0x7fc24406e2b0 2023-10-09T06:25:36.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.221+0000 7fc22b7fe700 1 -- 172.21.15.31:0/2458885130 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23400b760 con 0x7fc24406e2b0 2023-10-09T06:25:36.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.221+0000 7fc249d0b700 1 -- 172.21.15.31:0/2458885130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2440b2900 con 0x7fc24406e2b0 2023-10-09T06:25:36.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.221+0000 7fc22b7fe700 1 -- 172.21.15.31:0/2458885130 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23400bae0 con 0x7fc24406e2b0 2023-10-09T06:25:36.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.221+0000 7fc249d0b700 1 -- 172.21.15.31:0/2458885130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2440c7ae0 con 0x7fc24406e2b0 2023-10-09T06:25:36.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.222+0000 7fc249d0b700 1 -- 172.21.15.31:0/2458885130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2440c5820 con 0x7fc24406e2b0 2023-10-09T06:25:36.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.222+0000 7fc22b7fe700 1 -- 172.21.15.31:0/2458885130 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc23401e460 con 0x7fc24406e2b0 2023-10-09T06:25:36.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.222+0000 7fc22b7fe700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc230066f30 0x7fc2300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.223+0000 7fc22b7fe700 1 -- 172.21.15.31:0/2458885130 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc234084be0 con 0x7fc24406e2b0 2023-10-09T06:25:36.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.223+0000 7fc22b7fe700 1 -- 172.21.15.31:0/2458885130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7fc23006ea50 con 0x7fc24406e2b0 2023-10-09T06:25:36.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.223+0000 7fc242ffd700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc230066f30 0x7fc2300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.223+0000 7fc242ffd700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc230066f30 0x7fc2300693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc2440cb600 tx=0x7fc238017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:36.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.227+0000 7fc22b7fe700 1 -- 172.21.15.31:0/2458885130 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc234051e50 con 0x7fc24406e2b0 2023-10-09T06:25:36.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.421+0000 7fc249d0b700 1 -- 172.21.15.31:0/2458885130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc24404c3c0 con 0x7fc24406e2b0 2023-10-09T06:25:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.422+0000 7fc22b7fe700 1 -- 172.21.15.31:0/2458885130 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+15389 (secure 0 0 0) 0x7fc234055470 con 0x7fc24406e2b0 2023-10-09T06:25:36.423 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:36.423 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":88,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:25:34.751912+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:24:49.565040+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T06:24:50.345838+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:25:36.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.424+0000 7fc249d0b700 1 -- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc230066f30 msgr2=0x7fc2300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.424+0000 7fc249d0b700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc230066f30 0x7fc2300693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc2440cb600 tx=0x7fc238017000 comp rx=0 tx=0).stop 2023-10-09T06:25:36.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.424+0000 7fc249d0b700 1 -- 172.21.15.31:0/2458885130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc24406e2b0 msgr2=0x7fc2440b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.424+0000 7fc249d0b700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc24406e2b0 0x7fc2440b1d60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc23400d890 tx=0x7fc234008040 comp rx=0 tx=0).stop 2023-10-09T06:25:36.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.424+0000 7fc249d0b700 1 -- 172.21.15.31:0/2458885130 shutdown_connections 2023-10-09T06:25:36.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.424+0000 7fc249d0b700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc230066f30 0x7fc2300693e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.424+0000 7fc249d0b700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc244157270 0x7fc2440c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.424+0000 7fc249d0b700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc24406e2b0 0x7fc2440b1d60 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.424+0000 7fc249d0b700 1 --2- 172.21.15.31:0/2458885130 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc244156ea0 0x7fc244155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.424+0000 7fc249d0b700 1 -- 172.21.15.31:0/2458885130 >> 172.21.15.31:0/2458885130 conn(0x7fc2440ca4f0 msgr2=0x7fc2440cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:36.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.424+0000 7fc249d0b700 1 -- 172.21.15.31:0/2458885130 shutdown_connections 2023-10-09T06:25:36.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.424+0000 7fc249d0b700 1 -- 172.21.15.31:0/2458885130 wait complete. 2023-10-09T06:25:36.437 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:25:36.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.556+0000 7f8be359e700 1 Processor -- start 2023-10-09T06:25:36.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.556+0000 7f8be359e700 1 -- start start 2023-10-09T06:25:36.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8be415a170 0x7f8be4068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be359e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4069040 0x7f8be40af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be359e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be415ea70 con 0x7f8be4159da0 2023-10-09T06:25:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be359e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be40b34b0 con 0x7f8be415a170 2023-10-09T06:25:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be359e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be40694e0 con 0x7f8be4069040 2023-10-09T06:25:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be259c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f8be4159da0 0x7f8be40b2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:58274/0 (socket says 172.21.15.31:58274) 2023-10-09T06:25:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be2d9d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4069040 0x7f8be40af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be1d9b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8be415a170 0x7f8be4068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be259c700 1 -- 172.21.15.31:0/2348880745 learned_addr learned my addr 172.21.15.31:0/2348880745 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be159a700 1 -- 172.21.15.31:0/2348880745 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577200712 0 0) 0x7f8be415ea70 con 0x7f8be4159da0 2023-10-09T06:25:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be159a700 1 -- 172.21.15.31:0/2348880745 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bcc003570 con 0x7f8be4159da0 2023-10-09T06:25:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be2d9d700 1 -- 172.21.15.31:0/2348880745 >> v2:172.21.15.158:3300/0 conn(0x7f8be415a170 msgr2=0x7f8be4068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be2d9d700 1 --2- 172.21.15.31:0/2348880745 >> v2:172.21.15.158:3300/0 conn(0x7f8be415a170 0x7f8be4068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be2d9d700 1 -- 172.21.15.31:0/2348880745 >> v1:172.21.15.158:6789/0 conn(0x7f8be4159da0 legacy=0x7f8be40b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.557+0000 7f8be2d9d700 1 -- 172.21.15.31:0/2348880745 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be40b3990 con 0x7f8be4069040 2023-10-09T06:25:36.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.558+0000 7f8be2d9d700 1 --2- 172.21.15.31:0/2348880745 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4069040 0x7f8be40af4a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009e60 tx=0x7f8bdc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e3d658b28b72417 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:36.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.558+0000 7f8be159a700 1 -- 172.21.15.31:0/2348880745 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00e070 con 0x7f8be4069040 2023-10-09T06:25:36.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.558+0000 7f8be159a700 1 -- 172.21.15.31:0/2348880745 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc00bab0 con 0x7f8be4069040 2023-10-09T06:25:36.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.558+0000 7f8be159a700 1 -- 172.21.15.31:0/2348880745 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00be50 con 0x7f8be4069040 2023-10-09T06:25:36.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.558+0000 7f8be359e700 1 -- 172.21.15.31:0/2348880745 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4069040 msgr2=0x7f8be40af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.558+0000 7f8be359e700 1 --2- 172.21.15.31:0/2348880745 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4069040 0x7f8be40af4a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009e60 tx=0x7f8bdc009780 comp rx=0 tx=0).stop 2023-10-09T06:25:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.558+0000 7f8be359e700 1 -- 172.21.15.31:0/2348880745 shutdown_connections 2023-10-09T06:25:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.558+0000 7f8be359e700 1 --2- 172.21.15.31:0/2348880745 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4069040 0x7f8be40af4a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.558+0000 7f8be359e700 1 --2- 172.21.15.31:0/2348880745 >> v2:172.21.15.158:3300/0 conn(0x7f8be415a170 0x7f8be4068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.558+0000 7f8be359e700 1 -- 172.21.15.31:0/2348880745 >> 172.21.15.31:0/2348880745 conn(0x7f8be40d0bc0 msgr2=0x7f8be40d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.559+0000 7f8be359e700 1 -- 172.21.15.31:0/2348880745 shutdown_connections 2023-10-09T06:25:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.559+0000 7f8be359e700 1 -- 172.21.15.31:0/2348880745 wait complete. 2023-10-09T06:25:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.560+0000 7f8be359e700 1 Processor -- start 2023-10-09T06:25:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.560+0000 7f8be359e700 1 -- start start 2023-10-09T06:25:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.560+0000 7f8be359e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4069040 0x7f8be414e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.560+0000 7f8be359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be4159da0 0x7f8be4156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.560+0000 7f8be359e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8be415a170 0x7f8be4156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.560+0000 7f8be359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be4157fc0 con 0x7f8be4159da0 2023-10-09T06:25:36.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.560+0000 7f8be359e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be41573b0 con 0x7f8be415a170 2023-10-09T06:25:36.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.560+0000 7f8be359e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be4157690 con 0x7f8be4069040 2023-10-09T06:25:36.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.560+0000 7f8be1d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be4159da0 0x7f8be4156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8be1d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be4159da0 0x7f8be4156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44166/0 (socket says 172.21.15.31:44166) 2023-10-09T06:25:36.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8be1d9b700 1 -- 172.21.15.31:0/3414075420 learned_addr learned my addr 172.21.15.31:0/3414075420 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:36.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8be259c700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4069040 0x7f8be414e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8be2d9d700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8be415a170 0x7f8be4156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8be1d9b700 1 -- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4069040 msgr2=0x7f8be414e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8be1d9b700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4069040 0x7f8be414e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8be1d9b700 1 -- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8be415a170 msgr2=0x7f8be4156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8be1d9b700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8be415a170 0x7f8be4156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8be1d9b700 1 -- 172.21.15.31:0/3414075420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc009a20 con 0x7f8be4159da0 2023-10-09T06:25:36.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8be1d9b700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be4159da0 0x7f8be4156840 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800e930 tx=0x7f8bd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:36.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8bd27fc700 1 -- 172.21.15.31:0/3414075420 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8013680 con 0x7f8be4159da0 2023-10-09T06:25:36.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8bd27fc700 1 -- 172.21.15.31:0/3414075420 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd80137e0 con 0x7f8be4159da0 2023-10-09T06:25:36.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8be359e700 1 -- 172.21.15.31:0/3414075420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be4157970 con 0x7f8be4159da0 2023-10-09T06:25:36.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8bd27fc700 1 -- 172.21.15.31:0/3414075420 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8013b80 con 0x7f8be4159da0 2023-10-09T06:25:36.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.561+0000 7f8be359e700 1 -- 172.21.15.31:0/3414075420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be4156480 con 0x7f8be4159da0 2023-10-09T06:25:36.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.562+0000 7f8be359e700 1 -- 172.21.15.31:0/3414075420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be4158170 con 0x7f8be4159da0 2023-10-09T06:25:36.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.562+0000 7f8bd27fc700 1 -- 172.21.15.31:0/3414075420 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8bd800c3e0 con 0x7f8be4159da0 2023-10-09T06:25:36.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.563+0000 7f8bd27fc700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8bc4066f30 0x7f8bc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.563+0000 7f8bd27fc700 1 -- 172.21.15.31:0/3414075420 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bd80845b0 con 0x7f8be4159da0 2023-10-09T06:25:36.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.563+0000 7f8bd27fc700 1 -- 172.21.15.31:0/3414075420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f8bc406ea50 con 0x7f8be4159da0 2023-10-09T06:25:36.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.563+0000 7f8be259c700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8bc4066f30 0x7f8bc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.564+0000 7f8be259c700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8bc4066f30 0x7f8bc40693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4007fd0 tx=0x7f8bd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:36.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.567+0000 7f8bd27fc700 1 -- 172.21.15.31:0/3414075420 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8be4158170 con 0x7f8be4159da0 2023-10-09T06:25:36.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.764+0000 7f8bd27fc700 1 -- 172.21.15.31:0/3414075420 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(89..89 src has 1..89) v4 ==== 288+0+0 (secure 0 0 0) 0x7f8bd8055be0 con 0x7f8be4159da0 2023-10-09T06:25:36.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.764+0000 7f8bd27fc700 1 -- 172.21.15.31:0/3414075420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7f8bc406f3a0 con 0x7f8be4159da0 2023-10-09T06:25:36.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.809+0000 7f8be359e700 1 -- 172.21.15.31:0/3414075420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8be4158100 con 0x7f8be4159da0 2023-10-09T06:25:36.810 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:25:36.810+0000 7fc5e82b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:25:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.815+0000 7f8bd27fc700 1 -- 172.21.15.31:0/3414075420 <== mon.0 v2:172.21.15.31:3300/0 8 ==== osd_map(90..90 src has 1..90) v4 ==== 366+0+0 (secure 0 0 0) 0x7f8bd80510c0 con 0x7f8be4159da0 2023-10-09T06:25:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.815+0000 7f8bd27fc700 1 -- 172.21.15.31:0/3414075420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7f8bc406ea50 con 0x7f8be4159da0 2023-10-09T06:25:36.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.817+0000 7f8bd27fc700 1 -- 172.21.15.31:0/3414075420 <== mon.0 v2:172.21.15.31:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8bd8021020 con 0x7f8be4159da0 2023-10-09T06:25:36.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.820+0000 7f8be359e700 1 -- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8bc4066f30 msgr2=0x7f8bc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.820+0000 7f8be359e700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8bc4066f30 0x7f8bc40693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4007fd0 tx=0x7f8bd4009040 comp rx=0 tx=0).stop 2023-10-09T06:25:36.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.820+0000 7f8be359e700 1 -- 172.21.15.31:0/3414075420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be4159da0 msgr2=0x7f8be4156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.820+0000 7f8be359e700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be4159da0 0x7f8be4156840 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800e930 tx=0x7f8bd80091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.820+0000 7f8be359e700 1 -- 172.21.15.31:0/3414075420 shutdown_connections 2023-10-09T06:25:36.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.820+0000 7f8be359e700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8bc4066f30 0x7f8bc40693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.820+0000 7f8be359e700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8be4069040 0x7f8be414e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.820+0000 7f8be359e700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8be415a170 0x7f8be4156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.820+0000 7f8be359e700 1 --2- 172.21.15.31:0/3414075420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8be4159da0 0x7f8be4156840 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.820+0000 7f8be359e700 1 -- 172.21.15.31:0/3414075420 >> 172.21.15.31:0/3414075420 conn(0x7f8be40d0bc0 msgr2=0x7f8be40ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.820+0000 7f8be359e700 1 -- 172.21.15.31:0/3414075420 shutdown_connections 2023-10-09T06:25:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.820+0000 7f8be359e700 1 -- 172.21.15.31:0/3414075420 wait complete. 2023-10-09T06:25:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:25:36.833 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:25:36.852 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:25:36.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.955+0000 7f1591079700 1 Processor -- start 2023-10-09T06:25:36.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.955+0000 7f1591079700 1 -- start start 2023-10-09T06:25:36.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.955+0000 7f1591079700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f158c0cc6b0 0x7f158c06ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.955+0000 7f1591079700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f158c06f890 0x7f158c0aba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f1591079700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158c06e5e0 con 0x7f158c0cc2e0 2023-10-09T06:25:36.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f1591079700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158c06efb0 con 0x7f158c06f890 2023-10-09T06:25:36.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f1591079700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158c06d9d0 con 0x7f158c0cc6b0 2023-10-09T06:25:36.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f158b59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f158c06f890 0x7f158c0aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f158ad9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f158c0cc2e0 0x7f158c06f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47088/0 (socket says 172.21.15.31:47088) 2023-10-09T06:25:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f158ad9d700 1 -- 172.21.15.31:0/3803461127 learned_addr learned my addr 172.21.15.31:0/3803461127 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f158b59e700 1 -- 172.21.15.31:0/3803461127 >> v2:172.21.15.158:3300/0 conn(0x7f158c0cc6b0 msgr2=0x7f158c06ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f158b59e700 1 --2- 172.21.15.31:0/3803461127 >> v2:172.21.15.158:3300/0 conn(0x7f158c0cc6b0 0x7f158c06ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f158b59e700 1 -- 172.21.15.31:0/3803461127 >> v1:172.21.15.31:6789/0 conn(0x7f158c0cc2e0 legacy=0x7f158c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f158b59e700 1 -- 172.21.15.31:0/3803461127 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c06dcb0 con 0x7f158c06f890 2023-10-09T06:25:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f1589d9b700 1 -- 172.21.15.31:0/3803461127 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484034577 0 0) 0x7f158c06e5e0 con 0x7f158c0cc2e0 2023-10-09T06:25:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f158b59e700 1 --2- 172.21.15.31:0/3803461127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f158c06f890 0x7f158c0aba50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f158c15c8d0 tx=0x7f157c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9053206d41a1c7bd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f1589d9b700 1 -- 172.21.15.31:0/3803461127 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c00b6b0 con 0x7f158c06f890 2023-10-09T06:25:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f1589d9b700 1 -- 172.21.15.31:0/3803461127 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c00b810 con 0x7f158c06f890 2023-10-09T06:25:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.956+0000 7f1589d9b700 1 -- 172.21.15.31:0/3803461127 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c00bbb0 con 0x7f158c06f890 2023-10-09T06:25:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.957+0000 7f1591079700 1 -- 172.21.15.31:0/3803461127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f158c06f890 msgr2=0x7f158c0aba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.957+0000 7f1591079700 1 --2- 172.21.15.31:0/3803461127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f158c06f890 0x7f158c0aba50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f158c15c8d0 tx=0x7f157c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.957+0000 7f1591079700 1 -- 172.21.15.31:0/3803461127 shutdown_connections 2023-10-09T06:25:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.957+0000 7f1591079700 1 --2- 172.21.15.31:0/3803461127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f158c06f890 0x7f158c0aba50 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.957+0000 7f1591079700 1 --2- 172.21.15.31:0/3803461127 >> v2:172.21.15.158:3300/0 conn(0x7f158c0cc6b0 0x7f158c06ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.957+0000 7f1591079700 1 -- 172.21.15.31:0/3803461127 >> 172.21.15.31:0/3803461127 conn(0x7f158c068170 msgr2=0x7f158c0cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:36.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.957+0000 7f1591079700 1 -- 172.21.15.31:0/3803461127 shutdown_connections 2023-10-09T06:25:36.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.957+0000 7f1591079700 1 -- 172.21.15.31:0/3803461127 wait complete. 2023-10-09T06:25:36.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.958+0000 7f1591079700 1 Processor -- start 2023-10-09T06:25:36.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.958+0000 7f1591079700 1 -- start start 2023-10-09T06:25:36.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.959+0000 7f1591079700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f158c06f890 0x7f158c0c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.959+0000 7f1591079700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f158c0cc2e0 0x7f158c0c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.959+0000 7f1591079700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f158c0cc6b0 0x7f158c16d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.959+0000 7f1591079700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c16e710 con 0x7f158c0cc6b0 2023-10-09T06:25:36.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.959+0000 7f1591079700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c0c9420 con 0x7f158c06f890 2023-10-09T06:25:36.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.959+0000 7f1591079700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c0c52c0 con 0x7f158c0cc2e0 2023-10-09T06:25:36.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.959+0000 7f158b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f158c0cc6b0 0x7f158c16d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.959+0000 7f158b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f158c0cc6b0 0x7f158c16d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44212/0 (socket says 172.21.15.31:44212) 2023-10-09T06:25:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.959+0000 7f158b59e700 1 -- 172.21.15.31:0/2220244566 learned_addr learned my addr 172.21.15.31:0/2220244566 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.959+0000 7f158ad9d700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f158c06f890 0x7f158c0c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.959+0000 7f158a59c700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f158c0cc2e0 0x7f158c0c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.960+0000 7f158b59e700 1 -- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f158c0cc2e0 msgr2=0x7f158c0c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.960+0000 7f158b59e700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f158c0cc2e0 0x7f158c0c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.960+0000 7f158b59e700 1 -- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f158c06f890 msgr2=0x7f158c0c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.960+0000 7f158b59e700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f158c06f890 0x7f158c0c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.960+0000 7f158b59e700 1 -- 172.21.15.31:0/2220244566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c009420 con 0x7f158c0cc6b0 2023-10-09T06:25:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.960+0000 7f158ad9d700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f158c06f890 0x7f158c0c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.960+0000 7f158b59e700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f158c0cc6b0 0x7f158c16d890 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f157c0093f0 tx=0x7f157c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.960+0000 7f1582ffd700 1 -- 172.21.15.31:0/2220244566 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c011630 con 0x7f158c0cc6b0 2023-10-09T06:25:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.960+0000 7f1582ffd700 1 -- 172.21.15.31:0/2220244566 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c011790 con 0x7f158c0cc6b0 2023-10-09T06:25:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.960+0000 7f1591079700 1 -- 172.21.15.31:0/2220244566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158c0c4cb0 con 0x7f158c0cc6b0 2023-10-09T06:25:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.960+0000 7f1582ffd700 1 -- 172.21.15.31:0/2220244566 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c011b50 con 0x7f158c0cc6b0 2023-10-09T06:25:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.960+0000 7f1591079700 1 -- 172.21.15.31:0/2220244566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c0c4f50 con 0x7f158c0cc6b0 2023-10-09T06:25:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.961+0000 7f1591079700 1 -- 172.21.15.31:0/2220244566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158c04c3c0 con 0x7f158c0cc6b0 2023-10-09T06:25:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.961+0000 7f1582ffd700 1 -- 172.21.15.31:0/2220244566 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f157c0253f0 con 0x7f158c0cc6b0 2023-10-09T06:25:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.962+0000 7f1582ffd700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f156c066f30 0x7f156c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.962+0000 7f1582ffd700 1 -- 172.21.15.31:0/2220244566 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f157c086240 con 0x7f158c0cc6b0 2023-10-09T06:25:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.962+0000 7f1582ffd700 1 -- 172.21.15.31:0/2220244566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7f156c06eaf0 con 0x7f158c0cc6b0 2023-10-09T06:25:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.962+0000 7f158ad9d700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f156c066f30 0x7f156c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.963+0000 7f158ad9d700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f156c066f30 0x7f156c0693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1584001560 tx=0x7f1584009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:36.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:36.966+0000 7f1582ffd700 1 -- 172.21.15.31:0/2220244566 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f157c0534e0 con 0x7f158c0cc6b0 2023-10-09T06:25:37.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.203+0000 7f1591079700 1 -- 172.21.15.31:0/2220244566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f158c06df90 con 0x7f158c0cc6b0 2023-10-09T06:25:37.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.816+0000 7f1582ffd700 1 -- 172.21.15.31:0/2220244566 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7f157c056b00 con 0x7f158c0cc6b0 2023-10-09T06:25:37.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.818+0000 7f1591079700 1 -- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f156c066f30 msgr2=0x7f156c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:37.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.818+0000 7f1591079700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f156c066f30 0x7f156c0693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1584001560 tx=0x7f1584009040 comp rx=0 tx=0).stop 2023-10-09T06:25:37.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.818+0000 7f1591079700 1 -- 172.21.15.31:0/2220244566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f158c0cc6b0 msgr2=0x7f158c16d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:37.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.818+0000 7f1591079700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f158c0cc6b0 0x7f158c16d890 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f157c0093f0 tx=0x7f157c017000 comp rx=0 tx=0).stop 2023-10-09T06:25:37.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.818+0000 7f1591079700 1 -- 172.21.15.31:0/2220244566 shutdown_connections 2023-10-09T06:25:37.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.818+0000 7f1591079700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f156c066f30 0x7f156c0693e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:37.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.818+0000 7f1591079700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f158c0cc6b0 0x7f158c16d890 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:37.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.818+0000 7f1591079700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f158c06f890 0x7f158c0c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:37.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.818+0000 7f1591079700 1 --2- 172.21.15.31:0/2220244566 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f158c0cc2e0 0x7f158c0c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:37.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.818+0000 7f1591079700 1 -- 172.21.15.31:0/2220244566 >> 172.21.15.31:0/2220244566 conn(0x7f158c068170 msgr2=0x7f158c0ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:37.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.818+0000 7f1591079700 1 -- 172.21.15.31:0/2220244566 shutdown_connections 2023-10-09T06:25:37.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.818+0000 7f1591079700 1 -- 172.21.15.31:0/2220244566 wait complete. 2023-10-09T06:25:37.832 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:25:37.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.998+0000 7fb30b59e700 1 Processor -- start 2023-10-09T06:25:37.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.998+0000 7fb30b59e700 1 -- start start 2023-10-09T06:25:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.999+0000 7fb30b59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb30c0af890 0x7fb30c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.999+0000 7fb30b59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c0ad620 con 0x7fb30c15a060 2023-10-09T06:25:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.999+0000 7fb30b59e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c0acd80 con 0x7fb30c159c90 2023-10-09T06:25:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.999+0000 7fb30b59e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c0ad060 con 0x7fb30c0af890 2023-10-09T06:25:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.999+0000 7fb30ad9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb30c15a060 0x7fb30c0aa460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47090/0 (socket says 172.21.15.31:47090) 2023-10-09T06:25:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:37.999+0000 7fb30ad9d700 1 -- 172.21.15.31:0/923642960 learned_addr learned my addr 172.21.15.31:0/923642960 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb309d9b700 1 --2- 172.21.15.31:0/923642960 >> v2:172.21.15.158:3300/0 conn(0x7fb30c0af890 0x7fb30c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883073482 0 0) 0x7fb30c0ad620 con 0x7fb30c15a060 2023-10-09T06:25:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f8003570 con 0x7fb30c15a060 2023-10-09T06:25:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261262735 0 0) 0x7fb30c0acd80 con 0x7fb30c159c90 2023-10-09T06:25:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb30c0ad620 con 0x7fb30c159c90 2023-10-09T06:25:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1514793925 0 0) 0x7fb2f8003570 con 0x7fb30c15a060 2023-10-09T06:25:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 >> v2:172.21.15.158:3300/0 conn(0x7fb30c0af890 msgr2=0x7fb30c06ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 --2- 172.21.15.31:0/923642960 >> v2:172.21.15.158:3300/0 conn(0x7fb30c0af890 0x7fb30c06ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 >> v1:172.21.15.158:6789/0 conn(0x7fb30c159c90 legacy=0x7fb30c0ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c0ad340 con 0x7fb30c15a060 2023-10-09T06:25:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fb3040017f0 con 0x7fb30c15a060 2023-10-09T06:25:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 >> v1:172.21.15.31:6789/0 conn(0x7fb30c15a060 legacy=0x7fb30c0aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 --2- 172.21.15.31:0/923642960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2f8003bf0 0x7fb2f8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 --2- 172.21.15.31:0/923642960 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb2f8004810 0x7fb2f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 --2- 172.21.15.31:0/923642960 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f80051c0 0x7fb2f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0ad060 con 0x7fb2f8003bf0 2023-10-09T06:25:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f800c160 con 0x7fb2f80051c0 2023-10-09T06:25:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f800c320 con 0x7fb2f8004810 2023-10-09T06:25:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30a59c700 1 --2- 172.21.15.31:0/923642960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2f8003bf0 0x7fb2f8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb309d9b700 1 --2- 172.21.15.31:0/923642960 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb2f8004810 0x7fb2f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30ad9d700 1 --2- 172.21.15.31:0/923642960 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f80051c0 0x7fb2f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30a59c700 1 -- 172.21.15.31:0/923642960 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb2f8004810 msgr2=0x7fb2f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30a59c700 1 --2- 172.21.15.31:0/923642960 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb2f8004810 0x7fb2f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30a59c700 1 -- 172.21.15.31:0/923642960 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f80051c0 msgr2=0x7fb2f800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30a59c700 1 --2- 172.21.15.31:0/923642960 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f80051c0 0x7fb2f800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30a59c700 1 -- 172.21.15.31:0/923642960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f8003570 con 0x7fb2f8003bf0 2023-10-09T06:25:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30ad9d700 1 --2- 172.21.15.31:0/923642960 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f80051c0 0x7fb2f800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb30ad9d700 1 -- 172.21.15.31:0/923642960 reap_dead start 2023-10-09T06:25:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.000+0000 7fb309d9b700 1 --2- 172.21.15.31:0/923642960 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb2f8004810 0x7fb2f8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.001+0000 7fb30a59c700 1 --2- 172.21.15.31:0/923642960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2f8003bf0 0x7fb2f8003fe0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0019e0 tx=0x7fb2fc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdac3ef5f818623 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.001+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00c5d0 con 0x7fb2f8003bf0 2023-10-09T06:25:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.001+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc00c730 con 0x7fb2f8003bf0 2023-10-09T06:25:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.001+0000 7fb30959a700 1 -- 172.21.15.31:0/923642960 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00cad0 con 0x7fb2f8003bf0 2023-10-09T06:25:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.001+0000 7fb30b59e700 1 -- 172.21.15.31:0/923642960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2f8003bf0 msgr2=0x7fb2f8003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.001+0000 7fb30b59e700 1 --2- 172.21.15.31:0/923642960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2f8003bf0 0x7fb2f8003fe0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0019e0 tx=0x7fb2fc007d30 comp rx=0 tx=0).stop 2023-10-09T06:25:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.001+0000 7fb30b59e700 1 -- 172.21.15.31:0/923642960 shutdown_connections 2023-10-09T06:25:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.001+0000 7fb30b59e700 1 --2- 172.21.15.31:0/923642960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2f8003bf0 0x7fb2f8003fe0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.001+0000 7fb30b59e700 1 -- 172.21.15.31:0/923642960 >> 172.21.15.31:0/923642960 conn(0x7fb30c0cd270 msgr2=0x7fb30c0cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.001+0000 7fb30b59e700 1 -- 172.21.15.31:0/923642960 shutdown_connections 2023-10-09T06:25:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.001+0000 7fb30b59e700 1 -- 172.21.15.31:0/923642960 wait complete. 2023-10-09T06:25:38.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.002+0000 7fb30b59e700 1 Processor -- start 2023-10-09T06:25:38.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.003+0000 7fb30b59e700 1 -- start start 2023-10-09T06:25:38.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.003+0000 7fb30b59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f8003bf0 0x7fb30c0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:38.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.003+0000 7fb30b59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb30c0b0e80 0x7fb30c16a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:38.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.003+0000 7fb30b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30c16ae90 0x7fb30c0c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:38.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.003+0000 7fb30b59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c16b940 con 0x7fb30c16ae90 2023-10-09T06:25:38.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.003+0000 7fb30b59e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c16b380 con 0x7fb2f8003bf0 2023-10-09T06:25:38.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.003+0000 7fb30b59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c16b660 con 0x7fb30c0b0e80 2023-10-09T06:25:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.003+0000 7fb30ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30c16ae90 0x7fb30c0c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.003+0000 7fb30ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30c16ae90 0x7fb30c0c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44234/0 (socket says 172.21.15.31:44234) 2023-10-09T06:25:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.003+0000 7fb30ad9d700 1 -- 172.21.15.31:0/3877281041 learned_addr learned my addr 172.21.15.31:0/3877281041 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.003+0000 7fb30a59c700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f8003bf0 0x7fb30c0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.003+0000 7fb309d9b700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb30c0b0e80 0x7fb30c16a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.004+0000 7fb30ad9d700 1 -- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb30c0b0e80 msgr2=0x7fb30c16a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.004+0000 7fb30ad9d700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb30c0b0e80 0x7fb30c16a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.004+0000 7fb30ad9d700 1 -- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f8003bf0 msgr2=0x7fb30c0b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.004+0000 7fb30ad9d700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f8003bf0 0x7fb30c0b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.004+0000 7fb30ad9d700 1 -- 172.21.15.31:0/3877281041 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c0b0140 con 0x7fb30c16ae90 2023-10-09T06:25:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.004+0000 7fb30ad9d700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30c16ae90 0x7fb30c0c8d50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb304001350 tx=0x7fb304009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:38.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.004+0000 7fb3027fc700 1 -- 172.21.15.31:0/3877281041 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304004e90 con 0x7fb30c16ae90 2023-10-09T06:25:38.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.004+0000 7fb3027fc700 1 -- 172.21.15.31:0/3877281041 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30400b6c0 con 0x7fb30c16ae90 2023-10-09T06:25:38.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.004+0000 7fb30b59e700 1 -- 172.21.15.31:0/3877281041 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c0b0420 con 0x7fb30c16ae90 2023-10-09T06:25:38.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.004+0000 7fb3027fc700 1 -- 172.21.15.31:0/3877281041 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30400ba80 con 0x7fb30c16ae90 2023-10-09T06:25:38.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.004+0000 7fb30b59e700 1 -- 172.21.15.31:0/3877281041 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c0cbd10 con 0x7fb30c16ae90 2023-10-09T06:25:38.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.005+0000 7fb30b59e700 1 -- 172.21.15.31:0/3877281041 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c0b0660 con 0x7fb30c16ae90 2023-10-09T06:25:38.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.005+0000 7fb3027fc700 1 -- 172.21.15.31:0/3877281041 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb304007190 con 0x7fb30c16ae90 2023-10-09T06:25:38.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.006+0000 7fb3027fc700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb2ec066f30 0x7fb2ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:38.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.006+0000 7fb3027fc700 1 -- 172.21.15.31:0/3877281041 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fb3040846e0 con 0x7fb30c16ae90 2023-10-09T06:25:38.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.006+0000 7fb30a59c700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb2ec066f30 0x7fb2ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:38.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.006+0000 7fb3027fc700 1 -- 172.21.15.31:0/3877281041 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7fb2ec06eaf0 con 0x7fb30c16ae90 2023-10-09T06:25:38.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.007+0000 7fb30a59c700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb2ec066f30 0x7fb2ec0693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc000c00 tx=0x7fb2fc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:38.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.010+0000 7fb3027fc700 1 -- 172.21.15.31:0/3877281041 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb30c0b0660 con 0x7fb30c16ae90 2023-10-09T06:25:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.203+0000 7fb30b59e700 1 -- 172.21.15.31:0/3877281041 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb30c0b0660 con 0x7fb30c16ae90 2023-10-09T06:25:38.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.819+0000 7fb3027fc700 1 -- 172.21.15.31:0/3877281041 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(91..91 src has 1..91) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fb304055d40 con 0x7fb30c16ae90 2023-10-09T06:25:38.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.819+0000 7fb3027fc700 1 -- 172.21.15.31:0/3877281041 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7fb2ec06cf20 con 0x7fb30c16ae90 2023-10-09T06:25:38.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.821+0000 7fb3027fc700 1 -- 172.21.15.31:0/3877281041 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb30c0b0660 con 0x7fb30c16ae90 2023-10-09T06:25:38.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.825+0000 7fb30b59e700 1 -- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb2ec066f30 msgr2=0x7fb2ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:38.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.825+0000 7fb30b59e700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb2ec066f30 0x7fb2ec0693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc000c00 tx=0x7fb2fc015000 comp rx=0 tx=0).stop 2023-10-09T06:25:38.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.825+0000 7fb30b59e700 1 -- 172.21.15.31:0/3877281041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30c16ae90 msgr2=0x7fb30c0c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:38.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.825+0000 7fb30b59e700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30c16ae90 0x7fb30c0c8d50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb304001350 tx=0x7fb304009040 comp rx=0 tx=0).stop 2023-10-09T06:25:38.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.825+0000 7fb30b59e700 1 -- 172.21.15.31:0/3877281041 shutdown_connections 2023-10-09T06:25:38.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.825+0000 7fb30b59e700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb2ec066f30 0x7fb2ec0693e0 secure :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc000c00 tx=0x7fb2fc015000 comp rx=0 tx=0).stop 2023-10-09T06:25:38.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.825+0000 7fb30b59e700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb30c16ae90 0x7fb30c0c8d50 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:38.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.825+0000 7fb30b59e700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2f8003bf0 0x7fb30c0b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:38.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.825+0000 7fb30b59e700 1 --2- 172.21.15.31:0/3877281041 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb30c0b0e80 0x7fb30c16a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:38.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.825+0000 7fb30b59e700 1 -- 172.21.15.31:0/3877281041 >> 172.21.15.31:0/3877281041 conn(0x7fb30c0cd270 msgr2=0x7fb30c06edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:38.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.827+0000 7fb30b59e700 1 -- 172.21.15.31:0/3877281041 shutdown_connections 2023-10-09T06:25:38.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.827+0000 7fb30b59e700 1 -- 172.21.15.31:0/3877281041 wait complete. 2023-10-09T06:25:38.828 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:25:38.841 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:25:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.966+0000 7fea1f27d700 1 Processor -- start 2023-10-09T06:25:38.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.966+0000 7fea1f27d700 1 -- start start 2023-10-09T06:25:38.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.967+0000 7fea1f27d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea180cc940 0x7fea180ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:38.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.967+0000 7fea1f27d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180cbb80 con 0x7fea180ce810 2023-10-09T06:25:38.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.967+0000 7fea1f27d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180cbe60 con 0x7fea1815d240 2023-10-09T06:25:38.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.967+0000 7fea1f27d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea180cc140 con 0x7fea180cc940 2023-10-09T06:25:38.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.967+0000 7fea1ea7c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fea180ce810 0x7fea180cec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47104/0 (socket says 172.21.15.31:47104) 2023-10-09T06:25:38.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.967+0000 7fea1ea7c700 1 -- 172.21.15.31:0/1454602533 learned_addr learned my addr 172.21.15.31:0/1454602533 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:38.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.967+0000 7fea1da7a700 1 --2- 172.21.15.31:0/1454602533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea180cc940 0x7fea180ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:38.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.967+0000 7fea1d279700 1 -- 172.21.15.31:0/1454602533 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473901054 0 0) 0x7fea180cbb80 con 0x7fea180ce810 2023-10-09T06:25:38.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.967+0000 7fea1d279700 1 -- 172.21.15.31:0/1454602533 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea00003570 con 0x7fea180ce810 2023-10-09T06:25:38.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.968+0000 7fea1d279700 1 -- 172.21.15.31:0/1454602533 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258088464 0 0) 0x7fea180cbe60 con 0x7fea1815d240 2023-10-09T06:25:38.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.968+0000 7fea1d279700 1 -- 172.21.15.31:0/1454602533 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea180cbb80 con 0x7fea1815d240 2023-10-09T06:25:38.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.968+0000 7fea1da7a700 1 -- 172.21.15.31:0/1454602533 >> v1:172.21.15.158:6789/0 conn(0x7fea1815d240 legacy=0x7fea180b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:38.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.968+0000 7fea1d279700 1 -- 172.21.15.31:0/1454602533 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1525122703 0 0) 0x7fea00003570 con 0x7fea180ce810 2023-10-09T06:25:38.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.968+0000 7fea1da7a700 1 -- 172.21.15.31:0/1454602533 >> v1:172.21.15.31:6789/0 conn(0x7fea180ce810 legacy=0x7fea180cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:38.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.968+0000 7fea1da7a700 1 -- 172.21.15.31:0/1454602533 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180cc420 con 0x7fea180cc940 2023-10-09T06:25:38.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.968+0000 7fea1da7a700 1 --2- 172.21.15.31:0/1454602533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea180cc940 0x7fea180ccdb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009910 tx=0x7fea0c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=602ba83923b5765e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:38.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.968+0000 7fea1d279700 1 -- 172.21.15.31:0/1454602533 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea080017f0 con 0x7fea180cc940 2023-10-09T06:25:38.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.968+0000 7fea1d279700 1 -- 172.21.15.31:0/1454602533 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c011420 con 0x7fea180cc940 2023-10-09T06:25:38.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.968+0000 7fea1d279700 1 -- 172.21.15.31:0/1454602533 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0117c0 con 0x7fea180cc940 2023-10-09T06:25:38.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.968+0000 7fea1f27d700 1 -- 172.21.15.31:0/1454602533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea180cc940 msgr2=0x7fea180ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:38.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.968+0000 7fea1f27d700 1 --2- 172.21.15.31:0/1454602533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea180cc940 0x7fea180ccdb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009910 tx=0x7fea0c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:38.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.969+0000 7fea1f27d700 1 -- 172.21.15.31:0/1454602533 shutdown_connections 2023-10-09T06:25:38.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.969+0000 7fea1f27d700 1 --2- 172.21.15.31:0/1454602533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea180cc940 0x7fea180ccdb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:38.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.969+0000 7fea1f27d700 1 -- 172.21.15.31:0/1454602533 >> 172.21.15.31:0/1454602533 conn(0x7fea18067e40 msgr2=0x7fea180d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:38.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.969+0000 7fea1f27d700 1 -- 172.21.15.31:0/1454602533 shutdown_connections 2023-10-09T06:25:38.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.969+0000 7fea1f27d700 1 -- 172.21.15.31:0/1454602533 wait complete. 2023-10-09T06:25:38.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.970+0000 7fea1f27d700 1 Processor -- start 2023-10-09T06:25:38.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.970+0000 7fea1f27d700 1 -- start start 2023-10-09T06:25:38.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.970+0000 7fea1f27d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea180cc940 0x7fea1814b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:38.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.970+0000 7fea1f27d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea180ce810 0x7fea1816a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:38.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.970+0000 7fea1f27d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea1815d240 0x7fea180c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:38.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.970+0000 7fea1f27d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1816b1c0 con 0x7fea180cc940 2023-10-09T06:25:38.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.970+0000 7fea1f27d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1814bc40 con 0x7fea1815d240 2023-10-09T06:25:38.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.970+0000 7fea1f27d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1816ac00 con 0x7fea180ce810 2023-10-09T06:25:38.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea1e27b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea180cc940 0x7fea1814b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:38.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea1e27b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea180cc940 0x7fea1814b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44238/0 (socket says 172.21.15.31:44238) 2023-10-09T06:25:38.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea1e27b700 1 -- 172.21.15.31:0/170820563 learned_addr learned my addr 172.21.15.31:0/170820563 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:38.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea1da7a700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea180ce810 0x7fea1816a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:38.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea1ea7c700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea1815d240 0x7fea180c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:38.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea1e27b700 1 -- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea180ce810 msgr2=0x7fea1816a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:38.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea1e27b700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea180ce810 0x7fea1816a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:38.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea1e27b700 1 -- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea1815d240 msgr2=0x7fea180c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:38.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea1e27b700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea1815d240 0x7fea180c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:38.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea1e27b700 1 -- 172.21.15.31:0/170820563 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c009420 con 0x7fea180cc940 2023-10-09T06:25:38.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea1e27b700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea180cc940 0x7fea1814b700 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fea1000c560 tx=0x7fea10007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:38.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea167fc700 1 -- 172.21.15.31:0/170820563 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10010510 con 0x7fea180cc940 2023-10-09T06:25:38.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea167fc700 1 -- 172.21.15.31:0/170820563 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea10010670 con 0x7fea180cc940 2023-10-09T06:25:38.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea1f27d700 1 -- 172.21.15.31:0/170820563 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1816aee0 con 0x7fea180cc940 2023-10-09T06:25:38.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea167fc700 1 -- 172.21.15.31:0/170820563 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10010a30 con 0x7fea180cc940 2023-10-09T06:25:38.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.971+0000 7fea1f27d700 1 -- 172.21.15.31:0/170820563 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1809ac20 con 0x7fea180cc940 2023-10-09T06:25:38.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.972+0000 7fea1f27d700 1 -- 172.21.15.31:0/170820563 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1806ac60 con 0x7fea180cc940 2023-10-09T06:25:38.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.973+0000 7fea167fc700 1 -- 172.21.15.31:0/170820563 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea10002050 con 0x7fea180cc940 2023-10-09T06:25:38.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.973+0000 7fea167fc700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea04066f30 0x7fea040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:38.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.973+0000 7fea167fc700 1 -- 172.21.15.31:0/170820563 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fea10083c90 con 0x7fea180cc940 2023-10-09T06:25:38.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.973+0000 7fea1da7a700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea04066f30 0x7fea040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:38.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.974+0000 7fea1da7a700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea04066f30 0x7fea040693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0030c0 tx=0x7fea0c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:38.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:38.977+0000 7fea167fc700 1 -- 172.21.15.31:0/170820563 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea10051060 con 0x7fea180cc940 2023-10-09T06:25:39.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.171+0000 7fea1f27d700 1 -- 172.21.15.31:0/170820563 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fea180cfdd0 con 0x7fea180cc940 2023-10-09T06:25:39.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.828+0000 7fea167fc700 1 -- 172.21.15.31:0/170820563 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) v1 ==== 169+0+0 (secure 0 0 0) 0x7fea10054680 con 0x7fea180cc940 2023-10-09T06:25:39.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.833+0000 7fea1f27d700 1 -- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea04066f30 msgr2=0x7fea040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:39.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.833+0000 7fea1f27d700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea04066f30 0x7fea040693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0030c0 tx=0x7fea0c016000 comp rx=0 tx=0).stop 2023-10-09T06:25:39.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.833+0000 7fea1f27d700 1 -- 172.21.15.31:0/170820563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea180cc940 msgr2=0x7fea1814b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:39.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.833+0000 7fea1f27d700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea180cc940 0x7fea1814b700 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fea1000c560 tx=0x7fea10007e00 comp rx=0 tx=0).stop 2023-10-09T06:25:39.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.834+0000 7fea1f27d700 1 -- 172.21.15.31:0/170820563 shutdown_connections 2023-10-09T06:25:39.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.834+0000 7fea1f27d700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea04066f30 0x7fea040693e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:39.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.834+0000 7fea1f27d700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fea1815d240 0x7fea180c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:39.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.834+0000 7fea1f27d700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea180cc940 0x7fea1814b700 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:39.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.834+0000 7fea1f27d700 1 --2- 172.21.15.31:0/170820563 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fea180ce810 0x7fea1816a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:39.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.834+0000 7fea1f27d700 1 -- 172.21.15.31:0/170820563 >> 172.21.15.31:0/170820563 conn(0x7fea18067e40 msgr2=0x7fea1815ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:39.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.834+0000 7fea1f27d700 1 -- 172.21.15.31:0/170820563 shutdown_connections 2023-10-09T06:25:39.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.834+0000 7fea1f27d700 1 -- 172.21.15.31:0/170820563 wait complete. 2023-10-09T06:25:39.836 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2023-10-09T06:25:39.848 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:25:39.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.969+0000 7f20bcc0b700 1 Processor -- start 2023-10-09T06:25:39.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.969+0000 7f20bcc0b700 1 -- start start 2023-10-09T06:25:39.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.970+0000 7f20bcc0b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b80b6580 0x7f20b806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:39.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.970+0000 7f20bcc0b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f20b806a830 0x7f20b80b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:39.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.970+0000 7f20bcc0b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b80b4d70 con 0x7f20b80cce30 2023-10-09T06:25:39.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.970+0000 7f20bcc0b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b806ac70 con 0x7f20b806a830 2023-10-09T06:25:39.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.970+0000 7f20bcc0b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b815b3b0 con 0x7f20b80b6580 2023-10-09T06:25:39.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.970+0000 7f20b77fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f20b80cce30 0x7f20b815aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46488/0 (socket says 172.21.15.31:46488) 2023-10-09T06:25:39.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.970+0000 7f20b77fe700 1 -- 172.21.15.31:0/4040003904 learned_addr learned my addr 172.21.15.31:0/4040003904 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:39.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527120406 0 0) 0x7f20b80b4d70 con 0x7f20b80cce30 2023-10-09T06:25:39.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b7fff700 1 --2- 172.21.15.31:0/4040003904 >> v2:172.21.15.158:3300/0 conn(0x7f20b806a830 0x7f20b80b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:39.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20a0003570 con 0x7f20b80cce30 2023-10-09T06:25:39.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b6ffd700 1 --2- 172.21.15.31:0/4040003904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b80b6580 0x7f20b806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:39.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3404508155 0 0) 0x7f20a0003570 con 0x7f20b80cce30 2023-10-09T06:25:39.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b80b6580 msgr2=0x7f20b806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:39.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 --2- 172.21.15.31:0/4040003904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b80b6580 0x7f20b806a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:39.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 >> v2:172.21.15.158:3300/0 conn(0x7f20b806a830 msgr2=0x7f20b80b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:39.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 --2- 172.21.15.31:0/4040003904 >> v2:172.21.15.158:3300/0 conn(0x7f20b806a830 0x7f20b80b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:39.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80cd8d0 con 0x7f20b80cce30 2023-10-09T06:25:39.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f20a8001470 con 0x7f20b80cce30 2023-10-09T06:25:39.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 >> v1:172.21.15.31:6789/0 conn(0x7f20b80cce30 legacy=0x7f20b815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:39.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 --2- 172.21.15.31:0/4040003904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a0003a60 0x7f20a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:39.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 --2- 172.21.15.31:0/4040003904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b80b6580 0x7f20a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:39.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 --2- 172.21.15.31:0/4040003904 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20a0004d50 0x7f20a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:39.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b806ac70 con 0x7f20a0003a60 2023-10-09T06:25:39.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b815b3b0 con 0x7f20a0004d50 2023-10-09T06:25:39.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a000ba60 con 0x7f20b80b6580 2023-10-09T06:25:39.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b77fe700 1 --2- 172.21.15.31:0/4040003904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a0003a60 0x7f20a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:39.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b6ffd700 1 --2- 172.21.15.31:0/4040003904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b80b6580 0x7f20a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:39.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b7fff700 1 --2- 172.21.15.31:0/4040003904 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20a0004d50 0x7f20a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:39.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b77fe700 1 -- 172.21.15.31:0/4040003904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b80b6580 msgr2=0x7f20a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:39.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b77fe700 1 --2- 172.21.15.31:0/4040003904 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b80b6580 0x7f20a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:39.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b77fe700 1 -- 172.21.15.31:0/4040003904 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20a0004d50 msgr2=0x7f20a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:39.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b77fe700 1 --2- 172.21.15.31:0/4040003904 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20a0004d50 0x7f20a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:39.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.971+0000 7f20b77fe700 1 -- 172.21.15.31:0/4040003904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0003570 con 0x7f20a0003a60 2023-10-09T06:25:39.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.972+0000 7f20b77fe700 1 --2- 172.21.15.31:0/4040003904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a0003a60 0x7f20a0003e70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f20a800c3c0 tx=0x7f20b80cdca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fb88ea65c85d32 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:39.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.972+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800cc30 con 0x7f20a0003a60 2023-10-09T06:25:39.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.972+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a800cd90 con 0x7f20a0003a60 2023-10-09T06:25:39.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.972+0000 7f20b67fc700 1 -- 172.21.15.31:0/4040003904 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8005b70 con 0x7f20a0003a60 2023-10-09T06:25:39.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.972+0000 7f20bcc0b700 1 -- 172.21.15.31:0/4040003904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a0003a60 msgr2=0x7f20a0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:39.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.972+0000 7f20bcc0b700 1 --2- 172.21.15.31:0/4040003904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a0003a60 0x7f20a0003e70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f20a800c3c0 tx=0x7f20b80cdca0 comp rx=0 tx=0).stop 2023-10-09T06:25:39.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.972+0000 7f20b7fff700 1 -- 172.21.15.31:0/4040003904 reap_dead start 2023-10-09T06:25:39.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.972+0000 7f20bcc0b700 1 -- 172.21.15.31:0/4040003904 shutdown_connections 2023-10-09T06:25:39.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.972+0000 7f20bcc0b700 1 -- 172.21.15.31:0/4040003904 >> 172.21.15.31:0/4040003904 conn(0x7f20b8068cb0 msgr2=0x7f20b80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:39.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.972+0000 7f20bcc0b700 1 -- 172.21.15.31:0/4040003904 shutdown_connections 2023-10-09T06:25:39.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.972+0000 7f20bcc0b700 1 -- 172.21.15.31:0/4040003904 wait complete. 2023-10-09T06:25:39.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.974+0000 7f20bcc0b700 1 Processor -- start 2023-10-09T06:25:39.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.974+0000 7f20bcc0b700 1 -- start start 2023-10-09T06:25:39.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.974+0000 7f20bcc0b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a0003a60 0x7f20b80b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:39.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.974+0000 7f20bcc0b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b81594b0 0x7f20b8156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:39.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.974+0000 7f20bcc0b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20b81569b0 0x7f20b8154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:39.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.974+0000 7f20bcc0b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b814fcf0 con 0x7f20a0003a60 2023-10-09T06:25:39.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.974+0000 7f20bcc0b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b8152010 con 0x7f20b81569b0 2023-10-09T06:25:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.974+0000 7f20bcc0b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b80b26b0 con 0x7f20b81594b0 2023-10-09T06:25:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.974+0000 7f20b77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a0003a60 0x7f20b80b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f20b77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a0003a60 0x7f20b80b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58368/0 (socket says 172.21.15.31:58368) 2023-10-09T06:25:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f20b77fe700 1 -- 172.21.15.31:0/562371925 learned_addr learned my addr 172.21.15.31:0/562371925 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f20b6ffd700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b81594b0 0x7f20b8156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f20b7fff700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20b81569b0 0x7f20b8154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f20b77fe700 1 -- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b81594b0 msgr2=0x7f20b8156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f20b77fe700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b81594b0 0x7f20b8156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f20b77fe700 1 -- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20b81569b0 msgr2=0x7f20b8154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f20b77fe700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20b81569b0 0x7f20b8154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f20b77fe700 1 -- 172.21.15.31:0/562371925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80b2990 con 0x7f20a0003a60 2023-10-09T06:25:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f20b6ffd700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b81594b0 0x7f20b8156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f20b77fe700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a0003a60 0x7f20b80b1e60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f20a800c9b0 tx=0x7f20a8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f209f7fe700 1 -- 172.21.15.31:0/562371925 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800cc30 con 0x7f20a0003a60 2023-10-09T06:25:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f209f7fe700 1 -- 172.21.15.31:0/562371925 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a8000fe0 con 0x7f20a0003a60 2023-10-09T06:25:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f20bcc0b700 1 -- 172.21.15.31:0/562371925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b80b2c70 con 0x7f20a0003a60 2023-10-09T06:25:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f209f7fe700 1 -- 172.21.15.31:0/562371925 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8007510 con 0x7f20a0003a60 2023-10-09T06:25:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.975+0000 7f20bcc0b700 1 -- 172.21.15.31:0/562371925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b80b23a0 con 0x7f20a0003a60 2023-10-09T06:25:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.976+0000 7f20bcc0b700 1 -- 172.21.15.31:0/562371925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b8089550 con 0x7f20a0003a60 2023-10-09T06:25:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.977+0000 7f209f7fe700 1 -- 172.21.15.31:0/562371925 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20a8019030 con 0x7f20a0003a60 2023-10-09T06:25:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.977+0000 7f209f7fe700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f20a4066f30 0x7f20a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.977+0000 7f209f7fe700 1 -- 172.21.15.31:0/562371925 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f20a80854d0 con 0x7f20a0003a60 2023-10-09T06:25:39.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.977+0000 7f20b6ffd700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f20a4066f30 0x7f20a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:39.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.978+0000 7f20b6ffd700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f20a4066f30 0x7f20a40693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0093f0 tx=0x7f20ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:39.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:39.981+0000 7f209f7fe700 1 -- 172.21.15.31:0/562371925 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20a8052a40 con 0x7f20a0003a60 2023-10-09T06:25:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.177+0000 7f20bcc0b700 1 -- 172.21.15.31:0/562371925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f20b80b4440 con 0x7f20a0003a60 2023-10-09T06:25:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.181+0000 7f209f7fe700 1 -- 172.21.15.31:0/562371925 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f20a8056060 con 0x7f20a0003a60 2023-10-09T06:25:40.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.183+0000 7f20bcc0b700 1 -- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f20a4066f30 msgr2=0x7f20a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.183+0000 7f20bcc0b700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f20a4066f30 0x7f20a40693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0093f0 tx=0x7f20ac008040 comp rx=0 tx=0).stop 2023-10-09T06:25:40.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.183+0000 7f20bcc0b700 1 -- 172.21.15.31:0/562371925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a0003a60 msgr2=0x7f20b80b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.183+0000 7f20bcc0b700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a0003a60 0x7f20b80b1e60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f20a800c9b0 tx=0x7f20a8015000 comp rx=0 tx=0).stop 2023-10-09T06:25:40.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.183+0000 7f20bcc0b700 1 -- 172.21.15.31:0/562371925 shutdown_connections 2023-10-09T06:25:40.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.183+0000 7f20bcc0b700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f20a4066f30 0x7f20a40693e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.183+0000 7f20bcc0b700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20b81569b0 0x7f20b8154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.183+0000 7f20bcc0b700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a0003a60 0x7f20b80b1e60 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.183+0000 7f20bcc0b700 1 --2- 172.21.15.31:0/562371925 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f20b81594b0 0x7f20b8156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.183+0000 7f20bcc0b700 1 -- 172.21.15.31:0/562371925 >> 172.21.15.31:0/562371925 conn(0x7f20b8068cb0 msgr2=0x7f20b815a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:40.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.183+0000 7f20bcc0b700 1 -- 172.21.15.31:0/562371925 shutdown_connections 2023-10-09T06:25:40.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.183+0000 7f20bcc0b700 1 -- 172.21.15.31:0/562371925 wait complete. 2023-10-09T06:25:40.196 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-09T06:25:40.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.314+0000 7fe8eeaa8700 1 Processor -- start 2023-10-09T06:25:40.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.315+0000 7fe8eeaa8700 1 -- start start 2023-10-09T06:25:40.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.315+0000 7fe8eeaa8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e80cc720 0x7fe8e80cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.315+0000 7fe8eeaa8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e80caa60 con 0x7fe8e80cba50 2023-10-09T06:25:40.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.315+0000 7fe8eeaa8700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e80cf570 con 0x7fe8e80c9200 2023-10-09T06:25:40.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.315+0000 7fe8eeaa8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80cb5c0 con 0x7fe8e80cc720 2023-10-09T06:25:40.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8ed045700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe8e80cba50 0x7fe8e80cbed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46502/0 (socket says 172.21.15.31:46502) 2023-10-09T06:25:40.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8ed045700 1 -- 172.21.15.31:0/2370285260 learned_addr learned my addr 172.21.15.31:0/2370285260 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:40.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8ec844700 1 --2- 172.21.15.31:0/2370285260 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e80cc720 0x7fe8e80cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100383021 0 0) 0x7fe8e80caa60 con 0x7fe8e80cba50 2023-10-09T06:25:40.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d4003570 con 0x7fe8e80cba50 2023-10-09T06:25:40.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3234760789 0 0) 0x7fe8d4003570 con 0x7fe8e80cba50 2023-10-09T06:25:40.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e80cc720 msgr2=0x7fe8e80cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:40.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 --2- 172.21.15.31:0/2370285260 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e80cc720 0x7fe8e80cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 >> v1:172.21.15.158:6789/0 conn(0x7fe8e80c9200 legacy=0x7fe8e80b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80b2000 con 0x7fe8e80cba50 2023-10-09T06:25:40.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fe8d0001470 con 0x7fe8e80cba50 2023-10-09T06:25:40.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 >> v1:172.21.15.31:6789/0 conn(0x7fe8e80cba50 legacy=0x7fe8e80cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 --2- 172.21.15.31:0/2370285260 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8d4003a90 0x7fe8d4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 --2- 172.21.15.31:0/2370285260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8d4004810 0x7fe8d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 --2- 172.21.15.31:0/2370285260 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e80cc720 0x7fe8d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80cb5c0 con 0x7fe8d4004810 2023-10-09T06:25:40.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d400bb10 con 0x7fe8d4003a90 2023-10-09T06:25:40.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d400bcd0 con 0x7fe8e80cc720 2023-10-09T06:25:40.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8e7fff700 1 --2- 172.21.15.31:0/2370285260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8d4004810 0x7fe8d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8ec844700 1 --2- 172.21.15.31:0/2370285260 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8d4003a90 0x7fe8d4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.316+0000 7fe8ed045700 1 --2- 172.21.15.31:0/2370285260 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e80cc720 0x7fe8d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.317+0000 7fe8e7fff700 1 -- 172.21.15.31:0/2370285260 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e80cc720 msgr2=0x7fe8d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:40.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.317+0000 7fe8e7fff700 1 --2- 172.21.15.31:0/2370285260 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e80cc720 0x7fe8d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.317+0000 7fe8e7fff700 1 -- 172.21.15.31:0/2370285260 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8d4003a90 msgr2=0x7fe8d4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:40.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.317+0000 7fe8e7fff700 1 --2- 172.21.15.31:0/2370285260 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8d4003a90 0x7fe8d4003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.317+0000 7fe8e7fff700 1 -- 172.21.15.31:0/2370285260 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4003570 con 0x7fe8d4004810 2023-10-09T06:25:40.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.317+0000 7fe8e7fff700 1 --2- 172.21.15.31:0/2370285260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8d4004810 0x7fe8d4004c80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80020a0 tx=0x7fe8d80016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee68f94ea223533 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:40.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.317+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80019e0 con 0x7fe8d4004810 2023-10-09T06:25:40.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.317+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d800c8b0 con 0x7fe8d4004810 2023-10-09T06:25:40.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.317+0000 7fe8e77fe700 1 -- 172.21.15.31:0/2370285260 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d800cc50 con 0x7fe8d4004810 2023-10-09T06:25:40.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.317+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/2370285260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8d4004810 msgr2=0x7fe8d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.317+0000 7fe8eeaa8700 1 --2- 172.21.15.31:0/2370285260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8d4004810 0x7fe8d4004c80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80020a0 tx=0x7fe8d80016d0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.318+0000 7fe8ed045700 1 -- 172.21.15.31:0/2370285260 reap_dead start 2023-10-09T06:25:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.318+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/2370285260 shutdown_connections 2023-10-09T06:25:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.318+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/2370285260 >> 172.21.15.31:0/2370285260 conn(0x7fe8e806c6e0 msgr2=0x7fe8e8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.318+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/2370285260 shutdown_connections 2023-10-09T06:25:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.318+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/2370285260 wait complete. 2023-10-09T06:25:40.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.319+0000 7fe8eeaa8700 1 Processor -- start 2023-10-09T06:25:40.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.319+0000 7fe8eeaa8700 1 -- start start 2023-10-09T06:25:40.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8eeaa8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8d4004810 0x7fe8e814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8eeaa8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e815c510 0x7fe8e8152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8eeaa8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e8152b40 0x7fe8e814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8eeaa8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e8152fb0 con 0x7fe8e815c510 2023-10-09T06:25:40.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8eeaa8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80ce750 con 0x7fe8e8152b40 2023-10-09T06:25:40.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8eeaa8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80cea30 con 0x7fe8d4004810 2023-10-09T06:25:40.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8e7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e815c510 0x7fe8e8152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8e7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e815c510 0x7fe8e8152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58392/0 (socket says 172.21.15.31:58392) 2023-10-09T06:25:40.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8e7fff700 1 -- 172.21.15.31:0/91925561 learned_addr learned my addr 172.21.15.31:0/91925561 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:40.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8ec844700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8d4004810 0x7fe8e814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8ed045700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e8152b40 0x7fe8e814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8e7fff700 1 -- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8d4004810 msgr2=0x7fe8e814d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8e7fff700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8d4004810 0x7fe8e814d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8e7fff700 1 -- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e8152b40 msgr2=0x7fe8e814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8e7fff700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e8152b40 0x7fe8e814e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8e7fff700 1 -- 172.21.15.31:0/91925561 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80ced10 con 0x7fe8e815c510 2023-10-09T06:25:40.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8e7fff700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e815c510 0x7fe8e8152600 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800c6a0 tx=0x7fe8d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:40.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8e4ff9700 1 -- 172.21.15.31:0/91925561 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8012cd0 con 0x7fe8e815c510 2023-10-09T06:25:40.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8e4ff9700 1 -- 172.21.15.31:0/91925561 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d8012e50 con 0x7fe8e815c510 2023-10-09T06:25:40.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/91925561 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e80ceff0 con 0x7fe8e815c510 2023-10-09T06:25:40.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8e4ff9700 1 -- 172.21.15.31:0/91925561 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80276c0 con 0x7fe8e815c510 2023-10-09T06:25:40.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.320+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/91925561 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e814e950 con 0x7fe8e815c510 2023-10-09T06:25:40.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.321+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/91925561 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e814e130 con 0x7fe8e815c510 2023-10-09T06:25:40.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.322+0000 7fe8e4ff9700 1 -- 172.21.15.31:0/91925561 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8d8024070 con 0x7fe8e815c510 2023-10-09T06:25:40.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.322+0000 7fe8e4ff9700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8c8066f30 0x7fe8c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.322+0000 7fe8e4ff9700 1 -- 172.21.15.31:0/91925561 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe8d8086510 con 0x7fe8e815c510 2023-10-09T06:25:40.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.322+0000 7fe8ec844700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8c8066f30 0x7fe8c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.323+0000 7fe8ec844700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8c8066f30 0x7fe8c80693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00093f0 tx=0x7fe8e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:40.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.326+0000 7fe8e4ff9700 1 -- 172.21.15.31:0/91925561 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8e814e130 con 0x7fe8e815c510 2023-10-09T06:25:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.601+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/91925561 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7fe8e804c3c0 con 0x7fe8e815c510 2023-10-09T06:25:40.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.823+0000 7fe8e4ff9700 1 -- 172.21.15.31:0/91925561 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v242) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe8d8053a80 con 0x7fe8e815c510 2023-10-09T06:25:40.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.825+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8c8066f30 msgr2=0x7fe8c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.825+0000 7fe8eeaa8700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8c8066f30 0x7fe8c80693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00093f0 tx=0x7fe8e0008040 comp rx=0 tx=0).stop 2023-10-09T06:25:40.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.825+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/91925561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e815c510 msgr2=0x7fe8e8152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.825+0000 7fe8eeaa8700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e815c510 0x7fe8e8152600 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800c6a0 tx=0x7fe8d8016000 comp rx=0 tx=0).stop 2023-10-09T06:25:40.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.825+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/91925561 shutdown_connections 2023-10-09T06:25:40.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.825+0000 7fe8eeaa8700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8c8066f30 0x7fe8c80693e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.825+0000 7fe8eeaa8700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8d4004810 0x7fe8e814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.825+0000 7fe8eeaa8700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e8152b40 0x7fe8e814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.825+0000 7fe8eeaa8700 1 --2- 172.21.15.31:0/91925561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e815c510 0x7fe8e8152600 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.825+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/91925561 >> 172.21.15.31:0/91925561 conn(0x7fe8e806c6e0 msgr2=0x7fe8e80b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:40.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.825+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/91925561 shutdown_connections 2023-10-09T06:25:40.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.825+0000 7fe8eeaa8700 1 -- 172.21.15.31:0/91925561 wait complete. 2023-10-09T06:25:40.839 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-09T06:25:40.839 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-09T06:25:40.840 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-09T06:25:40.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.959+0000 7fd91bd22700 1 Processor -- start 2023-10-09T06:25:40.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.960+0000 7fd91bd22700 1 -- start start 2023-10-09T06:25:40.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.960+0000 7fd91bd22700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd914157870 0x7fd91415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.960+0000 7fd91bd22700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91415cbb0 con 0x7fd91415a620 2023-10-09T06:25:40.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.960+0000 7fd91bd22700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91415bfa0 con 0x7fd914157c40 2023-10-09T06:25:40.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.960+0000 7fd91bd22700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91415c280 con 0x7fd914157870 2023-10-09T06:25:40.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.960+0000 7fd9192bd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd91415a620 0x7fd91415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46516/0 (socket says 172.21.15.31:46516) 2023-10-09T06:25:40.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.960+0000 7fd9192bd700 1 -- 172.21.15.31:0/704241233 learned_addr learned my addr 172.21.15.31:0/704241233 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:40.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd919abe700 1 --2- 172.21.15.31:0/704241233 >> v2:172.21.15.158:3300/0 conn(0x7fd914157870 0x7fd91415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962304032 0 0) 0x7fd91415cbb0 con 0x7fd91415a620 2023-10-09T06:25:40.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8fc003570 con 0x7fd91415a620 2023-10-09T06:25:40.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061515220 0 0) 0x7fd91415bfa0 con 0x7fd914157c40 2023-10-09T06:25:40.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd91415cbb0 con 0x7fd914157c40 2023-10-09T06:25:40.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2887922915 0 0) 0x7fd8fc003570 con 0x7fd91415a620 2023-10-09T06:25:40.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 >> v2:172.21.15.158:3300/0 conn(0x7fd914157870 msgr2=0x7fd91415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:40.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 --2- 172.21.15.31:0/704241233 >> v2:172.21.15.158:3300/0 conn(0x7fd914157870 0x7fd91415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 >> v1:172.21.15.158:6789/0 conn(0x7fd914157c40 legacy=0x7fd914158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91415c560 con 0x7fd91415a620 2023-10-09T06:25:40.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd919abe700 1 --2- 172.21.15.31:0/704241233 >> v2:172.21.15.158:3300/0 conn(0x7fd914157870 0x7fd91415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:25:40.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fd908001470 con 0x7fd91415a620 2023-10-09T06:25:40.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 >> v1:172.21.15.31:6789/0 conn(0x7fd91415a620 legacy=0x7fd91415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 --2- 172.21.15.31:0/704241233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8fc003bf0 0x7fd8fc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 --2- 172.21.15.31:0/704241233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8fc004810 0x7fd8fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 --2- 172.21.15.31:0/704241233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8fc0051c0 0x7fd8fc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91415c280 con 0x7fd8fc004810 2023-10-09T06:25:40.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc00c160 con 0x7fd8fc0051c0 2023-10-09T06:25:40.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc00c320 con 0x7fd8fc003bf0 2023-10-09T06:25:40.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd9192bd700 1 --2- 172.21.15.31:0/704241233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8fc004810 0x7fd8fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd91a2bf700 1 --2- 172.21.15.31:0/704241233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8fc0051c0 0x7fd8fc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd919abe700 1 --2- 172.21.15.31:0/704241233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8fc003bf0 0x7fd8fc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd9192bd700 1 -- 172.21.15.31:0/704241233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8fc003bf0 msgr2=0x7fd8fc003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:40.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.961+0000 7fd9192bd700 1 --2- 172.21.15.31:0/704241233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd8fc003bf0 0x7fd8fc003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd9192bd700 1 -- 172.21.15.31:0/704241233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8fc0051c0 msgr2=0x7fd8fc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:40.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd9192bd700 1 --2- 172.21.15.31:0/704241233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8fc0051c0 0x7fd8fc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd9192bd700 1 -- 172.21.15.31:0/704241233 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc003570 con 0x7fd8fc004810 2023-10-09T06:25:40.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd91a2bf700 1 -- 172.21.15.31:0/704241233 reap_dead start 2023-10-09T06:25:40.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd9192bd700 1 --2- 172.21.15.31:0/704241233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8fc004810 0x7fd8fc004c80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd91415aa20 tx=0x7fd908001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d212f9e86f690e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:40.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90800cb40 con 0x7fd8fc004810 2023-10-09T06:25:40.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90800ccc0 con 0x7fd8fc004810 2023-10-09T06:25:40.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd918abc700 1 -- 172.21.15.31:0/704241233 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908005b70 con 0x7fd8fc004810 2023-10-09T06:25:40.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd91bd22700 1 -- 172.21.15.31:0/704241233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8fc004810 msgr2=0x7fd8fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd91bd22700 1 --2- 172.21.15.31:0/704241233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8fc004810 0x7fd8fc004c80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd91415aa20 tx=0x7fd908001e10 comp rx=0 tx=0).stop 2023-10-09T06:25:40.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd91bd22700 1 -- 172.21.15.31:0/704241233 shutdown_connections 2023-10-09T06:25:40.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd91bd22700 1 --2- 172.21.15.31:0/704241233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8fc004810 0x7fd8fc004c80 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd91bd22700 1 -- 172.21.15.31:0/704241233 >> 172.21.15.31:0/704241233 conn(0x7fd914068ce0 msgr2=0x7fd9140690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:40.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd91bd22700 1 -- 172.21.15.31:0/704241233 shutdown_connections 2023-10-09T06:25:40.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.962+0000 7fd91bd22700 1 -- 172.21.15.31:0/704241233 wait complete. 2023-10-09T06:25:40.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.963+0000 7fd91bd22700 1 Processor -- start 2023-10-09T06:25:40.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.963+0000 7fd91bd22700 1 -- start start 2023-10-09T06:25:40.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.964+0000 7fd91bd22700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8fc004810 0x7fd91413f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.964+0000 7fd91bd22700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd91416a4e0 0x7fd9141515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.964+0000 7fd91bd22700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd91416a950 0x7fd914151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.964+0000 7fd91bd22700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91414fa10 con 0x7fd8fc004810 2023-10-09T06:25:40.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.964+0000 7fd91bd22700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91414ee00 con 0x7fd91416a950 2023-10-09T06:25:40.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.964+0000 7fd91bd22700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91414f0e0 con 0x7fd91416a4e0 2023-10-09T06:25:40.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.964+0000 7fd919abe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8fc004810 0x7fd91413f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.964+0000 7fd919abe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8fc004810 0x7fd91413f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58422/0 (socket says 172.21.15.31:58422) 2023-10-09T06:25:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.964+0000 7fd919abe700 1 -- 172.21.15.31:0/446546140 learned_addr learned my addr 172.21.15.31:0/446546140 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.964+0000 7fd9192bd700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd91416a4e0 0x7fd9141515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.964+0000 7fd91a2bf700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd91416a950 0x7fd914151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.965+0000 7fd919abe700 1 -- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd91416a4e0 msgr2=0x7fd9141515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.965+0000 7fd919abe700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd91416a4e0 0x7fd9141515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.965+0000 7fd919abe700 1 -- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd91416a950 msgr2=0x7fd914151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:40.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.965+0000 7fd919abe700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd91416a950 0x7fd914151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:40.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.965+0000 7fd919abe700 1 -- 172.21.15.31:0/446546140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91414f3c0 con 0x7fd8fc004810 2023-10-09T06:25:40.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.965+0000 7fd919abe700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8fc004810 0x7fd91413f8a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd90400f2e0 tx=0x7fd90400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:40.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.965+0000 7fd911ffb700 1 -- 172.21.15.31:0/446546140 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90400e040 con 0x7fd8fc004810 2023-10-09T06:25:40.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.965+0000 7fd911ffb700 1 -- 172.21.15.31:0/446546140 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90400f040 con 0x7fd8fc004810 2023-10-09T06:25:40.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.965+0000 7fd91bd22700 1 -- 172.21.15.31:0/446546140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91414f6a0 con 0x7fd8fc004810 2023-10-09T06:25:40.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.965+0000 7fd911ffb700 1 -- 172.21.15.31:0/446546140 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904015430 con 0x7fd8fc004810 2023-10-09T06:25:40.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.965+0000 7fd91bd22700 1 -- 172.21.15.31:0/446546140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91414fea0 con 0x7fd8fc004810 2023-10-09T06:25:40.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.966+0000 7fd91bd22700 1 -- 172.21.15.31:0/446546140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91414fcf0 con 0x7fd8fc004810 2023-10-09T06:25:40.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.967+0000 7fd911ffb700 1 -- 172.21.15.31:0/446546140 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd904015800 con 0x7fd8fc004810 2023-10-09T06:25:40.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.967+0000 7fd911ffb700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd900066f30 0x7fd9000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:40.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.967+0000 7fd911ffb700 1 -- 172.21.15.31:0/446546140 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd904085050 con 0x7fd8fc004810 2023-10-09T06:25:40.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.967+0000 7fd9192bd700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd900066f30 0x7fd9000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:40.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.968+0000 7fd9192bd700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd900066f30 0x7fd9000693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd908001e50 tx=0x7fd908015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:40.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:40.971+0000 7fd911ffb700 1 -- 172.21.15.31:0/446546140 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd904056050 con 0x7fd8fc004810 2023-10-09T06:25:41.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.247+0000 7fd91bd22700 1 -- 172.21.15.31:0/446546140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7fd91404c3c0 con 0x7fd8fc004810 2023-10-09T06:25:41.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.824+0000 7fd911ffb700 1 -- 172.21.15.31:0/446546140 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v243) v1 ==== 140+0+0 (secure 0 0 0) 0x7fd904055be0 con 0x7fd8fc004810 2023-10-09T06:25:41.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.826+0000 7fd91bd22700 1 -- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd900066f30 msgr2=0x7fd9000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:41.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.826+0000 7fd91bd22700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd900066f30 0x7fd9000693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd908001e50 tx=0x7fd908015000 comp rx=0 tx=0).stop 2023-10-09T06:25:41.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.826+0000 7fd91bd22700 1 -- 172.21.15.31:0/446546140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8fc004810 msgr2=0x7fd91413f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:41.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.826+0000 7fd91bd22700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8fc004810 0x7fd91413f8a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd90400f2e0 tx=0x7fd90400b040 comp rx=0 tx=0).stop 2023-10-09T06:25:41.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.826+0000 7fd91bd22700 1 -- 172.21.15.31:0/446546140 shutdown_connections 2023-10-09T06:25:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.826+0000 7fd91bd22700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd900066f30 0x7fd9000693e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.826+0000 7fd91bd22700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd91416a950 0x7fd914151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.826+0000 7fd91bd22700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8fc004810 0x7fd91413f8a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.826+0000 7fd91bd22700 1 --2- 172.21.15.31:0/446546140 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd91416a4e0 0x7fd9141515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.826+0000 7fd91bd22700 1 -- 172.21.15.31:0/446546140 >> 172.21.15.31:0/446546140 conn(0x7fd914068ce0 msgr2=0x7fd914158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:41.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.826+0000 7fd91bd22700 1 -- 172.21.15.31:0/446546140 shutdown_connections 2023-10-09T06:25:41.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:41.826+0000 7fd91bd22700 1 -- 172.21.15.31:0/446546140 wait complete. 2023-10-09T06:25:41.840 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-09T06:25:41.976 INFO:teuthology.orchestra.run.smithi031.stdout:{"osd_objectstore":"memstore"} 2023-10-09T06:25:41.976 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-09T06:25:41.976 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:25:42.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.098+0000 7f68115b7700 1 Processor -- start 2023-10-09T06:25:42.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.098+0000 7f68115b7700 1 -- start start 2023-10-09T06:25:42.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f68115b7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f680c159ec0 0x7f680c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f68115b7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c15a290 0x7f680c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f68115b7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c0b0790 con 0x7f680c06a5a0 2023-10-09T06:25:42.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f68115b7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680c0ce1f0 con 0x7f680c159ec0 2023-10-09T06:25:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f68115b7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0b0b20 con 0x7f680c15a290 2023-10-09T06:25:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f680b7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f680c06a5a0 0x7f680c15db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46520/0 (socket says 172.21.15.31:46520) 2023-10-09T06:25:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f680b7fe700 1 -- 172.21.15.31:0/694209802 learned_addr learned my addr 172.21.15.31:0/694209802 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f680affd700 1 --2- 172.21.15.31:0/694209802 >> v2:172.21.15.158:3300/0 conn(0x7f680c159ec0 0x7f680c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f680a7fc700 1 --2- 172.21.15.31:0/694209802 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c15a290 0x7f680c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f6809ffb700 1 -- 172.21.15.31:0/694209802 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538424494 0 0) 0x7f680c0b0790 con 0x7f680c06a5a0 2023-10-09T06:25:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f6809ffb700 1 -- 172.21.15.31:0/694209802 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f4003570 con 0x7f680c06a5a0 2023-10-09T06:25:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f6809ffb700 1 -- 172.21.15.31:0/694209802 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2131192439 0 0) 0x7f67f4003570 con 0x7f680c06a5a0 2023-10-09T06:25:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f680affd700 1 -- 172.21.15.31:0/694209802 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c15a290 msgr2=0x7f680c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f680affd700 1 --2- 172.21.15.31:0/694209802 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c15a290 0x7f680c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f680affd700 1 -- 172.21.15.31:0/694209802 >> v1:172.21.15.31:6789/0 conn(0x7f680c06a5a0 legacy=0x7f680c15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f680affd700 1 -- 172.21.15.31:0/694209802 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0b04b0 con 0x7f680c159ec0 2023-10-09T06:25:42.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.099+0000 7f680a7fc700 1 --2- 172.21.15.31:0/694209802 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c15a290 0x7f680c0afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:25:42.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.100+0000 7f680affd700 1 --2- 172.21.15.31:0/694209802 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c159ec0 0x7f680c0af940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0098e0 tx=0x7f67fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fabaeef8225c384 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:42.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.100+0000 7f6809ffb700 1 -- 172.21.15.31:0/694209802 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68040017f0 con 0x7f680c159ec0 2023-10-09T06:25:42.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.100+0000 7f6809ffb700 1 -- 172.21.15.31:0/694209802 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc011420 con 0x7f680c159ec0 2023-10-09T06:25:42.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.100+0000 7f6809ffb700 1 -- 172.21.15.31:0/694209802 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc0117a0 con 0x7f680c159ec0 2023-10-09T06:25:42.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.100+0000 7f68115b7700 1 -- 172.21.15.31:0/694209802 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c159ec0 msgr2=0x7f680c0af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.100+0000 7f68115b7700 1 --2- 172.21.15.31:0/694209802 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c159ec0 0x7f680c0af940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0098e0 tx=0x7f67fc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.100+0000 7f68115b7700 1 -- 172.21.15.31:0/694209802 shutdown_connections 2023-10-09T06:25:42.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.100+0000 7f68115b7700 1 --2- 172.21.15.31:0/694209802 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c159ec0 0x7f680c0af940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.100+0000 7f68115b7700 1 --2- 172.21.15.31:0/694209802 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c15a290 0x7f680c0afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.100+0000 7f68115b7700 1 -- 172.21.15.31:0/694209802 >> 172.21.15.31:0/694209802 conn(0x7f680c0d1880 msgr2=0x7f680c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:42.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.100+0000 7f68115b7700 1 -- 172.21.15.31:0/694209802 shutdown_connections 2023-10-09T06:25:42.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.100+0000 7f68115b7700 1 -- 172.21.15.31:0/694209802 wait complete. 2023-10-09T06:25:42.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.102+0000 7f68115b7700 1 Processor -- start 2023-10-09T06:25:42.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.102+0000 7f68115b7700 1 -- start start 2023-10-09T06:25:42.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.102+0000 7f68115b7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c06a5a0 0x7f680c0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.102+0000 7f68115b7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c159ec0 0x7f680c16a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.102+0000 7f68115b7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c15a290 0x7f680c16b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.102+0000 7f68115b7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c158620 con 0x7f680c159ec0 2023-10-09T06:25:42.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.102+0000 7f68115b7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c16a870 con 0x7f680c06a5a0 2023-10-09T06:25:42.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.102+0000 7f68115b7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c16aad0 con 0x7f680c15a290 2023-10-09T06:25:42.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f680a7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c159ec0 0x7f680c16a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f680a7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c159ec0 0x7f680c16a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58436/0 (socket says 172.21.15.31:58436) 2023-10-09T06:25:42.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f680a7fc700 1 -- 172.21.15.31:0/619100294 learned_addr learned my addr 172.21.15.31:0/619100294 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:42.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f680affd700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c06a5a0 0x7f680c0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f680b7fe700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c15a290 0x7f680c16b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f680a7fc700 1 -- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c15a290 msgr2=0x7f680c16b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f680a7fc700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c15a290 0x7f680c16b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f680a7fc700 1 -- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c06a5a0 msgr2=0x7f680c0b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f680a7fc700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c06a5a0 0x7f680c0b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f680a7fc700 1 -- 172.21.15.31:0/619100294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6800009420 con 0x7f680c159ec0 2023-10-09T06:25:42.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f680b7fe700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c15a290 0x7f680c16b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:42.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f680a7fc700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c159ec0 0x7f680c16a330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f680000ec80 tx=0x7f68000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:42.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f67f2ffd700 1 -- 172.21.15.31:0/619100294 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680000c8f0 con 0x7f680c159ec0 2023-10-09T06:25:42.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f67f2ffd700 1 -- 172.21.15.31:0/619100294 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680000ca50 con 0x7f680c159ec0 2023-10-09T06:25:42.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f68115b7700 1 -- 172.21.15.31:0/619100294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc009420 con 0x7f680c159ec0 2023-10-09T06:25:42.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f67f2ffd700 1 -- 172.21.15.31:0/619100294 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680000cdd0 con 0x7f680c159ec0 2023-10-09T06:25:42.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.103+0000 7f68115b7700 1 -- 172.21.15.31:0/619100294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c16b090 con 0x7f680c159ec0 2023-10-09T06:25:42.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.104+0000 7f68115b7700 1 -- 172.21.15.31:0/619100294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680c158790 con 0x7f680c159ec0 2023-10-09T06:25:42.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.105+0000 7f67f2ffd700 1 -- 172.21.15.31:0/619100294 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6800013680 con 0x7f680c159ec0 2023-10-09T06:25:42.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.105+0000 7f67f2ffd700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f67f8066f30 0x7f67f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.105+0000 7f67f2ffd700 1 -- 172.21.15.31:0/619100294 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f68000845d0 con 0x7f680c159ec0 2023-10-09T06:25:42.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.105+0000 7f680affd700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f67f8066f30 0x7f67f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.106+0000 7f680affd700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f67f8066f30 0x7f67f80693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0091e0 tx=0x7f67fc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:42.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.110+0000 7f67f2ffd700 1 -- 172.21.15.31:0/619100294 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6800051b40 con 0x7f680c159ec0 2023-10-09T06:25:42.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.302+0000 7f68115b7700 1 -- 172.21.15.31:0/619100294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f680c04c3c0 con 0x7f680c159ec0 2023-10-09T06:25:42.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.306+0000 7f67f2ffd700 1 -- 172.21.15.31:0/619100294 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6800055160 con 0x7f680c159ec0 2023-10-09T06:25:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.308+0000 7f68115b7700 1 -- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f67f8066f30 msgr2=0x7f67f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.308+0000 7f68115b7700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f67f8066f30 0x7f67f80693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0091e0 tx=0x7f67fc016000 comp rx=0 tx=0).stop 2023-10-09T06:25:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.308+0000 7f68115b7700 1 -- 172.21.15.31:0/619100294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c159ec0 msgr2=0x7f680c16a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.308+0000 7f68115b7700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c159ec0 0x7f680c16a330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f680000ec80 tx=0x7f68000091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.308+0000 7f68115b7700 1 -- 172.21.15.31:0/619100294 shutdown_connections 2023-10-09T06:25:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.308+0000 7f68115b7700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f67f8066f30 0x7f67f80693e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.308+0000 7f68115b7700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c15a290 0x7f680c16b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.308+0000 7f68115b7700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c06a5a0 0x7f680c0b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.308+0000 7f68115b7700 1 --2- 172.21.15.31:0/619100294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c159ec0 0x7f680c16a330 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.308+0000 7f68115b7700 1 -- 172.21.15.31:0/619100294 >> 172.21.15.31:0/619100294 conn(0x7f680c0d1880 msgr2=0x7f680c0c73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.308+0000 7f68115b7700 1 -- 172.21.15.31:0/619100294 shutdown_connections 2023-10-09T06:25:42.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.308+0000 7f68115b7700 1 -- 172.21.15.31:0/619100294 wait complete. 2023-10-09T06:25:42.320 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:25:42.320 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:25:42.357 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:25:42.402 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:25:42.402 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:25:42.402 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:25:42.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.521+0000 7f29bac9b700 1 Processor -- start 2023-10-09T06:25:42.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.521+0000 7f29bac9b700 1 -- start start 2023-10-09T06:25:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.522+0000 7f29bac9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f29b40b0e50 0x7f29b40c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.522+0000 7f29bac9b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f29b40cb4f0 0x7f29b40cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.522+0000 7f29bac9b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b415de60 con 0x7f29b40b1220 2023-10-09T06:25:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.522+0000 7f29bac9b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b40cbed0 con 0x7f29b40cb4f0 2023-10-09T06:25:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.522+0000 7f29bac9b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b415e140 con 0x7f29b40b0e50 2023-10-09T06:25:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.522+0000 7f29b3fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f29b40b1220 0x7f29b406d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46528/0 (socket says 172.21.15.31:46528) 2023-10-09T06:25:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.522+0000 7f29b3fff700 1 -- 172.21.15.31:0/768022292 learned_addr learned my addr 172.21.15.31:0/768022292 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.522+0000 7f29b9238700 1 --2- 172.21.15.31:0/768022292 >> v2:172.21.15.158:3300/0 conn(0x7f29b40cb4f0 0x7f29b40cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.522+0000 7f29b8a37700 1 --2- 172.21.15.31:0/768022292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f29b40b0e50 0x7f29b40c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.522+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637957991 0 0) 0x7f29b415de60 con 0x7f29b40b1220 2023-10-09T06:25:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.522+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f299c003570 con 0x7f29b40b1220 2023-10-09T06:25:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2987343451 0 0) 0x7f299c003570 con 0x7f29b40b1220 2023-10-09T06:25:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f29b40b0e50 msgr2=0x7f29b40c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 --2- 172.21.15.31:0/768022292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f29b40b0e50 0x7f29b40c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 >> v2:172.21.15.158:3300/0 conn(0x7f29b40cb4f0 msgr2=0x7f29b40cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 --2- 172.21.15.31:0/768022292 >> v2:172.21.15.158:3300/0 conn(0x7f29b40cb4f0 0x7f29b40cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b415e420 con 0x7f29b40b1220 2023-10-09T06:25:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f29a8001470 con 0x7f29b40b1220 2023-10-09T06:25:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 >> v1:172.21.15.31:6789/0 conn(0x7f29b40b1220 legacy=0x7f29b406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 --2- 172.21.15.31:0/768022292 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f299c003a60 0x7f299c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 --2- 172.21.15.31:0/768022292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f29b40b0e50 0x7f299c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 --2- 172.21.15.31:0/768022292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f299c004d50 0x7f299c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40cbed0 con 0x7f299c004d50 2023-10-09T06:25:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b415e140 con 0x7f299c003a60 2023-10-09T06:25:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c00bae0 con 0x7f29b40b0e50 2023-10-09T06:25:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b9238700 1 --2- 172.21.15.31:0/768022292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f299c004d50 0x7f299c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b8a37700 1 --2- 172.21.15.31:0/768022292 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f299c003a60 0x7f299c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b3fff700 1 --2- 172.21.15.31:0/768022292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f29b40b0e50 0x7f299c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b9238700 1 -- 172.21.15.31:0/768022292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f29b40b0e50 msgr2=0x7f299c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b9238700 1 --2- 172.21.15.31:0/768022292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f29b40b0e50 0x7f299c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b9238700 1 -- 172.21.15.31:0/768022292 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f299c003a60 msgr2=0x7f299c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b9238700 1 --2- 172.21.15.31:0/768022292 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f299c003a60 0x7f299c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b9238700 1 -- 172.21.15.31:0/768022292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c003570 con 0x7f299c004d50 2023-10-09T06:25:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.523+0000 7f29b9238700 1 --2- 172.21.15.31:0/768022292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f299c004d50 0x7f299c0051c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00e210 tx=0x7f29ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11add59d10c8168 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.524+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00eac0 con 0x7f299c004d50 2023-10-09T06:25:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.524+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00f040 con 0x7f299c004d50 2023-10-09T06:25:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.524+0000 7f29b37fe700 1 -- 172.21.15.31:0/768022292 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00ee70 con 0x7f299c004d50 2023-10-09T06:25:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.524+0000 7f29bac9b700 1 -- 172.21.15.31:0/768022292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f299c004d50 msgr2=0x7f299c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.524+0000 7f29bac9b700 1 --2- 172.21.15.31:0/768022292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f299c004d50 0x7f299c0051c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00e210 tx=0x7f29ac00b040 comp rx=0 tx=0).stop 2023-10-09T06:25:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.524+0000 7f29b9238700 1 -- 172.21.15.31:0/768022292 reap_dead start 2023-10-09T06:25:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.524+0000 7f29bac9b700 1 -- 172.21.15.31:0/768022292 shutdown_connections 2023-10-09T06:25:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.524+0000 7f29bac9b700 1 -- 172.21.15.31:0/768022292 >> 172.21.15.31:0/768022292 conn(0x7f29b4069870 msgr2=0x7f29b4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.524+0000 7f29bac9b700 1 -- 172.21.15.31:0/768022292 shutdown_connections 2023-10-09T06:25:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.524+0000 7f29bac9b700 1 -- 172.21.15.31:0/768022292 wait complete. 2023-10-09T06:25:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.525+0000 7f29bac9b700 1 Processor -- start 2023-10-09T06:25:42.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.525+0000 7f29bac9b700 1 -- start start 2023-10-09T06:25:42.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.526+0000 7f29bac9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29b413eac0 0x7f29b4156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.526+0000 7f29bac9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f29b4140360 0x7f29b415c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.526+0000 7f29bac9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f29b41407d0 0x7f29b415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.526+0000 7f29bac9b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4156170 con 0x7f29b413eac0 2023-10-09T06:25:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.526+0000 7f29bac9b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b415d2e0 con 0x7f29b4140360 2023-10-09T06:25:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.526+0000 7f29bac9b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4155560 con 0x7f29b41407d0 2023-10-09T06:25:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.526+0000 7f29b8a37700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29b413eac0 0x7f29b4156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.526+0000 7f29b8a37700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29b413eac0 0x7f29b4156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58452/0 (socket says 172.21.15.31:58452) 2023-10-09T06:25:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.526+0000 7f29b8a37700 1 -- 172.21.15.31:0/1859712167 learned_addr learned my addr 172.21.15.31:0/1859712167 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.526+0000 7f29b9238700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f29b41407d0 0x7f29b415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.526+0000 7f29b3fff700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f29b4140360 0x7f29b415c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.527+0000 7f29b8a37700 1 -- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f29b41407d0 msgr2=0x7f29b415cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.527+0000 7f29b8a37700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f29b41407d0 0x7f29b415cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.527+0000 7f29b8a37700 1 -- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f29b4140360 msgr2=0x7f29b415c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.527+0000 7f29b8a37700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f29b4140360 0x7f29b415c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.527+0000 7f29b8a37700 1 -- 172.21.15.31:0/1859712167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4155840 con 0x7f29b413eac0 2023-10-09T06:25:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.527+0000 7f29b8a37700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29b413eac0 0x7f29b4156600 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f29a4006ac0 tx=0x7f29a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.527+0000 7f29b0ff9700 1 -- 172.21.15.31:0/1859712167 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400f940 con 0x7f29b413eac0 2023-10-09T06:25:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.527+0000 7f29b0ff9700 1 -- 172.21.15.31:0/1859712167 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a400faa0 con 0x7f29b413eac0 2023-10-09T06:25:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.527+0000 7f29bac9b700 1 -- 172.21.15.31:0/1859712167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b4155b20 con 0x7f29b413eac0 2023-10-09T06:25:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.527+0000 7f29b0ff9700 1 -- 172.21.15.31:0/1859712167 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400fe20 con 0x7f29b413eac0 2023-10-09T06:25:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.527+0000 7f29bac9b700 1 -- 172.21.15.31:0/1859712167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b413ee90 con 0x7f29b413eac0 2023-10-09T06:25:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.528+0000 7f29bac9b700 1 -- 172.21.15.31:0/1859712167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b4156450 con 0x7f29b413eac0 2023-10-09T06:25:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.528+0000 7f29b0ff9700 1 -- 172.21.15.31:0/1859712167 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29a4014650 con 0x7f29b413eac0 2023-10-09T06:25:42.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.529+0000 7f29b0ff9700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f29a0066f30 0x7f29a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.529+0000 7f29b0ff9700 1 -- 172.21.15.31:0/1859712167 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f29a4018030 con 0x7f29b413eac0 2023-10-09T06:25:42.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.529+0000 7f29b3fff700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f29a0066f30 0x7f29a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.530+0000 7f29b3fff700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f29a0066f30 0x7f29a00693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f29b40b4a80 tx=0x7f29a8001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:42.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.533+0000 7f29b0ff9700 1 -- 172.21.15.31:0/1859712167 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29a4052150 con 0x7f29b413eac0 2023-10-09T06:25:42.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.772+0000 7f29bac9b700 1 -- 172.21.15.31:0/1859712167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29b4155fc0 con 0x7f29b413eac0 2023-10-09T06:25:42.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.772+0000 7f29b0ff9700 1 -- 172.21.15.31:0/1859712167 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f29a4022090 con 0x7f29b413eac0 2023-10-09T06:25:42.773 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:42.773 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":44,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2895057012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2895057012},{"type":"v1","addr":"172.21.15.158:6836","nonce":2895057012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5707,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/756230701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":756230701},{"type":"v1","addr":"172.21.15.158:6837","nonce":756230701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5961,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2803435352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2803435352},{"type":"v1","addr":"172.21.15.31:6834","nonce":2803435352}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2026795070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2026795070},{"type":"v1","addr":"172.21.15.31:6835","nonce":2026795070}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[]} 2023-10-09T06:25:42.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.774+0000 7f29bac9b700 1 -- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f29a0066f30 msgr2=0x7f29a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.774+0000 7f29bac9b700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f29a0066f30 0x7f29a00693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f29b40b4a80 tx=0x7f29a8001e90 comp rx=0 tx=0).stop 2023-10-09T06:25:42.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.774+0000 7f29bac9b700 1 -- 172.21.15.31:0/1859712167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29b413eac0 msgr2=0x7f29b4156600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.774+0000 7f29bac9b700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29b413eac0 0x7f29b4156600 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f29a4006ac0 tx=0x7f29a40091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.774+0000 7f29bac9b700 1 -- 172.21.15.31:0/1859712167 shutdown_connections 2023-10-09T06:25:42.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.774+0000 7f29bac9b700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f29a0066f30 0x7f29a00693e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.774+0000 7f29bac9b700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f29b41407d0 0x7f29b415cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.774+0000 7f29bac9b700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29b413eac0 0x7f29b4156600 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.774+0000 7f29bac9b700 1 --2- 172.21.15.31:0/1859712167 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f29b4140360 0x7f29b415c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.774+0000 7f29bac9b700 1 -- 172.21.15.31:0/1859712167 >> 172.21.15.31:0/1859712167 conn(0x7f29b4069870 msgr2=0x7f29b4159090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:42.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.774+0000 7f29bac9b700 1 -- 172.21.15.31:0/1859712167 shutdown_connections 2023-10-09T06:25:42.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.774+0000 7f29bac9b700 1 -- 172.21.15.31:0/1859712167 wait complete. 2023-10-09T06:25:42.776 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 44 2023-10-09T06:25:42.787 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:25:42.787 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:25:42.787 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:25:42.788 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:25:42.788 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:25:42.788 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:25:42.788 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:25:42.788 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:25:42.788 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:25:42.788 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:25:42.789 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:25:42.789 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:25:42.789 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:25:42.789 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:25:42.789 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:25:42.789 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:25:42.798 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:25:42.798 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:25:42.799 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:25:42.800 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:25:42.801 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:25:42.801 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:25:42.801 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:25:42.802 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:25:42.845 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:25:42.846 DEBUG:teuthology.parallel:result is None 2023-10-09T06:25:42.847 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:25:42.847 DEBUG:teuthology.parallel:result is None 2023-10-09T06:25:42.849 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:25:42.849 DEBUG:teuthology.parallel:result is None 2023-10-09T06:25:42.849 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:25:42.849 DEBUG:teuthology.parallel:result is None 2023-10-09T06:25:42.850 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:25:42.921 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:25:42.921 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-10-09T06:25:42.928 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-09T06:25:42.928 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:25:42.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.976+0000 7f6fe6ac2700 1 Processor -- start 2023-10-09T06:25:42.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.976+0000 7f6fe6ac2700 1 -- start start 2023-10-09T06:25:42.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.977+0000 7f6fe6ac2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6fe006a280 0x7f6fe0067900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.977+0000 7f6fe6ac2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe006a650 0x7f6fe00afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.977+0000 7f6fe6ac2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe00cca00 con 0x7f6fe00affd0 2023-10-09T06:25:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.977+0000 7f6fe6ac2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe006aaa0 con 0x7f6fe006a280 2023-10-09T06:25:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.977+0000 7f6fe6ac2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0157f70 con 0x7f6fe006a650 2023-10-09T06:25:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.977+0000 7f6fe5ac0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6fe006a280 0x7f6fe0067900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.977+0000 7f6fe62c1700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f6fe00affd0 0x7f6fe0150b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:50224/0 (socket says 172.21.15.31:50224) 2023-10-09T06:25:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.977+0000 7f6fe62c1700 1 -- 172.21.15.31:0/1880338611 learned_addr learned my addr 172.21.15.31:0/1880338611 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.977+0000 7f6fe52bf700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe006a650 0x7f6fe00afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.978+0000 7f6fe4abe700 1 -- 172.21.15.31:0/1880338611 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903311384 0 0) 0x7f6fd8001490 con 0x7f6fe00affd0 2023-10-09T06:25:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.978+0000 7f6fe4abe700 1 -- 172.21.15.31:0/1880338611 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fcc003570 con 0x7f6fe00affd0 2023-10-09T06:25:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.978+0000 7f6fe5ac0700 1 -- 172.21.15.31:0/1880338611 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe006a650 msgr2=0x7f6fe00afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.978+0000 7f6fe5ac0700 1 --2- 172.21.15.31:0/1880338611 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe006a650 0x7f6fe00afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.978+0000 7f6fe5ac0700 1 -- 172.21.15.31:0/1880338611 >> v1:172.21.15.158:6789/0 conn(0x7f6fe00affd0 legacy=0x7f6fe0150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.978+0000 7f6fe5ac0700 1 -- 172.21.15.31:0/1880338611 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0157360 con 0x7f6fe006a280 2023-10-09T06:25:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.978+0000 7f6fe52bf700 1 --2- 172.21.15.31:0/1880338611 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe006a650 0x7f6fe00afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:25:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.978+0000 7f6fe5ac0700 1 --2- 172.21.15.31:0/1880338611 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe006a280 0x7f6fe0067900 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0098e0 tx=0x7f6fdc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb53287b53c44740 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.978+0000 7f6fe4abe700 1 -- 172.21.15.31:0/1880338611 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc011630 con 0x7f6fe006a280 2023-10-09T06:25:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.978+0000 7f6fe4abe700 1 -- 172.21.15.31:0/1880338611 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc011790 con 0x7f6fe006a280 2023-10-09T06:25:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.978+0000 7f6fe4abe700 1 -- 172.21.15.31:0/1880338611 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc011b10 con 0x7f6fe006a280 2023-10-09T06:25:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.979+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/1880338611 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe006a280 msgr2=0x7f6fe0067900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.979+0000 7f6fe6ac2700 1 --2- 172.21.15.31:0/1880338611 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe006a280 0x7f6fe0067900 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0098e0 tx=0x7f6fdc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.979+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/1880338611 shutdown_connections 2023-10-09T06:25:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.979+0000 7f6fe6ac2700 1 --2- 172.21.15.31:0/1880338611 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe006a280 0x7f6fe0067900 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.979+0000 7f6fe6ac2700 1 --2- 172.21.15.31:0/1880338611 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe006a650 0x7f6fe00afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.979+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/1880338611 >> 172.21.15.31:0/1880338611 conn(0x7f6fe00cd890 msgr2=0x7f6fe00cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:42.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.979+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/1880338611 shutdown_connections 2023-10-09T06:25:42.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.979+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/1880338611 wait complete. 2023-10-09T06:25:42.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.980+0000 7f6fe6ac2700 1 Processor -- start 2023-10-09T06:25:42.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.980+0000 7f6fe6ac2700 1 -- start start 2023-10-09T06:25:42.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe6ac2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe006a280 0x7f6fe015b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe6ac2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe006a650 0x7f6fe016a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe6ac2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe00affd0 0x7f6fe016b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe6ac2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe016a570 con 0x7f6fe006a650 2023-10-09T06:25:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe6ac2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00b0940 con 0x7f6fe00affd0 2023-10-09T06:25:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe6ac2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe016aff0 con 0x7f6fe006a280 2023-10-09T06:25:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe52bf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe006a650 0x7f6fe016a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe52bf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe006a650 0x7f6fe016a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58482/0 (socket says 172.21.15.31:58482) 2023-10-09T06:25:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe52bf700 1 -- 172.21.15.31:0/381279412 learned_addr learned my addr 172.21.15.31:0/381279412 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe62c1700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe00affd0 0x7f6fe016b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe5ac0700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe006a280 0x7f6fe015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe52bf700 1 -- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe006a280 msgr2=0x7f6fe015b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe52bf700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe006a280 0x7f6fe015b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe52bf700 1 -- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe00affd0 msgr2=0x7f6fe016b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:42.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe52bf700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe00affd0 0x7f6fe016b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:42.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe52bf700 1 -- 172.21.15.31:0/381279412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd0009420 con 0x7f6fe006a650 2023-10-09T06:25:42.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe62c1700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe00affd0 0x7f6fe016b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:42.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe5ac0700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe006a280 0x7f6fe015b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:42.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe52bf700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe006a650 0x7f6fe016a030 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000ec80 tx=0x7f6fd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:42.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fd5ffb700 1 -- 172.21.15.31:0/381279412 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000c9d0 con 0x7f6fe006a650 2023-10-09T06:25:42.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fd5ffb700 1 -- 172.21.15.31:0/381279412 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd000cb30 con 0x7f6fe006a650 2023-10-09T06:25:42.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/381279412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fdc009420 con 0x7f6fe006a650 2023-10-09T06:25:42.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.981+0000 7f6fd5ffb700 1 -- 172.21.15.31:0/381279412 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000ceb0 con 0x7f6fe006a650 2023-10-09T06:25:42.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.982+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/381279412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe016aa30 con 0x7f6fe006a650 2023-10-09T06:25:42.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.982+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/381279412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe00b0ab0 con 0x7f6fe006a650 2023-10-09T06:25:42.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.983+0000 7f6fd5ffb700 1 -- 172.21.15.31:0/381279412 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fd0013680 con 0x7f6fe006a650 2023-10-09T06:25:42.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.983+0000 7f6fd5ffb700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6fc4066f30 0x7f6fc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:42.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.983+0000 7f6fd5ffb700 1 -- 172.21.15.31:0/381279412 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6fd0084680 con 0x7f6fe006a650 2023-10-09T06:25:42.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.984+0000 7f6fe5ac0700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6fc4066f30 0x7f6fc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:42.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.984+0000 7f6fe5ac0700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6fc4066f30 0x7f6fc40693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0098e0 tx=0x7f6fdc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:42.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:42.988+0000 7f6fd5ffb700 1 -- 172.21.15.31:0/381279412 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fd0051bf0 con 0x7f6fe006a650 2023-10-09T06:25:43.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:43.196+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/381279412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6fe0157640 con 0x7f6fe006a650 2023-10-09T06:25:44.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.329+0000 7f6fd5ffb700 1 -- 172.21.15.31:0/381279412 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v97) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6fd0055210 con 0x7f6fe006a650 2023-10-09T06:25:44.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.332+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6fc4066f30 msgr2=0x7f6fc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:44.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.332+0000 7f6fe6ac2700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6fc4066f30 0x7f6fc40693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0098e0 tx=0x7f6fdc017000 comp rx=0 tx=0).stop 2023-10-09T06:25:44.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.332+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/381279412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe006a650 msgr2=0x7f6fe016a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:44.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.332+0000 7f6fe6ac2700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe006a650 0x7f6fe016a030 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000ec80 tx=0x7f6fd00091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.332+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/381279412 shutdown_connections 2023-10-09T06:25:44.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.332+0000 7f6fe6ac2700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6fc4066f30 0x7f6fc40693e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.332+0000 7f6fe6ac2700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6fe006a280 0x7f6fe015b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.332+0000 7f6fe6ac2700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fe00affd0 0x7f6fe016b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.332+0000 7f6fe6ac2700 1 --2- 172.21.15.31:0/381279412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe006a650 0x7f6fe016a030 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.332+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/381279412 >> 172.21.15.31:0/381279412 conn(0x7f6fe00cd890 msgr2=0x7f6fe0156370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.332+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/381279412 shutdown_connections 2023-10-09T06:25:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.332+0000 7f6fe6ac2700 1 -- 172.21.15.31:0/381279412 wait complete. 2023-10-09T06:25:44.334 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2023-10-09T06:25:44.348 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:25:44.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.474+0000 7fb129a5a700 1 Processor -- start 2023-10-09T06:25:44.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.474+0000 7fb129a5a700 1 -- start start 2023-10-09T06:25:44.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.474+0000 7fb129a5a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1240c9310 0x7fb124158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb129a5a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1241594f0 con 0x7fb124069f80 2023-10-09T06:25:44.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb129a5a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12406be10 con 0x7fb1241580b0 2023-10-09T06:25:44.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb129a5a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12406c0f0 con 0x7fb1240c9310 2023-10-09T06:25:44.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb1227fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb124069f80 0x7fb1241579a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46540/0 (socket says 172.21.15.31:46540) 2023-10-09T06:25:44.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb1227fc700 1 -- 172.21.15.31:0/1878299763 learned_addr learned my addr 172.21.15.31:0/1878299763 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:44.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb122ffd700 1 --2- 172.21.15.31:0/1878299763 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1240c9310 0x7fb124158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb121ffb700 1 -- 172.21.15.31:0/1878299763 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243919522 0 0) 0x7fb1241594f0 con 0x7fb124069f80 2023-10-09T06:25:44.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb121ffb700 1 -- 172.21.15.31:0/1878299763 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb10c003570 con 0x7fb124069f80 2023-10-09T06:25:44.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb121ffb700 1 -- 172.21.15.31:0/1878299763 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415222939 0 0) 0x7fb12406be10 con 0x7fb1241580b0 2023-10-09T06:25:44.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb121ffb700 1 -- 172.21.15.31:0/1878299763 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1241594f0 con 0x7fb1241580b0 2023-10-09T06:25:44.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb121ffb700 1 -- 172.21.15.31:0/1878299763 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 827525731 0 0) 0x7fb10c003570 con 0x7fb124069f80 2023-10-09T06:25:44.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb122ffd700 1 -- 172.21.15.31:0/1878299763 >> v1:172.21.15.158:6789/0 conn(0x7fb1241580b0 legacy=0x7fb1240ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:44.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb122ffd700 1 -- 172.21.15.31:0/1878299763 >> v1:172.21.15.31:6789/0 conn(0x7fb124069f80 legacy=0x7fb1241579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:44.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb122ffd700 1 -- 172.21.15.31:0/1878299763 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12406c3d0 con 0x7fb1240c9310 2023-10-09T06:25:44.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.475+0000 7fb122ffd700 1 --2- 172.21.15.31:0/1878299763 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1240c9310 0x7fb124158fb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb114009910 tx=0x7fb1140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce87b82aa67c601f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:44.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.476+0000 7fb121ffb700 1 -- 172.21.15.31:0/1878299763 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb118001470 con 0x7fb1240c9310 2023-10-09T06:25:44.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.476+0000 7fb121ffb700 1 -- 172.21.15.31:0/1878299763 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb114011420 con 0x7fb1240c9310 2023-10-09T06:25:44.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.476+0000 7fb121ffb700 1 -- 172.21.15.31:0/1878299763 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1140117c0 con 0x7fb1240c9310 2023-10-09T06:25:44.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.476+0000 7fb129a5a700 1 -- 172.21.15.31:0/1878299763 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1240c9310 msgr2=0x7fb124158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:44.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.476+0000 7fb129a5a700 1 --2- 172.21.15.31:0/1878299763 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1240c9310 0x7fb124158fb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb114009910 tx=0x7fb1140091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.476+0000 7fb129a5a700 1 -- 172.21.15.31:0/1878299763 shutdown_connections 2023-10-09T06:25:44.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.476+0000 7fb129a5a700 1 --2- 172.21.15.31:0/1878299763 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb1240c9310 0x7fb124158fb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.476+0000 7fb129a5a700 1 -- 172.21.15.31:0/1878299763 >> 172.21.15.31:0/1878299763 conn(0x7fb12406fe50 msgr2=0x7fb124069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:44.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.476+0000 7fb129a5a700 1 -- 172.21.15.31:0/1878299763 shutdown_connections 2023-10-09T06:25:44.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.476+0000 7fb129a5a700 1 -- 172.21.15.31:0/1878299763 wait complete. 2023-10-09T06:25:44.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.477+0000 7fb129a5a700 1 Processor -- start 2023-10-09T06:25:44.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.478+0000 7fb129a5a700 1 -- start start 2023-10-09T06:25:44.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.478+0000 7fb129a5a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb124069f80 0x7fb124168450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.478+0000 7fb129a5a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1240c9310 0x7fb1240c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.478+0000 7fb129a5a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1241580b0 0x7fb1240c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.478+0000 7fb129a5a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1240c65c0 con 0x7fb1241580b0 2023-10-09T06:25:44.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.478+0000 7fb129a5a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12415ebd0 con 0x7fb1240c9310 2023-10-09T06:25:44.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.478+0000 7fb129a5a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1240c74d0 con 0x7fb124069f80 2023-10-09T06:25:44.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.478+0000 7fb1237fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1241580b0 0x7fb1240c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.478+0000 7fb1237fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1241580b0 0x7fb1240c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58488/0 (socket says 172.21.15.31:58488) 2023-10-09T06:25:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.478+0000 7fb1237fe700 1 -- 172.21.15.31:0/47234002 learned_addr learned my addr 172.21.15.31:0/47234002 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.478+0000 7fb122ffd700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb124069f80 0x7fb124168450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.478+0000 7fb1227fc700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1240c9310 0x7fb1240c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.479+0000 7fb1237fe700 1 -- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb124069f80 msgr2=0x7fb124168450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.479+0000 7fb1237fe700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb124069f80 0x7fb124168450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.479+0000 7fb1237fe700 1 -- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1240c9310 msgr2=0x7fb1240c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.479+0000 7fb1237fe700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1240c9310 0x7fb1240c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.479+0000 7fb1237fe700 1 -- 172.21.15.31:0/47234002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb114009420 con 0x7fb1241580b0 2023-10-09T06:25:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.479+0000 7fb1237fe700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1241580b0 0x7fb1240c6f90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00c860 tx=0x7fb11c002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.479+0000 7fb10affd700 1 -- 172.21.15.31:0/47234002 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c002030 con 0x7fb1241580b0 2023-10-09T06:25:44.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.479+0000 7fb10affd700 1 -- 172.21.15.31:0/47234002 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c0021b0 con 0x7fb1241580b0 2023-10-09T06:25:44.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.479+0000 7fb10affd700 1 -- 172.21.15.31:0/47234002 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c012630 con 0x7fb1241580b0 2023-10-09T06:25:44.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.479+0000 7fb129a5a700 1 -- 172.21.15.31:0/47234002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1240c5cb0 con 0x7fb1241580b0 2023-10-09T06:25:44.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.479+0000 7fb129a5a700 1 -- 172.21.15.31:0/47234002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1240c6250 con 0x7fb1241580b0 2023-10-09T06:25:44.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.480+0000 7fb129a5a700 1 -- 172.21.15.31:0/47234002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12404c3c0 con 0x7fb1241580b0 2023-10-09T06:25:44.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.480+0000 7fb10affd700 1 -- 172.21.15.31:0/47234002 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb11c012a20 con 0x7fb1241580b0 2023-10-09T06:25:44.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.481+0000 7fb10affd700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb110066f30 0x7fb1100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.481+0000 7fb10affd700 1 -- 172.21.15.31:0/47234002 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb11c084120 con 0x7fb1241580b0 2023-10-09T06:25:44.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.481+0000 7fb122ffd700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb110066f30 0x7fb1100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.482+0000 7fb122ffd700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb110066f30 0x7fb1100693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb1140091e0 tx=0x7fb114016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:44.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.485+0000 7fb10affd700 1 -- 172.21.15.31:0/47234002 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb11c0516e0 con 0x7fb1241580b0 2023-10-09T06:25:44.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.756+0000 7fb129a5a700 1 -- 172.21.15.31:0/47234002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb12406c6b0 con 0x7fb1241580b0 2023-10-09T06:25:44.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.757+0000 7fb10affd700 1 -- 172.21.15.31:0/47234002 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb11c054d00 con 0x7fb1241580b0 2023-10-09T06:25:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:44.758 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:25:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2023-10-09T06:25:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2023-10-09T06:25:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl/nWKAxAA1kcqjt4lPGPkmDivDpIVjQ==", 2023-10-09T06:25:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:25:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:25:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:25:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2023-10-09T06:25:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl9xYEDxAAQJeaqz7lkrArv45vLGb34g==", 2023-10-09T06:25:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:25:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:25:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:25:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2023-10-09T06:25:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlJOp0ChAADGiI4SX7ZLvDrtjDtU905A==", 2023-10-09T06:25:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:25:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:25:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:25:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2023-10-09T06:25:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlbnnJFRAAO+XoxRQDaHv0ZicyggniLQ==", 2023-10-09T06:25:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:25:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:25:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:25:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2023-10-09T06:25:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNloyZ+LxAApAHpPxV7R1OVE2wlIaU+PA==", 2023-10-09T06:25:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:25:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:25:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2023-10-09T06:25:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNlvHeUNhAAXblIEmmsc5eTo5VcZVirfA==", 2023-10-09T06:25:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:25:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:25:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2023-10-09T06:25:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlxfIaBBAAE8WbXh4Q4SxaW2k7MkSTHg==", 2023-10-09T06:25:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:25:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:25:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2023-10-09T06:25:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlUtX3DRAA5NEq+lFMzqhu1GF1ZWT2ag==", 2023-10-09T06:25:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:25:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:25:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2023-10-09T06:25:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlcWc5IBAA5e62AwhIuHdw4dTjnNS8hQ==", 2023-10-09T06:25:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:25:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:25:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2023-10-09T06:25:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlX5S6JhAAzvzO2YEqEtq2fJ3FW9Fddg==", 2023-10-09T06:25:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:25:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:25:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2023-10-09T06:25:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl9jy5LxAAxgMslSN6ayxB2MFRf2dwNQ==", 2023-10-09T06:25:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:25:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:25:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2023-10-09T06:25:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl8M+TOBAARhk2wEaXO9Pi4TP9d+L5Gg==", 2023-10-09T06:25:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:25:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:25:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2023-10-09T06:25:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlfsC2GRAAlm37QI8DkNclcBpD5ZBR7A==", 2023-10-09T06:25:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:25:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2023-10-09T06:25:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T06:25:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2023-10-09T06:25:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlapIxIhAAiBZUkpnf6tyFHwySGKhRpQ==", 2023-10-09T06:25:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:25:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:25:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:25:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:25:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEZYuHxAA7WEH0vXmAEH5Wki8ESrDBg==", 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlFvuIJxAAGuTp4gsXrvUzDd1B7d5vcg==", 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:25:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:25:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:25:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:25:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2023-10-09T06:25:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlS8AlJBAAg8lLRVasKHyhbFlOTfgt9g==", 2023-10-09T06:25:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:25:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:25:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:25:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2023-10-09T06:25:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEE9eABAAHbJ1yvlmOUNo6n2uAhPrnw==", 2023-10-09T06:25:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:25:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:25:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:25:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2023-10-09T06:25:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlhol5OBAAZSZ+PbojVwsOJtLlTl6wAA==", 2023-10-09T06:25:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:25:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:25:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:25:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:25:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:25:44.772 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:25:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.759+0000 7fb129a5a700 1 -- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb110066f30 msgr2=0x7fb1100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.759+0000 7fb129a5a700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb110066f30 0x7fb1100693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb1140091e0 tx=0x7fb114016000 comp rx=0 tx=0).stop 2023-10-09T06:25:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.759+0000 7fb129a5a700 1 -- 172.21.15.31:0/47234002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1241580b0 msgr2=0x7fb1240c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.759+0000 7fb129a5a700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1241580b0 0x7fb1240c6f90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00c860 tx=0x7fb11c002700 comp rx=0 tx=0).stop 2023-10-09T06:25:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.759+0000 7fb129a5a700 1 -- 172.21.15.31:0/47234002 shutdown_connections 2023-10-09T06:25:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.759+0000 7fb129a5a700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb110066f30 0x7fb1100693e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.759+0000 7fb129a5a700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb124069f80 0x7fb124168450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.759+0000 7fb129a5a700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1241580b0 0x7fb1240c6f90 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.759+0000 7fb129a5a700 1 --2- 172.21.15.31:0/47234002 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb1240c9310 0x7fb1240c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.759+0000 7fb129a5a700 1 -- 172.21.15.31:0/47234002 >> 172.21.15.31:0/47234002 conn(0x7fb12406fe50 msgr2=0x7fb1240ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.759+0000 7fb129a5a700 1 -- 172.21.15.31:0/47234002 shutdown_connections 2023-10-09T06:25:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.759+0000 7fb129a5a700 1 -- 172.21.15.31:0/47234002 wait complete. 2023-10-09T06:25:44.776 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:25:44.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.895+0000 7f17d5bab700 1 Processor -- start 2023-10-09T06:25:44.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.895+0000 7f17d5bab700 1 -- start start 2023-10-09T06:25:44.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.895+0000 7f17d5bab700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d00b0e50 0x7f17d00c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.895+0000 7f17d5bab700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f17d00cb4f0 0x7f17d00cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.895+0000 7f17d5bab700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d015de60 con 0x7f17d00b1220 2023-10-09T06:25:44.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.895+0000 7f17d5bab700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d00cbed0 con 0x7f17d00cb4f0 2023-10-09T06:25:44.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.895+0000 7f17d5bab700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d015e140 con 0x7f17d00b0e50 2023-10-09T06:25:44.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ceffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f17d00b1220 0x7f17d006d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46546/0 (socket says 172.21.15.31:46546) 2023-10-09T06:25:44.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ceffd700 1 -- 172.21.15.31:0/1455487100 learned_addr learned my addr 172.21.15.31:0/1455487100 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:44.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17cf7fe700 1 --2- 172.21.15.31:0/1455487100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d00b0e50 0x7f17d00c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17cffff700 1 --2- 172.21.15.31:0/1455487100 >> v2:172.21.15.158:3300/0 conn(0x7f17d00cb4f0 0x7f17d00cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895081632 0 0) 0x7f17d015de60 con 0x7f17d00b1220 2023-10-09T06:25:44.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17b8003570 con 0x7f17d00b1220 2023-10-09T06:25:44.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1659153872 0 0) 0x7f17b8003570 con 0x7f17d00b1220 2023-10-09T06:25:44.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d00b0e50 msgr2=0x7f17d00c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:44.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 --2- 172.21.15.31:0/1455487100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d00b0e50 0x7f17d00c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 >> v2:172.21.15.158:3300/0 conn(0x7f17d00cb4f0 msgr2=0x7f17d00cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:44.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 --2- 172.21.15.31:0/1455487100 >> v2:172.21.15.158:3300/0 conn(0x7f17d00cb4f0 0x7f17d00cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d015e420 con 0x7f17d00b1220 2023-10-09T06:25:44.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f17c4001470 con 0x7f17d00b1220 2023-10-09T06:25:44.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17cf7fe700 1 --2- 172.21.15.31:0/1455487100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d00b0e50 0x7f17d00c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:25:44.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17cffff700 1 --2- 172.21.15.31:0/1455487100 >> v2:172.21.15.158:3300/0 conn(0x7f17d00cb4f0 0x7f17d00cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:25:44.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 >> v1:172.21.15.31:6789/0 conn(0x7f17d00b1220 legacy=0x7f17d006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:44.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 --2- 172.21.15.31:0/1455487100 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17b8003a60 0x7f17b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 --2- 172.21.15.31:0/1455487100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d00b0e50 0x7f17b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 --2- 172.21.15.31:0/1455487100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b8004d50 0x7f17b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d00cbed0 con 0x7f17b8004d50 2023-10-09T06:25:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d015e140 con 0x7f17b8003a60 2023-10-09T06:25:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b800ba90 con 0x7f17d00b0e50 2023-10-09T06:25:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17cffff700 1 --2- 172.21.15.31:0/1455487100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b8004d50 0x7f17b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17cf7fe700 1 --2- 172.21.15.31:0/1455487100 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17b8003a60 0x7f17b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.896+0000 7f17ceffd700 1 --2- 172.21.15.31:0/1455487100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d00b0e50 0x7f17b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17cffff700 1 -- 172.21.15.31:0/1455487100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d00b0e50 msgr2=0x7f17b8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17cffff700 1 --2- 172.21.15.31:0/1455487100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d00b0e50 0x7f17b8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17cffff700 1 -- 172.21.15.31:0/1455487100 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17b8003a60 msgr2=0x7f17b8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17cffff700 1 --2- 172.21.15.31:0/1455487100 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17b8003a60 0x7f17b8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17cffff700 1 -- 172.21.15.31:0/1455487100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0009420 con 0x7f17b8004d50 2023-10-09T06:25:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17cffff700 1 --2- 172.21.15.31:0/1455487100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b8004d50 0x7f17b80051c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f17c800e3c0 tx=0x7f17c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e1de72f62209c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c800ec70 con 0x7f17b8004d50 2023-10-09T06:25:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c800f040 con 0x7f17b8004d50 2023-10-09T06:25:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17ce7fc700 1 -- 172.21.15.31:0/1455487100 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8014480 con 0x7f17b8004d50 2023-10-09T06:25:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17d5bab700 1 -- 172.21.15.31:0/1455487100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b8004d50 msgr2=0x7f17b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17d5bab700 1 --2- 172.21.15.31:0/1455487100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b8004d50 0x7f17b80051c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f17c800e3c0 tx=0x7f17c800b040 comp rx=0 tx=0).stop 2023-10-09T06:25:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17cffff700 1 -- 172.21.15.31:0/1455487100 reap_dead start 2023-10-09T06:25:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17d5bab700 1 -- 172.21.15.31:0/1455487100 shutdown_connections 2023-10-09T06:25:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17d5bab700 1 -- 172.21.15.31:0/1455487100 >> 172.21.15.31:0/1455487100 conn(0x7f17d0069870 msgr2=0x7f17d0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17d5bab700 1 -- 172.21.15.31:0/1455487100 shutdown_connections 2023-10-09T06:25:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.897+0000 7f17d5bab700 1 -- 172.21.15.31:0/1455487100 wait complete. 2023-10-09T06:25:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.899+0000 7f17d5bab700 1 Processor -- start 2023-10-09T06:25:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.899+0000 7f17d5bab700 1 -- start start 2023-10-09T06:25:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.899+0000 7f17d5bab700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17b8004d50 0x7f17d015b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.899+0000 7f17d5bab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17d00b4100 0x7f17d01403e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.899+0000 7f17d5bab700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d015fb60 0x7f17d015ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.899+0000 7f17d5bab700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d0160510 con 0x7f17d00b4100 2023-10-09T06:25:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.899+0000 7f17d5bab700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d00b3c70 con 0x7f17b8004d50 2023-10-09T06:25:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.899+0000 7f17d5bab700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d00b3060 con 0x7f17d015fb60 2023-10-09T06:25:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17ceffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17d00b4100 0x7f17d01403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17ceffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17d00b4100 0x7f17d01403e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58500/0 (socket says 172.21.15.31:58500) 2023-10-09T06:25:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17ceffd700 1 -- 172.21.15.31:0/1792195370 learned_addr learned my addr 172.21.15.31:0/1792195370 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17cf7fe700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17b8004d50 0x7f17d015b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17cffff700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d015fb60 0x7f17d015ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17ceffd700 1 -- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d015fb60 msgr2=0x7f17d015ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17ceffd700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d015fb60 0x7f17d015ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17ceffd700 1 -- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17b8004d50 msgr2=0x7f17d015b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17ceffd700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17b8004d50 0x7f17d015b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17ceffd700 1 -- 172.21.15.31:0/1792195370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d00b3340 con 0x7f17d00b4100 2023-10-09T06:25:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17ceffd700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17d00b4100 0x7f17d01403e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f17c4007390 tx=0x7f17c4001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17b77fe700 1 -- 172.21.15.31:0/1792195370 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4018030 con 0x7f17d00b4100 2023-10-09T06:25:44.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17b77fe700 1 -- 172.21.15.31:0/1792195370 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c4000c90 con 0x7f17d00b4100 2023-10-09T06:25:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17d5bab700 1 -- 172.21.15.31:0/1792195370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d00b3620 con 0x7f17d00b4100 2023-10-09T06:25:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17b77fe700 1 -- 172.21.15.31:0/1792195370 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400fb20 con 0x7f17d00b4100 2023-10-09T06:25:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.900+0000 7f17d5bab700 1 -- 172.21.15.31:0/1792195370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d0140920 con 0x7f17d00b4100 2023-10-09T06:25:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.901+0000 7f17d5bab700 1 -- 172.21.15.31:0/1792195370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d00b3de0 con 0x7f17d00b4100 2023-10-09T06:25:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.902+0000 7f17b77fe700 1 -- 172.21.15.31:0/1792195370 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17c401b070 con 0x7f17d00b4100 2023-10-09T06:25:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.902+0000 7f17b77fe700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f17bc066f30 0x7f17bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.902+0000 7f17b77fe700 1 -- 172.21.15.31:0/1792195370 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f17c4019070 con 0x7f17d00b4100 2023-10-09T06:25:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.902+0000 7f17cf7fe700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f17bc066f30 0x7f17bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.903+0000 7f17cf7fe700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f17bc066f30 0x7f17bc0693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f17c0006ed0 tx=0x7f17c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:44.906+0000 7f17b77fe700 1 -- 172.21.15.31:0/1792195370 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17c40b55a0 con 0x7f17d00b4100 2023-10-09T06:25:45.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.099+0000 7f17d5bab700 1 -- 172.21.15.31:0/1792195370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17d00b3f70 con 0x7f17d00b4100 2023-10-09T06:25:45.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.100+0000 7f17b77fe700 1 -- 172.21.15.31:0/1792195370 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+12135 (secure 0 0 0) 0x7f17c40551c0 con 0x7f17d00b4100 2023-10-09T06:25:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:45.101 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":97,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:25:44.322564+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:25:45.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.102+0000 7f17d5bab700 1 -- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f17bc066f30 msgr2=0x7f17bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.102+0000 7f17d5bab700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f17bc066f30 0x7f17bc0693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f17c0006ed0 tx=0x7f17c0008040 comp rx=0 tx=0).stop 2023-10-09T06:25:45.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.102+0000 7f17d5bab700 1 -- 172.21.15.31:0/1792195370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17d00b4100 msgr2=0x7f17d01403e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.102+0000 7f17d5bab700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17d00b4100 0x7f17d01403e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f17c4007390 tx=0x7f17c4001e90 comp rx=0 tx=0).stop 2023-10-09T06:25:45.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.102+0000 7f17d5bab700 1 -- 172.21.15.31:0/1792195370 shutdown_connections 2023-10-09T06:25:45.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.102+0000 7f17d5bab700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f17bc066f30 0x7f17bc0693e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.102+0000 7f17d5bab700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f17d015fb60 0x7f17d015ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.102+0000 7f17d5bab700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17b8004d50 0x7f17d015b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.102+0000 7f17d5bab700 1 --2- 172.21.15.31:0/1792195370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17d00b4100 0x7f17d01403e0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.102+0000 7f17d5bab700 1 -- 172.21.15.31:0/1792195370 >> 172.21.15.31:0/1792195370 conn(0x7f17d0069870 msgr2=0x7f17d01592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:45.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.102+0000 7f17d5bab700 1 -- 172.21.15.31:0/1792195370 shutdown_connections 2023-10-09T06:25:45.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.102+0000 7f17d5bab700 1 -- 172.21.15.31:0/1792195370 wait complete. 2023-10-09T06:25:45.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:25:45.115 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:25:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.236+0000 7f16b1147700 1 Processor -- start 2023-10-09T06:25:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.236+0000 7f16b1147700 1 -- start start 2023-10-09T06:25:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.237+0000 7f16b1147700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f16ac15a290 0x7f16ac06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.237+0000 7f16b1147700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac0b0790 con 0x7f16ac06aae0 2023-10-09T06:25:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.237+0000 7f16b1147700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac06af20 con 0x7f16ac159ec0 2023-10-09T06:25:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.237+0000 7f16b1147700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ac0ce1f0 con 0x7f16ac15a290 2023-10-09T06:25:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.237+0000 7f16ab59e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f16ac06aae0 0x7f16ac0cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46558/0 (socket says 172.21.15.31:46558) 2023-10-09T06:25:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.237+0000 7f16ab59e700 1 -- 172.21.15.31:0/2197943234 learned_addr learned my addr 172.21.15.31:0/2197943234 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:45.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.237+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243012775 0 0) 0x7f16ac0b0790 con 0x7f16ac06aae0 2023-10-09T06:25:45.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.237+0000 7f16aa59c700 1 --2- 172.21.15.31:0/2197943234 >> v2:172.21.15.158:3300/0 conn(0x7f16ac15a290 0x7f16ac06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.237+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1698003570 con 0x7f16ac06aae0 2023-10-09T06:25:45.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1712475767 0 0) 0x7f1698003570 con 0x7f16ac06aae0 2023-10-09T06:25:45.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 >> v2:172.21.15.158:3300/0 conn(0x7f16ac15a290 msgr2=0x7f16ac06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:45.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 --2- 172.21.15.31:0/2197943234 >> v2:172.21.15.158:3300/0 conn(0x7f16ac15a290 0x7f16ac06a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 >> v1:172.21.15.158:6789/0 conn(0x7f16ac159ec0 legacy=0x7f16ac0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0b0b20 con 0x7f16ac06aae0 2023-10-09T06:25:45.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f16a40017f0 con 0x7f16ac06aae0 2023-10-09T06:25:45.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 >> v1:172.21.15.31:6789/0 conn(0x7f16ac06aae0 legacy=0x7f16ac0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 --2- 172.21.15.31:0/2197943234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1698003a60 0x7f1698003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 --2- 172.21.15.31:0/2197943234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1698004810 0x7f1698004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 --2- 172.21.15.31:0/2197943234 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16980051c0 0x7f169800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac0ce1f0 con 0x7f1698004810 2023-10-09T06:25:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169800c160 con 0x7f1698003a60 2023-10-09T06:25:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169800c320 con 0x7f16980051c0 2023-10-09T06:25:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16aa59c700 1 --2- 172.21.15.31:0/2197943234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1698004810 0x7f1698004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16aad9d700 1 --2- 172.21.15.31:0/2197943234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1698003a60 0x7f1698003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16ab59e700 1 --2- 172.21.15.31:0/2197943234 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16980051c0 0x7f169800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16aa59c700 1 -- 172.21.15.31:0/2197943234 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16980051c0 msgr2=0x7f169800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16aa59c700 1 --2- 172.21.15.31:0/2197943234 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16980051c0 0x7f169800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16aa59c700 1 -- 172.21.15.31:0/2197943234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1698003a60 msgr2=0x7f1698003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16aa59c700 1 --2- 172.21.15.31:0/2197943234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1698003a60 0x7f1698003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16aa59c700 1 -- 172.21.15.31:0/2197943234 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1698003570 con 0x7f1698004810 2023-10-09T06:25:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16ab59e700 1 --2- 172.21.15.31:0/2197943234 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16980051c0 0x7f169800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:45.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16ab59e700 1 -- 172.21.15.31:0/2197943234 reap_dead start 2023-10-09T06:25:45.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16aa59c700 1 --2- 172.21.15.31:0/2197943234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1698004810 0x7f1698004c80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1694009c00 tx=0x7f16940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d5731fdf9e1547 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:45.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169400e710 con 0x7f1698004810 2023-10-09T06:25:45.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169400e870 con 0x7f1698004810 2023-10-09T06:25:45.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.238+0000 7f16a9d9b700 1 -- 172.21.15.31:0/2197943234 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169400ec30 con 0x7f1698004810 2023-10-09T06:25:45.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.239+0000 7f16b1147700 1 -- 172.21.15.31:0/2197943234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1698004810 msgr2=0x7f1698004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.239+0000 7f16b1147700 1 --2- 172.21.15.31:0/2197943234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1698004810 0x7f1698004c80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1694009c00 tx=0x7f16940091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.239+0000 7f16b1147700 1 -- 172.21.15.31:0/2197943234 shutdown_connections 2023-10-09T06:25:45.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.239+0000 7f16b1147700 1 --2- 172.21.15.31:0/2197943234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1698004810 0x7f1698004c80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.239+0000 7f16b1147700 1 -- 172.21.15.31:0/2197943234 >> 172.21.15.31:0/2197943234 conn(0x7f16ac0d1880 msgr2=0x7f16ac0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:45.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.239+0000 7f16b1147700 1 -- 172.21.15.31:0/2197943234 shutdown_connections 2023-10-09T06:25:45.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.239+0000 7f16b1147700 1 -- 172.21.15.31:0/2197943234 wait complete. 2023-10-09T06:25:45.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.240+0000 7f16b1147700 1 Processor -- start 2023-10-09T06:25:45.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.240+0000 7f16b1147700 1 -- start start 2023-10-09T06:25:45.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16b1147700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1698004810 0x7f16ac157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16b1147700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16ac15d120 0x7f16ac158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16b1147700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16ac156930 0x7f16ac15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16b1147700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac142300 con 0x7f16ac156930 2023-10-09T06:25:45.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16b1147700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac159160 con 0x7f16ac15d120 2023-10-09T06:25:45.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16b1147700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac15d900 con 0x7f1698004810 2023-10-09T06:25:45.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16ab59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16ac156930 0x7f16ac15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16ab59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16ac156930 0x7f16ac15a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58510/0 (socket says 172.21.15.31:58510) 2023-10-09T06:25:45.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16ab59e700 1 -- 172.21.15.31:0/4207632098 learned_addr learned my addr 172.21.15.31:0/4207632098 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:45.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16aad9d700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1698004810 0x7f16ac157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16aa59c700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16ac15d120 0x7f16ac158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16ab59e700 1 -- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1698004810 msgr2=0x7f16ac157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16ab59e700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1698004810 0x7f16ac157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16ab59e700 1 -- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16ac15d120 msgr2=0x7f16ac158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16ab59e700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16ac15d120 0x7f16ac158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.241+0000 7f16ab59e700 1 -- 172.21.15.31:0/4207632098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0b3c80 con 0x7f16ac156930 2023-10-09T06:25:45.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.242+0000 7f16ab59e700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16ac156930 0x7f16ac15a660 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f16ac06b5b0 tx=0x7f16a40017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:45.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.242+0000 7f16a2ffd700 1 -- 172.21.15.31:0/4207632098 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4017070 con 0x7f16ac156930 2023-10-09T06:25:45.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.242+0000 7f16a2ffd700 1 -- 172.21.15.31:0/4207632098 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a400ec30 con 0x7f16ac156930 2023-10-09T06:25:45.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.242+0000 7f16b1147700 1 -- 172.21.15.31:0/4207632098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ac15d620 con 0x7f16ac156930 2023-10-09T06:25:45.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.242+0000 7f16a2ffd700 1 -- 172.21.15.31:0/4207632098 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4013420 con 0x7f16ac156930 2023-10-09T06:25:45.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.242+0000 7f16b1147700 1 -- 172.21.15.31:0/4207632098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ac0b4200 con 0x7f16ac156930 2023-10-09T06:25:45.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.243+0000 7f16b1147700 1 -- 172.21.15.31:0/4207632098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ac0b4420 con 0x7f16ac156930 2023-10-09T06:25:45.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.243+0000 7f16a2ffd700 1 -- 172.21.15.31:0/4207632098 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16a4013790 con 0x7f16ac156930 2023-10-09T06:25:45.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.243+0000 7f16a2ffd700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f168c066f30 0x7f168c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.243+0000 7f16a2ffd700 1 -- 172.21.15.31:0/4207632098 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f16a4084050 con 0x7f16ac156930 2023-10-09T06:25:45.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.244+0000 7f16aad9d700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f168c066f30 0x7f168c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.244+0000 7f16aad9d700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f168c066f30 0x7f168c0693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f169c000c00 tx=0x7f169c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:45.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.248+0000 7f16a2ffd700 1 -- 172.21.15.31:0/4207632098 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16a40516d0 con 0x7f16ac156930 2023-10-09T06:25:45.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.442+0000 7f16b1147700 1 -- 172.21.15.31:0/4207632098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16ac04c3c0 con 0x7f16ac156930 2023-10-09T06:25:45.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.442+0000 7f16a2ffd700 1 -- 172.21.15.31:0/4207632098 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16a4054cf0 con 0x7f16ac156930 2023-10-09T06:25:45.443 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:25:45.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.444+0000 7f16b1147700 1 -- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f168c066f30 msgr2=0x7f168c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.444+0000 7f16b1147700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f168c066f30 0x7f168c0693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f169c000c00 tx=0x7f169c007d30 comp rx=0 tx=0).stop 2023-10-09T06:25:45.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.444+0000 7f16b1147700 1 -- 172.21.15.31:0/4207632098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16ac156930 msgr2=0x7f16ac15a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.444+0000 7f16b1147700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16ac156930 0x7f16ac15a660 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f16ac06b5b0 tx=0x7f16a40017f0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.444+0000 7f16b1147700 1 -- 172.21.15.31:0/4207632098 shutdown_connections 2023-10-09T06:25:45.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.444+0000 7f16b1147700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f168c066f30 0x7f168c0693e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.444+0000 7f16b1147700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1698004810 0x7f16ac157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.444+0000 7f16b1147700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16ac156930 0x7f16ac15a660 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.444+0000 7f16b1147700 1 --2- 172.21.15.31:0/4207632098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16ac15d120 0x7f16ac158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.444+0000 7f16b1147700 1 -- 172.21.15.31:0/4207632098 >> 172.21.15.31:0/4207632098 conn(0x7f16ac0d1880 msgr2=0x7f16ac0c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:45.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.444+0000 7f16b1147700 1 -- 172.21.15.31:0/4207632098 shutdown_connections 2023-10-09T06:25:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.444+0000 7f16b1147700 1 -- 172.21.15.31:0/4207632098 wait complete. 2023-10-09T06:25:45.457 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:25:45.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.576+0000 7fb8a21e1700 1 Processor -- start 2023-10-09T06:25:45.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.576+0000 7fb8a21e1700 1 -- start start 2023-10-09T06:25:45.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb8a21e1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb89c15a2b0 0x7fb89c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb8a21e1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb89c0cfe20 0x7fb89c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb8a21e1700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89c0c5d80 con 0x7fb89c0d1c30 2023-10-09T06:25:45.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb8a21e1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89c068470 con 0x7fb89c15a2b0 2023-10-09T06:25:45.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb8a21e1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89c0c6060 con 0x7fb89c0cfe20 2023-10-09T06:25:45.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb89b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb89c15a2b0 0x7fb89c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb89b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb89c15a2b0 0x7fb89c0b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58526/0 (socket says 172.21.15.31:58526) 2023-10-09T06:25:45.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb89b7fe700 1 -- 172.21.15.31:0/998970079 learned_addr learned my addr 172.21.15.31:0/998970079 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:45.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb89bfff700 1 --2- 172.21.15.31:0/998970079 >> v2:172.21.15.158:3300/0 conn(0x7fb89c0cfe20 0x7fb89c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb89b7fe700 1 -- 172.21.15.31:0/998970079 >> v2:172.21.15.158:3300/0 conn(0x7fb89c0cfe20 msgr2=0x7fb89c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:45.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb89b7fe700 1 --2- 172.21.15.31:0/998970079 >> v2:172.21.15.158:3300/0 conn(0x7fb89c0cfe20 0x7fb89c0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb89b7fe700 1 -- 172.21.15.31:0/998970079 >> v1:172.21.15.158:6789/0 conn(0x7fb89c0d1c30 legacy=0x7fb89c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb89b7fe700 1 -- 172.21.15.31:0/998970079 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c0c6340 con 0x7fb89c15a2b0 2023-10-09T06:25:45.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb89b7fe700 1 --2- 172.21.15.31:0/998970079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb89c15a2b0 0x7fb89c0b3da0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb89c064970 tx=0x7fb88c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc2c3673a4c3aa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:45.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.577+0000 7fb89a7fc700 1 -- 172.21.15.31:0/998970079 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c005c10 con 0x7fb89c15a2b0 2023-10-09T06:25:45.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.578+0000 7fb89a7fc700 1 -- 172.21.15.31:0/998970079 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c005d70 con 0x7fb89c15a2b0 2023-10-09T06:25:45.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.578+0000 7fb89a7fc700 1 -- 172.21.15.31:0/998970079 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00b880 con 0x7fb89c15a2b0 2023-10-09T06:25:45.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.578+0000 7fb8a21e1700 1 -- 172.21.15.31:0/998970079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb89c15a2b0 msgr2=0x7fb89c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.578+0000 7fb8a21e1700 1 --2- 172.21.15.31:0/998970079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb89c15a2b0 0x7fb89c0b3da0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb89c064970 tx=0x7fb88c009220 comp rx=0 tx=0).stop 2023-10-09T06:25:45.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.578+0000 7fb8a21e1700 1 -- 172.21.15.31:0/998970079 shutdown_connections 2023-10-09T06:25:45.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.578+0000 7fb8a21e1700 1 --2- 172.21.15.31:0/998970079 >> v2:172.21.15.158:3300/0 conn(0x7fb89c0cfe20 0x7fb89c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.578+0000 7fb8a21e1700 1 --2- 172.21.15.31:0/998970079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb89c15a2b0 0x7fb89c0b3da0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.578+0000 7fb8a21e1700 1 -- 172.21.15.31:0/998970079 >> 172.21.15.31:0/998970079 conn(0x7fb89c067e40 msgr2=0x7fb89c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:45.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.578+0000 7fb8a21e1700 1 -- 172.21.15.31:0/998970079 shutdown_connections 2023-10-09T06:25:45.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.578+0000 7fb8a21e1700 1 -- 172.21.15.31:0/998970079 wait complete. 2023-10-09T06:25:45.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.579+0000 7fb8a21e1700 1 Processor -- start 2023-10-09T06:25:45.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.579+0000 7fb8a21e1700 1 -- start start 2023-10-09T06:25:45.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb8a21e1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb89c0cfe20 0x7fb89c0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb8a21e1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb89c0d1c30 0x7fb89c158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb8a21e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb89c15a2b0 0x7fb89c0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb8a21e1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c0cac10 con 0x7fb89c15a2b0 2023-10-09T06:25:45.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb8a21e1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c15b600 con 0x7fb89c0d1c30 2023-10-09T06:25:45.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb8a21e1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c15b8e0 con 0x7fb89c0cfe20 2023-10-09T06:25:45.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb89bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb89c15a2b0 0x7fb89c0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb89bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb89c15a2b0 0x7fb89c0b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58538/0 (socket says 172.21.15.31:58538) 2023-10-09T06:25:45.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb89affd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb89c0d1c30 0x7fb89c158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb89bfff700 1 -- 172.21.15.31:0/3972714999 learned_addr learned my addr 172.21.15.31:0/3972714999 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:45.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb89b7fe700 1 --2- 172.21.15.31:0/3972714999 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb89c0cfe20 0x7fb89c0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb89bfff700 1 -- 172.21.15.31:0/3972714999 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb89c0cfe20 msgr2=0x7fb89c0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb89bfff700 1 --2- 172.21.15.31:0/3972714999 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb89c0cfe20 0x7fb89c0ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb89bfff700 1 -- 172.21.15.31:0/3972714999 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb89c0d1c30 msgr2=0x7fb89c158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb89bfff700 1 --2- 172.21.15.31:0/3972714999 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb89c0d1c30 0x7fb89c158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.580+0000 7fb89bfff700 1 -- 172.21.15.31:0/3972714999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c009480 con 0x7fb89c15a2b0 2023-10-09T06:25:45.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.581+0000 7fb89bfff700 1 --2- 172.21.15.31:0/3972714999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb89c15a2b0 0x7fb89c0b55b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb894007ef0 tx=0x7fb894009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:45.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.581+0000 7fb8837fe700 1 -- 172.21.15.31:0/3972714999 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89400eb30 con 0x7fb89c15a2b0 2023-10-09T06:25:45.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.581+0000 7fb8837fe700 1 -- 172.21.15.31:0/3972714999 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89400ec90 con 0x7fb89c15a2b0 2023-10-09T06:25:45.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.581+0000 7fb8a21e1700 1 -- 172.21.15.31:0/3972714999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89c15bbc0 con 0x7fb89c15a2b0 2023-10-09T06:25:45.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.581+0000 7fb8837fe700 1 -- 172.21.15.31:0/3972714999 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894014670 con 0x7fb89c15a2b0 2023-10-09T06:25:45.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.581+0000 7fb8a21e1700 1 -- 172.21.15.31:0/3972714999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89c15c180 con 0x7fb89c15a2b0 2023-10-09T06:25:45.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.582+0000 7fb8a21e1700 1 -- 172.21.15.31:0/3972714999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89c04c3c0 con 0x7fb89c15a2b0 2023-10-09T06:25:45.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.582+0000 7fb8837fe700 1 -- 172.21.15.31:0/3972714999 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb894014a60 con 0x7fb89c15a2b0 2023-10-09T06:25:45.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.583+0000 7fb8837fe700 1 --2- 172.21.15.31:0/3972714999 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb888066f30 0x7fb8880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.583+0000 7fb8837fe700 1 -- 172.21.15.31:0/3972714999 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb894084780 con 0x7fb89c15a2b0 2023-10-09T06:25:45.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.583+0000 7fb89b7fe700 1 --2- 172.21.15.31:0/3972714999 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb888066f30 0x7fb8880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.583+0000 7fb89b7fe700 1 --2- 172.21.15.31:0/3972714999 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb888066f30 0x7fb8880693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb88c009260 tx=0x7fb88c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:45.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.587+0000 7fb8837fe700 1 -- 172.21.15.31:0/3972714999 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb894051d40 con 0x7fb89c15a2b0 2023-10-09T06:25:45.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.783+0000 7fb8a21e1700 1 -- 172.21.15.31:0/3972714999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb89c089fa0 con 0x7fb89c15a2b0 2023-10-09T06:25:45.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.783+0000 7fb8837fe700 1 -- 172.21.15.31:0/3972714999 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb894055360 con 0x7fb89c15a2b0 2023-10-09T06:25:45.784 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:45.784 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-10-09T06:25:45.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:25:45.784 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-10-09T06:25:45.784 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-10-09T06:25:45.784 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:25:45.784 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-10-09T06:25:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.785+0000 7fb8a21e1700 1 -- 172.21.15.31:0/3972714999 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb888066f30 msgr2=0x7fb8880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.785+0000 7fb8a21e1700 1 --2- 172.21.15.31:0/3972714999 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb888066f30 0x7fb8880693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb88c009260 tx=0x7fb88c016000 comp rx=0 tx=0).stop 2023-10-09T06:25:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.785+0000 7fb8a21e1700 1 -- 172.21.15.31:0/3972714999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb89c15a2b0 msgr2=0x7fb89c0b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.785+0000 7fb8a21e1700 1 --2- 172.21.15.31:0/3972714999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb89c15a2b0 0x7fb89c0b55b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb894007ef0 tx=0x7fb894009840 comp rx=0 tx=0).stop 2023-10-09T06:25:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.785+0000 7fb8a21e1700 1 -- 172.21.15.31:0/3972714999 shutdown_connections 2023-10-09T06:25:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.785+0000 7fb8a21e1700 1 --2- 172.21.15.31:0/3972714999 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb888066f30 0x7fb8880693e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.785+0000 7fb8a21e1700 1 --2- 172.21.15.31:0/3972714999 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb89c0cfe20 0x7fb89c0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.785+0000 7fb8a21e1700 1 --2- 172.21.15.31:0/3972714999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb89c15a2b0 0x7fb89c0b55b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.785+0000 7fb8a21e1700 1 --2- 172.21.15.31:0/3972714999 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb89c0d1c30 0x7fb89c158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.785+0000 7fb8a21e1700 1 -- 172.21.15.31:0/3972714999 >> 172.21.15.31:0/3972714999 conn(0x7fb89c067e40 msgr2=0x7fb89c068f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:45.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.785+0000 7fb8a21e1700 1 -- 172.21.15.31:0/3972714999 shutdown_connections 2023-10-09T06:25:45.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.785+0000 7fb8a21e1700 1 -- 172.21.15.31:0/3972714999 wait complete. 2023-10-09T06:25:45.798 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:25:45.799 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:25:45.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.921+0000 7f01aa827700 1 Processor -- start 2023-10-09T06:25:45.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.921+0000 7f01aa827700 1 -- start start 2023-10-09T06:25:45.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.922+0000 7f01aa827700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01a4067d70 0x7f01a415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.922+0000 7f01aa827700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a40cf350 con 0x7f01a4157b10 2023-10-09T06:25:45.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.922+0000 7f01aa827700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a415e140 con 0x7f01a415aee0 2023-10-09T06:25:45.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.922+0000 7f01aa827700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a415e9e0 con 0x7f01a4067d70 2023-10-09T06:25:45.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.922+0000 7f01a3fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f01a4157b10 0x7f01a4067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46570/0 (socket says 172.21.15.31:46570) 2023-10-09T06:25:45.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.922+0000 7f01a3fff700 1 -- 172.21.15.31:0/3500022818 learned_addr learned my addr 172.21.15.31:0/3500022818 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:45.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.922+0000 7f01a37fe700 1 --2- 172.21.15.31:0/3500022818 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01a4067d70 0x7f01a415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.923+0000 7f01a2ffd700 1 -- 172.21.15.31:0/3500022818 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132439959 0 0) 0x7f01a40cf350 con 0x7f01a4157b10 2023-10-09T06:25:45.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.923+0000 7f01a2ffd700 1 -- 172.21.15.31:0/3500022818 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f018c003570 con 0x7f01a4157b10 2023-10-09T06:25:45.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.923+0000 7f01a2ffd700 1 -- 172.21.15.31:0/3500022818 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121475726 0 0) 0x7f01a415e140 con 0x7f01a415aee0 2023-10-09T06:25:45.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.923+0000 7f01a2ffd700 1 -- 172.21.15.31:0/3500022818 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01a40cf350 con 0x7f01a415aee0 2023-10-09T06:25:45.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.923+0000 7f01a37fe700 1 -- 172.21.15.31:0/3500022818 >> v1:172.21.15.158:6789/0 conn(0x7f01a415aee0 legacy=0x7f01a40cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.923+0000 7f01a37fe700 1 -- 172.21.15.31:0/3500022818 >> v1:172.21.15.31:6789/0 conn(0x7f01a4157b10 legacy=0x7f01a4067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.923+0000 7f01a37fe700 1 -- 172.21.15.31:0/3500022818 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a415e420 con 0x7f01a4067d70 2023-10-09T06:25:45.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.923+0000 7f01a37fe700 1 --2- 172.21.15.31:0/3500022818 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01a4067d70 0x7f01a415dab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0198009910 tx=0x7f01980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=628b4e18453c8843 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:45.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.923+0000 7f01a2ffd700 1 -- 172.21.15.31:0/3500022818 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198011630 con 0x7f01a4067d70 2023-10-09T06:25:45.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.923+0000 7f01a2ffd700 1 -- 172.21.15.31:0/3500022818 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0198011790 con 0x7f01a4067d70 2023-10-09T06:25:45.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.923+0000 7f01a2ffd700 1 -- 172.21.15.31:0/3500022818 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198011b10 con 0x7f01a4067d70 2023-10-09T06:25:45.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.924+0000 7f01aa827700 1 -- 172.21.15.31:0/3500022818 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01a4067d70 msgr2=0x7f01a415dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.924+0000 7f01aa827700 1 --2- 172.21.15.31:0/3500022818 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01a4067d70 0x7f01a415dab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0198009910 tx=0x7f01980091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.924+0000 7f01aa827700 1 -- 172.21.15.31:0/3500022818 shutdown_connections 2023-10-09T06:25:45.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.924+0000 7f01aa827700 1 --2- 172.21.15.31:0/3500022818 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01a4067d70 0x7f01a415dab0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.924+0000 7f01aa827700 1 -- 172.21.15.31:0/3500022818 >> 172.21.15.31:0/3500022818 conn(0x7f01a40d0de0 msgr2=0x7f01a40d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:45.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.924+0000 7f01aa827700 1 -- 172.21.15.31:0/3500022818 shutdown_connections 2023-10-09T06:25:45.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.924+0000 7f01aa827700 1 -- 172.21.15.31:0/3500022818 wait complete. 2023-10-09T06:25:45.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.925+0000 7f01aa827700 1 Processor -- start 2023-10-09T06:25:45.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.925+0000 7f01aa827700 1 -- start start 2023-10-09T06:25:45.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01aa827700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01a4067d70 0x7f01a4154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01aa827700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01a4157b10 0x7f01a40c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01aa827700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01a415aee0 0x7f01a40b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01aa827700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40b1670 con 0x7f01a4157b10 2023-10-09T06:25:45.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01aa827700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40b0d40 con 0x7f01a415aee0 2023-10-09T06:25:45.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01aa827700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40b1020 con 0x7f01a4067d70 2023-10-09T06:25:45.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01a37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01a4157b10 0x7f01a40c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01a37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01a4157b10 0x7f01a40c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58548/0 (socket says 172.21.15.31:58548) 2023-10-09T06:25:45.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01a37fe700 1 -- 172.21.15.31:0/1612284154 learned_addr learned my addr 172.21.15.31:0/1612284154 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:45.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01a3fff700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01a4067d70 0x7f01a4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01a8dc4700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01a415aee0 0x7f01a40b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01a37fe700 1 -- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01a4067d70 msgr2=0x7f01a4154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01a37fe700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01a4067d70 0x7f01a4154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01a37fe700 1 -- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01a415aee0 msgr2=0x7f01a40b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:45.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01a37fe700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01a415aee0 0x7f01a40b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:45.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.926+0000 7f01a37fe700 1 -- 172.21.15.31:0/1612284154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0198009420 con 0x7f01a4157b10 2023-10-09T06:25:45.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.927+0000 7f01a37fe700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01a4157b10 0x7f01a40c92f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0198009860 tx=0x7f0198017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:45.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.927+0000 7f018bfff700 1 -- 172.21.15.31:0/1612284154 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198000c90 con 0x7f01a4157b10 2023-10-09T06:25:45.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.927+0000 7f018bfff700 1 -- 172.21.15.31:0/1612284154 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0198011900 con 0x7f01a4157b10 2023-10-09T06:25:45.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.927+0000 7f018bfff700 1 -- 172.21.15.31:0/1612284154 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198025650 con 0x7f01a4157b10 2023-10-09T06:25:45.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.927+0000 7f01aa827700 1 -- 172.21.15.31:0/1612284154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a40b1300 con 0x7f01a4157b10 2023-10-09T06:25:45.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.927+0000 7f01aa827700 1 -- 172.21.15.31:0/1612284154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a416ed30 con 0x7f01a4157b10 2023-10-09T06:25:45.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.928+0000 7f01aa827700 1 -- 172.21.15.31:0/1612284154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a40b1490 con 0x7f01a4157b10 2023-10-09T06:25:45.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.928+0000 7f018bfff700 1 -- 172.21.15.31:0/1612284154 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0198023070 con 0x7f01a4157b10 2023-10-09T06:25:45.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.929+0000 7f018bfff700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0190066f30 0x7f01900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:45.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.929+0000 7f018bfff700 1 -- 172.21.15.31:0/1612284154 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0198085480 con 0x7f01a4157b10 2023-10-09T06:25:45.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.929+0000 7f01a3fff700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0190066f30 0x7f01900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:45.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.929+0000 7f01a3fff700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0190066f30 0x7f01900693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0194007fd0 tx=0x7f0194009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:45.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:45.933+0000 7f018bfff700 1 -- 172.21.15.31:0/1612284154 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0198052a80 con 0x7f01a4157b10 2023-10-09T06:25:46.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.126+0000 7f01aa827700 1 -- 172.21.15.31:0/1612284154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f01a404c3c0 con 0x7f01a4157b10 2023-10-09T06:25:46.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.838+0000 7f018bfff700 1 -- 172.21.15.31:0/1612284154 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v98) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0198056060 con 0x7f01a4157b10 2023-10-09T06:25:46.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.841+0000 7f01aa827700 1 -- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0190066f30 msgr2=0x7f01900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:46.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.841+0000 7f01aa827700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0190066f30 0x7f01900693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0194007fd0 tx=0x7f0194009040 comp rx=0 tx=0).stop 2023-10-09T06:25:46.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.841+0000 7f01aa827700 1 -- 172.21.15.31:0/1612284154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01a4157b10 msgr2=0x7f01a40c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:46.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.841+0000 7f01aa827700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01a4157b10 0x7f01a40c92f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0198009860 tx=0x7f0198017000 comp rx=0 tx=0).stop 2023-10-09T06:25:46.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.842+0000 7f01aa827700 1 -- 172.21.15.31:0/1612284154 shutdown_connections 2023-10-09T06:25:46.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.842+0000 7f01aa827700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0190066f30 0x7f01900693e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:46.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.842+0000 7f01aa827700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f01a4067d70 0x7f01a4154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:46.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.842+0000 7f01aa827700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01a415aee0 0x7f01a40b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:46.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.842+0000 7f01aa827700 1 --2- 172.21.15.31:0/1612284154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01a4157b10 0x7f01a40c92f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:46.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.842+0000 7f01aa827700 1 -- 172.21.15.31:0/1612284154 >> 172.21.15.31:0/1612284154 conn(0x7f01a40d0de0 msgr2=0x7f01a40cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:46.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.843+0000 7f01aa827700 1 -- 172.21.15.31:0/1612284154 shutdown_connections 2023-10-09T06:25:46.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.843+0000 7f01aa827700 1 -- 172.21.15.31:0/1612284154 wait complete. 2023-10-09T06:25:46.845 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-10-09T06:25:46.857 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:25:46.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.986+0000 7f3a50a7c700 1 Processor -- start 2023-10-09T06:25:46.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.986+0000 7f3a50a7c700 1 -- start start 2023-10-09T06:25:46.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a50a7c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3a4c1542a0 0x7f3a4c0b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:46.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a50a7c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a4c0cd630 0x7f3a4c06a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:46.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a50a7c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a4c06a830 0x7f3a4c15d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:46.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a50a7c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c15b2e0 con 0x7f3a4c0cd630 2023-10-09T06:25:46.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a50a7c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c06b0a0 con 0x7f3a4c1542a0 2023-10-09T06:25:46.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a50a7c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c06ac30 con 0x7f3a4c06a830 2023-10-09T06:25:46.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a4affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a4c0cd630 0x7f3a4c06a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:46.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a4affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a4c0cd630 0x7f3a4c06a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58556/0 (socket says 172.21.15.31:58556) 2023-10-09T06:25:46.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a4affd700 1 -- 172.21.15.31:0/1946387768 learned_addr learned my addr 172.21.15.31:0/1946387768 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:46.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a4b7fe700 1 --2- 172.21.15.31:0/1946387768 >> v2:172.21.15.158:3300/0 conn(0x7f3a4c1542a0 0x7f3a4c0b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:46.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a4bfff700 1 --2- 172.21.15.31:0/1946387768 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a4c06a830 0x7f3a4c15d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:46.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a4affd700 1 -- 172.21.15.31:0/1946387768 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a4c06a830 msgr2=0x7f3a4c15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:46.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a4affd700 1 --2- 172.21.15.31:0/1946387768 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a4c06a830 0x7f3a4c15d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:46.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.987+0000 7f3a4affd700 1 -- 172.21.15.31:0/1946387768 >> v2:172.21.15.158:3300/0 conn(0x7f3a4c1542a0 msgr2=0x7f3a4c0b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:46.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a4affd700 1 --2- 172.21.15.31:0/1946387768 >> v2:172.21.15.158:3300/0 conn(0x7f3a4c1542a0 0x7f3a4c0b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:46.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a4affd700 1 -- 172.21.15.31:0/1946387768 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c15ad20 con 0x7f3a4c0cd630 2023-10-09T06:25:46.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a4b7fe700 1 --2- 172.21.15.31:0/1946387768 >> v2:172.21.15.158:3300/0 conn(0x7f3a4c1542a0 0x7f3a4c0b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:46.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a4affd700 1 --2- 172.21.15.31:0/1946387768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a4c0cd630 0x7f3a4c06a2f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0d1c50 tx=0x7f3a40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3136a3312f4df4f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:46.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a4a7fc700 1 -- 172.21.15.31:0/1946387768 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4000b860 con 0x7f3a4c0cd630 2023-10-09T06:25:46.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a4a7fc700 1 -- 172.21.15.31:0/1946387768 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4000b9c0 con 0x7f3a4c0cd630 2023-10-09T06:25:46.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a4a7fc700 1 -- 172.21.15.31:0/1946387768 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4000bd60 con 0x7f3a4c0cd630 2023-10-09T06:25:46.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a50a7c700 1 -- 172.21.15.31:0/1946387768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a4c0cd630 msgr2=0x7f3a4c06a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:46.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a50a7c700 1 --2- 172.21.15.31:0/1946387768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a4c0cd630 0x7f3a4c06a2f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0d1c50 tx=0x7f3a40009250 comp rx=0 tx=0).stop 2023-10-09T06:25:46.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a50a7c700 1 -- 172.21.15.31:0/1946387768 shutdown_connections 2023-10-09T06:25:46.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a50a7c700 1 --2- 172.21.15.31:0/1946387768 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a4c06a830 0x7f3a4c15d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:46.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a50a7c700 1 --2- 172.21.15.31:0/1946387768 >> v2:172.21.15.158:3300/0 conn(0x7f3a4c1542a0 0x7f3a4c0b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:46.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a50a7c700 1 --2- 172.21.15.31:0/1946387768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a4c0cd630 0x7f3a4c06a2f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:46.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a50a7c700 1 -- 172.21.15.31:0/1946387768 >> 172.21.15.31:0/1946387768 conn(0x7f3a4c068cb0 msgr2=0x7f3a4c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:46.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a50a7c700 1 -- 172.21.15.31:0/1946387768 shutdown_connections 2023-10-09T06:25:46.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.988+0000 7f3a50a7c700 1 -- 172.21.15.31:0/1946387768 wait complete. 2023-10-09T06:25:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.990+0000 7f3a50a7c700 1 Processor -- start 2023-10-09T06:25:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.990+0000 7f3a50a7c700 1 -- start start 2023-10-09T06:25:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.990+0000 7f3a50a7c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a4c06a830 0x7f3a4c16a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.990+0000 7f3a50a7c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a4c0cd630 0x7f3a4c16b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.990+0000 7f3a50a7c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a4c1542a0 0x7f3a4c0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.990+0000 7f3a50a7c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c153270 con 0x7f3a4c06a830 2023-10-09T06:25:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.990+0000 7f3a50a7c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c16b800 con 0x7f3a4c0cd630 2023-10-09T06:25:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.990+0000 7f3a50a7c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0c68c0 con 0x7f3a4c1542a0 2023-10-09T06:25:46.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a4b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a4c06a830 0x7f3a4c16a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:46.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a4b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a4c06a830 0x7f3a4c16a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58562/0 (socket says 172.21.15.31:58562) 2023-10-09T06:25:46.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a4b7fe700 1 -- 172.21.15.31:0/48274696 learned_addr learned my addr 172.21.15.31:0/48274696 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:46.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a4bfff700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a4c1542a0 0x7f3a4c0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:46.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a4affd700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a4c0cd630 0x7f3a4c16b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:46.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a4b7fe700 1 -- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a4c1542a0 msgr2=0x7f3a4c0c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:46.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a4b7fe700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a4c1542a0 0x7f3a4c0c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:46.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a4b7fe700 1 -- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a4c0cd630 msgr2=0x7f3a4c16b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:46.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a4b7fe700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a4c0cd630 0x7f3a4c16b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:46.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a4b7fe700 1 -- 172.21.15.31:0/48274696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a400094f0 con 0x7f3a4c06a830 2023-10-09T06:25:46.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a4b7fe700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a4c06a830 0x7f3a4c16a2f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00c880 tx=0x7f3a3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:46.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a337fe700 1 -- 172.21.15.31:0/48274696 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c005a00 con 0x7f3a4c06a830 2023-10-09T06:25:46.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a337fe700 1 -- 172.21.15.31:0/48274696 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c005b60 con 0x7f3a4c06a830 2023-10-09T06:25:46.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a50a7c700 1 -- 172.21.15.31:0/48274696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c0c59d0 con 0x7f3a4c06a830 2023-10-09T06:25:46.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a337fe700 1 -- 172.21.15.31:0/48274696 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c011600 con 0x7f3a4c06a830 2023-10-09T06:25:46.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.991+0000 7f3a50a7c700 1 -- 172.21.15.31:0/48274696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c0c5f90 con 0x7f3a4c06a830 2023-10-09T06:25:46.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.992+0000 7f3a50a7c700 1 -- 172.21.15.31:0/48274696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c0ccf80 con 0x7f3a4c06a830 2023-10-09T06:25:46.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.993+0000 7f3a337fe700 1 -- 172.21.15.31:0/48274696 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a3c0119f0 con 0x7f3a4c06a830 2023-10-09T06:25:46.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.993+0000 7f3a337fe700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3a38066f30 0x7f3a380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:46.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.993+0000 7f3a337fe700 1 -- 172.21.15.31:0/48274696 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f3a3c083fc0 con 0x7f3a4c06a830 2023-10-09T06:25:46.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.993+0000 7f3a4affd700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3a38066f30 0x7f3a380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:46.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.994+0000 7f3a4affd700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3a38066f30 0x7f3a380693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0d1c50 tx=0x7f3a40017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:46.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:46.998+0000 7f3a337fe700 1 -- 172.21.15.31:0/48274696 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a3c051410 con 0x7f3a4c06a830 2023-10-09T06:25:47.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.189+0000 7f3a50a7c700 1 -- 172.21.15.31:0/48274696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3a4c0b0030 con 0x7f3a4c06a830 2023-10-09T06:25:47.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.842+0000 7f3a337fe700 1 -- 172.21.15.31:0/48274696 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v99) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3a3c01e0d0 con 0x7f3a4c06a830 2023-10-09T06:25:47.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.854+0000 7f3a50a7c700 1 -- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3a38066f30 msgr2=0x7f3a380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:47.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.854+0000 7f3a50a7c700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3a38066f30 0x7f3a380693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0d1c50 tx=0x7f3a40017000 comp rx=0 tx=0).stop 2023-10-09T06:25:47.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.854+0000 7f3a50a7c700 1 -- 172.21.15.31:0/48274696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a4c06a830 msgr2=0x7f3a4c16a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:47.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.854+0000 7f3a50a7c700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a4c06a830 0x7f3a4c16a2f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00c880 tx=0x7f3a3c008040 comp rx=0 tx=0).stop 2023-10-09T06:25:47.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.854+0000 7f3a50a7c700 1 -- 172.21.15.31:0/48274696 shutdown_connections 2023-10-09T06:25:47.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.854+0000 7f3a50a7c700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3a38066f30 0x7f3a380693e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:47.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.854+0000 7f3a50a7c700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3a4c1542a0 0x7f3a4c0c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:47.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.854+0000 7f3a50a7c700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a4c06a830 0x7f3a4c16a2f0 secure :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00c880 tx=0x7f3a3c008040 comp rx=0 tx=0).stop 2023-10-09T06:25:47.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.854+0000 7f3a50a7c700 1 --2- 172.21.15.31:0/48274696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a4c0cd630 0x7f3a4c16b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:47.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.854+0000 7f3a50a7c700 1 -- 172.21.15.31:0/48274696 >> 172.21.15.31:0/48274696 conn(0x7f3a4c068cb0 msgr2=0x7f3a4c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:47.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.854+0000 7f3a50a7c700 1 -- 172.21.15.31:0/48274696 shutdown_connections 2023-10-09T06:25:47.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.855+0000 7f3a50a7c700 1 -- 172.21.15.31:0/48274696 wait complete. 2023-10-09T06:25:47.856 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-10-09T06:25:47.868 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:25:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.989+0000 7fd4dfe71700 1 Processor -- start 2023-10-09T06:25:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.990+0000 7fd4dfe71700 1 -- start start 2023-10-09T06:25:47.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.990+0000 7fd4dfe71700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd4d815b9a0 0x7fd4d80caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:47.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.990+0000 7fd4dfe71700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d815c8d0 con 0x7fd4d806d370 2023-10-09T06:25:47.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.990+0000 7fd4dfe71700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d80c9370 con 0x7fd4d8152300 2023-10-09T06:25:47.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.990+0000 7fd4dfe71700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d80b1400 con 0x7fd4d815b9a0 2023-10-09T06:25:47.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.991+0000 7fd4dd40c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd4d815b9a0 0x7fd4d80caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:47.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.991+0000 7fd4de40e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd4d806d370 0x7fd4d806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46574/0 (socket says 172.21.15.31:46574) 2023-10-09T06:25:47.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.991+0000 7fd4dd40c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd4d815b9a0 0x7fd4d80caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58574/0 (socket says 172.21.15.31:58574) 2023-10-09T06:25:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.991+0000 7fd4de40e700 1 -- 172.21.15.31:0/3031796 learned_addr learned my addr 172.21.15.31:0/3031796 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.991+0000 7fd4dd40c700 1 -- 172.21.15.31:0/3031796 >> v1:172.21.15.158:6789/0 conn(0x7fd4d8152300 legacy=0x7fd4d8158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.991+0000 7fd4dd40c700 1 -- 172.21.15.31:0/3031796 >> v1:172.21.15.31:6789/0 conn(0x7fd4d806d370 legacy=0x7fd4d806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.991+0000 7fd4dd40c700 1 -- 172.21.15.31:0/3031796 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d815c030 con 0x7fd4d815b9a0 2023-10-09T06:25:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.991+0000 7fd4dcc0b700 1 -- 172.21.15.31:0/3031796 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202689909 0 0) 0x7fd4d815c8d0 con 0x7fd4d806d370 2023-10-09T06:25:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.991+0000 7fd4dd40c700 1 --2- 172.21.15.31:0/3031796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d815b9a0 0x7fd4d80caaf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80098e0 tx=0x7fd4c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e41f84c815412c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.991+0000 7fd4dcc0b700 1 -- 172.21.15.31:0/3031796 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8009e80 con 0x7fd4d815b9a0 2023-10-09T06:25:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.991+0000 7fd4dcc0b700 1 -- 172.21.15.31:0/3031796 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c800b820 con 0x7fd4d815b9a0 2023-10-09T06:25:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.991+0000 7fd4dcc0b700 1 -- 172.21.15.31:0/3031796 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c800bba0 con 0x7fd4d815b9a0 2023-10-09T06:25:47.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.992+0000 7fd4dfe71700 1 -- 172.21.15.31:0/3031796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d815b9a0 msgr2=0x7fd4d80caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:47.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.992+0000 7fd4dfe71700 1 --2- 172.21.15.31:0/3031796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d815b9a0 0x7fd4d80caaf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80098e0 tx=0x7fd4c80091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:47.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.992+0000 7fd4dfe71700 1 -- 172.21.15.31:0/3031796 shutdown_connections 2023-10-09T06:25:47.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.992+0000 7fd4dfe71700 1 --2- 172.21.15.31:0/3031796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d815b9a0 0x7fd4d80caaf0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:47.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.992+0000 7fd4dfe71700 1 -- 172.21.15.31:0/3031796 >> 172.21.15.31:0/3031796 conn(0x7fd4d8069870 msgr2=0x7fd4d8069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:47.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.992+0000 7fd4dfe71700 1 -- 172.21.15.31:0/3031796 shutdown_connections 2023-10-09T06:25:47.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.992+0000 7fd4dfe71700 1 -- 172.21.15.31:0/3031796 wait complete. 2023-10-09T06:25:47.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.993+0000 7fd4dfe71700 1 Processor -- start 2023-10-09T06:25:47.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.993+0000 7fd4dfe71700 1 -- start start 2023-10-09T06:25:47.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4dfe71700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d806d370 0x7fd4d8156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:47.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4dfe71700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd4d8152300 0x7fd4d81516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:47.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4dfe71700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4d815b9a0 0x7fd4d80b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:47.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4dfe71700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80c8060 con 0x7fd4d806d370 2023-10-09T06:25:47.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4dfe71700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8158890 con 0x7fd4d815b9a0 2023-10-09T06:25:47.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4dfe71700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8157020 con 0x7fd4d8152300 2023-10-09T06:25:47.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4ddc0d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d806d370 0x7fd4d8156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:47.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4ddc0d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d806d370 0x7fd4d8156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58576/0 (socket says 172.21.15.31:58576) 2023-10-09T06:25:47.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4ddc0d700 1 -- 172.21.15.31:0/2943213152 learned_addr learned my addr 172.21.15.31:0/2943213152 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:47.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4de40e700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4d815b9a0 0x7fd4d80b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:47.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4dd40c700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd4d8152300 0x7fd4d81516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:47.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4ddc0d700 1 -- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd4d8152300 msgr2=0x7fd4d81516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:47.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4ddc0d700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd4d8152300 0x7fd4d81516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:47.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4ddc0d700 1 -- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4d815b9a0 msgr2=0x7fd4d80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:47.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4ddc0d700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4d815b9a0 0x7fd4d80b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:47.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4ddc0d700 1 -- 172.21.15.31:0/2943213152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c8009420 con 0x7fd4d806d370 2023-10-09T06:25:47.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4ddc0d700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d806d370 0x7fd4d8156ae0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400c5d0 tx=0x7fd4d4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:47.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4cdffb700 1 -- 172.21.15.31:0/2943213152 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4012630 con 0x7fd4d806d370 2023-10-09T06:25:47.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4cdffb700 1 -- 172.21.15.31:0/2943213152 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d4012790 con 0x7fd4d806d370 2023-10-09T06:25:47.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4dfe71700 1 -- 172.21.15.31:0/2943213152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d8158560 con 0x7fd4d806d370 2023-10-09T06:25:47.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.994+0000 7fd4cdffb700 1 -- 172.21.15.31:0/2943213152 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4012b50 con 0x7fd4d806d370 2023-10-09T06:25:47.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.995+0000 7fd4dfe71700 1 -- 172.21.15.31:0/2943213152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d80c7aa0 con 0x7fd4d806d370 2023-10-09T06:25:48.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.996+0000 7fd4dfe71700 1 -- 172.21.15.31:0/2943213152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d804c3c0 con 0x7fd4d806d370 2023-10-09T06:25:48.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.996+0000 7fd4cdffb700 1 -- 172.21.15.31:0/2943213152 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4d401b400 con 0x7fd4d806d370 2023-10-09T06:25:48.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.996+0000 7fd4cdffb700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd4bc066f30 0x7fd4bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:48.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.997+0000 7fd4cdffb700 1 -- 172.21.15.31:0/2943213152 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fd4d40846d0 con 0x7fd4d806d370 2023-10-09T06:25:48.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.997+0000 7fd4dd40c700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd4bc066f30 0x7fd4bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:48.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:47.997+0000 7fd4dd40c700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd4bc066f30 0x7fd4bc0693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80030c0 tx=0x7fd4c8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:48.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.001+0000 7fd4cdffb700 1 -- 172.21.15.31:0/2943213152 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4d40519a0 con 0x7fd4d806d370 2023-10-09T06:25:48.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.237+0000 7fd4dfe71700 1 -- 172.21.15.31:0/2943213152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd4d80cdf10 con 0x7fd4d806d370 2023-10-09T06:25:48.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.866+0000 7fd4cdffb700 1 -- 172.21.15.31:0/2943213152 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v46) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd4d4054fc0 con 0x7fd4d806d370 2023-10-09T06:25:48.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.872+0000 7fd4dfe71700 1 -- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd4bc066f30 msgr2=0x7fd4bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:48.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.872+0000 7fd4dfe71700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd4bc066f30 0x7fd4bc0693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80030c0 tx=0x7fd4c8016000 comp rx=0 tx=0).stop 2023-10-09T06:25:48.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.872+0000 7fd4dfe71700 1 -- 172.21.15.31:0/2943213152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d806d370 msgr2=0x7fd4d8156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:48.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.872+0000 7fd4dfe71700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d806d370 0x7fd4d8156ae0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400c5d0 tx=0x7fd4d4007f60 comp rx=0 tx=0).stop 2023-10-09T06:25:48.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.872+0000 7fd4dfe71700 1 -- 172.21.15.31:0/2943213152 shutdown_connections 2023-10-09T06:25:48.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.872+0000 7fd4dfe71700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd4bc066f30 0x7fd4bc0693e0 secure :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80030c0 tx=0x7fd4c8016000 comp rx=0 tx=0).stop 2023-10-09T06:25:48.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.872+0000 7fd4dfe71700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4d815b9a0 0x7fd4d80b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:48.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.872+0000 7fd4dfe71700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d806d370 0x7fd4d8156ae0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:48.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.872+0000 7fd4dfe71700 1 --2- 172.21.15.31:0/2943213152 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd4d8152300 0x7fd4d81516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:48.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.872+0000 7fd4dfe71700 1 -- 172.21.15.31:0/2943213152 >> 172.21.15.31:0/2943213152 conn(0x7fd4d8069870 msgr2=0x7fd4d80c39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:48.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.873+0000 7fd4dfe71700 1 -- 172.21.15.31:0/2943213152 shutdown_connections 2023-10-09T06:25:48.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:48.873+0000 7fd4dfe71700 1 -- 172.21.15.31:0/2943213152 wait complete. 2023-10-09T06:25:48.874 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 12 and data pool 13 2023-10-09T06:25:48.887 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:25:49.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.007+0000 7f3ebb59e700 1 Processor -- start 2023-10-09T06:25:49.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.007+0000 7f3ebb59e700 1 -- start start 2023-10-09T06:25:49.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.008+0000 7f3ebb59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ebc0cdab0 0x7f3ebc15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.008+0000 7f3ebb59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ebc0cb7c0 con 0x7f3ebc15dda0 2023-10-09T06:25:49.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.008+0000 7f3ebb59e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ebc15e290 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.008+0000 7f3ebb59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc15e850 con 0x7f3ebc0cdab0 2023-10-09T06:25:49.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.008+0000 7f3ebad9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3ebc15dda0 0x7f3ebc15cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46590/0 (socket says 172.21.15.31:46590) 2023-10-09T06:25:49.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.008+0000 7f3ebad9d700 1 -- 172.21.15.31:0/3571381868 learned_addr learned my addr 172.21.15.31:0/3571381868 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:49.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.008+0000 7f3eb9d9b700 1 --2- 172.21.15.31:0/3571381868 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ebc0cdab0 0x7f3ebc15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.008+0000 7f3eb959a700 1 -- 172.21.15.31:0/3571381868 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694847816 0 0) 0x7f3ebc0cb7c0 con 0x7f3ebc15dda0 2023-10-09T06:25:49.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.008+0000 7f3eb959a700 1 -- 172.21.15.31:0/3571381868 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ea8003570 con 0x7f3ebc15dda0 2023-10-09T06:25:49.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.008+0000 7f3eb959a700 1 -- 172.21.15.31:0/3571381868 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375814656 0 0) 0x7f3ebc15e290 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.008+0000 7f3eb959a700 1 -- 172.21.15.31:0/3571381868 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ebc0cb7c0 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.009+0000 7f3eb9d9b700 1 -- 172.21.15.31:0/3571381868 >> v1:172.21.15.158:6789/0 conn(0x7f3ebc0cd6e0 legacy=0x7f3ebc0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.009+0000 7f3eb9d9b700 1 -- 172.21.15.31:0/3571381868 >> v1:172.21.15.31:6789/0 conn(0x7f3ebc15dda0 legacy=0x7f3ebc15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.009+0000 7f3eb959a700 1 -- 172.21.15.31:0/3571381868 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2450844047 0 0) 0x7f3ea8003570 con 0x7f3ebc15dda0 2023-10-09T06:25:49.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.009+0000 7f3eb9d9b700 1 -- 172.21.15.31:0/3571381868 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc15e570 con 0x7f3ebc0cdab0 2023-10-09T06:25:49.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.009+0000 7f3eb9d9b700 1 --2- 172.21.15.31:0/3571381868 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ebc0cdab0 0x7f3ebc15d860 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009910 tx=0x7f3ea40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40ccd25b8adc325 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:49.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.009+0000 7f3eb959a700 1 -- 172.21.15.31:0/3571381868 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4001470 con 0x7f3ebc0cdab0 2023-10-09T06:25:49.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.009+0000 7f3eb959a700 1 -- 172.21.15.31:0/3571381868 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4011420 con 0x7f3ebc0cdab0 2023-10-09T06:25:49.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.009+0000 7f3eb959a700 1 -- 172.21.15.31:0/3571381868 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40117c0 con 0x7f3ebc0cdab0 2023-10-09T06:25:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.009+0000 7f3ebb59e700 1 -- 172.21.15.31:0/3571381868 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ebc0cdab0 msgr2=0x7f3ebc15d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.009+0000 7f3ebb59e700 1 --2- 172.21.15.31:0/3571381868 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ebc0cdab0 0x7f3ebc15d860 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009910 tx=0x7f3ea40091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.010+0000 7f3ebb59e700 1 -- 172.21.15.31:0/3571381868 shutdown_connections 2023-10-09T06:25:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.010+0000 7f3ebb59e700 1 --2- 172.21.15.31:0/3571381868 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ebc0cdab0 0x7f3ebc15d860 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.010+0000 7f3ebb59e700 1 -- 172.21.15.31:0/3571381868 >> 172.21.15.31:0/3571381868 conn(0x7f3ebc067660 msgr2=0x7f3ebc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.010+0000 7f3ebb59e700 1 -- 172.21.15.31:0/3571381868 shutdown_connections 2023-10-09T06:25:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.010+0000 7f3ebb59e700 1 -- 172.21.15.31:0/3571381868 wait complete. 2023-10-09T06:25:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.011+0000 7f3ebb59e700 1 Processor -- start 2023-10-09T06:25:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.011+0000 7f3ebb59e700 1 -- start start 2023-10-09T06:25:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.011+0000 7f3ebb59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc0cd6e0 0x7f3ebc0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.011+0000 7f3ebb59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ebc0cdab0 0x7f3ebc14a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.011+0000 7f3ebb59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ebc15dda0 0x7f3ebc16a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.011+0000 7f3ebb59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0cc360 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.011+0000 7f3ebb59e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0b3f50 con 0x7f3ebc15dda0 2023-10-09T06:25:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.011+0000 7f3ebb59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc16b040 con 0x7f3ebc0cdab0 2023-10-09T06:25:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.011+0000 7f3eba59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc0cd6e0 0x7f3ebc0b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3eba59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc0cd6e0 0x7f3ebc0b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58588/0 (socket says 172.21.15.31:58588) 2023-10-09T06:25:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3eba59c700 1 -- 172.21.15.31:0/2065781501 learned_addr learned my addr 172.21.15.31:0/2065781501 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3ebad9d700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ebc15dda0 0x7f3ebc16a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3eb9d9b700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ebc0cdab0 0x7f3ebc14a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3eba59c700 1 -- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ebc0cdab0 msgr2=0x7f3ebc14a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3eba59c700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ebc0cdab0 0x7f3ebc14a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3eba59c700 1 -- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ebc15dda0 msgr2=0x7f3ebc16a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3eba59c700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ebc15dda0 0x7f3ebc16a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3eba59c700 1 -- 172.21.15.31:0/2065781501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4009420 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3eba59c700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc0cd6e0 0x7f3ebc0b3a10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00cb10 tx=0x7f3eac002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:49.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3eb27fc700 1 -- 172.21.15.31:0/2065781501 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac00ce20 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3eb27fc700 1 -- 172.21.15.31:0/2065781501 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac00a7e0 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3ebb59e700 1 -- 172.21.15.31:0/2065781501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc16b320 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3eb27fc700 1 -- 172.21.15.31:0/2065781501 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac00ab80 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.012+0000 7f3ebb59e700 1 -- 172.21.15.31:0/2065781501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ebc0c9b30 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.013+0000 7f3ebb59e700 1 -- 172.21.15.31:0/2065781501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ebc0c9d50 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.014+0000 7f3eb27fc700 1 -- 172.21.15.31:0/2065781501 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3eac012420 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.014+0000 7f3eb27fc700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e9c066f30 0x7f3e9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.014+0000 7f3eb27fc700 1 -- 172.21.15.31:0/2065781501 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3eac0847c0 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.014+0000 7f3eb9d9b700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e9c066f30 0x7f3e9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.015+0000 7f3eb9d9b700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e9c066f30 0x7f3e9c0693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40030c0 tx=0x7f3ea4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.018+0000 7f3eb27fc700 1 -- 172.21.15.31:0/2065781501 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3eac051a30 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.210+0000 7f3ebb59e700 1 -- 172.21.15.31:0/2065781501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ebc0b5d60 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.211+0000 7f3eb27fc700 1 -- 172.21.15.31:0/2065781501 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+15369 (secure 0 0 0) 0x7f3eac055050 con 0x7f3ebc0cd6e0 2023-10-09T06:25:49.212 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:49.212 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":100,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:25:48.239430+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:25:46.157560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T06:25:47.220698+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:25:49.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.213+0000 7f3ebb59e700 1 -- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e9c066f30 msgr2=0x7f3e9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.213+0000 7f3ebb59e700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e9c066f30 0x7f3e9c0693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40030c0 tx=0x7f3ea4016000 comp rx=0 tx=0).stop 2023-10-09T06:25:49.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.213+0000 7f3ebb59e700 1 -- 172.21.15.31:0/2065781501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc0cd6e0 msgr2=0x7f3ebc0b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.213+0000 7f3ebb59e700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc0cd6e0 0x7f3ebc0b3a10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00cb10 tx=0x7f3eac002820 comp rx=0 tx=0).stop 2023-10-09T06:25:49.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.213+0000 7f3ebb59e700 1 -- 172.21.15.31:0/2065781501 shutdown_connections 2023-10-09T06:25:49.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.213+0000 7f3ebb59e700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e9c066f30 0x7f3e9c0693e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.213+0000 7f3ebb59e700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ebc15dda0 0x7f3ebc16a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.213+0000 7f3ebb59e700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc0cd6e0 0x7f3ebc0b3a10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.213+0000 7f3ebb59e700 1 --2- 172.21.15.31:0/2065781501 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ebc0cdab0 0x7f3ebc14a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.213+0000 7f3ebb59e700 1 -- 172.21.15.31:0/2065781501 >> 172.21.15.31:0/2065781501 conn(0x7f3ebc067660 msgr2=0x7f3ebc0cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:49.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.213+0000 7f3ebb59e700 1 -- 172.21.15.31:0/2065781501 shutdown_connections 2023-10-09T06:25:49.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.213+0000 7f3ebb59e700 1 -- 172.21.15.31:0/2065781501 wait complete. 2023-10-09T06:25:49.226 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:25:49.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.345+0000 7f5a61e7b700 1 Processor -- start 2023-10-09T06:25:49.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.345+0000 7f5a61e7b700 1 -- start start 2023-10-09T06:25:49.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a61e7b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5a5c15a620 0x7f5a5c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a61e7b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5c15cbb0 con 0x7f5a5c15d580 2023-10-09T06:25:49.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a61e7b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5c15bfa0 con 0x7f5a5c157870 2023-10-09T06:25:49.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a61e7b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5c15bdb0 con 0x7f5a5c15a620 2023-10-09T06:25:49.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a5bfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5a5c15d580 0x7f5a5c158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46604/0 (socket says 172.21.15.31:46604) 2023-10-09T06:25:49.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a5bfff700 1 -- 172.21.15.31:0/3769998817 learned_addr learned my addr 172.21.15.31:0/3769998817 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a5affd700 1 --2- 172.21.15.31:0/3769998817 >> v2:172.21.15.158:3300/0 conn(0x7f5a5c15a620 0x7f5a5c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a5a7fc700 1 -- 172.21.15.31:0/3769998817 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187172477 0 0) 0x7f5a5c15cbb0 con 0x7f5a5c15d580 2023-10-09T06:25:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a5a7fc700 1 -- 172.21.15.31:0/3769998817 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a48003570 con 0x7f5a5c15d580 2023-10-09T06:25:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a5a7fc700 1 -- 172.21.15.31:0/3769998817 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889512079 0 0) 0x7f5a5c15bfa0 con 0x7f5a5c157870 2023-10-09T06:25:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a5a7fc700 1 -- 172.21.15.31:0/3769998817 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a5c15cbb0 con 0x7f5a5c157870 2023-10-09T06:25:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a5affd700 1 -- 172.21.15.31:0/3769998817 >> v1:172.21.15.158:6789/0 conn(0x7f5a5c157870 legacy=0x7f5a5c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a5affd700 1 -- 172.21.15.31:0/3769998817 >> v1:172.21.15.31:6789/0 conn(0x7f5a5c15d580 legacy=0x7f5a5c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a5affd700 1 -- 172.21.15.31:0/3769998817 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c15c280 con 0x7f5a5c15a620 2023-10-09T06:25:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.346+0000 7f5a5affd700 1 --2- 172.21.15.31:0/3769998817 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a5c15a620 0x7f5a5c15d040 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5a440098e0 tx=0x7f5a440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23c9b7a3914867c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.347+0000 7f5a5a7fc700 1 -- 172.21.15.31:0/3769998817 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a44011630 con 0x7f5a5c15a620 2023-10-09T06:25:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.347+0000 7f5a5a7fc700 1 -- 172.21.15.31:0/3769998817 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a44011790 con 0x7f5a5c15a620 2023-10-09T06:25:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.347+0000 7f5a5a7fc700 1 -- 172.21.15.31:0/3769998817 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a44011b30 con 0x7f5a5c15a620 2023-10-09T06:25:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.347+0000 7f5a61e7b700 1 -- 172.21.15.31:0/3769998817 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a5c15a620 msgr2=0x7f5a5c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.347+0000 7f5a61e7b700 1 --2- 172.21.15.31:0/3769998817 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a5c15a620 0x7f5a5c15d040 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5a440098e0 tx=0x7f5a440091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.347+0000 7f5a61e7b700 1 -- 172.21.15.31:0/3769998817 shutdown_connections 2023-10-09T06:25:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.347+0000 7f5a61e7b700 1 --2- 172.21.15.31:0/3769998817 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a5c15a620 0x7f5a5c15d040 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.347+0000 7f5a61e7b700 1 -- 172.21.15.31:0/3769998817 >> 172.21.15.31:0/3769998817 conn(0x7f5a5c068ce0 msgr2=0x7f5a5c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.347+0000 7f5a61e7b700 1 -- 172.21.15.31:0/3769998817 shutdown_connections 2023-10-09T06:25:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.347+0000 7f5a61e7b700 1 -- 172.21.15.31:0/3769998817 wait complete. 2023-10-09T06:25:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.348+0000 7f5a61e7b700 1 Processor -- start 2023-10-09T06:25:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.348+0000 7f5a61e7b700 1 -- start start 2023-10-09T06:25:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.349+0000 7f5a61e7b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a5c157870 0x7f5a5c16f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.349+0000 7f5a61e7b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a5c15a620 0x7f5a5c0b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.349+0000 7f5a61e7b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a5c15d580 0x7f5a5c1507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.349+0000 7f5a61e7b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c152cf0 con 0x7f5a5c157870 2023-10-09T06:25:49.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.349+0000 7f5a61e7b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c152fd0 con 0x7f5a5c15a620 2023-10-09T06:25:49.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.349+0000 7f5a61e7b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c1532b0 con 0x7f5a5c15d580 2023-10-09T06:25:49.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.349+0000 7f5a5b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a5c157870 0x7f5a5c16f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.349+0000 7f5a5b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a5c157870 0x7f5a5c16f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58602/0 (socket says 172.21.15.31:58602) 2023-10-09T06:25:49.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.349+0000 7f5a5b7fe700 1 -- 172.21.15.31:0/1512889258 learned_addr learned my addr 172.21.15.31:0/1512889258 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:49.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.349+0000 7f5a5affd700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a5c15a620 0x7f5a5c0b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a5bfff700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a5c15d580 0x7f5a5c1507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a5b7fe700 1 -- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a5c15d580 msgr2=0x7f5a5c1507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a5b7fe700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a5c15d580 0x7f5a5c1507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a5b7fe700 1 -- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a5c15a620 msgr2=0x7f5a5c0b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a5b7fe700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a5c15a620 0x7f5a5c0b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a5b7fe700 1 -- 172.21.15.31:0/1512889258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a44009420 con 0x7f5a5c157870 2023-10-09T06:25:49.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a5affd700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a5c15a620 0x7f5a5c0b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:49.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a5bfff700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a5c15d580 0x7f5a5c1507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:49.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a5b7fe700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a5c157870 0x7f5a5c16f400 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00cb10 tx=0x7f5a4c002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:49.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a537fe700 1 -- 172.21.15.31:0/1512889258 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c00a760 con 0x7f5a5c157870 2023-10-09T06:25:49.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a537fe700 1 -- 172.21.15.31:0/1512889258 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4c00a8c0 con 0x7f5a5c157870 2023-10-09T06:25:49.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a61e7b700 1 -- 172.21.15.31:0/1512889258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5c153590 con 0x7f5a5c157870 2023-10-09T06:25:49.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a537fe700 1 -- 172.21.15.31:0/1512889258 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c00ac60 con 0x7f5a5c157870 2023-10-09T06:25:49.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.350+0000 7f5a61e7b700 1 -- 172.21.15.31:0/1512889258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5c16f940 con 0x7f5a5c157870 2023-10-09T06:25:49.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.351+0000 7f5a61e7b700 1 -- 172.21.15.31:0/1512889258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5c153ab0 con 0x7f5a5c157870 2023-10-09T06:25:49.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.351+0000 7f5a537fe700 1 -- 172.21.15.31:0/1512889258 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a4c012630 con 0x7f5a5c157870 2023-10-09T06:25:49.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.352+0000 7f5a537fe700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a3c066f30 0x7f5a3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.352+0000 7f5a537fe700 1 -- 172.21.15.31:0/1512889258 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a4c084900 con 0x7f5a5c157870 2023-10-09T06:25:49.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.352+0000 7f5a5affd700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a3c066f30 0x7f5a3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.353+0000 7f5a5affd700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a3c066f30 0x7f5a3c0693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c15aa20 tx=0x7f5a44017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:49.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.356+0000 7f5a537fe700 1 -- 172.21.15.31:0/1512889258 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a5c153ab0 con 0x7f5a5c157870 2023-10-09T06:25:49.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.553+0000 7f5a61e7b700 1 -- 172.21.15.31:0/1512889258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a5c153ab0 con 0x7f5a5c157870 2023-10-09T06:25:49.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.554+0000 7f5a537fe700 1 -- 172.21.15.31:0/1512889258 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+15369 (secure 0 0 0) 0x7f5a5c153ab0 con 0x7f5a5c157870 2023-10-09T06:25:49.554 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:49.554 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":100,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:25:48.239430+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:25:46.157560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T06:25:47.220698+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:25:49.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.556+0000 7f5a61e7b700 1 -- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a3c066f30 msgr2=0x7f5a3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.556+0000 7f5a61e7b700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a3c066f30 0x7f5a3c0693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c15aa20 tx=0x7f5a44017000 comp rx=0 tx=0).stop 2023-10-09T06:25:49.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.556+0000 7f5a61e7b700 1 -- 172.21.15.31:0/1512889258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a5c157870 msgr2=0x7f5a5c16f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.556+0000 7f5a61e7b700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a5c157870 0x7f5a5c16f400 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00cb10 tx=0x7f5a4c002820 comp rx=0 tx=0).stop 2023-10-09T06:25:49.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.556+0000 7f5a61e7b700 1 -- 172.21.15.31:0/1512889258 shutdown_connections 2023-10-09T06:25:49.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.556+0000 7f5a61e7b700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a3c066f30 0x7f5a3c0693e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.556+0000 7f5a61e7b700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a5c15d580 0x7f5a5c1507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.556+0000 7f5a61e7b700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a5c157870 0x7f5a5c16f400 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.556+0000 7f5a61e7b700 1 --2- 172.21.15.31:0/1512889258 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a5c15a620 0x7f5a5c0b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.556+0000 7f5a61e7b700 1 -- 172.21.15.31:0/1512889258 >> 172.21.15.31:0/1512889258 conn(0x7f5a5c068ce0 msgr2=0x7f5a5c15f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:49.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.556+0000 7f5a61e7b700 1 -- 172.21.15.31:0/1512889258 shutdown_connections 2023-10-09T06:25:49.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.556+0000 7f5a61e7b700 1 -- 172.21.15.31:0/1512889258 wait complete. 2023-10-09T06:25:49.569 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:25:49.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.690+0000 7f8ac0162700 1 Processor -- start 2023-10-09T06:25:49.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.690+0000 7f8ac0162700 1 -- start start 2023-10-09T06:25:49.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.691+0000 7f8ac0162700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8ab80697c0 0x7f8ab815e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.691+0000 7f8ac0162700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab815ea90 con 0x7f8ab815a230 2023-10-09T06:25:49.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.691+0000 7f8ac0162700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab80b3100 con 0x7f8ab8159e60 2023-10-09T06:25:49.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.691+0000 7f8ac0162700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab80d1cf0 con 0x7f8ab80697c0 2023-10-09T06:25:49.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.691+0000 7f8abd6fd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8ab80697c0 0x7f8ab815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.691+0000 7f8abe6ff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8ab815a230 0x7f8ab80af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52352/0 (socket says 172.21.15.31:52352) 2023-10-09T06:25:49.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.691+0000 7f8abd6fd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8ab80697c0 0x7f8ab815e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43086/0 (socket says 172.21.15.31:43086) 2023-10-09T06:25:49.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.691+0000 7f8abe6ff700 1 -- 172.21.15.31:0/3379796261 learned_addr learned my addr 172.21.15.31:0/3379796261 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:49.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.692+0000 7f8abd6fd700 1 -- 172.21.15.31:0/3379796261 >> v1:172.21.15.158:6789/0 conn(0x7f8ab8159e60 legacy=0x7f8ab80690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.692+0000 7f8abd6fd700 1 -- 172.21.15.31:0/3379796261 >> v1:172.21.15.31:6789/0 conn(0x7f8ab815a230 legacy=0x7f8ab80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.692+0000 7f8abd6fd700 1 -- 172.21.15.31:0/3379796261 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab80d10e0 con 0x7f8ab80697c0 2023-10-09T06:25:49.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.692+0000 7f8abcefc700 1 -- 172.21.15.31:0/3379796261 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710651404 0 0) 0x7f8ab815ea90 con 0x7f8ab815a230 2023-10-09T06:25:49.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.692+0000 7f8abd6fd700 1 --2- 172.21.15.31:0/3379796261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab80697c0 0x7f8ab815e550 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0098e0 tx=0x7f8aac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19cbf5205364d902 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:49.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.692+0000 7f8abcefc700 1 -- 172.21.15.31:0/3379796261 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac009e80 con 0x7f8ab80697c0 2023-10-09T06:25:49.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.692+0000 7f8abcefc700 1 -- 172.21.15.31:0/3379796261 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac00b860 con 0x7f8ab80697c0 2023-10-09T06:25:49.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.692+0000 7f8abcefc700 1 -- 172.21.15.31:0/3379796261 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00bbe0 con 0x7f8ab80697c0 2023-10-09T06:25:49.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.692+0000 7f8ac0162700 1 -- 172.21.15.31:0/3379796261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab80697c0 msgr2=0x7f8ab815e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.692+0000 7f8ac0162700 1 --2- 172.21.15.31:0/3379796261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab80697c0 0x7f8ab815e550 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0098e0 tx=0x7f8aac0091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.692+0000 7f8ac0162700 1 -- 172.21.15.31:0/3379796261 shutdown_connections 2023-10-09T06:25:49.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.692+0000 7f8ac0162700 1 --2- 172.21.15.31:0/3379796261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab80697c0 0x7f8ab815e550 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.693+0000 7f8ac0162700 1 -- 172.21.15.31:0/3379796261 >> 172.21.15.31:0/3379796261 conn(0x7f8ab8070700 msgr2=0x7f8ab8070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:49.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.693+0000 7f8ac0162700 1 -- 172.21.15.31:0/3379796261 shutdown_connections 2023-10-09T06:25:49.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.693+0000 7f8ac0162700 1 -- 172.21.15.31:0/3379796261 wait complete. 2023-10-09T06:25:49.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.694+0000 7f8ac0162700 1 Processor -- start 2023-10-09T06:25:49.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.694+0000 7f8ac0162700 1 -- start start 2023-10-09T06:25:49.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.694+0000 7f8ac0162700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab80697c0 0x7f8ab815c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.694+0000 7f8ac0162700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ab8159e60 0x7f8ab816e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.694+0000 7f8ac0162700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ab815a230 0x7f8ab816eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.694+0000 7f8ac0162700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab815d900 con 0x7f8ab80697c0 2023-10-09T06:25:49.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.694+0000 7f8ac0162700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab815cd80 con 0x7f8ab8159e60 2023-10-09T06:25:49.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.694+0000 7f8ac0162700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab815d060 con 0x7f8ab815a230 2023-10-09T06:25:49.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.694+0000 7f8abdefe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab80697c0 0x7f8ab815c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8abdefe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab80697c0 0x7f8ab815c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43088/0 (socket says 172.21.15.31:43088) 2023-10-09T06:25:49.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8abdefe700 1 -- 172.21.15.31:0/3557926138 learned_addr learned my addr 172.21.15.31:0/3557926138 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:49.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8abd6fd700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ab8159e60 0x7f8ab816e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8abe6ff700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ab815a230 0x7f8ab816eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8abdefe700 1 -- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ab815a230 msgr2=0x7f8ab816eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8abdefe700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ab815a230 0x7f8ab816eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8abdefe700 1 -- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ab8159e60 msgr2=0x7f8ab816e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:49.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8abdefe700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ab8159e60 0x7f8ab816e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:49.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8abdefe700 1 -- 172.21.15.31:0/3557926138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac009420 con 0x7f8ab80697c0 2023-10-09T06:25:49.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8abe6ff700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ab815a230 0x7f8ab816eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:49.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8abdefe700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab80697c0 0x7f8ab815c490 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000c790 tx=0x7f8ab0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:49.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8ab5ffb700 1 -- 172.21.15.31:0/3557926138 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0006820 con 0x7f8ab80697c0 2023-10-09T06:25:49.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8ac0162700 1 -- 172.21.15.31:0/3557926138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab815d340 con 0x7f8ab80697c0 2023-10-09T06:25:49.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8ab5ffb700 1 -- 172.21.15.31:0/3557926138 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab0006980 con 0x7f8ab80697c0 2023-10-09T06:25:49.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8ab5ffb700 1 -- 172.21.15.31:0/3557926138 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0006d40 con 0x7f8ab80697c0 2023-10-09T06:25:49.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.695+0000 7f8ac0162700 1 -- 172.21.15.31:0/3557926138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab815c9d0 con 0x7f8ab80697c0 2023-10-09T06:25:49.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.696+0000 7f8ac0162700 1 -- 172.21.15.31:0/3557926138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab80c4f30 con 0x7f8ab80697c0 2023-10-09T06:25:49.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.697+0000 7f8ab5ffb700 1 -- 172.21.15.31:0/3557926138 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ab0007240 con 0x7f8ab80697c0 2023-10-09T06:25:49.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.697+0000 7f8ab5ffb700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8aa4066f30 0x7f8aa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:49.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.697+0000 7f8ab5ffb700 1 -- 172.21.15.31:0/3557926138 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ab0083b20 con 0x7f8ab80697c0 2023-10-09T06:25:49.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.697+0000 7f8abd6fd700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8aa4066f30 0x7f8aa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:49.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.698+0000 7f8abd6fd700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8aa4066f30 0x7f8aa40693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0093f0 tx=0x7f8aac017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:49.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.701+0000 7f8ab5ffb700 1 -- 172.21.15.31:0/3557926138 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ab80c4f30 con 0x7f8ab80697c0 2023-10-09T06:25:49.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:49.941+0000 7f8ac0162700 1 -- 172.21.15.31:0/3557926138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8ab80c4f30 con 0x7f8ab80697c0 2023-10-09T06:25:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:50.874+0000 7f8ab5ffb700 1 -- 172.21.15.31:0/3557926138 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8ab80c4f30 con 0x7f8ab80697c0 2023-10-09T06:25:50.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:50.877+0000 7f8ac0162700 1 -- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8aa4066f30 msgr2=0x7f8aa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:50.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:50.877+0000 7f8ac0162700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8aa4066f30 0x7f8aa40693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0093f0 tx=0x7f8aac017000 comp rx=0 tx=0).stop 2023-10-09T06:25:50.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:50.877+0000 7f8ac0162700 1 -- 172.21.15.31:0/3557926138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab80697c0 msgr2=0x7f8ab815c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:50.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:50.877+0000 7f8ac0162700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab80697c0 0x7f8ab815c490 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000c790 tx=0x7f8ab0007f60 comp rx=0 tx=0).stop 2023-10-09T06:25:50.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:50.877+0000 7f8ac0162700 1 -- 172.21.15.31:0/3557926138 shutdown_connections 2023-10-09T06:25:50.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:50.877+0000 7f8ac0162700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8aa4066f30 0x7f8aa40693e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:50.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:50.877+0000 7f8ac0162700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ab815a230 0x7f8ab816eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:50.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:50.877+0000 7f8ac0162700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab80697c0 0x7f8ab815c490 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:50.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:50.877+0000 7f8ac0162700 1 --2- 172.21.15.31:0/3557926138 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ab8159e60 0x7f8ab816e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:50.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:50.877+0000 7f8ac0162700 1 -- 172.21.15.31:0/3557926138 >> 172.21.15.31:0/3557926138 conn(0x7f8ab8070700 msgr2=0x7f8ab80cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:50.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:50.877+0000 7f8ac0162700 1 -- 172.21.15.31:0/3557926138 shutdown_connections 2023-10-09T06:25:50.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:50.877+0000 7f8ac0162700 1 -- 172.21.15.31:0/3557926138 wait complete. 2023-10-09T06:25:50.893 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:25:51.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.022+0000 7f4183555700 1 Processor -- start 2023-10-09T06:25:51.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.022+0000 7f4183555700 1 -- start start 2023-10-09T06:25:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.023+0000 7f4183555700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f417c15a230 0x7f417c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.023+0000 7f4183555700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417c15ea90 con 0x7f417c159e60 2023-10-09T06:25:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.023+0000 7f4183555700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417c0b3100 con 0x7f417c0697c0 2023-10-09T06:25:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.023+0000 7f4183555700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c0d1cf0 con 0x7f417c15a230 2023-10-09T06:25:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.023+0000 7f4181af2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f417c15a230 0x7f417c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.023+0000 7f41812f1700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f417c159e60 0x7f417c0690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52358/0 (socket says 172.21.15.31:52358) 2023-10-09T06:25:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.023+0000 7f41812f1700 1 -- 172.21.15.31:0/3744460368 learned_addr learned my addr 172.21.15.31:0/3744460368 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.023+0000 7f4181af2700 1 -- 172.21.15.31:0/3744460368 >> v1:172.21.15.158:6789/0 conn(0x7f417c0697c0 legacy=0x7f417c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.023+0000 7f4181af2700 1 -- 172.21.15.31:0/3744460368 >> v1:172.21.15.31:6789/0 conn(0x7f417c159e60 legacy=0x7f417c0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.023+0000 7f4181af2700 1 -- 172.21.15.31:0/3744460368 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c0d10e0 con 0x7f417c15a230 2023-10-09T06:25:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.023+0000 7f4173fff700 1 -- 172.21.15.31:0/3744460368 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319287900 0 0) 0x7f417c15ea90 con 0x7f417c159e60 2023-10-09T06:25:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.023+0000 7f4181af2700 1 --2- 172.21.15.31:0/3744460368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c15a230 0x7f417c15e550 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4174009e60 tx=0x7f4174009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39c1353a9050c3e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.024+0000 7f4173fff700 1 -- 172.21.15.31:0/3744460368 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417400e070 con 0x7f417c15a230 2023-10-09T06:25:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.024+0000 7f4173fff700 1 -- 172.21.15.31:0/3744460368 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417400bc30 con 0x7f417c15a230 2023-10-09T06:25:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.024+0000 7f4173fff700 1 -- 172.21.15.31:0/3744460368 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174012430 con 0x7f417c15a230 2023-10-09T06:25:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.024+0000 7f4183555700 1 -- 172.21.15.31:0/3744460368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c15a230 msgr2=0x7f417c15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.024+0000 7f4183555700 1 --2- 172.21.15.31:0/3744460368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c15a230 0x7f417c15e550 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4174009e60 tx=0x7f4174009780 comp rx=0 tx=0).stop 2023-10-09T06:25:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.024+0000 7f4183555700 1 -- 172.21.15.31:0/3744460368 shutdown_connections 2023-10-09T06:25:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.024+0000 7f4183555700 1 --2- 172.21.15.31:0/3744460368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c15a230 0x7f417c15e550 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.024+0000 7f4183555700 1 -- 172.21.15.31:0/3744460368 >> 172.21.15.31:0/3744460368 conn(0x7f417c070700 msgr2=0x7f417c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:51.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.024+0000 7f4183555700 1 -- 172.21.15.31:0/3744460368 shutdown_connections 2023-10-09T06:25:51.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.024+0000 7f4183555700 1 -- 172.21.15.31:0/3744460368 wait complete. 2023-10-09T06:25:51.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.025+0000 7f4183555700 1 Processor -- start 2023-10-09T06:25:51.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.025+0000 7f4183555700 1 -- start start 2023-10-09T06:25:51.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.026+0000 7f4183555700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c0697c0 0x7f417c1468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:51.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.026+0000 7f4183555700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c159e60 0x7f417c0cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:51.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.026+0000 7f4183555700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c15a230 0x7f417c0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:51.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.026+0000 7f4183555700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0c5400 con 0x7f417c15a230 2023-10-09T06:25:51.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.026+0000 7f4183555700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0c47f0 con 0x7f417c159e60 2023-10-09T06:25:51.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.026+0000 7f4183555700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0c4ad0 con 0x7f417c0697c0 2023-10-09T06:25:51.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.026+0000 7f4181af2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c15a230 0x7f417c0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:51.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.026+0000 7f4181af2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c15a230 0x7f417c0cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43108/0 (socket says 172.21.15.31:43108) 2023-10-09T06:25:51.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.026+0000 7f4181af2700 1 -- 172.21.15.31:0/3465182143 learned_addr learned my addr 172.21.15.31:0/3465182143 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:51.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.026+0000 7f4180af0700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c159e60 0x7f417c0cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:51.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.026+0000 7f41812f1700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c0697c0 0x7f417c1468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:51.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.027+0000 7f4181af2700 1 -- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c0697c0 msgr2=0x7f417c1468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:51.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.027+0000 7f4181af2700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c0697c0 0x7f417c1468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:51.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.027+0000 7f4181af2700 1 -- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c159e60 msgr2=0x7f417c0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:51.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.027+0000 7f4181af2700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c159e60 0x7f417c0cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:51.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.027+0000 7f4181af2700 1 -- 172.21.15.31:0/3465182143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4174009a20 con 0x7f417c15a230 2023-10-09T06:25:51.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.027+0000 7f4181af2700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c15a230 0x7f417c0cc530 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4174003000 tx=0x7f4174018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:51.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.027+0000 7f41717fa700 1 -- 172.21.15.31:0/3465182143 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417401e640 con 0x7f417c15a230 2023-10-09T06:25:51.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.027+0000 7f41717fa700 1 -- 172.21.15.31:0/3465182143 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417401e7c0 con 0x7f417c15a230 2023-10-09T06:25:51.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.027+0000 7f41717fa700 1 -- 172.21.15.31:0/3465182143 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417401eb80 con 0x7f417c15a230 2023-10-09T06:25:51.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.027+0000 7f4183555700 1 -- 172.21.15.31:0/3465182143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417c0c4db0 con 0x7f417c15a230 2023-10-09T06:25:51.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.027+0000 7f4183555700 1 -- 172.21.15.31:0/3465182143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c146df0 con 0x7f417c15a230 2023-10-09T06:25:51.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.028+0000 7f4183555700 1 -- 172.21.15.31:0/3465182143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c0c5570 con 0x7f417c15a230 2023-10-09T06:25:51.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.028+0000 7f41717fa700 1 -- 172.21.15.31:0/3465182143 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4174024070 con 0x7f417c15a230 2023-10-09T06:25:51.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.029+0000 7f41717fa700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4160066f30 0x7f41600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:51.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.029+0000 7f41717fa700 1 -- 172.21.15.31:0/3465182143 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f41740870f0 con 0x7f417c15a230 2023-10-09T06:25:51.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.029+0000 7f41812f1700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4160066f30 0x7f41600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:51.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.029+0000 7f41812f1700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4160066f30 0x7f41600693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f41780011e0 tx=0x7f4178009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:51.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.033+0000 7f41717fa700 1 -- 172.21.15.31:0/3465182143 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41740542c0 con 0x7f417c15a230 2023-10-09T06:25:51.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.274+0000 7f4183555700 1 -- 172.21.15.31:0/3465182143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f417c04c3c0 con 0x7f417c15a230 2023-10-09T06:25:51.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.875+0000 7f41717fa700 1 -- 172.21.15.31:0/3465182143 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v50) v1 ==== 122+0+0 (secure 0 0 0) 0x7f41740578e0 con 0x7f417c15a230 2023-10-09T06:25:51.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.877+0000 7f4183555700 1 -- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4160066f30 msgr2=0x7f41600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:51.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.877+0000 7f4183555700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4160066f30 0x7f41600693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f41780011e0 tx=0x7f4178009040 comp rx=0 tx=0).stop 2023-10-09T06:25:51.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.878+0000 7f4183555700 1 -- 172.21.15.31:0/3465182143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c15a230 msgr2=0x7f417c0cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:51.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.878+0000 7f4183555700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c15a230 0x7f417c0cc530 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4174003000 tx=0x7f4174018000 comp rx=0 tx=0).stop 2023-10-09T06:25:51.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.878+0000 7f4183555700 1 -- 172.21.15.31:0/3465182143 shutdown_connections 2023-10-09T06:25:51.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.878+0000 7f4183555700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4160066f30 0x7f41600693e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:51.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.878+0000 7f4183555700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f417c0697c0 0x7f417c1468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:51.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.878+0000 7f4183555700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417c15a230 0x7f417c0cc530 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:51.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.878+0000 7f4183555700 1 --2- 172.21.15.31:0/3465182143 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f417c159e60 0x7f417c0cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:51.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.878+0000 7f4183555700 1 -- 172.21.15.31:0/3465182143 >> 172.21.15.31:0/3465182143 conn(0x7f417c070700 msgr2=0x7f417c159260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:51.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.878+0000 7f4183555700 1 -- 172.21.15.31:0/3465182143 shutdown_connections 2023-10-09T06:25:51.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:51.878+0000 7f4183555700 1 -- 172.21.15.31:0/3465182143 wait complete. 2023-10-09T06:25:51.892 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:25:52.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.014+0000 7f4c8f678700 1 Processor -- start 2023-10-09T06:25:52.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.014+0000 7f4c8f678700 1 -- start start 2023-10-09T06:25:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.015+0000 7f4c8f678700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4c880cfe20 0x7f4c880ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.015+0000 7f4c8f678700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c880c5d80 con 0x7f4c8815a2b0 2023-10-09T06:25:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.015+0000 7f4c8f678700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c880c6060 con 0x7f4c880d1c30 2023-10-09T06:25:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.015+0000 7f4c8f678700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c88068470 con 0x7f4c880cfe20 2023-10-09T06:25:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.015+0000 7f4c8d414700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4c8815a2b0 0x7f4c880b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52374/0 (socket says 172.21.15.31:52374) 2023-10-09T06:25:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.015+0000 7f4c8d414700 1 -- 172.21.15.31:0/862462941 learned_addr learned my addr 172.21.15.31:0/862462941 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.015+0000 7f4c8dc15700 1 --2- 172.21.15.31:0/862462941 >> v2:172.21.15.31:3300/0 conn(0x7f4c880cfe20 0x7f4c880ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.016+0000 7f4c8dc15700 1 -- 172.21.15.31:0/862462941 >> v1:172.21.15.158:6789/0 conn(0x7f4c880d1c30 legacy=0x7f4c880cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:52.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.016+0000 7f4c8dc15700 1 -- 172.21.15.31:0/862462941 >> v1:172.21.15.31:6789/0 conn(0x7f4c8815a2b0 legacy=0x7f4c880b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.016+0000 7f4c87fff700 1 -- 172.21.15.31:0/862462941 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193280100 0 0) 0x7f4c880c5d80 con 0x7f4c8815a2b0 2023-10-09T06:25:52.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.016+0000 7f4c8dc15700 1 -- 172.21.15.31:0/862462941 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c880c6340 con 0x7f4c880cfe20 2023-10-09T06:25:52.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.016+0000 7f4c8dc15700 1 --2- 172.21.15.31:0/862462941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c880cfe20 0x7f4c880ccdd0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f4c780098e0 tx=0x7f4c780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f62c66f9e1a14d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:52.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.016+0000 7f4c87fff700 1 -- 172.21.15.31:0/862462941 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78009e80 con 0x7f4c880cfe20 2023-10-09T06:25:52.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.016+0000 7f4c87fff700 1 -- 172.21.15.31:0/862462941 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7800b820 con 0x7f4c880cfe20 2023-10-09T06:25:52.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.016+0000 7f4c87fff700 1 -- 172.21.15.31:0/862462941 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7800bba0 con 0x7f4c880cfe20 2023-10-09T06:25:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.017+0000 7f4c8f678700 1 -- 172.21.15.31:0/862462941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c880cfe20 msgr2=0x7f4c880ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.017+0000 7f4c8f678700 1 --2- 172.21.15.31:0/862462941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c880cfe20 0x7f4c880ccdd0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f4c780098e0 tx=0x7f4c780091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.017+0000 7f4c8f678700 1 -- 172.21.15.31:0/862462941 shutdown_connections 2023-10-09T06:25:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.017+0000 7f4c8f678700 1 --2- 172.21.15.31:0/862462941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c880cfe20 0x7f4c880ccdd0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.017+0000 7f4c8f678700 1 -- 172.21.15.31:0/862462941 >> 172.21.15.31:0/862462941 conn(0x7f4c88067e40 msgr2=0x7f4c880d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.017+0000 7f4c8f678700 1 -- 172.21.15.31:0/862462941 shutdown_connections 2023-10-09T06:25:52.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.017+0000 7f4c8f678700 1 -- 172.21.15.31:0/862462941 wait complete. 2023-10-09T06:25:52.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.018+0000 7f4c8f678700 1 Processor -- start 2023-10-09T06:25:52.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.018+0000 7f4c8f678700 1 -- start start 2023-10-09T06:25:52.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8f678700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4c880cfe20 0x7f4c88157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8f678700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c880d1c30 0x7f4c8809bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8f678700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c8815a2b0 0x7f4c8816d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8f678700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8815a890 con 0x7f4c880d1c30 2023-10-09T06:25:52.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8f678700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8815b3a0 con 0x7f4c8815a2b0 2023-10-09T06:25:52.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8f678700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8815aa70 con 0x7f4c880cfe20 2023-10-09T06:25:52.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8cc13700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c880d1c30 0x7f4c8809bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8cc13700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c880d1c30 0x7f4c8809bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43128/0 (socket says 172.21.15.31:43128) 2023-10-09T06:25:52.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8cc13700 1 -- 172.21.15.31:0/3468471783 learned_addr learned my addr 172.21.15.31:0/3468471783 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:52.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8dc15700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c8815a2b0 0x7f4c8816d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8d414700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4c880cfe20 0x7f4c88157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8cc13700 1 -- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4c880cfe20 msgr2=0x7f4c88157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8cc13700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4c880cfe20 0x7f4c88157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8cc13700 1 -- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c8815a2b0 msgr2=0x7f4c8816d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8cc13700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c8815a2b0 0x7f4c8816d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8cc13700 1 -- 172.21.15.31:0/3468471783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78009420 con 0x7f4c880d1c30 2023-10-09T06:25:52.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.019+0000 7f4c8cc13700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c880d1c30 0x7f4c8809bf20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00b5e0 tx=0x7f4c7c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:52.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.020+0000 7f4c857fa700 1 -- 172.21.15.31:0/3468471783 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c00f510 con 0x7f4c880d1c30 2023-10-09T06:25:52.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.020+0000 7f4c857fa700 1 -- 172.21.15.31:0/3468471783 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c00f6b0 con 0x7f4c880d1c30 2023-10-09T06:25:52.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.020+0000 7f4c8f678700 1 -- 172.21.15.31:0/3468471783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8815ad50 con 0x7f4c880d1c30 2023-10-09T06:25:52.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.020+0000 7f4c857fa700 1 -- 172.21.15.31:0/3468471783 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c00fa70 con 0x7f4c880d1c30 2023-10-09T06:25:52.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.020+0000 7f4c8f678700 1 -- 172.21.15.31:0/3468471783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c881581a0 con 0x7f4c880d1c30 2023-10-09T06:25:52.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.020+0000 7f4c8f678700 1 -- 172.21.15.31:0/3468471783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8804c3c0 con 0x7f4c880d1c30 2023-10-09T06:25:52.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.021+0000 7f4c857fa700 1 -- 172.21.15.31:0/3468471783 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c7c01a400 con 0x7f4c880d1c30 2023-10-09T06:25:52.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.021+0000 7f4c857fa700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c74066f30 0x7f4c740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.021+0000 7f4c857fa700 1 -- 172.21.15.31:0/3468471783 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c7c083ee0 con 0x7f4c880d1c30 2023-10-09T06:25:52.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.022+0000 7f4c8d414700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c74066f30 0x7f4c740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.022+0000 7f4c8d414700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c74066f30 0x7f4c740693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4c800030c0 tx=0x7f4c80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:52.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.026+0000 7f4c857fa700 1 -- 172.21.15.31:0/3468471783 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c7c0511d0 con 0x7f4c880d1c30 2023-10-09T06:25:52.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.262+0000 7f4c8f678700 1 -- 172.21.15.31:0/3468471783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c8815b4e0 con 0x7f4c880d1c30 2023-10-09T06:25:52.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.262+0000 7f4c857fa700 1 -- 172.21.15.31:0/3468471783 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f4c7c0547f0 con 0x7f4c880d1c30 2023-10-09T06:25:52.263 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:52.263 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2694953357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2694953357},{"type":"v1","addr":"172.21.15.158:6836","nonce":2694953357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1926052104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1926052104},{"type":"v1","addr":"172.21.15.31:6834","nonce":1926052104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3700277268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3700277268},{"type":"v1","addr":"172.21.15.31:6835","nonce":3700277268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:25:48.239748+0000","modified":"2023-10-09T06:25:51.874363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/3699283833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3699283833},{"type":"v1","addr":"172.21.15.158:6837","nonce":3699283833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T06:25:52.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.264+0000 7f4c8f678700 1 -- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c74066f30 msgr2=0x7f4c740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.264+0000 7f4c8f678700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c74066f30 0x7f4c740693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4c800030c0 tx=0x7f4c80009040 comp rx=0 tx=0).stop 2023-10-09T06:25:52.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.264+0000 7f4c8f678700 1 -- 172.21.15.31:0/3468471783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c880d1c30 msgr2=0x7f4c8809bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.264+0000 7f4c8f678700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c880d1c30 0x7f4c8809bf20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00b5e0 tx=0x7f4c7c0090f0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.264+0000 7f4c8f678700 1 -- 172.21.15.31:0/3468471783 shutdown_connections 2023-10-09T06:25:52.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.264+0000 7f4c8f678700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c74066f30 0x7f4c740693e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.264+0000 7f4c8f678700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4c880cfe20 0x7f4c88157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.264+0000 7f4c8f678700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c8815a2b0 0x7f4c8816d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.264+0000 7f4c8f678700 1 --2- 172.21.15.31:0/3468471783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c880d1c30 0x7f4c8809bf20 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.264+0000 7f4c8f678700 1 -- 172.21.15.31:0/3468471783 >> 172.21.15.31:0/3468471783 conn(0x7f4c88067e40 msgr2=0x7f4c88069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:52.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.264+0000 7f4c8f678700 1 -- 172.21.15.31:0/3468471783 shutdown_connections 2023-10-09T06:25:52.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.264+0000 7f4c8f678700 1 -- 172.21.15.31:0/3468471783 wait complete. 2023-10-09T06:25:52.267 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 50 2023-10-09T06:25:52.277 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:25:52.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.395+0000 7f4d51269700 1 Processor -- start 2023-10-09T06:25:52.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.395+0000 7f4d51269700 1 -- start start 2023-10-09T06:25:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.396+0000 7f4d51269700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4d4c0cd6e0 0x7f4d4c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.396+0000 7f4d51269700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d4c15cbd0 0x7f4d4c15d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.396+0000 7f4d51269700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c0cb7c0 con 0x7f4d4c0cdab0 2023-10-09T06:25:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.396+0000 7f4d51269700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c15e850 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.396+0000 7f4d51269700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0cd030 con 0x7f4d4c15cbd0 2023-10-09T06:25:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.396+0000 7f4d4bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4d4c0cd6e0 0x7f4d4c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.396+0000 7f4d4b7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4d4c0cdab0 0x7f4d4c15d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52386/0 (socket says 172.21.15.31:52386) 2023-10-09T06:25:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.396+0000 7f4d4b7fe700 1 -- 172.21.15.31:0/3917845865 learned_addr learned my addr 172.21.15.31:0/3917845865 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.396+0000 7f4d4bfff700 1 -- 172.21.15.31:0/3917845865 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d4c15cbd0 msgr2=0x7f4d4c15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.396+0000 7f4d4bfff700 1 --2- 172.21.15.31:0/3917845865 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d4c15cbd0 0x7f4d4c15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.396+0000 7f4d4bfff700 1 -- 172.21.15.31:0/3917845865 >> v1:172.21.15.31:6789/0 conn(0x7f4d4c0cdab0 legacy=0x7f4d4c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.396+0000 7f4d4bfff700 1 -- 172.21.15.31:0/3917845865 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c15e290 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.396+0000 7f4d4affd700 1 -- 172.21.15.31:0/3917845865 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154947710 0 0) 0x7f4d4c0cb7c0 con 0x7f4d4c0cdab0 2023-10-09T06:25:52.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.397+0000 7f4d4bfff700 1 --2- 172.21.15.31:0/3917845865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c0cd6e0 0x7f4d4c0cbc50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0098e0 tx=0x7f4d3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e44f8cc4b4153c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:52.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.397+0000 7f4d4affd700 1 -- 172.21.15.31:0/3917845865 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c009e80 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.397+0000 7f4d4affd700 1 -- 172.21.15.31:0/3917845865 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c00b860 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.397+0000 7f4d4affd700 1 -- 172.21.15.31:0/3917845865 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c00bbe0 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.397+0000 7f4d51269700 1 -- 172.21.15.31:0/3917845865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c0cd6e0 msgr2=0x7f4d4c0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.397+0000 7f4d51269700 1 --2- 172.21.15.31:0/3917845865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c0cd6e0 0x7f4d4c0cbc50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0098e0 tx=0x7f4d3c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.397+0000 7f4d51269700 1 -- 172.21.15.31:0/3917845865 shutdown_connections 2023-10-09T06:25:52.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.397+0000 7f4d51269700 1 --2- 172.21.15.31:0/3917845865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c0cd6e0 0x7f4d4c0cbc50 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.397+0000 7f4d51269700 1 --2- 172.21.15.31:0/3917845865 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d4c15cbd0 0x7f4d4c15d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.397+0000 7f4d51269700 1 -- 172.21.15.31:0/3917845865 >> 172.21.15.31:0/3917845865 conn(0x7f4d4c067660 msgr2=0x7f4d4c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:52.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.397+0000 7f4d51269700 1 -- 172.21.15.31:0/3917845865 shutdown_connections 2023-10-09T06:25:52.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.397+0000 7f4d51269700 1 -- 172.21.15.31:0/3917845865 wait complete. 2023-10-09T06:25:52.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.398+0000 7f4d51269700 1 Processor -- start 2023-10-09T06:25:52.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.399+0000 7f4d51269700 1 -- start start 2023-10-09T06:25:52.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.399+0000 7f4d51269700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c0cd6e0 0x7f4d4c147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.399+0000 7f4d51269700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d4c0cdab0 0x7f4d4c158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.399+0000 7f4d51269700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d4c15cbd0 0x7f4d4c15b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.399+0000 7f4d51269700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c158e90 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.399+0000 7f4d51269700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c15b7e0 con 0x7f4d4c15cbd0 2023-10-09T06:25:52.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.399+0000 7f4d51269700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c15ba60 con 0x7f4d4c0cdab0 2023-10-09T06:25:52.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.399+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c0cd6e0 0x7f4d4c147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.399+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c0cd6e0 0x7f4d4c147800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43146/0 (socket says 172.21.15.31:43146) 2023-10-09T06:25:52.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.399+0000 7f4d4bfff700 1 -- 172.21.15.31:0/1337008310 learned_addr learned my addr 172.21.15.31:0/1337008310 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:52.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.399+0000 7f4d4b7fe700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d4c0cdab0 0x7f4d4c158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.399+0000 7f4d50a68700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d4c15cbd0 0x7f4d4c15b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.400+0000 7f4d4bfff700 1 -- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d4c0cdab0 msgr2=0x7f4d4c158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.400+0000 7f4d4bfff700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d4c0cdab0 0x7f4d4c158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.400+0000 7f4d4bfff700 1 -- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d4c15cbd0 msgr2=0x7f4d4c15b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.400+0000 7f4d4bfff700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d4c15cbd0 0x7f4d4c15b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.400+0000 7f4d4bfff700 1 -- 172.21.15.31:0/1337008310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c009420 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.400+0000 7f4d4bfff700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c0cd6e0 0x7f4d4c147800 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0c7b10 tx=0x7f4d3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:52.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.400+0000 7f4d43fff700 1 -- 172.21.15.31:0/1337008310 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c00bbe0 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.400+0000 7f4d43fff700 1 -- 172.21.15.31:0/1337008310 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c011420 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.400+0000 7f4d43fff700 1 -- 172.21.15.31:0/1337008310 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c011820 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.400+0000 7f4d51269700 1 -- 172.21.15.31:0/1337008310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c15bd40 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.400+0000 7f4d51269700 1 -- 172.21.15.31:0/1337008310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c15c300 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.401+0000 7f4d51269700 1 -- 172.21.15.31:0/1337008310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c0c9040 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.401+0000 7f4d43fff700 1 -- 172.21.15.31:0/1337008310 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d3c011c50 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.402+0000 7f4d43fff700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4d2c066f30 0x7f4d2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.402+0000 7f4d43fff700 1 -- 172.21.15.31:0/1337008310 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4d3c085e50 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.402+0000 7f4d4b7fe700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4d2c066f30 0x7f4d2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.403+0000 7f4d4b7fe700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4d2c066f30 0x7f4d2c0693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0b5c90 tx=0x7f4d34007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:52.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.406+0000 7f4d43fff700 1 -- 172.21.15.31:0/1337008310 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d4c0c9040 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.602+0000 7f4d51269700 1 -- 172.21.15.31:0/1337008310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d4c15e570 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.603+0000 7f4d43fff700 1 -- 172.21.15.31:0/1337008310 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+15356 (secure 0 0 0) 0x7f4d3c0530c0 con 0x7f4d4c0cd6e0 2023-10-09T06:25:52.604 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:52.604 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":101,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:25:49.850415+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:25:46.157560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T06:25:47.220698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:25:52.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.605+0000 7f4d51269700 1 -- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4d2c066f30 msgr2=0x7f4d2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.605+0000 7f4d51269700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4d2c066f30 0x7f4d2c0693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0b5c90 tx=0x7f4d34007d30 comp rx=0 tx=0).stop 2023-10-09T06:25:52.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.605+0000 7f4d51269700 1 -- 172.21.15.31:0/1337008310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c0cd6e0 msgr2=0x7f4d4c147800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.605+0000 7f4d51269700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c0cd6e0 0x7f4d4c147800 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0c7b10 tx=0x7f4d3c017000 comp rx=0 tx=0).stop 2023-10-09T06:25:52.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.605+0000 7f4d51269700 1 -- 172.21.15.31:0/1337008310 shutdown_connections 2023-10-09T06:25:52.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.605+0000 7f4d51269700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4d2c066f30 0x7f4d2c0693e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.605+0000 7f4d51269700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d4c15cbd0 0x7f4d4c15b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.605+0000 7f4d51269700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c0cd6e0 0x7f4d4c147800 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.605+0000 7f4d51269700 1 --2- 172.21.15.31:0/1337008310 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4d4c0cdab0 0x7f4d4c158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.605+0000 7f4d51269700 1 -- 172.21.15.31:0/1337008310 >> 172.21.15.31:0/1337008310 conn(0x7f4d4c067660 msgr2=0x7f4d4c0b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:52.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.605+0000 7f4d51269700 1 -- 172.21.15.31:0/1337008310 shutdown_connections 2023-10-09T06:25:52.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.605+0000 7f4d51269700 1 -- 172.21.15.31:0/1337008310 wait complete. 2023-10-09T06:25:52.618 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:25:52.619 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:25:52.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.738+0000 7f616f0e9700 1 Processor -- start 2023-10-09T06:25:52.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.738+0000 7f616f0e9700 1 -- start start 2023-10-09T06:25:52.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.738+0000 7f616f0e9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f61680b0890 0x7f61680cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.738+0000 7f616f0e9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6168067d70 0x7f6168159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.738+0000 7f616f0e9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680cb370 con 0x7f61680cbd40 2023-10-09T06:25:52.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.738+0000 7f616f0e9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61680b0c60 con 0x7f6168067d70 2023-10-09T06:25:52.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.738+0000 7f616f0e9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616806a1e0 con 0x7f61680b0890 2023-10-09T06:25:52.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.739+0000 7f616d686700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6168067d70 0x7f6168159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.739+0000 7f6167fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f61680cbd40 0x7f6168067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52402/0 (socket says 172.21.15.31:52402) 2023-10-09T06:25:52.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.739+0000 7f6167fff700 1 -- 172.21.15.31:0/3511750667 learned_addr learned my addr 172.21.15.31:0/3511750667 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:52.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.739+0000 7f616ce85700 1 --2- 172.21.15.31:0/3511750667 >> v2:172.21.15.158:3300/0 conn(0x7f61680b0890 0x7f61680cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.739+0000 7f616d686700 1 -- 172.21.15.31:0/3511750667 >> v2:172.21.15.158:3300/0 conn(0x7f61680b0890 msgr2=0x7f61680cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:52.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.739+0000 7f616d686700 1 --2- 172.21.15.31:0/3511750667 >> v2:172.21.15.158:3300/0 conn(0x7f61680b0890 0x7f61680cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.739+0000 7f616d686700 1 -- 172.21.15.31:0/3511750667 >> v1:172.21.15.31:6789/0 conn(0x7f61680cbd40 legacy=0x7f6168067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.739+0000 7f616d686700 1 -- 172.21.15.31:0/3511750667 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616806cb80 con 0x7f6168067d70 2023-10-09T06:25:52.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.739+0000 7f61677fe700 1 -- 172.21.15.31:0/3511750667 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963042786 0 0) 0x7f61680cb370 con 0x7f61680cbd40 2023-10-09T06:25:52.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.739+0000 7f616d686700 1 --2- 172.21.15.31:0/3511750667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6168067d70 0x7f6168159790 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f616806aae0 tx=0x7f61500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b231ce5a7f00b9a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:52.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.739+0000 7f61677fe700 1 -- 172.21.15.31:0/3511750667 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000b6b0 con 0x7f6168067d70 2023-10-09T06:25:52.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.739+0000 7f61677fe700 1 -- 172.21.15.31:0/3511750667 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615000b810 con 0x7f6168067d70 2023-10-09T06:25:52.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.739+0000 7f61677fe700 1 -- 172.21.15.31:0/3511750667 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000bbb0 con 0x7f6168067d70 2023-10-09T06:25:52.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.740+0000 7f616f0e9700 1 -- 172.21.15.31:0/3511750667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6168067d70 msgr2=0x7f6168159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.740+0000 7f616f0e9700 1 --2- 172.21.15.31:0/3511750667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6168067d70 0x7f6168159790 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f616806aae0 tx=0x7f61500091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.740+0000 7f616f0e9700 1 -- 172.21.15.31:0/3511750667 shutdown_connections 2023-10-09T06:25:52.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.740+0000 7f616f0e9700 1 --2- 172.21.15.31:0/3511750667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6168067d70 0x7f6168159790 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.740+0000 7f616f0e9700 1 --2- 172.21.15.31:0/3511750667 >> v2:172.21.15.158:3300/0 conn(0x7f61680b0890 0x7f61680cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.740+0000 7f616f0e9700 1 -- 172.21.15.31:0/3511750667 >> 172.21.15.31:0/3511750667 conn(0x7f616806fe50 msgr2=0x7f6168069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:52.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.740+0000 7f616f0e9700 1 -- 172.21.15.31:0/3511750667 shutdown_connections 2023-10-09T06:25:52.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.740+0000 7f616f0e9700 1 -- 172.21.15.31:0/3511750667 wait complete. 2023-10-09T06:25:52.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.741+0000 7f616f0e9700 1 Processor -- start 2023-10-09T06:25:52.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.741+0000 7f616f0e9700 1 -- start start 2023-10-09T06:25:52.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f616f0e9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6168067d70 0x7f61680c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f616f0e9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61680b0890 0x7f61680af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f616f0e9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61680cbd40 0x7f61680af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f616f0e9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61680c5390 con 0x7f61680b0890 2023-10-09T06:25:52.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f616f0e9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61680c4780 con 0x7f6168067d70 2023-10-09T06:25:52.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f616f0e9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61680c4a60 con 0x7f61680cbd40 2023-10-09T06:25:52.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f6167fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61680b0890 0x7f61680af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f6167fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61680b0890 0x7f61680af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43158/0 (socket says 172.21.15.31:43158) 2023-10-09T06:25:52.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f6167fff700 1 -- 172.21.15.31:0/396718732 learned_addr learned my addr 172.21.15.31:0/396718732 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:52.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f6167fff700 1 -- 172.21.15.31:0/396718732 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61680cbd40 msgr2=0x7f61680af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f6167fff700 1 --2- 172.21.15.31:0/396718732 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61680cbd40 0x7f61680af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f6167fff700 1 -- 172.21.15.31:0/396718732 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6168067d70 msgr2=0x7f61680c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f6167fff700 1 --2- 172.21.15.31:0/396718732 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6168067d70 0x7f61680c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f6167fff700 1 -- 172.21.15.31:0/396718732 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6150009420 con 0x7f61680b0890 2023-10-09T06:25:52.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.742+0000 7f6167fff700 1 --2- 172.21.15.31:0/396718732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61680b0890 0x7f61680af0c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f615800c7e0 tx=0x7f6158007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:52.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.743+0000 7f6164ff9700 1 -- 172.21.15.31:0/396718732 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158005b30 con 0x7f61680b0890 2023-10-09T06:25:52.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.743+0000 7f6164ff9700 1 -- 172.21.15.31:0/396718732 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6158005c90 con 0x7f61680b0890 2023-10-09T06:25:52.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.743+0000 7f616f0e9700 1 -- 172.21.15.31:0/396718732 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61680c4d40 con 0x7f61680b0890 2023-10-09T06:25:52.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.743+0000 7f6164ff9700 1 -- 172.21.15.31:0/396718732 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158007300 con 0x7f61680b0890 2023-10-09T06:25:52.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.743+0000 7f616f0e9700 1 -- 172.21.15.31:0/396718732 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61680c4490 con 0x7f61680b0890 2023-10-09T06:25:52.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.744+0000 7f616f0e9700 1 -- 172.21.15.31:0/396718732 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616804c3c0 con 0x7f61680b0890 2023-10-09T06:25:52.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.744+0000 7f6164ff9700 1 -- 172.21.15.31:0/396718732 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f615801b400 con 0x7f61680b0890 2023-10-09T06:25:52.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.744+0000 7f6164ff9700 1 --2- 172.21.15.31:0/396718732 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6148066f30 0x7f61480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:52.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.745+0000 7f6164ff9700 1 -- 172.21.15.31:0/396718732 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6158084040 con 0x7f61680b0890 2023-10-09T06:25:52.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.745+0000 7f616ce85700 1 --2- 172.21.15.31:0/396718732 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6148066f30 0x7f61480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:52.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.745+0000 7f616ce85700 1 --2- 172.21.15.31:0/396718732 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6148066f30 0x7f61480693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6160007460 tx=0x7f6160009a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:52.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.749+0000 7f6164ff9700 1 -- 172.21.15.31:0/396718732 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6158051330 con 0x7f61680b0890 2023-10-09T06:25:52.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.940+0000 7f616f0e9700 1 -- 172.21.15.31:0/396718732 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61680c9360 con 0x7f6148066f30 2023-10-09T06:25:52.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.949+0000 7f6164ff9700 1 -- 172.21.15.31:0/396718732 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281842 (secure 0 0 0) 0x7f61680c9360 con 0x7f6148066f30 2023-10-09T06:25:52.953 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:52.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.952+0000 7f616f0e9700 1 -- 172.21.15.31:0/396718732 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6148066f30 msgr2=0x7f61480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.952+0000 7f616f0e9700 1 --2- 172.21.15.31:0/396718732 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6148066f30 0x7f61480693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6160007460 tx=0x7f6160009a10 comp rx=0 tx=0).stop 2023-10-09T06:25:52.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.952+0000 7f616f0e9700 1 -- 172.21.15.31:0/396718732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61680b0890 msgr2=0x7f61680af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:52.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.952+0000 7f616f0e9700 1 --2- 172.21.15.31:0/396718732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61680b0890 0x7f61680af0c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f615800c7e0 tx=0x7f6158007df0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.952+0000 7f616f0e9700 1 -- 172.21.15.31:0/396718732 shutdown_connections 2023-10-09T06:25:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.952+0000 7f616f0e9700 1 --2- 172.21.15.31:0/396718732 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6148066f30 0x7f61480693e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.952+0000 7f616f0e9700 1 --2- 172.21.15.31:0/396718732 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61680cbd40 0x7f61680af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.952+0000 7f616f0e9700 1 --2- 172.21.15.31:0/396718732 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6168067d70 0x7f61680c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.952+0000 7f616f0e9700 1 --2- 172.21.15.31:0/396718732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61680b0890 0x7f61680af0c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.952+0000 7f616f0e9700 1 -- 172.21.15.31:0/396718732 >> 172.21.15.31:0/396718732 conn(0x7f616806fe50 msgr2=0x7f616815d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.952+0000 7f616f0e9700 1 -- 172.21.15.31:0/396718732 shutdown_connections 2023-10-09T06:25:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:52.952+0000 7f616f0e9700 1 -- 172.21.15.31:0/396718732 wait complete. 2023-10-09T06:25:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:25:52.965 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2023-10-09T06:25:52.588628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557183,"statfs":{"total":1600000000,"available":1594555790,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.750821"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843722+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:02.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846354+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:22:43.722563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847525+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:17.876832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848532+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:18.557206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846861+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:42.447136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841618+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847409+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:11.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.842300+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841871+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.945766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843529+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:33.951783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845884+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:39.017793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843265+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:03.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846965+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:21.991307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848134+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:10.690323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.849314+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:54.261243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846027+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:54:53.637423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.853432+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:43.433850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847291+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:47.595844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843183+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846879+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:40:43.836644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846733+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:05:08.101768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846057+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:48.507408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845561+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845926+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:36.957766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846840+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:12.934950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847443+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:43.433850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.849110+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.945766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846713+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847472+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:16.753156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845309+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:29.732017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845612+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:47:03.231614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843744+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:42.447136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848336+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851455+0000","last_change":"2023-10-09T06:25:47.851455+0000","last_active":"2023-10-09T06:25:47.851455+0000","last_peered":"2023-10-09T06:25:47.851455+0000","last_clean":"2023-10-09T06:25:47.851455+0000","last_became_active":"2023-10-09T06:25:47.851203+0000","last_became_peered":"2023-10-09T06:25:47.851203+0000","last_unstale":"2023-10-09T06:25:47.851455+0000","last_undegraded":"2023-10-09T06:25:47.851455+0000","last_fullsized":"2023-10-09T06:25:47.851455+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:11.772590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846339+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:30.810531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.854438+0000","last_change":"2023-10-09T06:25:47.854438+0000","last_active":"2023-10-09T06:25:47.854438+0000","last_peered":"2023-10-09T06:25:47.854438+0000","last_clean":"2023-10-09T06:25:47.854438+0000","last_became_active":"2023-10-09T06:25:47.854221+0000","last_became_peered":"2023-10-09T06:25:47.854221+0000","last_unstale":"2023-10-09T06:25:47.854438+0000","last_undegraded":"2023-10-09T06:25:47.854438+0000","last_fullsized":"2023-10-09T06:25:47.854438+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:05:38.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843221+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:54:53.637423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849059+0000","last_change":"2023-10-09T06:25:47.849059+0000","last_active":"2023-10-09T06:25:47.849059+0000","last_peered":"2023-10-09T06:25:47.849059+0000","last_clean":"2023-10-09T06:25:47.849059+0000","last_became_active":"2023-10-09T06:25:47.848790+0000","last_became_peered":"2023-10-09T06:25:47.848790+0000","last_unstale":"2023-10-09T06:25:47.849059+0000","last_undegraded":"2023-10-09T06:25:47.849059+0000","last_fullsized":"2023-10-09T06:25:47.849059+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:26.169034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847938+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.349968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849726+0000","last_change":"2023-10-09T06:25:47.849726+0000","last_active":"2023-10-09T06:25:47.849726+0000","last_peered":"2023-10-09T06:25:47.849726+0000","last_clean":"2023-10-09T06:25:47.849726+0000","last_became_active":"2023-10-09T06:25:47.849461+0000","last_became_peered":"2023-10-09T06:25:47.849461+0000","last_unstale":"2023-10-09T06:25:47.849726+0000","last_undegraded":"2023-10-09T06:25:47.849726+0000","last_fullsized":"2023-10-09T06:25:47.849726+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:41.443808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846130+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:26:52.798323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855263+0000","last_change":"2023-10-09T06:25:47.855263+0000","last_active":"2023-10-09T06:25:47.855263+0000","last_peered":"2023-10-09T06:25:47.855263+0000","last_clean":"2023-10-09T06:25:47.855263+0000","last_became_active":"2023-10-09T06:25:47.854779+0000","last_became_peered":"2023-10-09T06:25:47.854779+0000","last_unstale":"2023-10-09T06:25:47.855263+0000","last_undegraded":"2023-10-09T06:25:47.855263+0000","last_fullsized":"2023-10-09T06:25:47.855263+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.013764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.852995+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:21.991307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855905+0000","last_change":"2023-10-09T06:25:47.855905+0000","last_active":"2023-10-09T06:25:47.855905+0000","last_peered":"2023-10-09T06:25:47.855905+0000","last_clean":"2023-10-09T06:25:47.855905+0000","last_became_active":"2023-10-09T06:25:47.855664+0000","last_became_peered":"2023-10-09T06:25:47.855664+0000","last_unstale":"2023-10-09T06:25:47.855905+0000","last_undegraded":"2023-10-09T06:25:47.855905+0000","last_fullsized":"2023-10-09T06:25:47.855905+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:08.735859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848298+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:16.986469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.845607+0000","last_change":"2023-10-09T06:25:47.845607+0000","last_active":"2023-10-09T06:25:47.845607+0000","last_peered":"2023-10-09T06:25:47.845607+0000","last_clean":"2023-10-09T06:25:47.845607+0000","last_became_active":"2023-10-09T06:25:47.845108+0000","last_became_peered":"2023-10-09T06:25:47.845108+0000","last_unstale":"2023-10-09T06:25:47.845607+0000","last_undegraded":"2023-10-09T06:25:47.845607+0000","last_fullsized":"2023-10-09T06:25:47.845607+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:32.948454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848477+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:47:14.813193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.852047+0000","last_change":"2023-10-09T06:25:47.852047+0000","last_active":"2023-10-09T06:25:47.852047+0000","last_peered":"2023-10-09T06:25:47.852047+0000","last_clean":"2023-10-09T06:25:47.852047+0000","last_became_active":"2023-10-09T06:25:47.851541+0000","last_became_peered":"2023-10-09T06:25:47.851541+0000","last_unstale":"2023-10-09T06:25:47.852047+0000","last_undegraded":"2023-10-09T06:25:47.852047+0000","last_fullsized":"2023-10-09T06:25:47.852047+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:35.643402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848413+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:21.766447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849277+0000","last_change":"2023-10-09T06:25:47.849277+0000","last_active":"2023-10-09T06:25:47.849277+0000","last_peered":"2023-10-09T06:25:47.849277+0000","last_clean":"2023-10-09T06:25:47.849277+0000","last_became_active":"2023-10-09T06:25:47.849037+0000","last_became_peered":"2023-10-09T06:25:47.849037+0000","last_unstale":"2023-10-09T06:25:47.849277+0000","last_undegraded":"2023-10-09T06:25:47.849277+0000","last_fullsized":"2023-10-09T06:25:47.849277+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.013764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841231+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.854169+0000","last_change":"2023-10-09T06:25:47.854169+0000","last_active":"2023-10-09T06:25:47.854169+0000","last_peered":"2023-10-09T06:25:47.854169+0000","last_clean":"2023-10-09T06:25:47.854169+0000","last_became_active":"2023-10-09T06:25:47.853941+0000","last_became_peered":"2023-10-09T06:25:47.853941+0000","last_unstale":"2023-10-09T06:25:47.854169+0000","last_undegraded":"2023-10-09T06:25:47.854169+0000","last_fullsized":"2023-10-09T06:25:47.854169+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:18.208465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.842801+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.848404+0000","last_change":"2023-10-09T06:25:47.848404+0000","last_active":"2023-10-09T06:25:47.848404+0000","last_peered":"2023-10-09T06:25:47.848404+0000","last_clean":"2023-10-09T06:25:47.848404+0000","last_became_active":"2023-10-09T06:25:47.847936+0000","last_became_peered":"2023-10-09T06:25:47.847936+0000","last_unstale":"2023-10-09T06:25:47.848404+0000","last_undegraded":"2023-10-09T06:25:47.848404+0000","last_fullsized":"2023-10-09T06:25:47.848404+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:29.780809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846566+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:33.951783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.842724+0000","last_change":"2023-10-09T06:25:47.842724+0000","last_active":"2023-10-09T06:25:47.842724+0000","last_peered":"2023-10-09T06:25:47.842724+0000","last_clean":"2023-10-09T06:25:47.842724+0000","last_became_active":"2023-10-09T06:25:47.842472+0000","last_became_peered":"2023-10-09T06:25:47.842472+0000","last_unstale":"2023-10-09T06:25:47.842724+0000","last_undegraded":"2023-10-09T06:25:47.842724+0000","last_fullsized":"2023-10-09T06:25:47.842724+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:02.106046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843292+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.847553+0000","last_change":"2023-10-09T06:25:47.847553+0000","last_active":"2023-10-09T06:25:47.847553+0000","last_peered":"2023-10-09T06:25:47.847553+0000","last_clean":"2023-10-09T06:25:47.847553+0000","last_became_active":"2023-10-09T06:25:47.847331+0000","last_became_peered":"2023-10-09T06:25:47.847331+0000","last_unstale":"2023-10-09T06:25:47.847553+0000","last_undegraded":"2023-10-09T06:25:47.847553+0000","last_fullsized":"2023-10-09T06:25:47.847553+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:53.459647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847544+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:04.966793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.848332+0000","last_change":"2023-10-09T06:25:47.848332+0000","last_active":"2023-10-09T06:25:47.848332+0000","last_peered":"2023-10-09T06:25:47.848332+0000","last_clean":"2023-10-09T06:25:47.848332+0000","last_became_active":"2023-10-09T06:25:47.848047+0000","last_became_peered":"2023-10-09T06:25:47.848047+0000","last_unstale":"2023-10-09T06:25:47.848332+0000","last_undegraded":"2023-10-09T06:25:47.848332+0000","last_fullsized":"2023-10-09T06:25:47.848332+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:11.346640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845382+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:25.089742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855073+0000","last_change":"2023-10-09T06:25:47.855073+0000","last_active":"2023-10-09T06:25:47.855073+0000","last_peered":"2023-10-09T06:25:47.855073+0000","last_clean":"2023-10-09T06:25:47.855073+0000","last_became_active":"2023-10-09T06:25:47.854877+0000","last_became_peered":"2023-10-09T06:25:47.854877+0000","last_unstale":"2023-10-09T06:25:47.855073+0000","last_undegraded":"2023-10-09T06:25:47.855073+0000","last_fullsized":"2023-10-09T06:25:47.855073+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:32.948454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845712+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:55.341469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851026+0000","last_change":"2023-10-09T06:25:47.851026+0000","last_active":"2023-10-09T06:25:47.851026+0000","last_peered":"2023-10-09T06:25:47.851026+0000","last_clean":"2023-10-09T06:25:47.851026+0000","last_became_active":"2023-10-09T06:25:47.850820+0000","last_became_peered":"2023-10-09T06:25:47.850820+0000","last_unstale":"2023-10-09T06:25:47.851026+0000","last_undegraded":"2023-10-09T06:25:47.851026+0000","last_fullsized":"2023-10-09T06:25:47.851026+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:01.086319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846911+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850149+0000","last_change":"2023-10-09T06:25:47.850149+0000","last_active":"2023-10-09T06:25:47.850149+0000","last_peered":"2023-10-09T06:25:47.850149+0000","last_clean":"2023-10-09T06:25:47.850149+0000","last_became_active":"2023-10-09T06:25:47.849942+0000","last_became_peered":"2023-10-09T06:25:47.849942+0000","last_unstale":"2023-10-09T06:25:47.850149+0000","last_undegraded":"2023-10-09T06:25:47.850149+0000","last_fullsized":"2023-10-09T06:25:47.850149+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:08.735859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.844415+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850579+0000","last_change":"2023-10-09T06:25:47.850579+0000","last_active":"2023-10-09T06:25:47.850579+0000","last_peered":"2023-10-09T06:25:47.850579+0000","last_clean":"2023-10-09T06:25:47.850579+0000","last_became_active":"2023-10-09T06:25:47.850361+0000","last_became_peered":"2023-10-09T06:25:47.850361+0000","last_unstale":"2023-10-09T06:25:47.850579+0000","last_undegraded":"2023-10-09T06:25:47.850579+0000","last_fullsized":"2023-10-09T06:25:47.850579+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:48.069765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845198+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:12.775919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.848106+0000","last_change":"2023-10-09T06:25:47.848106+0000","last_active":"2023-10-09T06:25:47.848106+0000","last_peered":"2023-10-09T06:25:47.848106+0000","last_clean":"2023-10-09T06:25:47.848106+0000","last_became_active":"2023-10-09T06:25:47.847818+0000","last_became_peered":"2023-10-09T06:25:47.847818+0000","last_unstale":"2023-10-09T06:25:47.848106+0000","last_undegraded":"2023-10-09T06:25:47.848106+0000","last_fullsized":"2023-10-09T06:25:47.848106+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:02.106046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845529+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:09.795315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.842874+0000","last_change":"2023-10-09T06:25:47.842874+0000","last_active":"2023-10-09T06:25:47.842874+0000","last_peered":"2023-10-09T06:25:47.842874+0000","last_clean":"2023-10-09T06:25:47.842874+0000","last_became_active":"2023-10-09T06:25:47.842648+0000","last_became_peered":"2023-10-09T06:25:47.842648+0000","last_unstale":"2023-10-09T06:25:47.842874+0000","last_undegraded":"2023-10-09T06:25:47.842874+0000","last_fullsized":"2023-10-09T06:25:47.842874+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:15.983140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841909+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.846610+0000","last_change":"2023-10-09T06:25:47.846610+0000","last_active":"2023-10-09T06:25:47.846610+0000","last_peered":"2023-10-09T06:25:47.846610+0000","last_clean":"2023-10-09T06:25:47.846610+0000","last_became_active":"2023-10-09T06:25:47.846390+0000","last_became_peered":"2023-10-09T06:25:47.846390+0000","last_unstale":"2023-10-09T06:25:47.846610+0000","last_undegraded":"2023-10-09T06:25:47.846610+0000","last_fullsized":"2023-10-09T06:25:47.846610+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:45.550797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846133+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:54:51.114943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.847568+0000","last_change":"2023-10-09T06:25:47.847568+0000","last_active":"2023-10-09T06:25:47.847568+0000","last_peered":"2023-10-09T06:25:47.847568+0000","last_clean":"2023-10-09T06:25:47.847568+0000","last_became_active":"2023-10-09T06:25:47.847337+0000","last_became_peered":"2023-10-09T06:25:47.847337+0000","last_unstale":"2023-10-09T06:25:47.847568+0000","last_undegraded":"2023-10-09T06:25:47.847568+0000","last_fullsized":"2023-10-09T06:25:47.847568+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:27.334050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841126+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:02.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850759+0000","last_change":"2023-10-09T06:25:47.850759+0000","last_active":"2023-10-09T06:25:47.850759+0000","last_peered":"2023-10-09T06:25:47.850759+0000","last_clean":"2023-10-09T06:25:47.850759+0000","last_became_active":"2023-10-09T06:25:47.850307+0000","last_became_peered":"2023-10-09T06:25:47.850307+0000","last_unstale":"2023-10-09T06:25:47.850759+0000","last_undegraded":"2023-10-09T06:25:47.850759+0000","last_fullsized":"2023-10-09T06:25:47.850759+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:16.873504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846156+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:03.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850946+0000","last_change":"2023-10-09T06:25:47.850946+0000","last_active":"2023-10-09T06:25:47.850946+0000","last_peered":"2023-10-09T06:25:47.850946+0000","last_clean":"2023-10-09T06:25:47.850946+0000","last_became_active":"2023-10-09T06:25:47.850152+0000","last_became_peered":"2023-10-09T06:25:47.850152+0000","last_unstale":"2023-10-09T06:25:47.850946+0000","last_undegraded":"2023-10-09T06:25:47.850946+0000","last_fullsized":"2023-10-09T06:25:47.850946+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:45.813982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847416+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:23:39.868860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851348+0000","last_change":"2023-10-09T06:25:47.851348+0000","last_active":"2023-10-09T06:25:47.851348+0000","last_peered":"2023-10-09T06:25:47.851348+0000","last_clean":"2023-10-09T06:25:47.851348+0000","last_became_active":"2023-10-09T06:25:47.851175+0000","last_became_peered":"2023-10-09T06:25:47.851175+0000","last_unstale":"2023-10-09T06:25:47.851348+0000","last_undegraded":"2023-10-09T06:25:47.851348+0000","last_fullsized":"2023-10-09T06:25:47.851348+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:24.614225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843934+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.847988+0000","last_change":"2023-10-09T06:25:47.847988+0000","last_active":"2023-10-09T06:25:47.847988+0000","last_peered":"2023-10-09T06:25:47.847988+0000","last_clean":"2023-10-09T06:25:47.847988+0000","last_became_active":"2023-10-09T06:25:47.847720+0000","last_became_peered":"2023-10-09T06:25:47.847720+0000","last_unstale":"2023-10-09T06:25:47.847988+0000","last_undegraded":"2023-10-09T06:25:47.847988+0000","last_fullsized":"2023-10-09T06:25:47.847988+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:44.660413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848971+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849760+0000","last_change":"2023-10-09T06:25:47.849760+0000","last_active":"2023-10-09T06:25:47.849760+0000","last_peered":"2023-10-09T06:25:47.849760+0000","last_clean":"2023-10-09T06:25:47.849760+0000","last_became_active":"2023-10-09T06:25:47.849254+0000","last_became_peered":"2023-10-09T06:25:47.849254+0000","last_unstale":"2023-10-09T06:25:47.849760+0000","last_undegraded":"2023-10-09T06:25:47.849760+0000","last_fullsized":"2023-10-09T06:25:47.849760+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:05:38.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841441+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851090+0000","last_change":"2023-10-09T06:25:47.851090+0000","last_active":"2023-10-09T06:25:47.851090+0000","last_peered":"2023-10-09T06:25:47.851090+0000","last_clean":"2023-10-09T06:25:47.851090+0000","last_became_active":"2023-10-09T06:25:47.850476+0000","last_became_peered":"2023-10-09T06:25:47.850476+0000","last_unstale":"2023-10-09T06:25:47.851090+0000","last_undegraded":"2023-10-09T06:25:47.851090+0000","last_fullsized":"2023-10-09T06:25:47.851090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:10.729010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.842951+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:30.810531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855007+0000","last_change":"2023-10-09T06:25:47.855007+0000","last_active":"2023-10-09T06:25:47.855007+0000","last_peered":"2023-10-09T06:25:47.855007+0000","last_clean":"2023-10-09T06:25:47.855007+0000","last_became_active":"2023-10-09T06:25:47.854175+0000","last_became_peered":"2023-10-09T06:25:47.854175+0000","last_unstale":"2023-10-09T06:25:47.855007+0000","last_undegraded":"2023-10-09T06:25:47.855007+0000","last_fullsized":"2023-10-09T06:25:47.855007+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:18.208465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846419+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851947+0000","last_change":"2023-10-09T06:25:47.851947+0000","last_active":"2023-10-09T06:25:47.851947+0000","last_peered":"2023-10-09T06:25:47.851947+0000","last_clean":"2023-10-09T06:25:47.851947+0000","last_became_active":"2023-10-09T06:25:47.851716+0000","last_became_peered":"2023-10-09T06:25:47.851716+0000","last_unstale":"2023-10-09T06:25:47.851947+0000","last_undegraded":"2023-10-09T06:25:47.851947+0000","last_fullsized":"2023-10-09T06:25:47.851947+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:33.781182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845968+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.852812+0000","last_change":"2023-10-09T06:25:47.852812+0000","last_active":"2023-10-09T06:25:47.852812+0000","last_peered":"2023-10-09T06:25:47.852812+0000","last_clean":"2023-10-09T06:25:47.852812+0000","last_became_active":"2023-10-09T06:25:47.852370+0000","last_became_peered":"2023-10-09T06:25:47.852370+0000","last_unstale":"2023-10-09T06:25:47.852812+0000","last_undegraded":"2023-10-09T06:25:47.852812+0000","last_fullsized":"2023-10-09T06:25:47.852812+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:33.781182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845338+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:51.475186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.853329+0000","last_change":"2023-10-09T06:25:47.853329+0000","last_active":"2023-10-09T06:25:47.853329+0000","last_peered":"2023-10-09T06:25:47.853329+0000","last_clean":"2023-10-09T06:25:47.853329+0000","last_became_active":"2023-10-09T06:25:47.853093+0000","last_became_peered":"2023-10-09T06:25:47.853093+0000","last_unstale":"2023-10-09T06:25:47.853329+0000","last_undegraded":"2023-10-09T06:25:47.853329+0000","last_fullsized":"2023-10-09T06:25:47.853329+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:29.807202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":231,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T06:25:46.843032+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:25:46.843032+0000","last_peered":"2023-10-09T06:25:46.843032+0000","last_clean":"2023-10-09T06:25:46.843032+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:25:46.843032+0000","last_undegraded":"2023-10-09T06:25:46.843032+0000","last_fullsized":"2023-10-09T06:25:46.843032+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1098,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198875132,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82599999999999996,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.91200000000000003,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76800000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.746},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53100000000000003,"15min":0.50600000000000001},"min":{"1min":0.35199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75800000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.57399999999999995},"min":{"1min":0.44700000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81399999999999995,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.53600000000000003},"min":{"1min":0.45000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80600000000000005,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.64700000000000002,"15min":0.57899999999999996},"min":{"1min":0.45900000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.56299999999999994},"min":{"1min":0.46000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71299999999999997,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.78200000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46800000000000003,"15min":0.47299999999999998},"min":{"1min":0.27200000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.31900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.72699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.34000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.91400000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.86799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":515,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194796,"statfs":{"total":200000000,"available":199471763,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.66100000000000003,"15min":0.79100000000000004},"min":{"1min":0.35199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77100000000000002,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.38100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":1.133,"15min":1.133},"last":0.40799999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.47299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72699999999999998,"5min":1.155,"15min":1.155},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71599999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72599999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.68000000000000005,"15min":0.80000000000000004},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.78900000000000003,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58299999999999996,"15min":0.60099999999999998},"min":{"1min":0.46200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":1.337,"15min":1.337},"last":0.496},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":1.206,"15min":1.206},"last":0.48299999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.497,"15min":0.497},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45000000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47399999999999998},"min":{"1min":0.377,"5min":0.315,"15min":0.315},"max":{"1min":0.69499999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.438},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46600000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.36599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.254,"5min":0.219,"15min":0.219},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.37},{"interface":"front","average":{"1min":0.434,"5min":0.35999999999999999,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.28999999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.26300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.39700000000000002,"15min":0.38500000000000001},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.40500000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.436,"15min":0.41199999999999998},"min":{"1min":0.35899999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.442,"15min":0.42799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.56000000000000005},"min":{"1min":0.43099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.72499999999999998,"15min":0.82899999999999996},"min":{"1min":0.47399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90200000000000002,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64500000000000002,"15min":0.625},"min":{"1min":0.47099999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66000000000000003,"15min":0.66800000000000004},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.175,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64000000000000001,"15min":0.61799999999999999},"min":{"1min":0.51700000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.48599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0189999999999999,"5min":1.49,"15min":1.49},"last":0.73899999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.52300000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67200000000000004,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.84799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1098,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198875132,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.41399999999999998},"min":{"1min":0.23599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.50600000000000001,"5min":1.226,"15min":1.226},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.54900000000000004,"5min":1.131,"15min":1.131},"last":0.29299999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.55700000000000005,"15min":0.99399999999999999},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":12.929,"15min":12.929},"last":0.313},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.438,"15min":0.46300000000000002},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.55000000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.47699999999999998},"min":{"1min":0.32200000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.749,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45300000000000001,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.314,"15min":0.314},"max":{"1min":0.57399999999999995,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.628,"15min":0.65600000000000003},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97099999999999997,"5min":1.335,"15min":1.335},"last":0.629}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90700000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.495},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.81499999999999995,"5min":0.999,"15min":0.999},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83099999999999996,"5min":0.998,"15min":0.998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65400000000000003,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.262,"15min":1.262},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.67000000000000004},"min":{"1min":0.52100000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.95599999999999996,"5min":1.103,"15min":1.103},"last":0.59899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.5,"15min":0.88600000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.48599999999999999,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.312},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.46200000000000002,"15min":0.67400000000000004},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57099999999999995,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.436,"15min":0.63400000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68000000000000005,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.53600000000000003,"15min":0.70399999999999996},"min":{"1min":0.28299999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.91400000000000003,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.33700000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.51700000000000002,"15min":0.70699999999999996},"min":{"1min":0.30299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70299999999999996,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.371},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.58299999999999996,"15min":0.94599999999999995},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.77000000000000002,"15min":1.1459999999999999},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.95299999999999996,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.71899999999999997,"15min":0.93100000000000005},"min":{"1min":0.46700000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1160000000000001,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.61299999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.90600000000000003},"min":{"1min":0.432,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93600000000000005,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72299999999999998,"15min":0.91300000000000003},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.006,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.625}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.71099999999999997,"15min":0.89500000000000002},"min":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95599999999999996,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.78600000000000003,"15min":1.1439999999999999},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.028,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70099999999999996,"15min":0.89100000000000001},"min":{"1min":0.44600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85299999999999998,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72099999999999997,"15min":0.90800000000000003},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0609999999999999,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.52200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.33800000000000002,"15min":0.32600000000000001},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.499,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39500000000000002,"15min":0.375},"min":{"1min":0.33100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33800000000000002,"15min":0.32200000000000001},"min":{"1min":0.255,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.36899999999999999,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.314}]},{"osd":2,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.373,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.373},{"interface":"front","average":{"1min":0.502,"5min":0.44,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64600000000000002,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.38500000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46800000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82399999999999995,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.875,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.45100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.73999999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80600000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51700000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.58199999999999996},"min":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":0.87,"15min":0.87},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.51900000000000002,"15min":0.49399999999999999},"min":{"1min":0.46100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.40100000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65100000000000002,"15min":0.72499999999999998},"min":{"1min":0.39500000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72899999999999998,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.38500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.64200000000000002,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.68200000000000005,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.84899999999999998,"15min":1.125},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":11.715,"15min":11.715},"last":0.43099999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.56000000000000005,"15min":0.52400000000000002},"min":{"1min":0.53300000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.51700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73499999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54500000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53100000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50600000000000001,"15min":0.503},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55400000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.499},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":515,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194796,"statfs":{"total":200000000,"available":199471763,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.48999999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68899999999999995,"5min":1.093,"15min":1.093},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.51200000000000001},"min":{"1min":0.44400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.67100000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76300000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.77600000000000002,"5min":1.071,"15min":1.071},"last":0.64000000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66000000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48399999999999999,"15min":0.501},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.624,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.755}]},{"osd":6,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.50600000000000001,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64400000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.36399999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.67800000000000005,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65400000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64600000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.84399999999999997}]}]}],"pool_statfs":[]}} 2023-10-09T06:25:52.972 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:25:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.123+0000 7fadef223700 1 Processor -- start 2023-10-09T06:25:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.123+0000 7fadef223700 1 -- start start 2023-10-09T06:25:53.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.124+0000 7fadef223700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fade80cffa0 0x7fade806a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.124+0000 7fadef223700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade80b3d40 con 0x7fade8159e60 2023-10-09T06:25:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.124+0000 7fadef223700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade80b4300 con 0x7fade815a230 2023-10-09T06:25:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.124+0000 7fadef223700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade8069d70 con 0x7fade80cffa0 2023-10-09T06:25:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.124+0000 7fade7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fade80cffa0 0x7fade806a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.124+0000 7fadecfbf700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fade8159e60 0x7fade80b6890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52418/0 (socket says 172.21.15.31:52418) 2023-10-09T06:25:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.124+0000 7fade7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fade80cffa0 0x7fade806a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43172/0 (socket says 172.21.15.31:43172) 2023-10-09T06:25:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.124+0000 7fadecfbf700 1 -- 172.21.15.31:0/3390260497 learned_addr learned my addr 172.21.15.31:0/3390260497 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.124+0000 7fade7fff700 1 -- 172.21.15.31:0/3390260497 >> v1:172.21.15.158:6789/0 conn(0x7fade815a230 legacy=0x7fade8163c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.124+0000 7fade7fff700 1 -- 172.21.15.31:0/3390260497 >> v1:172.21.15.31:6789/0 conn(0x7fade8159e60 legacy=0x7fade80b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.125+0000 7fade7fff700 1 -- 172.21.15.31:0/3390260497 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade80d0480 con 0x7fade80cffa0 2023-10-09T06:25:53.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.124+0000 7fade77fe700 1 -- 172.21.15.31:0/3390260497 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531728492 0 0) 0x7fade80b3d40 con 0x7fade8159e60 2023-10-09T06:25:53.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.125+0000 7fade7fff700 1 --2- 172.21.15.31:0/3390260497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade80cffa0 0x7fade806a6a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009e60 tx=0x7fadd8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd552cfff0a9651c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:53.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.125+0000 7fade77fe700 1 -- 172.21.15.31:0/3390260497 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd800e070 con 0x7fade80cffa0 2023-10-09T06:25:53.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.125+0000 7fade77fe700 1 -- 172.21.15.31:0/3390260497 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd800bc30 con 0x7fade80cffa0 2023-10-09T06:25:53.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.125+0000 7fade77fe700 1 -- 172.21.15.31:0/3390260497 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8012430 con 0x7fade80cffa0 2023-10-09T06:25:53.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.125+0000 7fadef223700 1 -- 172.21.15.31:0/3390260497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade80cffa0 msgr2=0x7fade806a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.125+0000 7fadef223700 1 --2- 172.21.15.31:0/3390260497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade80cffa0 0x7fade806a6a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009e60 tx=0x7fadd8009780 comp rx=0 tx=0).stop 2023-10-09T06:25:53.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.125+0000 7fadef223700 1 -- 172.21.15.31:0/3390260497 shutdown_connections 2023-10-09T06:25:53.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.125+0000 7fadef223700 1 --2- 172.21.15.31:0/3390260497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade80cffa0 0x7fade806a6a0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.125+0000 7fadef223700 1 -- 172.21.15.31:0/3390260497 >> 172.21.15.31:0/3390260497 conn(0x7fade80d1a50 msgr2=0x7fade8068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:53.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.126+0000 7fadef223700 1 -- 172.21.15.31:0/3390260497 shutdown_connections 2023-10-09T06:25:53.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.126+0000 7fadef223700 1 -- 172.21.15.31:0/3390260497 wait complete. 2023-10-09T06:25:53.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.127+0000 7fadef223700 1 Processor -- start 2023-10-09T06:25:53.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.127+0000 7fadef223700 1 -- start start 2023-10-09T06:25:53.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.127+0000 7fadef223700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade80cffa0 0x7fade8157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.127+0000 7fadef223700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fade8159e60 0x7fade8151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.127+0000 7fadef223700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade815a230 0x7fade80b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7fadef223700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade8158b10 con 0x7fade815a230 2023-10-09T06:25:53.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7fadef223700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade815b8b0 con 0x7fade8159e60 2023-10-09T06:25:53.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7fadef223700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade8158830 con 0x7fade80cffa0 2023-10-09T06:25:53.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7faded7c0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade815a230 0x7fade80b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7faded7c0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade815a230 0x7fade80b07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43176/0 (socket says 172.21.15.31:43176) 2023-10-09T06:25:53.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7faded7c0700 1 -- 172.21.15.31:0/3970954835 learned_addr learned my addr 172.21.15.31:0/3970954835 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:53.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7fadecfbf700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade80cffa0 0x7fade8157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7fade7fff700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fade8159e60 0x7fade8151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7faded7c0700 1 -- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade80cffa0 msgr2=0x7fade8157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7faded7c0700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade80cffa0 0x7fade8157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7faded7c0700 1 -- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fade8159e60 msgr2=0x7fade8151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7faded7c0700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fade8159e60 0x7fade8151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7faded7c0700 1 -- 172.21.15.31:0/3970954835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd8009a20 con 0x7fade815a230 2023-10-09T06:25:53.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7faded7c0700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade815a230 0x7fade80b07d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fadd000c4c0 tx=0x7fadd0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:53.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7fade4ff9700 1 -- 172.21.15.31:0/3970954835 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0011590 con 0x7fade815a230 2023-10-09T06:25:53.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7fade4ff9700 1 -- 172.21.15.31:0/3970954835 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd0011710 con 0x7fade815a230 2023-10-09T06:25:53.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7fade4ff9700 1 -- 172.21.15.31:0/3970954835 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0011ad0 con 0x7fade815a230 2023-10-09T06:25:53.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7fadef223700 1 -- 172.21.15.31:0/3970954835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade815b260 con 0x7fade815a230 2023-10-09T06:25:53.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.128+0000 7fadef223700 1 -- 172.21.15.31:0/3970954835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade8158500 con 0x7fade815a230 2023-10-09T06:25:53.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.129+0000 7fadef223700 1 -- 172.21.15.31:0/3970954835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade815b0c0 con 0x7fade815a230 2023-10-09T06:25:53.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.130+0000 7fade4ff9700 1 -- 172.21.15.31:0/3970954835 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadd001b3b0 con 0x7fade815a230 2023-10-09T06:25:53.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.130+0000 7fade4ff9700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fadc8066f30 0x7fadc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.130+0000 7fade4ff9700 1 -- 172.21.15.31:0/3970954835 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fadd00839b0 con 0x7fade815a230 2023-10-09T06:25:53.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.130+0000 7fadecfbf700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fadc8066f30 0x7fadc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.131+0000 7fadecfbf700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fadc8066f30 0x7fadc80693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fade0007fd0 tx=0x7fade0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:53.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.134+0000 7fade4ff9700 1 -- 172.21.15.31:0/3970954835 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fade815b0c0 con 0x7fade815a230 2023-10-09T06:25:53.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.324+0000 7fadef223700 1 -- 172.21.15.31:0/3970954835 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fade815b0c0 con 0x7fadc8066f30 2023-10-09T06:25:53.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.332+0000 7fade4ff9700 1 -- 172.21.15.31:0/3970954835 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281842 (secure 0 0 0) 0x7fade815b0c0 con 0x7fadc8066f30 2023-10-09T06:25:53.336 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:53.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.335+0000 7fadef223700 1 -- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fadc8066f30 msgr2=0x7fadc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.335+0000 7fadef223700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fadc8066f30 0x7fadc80693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fade0007fd0 tx=0x7fade0009040 comp rx=0 tx=0).stop 2023-10-09T06:25:53.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.335+0000 7fadef223700 1 -- 172.21.15.31:0/3970954835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade815a230 msgr2=0x7fade80b07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.335+0000 7fadef223700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade815a230 0x7fade80b07d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fadd000c4c0 tx=0x7fadd0007f50 comp rx=0 tx=0).stop 2023-10-09T06:25:53.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.335+0000 7fadef223700 1 -- 172.21.15.31:0/3970954835 shutdown_connections 2023-10-09T06:25:53.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.335+0000 7fadef223700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fadc8066f30 0x7fadc80693e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.335+0000 7fadef223700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fade80cffa0 0x7fade8157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.335+0000 7fadef223700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade815a230 0x7fade80b07d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.335+0000 7fadef223700 1 --2- 172.21.15.31:0/3970954835 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fade8159e60 0x7fade8151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.335+0000 7fadef223700 1 -- 172.21.15.31:0/3970954835 >> 172.21.15.31:0/3970954835 conn(0x7fade80d1a50 msgr2=0x7fade80b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:53.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.336+0000 7fadef223700 1 -- 172.21.15.31:0/3970954835 shutdown_connections 2023-10-09T06:25:53.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.336+0000 7fadef223700 1 -- 172.21.15.31:0/3970954835 wait complete. 2023-10-09T06:25:53.339 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:25:53.348 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2023-10-09T06:25:52.588628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557183,"statfs":{"total":1600000000,"available":1594555790,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.750821"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843722+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:02.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846354+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:22:43.722563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847525+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:17.876832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848532+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:18.557206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846861+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:42.447136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841618+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847409+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:11.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.842300+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841871+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.945766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843529+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:33.951783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845884+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:39.017793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843265+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:03.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846965+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:21.991307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848134+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:10.690323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.849314+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:54.261243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846027+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:54:53.637423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.853432+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:43.433850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847291+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:47.595844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843183+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846879+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:40:43.836644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846733+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:05:08.101768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846057+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:48.507408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845561+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845926+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:36.957766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846840+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:12.934950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847443+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:43.433850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.849110+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.945766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846713+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847472+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:16.753156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845309+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:29.732017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845612+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:47:03.231614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843744+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:42.447136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848336+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851455+0000","last_change":"2023-10-09T06:25:47.851455+0000","last_active":"2023-10-09T06:25:47.851455+0000","last_peered":"2023-10-09T06:25:47.851455+0000","last_clean":"2023-10-09T06:25:47.851455+0000","last_became_active":"2023-10-09T06:25:47.851203+0000","last_became_peered":"2023-10-09T06:25:47.851203+0000","last_unstale":"2023-10-09T06:25:47.851455+0000","last_undegraded":"2023-10-09T06:25:47.851455+0000","last_fullsized":"2023-10-09T06:25:47.851455+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:11.772590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846339+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:30.810531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.854438+0000","last_change":"2023-10-09T06:25:47.854438+0000","last_active":"2023-10-09T06:25:47.854438+0000","last_peered":"2023-10-09T06:25:47.854438+0000","last_clean":"2023-10-09T06:25:47.854438+0000","last_became_active":"2023-10-09T06:25:47.854221+0000","last_became_peered":"2023-10-09T06:25:47.854221+0000","last_unstale":"2023-10-09T06:25:47.854438+0000","last_undegraded":"2023-10-09T06:25:47.854438+0000","last_fullsized":"2023-10-09T06:25:47.854438+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:05:38.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843221+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:54:53.637423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849059+0000","last_change":"2023-10-09T06:25:47.849059+0000","last_active":"2023-10-09T06:25:47.849059+0000","last_peered":"2023-10-09T06:25:47.849059+0000","last_clean":"2023-10-09T06:25:47.849059+0000","last_became_active":"2023-10-09T06:25:47.848790+0000","last_became_peered":"2023-10-09T06:25:47.848790+0000","last_unstale":"2023-10-09T06:25:47.849059+0000","last_undegraded":"2023-10-09T06:25:47.849059+0000","last_fullsized":"2023-10-09T06:25:47.849059+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:26.169034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847938+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.349968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849726+0000","last_change":"2023-10-09T06:25:47.849726+0000","last_active":"2023-10-09T06:25:47.849726+0000","last_peered":"2023-10-09T06:25:47.849726+0000","last_clean":"2023-10-09T06:25:47.849726+0000","last_became_active":"2023-10-09T06:25:47.849461+0000","last_became_peered":"2023-10-09T06:25:47.849461+0000","last_unstale":"2023-10-09T06:25:47.849726+0000","last_undegraded":"2023-10-09T06:25:47.849726+0000","last_fullsized":"2023-10-09T06:25:47.849726+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:41.443808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846130+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:26:52.798323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855263+0000","last_change":"2023-10-09T06:25:47.855263+0000","last_active":"2023-10-09T06:25:47.855263+0000","last_peered":"2023-10-09T06:25:47.855263+0000","last_clean":"2023-10-09T06:25:47.855263+0000","last_became_active":"2023-10-09T06:25:47.854779+0000","last_became_peered":"2023-10-09T06:25:47.854779+0000","last_unstale":"2023-10-09T06:25:47.855263+0000","last_undegraded":"2023-10-09T06:25:47.855263+0000","last_fullsized":"2023-10-09T06:25:47.855263+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.013764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.852995+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:21.991307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855905+0000","last_change":"2023-10-09T06:25:47.855905+0000","last_active":"2023-10-09T06:25:47.855905+0000","last_peered":"2023-10-09T06:25:47.855905+0000","last_clean":"2023-10-09T06:25:47.855905+0000","last_became_active":"2023-10-09T06:25:47.855664+0000","last_became_peered":"2023-10-09T06:25:47.855664+0000","last_unstale":"2023-10-09T06:25:47.855905+0000","last_undegraded":"2023-10-09T06:25:47.855905+0000","last_fullsized":"2023-10-09T06:25:47.855905+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:08.735859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848298+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:16.986469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.845607+0000","last_change":"2023-10-09T06:25:47.845607+0000","last_active":"2023-10-09T06:25:47.845607+0000","last_peered":"2023-10-09T06:25:47.845607+0000","last_clean":"2023-10-09T06:25:47.845607+0000","last_became_active":"2023-10-09T06:25:47.845108+0000","last_became_peered":"2023-10-09T06:25:47.845108+0000","last_unstale":"2023-10-09T06:25:47.845607+0000","last_undegraded":"2023-10-09T06:25:47.845607+0000","last_fullsized":"2023-10-09T06:25:47.845607+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:32.948454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848477+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:47:14.813193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.852047+0000","last_change":"2023-10-09T06:25:47.852047+0000","last_active":"2023-10-09T06:25:47.852047+0000","last_peered":"2023-10-09T06:25:47.852047+0000","last_clean":"2023-10-09T06:25:47.852047+0000","last_became_active":"2023-10-09T06:25:47.851541+0000","last_became_peered":"2023-10-09T06:25:47.851541+0000","last_unstale":"2023-10-09T06:25:47.852047+0000","last_undegraded":"2023-10-09T06:25:47.852047+0000","last_fullsized":"2023-10-09T06:25:47.852047+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:35.643402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848413+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:21.766447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849277+0000","last_change":"2023-10-09T06:25:47.849277+0000","last_active":"2023-10-09T06:25:47.849277+0000","last_peered":"2023-10-09T06:25:47.849277+0000","last_clean":"2023-10-09T06:25:47.849277+0000","last_became_active":"2023-10-09T06:25:47.849037+0000","last_became_peered":"2023-10-09T06:25:47.849037+0000","last_unstale":"2023-10-09T06:25:47.849277+0000","last_undegraded":"2023-10-09T06:25:47.849277+0000","last_fullsized":"2023-10-09T06:25:47.849277+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.013764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841231+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.854169+0000","last_change":"2023-10-09T06:25:47.854169+0000","last_active":"2023-10-09T06:25:47.854169+0000","last_peered":"2023-10-09T06:25:47.854169+0000","last_clean":"2023-10-09T06:25:47.854169+0000","last_became_active":"2023-10-09T06:25:47.853941+0000","last_became_peered":"2023-10-09T06:25:47.853941+0000","last_unstale":"2023-10-09T06:25:47.854169+0000","last_undegraded":"2023-10-09T06:25:47.854169+0000","last_fullsized":"2023-10-09T06:25:47.854169+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:18.208465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.842801+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.848404+0000","last_change":"2023-10-09T06:25:47.848404+0000","last_active":"2023-10-09T06:25:47.848404+0000","last_peered":"2023-10-09T06:25:47.848404+0000","last_clean":"2023-10-09T06:25:47.848404+0000","last_became_active":"2023-10-09T06:25:47.847936+0000","last_became_peered":"2023-10-09T06:25:47.847936+0000","last_unstale":"2023-10-09T06:25:47.848404+0000","last_undegraded":"2023-10-09T06:25:47.848404+0000","last_fullsized":"2023-10-09T06:25:47.848404+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:29.780809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846566+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:33.951783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.842724+0000","last_change":"2023-10-09T06:25:47.842724+0000","last_active":"2023-10-09T06:25:47.842724+0000","last_peered":"2023-10-09T06:25:47.842724+0000","last_clean":"2023-10-09T06:25:47.842724+0000","last_became_active":"2023-10-09T06:25:47.842472+0000","last_became_peered":"2023-10-09T06:25:47.842472+0000","last_unstale":"2023-10-09T06:25:47.842724+0000","last_undegraded":"2023-10-09T06:25:47.842724+0000","last_fullsized":"2023-10-09T06:25:47.842724+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:02.106046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843292+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.847553+0000","last_change":"2023-10-09T06:25:47.847553+0000","last_active":"2023-10-09T06:25:47.847553+0000","last_peered":"2023-10-09T06:25:47.847553+0000","last_clean":"2023-10-09T06:25:47.847553+0000","last_became_active":"2023-10-09T06:25:47.847331+0000","last_became_peered":"2023-10-09T06:25:47.847331+0000","last_unstale":"2023-10-09T06:25:47.847553+0000","last_undegraded":"2023-10-09T06:25:47.847553+0000","last_fullsized":"2023-10-09T06:25:47.847553+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:53.459647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847544+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:04.966793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.848332+0000","last_change":"2023-10-09T06:25:47.848332+0000","last_active":"2023-10-09T06:25:47.848332+0000","last_peered":"2023-10-09T06:25:47.848332+0000","last_clean":"2023-10-09T06:25:47.848332+0000","last_became_active":"2023-10-09T06:25:47.848047+0000","last_became_peered":"2023-10-09T06:25:47.848047+0000","last_unstale":"2023-10-09T06:25:47.848332+0000","last_undegraded":"2023-10-09T06:25:47.848332+0000","last_fullsized":"2023-10-09T06:25:47.848332+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:11.346640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845382+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:25.089742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855073+0000","last_change":"2023-10-09T06:25:47.855073+0000","last_active":"2023-10-09T06:25:47.855073+0000","last_peered":"2023-10-09T06:25:47.855073+0000","last_clean":"2023-10-09T06:25:47.855073+0000","last_became_active":"2023-10-09T06:25:47.854877+0000","last_became_peered":"2023-10-09T06:25:47.854877+0000","last_unstale":"2023-10-09T06:25:47.855073+0000","last_undegraded":"2023-10-09T06:25:47.855073+0000","last_fullsized":"2023-10-09T06:25:47.855073+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:32.948454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845712+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:55.341469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851026+0000","last_change":"2023-10-09T06:25:47.851026+0000","last_active":"2023-10-09T06:25:47.851026+0000","last_peered":"2023-10-09T06:25:47.851026+0000","last_clean":"2023-10-09T06:25:47.851026+0000","last_became_active":"2023-10-09T06:25:47.850820+0000","last_became_peered":"2023-10-09T06:25:47.850820+0000","last_unstale":"2023-10-09T06:25:47.851026+0000","last_undegraded":"2023-10-09T06:25:47.851026+0000","last_fullsized":"2023-10-09T06:25:47.851026+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:01.086319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846911+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850149+0000","last_change":"2023-10-09T06:25:47.850149+0000","last_active":"2023-10-09T06:25:47.850149+0000","last_peered":"2023-10-09T06:25:47.850149+0000","last_clean":"2023-10-09T06:25:47.850149+0000","last_became_active":"2023-10-09T06:25:47.849942+0000","last_became_peered":"2023-10-09T06:25:47.849942+0000","last_unstale":"2023-10-09T06:25:47.850149+0000","last_undegraded":"2023-10-09T06:25:47.850149+0000","last_fullsized":"2023-10-09T06:25:47.850149+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:08.735859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.844415+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850579+0000","last_change":"2023-10-09T06:25:47.850579+0000","last_active":"2023-10-09T06:25:47.850579+0000","last_peered":"2023-10-09T06:25:47.850579+0000","last_clean":"2023-10-09T06:25:47.850579+0000","last_became_active":"2023-10-09T06:25:47.850361+0000","last_became_peered":"2023-10-09T06:25:47.850361+0000","last_unstale":"2023-10-09T06:25:47.850579+0000","last_undegraded":"2023-10-09T06:25:47.850579+0000","last_fullsized":"2023-10-09T06:25:47.850579+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:48.069765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845198+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:12.775919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.848106+0000","last_change":"2023-10-09T06:25:47.848106+0000","last_active":"2023-10-09T06:25:47.848106+0000","last_peered":"2023-10-09T06:25:47.848106+0000","last_clean":"2023-10-09T06:25:47.848106+0000","last_became_active":"2023-10-09T06:25:47.847818+0000","last_became_peered":"2023-10-09T06:25:47.847818+0000","last_unstale":"2023-10-09T06:25:47.848106+0000","last_undegraded":"2023-10-09T06:25:47.848106+0000","last_fullsized":"2023-10-09T06:25:47.848106+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:02.106046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845529+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:09.795315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.842874+0000","last_change":"2023-10-09T06:25:47.842874+0000","last_active":"2023-10-09T06:25:47.842874+0000","last_peered":"2023-10-09T06:25:47.842874+0000","last_clean":"2023-10-09T06:25:47.842874+0000","last_became_active":"2023-10-09T06:25:47.842648+0000","last_became_peered":"2023-10-09T06:25:47.842648+0000","last_unstale":"2023-10-09T06:25:47.842874+0000","last_undegraded":"2023-10-09T06:25:47.842874+0000","last_fullsized":"2023-10-09T06:25:47.842874+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:15.983140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841909+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.846610+0000","last_change":"2023-10-09T06:25:47.846610+0000","last_active":"2023-10-09T06:25:47.846610+0000","last_peered":"2023-10-09T06:25:47.846610+0000","last_clean":"2023-10-09T06:25:47.846610+0000","last_became_active":"2023-10-09T06:25:47.846390+0000","last_became_peered":"2023-10-09T06:25:47.846390+0000","last_unstale":"2023-10-09T06:25:47.846610+0000","last_undegraded":"2023-10-09T06:25:47.846610+0000","last_fullsized":"2023-10-09T06:25:47.846610+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:45.550797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846133+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:54:51.114943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.847568+0000","last_change":"2023-10-09T06:25:47.847568+0000","last_active":"2023-10-09T06:25:47.847568+0000","last_peered":"2023-10-09T06:25:47.847568+0000","last_clean":"2023-10-09T06:25:47.847568+0000","last_became_active":"2023-10-09T06:25:47.847337+0000","last_became_peered":"2023-10-09T06:25:47.847337+0000","last_unstale":"2023-10-09T06:25:47.847568+0000","last_undegraded":"2023-10-09T06:25:47.847568+0000","last_fullsized":"2023-10-09T06:25:47.847568+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:27.334050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841126+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:02.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850759+0000","last_change":"2023-10-09T06:25:47.850759+0000","last_active":"2023-10-09T06:25:47.850759+0000","last_peered":"2023-10-09T06:25:47.850759+0000","last_clean":"2023-10-09T06:25:47.850759+0000","last_became_active":"2023-10-09T06:25:47.850307+0000","last_became_peered":"2023-10-09T06:25:47.850307+0000","last_unstale":"2023-10-09T06:25:47.850759+0000","last_undegraded":"2023-10-09T06:25:47.850759+0000","last_fullsized":"2023-10-09T06:25:47.850759+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:16.873504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846156+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:03.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850946+0000","last_change":"2023-10-09T06:25:47.850946+0000","last_active":"2023-10-09T06:25:47.850946+0000","last_peered":"2023-10-09T06:25:47.850946+0000","last_clean":"2023-10-09T06:25:47.850946+0000","last_became_active":"2023-10-09T06:25:47.850152+0000","last_became_peered":"2023-10-09T06:25:47.850152+0000","last_unstale":"2023-10-09T06:25:47.850946+0000","last_undegraded":"2023-10-09T06:25:47.850946+0000","last_fullsized":"2023-10-09T06:25:47.850946+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:45.813982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847416+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:23:39.868860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851348+0000","last_change":"2023-10-09T06:25:47.851348+0000","last_active":"2023-10-09T06:25:47.851348+0000","last_peered":"2023-10-09T06:25:47.851348+0000","last_clean":"2023-10-09T06:25:47.851348+0000","last_became_active":"2023-10-09T06:25:47.851175+0000","last_became_peered":"2023-10-09T06:25:47.851175+0000","last_unstale":"2023-10-09T06:25:47.851348+0000","last_undegraded":"2023-10-09T06:25:47.851348+0000","last_fullsized":"2023-10-09T06:25:47.851348+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:24.614225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843934+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.847988+0000","last_change":"2023-10-09T06:25:47.847988+0000","last_active":"2023-10-09T06:25:47.847988+0000","last_peered":"2023-10-09T06:25:47.847988+0000","last_clean":"2023-10-09T06:25:47.847988+0000","last_became_active":"2023-10-09T06:25:47.847720+0000","last_became_peered":"2023-10-09T06:25:47.847720+0000","last_unstale":"2023-10-09T06:25:47.847988+0000","last_undegraded":"2023-10-09T06:25:47.847988+0000","last_fullsized":"2023-10-09T06:25:47.847988+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:44.660413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848971+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849760+0000","last_change":"2023-10-09T06:25:47.849760+0000","last_active":"2023-10-09T06:25:47.849760+0000","last_peered":"2023-10-09T06:25:47.849760+0000","last_clean":"2023-10-09T06:25:47.849760+0000","last_became_active":"2023-10-09T06:25:47.849254+0000","last_became_peered":"2023-10-09T06:25:47.849254+0000","last_unstale":"2023-10-09T06:25:47.849760+0000","last_undegraded":"2023-10-09T06:25:47.849760+0000","last_fullsized":"2023-10-09T06:25:47.849760+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:05:38.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841441+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851090+0000","last_change":"2023-10-09T06:25:47.851090+0000","last_active":"2023-10-09T06:25:47.851090+0000","last_peered":"2023-10-09T06:25:47.851090+0000","last_clean":"2023-10-09T06:25:47.851090+0000","last_became_active":"2023-10-09T06:25:47.850476+0000","last_became_peered":"2023-10-09T06:25:47.850476+0000","last_unstale":"2023-10-09T06:25:47.851090+0000","last_undegraded":"2023-10-09T06:25:47.851090+0000","last_fullsized":"2023-10-09T06:25:47.851090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:10.729010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.842951+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:30.810531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855007+0000","last_change":"2023-10-09T06:25:47.855007+0000","last_active":"2023-10-09T06:25:47.855007+0000","last_peered":"2023-10-09T06:25:47.855007+0000","last_clean":"2023-10-09T06:25:47.855007+0000","last_became_active":"2023-10-09T06:25:47.854175+0000","last_became_peered":"2023-10-09T06:25:47.854175+0000","last_unstale":"2023-10-09T06:25:47.855007+0000","last_undegraded":"2023-10-09T06:25:47.855007+0000","last_fullsized":"2023-10-09T06:25:47.855007+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:18.208465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846419+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851947+0000","last_change":"2023-10-09T06:25:47.851947+0000","last_active":"2023-10-09T06:25:47.851947+0000","last_peered":"2023-10-09T06:25:47.851947+0000","last_clean":"2023-10-09T06:25:47.851947+0000","last_became_active":"2023-10-09T06:25:47.851716+0000","last_became_peered":"2023-10-09T06:25:47.851716+0000","last_unstale":"2023-10-09T06:25:47.851947+0000","last_undegraded":"2023-10-09T06:25:47.851947+0000","last_fullsized":"2023-10-09T06:25:47.851947+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:33.781182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845968+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.852812+0000","last_change":"2023-10-09T06:25:47.852812+0000","last_active":"2023-10-09T06:25:47.852812+0000","last_peered":"2023-10-09T06:25:47.852812+0000","last_clean":"2023-10-09T06:25:47.852812+0000","last_became_active":"2023-10-09T06:25:47.852370+0000","last_became_peered":"2023-10-09T06:25:47.852370+0000","last_unstale":"2023-10-09T06:25:47.852812+0000","last_undegraded":"2023-10-09T06:25:47.852812+0000","last_fullsized":"2023-10-09T06:25:47.852812+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:33.781182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845338+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:51.475186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.853329+0000","last_change":"2023-10-09T06:25:47.853329+0000","last_active":"2023-10-09T06:25:47.853329+0000","last_peered":"2023-10-09T06:25:47.853329+0000","last_clean":"2023-10-09T06:25:47.853329+0000","last_became_active":"2023-10-09T06:25:47.853093+0000","last_became_peered":"2023-10-09T06:25:47.853093+0000","last_unstale":"2023-10-09T06:25:47.853329+0000","last_undegraded":"2023-10-09T06:25:47.853329+0000","last_fullsized":"2023-10-09T06:25:47.853329+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:29.807202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":231,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T06:25:46.843032+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:25:46.843032+0000","last_peered":"2023-10-09T06:25:46.843032+0000","last_clean":"2023-10-09T06:25:46.843032+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:25:46.843032+0000","last_undegraded":"2023-10-09T06:25:46.843032+0000","last_fullsized":"2023-10-09T06:25:46.843032+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1098,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198875132,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82599999999999996,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.91200000000000003,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76800000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.746},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53100000000000003,"15min":0.50600000000000001},"min":{"1min":0.35199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75800000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.57399999999999995},"min":{"1min":0.44700000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81399999999999995,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.53600000000000003},"min":{"1min":0.45000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80600000000000005,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.64700000000000002,"15min":0.57899999999999996},"min":{"1min":0.45900000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.56299999999999994},"min":{"1min":0.46000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71299999999999997,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.78200000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46800000000000003,"15min":0.47299999999999998},"min":{"1min":0.27200000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.31900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.72699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.34000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.91400000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.86799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":515,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194796,"statfs":{"total":200000000,"available":199471763,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.66100000000000003,"15min":0.79100000000000004},"min":{"1min":0.35199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77100000000000002,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.38100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":1.133,"15min":1.133},"last":0.40799999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.47299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72699999999999998,"5min":1.155,"15min":1.155},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71599999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72599999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.68000000000000005,"15min":0.80000000000000004},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.78900000000000003,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58299999999999996,"15min":0.60099999999999998},"min":{"1min":0.46200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":1.337,"15min":1.337},"last":0.496},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":1.206,"15min":1.206},"last":0.48299999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.497,"15min":0.497},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45000000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47399999999999998},"min":{"1min":0.377,"5min":0.315,"15min":0.315},"max":{"1min":0.69499999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.438},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46600000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.36599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.254,"5min":0.219,"15min":0.219},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.37},{"interface":"front","average":{"1min":0.434,"5min":0.35999999999999999,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.28999999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.26300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.39700000000000002,"15min":0.38500000000000001},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.40500000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.436,"15min":0.41199999999999998},"min":{"1min":0.35899999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.442,"15min":0.42799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.56000000000000005},"min":{"1min":0.43099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.72499999999999998,"15min":0.82899999999999996},"min":{"1min":0.47399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90200000000000002,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64500000000000002,"15min":0.625},"min":{"1min":0.47099999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66000000000000003,"15min":0.66800000000000004},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.175,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64000000000000001,"15min":0.61799999999999999},"min":{"1min":0.51700000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.48599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0189999999999999,"5min":1.49,"15min":1.49},"last":0.73899999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.52300000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67200000000000004,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.84799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1098,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198875132,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.41399999999999998},"min":{"1min":0.23599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.50600000000000001,"5min":1.226,"15min":1.226},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.54900000000000004,"5min":1.131,"15min":1.131},"last":0.29299999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.55700000000000005,"15min":0.99399999999999999},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":12.929,"15min":12.929},"last":0.313},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.438,"15min":0.46300000000000002},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.55000000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.47699999999999998},"min":{"1min":0.32200000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.749,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45300000000000001,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.314,"15min":0.314},"max":{"1min":0.57399999999999995,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.628,"15min":0.65600000000000003},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97099999999999997,"5min":1.335,"15min":1.335},"last":0.629}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90700000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.495},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.81499999999999995,"5min":0.999,"15min":0.999},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83099999999999996,"5min":0.998,"15min":0.998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65400000000000003,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.262,"15min":1.262},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.67000000000000004},"min":{"1min":0.52100000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.95599999999999996,"5min":1.103,"15min":1.103},"last":0.59899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.5,"15min":0.88600000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.48599999999999999,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.312},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.46200000000000002,"15min":0.67400000000000004},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57099999999999995,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.436,"15min":0.63400000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68000000000000005,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.53600000000000003,"15min":0.70399999999999996},"min":{"1min":0.28299999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.91400000000000003,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.33700000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.51700000000000002,"15min":0.70699999999999996},"min":{"1min":0.30299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70299999999999996,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.371},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.58299999999999996,"15min":0.94599999999999995},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.77000000000000002,"15min":1.1459999999999999},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.95299999999999996,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.71899999999999997,"15min":0.93100000000000005},"min":{"1min":0.46700000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1160000000000001,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.61299999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.90600000000000003},"min":{"1min":0.432,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93600000000000005,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72299999999999998,"15min":0.91300000000000003},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.006,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.625}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.71099999999999997,"15min":0.89500000000000002},"min":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95599999999999996,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.78600000000000003,"15min":1.1439999999999999},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.028,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70099999999999996,"15min":0.89100000000000001},"min":{"1min":0.44600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85299999999999998,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72099999999999997,"15min":0.90800000000000003},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0609999999999999,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.52200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.33800000000000002,"15min":0.32600000000000001},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.499,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39500000000000002,"15min":0.375},"min":{"1min":0.33100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33800000000000002,"15min":0.32200000000000001},"min":{"1min":0.255,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.36899999999999999,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.314}]},{"osd":2,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.373,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.373},{"interface":"front","average":{"1min":0.502,"5min":0.44,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64600000000000002,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.38500000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46800000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82399999999999995,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.875,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.45100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.73999999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80600000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51700000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.58199999999999996},"min":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":0.87,"15min":0.87},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.51900000000000002,"15min":0.49399999999999999},"min":{"1min":0.46100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.40100000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65100000000000002,"15min":0.72499999999999998},"min":{"1min":0.39500000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72899999999999998,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.38500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.64200000000000002,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.68200000000000005,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.84899999999999998,"15min":1.125},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":11.715,"15min":11.715},"last":0.43099999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.56000000000000005,"15min":0.52400000000000002},"min":{"1min":0.53300000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.51700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73499999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54500000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53100000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50600000000000001,"15min":0.503},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55400000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.499},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":515,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194796,"statfs":{"total":200000000,"available":199471763,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.48999999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68899999999999995,"5min":1.093,"15min":1.093},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.51200000000000001},"min":{"1min":0.44400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.67100000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76300000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.77600000000000002,"5min":1.071,"15min":1.071},"last":0.64000000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66000000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48399999999999999,"15min":0.501},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.624,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.755}]},{"osd":6,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.50600000000000001,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64400000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.36399999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.67800000000000005,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65400000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64600000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.84399999999999997}]}]}],"pool_statfs":[]}} 2023-10-09T06:25:53.354 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:25:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.507+0000 7f526e84e700 1 Processor -- start 2023-10-09T06:25:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.507+0000 7f526e84e700 1 -- start start 2023-10-09T06:25:53.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f526e84e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52680a79f0 0x7f526806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f526e84e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f52680b15e0 0x7f526806eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f526e84e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52680a7dc0 0x7f526815dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f526e84e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680b26d0 con 0x7f52680a79f0 2023-10-09T06:25:53.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f526e84e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680aeab0 con 0x7f52680b15e0 2023-10-09T06:25:53.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f526e84e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680b2b60 con 0x7f52680a7dc0 2023-10-09T06:25:53.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f5267fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52680a79f0 0x7f526806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f5267fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52680a79f0 0x7f526806eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43190/0 (socket says 172.21.15.31:43190) 2023-10-09T06:25:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f5267fff700 1 -- 172.21.15.31:0/992898954 learned_addr learned my addr 172.21.15.31:0/992898954 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f5267fff700 1 -- 172.21.15.31:0/992898954 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52680a7dc0 msgr2=0x7f526815dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f526cdeb700 1 --2- 172.21.15.31:0/992898954 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52680a7dc0 0x7f526815dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f52677fe700 1 --2- 172.21.15.31:0/992898954 >> v2:172.21.15.158:3300/0 conn(0x7f52680b15e0 0x7f526806eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f5267fff700 1 --2- 172.21.15.31:0/992898954 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52680a7dc0 0x7f526815dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f5267fff700 1 -- 172.21.15.31:0/992898954 >> v2:172.21.15.158:3300/0 conn(0x7f52680b15e0 msgr2=0x7f526806eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f5267fff700 1 --2- 172.21.15.31:0/992898954 >> v2:172.21.15.158:3300/0 conn(0x7f52680b15e0 0x7f526806eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f5267fff700 1 -- 172.21.15.31:0/992898954 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680b1ac0 con 0x7f52680a79f0 2023-10-09T06:25:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f52677fe700 1 --2- 172.21.15.31:0/992898954 >> v2:172.21.15.158:3300/0 conn(0x7f52680b15e0 0x7f526806eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.508+0000 7f5267fff700 1 --2- 172.21.15.31:0/992898954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52680a79f0 0x7f526806eab0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5268064320 tx=0x7f5258009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a447e988499cd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.509+0000 7f5266ffd700 1 -- 172.21.15.31:0/992898954 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525800b860 con 0x7f52680a79f0 2023-10-09T06:25:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.509+0000 7f5266ffd700 1 -- 172.21.15.31:0/992898954 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525800b9c0 con 0x7f52680a79f0 2023-10-09T06:25:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.509+0000 7f5266ffd700 1 -- 172.21.15.31:0/992898954 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525800bd60 con 0x7f52680a79f0 2023-10-09T06:25:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.509+0000 7f526e84e700 1 -- 172.21.15.31:0/992898954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52680a79f0 msgr2=0x7f526806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.509+0000 7f526e84e700 1 --2- 172.21.15.31:0/992898954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52680a79f0 0x7f526806eab0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5268064320 tx=0x7f5258009250 comp rx=0 tx=0).stop 2023-10-09T06:25:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.509+0000 7f526e84e700 1 -- 172.21.15.31:0/992898954 shutdown_connections 2023-10-09T06:25:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.509+0000 7f526e84e700 1 --2- 172.21.15.31:0/992898954 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52680a7dc0 0x7f526815dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.509+0000 7f526e84e700 1 --2- 172.21.15.31:0/992898954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52680a79f0 0x7f526806eab0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.509+0000 7f526e84e700 1 --2- 172.21.15.31:0/992898954 >> v2:172.21.15.158:3300/0 conn(0x7f52680b15e0 0x7f526806eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.509+0000 7f526e84e700 1 -- 172.21.15.31:0/992898954 >> 172.21.15.31:0/992898954 conn(0x7f52680cd1e0 msgr2=0x7f52680cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.509+0000 7f526e84e700 1 -- 172.21.15.31:0/992898954 shutdown_connections 2023-10-09T06:25:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.509+0000 7f526e84e700 1 -- 172.21.15.31:0/992898954 wait complete. 2023-10-09T06:25:53.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.510+0000 7f526e84e700 1 Processor -- start 2023-10-09T06:25:53.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.511+0000 7f526e84e700 1 -- start start 2023-10-09T06:25:53.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.511+0000 7f526e84e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52680a79f0 0x7f5268099dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.511+0000 7f526e84e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52680a7dc0 0x7f526816a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.511+0000 7f526e84e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52680b15e0 0x7f5268098500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.511+0000 7f526e84e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5268098ff0 con 0x7f52680b15e0 2023-10-09T06:25:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.511+0000 7f526e84e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526815d1f0 con 0x7f52680a7dc0 2023-10-09T06:25:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.511+0000 7f526e84e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526815a730 con 0x7f52680a79f0 2023-10-09T06:25:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.511+0000 7f526cdeb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52680b15e0 0x7f5268098500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.511+0000 7f526cdeb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52680b15e0 0x7f5268098500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43202/0 (socket says 172.21.15.31:43202) 2023-10-09T06:25:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.511+0000 7f526cdeb700 1 -- 172.21.15.31:0/2440841699 learned_addr learned my addr 172.21.15.31:0/2440841699 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.511+0000 7f5267fff700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52680a79f0 0x7f5268099dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.511+0000 7f52677fe700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52680a7dc0 0x7f526816a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.512+0000 7f526cdeb700 1 -- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52680a79f0 msgr2=0x7f5268099dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.512+0000 7f526cdeb700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52680a79f0 0x7f5268099dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.512+0000 7f526cdeb700 1 -- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52680a7dc0 msgr2=0x7f526816a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.512+0000 7f526cdeb700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52680a7dc0 0x7f526816a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.512+0000 7f526cdeb700 1 -- 172.21.15.31:0/2440841699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52580094f0 con 0x7f52680b15e0 2023-10-09T06:25:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.512+0000 7f526cdeb700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52680b15e0 0x7f5268098500 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f526000ceb0 tx=0x7f5260007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.512+0000 7f524ffff700 1 -- 172.21.15.31:0/2440841699 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526000ad90 con 0x7f52680b15e0 2023-10-09T06:25:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.512+0000 7f524ffff700 1 -- 172.21.15.31:0/2440841699 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5260016430 con 0x7f52680b15e0 2023-10-09T06:25:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.512+0000 7f526e84e700 1 -- 172.21.15.31:0/2440841699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526815aa10 con 0x7f52680b15e0 2023-10-09T06:25:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.512+0000 7f524ffff700 1 -- 172.21.15.31:0/2440841699 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52600167d0 con 0x7f52680b15e0 2023-10-09T06:25:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.512+0000 7f526e84e700 1 -- 172.21.15.31:0/2440841699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526815afd0 con 0x7f52680b15e0 2023-10-09T06:25:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.513+0000 7f526e84e700 1 -- 172.21.15.31:0/2440841699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526804c3c0 con 0x7f52680b15e0 2023-10-09T06:25:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.513+0000 7f524ffff700 1 -- 172.21.15.31:0/2440841699 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5260003020 con 0x7f52680b15e0 2023-10-09T06:25:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.514+0000 7f524ffff700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5254066f30 0x7f52540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.514+0000 7f524ffff700 1 -- 172.21.15.31:0/2440841699 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5260012070 con 0x7f52680b15e0 2023-10-09T06:25:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.514+0000 7f5267fff700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5254066f30 0x7f52540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.514+0000 7f5267fff700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5254066f30 0x7f52540693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5268064320 tx=0x7f5258017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:53.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.518+0000 7f524ffff700 1 -- 172.21.15.31:0/2440841699 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5260052580 con 0x7f52680b15e0 2023-10-09T06:25:53.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.708+0000 7f526e84e700 1 -- 172.21.15.31:0/2440841699 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52680b1da0 con 0x7f5254066f30 2023-10-09T06:25:53.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.716+0000 7f524ffff700 1 -- 172.21.15.31:0/2440841699 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281842 (secure 0 0 0) 0x7f52680b1da0 con 0x7f5254066f30 2023-10-09T06:25:53.720 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:53.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.719+0000 7f526e84e700 1 -- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5254066f30 msgr2=0x7f52540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.719+0000 7f526e84e700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5254066f30 0x7f52540693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5268064320 tx=0x7f5258017000 comp rx=0 tx=0).stop 2023-10-09T06:25:53.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.719+0000 7f526e84e700 1 -- 172.21.15.31:0/2440841699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52680b15e0 msgr2=0x7f5268098500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.719+0000 7f526e84e700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52680b15e0 0x7f5268098500 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f526000ceb0 tx=0x7f5260007870 comp rx=0 tx=0).stop 2023-10-09T06:25:53.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.719+0000 7f526e84e700 1 -- 172.21.15.31:0/2440841699 shutdown_connections 2023-10-09T06:25:53.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.719+0000 7f526e84e700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5254066f30 0x7f52540693e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.719+0000 7f526e84e700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f52680a79f0 0x7f5268099dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.719+0000 7f526e84e700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52680b15e0 0x7f5268098500 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.719+0000 7f526e84e700 1 --2- 172.21.15.31:0/2440841699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52680a7dc0 0x7f526816a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.719+0000 7f526e84e700 1 -- 172.21.15.31:0/2440841699 >> 172.21.15.31:0/2440841699 conn(0x7f52680cd1e0 msgr2=0x7f52680ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:53.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.719+0000 7f526e84e700 1 -- 172.21.15.31:0/2440841699 shutdown_connections 2023-10-09T06:25:53.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.719+0000 7f526e84e700 1 -- 172.21.15.31:0/2440841699 wait complete. 2023-10-09T06:25:53.723 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:25:53.731 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2023-10-09T06:25:52.588628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557183,"statfs":{"total":1600000000,"available":1594555790,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.750821"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843722+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:02.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846354+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:22:43.722563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847525+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:17.876832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848532+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:18.557206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846861+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:42.447136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841618+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847409+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:11.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.842300+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841871+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.945766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843529+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:33.951783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845884+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:39.017793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843265+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:03.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846965+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:21.991307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848134+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:10.690323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.849314+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:54.261243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846027+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:54:53.637423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.853432+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:43.433850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847291+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:47.595844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843183+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846879+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:40:43.836644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846733+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:05:08.101768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846057+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:48.507408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845561+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845926+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:36.957766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846840+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:12.934950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847443+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:43.433850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.849110+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.945766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846713+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847472+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:16.753156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845309+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:29.732017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845612+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:47:03.231614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843744+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:42.447136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848336+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851455+0000","last_change":"2023-10-09T06:25:47.851455+0000","last_active":"2023-10-09T06:25:47.851455+0000","last_peered":"2023-10-09T06:25:47.851455+0000","last_clean":"2023-10-09T06:25:47.851455+0000","last_became_active":"2023-10-09T06:25:47.851203+0000","last_became_peered":"2023-10-09T06:25:47.851203+0000","last_unstale":"2023-10-09T06:25:47.851455+0000","last_undegraded":"2023-10-09T06:25:47.851455+0000","last_fullsized":"2023-10-09T06:25:47.851455+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:11.772590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846339+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:30.810531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.854438+0000","last_change":"2023-10-09T06:25:47.854438+0000","last_active":"2023-10-09T06:25:47.854438+0000","last_peered":"2023-10-09T06:25:47.854438+0000","last_clean":"2023-10-09T06:25:47.854438+0000","last_became_active":"2023-10-09T06:25:47.854221+0000","last_became_peered":"2023-10-09T06:25:47.854221+0000","last_unstale":"2023-10-09T06:25:47.854438+0000","last_undegraded":"2023-10-09T06:25:47.854438+0000","last_fullsized":"2023-10-09T06:25:47.854438+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:05:38.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843221+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:54:53.637423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849059+0000","last_change":"2023-10-09T06:25:47.849059+0000","last_active":"2023-10-09T06:25:47.849059+0000","last_peered":"2023-10-09T06:25:47.849059+0000","last_clean":"2023-10-09T06:25:47.849059+0000","last_became_active":"2023-10-09T06:25:47.848790+0000","last_became_peered":"2023-10-09T06:25:47.848790+0000","last_unstale":"2023-10-09T06:25:47.849059+0000","last_undegraded":"2023-10-09T06:25:47.849059+0000","last_fullsized":"2023-10-09T06:25:47.849059+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:26.169034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847938+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.349968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849726+0000","last_change":"2023-10-09T06:25:47.849726+0000","last_active":"2023-10-09T06:25:47.849726+0000","last_peered":"2023-10-09T06:25:47.849726+0000","last_clean":"2023-10-09T06:25:47.849726+0000","last_became_active":"2023-10-09T06:25:47.849461+0000","last_became_peered":"2023-10-09T06:25:47.849461+0000","last_unstale":"2023-10-09T06:25:47.849726+0000","last_undegraded":"2023-10-09T06:25:47.849726+0000","last_fullsized":"2023-10-09T06:25:47.849726+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:41.443808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846130+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:26:52.798323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855263+0000","last_change":"2023-10-09T06:25:47.855263+0000","last_active":"2023-10-09T06:25:47.855263+0000","last_peered":"2023-10-09T06:25:47.855263+0000","last_clean":"2023-10-09T06:25:47.855263+0000","last_became_active":"2023-10-09T06:25:47.854779+0000","last_became_peered":"2023-10-09T06:25:47.854779+0000","last_unstale":"2023-10-09T06:25:47.855263+0000","last_undegraded":"2023-10-09T06:25:47.855263+0000","last_fullsized":"2023-10-09T06:25:47.855263+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.013764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.852995+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:21.991307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855905+0000","last_change":"2023-10-09T06:25:47.855905+0000","last_active":"2023-10-09T06:25:47.855905+0000","last_peered":"2023-10-09T06:25:47.855905+0000","last_clean":"2023-10-09T06:25:47.855905+0000","last_became_active":"2023-10-09T06:25:47.855664+0000","last_became_peered":"2023-10-09T06:25:47.855664+0000","last_unstale":"2023-10-09T06:25:47.855905+0000","last_undegraded":"2023-10-09T06:25:47.855905+0000","last_fullsized":"2023-10-09T06:25:47.855905+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:08.735859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848298+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:16.986469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.845607+0000","last_change":"2023-10-09T06:25:47.845607+0000","last_active":"2023-10-09T06:25:47.845607+0000","last_peered":"2023-10-09T06:25:47.845607+0000","last_clean":"2023-10-09T06:25:47.845607+0000","last_became_active":"2023-10-09T06:25:47.845108+0000","last_became_peered":"2023-10-09T06:25:47.845108+0000","last_unstale":"2023-10-09T06:25:47.845607+0000","last_undegraded":"2023-10-09T06:25:47.845607+0000","last_fullsized":"2023-10-09T06:25:47.845607+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:32.948454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848477+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:47:14.813193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.852047+0000","last_change":"2023-10-09T06:25:47.852047+0000","last_active":"2023-10-09T06:25:47.852047+0000","last_peered":"2023-10-09T06:25:47.852047+0000","last_clean":"2023-10-09T06:25:47.852047+0000","last_became_active":"2023-10-09T06:25:47.851541+0000","last_became_peered":"2023-10-09T06:25:47.851541+0000","last_unstale":"2023-10-09T06:25:47.852047+0000","last_undegraded":"2023-10-09T06:25:47.852047+0000","last_fullsized":"2023-10-09T06:25:47.852047+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:35.643402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848413+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:21.766447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849277+0000","last_change":"2023-10-09T06:25:47.849277+0000","last_active":"2023-10-09T06:25:47.849277+0000","last_peered":"2023-10-09T06:25:47.849277+0000","last_clean":"2023-10-09T06:25:47.849277+0000","last_became_active":"2023-10-09T06:25:47.849037+0000","last_became_peered":"2023-10-09T06:25:47.849037+0000","last_unstale":"2023-10-09T06:25:47.849277+0000","last_undegraded":"2023-10-09T06:25:47.849277+0000","last_fullsized":"2023-10-09T06:25:47.849277+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.013764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841231+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.854169+0000","last_change":"2023-10-09T06:25:47.854169+0000","last_active":"2023-10-09T06:25:47.854169+0000","last_peered":"2023-10-09T06:25:47.854169+0000","last_clean":"2023-10-09T06:25:47.854169+0000","last_became_active":"2023-10-09T06:25:47.853941+0000","last_became_peered":"2023-10-09T06:25:47.853941+0000","last_unstale":"2023-10-09T06:25:47.854169+0000","last_undegraded":"2023-10-09T06:25:47.854169+0000","last_fullsized":"2023-10-09T06:25:47.854169+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:18.208465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.842801+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.848404+0000","last_change":"2023-10-09T06:25:47.848404+0000","last_active":"2023-10-09T06:25:47.848404+0000","last_peered":"2023-10-09T06:25:47.848404+0000","last_clean":"2023-10-09T06:25:47.848404+0000","last_became_active":"2023-10-09T06:25:47.847936+0000","last_became_peered":"2023-10-09T06:25:47.847936+0000","last_unstale":"2023-10-09T06:25:47.848404+0000","last_undegraded":"2023-10-09T06:25:47.848404+0000","last_fullsized":"2023-10-09T06:25:47.848404+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:29.780809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846566+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:33.951783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.842724+0000","last_change":"2023-10-09T06:25:47.842724+0000","last_active":"2023-10-09T06:25:47.842724+0000","last_peered":"2023-10-09T06:25:47.842724+0000","last_clean":"2023-10-09T06:25:47.842724+0000","last_became_active":"2023-10-09T06:25:47.842472+0000","last_became_peered":"2023-10-09T06:25:47.842472+0000","last_unstale":"2023-10-09T06:25:47.842724+0000","last_undegraded":"2023-10-09T06:25:47.842724+0000","last_fullsized":"2023-10-09T06:25:47.842724+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:02.106046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843292+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.847553+0000","last_change":"2023-10-09T06:25:47.847553+0000","last_active":"2023-10-09T06:25:47.847553+0000","last_peered":"2023-10-09T06:25:47.847553+0000","last_clean":"2023-10-09T06:25:47.847553+0000","last_became_active":"2023-10-09T06:25:47.847331+0000","last_became_peered":"2023-10-09T06:25:47.847331+0000","last_unstale":"2023-10-09T06:25:47.847553+0000","last_undegraded":"2023-10-09T06:25:47.847553+0000","last_fullsized":"2023-10-09T06:25:47.847553+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:53.459647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847544+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:04.966793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.848332+0000","last_change":"2023-10-09T06:25:47.848332+0000","last_active":"2023-10-09T06:25:47.848332+0000","last_peered":"2023-10-09T06:25:47.848332+0000","last_clean":"2023-10-09T06:25:47.848332+0000","last_became_active":"2023-10-09T06:25:47.848047+0000","last_became_peered":"2023-10-09T06:25:47.848047+0000","last_unstale":"2023-10-09T06:25:47.848332+0000","last_undegraded":"2023-10-09T06:25:47.848332+0000","last_fullsized":"2023-10-09T06:25:47.848332+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:11.346640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845382+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:25.089742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855073+0000","last_change":"2023-10-09T06:25:47.855073+0000","last_active":"2023-10-09T06:25:47.855073+0000","last_peered":"2023-10-09T06:25:47.855073+0000","last_clean":"2023-10-09T06:25:47.855073+0000","last_became_active":"2023-10-09T06:25:47.854877+0000","last_became_peered":"2023-10-09T06:25:47.854877+0000","last_unstale":"2023-10-09T06:25:47.855073+0000","last_undegraded":"2023-10-09T06:25:47.855073+0000","last_fullsized":"2023-10-09T06:25:47.855073+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:32.948454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845712+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:55.341469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851026+0000","last_change":"2023-10-09T06:25:47.851026+0000","last_active":"2023-10-09T06:25:47.851026+0000","last_peered":"2023-10-09T06:25:47.851026+0000","last_clean":"2023-10-09T06:25:47.851026+0000","last_became_active":"2023-10-09T06:25:47.850820+0000","last_became_peered":"2023-10-09T06:25:47.850820+0000","last_unstale":"2023-10-09T06:25:47.851026+0000","last_undegraded":"2023-10-09T06:25:47.851026+0000","last_fullsized":"2023-10-09T06:25:47.851026+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:01.086319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846911+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850149+0000","last_change":"2023-10-09T06:25:47.850149+0000","last_active":"2023-10-09T06:25:47.850149+0000","last_peered":"2023-10-09T06:25:47.850149+0000","last_clean":"2023-10-09T06:25:47.850149+0000","last_became_active":"2023-10-09T06:25:47.849942+0000","last_became_peered":"2023-10-09T06:25:47.849942+0000","last_unstale":"2023-10-09T06:25:47.850149+0000","last_undegraded":"2023-10-09T06:25:47.850149+0000","last_fullsized":"2023-10-09T06:25:47.850149+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:08.735859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.844415+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850579+0000","last_change":"2023-10-09T06:25:47.850579+0000","last_active":"2023-10-09T06:25:47.850579+0000","last_peered":"2023-10-09T06:25:47.850579+0000","last_clean":"2023-10-09T06:25:47.850579+0000","last_became_active":"2023-10-09T06:25:47.850361+0000","last_became_peered":"2023-10-09T06:25:47.850361+0000","last_unstale":"2023-10-09T06:25:47.850579+0000","last_undegraded":"2023-10-09T06:25:47.850579+0000","last_fullsized":"2023-10-09T06:25:47.850579+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:48.069765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845198+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:12.775919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.848106+0000","last_change":"2023-10-09T06:25:47.848106+0000","last_active":"2023-10-09T06:25:47.848106+0000","last_peered":"2023-10-09T06:25:47.848106+0000","last_clean":"2023-10-09T06:25:47.848106+0000","last_became_active":"2023-10-09T06:25:47.847818+0000","last_became_peered":"2023-10-09T06:25:47.847818+0000","last_unstale":"2023-10-09T06:25:47.848106+0000","last_undegraded":"2023-10-09T06:25:47.848106+0000","last_fullsized":"2023-10-09T06:25:47.848106+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:02.106046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845529+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:09.795315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.842874+0000","last_change":"2023-10-09T06:25:47.842874+0000","last_active":"2023-10-09T06:25:47.842874+0000","last_peered":"2023-10-09T06:25:47.842874+0000","last_clean":"2023-10-09T06:25:47.842874+0000","last_became_active":"2023-10-09T06:25:47.842648+0000","last_became_peered":"2023-10-09T06:25:47.842648+0000","last_unstale":"2023-10-09T06:25:47.842874+0000","last_undegraded":"2023-10-09T06:25:47.842874+0000","last_fullsized":"2023-10-09T06:25:47.842874+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:15.983140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841909+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.846610+0000","last_change":"2023-10-09T06:25:47.846610+0000","last_active":"2023-10-09T06:25:47.846610+0000","last_peered":"2023-10-09T06:25:47.846610+0000","last_clean":"2023-10-09T06:25:47.846610+0000","last_became_active":"2023-10-09T06:25:47.846390+0000","last_became_peered":"2023-10-09T06:25:47.846390+0000","last_unstale":"2023-10-09T06:25:47.846610+0000","last_undegraded":"2023-10-09T06:25:47.846610+0000","last_fullsized":"2023-10-09T06:25:47.846610+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:45.550797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846133+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:54:51.114943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.847568+0000","last_change":"2023-10-09T06:25:47.847568+0000","last_active":"2023-10-09T06:25:47.847568+0000","last_peered":"2023-10-09T06:25:47.847568+0000","last_clean":"2023-10-09T06:25:47.847568+0000","last_became_active":"2023-10-09T06:25:47.847337+0000","last_became_peered":"2023-10-09T06:25:47.847337+0000","last_unstale":"2023-10-09T06:25:47.847568+0000","last_undegraded":"2023-10-09T06:25:47.847568+0000","last_fullsized":"2023-10-09T06:25:47.847568+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:27.334050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841126+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:02.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850759+0000","last_change":"2023-10-09T06:25:47.850759+0000","last_active":"2023-10-09T06:25:47.850759+0000","last_peered":"2023-10-09T06:25:47.850759+0000","last_clean":"2023-10-09T06:25:47.850759+0000","last_became_active":"2023-10-09T06:25:47.850307+0000","last_became_peered":"2023-10-09T06:25:47.850307+0000","last_unstale":"2023-10-09T06:25:47.850759+0000","last_undegraded":"2023-10-09T06:25:47.850759+0000","last_fullsized":"2023-10-09T06:25:47.850759+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:16.873504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846156+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:03.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850946+0000","last_change":"2023-10-09T06:25:47.850946+0000","last_active":"2023-10-09T06:25:47.850946+0000","last_peered":"2023-10-09T06:25:47.850946+0000","last_clean":"2023-10-09T06:25:47.850946+0000","last_became_active":"2023-10-09T06:25:47.850152+0000","last_became_peered":"2023-10-09T06:25:47.850152+0000","last_unstale":"2023-10-09T06:25:47.850946+0000","last_undegraded":"2023-10-09T06:25:47.850946+0000","last_fullsized":"2023-10-09T06:25:47.850946+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:45.813982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847416+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:23:39.868860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851348+0000","last_change":"2023-10-09T06:25:47.851348+0000","last_active":"2023-10-09T06:25:47.851348+0000","last_peered":"2023-10-09T06:25:47.851348+0000","last_clean":"2023-10-09T06:25:47.851348+0000","last_became_active":"2023-10-09T06:25:47.851175+0000","last_became_peered":"2023-10-09T06:25:47.851175+0000","last_unstale":"2023-10-09T06:25:47.851348+0000","last_undegraded":"2023-10-09T06:25:47.851348+0000","last_fullsized":"2023-10-09T06:25:47.851348+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:24.614225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843934+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.847988+0000","last_change":"2023-10-09T06:25:47.847988+0000","last_active":"2023-10-09T06:25:47.847988+0000","last_peered":"2023-10-09T06:25:47.847988+0000","last_clean":"2023-10-09T06:25:47.847988+0000","last_became_active":"2023-10-09T06:25:47.847720+0000","last_became_peered":"2023-10-09T06:25:47.847720+0000","last_unstale":"2023-10-09T06:25:47.847988+0000","last_undegraded":"2023-10-09T06:25:47.847988+0000","last_fullsized":"2023-10-09T06:25:47.847988+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:44.660413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848971+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849760+0000","last_change":"2023-10-09T06:25:47.849760+0000","last_active":"2023-10-09T06:25:47.849760+0000","last_peered":"2023-10-09T06:25:47.849760+0000","last_clean":"2023-10-09T06:25:47.849760+0000","last_became_active":"2023-10-09T06:25:47.849254+0000","last_became_peered":"2023-10-09T06:25:47.849254+0000","last_unstale":"2023-10-09T06:25:47.849760+0000","last_undegraded":"2023-10-09T06:25:47.849760+0000","last_fullsized":"2023-10-09T06:25:47.849760+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:05:38.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841441+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851090+0000","last_change":"2023-10-09T06:25:47.851090+0000","last_active":"2023-10-09T06:25:47.851090+0000","last_peered":"2023-10-09T06:25:47.851090+0000","last_clean":"2023-10-09T06:25:47.851090+0000","last_became_active":"2023-10-09T06:25:47.850476+0000","last_became_peered":"2023-10-09T06:25:47.850476+0000","last_unstale":"2023-10-09T06:25:47.851090+0000","last_undegraded":"2023-10-09T06:25:47.851090+0000","last_fullsized":"2023-10-09T06:25:47.851090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:10.729010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.842951+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:30.810531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855007+0000","last_change":"2023-10-09T06:25:47.855007+0000","last_active":"2023-10-09T06:25:47.855007+0000","last_peered":"2023-10-09T06:25:47.855007+0000","last_clean":"2023-10-09T06:25:47.855007+0000","last_became_active":"2023-10-09T06:25:47.854175+0000","last_became_peered":"2023-10-09T06:25:47.854175+0000","last_unstale":"2023-10-09T06:25:47.855007+0000","last_undegraded":"2023-10-09T06:25:47.855007+0000","last_fullsized":"2023-10-09T06:25:47.855007+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:18.208465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846419+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851947+0000","last_change":"2023-10-09T06:25:47.851947+0000","last_active":"2023-10-09T06:25:47.851947+0000","last_peered":"2023-10-09T06:25:47.851947+0000","last_clean":"2023-10-09T06:25:47.851947+0000","last_became_active":"2023-10-09T06:25:47.851716+0000","last_became_peered":"2023-10-09T06:25:47.851716+0000","last_unstale":"2023-10-09T06:25:47.851947+0000","last_undegraded":"2023-10-09T06:25:47.851947+0000","last_fullsized":"2023-10-09T06:25:47.851947+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:33.781182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845968+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.852812+0000","last_change":"2023-10-09T06:25:47.852812+0000","last_active":"2023-10-09T06:25:47.852812+0000","last_peered":"2023-10-09T06:25:47.852812+0000","last_clean":"2023-10-09T06:25:47.852812+0000","last_became_active":"2023-10-09T06:25:47.852370+0000","last_became_peered":"2023-10-09T06:25:47.852370+0000","last_unstale":"2023-10-09T06:25:47.852812+0000","last_undegraded":"2023-10-09T06:25:47.852812+0000","last_fullsized":"2023-10-09T06:25:47.852812+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:33.781182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845338+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:51.475186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.853329+0000","last_change":"2023-10-09T06:25:47.853329+0000","last_active":"2023-10-09T06:25:47.853329+0000","last_peered":"2023-10-09T06:25:47.853329+0000","last_clean":"2023-10-09T06:25:47.853329+0000","last_became_active":"2023-10-09T06:25:47.853093+0000","last_became_peered":"2023-10-09T06:25:47.853093+0000","last_unstale":"2023-10-09T06:25:47.853329+0000","last_undegraded":"2023-10-09T06:25:47.853329+0000","last_fullsized":"2023-10-09T06:25:47.853329+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:29.807202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":231,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T06:25:46.843032+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:25:46.843032+0000","last_peered":"2023-10-09T06:25:46.843032+0000","last_clean":"2023-10-09T06:25:46.843032+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:25:46.843032+0000","last_undegraded":"2023-10-09T06:25:46.843032+0000","last_fullsized":"2023-10-09T06:25:46.843032+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1098,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198875132,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82599999999999996,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.91200000000000003,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76800000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.746},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53100000000000003,"15min":0.50600000000000001},"min":{"1min":0.35199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75800000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.57399999999999995},"min":{"1min":0.44700000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81399999999999995,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.53600000000000003},"min":{"1min":0.45000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80600000000000005,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.64700000000000002,"15min":0.57899999999999996},"min":{"1min":0.45900000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.56299999999999994},"min":{"1min":0.46000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71299999999999997,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.78200000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46800000000000003,"15min":0.47299999999999998},"min":{"1min":0.27200000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.31900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.72699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.34000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.91400000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.86799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":515,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194796,"statfs":{"total":200000000,"available":199471763,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.66100000000000003,"15min":0.79100000000000004},"min":{"1min":0.35199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77100000000000002,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.38100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":1.133,"15min":1.133},"last":0.40799999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.47299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72699999999999998,"5min":1.155,"15min":1.155},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71599999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72599999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.68000000000000005,"15min":0.80000000000000004},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.78900000000000003,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58299999999999996,"15min":0.60099999999999998},"min":{"1min":0.46200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":1.337,"15min":1.337},"last":0.496},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":1.206,"15min":1.206},"last":0.48299999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.497,"15min":0.497},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45000000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47399999999999998},"min":{"1min":0.377,"5min":0.315,"15min":0.315},"max":{"1min":0.69499999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.438},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46600000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.36599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.254,"5min":0.219,"15min":0.219},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.37},{"interface":"front","average":{"1min":0.434,"5min":0.35999999999999999,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.28999999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.26300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.39700000000000002,"15min":0.38500000000000001},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.40500000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.436,"15min":0.41199999999999998},"min":{"1min":0.35899999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.442,"15min":0.42799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.56000000000000005},"min":{"1min":0.43099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.72499999999999998,"15min":0.82899999999999996},"min":{"1min":0.47399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90200000000000002,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64500000000000002,"15min":0.625},"min":{"1min":0.47099999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66000000000000003,"15min":0.66800000000000004},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.175,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64000000000000001,"15min":0.61799999999999999},"min":{"1min":0.51700000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.48599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0189999999999999,"5min":1.49,"15min":1.49},"last":0.73899999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.52300000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67200000000000004,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.84799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1098,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198875132,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.41399999999999998},"min":{"1min":0.23599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.50600000000000001,"5min":1.226,"15min":1.226},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.54900000000000004,"5min":1.131,"15min":1.131},"last":0.29299999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.55700000000000005,"15min":0.99399999999999999},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":12.929,"15min":12.929},"last":0.313},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.438,"15min":0.46300000000000002},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.55000000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.47699999999999998},"min":{"1min":0.32200000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.749,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45300000000000001,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.314,"15min":0.314},"max":{"1min":0.57399999999999995,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.628,"15min":0.65600000000000003},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97099999999999997,"5min":1.335,"15min":1.335},"last":0.629}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90700000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.495},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.81499999999999995,"5min":0.999,"15min":0.999},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83099999999999996,"5min":0.998,"15min":0.998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65400000000000003,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.262,"15min":1.262},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.67000000000000004},"min":{"1min":0.52100000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.95599999999999996,"5min":1.103,"15min":1.103},"last":0.59899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.5,"15min":0.88600000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.48599999999999999,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.312},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.46200000000000002,"15min":0.67400000000000004},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57099999999999995,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.436,"15min":0.63400000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68000000000000005,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.53600000000000003,"15min":0.70399999999999996},"min":{"1min":0.28299999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.91400000000000003,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.33700000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.51700000000000002,"15min":0.70699999999999996},"min":{"1min":0.30299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70299999999999996,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.371},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.58299999999999996,"15min":0.94599999999999995},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.77000000000000002,"15min":1.1459999999999999},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.95299999999999996,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.71899999999999997,"15min":0.93100000000000005},"min":{"1min":0.46700000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1160000000000001,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.61299999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.90600000000000003},"min":{"1min":0.432,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93600000000000005,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72299999999999998,"15min":0.91300000000000003},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.006,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.625}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.71099999999999997,"15min":0.89500000000000002},"min":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95599999999999996,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.78600000000000003,"15min":1.1439999999999999},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.028,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70099999999999996,"15min":0.89100000000000001},"min":{"1min":0.44600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85299999999999998,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72099999999999997,"15min":0.90800000000000003},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0609999999999999,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.52200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.33800000000000002,"15min":0.32600000000000001},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.499,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39500000000000002,"15min":0.375},"min":{"1min":0.33100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33800000000000002,"15min":0.32200000000000001},"min":{"1min":0.255,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.36899999999999999,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.314}]},{"osd":2,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.373,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.373},{"interface":"front","average":{"1min":0.502,"5min":0.44,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64600000000000002,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.38500000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46800000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82399999999999995,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.875,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.45100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.73999999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80600000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51700000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.58199999999999996},"min":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":0.87,"15min":0.87},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.51900000000000002,"15min":0.49399999999999999},"min":{"1min":0.46100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.40100000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65100000000000002,"15min":0.72499999999999998},"min":{"1min":0.39500000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72899999999999998,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.38500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.64200000000000002,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.68200000000000005,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.84899999999999998,"15min":1.125},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":11.715,"15min":11.715},"last":0.43099999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.56000000000000005,"15min":0.52400000000000002},"min":{"1min":0.53300000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.51700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73499999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54500000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53100000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50600000000000001,"15min":0.503},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55400000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.499},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":515,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194796,"statfs":{"total":200000000,"available":199471763,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.48999999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68899999999999995,"5min":1.093,"15min":1.093},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.51200000000000001},"min":{"1min":0.44400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.67100000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76300000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.77600000000000002,"5min":1.071,"15min":1.071},"last":0.64000000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66000000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48399999999999999,"15min":0.501},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.624,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.755}]},{"osd":6,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.50600000000000001,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64400000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.36399999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.67800000000000005,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65400000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64600000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.84399999999999997}]}]}],"pool_statfs":[]}} 2023-10-09T06:25:53.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-10-09T06:25:53.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.843722+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:45:02.089647+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:25:53.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-10-09T06:25:53.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846354+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:22:43.722563+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:25:53.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-10-09T06:25:53.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.847525+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T06:47:17.876832+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:25:53.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-10-09T06:25:53.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.848532+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:22:18.557206+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:25:53.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-10-09T06:25:53.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846861+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:21:42.447136+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:25:53.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-10-09T06:25:53.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.841618+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:25:53.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-10-09T06:25:53.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.847409+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:07:11.592108+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:25:53.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-10-09T06:25:53.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.842300+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:25:53.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-10-09T06:25:53.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.841871+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:06:01.945766+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:25:53.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-10-09T06:25:53.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.843529+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:43:33.951783+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:25:53.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-10-09T06:25:53.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.845884+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:51:39.017793+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:25:53.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-10-09T06:25:53.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.843265+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:55:03.109374+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:25:53.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-10-09T06:25:53.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846965+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:50:21.991307+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:25:53.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-10-09T06:25:53.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.848134+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:09:10.690323+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:25:53.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-10-09T06:25:53.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.849314+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:09:54.261243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:25:53.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-10-09T06:25:53.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846027+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:54:53.637423+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:25:53.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-10-09T06:25:53.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.853432+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:49:43.433850+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:25:53.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-10-09T06:25:53.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.847291+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:39:47.595844+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:25:53.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-10-09T06:25:53.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.843183+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T06:25:53.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-10-09T06:25:53.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846879+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T06:40:43.836644+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:25:53.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-10-09T06:25:53.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846733+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:05:08.101768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:25:53.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-10-09T06:25:53.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846057+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:31:48.507408+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:25:53.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-10-09T06:25:53.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.845561+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:25:53.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-10-09T06:25:53.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.845926+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:27:36.957766+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:25:53.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-10-09T06:25:53.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846840+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:37:12.934950+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:25:53.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-10-09T06:25:53.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.847443+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:49:43.433850+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:25:53.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-10-09T06:25:53.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.849110+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:06:01.945766+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:25:53.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-10-09T06:25:53.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846713+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:25:53.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-10-09T06:25:53.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.847472+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:31:16.753156+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:25:53.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-10-09T06:25:53.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.845309+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:27:29.732017+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:25:53.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-10-09T06:25:53.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.845612+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:47:03.231614+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:25:53.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-10-09T06:25:53.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.843744+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:21:42.447136+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:25:53.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-10-09T06:25:53.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.848336+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:25:53.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-10-09T06:25:53.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846339+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:24:30.810531+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:25:53.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-10-09T06:25:53.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.843221+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:54:53.637423+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:25:53.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-10-09T06:25:53.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.847938+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:55:12.349968+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:25:53.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-10-09T06:25:53.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846130+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T06:26:52.798323+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:25:53.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-10-09T06:25:53.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.852995+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:50:21.991307+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:25:53.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-10-09T06:25:53.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.848298+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:18:16.986469+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:25:53.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-10-09T06:25:53.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.848477+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:47:14.813193+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:25:53.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-10-09T06:25:53.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.848413+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:25:21.766447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:25:53.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-10-09T06:25:53.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.841231+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:49:11.732339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:25:53.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-10-09T06:25:53.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.842801+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T06:25:53.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-10-09T06:25:53.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846566+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:43:33.951783+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:25:53.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-10-09T06:25:53.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.843292+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T06:25:53.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-10-09T06:25:53.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.847544+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:35:04.966793+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:25:53.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-10-09T06:25:53.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.845382+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:37:25.089742+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:25:53.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-10-09T06:25:53.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.845712+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:04:55.341469+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:25:53.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-10-09T06:25:53.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846911+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:25:53.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-10-09T06:25:53.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.844415+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:25:53.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-10-09T06:25:53.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.845198+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:34:12.775919+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:25:53.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-10-09T06:25:53.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.845529+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:56:09.795315+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:25:53.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-10-09T06:25:53.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.841909+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:25:53.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-10-09T06:25:53.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846133+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:54:51.114943+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:25:53.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-10-09T06:25:53.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.841126+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:45:02.089647+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:25:53.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-10-09T06:25:53.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846156+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:55:03.109374+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:25:53.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-10-09T06:25:53.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.847416+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:23:39.868860+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:25:53.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-10-09T06:25:53.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.843934+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:49:11.732339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:25:53.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-10-09T06:25:53.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.848971+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:25:53.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-10-09T06:25:53.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.841441+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:25:53.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-10-09T06:25:53.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.842951+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:24:30.810531+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T06:25:53.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-10-09T06:25:53.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.846419+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:25:53.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-10-09T06:25:53.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.845968+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:25:53.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-10-09T06:25:53.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:25:47.837017+0000', 'last_change': '2023-10-09T06:25:47.845338+0000', 'last_active': '2023-10-09T06:25:47.837017+0000', 'last_peered': '2023-10-09T06:25:47.837017+0000', 'last_clean': '2023-10-09T06:25:47.837017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:25:47.837017+0000', 'last_undegraded': '2023-10-09T06:25:47.837017+0000', 'last_fullsized': '2023-10-09T06:25:47.837017+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'last_clean_scrub_stamp': '2023-10-09T06:25:47.837017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:42:51.475186+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:25:53.751 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T06:25:53.836 INFO:tasks.ceph.mds.b.smithi158.stderr:2023-10-09T06:25:53.836+0000 7f99e496d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:25:53.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.890+0000 7fe8403c2700 1 Processor -- start 2023-10-09T06:25:53.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.890+0000 7fe8403c2700 1 -- start start 2023-10-09T06:25:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.891+0000 7fe8403c2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe8380b3430 0x7fe838164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.891+0000 7fe8403c2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83815db80 con 0x7fe838159e10 2023-10-09T06:25:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.891+0000 7fe8403c2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83815de60 con 0x7fe83815a1e0 2023-10-09T06:25:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.891+0000 7fe8403c2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83815e800 con 0x7fe8380b3430 2023-10-09T06:25:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.891+0000 7fe83e15e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe838159e10 0x7fe8380b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52426/0 (socket says 172.21.15.31:52426) 2023-10-09T06:25:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.891+0000 7fe83e15e700 1 -- 172.21.15.31:0/1402026073 learned_addr learned my addr 172.21.15.31:0/1402026073 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.891+0000 7fe83e95f700 1 --2- 172.21.15.31:0/1402026073 >> v2:172.21.15.158:3300/0 conn(0x7fe8380b3430 0x7fe838164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.891+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104050504 0 0) 0x7fe83815db80 con 0x7fe838159e10 2023-10-09T06:25:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.891+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe824003570 con 0x7fe838159e10 2023-10-09T06:25:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663263550 0 0) 0x7fe83815de60 con 0x7fe83815a1e0 2023-10-09T06:25:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe83815db80 con 0x7fe83815a1e0 2023-10-09T06:25:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 183119765 0 0) 0x7fe824003570 con 0x7fe838159e10 2023-10-09T06:25:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 >> v2:172.21.15.158:3300/0 conn(0x7fe8380b3430 msgr2=0x7fe838164e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 --2- 172.21.15.31:0/1402026073 >> v2:172.21.15.158:3300/0 conn(0x7fe8380b3430 0x7fe838164e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 >> v1:172.21.15.158:6789/0 conn(0x7fe83815a1e0 legacy=0x7fe8380cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83815e140 con 0x7fe838159e10 2023-10-09T06:25:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fe8300017f0 con 0x7fe838159e10 2023-10-09T06:25:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83e95f700 1 --2- 172.21.15.31:0/1402026073 >> v2:172.21.15.158:3300/0 conn(0x7fe8380b3430 0x7fe838164e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:25:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 >> v1:172.21.15.31:6789/0 conn(0x7fe838159e10 legacy=0x7fe8380b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 --2- 172.21.15.31:0/1402026073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe824003bf0 0x7fe824003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 --2- 172.21.15.31:0/1402026073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe824004810 0x7fe824004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 --2- 172.21.15.31:0/1402026073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8240051c0 0x7fe82400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83815e800 con 0x7fe824004810 2023-10-09T06:25:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82400c160 con 0x7fe8240051c0 2023-10-09T06:25:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82400c320 con 0x7fe824003bf0 2023-10-09T06:25:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d95d700 1 --2- 172.21.15.31:0/1402026073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe824004810 0x7fe824004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83e15e700 1 --2- 172.21.15.31:0/1402026073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe824003bf0 0x7fe824003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83e95f700 1 --2- 172.21.15.31:0/1402026073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8240051c0 0x7fe82400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d95d700 1 -- 172.21.15.31:0/1402026073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe824003bf0 msgr2=0x7fe824003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d95d700 1 --2- 172.21.15.31:0/1402026073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe824003bf0 0x7fe824003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d95d700 1 -- 172.21.15.31:0/1402026073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8240051c0 msgr2=0x7fe82400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d95d700 1 --2- 172.21.15.31:0/1402026073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8240051c0 0x7fe82400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83e95f700 1 -- 172.21.15.31:0/1402026073 reap_dead start 2023-10-09T06:25:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d95d700 1 -- 172.21.15.31:0/1402026073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe824003570 con 0x7fe824004810 2023-10-09T06:25:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d95d700 1 --2- 172.21.15.31:0/1402026073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe824004810 0x7fe824004c80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe8380c4510 tx=0x7fe828007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd31be4344c0ab55 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.892+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82800c560 con 0x7fe824004810 2023-10-09T06:25:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.893+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82800c6c0 con 0x7fe824004810 2023-10-09T06:25:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.893+0000 7fe83d15c700 1 -- 172.21.15.31:0/1402026073 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82800c850 con 0x7fe824004810 2023-10-09T06:25:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.893+0000 7fe8403c2700 1 -- 172.21.15.31:0/1402026073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe824004810 msgr2=0x7fe824004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.893+0000 7fe8403c2700 1 --2- 172.21.15.31:0/1402026073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe824004810 0x7fe824004c80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe8380c4510 tx=0x7fe828007d30 comp rx=0 tx=0).stop 2023-10-09T06:25:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.893+0000 7fe8403c2700 1 -- 172.21.15.31:0/1402026073 shutdown_connections 2023-10-09T06:25:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.893+0000 7fe8403c2700 1 --2- 172.21.15.31:0/1402026073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe824004810 0x7fe824004c80 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.893+0000 7fe8403c2700 1 -- 172.21.15.31:0/1402026073 >> 172.21.15.31:0/1402026073 conn(0x7fe838067660 msgr2=0x7fe838067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.893+0000 7fe8403c2700 1 -- 172.21.15.31:0/1402026073 shutdown_connections 2023-10-09T06:25:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.893+0000 7fe8403c2700 1 -- 172.21.15.31:0/1402026073 wait complete. 2023-10-09T06:25:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.894+0000 7fe8403c2700 1 Processor -- start 2023-10-09T06:25:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.894+0000 7fe8403c2700 1 -- start start 2023-10-09T06:25:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.895+0000 7fe8403c2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe824004810 0x7fe83816b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.895+0000 7fe8403c2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8380d1630 0x7fe83816e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.895+0000 7fe8403c2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8380cd4c0 0x7fe8380cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.895+0000 7fe8403c2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83816ec00 con 0x7fe8380cd4c0 2023-10-09T06:25:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.895+0000 7fe8403c2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8380cde70 con 0x7fe8380d1630 2023-10-09T06:25:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.895+0000 7fe8403c2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83816ae40 con 0x7fe824004810 2023-10-09T06:25:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.895+0000 7fe83e95f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8380cd4c0 0x7fe8380cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.895+0000 7fe83e95f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8380cd4c0 0x7fe8380cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43218/0 (socket says 172.21.15.31:43218) 2023-10-09T06:25:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.895+0000 7fe83e95f700 1 -- 172.21.15.31:0/2225926213 learned_addr learned my addr 172.21.15.31:0/2225926213 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.895+0000 7fe83e15e700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe824004810 0x7fe83816b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.895+0000 7fe83d95d700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8380d1630 0x7fe83816e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.896+0000 7fe83e95f700 1 -- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe824004810 msgr2=0x7fe83816b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.896+0000 7fe83e95f700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe824004810 0x7fe83816b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.896+0000 7fe83e95f700 1 -- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8380d1630 msgr2=0x7fe83816e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.896+0000 7fe83e95f700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8380d1630 0x7fe83816e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.896+0000 7fe83e95f700 1 -- 172.21.15.31:0/2225926213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8380c7420 con 0x7fe8380cd4c0 2023-10-09T06:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.896+0000 7fe83d95d700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8380d1630 0x7fe83816e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.896+0000 7fe83e95f700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8380cd4c0 0x7fe8380cd930 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe838089970 tx=0x7fe834008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.896+0000 7fe82e7fc700 1 -- 172.21.15.31:0/2225926213 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834015670 con 0x7fe8380cd4c0 2023-10-09T06:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.896+0000 7fe82e7fc700 1 -- 172.21.15.31:0/2225926213 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8340157d0 con 0x7fe8380cd4c0 2023-10-09T06:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.896+0000 7fe8403c2700 1 -- 172.21.15.31:0/2225926213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8380c7700 con 0x7fe8380cd4c0 2023-10-09T06:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.896+0000 7fe82e7fc700 1 -- 172.21.15.31:0/2225926213 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834015b90 con 0x7fe8380cd4c0 2023-10-09T06:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.896+0000 7fe8403c2700 1 -- 172.21.15.31:0/2225926213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83816aad0 con 0x7fe8380cd4c0 2023-10-09T06:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.897+0000 7fe8403c2700 1 -- 172.21.15.31:0/2225926213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8380d1a00 con 0x7fe8380cd4c0 2023-10-09T06:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.897+0000 7fe82e7fc700 1 -- 172.21.15.31:0/2225926213 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe83401f410 con 0x7fe8380cd4c0 2023-10-09T06:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.898+0000 7fe82e7fc700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe81c066f30 0x7fe81c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.898+0000 7fe82e7fc700 1 -- 172.21.15.31:0/2225926213 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe834084440 con 0x7fe8380cd4c0 2023-10-09T06:25:53.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.898+0000 7fe83e15e700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe81c066f30 0x7fe81c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:53.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.898+0000 7fe83e15e700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe81c066f30 0x7fe81c0693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe830007120 tx=0x7fe8300013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:53.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:53.902+0000 7fe82e7fc700 1 -- 172.21.15.31:0/2225926213 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8340516b0 con 0x7fe8380cd4c0 2023-10-09T06:25:54.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.174+0000 7fe8403c2700 1 -- 172.21.15.31:0/2225926213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe83804c3c0 con 0x7fe8380cd4c0 2023-10-09T06:25:54.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.175+0000 7fe82e7fc700 1 -- 172.21.15.31:0/2225926213 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1030 (secure 0 0 0) 0x7fe834054cd0 con 0x7fe8380cd4c0 2023-10-09T06:25:54.175 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:54.176 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":317,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":101,"num_osds":8,"num_up_osds":8,"osd_up_since":1696832442,"num_in_osds":8,"osd_in_since":1696832439,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":5444210,"bytes_avail":1594555790,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":50,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"b","status":"up:active","gid":6279}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-09T06:24:12.564850+0000","services":{}},"progress_events":{}} 2023-10-09T06:25:54.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.176+0000 7fe8403c2700 1 -- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe81c066f30 msgr2=0x7fe81c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:54.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.176+0000 7fe8403c2700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe81c066f30 0x7fe81c0693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe830007120 tx=0x7fe8300013f0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.176+0000 7fe8403c2700 1 -- 172.21.15.31:0/2225926213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8380cd4c0 msgr2=0x7fe8380cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:54.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.176+0000 7fe8403c2700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8380cd4c0 0x7fe8380cd930 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe838089970 tx=0x7fe834008040 comp rx=0 tx=0).stop 2023-10-09T06:25:54.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.176+0000 7fe8403c2700 1 -- 172.21.15.31:0/2225926213 shutdown_connections 2023-10-09T06:25:54.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.176+0000 7fe8403c2700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe81c066f30 0x7fe81c0693e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.176+0000 7fe8403c2700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe824004810 0x7fe83816b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.176+0000 7fe8403c2700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8380cd4c0 0x7fe8380cd930 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.176+0000 7fe8403c2700 1 --2- 172.21.15.31:0/2225926213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8380d1630 0x7fe83816e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.176+0000 7fe8403c2700 1 -- 172.21.15.31:0/2225926213 >> 172.21.15.31:0/2225926213 conn(0x7fe838067660 msgr2=0x7fe83815a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:54.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.177+0000 7fe8403c2700 1 -- 172.21.15.31:0/2225926213 shutdown_connections 2023-10-09T06:25:54.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.177+0000 7fe8403c2700 1 -- 172.21.15.31:0/2225926213 wait complete. 2023-10-09T06:25:54.189 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T06:25:54.189 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:25:54.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.307+0000 7efc67441700 1 Processor -- start 2023-10-09T06:25:54.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.308+0000 7efc67441700 1 -- start start 2023-10-09T06:25:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.308+0000 7efc67441700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efc60157870 0x7efc6015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.308+0000 7efc67441700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc60157c40 0x7efc60158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.308+0000 7efc67441700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6015cbb0 con 0x7efc6015a620 2023-10-09T06:25:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.308+0000 7efc67441700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6015bfa0 con 0x7efc60157870 2023-10-09T06:25:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.308+0000 7efc67441700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6015c280 con 0x7efc60157c40 2023-10-09T06:25:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.309+0000 7efc651dd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efc60157870 0x7efc6015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.309+0000 7efc649dc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efc6015a620 0x7efc6015d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52436/0 (socket says 172.21.15.31:52436) 2023-10-09T06:25:54.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.309+0000 7efc649dc700 1 -- 172.21.15.31:0/2399836350 learned_addr learned my addr 172.21.15.31:0/2399836350 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:54.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.309+0000 7efc659de700 1 --2- 172.21.15.31:0/2399836350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc60157c40 0x7efc60158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:54.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.309+0000 7efc651dd700 1 -- 172.21.15.31:0/2399836350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc60157c40 msgr2=0x7efc60158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:54.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.309+0000 7efc651dd700 1 --2- 172.21.15.31:0/2399836350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc60157c40 0x7efc60158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.309+0000 7efc651dd700 1 -- 172.21.15.31:0/2399836350 >> v1:172.21.15.31:6789/0 conn(0x7efc6015a620 legacy=0x7efc6015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:54.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.309+0000 7efc651dd700 1 -- 172.21.15.31:0/2399836350 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6015c560 con 0x7efc60157870 2023-10-09T06:25:54.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.309+0000 7efc5ffff700 1 -- 172.21.15.31:0/2399836350 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701637253 0 0) 0x7efc6015cbb0 con 0x7efc6015a620 2023-10-09T06:25:54.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.309+0000 7efc651dd700 1 --2- 172.21.15.31:0/2399836350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc60157870 0x7efc6015b6a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7efc580098e0 tx=0x7efc580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6fce2884d092471 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:54.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.309+0000 7efc5ffff700 1 -- 172.21.15.31:0/2399836350 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58009e80 con 0x7efc60157870 2023-10-09T06:25:54.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.309+0000 7efc5ffff700 1 -- 172.21.15.31:0/2399836350 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5800b860 con 0x7efc60157870 2023-10-09T06:25:54.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.309+0000 7efc5ffff700 1 -- 172.21.15.31:0/2399836350 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5800bbe0 con 0x7efc60157870 2023-10-09T06:25:54.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.310+0000 7efc67441700 1 -- 172.21.15.31:0/2399836350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc60157870 msgr2=0x7efc6015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:54.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.310+0000 7efc67441700 1 --2- 172.21.15.31:0/2399836350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc60157870 0x7efc6015b6a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7efc580098e0 tx=0x7efc580091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.310+0000 7efc67441700 1 -- 172.21.15.31:0/2399836350 shutdown_connections 2023-10-09T06:25:54.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.310+0000 7efc67441700 1 --2- 172.21.15.31:0/2399836350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc60157870 0x7efc6015b6a0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.310+0000 7efc67441700 1 --2- 172.21.15.31:0/2399836350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc60157c40 0x7efc60158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.310+0000 7efc67441700 1 -- 172.21.15.31:0/2399836350 >> 172.21.15.31:0/2399836350 conn(0x7efc60068ce0 msgr2=0x7efc600690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.310+0000 7efc67441700 1 -- 172.21.15.31:0/2399836350 shutdown_connections 2023-10-09T06:25:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.310+0000 7efc67441700 1 -- 172.21.15.31:0/2399836350 wait complete. 2023-10-09T06:25:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.311+0000 7efc67441700 1 Processor -- start 2023-10-09T06:25:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.311+0000 7efc67441700 1 -- start start 2023-10-09T06:25:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.312+0000 7efc67441700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc60157870 0x7efc6013eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.312+0000 7efc67441700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc60157c40 0x7efc6014e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.312+0000 7efc67441700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc6015a620 0x7efc601510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.312+0000 7efc67441700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6016d5a0 con 0x7efc6015a620 2023-10-09T06:25:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.312+0000 7efc67441700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6014eda0 con 0x7efc60157c40 2023-10-09T06:25:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.312+0000 7efc67441700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6013f980 con 0x7efc60157870 2023-10-09T06:25:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.312+0000 7efc659de700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc6015a620 0x7efc601510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.312+0000 7efc659de700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc6015a620 0x7efc601510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43238/0 (socket says 172.21.15.31:43238) 2023-10-09T06:25:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.312+0000 7efc659de700 1 -- 172.21.15.31:0/2556120928 learned_addr learned my addr 172.21.15.31:0/2556120928 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.312+0000 7efc651dd700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc60157870 0x7efc6013eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.312+0000 7efc649dc700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc60157c40 0x7efc6014e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.312+0000 7efc659de700 1 -- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc60157870 msgr2=0x7efc6013eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.312+0000 7efc659de700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc60157870 0x7efc6013eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.313+0000 7efc659de700 1 -- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc60157c40 msgr2=0x7efc6014e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.313+0000 7efc659de700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc60157c40 0x7efc6014e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.313+0000 7efc659de700 1 -- 172.21.15.31:0/2556120928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58009420 con 0x7efc6015a620 2023-10-09T06:25:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.313+0000 7efc649dc700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc60157c40 0x7efc6014e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:54.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.313+0000 7efc659de700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc6015a620 0x7efc601510f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7efc50007f30 tx=0x7efc500098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:54.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.313+0000 7efc5d7fa700 1 -- 172.21.15.31:0/2556120928 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5000ecf0 con 0x7efc6015a620 2023-10-09T06:25:54.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.313+0000 7efc5d7fa700 1 -- 172.21.15.31:0/2556120928 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5000ee50 con 0x7efc6015a620 2023-10-09T06:25:54.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.313+0000 7efc67441700 1 -- 172.21.15.31:0/2556120928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc600b2540 con 0x7efc6015a620 2023-10-09T06:25:54.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.313+0000 7efc5d7fa700 1 -- 172.21.15.31:0/2556120928 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc50014670 con 0x7efc6015a620 2023-10-09T06:25:54.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.313+0000 7efc67441700 1 -- 172.21.15.31:0/2556120928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc600b2b00 con 0x7efc6015a620 2023-10-09T06:25:54.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.314+0000 7efc67441700 1 -- 172.21.15.31:0/2556120928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6014ef50 con 0x7efc6015a620 2023-10-09T06:25:54.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.314+0000 7efc5d7fa700 1 -- 172.21.15.31:0/2556120928 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc500149e0 con 0x7efc6015a620 2023-10-09T06:25:54.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.315+0000 7efc5d7fa700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efc4c066f30 0x7efc4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:54.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.315+0000 7efc5d7fa700 1 -- 172.21.15.31:0/2556120928 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc50084cb0 con 0x7efc6015a620 2023-10-09T06:25:54.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.315+0000 7efc651dd700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efc4c066f30 0x7efc4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:54.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.315+0000 7efc651dd700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efc4c066f30 0x7efc4c0693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efc580091e0 tx=0x7efc58017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:54.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.319+0000 7efc5d7fa700 1 -- 172.21.15.31:0/2556120928 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc50051f20 con 0x7efc6015a620 2023-10-09T06:25:54.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.507+0000 7efc67441700 1 -- 172.21.15.31:0/2556120928 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc6015c840 con 0x7efc4c066f30 2023-10-09T06:25:54.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.516+0000 7efc5d7fa700 1 -- 172.21.15.31:0/2556120928 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281842 (secure 0 0 0) 0x7efc6015c840 con 0x7efc4c066f30 2023-10-09T06:25:54.519 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:54.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.519+0000 7efc67441700 1 -- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efc4c066f30 msgr2=0x7efc4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:54.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.519+0000 7efc67441700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efc4c066f30 0x7efc4c0693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efc580091e0 tx=0x7efc58017000 comp rx=0 tx=0).stop 2023-10-09T06:25:54.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.519+0000 7efc67441700 1 -- 172.21.15.31:0/2556120928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc6015a620 msgr2=0x7efc601510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:54.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.519+0000 7efc67441700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc6015a620 0x7efc601510f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7efc50007f30 tx=0x7efc500098e0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.519+0000 7efc67441700 1 -- 172.21.15.31:0/2556120928 shutdown_connections 2023-10-09T06:25:54.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.519+0000 7efc67441700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efc4c066f30 0x7efc4c0693e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.519+0000 7efc67441700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efc60157870 0x7efc6013eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.519+0000 7efc67441700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc6015a620 0x7efc601510f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.519+0000 7efc67441700 1 --2- 172.21.15.31:0/2556120928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc60157c40 0x7efc6014e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:54.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.519+0000 7efc67441700 1 -- 172.21.15.31:0/2556120928 >> 172.21.15.31:0/2556120928 conn(0x7efc60068ce0 msgr2=0x7efc6015ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:54.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.519+0000 7efc67441700 1 -- 172.21.15.31:0/2556120928 shutdown_connections 2023-10-09T06:25:54.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:54.519+0000 7efc67441700 1 -- 172.21.15.31:0/2556120928 wait complete. 2023-10-09T06:25:54.523 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:25:54.531 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2023-10-09T06:25:52.588628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557183,"statfs":{"total":1600000000,"available":1594555790,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.750821"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843722+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:02.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846354+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:22:43.722563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847525+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:17.876832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848532+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:18.557206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846861+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:42.447136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841618+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847409+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:11.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.842300+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841871+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.945766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843529+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:33.951783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845884+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:39.017793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843265+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:03.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846965+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:21.991307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848134+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:10.690323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.849314+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:54.261243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846027+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:54:53.637423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.853432+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:43.433850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847291+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:47.595844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843183+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846879+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:40:43.836644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846733+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:05:08.101768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846057+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:48.507408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845561+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845926+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:36.957766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846840+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:12.934950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847443+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:43.433850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.849110+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.945766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846713+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847472+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:16.753156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845309+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:29.732017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845612+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:47:03.231614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843744+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:42.447136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848336+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851455+0000","last_change":"2023-10-09T06:25:47.851455+0000","last_active":"2023-10-09T06:25:47.851455+0000","last_peered":"2023-10-09T06:25:47.851455+0000","last_clean":"2023-10-09T06:25:47.851455+0000","last_became_active":"2023-10-09T06:25:47.851203+0000","last_became_peered":"2023-10-09T06:25:47.851203+0000","last_unstale":"2023-10-09T06:25:47.851455+0000","last_undegraded":"2023-10-09T06:25:47.851455+0000","last_fullsized":"2023-10-09T06:25:47.851455+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:11.772590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846339+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:30.810531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.854438+0000","last_change":"2023-10-09T06:25:47.854438+0000","last_active":"2023-10-09T06:25:47.854438+0000","last_peered":"2023-10-09T06:25:47.854438+0000","last_clean":"2023-10-09T06:25:47.854438+0000","last_became_active":"2023-10-09T06:25:47.854221+0000","last_became_peered":"2023-10-09T06:25:47.854221+0000","last_unstale":"2023-10-09T06:25:47.854438+0000","last_undegraded":"2023-10-09T06:25:47.854438+0000","last_fullsized":"2023-10-09T06:25:47.854438+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:05:38.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843221+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:54:53.637423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849059+0000","last_change":"2023-10-09T06:25:47.849059+0000","last_active":"2023-10-09T06:25:47.849059+0000","last_peered":"2023-10-09T06:25:47.849059+0000","last_clean":"2023-10-09T06:25:47.849059+0000","last_became_active":"2023-10-09T06:25:47.848790+0000","last_became_peered":"2023-10-09T06:25:47.848790+0000","last_unstale":"2023-10-09T06:25:47.849059+0000","last_undegraded":"2023-10-09T06:25:47.849059+0000","last_fullsized":"2023-10-09T06:25:47.849059+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:26.169034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847938+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.349968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849726+0000","last_change":"2023-10-09T06:25:47.849726+0000","last_active":"2023-10-09T06:25:47.849726+0000","last_peered":"2023-10-09T06:25:47.849726+0000","last_clean":"2023-10-09T06:25:47.849726+0000","last_became_active":"2023-10-09T06:25:47.849461+0000","last_became_peered":"2023-10-09T06:25:47.849461+0000","last_unstale":"2023-10-09T06:25:47.849726+0000","last_undegraded":"2023-10-09T06:25:47.849726+0000","last_fullsized":"2023-10-09T06:25:47.849726+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:41.443808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846130+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:26:52.798323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855263+0000","last_change":"2023-10-09T06:25:47.855263+0000","last_active":"2023-10-09T06:25:47.855263+0000","last_peered":"2023-10-09T06:25:47.855263+0000","last_clean":"2023-10-09T06:25:47.855263+0000","last_became_active":"2023-10-09T06:25:47.854779+0000","last_became_peered":"2023-10-09T06:25:47.854779+0000","last_unstale":"2023-10-09T06:25:47.855263+0000","last_undegraded":"2023-10-09T06:25:47.855263+0000","last_fullsized":"2023-10-09T06:25:47.855263+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.013764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.852995+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:21.991307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855905+0000","last_change":"2023-10-09T06:25:47.855905+0000","last_active":"2023-10-09T06:25:47.855905+0000","last_peered":"2023-10-09T06:25:47.855905+0000","last_clean":"2023-10-09T06:25:47.855905+0000","last_became_active":"2023-10-09T06:25:47.855664+0000","last_became_peered":"2023-10-09T06:25:47.855664+0000","last_unstale":"2023-10-09T06:25:47.855905+0000","last_undegraded":"2023-10-09T06:25:47.855905+0000","last_fullsized":"2023-10-09T06:25:47.855905+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:08.735859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848298+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:16.986469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.845607+0000","last_change":"2023-10-09T06:25:47.845607+0000","last_active":"2023-10-09T06:25:47.845607+0000","last_peered":"2023-10-09T06:25:47.845607+0000","last_clean":"2023-10-09T06:25:47.845607+0000","last_became_active":"2023-10-09T06:25:47.845108+0000","last_became_peered":"2023-10-09T06:25:47.845108+0000","last_unstale":"2023-10-09T06:25:47.845607+0000","last_undegraded":"2023-10-09T06:25:47.845607+0000","last_fullsized":"2023-10-09T06:25:47.845607+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:32.948454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848477+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:47:14.813193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.852047+0000","last_change":"2023-10-09T06:25:47.852047+0000","last_active":"2023-10-09T06:25:47.852047+0000","last_peered":"2023-10-09T06:25:47.852047+0000","last_clean":"2023-10-09T06:25:47.852047+0000","last_became_active":"2023-10-09T06:25:47.851541+0000","last_became_peered":"2023-10-09T06:25:47.851541+0000","last_unstale":"2023-10-09T06:25:47.852047+0000","last_undegraded":"2023-10-09T06:25:47.852047+0000","last_fullsized":"2023-10-09T06:25:47.852047+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:35.643402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848413+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:21.766447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849277+0000","last_change":"2023-10-09T06:25:47.849277+0000","last_active":"2023-10-09T06:25:47.849277+0000","last_peered":"2023-10-09T06:25:47.849277+0000","last_clean":"2023-10-09T06:25:47.849277+0000","last_became_active":"2023-10-09T06:25:47.849037+0000","last_became_peered":"2023-10-09T06:25:47.849037+0000","last_unstale":"2023-10-09T06:25:47.849277+0000","last_undegraded":"2023-10-09T06:25:47.849277+0000","last_fullsized":"2023-10-09T06:25:47.849277+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.013764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841231+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.854169+0000","last_change":"2023-10-09T06:25:47.854169+0000","last_active":"2023-10-09T06:25:47.854169+0000","last_peered":"2023-10-09T06:25:47.854169+0000","last_clean":"2023-10-09T06:25:47.854169+0000","last_became_active":"2023-10-09T06:25:47.853941+0000","last_became_peered":"2023-10-09T06:25:47.853941+0000","last_unstale":"2023-10-09T06:25:47.854169+0000","last_undegraded":"2023-10-09T06:25:47.854169+0000","last_fullsized":"2023-10-09T06:25:47.854169+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:18.208465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.842801+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.848404+0000","last_change":"2023-10-09T06:25:47.848404+0000","last_active":"2023-10-09T06:25:47.848404+0000","last_peered":"2023-10-09T06:25:47.848404+0000","last_clean":"2023-10-09T06:25:47.848404+0000","last_became_active":"2023-10-09T06:25:47.847936+0000","last_became_peered":"2023-10-09T06:25:47.847936+0000","last_unstale":"2023-10-09T06:25:47.848404+0000","last_undegraded":"2023-10-09T06:25:47.848404+0000","last_fullsized":"2023-10-09T06:25:47.848404+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:29.780809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846566+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:33.951783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.842724+0000","last_change":"2023-10-09T06:25:47.842724+0000","last_active":"2023-10-09T06:25:47.842724+0000","last_peered":"2023-10-09T06:25:47.842724+0000","last_clean":"2023-10-09T06:25:47.842724+0000","last_became_active":"2023-10-09T06:25:47.842472+0000","last_became_peered":"2023-10-09T06:25:47.842472+0000","last_unstale":"2023-10-09T06:25:47.842724+0000","last_undegraded":"2023-10-09T06:25:47.842724+0000","last_fullsized":"2023-10-09T06:25:47.842724+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:02.106046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843292+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.847553+0000","last_change":"2023-10-09T06:25:47.847553+0000","last_active":"2023-10-09T06:25:47.847553+0000","last_peered":"2023-10-09T06:25:47.847553+0000","last_clean":"2023-10-09T06:25:47.847553+0000","last_became_active":"2023-10-09T06:25:47.847331+0000","last_became_peered":"2023-10-09T06:25:47.847331+0000","last_unstale":"2023-10-09T06:25:47.847553+0000","last_undegraded":"2023-10-09T06:25:47.847553+0000","last_fullsized":"2023-10-09T06:25:47.847553+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:53.459647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847544+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:04.966793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.848332+0000","last_change":"2023-10-09T06:25:47.848332+0000","last_active":"2023-10-09T06:25:47.848332+0000","last_peered":"2023-10-09T06:25:47.848332+0000","last_clean":"2023-10-09T06:25:47.848332+0000","last_became_active":"2023-10-09T06:25:47.848047+0000","last_became_peered":"2023-10-09T06:25:47.848047+0000","last_unstale":"2023-10-09T06:25:47.848332+0000","last_undegraded":"2023-10-09T06:25:47.848332+0000","last_fullsized":"2023-10-09T06:25:47.848332+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:11.346640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845382+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:25.089742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855073+0000","last_change":"2023-10-09T06:25:47.855073+0000","last_active":"2023-10-09T06:25:47.855073+0000","last_peered":"2023-10-09T06:25:47.855073+0000","last_clean":"2023-10-09T06:25:47.855073+0000","last_became_active":"2023-10-09T06:25:47.854877+0000","last_became_peered":"2023-10-09T06:25:47.854877+0000","last_unstale":"2023-10-09T06:25:47.855073+0000","last_undegraded":"2023-10-09T06:25:47.855073+0000","last_fullsized":"2023-10-09T06:25:47.855073+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:32.948454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845712+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:55.341469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851026+0000","last_change":"2023-10-09T06:25:47.851026+0000","last_active":"2023-10-09T06:25:47.851026+0000","last_peered":"2023-10-09T06:25:47.851026+0000","last_clean":"2023-10-09T06:25:47.851026+0000","last_became_active":"2023-10-09T06:25:47.850820+0000","last_became_peered":"2023-10-09T06:25:47.850820+0000","last_unstale":"2023-10-09T06:25:47.851026+0000","last_undegraded":"2023-10-09T06:25:47.851026+0000","last_fullsized":"2023-10-09T06:25:47.851026+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:01.086319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846911+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850149+0000","last_change":"2023-10-09T06:25:47.850149+0000","last_active":"2023-10-09T06:25:47.850149+0000","last_peered":"2023-10-09T06:25:47.850149+0000","last_clean":"2023-10-09T06:25:47.850149+0000","last_became_active":"2023-10-09T06:25:47.849942+0000","last_became_peered":"2023-10-09T06:25:47.849942+0000","last_unstale":"2023-10-09T06:25:47.850149+0000","last_undegraded":"2023-10-09T06:25:47.850149+0000","last_fullsized":"2023-10-09T06:25:47.850149+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:08.735859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.844415+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850579+0000","last_change":"2023-10-09T06:25:47.850579+0000","last_active":"2023-10-09T06:25:47.850579+0000","last_peered":"2023-10-09T06:25:47.850579+0000","last_clean":"2023-10-09T06:25:47.850579+0000","last_became_active":"2023-10-09T06:25:47.850361+0000","last_became_peered":"2023-10-09T06:25:47.850361+0000","last_unstale":"2023-10-09T06:25:47.850579+0000","last_undegraded":"2023-10-09T06:25:47.850579+0000","last_fullsized":"2023-10-09T06:25:47.850579+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:48.069765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845198+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:12.775919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.848106+0000","last_change":"2023-10-09T06:25:47.848106+0000","last_active":"2023-10-09T06:25:47.848106+0000","last_peered":"2023-10-09T06:25:47.848106+0000","last_clean":"2023-10-09T06:25:47.848106+0000","last_became_active":"2023-10-09T06:25:47.847818+0000","last_became_peered":"2023-10-09T06:25:47.847818+0000","last_unstale":"2023-10-09T06:25:47.848106+0000","last_undegraded":"2023-10-09T06:25:47.848106+0000","last_fullsized":"2023-10-09T06:25:47.848106+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:02.106046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845529+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:09.795315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.842874+0000","last_change":"2023-10-09T06:25:47.842874+0000","last_active":"2023-10-09T06:25:47.842874+0000","last_peered":"2023-10-09T06:25:47.842874+0000","last_clean":"2023-10-09T06:25:47.842874+0000","last_became_active":"2023-10-09T06:25:47.842648+0000","last_became_peered":"2023-10-09T06:25:47.842648+0000","last_unstale":"2023-10-09T06:25:47.842874+0000","last_undegraded":"2023-10-09T06:25:47.842874+0000","last_fullsized":"2023-10-09T06:25:47.842874+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:15.983140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841909+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.846610+0000","last_change":"2023-10-09T06:25:47.846610+0000","last_active":"2023-10-09T06:25:47.846610+0000","last_peered":"2023-10-09T06:25:47.846610+0000","last_clean":"2023-10-09T06:25:47.846610+0000","last_became_active":"2023-10-09T06:25:47.846390+0000","last_became_peered":"2023-10-09T06:25:47.846390+0000","last_unstale":"2023-10-09T06:25:47.846610+0000","last_undegraded":"2023-10-09T06:25:47.846610+0000","last_fullsized":"2023-10-09T06:25:47.846610+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:45.550797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846133+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:54:51.114943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.847568+0000","last_change":"2023-10-09T06:25:47.847568+0000","last_active":"2023-10-09T06:25:47.847568+0000","last_peered":"2023-10-09T06:25:47.847568+0000","last_clean":"2023-10-09T06:25:47.847568+0000","last_became_active":"2023-10-09T06:25:47.847337+0000","last_became_peered":"2023-10-09T06:25:47.847337+0000","last_unstale":"2023-10-09T06:25:47.847568+0000","last_undegraded":"2023-10-09T06:25:47.847568+0000","last_fullsized":"2023-10-09T06:25:47.847568+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:27.334050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841126+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:02.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850759+0000","last_change":"2023-10-09T06:25:47.850759+0000","last_active":"2023-10-09T06:25:47.850759+0000","last_peered":"2023-10-09T06:25:47.850759+0000","last_clean":"2023-10-09T06:25:47.850759+0000","last_became_active":"2023-10-09T06:25:47.850307+0000","last_became_peered":"2023-10-09T06:25:47.850307+0000","last_unstale":"2023-10-09T06:25:47.850759+0000","last_undegraded":"2023-10-09T06:25:47.850759+0000","last_fullsized":"2023-10-09T06:25:47.850759+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:16.873504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846156+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:03.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.850946+0000","last_change":"2023-10-09T06:25:47.850946+0000","last_active":"2023-10-09T06:25:47.850946+0000","last_peered":"2023-10-09T06:25:47.850946+0000","last_clean":"2023-10-09T06:25:47.850946+0000","last_became_active":"2023-10-09T06:25:47.850152+0000","last_became_peered":"2023-10-09T06:25:47.850152+0000","last_unstale":"2023-10-09T06:25:47.850946+0000","last_undegraded":"2023-10-09T06:25:47.850946+0000","last_fullsized":"2023-10-09T06:25:47.850946+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:45.813982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.847416+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:23:39.868860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851348+0000","last_change":"2023-10-09T06:25:47.851348+0000","last_active":"2023-10-09T06:25:47.851348+0000","last_peered":"2023-10-09T06:25:47.851348+0000","last_clean":"2023-10-09T06:25:47.851348+0000","last_became_active":"2023-10-09T06:25:47.851175+0000","last_became_peered":"2023-10-09T06:25:47.851175+0000","last_unstale":"2023-10-09T06:25:47.851348+0000","last_undegraded":"2023-10-09T06:25:47.851348+0000","last_fullsized":"2023-10-09T06:25:47.851348+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:24.614225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.843934+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.847988+0000","last_change":"2023-10-09T06:25:47.847988+0000","last_active":"2023-10-09T06:25:47.847988+0000","last_peered":"2023-10-09T06:25:47.847988+0000","last_clean":"2023-10-09T06:25:47.847988+0000","last_became_active":"2023-10-09T06:25:47.847720+0000","last_became_peered":"2023-10-09T06:25:47.847720+0000","last_unstale":"2023-10-09T06:25:47.847988+0000","last_undegraded":"2023-10-09T06:25:47.847988+0000","last_fullsized":"2023-10-09T06:25:47.847988+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:44.660413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.848971+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:27.172362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.849760+0000","last_change":"2023-10-09T06:25:47.849760+0000","last_active":"2023-10-09T06:25:47.849760+0000","last_peered":"2023-10-09T06:25:47.849760+0000","last_clean":"2023-10-09T06:25:47.849760+0000","last_became_active":"2023-10-09T06:25:47.849254+0000","last_became_peered":"2023-10-09T06:25:47.849254+0000","last_unstale":"2023-10-09T06:25:47.849760+0000","last_undegraded":"2023-10-09T06:25:47.849760+0000","last_fullsized":"2023-10-09T06:25:47.849760+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:05:38.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.841441+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:49.073093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851090+0000","last_change":"2023-10-09T06:25:47.851090+0000","last_active":"2023-10-09T06:25:47.851090+0000","last_peered":"2023-10-09T06:25:47.851090+0000","last_clean":"2023-10-09T06:25:47.851090+0000","last_became_active":"2023-10-09T06:25:47.850476+0000","last_became_peered":"2023-10-09T06:25:47.850476+0000","last_unstale":"2023-10-09T06:25:47.851090+0000","last_undegraded":"2023-10-09T06:25:47.851090+0000","last_fullsized":"2023-10-09T06:25:47.851090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:10.729010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.842951+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:30.810531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.855007+0000","last_change":"2023-10-09T06:25:47.855007+0000","last_active":"2023-10-09T06:25:47.855007+0000","last_peered":"2023-10-09T06:25:47.855007+0000","last_clean":"2023-10-09T06:25:47.855007+0000","last_became_active":"2023-10-09T06:25:47.854175+0000","last_became_peered":"2023-10-09T06:25:47.854175+0000","last_unstale":"2023-10-09T06:25:47.855007+0000","last_undegraded":"2023-10-09T06:25:47.855007+0000","last_fullsized":"2023-10-09T06:25:47.855007+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:18.208465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.846419+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.851947+0000","last_change":"2023-10-09T06:25:47.851947+0000","last_active":"2023-10-09T06:25:47.851947+0000","last_peered":"2023-10-09T06:25:47.851947+0000","last_clean":"2023-10-09T06:25:47.851947+0000","last_became_active":"2023-10-09T06:25:47.851716+0000","last_became_peered":"2023-10-09T06:25:47.851716+0000","last_unstale":"2023-10-09T06:25:47.851947+0000","last_undegraded":"2023-10-09T06:25:47.851947+0000","last_fullsized":"2023-10-09T06:25:47.851947+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:33.781182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845968+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.852812+0000","last_change":"2023-10-09T06:25:47.852812+0000","last_active":"2023-10-09T06:25:47.852812+0000","last_peered":"2023-10-09T06:25:47.852812+0000","last_clean":"2023-10-09T06:25:47.852812+0000","last_became_active":"2023-10-09T06:25:47.852370+0000","last_became_peered":"2023-10-09T06:25:47.852370+0000","last_unstale":"2023-10-09T06:25:47.852812+0000","last_undegraded":"2023-10-09T06:25:47.852812+0000","last_fullsized":"2023-10-09T06:25:47.852812+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:33.781182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:25:47.837017+0000","last_change":"2023-10-09T06:25:47.845338+0000","last_active":"2023-10-09T06:25:47.837017+0000","last_peered":"2023-10-09T06:25:47.837017+0000","last_clean":"2023-10-09T06:25:47.837017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:25:47.837017+0000","last_undegraded":"2023-10-09T06:25:47.837017+0000","last_fullsized":"2023-10-09T06:25:47.837017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:51.475186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T06:25:47.853329+0000","last_change":"2023-10-09T06:25:47.853329+0000","last_active":"2023-10-09T06:25:47.853329+0000","last_peered":"2023-10-09T06:25:47.853329+0000","last_clean":"2023-10-09T06:25:47.853329+0000","last_became_active":"2023-10-09T06:25:47.853093+0000","last_became_peered":"2023-10-09T06:25:47.853093+0000","last_unstale":"2023-10-09T06:25:47.853329+0000","last_undegraded":"2023-10-09T06:25:47.853329+0000","last_fullsized":"2023-10-09T06:25:47.853329+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:29.807202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":231,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T06:25:46.843032+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:25:46.843032+0000","last_peered":"2023-10-09T06:25:46.843032+0000","last_clean":"2023-10-09T06:25:46.843032+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:25:46.843032+0000","last_undegraded":"2023-10-09T06:25:46.843032+0000","last_fullsized":"2023-10-09T06:25:46.843032+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1098,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198875132,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82599999999999996,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.91200000000000003,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76800000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.746},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53100000000000003,"15min":0.50600000000000001},"min":{"1min":0.35199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75800000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.57399999999999995},"min":{"1min":0.44700000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81399999999999995,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.53600000000000003},"min":{"1min":0.45000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80600000000000005,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.64700000000000002,"15min":0.57899999999999996},"min":{"1min":0.45900000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.56299999999999994},"min":{"1min":0.46000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71299999999999997,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.78200000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46800000000000003,"15min":0.47299999999999998},"min":{"1min":0.27200000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.31900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.72699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.34000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.91400000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.86799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":515,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194796,"statfs":{"total":200000000,"available":199471763,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.66100000000000003,"15min":0.79100000000000004},"min":{"1min":0.35199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77100000000000002,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.38100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":1.133,"15min":1.133},"last":0.40799999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.47299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72699999999999998,"5min":1.155,"15min":1.155},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71599999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72599999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.68000000000000005,"15min":0.80000000000000004},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.78900000000000003,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58299999999999996,"15min":0.60099999999999998},"min":{"1min":0.46200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":1.337,"15min":1.337},"last":0.496},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":1.206,"15min":1.206},"last":0.48299999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.497,"15min":0.497},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45000000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47399999999999998},"min":{"1min":0.377,"5min":0.315,"15min":0.315},"max":{"1min":0.69499999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.438},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46600000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.36599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.254,"5min":0.219,"15min":0.219},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.37},{"interface":"front","average":{"1min":0.434,"5min":0.35999999999999999,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.28999999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.26300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.39700000000000002,"15min":0.38500000000000001},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.40500000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.436,"15min":0.41199999999999998},"min":{"1min":0.35899999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.442,"15min":0.42799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.56000000000000005},"min":{"1min":0.43099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.72499999999999998,"15min":0.82899999999999996},"min":{"1min":0.47399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90200000000000002,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64500000000000002,"15min":0.625},"min":{"1min":0.47099999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66000000000000003,"15min":0.66800000000000004},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.175,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64000000000000001,"15min":0.61799999999999999},"min":{"1min":0.51700000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.48599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0189999999999999,"5min":1.49,"15min":1.49},"last":0.73899999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.52300000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67200000000000004,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.84799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1098,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198875132,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.41399999999999998},"min":{"1min":0.23599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.50600000000000001,"5min":1.226,"15min":1.226},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.54900000000000004,"5min":1.131,"15min":1.131},"last":0.29299999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.55700000000000005,"15min":0.99399999999999999},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":12.929,"15min":12.929},"last":0.313},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.438,"15min":0.46300000000000002},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.55000000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.47699999999999998},"min":{"1min":0.32200000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.749,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45300000000000001,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.314,"15min":0.314},"max":{"1min":0.57399999999999995,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.628,"15min":0.65600000000000003},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97099999999999997,"5min":1.335,"15min":1.335},"last":0.629}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90700000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.495},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.81499999999999995,"5min":0.999,"15min":0.999},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83099999999999996,"5min":0.998,"15min":0.998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65400000000000003,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.262,"15min":1.262},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.67000000000000004},"min":{"1min":0.52100000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.95599999999999996,"5min":1.103,"15min":1.103},"last":0.59899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.5,"15min":0.88600000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.48599999999999999,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.312},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.46200000000000002,"15min":0.67400000000000004},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57099999999999995,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.436,"15min":0.63400000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68000000000000005,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.53600000000000003,"15min":0.70399999999999996},"min":{"1min":0.28299999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.91400000000000003,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.33700000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.51700000000000002,"15min":0.70699999999999996},"min":{"1min":0.30299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70299999999999996,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.371},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.58299999999999996,"15min":0.94599999999999995},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.77000000000000002,"15min":1.1459999999999999},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.95299999999999996,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.71899999999999997,"15min":0.93100000000000005},"min":{"1min":0.46700000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1160000000000001,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.61299999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.90600000000000003},"min":{"1min":0.432,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93600000000000005,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72299999999999998,"15min":0.91300000000000003},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.006,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.625}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.71099999999999997,"15min":0.89500000000000002},"min":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95599999999999996,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.78600000000000003,"15min":1.1439999999999999},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.028,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70099999999999996,"15min":0.89100000000000001},"min":{"1min":0.44600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85299999999999998,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72099999999999997,"15min":0.90800000000000003},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0609999999999999,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.52200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.33800000000000002,"15min":0.32600000000000001},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.499,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39500000000000002,"15min":0.375},"min":{"1min":0.33100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33800000000000002,"15min":0.32200000000000001},"min":{"1min":0.255,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.36899999999999999,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.314}]},{"osd":2,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.373,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.373},{"interface":"front","average":{"1min":0.502,"5min":0.44,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64600000000000002,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.38500000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46800000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82399999999999995,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.875,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.45100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.73999999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80600000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51700000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.58199999999999996},"min":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":0.87,"15min":0.87},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.51900000000000002,"15min":0.49399999999999999},"min":{"1min":0.46100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.40100000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65100000000000002,"15min":0.72499999999999998},"min":{"1min":0.39500000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72899999999999998,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.38500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.64200000000000002,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.68200000000000005,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.84899999999999998,"15min":1.125},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":11.715,"15min":11.715},"last":0.43099999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.56000000000000005,"15min":0.52400000000000002},"min":{"1min":0.53300000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.51700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73499999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54500000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53100000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50600000000000001,"15min":0.503},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55400000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.499},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81299999999999994,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":515,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194796,"statfs":{"total":200000000,"available":199471763,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.48999999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68899999999999995,"5min":1.093,"15min":1.093},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.51200000000000001},"min":{"1min":0.44400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73499999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.67100000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76300000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.77600000000000002,"5min":1.071,"15min":1.071},"last":0.64000000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66000000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48399999999999999,"15min":0.501},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.624,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.755}]},{"osd":6,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.50600000000000001,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64400000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.36399999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.67800000000000005,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65400000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64600000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.84399999999999997}]}]}],"pool_statfs":[]}} 2023-10-09T06:25:56.281 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:25:56.284 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:25:57.538 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:25:57.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.671+0000 7f961957e700 1 Processor -- start 2023-10-09T06:25:57.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.671+0000 7f961957e700 1 -- start start 2023-10-09T06:25:57.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.671+0000 7f961957e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f961415a2b0 0x7f96140b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:57.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.671+0000 7f961957e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96140d1c30 0x7f96140cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:57.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.671+0000 7f961957e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96140c5d80 con 0x7f961415a680 2023-10-09T06:25:57.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.671+0000 7f961957e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9614068470 con 0x7f961415a2b0 2023-10-09T06:25:57.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.671+0000 7f961957e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96140c6060 con 0x7f96140d1c30 2023-10-09T06:25:57.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.672+0000 7f9612ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f961415a2b0 0x7f96140b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:57.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.672+0000 7f9612ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f961415a2b0 0x7f96140b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43246/0 (socket says 172.21.15.31:43246) 2023-10-09T06:25:57.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.672+0000 7f9612ffd700 1 -- 172.21.15.31:0/3463082005 learned_addr learned my addr 172.21.15.31:0/3463082005 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:57.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.672+0000 7f96127fc700 1 --2- 172.21.15.31:0/3463082005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96140d1c30 0x7f96140cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:57.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.672+0000 7f9612ffd700 1 -- 172.21.15.31:0/3463082005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96140d1c30 msgr2=0x7f96140cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:57.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.672+0000 7f9612ffd700 1 --2- 172.21.15.31:0/3463082005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96140d1c30 0x7f96140cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:57.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.672+0000 7f9612ffd700 1 -- 172.21.15.31:0/3463082005 >> v1:172.21.15.158:6789/0 conn(0x7f961415a680 legacy=0x7f96140c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:57.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.672+0000 7f9612ffd700 1 -- 172.21.15.31:0/3463082005 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96140c6340 con 0x7f961415a2b0 2023-10-09T06:25:57.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.672+0000 7f9612ffd700 1 --2- 172.21.15.31:0/3463082005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961415a2b0 0x7f96140b3da0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f960c009990 tx=0x7f960c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93da689300a7d6b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.672+0000 7f9611ffb700 1 -- 172.21.15.31:0/3463082005 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c005c10 con 0x7f961415a2b0 2023-10-09T06:25:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.672+0000 7f9611ffb700 1 -- 172.21.15.31:0/3463082005 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c005d70 con 0x7f961415a2b0 2023-10-09T06:25:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.672+0000 7f9611ffb700 1 -- 172.21.15.31:0/3463082005 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c00b840 con 0x7f961415a2b0 2023-10-09T06:25:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.673+0000 7f961957e700 1 -- 172.21.15.31:0/3463082005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961415a2b0 msgr2=0x7f96140b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.673+0000 7f961957e700 1 --2- 172.21.15.31:0/3463082005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961415a2b0 0x7f96140b3da0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f960c009990 tx=0x7f960c009220 comp rx=0 tx=0).stop 2023-10-09T06:25:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.673+0000 7f961957e700 1 -- 172.21.15.31:0/3463082005 shutdown_connections 2023-10-09T06:25:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.673+0000 7f961957e700 1 --2- 172.21.15.31:0/3463082005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961415a2b0 0x7f96140b3da0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.673+0000 7f961957e700 1 --2- 172.21.15.31:0/3463082005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f96140d1c30 0x7f96140cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.673+0000 7f961957e700 1 -- 172.21.15.31:0/3463082005 >> 172.21.15.31:0/3463082005 conn(0x7f9614067e40 msgr2=0x7f96140d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.673+0000 7f961957e700 1 -- 172.21.15.31:0/3463082005 shutdown_connections 2023-10-09T06:25:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.673+0000 7f961957e700 1 -- 172.21.15.31:0/3463082005 wait complete. 2023-10-09T06:25:57.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.674+0000 7f961957e700 1 Processor -- start 2023-10-09T06:25:57.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.674+0000 7f961957e700 1 -- start start 2023-10-09T06:25:57.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f961957e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96140d1c30 0x7f961416e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:57.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f961957e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f961415a2b0 0x7f961415e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:57.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f961957e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f961415a680 0x7f961409dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:57.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f961957e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96140ca1f0 con 0x7f96140d1c30 2023-10-09T06:25:57.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f961957e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96140c95e0 con 0x7f961415a680 2023-10-09T06:25:57.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f961957e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96140c98c0 con 0x7f961415a2b0 2023-10-09T06:25:57.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f9612ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96140d1c30 0x7f961416e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:57.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f9612ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96140d1c30 0x7f961416e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43256/0 (socket says 172.21.15.31:43256) 2023-10-09T06:25:57.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f9612ffd700 1 -- 172.21.15.31:0/2380663452 learned_addr learned my addr 172.21.15.31:0/2380663452 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:57.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f96137fe700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f961415a680 0x7f961409dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:57.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f96127fc700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f961415a2b0 0x7f961415e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:57.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f9612ffd700 1 -- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f961415a2b0 msgr2=0x7f961415e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:57.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f9612ffd700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f961415a2b0 0x7f961415e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:57.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f9612ffd700 1 -- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f961415a680 msgr2=0x7f961409dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:57.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f9612ffd700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f961415a680 0x7f961409dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:57.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f9612ffd700 1 -- 172.21.15.31:0/2380663452 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c009480 con 0x7f96140d1c30 2023-10-09T06:25:57.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.675+0000 7f96137fe700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f961415a680 0x7f961409dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:57.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.676+0000 7f9612ffd700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96140d1c30 0x7f961416e720 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f960c003080 tx=0x7f960c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:57.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.676+0000 7f960affd700 1 -- 172.21.15.31:0/2380663452 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c011920 con 0x7f96140d1c30 2023-10-09T06:25:57.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.676+0000 7f960affd700 1 -- 172.21.15.31:0/2380663452 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c011a80 con 0x7f96140d1c30 2023-10-09T06:25:57.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.676+0000 7f961957e700 1 -- 172.21.15.31:0/2380663452 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96140c9ba0 con 0x7f96140d1c30 2023-10-09T06:25:57.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.676+0000 7f960affd700 1 -- 172.21.15.31:0/2380663452 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c011e40 con 0x7f96140d1c30 2023-10-09T06:25:57.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.676+0000 7f961957e700 1 -- 172.21.15.31:0/2380663452 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961416ec60 con 0x7f96140d1c30 2023-10-09T06:25:57.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.677+0000 7f961957e700 1 -- 172.21.15.31:0/2380663452 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961404c3c0 con 0x7f96140d1c30 2023-10-09T06:25:57.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.677+0000 7f960affd700 1 -- 172.21.15.31:0/2380663452 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f960c01d640 con 0x7f96140d1c30 2023-10-09T06:25:57.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.678+0000 7f960affd700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f95f4066f30 0x7f95f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:57.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.678+0000 7f960affd700 1 -- 172.21.15.31:0/2380663452 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f960c085f30 con 0x7f96140d1c30 2023-10-09T06:25:57.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.678+0000 7f96127fc700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f95f4066f30 0x7f95f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:57.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.678+0000 7f96127fc700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f95f4066f30 0x7f95f40693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f95fc006fd0 tx=0x7f95fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:57.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.682+0000 7f960affd700 1 -- 172.21.15.31:0/2380663452 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f960c0531a0 con 0x7f96140d1c30 2023-10-09T06:25:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.871+0000 7f961957e700 1 -- 172.21.15.31:0/2380663452 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96140ca330 con 0x7f95f4066f30 2023-10-09T06:25:57.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.880+0000 7f960affd700 1 -- 172.21.15.31:0/2380663452 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284847 (secure 0 0 0) 0x7f95fc00bdd0 con 0x7f95f4066f30 2023-10-09T06:25:57.884 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:58.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.882+0000 7f961957e700 1 -- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f95f4066f30 msgr2=0x7f95f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:58.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.882+0000 7f961957e700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f95f4066f30 0x7f95f40693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f95fc006fd0 tx=0x7f95fc008040 comp rx=0 tx=0).stop 2023-10-09T06:25:58.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.883+0000 7f961957e700 1 -- 172.21.15.31:0/2380663452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96140d1c30 msgr2=0x7f961416e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:58.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.883+0000 7f961957e700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96140d1c30 0x7f961416e720 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f960c003080 tx=0x7f960c015000 comp rx=0 tx=0).stop 2023-10-09T06:25:58.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.883+0000 7f961957e700 1 -- 172.21.15.31:0/2380663452 shutdown_connections 2023-10-09T06:25:58.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.883+0000 7f961957e700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f95f4066f30 0x7f95f40693e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.883+0000 7f961957e700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f961415a680 0x7f961409dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.883+0000 7f961957e700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96140d1c30 0x7f961416e720 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.883+0000 7f961957e700 1 --2- 172.21.15.31:0/2380663452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f961415a2b0 0x7f961415e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.883+0000 7f961957e700 1 -- 172.21.15.31:0/2380663452 >> 172.21.15.31:0/2380663452 conn(0x7f9614067e40 msgr2=0x7f96140b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:58.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.883+0000 7f961957e700 1 -- 172.21.15.31:0/2380663452 shutdown_connections 2023-10-09T06:25:58.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:57.883+0000 7f961957e700 1 -- 172.21.15.31:0/2380663452 wait complete. 2023-10-09T06:25:58.025 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:25:58.026 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2023-10-09T06:25:56.589510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5435,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557064,"statfs":{"total":1600000000,"available":1594434244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001908"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.858931+0000","last_change":"2023-10-09T06:25:48.858862+0000","last_active":"2023-10-09T06:25:48.858931+0000","last_peered":"2023-10-09T06:25:48.858931+0000","last_clean":"2023-10-09T06:25:48.858931+0000","last_became_active":"2023-10-09T06:25:48.858560+0000","last_became_peered":"2023-10-09T06:25:48.858560+0000","last_unstale":"2023-10-09T06:25:48.858931+0000","last_undegraded":"2023-10-09T06:25:48.858931+0000","last_fullsized":"2023-10-09T06:25:48.858931+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.865498+0000","last_change":"2023-10-09T06:25:48.863522+0000","last_active":"2023-10-09T06:25:48.865498+0000","last_peered":"2023-10-09T06:25:48.865498+0000","last_clean":"2023-10-09T06:25:48.865498+0000","last_became_active":"2023-10-09T06:25:48.862767+0000","last_became_peered":"2023-10-09T06:25:48.862767+0000","last_unstale":"2023-10-09T06:25:48.865498+0000","last_undegraded":"2023-10-09T06:25:48.865498+0000","last_fullsized":"2023-10-09T06:25:48.865498+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:45.663742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.859546+0000","last_change":"2023-10-09T06:25:48.859463+0000","last_active":"2023-10-09T06:25:48.859546+0000","last_peered":"2023-10-09T06:25:48.859546+0000","last_clean":"2023-10-09T06:25:48.859546+0000","last_became_active":"2023-10-09T06:25:48.859231+0000","last_became_peered":"2023-10-09T06:25:48.859231+0000","last_unstale":"2023-10-09T06:25:48.859546+0000","last_undegraded":"2023-10-09T06:25:48.859546+0000","last_fullsized":"2023-10-09T06:25:48.859546+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:54.261243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.866304+0000","last_change":"2023-10-09T06:25:48.866206+0000","last_active":"2023-10-09T06:25:48.866304+0000","last_peered":"2023-10-09T06:25:48.866304+0000","last_clean":"2023-10-09T06:25:48.866304+0000","last_became_active":"2023-10-09T06:25:48.865636+0000","last_became_peered":"2023-10-09T06:25:48.865636+0000","last_unstale":"2023-10-09T06:25:48.866304+0000","last_undegraded":"2023-10-09T06:25:48.866304+0000","last_fullsized":"2023-10-09T06:25:48.866304+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:51.475186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.863524+0000","last_change":"2023-10-09T06:25:48.863126+0000","last_active":"2023-10-09T06:25:48.863524+0000","last_peered":"2023-10-09T06:25:48.863524+0000","last_clean":"2023-10-09T06:25:48.863524+0000","last_became_active":"2023-10-09T06:25:48.862902+0000","last_became_peered":"2023-10-09T06:25:48.862902+0000","last_unstale":"2023-10-09T06:25:48.863524+0000","last_undegraded":"2023-10-09T06:25:48.863524+0000","last_fullsized":"2023-10-09T06:25:48.863524+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:16.986469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.866398+0000","last_change":"2023-10-09T06:25:48.866258+0000","last_active":"2023-10-09T06:25:48.866398+0000","last_peered":"2023-10-09T06:25:48.866398+0000","last_clean":"2023-10-09T06:25:48.866398+0000","last_became_active":"2023-10-09T06:25:48.865989+0000","last_became_peered":"2023-10-09T06:25:48.865989+0000","last_unstale":"2023-10-09T06:25:48.866398+0000","last_undegraded":"2023-10-09T06:25:48.866398+0000","last_fullsized":"2023-10-09T06:25:48.866398+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:23:39.868860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.860276+0000","last_change":"2023-10-09T06:25:48.859581+0000","last_active":"2023-10-09T06:25:48.860276+0000","last_peered":"2023-10-09T06:25:48.860276+0000","last_clean":"2023-10-09T06:25:48.860276+0000","last_became_active":"2023-10-09T06:25:48.858930+0000","last_became_peered":"2023-10-09T06:25:48.858930+0000","last_unstale":"2023-10-09T06:25:48.860276+0000","last_undegraded":"2023-10-09T06:25:48.860276+0000","last_fullsized":"2023-10-09T06:25:48.860276+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:46.817311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.862033+0000","last_change":"2023-10-09T06:25:48.861954+0000","last_active":"2023-10-09T06:25:48.862033+0000","last_peered":"2023-10-09T06:25:48.862033+0000","last_clean":"2023-10-09T06:25:48.862033+0000","last_became_active":"2023-10-09T06:25:48.861770+0000","last_became_peered":"2023-10-09T06:25:48.861770+0000","last_unstale":"2023-10-09T06:25:48.862033+0000","last_undegraded":"2023-10-09T06:25:48.862033+0000","last_fullsized":"2023-10-09T06:25:48.862033+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:21.991307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.865340+0000","last_change":"2023-10-09T06:25:48.865281+0000","last_active":"2023-10-09T06:25:48.865340+0000","last_peered":"2023-10-09T06:25:48.865340+0000","last_clean":"2023-10-09T06:25:48.865340+0000","last_became_active":"2023-10-09T06:25:48.865047+0000","last_became_peered":"2023-10-09T06:25:48.865047+0000","last_unstale":"2023-10-09T06:25:48.865340+0000","last_undegraded":"2023-10-09T06:25:48.865340+0000","last_fullsized":"2023-10-09T06:25:48.865340+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:43.433850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.860751+0000","last_change":"2023-10-09T06:25:48.860643+0000","last_active":"2023-10-09T06:25:48.860751+0000","last_peered":"2023-10-09T06:25:48.860751+0000","last_clean":"2023-10-09T06:25:48.860751+0000","last_became_active":"2023-10-09T06:25:48.860397+0000","last_became_peered":"2023-10-09T06:25:48.860397+0000","last_unstale":"2023-10-09T06:25:48.860751+0000","last_undegraded":"2023-10-09T06:25:48.860751+0000","last_fullsized":"2023-10-09T06:25:48.860751+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:04.966793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.861192+0000","last_change":"2023-10-09T06:25:48.861092+0000","last_active":"2023-10-09T06:25:48.861192+0000","last_peered":"2023-10-09T06:25:48.861192+0000","last_clean":"2023-10-09T06:25:48.861192+0000","last_became_active":"2023-10-09T06:25:48.860700+0000","last_became_peered":"2023-10-09T06:25:48.860700+0000","last_unstale":"2023-10-09T06:25:48.861192+0000","last_undegraded":"2023-10-09T06:25:48.861192+0000","last_fullsized":"2023-10-09T06:25:48.861192+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:13.017092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.861182+0000","last_change":"2023-10-09T06:25:48.861107+0000","last_active":"2023-10-09T06:25:48.861182+0000","last_peered":"2023-10-09T06:25:48.861182+0000","last_clean":"2023-10-09T06:25:48.861182+0000","last_became_active":"2023-10-09T06:25:48.860070+0000","last_became_peered":"2023-10-09T06:25:48.860070+0000","last_unstale":"2023-10-09T06:25:48.861182+0000","last_undegraded":"2023-10-09T06:25:48.861182+0000","last_fullsized":"2023-10-09T06:25:48.861182+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:23:39.868860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.860991+0000","last_change":"2023-10-09T06:25:48.860904+0000","last_active":"2023-10-09T06:25:48.860991+0000","last_peered":"2023-10-09T06:25:48.860991+0000","last_clean":"2023-10-09T06:25:48.860991+0000","last_became_active":"2023-10-09T06:25:48.860734+0000","last_became_peered":"2023-10-09T06:25:48.860734+0000","last_unstale":"2023-10-09T06:25:48.860991+0000","last_undegraded":"2023-10-09T06:25:48.860991+0000","last_fullsized":"2023-10-09T06:25:48.860991+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:21.766447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.866254+0000","last_change":"2023-10-09T06:25:48.865887+0000","last_active":"2023-10-09T06:25:48.866254+0000","last_peered":"2023-10-09T06:25:48.866254+0000","last_clean":"2023-10-09T06:25:48.866254+0000","last_became_active":"2023-10-09T06:25:48.865045+0000","last_became_peered":"2023-10-09T06:25:48.865045+0000","last_unstale":"2023-10-09T06:25:48.866254+0000","last_undegraded":"2023-10-09T06:25:48.866254+0000","last_fullsized":"2023-10-09T06:25:48.866254+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:29.732017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.859930+0000","last_change":"2023-10-09T06:25:48.859843+0000","last_active":"2023-10-09T06:25:48.859930+0000","last_peered":"2023-10-09T06:25:48.859930+0000","last_clean":"2023-10-09T06:25:48.859930+0000","last_became_active":"2023-10-09T06:25:48.859608+0000","last_became_peered":"2023-10-09T06:25:48.859608+0000","last_unstale":"2023-10-09T06:25:48.859930+0000","last_undegraded":"2023-10-09T06:25:48.859930+0000","last_fullsized":"2023-10-09T06:25:48.859930+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:18:01.760686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.857210+0000","last_change":"2023-10-09T06:25:48.857143+0000","last_active":"2023-10-09T06:25:48.857210+0000","last_peered":"2023-10-09T06:25:48.857210+0000","last_clean":"2023-10-09T06:25:48.857210+0000","last_became_active":"2023-10-09T06:25:48.856912+0000","last_became_peered":"2023-10-09T06:25:48.856912+0000","last_unstale":"2023-10-09T06:25:48.857210+0000","last_undegraded":"2023-10-09T06:25:48.857210+0000","last_fullsized":"2023-10-09T06:25:48.857210+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:02.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.857425+0000","last_change":"2023-10-09T06:25:48.857376+0000","last_active":"2023-10-09T06:25:48.857425+0000","last_peered":"2023-10-09T06:25:48.857425+0000","last_clean":"2023-10-09T06:25:48.857425+0000","last_became_active":"2023-10-09T06:25:48.856801+0000","last_became_peered":"2023-10-09T06:25:48.856801+0000","last_unstale":"2023-10-09T06:25:48.857425+0000","last_undegraded":"2023-10-09T06:25:48.857425+0000","last_fullsized":"2023-10-09T06:25:48.857425+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:04.966793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.863789+0000","last_change":"2023-10-09T06:25:48.863632+0000","last_active":"2023-10-09T06:25:48.863789+0000","last_peered":"2023-10-09T06:25:48.863789+0000","last_clean":"2023-10-09T06:25:48.863789+0000","last_became_active":"2023-10-09T06:25:48.863291+0000","last_became_peered":"2023-10-09T06:25:48.863291+0000","last_unstale":"2023-10-09T06:25:48.863789+0000","last_undegraded":"2023-10-09T06:25:48.863789+0000","last_fullsized":"2023-10-09T06:25:48.863789+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:54.462975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.861032+0000","last_change":"2023-10-09T06:25:48.860929+0000","last_active":"2023-10-09T06:25:48.861032+0000","last_peered":"2023-10-09T06:25:48.861032+0000","last_clean":"2023-10-09T06:25:48.861032+0000","last_became_active":"2023-10-09T06:25:48.860704+0000","last_became_peered":"2023-10-09T06:25:48.860704+0000","last_unstale":"2023-10-09T06:25:48.861032+0000","last_undegraded":"2023-10-09T06:25:48.861032+0000","last_fullsized":"2023-10-09T06:25:48.861032+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:21.991307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.866270+0000","last_change":"2023-10-09T06:25:48.865965+0000","last_active":"2023-10-09T06:25:48.866270+0000","last_peered":"2023-10-09T06:25:48.866270+0000","last_clean":"2023-10-09T06:25:48.866270+0000","last_became_active":"2023-10-09T06:25:48.865640+0000","last_became_peered":"2023-10-09T06:25:48.865640+0000","last_unstale":"2023-10-09T06:25:48.866270+0000","last_undegraded":"2023-10-09T06:25:48.866270+0000","last_fullsized":"2023-10-09T06:25:48.866270+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:12.919733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.860240+0000","last_change":"2023-10-09T06:25:48.859371+0000","last_active":"2023-10-09T06:25:48.860240+0000","last_peered":"2023-10-09T06:25:48.860240+0000","last_clean":"2023-10-09T06:25:48.860240+0000","last_became_active":"2023-10-09T06:25:48.857954+0000","last_became_peered":"2023-10-09T06:25:48.857954+0000","last_unstale":"2023-10-09T06:25:48.860240+0000","last_undegraded":"2023-10-09T06:25:48.860240+0000","last_fullsized":"2023-10-09T06:25:48.860240+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:42:38.050445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.865514+0000","last_change":"2023-10-09T06:25:48.863888+0000","last_active":"2023-10-09T06:25:48.865514+0000","last_peered":"2023-10-09T06:25:48.865514+0000","last_clean":"2023-10-09T06:25:48.865514+0000","last_became_active":"2023-10-09T06:25:48.863711+0000","last_became_peered":"2023-10-09T06:25:48.863711+0000","last_unstale":"2023-10-09T06:25:48.865514+0000","last_undegraded":"2023-10-09T06:25:48.865514+0000","last_fullsized":"2023-10-09T06:25:48.865514+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:09.739187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.859272+0000","last_change":"2023-10-09T06:25:48.859016+0000","last_active":"2023-10-09T06:25:48.859272+0000","last_peered":"2023-10-09T06:25:48.859272+0000","last_clean":"2023-10-09T06:25:48.859272+0000","last_became_active":"2023-10-09T06:25:48.858608+0000","last_became_peered":"2023-10-09T06:25:48.858608+0000","last_unstale":"2023-10-09T06:25:48.859272+0000","last_undegraded":"2023-10-09T06:25:48.859272+0000","last_fullsized":"2023-10-09T06:25:48.859272+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.349968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.862890+0000","last_change":"2023-10-09T06:25:48.859981+0000","last_active":"2023-10-09T06:25:48.862890+0000","last_peered":"2023-10-09T06:25:48.862890+0000","last_clean":"2023-10-09T06:25:48.862890+0000","last_became_active":"2023-10-09T06:25:48.859738+0000","last_became_peered":"2023-10-09T06:25:48.859738+0000","last_unstale":"2023-10-09T06:25:48.862890+0000","last_undegraded":"2023-10-09T06:25:48.862890+0000","last_fullsized":"2023-10-09T06:25:48.862890+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.617553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.865464+0000","last_change":"2023-10-09T06:25:48.862670+0000","last_active":"2023-10-09T06:25:48.865464+0000","last_peered":"2023-10-09T06:25:48.865464+0000","last_clean":"2023-10-09T06:25:48.865464+0000","last_became_active":"2023-10-09T06:25:48.861989+0000","last_became_peered":"2023-10-09T06:25:48.861989+0000","last_unstale":"2023-10-09T06:25:48.865464+0000","last_undegraded":"2023-10-09T06:25:48.865464+0000","last_fullsized":"2023-10-09T06:25:48.865464+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:05:39.476544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.862117+0000","last_change":"2023-10-09T06:25:48.862049+0000","last_active":"2023-10-09T06:25:48.862117+0000","last_peered":"2023-10-09T06:25:48.862117+0000","last_clean":"2023-10-09T06:25:48.862117+0000","last_became_active":"2023-10-09T06:25:48.861707+0000","last_became_peered":"2023-10-09T06:25:48.861707+0000","last_unstale":"2023-10-09T06:25:48.862117+0000","last_undegraded":"2023-10-09T06:25:48.862117+0000","last_fullsized":"2023-10-09T06:25:48.862117+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:44.707806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.860182+0000","last_change":"2023-10-09T06:25:48.860117+0000","last_active":"2023-10-09T06:25:48.860182+0000","last_peered":"2023-10-09T06:25:48.860182+0000","last_clean":"2023-10-09T06:25:48.860182+0000","last_became_active":"2023-10-09T06:25:48.859809+0000","last_became_peered":"2023-10-09T06:25:48.859809+0000","last_unstale":"2023-10-09T06:25:48.860182+0000","last_undegraded":"2023-10-09T06:25:48.860182+0000","last_fullsized":"2023-10-09T06:25:48.860182+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.349968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.863753+0000","last_change":"2023-10-09T06:25:48.863695+0000","last_active":"2023-10-09T06:25:48.863753+0000","last_peered":"2023-10-09T06:25:48.863753+0000","last_clean":"2023-10-09T06:25:48.863753+0000","last_became_active":"2023-10-09T06:25:48.863483+0000","last_became_peered":"2023-10-09T06:25:48.863483+0000","last_unstale":"2023-10-09T06:25:48.863753+0000","last_undegraded":"2023-10-09T06:25:48.863753+0000","last_fullsized":"2023-10-09T06:25:48.863753+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:43.433850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.861172+0000","last_change":"2023-10-09T06:25:48.861027+0000","last_active":"2023-10-09T06:25:48.861172+0000","last_peered":"2023-10-09T06:25:48.861172+0000","last_clean":"2023-10-09T06:25:48.861172+0000","last_became_active":"2023-10-09T06:25:48.860783+0000","last_became_peered":"2023-10-09T06:25:48.860783+0000","last_unstale":"2023-10-09T06:25:48.861172+0000","last_undegraded":"2023-10-09T06:25:48.861172+0000","last_fullsized":"2023-10-09T06:25:48.861172+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:35:15.229318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.868119+0000","last_change":"2023-10-09T06:25:48.868015+0000","last_active":"2023-10-09T06:25:48.868119+0000","last_peered":"2023-10-09T06:25:48.868119+0000","last_clean":"2023-10-09T06:25:48.868119+0000","last_became_active":"2023-10-09T06:25:48.867778+0000","last_became_peered":"2023-10-09T06:25:48.867778+0000","last_unstale":"2023-10-09T06:25:48.868119+0000","last_undegraded":"2023-10-09T06:25:48.868119+0000","last_fullsized":"2023-10-09T06:25:48.868119+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:19.211794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.864231+0000","last_change":"2023-10-09T06:25:48.864143+0000","last_active":"2023-10-09T06:25:48.864231+0000","last_peered":"2023-10-09T06:25:48.864231+0000","last_clean":"2023-10-09T06:25:48.864231+0000","last_became_active":"2023-10-09T06:25:48.863966+0000","last_became_peered":"2023-10-09T06:25:48.863966+0000","last_unstale":"2023-10-09T06:25:48.864231+0000","last_undegraded":"2023-10-09T06:25:48.864231+0000","last_fullsized":"2023-10-09T06:25:48.864231+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:39.198470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.861833+0000","last_change":"2023-10-09T06:25:48.861778+0000","last_active":"2023-10-09T06:25:48.861833+0000","last_peered":"2023-10-09T06:25:48.861833+0000","last_clean":"2023-10-09T06:25:48.861833+0000","last_became_active":"2023-10-09T06:25:48.861504+0000","last_became_peered":"2023-10-09T06:25:48.861504+0000","last_unstale":"2023-10-09T06:25:48.861833+0000","last_undegraded":"2023-10-09T06:25:48.861833+0000","last_fullsized":"2023-10-09T06:25:48.861833+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:21.991307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.860822+0000","last_change":"2023-10-09T06:25:48.860760+0000","last_active":"2023-10-09T06:25:48.860822+0000","last_peered":"2023-10-09T06:25:48.860822+0000","last_clean":"2023-10-09T06:25:48.860822+0000","last_became_active":"2023-10-09T06:25:48.860530+0000","last_became_peered":"2023-10-09T06:25:48.860530+0000","last_unstale":"2023-10-09T06:25:48.860822+0000","last_undegraded":"2023-10-09T06:25:48.860822+0000","last_fullsized":"2023-10-09T06:25:48.860822+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:30.810531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"100'4","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.873784+0000","last_change":"2023-10-09T06:25:47.851455+0000","last_active":"2023-10-09T06:25:48.873784+0000","last_peered":"2023-10-09T06:25:48.873784+0000","last_clean":"2023-10-09T06:25:48.873784+0000","last_became_active":"2023-10-09T06:25:47.851203+0000","last_became_peered":"2023-10-09T06:25:47.851203+0000","last_unstale":"2023-10-09T06:25:48.873784+0000","last_undegraded":"2023-10-09T06:25:48.873784+0000","last_fullsized":"2023-10-09T06:25:48.873784+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:11.772590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.858950+0000","last_change":"2023-10-09T06:25:48.858875+0000","last_active":"2023-10-09T06:25:48.858950+0000","last_peered":"2023-10-09T06:25:48.858950+0000","last_clean":"2023-10-09T06:25:48.858950+0000","last_became_active":"2023-10-09T06:25:48.858312+0000","last_became_peered":"2023-10-09T06:25:48.858312+0000","last_unstale":"2023-10-09T06:25:48.858950+0000","last_undegraded":"2023-10-09T06:25:48.858950+0000","last_fullsized":"2023-10-09T06:25:48.858950+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:32.359094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.873999+0000","last_change":"2023-10-09T06:25:47.854438+0000","last_active":"2023-10-09T06:25:48.873999+0000","last_peered":"2023-10-09T06:25:48.873999+0000","last_clean":"2023-10-09T06:25:48.873999+0000","last_became_active":"2023-10-09T06:25:47.854221+0000","last_became_peered":"2023-10-09T06:25:47.854221+0000","last_unstale":"2023-10-09T06:25:48.873999+0000","last_undegraded":"2023-10-09T06:25:48.873999+0000","last_fullsized":"2023-10-09T06:25:48.873999+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:05:38.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.862055+0000","last_change":"2023-10-09T06:25:48.861977+0000","last_active":"2023-10-09T06:25:48.862055+0000","last_peered":"2023-10-09T06:25:48.862055+0000","last_clean":"2023-10-09T06:25:48.862055+0000","last_became_active":"2023-10-09T06:25:48.861780+0000","last_became_peered":"2023-10-09T06:25:48.861780+0000","last_unstale":"2023-10-09T06:25:48.862055+0000","last_undegraded":"2023-10-09T06:25:48.862055+0000","last_fullsized":"2023-10-09T06:25:48.862055+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.945766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.873273+0000","last_change":"2023-10-09T06:25:47.849059+0000","last_active":"2023-10-09T06:25:48.873273+0000","last_peered":"2023-10-09T06:25:48.873273+0000","last_clean":"2023-10-09T06:25:48.873273+0000","last_became_active":"2023-10-09T06:25:47.848790+0000","last_became_peered":"2023-10-09T06:25:47.848790+0000","last_unstale":"2023-10-09T06:25:48.873273+0000","last_undegraded":"2023-10-09T06:25:48.873273+0000","last_fullsized":"2023-10-09T06:25:48.873273+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:26.169034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.866968+0000","last_change":"2023-10-09T06:25:48.866911+0000","last_active":"2023-10-09T06:25:48.866968+0000","last_peered":"2023-10-09T06:25:48.866968+0000","last_clean":"2023-10-09T06:25:48.866968+0000","last_became_active":"2023-10-09T06:25:48.866664+0000","last_became_peered":"2023-10-09T06:25:48.866664+0000","last_unstale":"2023-10-09T06:25:48.866968+0000","last_undegraded":"2023-10-09T06:25:48.866968+0000","last_fullsized":"2023-10-09T06:25:48.866968+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:47:14.813193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.873250+0000","last_change":"2023-10-09T06:25:47.849726+0000","last_active":"2023-10-09T06:25:48.873250+0000","last_peered":"2023-10-09T06:25:48.873250+0000","last_clean":"2023-10-09T06:25:48.873250+0000","last_became_active":"2023-10-09T06:25:47.849461+0000","last_became_peered":"2023-10-09T06:25:47.849461+0000","last_unstale":"2023-10-09T06:25:48.873250+0000","last_undegraded":"2023-10-09T06:25:48.873250+0000","last_fullsized":"2023-10-09T06:25:48.873250+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:41.443808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.865529+0000","last_change":"2023-10-09T06:25:48.864987+0000","last_active":"2023-10-09T06:25:48.865529+0000","last_peered":"2023-10-09T06:25:48.865529+0000","last_clean":"2023-10-09T06:25:48.865529+0000","last_became_active":"2023-10-09T06:25:48.864762+0000","last_became_peered":"2023-10-09T06:25:48.864762+0000","last_unstale":"2023-10-09T06:25:48.865529+0000","last_undegraded":"2023-10-09T06:25:48.865529+0000","last_fullsized":"2023-10-09T06:25:48.865529+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:30.784137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.871260+0000","last_change":"2023-10-09T06:25:47.855263+0000","last_active":"2023-10-09T06:25:48.871260+0000","last_peered":"2023-10-09T06:25:48.871260+0000","last_clean":"2023-10-09T06:25:48.871260+0000","last_became_active":"2023-10-09T06:25:47.854779+0000","last_became_peered":"2023-10-09T06:25:47.854779+0000","last_unstale":"2023-10-09T06:25:48.871260+0000","last_undegraded":"2023-10-09T06:25:48.871260+0000","last_fullsized":"2023-10-09T06:25:48.871260+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.013764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.857858+0000","last_change":"2023-10-09T06:25:48.857508+0000","last_active":"2023-10-09T06:25:48.857858+0000","last_peered":"2023-10-09T06:25:48.857858+0000","last_clean":"2023-10-09T06:25:48.857858+0000","last_became_active":"2023-10-09T06:25:48.857116+0000","last_became_peered":"2023-10-09T06:25:48.857116+0000","last_unstale":"2023-10-09T06:25:48.857858+0000","last_undegraded":"2023-10-09T06:25:48.857858+0000","last_fullsized":"2023-10-09T06:25:48.857858+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:17.876832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.872611+0000","last_change":"2023-10-09T06:25:47.855905+0000","last_active":"2023-10-09T06:25:48.872611+0000","last_peered":"2023-10-09T06:25:48.872611+0000","last_clean":"2023-10-09T06:25:48.872611+0000","last_became_active":"2023-10-09T06:25:47.855664+0000","last_became_peered":"2023-10-09T06:25:47.855664+0000","last_unstale":"2023-10-09T06:25:48.872611+0000","last_undegraded":"2023-10-09T06:25:48.872611+0000","last_fullsized":"2023-10-09T06:25:48.872611+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:08.735859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.865580+0000","last_change":"2023-10-09T06:25:48.865532+0000","last_active":"2023-10-09T06:25:48.865580+0000","last_peered":"2023-10-09T06:25:48.865580+0000","last_clean":"2023-10-09T06:25:48.865580+0000","last_became_active":"2023-10-09T06:25:48.865035+0000","last_became_peered":"2023-10-09T06:25:48.865035+0000","last_unstale":"2023-10-09T06:25:48.865580+0000","last_undegraded":"2023-10-09T06:25:48.865580+0000","last_fullsized":"2023-10-09T06:25:48.865580+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:04:19.441298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.855916+0000","last_change":"2023-10-09T06:25:47.845607+0000","last_active":"2023-10-09T06:25:48.855916+0000","last_peered":"2023-10-09T06:25:48.855916+0000","last_clean":"2023-10-09T06:25:48.855916+0000","last_became_active":"2023-10-09T06:25:47.845108+0000","last_became_peered":"2023-10-09T06:25:47.845108+0000","last_unstale":"2023-10-09T06:25:48.855916+0000","last_undegraded":"2023-10-09T06:25:48.855916+0000","last_fullsized":"2023-10-09T06:25:48.855916+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:32.948454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.861862+0000","last_change":"2023-10-09T06:25:48.861729+0000","last_active":"2023-10-09T06:25:48.861862+0000","last_peered":"2023-10-09T06:25:48.861862+0000","last_clean":"2023-10-09T06:25:48.861862+0000","last_became_active":"2023-10-09T06:25:48.861433+0000","last_became_peered":"2023-10-09T06:25:48.861433+0000","last_unstale":"2023-10-09T06:25:48.861862+0000","last_undegraded":"2023-10-09T06:25:48.861862+0000","last_fullsized":"2023-10-09T06:25:48.861862+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:04:19.441298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.861638+0000","last_change":"2023-10-09T06:25:47.852047+0000","last_active":"2023-10-09T06:25:48.861638+0000","last_peered":"2023-10-09T06:25:48.861638+0000","last_clean":"2023-10-09T06:25:48.861638+0000","last_became_active":"2023-10-09T06:25:47.851541+0000","last_became_peered":"2023-10-09T06:25:47.851541+0000","last_unstale":"2023-10-09T06:25:48.861638+0000","last_undegraded":"2023-10-09T06:25:48.861638+0000","last_fullsized":"2023-10-09T06:25:48.861638+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:35.643402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.862037+0000","last_change":"2023-10-09T06:25:48.861970+0000","last_active":"2023-10-09T06:25:48.862037+0000","last_peered":"2023-10-09T06:25:48.862037+0000","last_clean":"2023-10-09T06:25:48.862037+0000","last_became_active":"2023-10-09T06:25:48.861727+0000","last_became_peered":"2023-10-09T06:25:48.861727+0000","last_unstale":"2023-10-09T06:25:48.862037+0000","last_undegraded":"2023-10-09T06:25:48.862037+0000","last_fullsized":"2023-10-09T06:25:48.862037+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:53.141223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.852808+0000","last_change":"2023-10-09T06:25:47.849277+0000","last_active":"2023-10-09T06:25:48.852808+0000","last_peered":"2023-10-09T06:25:48.852808+0000","last_clean":"2023-10-09T06:25:48.852808+0000","last_became_active":"2023-10-09T06:25:47.849037+0000","last_became_peered":"2023-10-09T06:25:47.849037+0000","last_unstale":"2023-10-09T06:25:48.852808+0000","last_undegraded":"2023-10-09T06:25:48.852808+0000","last_fullsized":"2023-10-09T06:25:48.852808+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.013764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.866193+0000","last_change":"2023-10-09T06:25:48.866148+0000","last_active":"2023-10-09T06:25:48.866193+0000","last_peered":"2023-10-09T06:25:48.866193+0000","last_clean":"2023-10-09T06:25:48.866193+0000","last_became_active":"2023-10-09T06:25:48.865707+0000","last_became_peered":"2023-10-09T06:25:48.865707+0000","last_unstale":"2023-10-09T06:25:48.866193+0000","last_undegraded":"2023-10-09T06:25:48.866193+0000","last_fullsized":"2023-10-09T06:25:48.866193+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.852927+0000","last_change":"2023-10-09T06:25:47.854169+0000","last_active":"2023-10-09T06:25:48.852927+0000","last_peered":"2023-10-09T06:25:48.852927+0000","last_clean":"2023-10-09T06:25:48.852927+0000","last_became_active":"2023-10-09T06:25:47.853941+0000","last_became_peered":"2023-10-09T06:25:47.853941+0000","last_unstale":"2023-10-09T06:25:48.852927+0000","last_undegraded":"2023-10-09T06:25:48.852927+0000","last_fullsized":"2023-10-09T06:25:48.852927+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:18.208465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.864240+0000","last_change":"2023-10-09T06:25:48.863164+0000","last_active":"2023-10-09T06:25:48.864240+0000","last_peered":"2023-10-09T06:25:48.864240+0000","last_clean":"2023-10-09T06:25:48.864240+0000","last_became_active":"2023-10-09T06:25:48.862741+0000","last_became_peered":"2023-10-09T06:25:48.862741+0000","last_unstale":"2023-10-09T06:25:48.864240+0000","last_undegraded":"2023-10-09T06:25:48.864240+0000","last_fullsized":"2023-10-09T06:25:48.864240+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:23:39.868860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"100'3","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.874126+0000","last_change":"2023-10-09T06:25:47.848404+0000","last_active":"2023-10-09T06:25:48.874126+0000","last_peered":"2023-10-09T06:25:48.874126+0000","last_clean":"2023-10-09T06:25:48.874126+0000","last_became_active":"2023-10-09T06:25:47.847936+0000","last_became_peered":"2023-10-09T06:25:47.847936+0000","last_unstale":"2023-10-09T06:25:48.874126+0000","last_undegraded":"2023-10-09T06:25:48.874126+0000","last_fullsized":"2023-10-09T06:25:48.874126+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:29.780809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.863542+0000","last_change":"2023-10-09T06:25:48.863372+0000","last_active":"2023-10-09T06:25:48.863542+0000","last_peered":"2023-10-09T06:25:48.863542+0000","last_clean":"2023-10-09T06:25:48.863542+0000","last_became_active":"2023-10-09T06:25:48.863164+0000","last_became_peered":"2023-10-09T06:25:48.863164+0000","last_unstale":"2023-10-09T06:25:48.863542+0000","last_undegraded":"2023-10-09T06:25:48.863542+0000","last_fullsized":"2023-10-09T06:25:48.863542+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"100'6","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.875313+0000","last_change":"2023-10-09T06:25:47.842724+0000","last_active":"2023-10-09T06:25:48.875313+0000","last_peered":"2023-10-09T06:25:48.875313+0000","last_clean":"2023-10-09T06:25:48.875313+0000","last_became_active":"2023-10-09T06:25:47.842472+0000","last_became_peered":"2023-10-09T06:25:47.842472+0000","last_unstale":"2023-10-09T06:25:48.875313+0000","last_undegraded":"2023-10-09T06:25:48.875313+0000","last_fullsized":"2023-10-09T06:25:48.875313+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:02.106046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.862751+0000","last_change":"2023-10-09T06:25:48.862559+0000","last_active":"2023-10-09T06:25:48.862751+0000","last_peered":"2023-10-09T06:25:48.862751+0000","last_clean":"2023-10-09T06:25:48.862751+0000","last_became_active":"2023-10-09T06:25:48.862177+0000","last_became_peered":"2023-10-09T06:25:48.862177+0000","last_unstale":"2023-10-09T06:25:48.862751+0000","last_undegraded":"2023-10-09T06:25:48.862751+0000","last_fullsized":"2023-10-09T06:25:48.862751+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:17.876832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.873991+0000","last_change":"2023-10-09T06:25:47.847553+0000","last_active":"2023-10-09T06:25:48.873991+0000","last_peered":"2023-10-09T06:25:48.873991+0000","last_clean":"2023-10-09T06:25:48.873991+0000","last_became_active":"2023-10-09T06:25:47.847331+0000","last_became_peered":"2023-10-09T06:25:47.847331+0000","last_unstale":"2023-10-09T06:25:48.873991+0000","last_undegraded":"2023-10-09T06:25:48.873991+0000","last_fullsized":"2023-10-09T06:25:48.873991+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:53.459647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.865733+0000","last_change":"2023-10-09T06:25:48.865635+0000","last_active":"2023-10-09T06:25:48.865733+0000","last_peered":"2023-10-09T06:25:48.865733+0000","last_clean":"2023-10-09T06:25:48.865733+0000","last_became_active":"2023-10-09T06:25:48.865329+0000","last_became_peered":"2023-10-09T06:25:48.865329+0000","last_unstale":"2023-10-09T06:25:48.865733+0000","last_undegraded":"2023-10-09T06:25:48.865733+0000","last_fullsized":"2023-10-09T06:25:48.865733+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:18:01.760686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.857082+0000","last_change":"2023-10-09T06:25:47.848332+0000","last_active":"2023-10-09T06:25:48.857082+0000","last_peered":"2023-10-09T06:25:48.857082+0000","last_clean":"2023-10-09T06:25:48.857082+0000","last_became_active":"2023-10-09T06:25:47.848047+0000","last_became_peered":"2023-10-09T06:25:47.848047+0000","last_unstale":"2023-10-09T06:25:48.857082+0000","last_undegraded":"2023-10-09T06:25:48.857082+0000","last_fullsized":"2023-10-09T06:25:48.857082+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:11.346640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.861136+0000","last_change":"2023-10-09T06:25:48.860770+0000","last_active":"2023-10-09T06:25:48.861136+0000","last_peered":"2023-10-09T06:25:48.861136+0000","last_clean":"2023-10-09T06:25:48.861136+0000","last_became_active":"2023-10-09T06:25:48.860446+0000","last_became_peered":"2023-10-09T06:25:48.860446+0000","last_unstale":"2023-10-09T06:25:48.861136+0000","last_undegraded":"2023-10-09T06:25:48.861136+0000","last_fullsized":"2023-10-09T06:25:48.861136+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:34.784511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.856345+0000","last_change":"2023-10-09T06:25:47.855073+0000","last_active":"2023-10-09T06:25:48.856345+0000","last_peered":"2023-10-09T06:25:48.856345+0000","last_clean":"2023-10-09T06:25:48.856345+0000","last_became_active":"2023-10-09T06:25:47.854877+0000","last_became_peered":"2023-10-09T06:25:47.854877+0000","last_unstale":"2023-10-09T06:25:48.856345+0000","last_undegraded":"2023-10-09T06:25:48.856345+0000","last_fullsized":"2023-10-09T06:25:48.856345+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:32.948454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.865482+0000","last_change":"2023-10-09T06:25:48.863176+0000","last_active":"2023-10-09T06:25:48.865482+0000","last_peered":"2023-10-09T06:25:48.865482+0000","last_clean":"2023-10-09T06:25:48.865482+0000","last_became_active":"2023-10-09T06:25:48.862337+0000","last_became_peered":"2023-10-09T06:25:48.862337+0000","last_unstale":"2023-10-09T06:25:48.865482+0000","last_undegraded":"2023-10-09T06:25:48.865482+0000","last_fullsized":"2023-10-09T06:25:48.865482+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:55:57.253496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"100'8","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.873661+0000","last_change":"2023-10-09T06:25:47.851026+0000","last_active":"2023-10-09T06:25:48.873661+0000","last_peered":"2023-10-09T06:25:48.873661+0000","last_clean":"2023-10-09T06:25:48.873661+0000","last_became_active":"2023-10-09T06:25:47.850820+0000","last_became_peered":"2023-10-09T06:25:47.850820+0000","last_unstale":"2023-10-09T06:25:48.873661+0000","last_undegraded":"2023-10-09T06:25:48.873661+0000","last_fullsized":"2023-10-09T06:25:48.873661+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:01.086319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.861527+0000","last_change":"2023-10-09T06:25:48.861251+0000","last_active":"2023-10-09T06:25:48.861527+0000","last_peered":"2023-10-09T06:25:48.861527+0000","last_clean":"2023-10-09T06:25:48.861527+0000","last_became_active":"2023-10-09T06:25:48.859909+0000","last_became_peered":"2023-10-09T06:25:48.859909+0000","last_unstale":"2023-10-09T06:25:48.861527+0000","last_undegraded":"2023-10-09T06:25:48.861527+0000","last_fullsized":"2023-10-09T06:25:48.861527+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:53.141223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.872791+0000","last_change":"2023-10-09T06:25:47.850149+0000","last_active":"2023-10-09T06:25:48.872791+0000","last_peered":"2023-10-09T06:25:48.872791+0000","last_clean":"2023-10-09T06:25:48.872791+0000","last_became_active":"2023-10-09T06:25:47.849942+0000","last_became_peered":"2023-10-09T06:25:47.849942+0000","last_unstale":"2023-10-09T06:25:48.872791+0000","last_undegraded":"2023-10-09T06:25:48.872791+0000","last_fullsized":"2023-10-09T06:25:48.872791+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:08.735859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.859291+0000","last_change":"2023-10-09T06:25:48.859132+0000","last_active":"2023-10-09T06:25:48.859291+0000","last_peered":"2023-10-09T06:25:48.859291+0000","last_clean":"2023-10-09T06:25:48.859291+0000","last_became_active":"2023-10-09T06:25:48.858848+0000","last_became_peered":"2023-10-09T06:25:48.858848+0000","last_unstale":"2023-10-09T06:25:48.859291+0000","last_undegraded":"2023-10-09T06:25:48.859291+0000","last_fullsized":"2023-10-09T06:25:48.859291+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:16.986469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.873342+0000","last_change":"2023-10-09T06:25:47.850579+0000","last_active":"2023-10-09T06:25:48.873342+0000","last_peered":"2023-10-09T06:25:48.873342+0000","last_clean":"2023-10-09T06:25:48.873342+0000","last_became_active":"2023-10-09T06:25:47.850361+0000","last_became_peered":"2023-10-09T06:25:47.850361+0000","last_unstale":"2023-10-09T06:25:48.873342+0000","last_undegraded":"2023-10-09T06:25:48.873342+0000","last_fullsized":"2023-10-09T06:25:48.873342+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:48.069765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.861436+0000","last_change":"2023-10-09T06:25:48.861378+0000","last_active":"2023-10-09T06:25:48.861436+0000","last_peered":"2023-10-09T06:25:48.861436+0000","last_clean":"2023-10-09T06:25:48.861436+0000","last_became_active":"2023-10-09T06:25:48.861166+0000","last_became_peered":"2023-10-09T06:25:48.861166+0000","last_unstale":"2023-10-09T06:25:48.861436+0000","last_undegraded":"2023-10-09T06:25:48.861436+0000","last_fullsized":"2023-10-09T06:25:48.861436+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.856381+0000","last_change":"2023-10-09T06:25:47.848106+0000","last_active":"2023-10-09T06:25:48.856381+0000","last_peered":"2023-10-09T06:25:48.856381+0000","last_clean":"2023-10-09T06:25:48.856381+0000","last_became_active":"2023-10-09T06:25:47.847818+0000","last_became_peered":"2023-10-09T06:25:47.847818+0000","last_unstale":"2023-10-09T06:25:48.856381+0000","last_undegraded":"2023-10-09T06:25:48.856381+0000","last_fullsized":"2023-10-09T06:25:48.856381+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:02.106046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.866288+0000","last_change":"2023-10-09T06:25:48.866084+0000","last_active":"2023-10-09T06:25:48.866288+0000","last_peered":"2023-10-09T06:25:48.866288+0000","last_clean":"2023-10-09T06:25:48.866288+0000","last_became_active":"2023-10-09T06:25:48.865373+0000","last_became_peered":"2023-10-09T06:25:48.865373+0000","last_unstale":"2023-10-09T06:25:48.866288+0000","last_undegraded":"2023-10-09T06:25:48.866288+0000","last_fullsized":"2023-10-09T06:25:48.866288+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:36.646731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.873818+0000","last_change":"2023-10-09T06:25:47.842874+0000","last_active":"2023-10-09T06:25:48.873818+0000","last_peered":"2023-10-09T06:25:48.873818+0000","last_clean":"2023-10-09T06:25:48.873818+0000","last_became_active":"2023-10-09T06:25:47.842648+0000","last_became_peered":"2023-10-09T06:25:47.842648+0000","last_unstale":"2023-10-09T06:25:48.873818+0000","last_undegraded":"2023-10-09T06:25:48.873818+0000","last_fullsized":"2023-10-09T06:25:48.873818+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:15.983140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.863426+0000","last_change":"2023-10-09T06:25:48.862928+0000","last_active":"2023-10-09T06:25:48.863426+0000","last_peered":"2023-10-09T06:25:48.863426+0000","last_clean":"2023-10-09T06:25:48.863426+0000","last_became_active":"2023-10-09T06:25:48.862695+0000","last_became_peered":"2023-10-09T06:25:48.862695+0000","last_unstale":"2023-10-09T06:25:48.863426+0000","last_undegraded":"2023-10-09T06:25:48.863426+0000","last_fullsized":"2023-10-09T06:25:48.863426+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:04.966793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.852908+0000","last_change":"2023-10-09T06:25:47.846610+0000","last_active":"2023-10-09T06:25:48.852908+0000","last_peered":"2023-10-09T06:25:48.852908+0000","last_clean":"2023-10-09T06:25:48.852908+0000","last_became_active":"2023-10-09T06:25:47.846390+0000","last_became_peered":"2023-10-09T06:25:47.846390+0000","last_unstale":"2023-10-09T06:25:48.852908+0000","last_undegraded":"2023-10-09T06:25:48.852908+0000","last_fullsized":"2023-10-09T06:25:48.852908+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:45.550797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.860259+0000","last_change":"2023-10-09T06:25:48.859516+0000","last_active":"2023-10-09T06:25:48.860259+0000","last_peered":"2023-10-09T06:25:48.860259+0000","last_clean":"2023-10-09T06:25:48.860259+0000","last_became_active":"2023-10-09T06:25:48.859136+0000","last_became_peered":"2023-10-09T06:25:48.859136+0000","last_unstale":"2023-10-09T06:25:48.860259+0000","last_undegraded":"2023-10-09T06:25:48.860259+0000","last_fullsized":"2023-10-09T06:25:48.860259+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:46:38.170493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.852115+0000","last_change":"2023-10-09T06:25:47.847568+0000","last_active":"2023-10-09T06:25:48.852115+0000","last_peered":"2023-10-09T06:25:48.852115+0000","last_clean":"2023-10-09T06:25:48.852115+0000","last_became_active":"2023-10-09T06:25:47.847337+0000","last_became_peered":"2023-10-09T06:25:47.847337+0000","last_unstale":"2023-10-09T06:25:48.852115+0000","last_undegraded":"2023-10-09T06:25:48.852115+0000","last_fullsized":"2023-10-09T06:25:48.852115+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:27.334050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.865321+0000","last_change":"2023-10-09T06:25:48.865258+0000","last_active":"2023-10-09T06:25:48.865321+0000","last_peered":"2023-10-09T06:25:48.865321+0000","last_clean":"2023-10-09T06:25:48.865321+0000","last_became_active":"2023-10-09T06:25:48.865035+0000","last_became_peered":"2023-10-09T06:25:48.865035+0000","last_unstale":"2023-10-09T06:25:48.865321+0000","last_undegraded":"2023-10-09T06:25:48.865321+0000","last_fullsized":"2023-10-09T06:25:48.865321+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:17.876832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.857181+0000","last_change":"2023-10-09T06:25:47.850759+0000","last_active":"2023-10-09T06:25:48.857181+0000","last_peered":"2023-10-09T06:25:48.857181+0000","last_clean":"2023-10-09T06:25:48.857181+0000","last_became_active":"2023-10-09T06:25:47.850307+0000","last_became_peered":"2023-10-09T06:25:47.850307+0000","last_unstale":"2023-10-09T06:25:48.857181+0000","last_undegraded":"2023-10-09T06:25:48.857181+0000","last_fullsized":"2023-10-09T06:25:48.857181+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:16.873504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.862929+0000","last_change":"2023-10-09T06:25:48.862799+0000","last_active":"2023-10-09T06:25:48.862929+0000","last_peered":"2023-10-09T06:25:48.862929+0000","last_clean":"2023-10-09T06:25:48.862929+0000","last_became_active":"2023-10-09T06:25:48.862378+0000","last_became_peered":"2023-10-09T06:25:48.862378+0000","last_unstale":"2023-10-09T06:25:48.862929+0000","last_undegraded":"2023-10-09T06:25:48.862929+0000","last_fullsized":"2023-10-09T06:25:48.862929+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:09:30.968073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.872416+0000","last_change":"2023-10-09T06:25:47.850946+0000","last_active":"2023-10-09T06:25:48.872416+0000","last_peered":"2023-10-09T06:25:48.872416+0000","last_clean":"2023-10-09T06:25:48.872416+0000","last_became_active":"2023-10-09T06:25:47.850152+0000","last_became_peered":"2023-10-09T06:25:47.850152+0000","last_unstale":"2023-10-09T06:25:48.872416+0000","last_undegraded":"2023-10-09T06:25:48.872416+0000","last_fullsized":"2023-10-09T06:25:48.872416+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:45.813982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.859487+0000","last_change":"2023-10-09T06:25:48.859388+0000","last_active":"2023-10-09T06:25:48.859487+0000","last_peered":"2023-10-09T06:25:48.859487+0000","last_clean":"2023-10-09T06:25:48.859487+0000","last_became_active":"2023-10-09T06:25:48.859155+0000","last_became_peered":"2023-10-09T06:25:48.859155+0000","last_unstale":"2023-10-09T06:25:48.859487+0000","last_undegraded":"2023-10-09T06:25:48.859487+0000","last_fullsized":"2023-10-09T06:25:48.859487+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:32.359094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-09T06:25:50.305109+0000","last_change":"2023-10-09T06:25:47.851348+0000","last_active":"2023-10-09T06:25:50.305109+0000","last_peered":"2023-10-09T06:25:50.305109+0000","last_clean":"2023-10-09T06:25:50.305109+0000","last_became_active":"2023-10-09T06:25:47.851175+0000","last_became_peered":"2023-10-09T06:25:47.851175+0000","last_unstale":"2023-10-09T06:25:50.305109+0000","last_undegraded":"2023-10-09T06:25:50.305109+0000","last_fullsized":"2023-10-09T06:25:50.305109+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:24.614225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.861770+0000","last_change":"2023-10-09T06:25:48.861708+0000","last_active":"2023-10-09T06:25:48.861770+0000","last_peered":"2023-10-09T06:25:48.861770+0000","last_clean":"2023-10-09T06:25:48.861770+0000","last_became_active":"2023-10-09T06:25:48.861478+0000","last_became_peered":"2023-10-09T06:25:48.861478+0000","last_unstale":"2023-10-09T06:25:48.861770+0000","last_undegraded":"2023-10-09T06:25:48.861770+0000","last_fullsized":"2023-10-09T06:25:48.861770+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:17.876832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.853322+0000","last_change":"2023-10-09T06:25:47.847988+0000","last_active":"2023-10-09T06:25:48.853322+0000","last_peered":"2023-10-09T06:25:48.853322+0000","last_clean":"2023-10-09T06:25:48.853322+0000","last_became_active":"2023-10-09T06:25:47.847720+0000","last_became_peered":"2023-10-09T06:25:47.847720+0000","last_unstale":"2023-10-09T06:25:48.853322+0000","last_undegraded":"2023-10-09T06:25:48.853322+0000","last_fullsized":"2023-10-09T06:25:48.853322+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:44.660413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.862589+0000","last_change":"2023-10-09T06:25:48.862535+0000","last_active":"2023-10-09T06:25:48.862589+0000","last_peered":"2023-10-09T06:25:48.862589+0000","last_clean":"2023-10-09T06:25:48.862589+0000","last_became_active":"2023-10-09T06:25:48.862309+0000","last_became_peered":"2023-10-09T06:25:48.862309+0000","last_unstale":"2023-10-09T06:25:48.862589+0000","last_undegraded":"2023-10-09T06:25:48.862589+0000","last_fullsized":"2023-10-09T06:25:48.862589+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:23:39.868860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.853787+0000","last_change":"2023-10-09T06:25:47.849760+0000","last_active":"2023-10-09T06:25:48.853787+0000","last_peered":"2023-10-09T06:25:48.853787+0000","last_clean":"2023-10-09T06:25:48.853787+0000","last_became_active":"2023-10-09T06:25:47.849254+0000","last_became_peered":"2023-10-09T06:25:47.849254+0000","last_unstale":"2023-10-09T06:25:48.853787+0000","last_undegraded":"2023-10-09T06:25:48.853787+0000","last_fullsized":"2023-10-09T06:25:48.853787+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:05:38.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.863439+0000","last_change":"2023-10-09T06:25:48.862995+0000","last_active":"2023-10-09T06:25:48.863439+0000","last_peered":"2023-10-09T06:25:48.863439+0000","last_clean":"2023-10-09T06:25:48.863439+0000","last_became_active":"2023-10-09T06:25:48.862733+0000","last_became_peered":"2023-10-09T06:25:48.862733+0000","last_unstale":"2023-10-09T06:25:48.863439+0000","last_undegraded":"2023-10-09T06:25:48.863439+0000","last_fullsized":"2023-10-09T06:25:48.863439+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:30.810531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.856768+0000","last_change":"2023-10-09T06:25:47.851090+0000","last_active":"2023-10-09T06:25:48.856768+0000","last_peered":"2023-10-09T06:25:48.856768+0000","last_clean":"2023-10-09T06:25:48.856768+0000","last_became_active":"2023-10-09T06:25:47.850476+0000","last_became_peered":"2023-10-09T06:25:47.850476+0000","last_unstale":"2023-10-09T06:25:48.856768+0000","last_undegraded":"2023-10-09T06:25:48.856768+0000","last_fullsized":"2023-10-09T06:25:48.856768+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:10.729010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.862732+0000","last_change":"2023-10-09T06:25:48.862415+0000","last_active":"2023-10-09T06:25:48.862732+0000","last_peered":"2023-10-09T06:25:48.862732+0000","last_clean":"2023-10-09T06:25:48.862732+0000","last_became_active":"2023-10-09T06:25:48.861821+0000","last_became_peered":"2023-10-09T06:25:48.861821+0000","last_unstale":"2023-10-09T06:25:48.862732+0000","last_undegraded":"2023-10-09T06:25:48.862732+0000","last_fullsized":"2023-10-09T06:25:48.862732+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:43.433850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.856564+0000","last_change":"2023-10-09T06:25:47.855007+0000","last_active":"2023-10-09T06:25:48.856564+0000","last_peered":"2023-10-09T06:25:48.856564+0000","last_clean":"2023-10-09T06:25:48.856564+0000","last_became_active":"2023-10-09T06:25:47.854175+0000","last_became_peered":"2023-10-09T06:25:47.854175+0000","last_unstale":"2023-10-09T06:25:48.856564+0000","last_undegraded":"2023-10-09T06:25:48.856564+0000","last_fullsized":"2023-10-09T06:25:48.856564+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:18.208465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.862513+0000","last_change":"2023-10-09T06:25:48.862455+0000","last_active":"2023-10-09T06:25:48.862513+0000","last_peered":"2023-10-09T06:25:48.862513+0000","last_clean":"2023-10-09T06:25:48.862513+0000","last_became_active":"2023-10-09T06:25:48.862089+0000","last_became_peered":"2023-10-09T06:25:48.862089+0000","last_unstale":"2023-10-09T06:25:48.862513+0000","last_undegraded":"2023-10-09T06:25:48.862513+0000","last_fullsized":"2023-10-09T06:25:48.862513+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:44.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.855115+0000","last_change":"2023-10-09T06:25:47.851947+0000","last_active":"2023-10-09T06:25:48.855115+0000","last_peered":"2023-10-09T06:25:48.855115+0000","last_clean":"2023-10-09T06:25:48.855115+0000","last_became_active":"2023-10-09T06:25:47.851716+0000","last_became_peered":"2023-10-09T06:25:47.851716+0000","last_unstale":"2023-10-09T06:25:48.855115+0000","last_undegraded":"2023-10-09T06:25:48.855115+0000","last_fullsized":"2023-10-09T06:25:48.855115+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:33.781182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.857283+0000","last_change":"2023-10-09T06:25:48.857075+0000","last_active":"2023-10-09T06:25:48.857283+0000","last_peered":"2023-10-09T06:25:48.857283+0000","last_clean":"2023-10-09T06:25:48.857283+0000","last_became_active":"2023-10-09T06:25:48.856718+0000","last_became_peered":"2023-10-09T06:25:48.856718+0000","last_unstale":"2023-10-09T06:25:48.857283+0000","last_undegraded":"2023-10-09T06:25:48.857283+0000","last_fullsized":"2023-10-09T06:25:48.857283+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:21.766447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.852564+0000","last_change":"2023-10-09T06:25:47.852812+0000","last_active":"2023-10-09T06:25:48.852564+0000","last_peered":"2023-10-09T06:25:48.852564+0000","last_clean":"2023-10-09T06:25:48.852564+0000","last_became_active":"2023-10-09T06:25:47.852370+0000","last_became_peered":"2023-10-09T06:25:47.852370+0000","last_unstale":"2023-10-09T06:25:48.852564+0000","last_undegraded":"2023-10-09T06:25:48.852564+0000","last_fullsized":"2023-10-09T06:25:48.852564+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:33.781182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.861154+0000","last_change":"2023-10-09T06:25:48.860867+0000","last_active":"2023-10-09T06:25:48.861154+0000","last_peered":"2023-10-09T06:25:48.861154+0000","last_clean":"2023-10-09T06:25:48.861154+0000","last_became_active":"2023-10-09T06:25:48.860416+0000","last_became_peered":"2023-10-09T06:25:48.860416+0000","last_unstale":"2023-10-09T06:25:48.861154+0000","last_undegraded":"2023-10-09T06:25:48.861154+0000","last_fullsized":"2023-10-09T06:25:48.861154+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:47.837017+0000","last_clean_scrub_stamp":"2023-10-09T06:25:47.837017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:46.946654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.874205+0000","last_change":"2023-10-09T06:25:47.853329+0000","last_active":"2023-10-09T06:25:48.874205+0000","last_peered":"2023-10-09T06:25:48.874205+0000","last_clean":"2023-10-09T06:25:48.874205+0000","last_became_active":"2023-10-09T06:25:47.853093+0000","last_became_peered":"2023-10-09T06:25:47.853093+0000","last_unstale":"2023-10-09T06:25:48.874205+0000","last_undegraded":"2023-10-09T06:25:48.874205+0000","last_fullsized":"2023-10-09T06:25:48.874205+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:25:46.833689+0000","last_clean_scrub_stamp":"2023-10-09T06:25:46.833689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:29.807202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":233,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T06:25:48.855890+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:25:48.855890+0000","last_peered":"2023-10-09T06:25:48.855890+0000","last_clean":"2023-10-09T06:25:48.855890+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:25:48.855890+0000","last_undegraded":"2023-10-09T06:25:48.855890+0000","last_fullsized":"2023-10-09T06:25:48.855890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194201,"statfs":{"total":200000000,"available":198862011,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.51100000000000001},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78800000000000003,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57399999999999995,"15min":0.52400000000000002},"min":{"1min":0.28799999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70699999999999996,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.58399999999999996}]},{"osd":1,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54200000000000004,"15min":0.50600000000000001},"min":{"1min":0.39500000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53700000000000003,"15min":0.50800000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67700000000000005,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61699999999999999,"15min":0.57699999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71999999999999997,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58899999999999997,"15min":0.54000000000000004},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76400000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.443}]},{"osd":3,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65600000000000003,"15min":0.58199999999999996},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.84399999999999997,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.64400000000000002,"15min":0.56599999999999995},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78200000000000003,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.62}]},{"osd":4,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.28299999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.83099999999999996,"5min":0.872,"15min":0.872},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.79800000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.38600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91400000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88400000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.74299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194777,"statfs":{"total":200000000,"available":199451783,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.66100000000000003,"15min":0.79100000000000004},"min":{"1min":0.35199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77100000000000002,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.38100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":1.133,"15min":1.133},"last":0.48499999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.47299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72699999999999998,"5min":1.155,"15min":1.155},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71599999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.378}]},{"osd":2,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72599999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.499},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.68000000000000005,"15min":0.80000000000000004},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.78900000000000003,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58299999999999996,"15min":0.60099999999999998},"min":{"1min":0.46200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":1.337,"15min":1.337},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":1.206,"15min":1.206},"last":0.39600000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.497,"15min":0.497},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.435}]},{"osd":5,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47399999999999998},"min":{"1min":0.377,"5min":0.315,"15min":0.315},"max":{"1min":0.69499999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57199999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":534,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194777,"statfs":{"total":200000000,"available":199452255,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35799999999999998,"15min":0.36899999999999999},"min":{"1min":0.26100000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.48299999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.316},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36899999999999999,"15min":0.33600000000000002},"min":{"1min":0.247,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.505,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.253}]},{"osd":2,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.45900000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40500000000000003,"15min":0.38700000000000001},"min":{"1min":0.255,"5min":0.247,"15min":0.247},"max":{"1min":0.58499999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.36499999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.41599999999999998},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.60799999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44900000000000001,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.622,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.38800000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.91500000000000004,"5min":1.097,"15min":1.097},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67100000000000004,"15min":0.81100000000000005},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81299999999999994,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.443}]},{"osd":5,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65100000000000002,"15min":0.627},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90100000000000002,"5min":1.125,"15min":1.125},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94499999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.45700000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65100000000000002,"15min":0.622},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89100000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93600000000000005,"5min":1.49,"15min":1.49},"last":0.5}]},{"osd":7,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.64400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67600000000000005,"15min":0.65700000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88400000000000001,"5min":1.052,"15min":1.052},"last":0.51100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194201,"statfs":{"total":200000000,"available":198862047,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.41399999999999998},"min":{"1min":0.23599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.50600000000000001,"5min":1.226,"15min":1.226},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.54900000000000004,"5min":1.131,"15min":1.131},"last":0.29299999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.55700000000000005,"15min":0.99399999999999999},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":12.929,"15min":12.929},"last":0.313},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.438,"15min":0.46300000000000002},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.55000000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.47699999999999998},"min":{"1min":0.32200000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.749,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45300000000000001,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.314,"15min":0.314},"max":{"1min":0.57399999999999995,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.628,"15min":0.65600000000000003},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97099999999999997,"5min":1.335,"15min":1.335},"last":0.629}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90700000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.495},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.81499999999999995,"5min":0.999,"15min":0.999},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83099999999999996,"5min":0.998,"15min":0.998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65400000000000003,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.262,"15min":1.262},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.67000000000000004},"min":{"1min":0.52100000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.95599999999999996,"5min":1.103,"15min":1.103},"last":0.59899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194777,"statfs":{"total":200000000,"available":199451895,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.5,"15min":0.88600000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.48599999999999999,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.46200000000000002,"15min":0.67400000000000004},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57099999999999995,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.23400000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.436,"15min":0.63400000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68000000000000005,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.255},{"interface":"front","average":{"1min":0.44,"5min":0.53600000000000003,"15min":0.70399999999999996},"min":{"1min":0.28299999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.91400000000000003,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.28699999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.51700000000000002,"15min":0.70699999999999996},"min":{"1min":0.30299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70299999999999996,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.371},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.58299999999999996,"15min":0.94599999999999995},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.35999999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.77000000000000002,"15min":1.1459999999999999},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.95299999999999996,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.71899999999999997,"15min":0.93100000000000005},"min":{"1min":0.46700000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1160000000000001,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.64500000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.90600000000000003},"min":{"1min":0.432,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93600000000000005,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72299999999999998,"15min":0.91300000000000003},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.006,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.66100000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.71099999999999997,"15min":0.89500000000000002},"min":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95599999999999996,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.78600000000000003,"15min":1.1439999999999999},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.028,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70099999999999996,"15min":0.89100000000000001},"min":{"1min":0.44600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85299999999999998,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72099999999999997,"15min":0.90800000000000003},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0609999999999999,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.63}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194776,"statfs":{"total":200000000,"available":199450913,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.33800000000000002,"15min":0.32600000000000001},"min":{"1min":0.23599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.499,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39500000000000002,"15min":0.375},"min":{"1min":0.33100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.34399999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33800000000000002,"15min":0.32200000000000001},"min":{"1min":0.255,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.436,"5min":0.36899999999999999,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35599999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.373,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.44,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64600000000000002,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.433}]},{"osd":4,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46800000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82399999999999995,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.51400000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.875,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.45100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.54000000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.73999999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80600000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.497}]},{"osd":7,"last update":"Mon Oct 9 06:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.58199999999999996},"min":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":0.87,"15min":0.87},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":534,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194777,"statfs":{"total":200000000,"available":199452449,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53100000000000003,"15min":0.498},"min":{"1min":0.372,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.72199999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.51700000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.33000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.73999999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.437},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.71099999999999997},"min":{"1min":0.38500000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73299999999999998,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.42999999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.60099999999999998,"15min":0.70099999999999996},"min":{"1min":0.375,"5min":0.313,"15min":0.313},"max":{"1min":0.70599999999999996,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.70799999999999996,"15min":1.0780000000000001},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.74199999999999999,"5min":11.715,"15min":11.715},"last":0.36399999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56499999999999995,"15min":0.52500000000000002},"min":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.751,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.46100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77100000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.50800000000000001,"15min":0.52100000000000002},"min":{"1min":0.34499999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.77300000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40500000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50900000000000001,"15min":0.504},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78100000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.497}]},{"osd":7,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.879,"15min":0.879},"last":0.318},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83399999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194776,"statfs":{"total":200000000,"available":199450891,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85399999999999998,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.54600000000000004,"15min":0.52000000000000002},"min":{"1min":0.45100000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77900000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68600000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54800000000000004,"15min":0.51800000000000002},"min":{"1min":0.38900000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82399999999999995,"5min":1.093,"15min":1.093},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.55200000000000005,"15min":0.52000000000000002},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83399999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.43099999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.433,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57599999999999996,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84199999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.629}]},{"osd":3,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58399999999999996,"15min":0.55500000000000005},"min":{"1min":0.45600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.58599999999999997},"min":{"1min":0.47799999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.81299999999999994,"5min":1.071,"15min":1.071},"last":0.60899999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48899999999999999,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72399999999999998,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.37,"5min":0.309,"15min":0.309},"max":{"1min":0.75800000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.495}]},{"osd":6,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.504,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73999999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.82799999999999996,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.71199999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33200000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81000000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.36599999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84399999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69999999999999996}]}]}],"pool_statfs":[]}} 2023-10-09T06:25:58.033 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:25:58.034 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:25:58.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.160+0000 7f6f97bb0700 1 Processor -- start 2023-10-09T06:25:58.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.160+0000 7f6f97bb0700 1 -- start start 2023-10-09T06:25:58.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.161+0000 7f6f97bb0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6f90159de0 0x7f6f900c3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:58.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.161+0000 7f6f97bb0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f90070700 0x7f6f90070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:58.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.161+0000 7f6f97bb0700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f900710a0 con 0x7f6f900ccf90 2023-10-09T06:25:58.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.161+0000 7f6f97bb0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f900c3860 con 0x7f6f90159de0 2023-10-09T06:25:58.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.161+0000 7f6f97bb0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900cd430 con 0x7f6f90070700 2023-10-09T06:25:58.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.162+0000 7f6f9614d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f90070700 0x7f6f90070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:58.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.162+0000 7f6f9594c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6f90159de0 0x7f6f900c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:58.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.162+0000 7f6f9614d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f90070700 0x7f6f90070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:44794/0 (socket says 172.21.15.31:44794) 2023-10-09T06:25:58.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.162+0000 7f6f9614d700 1 -- 172.21.15.31:0/1770252462 learned_addr learned my addr 172.21.15.31:0/1770252462 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:58.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.162+0000 7f6f9614d700 1 -- 172.21.15.31:0/1770252462 >> v2:172.21.15.158:3300/0 conn(0x7f6f90159de0 msgr2=0x7f6f900c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:58.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.162+0000 7f6f9614d700 1 --2- 172.21.15.31:0/1770252462 >> v2:172.21.15.158:3300/0 conn(0x7f6f90159de0 0x7f6f900c3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.162+0000 7f6f9614d700 1 -- 172.21.15.31:0/1770252462 >> v1:172.21.15.158:6789/0 conn(0x7f6f900ccf90 legacy=0x7f6f900c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:58.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.162+0000 7f6f9614d700 1 -- 172.21.15.31:0/1770252462 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f900c4380 con 0x7f6f90070700 2023-10-09T06:25:58.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.162+0000 7f6f9494a700 1 -- 172.21.15.31:0/1770252462 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555342726 0 0) 0x7f6f84001110 con 0x7f6f900ccf90 2023-10-09T06:25:58.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.162+0000 7f6f9594c700 1 --2- 172.21.15.31:0/1770252462 >> v2:172.21.15.158:3300/0 conn(0x7f6f90159de0 0x7f6f900c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:25:58.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.162+0000 7f6f9614d700 1 --2- 172.21.15.31:0/1770252462 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f90070700 0x7f6f90070b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009f20 tx=0x7f6f80009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8027fbc781a3285 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:58.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.162+0000 7f6f9494a700 1 -- 172.21.15.31:0/1770252462 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000e070 con 0x7f6f90070700 2023-10-09T06:25:58.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.163+0000 7f6f9494a700 1 -- 172.21.15.31:0/1770252462 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8000b9d0 con 0x7f6f90070700 2023-10-09T06:25:58.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.163+0000 7f6f9494a700 1 -- 172.21.15.31:0/1770252462 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f800092e0 con 0x7f6f90070700 2023-10-09T06:25:58.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.163+0000 7f6f97bb0700 1 -- 172.21.15.31:0/1770252462 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f90070700 msgr2=0x7f6f90070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:58.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.163+0000 7f6f97bb0700 1 --2- 172.21.15.31:0/1770252462 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f90070700 0x7f6f90070b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009f20 tx=0x7f6f80009840 comp rx=0 tx=0).stop 2023-10-09T06:25:58.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.163+0000 7f6f97bb0700 1 -- 172.21.15.31:0/1770252462 shutdown_connections 2023-10-09T06:25:58.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.163+0000 7f6f97bb0700 1 --2- 172.21.15.31:0/1770252462 >> v2:172.21.15.158:3300/0 conn(0x7f6f90159de0 0x7f6f900c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.163+0000 7f6f97bb0700 1 --2- 172.21.15.31:0/1770252462 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f90070700 0x7f6f90070b60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.163+0000 7f6f97bb0700 1 -- 172.21.15.31:0/1770252462 >> 172.21.15.31:0/1770252462 conn(0x7f6f900ce540 msgr2=0x7f6f900ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:58.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.163+0000 7f6f97bb0700 1 -- 172.21.15.31:0/1770252462 shutdown_connections 2023-10-09T06:25:58.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.163+0000 7f6f97bb0700 1 -- 172.21.15.31:0/1770252462 wait complete. 2023-10-09T06:25:58.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.164+0000 7f6f97bb0700 1 Processor -- start 2023-10-09T06:25:58.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.164+0000 7f6f97bb0700 1 -- start start 2023-10-09T06:25:58.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f97bb0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f90070700 0x7f6f9016e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:58.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f97bb0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f900ccf90 0x7f6f900c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:58.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f97bb0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f90159de0 0x7f6f901537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:58.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f97bb0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9015a770 con 0x7f6f90070700 2023-10-09T06:25:58.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f97bb0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9015aa50 con 0x7f6f90159de0 2023-10-09T06:25:58.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f97bb0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9015ad30 con 0x7f6f900ccf90 2023-10-09T06:25:58.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f9594c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f90070700 0x7f6f9016e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:58.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f9594c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f90070700 0x7f6f9016e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43272/0 (socket says 172.21.15.31:43272) 2023-10-09T06:25:58.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f9594c700 1 -- 172.21.15.31:0/2950983342 learned_addr learned my addr 172.21.15.31:0/2950983342 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:58.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f9614d700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f90159de0 0x7f6f901537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:58.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f9514b700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f900ccf90 0x7f6f900c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:58.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f9594c700 1 -- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f900ccf90 msgr2=0x7f6f900c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:58.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f9594c700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f900ccf90 0x7f6f900c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f9594c700 1 -- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f90159de0 msgr2=0x7f6f901537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:58.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f9594c700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f90159de0 0x7f6f901537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.165+0000 7f6f9594c700 1 -- 172.21.15.31:0/2950983342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f88009420 con 0x7f6f90070700 2023-10-09T06:25:58.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.166+0000 7f6f9594c700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f90070700 0x7f6f9016e530 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800ec80 tx=0x7f6f880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:58.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.166+0000 7f6f8dffb700 1 -- 172.21.15.31:0/2950983342 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800c850 con 0x7f6f90070700 2023-10-09T06:25:58.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.166+0000 7f6f8dffb700 1 -- 172.21.15.31:0/2950983342 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8800c9b0 con 0x7f6f90070700 2023-10-09T06:25:58.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.166+0000 7f6f97bb0700 1 -- 172.21.15.31:0/2950983342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f80009ae0 con 0x7f6f90070700 2023-10-09T06:25:58.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.166+0000 7f6f8dffb700 1 -- 172.21.15.31:0/2950983342 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800cd30 con 0x7f6f90070700 2023-10-09T06:25:58.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.166+0000 7f6f97bb0700 1 -- 172.21.15.31:0/2950983342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9015b370 con 0x7f6f90070700 2023-10-09T06:25:58.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.167+0000 7f6f97bb0700 1 -- 172.21.15.31:0/2950983342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9004c3c0 con 0x7f6f90070700 2023-10-09T06:25:58.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.167+0000 7f6f8dffb700 1 -- 172.21.15.31:0/2950983342 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f88013680 con 0x7f6f90070700 2023-10-09T06:25:58.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.168+0000 7f6f8dffb700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f7c066f30 0x7f6f7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:58.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.168+0000 7f6f8dffb700 1 -- 172.21.15.31:0/2950983342 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f88084770 con 0x7f6f90070700 2023-10-09T06:25:58.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.168+0000 7f6f9514b700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f7c066f30 0x7f6f7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:58.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.168+0000 7f6f9514b700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f7c066f30 0x7f6f7c0693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6f900c7c90 tx=0x7f6f84007ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:58.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.172+0000 7f6f8dffb700 1 -- 172.21.15.31:0/2950983342 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f88055470 con 0x7f6f90070700 2023-10-09T06:25:58.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.447+0000 7f6f97bb0700 1 -- 172.21.15.31:0/2950983342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6f900cb3c0 con 0x7f6f90070700 2023-10-09T06:25:58.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.451+0000 7f6f8dffb700 1 -- 172.21.15.31:0/2950983342 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6f88055000 con 0x7f6f90070700 2023-10-09T06:25:58.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.453+0000 7f6f97bb0700 1 -- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f7c066f30 msgr2=0x7f6f7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:58.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.453+0000 7f6f97bb0700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f7c066f30 0x7f6f7c0693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6f900c7c90 tx=0x7f6f84007ba0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.453+0000 7f6f97bb0700 1 -- 172.21.15.31:0/2950983342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f90070700 msgr2=0x7f6f9016e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:58.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.453+0000 7f6f97bb0700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f90070700 0x7f6f9016e530 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800ec80 tx=0x7f6f880091a0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.453+0000 7f6f97bb0700 1 -- 172.21.15.31:0/2950983342 shutdown_connections 2023-10-09T06:25:58.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.453+0000 7f6f97bb0700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f7c066f30 0x7f6f7c0693e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.453+0000 7f6f97bb0700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f90159de0 0x7f6f901537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.453+0000 7f6f97bb0700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f90070700 0x7f6f9016e530 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.453+0000 7f6f97bb0700 1 --2- 172.21.15.31:0/2950983342 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f900ccf90 0x7f6f900c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.453+0000 7f6f97bb0700 1 -- 172.21.15.31:0/2950983342 >> 172.21.15.31:0/2950983342 conn(0x7f6f900ce540 msgr2=0x7f6f90067ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:58.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.453+0000 7f6f97bb0700 1 -- 172.21.15.31:0/2950983342 shutdown_connections 2023-10-09T06:25:58.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.453+0000 7f6f97bb0700 1 -- 172.21.15.31:0/2950983342 wait complete. 2023-10-09T06:25:58.455 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2023-10-09T06:25:58.466 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:25:58.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.625+0000 7f00c00a9700 1 Processor -- start 2023-10-09T06:25:58.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.626+0000 7f00c00a9700 1 -- start start 2023-10-09T06:25:58.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.626+0000 7f00c00a9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f00b815a2b0 0x7f00b80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:58.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.626+0000 7f00c00a9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00b80d1c30 0x7f00b80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:58.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.626+0000 7f00c00a9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00b815a680 0x7f00b80cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:58.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.626+0000 7f00c00a9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b8068470 con 0x7f00b815a680 2023-10-09T06:25:58.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.626+0000 7f00c00a9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b80c5d80 con 0x7f00b815a2b0 2023-10-09T06:25:58.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.626+0000 7f00c00a9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b80c6060 con 0x7f00b80d1c30 2023-10-09T06:25:58.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.626+0000 7f00be646700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00b815a680 0x7f00b80cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:58.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.627+0000 7f00be646700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00b815a680 0x7f00b80cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43280/0 (socket says 172.21.15.31:43280) 2023-10-09T06:25:58.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.627+0000 7f00be646700 1 -- 172.21.15.31:0/4222650228 learned_addr learned my addr 172.21.15.31:0/4222650228 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:58.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.627+0000 7f00bd644700 1 --2- 172.21.15.31:0/4222650228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00b80d1c30 0x7f00b80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:58.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.627+0000 7f00bde45700 1 --2- 172.21.15.31:0/4222650228 >> v2:172.21.15.158:3300/0 conn(0x7f00b815a2b0 0x7f00b80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:58.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.627+0000 7f00be646700 1 -- 172.21.15.31:0/4222650228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00b80d1c30 msgr2=0x7f00b80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:58.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.627+0000 7f00be646700 1 --2- 172.21.15.31:0/4222650228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00b80d1c30 0x7f00b80cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.627+0000 7f00be646700 1 -- 172.21.15.31:0/4222650228 >> v2:172.21.15.158:3300/0 conn(0x7f00b815a2b0 msgr2=0x7f00b80b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:58.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.627+0000 7f00be646700 1 --2- 172.21.15.31:0/4222650228 >> v2:172.21.15.158:3300/0 conn(0x7f00b815a2b0 0x7f00b80b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.627+0000 7f00be646700 1 -- 172.21.15.31:0/4222650228 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b80c6340 con 0x7f00b815a680 2023-10-09T06:25:58.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.627+0000 7f00be646700 1 --2- 172.21.15.31:0/4222650228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00b815a680 0x7f00b80cfc50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f00b8089220 tx=0x7f00b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3744781a0695ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:58.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.627+0000 7f00bce43700 1 -- 172.21.15.31:0/4222650228 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b000e070 con 0x7f00b815a680 2023-10-09T06:25:58.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.627+0000 7f00bce43700 1 -- 172.21.15.31:0/4222650228 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b000b970 con 0x7f00b815a680 2023-10-09T06:25:58.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.627+0000 7f00bce43700 1 -- 172.21.15.31:0/4222650228 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b00092e0 con 0x7f00b815a680 2023-10-09T06:25:58.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.628+0000 7f00c00a9700 1 -- 172.21.15.31:0/4222650228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00b815a680 msgr2=0x7f00b80cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:58.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.628+0000 7f00c00a9700 1 --2- 172.21.15.31:0/4222650228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00b815a680 0x7f00b80cfc50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f00b8089220 tx=0x7f00b0009840 comp rx=0 tx=0).stop 2023-10-09T06:25:58.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.628+0000 7f00c00a9700 1 -- 172.21.15.31:0/4222650228 shutdown_connections 2023-10-09T06:25:58.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.628+0000 7f00c00a9700 1 --2- 172.21.15.31:0/4222650228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00b815a680 0x7f00b80cfc50 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.628+0000 7f00c00a9700 1 --2- 172.21.15.31:0/4222650228 >> v2:172.21.15.158:3300/0 conn(0x7f00b815a2b0 0x7f00b80b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.628+0000 7f00c00a9700 1 --2- 172.21.15.31:0/4222650228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00b80d1c30 0x7f00b80cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.628+0000 7f00c00a9700 1 -- 172.21.15.31:0/4222650228 >> 172.21.15.31:0/4222650228 conn(0x7f00b8067e40 msgr2=0x7f00b80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:58.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.628+0000 7f00c00a9700 1 -- 172.21.15.31:0/4222650228 shutdown_connections 2023-10-09T06:25:58.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.628+0000 7f00c00a9700 1 -- 172.21.15.31:0/4222650228 wait complete. 2023-10-09T06:25:58.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.629+0000 7f00c00a9700 1 Processor -- start 2023-10-09T06:25:58.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.629+0000 7f00c00a9700 1 -- start start 2023-10-09T06:25:58.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00c00a9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00b80d1c30 0x7f00b80c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:58.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00c00a9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00b815a2b0 0x7f00b8155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:58.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00c00a9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00b815a680 0x7f00b815d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:58.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00c00a9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b8156010 con 0x7f00b80d1c30 2023-10-09T06:25:58.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00c00a9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b80ca5a0 con 0x7f00b815a680 2023-10-09T06:25:58.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00c00a9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b80c9990 con 0x7f00b815a2b0 2023-10-09T06:25:58.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00bde45700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00b80d1c30 0x7f00b80c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:58.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00bde45700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00b80d1c30 0x7f00b80c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43292/0 (socket says 172.21.15.31:43292) 2023-10-09T06:25:58.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00bde45700 1 -- 172.21.15.31:0/2721481538 learned_addr learned my addr 172.21.15.31:0/2721481538 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:58.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00bd644700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00b815a2b0 0x7f00b8155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:58.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00be646700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00b815a680 0x7f00b815d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:58.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00bde45700 1 -- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00b815a2b0 msgr2=0x7f00b8155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:58.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00bde45700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00b815a2b0 0x7f00b8155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00bde45700 1 -- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00b815a680 msgr2=0x7f00b815d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:58.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00bde45700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00b815a680 0x7f00b815d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00bde45700 1 -- 172.21.15.31:0/2721481538 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0009ae0 con 0x7f00b80d1c30 2023-10-09T06:25:58.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00be646700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00b815a680 0x7f00b815d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:58.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00bde45700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00b80d1c30 0x7f00b80c93b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f00b400ea30 tx=0x7f00b4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:58.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00adffb700 1 -- 172.21.15.31:0/2721481538 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400c850 con 0x7f00b80d1c30 2023-10-09T06:25:58.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00adffb700 1 -- 172.21.15.31:0/2721481538 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b400c9b0 con 0x7f00b80d1c30 2023-10-09T06:25:58.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00adffb700 1 -- 172.21.15.31:0/2721481538 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400cd30 con 0x7f00b80d1c30 2023-10-09T06:25:58.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.630+0000 7f00c00a9700 1 -- 172.21.15.31:0/2721481538 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b80c9c70 con 0x7f00b80d1c30 2023-10-09T06:25:58.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.631+0000 7f00c00a9700 1 -- 172.21.15.31:0/2721481538 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b80ca230 con 0x7f00b80d1c30 2023-10-09T06:25:58.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.631+0000 7f00c00a9700 1 -- 172.21.15.31:0/2721481538 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b804c3c0 con 0x7f00b80d1c30 2023-10-09T06:25:58.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.632+0000 7f00adffb700 1 -- 172.21.15.31:0/2721481538 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00b4013680 con 0x7f00b80d1c30 2023-10-09T06:25:58.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.632+0000 7f00adffb700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f009c066f30 0x7f009c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:58.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.632+0000 7f00adffb700 1 -- 172.21.15.31:0/2721481538 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00b4084b50 con 0x7f00b80d1c30 2023-10-09T06:25:58.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.632+0000 7f00bd644700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f009c066f30 0x7f009c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:58.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.633+0000 7f00bd644700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f009c066f30 0x7f009c0693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f00b80d2000 tx=0x7f00a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:58.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.637+0000 7f00adffb700 1 -- 172.21.15.31:0/2721481538 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00b4051dc0 con 0x7f00b80d1c30 2023-10-09T06:25:58.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.874+0000 7f00c00a9700 1 -- 172.21.15.31:0/2721481538 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00b80ca3f0 con 0x7f00b80d1c30 2023-10-09T06:25:58.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.874+0000 7f00adffb700 1 -- 172.21.15.31:0/2721481538 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f00b4021090 con 0x7f00b80d1c30 2023-10-09T06:25:58.875 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:25:58.875 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2694953357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2694953357},{"type":"v1","addr":"172.21.15.158:6836","nonce":2694953357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1926052104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1926052104},{"type":"v1","addr":"172.21.15.31:6834","nonce":1926052104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3700277268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3700277268},{"type":"v1","addr":"172.21.15.31:6835","nonce":3700277268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:25:48.239748+0000","modified":"2023-10-09T06:25:51.874363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/3699283833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3699283833},{"type":"v1","addr":"172.21.15.158:6837","nonce":3699283833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T06:25:58.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.876+0000 7f00c00a9700 1 -- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f009c066f30 msgr2=0x7f009c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:58.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.876+0000 7f00c00a9700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f009c066f30 0x7f009c0693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f00b80d2000 tx=0x7f00a8008040 comp rx=0 tx=0).stop 2023-10-09T06:25:58.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.876+0000 7f00c00a9700 1 -- 172.21.15.31:0/2721481538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00b80d1c30 msgr2=0x7f00b80c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:58.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.876+0000 7f00c00a9700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00b80d1c30 0x7f00b80c93b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f00b400ea30 tx=0x7f00b4009120 comp rx=0 tx=0).stop 2023-10-09T06:25:58.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.876+0000 7f00c00a9700 1 -- 172.21.15.31:0/2721481538 shutdown_connections 2023-10-09T06:25:58.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.876+0000 7f00c00a9700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f009c066f30 0x7f009c0693e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.876+0000 7f00c00a9700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00b815a680 0x7f00b815d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.876+0000 7f00c00a9700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00b80d1c30 0x7f00b80c93b0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.876+0000 7f00c00a9700 1 --2- 172.21.15.31:0/2721481538 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f00b815a2b0 0x7f00b8155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:58.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.876+0000 7f00c00a9700 1 -- 172.21.15.31:0/2721481538 >> 172.21.15.31:0/2721481538 conn(0x7f00b8067e40 msgr2=0x7f00b8158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:58.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.877+0000 7f00c00a9700 1 -- 172.21.15.31:0/2721481538 shutdown_connections 2023-10-09T06:25:58.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:58.877+0000 7f00c00a9700 1 -- 172.21.15.31:0/2721481538 wait complete. 2023-10-09T06:25:58.879 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 50 2023-10-09T06:25:59.292 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:25:48.239748+0000', 'modified': '2023-10-09T06:25:51.874363+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6279': {'gid': 6279, 'name': 'b', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.158:6837/3699283833', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6835', 'nonce': 3699283833}, {'type': 'v1', 'addr': '172.21.15.158:6837', 'nonce': 3699283833}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:25:59.292 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:25:59.292 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-09T06:25:59.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.413+0000 7f877904c700 1 Processor -- start 2023-10-09T06:25:59.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.413+0000 7f877904c700 1 -- start start 2023-10-09T06:25:59.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.414+0000 7f877904c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8774069210 0x7f87740af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.414+0000 7f877904c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877415ea70 con 0x7f877415a170 2023-10-09T06:25:59.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.414+0000 7f877904c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87740b3990 con 0x7f8774159da0 2023-10-09T06:25:59.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.414+0000 7f877904c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87740b34b0 con 0x7f8774069210 2023-10-09T06:25:59.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.414+0000 7f87737fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f877415a170 0x7f8774068b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52452/0 (socket says 172.21.15.31:52452) 2023-10-09T06:25:59.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.414+0000 7f87737fe700 1 -- 172.21.15.31:0/3241862129 learned_addr learned my addr 172.21.15.31:0/3241862129 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:25:59.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.414+0000 7f877884b700 1 --2- 172.21.15.31:0/3241862129 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8774069210 0x7f87740af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.414+0000 7f8772ffd700 1 -- 172.21.15.31:0/3241862129 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974033147 0 0) 0x7f877415ea70 con 0x7f877415a170 2023-10-09T06:25:59.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.414+0000 7f8772ffd700 1 -- 172.21.15.31:0/3241862129 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f875c003570 con 0x7f877415a170 2023-10-09T06:25:59.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.414+0000 7f8772ffd700 1 -- 172.21.15.31:0/3241862129 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036773523 0 0) 0x7f87740b3990 con 0x7f8774159da0 2023-10-09T06:25:59.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.414+0000 7f8772ffd700 1 -- 172.21.15.31:0/3241862129 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f877415ea70 con 0x7f8774159da0 2023-10-09T06:25:59.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.415+0000 7f8772ffd700 1 -- 172.21.15.31:0/3241862129 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3803511848 0 0) 0x7f875c003570 con 0x7f877415a170 2023-10-09T06:25:59.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.415+0000 7f877884b700 1 -- 172.21.15.31:0/3241862129 >> v1:172.21.15.158:6789/0 conn(0x7f8774159da0 legacy=0x7f87740b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.415+0000 7f877884b700 1 -- 172.21.15.31:0/3241862129 >> v1:172.21.15.31:6789/0 conn(0x7f877415a170 legacy=0x7f8774068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.415+0000 7f877884b700 1 -- 172.21.15.31:0/3241862129 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87740b0b70 con 0x7f8774069210 2023-10-09T06:25:59.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.415+0000 7f877884b700 1 --2- 172.21.15.31:0/3241862129 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8774069210 0x7f87740af4a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f876c009e90 tx=0x7f876c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d66b6c87739a2219 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:59.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.415+0000 7f8772ffd700 1 -- 172.21.15.31:0/3241862129 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c00e070 con 0x7f8774069210 2023-10-09T06:25:59.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.415+0000 7f8772ffd700 1 -- 172.21.15.31:0/3241862129 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c00b870 con 0x7f8774069210 2023-10-09T06:25:59.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.415+0000 7f8772ffd700 1 -- 172.21.15.31:0/3241862129 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768001470 con 0x7f8774069210 2023-10-09T06:25:59.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.415+0000 7f877904c700 1 -- 172.21.15.31:0/3241862129 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8774069210 msgr2=0x7f87740af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.415+0000 7f877904c700 1 --2- 172.21.15.31:0/3241862129 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8774069210 0x7f87740af4a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f876c009e90 tx=0x7f876c009780 comp rx=0 tx=0).stop 2023-10-09T06:25:59.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.416+0000 7f877904c700 1 -- 172.21.15.31:0/3241862129 shutdown_connections 2023-10-09T06:25:59.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.416+0000 7f877904c700 1 --2- 172.21.15.31:0/3241862129 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8774069210 0x7f87740af4a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.416+0000 7f877904c700 1 -- 172.21.15.31:0/3241862129 >> 172.21.15.31:0/3241862129 conn(0x7f87740d0bc0 msgr2=0x7f87740d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:59.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.416+0000 7f877904c700 1 -- 172.21.15.31:0/3241862129 shutdown_connections 2023-10-09T06:25:59.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.416+0000 7f877904c700 1 -- 172.21.15.31:0/3241862129 wait complete. 2023-10-09T06:25:59.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.417+0000 7f877904c700 1 Processor -- start 2023-10-09T06:25:59.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.417+0000 7f877904c700 1 -- start start 2023-10-09T06:25:59.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.417+0000 7f877904c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8774069210 0x7f87740c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.417+0000 7f877904c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8774159da0 0x7f87740c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.417+0000 7f877904c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f877415a170 0x7f87740d1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f877904c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87740c4b60 con 0x7f8774159da0 2023-10-09T06:25:59.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f877904c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87740c59a0 con 0x7f877415a170 2023-10-09T06:25:59.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f877904c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87740c4d90 con 0x7f8774069210 2023-10-09T06:25:59.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f87737fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8774159da0 0x7f87740c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f87737fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8774159da0 0x7f87740c4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43306/0 (socket says 172.21.15.31:43306) 2023-10-09T06:25:59.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f87737fe700 1 -- 172.21.15.31:0/2740888058 learned_addr learned my addr 172.21.15.31:0/2740888058 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:59.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f877884b700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f877415a170 0x7f87740d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f8773fff700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8774069210 0x7f87740c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f87737fe700 1 -- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8774069210 msgr2=0x7f87740c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f87737fe700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8774069210 0x7f87740c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f87737fe700 1 -- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f877415a170 msgr2=0x7f87740d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f87737fe700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f877415a170 0x7f87740d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f87737fe700 1 -- 172.21.15.31:0/2740888058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c009a20 con 0x7f8774159da0 2023-10-09T06:25:59.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f87737fe700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8774159da0 0x7f87740c4620 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f876800c7e0 tx=0x7f8768001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f875bfff700 1 -- 172.21.15.31:0/2740888058 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768007360 con 0x7f8774159da0 2023-10-09T06:25:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f875bfff700 1 -- 172.21.15.31:0/2740888058 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87680074e0 con 0x7f8774159da0 2023-10-09T06:25:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f877904c700 1 -- 172.21.15.31:0/2740888058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87740c5070 con 0x7f8774159da0 2023-10-09T06:25:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f875bfff700 1 -- 172.21.15.31:0/2740888058 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768004830 con 0x7f8774159da0 2023-10-09T06:25:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.418+0000 7f877904c700 1 -- 172.21.15.31:0/2740888058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87740c5630 con 0x7f8774159da0 2023-10-09T06:25:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.420+0000 7f875bfff700 1 -- 172.21.15.31:0/2740888058 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8768004ba0 con 0x7f8774159da0 2023-10-09T06:25:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.420+0000 7f875bfff700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8760066f30 0x7f87600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.420+0000 7f875bfff700 1 -- 172.21.15.31:0/2740888058 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8768083bb0 con 0x7f8774159da0 2023-10-09T06:25:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.420+0000 7f8773fff700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8760066f30 0x7f87600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.421+0000 7f8773fff700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8760066f30 0x7f87600693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8764003870 tx=0x7f8764009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.422+0000 7f87835a6b80 1 Processor -- start 2023-10-09T06:25:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.422+0000 7f87835a6b80 1 -- start start 2023-10-09T06:25:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87835a6b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71ea4480 0x55dc71e837d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87835a6b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e575f0 0x55dc71ea4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87835a6b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e59b80 0x55dc71e59ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87835a6b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc71db0a70 con 0x55dc71e575f0 2023-10-09T06:25:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87835a6b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc71dae270 con 0x55dc71e59b80 2023-10-09T06:25:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87835a6b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc71daa060 con 0x55dc71ea4480 2023-10-09T06:25:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87737fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e575f0 0x55dc71ea4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87737fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e575f0 0x55dc71ea4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43316/0 (socket says 172.21.15.31:43316) 2023-10-09T06:25:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87737fe700 1 -- 172.21.15.31:0/3082548796 learned_addr learned my addr 172.21.15.31:0/3082548796 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f8773fff700 1 --2- 172.21.15.31:0/3082548796 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71ea4480 0x55dc71e837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f877884b700 1 --2- 172.21.15.31:0/3082548796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e59b80 0x55dc71e59ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87737fe700 1 -- 172.21.15.31:0/3082548796 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71ea4480 msgr2=0x55dc71e837d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87737fe700 1 --2- 172.21.15.31:0/3082548796 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71ea4480 0x55dc71e837d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87737fe700 1 -- 172.21.15.31:0/3082548796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e59b80 msgr2=0x55dc71e59ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87737fe700 1 --2- 172.21.15.31:0/3082548796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e59b80 0x55dc71e59ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f87737fe700 1 -- 172.21.15.31:0/3082548796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc71c44270 con 0x55dc71e575f0 2023-10-09T06:25:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.423+0000 7f877884b700 1 --2- 172.21.15.31:0/3082548796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e59b80 0x55dc71e59ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:25:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.424+0000 7f87737fe700 1 --2- 172.21.15.31:0/3082548796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e575f0 0x55dc71ea4850 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8768082180 tx=0x7f8768009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9c961a7214a8c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.424+0000 7f87597fa700 1 -- 172.21.15.31:0/3082548796 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876805bb00 con 0x55dc71e575f0 2023-10-09T06:25:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.424+0000 7f87597fa700 1 -- 172.21.15.31:0/3082548796 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8768052ca0 con 0x55dc71e575f0 2023-10-09T06:25:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.424+0000 7f87597fa700 1 -- 172.21.15.31:0/3082548796 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768054050 con 0x55dc71e575f0 2023-10-09T06:25:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.424+0000 7f87835a6b80 1 -- 172.21.15.31:0/3082548796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e575f0 msgr2=0x55dc71ea4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.424+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3082548796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e575f0 0x55dc71ea4850 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8768082180 tx=0x7f8768009040 comp rx=0 tx=0).stop 2023-10-09T06:25:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.424+0000 7f87835a6b80 1 -- 172.21.15.31:0/3082548796 shutdown_connections 2023-10-09T06:25:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.424+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3082548796 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71ea4480 0x55dc71e837d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.424+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3082548796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e59b80 0x55dc71e59ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.424+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3082548796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e575f0 0x55dc71ea4850 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.424+0000 7f87835a6b80 1 -- 172.21.15.31:0/3082548796 >> 172.21.15.31:0/3082548796 conn(0x55dc71e5b0c0 msgr2=0x55dc71e5b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.424+0000 7f87835a6b80 1 -- 172.21.15.31:0/3082548796 shutdown_connections 2023-10-09T06:25:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.424+0000 7f87835a6b80 1 -- 172.21.15.31:0/3082548796 wait complete. 2023-10-09T06:25:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.425+0000 7f87835a6b80 1 -- start start 2023-10-09T06:25:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.425+0000 7f87835a6b80 1 Processor -- start 2023-10-09T06:25:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f87835a6b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e575f0 0x55dc71e7dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f87835a6b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e59b80 0x55dc71e84170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f87835a6b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71ea4480 0x55dc71e889e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f87835a6b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc71d55890 con 0x55dc71ea4480 2023-10-09T06:25:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f87835a6b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc71d70ea0 con 0x55dc71e575f0 2023-10-09T06:25:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f87835a6b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc71c2ce30 con 0x55dc71e59b80 2023-10-09T06:25:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f87835a6b80 10 client.0 _ll_register_callbacks cb 0x55dc71e1d2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:25:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f877884b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71ea4480 0x55dc71e889e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f877884b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71ea4480 0x55dc71e889e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43332/0 (socket says 172.21.15.31:43332) 2023-10-09T06:25:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f877884b700 1 -- 172.21.15.31:0/1443712686 learned_addr learned my addr 172.21.15.31:0/1443712686 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f8773fff700 1 --2- 172.21.15.31:0/1443712686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e575f0 0x55dc71e7dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f87737fe700 1 --2- 172.21.15.31:0/1443712686 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e59b80 0x55dc71e84170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f877884b700 1 -- 172.21.15.31:0/1443712686 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e59b80 msgr2=0x55dc71e84170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f877884b700 1 --2- 172.21.15.31:0/1443712686 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e59b80 0x55dc71e84170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f877884b700 1 -- 172.21.15.31:0/1443712686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e575f0 msgr2=0x55dc71e7dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f877884b700 1 --2- 172.21.15.31:0/1443712686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e575f0 0x55dc71e7dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f877884b700 1 -- 172.21.15.31:0/1443712686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87740c5630 con 0x55dc71ea4480 2023-10-09T06:25:59.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f877884b700 1 --2- 172.21.15.31:0/1443712686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71ea4480 0x55dc71e889e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f876c003000 tx=0x7f876c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dee78018e59d210 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:59.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.426+0000 7f87527fc700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:25:59.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87527fc700 1 -- 172.21.15.31:0/1443712686 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c0124b0 con 0x55dc71ea4480 2023-10-09T06:25:59.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87527fc700 1 -- 172.21.15.31:0/1443712686 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f876c028af0 con 0x55dc71ea4480 2023-10-09T06:25:59.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87835a6b80 1 -- 172.21.15.31:0/1443712686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc71e4ecd0 con 0x55dc71ea4480 2023-10-09T06:25:59.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87527fc700 1 -- 172.21.15.31:0/1443712686 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f876c028ec0 con 0x55dc71ea4480 2023-10-09T06:25:59.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87835a6b80 10 client.6441 fetch_fsmap learned FSMap version 50 2023-10-09T06:25:59.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87835a6b80 1 -- 172.21.15.31:0/1443712686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55dc71be6fe0 con 0x55dc71ea4480 2023-10-09T06:25:59.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87527fc700 1 -- 172.21.15.31:0/1443712686 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dc71e4ecd0 con 0x55dc71ea4480 2023-10-09T06:25:59.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87527fc700 1 -- 172.21.15.31:0/1443712686 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 50) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f876c012610 con 0x55dc71ea4480 2023-10-09T06:25:59.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87835a6b80 10 client.6441 fetch_fsmap finished waiting for FSMap version 50 2023-10-09T06:25:59.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87835a6b80 10 client.6441 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T06:25:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87835a6b80 20 client.6441 populate_metadata read hostname 'smithi031' 2023-10-09T06:25:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87835a6b80 1 --2- 172.21.15.31:0/1443712686 >> [v2:172.21.15.158:6835/3699283833,v1:172.21.15.158:6837/3699283833] conn(0x55dc71ea35f0 0x55dc71ea39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87835a6b80 4 client.6441 mds_command: new command op to 6279 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:25:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f87835a6b80 1 -- 172.21.15.31:0/1443712686 --> [v2:172.21.15.158:6835/3699283833,v1:172.21.15.158:6837/3699283833] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc71e2baa0 con 0x55dc71ea35f0 2023-10-09T06:25:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.427+0000 7f8773fff700 1 --2- 172.21.15.31:0/1443712686 >> [v2:172.21.15.158:6835/3699283833,v1:172.21.15.158:6837/3699283833] conn(0x55dc71ea35f0 0x55dc71ea39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.428+0000 7f87527fc700 10 client.6441 ms_handle_connect on v2:172.21.15.158:6835/3699283833 2023-10-09T06:25:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.428+0000 7f8773fff700 1 --2- 172.21.15.31:0/1443712686 >> [v2:172.21.15.158:6835/3699283833,v1:172.21.15.158:6837/3699283833] conn(0x55dc71ea35f0 0x55dc71ea39c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28c89bdcf1bfd204 server_cookie=4bc7dd032ddfc032 in_seq=0 out_seq=0 2023-10-09T06:25:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.428+0000 7f87527fc700 1 -- 172.21.15.31:0/1443712686 <== mds.0 v2:172.21.15.158:6835/3699283833 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55dc71e2baa0 con 0x55dc71ea35f0 2023-10-09T06:25:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.428+0000 7f87527fc700 10 client.6441 handle_command_reply: tid=0 2023-10-09T06:25:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.428+0000 7f87835a6b80 1 client.6441 shutdown 2023-10-09T06:25:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.429+0000 7f87835a6b80 1 -- 172.21.15.31:0/1443712686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71ea4480 msgr2=0x55dc71e889e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.429+0000 7f87835a6b80 1 --2- 172.21.15.31:0/1443712686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71ea4480 0x55dc71e889e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f876c003000 tx=0x7f876c017000 comp rx=0 tx=0).stop 2023-10-09T06:25:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.429+0000 7f87835a6b80 1 -- 172.21.15.31:0/1443712686 shutdown_connections 2023-10-09T06:25:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.429+0000 7f87835a6b80 1 --2- 172.21.15.31:0/1443712686 >> [v2:172.21.15.158:6835/3699283833,v1:172.21.15.158:6837/3699283833] conn(0x55dc71ea35f0 0x55dc71ea39c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.429+0000 7f87835a6b80 1 --2- 172.21.15.31:0/1443712686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71ea4480 0x55dc71e889e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.429+0000 7f87835a6b80 1 --2- 172.21.15.31:0/1443712686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e575f0 0x55dc71e7dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.429+0000 7f87527fc700 0 client.6441 ms_handle_reset on v2:172.21.15.158:6835/3699283833 2023-10-09T06:25:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.429+0000 7f87835a6b80 1 --2- 172.21.15.31:0/1443712686 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e59b80 0x55dc71e84170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.429+0000 7f87835a6b80 1 -- 172.21.15.31:0/1443712686 >> 172.21.15.31:0/1443712686 conn(0x55dc71e5b0c0 msgr2=0x55dc71e59ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.429+0000 7f87835a6b80 1 -- 172.21.15.31:0/1443712686 shutdown_connections 2023-10-09T06:25:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.429+0000 7f87835a6b80 1 -- 172.21.15.31:0/1443712686 wait complete. 2023-10-09T06:25:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.429+0000 7f87835a6b80 20 client.6441 trim_cache size 0 max 16384 2023-10-09T06:25:59.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.446+0000 7f87835a6b80 1 Processor -- start 2023-10-09T06:25:59.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.446+0000 7f87835a6b80 1 -- start start 2023-10-09T06:25:59.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.446+0000 7f87835a6b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 0x55dc71e83db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.446+0000 7f87835a6b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e575f0 0x55dc71e5b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.446+0000 7f87835a6b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e59b80 0x55dc71e56c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.446+0000 7f87835a6b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc71e7d680 con 0x55dc71e5b0c0 2023-10-09T06:25:59.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.446+0000 7f87835a6b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc71e895b0 con 0x55dc71e575f0 2023-10-09T06:25:59.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.446+0000 7f87835a6b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc71eb3210 con 0x55dc71e59b80 2023-10-09T06:25:59.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.447+0000 7f8773fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 0x55dc71e83db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.447+0000 7f8773fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 0x55dc71e83db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43342/0 (socket says 172.21.15.31:43342) 2023-10-09T06:25:59.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.447+0000 7f8773fff700 1 -- 172.21.15.31:0/3759978006 learned_addr learned my addr 172.21.15.31:0/3759978006 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:59.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.447+0000 7f8773fff700 1 -- 172.21.15.31:0/3759978006 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e59b80 msgr2=0x55dc71e56c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:59.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.447+0000 7f8773fff700 1 --2- 172.21.15.31:0/3759978006 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e59b80 0x55dc71e56c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.447+0000 7f8773fff700 1 -- 172.21.15.31:0/3759978006 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e575f0 msgr2=0x55dc71e5b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:59.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.447+0000 7f8773fff700 1 --2- 172.21.15.31:0/3759978006 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e575f0 0x55dc71e5b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.447+0000 7f8773fff700 1 -- 172.21.15.31:0/3759978006 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc71d78780 con 0x55dc71e5b0c0 2023-10-09T06:25:59.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.447+0000 7f8773fff700 1 --2- 172.21.15.31:0/3759978006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 0x55dc71e83db0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f876400e440 tx=0x7f8764013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2996e2a43b981d5d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:59.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.447+0000 7f8759ffb700 1 -- 172.21.15.31:0/3759978006 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764006820 con 0x55dc71e5b0c0 2023-10-09T06:25:59.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.447+0000 7f8759ffb700 1 -- 172.21.15.31:0/3759978006 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8764006980 con 0x55dc71e5b0c0 2023-10-09T06:25:59.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.447+0000 7f8759ffb700 1 -- 172.21.15.31:0/3759978006 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764006af0 con 0x55dc71e5b0c0 2023-10-09T06:25:59.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.448+0000 7f87835a6b80 1 -- 172.21.15.31:0/3759978006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 msgr2=0x55dc71e83db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.448+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3759978006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 0x55dc71e83db0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f876400e440 tx=0x7f8764013000 comp rx=0 tx=0).stop 2023-10-09T06:25:59.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.448+0000 7f87835a6b80 1 -- 172.21.15.31:0/3759978006 shutdown_connections 2023-10-09T06:25:59.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.448+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3759978006 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e59b80 0x55dc71e56c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.448+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3759978006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 0x55dc71e83db0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.448+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3759978006 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e575f0 0x55dc71e5b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.448+0000 7f87835a6b80 1 -- 172.21.15.31:0/3759978006 >> 172.21.15.31:0/3759978006 conn(0x55dc71e57ff0 msgr2=0x55dc71eaf370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:59.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.448+0000 7f87835a6b80 1 -- 172.21.15.31:0/3759978006 shutdown_connections 2023-10-09T06:25:59.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.448+0000 7f87835a6b80 1 -- 172.21.15.31:0/3759978006 wait complete. 2023-10-09T06:25:59.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.448+0000 7f87835a6b80 1 -- start start 2023-10-09T06:25:59.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.448+0000 7f87835a6b80 1 Processor -- start 2023-10-09T06:25:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f87835a6b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e575f0 0x55dc71efd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f87835a6b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e59b80 0x55dc71e821c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f87835a6b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 0x55dc71e82700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f87835a6b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc71efda80 con 0x55dc71e5b0c0 2023-10-09T06:25:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f87835a6b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc71e831f0 con 0x55dc71e59b80 2023-10-09T06:25:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f87835a6b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc71e51170 con 0x55dc71e575f0 2023-10-09T06:25:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f87835a6b80 10 client.0 _ll_register_callbacks cb 0x55dc71e1d2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:25:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f877884b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 0x55dc71e82700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f877884b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 0x55dc71e82700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43344/0 (socket says 172.21.15.31:43344) 2023-10-09T06:25:59.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f877884b700 1 -- 172.21.15.31:0/3393418065 learned_addr learned my addr 172.21.15.31:0/3393418065 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f87737fe700 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e59b80 0x55dc71e821c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f8773fff700 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e575f0 0x55dc71efd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f877884b700 1 -- 172.21.15.31:0/3393418065 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e575f0 msgr2=0x55dc71efd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f877884b700 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e575f0 0x55dc71efd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f877884b700 1 -- 172.21.15.31:0/3393418065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e59b80 msgr2=0x55dc71e821c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.449+0000 7f877884b700 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e59b80 0x55dc71e821c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f877884b700 1 -- 172.21.15.31:0/3393418065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876400f040 con 0x55dc71e5b0c0 2023-10-09T06:25:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87737fe700 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e59b80 0x55dc71e821c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f877884b700 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 0x55dc71e82700 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f876c00b840 tx=0x7f876c020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb3c9e94a4d9b6a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87527fc700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:25:59.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87527fc700 1 -- 172.21.15.31:0/3393418065 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c012e30 con 0x55dc71e5b0c0 2023-10-09T06:25:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87527fc700 1 -- 172.21.15.31:0/3393418065 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f876c012640 con 0x55dc71e5b0c0 2023-10-09T06:25:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87835a6b80 1 -- 172.21.15.31:0/3393418065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8768052ca0 con 0x55dc71e5b0c0 2023-10-09T06:25:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87527fc700 1 -- 172.21.15.31:0/3393418065 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f876c031680 con 0x55dc71e5b0c0 2023-10-09T06:25:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87835a6b80 10 client.6447 fetch_fsmap learned FSMap version 50 2023-10-09T06:25:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87835a6b80 1 -- 172.21.15.31:0/3393418065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55dc71d5f470 con 0x55dc71e5b0c0 2023-10-09T06:25:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87527fc700 1 -- 172.21.15.31:0/3393418065 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8768052ca0 con 0x55dc71e5b0c0 2023-10-09T06:25:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87527fc700 1 -- 172.21.15.31:0/3393418065 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 50) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f876c0317e0 con 0x55dc71e5b0c0 2023-10-09T06:25:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87835a6b80 10 client.6447 fetch_fsmap finished waiting for FSMap version 50 2023-10-09T06:25:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87835a6b80 10 client.6447 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T06:25:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87835a6b80 20 client.6447 populate_metadata read hostname 'smithi031' 2023-10-09T06:25:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.158:6835/3699283833,v1:172.21.15.158:6837/3699283833] conn(0x55dc71ea4480 0x55dc71e9e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87835a6b80 4 client.6447 mds_command: new command op to 6279 tid=0[{"prefix": "status"}] 2023-10-09T06:25:59.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.450+0000 7f87835a6b80 1 -- 172.21.15.31:0/3393418065 --> [v2:172.21.15.158:6835/3699283833,v1:172.21.15.158:6837/3699283833] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dc71d4ce00 con 0x55dc71ea4480 2023-10-09T06:25:59.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f8773fff700 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.158:6835/3699283833,v1:172.21.15.158:6837/3699283833] conn(0x55dc71ea4480 0x55dc71e9e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f87527fc700 10 client.6447 ms_handle_connect on v2:172.21.15.158:6835/3699283833 2023-10-09T06:25:59.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f8773fff700 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.158:6835/3699283833,v1:172.21.15.158:6837/3699283833] conn(0x55dc71ea4480 0x55dc71e9e920 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a48cd1b52006f34c server_cookie=64d16c194edbb9e2 in_seq=0 out_seq=0 2023-10-09T06:25:59.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f87527fc700 1 -- 172.21.15.31:0/3393418065 <== mds.0 v2:172.21.15.158:6835/3699283833 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55dc71d4ce00 con 0x55dc71ea4480 2023-10-09T06:25:59.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f87527fc700 10 client.6447 handle_command_reply: tid=0 2023-10-09T06:25:59.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f87835a6b80 1 client.6447 shutdown 2023-10-09T06:25:59.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f87835a6b80 1 -- 172.21.15.31:0/3393418065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 msgr2=0x55dc71e82700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 0x55dc71e82700 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f876c00b840 tx=0x7f876c020070 comp rx=0 tx=0).stop 2023-10-09T06:25:59.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f87835a6b80 1 -- 172.21.15.31:0/3393418065 shutdown_connections 2023-10-09T06:25:59.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55dc71e575f0 0x55dc71efd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.158:6835/3699283833,v1:172.21.15.158:6837/3699283833] conn(0x55dc71ea4480 0x55dc71e9e920 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc71e5b0c0 0x55dc71e82700 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f87835a6b80 1 --2- 172.21.15.31:0/3393418065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc71e59b80 0x55dc71e821c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f87527fc700 0 client.6447 ms_handle_reset on v2:172.21.15.158:6835/3699283833 2023-10-09T06:25:59.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.451+0000 7f87835a6b80 1 -- 172.21.15.31:0/3393418065 >> 172.21.15.31:0/3393418065 conn(0x55dc71e57ff0 msgr2=0x55dc71e56c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:59.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f87835a6b80 1 -- 172.21.15.31:0/3393418065 shutdown_connections 2023-10-09T06:25:59.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f87835a6b80 1 -- 172.21.15.31:0/3393418065 wait complete. 2023-10-09T06:25:59.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f87835a6b80 20 client.6447 trim_cache size 0 max 16384 2023-10-09T06:25:59.459 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:25:59.460 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:25:59.460 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-10-09T06:25:59.460 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 6279, 2023-10-09T06:25:59.460 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-10-09T06:25:59.460 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-10-09T06:25:59.460 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-10-09T06:25:59.460 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 10.588603315, 2023-10-09T06:25:59.460 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 50, 2023-10-09T06:25:59.460 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 101, 2023-10-09T06:25:59.460 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 101, 2023-10-09T06:25:59.460 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 16.521582249000001 2023-10-09T06:25:59.460 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:25:59.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f877904c700 1 -- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8760066f30 msgr2=0x7f87600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f877904c700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8760066f30 0x7f87600693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8764003870 tx=0x7f8764009040 comp rx=0 tx=0).stop 2023-10-09T06:25:59.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f877904c700 1 -- 172.21.15.31:0/2740888058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8774159da0 msgr2=0x7f87740c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f877904c700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8774159da0 0x7f87740c4620 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f876800c7e0 tx=0x7f8768001a30 comp rx=0 tx=0).stop 2023-10-09T06:25:59.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f877904c700 1 -- 172.21.15.31:0/2740888058 shutdown_connections 2023-10-09T06:25:59.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f877904c700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8760066f30 0x7f87600693e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f877904c700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8774069210 0x7f87740c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f877904c700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f877415a170 0x7f87740d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f877904c700 1 --2- 172.21.15.31:0/2740888058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8774159da0 0x7f87740c4620 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f877904c700 1 -- 172.21.15.31:0/2740888058 >> 172.21.15.31:0/2740888058 conn(0x7f87740d0bc0 msgr2=0x7f8774159020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:59.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f877904c700 1 -- 172.21.15.31:0/2740888058 shutdown_connections 2023-10-09T06:25:59.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.452+0000 7f877904c700 1 -- 172.21.15.31:0/2740888058 wait complete. 2023-10-09T06:25:59.465 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:25:59.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.582+0000 7f2900df8700 1 Processor -- start 2023-10-09T06:25:59.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.582+0000 7f2900df8700 1 -- start start 2023-10-09T06:25:59.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.583+0000 7f2900df8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f28fc15a030 0x7f28fc15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.583+0000 7f2900df8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28fc0cf100 0x7f28fc0cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.583+0000 7f2900df8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28fc0b40b0 0x7f28fc0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.583+0000 7f2900df8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc0d1960 con 0x7f28fc0b40b0 2023-10-09T06:25:59.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.583+0000 7f2900df8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc0d0610 con 0x7f28fc15a030 2023-10-09T06:25:59.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.583+0000 7f2900df8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc15a940 con 0x7f28fc0cf100 2023-10-09T06:25:59.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.583+0000 7f28fbfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28fc0b40b0 0x7f28fc0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.583+0000 7f28fbfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28fc0b40b0 0x7f28fc0b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43356/0 (socket says 172.21.15.31:43356) 2023-10-09T06:25:59.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.583+0000 7f28fbfff700 1 -- 172.21.15.31:0/866369847 learned_addr learned my addr 172.21.15.31:0/866369847 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:59.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.583+0000 7f28fb7fe700 1 --2- 172.21.15.31:0/866369847 >> v2:172.21.15.158:3300/0 conn(0x7f28fc15a030 0x7f28fc15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.583+0000 7f28faffd700 1 --2- 172.21.15.31:0/866369847 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28fc0cf100 0x7f28fc0cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.584+0000 7f28fbfff700 1 -- 172.21.15.31:0/866369847 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28fc0cf100 msgr2=0x7f28fc0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:59.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.584+0000 7f28fbfff700 1 --2- 172.21.15.31:0/866369847 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28fc0cf100 0x7f28fc0cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.584+0000 7f28fbfff700 1 -- 172.21.15.31:0/866369847 >> v2:172.21.15.158:3300/0 conn(0x7f28fc15a030 msgr2=0x7f28fc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:25:59.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.584+0000 7f28fbfff700 1 --2- 172.21.15.31:0/866369847 >> v2:172.21.15.158:3300/0 conn(0x7f28fc15a030 0x7f28fc15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.584+0000 7f28fbfff700 1 -- 172.21.15.31:0/866369847 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc0cfab0 con 0x7f28fc0b40b0 2023-10-09T06:25:59.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.584+0000 7f28fbfff700 1 --2- 172.21.15.31:0/866369847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc0b40b0 0x7f28fc0b4530 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f28fc06b8e0 tx=0x7f28f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcabfa4dcaf4218 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:59.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.584+0000 7f28fa7fc700 1 -- 172.21.15.31:0/866369847 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f400e070 con 0x7f28fc0b40b0 2023-10-09T06:25:59.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.584+0000 7f28fa7fc700 1 -- 172.21.15.31:0/866369847 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f400b970 con 0x7f28fc0b40b0 2023-10-09T06:25:59.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.584+0000 7f28fa7fc700 1 -- 172.21.15.31:0/866369847 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f40092e0 con 0x7f28fc0b40b0 2023-10-09T06:25:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.585+0000 7f2900df8700 1 -- 172.21.15.31:0/866369847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc0b40b0 msgr2=0x7f28fc0b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.585+0000 7f2900df8700 1 --2- 172.21.15.31:0/866369847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc0b40b0 0x7f28fc0b4530 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f28fc06b8e0 tx=0x7f28f4009840 comp rx=0 tx=0).stop 2023-10-09T06:25:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.585+0000 7f2900df8700 1 -- 172.21.15.31:0/866369847 shutdown_connections 2023-10-09T06:25:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.585+0000 7f2900df8700 1 --2- 172.21.15.31:0/866369847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc0b40b0 0x7f28fc0b4530 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.585+0000 7f2900df8700 1 --2- 172.21.15.31:0/866369847 >> v2:172.21.15.158:3300/0 conn(0x7f28fc15a030 0x7f28fc15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.585+0000 7f2900df8700 1 --2- 172.21.15.31:0/866369847 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28fc0cf100 0x7f28fc0cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.585+0000 7f2900df8700 1 -- 172.21.15.31:0/866369847 >> 172.21.15.31:0/866369847 conn(0x7f28fc067e40 msgr2=0x7f28fc0d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.585+0000 7f2900df8700 1 -- 172.21.15.31:0/866369847 shutdown_connections 2023-10-09T06:25:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.585+0000 7f2900df8700 1 -- 172.21.15.31:0/866369847 wait complete. 2023-10-09T06:25:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.586+0000 7f2900df8700 1 Processor -- start 2023-10-09T06:25:59.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.586+0000 7f2900df8700 1 -- start start 2023-10-09T06:25:59.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f2900df8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28fc0b40b0 0x7f28fc15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f2900df8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28fc0cf100 0x7f28fc159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f2900df8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc15a030 0x7f28fc09c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f2900df8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc159790 con 0x7f28fc15a030 2023-10-09T06:25:59.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f2900df8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc15b840 con 0x7f28fc0cf100 2023-10-09T06:25:59.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f2900df8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc09c700 con 0x7f28fc0b40b0 2023-10-09T06:25:59.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28fbfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc15a030 0x7f28fc09c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28fbfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc15a030 0x7f28fc09c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43358/0 (socket says 172.21.15.31:43358) 2023-10-09T06:25:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28fbfff700 1 -- 172.21.15.31:0/3445573163 learned_addr learned my addr 172.21.15.31:0/3445573163 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:25:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28fb7fe700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28fc0b40b0 0x7f28fc15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28faffd700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28fc0cf100 0x7f28fc159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28fbfff700 1 -- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28fc0b40b0 msgr2=0x7f28fc15fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28fbfff700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28fc0b40b0 0x7f28fc15fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28fbfff700 1 -- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28fc0cf100 msgr2=0x7f28fc159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28fbfff700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28fc0cf100 0x7f28fc159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28fbfff700 1 -- 172.21.15.31:0/3445573163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f4009ae0 con 0x7f28fc15a030 2023-10-09T06:25:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28fb7fe700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28fc0b40b0 0x7f28fc15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28faffd700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28fc0cf100 0x7f28fc159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:25:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28fbfff700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc15a030 0x7f28fc09c1c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f28fc089600 tx=0x7f28f4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28e37fe700 1 -- 172.21.15.31:0/3445573163 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4008b80 con 0x7f28fc15a030 2023-10-09T06:25:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.587+0000 7f28e37fe700 1 -- 172.21.15.31:0/3445573163 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f4008ce0 con 0x7f28fc15a030 2023-10-09T06:25:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.588+0000 7f28e37fe700 1 -- 172.21.15.31:0/3445573163 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f40266b0 con 0x7f28fc15a030 2023-10-09T06:25:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.588+0000 7f2900df8700 1 -- 172.21.15.31:0/3445573163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc15ac30 con 0x7f28fc15a030 2023-10-09T06:25:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.588+0000 7f2900df8700 1 -- 172.21.15.31:0/3445573163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc15b1f0 con 0x7f28fc15a030 2023-10-09T06:25:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.588+0000 7f2900df8700 1 -- 172.21.15.31:0/3445573163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc089300 con 0x7f28fc15a030 2023-10-09T06:25:59.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.589+0000 7f28e37fe700 1 -- 172.21.15.31:0/3445573163 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28f4003040 con 0x7f28fc15a030 2023-10-09T06:25:59.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.589+0000 7f28e37fe700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f28e8066f30 0x7f28e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:25:59.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.590+0000 7f28e37fe700 1 -- 172.21.15.31:0/3445573163 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28f4086390 con 0x7f28fc15a030 2023-10-09T06:25:59.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.590+0000 7f28fb7fe700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f28e8066f30 0x7f28e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:25:59.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.590+0000 7f28fb7fe700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f28e8066f30 0x7f28e80693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f28ec009cd0 tx=0x7f28ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:25:59.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.594+0000 7f28e37fe700 1 -- 172.21.15.31:0/3445573163 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28f40536b0 con 0x7f28fc15a030 2023-10-09T06:25:59.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.832+0000 7f2900df8700 1 -- 172.21.15.31:0/3445573163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f28fc0890a0 con 0x7f28fc15a030 2023-10-09T06:25:59.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.833+0000 7f28e37fe700 1 -- 172.21.15.31:0/3445573163 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+73 (secure 0 0 0) 0x7f28f4056cd0 con 0x7f28fc15a030 2023-10-09T06:25:59.833 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:25:59.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.834+0000 7f2900df8700 1 -- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f28e8066f30 msgr2=0x7f28e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.834+0000 7f2900df8700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f28e8066f30 0x7f28e80693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f28ec009cd0 tx=0x7f28ec008040 comp rx=0 tx=0).stop 2023-10-09T06:25:59.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.834+0000 7f2900df8700 1 -- 172.21.15.31:0/3445573163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc15a030 msgr2=0x7f28fc09c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:25:59.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.834+0000 7f2900df8700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc15a030 0x7f28fc09c1c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f28fc089600 tx=0x7f28f4018000 comp rx=0 tx=0).stop 2023-10-09T06:25:59.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.834+0000 7f2900df8700 1 -- 172.21.15.31:0/3445573163 shutdown_connections 2023-10-09T06:25:59.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.834+0000 7f2900df8700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f28e8066f30 0x7f28e80693e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.834+0000 7f2900df8700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28fc0b40b0 0x7f28fc15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.834+0000 7f2900df8700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28fc15a030 0x7f28fc09c1c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.834+0000 7f2900df8700 1 --2- 172.21.15.31:0/3445573163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28fc0cf100 0x7f28fc159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:25:59.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.834+0000 7f2900df8700 1 -- 172.21.15.31:0/3445573163 >> 172.21.15.31:0/3445573163 conn(0x7f28fc067e40 msgr2=0x7f28fc0ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:25:59.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.834+0000 7f2900df8700 1 -- 172.21.15.31:0/3445573163 shutdown_connections 2023-10-09T06:25:59.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:25:59.834+0000 7f2900df8700 1 -- 172.21.15.31:0/3445573163 wait complete. 2023-10-09T06:25:59.847 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:25:59.847 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:25:59.847 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-10-09T06:25:59.847 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:25:59.848 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:25:59.848 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:25:59.848 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:25:59.848 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:25:59.848 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:25:59.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:25:59.848 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-10-09T06:25:59.864 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:25:59.864 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:25:59.864 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:25:59.864 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:25:59.864 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:25:59.864 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:25:59.865 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:25:59.865 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T06:25:59.865 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-10-09T06:25:59.865 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:25:59.865 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T06:25:59.865 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-10-09T06:25:59.865 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:25:59.865 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-10-09T06:25:59.865 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-10-09T06:25:59.865 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T06:25:59.865 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42207sec preferred_lft 42207sec 2023-10-09T06:25:59.866 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-10-09T06:25:59.866 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:25:59.866 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:25:59.866 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:25:59.866 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-10-09T06:25:59.866 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:25:59.866 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:25:59.866 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:25:59.866 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:25:59.866 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::b4ad:53ff:fed3:a589/64 scope link 2023-10-09T06:25:59.866 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:25:59.867 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:25:59.867 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether f6:bf:b8:0f:49:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:25:59.867 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::f4bf:b8ff:fe0f:498b/64 scope link 2023-10-09T06:25:59.867 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:25:59.867 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:25:59.867 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:25:59.867 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::d8ab:b5ff:fe1d:e066/64 scope link 2023-10-09T06:25:59.867 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:25:59.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:25:59.867 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:25:59.928 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-10-09T06:25:59.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:25:59.930 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-10-09T06:25:59.985 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-10-09T06:25:59.985 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:25:59.985 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T06:25:59.986 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T06:25:59.986 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:25:59.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:25:59.986 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:25:59.986 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:25:59.986 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T06:25:59.986 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T06:25:59.986 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T06:25:59.986 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:26:00.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:00.087 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:26:00.102 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:26:00.102 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:26:00.102 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:26:00.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:00.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-10-09T06:26:00.167 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:26:00.167 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:26:00.222 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:26:00.222 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:26:00.223 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:26:00.277 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:26:00.277 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:26:00.277 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:00.358 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:00.358 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:26:00.378 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:00.378 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:26:00.378 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:26:00.378 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:26:00.378 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:26:00.378 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:26:00.378 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:26:00.378 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:26:00.399 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:00.399 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:26:00.400 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:26:00.400 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:26:00.400 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:26:00.400 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:26:00.400 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:26:00.400 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:26:00.400 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:26:00.400 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:26:00.400 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:26:00.401 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:26:00.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:00.402 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:26:00.467 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:26:00.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.626+0000 7f12feb45700 1 Processor -- start 2023-10-09T06:26:00.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.626+0000 7f12feb45700 1 -- start start 2023-10-09T06:26:00.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.626+0000 7f12feb45700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12f8159cf0 0x7f12f815e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:00.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.626+0000 7f12feb45700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f12f815a0c0 0x7f12f80ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:00.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.626+0000 7f12feb45700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f80cca20 con 0x7f12f80ce1a0 2023-10-09T06:26:00.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.626+0000 7f12feb45700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f815ea40 con 0x7f12f815a0c0 2023-10-09T06:26:00.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.626+0000 7f12feb45700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f8067660 con 0x7f12f8159cf0 2023-10-09T06:26:00.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.627+0000 7f12f7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f12f815a0c0 0x7f12f80ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.627+0000 7f12fd0e2700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f12f80ce1a0 0x7f12f80cb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57348/0 (socket says 172.21.15.31:57348) 2023-10-09T06:26:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.627+0000 7f12fd0e2700 1 -- 172.21.15.31:0/2140631260 learned_addr learned my addr 172.21.15.31:0/2140631260 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.627+0000 7f12f7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f12f815a0c0 0x7f12f80ceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54646/0 (socket says 172.21.15.31:54646) 2023-10-09T06:26:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.627+0000 7f12f7fff700 1 -- 172.21.15.31:0/2140631260 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12f8159cf0 msgr2=0x7f12f815e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.627+0000 7f12f7fff700 1 --2- 172.21.15.31:0/2140631260 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12f8159cf0 0x7f12f815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.627+0000 7f12f7fff700 1 -- 172.21.15.31:0/2140631260 >> v1:172.21.15.31:6789/0 conn(0x7f12f80ce1a0 legacy=0x7f12f80cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.627+0000 7f12f77fe700 1 -- 172.21.15.31:0/2140631260 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107736849 0 0) 0x7f12f80cca20 con 0x7f12f80ce1a0 2023-10-09T06:26:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.627+0000 7f12f7fff700 1 -- 172.21.15.31:0/2140631260 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8067f00 con 0x7f12f815a0c0 2023-10-09T06:26:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.627+0000 7f12f7fff700 1 --2- 172.21.15.31:0/2140631260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12f815a0c0 0x7f12f80ceab0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009e60 tx=0x7f12e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9854f7ab8593da server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.627+0000 7f12f77fe700 1 -- 172.21.15.31:0/2140631260 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e800e070 con 0x7f12f815a0c0 2023-10-09T06:26:00.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.627+0000 7f12f77fe700 1 -- 172.21.15.31:0/2140631260 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e800bc30 con 0x7f12f815a0c0 2023-10-09T06:26:00.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.627+0000 7f12f77fe700 1 -- 172.21.15.31:0/2140631260 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8012430 con 0x7f12f815a0c0 2023-10-09T06:26:00.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.628+0000 7f12feb45700 1 -- 172.21.15.31:0/2140631260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12f815a0c0 msgr2=0x7f12f80ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:00.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.628+0000 7f12feb45700 1 --2- 172.21.15.31:0/2140631260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12f815a0c0 0x7f12f80ceab0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009e60 tx=0x7f12e8009780 comp rx=0 tx=0).stop 2023-10-09T06:26:00.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.628+0000 7f12feb45700 1 -- 172.21.15.31:0/2140631260 shutdown_connections 2023-10-09T06:26:00.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.628+0000 7f12feb45700 1 --2- 172.21.15.31:0/2140631260 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12f8159cf0 0x7f12f815e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:00.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.628+0000 7f12feb45700 1 --2- 172.21.15.31:0/2140631260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12f815a0c0 0x7f12f80ceab0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:00.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.628+0000 7f12feb45700 1 -- 172.21.15.31:0/2140631260 >> 172.21.15.31:0/2140631260 conn(0x7f12f806c6e0 msgr2=0x7f12f8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:00.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.628+0000 7f12feb45700 1 -- 172.21.15.31:0/2140631260 shutdown_connections 2023-10-09T06:26:00.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.628+0000 7f12feb45700 1 -- 172.21.15.31:0/2140631260 wait complete. 2023-10-09T06:26:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.629+0000 7f12feb45700 1 Processor -- start 2023-10-09T06:26:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.629+0000 7f12feb45700 1 -- start start 2023-10-09T06:26:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12feb45700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12f80ce1a0 0x7f12f8154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12feb45700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12f8159cf0 0x7f12f816a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12feb45700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12f816a590 0x7f12f80c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12feb45700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f816a9e0 con 0x7f12f816a590 2023-10-09T06:26:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12feb45700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f816ac30 con 0x7f12f80ce1a0 2023-10-09T06:26:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12feb45700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f816af10 con 0x7f12f8159cf0 2023-10-09T06:26:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12fd0e2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12f816a590 0x7f12f80c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12fd0e2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12f816a590 0x7f12f80c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54662/0 (socket says 172.21.15.31:54662) 2023-10-09T06:26:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12fd0e2700 1 -- 172.21.15.31:0/236285965 learned_addr learned my addr 172.21.15.31:0/236285965 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12f7fff700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12f8159cf0 0x7f12f816a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12fc8e1700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12f80ce1a0 0x7f12f8154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12fd0e2700 1 -- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12f8159cf0 msgr2=0x7f12f816a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12fd0e2700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12f8159cf0 0x7f12f816a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12fd0e2700 1 -- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12f80ce1a0 msgr2=0x7f12f8154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12fd0e2700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12f80ce1a0 0x7f12f8154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12fd0e2700 1 -- 172.21.15.31:0/236285965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e8009a20 con 0x7f12f816a590 2023-10-09T06:26:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12fc8e1700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12f80ce1a0 0x7f12f8154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12f7fff700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12f8159cf0 0x7f12f816a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.630+0000 7f12fd0e2700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12f816a590 0x7f12f80c3e50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c7e0 tx=0x7f12e0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.631+0000 7f12f4ff9700 1 -- 172.21.15.31:0/236285965 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0005c00 con 0x7f12f816a590 2023-10-09T06:26:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.631+0000 7f12f4ff9700 1 -- 172.21.15.31:0/236285965 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0005d60 con 0x7f12f816a590 2023-10-09T06:26:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.631+0000 7f12feb45700 1 -- 172.21.15.31:0/236285965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f81560d0 con 0x7f12f816a590 2023-10-09T06:26:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.631+0000 7f12f4ff9700 1 -- 172.21.15.31:0/236285965 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0004a80 con 0x7f12f816a590 2023-10-09T06:26:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.631+0000 7f12feb45700 1 -- 172.21.15.31:0/236285965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f8156690 con 0x7f12f816a590 2023-10-09T06:26:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.632+0000 7f12feb45700 1 -- 172.21.15.31:0/236285965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f806a490 con 0x7f12f816a590 2023-10-09T06:26:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.632+0000 7f12f4ff9700 1 -- 172.21.15.31:0/236285965 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12e0005030 con 0x7f12f816a590 2023-10-09T06:26:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.633+0000 7f12f4ff9700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f12d8066f30 0x7f12d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.633+0000 7f12f4ff9700 1 -- 172.21.15.31:0/236285965 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12e0083970 con 0x7f12f816a590 2023-10-09T06:26:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.633+0000 7f12fc8e1700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f12d8066f30 0x7f12d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:00.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.633+0000 7f12fc8e1700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f12d8066f30 0x7f12d80693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12f0006fd0 tx=0x7f12f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:00.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.637+0000 7f12f4ff9700 1 -- 172.21.15.31:0/236285965 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12e004b5a0 con 0x7f12f816a590 2023-10-09T06:26:00.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.877+0000 7f12feb45700 1 -- 172.21.15.31:0/236285965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f12f8156880 con 0x7f12f816a590 2023-10-09T06:26:00.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.877+0000 7f12f4ff9700 1 -- 172.21.15.31:0/236285965 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+73 (secure 0 0 0) 0x7f12e0050be0 con 0x7f12f816a590 2023-10-09T06:26:00.878 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:26:00.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.879+0000 7f12feb45700 1 -- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f12d8066f30 msgr2=0x7f12d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:00.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.879+0000 7f12feb45700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f12d8066f30 0x7f12d80693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12f0006fd0 tx=0x7f12f0008040 comp rx=0 tx=0).stop 2023-10-09T06:26:00.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.879+0000 7f12feb45700 1 -- 172.21.15.31:0/236285965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12f816a590 msgr2=0x7f12f80c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:00.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.879+0000 7f12feb45700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12f816a590 0x7f12f80c3e50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c7e0 tx=0x7f12e0007d90 comp rx=0 tx=0).stop 2023-10-09T06:26:00.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.879+0000 7f12feb45700 1 -- 172.21.15.31:0/236285965 shutdown_connections 2023-10-09T06:26:00.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.879+0000 7f12feb45700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f12d8066f30 0x7f12d80693e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:00.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.879+0000 7f12feb45700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12f816a590 0x7f12f80c3e50 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:00.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.879+0000 7f12feb45700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12f80ce1a0 0x7f12f8154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:00.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.879+0000 7f12feb45700 1 --2- 172.21.15.31:0/236285965 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f12f8159cf0 0x7f12f816a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:00.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.879+0000 7f12feb45700 1 -- 172.21.15.31:0/236285965 >> 172.21.15.31:0/236285965 conn(0x7f12f806c6e0 msgr2=0x7f12f8069010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:00.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.879+0000 7f12feb45700 1 -- 172.21.15.31:0/236285965 shutdown_connections 2023-10-09T06:26:00.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:00.879+0000 7f12feb45700 1 -- 172.21.15.31:0/236285965 wait complete. 2023-10-09T06:26:00.892 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:26:00.892 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:26:00.892 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-09T06:26:00.892 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T06:26:00.892 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T06:26:00.893 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:26:00.893 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:26:00.893 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:26:00.893 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:26:00.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:00.893 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-09T06:26:00.911 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:26:00.911 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:26:00.911 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:26:00.911 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:00.912 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:26:00.912 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:00.912 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:26:00.912 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:00.912 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-09T06:26:00.912 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:26:00.912 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:00.912 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-09T06:26:00.912 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:26:00.912 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:00.913 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:26:00.913 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:00.913 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:26:00.913 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42233sec preferred_lft 42233sec 2023-10-09T06:26:00.913 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-09T06:26:00.913 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:00.913 INFO:teuthology.orchestra.run.smithi158.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:26:00.914 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:00.914 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:26:00.914 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:00.914 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::c5:35ff:fec9:1844/64 scope link 2023-10-09T06:26:00.914 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:00.914 INFO:teuthology.orchestra.run.smithi158.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:26:00.915 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether e6:10:14:7c:a4:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:26:00.915 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::e410:14ff:fe7c:a4d7/64 scope link 2023-10-09T06:26:00.915 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:00.915 INFO:teuthology.orchestra.run.smithi158.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:26:00.915 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T06:26:00.915 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::44a9:f1ff:fe2b:babb/64 scope link 2023-10-09T06:26:00.916 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:00.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:00.916 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:26:00.977 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-09T06:26:00.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:00.979 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-09T06:26:01.037 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-09T06:26:01.037 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:26:01.037 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:26:01.037 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:26:01.037 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:26:01.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:01.038 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:26:01.038 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:26:01.038 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:26:01.038 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:26:01.038 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:26:01.038 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:26:01.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:01.141 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:26:01.156 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T06:26:01.156 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T06:26:01.156 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:26:01.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:01.157 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-09T06:26:01.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:26:01.221 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T06:26:01.275 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:26:01.276 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:26:01.276 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:26:01.330 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T06:26:01.330 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:26:01.331 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:01.409 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:01.410 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:26:01.428 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:01.429 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:26:01.429 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:26:01.429 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:26:01.429 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:26:01.429 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:26:01.429 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:26:01.429 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:26:01.450 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:01.450 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:26:01.450 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:26:01.450 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:26:01.450 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:26:01.450 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:26:01.450 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:26:01.450 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:26:01.450 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:26:01.451 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:26:01.451 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:26:01.452 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:26:01.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:01.452 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:26:01.516 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:01.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.638+0000 7f4b109b6700 1 Processor -- start 2023-10-09T06:26:01.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.638+0000 7f4b109b6700 1 -- start start 2023-10-09T06:26:01.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b109b6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4b0c159cf0 0x7f4b0c15e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:01.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b109b6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4b0c0cf1c0 0x7f4b0c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:01.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b109b6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0c0cca20 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b109b6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c15ea40 con 0x7f4b0c0cf1c0 2023-10-09T06:26:01.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b109b6700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c067660 con 0x7f4b0c159cf0 2023-10-09T06:26:01.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b0ad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4b0c0cf1c0 0x7f4b0c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:01.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b0ad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4b0c0cf1c0 0x7f4b0c068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54676/0 (socket says 172.21.15.31:54676) 2023-10-09T06:26:01.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b0ad9d700 1 -- 172.21.15.31:0/1265235280 learned_addr learned my addr 172.21.15.31:0/1265235280 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:01.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b0a59c700 1 --2- 172.21.15.31:0/1265235280 >> v2:172.21.15.158:3300/0 conn(0x7f4b0c159cf0 0x7f4b0c15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:01.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b0ad9d700 1 -- 172.21.15.31:0/1265235280 >> v2:172.21.15.158:3300/0 conn(0x7f4b0c159cf0 msgr2=0x7f4b0c15e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:01.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b0ad9d700 1 --2- 172.21.15.31:0/1265235280 >> v2:172.21.15.158:3300/0 conn(0x7f4b0c159cf0 0x7f4b0c15e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:01.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b0ad9d700 1 -- 172.21.15.31:0/1265235280 >> v1:172.21.15.158:6789/0 conn(0x7f4b0c15a0c0 legacy=0x7f4b0c0ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:01.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b0ad9d700 1 -- 172.21.15.31:0/1265235280 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c067f00 con 0x7f4b0c0cf1c0 2023-10-09T06:26:01.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.639+0000 7f4b0a59c700 1 --2- 172.21.15.31:0/1265235280 >> v2:172.21.15.158:3300/0 conn(0x7f4b0c159cf0 0x7f4b0c15e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:01.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.640+0000 7f4b0ad9d700 1 --2- 172.21.15.31:0/1265235280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b0c0cf1c0 0x7f4b0c068390 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0777e0 tx=0x7f4b04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45c3c30d57a45f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:01.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.640+0000 7f4b0959a700 1 -- 172.21.15.31:0/1265235280 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0400e070 con 0x7f4b0c0cf1c0 2023-10-09T06:26:01.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.640+0000 7f4b0959a700 1 -- 172.21.15.31:0/1265235280 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0400ba10 con 0x7f4b0c0cf1c0 2023-10-09T06:26:01.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.640+0000 7f4b0959a700 1 -- 172.21.15.31:0/1265235280 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040092e0 con 0x7f4b0c0cf1c0 2023-10-09T06:26:01.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.640+0000 7f4b109b6700 1 -- 172.21.15.31:0/1265235280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b0c0cf1c0 msgr2=0x7f4b0c068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:01.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.640+0000 7f4b109b6700 1 --2- 172.21.15.31:0/1265235280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b0c0cf1c0 0x7f4b0c068390 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0777e0 tx=0x7f4b04009840 comp rx=0 tx=0).stop 2023-10-09T06:26:01.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.640+0000 7f4b109b6700 1 -- 172.21.15.31:0/1265235280 shutdown_connections 2023-10-09T06:26:01.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.640+0000 7f4b109b6700 1 --2- 172.21.15.31:0/1265235280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b0c0cf1c0 0x7f4b0c068390 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:01.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.640+0000 7f4b109b6700 1 --2- 172.21.15.31:0/1265235280 >> v2:172.21.15.158:3300/0 conn(0x7f4b0c159cf0 0x7f4b0c15e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:01.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.640+0000 7f4b109b6700 1 -- 172.21.15.31:0/1265235280 >> 172.21.15.31:0/1265235280 conn(0x7f4b0c06c6e0 msgr2=0x7f4b0c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:01.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.640+0000 7f4b109b6700 1 -- 172.21.15.31:0/1265235280 shutdown_connections 2023-10-09T06:26:01.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.640+0000 7f4b109b6700 1 -- 172.21.15.31:0/1265235280 wait complete. 2023-10-09T06:26:01.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.641+0000 7f4b109b6700 1 Processor -- start 2023-10-09T06:26:01.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.641+0000 7f4b109b6700 1 -- start start 2023-10-09T06:26:01.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.642+0000 7f4b109b6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b0c0cf1c0 0x7f4b0c155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:01.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.642+0000 7f4b109b6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b0c159cf0 0x7f4b0c0c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:01.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.642+0000 7f4b109b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b0c15a0c0 0x7f4b0c0c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:01.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.642+0000 7f4b109b6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0aa910 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.642+0000 7f4b109b6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0c87a0 con 0x7f4b0c159cf0 2023-10-09T06:26:01.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.642+0000 7f4b109b6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0aab80 con 0x7f4b0c0cf1c0 2023-10-09T06:26:01.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.642+0000 7f4b0ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b0c15a0c0 0x7f4b0c0c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:01.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.642+0000 7f4b0ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b0c15a0c0 0x7f4b0c0c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54678/0 (socket says 172.21.15.31:54678) 2023-10-09T06:26:01.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.642+0000 7f4b0ad9d700 1 -- 172.21.15.31:0/3428404353 learned_addr learned my addr 172.21.15.31:0/3428404353 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:01.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.642+0000 7f4b09d9b700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b0c159cf0 0x7f4b0c0c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:01.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.642+0000 7f4b0a59c700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b0c0cf1c0 0x7f4b0c155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:01.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.643+0000 7f4b0ad9d700 1 -- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b0c0cf1c0 msgr2=0x7f4b0c155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:01.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.643+0000 7f4b0ad9d700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b0c0cf1c0 0x7f4b0c155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:01.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.643+0000 7f4b0ad9d700 1 -- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b0c159cf0 msgr2=0x7f4b0c0c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:01.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.643+0000 7f4b0ad9d700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b0c159cf0 0x7f4b0c0c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:01.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.643+0000 7f4b0ad9d700 1 -- 172.21.15.31:0/3428404353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04009ae0 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.643+0000 7f4b0ad9d700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b0c15a0c0 0x7f4b0c0c9b60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c06de20 tx=0x7f4b04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:01.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.643+0000 7f4afa7fc700 1 -- 172.21.15.31:0/3428404353 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040032f0 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.643+0000 7f4afa7fc700 1 -- 172.21.15.31:0/3428404353 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b04012d00 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.643+0000 7f4b109b6700 1 -- 172.21.15.31:0/3428404353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c0aae60 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.643+0000 7f4afa7fc700 1 -- 172.21.15.31:0/3428404353 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0401d670 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.643+0000 7f4b109b6700 1 -- 172.21.15.31:0/3428404353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c0b4590 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.644+0000 7f4b109b6700 1 -- 172.21.15.31:0/3428404353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0c06ae00 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.645+0000 7f4afa7fc700 1 -- 172.21.15.31:0/3428404353 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b0401daa0 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.645+0000 7f4afa7fc700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4aec066f30 0x7f4aec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:01.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.645+0000 7f4afa7fc700 1 -- 172.21.15.31:0/3428404353 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b04086180 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.646+0000 7f4b0a59c700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4aec066f30 0x7f4aec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:01.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.646+0000 7f4b0a59c700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4aec066f30 0x7f4aec0693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00adc0 tx=0x7f4afc006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:01.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.649+0000 7f4afa7fc700 1 -- 172.21.15.31:0/3428404353 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b04053470 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.890+0000 7f4b109b6700 1 -- 172.21.15.31:0/3428404353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b0c04c3c0 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.891+0000 7f4afa7fc700 1 -- 172.21.15.31:0/3428404353 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f4b04009420 con 0x7f4b0c15a0c0 2023-10-09T06:26:01.892 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:01.892 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2694953357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2694953357},{"type":"v1","addr":"172.21.15.158:6836","nonce":2694953357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1926052104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1926052104},{"type":"v1","addr":"172.21.15.31:6834","nonce":1926052104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3700277268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3700277268},{"type":"v1","addr":"172.21.15.31:6835","nonce":3700277268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:25:48.239748+0000","modified":"2023-10-09T06:25:51.874363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/3699283833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3699283833},{"type":"v1","addr":"172.21.15.158:6837","nonce":3699283833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T06:26:01.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.893+0000 7f4b109b6700 1 -- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4aec066f30 msgr2=0x7f4aec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:01.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.893+0000 7f4b109b6700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4aec066f30 0x7f4aec0693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00adc0 tx=0x7f4afc006f90 comp rx=0 tx=0).stop 2023-10-09T06:26:01.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.893+0000 7f4b109b6700 1 -- 172.21.15.31:0/3428404353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b0c15a0c0 msgr2=0x7f4b0c0c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:01.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.893+0000 7f4b109b6700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b0c15a0c0 0x7f4b0c0c9b60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c06de20 tx=0x7f4b04017000 comp rx=0 tx=0).stop 2023-10-09T06:26:01.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.893+0000 7f4b109b6700 1 -- 172.21.15.31:0/3428404353 shutdown_connections 2023-10-09T06:26:01.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.893+0000 7f4b109b6700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4aec066f30 0x7f4aec0693e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:01.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.893+0000 7f4b109b6700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4b0c0cf1c0 0x7f4b0c155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:01.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.893+0000 7f4b109b6700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b0c15a0c0 0x7f4b0c0c9b60 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:01.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.893+0000 7f4b109b6700 1 --2- 172.21.15.31:0/3428404353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b0c159cf0 0x7f4b0c0c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:01.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.893+0000 7f4b109b6700 1 -- 172.21.15.31:0/3428404353 >> 172.21.15.31:0/3428404353 conn(0x7f4b0c06c6e0 msgr2=0x7f4b0c0c38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:01.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.893+0000 7f4b109b6700 1 -- 172.21.15.31:0/3428404353 shutdown_connections 2023-10-09T06:26:01.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:01.893+0000 7f4b109b6700 1 -- 172.21.15.31:0/3428404353 wait complete. 2023-10-09T06:26:01.895 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 50 2023-10-09T06:26:01.906 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-09T06:26:02.039 INFO:teuthology.orchestra.run.smithi158.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":6279,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.165743547,"mdsmap_epoch":50,"osdmap_epoch":101,"osdmap_epoch_barrier":101,"uptime":19.098723894999999} 2023-10-09T06:26:02.039 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 6279, "mdsmap_epoch": 50, "osdmap_epoch": 101, "osdmap_epoch_barrier": 101, "rank_uptime": 13.165743547, "state": "up:active", "uptime": 19.098723895, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:26:02.040 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T06:26:02.174 INFO:teuthology.orchestra.run.smithi031.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T06:26:02.174 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T06:26:02.174 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-09T06:26:02.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:02.175 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-09T06:26:03.573 INFO:teuthology.orchestra.run.smithi031.stderr:265+0 records in 2023-10-09T06:26:03.573 INFO:teuthology.orchestra.run.smithi031.stderr:265+0 records out 2023-10-09T06:26:03.573 INFO:teuthology.orchestra.run.smithi031.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.37921 s, 201 MB/s 2023-10-09T06:26:03.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:03.574 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-09T06:26:05.131 INFO:teuthology.orchestra.run.smithi031.stderr:292+0 records in 2023-10-09T06:26:05.131 INFO:teuthology.orchestra.run.smithi031.stderr:292+0 records out 2023-10-09T06:26:05.131 INFO:teuthology.orchestra.run.smithi031.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.53995 s, 199 MB/s 2023-10-09T06:26:05.131 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-09T06:26:05.131 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:26:05.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.249+0000 7fe240bc2700 1 Processor -- start 2023-10-09T06:26:05.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.249+0000 7fe240bc2700 1 -- start start 2023-10-09T06:26:05.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.250+0000 7fe240bc2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe23c0b0e50 0x7fe23c0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:05.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.250+0000 7fe240bc2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23c15de60 con 0x7fe23c0cb4f0 2023-10-09T06:26:05.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.250+0000 7fe240bc2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23c15e140 con 0x7fe23c0b1220 2023-10-09T06:26:05.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.250+0000 7fe240bc2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23c15e420 con 0x7fe23c0b0e50 2023-10-09T06:26:05.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.250+0000 7fe23a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe23c0b0e50 0x7fe23c0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:05.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.250+0000 7fe23ad9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe23c0cb4f0 0x7fe23c0679d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57354/0 (socket says 172.21.15.31:57354) 2023-10-09T06:26:05.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.250+0000 7fe23a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe23c0b0e50 0x7fe23c0c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54682/0 (socket says 172.21.15.31:54682) 2023-10-09T06:26:05.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.250+0000 7fe23ad9d700 1 -- 172.21.15.31:0/1933528227 learned_addr learned my addr 172.21.15.31:0/1933528227 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:05.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.251+0000 7fe23a59c700 1 -- 172.21.15.31:0/1933528227 >> v1:172.21.15.158:6789/0 conn(0x7fe23c0b1220 legacy=0x7fe23c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:05.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.251+0000 7fe23a59c700 1 -- 172.21.15.31:0/1933528227 >> v1:172.21.15.31:6789/0 conn(0x7fe23c0cb4f0 legacy=0x7fe23c0679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:05.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.251+0000 7fe23a59c700 1 -- 172.21.15.31:0/1933528227 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c15e700 con 0x7fe23c0b0e50 2023-10-09T06:26:05.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.251+0000 7fe23959a700 1 -- 172.21.15.31:0/1933528227 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320820621 0 0) 0x7fe23c15de60 con 0x7fe23c0cb4f0 2023-10-09T06:26:05.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.251+0000 7fe23a59c700 1 --2- 172.21.15.31:0/1933528227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0b0e50 0x7fe23c0c9180 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe2340098e0 tx=0x7fe2340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29269cf0a7d196 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:05.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.251+0000 7fe23959a700 1 -- 172.21.15.31:0/1933528227 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234009e80 con 0x7fe23c0b0e50 2023-10-09T06:26:05.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.251+0000 7fe23959a700 1 -- 172.21.15.31:0/1933528227 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23400b820 con 0x7fe23c0b0e50 2023-10-09T06:26:05.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.251+0000 7fe23959a700 1 -- 172.21.15.31:0/1933528227 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23400bba0 con 0x7fe23c0b0e50 2023-10-09T06:26:05.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.252+0000 7fe240bc2700 1 -- 172.21.15.31:0/1933528227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0b0e50 msgr2=0x7fe23c0c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:05.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.252+0000 7fe240bc2700 1 --2- 172.21.15.31:0/1933528227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0b0e50 0x7fe23c0c9180 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe2340098e0 tx=0x7fe2340091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:05.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.252+0000 7fe240bc2700 1 -- 172.21.15.31:0/1933528227 shutdown_connections 2023-10-09T06:26:05.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.252+0000 7fe240bc2700 1 --2- 172.21.15.31:0/1933528227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0b0e50 0x7fe23c0c9180 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:05.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.252+0000 7fe240bc2700 1 -- 172.21.15.31:0/1933528227 >> 172.21.15.31:0/1933528227 conn(0x7fe23c069870 msgr2=0x7fe23c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:05.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.252+0000 7fe240bc2700 1 -- 172.21.15.31:0/1933528227 shutdown_connections 2023-10-09T06:26:05.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.252+0000 7fe240bc2700 1 -- 172.21.15.31:0/1933528227 wait complete. 2023-10-09T06:26:05.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.253+0000 7fe240bc2700 1 Processor -- start 2023-10-09T06:26:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.253+0000 7fe240bc2700 1 -- start start 2023-10-09T06:26:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.253+0000 7fe240bc2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0b0e50 0x7fe23c0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.253+0000 7fe240bc2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe23c0b1220 0x7fe23c0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.253+0000 7fe240bc2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe23c0cb4f0 0x7fe23c16a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.253+0000 7fe240bc2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0c5bf0 con 0x7fe23c0b0e50 2023-10-09T06:26:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.253+0000 7fe240bc2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0b3b30 con 0x7fe23c0cb4f0 2023-10-09T06:26:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.253+0000 7fe240bc2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0b2450 con 0x7fe23c0b1220 2023-10-09T06:26:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe23a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0b0e50 0x7fe23c0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe23a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0b0e50 0x7fe23c0b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54698/0 (socket says 172.21.15.31:54698) 2023-10-09T06:26:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe23a59c700 1 -- 172.21.15.31:0/2914246623 learned_addr learned my addr 172.21.15.31:0/2914246623 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe23ad9d700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe23c0cb4f0 0x7fe23c16a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe239d9b700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe23c0b1220 0x7fe23c0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe23a59c700 1 -- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe23c0b1220 msgr2=0x7fe23c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe23a59c700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe23c0b1220 0x7fe23c0b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe23a59c700 1 -- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe23c0cb4f0 msgr2=0x7fe23c16a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe23a59c700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe23c0cb4f0 0x7fe23c16a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe23a59c700 1 -- 172.21.15.31:0/2914246623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe234009420 con 0x7fe23c0b0e50 2023-10-09T06:26:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe239d9b700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe23c0b1220 0x7fe23c0b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe23a59c700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0b0e50 0x7fe23c0b18e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0c59e0 tx=0x7fe234016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe2327fc700 1 -- 172.21.15.31:0/2914246623 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23400b990 con 0x7fe23c0b0e50 2023-10-09T06:26:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe2327fc700 1 -- 172.21.15.31:0/2914246623 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe234020070 con 0x7fe23c0b0e50 2023-10-09T06:26:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe240bc2700 1 -- 172.21.15.31:0/2914246623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23c0b2730 con 0x7fe23c0b0e50 2023-10-09T06:26:05.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe2327fc700 1 -- 172.21.15.31:0/2914246623 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23401b6a0 con 0x7fe23c0b0e50 2023-10-09T06:26:05.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.254+0000 7fe240bc2700 1 -- 172.21.15.31:0/2914246623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23c0b2cf0 con 0x7fe23c0b0e50 2023-10-09T06:26:05.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.255+0000 7fe240bc2700 1 -- 172.21.15.31:0/2914246623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23c06dbf0 con 0x7fe23c0b0e50 2023-10-09T06:26:05.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.256+0000 7fe2327fc700 1 -- 172.21.15.31:0/2914246623 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe234022030 con 0x7fe23c0b0e50 2023-10-09T06:26:05.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.256+0000 7fe2327fc700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe21c066f30 0x7fe21c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:05.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.256+0000 7fe2327fc700 1 -- 172.21.15.31:0/2914246623 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2340864b0 con 0x7fe23c0b0e50 2023-10-09T06:26:05.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.256+0000 7fe239d9b700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe21c066f30 0x7fe21c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:05.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.257+0000 7fe239d9b700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe21c066f30 0x7fe21c0693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe23c156d40 tx=0x7fe224009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:05.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.261+0000 7fe2327fc700 1 -- 172.21.15.31:0/2914246623 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe234053720 con 0x7fe23c0b0e50 2023-10-09T06:26:05.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.455+0000 7fe240bc2700 1 -- 172.21.15.31:0/2914246623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe23c06dbf0 con 0x7fe23c0b0e50 2023-10-09T06:26:05.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.456+0000 7fe2327fc700 1 -- 172.21.15.31:0/2914246623 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v101) v1 ==== 81+0+32266 (secure 0 0 0) 0x7fe234056d40 con 0x7fe23c0b0e50 2023-10-09T06:26:05.457 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:05.457 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:26:05.457 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 101, 2023-10-09T06:26:05.457 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:26:05.457 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:26:05.457 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:25:49.850415+0000", 2023-10-09T06:26:05.457 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:26:05.457 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:26:05.457 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:26:05.458 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:26:05.458 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:26:05.458 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:26:05.458 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:26:05.458 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:26:05.458 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:26:05.458 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:05.458 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:26:05.458 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:26:05.458 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:26:05.458 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:26:05.459 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:26:05.459 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 13, 2023-10-09T06:26:05.459 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:26:05.459 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:26:05.459 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:26:05.459 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:26:05.459 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:26:05.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.459 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:26:05.459 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:26:05.459 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:26:05.459 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:26:05.460 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:26:05.460 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:05.460 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:05.460 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:05.460 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:05.460 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:05.460 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:05.460 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:05.460 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:05.460 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:05.460 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:05.460 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:26:05.461 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:26:05.461 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:26:05.461 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:26:05.461 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:26:05.461 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:05.461 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:05.461 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:05.461 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:05.461 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:05.461 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:05.461 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:05.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.462 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "91", 2023-10-09T06:26:05.462 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:05.462 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:05.462 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:05.462 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:05.462 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:05.462 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:05.462 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:05.462 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:05.462 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:05.462 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:05.463 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:05.463 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:05.463 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:05.463 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:05.463 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:05.463 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:05.463 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:05.463 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:05.463 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:05.463 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:05.463 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:05.463 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:05.464 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:05.464 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:05.464 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:05.464 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:05.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.464 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:05.464 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:05.464 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:05.464 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:05.464 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:05.464 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:05.464 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:26:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:26:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:26:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 12, 2023-10-09T06:26:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:26:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:46.157560+0000", 2023-10-09T06:26:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:26:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:26:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:26:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:26:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:26:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:26:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:26:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "100", 2023-10-09T06:26:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:05.469 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:05.469 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:05.469 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:05.469 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:05.469 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:05.469 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:05.469 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:05.469 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:05.469 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:05.469 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:05.469 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:05.470 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:05.470 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:05.470 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:05.470 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:05.470 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:05.470 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:05.470 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:05.470 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:05.470 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:05.470 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:05.471 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:05.471 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:05.471 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:05.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.471 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:05.471 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:05.471 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:05.471 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:05.471 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:05.471 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:05.471 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:05.471 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:05.472 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:05.472 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:05.472 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:05.472 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:05.472 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:26:05.472 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:26:05.472 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:26:05.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.472 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:05.472 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:05.472 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:26:05.472 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.473 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.473 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 13, 2023-10-09T06:26:05.473 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:26:05.473 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:47.220698+0000", 2023-10-09T06:26:05.473 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:26:05.473 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:26:05.473 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:05.473 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:05.473 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:05.473 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:05.473 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:05.474 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:05.474 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:05.474 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:05.474 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:05.474 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:05.474 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:26:05.474 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:26:05.474 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:26:05.474 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:26:05.474 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:26:05.474 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:05.475 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:05.475 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:05.475 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:05.475 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:05.475 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:05.475 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:05.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.475 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "101", 2023-10-09T06:26:05.475 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:05.475 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:05.475 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:05.475 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:05.475 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:05.476 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:05.476 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:05.476 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:05.476 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:05.476 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:05.476 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:05.476 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:05.476 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:05.476 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:05.476 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:05.476 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:05.476 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:05.477 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:05.477 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:05.477 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:05.477 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:05.477 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:05.477 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:05.477 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:05.477 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:05.477 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:05.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.477 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:05.477 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:05.478 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:05.478 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:05.478 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:05.478 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:05.478 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:05.478 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:05.478 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:05.478 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:05.478 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:05.478 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:05.478 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:26:05.479 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:26:05.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.479 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:05.479 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:05.479 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:26:05.479 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.479 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.479 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.479 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:05.479 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:26:05.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.479 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:05.480 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:05.480 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:05.480 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:05.480 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:05.480 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:05.480 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:05.480 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:05.480 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:05.480 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:05.480 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:05.480 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:05.480 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:05.481 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.481 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.481 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:26:05.481 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:05.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.481 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.481 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:26:05.481 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:05.481 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.482 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.482 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:05.482 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.482 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.482 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:26:05.482 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:05.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.482 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.483 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:26:05.483 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:05.483 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.483 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.483 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:05.483 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.483 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.483 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:26:05.483 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:05.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.484 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.484 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:26:05.484 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:05.484 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.484 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.484 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:05.484 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.484 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.484 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:26:05.484 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:05.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.485 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.485 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:26:05.485 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:05.485 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.485 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.485 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:26:05.485 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:26:05.485 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:26:05.485 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:26:05.486 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:05.486 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:05.486 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:05.486 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.486 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:05.486 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:05.486 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:05.486 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:05.486 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:05.486 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:05.487 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:05.487 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:05.487 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:05.487 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:05.487 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:05.487 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:05.487 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:05.487 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.487 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.487 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:26:05.487 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:05.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.488 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.488 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:26:05.488 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:05.488 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.488 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.488 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:05.488 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.488 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.489 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:26:05.489 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:05.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.489 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.489 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:26:05.489 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:05.489 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.489 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.489 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:05.489 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.490 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.490 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:26:05.490 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:05.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.490 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.490 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:26:05.490 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:05.490 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.490 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.491 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:05.491 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.491 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.491 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:26:05.491 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:05.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.491 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.491 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:26:05.491 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:05.492 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.492 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.492 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:26:05.492 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:26:05.492 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:26:05.492 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:26:05.492 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:05.492 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:05.492 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:05.492 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.493 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:05.493 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:05.493 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:05.493 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:05.493 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:05.493 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:05.493 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:05.493 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:05.493 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:05.493 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:05.494 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:05.494 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:05.494 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:05.494 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.494 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.494 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:26:05.494 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:05.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.494 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.494 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:26:05.495 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:05.495 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.495 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.495 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:05.495 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.495 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.495 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:26:05.495 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:05.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.496 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.496 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:26:05.496 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:05.496 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.496 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.496 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:05.496 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.496 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.496 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:26:05.496 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:05.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.497 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.497 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:26:05.497 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:05.497 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.497 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.497 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:05.497 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.497 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.498 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:26:05.498 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:05.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.498 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.498 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:26:05.498 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:05.498 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.498 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.498 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:26:05.499 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:26:05.499 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:26:05.499 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:26:05.499 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:05.499 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:05.499 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:05.499 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.499 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:05.499 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:05.500 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:05.500 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:05.500 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:05.500 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:05.500 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:05.500 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:05.500 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:05.500 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:05.500 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:05.500 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:05.500 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:05.501 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.501 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.501 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:26:05.501 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:05.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.501 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.501 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:26:05.501 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:05.502 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.502 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.502 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:05.502 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.502 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.502 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:26:05.502 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:05.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.502 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.503 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:26:05.503 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:05.503 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.503 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.503 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:05.503 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.503 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.503 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:26:05.503 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:05.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.504 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.504 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:26:05.504 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:05.504 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.504 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.504 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:05.504 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.504 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.504 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:26:05.505 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:05.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.505 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.505 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:26:05.505 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:05.505 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.505 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.505 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:26:05.505 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:26:05.506 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:26:05.506 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:26:05.506 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:05.506 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:05.506 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:05.506 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.506 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:05.506 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:05.506 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:05.506 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:05.507 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:05.507 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:05.507 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:05.507 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:05.507 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:05.507 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:05.507 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:05.507 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:05.507 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:05.507 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.508 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.508 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:26:05.508 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:05.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.508 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.508 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:26:05.508 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:05.508 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.508 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.508 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:05.509 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.509 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.509 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:26:05.509 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:05.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.509 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.509 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:26:05.509 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:05.509 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.509 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.510 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:05.510 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.510 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.510 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:26:05.510 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:05.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.510 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.510 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:26:05.511 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:05.511 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.511 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.511 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:05.511 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.511 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.511 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:26:05.511 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:05.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.511 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.512 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:26:05.512 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:05.512 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.512 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.512 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:26:05.512 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:26:05.512 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:26:05.512 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:26:05.512 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:05.512 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:05.513 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:05.513 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.513 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:05.513 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:05.513 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:05.513 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:05.513 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:05.513 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:05.513 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:05.513 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:05.514 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:05.514 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:05.514 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:05.514 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:05.514 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:05.514 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.514 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.514 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:26:05.514 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:05.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.515 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.515 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:26:05.515 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:05.515 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.515 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.515 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:05.515 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.515 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.515 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:26:05.516 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:05.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.516 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.516 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:26:05.516 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:05.516 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.516 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.516 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:05.516 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.517 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.517 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:26:05.517 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:05.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.517 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.517 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:26:05.517 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:05.517 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.517 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.518 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:05.518 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.518 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.518 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:26:05.518 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:05.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.518 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.518 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:26:05.518 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:05.518 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.519 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.519 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:26:05.519 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:26:05.519 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:26:05.519 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:26:05.519 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:05.519 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:05.519 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:05.519 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.520 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:05.520 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:05.520 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:05.520 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:05.520 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:05.520 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:05.520 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:05.520 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:05.520 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:05.520 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:05.520 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:05.520 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:05.520 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:05.521 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.521 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.521 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:26:05.521 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:05.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.521 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.521 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:26:05.521 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:05.521 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.522 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.522 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:05.522 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.522 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.522 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:26:05.522 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:05.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.522 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.522 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:26:05.523 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:05.523 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.523 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.523 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:05.523 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.523 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.523 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:26:05.523 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:05.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.524 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.524 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:26:05.524 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:05.524 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.524 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.524 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:05.524 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.524 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.524 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:26:05.524 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:05.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.525 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.525 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:26:05.525 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:05.525 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.525 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.525 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:26:05.525 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:26:05.525 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:26:05.525 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:26:05.526 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:05.526 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:05.526 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:05.526 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.526 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:05.526 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:05.526 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:05.526 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:05.526 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:05.526 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:05.527 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:05.527 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:05.527 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:05.527 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:05.527 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:05.527 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:05.527 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:05.527 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.527 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.528 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:26:05.528 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:05.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.528 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.528 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:26:05.528 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:05.528 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.528 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.528 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:05.528 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.529 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.529 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:26:05.529 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:05.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.529 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.529 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:26:05.529 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:05.529 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.529 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.530 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:05.530 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.530 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.530 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:26:05.530 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:05.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.530 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.530 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:26:05.531 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:05.531 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.531 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.531 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:05.531 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:05.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.531 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:05.531 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:26:05.531 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:05.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.532 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:05.532 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:26:05.532 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:05.532 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.532 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.532 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:26:05.532 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:26:05.532 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:26:05.532 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:26:05.532 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:05.532 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:05.533 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:05.533 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:05.533 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.533 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:05.533 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:26:05.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.533 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:05.533 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:05.533 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:05.533 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:05.533 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:05.533 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:05.534 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:26:05.534 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:05.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.534 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:05.534 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:05.534 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:05.534 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:05.534 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:05.534 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:05.534 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:26:05.535 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:05.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.535 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:05.535 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:05.535 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:05.535 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:05.535 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:05.535 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:05.535 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:26:05.535 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:05.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.536 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:05.536 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:05.536 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:05.536 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:05.536 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:05.536 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:05.536 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:26:05.536 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:05.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.536 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:05.537 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:05.537 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:05.537 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:05.537 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:05.537 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:05.537 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:26:05.537 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:05.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.537 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:05.538 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:05.538 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:05.538 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:05.538 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:05.538 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:05.538 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:26:05.538 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:05.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.538 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:05.538 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:05.539 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:05.539 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:05.539 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:05.539 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:05.539 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:26:05.539 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:05.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:05.539 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:05.539 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:05.539 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:05.539 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:05.540 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:05.540 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:05.540 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:26:05.540 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:05.540 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.540 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:05.540 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:26:05.540 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:26:05.540 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:26:05.540 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:26:05.540 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:26:05.541 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:26:05.541 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:26:05.541 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:26:05.541 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:26:05.541 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:26:05.541 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:26:05.541 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:26:05.541 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:26:05.541 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:05.541 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:26:05.541 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:26:05.541 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:26:05.542 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:26:05.542 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:26:05.542 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:26:05.542 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:26:05.542 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:26:05.542 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:26:05.542 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:26:05.542 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:26:05.542 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:05.542 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:26:05.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.458+0000 7fe240bc2700 1 -- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe21c066f30 msgr2=0x7fe21c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:05.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.458+0000 7fe240bc2700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe21c066f30 0x7fe21c0693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe23c156d40 tx=0x7fe224009040 comp rx=0 tx=0).stop 2023-10-09T06:26:05.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.458+0000 7fe240bc2700 1 -- 172.21.15.31:0/2914246623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0b0e50 msgr2=0x7fe23c0b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:05.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.458+0000 7fe240bc2700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0b0e50 0x7fe23c0b18e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0c59e0 tx=0x7fe234016000 comp rx=0 tx=0).stop 2023-10-09T06:26:05.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.458+0000 7fe240bc2700 1 -- 172.21.15.31:0/2914246623 shutdown_connections 2023-10-09T06:26:05.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.458+0000 7fe240bc2700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe21c066f30 0x7fe21c0693e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:05.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.458+0000 7fe240bc2700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe23c0cb4f0 0x7fe23c16a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:05.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.458+0000 7fe240bc2700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0b0e50 0x7fe23c0b18e0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:05.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.458+0000 7fe240bc2700 1 --2- 172.21.15.31:0/2914246623 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe23c0b1220 0x7fe23c0b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:05.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.458+0000 7fe240bc2700 1 -- 172.21.15.31:0/2914246623 >> 172.21.15.31:0/2914246623 conn(0x7fe23c069870 msgr2=0x7fe23c0cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:05.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.458+0000 7fe240bc2700 1 -- 172.21.15.31:0/2914246623 shutdown_connections 2023-10-09T06:26:05.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:05.458+0000 7fe240bc2700 1 -- 172.21.15.31:0/2914246623 wait complete. 2023-10-09T06:26:05.545 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:26:06.912 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:26:06.912+0000 7fc5eaab7700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-10-09T06:26:10.546 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:26:10.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.680+0000 7ff1f9652700 1 Processor -- start 2023-10-09T06:26:10.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.680+0000 7ff1f9652700 1 -- start start 2023-10-09T06:26:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.681+0000 7ff1f9652700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1f406c630 0x7ff1f4067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.681+0000 7ff1f9652700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff1f4067ba0 0x7ff1f4159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.681+0000 7ff1f9652700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f4068000 con 0x7ff1f40b0890 2023-10-09T06:26:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.681+0000 7ff1f9652700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f40cb370 con 0x7ff1f4067ba0 2023-10-09T06:26:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.681+0000 7ff1f9652700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40b0c60 con 0x7ff1f406c630 2023-10-09T06:26:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.681+0000 7ff1f27fc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1f406c630 0x7ff1f4067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:10.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.682+0000 7ff1f27fc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1f406c630 0x7ff1f4067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:45548/0 (socket says 172.21.15.31:45548) 2023-10-09T06:26:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.682+0000 7ff1f27fc700 1 -- 172.21.15.31:0/362621831 learned_addr learned my addr 172.21.15.31:0/362621831 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.682+0000 7ff1f37fe700 1 --2- 172.21.15.31:0/362621831 >> v2:172.21.15.158:3300/0 conn(0x7ff1f4067ba0 0x7ff1f4159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.682+0000 7ff1f1ffb700 1 -- 172.21.15.31:0/362621831 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958967136 0 0) 0x7ff1f4068000 con 0x7ff1f40b0890 2023-10-09T06:26:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.682+0000 7ff1f27fc700 1 -- 172.21.15.31:0/362621831 >> v2:172.21.15.158:3300/0 conn(0x7ff1f4067ba0 msgr2=0x7ff1f4159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.682+0000 7ff1f27fc700 1 --2- 172.21.15.31:0/362621831 >> v2:172.21.15.158:3300/0 conn(0x7ff1f4067ba0 0x7ff1f4159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.682+0000 7ff1f27fc700 1 -- 172.21.15.31:0/362621831 >> v1:172.21.15.158:6789/0 conn(0x7ff1f40b0890 legacy=0x7ff1f40cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.682+0000 7ff1f27fc700 1 -- 172.21.15.31:0/362621831 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f406a1e0 con 0x7ff1f406c630 2023-10-09T06:26:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.682+0000 7ff1f27fc700 1 --2- 172.21.15.31:0/362621831 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1f406c630 0x7ff1f4067660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40099b0 tx=0x7ff1e4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f0edfeed7059f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.682+0000 7ff1f1ffb700 1 -- 172.21.15.31:0/362621831 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4009ea0 con 0x7ff1f406c630 2023-10-09T06:26:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.682+0000 7ff1f1ffb700 1 -- 172.21.15.31:0/362621831 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e400b860 con 0x7ff1f406c630 2023-10-09T06:26:10.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.682+0000 7ff1f1ffb700 1 -- 172.21.15.31:0/362621831 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e400bc00 con 0x7ff1f406c630 2023-10-09T06:26:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.683+0000 7ff1f9652700 1 -- 172.21.15.31:0/362621831 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1f406c630 msgr2=0x7ff1f4067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.683+0000 7ff1f9652700 1 --2- 172.21.15.31:0/362621831 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1f406c630 0x7ff1f4067660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40099b0 tx=0x7ff1e4009250 comp rx=0 tx=0).stop 2023-10-09T06:26:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.683+0000 7ff1f9652700 1 -- 172.21.15.31:0/362621831 shutdown_connections 2023-10-09T06:26:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.683+0000 7ff1f9652700 1 --2- 172.21.15.31:0/362621831 >> v2:172.21.15.158:3300/0 conn(0x7ff1f4067ba0 0x7ff1f4159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.683+0000 7ff1f9652700 1 --2- 172.21.15.31:0/362621831 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1f406c630 0x7ff1f4067660 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.683+0000 7ff1f9652700 1 -- 172.21.15.31:0/362621831 >> 172.21.15.31:0/362621831 conn(0x7ff1f406fe50 msgr2=0x7ff1f4069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.683+0000 7ff1f9652700 1 -- 172.21.15.31:0/362621831 shutdown_connections 2023-10-09T06:26:10.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.683+0000 7ff1f9652700 1 -- 172.21.15.31:0/362621831 wait complete. 2023-10-09T06:26:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.684+0000 7ff1f9652700 1 Processor -- start 2023-10-09T06:26:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.684+0000 7ff1f9652700 1 -- start start 2023-10-09T06:26:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.685+0000 7ff1f9652700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1f4067ba0 0x7ff1f40ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.685+0000 7ff1f9652700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1f406c630 0x7ff1f416e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.685+0000 7ff1f9652700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f40b0890 0x7ff1f4150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.685+0000 7ff1f9652700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40ac190 con 0x7ff1f40b0890 2023-10-09T06:26:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.685+0000 7ff1f9652700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40b2c60 con 0x7ff1f406c630 2023-10-09T06:26:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.685+0000 7ff1f9652700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f416e630 con 0x7ff1f4067ba0 2023-10-09T06:26:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.685+0000 7ff1f37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f40b0890 0x7ff1f4150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.685+0000 7ff1f37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f40b0890 0x7ff1f4150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50572/0 (socket says 172.21.15.31:50572) 2023-10-09T06:26:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.685+0000 7ff1f37fe700 1 -- 172.21.15.31:0/3489314551 learned_addr learned my addr 172.21.15.31:0/3489314551 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:10.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.685+0000 7ff1f2ffd700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1f4067ba0 0x7ff1f40ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.685+0000 7ff1f27fc700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1f406c630 0x7ff1f416e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.685+0000 7ff1f37fe700 1 -- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1f4067ba0 msgr2=0x7ff1f40ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.686+0000 7ff1f37fe700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1f4067ba0 0x7ff1f40ab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.686+0000 7ff1f37fe700 1 -- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1f406c630 msgr2=0x7ff1f416e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.686+0000 7ff1f37fe700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1f406c630 0x7ff1f416e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.686+0000 7ff1f37fe700 1 -- 172.21.15.31:0/3489314551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e40094f0 con 0x7ff1f40b0890 2023-10-09T06:26:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.686+0000 7ff1f37fe700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f40b0890 0x7ff1f4150ff0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009e90 tx=0x7ff1ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.686+0000 7ff1eaffd700 1 -- 172.21.15.31:0/3489314551 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec00cb70 con 0x7ff1f40b0890 2023-10-09T06:26:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.686+0000 7ff1eaffd700 1 -- 172.21.15.31:0/3489314551 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ec00f040 con 0x7ff1f40b0890 2023-10-09T06:26:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.686+0000 7ff1eaffd700 1 -- 172.21.15.31:0/3489314551 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec014480 con 0x7ff1f40b0890 2023-10-09T06:26:10.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.686+0000 7ff1f9652700 1 -- 172.21.15.31:0/3489314551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f40abbd0 con 0x7ff1f40b0890 2023-10-09T06:26:10.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.686+0000 7ff1f9652700 1 -- 172.21.15.31:0/3489314551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f40b2e70 con 0x7ff1f40b0890 2023-10-09T06:26:10.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.687+0000 7ff1f9652700 1 -- 172.21.15.31:0/3489314551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f404c3c0 con 0x7ff1f40b0890 2023-10-09T06:26:10.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.687+0000 7ff1eaffd700 1 -- 172.21.15.31:0/3489314551 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1ec014830 con 0x7ff1f40b0890 2023-10-09T06:26:10.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.688+0000 7ff1eaffd700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff1d4066f30 0x7ff1d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:10.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.688+0000 7ff1eaffd700 1 -- 172.21.15.31:0/3489314551 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1ec084f00 con 0x7ff1f40b0890 2023-10-09T06:26:10.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.688+0000 7ff1eaffd700 1 -- 172.21.15.31:0/3489314551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=105}) v3 -- 0x7ff1d406ea50 con 0x7ff1f40b0890 2023-10-09T06:26:10.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.688+0000 7ff1f2ffd700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff1d4066f30 0x7ff1d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:10.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.688+0000 7ff1f2ffd700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff1d4066f30 0x7ff1d40693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0039b0 tx=0x7ff1dc007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:10.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.692+0000 7ff1eaffd700 1 -- 172.21.15.31:0/3489314551 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1ec052170 con 0x7ff1f40b0890 2023-10-09T06:26:10.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.887+0000 7ff1f9652700 1 -- 172.21.15.31:0/3489314551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff1f406cdc0 con 0x7ff1f40b0890 2023-10-09T06:26:10.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.888+0000 7ff1eaffd700 1 -- 172.21.15.31:0/3489314551 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v104) v1 ==== 81+0+32378 (secure 0 0 0) 0x7ff1ec018070 con 0x7ff1f40b0890 2023-10-09T06:26:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:10.888 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:26:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 104, 2023-10-09T06:26:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:26:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:26:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:26:09.923450+0000", 2023-10-09T06:26:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:26:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:26:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:26:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:26:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:26:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:26:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:26:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:26:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:26:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:26:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:26:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:26:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:26:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:26:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 13, 2023-10-09T06:26:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:26:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:26:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:26:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:26:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:26:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:26:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:26:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:26:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:26:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:26:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:26:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:26:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:26:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:26:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:26:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "102", 2023-10-09T06:26:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:26:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:26:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:26:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 12, 2023-10-09T06:26:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:26:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:46.157560+0000", 2023-10-09T06:26:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:26:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:26:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:26:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:26:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:26:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:26:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:26:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "102", 2023-10-09T06:26:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:26:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:26:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:26:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:26:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 13, 2023-10-09T06:26:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:26:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:47.220698+0000", 2023-10-09T06:26:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:26:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:26:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:26:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:26:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:26:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:26:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:26:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "102", 2023-10-09T06:26:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:26:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:26:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:26:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:26:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:26:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:26:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:26:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:26:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:26:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:26:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:26:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:26:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:26:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:26:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:26:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:26:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:26:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:26:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:26:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:26:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:26:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:26:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:26:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:26:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:26:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:26:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:26:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:26:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:10.927 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:10.927 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:10.927 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:10.927 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:10.927 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.927 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.927 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:26:10.927 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:10.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.927 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.928 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:26:10.928 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:10.928 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.928 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.928 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:10.928 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.928 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.928 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:26:10.928 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:10.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:26:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:26:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:26:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:26:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:26:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:26:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:26:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:26:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:26:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:26:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:26:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:26:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:26:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:26:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:26:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:26:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:26:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:26:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:26:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:26:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:26:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:26:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:26:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:26:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:26:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:26:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:26:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:26:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:26:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:26:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:26:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:26:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:26:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:26:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:26:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:26:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:26:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:26:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:26:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:26:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:26:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:26:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:26:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:26:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:26:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:26:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:26:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:26:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:26:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:26:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:26:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:26:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:26:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:26:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:26:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:26:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:26:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:10.960 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:10.960 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:10.960 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:10.960 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:10.960 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:10.960 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:10.960 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:10.960 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:10.960 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:10.960 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:10.960 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:26:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:26:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:26:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:26:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:26:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:26:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:26:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:26:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:26:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:26:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:26:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:26:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:26:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:26:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:26:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:26:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:26:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:26:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:26:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:26:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:26:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:26:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:26:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:26:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:26:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:26:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:26:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:26:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:26:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:26:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:26:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:26:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:26:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:26:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:26:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:26:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:26:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:26:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:26:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:26:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:26:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:26:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:26:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:26:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:26:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:10.984 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:26:10.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.890+0000 7ff1f9652700 1 -- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff1d4066f30 msgr2=0x7ff1d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:10.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.890+0000 7ff1f9652700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff1d4066f30 0x7ff1d40693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0039b0 tx=0x7ff1dc007ec0 comp rx=0 tx=0).stop 2023-10-09T06:26:10.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.890+0000 7ff1f9652700 1 -- 172.21.15.31:0/3489314551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f40b0890 msgr2=0x7ff1f4150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:10.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.890+0000 7ff1f9652700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f40b0890 0x7ff1f4150ff0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009e90 tx=0x7ff1ec00b040 comp rx=0 tx=0).stop 2023-10-09T06:26:10.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.890+0000 7ff1f9652700 1 -- 172.21.15.31:0/3489314551 shutdown_connections 2023-10-09T06:26:10.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.890+0000 7ff1f9652700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff1d4066f30 0x7ff1d40693e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:10.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.890+0000 7ff1f9652700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff1f4067ba0 0x7ff1f40ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:10.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.890+0000 7ff1f9652700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f40b0890 0x7ff1f4150ff0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:10.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.890+0000 7ff1f9652700 1 --2- 172.21.15.31:0/3489314551 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1f406c630 0x7ff1f416e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:10.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.890+0000 7ff1f9652700 1 -- 172.21.15.31:0/3489314551 >> 172.21.15.31:0/3489314551 conn(0x7ff1f406fe50 msgr2=0x7ff1f415c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:10.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.890+0000 7ff1f9652700 1 -- 172.21.15.31:0/3489314551 shutdown_connections 2023-10-09T06:26:10.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:10.890+0000 7ff1f9652700 1 -- 172.21.15.31:0/3489314551 wait complete. 2023-10-09T06:26:10.988 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-09T06:26:10.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:10.988 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-09T06:26:11.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:26:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-09T06:26:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records in 2023-10-09T06:26:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records out 2023-10-09T06:26:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.232184 s, 226 MB/s 2023-10-09T06:26:11.242 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:26:11.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.361+0000 7f378a48a700 1 Processor -- start 2023-10-09T06:26:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.361+0000 7f378a48a700 1 -- start start 2023-10-09T06:26:11.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f378a48a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f37840a79f0 0x7f378406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:11.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f378a48a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f37840b15e0 0x7f378406eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:11.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f378a48a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37840b26d0 con 0x7f37840a7dc0 2023-10-09T06:26:11.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f378a48a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37840aeab0 con 0x7f37840b15e0 2023-10-09T06:26:11.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f378a48a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37840b2b60 con 0x7f37840a79f0 2023-10-09T06:26:11.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f3788a27700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f37840a7dc0 0x7f378415dae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42618/0 (socket says 172.21.15.31:42618) 2023-10-09T06:26:11.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f37837fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f37840b15e0 0x7f378406eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:11.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f3788a27700 1 -- 172.21.15.31:0/2435325388 learned_addr learned my addr 172.21.15.31:0/2435325388 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:11.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f3783fff700 1 --2- 172.21.15.31:0/2435325388 >> v2:172.21.15.158:3300/0 conn(0x7f37840a79f0 0x7f378406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:11.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f37837fe700 1 -- 172.21.15.31:0/2435325388 >> v2:172.21.15.158:3300/0 conn(0x7f37840a79f0 msgr2=0x7f378406eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:11.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f37837fe700 1 --2- 172.21.15.31:0/2435325388 >> v2:172.21.15.158:3300/0 conn(0x7f37840a79f0 0x7f378406eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f37837fe700 1 -- 172.21.15.31:0/2435325388 >> v1:172.21.15.31:6789/0 conn(0x7f37840a7dc0 legacy=0x7f378415dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:11.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f37837fe700 1 -- 172.21.15.31:0/2435325388 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840b1ac0 con 0x7f37840b15e0 2023-10-09T06:26:11.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f3782ffd700 1 -- 172.21.15.31:0/2435325388 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969122210 0 0) 0x7f37840b26d0 con 0x7f37840a7dc0 2023-10-09T06:26:11.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f37837fe700 1 --2- 172.21.15.31:0/2435325388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37840b15e0 0x7f378406eff0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f378406c5e0 tx=0x7f37780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28ed1867283ccd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:11.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.362+0000 7f3782ffd700 1 -- 172.21.15.31:0/2435325388 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800b6b0 con 0x7f37840b15e0 2023-10-09T06:26:11.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.363+0000 7f3782ffd700 1 -- 172.21.15.31:0/2435325388 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800b810 con 0x7f37840b15e0 2023-10-09T06:26:11.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.363+0000 7f3782ffd700 1 -- 172.21.15.31:0/2435325388 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800bbb0 con 0x7f37840b15e0 2023-10-09T06:26:11.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.363+0000 7f378a48a700 1 -- 172.21.15.31:0/2435325388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37840b15e0 msgr2=0x7f378406eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:11.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.363+0000 7f378a48a700 1 --2- 172.21.15.31:0/2435325388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37840b15e0 0x7f378406eff0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f378406c5e0 tx=0x7f37780091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.363+0000 7f378a48a700 1 -- 172.21.15.31:0/2435325388 shutdown_connections 2023-10-09T06:26:11.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.363+0000 7f378a48a700 1 --2- 172.21.15.31:0/2435325388 >> v2:172.21.15.158:3300/0 conn(0x7f37840a79f0 0x7f378406eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.363+0000 7f378a48a700 1 --2- 172.21.15.31:0/2435325388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37840b15e0 0x7f378406eff0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.363+0000 7f378a48a700 1 -- 172.21.15.31:0/2435325388 >> 172.21.15.31:0/2435325388 conn(0x7f37840cd1e0 msgr2=0x7f37840cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:11.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.363+0000 7f378a48a700 1 -- 172.21.15.31:0/2435325388 shutdown_connections 2023-10-09T06:26:11.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.363+0000 7f378a48a700 1 -- 172.21.15.31:0/2435325388 wait complete. 2023-10-09T06:26:11.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.364+0000 7f378a48a700 1 Processor -- start 2023-10-09T06:26:11.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.364+0000 7f378a48a700 1 -- start start 2023-10-09T06:26:11.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.365+0000 7f378a48a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37840a79f0 0x7f3784158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:11.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.365+0000 7f378a48a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37840a7dc0 0x7f3784099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:11.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.365+0000 7f378a48a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37840b15e0 0x7f378415c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:11.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.365+0000 7f378a48a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37840c20b0 con 0x7f37840b15e0 2023-10-09T06:26:11.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.365+0000 7f378a48a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378409a300 con 0x7f37840a79f0 2023-10-09T06:26:11.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.365+0000 7f378a48a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378409a5e0 con 0x7f37840a7dc0 2023-10-09T06:26:11.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.365+0000 7f3788a27700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37840b15e0 0x7f378415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:11.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.365+0000 7f3788a27700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37840b15e0 0x7f378415c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50592/0 (socket says 172.21.15.31:50592) 2023-10-09T06:26:11.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.365+0000 7f3788a27700 1 -- 172.21.15.31:0/247829227 learned_addr learned my addr 172.21.15.31:0/247829227 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.365+0000 7f3788a27700 1 -- 172.21.15.31:0/247829227 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37840a7dc0 msgr2=0x7f3784099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.365+0000 7f3788a27700 1 --2- 172.21.15.31:0/247829227 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37840a7dc0 0x7f3784099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.365+0000 7f3783fff700 1 --2- 172.21.15.31:0/247829227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37840a79f0 0x7f3784158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.365+0000 7f3788a27700 1 -- 172.21.15.31:0/247829227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37840a79f0 msgr2=0x7f3784158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.366+0000 7f3788a27700 1 --2- 172.21.15.31:0/247829227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37840a79f0 0x7f3784158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.366+0000 7f3788a27700 1 -- 172.21.15.31:0/247829227 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778009420 con 0x7f37840b15e0 2023-10-09T06:26:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.366+0000 7f3788a27700 1 --2- 172.21.15.31:0/247829227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37840b15e0 0x7f378415c880 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f377c00cc90 tx=0x7f377c001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.366+0000 7f376bfff700 1 -- 172.21.15.31:0/247829227 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c00cea0 con 0x7f37840b15e0 2023-10-09T06:26:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.366+0000 7f376bfff700 1 -- 172.21.15.31:0/247829227 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c00ab70 con 0x7f37840b15e0 2023-10-09T06:26:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.366+0000 7f378a48a700 1 -- 172.21.15.31:0/247829227 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378409a8c0 con 0x7f37840b15e0 2023-10-09T06:26:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.366+0000 7f376bfff700 1 -- 172.21.15.31:0/247829227 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0070f0 con 0x7f37840b15e0 2023-10-09T06:26:11.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.366+0000 7f378a48a700 1 -- 172.21.15.31:0/247829227 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3784099f80 con 0x7f37840b15e0 2023-10-09T06:26:11.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.367+0000 7f378a48a700 1 -- 172.21.15.31:0/247829227 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37840c2220 con 0x7f37840b15e0 2023-10-09T06:26:11.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.367+0000 7f376bfff700 1 -- 172.21.15.31:0/247829227 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f377c0074e0 con 0x7f37840b15e0 2023-10-09T06:26:11.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.368+0000 7f376bfff700 1 --2- 172.21.15.31:0/247829227 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3770066f30 0x7f37700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:11.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.368+0000 7f376bfff700 1 -- 172.21.15.31:0/247829227 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f377c084980 con 0x7f37840b15e0 2023-10-09T06:26:11.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.368+0000 7f376bfff700 1 -- 172.21.15.31:0/247829227 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=106}) v3 -- 0x7f377006ea50 con 0x7f37840b15e0 2023-10-09T06:26:11.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.368+0000 7f3783fff700 1 --2- 172.21.15.31:0/247829227 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3770066f30 0x7f37700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:11.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.369+0000 7f3783fff700 1 --2- 172.21.15.31:0/247829227 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3770066f30 0x7f37700693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3774006fd0 tx=0x7f3774008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:11.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.372+0000 7f376bfff700 1 -- 172.21.15.31:0/247829227 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37840c2220 con 0x7f37840b15e0 2023-10-09T06:26:11.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.566+0000 7f378a48a700 1 -- 172.21.15.31:0/247829227 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f37840c21f0 con 0x7f37840b15e0 2023-10-09T06:26:11.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.567+0000 7f376bfff700 1 -- 172.21.15.31:0/247829227 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v105) v1 ==== 81+0+32410 (secure 0 0 0) 0x7f377c051c70 con 0x7f37840b15e0 2023-10-09T06:26:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:11.567 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:26:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 105, 2023-10-09T06:26:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:26:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:26:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:26:10.929535+0000", 2023-10-09T06:26:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:26:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:26:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:26:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:26:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:26:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:26:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:26:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:26:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:26:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:26:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:26:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:26:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:26:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:26:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 13, 2023-10-09T06:26:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:26:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:26:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:26:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:26:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:26:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:26:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:26:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:26:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:26:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:26:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:26:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:26:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:26:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:26:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:26:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "102", 2023-10-09T06:26:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:26:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:26:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:26:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 12, 2023-10-09T06:26:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:26:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:46.157560+0000", 2023-10-09T06:26:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:26:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:26:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:26:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:26:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:26:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:26:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:26:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "102", 2023-10-09T06:26:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:26:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:26:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:26:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:26:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 13, 2023-10-09T06:26:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:26:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:47.220698+0000", 2023-10-09T06:26:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:26:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:26:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:26:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:26:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:26:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:26:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:26:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "102", 2023-10-09T06:26:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:26:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:26:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:26:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:26:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:26:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:26:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:26:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:26:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:26:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:26:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:26:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:26:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:26:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:26:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:26:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:26:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:26:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:26:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:26:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:26:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:26:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:26:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:26:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:26:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:26:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:26:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:26:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:26:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:26:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:26:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:26:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:26:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:26:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:26:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:26:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:26:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:11.611 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.611 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.611 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:26:11.611 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:26:11.611 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:26:11.611 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:26:11.611 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:11.611 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:11.611 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:11.611 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:11.611 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.612 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:11.612 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:11.612 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:11.612 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:11.612 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:11.612 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:11.612 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:11.612 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:11.612 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:11.612 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:11.613 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:11.613 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:11.613 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:11.613 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.613 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.613 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:26:11.613 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:11.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.613 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.614 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:26:11.614 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:11.614 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.614 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.614 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:11.614 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.614 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.614 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:26:11.614 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.616 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:26:11.616 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:11.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.616 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.616 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:26:11.616 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:11.616 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.616 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.616 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:11.617 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.617 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.617 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:26:11.617 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:11.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.617 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.617 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:26:11.617 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:11.617 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.617 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.618 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:26:11.618 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:26:11.618 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:26:11.618 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:26:11.618 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:11.618 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:11.618 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:11.618 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.618 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:11.619 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:11.619 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:11.619 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:11.619 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:11.619 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:11.619 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:11.619 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:11.619 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:11.619 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:11.619 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:11.620 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:11.620 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:11.620 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.620 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.620 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:26:11.620 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:11.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.620 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.620 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:26:11.620 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:11.621 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.621 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.621 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:11.621 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.621 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.621 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:26:11.621 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:11.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.622 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.622 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:26:11.622 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:11.622 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.622 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.622 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:11.622 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.622 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.622 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:26:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:26:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.624 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.624 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:26:11.624 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:11.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.624 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.624 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:26:11.624 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:11.624 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.624 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.625 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:26:11.625 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:26:11.625 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:26:11.625 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:26:11.625 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:11.625 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:11.625 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:11.625 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:11.625 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.625 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:11.626 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:11.626 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:11.626 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:11.626 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:11.626 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:11.626 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:11.626 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:11.626 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:11.626 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:11.626 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:11.626 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:11.627 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:11.627 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.627 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.627 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:26:11.627 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:11.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.627 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.627 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:26:11.627 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:11.627 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.628 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.628 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:11.628 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.628 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.628 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:26:11.628 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:11.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.628 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.628 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:26:11.629 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:11.629 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.629 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.629 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:11.629 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.629 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.629 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:26:11.629 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:11.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.630 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.630 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:26:11.630 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:11.630 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.630 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.630 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:11.630 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.630 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.630 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:26:11.630 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:11.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.631 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.631 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:26:11.631 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:11.631 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.631 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.631 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:26:11.631 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:26:11.631 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:26:11.632 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:26:11.632 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:11.632 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:11.632 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:11.632 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.632 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:11.632 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:11.632 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:11.632 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:11.633 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:11.633 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:11.633 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:11.633 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:11.633 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:11.633 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:11.633 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:11.633 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:11.633 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:11.633 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.633 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.633 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:26:11.634 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:11.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.634 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.634 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:26:11.634 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:11.634 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.634 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.634 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:11.634 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.635 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.635 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:26:11.635 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:11.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.635 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.635 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:26:11.635 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:11.635 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.635 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.636 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:11.636 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.636 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.636 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:26:11.636 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:11.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.636 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.636 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:26:11.636 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:11.637 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.637 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.637 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:11.637 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.637 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.637 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:26:11.637 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:11.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.638 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.638 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:26:11.638 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:11.638 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.638 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.638 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:26:11.638 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:26:11.638 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:26:11.638 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:26:11.638 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:11.639 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:11.639 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:11.639 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:11.639 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.639 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:11.639 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:11.639 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:11.639 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:11.639 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:11.640 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:11.640 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:11.640 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:11.640 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:11.640 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:11.640 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:11.640 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:11.640 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:11.640 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.641 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.641 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:26:11.641 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:11.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.641 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.641 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:26:11.641 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:11.641 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.641 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.641 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:11.642 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.642 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.642 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:26:11.642 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:11.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.642 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.642 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:26:11.642 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:11.642 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.643 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.643 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:11.643 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.643 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.643 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:26:11.643 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:11.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.643 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:26:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:26:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.645 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:11.645 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:26:11.645 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:11.645 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.645 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.645 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:26:11.645 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:26:11.645 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:26:11.645 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:26:11.645 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:11.646 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull", 2023-10-09T06:26:11.646 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:11.646 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:11.646 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:11.646 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.646 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:11.646 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:26:11.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.646 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:11.646 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:11.646 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:11.646 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:11.647 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:11.647 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:11.647 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:26:11.647 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:11.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.647 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:11.647 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:11.647 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:11.647 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:11.647 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:11.647 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:11.648 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:26:11.648 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:11.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.648 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:11.648 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:11.648 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:11.648 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:11.648 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:11.648 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:11.648 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:26:11.649 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:11.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.649 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:11.649 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:11.649 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:11.649 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:11.649 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:11.649 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:11.649 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:26:11.649 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:11.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.650 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:11.650 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:11.650 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:11.650 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:11.650 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:11.650 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:11.650 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:26:11.650 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:11.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.651 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:11.651 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:11.651 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:11.651 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:11.651 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:11.651 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:11.651 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:26:11.651 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:11.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.651 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:11.651 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:11.652 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:11.652 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:11.652 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:11.652 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:11.652 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:26:11.652 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:11.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:11.652 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:11.652 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:11.652 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:11.652 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:11.652 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:11.653 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:11.653 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:26:11.653 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:11.653 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.653 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:11.653 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:26:11.653 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:26:11.653 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:26:11.653 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:26:11.653 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:26:11.653 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:26:11.653 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:26:11.654 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:26:11.654 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:26:11.654 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:26:11.654 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:26:11.654 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:26:11.654 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:26:11.654 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:11.654 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:26:11.654 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:26:11.654 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:26:11.654 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:26:11.655 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:26:11.655 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:26:11.655 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:26:11.655 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:26:11.655 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:26:11.655 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:26:11.655 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:26:11.655 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:11.655 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:26:11.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.569+0000 7f378a48a700 1 -- 172.21.15.31:0/247829227 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3770066f30 msgr2=0x7f37700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:11.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.569+0000 7f378a48a700 1 --2- 172.21.15.31:0/247829227 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3770066f30 0x7f37700693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3774006fd0 tx=0x7f3774008040 comp rx=0 tx=0).stop 2023-10-09T06:26:11.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.569+0000 7f378a48a700 1 -- 172.21.15.31:0/247829227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37840b15e0 msgr2=0x7f378415c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:11.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.569+0000 7f378a48a700 1 --2- 172.21.15.31:0/247829227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37840b15e0 0x7f378415c880 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f377c00cc90 tx=0x7f377c001a80 comp rx=0 tx=0).stop 2023-10-09T06:26:11.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.569+0000 7f378a48a700 1 -- 172.21.15.31:0/247829227 shutdown_connections 2023-10-09T06:26:11.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.569+0000 7f378a48a700 1 --2- 172.21.15.31:0/247829227 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3770066f30 0x7f37700693e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.569+0000 7f378a48a700 1 --2- 172.21.15.31:0/247829227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37840b15e0 0x7f378415c880 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.569+0000 7f378a48a700 1 --2- 172.21.15.31:0/247829227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37840a79f0 0x7f3784158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.569+0000 7f378a48a700 1 --2- 172.21.15.31:0/247829227 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37840a7dc0 0x7f3784099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.569+0000 7f378a48a700 1 -- 172.21.15.31:0/247829227 >> 172.21.15.31:0/247829227 conn(0x7f37840cd1e0 msgr2=0x7f37840ae330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:11.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.569+0000 7f378a48a700 1 -- 172.21.15.31:0/247829227 shutdown_connections 2023-10-09T06:26:11.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.569+0000 7f378a48a700 1 -- 172.21.15.31:0/247829227 wait complete. 2023-10-09T06:26:11.658 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:11.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.777+0000 7f0409a4d700 1 Processor -- start 2023-10-09T06:26:11.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.777+0000 7f0409a4d700 1 -- start start 2023-10-09T06:26:11.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0409a4d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04040cd6e0 0x7f04040cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:11.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0409a4d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04040cdab0 0x7f040415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:11.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0409a4d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04040cb7c0 con 0x7f040415dda0 2023-10-09T06:26:11.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0409a4d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040415e850 con 0x7f04040cdab0 2023-10-09T06:26:11.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0409a4d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04040cd030 con 0x7f04040cd6e0 2023-10-09T06:26:11.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0403fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04040cdab0 0x7f040415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:11.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0403fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04040cdab0 0x7f040415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50606/0 (socket says 172.21.15.31:50606) 2023-10-09T06:26:11.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0403fff700 1 -- 172.21.15.31:0/3440252286 learned_addr learned my addr 172.21.15.31:0/3440252286 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:11.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0408a4b700 1 --2- 172.21.15.31:0/3440252286 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04040cd6e0 0x7f04040cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:11.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0403fff700 1 -- 172.21.15.31:0/3440252286 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04040cd6e0 msgr2=0x7f04040cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:11.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0403fff700 1 --2- 172.21.15.31:0/3440252286 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04040cd6e0 0x7f04040cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0403fff700 1 -- 172.21.15.31:0/3440252286 >> v1:172.21.15.158:6789/0 conn(0x7f040415dda0 legacy=0x7f040415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:11.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0403fff700 1 -- 172.21.15.31:0/3440252286 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040415e290 con 0x7f04040cdab0 2023-10-09T06:26:11.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.778+0000 7f0408a4b700 1 --2- 172.21.15.31:0/3440252286 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04040cd6e0 0x7f04040cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:11.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.779+0000 7f0403fff700 1 --2- 172.21.15.31:0/3440252286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040cdab0 0x7f040415d860 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009f20 tx=0x7f03f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ced933f0f078530 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:11.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.779+0000 7f04037fe700 1 -- 172.21.15.31:0/3440252286 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f400e070 con 0x7f04040cdab0 2023-10-09T06:26:11.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.779+0000 7f04037fe700 1 -- 172.21.15.31:0/3440252286 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f400ba40 con 0x7f04040cdab0 2023-10-09T06:26:11.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.779+0000 7f04037fe700 1 -- 172.21.15.31:0/3440252286 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f40092e0 con 0x7f04040cdab0 2023-10-09T06:26:11.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.779+0000 7f0409a4d700 1 -- 172.21.15.31:0/3440252286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040cdab0 msgr2=0x7f040415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:11.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.779+0000 7f0409a4d700 1 --2- 172.21.15.31:0/3440252286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040cdab0 0x7f040415d860 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009f20 tx=0x7f03f4009840 comp rx=0 tx=0).stop 2023-10-09T06:26:11.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.779+0000 7f0409a4d700 1 -- 172.21.15.31:0/3440252286 shutdown_connections 2023-10-09T06:26:11.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.779+0000 7f0409a4d700 1 --2- 172.21.15.31:0/3440252286 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04040cd6e0 0x7f04040cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.779+0000 7f0409a4d700 1 --2- 172.21.15.31:0/3440252286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040cdab0 0x7f040415d860 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.779+0000 7f0409a4d700 1 -- 172.21.15.31:0/3440252286 >> 172.21.15.31:0/3440252286 conn(0x7f0404067660 msgr2=0x7f0404067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:11.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.779+0000 7f0409a4d700 1 -- 172.21.15.31:0/3440252286 shutdown_connections 2023-10-09T06:26:11.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.779+0000 7f0409a4d700 1 -- 172.21.15.31:0/3440252286 wait complete. 2023-10-09T06:26:11.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.780+0000 7f0409a4d700 1 Processor -- start 2023-10-09T06:26:11.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.781+0000 7f0409a4d700 1 -- start start 2023-10-09T06:26:11.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.781+0000 7f0409a4d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040cd6e0 0x7f0404158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:11.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.781+0000 7f0409a4d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04040cdab0 0x7f0404157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:11.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.781+0000 7f0409a4d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f040415dda0 0x7f04041557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:11.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.781+0000 7f0409a4d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040416e550 con 0x7f04040cd6e0 2023-10-09T06:26:11.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.781+0000 7f0409a4d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040416d940 con 0x7f04040cdab0 2023-10-09T06:26:11.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.781+0000 7f0409a4d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040416dc20 con 0x7f040415dda0 2023-10-09T06:26:11.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.781+0000 7f0408a4b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040cd6e0 0x7f0404158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:11.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.781+0000 7f0408a4b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040cd6e0 0x7f0404158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50614/0 (socket says 172.21.15.31:50614) 2023-10-09T06:26:11.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.781+0000 7f0408a4b700 1 -- 172.21.15.31:0/1039422796 learned_addr learned my addr 172.21.15.31:0/1039422796 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:11.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.782+0000 7f0403fff700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04040cdab0 0x7f0404157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:11.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.782+0000 7f040924c700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f040415dda0 0x7f04041557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:11.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.782+0000 7f0408a4b700 1 -- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f040415dda0 msgr2=0x7f04041557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:11.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.782+0000 7f0408a4b700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f040415dda0 0x7f04041557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.782+0000 7f0408a4b700 1 -- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04040cdab0 msgr2=0x7f0404157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:11.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.782+0000 7f0408a4b700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04040cdab0 0x7f0404157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:11.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.782+0000 7f0408a4b700 1 -- 172.21.15.31:0/1039422796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f4009ae0 con 0x7f04040cd6e0 2023-10-09T06:26:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.782+0000 7f0408a4b700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040cd6e0 0x7f0404158890 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00c850 tx=0x7f03fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.782+0000 7f0400ff9700 1 -- 172.21.15.31:0/1039422796 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc011600 con 0x7f04040cd6e0 2023-10-09T06:26:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.782+0000 7f0400ff9700 1 -- 172.21.15.31:0/1039422796 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc011760 con 0x7f04040cd6e0 2023-10-09T06:26:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.782+0000 7f0409a4d700 1 -- 172.21.15.31:0/1039422796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040416df00 con 0x7f04040cd6e0 2023-10-09T06:26:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.782+0000 7f0400ff9700 1 -- 172.21.15.31:0/1039422796 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc011b20 con 0x7f04040cd6e0 2023-10-09T06:26:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.782+0000 7f0409a4d700 1 -- 172.21.15.31:0/1039422796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0404158dd0 con 0x7f04040cd6e0 2023-10-09T06:26:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.783+0000 7f0409a4d700 1 -- 172.21.15.31:0/1039422796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040416e3a0 con 0x7f04040cd6e0 2023-10-09T06:26:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.783+0000 7f0400ff9700 1 -- 172.21.15.31:0/1039422796 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03fc018350 con 0x7f04040cd6e0 2023-10-09T06:26:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.784+0000 7f0400ff9700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f03e4066f30 0x7f03e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.784+0000 7f0400ff9700 1 -- 172.21.15.31:0/1039422796 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03fc084450 con 0x7f04040cd6e0 2023-10-09T06:26:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.784+0000 7f0400ff9700 1 -- 172.21.15.31:0/1039422796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=106}) v3 -- 0x7f03e406ea50 con 0x7f04040cd6e0 2023-10-09T06:26:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.784+0000 7f0403fff700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f03e4066f30 0x7f03e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:11.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.785+0000 7f0403fff700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f03e4066f30 0x7f03e40693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009880 tx=0x7f03f4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:11.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.788+0000 7f0400ff9700 1 -- 172.21.15.31:0/1039422796 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03fc0516c0 con 0x7f04040cd6e0 2023-10-09T06:26:11.932 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:26:11.933+0000 7fc5eaab7700 -1 log_channel(cluster) log [ERR] : Health check update: 5 full osd(s) (OSD_FULL) 2023-10-09T06:26:11.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.941+0000 7f0400ff9700 1 -- 172.21.15.31:0/1039422796 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(106..106 src has 1..106) v4 ==== 288+0+0 (secure 0 0 0) 0x7f03fc055a80 con 0x7f04040cd6e0 2023-10-09T06:26:11.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:11.941+0000 7f0400ff9700 1 -- 172.21.15.31:0/1039422796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=107}) v3 -- 0x7f03e406f3a0 con 0x7f04040cd6e0 2023-10-09T06:26:12.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.028+0000 7f0409a4d700 1 -- 172.21.15.31:0/1039422796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f040415e570 con 0x7f04040cd6e0 2023-10-09T06:26:12.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.029+0000 7f0400ff9700 1 -- 172.21.15.31:0/1039422796 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f03fc01e060 con 0x7f04040cd6e0 2023-10-09T06:26:12.029 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:12.029 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2694953357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2694953357},{"type":"v1","addr":"172.21.15.158:6836","nonce":2694953357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1926052104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1926052104},{"type":"v1","addr":"172.21.15.31:6834","nonce":1926052104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3700277268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3700277268},{"type":"v1","addr":"172.21.15.31:6835","nonce":3700277268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:25:48.239748+0000","modified":"2023-10-09T06:25:51.874363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/3699283833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3699283833},{"type":"v1","addr":"172.21.15.158:6837","nonce":3699283833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T06:26:12.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.031+0000 7f0409a4d700 1 -- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f03e4066f30 msgr2=0x7f03e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:12.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.031+0000 7f0409a4d700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f03e4066f30 0x7f03e40693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009880 tx=0x7f03f4017000 comp rx=0 tx=0).stop 2023-10-09T06:26:12.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.031+0000 7f0409a4d700 1 -- 172.21.15.31:0/1039422796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040cd6e0 msgr2=0x7f0404158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:12.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.031+0000 7f0409a4d700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040cd6e0 0x7f0404158890 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00c850 tx=0x7f03fc008040 comp rx=0 tx=0).stop 2023-10-09T06:26:12.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.031+0000 7f0409a4d700 1 -- 172.21.15.31:0/1039422796 shutdown_connections 2023-10-09T06:26:12.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.031+0000 7f0409a4d700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f03e4066f30 0x7f03e40693e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.031+0000 7f0409a4d700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f040415dda0 0x7f04041557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.031+0000 7f0409a4d700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040cd6e0 0x7f0404158890 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.031+0000 7f0409a4d700 1 --2- 172.21.15.31:0/1039422796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04040cdab0 0x7f0404157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.031+0000 7f0409a4d700 1 -- 172.21.15.31:0/1039422796 >> 172.21.15.31:0/1039422796 conn(0x7f0404067660 msgr2=0x7f04040c6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:12.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.031+0000 7f0409a4d700 1 -- 172.21.15.31:0/1039422796 shutdown_connections 2023-10-09T06:26:12.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.031+0000 7f0409a4d700 1 -- 172.21.15.31:0/1039422796 wait complete. 2023-10-09T06:26:12.032 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 50 2023-10-09T06:26:12.043 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-09T06:26:12.188 INFO:teuthology.orchestra.run.smithi158.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":6279,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":23.314488970999999,"mdsmap_epoch":50,"osdmap_epoch":106,"osdmap_epoch_barrier":105,"uptime":29.247469454000001} 2023-10-09T06:26:12.188 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 6279, "mdsmap_epoch": 50, "osdmap_epoch": 106, "osdmap_epoch_barrier": 105, "rank_uptime": 23.314488971, "state": "up:active", "uptime": 29.247469454, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:26:12.188 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T06:26:12.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:12.189 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T06:26:12.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:26:12.204 INFO:teuthology.orchestra.run.smithi031.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-09T06:26:12.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:12.205 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-09T06:26:12.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:12.262 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-09T06:26:12.340 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:26:12.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.499+0000 7f957ba6d700 1 Processor -- start 2023-10-09T06:26:12.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.499+0000 7f957ba6d700 1 -- start start 2023-10-09T06:26:12.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f957ba6d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95741510f0 0x7f957406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:12.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f957ba6d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95740c9af0 0x7f957415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:12.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f957ba6d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9574070700 0x7f9574070b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:12.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f957ba6d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9574071080 con 0x7f95740c9af0 2023-10-09T06:26:12.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f957ba6d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957415e280 con 0x7f9574070700 2023-10-09T06:26:12.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f957ba6d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95740ca0b0 con 0x7f95741510f0 2023-10-09T06:26:12.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f9579008700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95740c9af0 0x7f957415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:12.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f9579008700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95740c9af0 0x7f957415dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50624/0 (socket says 172.21.15.31:50624) 2023-10-09T06:26:12.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f9579008700 1 -- 172.21.15.31:0/1731497497 learned_addr learned my addr 172.21.15.31:0/1731497497 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:12.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f9579809700 1 --2- 172.21.15.31:0/1731497497 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95741510f0 0x7f957406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:12.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f957a00a700 1 --2- 172.21.15.31:0/1731497497 >> v2:172.21.15.158:3300/0 conn(0x7f9574070700 0x7f9574070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:12.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f9579008700 1 -- 172.21.15.31:0/1731497497 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95741510f0 msgr2=0x7f957406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:12.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f9579008700 1 --2- 172.21.15.31:0/1731497497 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95741510f0 0x7f957406ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f9579008700 1 -- 172.21.15.31:0/1731497497 >> v2:172.21.15.158:3300/0 conn(0x7f9574070700 msgr2=0x7f9574070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:12.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f9579008700 1 --2- 172.21.15.31:0/1731497497 >> v2:172.21.15.158:3300/0 conn(0x7f9574070700 0x7f9574070b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f9579008700 1 -- 172.21.15.31:0/1731497497 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9574068a10 con 0x7f95740c9af0 2023-10-09T06:26:12.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f957a00a700 1 --2- 172.21.15.31:0/1731497497 >> v2:172.21.15.158:3300/0 conn(0x7f9574070700 0x7f9574070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:12.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f9579008700 1 --2- 172.21.15.31:0/1731497497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95740c9af0 0x7f957415dd40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f95740c8050 tx=0x7f9568009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf554b34f426adc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:12.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f9578807700 1 -- 172.21.15.31:0/1731497497 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568009e70 con 0x7f95740c9af0 2023-10-09T06:26:12.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f9578807700 1 -- 172.21.15.31:0/1731497497 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956800b860 con 0x7f95740c9af0 2023-10-09T06:26:12.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.500+0000 7f9578807700 1 -- 172.21.15.31:0/1731497497 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800bc00 con 0x7f95740c9af0 2023-10-09T06:26:12.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.501+0000 7f957ba6d700 1 -- 172.21.15.31:0/1731497497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95740c9af0 msgr2=0x7f957415dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:12.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.501+0000 7f957ba6d700 1 --2- 172.21.15.31:0/1731497497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95740c9af0 0x7f957415dd40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f95740c8050 tx=0x7f9568009250 comp rx=0 tx=0).stop 2023-10-09T06:26:12.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.501+0000 7f957ba6d700 1 -- 172.21.15.31:0/1731497497 shutdown_connections 2023-10-09T06:26:12.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.501+0000 7f957ba6d700 1 --2- 172.21.15.31:0/1731497497 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95741510f0 0x7f957406ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.501+0000 7f957ba6d700 1 --2- 172.21.15.31:0/1731497497 >> v2:172.21.15.158:3300/0 conn(0x7f9574070700 0x7f9574070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.501+0000 7f957ba6d700 1 --2- 172.21.15.31:0/1731497497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95740c9af0 0x7f957415dd40 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.501+0000 7f957ba6d700 1 -- 172.21.15.31:0/1731497497 >> 172.21.15.31:0/1731497497 conn(0x7f95740ca4f0 msgr2=0x7f95740ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:12.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.501+0000 7f957ba6d700 1 -- 172.21.15.31:0/1731497497 shutdown_connections 2023-10-09T06:26:12.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.501+0000 7f957ba6d700 1 -- 172.21.15.31:0/1731497497 wait complete. 2023-10-09T06:26:12.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.502+0000 7f957ba6d700 1 Processor -- start 2023-10-09T06:26:12.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.502+0000 7f957ba6d700 1 -- start start 2023-10-09T06:26:12.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f957ba6d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9574070700 0x7f95740c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:12.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f957ba6d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95740c9af0 0x7f95740afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:12.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f957ba6d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95741510f0 0x7f95741501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:12.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f957ba6d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95740b1200 con 0x7f9574070700 2023-10-09T06:26:12.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f957ba6d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95740c76a0 con 0x7f95741510f0 2023-10-09T06:26:12.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f957ba6d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95740c7980 con 0x7f95740c9af0 2023-10-09T06:26:12.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f9579809700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9574070700 0x7f95740c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:12.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f9579809700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9574070700 0x7f95740c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50638/0 (socket says 172.21.15.31:50638) 2023-10-09T06:26:12.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f9579809700 1 -- 172.21.15.31:0/3841676536 learned_addr learned my addr 172.21.15.31:0/3841676536 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:12.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f9579008700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95740c9af0 0x7f95740afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:12.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f957a00a700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95741510f0 0x7f95741501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:12.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f9579809700 1 -- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95740c9af0 msgr2=0x7f95740afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:12.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f9579809700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95740c9af0 0x7f95740afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f9579809700 1 -- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95741510f0 msgr2=0x7f95741501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:12.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f9579809700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95741510f0 0x7f95741501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.503+0000 7f9579809700 1 -- 172.21.15.31:0/3841676536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680094f0 con 0x7f9574070700 2023-10-09T06:26:12.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.504+0000 7f9579809700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9574070700 0x7f95740c6d50 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f956c00e930 tx=0x7f956c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:12.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.504+0000 7f9571ffb700 1 -- 172.21.15.31:0/3841676536 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c013680 con 0x7f9574070700 2023-10-09T06:26:12.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.504+0000 7f9571ffb700 1 -- 172.21.15.31:0/3841676536 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956c0137e0 con 0x7f9574070700 2023-10-09T06:26:12.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.504+0000 7f957ba6d700 1 -- 172.21.15.31:0/3841676536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95740c7c60 con 0x7f9574070700 2023-10-09T06:26:12.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.504+0000 7f9571ffb700 1 -- 172.21.15.31:0/3841676536 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c013b80 con 0x7f9574070700 2023-10-09T06:26:12.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.504+0000 7f957ba6d700 1 -- 172.21.15.31:0/3841676536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95740c7290 con 0x7f9574070700 2023-10-09T06:26:12.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.505+0000 7f957ba6d700 1 -- 172.21.15.31:0/3841676536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95740c7df0 con 0x7f9574070700 2023-10-09T06:26:12.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.505+0000 7f9571ffb700 1 -- 172.21.15.31:0/3841676536 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f956c00c3e0 con 0x7f9574070700 2023-10-09T06:26:12.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.506+0000 7f9571ffb700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9560066f30 0x7f95600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:12.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.506+0000 7f9571ffb700 1 -- 172.21.15.31:0/3841676536 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f956c0845e0 con 0x7f9574070700 2023-10-09T06:26:12.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.506+0000 7f9571ffb700 1 -- 172.21.15.31:0/3841676536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=107}) v3 -- 0x7f956006ea50 con 0x7f9574070700 2023-10-09T06:26:12.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.506+0000 7f9579008700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9560066f30 0x7f95600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:12.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.506+0000 7f9579008700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9560066f30 0x7f95600693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f95740c8050 tx=0x7f9568017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:12.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.510+0000 7f9571ffb700 1 -- 172.21.15.31:0/3841676536 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f956c051850 con 0x7f9574070700 2023-10-09T06:26:12.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.704+0000 7f957ba6d700 1 -- 172.21.15.31:0/3841676536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f957404c3c0 con 0x7f9574070700 2023-10-09T06:26:12.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.704+0000 7f9571ffb700 1 -- 172.21.15.31:0/3841676536 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) v1 ==== 81+0+32434 (secure 0 0 0) 0x7f956c054e70 con 0x7f9574070700 2023-10-09T06:26:12.704 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:12.705 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:26:12.705 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 106, 2023-10-09T06:26:12.705 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:26:12.705 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:26:12.705 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:26:11.933403+0000", 2023-10-09T06:26:12.705 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:26:12.705 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:26:12.705 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:26:12.705 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:26:12.705 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:26:12.705 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:26:12.705 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:26:12.706 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:26:12.706 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:26:12.706 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:12.706 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:26:12.706 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:26:12.706 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:26:12.706 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:26:12.706 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:26:12.706 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 13, 2023-10-09T06:26:12.706 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:26:12.706 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:26:12.706 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:26:12.707 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:26:12.707 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:26:12.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.707 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:26:12.707 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:26:12.707 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:26:12.707 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:26:12.707 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:26:12.707 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:12.707 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:12.707 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:12.707 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:12.708 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:12.708 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:12.708 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:12.708 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:12.708 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:12.708 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:12.708 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:26:12.708 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:26:12.708 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:26:12.708 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:26:12.708 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:26:12.708 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:12.709 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:12.709 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:12.709 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:12.709 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:12.709 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:12.709 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:12.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.709 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "102", 2023-10-09T06:26:12.709 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:12.709 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:12.709 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:12.709 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:12.710 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:12.710 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:12.710 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:12.710 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:12.710 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:12.710 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:12.710 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:12.710 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:12.710 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:12.710 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:12.710 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:12.710 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:12.710 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:12.711 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:12.711 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:12.711 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:12.711 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:12.711 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:12.711 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:12.711 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:12.711 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:12.711 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:12.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.711 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:12.711 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:12.712 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:12.712 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:12.712 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:12.712 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:12.712 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:12.712 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:12.712 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:12.712 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:12.712 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:12.712 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:12.712 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:26:12.712 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:26:12.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.713 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:12.713 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:26:12.713 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.713 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 12, 2023-10-09T06:26:12.713 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:26:12.713 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:46.157560+0000", 2023-10-09T06:26:12.713 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:26:12.713 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:26:12.713 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:12.713 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:12.714 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:12.714 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:12.714 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:12.714 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:12.714 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:12.714 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:12.714 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:12.714 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:12.714 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:26:12.714 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:26:12.714 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:26:12.714 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:26:12.715 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:26:12.715 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:12.715 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:12.715 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:12.715 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:12.715 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:12.715 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:12.715 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:12.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.715 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "102", 2023-10-09T06:26:12.715 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:12.715 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:12.715 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:12.716 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:12.716 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:12.716 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:12.716 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:12.716 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:12.716 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:12.716 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:12.716 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:12.716 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:12.716 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:12.716 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:12.716 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:12.717 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:12.717 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:12.717 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:12.717 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:12.717 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:12.717 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:12.717 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:12.717 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:12.717 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:12.717 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:12.718 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:12.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.718 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:12.718 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:12.718 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:12.718 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:12.718 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:12.718 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:12.718 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:12.718 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:12.718 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:12.719 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:12.719 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:12.719 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:12.719 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:26:12.719 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:26:12.719 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:26:12.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.719 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:12.719 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:12.719 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:26:12.719 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.719 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.720 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 13, 2023-10-09T06:26:12.720 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:26:12.720 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:47.220698+0000", 2023-10-09T06:26:12.720 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:26:12.720 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:26:12.720 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:12.720 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:12.720 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:12.720 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:12.720 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:12.720 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:12.721 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:12.721 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:12.721 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:12.721 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:12.721 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:26:12.721 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:26:12.721 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:26:12.721 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:26:12.721 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:26:12.721 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:12.721 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:12.721 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:12.722 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:12.722 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:12.722 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:12.722 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:12.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.722 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "102", 2023-10-09T06:26:12.722 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:12.722 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:12.722 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:12.722 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:12.722 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:12.723 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:12.723 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:12.723 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:12.723 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:12.723 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:12.723 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:12.723 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:12.723 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:12.723 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:12.723 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:12.723 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:12.723 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:26:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:26:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:26:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:26:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:26:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:26:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:26:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:26:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:12.729 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.730 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.730 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:12.730 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.730 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.730 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:26:12.730 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:12.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.730 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.730 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:26:12.731 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:12.731 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.731 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.731 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:12.731 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.731 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.731 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:26:12.731 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:12.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.731 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.732 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:26:12.732 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:12.732 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.732 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.732 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:26:12.732 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:26:12.732 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:26:12.732 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:26:12.732 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:12.732 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:12.733 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:12.733 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:12.733 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.733 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:12.733 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:12.733 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:12.733 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:12.733 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:12.733 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:12.733 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:12.734 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:12.734 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:12.734 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:12.734 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:12.734 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:12.734 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:12.734 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.734 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.734 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:26:12.734 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:12.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.735 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.735 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.735 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:26:12.735 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:12.735 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.735 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.735 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:12.735 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.735 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.735 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.735 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:26:12.736 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:12.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.736 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.736 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:26:12.736 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:12.736 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.736 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.736 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:12.736 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.736 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.737 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:26:12.737 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:12.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.737 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.737 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:26:12.737 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:12.737 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.737 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.737 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:12.738 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.738 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.738 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:26:12.738 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:12.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.738 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.738 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:26:12.738 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:12.738 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.738 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.739 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:26:12.739 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:26:12.739 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:26:12.739 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:26:12.739 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:12.739 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:12.739 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:12.739 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:12.739 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.740 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:12.740 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:12.740 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:12.740 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:12.740 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:12.740 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:12.740 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:12.740 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:12.740 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:12.740 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:12.740 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:12.740 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:12.741 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:12.741 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.741 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.741 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:26:12.741 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:12.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.741 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.741 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:26:12.741 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:12.741 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.742 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.742 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:12.742 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.742 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.742 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.742 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:26:12.742 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:12.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.742 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.742 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.742 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:26:12.743 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:12.743 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.743 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.743 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:12.743 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.743 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.743 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:26:12.743 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:12.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.744 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.744 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:26:12.744 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:12.744 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.744 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.744 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:12.744 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.744 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.744 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:26:12.745 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:12.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.745 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.745 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:26:12.745 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:12.745 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.745 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.745 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:26:12.745 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:26:12.745 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:26:12.746 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:26:12.746 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:12.746 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:12.746 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:12.746 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:12.746 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.746 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:12.746 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:12.747 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:12.747 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:12.747 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:12.747 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:12.747 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:12.747 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:12.747 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:12.747 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:12.747 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:12.747 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:12.747 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:12.747 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.748 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.748 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:26:12.748 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:12.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.748 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.748 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:26:12.748 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:12.748 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.748 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.749 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:12.749 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.749 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.749 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:26:12.749 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:12.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.749 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.749 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:26:12.749 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:12.749 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.750 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.750 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:12.750 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.750 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.750 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:26:12.750 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:12.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.750 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.750 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:26:12.751 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:12.751 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.751 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.751 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:12.751 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.751 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.751 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:26:12.751 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:12.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:26:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:26:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:26:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:26:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:26:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:12.753 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:12.753 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.753 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:12.753 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:12.753 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:12.753 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:12.753 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:12.753 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:12.753 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:12.753 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:12.754 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:12.754 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:12.754 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:12.754 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:12.754 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:12.754 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.754 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.754 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:26:12.754 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:12.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.755 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.755 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:26:12.755 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:12.755 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.755 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.755 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:12.755 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.755 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.755 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:26:12.756 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:12.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.756 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.756 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:26:12.756 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:12.756 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.756 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.756 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:12.756 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.757 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.757 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:26:12.757 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:12.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.757 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.757 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:26:12.757 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:12.757 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.757 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.758 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:12.758 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.758 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.758 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:26:12.758 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:12.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.758 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.758 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:26:12.758 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:12.758 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.759 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.759 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:26:12.759 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:26:12.759 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:26:12.759 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:26:12.759 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:12.759 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:12.759 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:12.759 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:12.759 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.760 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:12.760 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:12.760 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:12.760 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:12.760 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:12.760 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:12.760 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:12.760 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:12.760 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:12.760 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:12.760 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:12.761 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:12.761 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:12.761 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.761 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.761 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:26:12.761 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:12.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.761 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.761 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:26:12.761 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:12.762 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.762 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.762 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:12.762 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.762 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.762 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:26:12.762 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:12.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.762 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.763 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:26:12.763 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:12.763 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.763 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.763 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:12.763 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.763 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.763 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:26:12.763 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:12.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.764 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.764 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:26:12.764 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:12.764 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.764 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.764 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:12.764 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.764 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.764 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:26:12.765 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:12.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.765 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.765 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:26:12.765 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:12.765 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.765 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.765 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:26:12.765 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:26:12.765 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:26:12.765 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:26:12.766 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:12.766 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:12.766 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:12.766 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.766 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:12.766 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:12.766 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:12.766 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:12.766 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:12.767 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:12.767 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:12.767 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:12.767 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:12.767 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:12.767 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:12.767 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:12.767 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:12.767 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.767 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.767 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:26:12.768 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:12.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.768 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.768 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:26:12.768 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:12.768 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.768 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.768 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:12.768 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.768 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.769 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:26:12.769 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:12.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.769 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.769 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:26:12.769 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:12.769 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.769 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.769 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:12.769 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.770 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.770 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:26:12.770 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:12.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.770 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.770 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:26:12.770 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:12.770 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.770 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.771 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:12.771 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.771 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.771 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:26:12.771 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:12.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.771 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.771 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:26:12.771 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:12.771 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.772 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.772 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:26:12.772 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:26:12.772 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:26:12.772 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:26:12.772 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:12.772 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:12.772 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:12.772 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:12.772 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.773 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:12.773 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:12.773 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:12.773 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:12.773 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:12.773 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:12.773 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:12.773 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:12.773 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:12.773 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:12.774 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:12.774 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:12.774 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:12.774 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.774 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.774 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:26:12.774 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:12.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.774 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.775 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:26:12.775 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:12.775 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.775 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.775 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:12.775 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.775 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.775 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:26:12.775 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:12.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.776 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.776 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:26:12.776 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:12.776 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.776 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.776 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:12.776 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.776 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.776 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:26:12.777 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:12.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.777 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.777 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:26:12.777 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:12.777 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.777 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.777 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:12.777 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:12.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.777 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:12.778 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:26:12.778 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:12.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.778 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:12.778 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:26:12.778 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:12.778 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.778 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.778 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:26:12.779 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:26:12.779 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:26:12.779 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:26:12.779 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:12.779 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull", 2023-10-09T06:26:12.779 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:12.779 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:12.779 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:12.779 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.779 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:12.779 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:26:12.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.780 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:12.780 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:12.780 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:12.780 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:12.780 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:12.780 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:12.780 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:26:12.780 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:12.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.781 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:12.781 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:12.781 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:12.781 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:12.781 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:12.781 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:12.781 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:26:12.781 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:12.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.782 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:12.782 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:12.782 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:12.782 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:12.782 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:12.782 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:12.782 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:26:12.782 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:12.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.782 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:12.782 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:12.783 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:12.783 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:12.783 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:12.783 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:12.783 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:26:12.783 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:12.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.783 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:12.783 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:12.783 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:12.783 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:12.784 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:12.784 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:12.784 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:26:12.784 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:12.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.784 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:12.784 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:12.784 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:12.784 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:12.784 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:12.784 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:12.785 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:26:12.785 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:12.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.785 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:12.785 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:12.785 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:12.785 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:12.785 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:12.785 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:12.785 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:26:12.785 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:12.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:12.786 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:12.786 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:12.786 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:12.786 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:12.786 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:12.786 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:12.786 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:26:12.786 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:12.786 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.786 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:12.787 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:26:12.787 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:26:12.787 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:26:12.787 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:26:12.787 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:26:12.787 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:26:12.787 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:26:12.787 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:26:12.787 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:26:12.787 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:26:12.787 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:26:12.787 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:26:12.788 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:26:12.788 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:12.788 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:26:12.788 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:26:12.788 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:26:12.788 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:26:12.788 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:26:12.788 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:26:12.788 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:26:12.788 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:26:12.788 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:26:12.788 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:26:12.789 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:26:12.789 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:12.789 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:26:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.707+0000 7f957ba6d700 1 -- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9560066f30 msgr2=0x7f95600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:12.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.707+0000 7f957ba6d700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9560066f30 0x7f95600693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f95740c8050 tx=0x7f9568017000 comp rx=0 tx=0).stop 2023-10-09T06:26:12.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.707+0000 7f957ba6d700 1 -- 172.21.15.31:0/3841676536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9574070700 msgr2=0x7f95740c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:12.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.707+0000 7f957ba6d700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9574070700 0x7f95740c6d50 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f956c00e930 tx=0x7f956c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.707+0000 7f957ba6d700 1 -- 172.21.15.31:0/3841676536 shutdown_connections 2023-10-09T06:26:12.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.707+0000 7f957ba6d700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9560066f30 0x7f95600693e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.707+0000 7f957ba6d700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95741510f0 0x7f95741501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.707+0000 7f957ba6d700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9574070700 0x7f95740c6d50 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.707+0000 7f957ba6d700 1 --2- 172.21.15.31:0/3841676536 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f95740c9af0 0x7f95740afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:12.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.707+0000 7f957ba6d700 1 -- 172.21.15.31:0/3841676536 >> 172.21.15.31:0/3841676536 conn(0x7f95740ca4f0 msgr2=0x7f95740cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:12.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.707+0000 7f957ba6d700 1 -- 172.21.15.31:0/3841676536 shutdown_connections 2023-10-09T06:26:12.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:12.707+0000 7f957ba6d700 1 -- 172.21.15.31:0/3841676536 wait complete. 2023-10-09T06:26:12.792 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:26:17.794 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:26:17.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.938+0000 7fbd36d69700 1 Processor -- start 2023-10-09T06:26:17.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.939+0000 7fbd36d69700 1 -- start start 2023-10-09T06:26:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.939+0000 7fbd36d69700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd30159be0 0x7fbd30068db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.939+0000 7fbd36d69700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbd30159fb0 0x7fbd300ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.939+0000 7fbd36d69700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd30067800 con 0x7fbd300692f0 2023-10-09T06:26:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.939+0000 7fbd36d69700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd300701f0 con 0x7fbd30159fb0 2023-10-09T06:26:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.939+0000 7fbd36d69700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd30067ae0 con 0x7fbd30159be0 2023-10-09T06:26:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.940+0000 7fbd35566700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbd30159fb0 0x7fbd300ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.940+0000 7fbd35566700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbd30159fb0 0x7fbd300ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50642/0 (socket says 172.21.15.31:50642) 2023-10-09T06:26:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.940+0000 7fbd35566700 1 -- 172.21.15.31:0/3429399548 learned_addr learned my addr 172.21.15.31:0/3429399548 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.940+0000 7fbd35d67700 1 --2- 172.21.15.31:0/3429399548 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd30159be0 0x7fbd30068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.940+0000 7fbd35566700 1 -- 172.21.15.31:0/3429399548 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd30159be0 msgr2=0x7fbd30068db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.940+0000 7fbd35566700 1 --2- 172.21.15.31:0/3429399548 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd30159be0 0x7fbd30068db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.940+0000 7fbd35566700 1 -- 172.21.15.31:0/3429399548 >> v1:172.21.15.158:6789/0 conn(0x7fbd300692f0 legacy=0x7fbd300b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.940+0000 7fbd35566700 1 -- 172.21.15.31:0/3429399548 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30067dc0 con 0x7fbd30159fb0 2023-10-09T06:26:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.940+0000 7fbd35566700 1 --2- 172.21.15.31:0/3429399548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30159fb0 0x7fbd300ce950 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbd240099b0 tx=0x7fbd24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba99589868b56be server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.940+0000 7fbd34d65700 1 -- 172.21.15.31:0/3429399548 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2400b860 con 0x7fbd30159fb0 2023-10-09T06:26:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.940+0000 7fbd34d65700 1 -- 172.21.15.31:0/3429399548 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2400b9c0 con 0x7fbd30159fb0 2023-10-09T06:26:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.940+0000 7fbd34d65700 1 -- 172.21.15.31:0/3429399548 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2400bd60 con 0x7fbd30159fb0 2023-10-09T06:26:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.941+0000 7fbd36d69700 1 -- 172.21.15.31:0/3429399548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30159fb0 msgr2=0x7fbd300ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.941+0000 7fbd36d69700 1 --2- 172.21.15.31:0/3429399548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30159fb0 0x7fbd300ce950 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbd240099b0 tx=0x7fbd24009250 comp rx=0 tx=0).stop 2023-10-09T06:26:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.941+0000 7fbd36d69700 1 -- 172.21.15.31:0/3429399548 shutdown_connections 2023-10-09T06:26:17.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.941+0000 7fbd36d69700 1 --2- 172.21.15.31:0/3429399548 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd30159be0 0x7fbd30068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:17.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.941+0000 7fbd36d69700 1 --2- 172.21.15.31:0/3429399548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30159fb0 0x7fbd300ce950 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:17.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.941+0000 7fbd36d69700 1 -- 172.21.15.31:0/3429399548 >> 172.21.15.31:0/3429399548 conn(0x7fbd3006bc70 msgr2=0x7fbd3006c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:17.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.941+0000 7fbd36d69700 1 -- 172.21.15.31:0/3429399548 shutdown_connections 2023-10-09T06:26:17.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.941+0000 7fbd36d69700 1 -- 172.21.15.31:0/3429399548 wait complete. 2023-10-09T06:26:17.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.942+0000 7fbd36d69700 1 Processor -- start 2023-10-09T06:26:17.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.942+0000 7fbd36d69700 1 -- start start 2023-10-09T06:26:17.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd36d69700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd300692f0 0x7fbd300b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:17.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd36d69700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30159be0 0x7fbd300c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:17.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd36d69700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbd30159fb0 0x7fbd300b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:17.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd36d69700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300c7c90 con 0x7fbd30159be0 2023-10-09T06:26:17.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd36d69700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300c25c0 con 0x7fbd30159fb0 2023-10-09T06:26:17.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd36d69700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300c28a0 con 0x7fbd300692f0 2023-10-09T06:26:17.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd35566700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30159be0 0x7fbd300c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:17.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd35566700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30159be0 0x7fbd300c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50652/0 (socket says 172.21.15.31:50652) 2023-10-09T06:26:17.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd35566700 1 -- 172.21.15.31:0/1387759805 learned_addr learned my addr 172.21.15.31:0/1387759805 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:17.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd35d67700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd300692f0 0x7fbd300b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:17.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd36568700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbd30159fb0 0x7fbd300b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:17.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd35566700 1 -- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd300692f0 msgr2=0x7fbd300b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:17.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd35566700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd300692f0 0x7fbd300b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:17.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd35566700 1 -- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbd30159fb0 msgr2=0x7fbd300b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:17.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd35566700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbd30159fb0 0x7fbd300b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:17.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd35566700 1 -- 172.21.15.31:0/1387759805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240094f0 con 0x7fbd30159be0 2023-10-09T06:26:17.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd35566700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30159be0 0x7fbd300c7390 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fbd3006f9e0 tx=0x7fbd24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:17.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.943+0000 7fbd2dffb700 1 -- 172.21.15.31:0/1387759805 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24011e40 con 0x7fbd30159be0 2023-10-09T06:26:17.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.944+0000 7fbd2dffb700 1 -- 172.21.15.31:0/1387759805 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24024440 con 0x7fbd30159be0 2023-10-09T06:26:17.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.944+0000 7fbd2dffb700 1 -- 172.21.15.31:0/1387759805 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24024800 con 0x7fbd30159be0 2023-10-09T06:26:17.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.944+0000 7fbd36d69700 1 -- 172.21.15.31:0/1387759805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd300c2b80 con 0x7fbd30159be0 2023-10-09T06:26:17.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.944+0000 7fbd36d69700 1 -- 172.21.15.31:0/1387759805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd300b3e30 con 0x7fbd30159be0 2023-10-09T06:26:17.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.945+0000 7fbd36d69700 1 -- 172.21.15.31:0/1387759805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd300c2420 con 0x7fbd30159be0 2023-10-09T06:26:17.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.945+0000 7fbd2dffb700 1 -- 172.21.15.31:0/1387759805 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd2401a420 con 0x7fbd30159be0 2023-10-09T06:26:17.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.945+0000 7fbd2dffb700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbd1c066f30 0x7fbd1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:17.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.946+0000 7fbd2dffb700 1 -- 172.21.15.31:0/1387759805 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd240862a0 con 0x7fbd30159be0 2023-10-09T06:26:17.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.946+0000 7fbd2dffb700 1 -- 172.21.15.31:0/1387759805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=108}) v3 -- 0x7fbd1c06ea50 con 0x7fbd30159be0 2023-10-09T06:26:17.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.946+0000 7fbd35d67700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbd1c066f30 0x7fbd1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:17.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.946+0000 7fbd35d67700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbd1c066f30 0x7fbd1c0693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbd28007640 tx=0x7fbd28009850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:17.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:17.950+0000 7fbd2dffb700 1 -- 172.21.15.31:0/1387759805 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd300c2420 con 0x7fbd30159be0 2023-10-09T06:26:18.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.146+0000 7fbd36d69700 1 -- 172.21.15.31:0/1387759805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fbd300c23c0 con 0x7fbd30159be0 2023-10-09T06:26:18.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.147+0000 7fbd2dffb700 1 -- 172.21.15.31:0/1387759805 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v107) v1 ==== 81+0+32442 (secure 0 0 0) 0x7fbd24015070 con 0x7fbd30159be0 2023-10-09T06:26:18.147 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:18.148 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:26:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 107, 2023-10-09T06:26:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:26:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:26:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:26:15.943057+0000", 2023-10-09T06:26:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:26:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:26:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:26:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:26:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:26:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:26:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:26:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:26:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:26:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:26:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:26:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:26:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:26:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:26:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 13, 2023-10-09T06:26:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:26:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:26:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:26:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:26:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:26:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:26:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:26:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:26:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:26:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:26:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:26:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:26:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:26:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:26:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:26:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "102", 2023-10-09T06:26:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:26:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:26:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:26:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 12, 2023-10-09T06:26:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:26:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:46.157560+0000", 2023-10-09T06:26:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:26:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:26:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:26:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:26:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:26:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:26:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:26:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "102", 2023-10-09T06:26:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:18.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.162 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:18.162 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:18.162 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:18.162 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:18.162 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:18.162 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:18.162 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:18.162 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:18.162 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:18.162 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:18.163 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:18.163 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:18.163 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:26:18.163 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:26:18.163 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:26:18.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.163 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:18.163 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:18.163 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:26:18.163 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.163 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.164 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 13, 2023-10-09T06:26:18.164 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:26:18.164 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:47.220698+0000", 2023-10-09T06:26:18.164 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 3, 2023-10-09T06:26:18.164 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full", 2023-10-09T06:26:18.164 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:18.164 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:18.164 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:18.164 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:18.164 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:18.164 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:18.164 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:18.165 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:18.165 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:18.165 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:18.165 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:26:18.165 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:26:18.165 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:26:18.165 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:26:18.165 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:26:18.165 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:18.165 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:18.165 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:18.165 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:18.166 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:18.166 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:18.166 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:18.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.166 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "102", 2023-10-09T06:26:18.166 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:18.166 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:18.166 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:18.166 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:18.166 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:18.166 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:18.166 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:18.167 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:18.167 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:18.167 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:18.167 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:18.167 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:18.167 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:18.167 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:18.167 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:18.167 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:18.167 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:18.167 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:18.167 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:18.168 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:18.168 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:18.168 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:18.168 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:18.168 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:18.168 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:18.168 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:18.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.168 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:18.168 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:18.168 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:18.168 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:18.169 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:18.169 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:18.169 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:18.169 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:18.169 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:18.169 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:18.169 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:18.169 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:18.169 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:26:18.169 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:26:18.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.169 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:18.170 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:18.170 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:26:18.170 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.170 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.170 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.170 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:18.170 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:26:18.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.170 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:18.170 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:18.170 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:18.170 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:18.171 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:18.171 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:18.171 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:18.171 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:18.171 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:18.171 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:18.171 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:18.171 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:18.171 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:18.171 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:26:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:26:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:26:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:26:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.174 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.174 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:18.174 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.174 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.174 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:26:18.174 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:18.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.175 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.175 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:26:18.175 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:18.175 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.175 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.175 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:18.175 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.175 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.176 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:26:18.176 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:18.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.176 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.176 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:26:18.176 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:18.176 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.176 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.176 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:26:18.176 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:26:18.177 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:26:18.177 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:26:18.177 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:18.177 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:18.177 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:18.177 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:18.177 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.177 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:18.177 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:18.178 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:18.178 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:18.178 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:18.178 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:18.178 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:18.178 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:18.178 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:18.178 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:18.178 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:18.178 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:18.179 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:18.179 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.179 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.179 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:26:18.179 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:18.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.179 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.179 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:26:18.179 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:18.179 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.180 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.180 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:18.180 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.180 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.180 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:26:18.180 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:18.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.180 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.181 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:26:18.181 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:18.181 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.181 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.181 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:18.181 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.181 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.181 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:26:18.181 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:18.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.182 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.182 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:26:18.182 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:18.182 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.182 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.182 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:18.182 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.182 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.182 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:26:18.183 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:18.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.183 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.183 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.183 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:26:18.183 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:18.183 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.183 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.183 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:26:18.183 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:26:18.184 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:26:18.184 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:26:18.184 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:18.184 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:18.184 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:18.184 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:18.184 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.184 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:18.184 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:18.184 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:18.184 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:18.185 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:18.185 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:18.185 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:18.185 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:18.185 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:18.185 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:18.185 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:18.185 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:18.185 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:18.185 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.185 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.186 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:26:18.186 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:18.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.186 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.186 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:26:18.186 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:18.186 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.186 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.186 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:18.187 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.187 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.187 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:26:18.187 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:18.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.187 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.187 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:26:18.187 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:18.187 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.187 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.188 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:18.188 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.188 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.188 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:26:18.188 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:18.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.188 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.188 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:26:18.188 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:18.188 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.189 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.189 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:18.189 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.189 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.189 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:26:18.189 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:18.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.189 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.189 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:26:18.190 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:18.190 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.190 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.190 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:26:18.190 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:26:18.190 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:26:18.190 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:26:18.190 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:18.190 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:18.191 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:18.191 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:18.191 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.191 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:18.191 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:18.191 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:18.191 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:18.191 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:18.191 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:18.191 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:18.192 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:18.192 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:18.192 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:18.192 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:18.192 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:18.192 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:18.192 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.192 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.192 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:26:18.192 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:18.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.193 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.193 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:26:18.193 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:18.193 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.193 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.193 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:18.193 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.194 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.194 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:26:18.194 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:18.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.194 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.194 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:26:18.194 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:18.194 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.194 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.194 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:18.195 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.195 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.195 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:26:18.195 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:18.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.195 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.195 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:26:18.195 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:18.195 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.196 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.196 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:18.196 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.196 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.196 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:26:18.196 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:18.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.196 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.196 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:26:18.197 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:18.197 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.197 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.197 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:26:18.197 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:26:18.197 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:26:18.197 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:26:18.197 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:18.197 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:18.197 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:18.198 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.198 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:18.198 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:18.198 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:18.198 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:18.198 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:18.198 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:18.198 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:18.198 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:18.198 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:18.199 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:18.199 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:18.199 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:18.199 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:18.199 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.199 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.199 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:26:18.199 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:18.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.199 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.200 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:26:18.200 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:18.200 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.200 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.200 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:18.200 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.200 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.200 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:26:18.200 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:18.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.201 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.201 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:26:18.201 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:18.201 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.201 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.201 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:18.201 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.201 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.202 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:26:18.202 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:18.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.202 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.202 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:26:18.202 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:18.202 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.202 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.202 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:18.202 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.203 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.203 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:26:18.203 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:18.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.203 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.203 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:26:18.203 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:18.203 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.203 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.204 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:26:18.204 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:26:18.204 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:26:18.204 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:26:18.204 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:18.204 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull", 2023-10-09T06:26:18.204 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:18.204 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:18.204 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.205 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:18.205 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:18.205 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:18.205 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:18.205 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:18.205 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:18.205 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:18.205 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:18.205 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:18.205 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:18.205 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:18.205 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:18.206 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:18.206 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.206 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.206 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:26:18.206 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:18.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.206 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.206 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:26:18.206 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:18.207 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.207 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.207 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:18.207 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.207 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.207 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:26:18.207 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:18.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.207 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.208 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:26:18.208 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:18.208 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.208 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.208 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:18.208 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.208 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.208 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:26:18.208 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:18.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.209 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.209 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:26:18.209 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:18.209 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.209 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.209 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:18.209 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.209 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.210 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:26:18.210 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:18.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.210 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.210 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:26:18.210 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:18.210 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.210 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.210 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:26:18.211 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:26:18.211 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:26:18.211 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:26:18.211 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:18.211 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:18.211 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:18.211 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.211 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:18.211 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:18.211 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:18.212 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:18.212 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:18.212 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:18.212 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:18.212 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:18.212 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:18.212 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:18.212 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:18.212 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:18.212 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:18.212 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.213 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:26:18.213 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:18.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.213 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:26:18.213 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:18.213 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.213 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.213 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:18.214 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.214 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.214 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:26:18.214 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:18.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.214 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.214 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:26:18.214 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:18.214 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.215 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.215 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:18.215 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.215 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.215 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:26:18.215 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:18.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.215 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.215 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:26:18.216 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:18.216 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.216 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.216 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:18.216 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.216 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.216 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:26:18.216 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:18.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.217 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.217 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:26:18.217 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:18.217 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.217 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.217 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:26:18.217 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:26:18.217 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:26:18.217 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:26:18.217 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:18.217 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:18.218 INFO:teuthology.orchestra.run.smithi031.stdout: "full", 2023-10-09T06:26:18.218 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:18.218 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.218 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:18.218 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:18.218 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:18.218 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:18.218 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:18.218 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:18.219 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:18.219 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:18.219 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:18.219 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:18.219 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:18.219 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:18.219 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:18.219 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.219 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.219 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:26:18.219 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:18.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.220 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.220 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:26:18.220 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:18.220 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.220 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.220 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:18.220 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.220 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.221 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:26:18.221 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:18.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.221 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.221 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:26:18.221 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:18.221 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.221 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.221 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:18.221 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.222 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.222 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:26:18.222 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:18.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.222 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.222 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:26:18.222 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:18.222 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.222 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.223 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:18.223 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:18.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.223 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:18.223 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:26:18.223 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:18.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.223 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:18.223 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:26:18.223 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:18.224 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.224 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.224 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:26:18.224 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:26:18.224 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:26:18.224 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:26:18.224 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:18.224 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull", 2023-10-09T06:26:18.224 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:18.224 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:18.224 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:18.225 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.225 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:18.225 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:26:18.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.225 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:18.225 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:18.225 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:18.225 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:18.225 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:18.225 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:18.225 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:26:18.225 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:18.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.226 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:18.226 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:18.226 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:18.226 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:18.226 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:18.226 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:18.226 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:26:18.226 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:18.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.227 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:18.227 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:18.227 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:18.227 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:18.227 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:18.227 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:18.227 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:26:18.227 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:18.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.227 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:18.228 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:18.228 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:18.228 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:18.228 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:18.228 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:18.228 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:26:18.228 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:18.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.228 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:18.228 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:18.228 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:18.229 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:18.229 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:18.229 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:18.229 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:26:18.229 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:18.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.229 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:18.229 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:18.229 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:18.229 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:18.229 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:18.230 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:18.230 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:26:18.230 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:18.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.230 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:18.230 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:18.230 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:18.230 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:18.230 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:18.230 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:18.230 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:26:18.231 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:18.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:18.231 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:18.231 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:18.231 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:18.231 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:18.231 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:18.231 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:18.231 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:26:18.231 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:18.231 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.232 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:18.232 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:26:18.232 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:26:18.232 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:26:18.232 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:26:18.232 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:26:18.232 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:26:18.232 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:26:18.232 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:26:18.232 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:26:18.232 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:26:18.233 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:26:18.233 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:26:18.233 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:26:18.233 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:18.233 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:26:18.233 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:26:18.233 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:26:18.233 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:26:18.233 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:26:18.233 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:26:18.233 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:26:18.233 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:26:18.234 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:26:18.234 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:26:18.234 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:26:18.234 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:18.234 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:26:18.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.149+0000 7fbd36d69700 1 -- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbd1c066f30 msgr2=0x7fbd1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.149+0000 7fbd36d69700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbd1c066f30 0x7fbd1c0693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbd28007640 tx=0x7fbd28009850 comp rx=0 tx=0).stop 2023-10-09T06:26:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.149+0000 7fbd36d69700 1 -- 172.21.15.31:0/1387759805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30159be0 msgr2=0x7fbd300c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.149+0000 7fbd36d69700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30159be0 0x7fbd300c7390 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fbd3006f9e0 tx=0x7fbd24017000 comp rx=0 tx=0).stop 2023-10-09T06:26:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.149+0000 7fbd36d69700 1 -- 172.21.15.31:0/1387759805 shutdown_connections 2023-10-09T06:26:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.149+0000 7fbd36d69700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbd1c066f30 0x7fbd1c0693e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.149+0000 7fbd36d69700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbd300692f0 0x7fbd300b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.149+0000 7fbd36d69700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbd30159fb0 0x7fbd300b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.149+0000 7fbd36d69700 1 --2- 172.21.15.31:0/1387759805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30159be0 0x7fbd300c7390 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.149+0000 7fbd36d69700 1 -- 172.21.15.31:0/1387759805 >> 172.21.15.31:0/1387759805 conn(0x7fbd3006bc70 msgr2=0x7fbd300ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.149+0000 7fbd36d69700 1 -- 172.21.15.31:0/1387759805 shutdown_connections 2023-10-09T06:26:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:18.149+0000 7fbd36d69700 1 -- 172.21.15.31:0/1387759805 wait complete. 2023-10-09T06:26:18.237 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:26:19.956 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:26:19.956+0000 7fc5eaab7700 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-10-09T06:26:23.238 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:26:23.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.371+0000 7ff600529700 1 Processor -- start 2023-10-09T06:26:23.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.371+0000 7ff600529700 1 -- start start 2023-10-09T06:26:23.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.372+0000 7ff600529700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5f80b1220 0x7ff5f80c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:23.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.372+0000 7ff600529700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff5f80cb4f0 0x7ff5f80cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:23.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.372+0000 7ff600529700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f815de60 con 0x7ff5f80b0e50 2023-10-09T06:26:23.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.372+0000 7ff600529700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f80cbed0 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.372+0000 7ff600529700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f815e140 con 0x7ff5f80b1220 2023-10-09T06:26:23.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.373+0000 7ff5feac6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff5f80cb4f0 0x7ff5f80cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:23.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.373+0000 7ff5feac6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff5f80cb4f0 0x7ff5f80cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35824/0 (socket says 172.21.15.31:35824) 2023-10-09T06:26:23.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.373+0000 7ff5feac6700 1 -- 172.21.15.31:0/799439662 learned_addr learned my addr 172.21.15.31:0/799439662 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:23.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.373+0000 7ff5fdac4700 1 --2- 172.21.15.31:0/799439662 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5f80b1220 0x7ff5f80c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:23.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.373+0000 7ff5feac6700 1 -- 172.21.15.31:0/799439662 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5f80b1220 msgr2=0x7ff5f80c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:23.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.373+0000 7ff5feac6700 1 --2- 172.21.15.31:0/799439662 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5f80b1220 0x7ff5f80c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:23.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.373+0000 7ff5feac6700 1 -- 172.21.15.31:0/799439662 >> v1:172.21.15.158:6789/0 conn(0x7ff5f80b0e50 legacy=0x7ff5f806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:23.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.373+0000 7ff5feac6700 1 -- 172.21.15.31:0/799439662 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f815e420 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.373+0000 7ff5feac6700 1 --2- 172.21.15.31:0/799439662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f80cb4f0 0x7ff5f80cb990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00099b0 tx=0x7ff5f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cff64e6727c180 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:23.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.373+0000 7ff5fd2c3700 1 -- 172.21.15.31:0/799439662 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0009ea0 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.373+0000 7ff5fd2c3700 1 -- 172.21.15.31:0/799439662 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f000b860 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.373+0000 7ff5fd2c3700 1 -- 172.21.15.31:0/799439662 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f000bc20 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.374+0000 7ff600529700 1 -- 172.21.15.31:0/799439662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f80cb4f0 msgr2=0x7ff5f80cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:23.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.374+0000 7ff600529700 1 --2- 172.21.15.31:0/799439662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f80cb4f0 0x7ff5f80cb990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00099b0 tx=0x7ff5f0009250 comp rx=0 tx=0).stop 2023-10-09T06:26:23.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.374+0000 7ff600529700 1 -- 172.21.15.31:0/799439662 shutdown_connections 2023-10-09T06:26:23.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.374+0000 7ff600529700 1 --2- 172.21.15.31:0/799439662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f80cb4f0 0x7ff5f80cb990 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:23.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.374+0000 7ff600529700 1 --2- 172.21.15.31:0/799439662 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5f80b1220 0x7ff5f80c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:23.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.374+0000 7ff600529700 1 -- 172.21.15.31:0/799439662 >> 172.21.15.31:0/799439662 conn(0x7ff5f8069870 msgr2=0x7ff5f8069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:23.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.374+0000 7ff600529700 1 -- 172.21.15.31:0/799439662 shutdown_connections 2023-10-09T06:26:23.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.374+0000 7ff600529700 1 -- 172.21.15.31:0/799439662 wait complete. 2023-10-09T06:26:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.375+0000 7ff600529700 1 Processor -- start 2023-10-09T06:26:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.375+0000 7ff600529700 1 -- start start 2023-10-09T06:26:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff600529700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5f80b0e50 0x7ff5f80c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff600529700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5f80b1220 0x7ff5f8157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff600529700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f80cb4f0 0x7ff5f81583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff600529700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f815b3b0 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff600529700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80c9490 con 0x7ff5f80b0e50 2023-10-09T06:26:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff600529700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f8158a00 con 0x7ff5f80b1220 2023-10-09T06:26:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff5feac6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f80cb4f0 0x7ff5f81583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff5feac6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f80cb4f0 0x7ff5f81583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35826/0 (socket says 172.21.15.31:35826) 2023-10-09T06:26:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff5feac6700 1 -- 172.21.15.31:0/1343021552 learned_addr learned my addr 172.21.15.31:0/1343021552 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff5fdac4700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5f80b1220 0x7ff5f8157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff5fe2c5700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5f80b0e50 0x7ff5f80c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff5feac6700 1 -- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5f80b1220 msgr2=0x7ff5f8157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff5feac6700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5f80b1220 0x7ff5f8157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff5feac6700 1 -- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5f80b0e50 msgr2=0x7ff5f80c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff5feac6700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5f80b0e50 0x7ff5f80c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.376+0000 7ff5feac6700 1 -- 172.21.15.31:0/1343021552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f00094f0 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.377+0000 7ff5feac6700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f80cb4f0 0x7ff5f81583c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0006fd0 tx=0x7ff5f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.377+0000 7ff5f67fc700 1 -- 172.21.15.31:0/1343021552 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f001f070 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.377+0000 7ff5f67fc700 1 -- 172.21.15.31:0/1343021552 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f000bbe0 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.377+0000 7ff600529700 1 -- 172.21.15.31:0/1343021552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f8158ce0 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.377+0000 7ff5f67fc700 1 -- 172.21.15.31:0/1343021552 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0009ea0 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.377+0000 7ff600529700 1 -- 172.21.15.31:0/1343021552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f815b040 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.378+0000 7ff600529700 1 -- 172.21.15.31:0/1343021552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f804c3c0 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.378+0000 7ff5f67fc700 1 -- 172.21.15.31:0/1343021552 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5f0011840 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.379+0000 7ff5f67fc700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff5e4066f30 0x7ff5e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:23.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.379+0000 7ff5f67fc700 1 -- 172.21.15.31:0/1343021552 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff5f00858e0 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.379+0000 7ff5fe2c5700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff5e4066f30 0x7ff5e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:23.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.379+0000 7ff5fe2c5700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff5e4066f30 0x7ff5e40693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8007fd0 tx=0x7ff5e80016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:23.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.383+0000 7ff5f67fc700 1 -- 172.21.15.31:0/1343021552 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5f0052c80 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.575+0000 7ff600529700 1 -- 172.21.15.31:0/1343021552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff5f815b4f0 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.576+0000 7ff5f67fc700 1 -- 172.21.15.31:0/1343021552 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v109) v1 ==== 81+0+32267 (secure 0 0 0) 0x7ff5f0015090 con 0x7ff5f80cb4f0 2023-10-09T06:26:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:23.577 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:26:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 109, 2023-10-09T06:26:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:26:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:26:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:26:20.962501+0000", 2023-10-09T06:26:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:26:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:26:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:26:23.577 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:26:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:26:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:26:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:26:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:26:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:26:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:26:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:26:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:26:23.578 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:26:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:26:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 13, 2023-10-09T06:26:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:26:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:26:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:26:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:26:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:26:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:26:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:26:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:26:23.579 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:26:23.580 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:26:23.580 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:23.580 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:23.580 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:23.580 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:23.580 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:23.580 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:23.580 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:23.580 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:23.580 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:23.580 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:23.581 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:26:23.581 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:26:23.581 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:26:23.581 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:26:23.581 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:26:23.581 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:23.581 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:23.581 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:23.581 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:23.581 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:23.581 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:23.581 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:23.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.582 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:26:23.582 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:23.582 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:23.582 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:23.582 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:23.582 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:23.582 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:23.582 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:23.582 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:23.582 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:23.583 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:23.583 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:23.583 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:23.583 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:23.583 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:23.583 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:23.583 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:23.583 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:23.583 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:23.583 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:23.583 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:23.583 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:23.584 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:23.584 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:23.584 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:23.584 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:23.584 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:23.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.584 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:23.584 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:23.584 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:23.584 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:23.584 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:23.584 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:23.585 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:23.585 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:23.585 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:23.585 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:23.585 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:23.585 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:23.585 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:26:23.585 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:26:23.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.585 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:23.585 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:26:23.585 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.586 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 12, 2023-10-09T06:26:23.586 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:26:23.586 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:46.157560+0000", 2023-10-09T06:26:23.586 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:26:23.586 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:26:23.586 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:23.586 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:23.586 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:23.587 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:23.587 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:23.587 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:23.587 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:23.587 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:23.587 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:23.587 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:23.587 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:26:23.587 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:26:23.587 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:26:23.587 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:26:23.587 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:26:23.588 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:23.588 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:23.588 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:23.588 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:23.588 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:23.588 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:23.588 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:23.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.588 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:26:23.588 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:23.588 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:23.588 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:23.589 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:23.589 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:23.589 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:23.589 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:23.589 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:23.589 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:23.589 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:23.589 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:23.589 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:23.589 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:23.589 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:23.589 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:23.590 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:23.590 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:23.590 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:23.590 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:23.590 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:23.590 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:23.590 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:23.590 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:23.590 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:23.590 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:23.590 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:23.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.591 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:23.591 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:23.591 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:23.591 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:23.591 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:23.591 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:23.591 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:23.591 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:23.591 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:23.591 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:23.591 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:23.591 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:23.592 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:26:23.592 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:26:23.592 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:26:23.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.592 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:23.592 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:23.592 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:26:23.592 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.592 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.592 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 13, 2023-10-09T06:26:23.592 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:26:23.593 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:47.220698+0000", 2023-10-09T06:26:23.593 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:26:23.593 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:26:23.593 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:23.593 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:23.593 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:23.593 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:23.593 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:23.593 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:23.593 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:23.593 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:23.593 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:23.594 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:23.594 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:26:23.594 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:26:23.594 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:26:23.594 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:26:23.594 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:26:23.594 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:23.594 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:23.594 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:23.594 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:23.594 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:23.594 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:23.595 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:23.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.595 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:26:23.595 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:23.595 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:23.595 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:23.595 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:23.595 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:23.595 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:23.595 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:23.595 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:23.595 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:23.596 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:23.596 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:23.596 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:23.596 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:23.596 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:23.596 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:23.596 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:23.596 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:23.596 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:23.596 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:23.596 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:23.596 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:23.597 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:23.597 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:23.597 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:23.597 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:23.597 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:23.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.597 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:23.597 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:23.597 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:23.597 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:23.597 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:23.597 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:23.598 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:23.598 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:23.598 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:23.598 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:23.598 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:23.598 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:23.598 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:26:23.598 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:26:23.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.598 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:23.598 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:23.599 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:26:23.599 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.599 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.599 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.599 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:23.599 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:26:23.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.599 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:23.599 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:23.599 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:23.599 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:23.599 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:23.600 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:23.600 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:23.600 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:23.600 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:23.600 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:23.600 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:23.600 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:23.600 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:23.600 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.600 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.601 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:26:23.601 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:23.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.601 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.601 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:26:23.601 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:23.601 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.601 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.601 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:23.602 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.602 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.602 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:26:23.602 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:23.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.602 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.602 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:26:23.602 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:23.602 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.602 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.603 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:23.603 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.603 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.603 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:26:23.603 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:23.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.603 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.603 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:26:23.604 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:23.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.604 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.604 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:23.604 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.604 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.604 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:26:23.604 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:23.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.605 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.605 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:26:23.605 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:23.605 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.605 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.605 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:26:23.605 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:26:23.605 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:26:23.605 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:26:23.605 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:23.605 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:23.605 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:23.606 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.606 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:23.606 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:23.606 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:23.606 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:23.606 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:23.606 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:23.606 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:23.606 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:23.606 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:23.607 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:23.607 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:23.607 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:23.607 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:23.607 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.607 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.607 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:26:23.607 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:23.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.607 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.608 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:26:23.608 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:23.608 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.608 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.608 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:23.608 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.608 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.608 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:26:23.608 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:23.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.609 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.609 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:26:23.609 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:23.609 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.609 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.609 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:23.609 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.609 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.609 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:26:23.610 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:23.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.610 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.610 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:26:23.610 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:23.610 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.610 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.610 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:23.610 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.611 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.611 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:26:23.611 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:23.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.611 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.611 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:26:23.611 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:23.611 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.611 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.611 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:26:23.612 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:26:23.612 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:26:23.612 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:26:23.612 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:23.612 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:23.612 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:23.612 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.612 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:23.612 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:23.612 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:23.613 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:23.613 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:23.613 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:23.613 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:23.613 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:23.613 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:23.613 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:23.613 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:23.613 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:23.613 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:23.613 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.614 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.614 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:26:23.614 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:23.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.614 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.614 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:26:23.614 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:23.614 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.614 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.614 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:23.615 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.615 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.615 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:26:23.615 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:23.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.615 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.615 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:26:23.615 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:23.615 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.615 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.616 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:23.616 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.616 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.616 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:26:23.616 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:23.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.616 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.616 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:26:23.617 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:23.617 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.617 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.617 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:23.617 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.617 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.617 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:26:23.617 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:23.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.618 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.618 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:26:23.618 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:23.618 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.618 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.618 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:26:23.618 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:26:23.618 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:26:23.618 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:26:23.618 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:23.618 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:23.619 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:23.619 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.619 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:23.619 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:23.619 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:23.619 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:23.619 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:23.619 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:23.619 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:23.619 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:23.620 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:23.620 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:23.620 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:23.620 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:23.620 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:23.620 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.620 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.620 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:26:23.620 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:26:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.622 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:26:23.622 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:23.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.622 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.622 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:26:23.622 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:23.622 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.622 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.622 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:23.622 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.623 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.623 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:26:23.623 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:23.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.623 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.623 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:26:23.623 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:23.623 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.623 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.624 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:23.624 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.624 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.624 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:26:23.624 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:23.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.624 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.624 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:26:23.624 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:23.624 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.625 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.625 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:26:23.625 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:26:23.625 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:26:23.625 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:26:23.625 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:23.625 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:23.625 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:23.625 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.626 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:23.626 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:23.626 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:23.626 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:23.626 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:23.626 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:23.626 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:23.626 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:23.626 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:23.626 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:23.626 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:23.626 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:23.627 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:23.627 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.627 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.627 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:26:23.627 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:23.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.627 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.627 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:26:23.627 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:23.627 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.628 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.628 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:23.628 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.628 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.628 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:26:23.628 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:23.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.628 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.628 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:26:23.629 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:23.629 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.629 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.629 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:23.629 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.629 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.629 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:26:23.629 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:23.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.630 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.630 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:26:23.630 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:23.630 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.630 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.630 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:23.630 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.630 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.630 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:26:23.631 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:23.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.631 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.631 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:26:23.631 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:23.631 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.631 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.631 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:26:23.631 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:26:23.631 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:26:23.631 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:26:23.632 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:23.632 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:23.632 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:23.632 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.632 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:23.632 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:23.632 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:23.632 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:23.633 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:23.633 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:23.633 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:23.633 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:23.633 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:23.633 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:23.633 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:23.633 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:23.633 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:23.633 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.633 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.634 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:26:23.634 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:23.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.634 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.634 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:26:23.634 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:23.634 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.634 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.634 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:23.634 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.635 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.635 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:26:23.635 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:23.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.635 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.635 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:26:23.635 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:23.635 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.635 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.636 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:23.636 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.636 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.636 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:26:23.636 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:23.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.636 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.636 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:26:23.636 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:23.636 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.636 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:26:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:26:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:23.637 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.638 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.638 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:26:23.638 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:26:23.638 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:26:23.638 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:26:23.638 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:23.638 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:23.638 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:23.638 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.639 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:23.639 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:23.639 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:23.639 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:23.639 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:23.639 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:23.639 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:23.639 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:23.639 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:23.639 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:23.639 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:23.640 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:23.640 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:23.640 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.640 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.640 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:26:23.640 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:23.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.640 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.640 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:26:23.640 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:23.641 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.641 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.641 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:23.641 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.641 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.641 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:26:23.641 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:23.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.641 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.642 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:26:23.642 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:23.642 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.642 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.642 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:23.642 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.642 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.642 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:26:23.642 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:23.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.643 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.643 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:26:23.643 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:23.643 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.643 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.643 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:23.643 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.643 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.643 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:26:23.644 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:23.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.644 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.644 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:26:23.644 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:23.644 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.644 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.644 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:26:23.644 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:26:23.644 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:26:23.645 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:26:23.645 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:23.645 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:23.645 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:23.645 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.645 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:23.645 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:23.645 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:23.645 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:23.645 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:23.646 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:23.646 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:23.646 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:23.646 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:23.646 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:23.646 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:23.646 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:23.646 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:23.646 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.646 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.646 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:26:23.647 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:23.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.647 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.647 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:26:23.647 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:23.647 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.647 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.647 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:23.647 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.648 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.648 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:26:23.648 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:23.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.648 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.648 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:26:23.648 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:23.648 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.648 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.649 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:23.649 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.649 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.649 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:26:23.649 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:23.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.649 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.649 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:26:23.649 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:23.649 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.649 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.650 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:23.650 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:23.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.650 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:23.650 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:26:23.650 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:23.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.650 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:23.650 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:26:23.651 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:23.651 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.651 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.651 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:26:23.651 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:26:23.651 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:26:23.651 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:26:23.651 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:23.651 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:23.651 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:23.652 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:23.652 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.652 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:23.652 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:26:23.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.652 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:23.652 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:23.652 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:23.652 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:23.652 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:23.652 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:23.653 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:26:23.653 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:23.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.653 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:23.653 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:23.653 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:23.653 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:23.653 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:23.653 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:23.653 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:26:23.653 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:23.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.654 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:23.654 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:23.654 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:23.654 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:23.654 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:23.654 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:23.654 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:26:23.654 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:23.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.655 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:23.655 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:23.655 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:23.655 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:23.655 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:23.655 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:23.655 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:26:23.655 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:23.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.655 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:23.656 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:23.656 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:23.656 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:23.656 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:23.656 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:23.656 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:26:23.656 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:23.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.656 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:23.656 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:23.657 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:23.657 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:23.657 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:23.657 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:23.657 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:26:23.657 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:23.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.657 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:23.657 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:23.657 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:23.657 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:23.658 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:23.658 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:23.658 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:26:23.658 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:23.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.658 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:23.658 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:23.658 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:23.658 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:23.658 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:23.658 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:23.659 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:26:23.659 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:23.659 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.659 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:23.659 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:26:23.659 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:26:23.659 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:26:23.659 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:26:23.659 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:26:23.659 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:26:23.659 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:26:23.659 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:26:23.660 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:26:23.660 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:26:23.660 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:26:23.660 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:26:23.660 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:26:23.660 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.660 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:26:23.660 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:26:23.660 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:26:23.660 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:26:23.661 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:26:23.661 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:26:23.661 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:26:23.661 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:26:23.661 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:26:23.661 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:26:23.661 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:26:23.661 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:23.661 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:26:23.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.578+0000 7ff600529700 1 -- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff5e4066f30 msgr2=0x7ff5e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:23.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.578+0000 7ff600529700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff5e4066f30 0x7ff5e40693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8007fd0 tx=0x7ff5e80016f0 comp rx=0 tx=0).stop 2023-10-09T06:26:23.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.578+0000 7ff600529700 1 -- 172.21.15.31:0/1343021552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f80cb4f0 msgr2=0x7ff5f81583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:23.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.578+0000 7ff600529700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f80cb4f0 0x7ff5f81583c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0006fd0 tx=0x7ff5f0017000 comp rx=0 tx=0).stop 2023-10-09T06:26:23.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.578+0000 7ff600529700 1 -- 172.21.15.31:0/1343021552 shutdown_connections 2023-10-09T06:26:23.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.578+0000 7ff600529700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff5e4066f30 0x7ff5e40693e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:23.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.578+0000 7ff600529700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f80cb4f0 0x7ff5f81583c0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.578+0000 7ff600529700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5f80b0e50 0x7ff5f80c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.578+0000 7ff600529700 1 --2- 172.21.15.31:0/1343021552 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff5f80b1220 0x7ff5f8157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.578+0000 7ff600529700 1 -- 172.21.15.31:0/1343021552 >> 172.21.15.31:0/1343021552 conn(0x7ff5f8069870 msgr2=0x7ff5f80c5210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.578+0000 7ff600529700 1 -- 172.21.15.31:0/1343021552 shutdown_connections 2023-10-09T06:26:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.578+0000 7ff600529700 1 -- 172.21.15.31:0/1343021552 wait complete. 2023-10-09T06:26:23.664 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-09T06:26:23.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:26:23.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.783+0000 7fbc59f04700 1 Processor -- start 2023-10-09T06:26:23.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.783+0000 7fbc59f04700 1 -- start start 2023-10-09T06:26:23.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.784+0000 7fbc59f04700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc5406adb0 0x7fbc54164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:23.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.784+0000 7fbc59f04700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc540b3d40 con 0x7fbc540cffa0 2023-10-09T06:26:23.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.784+0000 7fbc59f04700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc540b4300 con 0x7fbc54159e60 2023-10-09T06:26:23.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.784+0000 7fbc59f04700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc54069d70 con 0x7fbc5406adb0 2023-10-09T06:26:23.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.784+0000 7fbc52ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbc540cffa0 0x7fbc5406a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57350/0 (socket says 172.21.15.31:57350) 2023-10-09T06:26:23.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.784+0000 7fbc52ffd700 1 -- 172.21.15.31:0/2893309226 learned_addr learned my addr 172.21.15.31:0/2893309226 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:23.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.785+0000 7fbc53fff700 1 --2- 172.21.15.31:0/2893309226 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc5406adb0 0x7fbc54164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:23.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.785+0000 7fbc527fc700 1 -- 172.21.15.31:0/2893309226 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601982293 0 0) 0x7fbc540b3d40 con 0x7fbc540cffa0 2023-10-09T06:26:23.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.785+0000 7fbc527fc700 1 -- 172.21.15.31:0/2893309226 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc3c003570 con 0x7fbc540cffa0 2023-10-09T06:26:23.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.785+0000 7fbc527fc700 1 -- 172.21.15.31:0/2893309226 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747376906 0 0) 0x7fbc540b4300 con 0x7fbc54159e60 2023-10-09T06:26:23.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.785+0000 7fbc527fc700 1 -- 172.21.15.31:0/2893309226 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc540b3d40 con 0x7fbc54159e60 2023-10-09T06:26:23.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.785+0000 7fbc53fff700 1 -- 172.21.15.31:0/2893309226 >> v1:172.21.15.158:6789/0 conn(0x7fbc54159e60 legacy=0x7fbc540b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:23.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.785+0000 7fbc53fff700 1 -- 172.21.15.31:0/2893309226 >> v1:172.21.15.31:6789/0 conn(0x7fbc540cffa0 legacy=0x7fbc5406a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:23.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.785+0000 7fbc53fff700 1 -- 172.21.15.31:0/2893309226 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc540d0480 con 0x7fbc5406adb0 2023-10-09T06:26:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.785+0000 7fbc53fff700 1 --2- 172.21.15.31:0/2893309226 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc5406adb0 0x7fbc54164ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009e90 tx=0x7fbc4c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d7d7f4f5e6d2d71 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.785+0000 7fbc527fc700 1 -- 172.21.15.31:0/2893309226 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00e070 con 0x7fbc5406adb0 2023-10-09T06:26:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.785+0000 7fbc527fc700 1 -- 172.21.15.31:0/2893309226 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c00bb80 con 0x7fbc5406adb0 2023-10-09T06:26:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.785+0000 7fbc527fc700 1 -- 172.21.15.31:0/2893309226 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c012430 con 0x7fbc5406adb0 2023-10-09T06:26:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.786+0000 7fbc59f04700 1 -- 172.21.15.31:0/2893309226 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc5406adb0 msgr2=0x7fbc54164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.786+0000 7fbc59f04700 1 --2- 172.21.15.31:0/2893309226 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc5406adb0 0x7fbc54164ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009e90 tx=0x7fbc4c009780 comp rx=0 tx=0).stop 2023-10-09T06:26:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.786+0000 7fbc59f04700 1 -- 172.21.15.31:0/2893309226 shutdown_connections 2023-10-09T06:26:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.786+0000 7fbc59f04700 1 --2- 172.21.15.31:0/2893309226 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc5406adb0 0x7fbc54164ca0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.786+0000 7fbc59f04700 1 -- 172.21.15.31:0/2893309226 >> 172.21.15.31:0/2893309226 conn(0x7fbc540d1a50 msgr2=0x7fbc54068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.786+0000 7fbc59f04700 1 -- 172.21.15.31:0/2893309226 shutdown_connections 2023-10-09T06:26:23.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.786+0000 7fbc59f04700 1 -- 172.21.15.31:0/2893309226 wait complete. 2023-10-09T06:26:23.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.787+0000 7fbc59f04700 1 Processor -- start 2023-10-09T06:26:23.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.787+0000 7fbc59f04700 1 -- start start 2023-10-09T06:26:23.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc59f04700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc5406adb0 0x7fbc5415bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:23.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc59f04700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc540cffa0 0x7fbc54154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:23.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc59f04700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc54159e60 0x7fbc540b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:23.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc59f04700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5415cbd0 con 0x7fbc5406adb0 2023-10-09T06:26:23.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc59f04700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5415c100 con 0x7fbc54159e60 2023-10-09T06:26:23.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc59f04700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc540c74b0 con 0x7fbc540cffa0 2023-10-09T06:26:23.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc5406adb0 0x7fbc5415bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:23.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc5406adb0 0x7fbc5415bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35840/0 (socket says 172.21.15.31:35840) 2023-10-09T06:26:23.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc537fe700 1 -- 172.21.15.31:0/1539444834 learned_addr learned my addr 172.21.15.31:0/1539444834 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:23.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc53fff700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc54159e60 0x7fbc540b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:23.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc52ffd700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc540cffa0 0x7fbc54154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:23.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc537fe700 1 -- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc540cffa0 msgr2=0x7fbc54154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:23.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc537fe700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc540cffa0 0x7fbc54154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:23.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc537fe700 1 -- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc54159e60 msgr2=0x7fbc540b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:23.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc537fe700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc54159e60 0x7fbc540b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:23.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc537fe700 1 -- 172.21.15.31:0/1539444834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c009a20 con 0x7fbc5406adb0 2023-10-09T06:26:23.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc53fff700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc54159e60 0x7fbc540b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:23.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc52ffd700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc540cffa0 0x7fbc54154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:23.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.788+0000 7fbc537fe700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc5406adb0 0x7fbc5415bbc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400c590 tx=0x7fbc44007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:23.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.789+0000 7fbc3b7fe700 1 -- 172.21.15.31:0/1539444834 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc44010510 con 0x7fbc5406adb0 2023-10-09T06:26:23.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.789+0000 7fbc3b7fe700 1 -- 172.21.15.31:0/1539444834 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc44010670 con 0x7fbc5406adb0 2023-10-09T06:26:23.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.789+0000 7fbc3b7fe700 1 -- 172.21.15.31:0/1539444834 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc44010a30 con 0x7fbc5406adb0 2023-10-09T06:26:23.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.789+0000 7fbc59f04700 1 -- 172.21.15.31:0/1539444834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc540c7790 con 0x7fbc5406adb0 2023-10-09T06:26:23.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.789+0000 7fbc59f04700 1 -- 172.21.15.31:0/1539444834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc540c8030 con 0x7fbc5406adb0 2023-10-09T06:26:23.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.790+0000 7fbc59f04700 1 -- 172.21.15.31:0/1539444834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5404c3c0 con 0x7fbc5406adb0 2023-10-09T06:26:23.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.790+0000 7fbc3b7fe700 1 -- 172.21.15.31:0/1539444834 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc4401b400 con 0x7fbc5406adb0 2023-10-09T06:26:23.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.790+0000 7fbc3b7fe700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbc40066f30 0x7fbc400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:23.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.791+0000 7fbc3b7fe700 1 -- 172.21.15.31:0/1539444834 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc44084140 con 0x7fbc5406adb0 2023-10-09T06:26:23.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.791+0000 7fbc52ffd700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbc40066f30 0x7fbc400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:23.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.791+0000 7fbc52ffd700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbc40066f30 0x7fbc400693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbc48007fd0 tx=0x7fbc48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:23.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.795+0000 7fbc3b7fe700 1 -- 172.21.15.31:0/1539444834 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc440513b0 con 0x7fbc5406adb0 2023-10-09T06:26:23.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.991+0000 7fbc59f04700 1 -- 172.21.15.31:0/1539444834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fbc54068770 con 0x7fbc5406adb0 2023-10-09T06:26:23.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.992+0000 7fbc3b7fe700 1 -- 172.21.15.31:0/1539444834 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v109) v1 ==== 81+0+32267 (secure 0 0 0) 0x7fbc440549d0 con 0x7fbc5406adb0 2023-10-09T06:26:23.993 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:23.993 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:26:23.993 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 109, 2023-10-09T06:26:23.993 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:26:23.993 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:26:23.993 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:26:20.962501+0000", 2023-10-09T06:26:23.993 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:26:23.993 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:26:23.993 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:26:23.993 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:26:23.994 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:26:23.994 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:26:23.994 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:26:23.994 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:26:23.994 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:26:23.994 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:23.994 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:26:23.994 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:26:23.994 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:26:23.994 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:26:23.995 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:26:23.995 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 13, 2023-10-09T06:26:23.995 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:26:23.995 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:26:23.995 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:26:23.995 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:26:23.995 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:26:23.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:23.995 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:26:23.995 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:26:23.995 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:26:23.995 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:26:23.996 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:26:23.996 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:23.996 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:23.996 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:23.996 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:23.996 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:23.996 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:23.996 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:23.996 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:23.996 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:23.996 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:23.997 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:26:23.997 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:26:23.997 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:26:23.997 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:26:23.997 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:26:23.997 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:23.997 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:23.997 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:23.997 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:23.997 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:23.997 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:23.997 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:23.998 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:23.998 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:26:23.998 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:23.998 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:23.998 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:23.998 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:23.998 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:23.998 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:23.998 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:23.998 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:23.998 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:23.999 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:23.999 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:23.999 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:23.999 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:23.999 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:23.999 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:23.999 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:23.999 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:23.999 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:23.999 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:23.999 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:24.000 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:24.000 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:24.000 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:24.000 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:24.000 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:24.000 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:24.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.000 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:24.000 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:24.000 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:24.000 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:24.001 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:24.001 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:24.001 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:24.001 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:24.001 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:24.001 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:24.001 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:24.001 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:24.001 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:26:24.001 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:26:24.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.001 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:24.002 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:26:24.002 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.002 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.002 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 12, 2023-10-09T06:26:24.002 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:26:24.002 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:46.157560+0000", 2023-10-09T06:26:24.002 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:26:24.002 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:26:24.002 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:24.003 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:24.003 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:24.003 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:24.003 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:24.003 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:24.003 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:24.003 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:24.003 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:24.003 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:24.003 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:26:24.003 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:26:24.003 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:26:24.004 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:26:24.004 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:26:24.004 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:24.004 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:24.004 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:24.004 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:24.004 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:24.004 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:24.004 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:24.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.004 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:26:24.005 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:24.005 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:24.005 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:24.005 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:24.005 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:24.005 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:24.005 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:24.005 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:24.005 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:24.005 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:24.005 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:24.006 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:24.006 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:24.006 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:24.006 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:24.006 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:24.006 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:24.006 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:24.006 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:24.006 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:24.007 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:24.007 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:24.007 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:24.007 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:24.007 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:24.007 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:24.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.007 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:24.007 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:24.007 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:24.007 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:24.007 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:24.008 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:24.008 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:24.008 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:24.008 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:24.008 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:24.008 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:24.008 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:24.008 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:26:24.008 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:26:24.008 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:26:24.008 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.008 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:24.009 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:24.009 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:26:24.009 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.009 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.009 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 13, 2023-10-09T06:26:24.009 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:26:24.009 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:25:47.220698+0000", 2023-10-09T06:26:24.009 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:26:24.009 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:26:24.010 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:26:24.010 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:26:24.010 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:26:24.010 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:26:24.010 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:26:24.010 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:26:24.010 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:26:24.010 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:26:24.010 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:26:24.010 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:26:24.010 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:26:24.010 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:26:24.011 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:26:24.011 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:26:24.011 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:26:24.011 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:26:24.011 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:26:24.011 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:26:24.011 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:26:24.011 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:26:24.011 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:26:24.011 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:26:24.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.011 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:26:24.012 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:26:24.012 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:26:24.012 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:26:24.012 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:26:24.012 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:26:24.012 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:26:24.012 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:26:24.012 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:26:24.012 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:26:24.012 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:24.017 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:24.017 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:24.017 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:24.017 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:24.017 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:24.017 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:24.017 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:24.017 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:24.017 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:24.017 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.017 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.017 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.018 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:26:24.018 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:24.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.018 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.018 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:26:24.018 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:24.018 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.018 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.018 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:24.019 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.019 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.019 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:26:24.019 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:24.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.019 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.019 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:26:24.019 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:24.019 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.020 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.020 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:24.020 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.020 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.020 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.020 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:26:24.020 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:24.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.020 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.020 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.021 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:26:24.021 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:24.021 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.021 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.021 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:24.021 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.021 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.021 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.021 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:26:24.021 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:24.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.022 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.022 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:26:24.022 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:26:24.022 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.022 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.022 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:26:24.022 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:26:24.022 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:26:24.022 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:26:24.023 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:24.023 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:24.023 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:24.023 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.023 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:24.023 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:24.023 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:24.023 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:24.023 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:24.024 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:24.024 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:24.024 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:24.024 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:24.024 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:24.024 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:24.024 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:24.024 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:24.024 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.024 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.025 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:26:24.025 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:24.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.025 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.025 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.025 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:26:24.025 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:24.025 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.025 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.025 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:24.025 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.025 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.026 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.026 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:26:24.026 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:24.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.026 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.026 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:26:24.026 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:24.026 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.026 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.027 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:24.027 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.027 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.027 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:26:24.027 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:24.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.027 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.027 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:26:24.028 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:24.028 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.028 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.028 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:24.028 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.028 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.028 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:26:24.028 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:24.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.029 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.029 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:26:24.029 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:26:24.029 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.029 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.029 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:26:24.029 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:26:24.029 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:26:24.029 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:26:24.029 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:24.030 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:24.030 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:24.030 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.030 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.030 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.030 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:24.030 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:24.030 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:24.030 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:24.030 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:24.031 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:24.031 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:24.031 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:24.031 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:24.031 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:24.031 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:24.031 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:24.031 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:24.031 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.031 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.031 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:26:24.032 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:24.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.032 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.032 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:26:24.032 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:24.032 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.032 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.032 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:24.032 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.033 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.033 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:26:24.033 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:24.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.033 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.033 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:26:24.033 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:24.033 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.033 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.034 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:24.034 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.034 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.034 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.034 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:26:24.034 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:24.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.034 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.034 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.034 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:26:24.034 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:26:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.036 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:26:24.036 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:26:24.036 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.036 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.036 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.036 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:26:24.036 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:26:24.036 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:26:24.036 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:26:24.036 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:24.036 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:24.036 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:24.037 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.037 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.037 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:24.037 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:24.037 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:24.037 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:24.037 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:24.037 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:24.037 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:24.037 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:24.037 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:24.038 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:24.038 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:24.038 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:24.038 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:24.038 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.038 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.038 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:26:24.038 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:24.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.038 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.039 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:26:24.039 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:24.039 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.039 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.039 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:24.039 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.039 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.039 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:26:24.039 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:24.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.040 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.040 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:26:24.040 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:24.040 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.040 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.040 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:24.040 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.040 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.040 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:26:24.041 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:24.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.041 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.041 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:26:24.041 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:24.041 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.041 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.041 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:24.041 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.042 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.042 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:26:24.042 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:24.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.042 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.042 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:26:24.042 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:26:24.042 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.042 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.043 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:26:24.043 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:26:24.043 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:26:24.043 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:26:24.043 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:24.043 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:24.043 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:24.043 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.043 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:24.043 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:24.044 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:24.044 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:24.044 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:24.044 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:24.044 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:24.044 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:24.044 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:24.044 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:24.044 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:24.044 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:24.044 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:24.045 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.045 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.045 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:26:24.045 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:24.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.045 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.045 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:26:24.045 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:24.045 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.046 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.046 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:24.046 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.046 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.046 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:26:24.046 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:24.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.046 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.047 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:26:24.047 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:24.047 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.047 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.047 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:24.047 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.047 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.047 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:26:24.047 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:24.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.048 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.048 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:26:24.048 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:24.048 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.048 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.048 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:24.048 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.049 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.049 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:26:24.049 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:24.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.049 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.049 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:26:24.049 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:26:24.049 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.049 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.049 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:26:24.050 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:26:24.050 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:26:24.050 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:26:24.050 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:24.050 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:24.050 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:24.050 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.050 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:24.050 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:24.050 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:24.051 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:24.051 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:24.051 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:24.051 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:24.051 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:24.051 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:24.051 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:24.051 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:24.051 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:24.051 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:24.051 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.052 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.052 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:26:24.052 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:24.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.052 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.052 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:26:24.052 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:24.052 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.052 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.053 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:24.053 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.053 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.053 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:26:24.053 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:24.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.053 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.053 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:26:24.053 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:24.054 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.054 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.054 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:24.054 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.054 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.054 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:26:24.054 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:24.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.055 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.055 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:26:24.055 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:24.055 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.055 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.055 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:24.055 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.055 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.055 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:26:24.055 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:24.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.056 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.056 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:26:24.056 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:26:24.056 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.056 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.056 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:26:24.056 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:26:24.056 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:26:24.056 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:26:24.056 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:24.057 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:24.057 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:24.057 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.057 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:24.057 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:24.057 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:24.057 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:24.057 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:24.057 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:24.058 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:24.058 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:24.058 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:24.058 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:24.058 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:24.058 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:24.058 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:24.058 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.058 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.058 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:26:24.058 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:24.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.059 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.059 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:26:24.059 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:24.059 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.059 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.059 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:24.059 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.060 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.060 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:26:24.060 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:24.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.060 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.060 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:26:24.060 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:24.060 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.060 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.061 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:24.061 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.061 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.061 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:26:24.061 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:24.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.061 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.061 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:26:24.061 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:24.062 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.062 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.062 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:24.062 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.062 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.062 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:26:24.062 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:24.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.063 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.063 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:26:24.063 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:26:24.063 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.063 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.063 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:26:24.063 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:26:24.063 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:26:24.063 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:26:24.063 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:24.064 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:24.064 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:24.064 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.064 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:24.064 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:26:24.064 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:26:24.064 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:26:24.064 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:26:24.064 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:26:24.064 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:26:24.065 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:26:24.065 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:26:24.065 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 99, 2023-10-09T06:26:24.065 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:26:24.065 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:26:24.065 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:26:24.065 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.065 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.065 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:26:24.065 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:24.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.066 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.066 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:26:24.066 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:24.066 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.066 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.066 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:26:24.066 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.066 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.067 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:26:24.067 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:24.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.067 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.067 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:26:24.067 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:24.067 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.067 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.067 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:26:24.067 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.068 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.068 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:26:24.068 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:24.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.068 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.068 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:26:24.068 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:24.068 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.068 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.069 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:26:24.069 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:26:24.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.069 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:26:24.069 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:26:24.069 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:24.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.069 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:26:24.069 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:26:24.069 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:26:24.070 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.070 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.070 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:26:24.070 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:26:24.070 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:26:24.070 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:26:24.070 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:26:24.070 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:26:24.070 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:26:24.070 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:24.071 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.071 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:24.071 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:26:24.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.071 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:26:24.071 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:24.071 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:24.071 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:24.071 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:24.071 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:24.071 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:26:24.071 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:24.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.072 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:26:24.072 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:24.072 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:24.072 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:24.072 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:24.072 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:24.072 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:26:24.072 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:24.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.073 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:26:24.073 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:24.073 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:24.073 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:24.073 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:24.073 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:24.073 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:26:24.073 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:24.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.073 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:26:24.074 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:24.074 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:24.074 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:24.074 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:24.074 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:24.074 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:26:24.074 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:24.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.074 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:26:24.074 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:24.074 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:24.075 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:24.075 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:24.075 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:24.075 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:26:24.075 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:24.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.075 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:26:24.075 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:24.075 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:24.075 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:24.076 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:24.076 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:24.076 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:26:24.076 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:24.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.076 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:26:24.076 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:24.076 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:24.076 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:24.076 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:24.076 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:24.077 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:26:24.077 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:24.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:24.077 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:26:24.077 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:26:24.077 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:26:24.077 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:26:24.077 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:26:24.077 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:26:24.077 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:26:24.077 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:26:24.078 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.078 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:26:24.078 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:26:24.078 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:26:24.078 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:26:24.078 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:26:24.078 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:26:24.078 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:26:24.078 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:26:24.078 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:26:24.078 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:26:24.078 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:26:24.079 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:26:24.079 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:26:24.079 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:26:24.079 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:24.079 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:26:24.079 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:26:24.079 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:26:24.079 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:26:24.079 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:26:24.079 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:26:24.079 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:26:24.080 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:26:24.080 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:26:24.080 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:26:24.080 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:26:24.080 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:24.080 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:26:24.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.994+0000 7fbc59f04700 1 -- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbc40066f30 msgr2=0x7fbc400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:24.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.994+0000 7fbc59f04700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbc40066f30 0x7fbc400693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbc48007fd0 tx=0x7fbc48009040 comp rx=0 tx=0).stop 2023-10-09T06:26:24.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.994+0000 7fbc59f04700 1 -- 172.21.15.31:0/1539444834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc5406adb0 msgr2=0x7fbc5415bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:24.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.994+0000 7fbc59f04700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc5406adb0 0x7fbc5415bbc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400c590 tx=0x7fbc44007dc0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.994+0000 7fbc59f04700 1 -- 172.21.15.31:0/1539444834 shutdown_connections 2023-10-09T06:26:24.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.994+0000 7fbc59f04700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbc40066f30 0x7fbc400693e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.994+0000 7fbc59f04700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc54159e60 0x7fbc540b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.994+0000 7fbc59f04700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc5406adb0 0x7fbc5415bbc0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.994+0000 7fbc59f04700 1 --2- 172.21.15.31:0/1539444834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc540cffa0 0x7fbc54154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.994+0000 7fbc59f04700 1 -- 172.21.15.31:0/1539444834 >> 172.21.15.31:0/1539444834 conn(0x7fbc540d1a50 msgr2=0x7fbc541562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:24.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.994+0000 7fbc59f04700 1 -- 172.21.15.31:0/1539444834 shutdown_connections 2023-10-09T06:26:24.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:23.994+0000 7fbc59f04700 1 -- 172.21.15.31:0/1539444834 wait complete. 2023-10-09T06:26:24.083 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:24.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.202+0000 7f8ae04d9700 1 Processor -- start 2023-10-09T06:26:24.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.202+0000 7f8ae04d9700 1 -- start start 2023-10-09T06:26:24.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8ae04d9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ad815a2b0 0x7f8ad80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:24.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8ae04d9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8ad80d1c30 0x7f8ad80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:24.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8ae04d9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8ad815a680 0x7f8ad80cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:24.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8ae04d9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad8068470 con 0x7f8ad80d1c30 2023-10-09T06:26:24.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8ae04d9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80c5d80 con 0x7f8ad815a680 2023-10-09T06:26:24.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8ae04d9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80c6060 con 0x7f8ad815a2b0 2023-10-09T06:26:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8adda74700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8ad80d1c30 0x7f8ad80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8adda74700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8ad80d1c30 0x7f8ad80cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35844/0 (socket says 172.21.15.31:35844) 2023-10-09T06:26:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8adda74700 1 -- 172.21.15.31:0/618631166 learned_addr learned my addr 172.21.15.31:0/618631166 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8ade275700 1 --2- 172.21.15.31:0/618631166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ad815a2b0 0x7f8ad80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8adea76700 1 --2- 172.21.15.31:0/618631166 >> v2:172.21.15.158:3300/0 conn(0x7f8ad815a680 0x7f8ad80cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8adda74700 1 -- 172.21.15.31:0/618631166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ad815a2b0 msgr2=0x7f8ad80b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8adda74700 1 --2- 172.21.15.31:0/618631166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ad815a2b0 0x7f8ad80b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8adda74700 1 -- 172.21.15.31:0/618631166 >> v2:172.21.15.158:3300/0 conn(0x7f8ad815a680 msgr2=0x7f8ad80cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8adda74700 1 --2- 172.21.15.31:0/618631166 >> v2:172.21.15.158:3300/0 conn(0x7f8ad815a680 0x7f8ad80cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8adda74700 1 -- 172.21.15.31:0/618631166 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80c6340 con 0x7f8ad80d1c30 2023-10-09T06:26:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8adea76700 1 --2- 172.21.15.31:0/618631166 >> v2:172.21.15.158:3300/0 conn(0x7f8ad815a680 0x7f8ad80cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8ade275700 1 --2- 172.21.15.31:0/618631166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ad815a2b0 0x7f8ad80b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8adda74700 1 --2- 172.21.15.31:0/618631166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad80d1c30 0x7f8ad80cf710 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f8ad808a810 tx=0x7f8acc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575f8ded2740ef60 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8add273700 1 -- 172.21.15.31:0/618631166 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc00b860 con 0x7f8ad80d1c30 2023-10-09T06:26:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8add273700 1 -- 172.21.15.31:0/618631166 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc00b9c0 con 0x7f8ad80d1c30 2023-10-09T06:26:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.203+0000 7f8add273700 1 -- 172.21.15.31:0/618631166 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc00bd60 con 0x7f8ad80d1c30 2023-10-09T06:26:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.204+0000 7f8ae04d9700 1 -- 172.21.15.31:0/618631166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad80d1c30 msgr2=0x7f8ad80cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.204+0000 7f8ae04d9700 1 --2- 172.21.15.31:0/618631166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad80d1c30 0x7f8ad80cf710 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f8ad808a810 tx=0x7f8acc009250 comp rx=0 tx=0).stop 2023-10-09T06:26:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.204+0000 7f8ae04d9700 1 -- 172.21.15.31:0/618631166 shutdown_connections 2023-10-09T06:26:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.204+0000 7f8ae04d9700 1 --2- 172.21.15.31:0/618631166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ad815a2b0 0x7f8ad80b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.204+0000 7f8ae04d9700 1 --2- 172.21.15.31:0/618631166 >> v2:172.21.15.158:3300/0 conn(0x7f8ad815a680 0x7f8ad80cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.204+0000 7f8ae04d9700 1 --2- 172.21.15.31:0/618631166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad80d1c30 0x7f8ad80cf710 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.204+0000 7f8ae04d9700 1 -- 172.21.15.31:0/618631166 >> 172.21.15.31:0/618631166 conn(0x7f8ad8067e40 msgr2=0x7f8ad80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:24.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.204+0000 7f8ae04d9700 1 -- 172.21.15.31:0/618631166 shutdown_connections 2023-10-09T06:26:24.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.204+0000 7f8ae04d9700 1 -- 172.21.15.31:0/618631166 wait complete. 2023-10-09T06:26:24.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.205+0000 7f8ae04d9700 1 Processor -- start 2023-10-09T06:26:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.205+0000 7f8ae04d9700 1 -- start start 2023-10-09T06:26:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8ae04d9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ad80d1c30 0x7f8ad8158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8ae04d9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ad815a2b0 0x7f8ad81593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8ae04d9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad815a680 0x7f8ad80c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8ae04d9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad8158380 con 0x7f8ad815a680 2023-10-09T06:26:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8ae04d9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad8170070 con 0x7f8ad815a2b0 2023-10-09T06:26:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8ae04d9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81577b0 con 0x7f8ad80d1c30 2023-10-09T06:26:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8adea76700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad815a680 0x7f8ad80c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8adea76700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad815a680 0x7f8ad80c97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35860/0 (socket says 172.21.15.31:35860) 2023-10-09T06:26:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8adea76700 1 -- 172.21.15.31:0/1990383576 learned_addr learned my addr 172.21.15.31:0/1990383576 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8ade275700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ad80d1c30 0x7f8ad8158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8adda74700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ad815a2b0 0x7f8ad81593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8adea76700 1 -- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ad80d1c30 msgr2=0x7f8ad8158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8adea76700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ad80d1c30 0x7f8ad8158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8adea76700 1 -- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ad815a2b0 msgr2=0x7f8ad81593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8adea76700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ad815a2b0 0x7f8ad81593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.206+0000 7f8adea76700 1 -- 172.21.15.31:0/1990383576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc0094f0 con 0x7f8ad815a680 2023-10-09T06:26:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.207+0000 7f8adea76700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad815a680 0x7f8ad80c97a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8007f30 tx=0x7f8ac8009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.207+0000 7f8ad67fc700 1 -- 172.21.15.31:0/1990383576 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac800db80 con 0x7f8ad815a680 2023-10-09T06:26:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.207+0000 7f8ad67fc700 1 -- 172.21.15.31:0/1990383576 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac800f040 con 0x7f8ad815a680 2023-10-09T06:26:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.207+0000 7f8ae04d9700 1 -- 172.21.15.31:0/1990383576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad8157a50 con 0x7f8ad815a680 2023-10-09T06:26:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.207+0000 7f8ad67fc700 1 -- 172.21.15.31:0/1990383576 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8015440 con 0x7f8ad815a680 2023-10-09T06:26:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.207+0000 7f8ae04d9700 1 -- 172.21.15.31:0/1990383576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad8158010 con 0x7f8ad815a680 2023-10-09T06:26:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.208+0000 7f8ae04d9700 1 -- 172.21.15.31:0/1990383576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad804c3c0 con 0x7f8ad815a680 2023-10-09T06:26:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.208+0000 7f8ad67fc700 1 -- 172.21.15.31:0/1990383576 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ac801e3b0 con 0x7f8ad815a680 2023-10-09T06:26:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.209+0000 7f8ad67fc700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8ac4066f30 0x7f8ac40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.209+0000 7f8ad67fc700 1 -- 172.21.15.31:0/1990383576 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ac8084940 con 0x7f8ad815a680 2023-10-09T06:26:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.209+0000 7f8ade275700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8ac4066f30 0x7f8ac40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.209+0000 7f8ade275700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8ac4066f30 0x7f8ac40693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8158e10 tx=0x7f8ad0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.213+0000 7f8ad67fc700 1 -- 172.21.15.31:0/1990383576 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ac8051b10 con 0x7f8ad815a680 2023-10-09T06:26:24.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.448+0000 7f8ae04d9700 1 -- 172.21.15.31:0/1990383576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ad81584c0 con 0x7f8ad815a680 2023-10-09T06:26:24.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.448+0000 7f8ad67fc700 1 -- 172.21.15.31:0/1990383576 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f8ac801a090 con 0x7f8ad815a680 2023-10-09T06:26:24.449 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:24.449 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2694953357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2694953357},{"type":"v1","addr":"172.21.15.158:6836","nonce":2694953357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1926052104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1926052104},{"type":"v1","addr":"172.21.15.31:6834","nonce":1926052104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3700277268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3700277268},{"type":"v1","addr":"172.21.15.31:6835","nonce":3700277268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:25:48.239748+0000","modified":"2023-10-09T06:25:51.874363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/3699283833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3699283833},{"type":"v1","addr":"172.21.15.158:6837","nonce":3699283833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T06:26:24.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.450+0000 7f8ae04d9700 1 -- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8ac4066f30 msgr2=0x7f8ac40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:24.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.450+0000 7f8ae04d9700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8ac4066f30 0x7f8ac40693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8158e10 tx=0x7f8ad0008040 comp rx=0 tx=0).stop 2023-10-09T06:26:24.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.450+0000 7f8ae04d9700 1 -- 172.21.15.31:0/1990383576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad815a680 msgr2=0x7f8ad80c97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:24.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.450+0000 7f8ae04d9700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad815a680 0x7f8ad80c97a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8007f30 tx=0x7f8ac8009930 comp rx=0 tx=0).stop 2023-10-09T06:26:24.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.450+0000 7f8ae04d9700 1 -- 172.21.15.31:0/1990383576 shutdown_connections 2023-10-09T06:26:24.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.450+0000 7f8ae04d9700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8ac4066f30 0x7f8ac40693e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.450+0000 7f8ae04d9700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ad80d1c30 0x7f8ad8158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.450+0000 7f8ae04d9700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad815a680 0x7f8ad80c97a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.450+0000 7f8ae04d9700 1 --2- 172.21.15.31:0/1990383576 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ad815a2b0 0x7f8ad81593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:24.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.450+0000 7f8ae04d9700 1 -- 172.21.15.31:0/1990383576 >> 172.21.15.31:0/1990383576 conn(0x7f8ad8067e40 msgr2=0x7f8ad80cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:24.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.450+0000 7f8ae04d9700 1 -- 172.21.15.31:0/1990383576 shutdown_connections 2023-10-09T06:26:24.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:24.450+0000 7f8ae04d9700 1 -- 172.21.15.31:0/1990383576 wait complete. 2023-10-09T06:26:24.452 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 50 2023-10-09T06:26:24.463 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-09T06:26:24.607 INFO:teuthology.orchestra.run.smithi158.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":6279,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":35.733394351999998,"mdsmap_epoch":50,"osdmap_epoch":109,"osdmap_epoch_barrier":105,"uptime":41.666372303000003} 2023-10-09T06:26:24.607 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 6279, "mdsmap_epoch": 50, "osdmap_epoch": 109, "osdmap_epoch_barrier": 105, "rank_uptime": 35.733394352, "state": "up:active", "uptime": 41.666372303, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:26:24.607 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T06:26:24.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:24.608 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-09T06:26:24.901 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records in 2023-10-09T06:26:24.901 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records out 2023-10-09T06:26:24.902 INFO:teuthology.orchestra.run.smithi031.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.276749 s, 189 MB/s 2023-10-09T06:26:24.903 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:26:24.903 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:26:24.936 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:26:24.969 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:26:24.969 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:26:24.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:24.969 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:26:25.034 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:26:25.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:25.034 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:26:25.055 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T06:26:25.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:25.055 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T06:26:25.096 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:26:25.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:25.096 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T06:26:25.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:25.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.270+0000 7fcc8c638700 1 Processor -- start 2023-10-09T06:26:25.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.270+0000 7fcc8c638700 1 -- start start 2023-10-09T06:26:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.270+0000 7fcc8c638700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84157870 0x7fcc8415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.270+0000 7fcc8c638700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcc8415a620 0x7fcc8415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc8c638700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8415cbb0 con 0x7fcc8415d580 2023-10-09T06:26:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc8c638700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8415bfa0 con 0x7fcc8415a620 2023-10-09T06:26:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc8c638700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8415c280 con 0x7fcc84157870 2023-10-09T06:26:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc89bd3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcc8415a620 0x7fcc8415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc8abd5700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcc8415d580 0x7fcc84158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57358/0 (socket says 172.21.15.31:57358) 2023-10-09T06:26:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc8abd5700 1 -- 172.21.15.31:0/2101799755 learned_addr learned my addr 172.21.15.31:0/2101799755 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:25.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc8a3d4700 1 --2- 172.21.15.31:0/2101799755 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84157870 0x7fcc8415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:25.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc89bd3700 1 -- 172.21.15.31:0/2101799755 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84157870 msgr2=0x7fcc8415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:25.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc89bd3700 1 --2- 172.21.15.31:0/2101799755 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84157870 0x7fcc8415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc89bd3700 1 -- 172.21.15.31:0/2101799755 >> v1:172.21.15.31:6789/0 conn(0x7fcc8415d580 legacy=0x7fcc84158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc893d2700 1 -- 172.21.15.31:0/2101799755 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993931548 0 0) 0x7fcc8415cbb0 con 0x7fcc8415d580 2023-10-09T06:26:25.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc89bd3700 1 -- 172.21.15.31:0/2101799755 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8415c560 con 0x7fcc8415a620 2023-10-09T06:26:25.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc89bd3700 1 --2- 172.21.15.31:0/2101799755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc8415a620 0x7fcc8415d040 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcc780098e0 tx=0x7fcc780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db71cd0f2ad7a691 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:25.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc893d2700 1 -- 172.21.15.31:0/2101799755 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78009e80 con 0x7fcc8415a620 2023-10-09T06:26:25.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc893d2700 1 -- 172.21.15.31:0/2101799755 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7800b860 con 0x7fcc8415a620 2023-10-09T06:26:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.271+0000 7fcc893d2700 1 -- 172.21.15.31:0/2101799755 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800bbe0 con 0x7fcc8415a620 2023-10-09T06:26:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.272+0000 7fcc8c638700 1 -- 172.21.15.31:0/2101799755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc8415a620 msgr2=0x7fcc8415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.272+0000 7fcc8c638700 1 --2- 172.21.15.31:0/2101799755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc8415a620 0x7fcc8415d040 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcc780098e0 tx=0x7fcc780091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.272+0000 7fcc8c638700 1 -- 172.21.15.31:0/2101799755 shutdown_connections 2023-10-09T06:26:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.272+0000 7fcc8c638700 1 --2- 172.21.15.31:0/2101799755 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84157870 0x7fcc8415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.272+0000 7fcc8c638700 1 --2- 172.21.15.31:0/2101799755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc8415a620 0x7fcc8415d040 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.272+0000 7fcc8c638700 1 -- 172.21.15.31:0/2101799755 >> 172.21.15.31:0/2101799755 conn(0x7fcc84068ce0 msgr2=0x7fcc840690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.272+0000 7fcc8c638700 1 -- 172.21.15.31:0/2101799755 shutdown_connections 2023-10-09T06:26:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.272+0000 7fcc8c638700 1 -- 172.21.15.31:0/2101799755 wait complete. 2023-10-09T06:26:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.273+0000 7fcc8c638700 1 Processor -- start 2023-10-09T06:26:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.273+0000 7fcc8c638700 1 -- start start 2023-10-09T06:26:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc8c638700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84157870 0x7fcc840b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc8c638700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc8415a620 0x7fcc840d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc8c638700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc8415d580 0x7fcc8416aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc8c638700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840d1370 con 0x7fcc8415a620 2023-10-09T06:26:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc8c638700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840b07f0 con 0x7fcc8415d580 2023-10-09T06:26:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc8c638700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840d0ad0 con 0x7fcc84157870 2023-10-09T06:26:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc89bd3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc8415a620 0x7fcc840d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc89bd3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc8415a620 0x7fcc840d00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35886/0 (socket says 172.21.15.31:35886) 2023-10-09T06:26:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc89bd3700 1 -- 172.21.15.31:0/1716700445 learned_addr learned my addr 172.21.15.31:0/1716700445 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc8abd5700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc8415d580 0x7fcc8416aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc8a3d4700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84157870 0x7fcc840b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc89bd3700 1 -- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84157870 msgr2=0x7fcc840b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc89bd3700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84157870 0x7fcc840b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc89bd3700 1 -- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc8415d580 msgr2=0x7fcc8416aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc89bd3700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc8415d580 0x7fcc8416aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc89bd3700 1 -- 172.21.15.31:0/1716700445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc78009420 con 0x7fcc8415a620 2023-10-09T06:26:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc8a3d4700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84157870 0x7fcc840b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.274+0000 7fcc89bd3700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc8415a620 0x7fcc840d00a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcc8406b530 tx=0x7fcc78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.275+0000 7fcc827fc700 1 -- 172.21.15.31:0/1716700445 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800bbe0 con 0x7fcc8415a620 2023-10-09T06:26:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.275+0000 7fcc827fc700 1 -- 172.21.15.31:0/1716700445 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc78011420 con 0x7fcc8415a620 2023-10-09T06:26:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.275+0000 7fcc8c638700 1 -- 172.21.15.31:0/1716700445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc840d0db0 con 0x7fcc8415a620 2023-10-09T06:26:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.275+0000 7fcc827fc700 1 -- 172.21.15.31:0/1716700445 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780117e0 con 0x7fcc8415a620 2023-10-09T06:26:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.275+0000 7fcc8c638700 1 -- 172.21.15.31:0/1716700445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc840d05e0 con 0x7fcc8415a620 2023-10-09T06:26:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.275+0000 7fcc8c638700 1 -- 172.21.15.31:0/1716700445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc840d0890 con 0x7fcc8415a620 2023-10-09T06:26:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.276+0000 7fcc827fc700 1 -- 172.21.15.31:0/1716700445 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc78011c10 con 0x7fcc8415a620 2023-10-09T06:26:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.276+0000 7fcc827fc700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc70066f30 0x7fcc700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.277+0000 7fcc827fc700 1 -- 172.21.15.31:0/1716700445 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc78085fa0 con 0x7fcc8415a620 2023-10-09T06:26:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.277+0000 7fcc8a3d4700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc70066f30 0x7fcc700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.277+0000 7fcc8a3d4700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc70066f30 0x7fcc700693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00e470 tx=0x7fcc7c007680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.281+0000 7fcc827fc700 1 -- 172.21.15.31:0/1716700445 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc780b75a0 con 0x7fcc8415a620 2023-10-09T06:26:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.517+0000 7fcc8c638700 1 -- 172.21.15.31:0/1716700445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc840b09b0 con 0x7fcc8415a620 2023-10-09T06:26:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.517+0000 7fcc827fc700 1 -- 172.21.15.31:0/1716700445 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fcc7805ae60 con 0x7fcc8415a620 2023-10-09T06:26:25.518 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:25.519 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2694953357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2694953357},{"type":"v1","addr":"172.21.15.158:6836","nonce":2694953357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1926052104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1926052104},{"type":"v1","addr":"172.21.15.31:6834","nonce":1926052104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3700277268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3700277268},{"type":"v1","addr":"172.21.15.31:6835","nonce":3700277268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:25:48.239748+0000","modified":"2023-10-09T06:25:51.874363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/3699283833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3699283833},{"type":"v1","addr":"172.21.15.158:6837","nonce":3699283833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T06:26:25.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.519+0000 7fcc8c638700 1 -- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc70066f30 msgr2=0x7fcc700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.519+0000 7fcc8c638700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc70066f30 0x7fcc700693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00e470 tx=0x7fcc7c007680 comp rx=0 tx=0).stop 2023-10-09T06:26:25.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.519+0000 7fcc8c638700 1 -- 172.21.15.31:0/1716700445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc8415a620 msgr2=0x7fcc840d00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.519+0000 7fcc8c638700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc8415a620 0x7fcc840d00a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcc8406b530 tx=0x7fcc78017000 comp rx=0 tx=0).stop 2023-10-09T06:26:25.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.520+0000 7fcc8c638700 1 -- 172.21.15.31:0/1716700445 shutdown_connections 2023-10-09T06:26:25.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.520+0000 7fcc8c638700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc70066f30 0x7fcc700693e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.520+0000 7fcc8c638700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc84157870 0x7fcc840b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.520+0000 7fcc8c638700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc8415d580 0x7fcc8416aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.520+0000 7fcc8c638700 1 --2- 172.21.15.31:0/1716700445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc8415a620 0x7fcc840d00a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.520+0000 7fcc8c638700 1 -- 172.21.15.31:0/1716700445 >> 172.21.15.31:0/1716700445 conn(0x7fcc84068ce0 msgr2=0x7fcc8414c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:25.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.520+0000 7fcc8c638700 1 -- 172.21.15.31:0/1716700445 shutdown_connections 2023-10-09T06:26:25.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.520+0000 7fcc8c638700 1 -- 172.21.15.31:0/1716700445 wait complete. 2023-10-09T06:26:25.522 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 50 2023-10-09T06:26:25.533 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:26:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.650+0000 7fdfb333b700 1 Processor -- start 2023-10-09T06:26:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.650+0000 7fdfb333b700 1 -- start start 2023-10-09T06:26:25.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.651+0000 7fdfb333b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdfac0c59e0 0x7fdfac15a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.651+0000 7fdfb333b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac0ae320 con 0x7fdfac0cc410 2023-10-09T06:26:25.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.651+0000 7fdfb333b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac0ad710 con 0x7fdfac159f10 2023-10-09T06:26:25.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.651+0000 7fdfb333b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfac0c5e10 con 0x7fdfac0c59e0 2023-10-09T06:26:25.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.651+0000 7fdfb2b3a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdfac0c59e0 0x7fdfac15a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:25.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.651+0000 7fdfb1b38700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdfac0cc410 0x7fdfac0cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57368/0 (socket says 172.21.15.31:57368) 2023-10-09T06:26:25.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.651+0000 7fdfb1b38700 1 -- 172.21.15.31:0/1786664585 learned_addr learned my addr 172.21.15.31:0/1786664585 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:25.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.651+0000 7fdfb2b3a700 1 -- 172.21.15.31:0/1786664585 >> v1:172.21.15.158:6789/0 conn(0x7fdfac159f10 legacy=0x7fdfac0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.651+0000 7fdfb2b3a700 1 -- 172.21.15.31:0/1786664585 >> v1:172.21.15.31:6789/0 conn(0x7fdfac0cc410 legacy=0x7fdfac0cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.651+0000 7fdfb2b3a700 1 -- 172.21.15.31:0/1786664585 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac0ad9f0 con 0x7fdfac0c59e0 2023-10-09T06:26:25.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.652+0000 7fdfb2b3a700 1 --2- 172.21.15.31:0/1786664585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfac0c59e0 0x7fdfac15a2e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c009e60 tx=0x7fdf9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3187b82a4479b1e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:25.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.652+0000 7fdfb1337700 1 -- 172.21.15.31:0/1786664585 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c00e070 con 0x7fdfac0c59e0 2023-10-09T06:26:25.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.652+0000 7fdfb1337700 1 -- 172.21.15.31:0/1786664585 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9c00bc30 con 0x7fdfac0c59e0 2023-10-09T06:26:25.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.652+0000 7fdfb1337700 1 -- 172.21.15.31:0/1786664585 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c012430 con 0x7fdfac0c59e0 2023-10-09T06:26:25.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.652+0000 7fdfb333b700 1 -- 172.21.15.31:0/1786664585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfac0c59e0 msgr2=0x7fdfac15a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.652+0000 7fdfb333b700 1 --2- 172.21.15.31:0/1786664585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfac0c59e0 0x7fdfac15a2e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c009e60 tx=0x7fdf9c009780 comp rx=0 tx=0).stop 2023-10-09T06:26:25.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.652+0000 7fdfb333b700 1 -- 172.21.15.31:0/1786664585 shutdown_connections 2023-10-09T06:26:25.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.652+0000 7fdfb333b700 1 --2- 172.21.15.31:0/1786664585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfac0c59e0 0x7fdfac15a2e0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.652+0000 7fdfb333b700 1 -- 172.21.15.31:0/1786664585 >> 172.21.15.31:0/1786664585 conn(0x7fdfac067e40 msgr2=0x7fdfac0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:25.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.652+0000 7fdfb333b700 1 -- 172.21.15.31:0/1786664585 shutdown_connections 2023-10-09T06:26:25.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.652+0000 7fdfb333b700 1 -- 172.21.15.31:0/1786664585 wait complete. 2023-10-09T06:26:25.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.653+0000 7fdfb333b700 1 Processor -- start 2023-10-09T06:26:25.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.654+0000 7fdfb333b700 1 -- start start 2023-10-09T06:26:25.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.654+0000 7fdfb333b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdfac0c59e0 0x7fdfac15fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.654+0000 7fdfb333b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfac0cc410 0x7fdfac0b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.654+0000 7fdfb333b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfac159f10 0x7fdfac14a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.654+0000 7fdfb333b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0b4750 con 0x7fdfac0cc410 2023-10-09T06:26:25.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.654+0000 7fdfb333b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0b3b80 con 0x7fdfac159f10 2023-10-09T06:26:25.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.654+0000 7fdfb333b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0b3e20 con 0x7fdfac0c59e0 2023-10-09T06:26:25.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.654+0000 7fdfb1b38700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfac0cc410 0x7fdfac0b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:25.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.654+0000 7fdfb1b38700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfac0cc410 0x7fdfac0b4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35900/0 (socket says 172.21.15.31:35900) 2023-10-09T06:26:25.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.654+0000 7fdfb1b38700 1 -- 172.21.15.31:0/2296305347 learned_addr learned my addr 172.21.15.31:0/2296305347 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:25.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfb2339700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdfac0c59e0 0x7fdfac15fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:25.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfb2b3a700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfac159f10 0x7fdfac14a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:25.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfb1b38700 1 -- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdfac0c59e0 msgr2=0x7fdfac15fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfb1b38700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdfac0c59e0 0x7fdfac15fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfb1b38700 1 -- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfac159f10 msgr2=0x7fdfac14a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfb1b38700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfac159f10 0x7fdfac14a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfb1b38700 1 -- 172.21.15.31:0/2296305347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c009a20 con 0x7fdfac0cc410 2023-10-09T06:26:25.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfb2b3a700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfac159f10 0x7fdfac14a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:25.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfb1b38700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfac0cc410 0x7fdfac0b4be0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000c7c0 tx=0x7fdfa0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:25.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfaa7fc700 1 -- 172.21.15.31:0/2296305347 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0005b30 con 0x7fdfac0cc410 2023-10-09T06:26:25.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfaa7fc700 1 -- 172.21.15.31:0/2296305347 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa0005cb0 con 0x7fdfac0cc410 2023-10-09T06:26:25.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfb333b700 1 -- 172.21.15.31:0/2296305347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfac0b4100 con 0x7fdfac0cc410 2023-10-09T06:26:25.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfaa7fc700 1 -- 172.21.15.31:0/2296305347 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0004a80 con 0x7fdfac0cc410 2023-10-09T06:26:25.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.655+0000 7fdfb333b700 1 -- 172.21.15.31:0/2296305347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfac160380 con 0x7fdfac0cc410 2023-10-09T06:26:25.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.656+0000 7fdfb333b700 1 -- 172.21.15.31:0/2296305347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac089300 con 0x7fdfac0cc410 2023-10-09T06:26:25.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.656+0000 7fdfaa7fc700 1 -- 172.21.15.31:0/2296305347 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfa00070f0 con 0x7fdfac0cc410 2023-10-09T06:26:25.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.657+0000 7fdfaa7fc700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdf98066f30 0x7fdf980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.657+0000 7fdfaa7fc700 1 -- 172.21.15.31:0/2296305347 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdfa00839e0 con 0x7fdfac0cc410 2023-10-09T06:26:25.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.657+0000 7fdfb2339700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdf98066f30 0x7fdf980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:25.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.657+0000 7fdfb2339700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdf98066f30 0x7fdf980693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000c00 tx=0x7fdfa4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:25.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.661+0000 7fdfaa7fc700 1 -- 172.21.15.31:0/2296305347 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfa0050cd0 con 0x7fdfac0cc410 2023-10-09T06:26:25.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.854+0000 7fdfb333b700 1 -- 172.21.15.31:0/2296305347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfac0890a0 con 0x7fdfac0cc410 2023-10-09T06:26:25.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.855+0000 7fdfaa7fc700 1 -- 172.21.15.31:0/2296305347 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+15357 (secure 0 0 0) 0x7fdfa0018070 con 0x7fdfac0cc410 2023-10-09T06:26:25.855 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:25.855 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":109,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:26:20.962501+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:25:46.157560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T06:25:47.220698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:26:25.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.856+0000 7fdfb333b700 1 -- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdf98066f30 msgr2=0x7fdf980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.856+0000 7fdfb333b700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdf98066f30 0x7fdf980693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000c00 tx=0x7fdfa4009040 comp rx=0 tx=0).stop 2023-10-09T06:26:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.856+0000 7fdfb333b700 1 -- 172.21.15.31:0/2296305347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfac0cc410 msgr2=0x7fdfac0b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.856+0000 7fdfb333b700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfac0cc410 0x7fdfac0b4be0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000c7c0 tx=0x7fdfa0007f70 comp rx=0 tx=0).stop 2023-10-09T06:26:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.856+0000 7fdfb333b700 1 -- 172.21.15.31:0/2296305347 shutdown_connections 2023-10-09T06:26:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.856+0000 7fdfb333b700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdf98066f30 0x7fdf980693e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.856+0000 7fdfb333b700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdfac0c59e0 0x7fdfac15fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.856+0000 7fdfb333b700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfac159f10 0x7fdfac14a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.856+0000 7fdfb333b700 1 --2- 172.21.15.31:0/2296305347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfac0cc410 0x7fdfac0b4be0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.856+0000 7fdfb333b700 1 -- 172.21.15.31:0/2296305347 >> 172.21.15.31:0/2296305347 conn(0x7fdfac067e40 msgr2=0x7fdfac0d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.857+0000 7fdfb333b700 1 -- 172.21.15.31:0/2296305347 shutdown_connections 2023-10-09T06:26:25.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.857+0000 7fdfb333b700 1 -- 172.21.15.31:0/2296305347 wait complete. 2023-10-09T06:26:25.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:25:46.157560+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:25:47.220698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:26:25.870 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:26:25.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.991+0000 7f4e3359e700 1 Processor -- start 2023-10-09T06:26:25.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.991+0000 7f4e3359e700 1 -- start start 2023-10-09T06:26:25.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.992+0000 7f4e3359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e3415ade0 0x7f4e340cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.992+0000 7f4e3359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e340cc760 con 0x7f4e3415a300 2023-10-09T06:26:25.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.992+0000 7f4e3359e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3415b460 con 0x7f4e3415cec0 2023-10-09T06:26:25.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.992+0000 7f4e3359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3415ba20 con 0x7f4e3415ade0 2023-10-09T06:26:25.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.992+0000 7f4e3259c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4e3415a300 0x7f4e3415a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57380/0 (socket says 172.21.15.31:57380) 2023-10-09T06:26:25.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.992+0000 7f4e3259c700 1 -- 172.21.15.31:0/2060453943 learned_addr learned my addr 172.21.15.31:0/2060453943 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:25.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.992+0000 7f4e32d9d700 1 --2- 172.21.15.31:0/2060453943 >> v2:172.21.15.31:3300/0 conn(0x7f4e3415ade0 0x7f4e340cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:25.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.992+0000 7f4e3159a700 1 -- 172.21.15.31:0/2060453943 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871197636 0 0) 0x7f4e340cc760 con 0x7f4e3415a300 2023-10-09T06:26:25.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.992+0000 7f4e3159a700 1 -- 172.21.15.31:0/2060453943 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e20003570 con 0x7f4e3415a300 2023-10-09T06:26:25.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.992+0000 7f4e32d9d700 1 -- 172.21.15.31:0/2060453943 >> v1:172.21.15.158:6789/0 conn(0x7f4e3415cec0 legacy=0x7f4e340cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.992+0000 7f4e32d9d700 1 -- 172.21.15.31:0/2060453943 >> v1:172.21.15.31:6789/0 conn(0x7f4e3415a300 legacy=0x7f4e3415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.992+0000 7f4e32d9d700 1 -- 172.21.15.31:0/2060453943 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e340cc1a0 con 0x7f4e3415ade0 2023-10-09T06:26:25.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.992+0000 7f4e32d9d700 1 --2- 172.21.15.31:0/2060453943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e3415ade0 0x7f4e340cbb40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009e60 tx=0x7f4e24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb804abeb95ae78 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.993+0000 7f4e3159a700 1 -- 172.21.15.31:0/2060453943 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2400e070 con 0x7f4e3415ade0 2023-10-09T06:26:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.993+0000 7f4e3159a700 1 -- 172.21.15.31:0/2060453943 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2400bb60 con 0x7f4e3415ade0 2023-10-09T06:26:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.993+0000 7f4e3159a700 1 -- 172.21.15.31:0/2060453943 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24012430 con 0x7f4e3415ade0 2023-10-09T06:26:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.993+0000 7f4e3359e700 1 -- 172.21.15.31:0/2060453943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e3415ade0 msgr2=0x7f4e340cbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.993+0000 7f4e3359e700 1 --2- 172.21.15.31:0/2060453943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e3415ade0 0x7f4e340cbb40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009e60 tx=0x7f4e24009780 comp rx=0 tx=0).stop 2023-10-09T06:26:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.993+0000 7f4e3359e700 1 -- 172.21.15.31:0/2060453943 shutdown_connections 2023-10-09T06:26:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.993+0000 7f4e3359e700 1 --2- 172.21.15.31:0/2060453943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e3415ade0 0x7f4e340cbb40 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.993+0000 7f4e3359e700 1 -- 172.21.15.31:0/2060453943 >> 172.21.15.31:0/2060453943 conn(0x7f4e34099f50 msgr2=0x7f4e34067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.993+0000 7f4e3359e700 1 -- 172.21.15.31:0/2060453943 shutdown_connections 2023-10-09T06:26:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.993+0000 7f4e3359e700 1 -- 172.21.15.31:0/2060453943 wait complete. 2023-10-09T06:26:25.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.994+0000 7f4e3359e700 1 Processor -- start 2023-10-09T06:26:25.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.994+0000 7f4e3359e700 1 -- start start 2023-10-09T06:26:25.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e3359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e3415a300 0x7f4e3414f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e3359e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e3415ade0 0x7f4e340b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e3359e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e3415cec0 0x7f4e340b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:25.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e3359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e340b0bf0 con 0x7f4e3415a300 2023-10-09T06:26:26.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e3359e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e340c6390 con 0x7f4e3415cec0 2023-10-09T06:26:26.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e3359e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e340c6670 con 0x7f4e3415ade0 2023-10-09T06:26:26.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e3259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e3415a300 0x7f4e3414f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e3259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e3415a300 0x7f4e3414f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35926/0 (socket says 172.21.15.31:35926) 2023-10-09T06:26:26.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e3259c700 1 -- 172.21.15.31:0/3068366472 learned_addr learned my addr 172.21.15.31:0/3068366472 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:26.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e32d9d700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e3415cec0 0x7f4e340b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e31d9b700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e3415ade0 0x7f4e340b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e3259c700 1 -- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e3415ade0 msgr2=0x7f4e340b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e3259c700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e3415ade0 0x7f4e340b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e3259c700 1 -- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e3415cec0 msgr2=0x7f4e340b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.995+0000 7f4e3259c700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e3415cec0 0x7f4e340b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.996+0000 7f4e3259c700 1 -- 172.21.15.31:0/3068366472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e24009a20 con 0x7f4e3415a300 2023-10-09T06:26:26.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.996+0000 7f4e32d9d700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e3415cec0 0x7f4e340b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:26.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.996+0000 7f4e3259c700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e3415a300 0x7f4e3414f750 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c790 tx=0x7f4e2c007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:26.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.996+0000 7f4e2a7fc700 1 -- 172.21.15.31:0/3068366472 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0072e0 con 0x7f4e3415a300 2023-10-09T06:26:26.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.996+0000 7f4e2a7fc700 1 -- 172.21.15.31:0/3068366472 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c007440 con 0x7f4e3415a300 2023-10-09T06:26:26.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.996+0000 7f4e3359e700 1 -- 172.21.15.31:0/3068366472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e340b1210 con 0x7f4e3415a300 2023-10-09T06:26:26.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.996+0000 7f4e2a7fc700 1 -- 172.21.15.31:0/3068366472 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0057f0 con 0x7f4e3415a300 2023-10-09T06:26:26.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.996+0000 7f4e3359e700 1 -- 172.21.15.31:0/3068366472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e340b17d0 con 0x7f4e3415a300 2023-10-09T06:26:26.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.997+0000 7f4e3359e700 1 -- 172.21.15.31:0/3068366472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e340b19c0 con 0x7f4e3415a300 2023-10-09T06:26:26.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.997+0000 7f4e2a7fc700 1 -- 172.21.15.31:0/3068366472 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e2c005c20 con 0x7f4e3415a300 2023-10-09T06:26:26.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.998+0000 7f4e2a7fc700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e14066f30 0x7f4e140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:26.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.998+0000 7f4e2a7fc700 1 -- 172.21.15.31:0/3068366472 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e2c083970 con 0x7f4e3415a300 2023-10-09T06:26:26.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.998+0000 7f4e31d9b700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e14066f30 0x7f4e140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:25.998+0000 7f4e31d9b700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e14066f30 0x7f4e140693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4e340c6b80 tx=0x7f4e1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:26.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.002+0000 7f4e2a7fc700 1 -- 172.21.15.31:0/3068366472 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e2c04b5a0 con 0x7f4e3415a300 2023-10-09T06:26:26.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.195+0000 7f4e3359e700 1 -- 172.21.15.31:0/3068366472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e3406ada0 con 0x7f4e3415a300 2023-10-09T06:26:26.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.195+0000 7f4e2a7fc700 1 -- 172.21.15.31:0/3068366472 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e2c017070 con 0x7f4e3415a300 2023-10-09T06:26:26.196 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:26:26.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.197+0000 7f4e3359e700 1 -- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e14066f30 msgr2=0x7f4e140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.197+0000 7f4e3359e700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e14066f30 0x7f4e140693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4e340c6b80 tx=0x7f4e1c009040 comp rx=0 tx=0).stop 2023-10-09T06:26:26.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.197+0000 7f4e3359e700 1 -- 172.21.15.31:0/3068366472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e3415a300 msgr2=0x7f4e3414f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.197+0000 7f4e3359e700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e3415a300 0x7f4e3414f750 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c790 tx=0x7f4e2c007c80 comp rx=0 tx=0).stop 2023-10-09T06:26:26.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.197+0000 7f4e3359e700 1 -- 172.21.15.31:0/3068366472 shutdown_connections 2023-10-09T06:26:26.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.197+0000 7f4e3359e700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e14066f30 0x7f4e140693e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.197+0000 7f4e3359e700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e3415cec0 0x7f4e340b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.197+0000 7f4e3359e700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e3415a300 0x7f4e3414f750 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.197+0000 7f4e3359e700 1 --2- 172.21.15.31:0/3068366472 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e3415ade0 0x7f4e340b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.197+0000 7f4e3359e700 1 -- 172.21.15.31:0/3068366472 >> 172.21.15.31:0/3068366472 conn(0x7f4e34099f50 msgr2=0x7f4e34067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:26.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.197+0000 7f4e3359e700 1 -- 172.21.15.31:0/3068366472 shutdown_connections 2023-10-09T06:26:26.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.197+0000 7f4e3359e700 1 -- 172.21.15.31:0/3068366472 wait complete. 2023-10-09T06:26:26.210 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:26:26.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.331+0000 7f7e12a50700 1 Processor -- start 2023-10-09T06:26:26.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.331+0000 7f7e12a50700 1 -- start start 2023-10-09T06:26:26.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.331+0000 7f7e12a50700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7e0c159ec0 0x7f7e0c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:26.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.331+0000 7f7e12a50700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7e0c06acb0 0x7f7e0c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:26.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.331+0000 7f7e12a50700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c0b0790 con 0x7f7e0c15a290 2023-10-09T06:26:26.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.331+0000 7f7e12a50700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0c0ce1f0 con 0x7f7e0c06acb0 2023-10-09T06:26:26.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.331+0000 7f7e12a50700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0b0b20 con 0x7f7e0c159ec0 2023-10-09T06:26:26.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.332+0000 7f7e10fed700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7e0c06acb0 0x7f7e0c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.332+0000 7f7e10fed700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7e0c06acb0 0x7f7e0c0afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35934/0 (socket says 172.21.15.31:35934) 2023-10-09T06:26:26.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.332+0000 7f7e10fed700 1 -- 172.21.15.31:0/781659053 learned_addr learned my addr 172.21.15.31:0/781659053 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:26.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.332+0000 7f7e0bfff700 1 --2- 172.21.15.31:0/781659053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7e0c159ec0 0x7f7e0c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.332+0000 7f7e10fed700 1 -- 172.21.15.31:0/781659053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7e0c159ec0 msgr2=0x7f7e0c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:26.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.332+0000 7f7e10fed700 1 --2- 172.21.15.31:0/781659053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7e0c159ec0 0x7f7e0c0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.332+0000 7f7e10fed700 1 -- 172.21.15.31:0/781659053 >> v1:172.21.15.158:6789/0 conn(0x7f7e0c15a290 legacy=0x7f7e0c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.332+0000 7f7e10fed700 1 -- 172.21.15.31:0/781659053 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c0b04b0 con 0x7f7e0c06acb0 2023-10-09T06:26:26.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.332+0000 7f7e10fed700 1 --2- 172.21.15.31:0/781659053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c06acb0 0x7f7e0c0afe80 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009f20 tx=0x7f7e04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5d37ff449b56c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:26.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.332+0000 7f7e0affd700 1 -- 172.21.15.31:0/781659053 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400e070 con 0x7f7e0c06acb0 2023-10-09T06:26:26.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.332+0000 7f7e0affd700 1 -- 172.21.15.31:0/781659053 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0400b9d0 con 0x7f7e0c06acb0 2023-10-09T06:26:26.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.332+0000 7f7e0affd700 1 -- 172.21.15.31:0/781659053 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e040092e0 con 0x7f7e0c06acb0 2023-10-09T06:26:26.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.333+0000 7f7e12a50700 1 -- 172.21.15.31:0/781659053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c06acb0 msgr2=0x7f7e0c0afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.333+0000 7f7e12a50700 1 --2- 172.21.15.31:0/781659053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c06acb0 0x7f7e0c0afe80 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009f20 tx=0x7f7e04009840 comp rx=0 tx=0).stop 2023-10-09T06:26:26.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.333+0000 7f7e12a50700 1 -- 172.21.15.31:0/781659053 shutdown_connections 2023-10-09T06:26:26.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.333+0000 7f7e12a50700 1 --2- 172.21.15.31:0/781659053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c06acb0 0x7f7e0c0afe80 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.333+0000 7f7e12a50700 1 --2- 172.21.15.31:0/781659053 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7e0c159ec0 0x7f7e0c0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.333+0000 7f7e12a50700 1 -- 172.21.15.31:0/781659053 >> 172.21.15.31:0/781659053 conn(0x7f7e0c0d1880 msgr2=0x7f7e0c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:26.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.333+0000 7f7e12a50700 1 -- 172.21.15.31:0/781659053 shutdown_connections 2023-10-09T06:26:26.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.333+0000 7f7e12a50700 1 -- 172.21.15.31:0/781659053 wait complete. 2023-10-09T06:26:26.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.334+0000 7f7e12a50700 1 Processor -- start 2023-10-09T06:26:26.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.334+0000 7f7e12a50700 1 -- start start 2023-10-09T06:26:26.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e12a50700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c06acb0 0x7f7e0c14e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:26.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e12a50700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e0c159ec0 0x7f7e0c153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:26.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e12a50700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7e0c15a290 0x7f7e0c0b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:26.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e12a50700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c151980 con 0x7f7e0c06acb0 2023-10-09T06:26:26.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e12a50700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c16e9d0 con 0x7f7e0c159ec0 2023-10-09T06:26:26.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e12a50700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c14fc80 con 0x7f7e0c15a290 2023-10-09T06:26:26.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e0bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c06acb0 0x7f7e0c14e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e0bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c06acb0 0x7f7e0c14e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35942/0 (socket says 172.21.15.31:35942) 2023-10-09T06:26:26.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e0bfff700 1 -- 172.21.15.31:0/3888454967 learned_addr learned my addr 172.21.15.31:0/3888454967 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:26.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e10fed700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7e0c15a290 0x7f7e0c0b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e0bfff700 1 -- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7e0c15a290 msgr2=0x7f7e0c0b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e0bfff700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7e0c15a290 0x7f7e0c0b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e0b7fe700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e0c159ec0 0x7f7e0c153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e0bfff700 1 -- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e0c159ec0 msgr2=0x7f7e0c153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e0bfff700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e0c159ec0 0x7f7e0c153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e0bfff700 1 -- 172.21.15.31:0/3888454967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04009ae0 con 0x7f7e0c06acb0 2023-10-09T06:26:26.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.335+0000 7f7e0bfff700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c06acb0 0x7f7e0c14e940 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7df400ecb0 tx=0x7f7df40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:26.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.336+0000 7f7e03fff700 1 -- 172.21.15.31:0/3888454967 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df400c9d0 con 0x7f7e0c06acb0 2023-10-09T06:26:26.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.336+0000 7f7e03fff700 1 -- 172.21.15.31:0/3888454967 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df400cb30 con 0x7f7e0c06acb0 2023-10-09T06:26:26.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.336+0000 7f7e12a50700 1 -- 172.21.15.31:0/3888454967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c14ee80 con 0x7f7e0c06acb0 2023-10-09T06:26:26.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.336+0000 7f7e03fff700 1 -- 172.21.15.31:0/3888454967 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4013470 con 0x7f7e0c06acb0 2023-10-09T06:26:26.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.336+0000 7f7e12a50700 1 -- 172.21.15.31:0/3888454967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0c14f630 con 0x7f7e0c06acb0 2023-10-09T06:26:26.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.337+0000 7f7e12a50700 1 -- 172.21.15.31:0/3888454967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0c06aa50 con 0x7f7e0c06acb0 2023-10-09T06:26:26.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.337+0000 7f7e03fff700 1 -- 172.21.15.31:0/3888454967 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7df40137e0 con 0x7f7e0c06acb0 2023-10-09T06:26:26.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.338+0000 7f7e03fff700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7dec066f30 0x7f7dec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:26.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.338+0000 7f7e03fff700 1 -- 172.21.15.31:0/3888454967 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7df40847e0 con 0x7f7e0c06acb0 2023-10-09T06:26:26.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.338+0000 7f7e0b7fe700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7dec066f30 0x7f7dec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.338+0000 7f7e0b7fe700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7dec066f30 0x7f7dec0693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0cb320 tx=0x7f7dfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:26.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.342+0000 7f7e03fff700 1 -- 172.21.15.31:0/3888454967 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7df4051a50 con 0x7f7e0c06acb0 2023-10-09T06:26:26.415 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:26:26.417 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:26:26.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.537+0000 7f7e12a50700 1 -- 172.21.15.31:0/3888454967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e0c04c3c0 con 0x7f7e0c06acb0 2023-10-09T06:26:26.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.537+0000 7f7e03fff700 1 -- 172.21.15.31:0/3888454967 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v109) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7df4055070 con 0x7f7e0c06acb0 2023-10-09T06:26:26.538 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:26:26.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.539+0000 7f7e12a50700 1 -- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7dec066f30 msgr2=0x7f7dec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.539+0000 7f7e12a50700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7dec066f30 0x7f7dec0693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0cb320 tx=0x7f7dfc009040 comp rx=0 tx=0).stop 2023-10-09T06:26:26.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.539+0000 7f7e12a50700 1 -- 172.21.15.31:0/3888454967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c06acb0 msgr2=0x7f7e0c14e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.539+0000 7f7e12a50700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c06acb0 0x7f7e0c14e940 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7df400ecb0 tx=0x7f7df40091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.540+0000 7f7e12a50700 1 -- 172.21.15.31:0/3888454967 shutdown_connections 2023-10-09T06:26:26.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.540+0000 7f7e12a50700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7dec066f30 0x7f7dec0693e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.540+0000 7f7e12a50700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7e0c15a290 0x7f7e0c0b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.540+0000 7f7e12a50700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c06acb0 0x7f7e0c14e940 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.540+0000 7f7e12a50700 1 --2- 172.21.15.31:0/3888454967 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e0c159ec0 0x7f7e0c153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.540+0000 7f7e12a50700 1 -- 172.21.15.31:0/3888454967 >> 172.21.15.31:0/3888454967 conn(0x7f7e0c0d1880 msgr2=0x7f7e0c0afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:26.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.540+0000 7f7e12a50700 1 -- 172.21.15.31:0/3888454967 shutdown_connections 2023-10-09T06:26:26.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.540+0000 7f7e12a50700 1 -- 172.21.15.31:0/3888454967 wait complete. 2023-10-09T06:26:26.552 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:26:26.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.673+0000 7fb3ab38d700 1 Processor -- start 2023-10-09T06:26:26.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.674+0000 7fb3ab38d700 1 -- start start 2023-10-09T06:26:26.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.674+0000 7fb3ab38d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb3a40678b0 0x7fb3a415db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:26.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.674+0000 7fb3ab38d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb3a40c9390 0x7fb3a415a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:26.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.674+0000 7fb3ab38d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a40cae70 con 0x7fb3a40cbf10 2023-10-09T06:26:26.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.674+0000 7fb3ab38d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a40cb150 con 0x7fb3a40678b0 2023-10-09T06:26:26.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.674+0000 7fb3ab38d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a40cb430 con 0x7fb3a40c9390 2023-10-09T06:26:26.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.675+0000 7fb3a9129700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb3a40678b0 0x7fb3a415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.675+0000 7fb3a9129700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb3a40678b0 0x7fb3a415db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35956/0 (socket says 172.21.15.31:35956) 2023-10-09T06:26:26.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.675+0000 7fb3a9129700 1 -- 172.21.15.31:0/657206581 learned_addr learned my addr 172.21.15.31:0/657206581 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:26.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.675+0000 7fb3a992a700 1 --2- 172.21.15.31:0/657206581 >> v2:172.21.15.158:3300/0 conn(0x7fb3a40c9390 0x7fb3a415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.675+0000 7fb3a9129700 1 -- 172.21.15.31:0/657206581 >> v2:172.21.15.158:3300/0 conn(0x7fb3a40c9390 msgr2=0x7fb3a415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:26.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.675+0000 7fb3a9129700 1 --2- 172.21.15.31:0/657206581 >> v2:172.21.15.158:3300/0 conn(0x7fb3a40c9390 0x7fb3a415a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.675+0000 7fb3a9129700 1 -- 172.21.15.31:0/657206581 >> v1:172.21.15.158:6789/0 conn(0x7fb3a40cbf10 legacy=0x7fb3a415e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.675+0000 7fb3a9129700 1 -- 172.21.15.31:0/657206581 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a40cb710 con 0x7fb3a40678b0 2023-10-09T06:26:26.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.675+0000 7fb3a9129700 1 --2- 172.21.15.31:0/657206581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3a40678b0 0x7fb3a415db80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40c9ab0 tx=0x7fb39c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1546e0df6f571 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:26.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.675+0000 7fb3a3fff700 1 -- 172.21.15.31:0/657206581 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c00b820 con 0x7fb3a40678b0 2023-10-09T06:26:26.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.675+0000 7fb3a3fff700 1 -- 172.21.15.31:0/657206581 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c00b980 con 0x7fb3a40678b0 2023-10-09T06:26:26.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.675+0000 7fb3a3fff700 1 -- 172.21.15.31:0/657206581 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c00bd20 con 0x7fb3a40678b0 2023-10-09T06:26:26.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.676+0000 7fb3ab38d700 1 -- 172.21.15.31:0/657206581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3a40678b0 msgr2=0x7fb3a415db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.676+0000 7fb3ab38d700 1 --2- 172.21.15.31:0/657206581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3a40678b0 0x7fb3a415db80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40c9ab0 tx=0x7fb39c009250 comp rx=0 tx=0).stop 2023-10-09T06:26:26.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.676+0000 7fb3ab38d700 1 -- 172.21.15.31:0/657206581 shutdown_connections 2023-10-09T06:26:26.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.676+0000 7fb3ab38d700 1 --2- 172.21.15.31:0/657206581 >> v2:172.21.15.158:3300/0 conn(0x7fb3a40c9390 0x7fb3a415a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.676+0000 7fb3ab38d700 1 --2- 172.21.15.31:0/657206581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3a40678b0 0x7fb3a415db80 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.676+0000 7fb3ab38d700 1 -- 172.21.15.31:0/657206581 >> 172.21.15.31:0/657206581 conn(0x7fb3a4069870 msgr2=0x7fb3a4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:26.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.676+0000 7fb3ab38d700 1 -- 172.21.15.31:0/657206581 shutdown_connections 2023-10-09T06:26:26.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.676+0000 7fb3ab38d700 1 -- 172.21.15.31:0/657206581 wait complete. 2023-10-09T06:26:26.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.677+0000 7fb3ab38d700 1 Processor -- start 2023-10-09T06:26:26.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.677+0000 7fb3ab38d700 1 -- start start 2023-10-09T06:26:26.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3ab38d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3a40678b0 0x7fb3a40b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:26.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3ab38d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3a40c9390 0x7fb3a40ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:26.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3ab38d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3a40cbf10 0x7fb3a40c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:26.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3ab38d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a416abb0 con 0x7fb3a40678b0 2023-10-09T06:26:26.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3ab38d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a4169fa0 con 0x7fb3a40c9390 2023-10-09T06:26:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3ab38d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a416a280 con 0x7fb3a40cbf10 2023-10-09T06:26:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3a9129700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3a40678b0 0x7fb3a40b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3a9129700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3a40678b0 0x7fb3a40b07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35968/0 (socket says 172.21.15.31:35968) 2023-10-09T06:26:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3a9129700 1 -- 172.21.15.31:0/1876880442 learned_addr learned my addr 172.21.15.31:0/1876880442 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3a8928700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3a40c9390 0x7fb3a40ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3a992a700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3a40cbf10 0x7fb3a40c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3a9129700 1 -- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3a40cbf10 msgr2=0x7fb3a40c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3a9129700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3a40cbf10 0x7fb3a40c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3a9129700 1 -- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3a40c9390 msgr2=0x7fb3a40ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3a9129700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3a40c9390 0x7fb3a40ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3a9129700 1 -- 172.21.15.31:0/1876880442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c0094f0 con 0x7fb3a40678b0 2023-10-09T06:26:26.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.678+0000 7fb3a9129700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3a40678b0 0x7fb3a40b07c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009290 tx=0x7fb39c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:26.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.679+0000 7fb3a17fa700 1 -- 172.21.15.31:0/1876880442 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c011cc0 con 0x7fb3a40678b0 2023-10-09T06:26:26.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.679+0000 7fb3a17fa700 1 -- 172.21.15.31:0/1876880442 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c020070 con 0x7fb3a40678b0 2023-10-09T06:26:26.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.679+0000 7fb3a17fa700 1 -- 172.21.15.31:0/1876880442 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c01b6a0 con 0x7fb3a40678b0 2023-10-09T06:26:26.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.679+0000 7fb3ab38d700 1 -- 172.21.15.31:0/1876880442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a416a560 con 0x7fb3a40678b0 2023-10-09T06:26:26.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.679+0000 7fb3ab38d700 1 -- 172.21.15.31:0/1876880442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a4169bc0 con 0x7fb3a40678b0 2023-10-09T06:26:26.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.680+0000 7fb3ab38d700 1 -- 172.21.15.31:0/1876880442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a416acf0 con 0x7fb3a40678b0 2023-10-09T06:26:26.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.680+0000 7fb3a17fa700 1 -- 172.21.15.31:0/1876880442 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb39c022030 con 0x7fb3a40678b0 2023-10-09T06:26:26.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.681+0000 7fb3a17fa700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb390066f30 0x7fb3900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:26.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.681+0000 7fb3a17fa700 1 -- 172.21.15.31:0/1876880442 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb39c0862b0 con 0x7fb3a40678b0 2023-10-09T06:26:26.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.681+0000 7fb3a8928700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb390066f30 0x7fb3900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:26.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.681+0000 7fb3a8928700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb390066f30 0x7fb3900693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40b4a40 tx=0x7fb398007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:26.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.685+0000 7fb3a17fa700 1 -- 172.21.15.31:0/1876880442 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3a416acf0 con 0x7fb3a40678b0 2023-10-09T06:26:26.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.878+0000 7fb3ab38d700 1 -- 172.21.15.31:0/1876880442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3a416acf0 con 0x7fb3a40678b0 2023-10-09T06:26:26.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.878+0000 7fb3a17fa700 1 -- 172.21.15.31:0/1876880442 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v109) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3a416acf0 con 0x7fb3a40678b0 2023-10-09T06:26:26.879 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:26:26.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.880+0000 7fb3ab38d700 1 -- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb390066f30 msgr2=0x7fb3900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.880+0000 7fb3ab38d700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb390066f30 0x7fb3900693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40b4a40 tx=0x7fb398007ec0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.880+0000 7fb3ab38d700 1 -- 172.21.15.31:0/1876880442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3a40678b0 msgr2=0x7fb3a40b07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:26.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.880+0000 7fb3ab38d700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3a40678b0 0x7fb3a40b07c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009290 tx=0x7fb39c016000 comp rx=0 tx=0).stop 2023-10-09T06:26:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.880+0000 7fb3ab38d700 1 -- 172.21.15.31:0/1876880442 shutdown_connections 2023-10-09T06:26:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.880+0000 7fb3ab38d700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb390066f30 0x7fb3900693e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.880+0000 7fb3ab38d700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb3a40cbf10 0x7fb3a40c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.880+0000 7fb3ab38d700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3a40678b0 0x7fb3a40b07c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.880+0000 7fb3ab38d700 1 --2- 172.21.15.31:0/1876880442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3a40c9390 0x7fb3a40ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.880+0000 7fb3ab38d700 1 -- 172.21.15.31:0/1876880442 >> 172.21.15.31:0/1876880442 conn(0x7fb3a4069870 msgr2=0x7fb3a40b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.880+0000 7fb3ab38d700 1 -- 172.21.15.31:0/1876880442 shutdown_connections 2023-10-09T06:26:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:26.881+0000 7fb3ab38d700 1 -- 172.21.15.31:0/1876880442 wait complete. 2023-10-09T06:26:26.893 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:27.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.012+0000 7f06bc70f700 1 Processor -- start 2023-10-09T06:26:27.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.012+0000 7f06bc70f700 1 -- start start 2023-10-09T06:26:27.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.013+0000 7f06bc70f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f06b41523e0 0x7f06b406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.013+0000 7f06bc70f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b4158e50 0x7f06b40cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.013+0000 7f06bc70f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b406c010 con 0x7f06b4152010 2023-10-09T06:26:27.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.013+0000 7f06bc70f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b406bd10 con 0x7f06b41523e0 2023-10-09T06:26:27.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.013+0000 7f06bc70f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b415c060 con 0x7f06b4158e50 2023-10-09T06:26:27.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.013+0000 7f06ba4ab700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f06b4152010 0x7f06b415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57386/0 (socket says 172.21.15.31:57386) 2023-10-09T06:26:27.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.013+0000 7f06ba4ab700 1 -- 172.21.15.31:0/1185664013 learned_addr learned my addr 172.21.15.31:0/1185664013 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:27.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865968741 0 0) 0x7f06b406c010 con 0x7f06b4152010 2023-10-09T06:26:27.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b9caa700 1 --2- 172.21.15.31:0/1185664013 >> v2:172.21.15.158:3300/0 conn(0x7f06b41523e0 0x7f06b406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06bacac700 1 --2- 172.21.15.31:0/1185664013 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b4158e50 0x7f06b40cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f069c003570 con 0x7f06b4152010 2023-10-09T06:26:27.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1125774915 0 0) 0x7f069c003570 con 0x7f06b4152010 2023-10-09T06:26:27.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b4158e50 msgr2=0x7f06b40cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:27.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 --2- 172.21.15.31:0/1185664013 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b4158e50 0x7f06b40cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 >> v2:172.21.15.158:3300/0 conn(0x7f06b41523e0 msgr2=0x7f06b406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:27.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 --2- 172.21.15.31:0/1185664013 >> v2:172.21.15.158:3300/0 conn(0x7f06b41523e0 0x7f06b406c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b415c340 con 0x7f06b4152010 2023-10-09T06:26:27.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f06ac001470 con 0x7f06b4152010 2023-10-09T06:26:27.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 >> v1:172.21.15.31:6789/0 conn(0x7f06b4152010 legacy=0x7f06b415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 --2- 172.21.15.31:0/1185664013 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b4158e50 0x7f069c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 --2- 172.21.15.31:0/1185664013 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f069c003fe0 0x7f069c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 --2- 172.21.15.31:0/1185664013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c004d50 0x7f069c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b406bd10 con 0x7f069c004d50 2023-10-09T06:26:27.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b415c060 con 0x7f069c003fe0 2023-10-09T06:26:27.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c00ba90 con 0x7f06b4158e50 2023-10-09T06:26:27.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06bacac700 1 --2- 172.21.15.31:0/1185664013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c004d50 0x7f069c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06ba4ab700 1 --2- 172.21.15.31:0/1185664013 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b4158e50 0x7f069c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06b9caa700 1 --2- 172.21.15.31:0/1185664013 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f069c003fe0 0x7f069c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06bacac700 1 -- 172.21.15.31:0/1185664013 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b4158e50 msgr2=0x7f069c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:27.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06bacac700 1 --2- 172.21.15.31:0/1185664013 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b4158e50 0x7f069c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06bacac700 1 -- 172.21.15.31:0/1185664013 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f069c003fe0 msgr2=0x7f069c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:27.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06bacac700 1 --2- 172.21.15.31:0/1185664013 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f069c003fe0 0x7f069c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.014+0000 7f06bacac700 1 -- 172.21.15.31:0/1185664013 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c003570 con 0x7f069c004d50 2023-10-09T06:26:27.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.015+0000 7f06bacac700 1 --2- 172.21.15.31:0/1185664013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c004d50 0x7f069c0051c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f06a400e210 tx=0x7f06a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36732e0d2ddcf38e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:27.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.015+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a400ea60 con 0x7f069c004d50 2023-10-09T06:26:27.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.015+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a400f040 con 0x7f069c004d50 2023-10-09T06:26:27.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.015+0000 7f06b94a9700 1 -- 172.21.15.31:0/1185664013 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a400ee10 con 0x7f069c004d50 2023-10-09T06:26:27.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.015+0000 7f06bc70f700 1 -- 172.21.15.31:0/1185664013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c004d50 msgr2=0x7f069c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.015+0000 7f06bc70f700 1 --2- 172.21.15.31:0/1185664013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c004d50 0x7f069c0051c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f06a400e210 tx=0x7f06a400b040 comp rx=0 tx=0).stop 2023-10-09T06:26:27.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.015+0000 7f06bacac700 1 -- 172.21.15.31:0/1185664013 reap_dead start 2023-10-09T06:26:27.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.015+0000 7f06bc70f700 1 -- 172.21.15.31:0/1185664013 shutdown_connections 2023-10-09T06:26:27.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.015+0000 7f06bc70f700 1 -- 172.21.15.31:0/1185664013 >> 172.21.15.31:0/1185664013 conn(0x7f06b4069870 msgr2=0x7f06b4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:27.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.015+0000 7f06bc70f700 1 -- 172.21.15.31:0/1185664013 shutdown_connections 2023-10-09T06:26:27.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.015+0000 7f06bc70f700 1 -- 172.21.15.31:0/1185664013 wait complete. 2023-10-09T06:26:27.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.016+0000 7f06bc70f700 1 Processor -- start 2023-10-09T06:26:27.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.016+0000 7f06bc70f700 1 -- start start 2023-10-09T06:26:27.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06bc70f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c004d50 0x7f06b40c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06bc70f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b40b3a90 0x7f06b41501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06bc70f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06b4067660 0x7f06b4159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06bc70f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b40b26d0 con 0x7f069c004d50 2023-10-09T06:26:27.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06bc70f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b41593e0 con 0x7f06b4067660 2023-10-09T06:26:27.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06bc70f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b40b48c0 con 0x7f06b40b3a90 2023-10-09T06:26:27.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06ba4ab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c004d50 0x7f06b40c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06ba4ab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c004d50 0x7f06b40c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35982/0 (socket says 172.21.15.31:35982) 2023-10-09T06:26:27.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06ba4ab700 1 -- 172.21.15.31:0/4011163 learned_addr learned my addr 172.21.15.31:0/4011163 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:27.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06bacac700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06b4067660 0x7f06b4159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06b9caa700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b40b3a90 0x7f06b41501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06ba4ab700 1 -- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b40b3a90 msgr2=0x7f06b41501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06ba4ab700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b40b3a90 0x7f06b41501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06ba4ab700 1 -- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06b4067660 msgr2=0x7f06b4159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06ba4ab700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06b4067660 0x7f06b4159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06ba4ab700 1 -- 172.21.15.31:0/4011163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b40b4020 con 0x7f069c004d50 2023-10-09T06:26:27.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.017+0000 7f06b9caa700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b40b3a90 0x7f06b41501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:27.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.018+0000 7f06ba4ab700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c004d50 0x7f06b40c8920 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f06ac007370 tx=0x7f06b406bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:27.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.018+0000 7f06b27fc700 1 -- 172.21.15.31:0/4011163 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac018030 con 0x7f069c004d50 2023-10-09T06:26:27.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.018+0000 7f06b27fc700 1 -- 172.21.15.31:0/4011163 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac00f8d0 con 0x7f069c004d50 2023-10-09T06:26:27.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.018+0000 7f06bc70f700 1 -- 172.21.15.31:0/4011163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b40b4300 con 0x7f069c004d50 2023-10-09T06:26:27.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.018+0000 7f06b27fc700 1 -- 172.21.15.31:0/4011163 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac00fc70 con 0x7f069c004d50 2023-10-09T06:26:27.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.018+0000 7f06bc70f700 1 -- 172.21.15.31:0/4011163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b40c8e60 con 0x7f069c004d50 2023-10-09T06:26:27.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.019+0000 7f06bc70f700 1 -- 172.21.15.31:0/4011163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b404c3c0 con 0x7f069c004d50 2023-10-09T06:26:27.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.019+0000 7f06b27fc700 1 -- 172.21.15.31:0/4011163 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06ac01b070 con 0x7f069c004d50 2023-10-09T06:26:27.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.019+0000 7f06b27fc700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f06a0066f30 0x7f06a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.020+0000 7f06b27fc700 1 -- 172.21.15.31:0/4011163 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06ac019070 con 0x7f069c004d50 2023-10-09T06:26:27.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.020+0000 7f06b9caa700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f06a0066f30 0x7f06a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.020+0000 7f06b9caa700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f06a0066f30 0x7f06a00693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f06b4069400 tx=0x7f06a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:27.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.024+0000 7f06b27fc700 1 -- 172.21.15.31:0/4011163 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06ac051800 con 0x7f069c004d50 2023-10-09T06:26:27.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.261+0000 7f06bc70f700 1 -- 172.21.15.31:0/4011163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06b406d1b0 con 0x7f069c004d50 2023-10-09T06:26:27.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.262+0000 7f06b27fc700 1 -- 172.21.15.31:0/4011163 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f06ac054e20 con 0x7f069c004d50 2023-10-09T06:26:27.263 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:27.263 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2694953357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2694953357},{"type":"v1","addr":"172.21.15.158:6836","nonce":2694953357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1926052104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1926052104},{"type":"v1","addr":"172.21.15.31:6834","nonce":1926052104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3700277268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3700277268},{"type":"v1","addr":"172.21.15.31:6835","nonce":3700277268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:25:48.239748+0000","modified":"2023-10-09T06:25:51.874363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/3699283833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3699283833},{"type":"v1","addr":"172.21.15.158:6837","nonce":3699283833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T06:26:27.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.264+0000 7f06bc70f700 1 -- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f06a0066f30 msgr2=0x7f06a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.264+0000 7f06bc70f700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f06a0066f30 0x7f06a00693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f06b4069400 tx=0x7f06a8008040 comp rx=0 tx=0).stop 2023-10-09T06:26:27.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.264+0000 7f06bc70f700 1 -- 172.21.15.31:0/4011163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c004d50 msgr2=0x7f06b40c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.264+0000 7f06bc70f700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c004d50 0x7f06b40c8920 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f06ac007370 tx=0x7f06b406bf80 comp rx=0 tx=0).stop 2023-10-09T06:26:27.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.264+0000 7f06bc70f700 1 -- 172.21.15.31:0/4011163 shutdown_connections 2023-10-09T06:26:27.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.264+0000 7f06bc70f700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f06a0066f30 0x7f06a00693e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.264+0000 7f06bc70f700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06b4067660 0x7f06b4159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.264+0000 7f06bc70f700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c004d50 0x7f06b40c8920 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.264+0000 7f06bc70f700 1 --2- 172.21.15.31:0/4011163 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f06b40b3a90 0x7f06b41501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.264+0000 7f06bc70f700 1 -- 172.21.15.31:0/4011163 >> 172.21.15.31:0/4011163 conn(0x7f06b4069870 msgr2=0x7f06b406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:27.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.264+0000 7f06bc70f700 1 -- 172.21.15.31:0/4011163 shutdown_connections 2023-10-09T06:26:27.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.264+0000 7f06bc70f700 1 -- 172.21.15.31:0/4011163 wait complete. 2023-10-09T06:26:27.266 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 50 2023-10-09T06:26:27.277 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:26:27.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.394+0000 7fad2abde700 1 Processor -- start 2023-10-09T06:26:27.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.394+0000 7fad2abde700 1 -- start start 2023-10-09T06:26:27.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.395+0000 7fad2abde700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad2415a620 0x7fad2415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.395+0000 7fad2abde700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fad2415d580 0x7fad24158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.395+0000 7fad2abde700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2415cbb0 con 0x7fad24157870 2023-10-09T06:26:27.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.395+0000 7fad2abde700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2415bdb0 con 0x7fad2415d580 2023-10-09T06:26:27.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.395+0000 7fad2abde700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2415bfa0 con 0x7fad2415a620 2023-10-09T06:26:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.396+0000 7fad2917b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fad2415d580 0x7fad24158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.396+0000 7fad23fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad2415a620 0x7fad2415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.396+0000 7fad2917b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fad2415d580 0x7fad24158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:35282/0 (socket says 172.21.15.31:35282) 2023-10-09T06:26:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.396+0000 7fad2917b700 1 -- 172.21.15.31:0/2244768253 learned_addr learned my addr 172.21.15.31:0/2244768253 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.396+0000 7fad2917b700 1 -- 172.21.15.31:0/2244768253 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad2415a620 msgr2=0x7fad2415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.396+0000 7fad2917b700 1 --2- 172.21.15.31:0/2244768253 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad2415a620 0x7fad2415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.396+0000 7fad2917b700 1 -- 172.21.15.31:0/2244768253 >> v1:172.21.15.158:6789/0 conn(0x7fad24157870 legacy=0x7fad2415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.396+0000 7fad2917b700 1 -- 172.21.15.31:0/2244768253 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2415c280 con 0x7fad2415d580 2023-10-09T06:26:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.396+0000 7fad237fe700 1 -- 172.21.15.31:0/2244768253 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161542977 0 0) 0x7fad2415cbb0 con 0x7fad24157870 2023-10-09T06:26:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.396+0000 7fad2917b700 1 --2- 172.21.15.31:0/2244768253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad2415d580 0x7fad24158110 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0099b0 tx=0x7fad1c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d5fc739e0a39abb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.396+0000 7fad237fe700 1 -- 172.21.15.31:0/2244768253 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c009ea0 con 0x7fad2415d580 2023-10-09T06:26:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.396+0000 7fad237fe700 1 -- 172.21.15.31:0/2244768253 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c00b860 con 0x7fad2415d580 2023-10-09T06:26:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.396+0000 7fad237fe700 1 -- 172.21.15.31:0/2244768253 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c00bc00 con 0x7fad2415d580 2023-10-09T06:26:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.397+0000 7fad2abde700 1 -- 172.21.15.31:0/2244768253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad2415d580 msgr2=0x7fad24158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.397+0000 7fad2abde700 1 --2- 172.21.15.31:0/2244768253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad2415d580 0x7fad24158110 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0099b0 tx=0x7fad1c009250 comp rx=0 tx=0).stop 2023-10-09T06:26:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.397+0000 7fad2abde700 1 -- 172.21.15.31:0/2244768253 shutdown_connections 2023-10-09T06:26:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.397+0000 7fad2abde700 1 --2- 172.21.15.31:0/2244768253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad2415d580 0x7fad24158110 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.397+0000 7fad2abde700 1 --2- 172.21.15.31:0/2244768253 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad2415a620 0x7fad2415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.397+0000 7fad2abde700 1 -- 172.21.15.31:0/2244768253 >> 172.21.15.31:0/2244768253 conn(0x7fad24068ce0 msgr2=0x7fad240690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:27.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.397+0000 7fad2abde700 1 -- 172.21.15.31:0/2244768253 shutdown_connections 2023-10-09T06:26:27.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.397+0000 7fad2abde700 1 -- 172.21.15.31:0/2244768253 wait complete. 2023-10-09T06:26:27.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.398+0000 7fad2abde700 1 Processor -- start 2023-10-09T06:26:27.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.398+0000 7fad2abde700 1 -- start start 2023-10-09T06:26:27.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad2abde700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad24157870 0x7fad240d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad2abde700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2415a620 0x7fad2414bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad2abde700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad2415d580 0x7fad241592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad2abde700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad24159800 con 0x7fad2415a620 2023-10-09T06:26:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad2abde700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad240d0bc0 con 0x7fad24157870 2023-10-09T06:26:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad2abde700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad240d0ea0 con 0x7fad2415d580 2023-10-09T06:26:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad23fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2415a620 0x7fad2414bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad23fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2415a620 0x7fad2414bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35994/0 (socket says 172.21.15.31:35994) 2023-10-09T06:26:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad23fff700 1 -- 172.21.15.31:0/1657878009 learned_addr learned my addr 172.21.15.31:0/1657878009 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad2897a700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad24157870 0x7fad240d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad2917b700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad2415d580 0x7fad241592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad23fff700 1 -- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad2415d580 msgr2=0x7fad241592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad23fff700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad2415d580 0x7fad241592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad23fff700 1 -- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad24157870 msgr2=0x7fad240d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad23fff700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad24157870 0x7fad240d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad23fff700 1 -- 172.21.15.31:0/1657878009 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c0094f0 con 0x7fad2415a620 2023-10-09T06:26:27.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.399+0000 7fad23fff700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2415a620 0x7fad2414bd30 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fad14009eb0 tx=0x7fad1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:27.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.400+0000 7fad20ff9700 1 -- 172.21.15.31:0/1657878009 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1400cb70 con 0x7fad2415a620 2023-10-09T06:26:27.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.400+0000 7fad20ff9700 1 -- 172.21.15.31:0/1657878009 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1400f040 con 0x7fad2415a620 2023-10-09T06:26:27.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.400+0000 7fad2abde700 1 -- 172.21.15.31:0/1657878009 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad240d1180 con 0x7fad2415a620 2023-10-09T06:26:27.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.400+0000 7fad20ff9700 1 -- 172.21.15.31:0/1657878009 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14014480 con 0x7fad2415a620 2023-10-09T06:26:27.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.400+0000 7fad2abde700 1 -- 172.21.15.31:0/1657878009 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad241507b0 con 0x7fad2415a620 2023-10-09T06:26:27.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.401+0000 7fad2abde700 1 -- 172.21.15.31:0/1657878009 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad241509d0 con 0x7fad2415a620 2023-10-09T06:26:27.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.401+0000 7fad20ff9700 1 -- 172.21.15.31:0/1657878009 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad140147f0 con 0x7fad2415a620 2023-10-09T06:26:27.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.401+0000 7fad20ff9700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad04066f30 0x7fad040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.402+0000 7fad20ff9700 1 -- 172.21.15.31:0/1657878009 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad14085150 con 0x7fad2415a620 2023-10-09T06:26:27.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.402+0000 7fad2897a700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad04066f30 0x7fad040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.402+0000 7fad2897a700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad04066f30 0x7fad040693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fad0c007fd0 tx=0x7fad0c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:27.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.406+0000 7fad20ff9700 1 -- 172.21.15.31:0/1657878009 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad140523c0 con 0x7fad2415a620 2023-10-09T06:26:27.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.599+0000 7fad2abde700 1 -- 172.21.15.31:0/1657878009 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad2404c3c0 con 0x7fad2415a620 2023-10-09T06:26:27.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.599+0000 7fad20ff9700 1 -- 172.21.15.31:0/1657878009 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+15357 (secure 0 0 0) 0x7fad140559e0 con 0x7fad2415a620 2023-10-09T06:26:27.600 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:27.600 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":109,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:26:20.962501+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:25:46.157560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T06:25:47.220698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:26:27.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.601+0000 7fad2abde700 1 -- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad04066f30 msgr2=0x7fad040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.601+0000 7fad2abde700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad04066f30 0x7fad040693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fad0c007fd0 tx=0x7fad0c007d30 comp rx=0 tx=0).stop 2023-10-09T06:26:27.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.601+0000 7fad2abde700 1 -- 172.21.15.31:0/1657878009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2415a620 msgr2=0x7fad2414bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.601+0000 7fad2abde700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2415a620 0x7fad2414bd30 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fad14009eb0 tx=0x7fad1400b040 comp rx=0 tx=0).stop 2023-10-09T06:26:27.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.601+0000 7fad2abde700 1 -- 172.21.15.31:0/1657878009 shutdown_connections 2023-10-09T06:26:27.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.601+0000 7fad2abde700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fad04066f30 0x7fad040693e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.601+0000 7fad2abde700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad2415d580 0x7fad241592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.601+0000 7fad2abde700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad24157870 0x7fad240d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.601+0000 7fad2abde700 1 --2- 172.21.15.31:0/1657878009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad2415a620 0x7fad2414bd30 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.601+0000 7fad2abde700 1 -- 172.21.15.31:0/1657878009 >> 172.21.15.31:0/1657878009 conn(0x7fad24068ce0 msgr2=0x7fad240b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:27.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.602+0000 7fad2abde700 1 -- 172.21.15.31:0/1657878009 shutdown_connections 2023-10-09T06:26:27.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.602+0000 7fad2abde700 1 -- 172.21.15.31:0/1657878009 wait complete. 2023-10-09T06:26:27.614 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:26:27.615 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:27.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.733+0000 7f65c1b47700 1 Processor -- start 2023-10-09T06:26:27.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.733+0000 7f65c1b47700 1 -- start start 2023-10-09T06:26:27.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65c1b47700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f65bc0b3430 0x7f65bc164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65c1b47700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc15db80 con 0x7f65bc15a1e0 2023-10-09T06:26:27.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65c1b47700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc15de60 con 0x7f65bc159e10 2023-10-09T06:26:27.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65c1b47700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc15e800 con 0x7f65bc0b3430 2023-10-09T06:26:27.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65baffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f65bc15a1e0 0x7f65bc0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57388/0 (socket says 172.21.15.31:57388) 2023-10-09T06:26:27.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65baffd700 1 -- 172.21.15.31:0/1038128716 learned_addr learned my addr 172.21.15.31:0/1038128716 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:27.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65bbfff700 1 --2- 172.21.15.31:0/1038128716 >> v2:172.21.15.158:3300/0 conn(0x7f65bc0b3430 0x7f65bc164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65ba7fc700 1 -- 172.21.15.31:0/1038128716 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668406999 0 0) 0x7f65bc15db80 con 0x7f65bc15a1e0 2023-10-09T06:26:27.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65ba7fc700 1 -- 172.21.15.31:0/1038128716 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65a4003570 con 0x7f65bc15a1e0 2023-10-09T06:26:27.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65bbfff700 1 -- 172.21.15.31:0/1038128716 >> v1:172.21.15.158:6789/0 conn(0x7f65bc159e10 legacy=0x7f65bc0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65ba7fc700 1 -- 172.21.15.31:0/1038128716 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767607140 0 0) 0x7f65bc15de60 con 0x7f65bc159e10 2023-10-09T06:26:27.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65bbfff700 1 -- 172.21.15.31:0/1038128716 >> v1:172.21.15.31:6789/0 conn(0x7f65bc15a1e0 legacy=0x7f65bc0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65bbfff700 1 -- 172.21.15.31:0/1038128716 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc15e140 con 0x7f65bc0b3430 2023-10-09T06:26:27.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.734+0000 7f65bbfff700 1 --2- 172.21.15.31:0/1038128716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc0b3430 0x7f65bc164e20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009e60 tx=0x7f65b4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c97e2d414fa4b6f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:27.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.735+0000 7f65ba7fc700 1 -- 172.21.15.31:0/1038128716 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400e070 con 0x7f65bc0b3430 2023-10-09T06:26:27.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.735+0000 7f65ba7fc700 1 -- 172.21.15.31:0/1038128716 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b400bb60 con 0x7f65bc0b3430 2023-10-09T06:26:27.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.735+0000 7f65ba7fc700 1 -- 172.21.15.31:0/1038128716 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4012430 con 0x7f65bc0b3430 2023-10-09T06:26:27.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.735+0000 7f65c1b47700 1 -- 172.21.15.31:0/1038128716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc0b3430 msgr2=0x7f65bc164e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.735+0000 7f65c1b47700 1 --2- 172.21.15.31:0/1038128716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc0b3430 0x7f65bc164e20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009e60 tx=0x7f65b4009780 comp rx=0 tx=0).stop 2023-10-09T06:26:27.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.735+0000 7f65c1b47700 1 -- 172.21.15.31:0/1038128716 shutdown_connections 2023-10-09T06:26:27.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.735+0000 7f65c1b47700 1 --2- 172.21.15.31:0/1038128716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc0b3430 0x7f65bc164e20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.735+0000 7f65c1b47700 1 -- 172.21.15.31:0/1038128716 >> 172.21.15.31:0/1038128716 conn(0x7f65bc067660 msgr2=0x7f65bc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:27.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.735+0000 7f65c1b47700 1 -- 172.21.15.31:0/1038128716 shutdown_connections 2023-10-09T06:26:27.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.735+0000 7f65c1b47700 1 -- 172.21.15.31:0/1038128716 wait complete. 2023-10-09T06:26:27.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.736+0000 7f65c1b47700 1 Processor -- start 2023-10-09T06:26:27.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.736+0000 7f65c1b47700 1 -- start start 2023-10-09T06:26:27.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65c1b47700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f65bc0b3430 0x7f65bc1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65c1b47700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc159e10 0x7f65bc0d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65c1b47700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65bc15a1e0 0x7f65bc0c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65c1b47700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0cf240 con 0x7f65bc15a1e0 2023-10-09T06:26:27.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65c1b47700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0ce910 con 0x7f65bc159e10 2023-10-09T06:26:27.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65c1b47700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0cebf0 con 0x7f65bc0b3430 2023-10-09T06:26:27.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65bbfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65bc15a1e0 0x7f65bc0c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65bbfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65bc15a1e0 0x7f65bc0c6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36004/0 (socket says 172.21.15.31:36004) 2023-10-09T06:26:27.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65bbfff700 1 -- 172.21.15.31:0/2480492953 learned_addr learned my addr 172.21.15.31:0/2480492953 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:27.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65bbfff700 1 -- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f65bc0b3430 msgr2=0x7f65bc1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65bb7fe700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f65bc0b3430 0x7f65bc1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65baffd700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc159e10 0x7f65bc0d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65bbfff700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f65bc0b3430 0x7f65bc1585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65bbfff700 1 -- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc159e10 msgr2=0x7f65bc0d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65bbfff700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc159e10 0x7f65bc0d01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.737+0000 7f65bbfff700 1 -- 172.21.15.31:0/2480492953 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b4009a20 con 0x7f65bc15a1e0 2023-10-09T06:26:27.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.738+0000 7f65bbfff700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65bc15a1e0 0x7f65bc0c6c30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0b2310 tx=0x7f65b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:27.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.738+0000 7f65a37fe700 1 -- 172.21.15.31:0/2480492953 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4012e00 con 0x7f65bc15a1e0 2023-10-09T06:26:27.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.738+0000 7f65a37fe700 1 -- 172.21.15.31:0/2480492953 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b401c610 con 0x7f65bc15a1e0 2023-10-09T06:26:27.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.738+0000 7f65a37fe700 1 -- 172.21.15.31:0/2480492953 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b401c9d0 con 0x7f65bc15a1e0 2023-10-09T06:26:27.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.738+0000 7f65c1b47700 1 -- 172.21.15.31:0/2480492953 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc0ceed0 con 0x7f65bc15a1e0 2023-10-09T06:26:27.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.738+0000 7f65c1b47700 1 -- 172.21.15.31:0/2480492953 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc0d0c40 con 0x7f65bc15a1e0 2023-10-09T06:26:27.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.739+0000 7f65c1b47700 1 -- 172.21.15.31:0/2480492953 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc04c3c0 con 0x7f65bc15a1e0 2023-10-09T06:26:27.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.739+0000 7f65a37fe700 1 -- 172.21.15.31:0/2480492953 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65b401b400 con 0x7f65bc15a1e0 2023-10-09T06:26:27.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.740+0000 7f65a37fe700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f65a8066f30 0x7f65a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:27.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.740+0000 7f65a37fe700 1 -- 172.21.15.31:0/2480492953 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f65b4086550 con 0x7f65bc15a1e0 2023-10-09T06:26:27.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.740+0000 7f65bb7fe700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f65a8066f30 0x7f65a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:27.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.741+0000 7f65bb7fe700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f65a8066f30 0x7f65a80693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0011e0 tx=0x7f65ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:27.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.744+0000 7f65a37fe700 1 -- 172.21.15.31:0/2480492953 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65b40537c0 con 0x7f65bc15a1e0 2023-10-09T06:26:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.982+0000 7f65c1b47700 1 -- 172.21.15.31:0/2480492953 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65bc15e420 con 0x7f65bc15a1e0 2023-10-09T06:26:27.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.982+0000 7f65a37fe700 1 -- 172.21.15.31:0/2480492953 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f65b4056de0 con 0x7f65bc15a1e0 2023-10-09T06:26:27.983 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:27.983 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2694953357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2694953357},{"type":"v1","addr":"172.21.15.158:6836","nonce":2694953357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1926052104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1926052104},{"type":"v1","addr":"172.21.15.31:6834","nonce":1926052104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3700277268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3700277268},{"type":"v1","addr":"172.21.15.31:6835","nonce":3700277268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:25:48.239748+0000","modified":"2023-10-09T06:25:51.874363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/3699283833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3699283833},{"type":"v1","addr":"172.21.15.158:6837","nonce":3699283833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T06:26:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.984+0000 7f65c1b47700 1 -- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f65a8066f30 msgr2=0x7f65a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.984+0000 7f65c1b47700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f65a8066f30 0x7f65a80693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0011e0 tx=0x7f65ac009040 comp rx=0 tx=0).stop 2023-10-09T06:26:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.984+0000 7f65c1b47700 1 -- 172.21.15.31:0/2480492953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65bc15a1e0 msgr2=0x7f65bc0c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.984+0000 7f65c1b47700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65bc15a1e0 0x7f65bc0c6c30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0b2310 tx=0x7f65b4019000 comp rx=0 tx=0).stop 2023-10-09T06:26:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.984+0000 7f65c1b47700 1 -- 172.21.15.31:0/2480492953 shutdown_connections 2023-10-09T06:26:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.984+0000 7f65c1b47700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f65a8066f30 0x7f65a80693e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.984+0000 7f65c1b47700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f65bc0b3430 0x7f65bc1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.984+0000 7f65c1b47700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65bc15a1e0 0x7f65bc0c6c30 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.984+0000 7f65c1b47700 1 --2- 172.21.15.31:0/2480492953 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc159e10 0x7f65bc0d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:27.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.984+0000 7f65c1b47700 1 -- 172.21.15.31:0/2480492953 >> 172.21.15.31:0/2480492953 conn(0x7f65bc067660 msgr2=0x7f65bc15d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:27.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.984+0000 7f65c1b47700 1 -- 172.21.15.31:0/2480492953 shutdown_connections 2023-10-09T06:26:27.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:27.984+0000 7f65c1b47700 1 -- 172.21.15.31:0/2480492953 wait complete. 2023-10-09T06:26:27.986 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 50 2023-10-09T06:26:27.997 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:28.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.115+0000 7ff4bd626700 1 Processor -- start 2023-10-09T06:26:28.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.115+0000 7ff4bd626700 1 -- start start 2023-10-09T06:26:28.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.116+0000 7ff4bd626700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff4b8159f10 0x7ff4b80c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.116+0000 7ff4bd626700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b80cc410 0x7ff4b80cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.116+0000 7ff4bd626700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b80ae320 con 0x7ff4b815a2e0 2023-10-09T06:26:28.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.116+0000 7ff4bd626700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b815a760 con 0x7ff4b8159f10 2023-10-09T06:26:28.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.116+0000 7ff4bd626700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80ad710 con 0x7ff4b80cc410 2023-10-09T06:26:28.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.116+0000 7ff4b7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff4b8159f10 0x7ff4b80c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.116+0000 7ff4b77fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff4b815a2e0 0x7ff4b80cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57396/0 (socket says 172.21.15.31:57396) 2023-10-09T06:26:28.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.116+0000 7ff4b7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff4b8159f10 0x7ff4b80c59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36016/0 (socket says 172.21.15.31:36016) 2023-10-09T06:26:28.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.116+0000 7ff4b77fe700 1 -- 172.21.15.31:0/1866281213 learned_addr learned my addr 172.21.15.31:0/1866281213 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:28.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.116+0000 7ff4b7fff700 1 -- 172.21.15.31:0/1866281213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b80cc410 msgr2=0x7ff4b80cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:28.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.116+0000 7ff4bce25700 1 --2- 172.21.15.31:0/1866281213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b80cc410 0x7ff4b80cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.116+0000 7ff4b7fff700 1 --2- 172.21.15.31:0/1866281213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b80cc410 0x7ff4b80cf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4b7fff700 1 -- 172.21.15.31:0/1866281213 >> v1:172.21.15.31:6789/0 conn(0x7ff4b815a2e0 legacy=0x7ff4b80cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4b7fff700 1 -- 172.21.15.31:0/1866281213 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80ad9f0 con 0x7ff4b8159f10 2023-10-09T06:26:28.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.116+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1866281213 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802385731 0 0) 0x7ff4b80ae320 con 0x7ff4b815a2e0 2023-10-09T06:26:28.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4b7fff700 1 --2- 172.21.15.31:0/1866281213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8159f10 0x7ff4b80c59e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80098e0 tx=0x7ff4a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f5672c40bc5510 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:28.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1866281213 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8009e80 con 0x7ff4b8159f10 2023-10-09T06:26:28.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1866281213 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a800b860 con 0x7ff4b8159f10 2023-10-09T06:26:28.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1866281213 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800bbe0 con 0x7ff4b8159f10 2023-10-09T06:26:28.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4bd626700 1 -- 172.21.15.31:0/1866281213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8159f10 msgr2=0x7ff4b80c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4bd626700 1 --2- 172.21.15.31:0/1866281213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8159f10 0x7ff4b80c59e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80098e0 tx=0x7ff4a80091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4bd626700 1 -- 172.21.15.31:0/1866281213 shutdown_connections 2023-10-09T06:26:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4bd626700 1 --2- 172.21.15.31:0/1866281213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8159f10 0x7ff4b80c59e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4bd626700 1 --2- 172.21.15.31:0/1866281213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b80cc410 0x7ff4b80cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4bd626700 1 -- 172.21.15.31:0/1866281213 >> 172.21.15.31:0/1866281213 conn(0x7ff4b8067e40 msgr2=0x7ff4b80d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4bd626700 1 -- 172.21.15.31:0/1866281213 shutdown_connections 2023-10-09T06:26:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.117+0000 7ff4bd626700 1 -- 172.21.15.31:0/1866281213 wait complete. 2023-10-09T06:26:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.118+0000 7ff4bd626700 1 Processor -- start 2023-10-09T06:26:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.119+0000 7ff4bd626700 1 -- start start 2023-10-09T06:26:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.119+0000 7ff4bd626700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4b80cc410 0x7ff4b80b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.119+0000 7ff4bd626700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8159f10 0x7ff4b8155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.119+0000 7ff4bd626700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b815a2e0 0x7ff4b80b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.119+0000 7ff4bd626700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80c8cc0 con 0x7ff4b8159f10 2023-10-09T06:26:28.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.119+0000 7ff4bd626700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80c9520 con 0x7ff4b80cc410 2023-10-09T06:26:28.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.119+0000 7ff4bd626700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b815d440 con 0x7ff4b815a2e0 2023-10-09T06:26:28.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff4b77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8159f10 0x7ff4b8155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff4b77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8159f10 0x7ff4b8155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36026/0 (socket says 172.21.15.31:36026) 2023-10-09T06:26:28.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff4b77fe700 1 -- 172.21.15.31:0/3649324647 learned_addr learned my addr 172.21.15.31:0/3649324647 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:28.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff4b7fff700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4b80cc410 0x7ff4b80b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff4bce25700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b815a2e0 0x7ff4b80b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff4b77fe700 1 -- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b815a2e0 msgr2=0x7ff4b80b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff4b77fe700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b815a2e0 0x7ff4b80b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff4b77fe700 1 -- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4b80cc410 msgr2=0x7ff4b80b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff4b77fe700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4b80cc410 0x7ff4b80b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff4b77fe700 1 -- 172.21.15.31:0/3649324647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8009420 con 0x7ff4b8159f10 2023-10-09T06:26:28.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff4b77fe700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8159f10 0x7ff4b8155ae0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c5b0 tx=0x7ff4ac001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:28.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff49ffff700 1 -- 172.21.15.31:0/3649324647 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac005b30 con 0x7ff4b8159f10 2023-10-09T06:26:28.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff49ffff700 1 -- 172.21.15.31:0/3649324647 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac005c90 con 0x7ff4b8159f10 2023-10-09T06:26:28.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff4bd626700 1 -- 172.21.15.31:0/3649324647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b80c8ed0 con 0x7ff4b8159f10 2023-10-09T06:26:28.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff49ffff700 1 -- 172.21.15.31:0/3649324647 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac007320 con 0x7ff4b8159f10 2023-10-09T06:26:28.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.120+0000 7ff4bd626700 1 -- 172.21.15.31:0/3649324647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b8156020 con 0x7ff4b8159f10 2023-10-09T06:26:28.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.121+0000 7ff4bd626700 1 -- 172.21.15.31:0/3649324647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b8089300 con 0x7ff4b8159f10 2023-10-09T06:26:28.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.122+0000 7ff49ffff700 1 -- 172.21.15.31:0/3649324647 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4ac01b3b0 con 0x7ff4b8159f10 2023-10-09T06:26:28.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.122+0000 7ff49ffff700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4a4066f30 0x7ff4a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.122+0000 7ff49ffff700 1 -- 172.21.15.31:0/3649324647 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4ac083a70 con 0x7ff4b8159f10 2023-10-09T06:26:28.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.122+0000 7ff4b7fff700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4a4066f30 0x7ff4a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.123+0000 7ff4b7fff700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4a4066f30 0x7ff4a40693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80091e0 tx=0x7ff4a8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:28.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.126+0000 7ff49ffff700 1 -- 172.21.15.31:0/3649324647 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4ac050c40 con 0x7ff4b8159f10 2023-10-09T06:26:28.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.365+0000 7ff4bd626700 1 -- 172.21.15.31:0/3649324647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4b80c9370 con 0x7ff4b8159f10 2023-10-09T06:26:28.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.365+0000 7ff49ffff700 1 -- 172.21.15.31:0/3649324647 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4605 (secure 0 0 0) 0x7ff4ac017090 con 0x7ff4b8159f10 2023-10-09T06:26:28.366 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:28.366 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2694953357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2694953357},{"type":"v1","addr":"172.21.15.158:6836","nonce":2694953357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1926052104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1926052104},{"type":"v1","addr":"172.21.15.31:6834","nonce":1926052104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3700277268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3700277268},{"type":"v1","addr":"172.21.15.31:6835","nonce":3700277268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:25:48.239748+0000","modified":"2023-10-09T06:25:51.874363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/3699283833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3699283833},{"type":"v1","addr":"172.21.15.158:6837","nonce":3699283833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T06:26:28.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.367+0000 7ff4bd626700 1 -- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4a4066f30 msgr2=0x7ff4a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.367+0000 7ff4bd626700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4a4066f30 0x7ff4a40693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80091e0 tx=0x7ff4a8017000 comp rx=0 tx=0).stop 2023-10-09T06:26:28.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.367+0000 7ff4bd626700 1 -- 172.21.15.31:0/3649324647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8159f10 msgr2=0x7ff4b8155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.367+0000 7ff4bd626700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8159f10 0x7ff4b8155ae0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c5b0 tx=0x7ff4ac001070 comp rx=0 tx=0).stop 2023-10-09T06:26:28.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.367+0000 7ff4bd626700 1 -- 172.21.15.31:0/3649324647 shutdown_connections 2023-10-09T06:26:28.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.367+0000 7ff4bd626700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4a4066f30 0x7ff4a40693e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.367+0000 7ff4bd626700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b815a2e0 0x7ff4b80b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.367+0000 7ff4bd626700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4b80cc410 0x7ff4b80b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.367+0000 7ff4bd626700 1 --2- 172.21.15.31:0/3649324647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8159f10 0x7ff4b8155ae0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.367+0000 7ff4bd626700 1 -- 172.21.15.31:0/3649324647 >> 172.21.15.31:0/3649324647 conn(0x7ff4b8067e40 msgr2=0x7ff4b80c68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:28.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.368+0000 7ff4bd626700 1 -- 172.21.15.31:0/3649324647 shutdown_connections 2023-10-09T06:26:28.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.368+0000 7ff4bd626700 1 -- 172.21.15.31:0/3649324647 wait complete. 2023-10-09T06:26:28.369 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 50 2023-10-09T06:26:28.380 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:26:28.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.498+0000 7f1ddf3ad700 1 Processor -- start 2023-10-09T06:26:28.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.499+0000 7f1ddf3ad700 1 -- start start 2023-10-09T06:26:28.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.499+0000 7f1ddf3ad700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1dd8157ba0 0x7f1dd806a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.499+0000 7f1ddf3ad700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1dd815b0d0 0x7f1dd806aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.499+0000 7f1ddf3ad700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd815c360 con 0x7f1dd81577d0 2023-10-09T06:26:28.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.499+0000 7f1ddf3ad700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd815b790 con 0x7f1dd815b0d0 2023-10-09T06:26:28.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.499+0000 7f1ddf3ad700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd815d800 con 0x7f1dd8157ba0 2023-10-09T06:26:28.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.500+0000 7f1ddd94a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1dd815b0d0 0x7f1dd806aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.500+0000 7f1ddd94a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1dd815b0d0 0x7f1dd806aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36028/0 (socket says 172.21.15.31:36028) 2023-10-09T06:26:28.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.500+0000 7f1ddd94a700 1 -- 172.21.15.31:0/3645280268 learned_addr learned my addr 172.21.15.31:0/3645280268 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:28.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.500+0000 7f1ddc948700 1 --2- 172.21.15.31:0/3645280268 >> v2:172.21.15.158:3300/0 conn(0x7f1dd8157ba0 0x7f1dd806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.500+0000 7f1ddd94a700 1 -- 172.21.15.31:0/3645280268 >> v2:172.21.15.158:3300/0 conn(0x7f1dd8157ba0 msgr2=0x7f1dd806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:28.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.500+0000 7f1ddd94a700 1 --2- 172.21.15.31:0/3645280268 >> v2:172.21.15.158:3300/0 conn(0x7f1dd8157ba0 0x7f1dd806a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.500+0000 7f1ddd94a700 1 -- 172.21.15.31:0/3645280268 >> v1:172.21.15.158:6789/0 conn(0x7f1dd81577d0 legacy=0x7f1dd80cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.500+0000 7f1ddd94a700 1 -- 172.21.15.31:0/3645280268 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd815ba30 con 0x7f1dd815b0d0 2023-10-09T06:26:28.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.500+0000 7f1ddd94a700 1 --2- 172.21.15.31:0/3645280268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd815b0d0 0x7f1dd806aa60 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80b38b0 tx=0x7f1dc8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab8fcb702ce74cd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:28.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.500+0000 7f1dd7fff700 1 -- 172.21.15.31:0/3645280268 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800e070 con 0x7f1dd815b0d0 2023-10-09T06:26:28.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.500+0000 7f1dd7fff700 1 -- 172.21.15.31:0/3645280268 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800ba20 con 0x7f1dd815b0d0 2023-10-09T06:26:28.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.500+0000 7f1dd7fff700 1 -- 172.21.15.31:0/3645280268 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80092e0 con 0x7f1dd815b0d0 2023-10-09T06:26:28.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.501+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/3645280268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd815b0d0 msgr2=0x7f1dd806aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.501+0000 7f1ddf3ad700 1 --2- 172.21.15.31:0/3645280268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd815b0d0 0x7f1dd806aa60 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80b38b0 tx=0x7f1dc8009840 comp rx=0 tx=0).stop 2023-10-09T06:26:28.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.501+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/3645280268 shutdown_connections 2023-10-09T06:26:28.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.501+0000 7f1ddf3ad700 1 --2- 172.21.15.31:0/3645280268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd815b0d0 0x7f1dd806aa60 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.501+0000 7f1ddf3ad700 1 --2- 172.21.15.31:0/3645280268 >> v2:172.21.15.158:3300/0 conn(0x7f1dd8157ba0 0x7f1dd806a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.501+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/3645280268 >> 172.21.15.31:0/3645280268 conn(0x7f1dd8068ce0 msgr2=0x7f1dd80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:28.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.501+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/3645280268 shutdown_connections 2023-10-09T06:26:28.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.501+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/3645280268 wait complete. 2023-10-09T06:26:28.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.502+0000 7f1ddf3ad700 1 Processor -- start 2023-10-09T06:26:28.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.502+0000 7f1ddf3ad700 1 -- start start 2023-10-09T06:26:28.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddf3ad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd81577d0 0x7f1dd80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddf3ad700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1dd8157ba0 0x7f1dd80b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddf3ad700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1dd815b0d0 0x7f1dd814dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddf3ad700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd80b1370 con 0x7f1dd81577d0 2023-10-09T06:26:28.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddf3ad700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd80b1650 con 0x7f1dd815b0d0 2023-10-09T06:26:28.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddf3ad700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd80b1930 con 0x7f1dd8157ba0 2023-10-09T06:26:28.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddd149700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd81577d0 0x7f1dd80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddd149700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd81577d0 0x7f1dd80d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36040/0 (socket says 172.21.15.31:36040) 2023-10-09T06:26:28.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddd149700 1 -- 172.21.15.31:0/2274737610 learned_addr learned my addr 172.21.15.31:0/2274737610 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:28.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddc948700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1dd8157ba0 0x7f1dd80b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddd94a700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1dd815b0d0 0x7f1dd814dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddd149700 1 -- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1dd8157ba0 msgr2=0x7f1dd80b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddd149700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1dd8157ba0 0x7f1dd80b2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddd149700 1 -- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1dd815b0d0 msgr2=0x7f1dd814dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddd149700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1dd815b0d0 0x7f1dd814dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddd149700 1 -- 172.21.15.31:0/2274737610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8009ae0 con 0x7f1dd81577d0 2023-10-09T06:26:28.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddc948700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1dd8157ba0 0x7f1dd80b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:28.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.503+0000 7f1ddd149700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd81577d0 0x7f1dd80d0c50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000c590 tx=0x7f1dd000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:28.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.504+0000 7f1dd57fa700 1 -- 172.21.15.31:0/2274737610 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0011590 con 0x7f1dd81577d0 2023-10-09T06:26:28.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.504+0000 7f1dd57fa700 1 -- 172.21.15.31:0/2274737610 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd00116f0 con 0x7f1dd81577d0 2023-10-09T06:26:28.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.504+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/2274737610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd80b1c10 con 0x7f1dd81577d0 2023-10-09T06:26:28.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.504+0000 7f1dd57fa700 1 -- 172.21.15.31:0/2274737610 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0011ab0 con 0x7f1dd81577d0 2023-10-09T06:26:28.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.504+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/2274737610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd814e1d0 con 0x7f1dd81577d0 2023-10-09T06:26:28.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.505+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/2274737610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd804c3c0 con 0x7f1dd81577d0 2023-10-09T06:26:28.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.505+0000 7f1dd57fa700 1 -- 172.21.15.31:0/2274737610 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1dd001b3b0 con 0x7f1dd81577d0 2023-10-09T06:26:28.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.506+0000 7f1dd57fa700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1dc4066f30 0x7f1dc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.506+0000 7f1dd57fa700 1 -- 172.21.15.31:0/2274737610 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1dd0083a90 con 0x7f1dd81577d0 2023-10-09T06:26:28.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.506+0000 7f1ddc948700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1dc4066f30 0x7f1dc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.506+0000 7f1ddc948700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1dc4066f30 0x7f1dc40693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009d80 tx=0x7f1dcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:28.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.510+0000 7f1dd57fa700 1 -- 172.21.15.31:0/2274737610 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1dd0050d00 con 0x7f1dd81577d0 2023-10-09T06:26:28.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.705+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/2274737610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dd815bd10 con 0x7f1dd81577d0 2023-10-09T06:26:28.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.706+0000 7f1dd57fa700 1 -- 172.21.15.31:0/2274737610 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+15357 (secure 0 0 0) 0x7f1dd0017020 con 0x7f1dd81577d0 2023-10-09T06:26:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:28.707 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":109,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:26:20.962501+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:25:46.157560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T06:25:47.220698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:26:28.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.708+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1dc4066f30 msgr2=0x7f1dc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.708+0000 7f1ddf3ad700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1dc4066f30 0x7f1dc40693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009d80 tx=0x7f1dcc008040 comp rx=0 tx=0).stop 2023-10-09T06:26:28.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.708+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/2274737610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd81577d0 msgr2=0x7f1dd80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.708+0000 7f1ddf3ad700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd81577d0 0x7f1dd80d0c50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000c590 tx=0x7f1dd000c950 comp rx=0 tx=0).stop 2023-10-09T06:26:28.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.708+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/2274737610 shutdown_connections 2023-10-09T06:26:28.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.708+0000 7f1ddf3ad700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1dc4066f30 0x7f1dc40693e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.708+0000 7f1ddf3ad700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1dd815b0d0 0x7f1dd814dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.708+0000 7f1ddf3ad700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dd81577d0 0x7f1dd80d0c50 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.708+0000 7f1ddf3ad700 1 --2- 172.21.15.31:0/2274737610 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1dd8157ba0 0x7f1dd80b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.708+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/2274737610 >> 172.21.15.31:0/2274737610 conn(0x7f1dd8068ce0 msgr2=0x7f1dd80b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:28.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.708+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/2274737610 shutdown_connections 2023-10-09T06:26:28.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.708+0000 7f1ddf3ad700 1 -- 172.21.15.31:0/2274737610 wait complete. 2023-10-09T06:26:28.721 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:26:28.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.840+0000 7f57ce02a700 1 Processor -- start 2023-10-09T06:26:28.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.840+0000 7f57ce02a700 1 -- start start 2023-10-09T06:26:28.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57ce02a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f57c80cdfa0 0x7f57c80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57ce02a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57c8068f10 0x7f57c8159880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57ce02a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c815db30 con 0x7f57c80693b0 2023-10-09T06:26:28.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57ce02a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c815ddd0 con 0x7f57c8068f10 2023-10-09T06:26:28.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57ce02a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c815e0b0 con 0x7f57c80cdfa0 2023-10-09T06:26:28.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57cc827700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57c8068f10 0x7f57c8159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57cc827700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57c8068f10 0x7f57c8159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36044/0 (socket says 172.21.15.31:36044) 2023-10-09T06:26:28.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57cc827700 1 -- 172.21.15.31:0/4158074365 learned_addr learned my addr 172.21.15.31:0/4158074365 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:28.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57cd028700 1 --2- 172.21.15.31:0/4158074365 >> v2:172.21.15.158:3300/0 conn(0x7f57c80cdfa0 0x7f57c80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57cc827700 1 -- 172.21.15.31:0/4158074365 >> v2:172.21.15.158:3300/0 conn(0x7f57c80cdfa0 msgr2=0x7f57c80ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:28.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57cc827700 1 --2- 172.21.15.31:0/4158074365 >> v2:172.21.15.158:3300/0 conn(0x7f57c80cdfa0 0x7f57c80ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57cc827700 1 -- 172.21.15.31:0/4158074365 >> v1:172.21.15.158:6789/0 conn(0x7f57c80693b0 legacy=0x7f57c8159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57cc827700 1 -- 172.21.15.31:0/4158074365 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c815e390 con 0x7f57c8068f10 2023-10-09T06:26:28.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.841+0000 7f57cd028700 1 --2- 172.21.15.31:0/4158074365 >> v2:172.21.15.158:3300/0 conn(0x7f57c80cdfa0 0x7f57c80ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:28.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.842+0000 7f57cc827700 1 --2- 172.21.15.31:0/4158074365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57c8068f10 0x7f57c8159880 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f57c80643b0 tx=0x7f57bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfac3631c7be9dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:28.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.842+0000 7f57c7fff700 1 -- 172.21.15.31:0/4158074365 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc00b860 con 0x7f57c8068f10 2023-10-09T06:26:28.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.842+0000 7f57c7fff700 1 -- 172.21.15.31:0/4158074365 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc00b9c0 con 0x7f57c8068f10 2023-10-09T06:26:28.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.842+0000 7f57c7fff700 1 -- 172.21.15.31:0/4158074365 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc00bd60 con 0x7f57c8068f10 2023-10-09T06:26:28.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.842+0000 7f57ce02a700 1 -- 172.21.15.31:0/4158074365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57c8068f10 msgr2=0x7f57c8159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.842+0000 7f57ce02a700 1 --2- 172.21.15.31:0/4158074365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57c8068f10 0x7f57c8159880 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f57c80643b0 tx=0x7f57bc009250 comp rx=0 tx=0).stop 2023-10-09T06:26:28.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.842+0000 7f57ce02a700 1 -- 172.21.15.31:0/4158074365 shutdown_connections 2023-10-09T06:26:28.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.842+0000 7f57ce02a700 1 --2- 172.21.15.31:0/4158074365 >> v2:172.21.15.158:3300/0 conn(0x7f57c80cdfa0 0x7f57c80ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.842+0000 7f57ce02a700 1 --2- 172.21.15.31:0/4158074365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57c8068f10 0x7f57c8159880 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.842+0000 7f57ce02a700 1 -- 172.21.15.31:0/4158074365 >> 172.21.15.31:0/4158074365 conn(0x7f57c806c700 msgr2=0x7f57c8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:28.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.842+0000 7f57ce02a700 1 -- 172.21.15.31:0/4158074365 shutdown_connections 2023-10-09T06:26:28.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.842+0000 7f57ce02a700 1 -- 172.21.15.31:0/4158074365 wait complete. 2023-10-09T06:26:28.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.843+0000 7f57ce02a700 1 Processor -- start 2023-10-09T06:26:28.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.843+0000 7f57ce02a700 1 -- start start 2023-10-09T06:26:28.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.844+0000 7f57ce02a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57c8068f10 0x7f57c8144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.844+0000 7f57ce02a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57c80693b0 0x7f57c8145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.844+0000 7f57ce02a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57c80cdfa0 0x7f57c81458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.844+0000 7f57ce02a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c81442f0 con 0x7f57c80693b0 2023-10-09T06:26:28.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.844+0000 7f57ce02a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c8145e00 con 0x7f57c80cdfa0 2023-10-09T06:26:28.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.844+0000 7f57ce02a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c81436e0 con 0x7f57c8068f10 2023-10-09T06:26:28.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.844+0000 7f57cc827700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57c80693b0 0x7f57c8145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.844+0000 7f57cc827700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57c80693b0 0x7f57c8145380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36058/0 (socket says 172.21.15.31:36058) 2023-10-09T06:26:28.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.844+0000 7f57cc827700 1 -- 172.21.15.31:0/21297085 learned_addr learned my addr 172.21.15.31:0/21297085 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:28.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57cd028700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57c8068f10 0x7f57c8144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57cd829700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57c80cdfa0 0x7f57c81458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57cc827700 1 -- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57c8068f10 msgr2=0x7f57c8144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57cc827700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57c8068f10 0x7f57c8144780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57cc827700 1 -- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57c80cdfa0 msgr2=0x7f57c81458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:28.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57cc827700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57c80cdfa0 0x7f57c81458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:28.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57cc827700 1 -- 172.21.15.31:0/21297085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc0094f0 con 0x7f57c80693b0 2023-10-09T06:26:28.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57cd829700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57c80cdfa0 0x7f57c81458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:28.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57cc827700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57c80693b0 0x7f57c8145380 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009290 tx=0x7f57bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:28.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57c57fa700 1 -- 172.21.15.31:0/21297085 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc011e60 con 0x7f57c80693b0 2023-10-09T06:26:28.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57c57fa700 1 -- 172.21.15.31:0/21297085 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc01f070 con 0x7f57c80693b0 2023-10-09T06:26:28.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57ce02a700 1 -- 172.21.15.31:0/21297085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c81439c0 con 0x7f57c80693b0 2023-10-09T06:26:28.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57c57fa700 1 -- 172.21.15.31:0/21297085 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc01a870 con 0x7f57c80693b0 2023-10-09T06:26:28.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.845+0000 7f57ce02a700 1 -- 172.21.15.31:0/21297085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c8143f80 con 0x7f57c80693b0 2023-10-09T06:26:28.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.846+0000 7f57ce02a700 1 -- 172.21.15.31:0/21297085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c81444a0 con 0x7f57c80693b0 2023-10-09T06:26:28.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.846+0000 7f57c57fa700 1 -- 172.21.15.31:0/21297085 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57bc01abe0 con 0x7f57c80693b0 2023-10-09T06:26:28.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.847+0000 7f57c57fa700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57b4066f30 0x7f57b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:28.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.847+0000 7f57c57fa700 1 -- 172.21.15.31:0/21297085 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f57bc021070 con 0x7f57c80693b0 2023-10-09T06:26:28.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.847+0000 7f57cd028700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57b4066f30 0x7f57b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:28.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.848+0000 7f57cd028700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57b4066f30 0x7f57b40693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f57c00076a0 tx=0x7f57c00098f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:28.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:28.851+0000 7f57c57fa700 1 -- 172.21.15.31:0/21297085 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57c81444a0 con 0x7f57c80693b0 2023-10-09T06:26:29.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.094+0000 7f57ce02a700 1 -- 172.21.15.31:0/21297085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f57c806b8b0 con 0x7f57c80693b0 2023-10-09T06:26:29.095 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:26:29.094+0000 7fc5e82b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:26:29.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.098+0000 7f57c57fa700 1 -- 172.21.15.31:0/21297085 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) v1 ==== 161+0+0 (secure 0 0 0) 0x7f57bc053640 con 0x7f57c80693b0 2023-10-09T06:26:29.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.101+0000 7f57ce02a700 1 -- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57b4066f30 msgr2=0x7f57b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:29.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.101+0000 7f57ce02a700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57b4066f30 0x7f57b40693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f57c00076a0 tx=0x7f57c00098f0 comp rx=0 tx=0).stop 2023-10-09T06:26:29.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.101+0000 7f57ce02a700 1 -- 172.21.15.31:0/21297085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57c80693b0 msgr2=0x7f57c8145380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:29.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.101+0000 7f57ce02a700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57c80693b0 0x7f57c8145380 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009290 tx=0x7f57bc017000 comp rx=0 tx=0).stop 2023-10-09T06:26:29.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.101+0000 7f57ce02a700 1 -- 172.21.15.31:0/21297085 shutdown_connections 2023-10-09T06:26:29.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.101+0000 7f57ce02a700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57b4066f30 0x7f57b40693e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:29.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.101+0000 7f57ce02a700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57c8068f10 0x7f57c8144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:29.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.101+0000 7f57ce02a700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57c80cdfa0 0x7f57c81458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:29.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.101+0000 7f57ce02a700 1 --2- 172.21.15.31:0/21297085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57c80693b0 0x7f57c8145380 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:29.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.101+0000 7f57ce02a700 1 -- 172.21.15.31:0/21297085 >> 172.21.15.31:0/21297085 conn(0x7f57c806c700 msgr2=0x7f57c80cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:29.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.101+0000 7f57ce02a700 1 -- 172.21.15.31:0/21297085 shutdown_connections 2023-10-09T06:26:29.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.101+0000 7f57ce02a700 1 -- 172.21.15.31:0/21297085 wait complete. 2023-10-09T06:26:29.103 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:26:29.104 INFO:tasks.ceph.mds.b.smithi158.stderr: -9176> 2023-10-09T06:25:53.836+0000 7f99e496d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:26:29.113 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:26:29.135 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:26:29.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.234+0000 7feecc4d4700 1 Processor -- start 2023-10-09T06:26:29.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.234+0000 7feecc4d4700 1 -- start start 2023-10-09T06:26:29.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.235+0000 7feecc4d4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feec4152300 0x7feec415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:29.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.235+0000 7feecc4d4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feec4158df0 0x7feec40caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:29.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.235+0000 7feecc4d4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec415c8d0 con 0x7feec406d370 2023-10-09T06:26:29.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.235+0000 7feecc4d4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec40b1400 con 0x7feec4158df0 2023-10-09T06:26:29.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.235+0000 7feecc4d4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40c9370 con 0x7feec4152300 2023-10-09T06:26:29.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.235+0000 7feec9a6f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feec4158df0 0x7feec40caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:29.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.235+0000 7feec9a6f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feec4158df0 0x7feec40caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36066/0 (socket says 172.21.15.31:36066) 2023-10-09T06:26:29.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.235+0000 7feec9a6f700 1 -- 172.21.15.31:0/1376800799 learned_addr learned my addr 172.21.15.31:0/1376800799 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:29.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.236+0000 7feeca270700 1 --2- 172.21.15.31:0/1376800799 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feec4152300 0x7feec415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.236+0000 7feec9a6f700 1 -- 172.21.15.31:0/1376800799 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feec4152300 msgr2=0x7feec415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.236+0000 7feec9a6f700 1 --2- 172.21.15.31:0/1376800799 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feec4152300 0x7feec415b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.236+0000 7feec9a6f700 1 -- 172.21.15.31:0/1376800799 >> v1:172.21.15.158:6789/0 conn(0x7feec406d370 legacy=0x7feec406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.236+0000 7feec9a6f700 1 -- 172.21.15.31:0/1376800799 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec415c030 con 0x7feec4158df0 2023-10-09T06:26:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.236+0000 7feec9a6f700 1 --2- 172.21.15.31:0/1376800799 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec4158df0 0x7feec40caaf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7feeb40099b0 tx=0x7feeb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff9921793e6f5cd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.236+0000 7feec926e700 1 -- 172.21.15.31:0/1376800799 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb400b820 con 0x7feec4158df0 2023-10-09T06:26:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.236+0000 7feec926e700 1 -- 172.21.15.31:0/1376800799 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb400b980 con 0x7feec4158df0 2023-10-09T06:26:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.236+0000 7feec926e700 1 -- 172.21.15.31:0/1376800799 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb400bd20 con 0x7feec4158df0 2023-10-09T06:26:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.237+0000 7feecc4d4700 1 -- 172.21.15.31:0/1376800799 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec4158df0 msgr2=0x7feec40caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.237+0000 7feecc4d4700 1 --2- 172.21.15.31:0/1376800799 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec4158df0 0x7feec40caaf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7feeb40099b0 tx=0x7feeb4009250 comp rx=0 tx=0).stop 2023-10-09T06:26:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.237+0000 7feecc4d4700 1 -- 172.21.15.31:0/1376800799 shutdown_connections 2023-10-09T06:26:29.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.237+0000 7feecc4d4700 1 --2- 172.21.15.31:0/1376800799 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feec4152300 0x7feec415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:29.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.237+0000 7feecc4d4700 1 --2- 172.21.15.31:0/1376800799 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec4158df0 0x7feec40caaf0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:29.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.237+0000 7feecc4d4700 1 -- 172.21.15.31:0/1376800799 >> 172.21.15.31:0/1376800799 conn(0x7feec4069870 msgr2=0x7feec4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:29.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.237+0000 7feecc4d4700 1 -- 172.21.15.31:0/1376800799 shutdown_connections 2023-10-09T06:26:29.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.237+0000 7feecc4d4700 1 -- 172.21.15.31:0/1376800799 wait complete. 2023-10-09T06:26:29.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.238+0000 7feecc4d4700 1 Processor -- start 2023-10-09T06:26:29.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.238+0000 7feecc4d4700 1 -- start start 2023-10-09T06:26:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.238+0000 7feecc4d4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feec406d370 0x7feec4158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecc4d4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feec4152300 0x7feec41686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecc4d4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec4158df0 0x7feec40cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecc4d4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec40b2a00 con 0x7feec4158df0 2023-10-09T06:26:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecc4d4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec4158a80 con 0x7feec406d370 2023-10-09T06:26:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecc4d4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40b1c40 con 0x7feec4152300 2023-10-09T06:26:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecaa71700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec4158df0 0x7feec40cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecaa71700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec4158df0 0x7feec40cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36072/0 (socket says 172.21.15.31:36072) 2023-10-09T06:26:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecaa71700 1 -- 172.21.15.31:0/1751409363 learned_addr learned my addr 172.21.15.31:0/1751409363 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feeca270700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feec406d370 0x7feec4158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feec9a6f700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feec4152300 0x7feec41686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecaa71700 1 -- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feec4152300 msgr2=0x7feec41686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecaa71700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feec4152300 0x7feec41686d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecaa71700 1 -- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feec406d370 msgr2=0x7feec4158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecaa71700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feec406d370 0x7feec4158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecaa71700 1 -- 172.21.15.31:0/1751409363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb40094f0 con 0x7feec4158df0 2023-10-09T06:26:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecaa71700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec4158df0 0x7feec40cb570 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7feec000c5b0 tx=0x7feec0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feeba7fc700 1 -- 172.21.15.31:0/1751409363 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0011590 con 0x7feec4158df0 2023-10-09T06:26:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feeba7fc700 1 -- 172.21.15.31:0/1751409363 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0011710 con 0x7feec4158df0 2023-10-09T06:26:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feeba7fc700 1 -- 172.21.15.31:0/1751409363 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0011ad0 con 0x7feec4158df0 2023-10-09T06:26:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecc4d4700 1 -- 172.21.15.31:0/1751409363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec40b4710 con 0x7feec4158df0 2023-10-09T06:26:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.239+0000 7feecc4d4700 1 -- 172.21.15.31:0/1751409363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec40b2690 con 0x7feec4158df0 2023-10-09T06:26:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.240+0000 7feecc4d4700 1 -- 172.21.15.31:0/1751409363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec404c3c0 con 0x7feec4158df0 2023-10-09T06:26:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.241+0000 7feeba7fc700 1 -- 172.21.15.31:0/1751409363 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feec001c460 con 0x7feec4158df0 2023-10-09T06:26:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.241+0000 7feeba7fc700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7feea8066f30 0x7feea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.241+0000 7feeba7fc700 1 -- 172.21.15.31:0/1751409363 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5791+0+0 (secure 0 0 0) 0x7feec0084270 con 0x7feec4158df0 2023-10-09T06:26:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.241+0000 7feeca270700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7feea8066f30 0x7feea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.242+0000 7feeca270700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7feea8066f30 0x7feea80693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feebc00d390 tx=0x7feebc007510 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:29.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.245+0000 7feeba7fc700 1 -- 172.21.15.31:0/1751409363 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feec0051490 con 0x7feec4158df0 2023-10-09T06:26:29.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:29.482+0000 7feecc4d4700 1 -- 172.21.15.31:0/1751409363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7feec40cdf10 con 0x7feec4158df0 2023-10-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.098+0000 7feeba7fc700 1 -- 172.21.15.31:0/1751409363 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) v1 ==== 104+0+0 (secure 0 0 0) 0x7feec0054ab0 con 0x7feec4158df0 2023-10-09T06:26:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.100+0000 7feecc4d4700 1 -- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7feea8066f30 msgr2=0x7feea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.100+0000 7feecc4d4700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7feea8066f30 0x7feea80693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feebc00d390 tx=0x7feebc007510 comp rx=0 tx=0).stop 2023-10-09T06:26:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.100+0000 7feecc4d4700 1 -- 172.21.15.31:0/1751409363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec4158df0 msgr2=0x7feec40cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.100+0000 7feecc4d4700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec4158df0 0x7feec40cb570 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7feec000c5b0 tx=0x7feec0007f60 comp rx=0 tx=0).stop 2023-10-09T06:26:30.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.100+0000 7feecc4d4700 1 -- 172.21.15.31:0/1751409363 shutdown_connections 2023-10-09T06:26:30.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.100+0000 7feecc4d4700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7feea8066f30 0x7feea80693e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:30.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.100+0000 7feecc4d4700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec4158df0 0x7feec40cb570 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:30.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.100+0000 7feecc4d4700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feec406d370 0x7feec4158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:30.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.100+0000 7feecc4d4700 1 --2- 172.21.15.31:0/1751409363 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feec4152300 0x7feec41686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:30.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.100+0000 7feecc4d4700 1 -- 172.21.15.31:0/1751409363 >> 172.21.15.31:0/1751409363 conn(0x7feec4069870 msgr2=0x7feec4159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:30.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.100+0000 7feecc4d4700 1 -- 172.21.15.31:0/1751409363 shutdown_connections 2023-10-09T06:26:30.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.100+0000 7feecc4d4700 1 -- 172.21.15.31:0/1751409363 wait complete. 2023-10-09T06:26:30.114 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:26:30.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.239+0000 7f6d45568700 1 Processor -- start 2023-10-09T06:26:30.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.239+0000 7f6d45568700 1 -- start start 2023-10-09T06:26:30.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.240+0000 7f6d45568700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6d400b6a10 0x7f6d4015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:30.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.240+0000 7f6d45568700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d400b17b0 con 0x7f6d40159ef0 2023-10-09T06:26:30.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.240+0000 7f6d45568700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d400b1a60 con 0x7f6d400b46f0 2023-10-09T06:26:30.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.240+0000 7f6d45568700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d400b1d40 con 0x7f6d400b6a10 2023-10-09T06:26:30.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.240+0000 7f6d3effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6d40159ef0 0x7f6d400b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52440/0 (socket says 172.21.15.31:52440) 2023-10-09T06:26:30.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.240+0000 7f6d3effd700 1 -- 172.21.15.31:0/49298279 learned_addr learned my addr 172.21.15.31:0/49298279 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:30.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3e7fc700 1 --2- 172.21.15.31:0/49298279 >> v2:172.21.15.158:3300/0 conn(0x7f6d400b6a10 0x7f6d4015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:30.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831787017 0 0) 0x7f6d400b17b0 con 0x7f6d40159ef0 2023-10-09T06:26:30.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d2c003570 con 0x7f6d40159ef0 2023-10-09T06:26:30.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410307738 0 0) 0x7f6d400b1a60 con 0x7f6d400b46f0 2023-10-09T06:26:30.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d400b17b0 con 0x7f6d400b46f0 2023-10-09T06:26:30.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1193989546 0 0) 0x7f6d2c003570 con 0x7f6d40159ef0 2023-10-09T06:26:30.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 >> v2:172.21.15.158:3300/0 conn(0x7f6d400b6a10 msgr2=0x7f6d4015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:30.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 --2- 172.21.15.31:0/49298279 >> v2:172.21.15.158:3300/0 conn(0x7f6d400b6a10 0x7f6d4015a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:30.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 >> v1:172.21.15.158:6789/0 conn(0x7f6d400b46f0 legacy=0x7f6d400b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:30.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d400b2020 con 0x7f6d40159ef0 2023-10-09T06:26:30.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f6d380015f0 con 0x7f6d40159ef0 2023-10-09T06:26:30.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 >> v1:172.21.15.31:6789/0 conn(0x7f6d40159ef0 legacy=0x7f6d400b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:30.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 --2- 172.21.15.31:0/49298279 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d2c003bf0 0x7f6d2c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:30.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 --2- 172.21.15.31:0/49298279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c004810 0x7f6d2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 --2- 172.21.15.31:0/49298279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d2c0051c0 0x7f6d2c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400b1d40 con 0x7f6d2c004810 2023-10-09T06:26:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c00c0b0 con 0x7f6d2c0051c0 2023-10-09T06:26:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c00c270 con 0x7f6d2c003bf0 2023-10-09T06:26:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3e7fc700 1 --2- 172.21.15.31:0/49298279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c004810 0x7f6d2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3effd700 1 --2- 172.21.15.31:0/49298279 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d2c003bf0 0x7f6d2c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3f7fe700 1 --2- 172.21.15.31:0/49298279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d2c0051c0 0x7f6d2c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3e7fc700 1 -- 172.21.15.31:0/49298279 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d2c003bf0 msgr2=0x7f6d2c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3e7fc700 1 --2- 172.21.15.31:0/49298279 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d2c003bf0 0x7f6d2c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3e7fc700 1 -- 172.21.15.31:0/49298279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d2c0051c0 msgr2=0x7f6d2c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3e7fc700 1 --2- 172.21.15.31:0/49298279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d2c0051c0 0x7f6d2c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3e7fc700 1 -- 172.21.15.31:0/49298279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c003570 con 0x7f6d2c004810 2023-10-09T06:26:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3f7fe700 1 -- 172.21.15.31:0/49298279 reap_dead start 2023-10-09T06:26:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.241+0000 7f6d3effd700 1 --2- 172.21.15.31:0/49298279 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d2c003bf0 0x7f6d2c003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.242+0000 7f6d3e7fc700 1 --2- 172.21.15.31:0/49298279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c004810 0x7f6d2c004c80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6d400b6e10 tx=0x7f6d280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef001f58262fbea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.242+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2800e710 con 0x7f6d2c004810 2023-10-09T06:26:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.242+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2800e870 con 0x7f6d2c004810 2023-10-09T06:26:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.242+0000 7f6d3dffb700 1 -- 172.21.15.31:0/49298279 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2800ec30 con 0x7f6d2c004810 2023-10-09T06:26:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.242+0000 7f6d45568700 1 -- 172.21.15.31:0/49298279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c004810 msgr2=0x7f6d2c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.242+0000 7f6d45568700 1 --2- 172.21.15.31:0/49298279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c004810 0x7f6d2c004c80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6d400b6e10 tx=0x7f6d280091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:30.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.242+0000 7f6d45568700 1 -- 172.21.15.31:0/49298279 shutdown_connections 2023-10-09T06:26:30.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.242+0000 7f6d45568700 1 --2- 172.21.15.31:0/49298279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c004810 0x7f6d2c004c80 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:30.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.242+0000 7f6d45568700 1 -- 172.21.15.31:0/49298279 >> 172.21.15.31:0/49298279 conn(0x7f6d4009a0a0 msgr2=0x7f6d40067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:30.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.242+0000 7f6d45568700 1 -- 172.21.15.31:0/49298279 shutdown_connections 2023-10-09T06:26:30.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.242+0000 7f6d45568700 1 -- 172.21.15.31:0/49298279 wait complete. 2023-10-09T06:26:30.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.244+0000 7f6d45568700 1 Processor -- start 2023-10-09T06:26:30.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.244+0000 7f6d45568700 1 -- start start 2023-10-09T06:26:30.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.244+0000 7f6d45568700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d2c004810 0x7f6d4015ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:30.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.244+0000 7f6d45568700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d4015efa0 0x7f6d4014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:30.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.244+0000 7f6d45568700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d4014ee20 0x7f6d40156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:30.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.244+0000 7f6d45568700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4014dae0 con 0x7f6d4015efa0 2023-10-09T06:26:30.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.244+0000 7f6d45568700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4015d9c0 con 0x7f6d2c004810 2023-10-09T06:26:30.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.244+0000 7f6d45568700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4015dca0 con 0x7f6d4014ee20 2023-10-09T06:26:30.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d3e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d4015efa0 0x7f6d4014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:30.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d3e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d4015efa0 0x7f6d4014e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48338/0 (socket says 172.21.15.31:48338) 2023-10-09T06:26:30.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d3e7fc700 1 -- 172.21.15.31:0/1022728348 learned_addr learned my addr 172.21.15.31:0/1022728348 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:30.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d3f7fe700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d4014ee20 0x7f6d40156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:30.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d3effd700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d2c004810 0x7f6d4015ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:30.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d3e7fc700 1 -- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d4014ee20 msgr2=0x7f6d40156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:30.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d3e7fc700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d4014ee20 0x7f6d40156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:30.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d3e7fc700 1 -- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d2c004810 msgr2=0x7f6d4015ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:30.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d3e7fc700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d2c004810 0x7f6d4015ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:30.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d3e7fc700 1 -- 172.21.15.31:0/1022728348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4015df80 con 0x7f6d4015efa0 2023-10-09T06:26:30.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d3effd700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d2c004810 0x7f6d4015ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:30.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d3e7fc700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d4015efa0 0x7f6d4014e8e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00c080 tx=0x7f6d2801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:30.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d36ffd700 1 -- 172.21.15.31:0/1022728348 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28022070 con 0x7f6d4015efa0 2023-10-09T06:26:30.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d36ffd700 1 -- 172.21.15.31:0/1022728348 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2800e9e0 con 0x7f6d4015efa0 2023-10-09T06:26:30.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d45568700 1 -- 172.21.15.31:0/1022728348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4015e260 con 0x7f6d4015efa0 2023-10-09T06:26:30.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d36ffd700 1 -- 172.21.15.31:0/1022728348 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2801c450 con 0x7f6d4015efa0 2023-10-09T06:26:30.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.245+0000 7f6d45568700 1 -- 172.21.15.31:0/1022728348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4014d520 con 0x7f6d4015efa0 2023-10-09T06:26:30.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.246+0000 7f6d45568700 1 -- 172.21.15.31:0/1022728348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4004c3c0 con 0x7f6d4015efa0 2023-10-09T06:26:30.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.247+0000 7f6d36ffd700 1 -- 172.21.15.31:0/1022728348 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d2801c880 con 0x7f6d4015efa0 2023-10-09T06:26:30.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.247+0000 7f6d36ffd700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6d20066f60 0x7f6d20069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:30.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.247+0000 7f6d36ffd700 1 -- 172.21.15.31:0/1022728348 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6d28085c40 con 0x7f6d4015efa0 2023-10-09T06:26:30.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.247+0000 7f6d3effd700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6d20066f60 0x7f6d20069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:30.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.248+0000 7f6d3effd700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6d20066f60 0x7f6d20069410 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6d38001720 tx=0x7f6d38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:30.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.251+0000 7f6d36ffd700 1 -- 172.21.15.31:0/1022728348 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d28052f10 con 0x7f6d4015efa0 2023-10-09T06:26:30.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:30.443+0000 7f6d45568700 1 -- 172.21.15.31:0/1022728348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d4014dae0 con 0x7f6d4015efa0 2023-10-09T06:26:31.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.102+0000 7f6d36ffd700 1 -- 172.21.15.31:0/1022728348 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v111) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6d280170d0 con 0x7f6d4015efa0 2023-10-09T06:26:31.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.105+0000 7f6d45568700 1 -- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6d20066f60 msgr2=0x7f6d20069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:31.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.105+0000 7f6d45568700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6d20066f60 0x7f6d20069410 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6d38001720 tx=0x7f6d38009040 comp rx=0 tx=0).stop 2023-10-09T06:26:31.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.105+0000 7f6d45568700 1 -- 172.21.15.31:0/1022728348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d4015efa0 msgr2=0x7f6d4014e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:31.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.105+0000 7f6d45568700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d4015efa0 0x7f6d4014e8e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00c080 tx=0x7f6d2801a000 comp rx=0 tx=0).stop 2023-10-09T06:26:31.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.105+0000 7f6d45568700 1 -- 172.21.15.31:0/1022728348 shutdown_connections 2023-10-09T06:26:31.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.105+0000 7f6d45568700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6d20066f60 0x7f6d20069410 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:31.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.105+0000 7f6d45568700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6d4014ee20 0x7f6d40156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:31.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.105+0000 7f6d45568700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d2c004810 0x7f6d4015ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:31.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.105+0000 7f6d45568700 1 --2- 172.21.15.31:0/1022728348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d4015efa0 0x7f6d4014e8e0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:31.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.105+0000 7f6d45568700 1 -- 172.21.15.31:0/1022728348 >> 172.21.15.31:0/1022728348 conn(0x7f6d4009a0a0 msgr2=0x7f6d40152810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:31.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.105+0000 7f6d45568700 1 -- 172.21.15.31:0/1022728348 shutdown_connections 2023-10-09T06:26:31.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.105+0000 7f6d45568700 1 -- 172.21.15.31:0/1022728348 wait complete. 2023-10-09T06:26:31.107 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:26:31.120 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:26:31.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.247+0000 7f2f53a78700 1 Processor -- start 2023-10-09T06:26:31.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.247+0000 7f2f53a78700 1 -- start start 2023-10-09T06:26:31.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.248+0000 7f2f53a78700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f4c159ef0 0x7f2f4c15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:31.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.248+0000 7f2f53a78700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2f4c0b6a10 0x7f2f4c0b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:31.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.248+0000 7f2f53a78700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2f4c0b15e0 0x7f2f4c0b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:31.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.248+0000 7f2f53a78700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4c0b1a60 con 0x7f2f4c0b15e0 2023-10-09T06:26:31.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.248+0000 7f2f53a78700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4c0b1d40 con 0x7f2f4c0b6a10 2023-10-09T06:26:31.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.248+0000 7f2f53a78700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0b2020 con 0x7f2f4c159ef0 2023-10-09T06:26:31.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.248+0000 7f2f52015700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2f4c0b15e0 0x7f2f4c0b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:31.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.248+0000 7f2f52015700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2f4c0b15e0 0x7f2f4c0b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48340/0 (socket says 172.21.15.31:48340) 2023-10-09T06:26:31.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.248+0000 7f2f52015700 1 -- 172.21.15.31:0/469205786 learned_addr learned my addr 172.21.15.31:0/469205786 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:31.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f52015700 1 -- 172.21.15.31:0/469205786 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f4c159ef0 msgr2=0x7f2f4c15a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:31.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f51013700 1 --2- 172.21.15.31:0/469205786 >> v2:172.21.15.158:3300/0 conn(0x7f2f4c0b6a10 0x7f2f4c0b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:31.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f51814700 1 --2- 172.21.15.31:0/469205786 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f4c159ef0 0x7f2f4c15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:31.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f52015700 1 --2- 172.21.15.31:0/469205786 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f4c159ef0 0x7f2f4c15a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:31.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f52015700 1 -- 172.21.15.31:0/469205786 >> v2:172.21.15.158:3300/0 conn(0x7f2f4c0b6a10 msgr2=0x7f2f4c0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:31.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f52015700 1 --2- 172.21.15.31:0/469205786 >> v2:172.21.15.158:3300/0 conn(0x7f2f4c0b6a10 0x7f2f4c0b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:31.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f52015700 1 -- 172.21.15.31:0/469205786 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c0b2300 con 0x7f2f4c0b15e0 2023-10-09T06:26:31.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f51814700 1 --2- 172.21.15.31:0/469205786 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f4c159ef0 0x7f2f4c15a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:31.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f51013700 1 --2- 172.21.15.31:0/469205786 >> v2:172.21.15.158:3300/0 conn(0x7f2f4c0b6a10 0x7f2f4c0b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:31.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f52015700 1 --2- 172.21.15.31:0/469205786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c0b15e0 0x7f2f4c0b46f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0894b0 tx=0x7f2f3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45303d47af89544 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:31.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f50812700 1 -- 172.21.15.31:0/469205786 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c00b860 con 0x7f2f4c0b15e0 2023-10-09T06:26:31.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f50812700 1 -- 172.21.15.31:0/469205786 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c00b9c0 con 0x7f2f4c0b15e0 2023-10-09T06:26:31.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f50812700 1 -- 172.21.15.31:0/469205786 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c00bd60 con 0x7f2f4c0b15e0 2023-10-09T06:26:31.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f53a78700 1 -- 172.21.15.31:0/469205786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c0b15e0 msgr2=0x7f2f4c0b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:31.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f53a78700 1 --2- 172.21.15.31:0/469205786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c0b15e0 0x7f2f4c0b46f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0894b0 tx=0x7f2f3c009250 comp rx=0 tx=0).stop 2023-10-09T06:26:31.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f53a78700 1 -- 172.21.15.31:0/469205786 shutdown_connections 2023-10-09T06:26:31.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f53a78700 1 --2- 172.21.15.31:0/469205786 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f4c159ef0 0x7f2f4c15a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:31.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f53a78700 1 --2- 172.21.15.31:0/469205786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c0b15e0 0x7f2f4c0b46f0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:31.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f53a78700 1 --2- 172.21.15.31:0/469205786 >> v2:172.21.15.158:3300/0 conn(0x7f2f4c0b6a10 0x7f2f4c0b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:31.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.249+0000 7f2f53a78700 1 -- 172.21.15.31:0/469205786 >> 172.21.15.31:0/469205786 conn(0x7f2f4c09a0a0 msgr2=0x7f2f4c067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:31.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.250+0000 7f2f53a78700 1 -- 172.21.15.31:0/469205786 shutdown_connections 2023-10-09T06:26:31.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.250+0000 7f2f53a78700 1 -- 172.21.15.31:0/469205786 wait complete. 2023-10-09T06:26:31.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.251+0000 7f2f53a78700 1 Processor -- start 2023-10-09T06:26:31.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.251+0000 7f2f53a78700 1 -- start start 2023-10-09T06:26:31.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.251+0000 7f2f53a78700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f4c0b6a10 0x7f2f4c1504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:31.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.251+0000 7f2f53a78700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c159ef0 0x7f2f4c152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:31.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.251+0000 7f2f53a78700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f4c169f80 0x7f2f4c0b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:31.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.251+0000 7f2f53a78700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c1513c0 con 0x7f2f4c159ef0 2023-10-09T06:26:31.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.251+0000 7f2f53a78700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c169850 con 0x7f2f4c0b6a10 2023-10-09T06:26:31.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.251+0000 7f2f53a78700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c152640 con 0x7f2f4c169f80 2023-10-09T06:26:31.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f51013700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c159ef0 0x7f2f4c152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:31.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f51013700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c159ef0 0x7f2f4c152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48346/0 (socket says 172.21.15.31:48346) 2023-10-09T06:26:31.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f51013700 1 -- 172.21.15.31:0/1277952844 learned_addr learned my addr 172.21.15.31:0/1277952844 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:31.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f51814700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f4c0b6a10 0x7f2f4c1504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:31.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f52015700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f4c169f80 0x7f2f4c0b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f51013700 1 -- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f4c169f80 msgr2=0x7f2f4c0b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f51013700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f4c169f80 0x7f2f4c0b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f51013700 1 -- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f4c0b6a10 msgr2=0x7f2f4c1504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f51013700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f4c0b6a10 0x7f2f4c1504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f51013700 1 -- 172.21.15.31:0/1277952844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c0094f0 con 0x7f2f4c159ef0 2023-10-09T06:26:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f51013700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c159ef0 0x7f2f4c152100 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000c880 tx=0x7f2f40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f49ffb700 1 -- 172.21.15.31:0/1277952844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40011600 con 0x7f2f4c159ef0 2023-10-09T06:26:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f49ffb700 1 -- 172.21.15.31:0/1277952844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f40011760 con 0x7f2f4c159ef0 2023-10-09T06:26:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f53a78700 1 -- 172.21.15.31:0/1277952844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c150b20 con 0x7f2f4c159ef0 2023-10-09T06:26:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.252+0000 7f2f49ffb700 1 -- 172.21.15.31:0/1277952844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40011ae0 con 0x7f2f4c159ef0 2023-10-09T06:26:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.253+0000 7f2f53a78700 1 -- 172.21.15.31:0/1277952844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c1510e0 con 0x7f2f4c159ef0 2023-10-09T06:26:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.253+0000 7f2f53a78700 1 -- 172.21.15.31:0/1277952844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4c04c3c0 con 0x7f2f4c159ef0 2023-10-09T06:26:31.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.254+0000 7f2f49ffb700 1 -- 172.21.15.31:0/1277952844 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f40010350 con 0x7f2f4c159ef0 2023-10-09T06:26:31.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.254+0000 7f2f49ffb700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f38066f30 0x7f2f380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:31.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.254+0000 7f2f49ffb700 1 -- 172.21.15.31:0/1277952844 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f2f400843a0 con 0x7f2f4c159ef0 2023-10-09T06:26:31.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.254+0000 7f2f51814700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f38066f30 0x7f2f380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:31.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.255+0000 7f2f51814700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f38066f30 0x7f2f380693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400e600 tx=0x7f2f440076c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:31.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.258+0000 7f2f49ffb700 1 -- 172.21.15.31:0/1277952844 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f40055200 con 0x7f2f4c159ef0 2023-10-09T06:26:31.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:31.451+0000 7f2f53a78700 1 -- 172.21.15.31:0/1277952844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2f4c1585a0 con 0x7f2f4c159ef0 2023-10-09T06:26:32.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.103+0000 7f2f49ffb700 1 -- 172.21.15.31:0/1277952844 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v112) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2f40054d90 con 0x7f2f4c159ef0 2023-10-09T06:26:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.106+0000 7f2f53a78700 1 -- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f38066f30 msgr2=0x7f2f380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.106+0000 7f2f53a78700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f38066f30 0x7f2f380693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400e600 tx=0x7f2f440076c0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.106+0000 7f2f53a78700 1 -- 172.21.15.31:0/1277952844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c159ef0 msgr2=0x7f2f4c152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.106+0000 7f2f53a78700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c159ef0 0x7f2f4c152100 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000c880 tx=0x7f2f40008040 comp rx=0 tx=0).stop 2023-10-09T06:26:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.106+0000 7f2f53a78700 1 -- 172.21.15.31:0/1277952844 shutdown_connections 2023-10-09T06:26:32.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.106+0000 7f2f53a78700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f38066f30 0x7f2f380693e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.106+0000 7f2f53a78700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f4c169f80 0x7f2f4c0b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.106+0000 7f2f53a78700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f4c0b6a10 0x7f2f4c1504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.106+0000 7f2f53a78700 1 --2- 172.21.15.31:0/1277952844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c159ef0 0x7f2f4c152100 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.106+0000 7f2f53a78700 1 -- 172.21.15.31:0/1277952844 >> 172.21.15.31:0/1277952844 conn(0x7f2f4c09a0a0 msgr2=0x7f2f4c158da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:32.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.106+0000 7f2f53a78700 1 -- 172.21.15.31:0/1277952844 shutdown_connections 2023-10-09T06:26:32.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.106+0000 7f2f53a78700 1 -- 172.21.15.31:0/1277952844 wait complete. 2023-10-09T06:26:32.108 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2023-10-09T06:26:32.121 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:26:32.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.246+0000 7fe62e31a700 1 Processor -- start 2023-10-09T06:26:32.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.246+0000 7fe62e31a700 1 -- start start 2023-10-09T06:26:32.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.247+0000 7fe62e31a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6280cc940 0x7fe6280c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:32.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.247+0000 7fe62e31a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe6280ccd10 0x7fe62806f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:32.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.247+0000 7fe62e31a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6280c2420 con 0x7fe62806fb00 2023-10-09T06:26:32.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.247+0000 7fe62e31a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6280c93c0 con 0x7fe6280ccd10 2023-10-09T06:26:32.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.247+0000 7fe62e31a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280c96a0 con 0x7fe6280cc940 2023-10-09T06:26:32.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.248+0000 7fe627fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6280cc940 0x7fe6280c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:32.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.248+0000 7fe61ffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe6280ccd10 0x7fe62806f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:32.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.248+0000 7fe627fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6280cc940 0x7fe6280c28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:48642/0 (socket says 172.21.15.31:48642) 2023-10-09T06:26:32.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.248+0000 7fe627fff700 1 -- 172.21.15.31:0/2500514854 learned_addr learned my addr 172.21.15.31:0/2500514854 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:32.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.248+0000 7fe6277fe700 1 -- 172.21.15.31:0/2500514854 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061599861 0 0) 0x7fe6280c2420 con 0x7fe62806fb00 2023-10-09T06:26:32.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.248+0000 7fe627fff700 1 -- 172.21.15.31:0/2500514854 >> v2:172.21.15.158:3300/0 conn(0x7fe6280ccd10 msgr2=0x7fe62806f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:32.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.248+0000 7fe627fff700 1 --2- 172.21.15.31:0/2500514854 >> v2:172.21.15.158:3300/0 conn(0x7fe6280ccd10 0x7fe62806f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.248+0000 7fe627fff700 1 -- 172.21.15.31:0/2500514854 >> v1:172.21.15.158:6789/0 conn(0x7fe62806fb00 legacy=0x7fe6280cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:32.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.248+0000 7fe627fff700 1 -- 172.21.15.31:0/2500514854 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6280c9980 con 0x7fe6280cc940 2023-10-09T06:26:32.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.248+0000 7fe61ffff700 1 --2- 172.21.15.31:0/2500514854 >> v2:172.21.15.158:3300/0 conn(0x7fe6280ccd10 0x7fe62806f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:26:32.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.248+0000 7fe627fff700 1 --2- 172.21.15.31:0/2500514854 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6280cc940 0x7fe6280c28b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe6180099b0 tx=0x7fe618009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1a814609d06acf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:32.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.249+0000 7fe6277fe700 1 -- 172.21.15.31:0/2500514854 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618009ea0 con 0x7fe6280cc940 2023-10-09T06:26:32.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.249+0000 7fe6277fe700 1 -- 172.21.15.31:0/2500514854 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61800b860 con 0x7fe6280cc940 2023-10-09T06:26:32.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.249+0000 7fe6277fe700 1 -- 172.21.15.31:0/2500514854 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61800bc00 con 0x7fe6280cc940 2023-10-09T06:26:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.249+0000 7fe62e31a700 1 -- 172.21.15.31:0/2500514854 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6280cc940 msgr2=0x7fe6280c28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.249+0000 7fe62e31a700 1 --2- 172.21.15.31:0/2500514854 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6280cc940 0x7fe6280c28b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe6180099b0 tx=0x7fe618009250 comp rx=0 tx=0).stop 2023-10-09T06:26:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.249+0000 7fe62e31a700 1 -- 172.21.15.31:0/2500514854 shutdown_connections 2023-10-09T06:26:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.249+0000 7fe62e31a700 1 --2- 172.21.15.31:0/2500514854 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6280cc940 0x7fe6280c28b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.249+0000 7fe62e31a700 1 --2- 172.21.15.31:0/2500514854 >> v2:172.21.15.158:3300/0 conn(0x7fe6280ccd10 0x7fe62806f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.249+0000 7fe62e31a700 1 -- 172.21.15.31:0/2500514854 >> 172.21.15.31:0/2500514854 conn(0x7fe628067660 msgr2=0x7fe628067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.249+0000 7fe62e31a700 1 -- 172.21.15.31:0/2500514854 shutdown_connections 2023-10-09T06:26:32.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.249+0000 7fe62e31a700 1 -- 172.21.15.31:0/2500514854 wait complete. 2023-10-09T06:26:32.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.250+0000 7fe62e31a700 1 Processor -- start 2023-10-09T06:26:32.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.250+0000 7fe62e31a700 1 -- start start 2023-10-09T06:26:32.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe62e31a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe62806fb00 0x7fe62816a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:32.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe62e31a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6280cc940 0x7fe62815da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:32.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe62e31a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe6280ccd10 0x7fe62816b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:32.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe62e31a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62815bb90 con 0x7fe62806fb00 2023-10-09T06:26:32.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe62e31a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280b06e0 con 0x7fe6280ccd10 2023-10-09T06:26:32.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe62e31a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280b09c0 con 0x7fe6280cc940 2023-10-09T06:26:32.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe627fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe62806fb00 0x7fe62816a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:32.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe627fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe62806fb00 0x7fe62816a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48348/0 (socket says 172.21.15.31:48348) 2023-10-09T06:26:32.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe627fff700 1 -- 172.21.15.31:0/808537337 learned_addr learned my addr 172.21.15.31:0/808537337 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:32.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe62c8b7700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe6280ccd10 0x7fe62816b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:32.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe61ffff700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6280cc940 0x7fe62815da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:32.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe627fff700 1 -- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6280cc940 msgr2=0x7fe62815da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:32.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe627fff700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6280cc940 0x7fe62815da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe627fff700 1 -- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe6280ccd10 msgr2=0x7fe62816b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:32.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe627fff700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe6280ccd10 0x7fe62816b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.251+0000 7fe627fff700 1 -- 172.21.15.31:0/808537337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe610009420 con 0x7fe62806fb00 2023-10-09T06:26:32.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.252+0000 7fe627fff700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe62806fb00 0x7fe62816a210 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe6280c97e0 tx=0x7fe618017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:32.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.252+0000 7fe624ff9700 1 -- 172.21.15.31:0/808537337 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618000d10 con 0x7fe62806fb00 2023-10-09T06:26:32.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.252+0000 7fe624ff9700 1 -- 172.21.15.31:0/808537337 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61800bbe0 con 0x7fe62806fb00 2023-10-09T06:26:32.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.252+0000 7fe62e31a700 1 -- 172.21.15.31:0/808537337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6180094f0 con 0x7fe62806fb00 2023-10-09T06:26:32.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.252+0000 7fe624ff9700 1 -- 172.21.15.31:0/808537337 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618011670 con 0x7fe62806fb00 2023-10-09T06:26:32.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.252+0000 7fe62e31a700 1 -- 172.21.15.31:0/808537337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6280b0f80 con 0x7fe62806fb00 2023-10-09T06:26:32.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.253+0000 7fe62e31a700 1 -- 172.21.15.31:0/808537337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62804c3c0 con 0x7fe62806fb00 2023-10-09T06:26:32.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.253+0000 7fe624ff9700 1 -- 172.21.15.31:0/808537337 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe618011aa0 con 0x7fe62806fb00 2023-10-09T06:26:32.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.254+0000 7fe624ff9700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe608066f30 0x7fe6080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:32.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.254+0000 7fe624ff9700 1 -- 172.21.15.31:0/808537337 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe618085ad0 con 0x7fe62806fb00 2023-10-09T06:26:32.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.254+0000 7fe61ffff700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe608066f30 0x7fe6080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:32.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.254+0000 7fe61ffff700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe608066f30 0x7fe6080693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe62815f480 tx=0x7fe6100091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:32.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.258+0000 7fe624ff9700 1 -- 172.21.15.31:0/808537337 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe618053040 con 0x7fe62806fb00 2023-10-09T06:26:32.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.452+0000 7fe62e31a700 1 -- 172.21.15.31:0/808537337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe6280c20b0 con 0x7fe62806fb00 2023-10-09T06:26:32.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.456+0000 7fe624ff9700 1 -- 172.21.15.31:0/808537337 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe618056660 con 0x7fe62806fb00 2023-10-09T06:26:32.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.458+0000 7fe62e31a700 1 -- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe608066f30 msgr2=0x7fe6080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:32.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.458+0000 7fe62e31a700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe608066f30 0x7fe6080693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe62815f480 tx=0x7fe6100091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.458+0000 7fe62e31a700 1 -- 172.21.15.31:0/808537337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe62806fb00 msgr2=0x7fe62816a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:32.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.458+0000 7fe62e31a700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe62806fb00 0x7fe62816a210 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe6280c97e0 tx=0x7fe618017000 comp rx=0 tx=0).stop 2023-10-09T06:26:32.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.458+0000 7fe62e31a700 1 -- 172.21.15.31:0/808537337 shutdown_connections 2023-10-09T06:26:32.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.458+0000 7fe62e31a700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe608066f30 0x7fe6080693e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.458+0000 7fe62e31a700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe6280ccd10 0x7fe62816b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.458+0000 7fe62e31a700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe62806fb00 0x7fe62816a210 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.458+0000 7fe62e31a700 1 --2- 172.21.15.31:0/808537337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe6280cc940 0x7fe62815da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.458+0000 7fe62e31a700 1 -- 172.21.15.31:0/808537337 >> 172.21.15.31:0/808537337 conn(0x7fe628067660 msgr2=0x7fe62806ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:32.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.458+0000 7fe62e31a700 1 -- 172.21.15.31:0/808537337 shutdown_connections 2023-10-09T06:26:32.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.458+0000 7fe62e31a700 1 -- 172.21.15.31:0/808537337 wait complete. 2023-10-09T06:26:32.471 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-09T06:26:32.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.589+0000 7f0bf9ec6700 1 Processor -- start 2023-10-09T06:26:32.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.589+0000 7f0bf9ec6700 1 -- start start 2023-10-09T06:26:32.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.590+0000 7f0bf9ec6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0bf41568d0 0x7f0bf4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:32.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.590+0000 7f0bf9ec6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0bf40ad9b0 0x7f0bf406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:32.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.590+0000 7f0bf9ec6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf4067ba0 con 0x7f0bf4156ca0 2023-10-09T06:26:32.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.590+0000 7f0bf9ec6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf415aa90 con 0x7f0bf41568d0 2023-10-09T06:26:32.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.590+0000 7f0bf9ec6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf4067870 con 0x7f0bf40ad9b0 2023-10-09T06:26:32.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.590+0000 7f0bf37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0bf41568d0 0x7f0bf4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:32.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.590+0000 7f0bf3fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0bf4156ca0 0x7f0bf40c8090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52444/0 (socket says 172.21.15.31:52444) 2023-10-09T06:26:32.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.590+0000 7f0bf3fff700 1 -- 172.21.15.31:0/1353516272 learned_addr learned my addr 172.21.15.31:0/1353516272 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:32.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.590+0000 7f0bf2ffd700 1 --2- 172.21.15.31:0/1353516272 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0bf40ad9b0 0x7f0bf406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:32.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.591+0000 7f0bf37fe700 1 -- 172.21.15.31:0/1353516272 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0bf40ad9b0 msgr2=0x7f0bf406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:32.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.591+0000 7f0bf37fe700 1 --2- 172.21.15.31:0/1353516272 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0bf40ad9b0 0x7f0bf406a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.591+0000 7f0bf37fe700 1 -- 172.21.15.31:0/1353516272 >> v1:172.21.15.31:6789/0 conn(0x7f0bf4156ca0 legacy=0x7f0bf40c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:32.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.591+0000 7f0bf27fc700 1 -- 172.21.15.31:0/1353516272 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297391876 0 0) 0x7f0bf4067ba0 con 0x7f0bf4156ca0 2023-10-09T06:26:32.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.591+0000 7f0bf37fe700 1 -- 172.21.15.31:0/1353516272 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf40c8ca0 con 0x7f0bf41568d0 2023-10-09T06:26:32.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.591+0000 7f0bf2ffd700 1 --2- 172.21.15.31:0/1353516272 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0bf40ad9b0 0x7f0bf406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:32.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.591+0000 7f0bf37fe700 1 --2- 172.21.15.31:0/1353516272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bf41568d0 0x7f0bf4069e20 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f0be40098e0 tx=0x7f0be40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d2e5d958957af5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:32.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.591+0000 7f0bf27fc700 1 -- 172.21.15.31:0/1353516272 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4009e80 con 0x7f0bf41568d0 2023-10-09T06:26:32.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.591+0000 7f0bf27fc700 1 -- 172.21.15.31:0/1353516272 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be400b860 con 0x7f0bf41568d0 2023-10-09T06:26:32.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.591+0000 7f0bf27fc700 1 -- 172.21.15.31:0/1353516272 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400bbe0 con 0x7f0bf41568d0 2023-10-09T06:26:32.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.592+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/1353516272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bf41568d0 msgr2=0x7f0bf4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:32.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.592+0000 7f0bf9ec6700 1 --2- 172.21.15.31:0/1353516272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bf41568d0 0x7f0bf4069e20 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f0be40098e0 tx=0x7f0be40091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.592+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/1353516272 shutdown_connections 2023-10-09T06:26:32.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.592+0000 7f0bf9ec6700 1 --2- 172.21.15.31:0/1353516272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bf41568d0 0x7f0bf4069e20 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.592+0000 7f0bf9ec6700 1 --2- 172.21.15.31:0/1353516272 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0bf40ad9b0 0x7f0bf406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.592+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/1353516272 >> 172.21.15.31:0/1353516272 conn(0x7f0bf40cda50 msgr2=0x7f0bf40cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.592+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/1353516272 shutdown_connections 2023-10-09T06:26:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.592+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/1353516272 wait complete. 2023-10-09T06:26:32.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.593+0000 7f0bf9ec6700 1 Processor -- start 2023-10-09T06:26:32.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.593+0000 7f0bf9ec6700 1 -- start start 2023-10-09T06:26:32.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf9ec6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bf40ad9b0 0x7f0bf40b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:32.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf9ec6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0bf41568d0 0x7f0bf40c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:32.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf9ec6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0bf4156ca0 0x7f0bf4159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:32.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf9ec6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf4159150 con 0x7f0bf40ad9b0 2023-10-09T06:26:32.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf9ec6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf41582a0 con 0x7f0bf41568d0 2023-10-09T06:26:32.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf9ec6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf40b3720 con 0x7f0bf4156ca0 2023-10-09T06:26:32.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bf40ad9b0 0x7f0bf40b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:32.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bf40ad9b0 0x7f0bf40b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48364/0 (socket says 172.21.15.31:48364) 2023-10-09T06:26:32.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf37fe700 1 -- 172.21.15.31:0/2624881556 learned_addr learned my addr 172.21.15.31:0/2624881556 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:32.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf37fe700 1 -- 172.21.15.31:0/2624881556 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0bf4156ca0 msgr2=0x7f0bf4159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:32.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf37fe700 1 --2- 172.21.15.31:0/2624881556 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0bf4156ca0 0x7f0bf4159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf37fe700 1 -- 172.21.15.31:0/2624881556 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0bf41568d0 msgr2=0x7f0bf40c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:32.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf37fe700 1 --2- 172.21.15.31:0/2624881556 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0bf41568d0 0x7f0bf40c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:32.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf37fe700 1 -- 172.21.15.31:0/2624881556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be4009420 con 0x7f0bf40ad9b0 2023-10-09T06:26:32.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf37fe700 1 --2- 172.21.15.31:0/2624881556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bf40ad9b0 0x7f0bf40b31e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40ce880 tx=0x7f0be4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:32.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bdb7fe700 1 -- 172.21.15.31:0/2624881556 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400bbe0 con 0x7f0bf40ad9b0 2023-10-09T06:26:32.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bdb7fe700 1 -- 172.21.15.31:0/2624881556 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be4011420 con 0x7f0bf40ad9b0 2023-10-09T06:26:32.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/2624881556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf40c42e0 con 0x7f0bf40ad9b0 2023-10-09T06:26:32.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bdb7fe700 1 -- 172.21.15.31:0/2624881556 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40117c0 con 0x7f0bf40ad9b0 2023-10-09T06:26:32.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.594+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/2624881556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf4158820 con 0x7f0bf40ad9b0 2023-10-09T06:26:32.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.595+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/2624881556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf404c3c0 con 0x7f0bf40ad9b0 2023-10-09T06:26:32.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.596+0000 7f0bdb7fe700 1 -- 172.21.15.31:0/2624881556 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0be4011bf0 con 0x7f0bf40ad9b0 2023-10-09T06:26:32.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.596+0000 7f0bdb7fe700 1 --2- 172.21.15.31:0/2624881556 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0be0066f30 0x7f0be00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:32.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.596+0000 7f0bdb7fe700 1 -- 172.21.15.31:0/2624881556 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0be4085c20 con 0x7f0bf40ad9b0 2023-10-09T06:26:32.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.596+0000 7f0bf2ffd700 1 --2- 172.21.15.31:0/2624881556 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0be0066f30 0x7f0be00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:32.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.597+0000 7f0bf2ffd700 1 --2- 172.21.15.31:0/2624881556 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0be0066f30 0x7f0be00693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0be8006f00 tx=0x7f0be8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:32.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.601+0000 7f0bdb7fe700 1 -- 172.21.15.31:0/2624881556 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0be4053190 con 0x7f0bf40ad9b0 2023-10-09T06:26:32.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:32.877+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/2624881556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f0bf40c8f80 con 0x7f0bf40ad9b0 2023-10-09T06:26:33.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.106+0000 7f0bdb7fe700 1 -- 172.21.15.31:0/2624881556 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v288) v1 ==== 137+0+0 (secure 0 0 0) 0x7f0be40567b0 con 0x7f0bf40ad9b0 2023-10-09T06:26:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.108+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/2624881556 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0be0066f30 msgr2=0x7f0be00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.108+0000 7f0bf9ec6700 1 --2- 172.21.15.31:0/2624881556 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0be0066f30 0x7f0be00693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0be8006f00 tx=0x7f0be8008040 comp rx=0 tx=0).stop 2023-10-09T06:26:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.108+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/2624881556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bf40ad9b0 msgr2=0x7f0bf40b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.108+0000 7f0bf9ec6700 1 --2- 172.21.15.31:0/2624881556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bf40ad9b0 0x7f0bf40b31e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40ce880 tx=0x7f0be4017000 comp rx=0 tx=0).stop 2023-10-09T06:26:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.108+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/2624881556 shutdown_connections 2023-10-09T06:26:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.108+0000 7f0bf9ec6700 1 --2- 172.21.15.31:0/2624881556 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0be0066f30 0x7f0be00693e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.108+0000 7f0bf9ec6700 1 --2- 172.21.15.31:0/2624881556 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0bf4156ca0 0x7f0bf4159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:33.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.108+0000 7f0bf9ec6700 1 --2- 172.21.15.31:0/2624881556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bf40ad9b0 0x7f0bf40b31e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:33.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.108+0000 7f0bf9ec6700 1 --2- 172.21.15.31:0/2624881556 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0bf41568d0 0x7f0bf40c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:33.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.108+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/2624881556 >> 172.21.15.31:0/2624881556 conn(0x7f0bf40cda50 msgr2=0x7f0bf4068030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:33.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.108+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/2624881556 shutdown_connections 2023-10-09T06:26:33.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.108+0000 7f0bf9ec6700 1 -- 172.21.15.31:0/2624881556 wait complete. 2023-10-09T06:26:33.121 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-09T06:26:33.121 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-09T06:26:33.121 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-10-09T06:26:33.122 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-09T06:26:33.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.241+0000 7ff3123a8700 1 Processor -- start 2023-10-09T06:26:33.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.241+0000 7ff3123a8700 1 -- start start 2023-10-09T06:26:33.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.242+0000 7ff3123a8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff30c159e10 0x7ff30c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:33.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.242+0000 7ff3123a8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff30c15a1e0 0x7ff30c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:33.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.242+0000 7ff3123a8700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30c15db80 con 0x7ff30c0b1610 2023-10-09T06:26:33.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.242+0000 7ff3123a8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30c15e800 con 0x7ff30c15a1e0 2023-10-09T06:26:33.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.242+0000 7ff3123a8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c15de60 con 0x7ff30c159e10 2023-10-09T06:26:33.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.242+0000 7ff30bfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff30c159e10 0x7ff30c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:33.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.242+0000 7ff30b7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff30c15a1e0 0x7ff30c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:33.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.242+0000 7ff30b7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff30c15a1e0 0x7ff30c0b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:40972/0 (socket says 172.21.15.31:40972) 2023-10-09T06:26:33.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.242+0000 7ff30bfff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff30c159e10 0x7ff30c0b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:48692/0 (socket says 172.21.15.31:48692) 2023-10-09T06:26:33.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.242+0000 7ff30b7fe700 1 -- 172.21.15.31:0/1159982240 learned_addr learned my addr 172.21.15.31:0/1159982240 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:33.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.242+0000 7ff310945700 1 --1- 172.21.15.31:0/1159982240 >> v1:172.21.15.158:6789/0 conn(0x7ff30c0b1610 0x7ff30c0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:46584/0 (socket says 172.21.15.31:46584) 2023-10-09T06:26:33.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.243+0000 7ff30bfff700 1 -- 172.21.15.31:0/1159982240 >> v2:172.21.15.158:3300/0 conn(0x7ff30c15a1e0 msgr2=0x7ff30c0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:33.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.243+0000 7ff30bfff700 1 --2- 172.21.15.31:0/1159982240 >> v2:172.21.15.158:3300/0 conn(0x7ff30c15a1e0 0x7ff30c0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:33.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.243+0000 7ff30bfff700 1 -- 172.21.15.31:0/1159982240 >> v1:172.21.15.158:6789/0 conn(0x7ff30c0b1610 legacy=0x7ff30c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.243+0000 7ff30bfff700 1 -- 172.21.15.31:0/1159982240 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30c15e140 con 0x7ff30c159e10 2023-10-09T06:26:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.243+0000 7ff30b7fe700 1 --2- 172.21.15.31:0/1159982240 >> v2:172.21.15.158:3300/0 conn(0x7ff30c15a1e0 0x7ff30c0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:26:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.243+0000 7ff30bfff700 1 --2- 172.21.15.31:0/1159982240 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff30c159e10 0x7ff30c0b2d20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0098e0 tx=0x7ff2fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f955e3d8066f3654 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.243+0000 7ff30affd700 1 -- 172.21.15.31:0/1159982240 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc00b640 con 0x7ff30c159e10 2023-10-09T06:26:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.243+0000 7ff30affd700 1 -- 172.21.15.31:0/1159982240 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc00b7a0 con 0x7ff30c159e10 2023-10-09T06:26:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.243+0000 7ff30affd700 1 -- 172.21.15.31:0/1159982240 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc00bb40 con 0x7ff30c159e10 2023-10-09T06:26:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.244+0000 7ff3123a8700 1 -- 172.21.15.31:0/1159982240 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff30c159e10 msgr2=0x7ff30c0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.244+0000 7ff3123a8700 1 --2- 172.21.15.31:0/1159982240 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff30c159e10 0x7ff30c0b2d20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0098e0 tx=0x7ff2fc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.244+0000 7ff3123a8700 1 -- 172.21.15.31:0/1159982240 shutdown_connections 2023-10-09T06:26:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.244+0000 7ff3123a8700 1 --2- 172.21.15.31:0/1159982240 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff30c159e10 0x7ff30c0b2d20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.244+0000 7ff3123a8700 1 --2- 172.21.15.31:0/1159982240 >> v2:172.21.15.158:3300/0 conn(0x7ff30c15a1e0 0x7ff30c0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:33.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.244+0000 7ff3123a8700 1 -- 172.21.15.31:0/1159982240 >> 172.21.15.31:0/1159982240 conn(0x7ff30c067660 msgr2=0x7ff30c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:33.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.244+0000 7ff3123a8700 1 -- 172.21.15.31:0/1159982240 shutdown_connections 2023-10-09T06:26:33.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.244+0000 7ff3123a8700 1 -- 172.21.15.31:0/1159982240 wait complete. 2023-10-09T06:26:33.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.245+0000 7ff3123a8700 1 Processor -- start 2023-10-09T06:26:33.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.245+0000 7ff3123a8700 1 -- start start 2023-10-09T06:26:33.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff3123a8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff30c0b1610 0x7ff30c1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:33.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff3123a8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30c159e10 0x7ff30c0cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:33.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff3123a8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff30c15a1e0 0x7ff30c0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:33.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff3123a8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c0cef60 con 0x7ff30c159e10 2023-10-09T06:26:33.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff3123a8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c0c72f0 con 0x7ff30c15a1e0 2023-10-09T06:26:33.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff3123a8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c0c75d0 con 0x7ff30c0b1610 2023-10-09T06:26:33.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff30b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30c159e10 0x7ff30c0cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:33.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff30b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30c159e10 0x7ff30c0cf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48368/0 (socket says 172.21.15.31:48368) 2023-10-09T06:26:33.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff30b7fe700 1 -- 172.21.15.31:0/3569299142 learned_addr learned my addr 172.21.15.31:0/3569299142 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:33.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff30bfff700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff30c0b1610 0x7ff30c1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:33.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff310945700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff30c15a1e0 0x7ff30c0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:33.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff30b7fe700 1 -- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff30c0b1610 msgr2=0x7ff30c1584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:33.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff30b7fe700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff30c0b1610 0x7ff30c1584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:33.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff30b7fe700 1 -- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff30c15a1e0 msgr2=0x7ff30c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:33.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff30b7fe700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff30c15a1e0 0x7ff30c0c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:33.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff30b7fe700 1 -- 172.21.15.31:0/3569299142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f40094f0 con 0x7ff30c159e10 2023-10-09T06:26:33.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff310945700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff30c15a1e0 0x7ff30c0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:33.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff30b7fe700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30c159e10 0x7ff30c0cf3f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400ec50 tx=0x7ff2f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:33.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.246+0000 7ff303fff700 1 -- 172.21.15.31:0/3569299142 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f400c9d0 con 0x7ff30c159e10 2023-10-09T06:26:33.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.247+0000 7ff303fff700 1 -- 172.21.15.31:0/3569299142 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f400cb30 con 0x7ff30c159e10 2023-10-09T06:26:33.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.247+0000 7ff303fff700 1 -- 172.21.15.31:0/3569299142 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4013470 con 0x7ff30c159e10 2023-10-09T06:26:33.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.247+0000 7ff3123a8700 1 -- 172.21.15.31:0/3569299142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc009420 con 0x7ff30c159e10 2023-10-09T06:26:33.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.247+0000 7ff3123a8700 1 -- 172.21.15.31:0/3569299142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30c0cebf0 con 0x7ff30c159e10 2023-10-09T06:26:33.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.247+0000 7ff3123a8700 1 -- 172.21.15.31:0/3569299142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30c04c3c0 con 0x7ff30c159e10 2023-10-09T06:26:33.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.248+0000 7ff303fff700 1 -- 172.21.15.31:0/3569299142 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2f4013860 con 0x7ff30c159e10 2023-10-09T06:26:33.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.248+0000 7ff303fff700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff2ec066f30 0x7ff2ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:33.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.248+0000 7ff303fff700 1 -- 172.21.15.31:0/3569299142 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff2f4084970 con 0x7ff30c159e10 2023-10-09T06:26:33.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.248+0000 7ff30bfff700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff2ec066f30 0x7ff2ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:33.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.249+0000 7ff30bfff700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff2ec066f30 0x7ff2ec0693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0093f0 tx=0x7ff2fc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:33.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.252+0000 7ff303fff700 1 -- 172.21.15.31:0/3569299142 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2f4051ee0 con 0x7ff30c159e10 2023-10-09T06:26:33.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:33.526+0000 7ff3123a8700 1 -- 172.21.15.31:0/3569299142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7ff30c0cf0a0 con 0x7ff30c159e10 2023-10-09T06:26:34.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.106+0000 7ff303fff700 1 -- 172.21.15.31:0/3569299142 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v289) v1 ==== 131+0+0 (secure 0 0 0) 0x7ff2f40170c0 con 0x7ff30c159e10 2023-10-09T06:26:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.108+0000 7ff3123a8700 1 -- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff2ec066f30 msgr2=0x7ff2ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.108+0000 7ff3123a8700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff2ec066f30 0x7ff2ec0693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0093f0 tx=0x7ff2fc017000 comp rx=0 tx=0).stop 2023-10-09T06:26:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.108+0000 7ff3123a8700 1 -- 172.21.15.31:0/3569299142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30c159e10 msgr2=0x7ff30c0cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.108+0000 7ff3123a8700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30c159e10 0x7ff30c0cf3f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400ec50 tx=0x7ff2f4009250 comp rx=0 tx=0).stop 2023-10-09T06:26:34.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.108+0000 7ff3123a8700 1 -- 172.21.15.31:0/3569299142 shutdown_connections 2023-10-09T06:26:34.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.108+0000 7ff3123a8700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff2ec066f30 0x7ff2ec0693e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.108+0000 7ff3123a8700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff30c0b1610 0x7ff30c1584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.108+0000 7ff3123a8700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff30c15a1e0 0x7ff30c0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.108+0000 7ff3123a8700 1 --2- 172.21.15.31:0/3569299142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30c159e10 0x7ff30c0cf3f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.108+0000 7ff3123a8700 1 -- 172.21.15.31:0/3569299142 >> 172.21.15.31:0/3569299142 conn(0x7ff30c067660 msgr2=0x7ff30c0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:34.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.108+0000 7ff3123a8700 1 -- 172.21.15.31:0/3569299142 shutdown_connections 2023-10-09T06:26:34.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.108+0000 7ff3123a8700 1 -- 172.21.15.31:0/3569299142 wait complete. 2023-10-09T06:26:34.122 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:26:34.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.245+0000 7fbfb091c700 1 Processor -- start 2023-10-09T06:26:34.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.245+0000 7fbfb091c700 1 -- start start 2023-10-09T06:26:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfb091c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbfac0678b0 0x7fbfac15db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfb091c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfac0c9390 0x7fbfac15a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfb091c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfac0cae70 con 0x7fbfac0cbf10 2023-10-09T06:26:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfb091c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac0cb150 con 0x7fbfac0678b0 2023-10-09T06:26:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfb091c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0cb430 con 0x7fbfac0c9390 2023-10-09T06:26:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfaa59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbfac0678b0 0x7fbfac15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfaa59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbfac0678b0 0x7fbfac15db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48370/0 (socket says 172.21.15.31:48370) 2023-10-09T06:26:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfaa59c700 1 -- 172.21.15.31:0/1796752288 learned_addr learned my addr 172.21.15.31:0/1796752288 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfaad9d700 1 --2- 172.21.15.31:0/1796752288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfac0c9390 0x7fbfac15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfaa59c700 1 -- 172.21.15.31:0/1796752288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfac0c9390 msgr2=0x7fbfac15a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfaa59c700 1 --2- 172.21.15.31:0/1796752288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfac0c9390 0x7fbfac15a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfaa59c700 1 -- 172.21.15.31:0/1796752288 >> v1:172.21.15.158:6789/0 conn(0x7fbfac0cbf10 legacy=0x7fbfac15e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfaa59c700 1 -- 172.21.15.31:0/1796752288 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac0cb710 con 0x7fbfac0678b0 2023-10-09T06:26:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfaa59c700 1 --2- 172.21.15.31:0/1796752288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfac0678b0 0x7fbfac15db80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40099b0 tx=0x7fbfa4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8678914c92a6bb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfa959a700 1 -- 172.21.15.31:0/1796752288 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa400b860 con 0x7fbfac0678b0 2023-10-09T06:26:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfa959a700 1 -- 172.21.15.31:0/1796752288 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa400b9c0 con 0x7fbfac0678b0 2023-10-09T06:26:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.246+0000 7fbfa959a700 1 -- 172.21.15.31:0/1796752288 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa400bd60 con 0x7fbfac0678b0 2023-10-09T06:26:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.247+0000 7fbfb091c700 1 -- 172.21.15.31:0/1796752288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfac0678b0 msgr2=0x7fbfac15db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.247+0000 7fbfb091c700 1 --2- 172.21.15.31:0/1796752288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfac0678b0 0x7fbfac15db80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40099b0 tx=0x7fbfa4009250 comp rx=0 tx=0).stop 2023-10-09T06:26:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.247+0000 7fbfb091c700 1 -- 172.21.15.31:0/1796752288 shutdown_connections 2023-10-09T06:26:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.247+0000 7fbfb091c700 1 --2- 172.21.15.31:0/1796752288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfac0678b0 0x7fbfac15db80 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.247+0000 7fbfb091c700 1 --2- 172.21.15.31:0/1796752288 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfac0c9390 0x7fbfac15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.247+0000 7fbfb091c700 1 -- 172.21.15.31:0/1796752288 >> 172.21.15.31:0/1796752288 conn(0x7fbfac069870 msgr2=0x7fbfac069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:34.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.247+0000 7fbfb091c700 1 -- 172.21.15.31:0/1796752288 shutdown_connections 2023-10-09T06:26:34.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.247+0000 7fbfb091c700 1 -- 172.21.15.31:0/1796752288 wait complete. 2023-10-09T06:26:34.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.248+0000 7fbfb091c700 1 Processor -- start 2023-10-09T06:26:34.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.248+0000 7fbfb091c700 1 -- start start 2023-10-09T06:26:34.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfb091c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfac0678b0 0x7fbfac1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:34.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfb091c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfac0c9390 0x7fbfac1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:34.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfb091c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfac0cbf10 0x7fbfac152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:34.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfb091c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac151a10 con 0x7fbfac0678b0 2023-10-09T06:26:34.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfb091c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac154250 con 0x7fbfac0cbf10 2023-10-09T06:26:34.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfb091c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac153370 con 0x7fbfac0c9390 2023-10-09T06:26:34.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfaa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfac0678b0 0x7fbfac1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:34.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfaa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfac0678b0 0x7fbfac1573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48384/0 (socket says 172.21.15.31:48384) 2023-10-09T06:26:34.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfaa59c700 1 -- 172.21.15.31:0/4081139404 learned_addr learned my addr 172.21.15.31:0/4081139404 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:34.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfa9d9b700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfac0c9390 0x7fbfac1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:34.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfaad9d700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfac0cbf10 0x7fbfac152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:34.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfaa59c700 1 -- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfac0c9390 msgr2=0x7fbfac1514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:34.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfaa59c700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfac0c9390 0x7fbfac1514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfaa59c700 1 -- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfac0cbf10 msgr2=0x7fbfac152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:34.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfaa59c700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfac0cbf10 0x7fbfac152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.249+0000 7fbfaa59c700 1 -- 172.21.15.31:0/4081139404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa40094f0 con 0x7fbfac0678b0 2023-10-09T06:26:34.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.250+0000 7fbfaa59c700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfac0678b0 0x7fbfac1573b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbfac06a380 tx=0x7fbfa4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:34.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.250+0000 7fbfa27fc700 1 -- 172.21.15.31:0/4081139404 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4011e40 con 0x7fbfac0678b0 2023-10-09T06:26:34.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.250+0000 7fbfa27fc700 1 -- 172.21.15.31:0/4081139404 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa4024440 con 0x7fbfac0678b0 2023-10-09T06:26:34.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.250+0000 7fbfb091c700 1 -- 172.21.15.31:0/4081139404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac14f7c0 con 0x7fbfac0678b0 2023-10-09T06:26:34.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.250+0000 7fbfa27fc700 1 -- 172.21.15.31:0/4081139404 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4024800 con 0x7fbfac0678b0 2023-10-09T06:26:34.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.250+0000 7fbfb091c700 1 -- 172.21.15.31:0/4081139404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac153920 con 0x7fbfac0678b0 2023-10-09T06:26:34.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.251+0000 7fbfb091c700 1 -- 172.21.15.31:0/4081139404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac04c3c0 con 0x7fbfac0678b0 2023-10-09T06:26:34.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.251+0000 7fbfa27fc700 1 -- 172.21.15.31:0/4081139404 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbfa401a420 con 0x7fbfac0678b0 2023-10-09T06:26:34.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.252+0000 7fbfa27fc700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbf8c066f30 0x7fbf8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:34.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.252+0000 7fbfa27fc700 1 -- 172.21.15.31:0/4081139404 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbfa4085f70 con 0x7fbfac0678b0 2023-10-09T06:26:34.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.252+0000 7fbfa9d9b700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbf8c066f30 0x7fbf8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:34.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.252+0000 7fbfa9d9b700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbf8c066f30 0x7fbf8c0693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbfac16db00 tx=0x7fbf94007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:34.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.256+0000 7fbfa27fc700 1 -- 172.21.15.31:0/4081139404 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfa40534e0 con 0x7fbfac0678b0 2023-10-09T06:26:34.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.448+0000 7fbfb091c700 1 -- 172.21.15.31:0/4081139404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbfac068da0 con 0x7fbfac0678b0 2023-10-09T06:26:34.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.452+0000 7fbfa27fc700 1 -- 172.21.15.31:0/4081139404 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbfa4015020 con 0x7fbfac0678b0 2023-10-09T06:26:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.454+0000 7fbfb091c700 1 -- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbf8c066f30 msgr2=0x7fbf8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.454+0000 7fbfb091c700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbf8c066f30 0x7fbf8c0693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbfac16db00 tx=0x7fbf94007ec0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.454+0000 7fbfb091c700 1 -- 172.21.15.31:0/4081139404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfac0678b0 msgr2=0x7fbfac1573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.454+0000 7fbfb091c700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfac0678b0 0x7fbfac1573b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbfac06a380 tx=0x7fbfa4017000 comp rx=0 tx=0).stop 2023-10-09T06:26:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.454+0000 7fbfb091c700 1 -- 172.21.15.31:0/4081139404 shutdown_connections 2023-10-09T06:26:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.454+0000 7fbfb091c700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbf8c066f30 0x7fbf8c0693e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.454+0000 7fbfb091c700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfac0cbf10 0x7fbfac152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.454+0000 7fbfb091c700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfac0678b0 0x7fbfac1573b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.454+0000 7fbfb091c700 1 --2- 172.21.15.31:0/4081139404 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbfac0c9390 0x7fbfac1514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.454+0000 7fbfb091c700 1 -- 172.21.15.31:0/4081139404 >> 172.21.15.31:0/4081139404 conn(0x7fbfac069870 msgr2=0x7fbfac0c39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:34.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.454+0000 7fbfb091c700 1 -- 172.21.15.31:0/4081139404 shutdown_connections 2023-10-09T06:26:34.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.454+0000 7fbfb091c700 1 -- 172.21.15.31:0/4081139404 wait complete. 2023-10-09T06:26:34.466 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:26:34.467 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:26:34.503 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:26:34.546 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:26:34.547 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:26:34.547 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:34.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.665+0000 7f8506118700 1 Processor -- start 2023-10-09T06:26:34.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.665+0000 7f8506118700 1 -- start start 2023-10-09T06:26:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.666+0000 7f8506118700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f850015a2b0 0x7f85000b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.666+0000 7f8506118700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f85000d1c30 0x7f85000cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.666+0000 7f8506118700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f850015a680 0x7f85000cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.666+0000 7f8506118700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8500068470 con 0x7f850015a680 2023-10-09T06:26:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.666+0000 7f8506118700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85000c5d80 con 0x7f85000d1c30 2023-10-09T06:26:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.666+0000 7f8506118700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85000c6060 con 0x7f850015a2b0 2023-10-09T06:26:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.666+0000 7f84fffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f850015a680 0x7f85000cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.666+0000 7f84fffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f850015a680 0x7f85000cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48386/0 (socket says 172.21.15.31:48386) 2023-10-09T06:26:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.666+0000 7f84fffff700 1 -- 172.21.15.31:0/2120423147 learned_addr learned my addr 172.21.15.31:0/2120423147 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.667+0000 7f84feffd700 1 --2- 172.21.15.31:0/2120423147 >> v2:172.21.15.158:3300/0 conn(0x7f85000d1c30 0x7f85000cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.667+0000 7f84ff7fe700 1 --2- 172.21.15.31:0/2120423147 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f850015a2b0 0x7f85000b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.667+0000 7f84fffff700 1 -- 172.21.15.31:0/2120423147 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f850015a2b0 msgr2=0x7f85000b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.667+0000 7f84fffff700 1 --2- 172.21.15.31:0/2120423147 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f850015a2b0 0x7f85000b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.667+0000 7f84fffff700 1 -- 172.21.15.31:0/2120423147 >> v2:172.21.15.158:3300/0 conn(0x7f85000d1c30 msgr2=0x7f85000cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.667+0000 7f84fffff700 1 --2- 172.21.15.31:0/2120423147 >> v2:172.21.15.158:3300/0 conn(0x7f85000d1c30 0x7f85000cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.667+0000 7f84fffff700 1 -- 172.21.15.31:0/2120423147 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000c6340 con 0x7f850015a680 2023-10-09T06:26:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.667+0000 7f84fffff700 1 --2- 172.21.15.31:0/2120423147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015a680 0x7f85000cfc50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8500089050 tx=0x7f84f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5d41bb099bcac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.667+0000 7f84fe7fc700 1 -- 172.21.15.31:0/2120423147 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f800e070 con 0x7f850015a680 2023-10-09T06:26:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.667+0000 7f84fe7fc700 1 -- 172.21.15.31:0/2120423147 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f800ba50 con 0x7f850015a680 2023-10-09T06:26:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.667+0000 7f84fe7fc700 1 -- 172.21.15.31:0/2120423147 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80092e0 con 0x7f850015a680 2023-10-09T06:26:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.668+0000 7f8506118700 1 -- 172.21.15.31:0/2120423147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015a680 msgr2=0x7f85000cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.668+0000 7f8506118700 1 --2- 172.21.15.31:0/2120423147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015a680 0x7f85000cfc50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8500089050 tx=0x7f84f8009840 comp rx=0 tx=0).stop 2023-10-09T06:26:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.668+0000 7f8506118700 1 -- 172.21.15.31:0/2120423147 shutdown_connections 2023-10-09T06:26:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.668+0000 7f8506118700 1 --2- 172.21.15.31:0/2120423147 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f850015a2b0 0x7f85000b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.668+0000 7f8506118700 1 --2- 172.21.15.31:0/2120423147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015a680 0x7f85000cfc50 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.668+0000 7f8506118700 1 --2- 172.21.15.31:0/2120423147 >> v2:172.21.15.158:3300/0 conn(0x7f85000d1c30 0x7f85000cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.668+0000 7f8506118700 1 -- 172.21.15.31:0/2120423147 >> 172.21.15.31:0/2120423147 conn(0x7f8500067e40 msgr2=0x7f85000d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:34.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.668+0000 7f8506118700 1 -- 172.21.15.31:0/2120423147 shutdown_connections 2023-10-09T06:26:34.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.668+0000 7f8506118700 1 -- 172.21.15.31:0/2120423147 wait complete. 2023-10-09T06:26:34.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.669+0000 7f8506118700 1 Processor -- start 2023-10-09T06:26:34.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.669+0000 7f8506118700 1 -- start start 2023-10-09T06:26:34.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f8506118700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85000d1c30 0x7f850015b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:34.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f8506118700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f850015a2b0 0x7f85000c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:34.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f8506118700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015a680 0x7f85000c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:34.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f8506118700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850015e140 con 0x7f850015a680 2023-10-09T06:26:34.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f8506118700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850015e3e0 con 0x7f85000d1c30 2023-10-09T06:26:34.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f8506118700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850015c0f0 con 0x7f850015a2b0 2023-10-09T06:26:34.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84fffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015a680 0x7f85000c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:34.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84fffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015a680 0x7f85000c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48390/0 (socket says 172.21.15.31:48390) 2023-10-09T06:26:34.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84fffff700 1 -- 172.21.15.31:0/3484696130 learned_addr learned my addr 172.21.15.31:0/3484696130 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:34.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84feffd700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f850015a2b0 0x7f85000c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:34.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84ff7fe700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85000d1c30 0x7f850015b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:34.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84fffff700 1 -- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f850015a2b0 msgr2=0x7f85000c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:34.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84fffff700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f850015a2b0 0x7f85000c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84fffff700 1 -- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85000d1c30 msgr2=0x7f850015b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84fffff700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85000d1c30 0x7f850015b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84fffff700 1 -- 172.21.15.31:0/3484696130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f8009ae0 con 0x7f850015a680 2023-10-09T06:26:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84feffd700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f850015a2b0 0x7f85000c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84fffff700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015a680 0x7f85000c9e50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009fd0 tx=0x7f84f8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84e77fe700 1 -- 172.21.15.31:0/3484696130 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80032f0 con 0x7f850015a680 2023-10-09T06:26:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84e77fe700 1 -- 172.21.15.31:0/3484696130 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f8008e70 con 0x7f850015a680 2023-10-09T06:26:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f8506118700 1 -- 172.21.15.31:0/3484696130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850015c3d0 con 0x7f850015a680 2023-10-09T06:26:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f84e77fe700 1 -- 172.21.15.31:0/3484696130 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8025690 con 0x7f850015a680 2023-10-09T06:26:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.670+0000 7f8506118700 1 -- 172.21.15.31:0/3484696130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850015bd20 con 0x7f850015a680 2023-10-09T06:26:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.671+0000 7f8506118700 1 -- 172.21.15.31:0/3484696130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850004c3c0 con 0x7f850015a680 2023-10-09T06:26:34.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.672+0000 7f84e77fe700 1 -- 172.21.15.31:0/3484696130 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84f8003040 con 0x7f850015a680 2023-10-09T06:26:34.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.672+0000 7f84e77fe700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f84ec066f30 0x7f84ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:34.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.672+0000 7f84e77fe700 1 -- 172.21.15.31:0/3484696130 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f84f8085830 con 0x7f850015a680 2023-10-09T06:26:34.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.672+0000 7f84ff7fe700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f84ec066f30 0x7f84ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:34.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.673+0000 7f84ff7fe700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f84ec066f30 0x7f84ec0693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f84f0006520 tx=0x7f84f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:34.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.677+0000 7f84e77fe700 1 -- 172.21.15.31:0/3484696130 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84f8052da0 con 0x7f850015a680 2023-10-09T06:26:34.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.913+0000 7f8506118700 1 -- 172.21.15.31:0/3484696130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85000b6da0 con 0x7f850015a680 2023-10-09T06:26:34.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.913+0000 7f84e77fe700 1 -- 172.21.15.31:0/3484696130 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f84f8020de0 con 0x7f850015a680 2023-10-09T06:26:34.914 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:34.915 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2694953357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2694953357},{"type":"v1","addr":"172.21.15.158:6836","nonce":2694953357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1926052104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1926052104},{"type":"v1","addr":"172.21.15.31:6834","nonce":1926052104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3700277268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3700277268},{"type":"v1","addr":"172.21.15.31:6835","nonce":3700277268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6609,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/265263942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":265263942},{"type":"v1","addr":"172.21.15.158:6837","nonce":265263942}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[]} 2023-10-09T06:26:34.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.915+0000 7f8506118700 1 -- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f84ec066f30 msgr2=0x7f84ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:34.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.915+0000 7f8506118700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f84ec066f30 0x7f84ec0693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f84f0006520 tx=0x7f84f0008040 comp rx=0 tx=0).stop 2023-10-09T06:26:34.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.915+0000 7f8506118700 1 -- 172.21.15.31:0/3484696130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015a680 msgr2=0x7f85000c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:34.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.915+0000 7f8506118700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015a680 0x7f85000c9e50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009fd0 tx=0x7f84f8018000 comp rx=0 tx=0).stop 2023-10-09T06:26:34.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.915+0000 7f8506118700 1 -- 172.21.15.31:0/3484696130 shutdown_connections 2023-10-09T06:26:34.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.915+0000 7f8506118700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f84ec066f30 0x7f84ec0693e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.915+0000 7f8506118700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015a680 0x7f85000c9e50 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.915+0000 7f8506118700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f85000d1c30 0x7f850015b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.915+0000 7f8506118700 1 --2- 172.21.15.31:0/3484696130 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f850015a2b0 0x7f85000c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:34.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.915+0000 7f8506118700 1 -- 172.21.15.31:0/3484696130 >> 172.21.15.31:0/3484696130 conn(0x7f8500067e40 msgr2=0x7f85000695a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:34.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.915+0000 7f8506118700 1 -- 172.21.15.31:0/3484696130 shutdown_connections 2023-10-09T06:26:34.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:34.915+0000 7f8506118700 1 -- 172.21.15.31:0/3484696130 wait complete. 2023-10-09T06:26:34.917 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 52 2023-10-09T06:26:34.928 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:26:34.928 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:26:34.929 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:26:34.929 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:26:34.929 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:26:34.929 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:26:34.929 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:26:34.929 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:26:34.930 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:26:34.930 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:26:34.930 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:26:34.930 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:26:34.930 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:26:34.930 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:26:34.931 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:26:34.931 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:26:34.937 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:26:34.937 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:26:34.938 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:26:34.938 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:26:34.944 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:26:34.944 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:26:34.945 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:26:34.945 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:26:34.980 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:26:34.980 DEBUG:teuthology.parallel:result is None 2023-10-09T06:26:34.980 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:26:34.981 DEBUG:teuthology.parallel:result is None 2023-10-09T06:26:34.986 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:26:34.986 DEBUG:teuthology.parallel:result is None 2023-10-09T06:26:34.987 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:26:34.987 DEBUG:teuthology.parallel:result is None 2023-10-09T06:26:34.987 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:26:35.055 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-10-09T06:26:35.056 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:26:35.070 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:26:35.070 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-09T06:26:35.070 INFO:tasks.ceph.mds.d.smithi158.stderr:2023-10-09T06:26:35.070+0000 7f4494c0b700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-09T06:26:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.113+0000 7f7c0ba06700 1 Processor -- start 2023-10-09T06:26:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.113+0000 7f7c0ba06700 1 -- start start 2023-10-09T06:26:35.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.114+0000 7f7c0ba06700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7c041568d0 0x7f7c04069e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:35.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.114+0000 7f7c0ba06700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c040ad9b0 0x7f7c0406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:35.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.114+0000 7f7c0ba06700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c04067ba0 con 0x7f7c04156ca0 2023-10-09T06:26:35.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.114+0000 7f7c0ba06700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0415aa90 con 0x7f7c041568d0 2023-10-09T06:26:35.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.114+0000 7f7c0ba06700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c04067870 con 0x7f7c040ad9b0 2023-10-09T06:26:35.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.114+0000 7f7c08fa1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c040ad9b0 0x7f7c0406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:35.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.114+0000 7f7c09fa3700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f7c04156ca0 0x7f7c040c8090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:46638/0 (socket says 172.21.15.31:46638) 2023-10-09T06:26:35.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.114+0000 7f7c09fa3700 1 -- 172.21.15.31:0/628340455 learned_addr learned my addr 172.21.15.31:0/628340455 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:35.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.114+0000 7f7c097a2700 1 --2- 172.21.15.31:0/628340455 >> v2:172.21.15.158:3300/0 conn(0x7f7c041568d0 0x7f7c04069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:35.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.115+0000 7f7c08fa1700 1 -- 172.21.15.31:0/628340455 >> v2:172.21.15.158:3300/0 conn(0x7f7c041568d0 msgr2=0x7f7c04069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:35.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.115+0000 7f7c08fa1700 1 --2- 172.21.15.31:0/628340455 >> v2:172.21.15.158:3300/0 conn(0x7f7c041568d0 0x7f7c04069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:35.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.115+0000 7f7c08fa1700 1 -- 172.21.15.31:0/628340455 >> v1:172.21.15.158:6789/0 conn(0x7f7c04156ca0 legacy=0x7f7c040c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:35.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.115+0000 7f7c08fa1700 1 -- 172.21.15.31:0/628340455 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040c8ca0 con 0x7f7c040ad9b0 2023-10-09T06:26:35.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.115+0000 7f7c097a2700 1 --2- 172.21.15.31:0/628340455 >> v2:172.21.15.158:3300/0 conn(0x7f7c041568d0 0x7f7c04069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:26:35.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.115+0000 7f7c08fa1700 1 --2- 172.21.15.31:0/628340455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c040ad9b0 0x7f7c0406a360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40098e0 tx=0x7f7bf40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8da0da8ec0587582 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.115+0000 7f7bfbfff700 1 -- 172.21.15.31:0/628340455 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf400b640 con 0x7f7c040ad9b0 2023-10-09T06:26:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.115+0000 7f7bfbfff700 1 -- 172.21.15.31:0/628340455 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf400b7a0 con 0x7f7c040ad9b0 2023-10-09T06:26:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.115+0000 7f7bfbfff700 1 -- 172.21.15.31:0/628340455 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf400bb40 con 0x7f7c040ad9b0 2023-10-09T06:26:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.116+0000 7f7c0ba06700 1 -- 172.21.15.31:0/628340455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c040ad9b0 msgr2=0x7f7c0406a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.116+0000 7f7c0ba06700 1 --2- 172.21.15.31:0/628340455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c040ad9b0 0x7f7c0406a360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40098e0 tx=0x7f7bf40091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:35.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.116+0000 7f7c0ba06700 1 -- 172.21.15.31:0/628340455 shutdown_connections 2023-10-09T06:26:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.116+0000 7f7c0ba06700 1 --2- 172.21.15.31:0/628340455 >> v2:172.21.15.158:3300/0 conn(0x7f7c041568d0 0x7f7c04069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.116+0000 7f7c0ba06700 1 --2- 172.21.15.31:0/628340455 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c040ad9b0 0x7f7c0406a360 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.116+0000 7f7c0ba06700 1 -- 172.21.15.31:0/628340455 >> 172.21.15.31:0/628340455 conn(0x7f7c040cda50 msgr2=0x7f7c040cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.116+0000 7f7c0ba06700 1 -- 172.21.15.31:0/628340455 shutdown_connections 2023-10-09T06:26:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.116+0000 7f7c0ba06700 1 -- 172.21.15.31:0/628340455 wait complete. 2023-10-09T06:26:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.117+0000 7f7c0ba06700 1 Processor -- start 2023-10-09T06:26:35.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.117+0000 7f7c0ba06700 1 -- start start 2023-10-09T06:26:35.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.118+0000 7f7c0ba06700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c040ad9b0 0x7f7c040b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:35.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.118+0000 7f7c0ba06700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c041568d0 0x7f7c04150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:35.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.118+0000 7f7c0ba06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04156ca0 0x7f7c04158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.118+0000 7f7c0ba06700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c04150680 con 0x7f7c04156ca0 2023-10-09T06:26:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.118+0000 7f7c0ba06700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040c3eb0 con 0x7f7c040ad9b0 2023-10-09T06:26:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.118+0000 7f7c0ba06700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040c32e0 con 0x7f7c041568d0 2023-10-09T06:26:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.118+0000 7f7c09fa3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04156ca0 0x7f7c04158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.118+0000 7f7c09fa3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04156ca0 0x7f7c04158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48428/0 (socket says 172.21.15.31:48428) 2023-10-09T06:26:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7c09fa3700 1 -- 172.21.15.31:0/317829465 learned_addr learned my addr 172.21.15.31:0/317829465 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7c097a2700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c040ad9b0 0x7f7c040b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7c08fa1700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c041568d0 0x7f7c04150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7c09fa3700 1 -- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c041568d0 msgr2=0x7f7c04150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:35.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7c09fa3700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c041568d0 0x7f7c04150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7c09fa3700 1 -- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c040ad9b0 msgr2=0x7f7c040b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7c09fa3700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c040ad9b0 0x7f7c040b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7c09fa3700 1 -- 172.21.15.31:0/317829465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c00009420 con 0x7f7c04156ca0 2023-10-09T06:26:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7c097a2700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c040ad9b0 0x7f7c040b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:26:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7c09fa3700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04156ca0 0x7f7c04158150 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00cc40 tx=0x7f7bfc001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7bf97fa700 1 -- 172.21.15.31:0/317829465 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00a8b0 con 0x7f7c04156ca0 2023-10-09T06:26:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7bf97fa700 1 -- 172.21.15.31:0/317829465 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00aa10 con 0x7f7c04156ca0 2023-10-09T06:26:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7bf97fa700 1 -- 172.21.15.31:0/317829465 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00add0 con 0x7f7c04156ca0 2023-10-09T06:26:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7c0ba06700 1 -- 172.21.15.31:0/317829465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf4009420 con 0x7f7c04156ca0 2023-10-09T06:26:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.119+0000 7f7c0ba06700 1 -- 172.21.15.31:0/317829465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c040c3580 con 0x7f7c04156ca0 2023-10-09T06:26:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.120+0000 7f7c0ba06700 1 -- 172.21.15.31:0/317829465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c040c4040 con 0x7f7c04156ca0 2023-10-09T06:26:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.121+0000 7f7bf97fa700 1 -- 172.21.15.31:0/317829465 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bfc007300 con 0x7f7c04156ca0 2023-10-09T06:26:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.121+0000 7f7bf97fa700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7be8066f30 0x7f7be80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.121+0000 7f7bf97fa700 1 -- 172.21.15.31:0/317829465 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7bfc0844f0 con 0x7f7c04156ca0 2023-10-09T06:26:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.121+0000 7f7c097a2700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7be8066f30 0x7f7be80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.122+0000 7f7c097a2700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7be8066f30 0x7f7be80693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7c00011600 tx=0x7f7c000091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:35.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.125+0000 7f7bf97fa700 1 -- 172.21.15.31:0/317829465 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bfc051ae0 con 0x7f7c04156ca0 2023-10-09T06:26:35.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:35.334+0000 7f7c0ba06700 1 -- 172.21.15.31:0/317829465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7c0404c3c0 con 0x7f7c04156ca0 2023-10-09T06:26:36.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.119+0000 7f7bf97fa700 1 -- 172.21.15.31:0/317829465 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v117) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7bfc055100 con 0x7f7c04156ca0 2023-10-09T06:26:36.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.121+0000 7f7c0ba06700 1 -- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7be8066f30 msgr2=0x7f7be80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:36.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.121+0000 7f7c0ba06700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7be8066f30 0x7f7be80693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7c00011600 tx=0x7f7c000091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.121+0000 7f7c0ba06700 1 -- 172.21.15.31:0/317829465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04156ca0 msgr2=0x7f7c04158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:36.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.121+0000 7f7c0ba06700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04156ca0 0x7f7c04158150 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00cc40 tx=0x7f7bfc001a50 comp rx=0 tx=0).stop 2023-10-09T06:26:36.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.121+0000 7f7c0ba06700 1 -- 172.21.15.31:0/317829465 shutdown_connections 2023-10-09T06:26:36.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.121+0000 7f7c0ba06700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7be8066f30 0x7f7be80693e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.121+0000 7f7c0ba06700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c04156ca0 0x7f7c04158150 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.121+0000 7f7c0ba06700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c040ad9b0 0x7f7c040b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.121+0000 7f7c0ba06700 1 --2- 172.21.15.31:0/317829465 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c041568d0 0x7f7c04150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.121+0000 7f7c0ba06700 1 -- 172.21.15.31:0/317829465 >> 172.21.15.31:0/317829465 conn(0x7f7c040cda50 msgr2=0x7f7c04155fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:36.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.122+0000 7f7c0ba06700 1 -- 172.21.15.31:0/317829465 shutdown_connections 2023-10-09T06:26:36.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.122+0000 7f7c0ba06700 1 -- 172.21.15.31:0/317829465 wait complete. 2023-10-09T06:26:36.124 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2023-10-09T06:26:36.137 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:26:36.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.260+0000 7f80d9727700 1 Processor -- start 2023-10-09T06:26:36.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.260+0000 7f80d9727700 1 -- start start 2023-10-09T06:26:36.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d9727700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f80d4159850 0x7f80d4159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d9727700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f80d40b2be0 0x7f80d40b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d9727700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f80d4068b10 0x7f80d4068f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d9727700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d40b35c0 con 0x7f80d4159850 2023-10-09T06:26:36.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d9727700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d40694d0 con 0x7f80d40b2be0 2023-10-09T06:26:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d9727700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d415a160 con 0x7f80d4068b10 2023-10-09T06:26:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d2ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f80d4159850 0x7f80d4159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d2ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f80d4159850 0x7f80d4159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48442/0 (socket says 172.21.15.31:48442) 2023-10-09T06:26:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d2ffd700 1 -- 172.21.15.31:0/286310630 learned_addr learned my addr 172.21.15.31:0/286310630 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d2ffd700 1 -- 172.21.15.31:0/286310630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f80d4068b10 msgr2=0x7f80d4068f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d37fe700 1 --2- 172.21.15.31:0/286310630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f80d4068b10 0x7f80d4068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d27fc700 1 --2- 172.21.15.31:0/286310630 >> v2:172.21.15.158:3300/0 conn(0x7f80d40b2be0 0x7f80d40b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d2ffd700 1 --2- 172.21.15.31:0/286310630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f80d4068b10 0x7f80d4068f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d2ffd700 1 -- 172.21.15.31:0/286310630 >> v2:172.21.15.158:3300/0 conn(0x7f80d40b2be0 msgr2=0x7f80d40b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d2ffd700 1 --2- 172.21.15.31:0/286310630 >> v2:172.21.15.158:3300/0 conn(0x7f80d40b2be0 0x7f80d40b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d2ffd700 1 -- 172.21.15.31:0/286310630 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d40cbaa0 con 0x7f80d4159850 2023-10-09T06:26:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d27fc700 1 --2- 172.21.15.31:0/286310630 >> v2:172.21.15.158:3300/0 conn(0x7f80d40b2be0 0x7f80d40b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:36.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d37fe700 1 --2- 172.21.15.31:0/286310630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f80d4068b10 0x7f80d4068f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:36.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.261+0000 7f80d2ffd700 1 --2- 172.21.15.31:0/286310630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80d4159850 0x7f80d4159c20 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f80d40b18f0 tx=0x7f80cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557fe4c42909caf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:36.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.262+0000 7f80d1ffb700 1 -- 172.21.15.31:0/286310630 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc00e070 con 0x7f80d4159850 2023-10-09T06:26:36.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.262+0000 7f80d1ffb700 1 -- 172.21.15.31:0/286310630 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc00ba40 con 0x7f80d4159850 2023-10-09T06:26:36.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.262+0000 7f80d1ffb700 1 -- 172.21.15.31:0/286310630 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0092e0 con 0x7f80d4159850 2023-10-09T06:26:36.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.262+0000 7f80d9727700 1 -- 172.21.15.31:0/286310630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80d4159850 msgr2=0x7f80d4159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:36.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.262+0000 7f80d9727700 1 --2- 172.21.15.31:0/286310630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80d4159850 0x7f80d4159c20 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f80d40b18f0 tx=0x7f80cc009840 comp rx=0 tx=0).stop 2023-10-09T06:26:36.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.262+0000 7f80d9727700 1 -- 172.21.15.31:0/286310630 shutdown_connections 2023-10-09T06:26:36.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.262+0000 7f80d9727700 1 --2- 172.21.15.31:0/286310630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f80d4068b10 0x7f80d4068f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.262+0000 7f80d9727700 1 --2- 172.21.15.31:0/286310630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80d4159850 0x7f80d4159c20 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.262+0000 7f80d9727700 1 --2- 172.21.15.31:0/286310630 >> v2:172.21.15.158:3300/0 conn(0x7f80d40b2be0 0x7f80d40b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.262+0000 7f80d9727700 1 -- 172.21.15.31:0/286310630 >> 172.21.15.31:0/286310630 conn(0x7f80d4067660 msgr2=0x7f80d4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:36.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.262+0000 7f80d9727700 1 -- 172.21.15.31:0/286310630 shutdown_connections 2023-10-09T06:26:36.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.262+0000 7f80d9727700 1 -- 172.21.15.31:0/286310630 wait complete. 2023-10-09T06:26:36.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.263+0000 7f80d9727700 1 Processor -- start 2023-10-09T06:26:36.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.264+0000 7f80d9727700 1 -- start start 2023-10-09T06:26:36.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.264+0000 7f80d9727700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80d4068b10 0x7f80d416b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.264+0000 7f80d9727700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80d40b2be0 0x7f80d40c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.264+0000 7f80d9727700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f80d4159850 0x7f80d40c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.264+0000 7f80d9727700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d415c840 con 0x7f80d4068b10 2023-10-09T06:26:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.264+0000 7f80d9727700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d416ba00 con 0x7f80d40b2be0 2023-10-09T06:26:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.264+0000 7f80d9727700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d40c7190 con 0x7f80d4159850 2023-10-09T06:26:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.264+0000 7f80d2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80d4068b10 0x7f80d416b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.264+0000 7f80d2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80d4068b10 0x7f80d416b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48456/0 (socket says 172.21.15.31:48456) 2023-10-09T06:26:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.264+0000 7f80d2ffd700 1 -- 172.21.15.31:0/3559383454 learned_addr learned my addr 172.21.15.31:0/3559383454 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.264+0000 7f80d27fc700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80d40b2be0 0x7f80d40c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.264+0000 7f80d37fe700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f80d4159850 0x7f80d40c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.265+0000 7f80d2ffd700 1 -- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f80d4159850 msgr2=0x7f80d40c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.265+0000 7f80d2ffd700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f80d4159850 0x7f80d40c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.265+0000 7f80d2ffd700 1 -- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80d40b2be0 msgr2=0x7f80d40c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.265+0000 7f80d2ffd700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80d40b2be0 0x7f80d40c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.265+0000 7f80d2ffd700 1 -- 172.21.15.31:0/3559383454 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc009ae0 con 0x7f80d4068b10 2023-10-09T06:26:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.265+0000 7f80d2ffd700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80d4068b10 0x7f80d416b4c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f80d40710e0 tx=0x7f80cc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.265+0000 7f80caffd700 1 -- 172.21.15.31:0/3559383454 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc008930 con 0x7f80d4068b10 2023-10-09T06:26:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.265+0000 7f80caffd700 1 -- 172.21.15.31:0/3559383454 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc008a90 con 0x7f80d4068b10 2023-10-09T06:26:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.265+0000 7f80d9727700 1 -- 172.21.15.31:0/3559383454 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d415bc30 con 0x7f80d4068b10 2023-10-09T06:26:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.265+0000 7f80caffd700 1 -- 172.21.15.31:0/3559383454 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc008e50 con 0x7f80d4068b10 2023-10-09T06:26:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.265+0000 7f80d9727700 1 -- 172.21.15.31:0/3559383454 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d415c1f0 con 0x7f80d4068b10 2023-10-09T06:26:36.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.266+0000 7f80d9727700 1 -- 172.21.15.31:0/3559383454 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d40891c0 con 0x7f80d4068b10 2023-10-09T06:26:36.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.266+0000 7f80caffd700 1 -- 172.21.15.31:0/3559383454 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80cc003040 con 0x7f80d4068b10 2023-10-09T06:26:36.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.267+0000 7f80caffd700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f80b4066f30 0x7f80b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.267+0000 7f80caffd700 1 -- 172.21.15.31:0/3559383454 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f80cc0859e0 con 0x7f80d4068b10 2023-10-09T06:26:36.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.267+0000 7f80d27fc700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f80b4066f30 0x7f80b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.267+0000 7f80d27fc700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f80b4066f30 0x7f80b40693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f80d40c78c0 tx=0x7f80bc006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:36.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.271+0000 7f80caffd700 1 -- 172.21.15.31:0/3559383454 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80cc052f80 con 0x7f80d4068b10 2023-10-09T06:26:36.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.543+0000 7f80d9727700 1 -- 172.21.15.31:0/3559383454 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f80d40cc060 con 0x7f80d4068b10 2023-10-09T06:26:36.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.544+0000 7f80caffd700 1 -- 172.21.15.31:0/3559383454 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f80cc0565a0 con 0x7f80d4068b10 2023-10-09T06:26:36.545 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:36.545 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:26:36.545 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2023-10-09T06:26:36.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.545 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2023-10-09T06:26:36.545 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl/nWKAxAA1kcqjt4lPGPkmDivDpIVjQ==", 2023-10-09T06:26:36.545 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.546 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:26:36.546 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:26:36.546 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:26:36.546 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.546 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.546 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2023-10-09T06:26:36.546 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl9xYEDxAAQJeaqz7lkrArv45vLGb34g==", 2023-10-09T06:26:36.546 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.546 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:26:36.547 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:26:36.547 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:26:36.547 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.547 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.547 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2023-10-09T06:26:36.547 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlJOp0ChAADGiI4SX7ZLvDrtjDtU905A==", 2023-10-09T06:26:36.547 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.547 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:26:36.547 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:26:36.548 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:26:36.548 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.548 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.548 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2023-10-09T06:26:36.548 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlbnnJFRAAO+XoxRQDaHv0ZicyggniLQ==", 2023-10-09T06:26:36.548 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.548 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:26:36.548 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:26:36.548 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:26:36.548 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.549 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.549 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2023-10-09T06:26:36.549 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNloyZ+LxAApAHpPxV7R1OVE2wlIaU+PA==", 2023-10-09T06:26:36.549 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.549 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:26:36.549 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:26:36.549 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.549 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.550 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2023-10-09T06:26:36.550 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNlvHeUNhAAXblIEmmsc5eTo5VcZVirfA==", 2023-10-09T06:26:36.550 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.550 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:26:36.550 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:26:36.550 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.550 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.550 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2023-10-09T06:26:36.550 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlxfIaBBAAE8WbXh4Q4SxaW2k7MkSTHg==", 2023-10-09T06:26:36.551 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.551 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:26:36.551 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:26:36.551 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.551 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.551 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2023-10-09T06:26:36.551 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlUtX3DRAA5NEq+lFMzqhu1GF1ZWT2ag==", 2023-10-09T06:26:36.551 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.551 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:26:36.552 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:26:36.552 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.552 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.552 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2023-10-09T06:26:36.552 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlcWc5IBAA5e62AwhIuHdw4dTjnNS8hQ==", 2023-10-09T06:26:36.552 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.552 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:26:36.552 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:26:36.552 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.553 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.553 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2023-10-09T06:26:36.553 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlX5S6JhAAzvzO2YEqEtq2fJ3FW9Fddg==", 2023-10-09T06:26:36.553 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.553 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:26:36.553 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:26:36.553 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.553 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2023-10-09T06:26:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl9jy5LxAAxgMslSN6ayxB2MFRf2dwNQ==", 2023-10-09T06:26:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:26:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:26:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2023-10-09T06:26:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl8M+TOBAARhk2wEaXO9Pi4TP9d+L5Gg==", 2023-10-09T06:26:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:26:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:26:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2023-10-09T06:26:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlfsC2GRAAlm37QI8DkNclcBpD5ZBR7A==", 2023-10-09T06:26:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:26:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2023-10-09T06:26:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T06:26:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2023-10-09T06:26:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlapIxIhAAiBZUkpnf6tyFHwySGKhRpQ==", 2023-10-09T06:26:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:26:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:26:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:26:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:26:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2023-10-09T06:26:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEZYuHxAA7WEH0vXmAEH5Wki8ESrDBg==", 2023-10-09T06:26:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:26:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:26:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:26:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:26:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2023-10-09T06:26:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlFvuIJxAAGuTp4gsXrvUzDd1B7d5vcg==", 2023-10-09T06:26:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:26:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:26:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:26:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:26:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2023-10-09T06:26:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlS8AlJBAAg8lLRVasKHyhbFlOTfgt9g==", 2023-10-09T06:26:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:26:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:26:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:26:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2023-10-09T06:26:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEE9eABAAHbJ1yvlmOUNo6n2uAhPrnw==", 2023-10-09T06:26:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:26:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:26:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:26:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2023-10-09T06:26:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlhol5OBAAZSZ+PbojVwsOJtLlTl6wAA==", 2023-10-09T06:26:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:26:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:26:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:26:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:26:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:26:36.561 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:26:36.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.546+0000 7f80d9727700 1 -- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f80b4066f30 msgr2=0x7f80b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:36.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.546+0000 7f80d9727700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f80b4066f30 0x7f80b40693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f80d40c78c0 tx=0x7f80bc006f90 comp rx=0 tx=0).stop 2023-10-09T06:26:36.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.546+0000 7f80d9727700 1 -- 172.21.15.31:0/3559383454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80d4068b10 msgr2=0x7f80d416b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.546+0000 7f80d9727700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80d4068b10 0x7f80d416b4c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f80d40710e0 tx=0x7f80cc018000 comp rx=0 tx=0).stop 2023-10-09T06:26:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.546+0000 7f80d9727700 1 -- 172.21.15.31:0/3559383454 shutdown_connections 2023-10-09T06:26:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.546+0000 7f80d9727700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f80b4066f30 0x7f80b40693e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.546+0000 7f80d9727700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f80d4159850 0x7f80d40c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.546+0000 7f80d9727700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80d4068b10 0x7f80d416b4c0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.546+0000 7f80d9727700 1 --2- 172.21.15.31:0/3559383454 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80d40b2be0 0x7f80d40c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.546+0000 7f80d9727700 1 -- 172.21.15.31:0/3559383454 >> 172.21.15.31:0/3559383454 conn(0x7f80d4067660 msgr2=0x7f80d4158590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.546+0000 7f80d9727700 1 -- 172.21.15.31:0/3559383454 shutdown_connections 2023-10-09T06:26:36.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.546+0000 7f80d9727700 1 -- 172.21.15.31:0/3559383454 wait complete. 2023-10-09T06:26:36.564 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:26:36.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.682+0000 7f165852f700 1 Processor -- start 2023-10-09T06:26:36.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.682+0000 7f165852f700 1 -- start start 2023-10-09T06:26:36.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.683+0000 7f165852f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16500b0e50 0x7f16500c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.683+0000 7f165852f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f16500b1220 0x7f165006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.683+0000 7f165852f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f165006dad0 0x7f16500cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.683+0000 7f165852f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165015de60 con 0x7f165006dad0 2023-10-09T06:26:36.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.683+0000 7f165852f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165015e140 con 0x7f16500b1220 2023-10-09T06:26:36.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.683+0000 7f165852f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165015e420 con 0x7f16500b0e50 2023-10-09T06:26:36.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.683+0000 7f1656acc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f165006dad0 0x7f16500cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.683+0000 7f1656acc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f165006dad0 0x7f16500cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48464/0 (socket says 172.21.15.31:48464) 2023-10-09T06:26:36.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.683+0000 7f1656acc700 1 -- 172.21.15.31:0/3291562598 learned_addr learned my addr 172.21.15.31:0/3291562598 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:36.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.684+0000 7f1655aca700 1 --2- 172.21.15.31:0/3291562598 >> v2:172.21.15.158:3300/0 conn(0x7f16500b1220 0x7f165006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.684+0000 7f16562cb700 1 --2- 172.21.15.31:0/3291562598 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16500b0e50 0x7f16500c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.684+0000 7f1656acc700 1 -- 172.21.15.31:0/3291562598 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16500b0e50 msgr2=0x7f16500c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:36.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.684+0000 7f1656acc700 1 --2- 172.21.15.31:0/3291562598 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16500b0e50 0x7f16500c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.684+0000 7f1656acc700 1 -- 172.21.15.31:0/3291562598 >> v2:172.21.15.158:3300/0 conn(0x7f16500b1220 msgr2=0x7f165006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:36.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.684+0000 7f1656acc700 1 --2- 172.21.15.31:0/3291562598 >> v2:172.21.15.158:3300/0 conn(0x7f16500b1220 0x7f165006d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.684+0000 7f1656acc700 1 -- 172.21.15.31:0/3291562598 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165015e700 con 0x7f165006dad0 2023-10-09T06:26:36.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.684+0000 7f1656acc700 1 --2- 172.21.15.31:0/3291562598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f165006dad0 0x7f16500cb4f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1640009f20 tx=0x7f1640009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef3914495c079f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:36.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.684+0000 7f16552c9700 1 -- 172.21.15.31:0/3291562598 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164000e070 con 0x7f165006dad0 2023-10-09T06:26:36.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.684+0000 7f16552c9700 1 -- 172.21.15.31:0/3291562598 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164000b930 con 0x7f165006dad0 2023-10-09T06:26:36.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.684+0000 7f16552c9700 1 -- 172.21.15.31:0/3291562598 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400092e0 con 0x7f165006dad0 2023-10-09T06:26:36.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.685+0000 7f165852f700 1 -- 172.21.15.31:0/3291562598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f165006dad0 msgr2=0x7f16500cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:36.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.685+0000 7f165852f700 1 --2- 172.21.15.31:0/3291562598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f165006dad0 0x7f16500cb4f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1640009f20 tx=0x7f1640009840 comp rx=0 tx=0).stop 2023-10-09T06:26:36.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.685+0000 7f165852f700 1 -- 172.21.15.31:0/3291562598 shutdown_connections 2023-10-09T06:26:36.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.685+0000 7f165852f700 1 --2- 172.21.15.31:0/3291562598 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16500b0e50 0x7f16500c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.685+0000 7f165852f700 1 --2- 172.21.15.31:0/3291562598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f165006dad0 0x7f16500cb4f0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.685+0000 7f165852f700 1 --2- 172.21.15.31:0/3291562598 >> v2:172.21.15.158:3300/0 conn(0x7f16500b1220 0x7f165006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.685+0000 7f165852f700 1 -- 172.21.15.31:0/3291562598 >> 172.21.15.31:0/3291562598 conn(0x7f1650069870 msgr2=0x7f1650069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:36.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.685+0000 7f165852f700 1 -- 172.21.15.31:0/3291562598 shutdown_connections 2023-10-09T06:26:36.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.685+0000 7f165852f700 1 -- 172.21.15.31:0/3291562598 wait complete. 2023-10-09T06:26:36.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.686+0000 7f165852f700 1 Processor -- start 2023-10-09T06:26:36.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.686+0000 7f165852f700 1 -- start start 2023-10-09T06:26:36.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f165852f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f165006dad0 0x7f1650141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f165852f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16500b0e50 0x7f1650157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f165852f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16500b1220 0x7f1650157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f165852f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16500c7ea0 con 0x7f165006dad0 2023-10-09T06:26:36.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f165852f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16501580e0 con 0x7f16500b1220 2023-10-09T06:26:36.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f165852f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16501583c0 con 0x7f16500b0e50 2023-10-09T06:26:36.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f16562cb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f165006dad0 0x7f1650141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f16562cb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f165006dad0 0x7f1650141740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48470/0 (socket says 172.21.15.31:48470) 2023-10-09T06:26:36.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f16562cb700 1 -- 172.21.15.31:0/209751989 learned_addr learned my addr 172.21.15.31:0/209751989 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:36.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f1656acc700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16500b1220 0x7f1650157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f1655aca700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16500b0e50 0x7f1650157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f16562cb700 1 -- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16500b0e50 msgr2=0x7f1650157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:36.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f16562cb700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16500b0e50 0x7f1650157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f16562cb700 1 -- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16500b1220 msgr2=0x7f1650157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:36.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f16562cb700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16500b1220 0x7f1650157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f16562cb700 1 -- 172.21.15.31:0/209751989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1640009ae0 con 0x7f165006dad0 2023-10-09T06:26:36.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f1655aca700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16500b0e50 0x7f1650157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:36.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f1656acc700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16500b1220 0x7f1650157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:36.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f16562cb700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f165006dad0 0x7f1650141740 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f164800ec80 tx=0x7f16480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:36.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f164e7fc700 1 -- 172.21.15.31:0/209751989 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164800c9d0 con 0x7f165006dad0 2023-10-09T06:26:36.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f164e7fc700 1 -- 172.21.15.31:0/209751989 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164800cb30 con 0x7f165006dad0 2023-10-09T06:26:36.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f165852f700 1 -- 172.21.15.31:0/209751989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16501586a0 con 0x7f165006dad0 2023-10-09T06:26:36.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f164e7fc700 1 -- 172.21.15.31:0/209751989 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648013470 con 0x7f165006dad0 2023-10-09T06:26:36.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.687+0000 7f165852f700 1 -- 172.21.15.31:0/209751989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1650158c60 con 0x7f165006dad0 2023-10-09T06:26:36.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.688+0000 7f165852f700 1 -- 172.21.15.31:0/209751989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165004c3c0 con 0x7f165006dad0 2023-10-09T06:26:36.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.689+0000 7f164e7fc700 1 -- 172.21.15.31:0/209751989 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1648013820 con 0x7f165006dad0 2023-10-09T06:26:36.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.689+0000 7f164e7fc700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f163c066f30 0x7f163c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:36.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.689+0000 7f164e7fc700 1 -- 172.21.15.31:0/209751989 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1648084570 con 0x7f165006dad0 2023-10-09T06:26:36.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.689+0000 7f1655aca700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f163c066f30 0x7f163c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:36.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.690+0000 7f1655aca700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f163c066f30 0x7f163c0693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1644006f00 tx=0x7f1644008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:36.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.693+0000 7f164e7fc700 1 -- 172.21.15.31:0/209751989 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1648051b30 con 0x7f165006dad0 2023-10-09T06:26:36.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.887+0000 7f165852f700 1 -- 172.21.15.31:0/209751989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1650159c20 con 0x7f165006dad0 2023-10-09T06:26:36.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.888+0000 7f164e7fc700 1 -- 172.21.15.31:0/209751989 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+12137 (secure 0 0 0) 0x7f1648055150 con 0x7f165006dad0 2023-10-09T06:26:36.889 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:36.889 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":117,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:26:36.117627+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:26:36.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.890+0000 7f165852f700 1 -- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f163c066f30 msgr2=0x7f163c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:36.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.890+0000 7f165852f700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f163c066f30 0x7f163c0693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1644006f00 tx=0x7f1644008040 comp rx=0 tx=0).stop 2023-10-09T06:26:36.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.890+0000 7f165852f700 1 -- 172.21.15.31:0/209751989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f165006dad0 msgr2=0x7f1650141740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:36.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.890+0000 7f165852f700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f165006dad0 0x7f1650141740 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f164800ec80 tx=0x7f16480091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.890+0000 7f165852f700 1 -- 172.21.15.31:0/209751989 shutdown_connections 2023-10-09T06:26:36.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.890+0000 7f165852f700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f163c066f30 0x7f163c0693e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.890+0000 7f165852f700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16500b1220 0x7f1650157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.890+0000 7f165852f700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f165006dad0 0x7f1650141740 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.890+0000 7f165852f700 1 --2- 172.21.15.31:0/209751989 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16500b0e50 0x7f1650157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:36.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.890+0000 7f165852f700 1 -- 172.21.15.31:0/209751989 >> 172.21.15.31:0/209751989 conn(0x7f1650069870 msgr2=0x7f1650067820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:36.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.890+0000 7f165852f700 1 -- 172.21.15.31:0/209751989 shutdown_connections 2023-10-09T06:26:36.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:36.891+0000 7f165852f700 1 -- 172.21.15.31:0/209751989 wait complete. 2023-10-09T06:26:36.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:26:36.903 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:26:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.027+0000 7f8852e1b700 1 Processor -- start 2023-10-09T06:26:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.027+0000 7f8852e1b700 1 -- start start 2023-10-09T06:26:37.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f8852e1b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f884c154440 0x7f884c15da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f8852e1b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f884c15af30 0x7f884c067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f8852e1b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c15e1e0 con 0x7f884c15b380 2023-10-09T06:26:37.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f8852e1b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884c15dfd0 con 0x7f884c154440 2023-10-09T06:26:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f8852e1b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c15e4c0 con 0x7f884c15af30 2023-10-09T06:26:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f88513b8700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f884c15b380 0x7f884c06a530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52462/0 (socket says 172.21.15.31:52462) 2023-10-09T06:26:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f88513b8700 1 -- 172.21.15.31:0/61797111 learned_addr learned my addr 172.21.15.31:0/61797111 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f8850bb7700 1 --2- 172.21.15.31:0/61797111 >> v2:172.21.15.158:3300/0 conn(0x7f884c154440 0x7f884c15da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884bfff700 1 --2- 172.21.15.31:0/61797111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f884c15af30 0x7f884c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200813661 0 0) 0x7f884c15e1e0 con 0x7f884c15b380 2023-10-09T06:26:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8838003570 con 0x7f884c15b380 2023-10-09T06:26:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1032548141 0 0) 0x7f8838003570 con 0x7f884c15b380 2023-10-09T06:26:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f884c15af30 msgr2=0x7f884c067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 --2- 172.21.15.31:0/61797111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f884c15af30 0x7f884c067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 >> v2:172.21.15.158:3300/0 conn(0x7f884c154440 msgr2=0x7f884c15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 --2- 172.21.15.31:0/61797111 >> v2:172.21.15.158:3300/0 conn(0x7f884c154440 0x7f884c15da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c15e7a0 con 0x7f884c15b380 2023-10-09T06:26:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f88440017f0 con 0x7f884c15b380 2023-10-09T06:26:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 >> v1:172.21.15.31:6789/0 conn(0x7f884c15b380 legacy=0x7f884c06a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 --2- 172.21.15.31:0/61797111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8838003a60 0x7f8838003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 --2- 172.21.15.31:0/61797111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f884c15af30 0x7f8838004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 --2- 172.21.15.31:0/61797111 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8838004d50 0x7f88380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c15dfd0 con 0x7f8838003a60 2023-10-09T06:26:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c15e4c0 con 0x7f8838004d50 2023-10-09T06:26:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.028+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883800bae0 con 0x7f884c15af30 2023-10-09T06:26:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.029+0000 7f8850bb7700 1 --2- 172.21.15.31:0/61797111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8838003a60 0x7f8838003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.029+0000 7f88513b8700 1 --2- 172.21.15.31:0/61797111 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8838004d50 0x7f88380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.029+0000 7f884bfff700 1 --2- 172.21.15.31:0/61797111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f884c15af30 0x7f8838004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.029+0000 7f8850bb7700 1 -- 172.21.15.31:0/61797111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f884c15af30 msgr2=0x7f8838004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.029+0000 7f8850bb7700 1 --2- 172.21.15.31:0/61797111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f884c15af30 0x7f8838004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.029+0000 7f8850bb7700 1 -- 172.21.15.31:0/61797111 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8838004d50 msgr2=0x7f88380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.029+0000 7f8850bb7700 1 --2- 172.21.15.31:0/61797111 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8838004d50 0x7f88380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.029+0000 7f8850bb7700 1 -- 172.21.15.31:0/61797111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8838003570 con 0x7f8838003a60 2023-10-09T06:26:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.029+0000 7f884bfff700 1 --2- 172.21.15.31:0/61797111 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f884c15af30 0x7f8838004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.029+0000 7f8850bb7700 1 --2- 172.21.15.31:0/61797111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8838003a60 0x7f8838003e70 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8834009c00 tx=0x7f88340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49b7d9446391778 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.029+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883400e710 con 0x7f8838003a60 2023-10-09T06:26:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.029+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883400e870 con 0x7f8838003a60 2023-10-09T06:26:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.029+0000 7f884b7fe700 1 -- 172.21.15.31:0/61797111 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883400ec30 con 0x7f8838003a60 2023-10-09T06:26:37.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.030+0000 7f8852e1b700 1 -- 172.21.15.31:0/61797111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8838003a60 msgr2=0x7f8838003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.030+0000 7f8852e1b700 1 --2- 172.21.15.31:0/61797111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8838003a60 0x7f8838003e70 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8834009c00 tx=0x7f88340091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.030+0000 7f88513b8700 1 -- 172.21.15.31:0/61797111 reap_dead start 2023-10-09T06:26:37.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.030+0000 7f8852e1b700 1 -- 172.21.15.31:0/61797111 shutdown_connections 2023-10-09T06:26:37.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.030+0000 7f8852e1b700 1 -- 172.21.15.31:0/61797111 >> 172.21.15.31:0/61797111 conn(0x7f884c0d0dd0 msgr2=0x7f884c0d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:37.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.030+0000 7f8852e1b700 1 -- 172.21.15.31:0/61797111 shutdown_connections 2023-10-09T06:26:37.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.030+0000 7f8852e1b700 1 -- 172.21.15.31:0/61797111 wait complete. 2023-10-09T06:26:37.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.031+0000 7f8852e1b700 1 Processor -- start 2023-10-09T06:26:37.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.031+0000 7f8852e1b700 1 -- start start 2023-10-09T06:26:37.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f8852e1b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8838003a60 0x7f884c14b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f8852e1b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f884c154810 0x7f884c0b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f8852e1b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f884c159050 0x7f884c1594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f8852e1b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c159a30 con 0x7f884c154810 2023-10-09T06:26:37.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f8852e1b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c155970 con 0x7f884c159050 2023-10-09T06:26:37.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f8852e1b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c14be50 con 0x7f8838003a60 2023-10-09T06:26:37.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f884bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f884c154810 0x7f884c0b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f884bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f884c154810 0x7f884c0b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48488/0 (socket says 172.21.15.31:48488) 2023-10-09T06:26:37.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f884bfff700 1 -- 172.21.15.31:0/3031868981 learned_addr learned my addr 172.21.15.31:0/3031868981 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:37.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f8850bb7700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8838003a60 0x7f884c14b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f88513b8700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f884c159050 0x7f884c1594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f884bfff700 1 -- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8838003a60 msgr2=0x7f884c14b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f884bfff700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8838003a60 0x7f884c14b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f884bfff700 1 -- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f884c159050 msgr2=0x7f884c1594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f884bfff700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f884c159050 0x7f884c1594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f884bfff700 1 -- 172.21.15.31:0/3031868981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c154d60 con 0x7f884c154810 2023-10-09T06:26:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f884bfff700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f884c154810 0x7f884c0b24d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f883c011910 tx=0x7f883c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f8848ff9700 1 -- 172.21.15.31:0/3031868981 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c011eb0 con 0x7f884c154810 2023-10-09T06:26:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f8848ff9700 1 -- 172.21.15.31:0/3031868981 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c00f8e0 con 0x7f884c154810 2023-10-09T06:26:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f8848ff9700 1 -- 172.21.15.31:0/3031868981 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00fc80 con 0x7f884c154810 2023-10-09T06:26:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.032+0000 7f8852e1b700 1 -- 172.21.15.31:0/3031868981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c155040 con 0x7f884c154810 2023-10-09T06:26:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.033+0000 7f8852e1b700 1 -- 172.21.15.31:0/3031868981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c155600 con 0x7f884c154810 2023-10-09T06:26:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.033+0000 7f8852e1b700 1 -- 172.21.15.31:0/3031868981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884c04c3c0 con 0x7f884c154810 2023-10-09T06:26:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.034+0000 7f8848ff9700 1 -- 172.21.15.31:0/3031868981 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f883c015460 con 0x7f884c154810 2023-10-09T06:26:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.034+0000 7f8848ff9700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f882c066fb0 0x7f882c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.034+0000 7f8848ff9700 1 -- 172.21.15.31:0/3031868981 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f883c084b10 con 0x7f884c154810 2023-10-09T06:26:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.035+0000 7f8850bb7700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f882c066fb0 0x7f882c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.035+0000 7f8850bb7700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f882c066fb0 0x7f882c069460 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f88340091e0 tx=0x7f883401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.039+0000 7f8848ff9700 1 -- 172.21.15.31:0/3031868981 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f883c052030 con 0x7f884c154810 2023-10-09T06:26:37.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.232+0000 7f8852e1b700 1 -- 172.21.15.31:0/3031868981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f884c155ab0 con 0x7f884c154810 2023-10-09T06:26:37.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.232+0000 7f8848ff9700 1 -- 172.21.15.31:0/3031868981 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) v1 ==== 93+0+10 (secure 0 0 0) 0x7f883c055650 con 0x7f884c154810 2023-10-09T06:26:37.233 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:26:37.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.234+0000 7f8852e1b700 1 -- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f882c066fb0 msgr2=0x7f882c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.234+0000 7f8852e1b700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f882c066fb0 0x7f882c069460 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f88340091e0 tx=0x7f883401a000 comp rx=0 tx=0).stop 2023-10-09T06:26:37.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.234+0000 7f8852e1b700 1 -- 172.21.15.31:0/3031868981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f884c154810 msgr2=0x7f884c0b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.234+0000 7f8852e1b700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f884c154810 0x7f884c0b24d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f883c011910 tx=0x7f883c008040 comp rx=0 tx=0).stop 2023-10-09T06:26:37.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.234+0000 7f8852e1b700 1 -- 172.21.15.31:0/3031868981 shutdown_connections 2023-10-09T06:26:37.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.234+0000 7f8852e1b700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f882c066fb0 0x7f882c069460 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.234+0000 7f8852e1b700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8838003a60 0x7f884c14b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.234+0000 7f8852e1b700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f884c159050 0x7f884c1594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.234+0000 7f8852e1b700 1 --2- 172.21.15.31:0/3031868981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f884c154810 0x7f884c0b24d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.234+0000 7f8852e1b700 1 -- 172.21.15.31:0/3031868981 >> 172.21.15.31:0/3031868981 conn(0x7f884c0d0dd0 msgr2=0x7f884c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:37.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.234+0000 7f8852e1b700 1 -- 172.21.15.31:0/3031868981 shutdown_connections 2023-10-09T06:26:37.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.234+0000 7f8852e1b700 1 -- 172.21.15.31:0/3031868981 wait complete. 2023-10-09T06:26:37.247 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:26:37.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.365+0000 7f3c8d217700 1 Processor -- start 2023-10-09T06:26:37.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.365+0000 7f3c8d217700 1 -- start start 2023-10-09T06:26:37.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.366+0000 7f3c8d217700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3c88157870 0x7f3c8815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.366+0000 7f3c8d217700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8815cbb0 con 0x7f3c8815a620 2023-10-09T06:26:37.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.366+0000 7f3c8d217700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8815bfa0 con 0x7f3c88157c40 2023-10-09T06:26:37.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.366+0000 7f3c8d217700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8815c280 con 0x7f3c88157870 2023-10-09T06:26:37.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.366+0000 7f3c86d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3c88157870 0x7f3c8815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.366+0000 7f3c8659c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3c8815a620 0x7f3c8815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52472/0 (socket says 172.21.15.31:52472) 2023-10-09T06:26:37.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.366+0000 7f3c8659c700 1 -- 172.21.15.31:0/342397257 learned_addr learned my addr 172.21.15.31:0/342397257 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:37.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.366+0000 7f3c86d9d700 1 -- 172.21.15.31:0/342397257 >> v1:172.21.15.158:6789/0 conn(0x7f3c88157c40 legacy=0x7f3c88158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:37.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.366+0000 7f3c86d9d700 1 -- 172.21.15.31:0/342397257 >> v1:172.21.15.31:6789/0 conn(0x7f3c8815a620 legacy=0x7f3c8815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.366+0000 7f3c86d9d700 1 -- 172.21.15.31:0/342397257 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8815c560 con 0x7f3c88157870 2023-10-09T06:26:37.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.366+0000 7f3c85d9b700 1 -- 172.21.15.31:0/342397257 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290089507 0 0) 0x7f3c8815cbb0 con 0x7f3c8815a620 2023-10-09T06:26:37.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.367+0000 7f3c86d9d700 1 --2- 172.21.15.31:0/342397257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c88157870 0x7f3c8815b6a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3c780098e0 tx=0x7f3c780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f8ece423313a19 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:37.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.367+0000 7f3c85d9b700 1 -- 172.21.15.31:0/342397257 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78009e80 con 0x7f3c88157870 2023-10-09T06:26:37.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.367+0000 7f3c85d9b700 1 -- 172.21.15.31:0/342397257 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7800b820 con 0x7f3c88157870 2023-10-09T06:26:37.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.367+0000 7f3c85d9b700 1 -- 172.21.15.31:0/342397257 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800bba0 con 0x7f3c88157870 2023-10-09T06:26:37.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.367+0000 7f3c8d217700 1 -- 172.21.15.31:0/342397257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c88157870 msgr2=0x7f3c8815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.367+0000 7f3c8d217700 1 --2- 172.21.15.31:0/342397257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c88157870 0x7f3c8815b6a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3c780098e0 tx=0x7f3c780091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.367+0000 7f3c8d217700 1 -- 172.21.15.31:0/342397257 shutdown_connections 2023-10-09T06:26:37.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.367+0000 7f3c8d217700 1 --2- 172.21.15.31:0/342397257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c88157870 0x7f3c8815b6a0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.367+0000 7f3c8d217700 1 -- 172.21.15.31:0/342397257 >> 172.21.15.31:0/342397257 conn(0x7f3c88068ce0 msgr2=0x7f3c880690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:37.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.367+0000 7f3c8d217700 1 -- 172.21.15.31:0/342397257 shutdown_connections 2023-10-09T06:26:37.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.367+0000 7f3c8d217700 1 -- 172.21.15.31:0/342397257 wait complete. 2023-10-09T06:26:37.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.368+0000 7f3c8d217700 1 Processor -- start 2023-10-09T06:26:37.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.369+0000 7f3c8d217700 1 -- start start 2023-10-09T06:26:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.369+0000 7f3c8d217700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c88157870 0x7f3c8815db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.369+0000 7f3c8d217700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c88157c40 0x7f3c88160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.369+0000 7f3c8d217700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c8815a620 0x7f3c8816d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.369+0000 7f3c8d217700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880c5d40 con 0x7f3c8815a620 2023-10-09T06:26:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.369+0000 7f3c8d217700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8815ebd0 con 0x7f3c88157870 2023-10-09T06:26:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.369+0000 7f3c8d217700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8815e060 con 0x7f3c88157c40 2023-10-09T06:26:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.369+0000 7f3c8759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c8815a620 0x7f3c8816d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.369+0000 7f3c8759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c8815a620 0x7f3c8816d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48504/0 (socket says 172.21.15.31:48504) 2023-10-09T06:26:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.369+0000 7f3c8759e700 1 -- 172.21.15.31:0/1919276364 learned_addr learned my addr 172.21.15.31:0/1919276364 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c86d9d700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c88157870 0x7f3c8815db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c8659c700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c88157c40 0x7f3c88160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c8759e700 1 -- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c88157c40 msgr2=0x7f3c88160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c8759e700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c88157c40 0x7f3c88160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c8759e700 1 -- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c88157870 msgr2=0x7f3c8815db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c8759e700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c88157870 0x7f3c8815db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c8759e700 1 -- 172.21.15.31:0/1919276364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78009420 con 0x7f3c8815a620 2023-10-09T06:26:37.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c86d9d700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c88157870 0x7f3c8815db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:37.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c8759e700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c8815a620 0x7f3c8816d960 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000c8c0 tx=0x7f3c800026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:37.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c7effd700 1 -- 172.21.15.31:0/1919276364 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8000ce60 con 0x7f3c8815a620 2023-10-09T06:26:37.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c7effd700 1 -- 172.21.15.31:0/1919276364 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8000a7a0 con 0x7f3c8815a620 2023-10-09T06:26:37.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c8d217700 1 -- 172.21.15.31:0/1919276364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8815e330 con 0x7f3c8815a620 2023-10-09T06:26:37.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c7effd700 1 -- 172.21.15.31:0/1919276364 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8000ab40 con 0x7f3c8815a620 2023-10-09T06:26:37.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.370+0000 7f3c8d217700 1 -- 172.21.15.31:0/1919276364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8815e8f0 con 0x7f3c8815a620 2023-10-09T06:26:37.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.371+0000 7f3c8d217700 1 -- 172.21.15.31:0/1919276364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c880c5b10 con 0x7f3c8815a620 2023-10-09T06:26:37.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.371+0000 7f3c7effd700 1 -- 172.21.15.31:0/1919276364 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c80012420 con 0x7f3c8815a620 2023-10-09T06:26:37.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.372+0000 7f3c7effd700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c68066f30 0x7f3c680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.372+0000 7f3c7effd700 1 -- 172.21.15.31:0/1919276364 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3c80084650 con 0x7f3c8815a620 2023-10-09T06:26:37.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.372+0000 7f3c86d9d700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c68066f30 0x7f3c680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.372+0000 7f3c86d9d700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c68066f30 0x7f3c680693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3c780030c0 tx=0x7f3c78016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:37.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.376+0000 7f3c7effd700 1 -- 172.21.15.31:0/1919276364 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c880c5b10 con 0x7f3c8815a620 2023-10-09T06:26:37.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.570+0000 7f3c8d217700 1 -- 172.21.15.31:0/1919276364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3c880c5b10 con 0x7f3c8815a620 2023-10-09T06:26:37.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.571+0000 7f3c7effd700 1 -- 172.21.15.31:0/1919276364 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v117) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3c880c5b10 con 0x7f3c8815a620 2023-10-09T06:26:37.571 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:37.572 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-10-09T06:26:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:26:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-10-09T06:26:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-10-09T06:26:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:26:37.572 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-10-09T06:26:37.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.573+0000 7f3c8d217700 1 -- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c68066f30 msgr2=0x7f3c680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.573+0000 7f3c8d217700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c68066f30 0x7f3c680693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3c780030c0 tx=0x7f3c78016000 comp rx=0 tx=0).stop 2023-10-09T06:26:37.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.573+0000 7f3c8d217700 1 -- 172.21.15.31:0/1919276364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c8815a620 msgr2=0x7f3c8816d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.573+0000 7f3c8d217700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c8815a620 0x7f3c8816d960 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000c8c0 tx=0x7f3c800026a0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.573+0000 7f3c8d217700 1 -- 172.21.15.31:0/1919276364 shutdown_connections 2023-10-09T06:26:37.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.573+0000 7f3c8d217700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c68066f30 0x7f3c680693e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.573+0000 7f3c8d217700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c8815a620 0x7f3c8816d960 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.573+0000 7f3c8d217700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c88157870 0x7f3c8815db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.573+0000 7f3c8d217700 1 --2- 172.21.15.31:0/1919276364 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c88157c40 0x7f3c88160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.573+0000 7f3c8d217700 1 -- 172.21.15.31:0/1919276364 >> 172.21.15.31:0/1919276364 conn(0x7f3c88068ce0 msgr2=0x7f3c880d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:37.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.573+0000 7f3c8d217700 1 -- 172.21.15.31:0/1919276364 shutdown_connections 2023-10-09T06:26:37.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.573+0000 7f3c8d217700 1 -- 172.21.15.31:0/1919276364 wait complete. 2023-10-09T06:26:37.585 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:26:37.586 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:26:37.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.708+0000 7f7c286f6700 1 Processor -- start 2023-10-09T06:26:37.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.708+0000 7f7c286f6700 1 -- start start 2023-10-09T06:26:37.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.709+0000 7f7c286f6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7c20068af0 0x7f7c200b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.709+0000 7f7c286f6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c200aff80 con 0x7f7c20068ec0 2023-10-09T06:26:37.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.709+0000 7f7c286f6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c200b0350 con 0x7f7c200b1950 2023-10-09T06:26:37.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.709+0000 7f7c286f6700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c200b15c0 con 0x7f7c20068af0 2023-10-09T06:26:37.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.709+0000 7f7c25c91700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7c20068ec0 0x7f7c2015aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52474/0 (socket says 172.21.15.31:52474) 2023-10-09T06:26:37.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.709+0000 7f7c25c91700 1 -- 172.21.15.31:0/2602045915 learned_addr learned my addr 172.21.15.31:0/2602045915 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.710+0000 7f7c26492700 1 --2- 172.21.15.31:0/2602045915 >> v2:172.21.15.158:3300/0 conn(0x7f7c20068af0 0x7f7c200b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.710+0000 7f7c25490700 1 -- 172.21.15.31:0/2602045915 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364703930 0 0) 0x7f7c200aff80 con 0x7f7c20068ec0 2023-10-09T06:26:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.710+0000 7f7c25490700 1 -- 172.21.15.31:0/2602045915 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c08003570 con 0x7f7c20068ec0 2023-10-09T06:26:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.710+0000 7f7c25490700 1 -- 172.21.15.31:0/2602045915 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958453365 0 0) 0x7f7c200b0350 con 0x7f7c200b1950 2023-10-09T06:26:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.710+0000 7f7c25490700 1 -- 172.21.15.31:0/2602045915 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c200aff80 con 0x7f7c200b1950 2023-10-09T06:26:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.710+0000 7f7c25490700 1 -- 172.21.15.31:0/2602045915 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1488953409 0 0) 0x7f7c08003570 con 0x7f7c20068ec0 2023-10-09T06:26:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.710+0000 7f7c26492700 1 -- 172.21.15.31:0/2602045915 >> v1:172.21.15.158:6789/0 conn(0x7f7c200b1950 legacy=0x7f7c200af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.710+0000 7f7c26492700 1 -- 172.21.15.31:0/2602045915 >> v1:172.21.15.31:6789/0 conn(0x7f7c20068ec0 legacy=0x7f7c2015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.710+0000 7f7c26492700 1 -- 172.21.15.31:0/2602045915 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c200b0bf0 con 0x7f7c20068af0 2023-10-09T06:26:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.710+0000 7f7c26492700 1 --2- 172.21.15.31:0/2602045915 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c20068af0 0x7f7c200b1080 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7c180098e0 tx=0x7f7c180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7678b8ba0570212 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.710+0000 7f7c25490700 1 -- 172.21.15.31:0/2602045915 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14001470 con 0x7f7c20068af0 2023-10-09T06:26:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.710+0000 7f7c25490700 1 -- 172.21.15.31:0/2602045915 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c18011420 con 0x7f7c20068af0 2023-10-09T06:26:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.710+0000 7f7c25490700 1 -- 172.21.15.31:0/2602045915 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c180117c0 con 0x7f7c20068af0 2023-10-09T06:26:37.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.711+0000 7f7c286f6700 1 -- 172.21.15.31:0/2602045915 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c20068af0 msgr2=0x7f7c200b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.711+0000 7f7c286f6700 1 --2- 172.21.15.31:0/2602045915 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c20068af0 0x7f7c200b1080 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7c180098e0 tx=0x7f7c180091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.711+0000 7f7c286f6700 1 -- 172.21.15.31:0/2602045915 shutdown_connections 2023-10-09T06:26:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.711+0000 7f7c286f6700 1 --2- 172.21.15.31:0/2602045915 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c20068af0 0x7f7c200b1080 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.711+0000 7f7c286f6700 1 -- 172.21.15.31:0/2602045915 >> 172.21.15.31:0/2602045915 conn(0x7f7c20069870 msgr2=0x7f7c20069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.711+0000 7f7c286f6700 1 -- 172.21.15.31:0/2602045915 shutdown_connections 2023-10-09T06:26:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.711+0000 7f7c286f6700 1 -- 172.21.15.31:0/2602045915 wait complete. 2023-10-09T06:26:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.712+0000 7f7c286f6700 1 Processor -- start 2023-10-09T06:26:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.712+0000 7f7c286f6700 1 -- start start 2023-10-09T06:26:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c286f6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c20068af0 0x7f7c200ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c286f6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c20068ec0 0x7f7c20147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c286f6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c200b1950 0x7f7c2015b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c286f6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200c8480 con 0x7f7c200b1950 2023-10-09T06:26:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c286f6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200c7e70 con 0x7f7c20068ec0 2023-10-09T06:26:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c286f6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200caef0 con 0x7f7c20068af0 2023-10-09T06:26:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c26c93700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c200b1950 0x7f7c2015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c26c93700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c200b1950 0x7f7c2015b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48508/0 (socket says 172.21.15.31:48508) 2023-10-09T06:26:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c26c93700 1 -- 172.21.15.31:0/3657227102 learned_addr learned my addr 172.21.15.31:0/3657227102 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c26492700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c20068af0 0x7f7c200ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c25c91700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c20068ec0 0x7f7c20147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c26c93700 1 -- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c20068af0 msgr2=0x7f7c200ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c26c93700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c20068af0 0x7f7c200ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c26c93700 1 -- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c20068ec0 msgr2=0x7f7c20147490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c26c93700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c20068ec0 0x7f7c20147490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c26c93700 1 -- 172.21.15.31:0/3657227102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18009420 con 0x7f7c200b1950 2023-10-09T06:26:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c25c91700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c20068ec0 0x7f7c20147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.713+0000 7f7c26c93700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c200b1950 0x7f7c2015b790 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000c860 tx=0x7f7c10002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.714+0000 7f7c1e7fc700 1 -- 172.21.15.31:0/3657227102 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10012630 con 0x7f7c200b1950 2023-10-09T06:26:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.714+0000 7f7c1e7fc700 1 -- 172.21.15.31:0/3657227102 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c100127b0 con 0x7f7c200b1950 2023-10-09T06:26:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.714+0000 7f7c286f6700 1 -- 172.21.15.31:0/3657227102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c200c8110 con 0x7f7c200b1950 2023-10-09T06:26:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.714+0000 7f7c1e7fc700 1 -- 172.21.15.31:0/3657227102 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10012b70 con 0x7f7c200b1950 2023-10-09T06:26:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.714+0000 7f7c286f6700 1 -- 172.21.15.31:0/3657227102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c200cb1d0 con 0x7f7c200b1950 2023-10-09T06:26:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.715+0000 7f7c286f6700 1 -- 172.21.15.31:0/3657227102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2006b900 con 0x7f7c200b1950 2023-10-09T06:26:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.715+0000 7f7c1e7fc700 1 -- 172.21.15.31:0/3657227102 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c1001b400 con 0x7f7c200b1950 2023-10-09T06:26:37.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.715+0000 7f7c1e7fc700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7c0c066f30 0x7f7c0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:37.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.716+0000 7f7c1e7fc700 1 -- 172.21.15.31:0/3657227102 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7c10084430 con 0x7f7c200b1950 2023-10-09T06:26:37.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.716+0000 7f7c26492700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7c0c066f30 0x7f7c0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:37.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.716+0000 7f7c26492700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7c0c066f30 0x7f7c0c0693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7c180093f0 tx=0x7f7c18016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:37.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.720+0000 7f7c1e7fc700 1 -- 172.21.15.31:0/3657227102 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c100519f0 con 0x7f7c200b1950 2023-10-09T06:26:37.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:37.913+0000 7f7c286f6700 1 -- 172.21.15.31:0/3657227102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7c2004c3c0 con 0x7f7c200b1950 2023-10-09T06:26:38.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.128+0000 7f7c1e7fc700 1 -- 172.21.15.31:0/3657227102 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v118) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7c10055010 con 0x7f7c200b1950 2023-10-09T06:26:38.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.132+0000 7f7c286f6700 1 -- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7c0c066f30 msgr2=0x7f7c0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:38.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.132+0000 7f7c286f6700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7c0c066f30 0x7f7c0c0693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7c180093f0 tx=0x7f7c18016000 comp rx=0 tx=0).stop 2023-10-09T06:26:38.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.132+0000 7f7c286f6700 1 -- 172.21.15.31:0/3657227102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c200b1950 msgr2=0x7f7c2015b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:38.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.132+0000 7f7c286f6700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c200b1950 0x7f7c2015b790 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000c860 tx=0x7f7c10002700 comp rx=0 tx=0).stop 2023-10-09T06:26:38.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.133+0000 7f7c286f6700 1 -- 172.21.15.31:0/3657227102 shutdown_connections 2023-10-09T06:26:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.133+0000 7f7c286f6700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7c0c066f30 0x7f7c0c0693e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.133+0000 7f7c286f6700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7c20068af0 0x7f7c200ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.133+0000 7f7c286f6700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c200b1950 0x7f7c2015b790 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.133+0000 7f7c286f6700 1 --2- 172.21.15.31:0/3657227102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c20068ec0 0x7f7c20147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.133+0000 7f7c286f6700 1 -- 172.21.15.31:0/3657227102 >> 172.21.15.31:0/3657227102 conn(0x7f7c20069870 msgr2=0x7f7c20158830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.133+0000 7f7c286f6700 1 -- 172.21.15.31:0/3657227102 shutdown_connections 2023-10-09T06:26:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.133+0000 7f7c286f6700 1 -- 172.21.15.31:0/3657227102 wait complete. 2023-10-09T06:26:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-10-09T06:26:38.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:26:38.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.271+0000 7f68af20a700 1 Processor -- start 2023-10-09T06:26:38.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.271+0000 7f68af20a700 1 -- start start 2023-10-09T06:26:38.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.272+0000 7f68af20a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a80cd300 0x7f68a815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:38.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.272+0000 7f68af20a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f68a80d1470 0x7f68a80cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:38.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.272+0000 7f68af20a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a81513f0 con 0x7f68a80b6760 2023-10-09T06:26:38.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.272+0000 7f68af20a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a815e7a0 con 0x7f68a80d1470 2023-10-09T06:26:38.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.272+0000 7f68af20a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a815db20 con 0x7f68a80cd300 2023-10-09T06:26:38.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68ad7a7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f68a80d1470 0x7f68a80cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:38.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68acfa6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a80cd300 0x7f68a815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:38.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68acfa6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a80cd300 0x7f68a815afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:48886/0 (socket says 172.21.15.31:48886) 2023-10-09T06:26:38.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68a7fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f68a80b6760 0x7f68a80d0d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:46668/0 (socket says 172.21.15.31:46668) 2023-10-09T06:26:38.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68ad7a7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f68a80d1470 0x7f68a80cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:41134/0 (socket says 172.21.15.31:41134) 2023-10-09T06:26:38.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68acfa6700 1 -- 172.21.15.31:0/2287966020 learned_addr learned my addr 172.21.15.31:0/2287966020 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:38.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68acfa6700 1 -- 172.21.15.31:0/2287966020 >> v2:172.21.15.158:3300/0 conn(0x7f68a80d1470 msgr2=0x7f68a80cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68acfa6700 1 --2- 172.21.15.31:0/2287966020 >> v2:172.21.15.158:3300/0 conn(0x7f68a80d1470 0x7f68a80cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68acfa6700 1 -- 172.21.15.31:0/2287966020 >> v1:172.21.15.158:6789/0 conn(0x7f68a80b6760 legacy=0x7f68a80d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68acfa6700 1 -- 172.21.15.31:0/2287966020 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a815de00 con 0x7f68a80cd300 2023-10-09T06:26:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68a77fe700 1 -- 172.21.15.31:0/2287966020 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30563928 0 0) 0x7f68a81513f0 con 0x7f68a80b6760 2023-10-09T06:26:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68ad7a7700 1 --2- 172.21.15.31:0/2287966020 >> v2:172.21.15.158:3300/0 conn(0x7f68a80d1470 0x7f68a80cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:26:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68acfa6700 1 --2- 172.21.15.31:0/2287966020 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a80cd300 0x7f68a815afb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009f20 tx=0x7f68a0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3980800ee0ad6f9e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68a77fe700 1 -- 172.21.15.31:0/2287966020 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a000e070 con 0x7f68a80cd300 2023-10-09T06:26:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68a77fe700 1 -- 172.21.15.31:0/2287966020 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a000b9d0 con 0x7f68a80cd300 2023-10-09T06:26:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.273+0000 7f68a77fe700 1 -- 172.21.15.31:0/2287966020 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a00092e0 con 0x7f68a80cd300 2023-10-09T06:26:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.274+0000 7f68af20a700 1 -- 172.21.15.31:0/2287966020 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a80cd300 msgr2=0x7f68a815afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:38.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.274+0000 7f68af20a700 1 --2- 172.21.15.31:0/2287966020 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a80cd300 0x7f68a815afb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009f20 tx=0x7f68a0009840 comp rx=0 tx=0).stop 2023-10-09T06:26:38.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.274+0000 7f68af20a700 1 -- 172.21.15.31:0/2287966020 shutdown_connections 2023-10-09T06:26:38.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.274+0000 7f68af20a700 1 --2- 172.21.15.31:0/2287966020 >> v2:172.21.15.158:3300/0 conn(0x7f68a80d1470 0x7f68a80cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:38.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.274+0000 7f68af20a700 1 --2- 172.21.15.31:0/2287966020 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a80cd300 0x7f68a815afb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:38.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.274+0000 7f68af20a700 1 -- 172.21.15.31:0/2287966020 >> 172.21.15.31:0/2287966020 conn(0x7f68a8068d90 msgr2=0x7f68a8069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:38.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.274+0000 7f68af20a700 1 -- 172.21.15.31:0/2287966020 shutdown_connections 2023-10-09T06:26:38.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.274+0000 7f68af20a700 1 -- 172.21.15.31:0/2287966020 wait complete. 2023-10-09T06:26:38.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.275+0000 7f68af20a700 1 Processor -- start 2023-10-09T06:26:38.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.275+0000 7f68af20a700 1 -- start start 2023-10-09T06:26:38.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68af20a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68a80b6760 0x7f68a80c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:38.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68af20a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a80cd300 0x7f68a814f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:38.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68af20a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a80d1470 0x7f68a80c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:38.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68af20a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a80c70d0 con 0x7f68a80d1470 2023-10-09T06:26:38.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68af20a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a80c6450 con 0x7f68a80b6760 2023-10-09T06:26:38.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68af20a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a80c6730 con 0x7f68a80cd300 2023-10-09T06:26:38.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68ad7a7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a80d1470 0x7f68a80c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:38.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68ad7a7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a80d1470 0x7f68a80c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48520/0 (socket says 172.21.15.31:48520) 2023-10-09T06:26:38.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68ad7a7700 1 -- 172.21.15.31:0/862707100 learned_addr learned my addr 172.21.15.31:0/862707100 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:38.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68acfa6700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68a80b6760 0x7f68a80c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:38.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68a7fff700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a80cd300 0x7f68a814f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:38.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68ad7a7700 1 -- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a80cd300 msgr2=0x7f68a814f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:38.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68ad7a7700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a80cd300 0x7f68a814f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:38.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68ad7a7700 1 -- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68a80b6760 msgr2=0x7f68a80c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:38.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68ad7a7700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68a80b6760 0x7f68a80c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:38.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68ad7a7700 1 -- 172.21.15.31:0/862707100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6890009420 con 0x7f68a80d1470 2023-10-09T06:26:38.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68acfa6700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68a80b6760 0x7f68a80c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:38.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.276+0000 7f68a7fff700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a80cd300 0x7f68a814f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:38.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.277+0000 7f68ad7a7700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a80d1470 0x7f68a80c76d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6890009fd0 tx=0x7f68900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:38.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.277+0000 7f68a4ff9700 1 -- 172.21.15.31:0/862707100 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000c850 con 0x7f68a80d1470 2023-10-09T06:26:38.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.277+0000 7f68a4ff9700 1 -- 172.21.15.31:0/862707100 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689000c9b0 con 0x7f68a80d1470 2023-10-09T06:26:38.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.277+0000 7f68af20a700 1 -- 172.21.15.31:0/862707100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a0009ae0 con 0x7f68a80d1470 2023-10-09T06:26:38.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.277+0000 7f68a4ff9700 1 -- 172.21.15.31:0/862707100 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000cd30 con 0x7f68a80d1470 2023-10-09T06:26:38.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.277+0000 7f68af20a700 1 -- 172.21.15.31:0/862707100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a80c6cf0 con 0x7f68a80d1470 2023-10-09T06:26:38.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.278+0000 7f68af20a700 1 -- 172.21.15.31:0/862707100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a804c3c0 con 0x7f68a80d1470 2023-10-09T06:26:38.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.278+0000 7f68a4ff9700 1 -- 172.21.15.31:0/862707100 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6890013680 con 0x7f68a80d1470 2023-10-09T06:26:38.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.279+0000 7f68a4ff9700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6888066f30 0x7f68880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:38.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.279+0000 7f68a4ff9700 1 -- 172.21.15.31:0/862707100 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f6890084600 con 0x7f68a80d1470 2023-10-09T06:26:38.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.279+0000 7f68acfa6700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6888066f30 0x7f68880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:38.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.279+0000 7f68acfa6700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6888066f30 0x7f68880693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009880 tx=0x7f68a0018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.283+0000 7f68a4ff9700 1 -- 172.21.15.31:0/862707100 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6890051a50 con 0x7f68a80d1470 2023-10-09T06:26:38.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:38.476+0000 7f68af20a700 1 -- 172.21.15.31:0/862707100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f68a80b4010 con 0x7f68a80d1470 2023-10-09T06:26:39.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.135+0000 7f68a4ff9700 1 -- 172.21.15.31:0/862707100 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v119) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6890055070 con 0x7f68a80d1470 2023-10-09T06:26:39.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.148+0000 7f68af20a700 1 -- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6888066f30 msgr2=0x7f68880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:39.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.148+0000 7f68af20a700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6888066f30 0x7f68880693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009880 tx=0x7f68a0018000 comp rx=0 tx=0).stop 2023-10-09T06:26:39.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.148+0000 7f68af20a700 1 -- 172.21.15.31:0/862707100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a80d1470 msgr2=0x7f68a80c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:39.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.148+0000 7f68af20a700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a80d1470 0x7f68a80c76d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6890009fd0 tx=0x7f68900091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:39.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.149+0000 7f68af20a700 1 -- 172.21.15.31:0/862707100 shutdown_connections 2023-10-09T06:26:39.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.149+0000 7f68af20a700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6888066f30 0x7f68880693e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:39.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.149+0000 7f68af20a700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68a80d1470 0x7f68a80c76d0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:39.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.149+0000 7f68af20a700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68a80b6760 0x7f68a80c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:39.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.149+0000 7f68af20a700 1 --2- 172.21.15.31:0/862707100 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68a80cd300 0x7f68a814f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:39.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.149+0000 7f68af20a700 1 -- 172.21.15.31:0/862707100 >> 172.21.15.31:0/862707100 conn(0x7f68a8068d90 msgr2=0x7f68a80b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:39.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.149+0000 7f68af20a700 1 -- 172.21.15.31:0/862707100 shutdown_connections 2023-10-09T06:26:39.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.149+0000 7f68af20a700 1 -- 172.21.15.31:0/862707100 wait complete. 2023-10-09T06:26:39.151 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-10-09T06:26:39.163 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:26:39.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.286+0000 7f74fc27c700 1 Processor -- start 2023-10-09T06:26:39.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.286+0000 7f74fc27c700 1 -- start start 2023-10-09T06:26:39.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.287+0000 7f74fc27c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f74f4159e60 0x7f74f415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:39.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.287+0000 7f74fc27c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f74f415a230 0x7f74f40690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:39.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.287+0000 7f74fc27c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f415ea90 con 0x7f74f40695f0 2023-10-09T06:26:39.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.287+0000 7f74fc27c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f40d1cf0 con 0x7f74f4159e60 2023-10-09T06:26:39.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.287+0000 7f74fc27c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f4069a70 con 0x7f74f415a230 2023-10-09T06:26:39.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74f9817700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f74f415a230 0x7f74f40690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:39.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74fa819700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f74f40695f0 0x7f74f40af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:46684/0 (socket says 172.21.15.31:46684) 2023-10-09T06:26:39.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74fa819700 1 -- 172.21.15.31:0/2179381422 learned_addr learned my addr 172.21.15.31:0/2179381422 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:39.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74f9817700 1 --2- 172.21.15.31:0/2179381422 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f74f415a230 0x7f74f40690b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:48904/0 (socket says 172.21.15.31:48904) 2023-10-09T06:26:39.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74fa018700 1 --2- 172.21.15.31:0/2179381422 >> v2:172.21.15.158:3300/0 conn(0x7f74f4159e60 0x7f74f415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:39.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74f9016700 1 -- 172.21.15.31:0/2179381422 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827267713 0 0) 0x7f74f415ea90 con 0x7f74f40695f0 2023-10-09T06:26:39.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74f9817700 1 -- 172.21.15.31:0/2179381422 >> v2:172.21.15.158:3300/0 conn(0x7f74f4159e60 msgr2=0x7f74f415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:39.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74f9817700 1 --2- 172.21.15.31:0/2179381422 >> v2:172.21.15.158:3300/0 conn(0x7f74f4159e60 0x7f74f415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:39.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74f9817700 1 -- 172.21.15.31:0/2179381422 >> v1:172.21.15.158:6789/0 conn(0x7f74f40695f0 legacy=0x7f74f40af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:39.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74f9817700 1 -- 172.21.15.31:0/2179381422 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f40b3100 con 0x7f74f415a230 2023-10-09T06:26:39.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74f9817700 1 --2- 172.21.15.31:0/2179381422 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f74f415a230 0x7f74f40690b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f74e80098e0 tx=0x7f74e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39977ba72a11334b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:39.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74f9016700 1 -- 172.21.15.31:0/2179381422 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e800b640 con 0x7f74f415a230 2023-10-09T06:26:39.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74f9016700 1 -- 172.21.15.31:0/2179381422 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e800b7a0 con 0x7f74f415a230 2023-10-09T06:26:39.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.288+0000 7f74f9016700 1 -- 172.21.15.31:0/2179381422 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e800bb40 con 0x7f74f415a230 2023-10-09T06:26:39.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.289+0000 7f74fc27c700 1 -- 172.21.15.31:0/2179381422 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f74f415a230 msgr2=0x7f74f40690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:39.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.289+0000 7f74fc27c700 1 --2- 172.21.15.31:0/2179381422 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f74f415a230 0x7f74f40690b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f74e80098e0 tx=0x7f74e80091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:39.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.289+0000 7f74fc27c700 1 -- 172.21.15.31:0/2179381422 shutdown_connections 2023-10-09T06:26:39.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.289+0000 7f74fc27c700 1 --2- 172.21.15.31:0/2179381422 >> v2:172.21.15.158:3300/0 conn(0x7f74f4159e60 0x7f74f415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:39.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.289+0000 7f74fc27c700 1 --2- 172.21.15.31:0/2179381422 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f74f415a230 0x7f74f40690b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:39.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.289+0000 7f74fc27c700 1 -- 172.21.15.31:0/2179381422 >> 172.21.15.31:0/2179381422 conn(0x7f74f4070700 msgr2=0x7f74f4070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:39.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.289+0000 7f74fc27c700 1 -- 172.21.15.31:0/2179381422 shutdown_connections 2023-10-09T06:26:39.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.289+0000 7f74fc27c700 1 -- 172.21.15.31:0/2179381422 wait complete. 2023-10-09T06:26:39.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.290+0000 7f74fc27c700 1 Processor -- start 2023-10-09T06:26:39.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.290+0000 7f74fc27c700 1 -- start start 2023-10-09T06:26:39.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fc27c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74f40695f0 0x7f74f40b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:39.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fc27c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f74f4159e60 0x7f74f414ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:39.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fc27c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f415a230 0x7f74f414d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:39.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fc27c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f40c9300 con 0x7f74f415a230 2023-10-09T06:26:39.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fc27c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f415e160 con 0x7f74f40695f0 2023-10-09T06:26:39.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fc27c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f415e440 con 0x7f74f4159e60 2023-10-09T06:26:39.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fa819700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f415a230 0x7f74f414d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:39.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fa819700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f415a230 0x7f74f414d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48534/0 (socket says 172.21.15.31:48534) 2023-10-09T06:26:39.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fa819700 1 -- 172.21.15.31:0/2726749187 learned_addr learned my addr 172.21.15.31:0/2726749187 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:39.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74f9817700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f74f4159e60 0x7f74f414ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:39.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fa018700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74f40695f0 0x7f74f40b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:39.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fa819700 1 -- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f74f4159e60 msgr2=0x7f74f414ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:39.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fa819700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f74f4159e60 0x7f74f414ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:39.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fa819700 1 -- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74f40695f0 msgr2=0x7f74f40b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:39.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fa819700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74f40695f0 0x7f74f40b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:39.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.291+0000 7f74fa819700 1 -- 172.21.15.31:0/2726749187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e8009420 con 0x7f74f415a230 2023-10-09T06:26:39.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.292+0000 7f74fa819700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f415a230 0x7f74f414d340 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f74e400cc10 tx=0x7f74e4001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:39.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.292+0000 7f74f27fc700 1 -- 172.21.15.31:0/2726749187 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e400a850 con 0x7f74f415a230 2023-10-09T06:26:39.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.292+0000 7f74f27fc700 1 -- 172.21.15.31:0/2726749187 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e400a9d0 con 0x7f74f415a230 2023-10-09T06:26:39.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.292+0000 7f74f27fc700 1 -- 172.21.15.31:0/2726749187 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e400ad90 con 0x7f74f415a230 2023-10-09T06:26:39.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.292+0000 7f74fc27c700 1 -- 172.21.15.31:0/2726749187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f415e720 con 0x7f74f415a230 2023-10-09T06:26:39.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.292+0000 7f74fc27c700 1 -- 172.21.15.31:0/2726749187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f40b10b0 con 0x7f74f415a230 2023-10-09T06:26:39.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.293+0000 7f74fc27c700 1 -- 172.21.15.31:0/2726749187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f40c90d0 con 0x7f74f415a230 2023-10-09T06:26:39.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.293+0000 7f74f27fc700 1 -- 172.21.15.31:0/2726749187 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74e4007300 con 0x7f74f415a230 2023-10-09T06:26:39.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.294+0000 7f74f27fc700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f74e0066f30 0x7f74e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:39.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.294+0000 7f74f27fc700 1 -- 172.21.15.31:0/2726749187 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f74e4084700 con 0x7f74f415a230 2023-10-09T06:26:39.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.294+0000 7f74fa018700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f74e0066f30 0x7f74e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:39.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.294+0000 7f74fa018700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f74e0066f30 0x7f74e00693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f74f40b12f0 tx=0x7f74ec0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:39.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.298+0000 7f74f27fc700 1 -- 172.21.15.31:0/2726749187 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74f40c90d0 con 0x7f74f415a230 2023-10-09T06:26:39.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:39.535+0000 7f74fc27c700 1 -- 172.21.15.31:0/2726749187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f74f40c90d0 con 0x7f74f415a230 2023-10-09T06:26:40.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.136+0000 7f74f27fc700 1 -- 172.21.15.31:0/2726749187 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v54) v1 ==== 174+0+0 (secure 0 0 0) 0x7f74f40c90d0 con 0x7f74f415a230 2023-10-09T06:26:40.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.144+0000 7f74fc27c700 1 -- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f74e0066f30 msgr2=0x7f74e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.144+0000 7f74fc27c700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f74e0066f30 0x7f74e00693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f74f40b12f0 tx=0x7f74ec0091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.144+0000 7f74fc27c700 1 -- 172.21.15.31:0/2726749187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f415a230 msgr2=0x7f74f414d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.144+0000 7f74fc27c700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f415a230 0x7f74f414d340 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f74e400cc10 tx=0x7f74e4001970 comp rx=0 tx=0).stop 2023-10-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.144+0000 7f74fc27c700 1 -- 172.21.15.31:0/2726749187 shutdown_connections 2023-10-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.144+0000 7f74fc27c700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f74e0066f30 0x7f74e00693e0 secure :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f74f40b12f0 tx=0x7f74ec0091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.144+0000 7f74fc27c700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f415a230 0x7f74f414d340 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.144+0000 7f74fc27c700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74f40695f0 0x7f74f40b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.144+0000 7f74fc27c700 1 --2- 172.21.15.31:0/2726749187 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f74f4159e60 0x7f74f414ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.144+0000 7f74fc27c700 1 -- 172.21.15.31:0/2726749187 >> 172.21.15.31:0/2726749187 conn(0x7f74f4070700 msgr2=0x7f74f40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:40.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.159+0000 7f74fc27c700 1 -- 172.21.15.31:0/2726749187 shutdown_connections 2023-10-09T06:26:40.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.159+0000 7f74fc27c700 1 -- 172.21.15.31:0/2726749187 wait complete. 2023-10-09T06:26:40.160 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 14 and data pool 15 2023-10-09T06:26:40.173 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:26:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.334+0000 7f8890b84700 1 Processor -- start 2023-10-09T06:26:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.334+0000 7f8890b84700 1 -- start start 2023-10-09T06:26:40.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.335+0000 7f8890b84700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f888c159c60 0x7f888c15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:40.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.335+0000 7f8890b84700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f888c15a030 0x7f888c0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:40.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.335+0000 7f8890b84700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888c068de0 con 0x7f888c06a060 2023-10-09T06:26:40.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.335+0000 7f8890b84700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888c0affc0 con 0x7f888c15a030 2023-10-09T06:26:40.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.335+0000 7f8890b84700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c15b370 con 0x7f888c159c60 2023-10-09T06:26:40.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.335+0000 7f888bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f888c15a030 0x7f888c0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:40.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.335+0000 7f888bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f888c15a030 0x7f888c0b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53830/0 (socket says 172.21.15.31:53830) 2023-10-09T06:26:40.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.335+0000 7f888bfff700 1 -- 172.21.15.31:0/1826843337 learned_addr learned my addr 172.21.15.31:0/1826843337 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:40.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.335+0000 7f888b7fe700 1 --2- 172.21.15.31:0/1826843337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f888c159c60 0x7f888c15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:40.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.335+0000 7f888bfff700 1 -- 172.21.15.31:0/1826843337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f888c159c60 msgr2=0x7f888c15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.335+0000 7f888bfff700 1 --2- 172.21.15.31:0/1826843337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f888c159c60 0x7f888c15ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.335+0000 7f888bfff700 1 -- 172.21.15.31:0/1826843337 >> v1:172.21.15.158:6789/0 conn(0x7f888c06a060 legacy=0x7f888c0ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.336+0000 7f888bfff700 1 -- 172.21.15.31:0/1826843337 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c0695f0 con 0x7f888c15a030 2023-10-09T06:26:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.336+0000 7f888bfff700 1 --2- 172.21.15.31:0/1826843337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f888c15a030 0x7f888c0b0450 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8884009f20 tx=0x7f8884009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13134548600a0cd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.336+0000 7f888a7fc700 1 -- 172.21.15.31:0/1826843337 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888400e070 con 0x7f888c15a030 2023-10-09T06:26:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.336+0000 7f888a7fc700 1 -- 172.21.15.31:0/1826843337 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888400ba40 con 0x7f888c15a030 2023-10-09T06:26:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.336+0000 7f888a7fc700 1 -- 172.21.15.31:0/1826843337 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88840092e0 con 0x7f888c15a030 2023-10-09T06:26:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.336+0000 7f8890b84700 1 -- 172.21.15.31:0/1826843337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f888c15a030 msgr2=0x7f888c0b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.336+0000 7f8890b84700 1 --2- 172.21.15.31:0/1826843337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f888c15a030 0x7f888c0b0450 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8884009f20 tx=0x7f8884009840 comp rx=0 tx=0).stop 2023-10-09T06:26:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.336+0000 7f8890b84700 1 -- 172.21.15.31:0/1826843337 shutdown_connections 2023-10-09T06:26:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.336+0000 7f8890b84700 1 --2- 172.21.15.31:0/1826843337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f888c15a030 0x7f888c0b0450 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.336+0000 7f8890b84700 1 --2- 172.21.15.31:0/1826843337 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f888c159c60 0x7f888c15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.336+0000 7f8890b84700 1 -- 172.21.15.31:0/1826843337 >> 172.21.15.31:0/1826843337 conn(0x7f888c06c740 msgr2=0x7f888c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.336+0000 7f8890b84700 1 -- 172.21.15.31:0/1826843337 shutdown_connections 2023-10-09T06:26:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.336+0000 7f8890b84700 1 -- 172.21.15.31:0/1826843337 wait complete. 2023-10-09T06:26:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.338+0000 7f8890b84700 1 Processor -- start 2023-10-09T06:26:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.338+0000 7f8890b84700 1 -- start start 2023-10-09T06:26:40.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.338+0000 7f8890b84700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f888c06a060 0x7f888c16e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:40.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.338+0000 7f8890b84700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f888c159c60 0x7f888c0b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:40.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.338+0000 7f8890b84700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f888c15a030 0x7f888c1454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:40.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.338+0000 7f8890b84700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0b17d0 con 0x7f888c06a060 2023-10-09T06:26:40.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.338+0000 7f8890b84700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c15ce30 con 0x7f888c15a030 2023-10-09T06:26:40.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.338+0000 7f8890b84700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c145a00 con 0x7f888c159c60 2023-10-09T06:26:40.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.338+0000 7f888b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f888c06a060 0x7f888c16e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:40.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.338+0000 7f888b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f888c06a060 0x7f888c16e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53846/0 (socket says 172.21.15.31:53846) 2023-10-09T06:26:40.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.338+0000 7f888b7fe700 1 -- 172.21.15.31:0/3807024632 learned_addr learned my addr 172.21.15.31:0/3807024632 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:40.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f888bfff700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f888c15a030 0x7f888c1454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:40.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f888affd700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f888c159c60 0x7f888c0b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:40.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f888b7fe700 1 -- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f888c159c60 msgr2=0x7f888c0b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:40.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f888b7fe700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f888c159c60 0x7f888c0b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f888b7fe700 1 -- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f888c15a030 msgr2=0x7f888c1454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:40.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f888b7fe700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f888c15a030 0x7f888c1454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f888b7fe700 1 -- 172.21.15.31:0/3807024632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8884009ae0 con 0x7f888c06a060 2023-10-09T06:26:40.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f888bfff700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f888c15a030 0x7f888c1454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:40.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f888b7fe700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f888c06a060 0x7f888c16e410 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f887c00d890 tx=0x7f887c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:40.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f88737fe700 1 -- 172.21.15.31:0/3807024632 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c00b600 con 0x7f888c06a060 2023-10-09T06:26:40.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f88737fe700 1 -- 172.21.15.31:0/3807024632 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887c00b760 con 0x7f888c06a060 2023-10-09T06:26:40.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f8890b84700 1 -- 172.21.15.31:0/3807024632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888c0b19e0 con 0x7f888c06a060 2023-10-09T06:26:40.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f88737fe700 1 -- 172.21.15.31:0/3807024632 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c00bae0 con 0x7f888c06a060 2023-10-09T06:26:40.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.339+0000 7f8890b84700 1 -- 172.21.15.31:0/3807024632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888c0b1fa0 con 0x7f888c06a060 2023-10-09T06:26:40.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.340+0000 7f8890b84700 1 -- 172.21.15.31:0/3807024632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f888c0b25f0 con 0x7f888c06a060 2023-10-09T06:26:40.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.341+0000 7f88737fe700 1 -- 172.21.15.31:0/3807024632 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f887c01e460 con 0x7f888c06a060 2023-10-09T06:26:40.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.341+0000 7f88737fe700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8878066f30 0x7f88780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:40.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.341+0000 7f88737fe700 1 -- 172.21.15.31:0/3807024632 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f887c084be0 con 0x7f888c06a060 2023-10-09T06:26:40.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.341+0000 7f888affd700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8878066f30 0x7f88780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:40.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.342+0000 7f888affd700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8878066f30 0x7f88780693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f888c0cdc90 tx=0x7f8880009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:40.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.345+0000 7f88737fe700 1 -- 172.21.15.31:0/3807024632 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f887c051e50 con 0x7f888c06a060 2023-10-09T06:26:40.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.538+0000 7f8890b84700 1 -- 172.21.15.31:0/3807024632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f888c158280 con 0x7f888c06a060 2023-10-09T06:26:40.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.539+0000 7f88737fe700 1 -- 172.21.15.31:0/3807024632 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f887c055470 con 0x7f888c06a060 2023-10-09T06:26:40.541 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:40.541 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":120,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:26:39.537342+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:26:37.944788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T06:26:38.507409+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:26:40.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.541+0000 7f8890b84700 1 -- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8878066f30 msgr2=0x7f88780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:40.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.541+0000 7f8890b84700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8878066f30 0x7f88780693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f888c0cdc90 tx=0x7f8880009040 comp rx=0 tx=0).stop 2023-10-09T06:26:40.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.541+0000 7f8890b84700 1 -- 172.21.15.31:0/3807024632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f888c06a060 msgr2=0x7f888c16e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:40.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.541+0000 7f8890b84700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f888c06a060 0x7f888c16e410 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f887c00d890 tx=0x7f887c008040 comp rx=0 tx=0).stop 2023-10-09T06:26:40.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.541+0000 7f8890b84700 1 -- 172.21.15.31:0/3807024632 shutdown_connections 2023-10-09T06:26:40.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.541+0000 7f8890b84700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8878066f30 0x7f88780693e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.541+0000 7f8890b84700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f888c15a030 0x7f888c1454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.541+0000 7f8890b84700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f888c06a060 0x7f888c16e410 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.541+0000 7f8890b84700 1 --2- 172.21.15.31:0/3807024632 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f888c159c60 0x7f888c0b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.541+0000 7f8890b84700 1 -- 172.21.15.31:0/3807024632 >> 172.21.15.31:0/3807024632 conn(0x7f888c06c740 msgr2=0x7f888c0cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:40.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.542+0000 7f8890b84700 1 -- 172.21.15.31:0/3807024632 shutdown_connections 2023-10-09T06:26:40.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.542+0000 7f8890b84700 1 -- 172.21.15.31:0/3807024632 wait complete. 2023-10-09T06:26:40.555 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:26:40.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.674+0000 7fa38d608700 1 Processor -- start 2023-10-09T06:26:40.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.674+0000 7fa38d608700 1 -- start start 2023-10-09T06:26:40.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.675+0000 7fa38d608700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3880b6620 0x7fa3880b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:40.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.675+0000 7fa38d608700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa38809b180 0x7fa38809b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:40.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.675+0000 7fa38d608700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38809acf0 con 0x7fa38815d5d0 2023-10-09T06:26:40.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.675+0000 7fa38d608700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3880b6a90 con 0x7fa38809b180 2023-10-09T06:26:40.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.675+0000 7fa38d608700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38815d9a0 con 0x7fa3880b6620 2023-10-09T06:26:40.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.675+0000 7fa3867fc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3880b6620 0x7fa3880b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:40.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.675+0000 7fa3877fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa38809b180 0x7fa38809b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:40.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.675+0000 7fa3877fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa38809b180 0x7fa38809b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:48426/0 (socket says 172.21.15.31:48426) 2023-10-09T06:26:40.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.675+0000 7fa3877fe700 1 -- 172.21.15.31:0/2897477067 learned_addr learned my addr 172.21.15.31:0/2897477067 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:40.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.676+0000 7fa3877fe700 1 -- 172.21.15.31:0/2897477067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3880b6620 msgr2=0x7fa3880b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:40.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.676+0000 7fa3877fe700 1 --2- 172.21.15.31:0/2897477067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3880b6620 0x7fa3880b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.676+0000 7fa3877fe700 1 -- 172.21.15.31:0/2897477067 >> v1:172.21.15.158:6789/0 conn(0x7fa38815d5d0 legacy=0x7fa3880b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:40.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.676+0000 7fa3877fe700 1 -- 172.21.15.31:0/2897477067 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3880b4b20 con 0x7fa38809b180 2023-10-09T06:26:40.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.676+0000 7fa3867fc700 1 --2- 172.21.15.31:0/2897477067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3880b6620 0x7fa3880b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:26:40.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.676+0000 7fa3877fe700 1 --2- 172.21.15.31:0/2897477067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa38809b180 0x7fa38809b600 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa3780099b0 tx=0x7fa378009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d153572d27b6a136 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:40.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.676+0000 7fa385ffb700 1 -- 172.21.15.31:0/2897477067 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa378009ea0 con 0x7fa38809b180 2023-10-09T06:26:40.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.676+0000 7fa385ffb700 1 -- 172.21.15.31:0/2897477067 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37800b8f0 con 0x7fa38809b180 2023-10-09T06:26:40.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.676+0000 7fa385ffb700 1 -- 172.21.15.31:0/2897477067 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37800bc90 con 0x7fa38809b180 2023-10-09T06:26:40.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.677+0000 7fa38d608700 1 -- 172.21.15.31:0/2897477067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa38809b180 msgr2=0x7fa38809b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:40.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.677+0000 7fa38d608700 1 --2- 172.21.15.31:0/2897477067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa38809b180 0x7fa38809b600 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa3780099b0 tx=0x7fa378009250 comp rx=0 tx=0).stop 2023-10-09T06:26:40.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.677+0000 7fa38d608700 1 -- 172.21.15.31:0/2897477067 shutdown_connections 2023-10-09T06:26:40.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.677+0000 7fa38d608700 1 --2- 172.21.15.31:0/2897477067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa38809b180 0x7fa38809b600 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.677+0000 7fa38d608700 1 --2- 172.21.15.31:0/2897477067 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa3880b6620 0x7fa3880b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.677+0000 7fa38d608700 1 -- 172.21.15.31:0/2897477067 >> 172.21.15.31:0/2897477067 conn(0x7fa388067e40 msgr2=0x7fa3880d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:40.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.677+0000 7fa38d608700 1 -- 172.21.15.31:0/2897477067 shutdown_connections 2023-10-09T06:26:40.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.677+0000 7fa38d608700 1 -- 172.21.15.31:0/2897477067 wait complete. 2023-10-09T06:26:40.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.678+0000 7fa38d608700 1 Processor -- start 2023-10-09T06:26:40.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.678+0000 7fa38d608700 1 -- start start 2023-10-09T06:26:40.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa38d608700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa38809b180 0x7fa388158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:40.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa38d608700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3880b6620 0x7fa38815de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:40.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa38d608700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa38815d5d0 0x7fa3880ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:40.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa38d608700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3880adf20 con 0x7fa3880b6620 2023-10-09T06:26:40.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa38d608700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa388158560 con 0x7fa38815d5d0 2023-10-09T06:26:40.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa38d608700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38815e3a0 con 0x7fa38809b180 2023-10-09T06:26:40.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa3867fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3880b6620 0x7fa38815de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:40.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa3867fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3880b6620 0x7fa38815de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53854/0 (socket says 172.21.15.31:53854) 2023-10-09T06:26:40.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa3867fc700 1 -- 172.21.15.31:0/4277708873 learned_addr learned my addr 172.21.15.31:0/4277708873 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:40.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa3877fe700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa38815d5d0 0x7fa3880ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:40.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa386ffd700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa38809b180 0x7fa388158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:40.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa3867fc700 1 -- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa38809b180 msgr2=0x7fa388158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:40.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa3867fc700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa38809b180 0x7fa388158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa3867fc700 1 -- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa38815d5d0 msgr2=0x7fa3880ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:40.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa3867fc700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa38815d5d0 0x7fa3880ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa3867fc700 1 -- 172.21.15.31:0/4277708873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa370009420 con 0x7fa3880b6620 2023-10-09T06:26:40.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa386ffd700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa38809b180 0x7fa388158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:40.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.679+0000 7fa3867fc700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3880b6620 0x7fa38815de60 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fa37000ec80 tx=0x7fa3700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:40.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.680+0000 7fa37effd700 1 -- 172.21.15.31:0/4277708873 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000c8f0 con 0x7fa3880b6620 2023-10-09T06:26:40.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.680+0000 7fa37effd700 1 -- 172.21.15.31:0/4277708873 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37000ca50 con 0x7fa3880b6620 2023-10-09T06:26:40.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.680+0000 7fa37effd700 1 -- 172.21.15.31:0/4277708873 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000cdd0 con 0x7fa3880b6620 2023-10-09T06:26:40.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.680+0000 7fa38d608700 1 -- 172.21.15.31:0/4277708873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3780094f0 con 0x7fa3880b6620 2023-10-09T06:26:40.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.680+0000 7fa38d608700 1 -- 172.21.15.31:0/4277708873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3880ad8d0 con 0x7fa3880b6620 2023-10-09T06:26:40.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.681+0000 7fa38d608700 1 -- 172.21.15.31:0/4277708873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3880ad730 con 0x7fa3880b6620 2023-10-09T06:26:40.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.681+0000 7fa37effd700 1 -- 172.21.15.31:0/4277708873 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa370013680 con 0x7fa3880b6620 2023-10-09T06:26:40.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.681+0000 7fa37effd700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa368066f30 0x7fa3680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:40.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.681+0000 7fa37effd700 1 -- 172.21.15.31:0/4277708873 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa370084880 con 0x7fa3880b6620 2023-10-09T06:26:40.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.682+0000 7fa386ffd700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa368066f30 0x7fa3680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:40.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.682+0000 7fa386ffd700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa368066f30 0x7fa3680693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa380007fd0 tx=0x7fa380009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:40.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.686+0000 7fa37effd700 1 -- 172.21.15.31:0/4277708873 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3880ad730 con 0x7fa3880b6620 2023-10-09T06:26:40.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.878+0000 7fa38d608700 1 -- 172.21.15.31:0/4277708873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3880ad730 con 0x7fa3880b6620 2023-10-09T06:26:40.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.878+0000 7fa37effd700 1 -- 172.21.15.31:0/4277708873 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fa3880ad730 con 0x7fa3880b6620 2023-10-09T06:26:40.879 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:40.879 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":120,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:26:39.537342+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:26:37.944788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T06:26:38.507409+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:26:40.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.880+0000 7fa38d608700 1 -- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa368066f30 msgr2=0x7fa3680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:40.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.880+0000 7fa38d608700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa368066f30 0x7fa3680693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa380007fd0 tx=0x7fa380009040 comp rx=0 tx=0).stop 2023-10-09T06:26:40.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.880+0000 7fa38d608700 1 -- 172.21.15.31:0/4277708873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3880b6620 msgr2=0x7fa38815de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:40.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.880+0000 7fa38d608700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3880b6620 0x7fa38815de60 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fa37000ec80 tx=0x7fa3700091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.881+0000 7fa38d608700 1 -- 172.21.15.31:0/4277708873 shutdown_connections 2023-10-09T06:26:40.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.881+0000 7fa38d608700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa368066f30 0x7fa3680693e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.881+0000 7fa38d608700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa38809b180 0x7fa388158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.881+0000 7fa38d608700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa38815d5d0 0x7fa3880ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.881+0000 7fa38d608700 1 --2- 172.21.15.31:0/4277708873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3880b6620 0x7fa38815de60 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:40.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.881+0000 7fa38d608700 1 -- 172.21.15.31:0/4277708873 >> 172.21.15.31:0/4277708873 conn(0x7fa388067e40 msgr2=0x7fa3880b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:40.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.881+0000 7fa38d608700 1 -- 172.21.15.31:0/4277708873 shutdown_connections 2023-10-09T06:26:40.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:40.881+0000 7fa38d608700 1 -- 172.21.15.31:0/4277708873 wait complete. 2023-10-09T06:26:40.894 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:26:41.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.015+0000 7f9f38ae2700 1 Processor -- start 2023-10-09T06:26:41.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.015+0000 7f9f38ae2700 1 -- start start 2023-10-09T06:26:41.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.016+0000 7f9f38ae2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f34157a20 0x7f9f340af870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:41.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.016+0000 7f9f38ae2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9f34157df0 0x7f9f340c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:41.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.016+0000 7f9f38ae2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f340c8d20 con 0x7f9f3406eaf0 2023-10-09T06:26:41.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.016+0000 7f9f38ae2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f340c8a80 con 0x7f9f34157a20 2023-10-09T06:26:41.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.016+0000 7f9f38ae2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f340c7930 con 0x7f9f34157df0 2023-10-09T06:26:41.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.016+0000 7f9f3259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f34157a20 0x7f9f340af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:41.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.017+0000 7f9f3259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f34157a20 0x7f9f340af870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53868/0 (socket says 172.21.15.31:53868) 2023-10-09T06:26:41.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.017+0000 7f9f3259c700 1 -- 172.21.15.31:0/4150339823 learned_addr learned my addr 172.21.15.31:0/4150339823 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:41.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.017+0000 7f9f31d9b700 1 --2- 172.21.15.31:0/4150339823 >> v2:172.21.15.158:3300/0 conn(0x7f9f34157df0 0x7f9f340c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:41.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.017+0000 7f9f3259c700 1 -- 172.21.15.31:0/4150339823 >> v2:172.21.15.158:3300/0 conn(0x7f9f34157df0 msgr2=0x7f9f340c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:41.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.017+0000 7f9f3259c700 1 --2- 172.21.15.31:0/4150339823 >> v2:172.21.15.158:3300/0 conn(0x7f9f34157df0 0x7f9f340c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:41.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.017+0000 7f9f3259c700 1 -- 172.21.15.31:0/4150339823 >> v1:172.21.15.158:6789/0 conn(0x7f9f3406eaf0 legacy=0x7f9f3406ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:41.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.017+0000 7f9f3259c700 1 -- 172.21.15.31:0/4150339823 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f340c7c10 con 0x7f9f34157a20 2023-10-09T06:26:41.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.017+0000 7f9f3259c700 1 --2- 172.21.15.31:0/4150339823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f34157a20 0x7f9f340af870 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9f3406b5d0 tx=0x7f9f2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c3dd36d0d42e8c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:41.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.017+0000 7f9f3159a700 1 -- 172.21.15.31:0/4150339823 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c009e70 con 0x7f9f34157a20 2023-10-09T06:26:41.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.017+0000 7f9f3159a700 1 -- 172.21.15.31:0/4150339823 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c00b860 con 0x7f9f34157a20 2023-10-09T06:26:41.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.017+0000 7f9f3159a700 1 -- 172.21.15.31:0/4150339823 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c00bc00 con 0x7f9f34157a20 2023-10-09T06:26:41.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.018+0000 7f9f38ae2700 1 -- 172.21.15.31:0/4150339823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f34157a20 msgr2=0x7f9f340af870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:41.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.018+0000 7f9f38ae2700 1 --2- 172.21.15.31:0/4150339823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f34157a20 0x7f9f340af870 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9f3406b5d0 tx=0x7f9f2c009250 comp rx=0 tx=0).stop 2023-10-09T06:26:41.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.018+0000 7f9f38ae2700 1 -- 172.21.15.31:0/4150339823 shutdown_connections 2023-10-09T06:26:41.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.018+0000 7f9f38ae2700 1 --2- 172.21.15.31:0/4150339823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f34157a20 0x7f9f340af870 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:41.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.018+0000 7f9f38ae2700 1 --2- 172.21.15.31:0/4150339823 >> v2:172.21.15.158:3300/0 conn(0x7f9f34157df0 0x7f9f340c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:41.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.018+0000 7f9f38ae2700 1 -- 172.21.15.31:0/4150339823 >> 172.21.15.31:0/4150339823 conn(0x7f9f34067660 msgr2=0x7f9f34067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:41.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.018+0000 7f9f38ae2700 1 -- 172.21.15.31:0/4150339823 shutdown_connections 2023-10-09T06:26:41.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.018+0000 7f9f38ae2700 1 -- 172.21.15.31:0/4150339823 wait complete. 2023-10-09T06:26:41.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.019+0000 7f9f38ae2700 1 Processor -- start 2023-10-09T06:26:41.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.019+0000 7f9f38ae2700 1 -- start start 2023-10-09T06:26:41.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f38ae2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f3406eaf0 0x7f9f341521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:41.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f38ae2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f34157a20 0x7f9f34159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:41.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f38ae2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f34157df0 0x7f9f34149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:41.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f38ae2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f341514f0 con 0x7f9f34157a20 2023-10-09T06:26:41.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f38ae2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f34151d30 con 0x7f9f3406eaf0 2023-10-09T06:26:41.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f38ae2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340c4ce0 con 0x7f9f34157df0 2023-10-09T06:26:41.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f31d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f34157a20 0x7f9f34159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:41.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f31d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f34157a20 0x7f9f34159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53870/0 (socket says 172.21.15.31:53870) 2023-10-09T06:26:41.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f31d9b700 1 -- 172.21.15.31:0/2382693902 learned_addr learned my addr 172.21.15.31:0/2382693902 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:41.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f3259c700 1 --2- 172.21.15.31:0/2382693902 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f3406eaf0 0x7f9f341521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:41.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f31d9b700 1 -- 172.21.15.31:0/2382693902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f34157df0 msgr2=0x7f9f34149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:41.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f31d9b700 1 --2- 172.21.15.31:0/2382693902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f34157df0 0x7f9f34149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:41.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f31d9b700 1 -- 172.21.15.31:0/2382693902 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f3406eaf0 msgr2=0x7f9f341521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:41.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f31d9b700 1 --2- 172.21.15.31:0/2382693902 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f3406eaf0 0x7f9f341521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:41.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f31d9b700 1 -- 172.21.15.31:0/2382693902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c0094f0 con 0x7f9f34157a20 2023-10-09T06:26:41.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f31d9b700 1 --2- 172.21.15.31:0/2382693902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f34157a20 0x7f9f34159120 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00e900 tx=0x7f9f1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:41.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f2a7fc700 1 -- 172.21.15.31:0/2382693902 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c00eea0 con 0x7f9f34157a20 2023-10-09T06:26:41.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f2a7fc700 1 -- 172.21.15.31:0/2382693902 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1c00c850 con 0x7f9f34157a20 2023-10-09T06:26:41.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f38ae2700 1 -- 172.21.15.31:0/2382693902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f340c6790 con 0x7f9f34157a20 2023-10-09T06:26:41.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f2a7fc700 1 -- 172.21.15.31:0/2382693902 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c00cc10 con 0x7f9f34157a20 2023-10-09T06:26:41.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.020+0000 7f9f38ae2700 1 -- 172.21.15.31:0/2382693902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f341519c0 con 0x7f9f34157a20 2023-10-09T06:26:41.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.021+0000 7f9f38ae2700 1 -- 172.21.15.31:0/2382693902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f34151ec0 con 0x7f9f34157a20 2023-10-09T06:26:41.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.022+0000 7f9f2a7fc700 1 -- 172.21.15.31:0/2382693902 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f1c013470 con 0x7f9f34157a20 2023-10-09T06:26:41.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.022+0000 7f9f2a7fc700 1 --2- 172.21.15.31:0/2382693902 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f14066f30 0x7f9f140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:41.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.022+0000 7f9f2a7fc700 1 -- 172.21.15.31:0/2382693902 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f1c084510 con 0x7f9f34157a20 2023-10-09T06:26:41.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.023+0000 7f9f3259c700 1 --2- 172.21.15.31:0/2382693902 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f14066f30 0x7f9f140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:41.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.023+0000 7f9f3259c700 1 --2- 172.21.15.31:0/2382693902 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f14066f30 0x7f9f140693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9f3406b5d0 tx=0x7f9f2c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:41.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.026+0000 7f9f2a7fc700 1 -- 172.21.15.31:0/2382693902 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f1c051780 con 0x7f9f34157a20 2023-10-09T06:26:41.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:41.267+0000 7f9f38ae2700 1 -- 172.21.15.31:0/2382693902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9f3404c3c0 con 0x7f9f34157a20 2023-10-09T06:26:42.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.150+0000 7f9f2a7fc700 1 -- 172.21.15.31:0/2382693902 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9f1c054da0 con 0x7f9f34157a20 2023-10-09T06:26:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.153+0000 7f9f38ae2700 1 -- 172.21.15.31:0/2382693902 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f14066f30 msgr2=0x7f9f140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.153+0000 7f9f38ae2700 1 --2- 172.21.15.31:0/2382693902 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f14066f30 0x7f9f140693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9f3406b5d0 tx=0x7f9f2c017000 comp rx=0 tx=0).stop 2023-10-09T06:26:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.153+0000 7f9f38ae2700 1 -- 172.21.15.31:0/2382693902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f34157a20 msgr2=0x7f9f34159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.153+0000 7f9f38ae2700 1 --2- 172.21.15.31:0/2382693902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f34157a20 0x7f9f34159120 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00e900 tx=0x7f9f1c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.153+0000 7f9f38ae2700 1 -- 172.21.15.31:0/2382693902 shutdown_connections 2023-10-09T06:26:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.153+0000 7f9f38ae2700 1 --2- 172.21.15.31:0/2382693902 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f14066f30 0x7f9f140693e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.153+0000 7f9f38ae2700 1 --2- 172.21.15.31:0/2382693902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f34157df0 0x7f9f34149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.153+0000 7f9f38ae2700 1 --2- 172.21.15.31:0/2382693902 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f3406eaf0 0x7f9f341521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.153+0000 7f9f38ae2700 1 --2- 172.21.15.31:0/2382693902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f34157a20 0x7f9f34159120 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.153+0000 7f9f38ae2700 1 -- 172.21.15.31:0/2382693902 >> 172.21.15.31:0/2382693902 conn(0x7f9f34067660 msgr2=0x7f9f340b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:42.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.153+0000 7f9f38ae2700 1 -- 172.21.15.31:0/2382693902 shutdown_connections 2023-10-09T06:26:42.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.153+0000 7f9f38ae2700 1 -- 172.21.15.31:0/2382693902 wait complete. 2023-10-09T06:26:42.168 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:26:42.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.294+0000 7fcded180700 1 Processor -- start 2023-10-09T06:26:42.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.294+0000 7fcded180700 1 -- start start 2023-10-09T06:26:42.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.295+0000 7fcded180700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcde8067d70 0x7fcde8164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:42.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.295+0000 7fcded180700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde815e1e0 con 0x7fcde8154440 2023-10-09T06:26:42.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.295+0000 7fcded180700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde815e4c0 con 0x7fcde815da90 2023-10-09T06:26:42.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.295+0000 7fcded180700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde815e7a0 con 0x7fcde8067d70 2023-10-09T06:26:42.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.295+0000 7fcde759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcde8067d70 0x7fcde8164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:42.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.295+0000 7fcde6d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcde8154440 0x7fcde815af30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43710/0 (socket says 172.21.15.31:43710) 2023-10-09T06:26:42.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.295+0000 7fcde6d9d700 1 -- 172.21.15.31:0/96947380 learned_addr learned my addr 172.21.15.31:0/96947380 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:42.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.295+0000 7fcde759e700 1 -- 172.21.15.31:0/96947380 >> v1:172.21.15.158:6789/0 conn(0x7fcde815da90 legacy=0x7fcde8067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:42.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.295+0000 7fcde759e700 1 -- 172.21.15.31:0/96947380 >> v1:172.21.15.31:6789/0 conn(0x7fcde8154440 legacy=0x7fcde815af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:42.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.295+0000 7fcde5d9b700 1 -- 172.21.15.31:0/96947380 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965536350 0 0) 0x7fcde815e1e0 con 0x7fcde8154440 2023-10-09T06:26:42.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.295+0000 7fcde759e700 1 -- 172.21.15.31:0/96947380 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde80cf500 con 0x7fcde8067d70 2023-10-09T06:26:42.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.295+0000 7fcde759e700 1 --2- 172.21.15.31:0/96947380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde8067d70 0x7fcde8164e30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcde00098e0 tx=0x7fcde00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe49ebbcd52e444 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:42.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.296+0000 7fcde5d9b700 1 -- 172.21.15.31:0/96947380 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0009e80 con 0x7fcde8067d70 2023-10-09T06:26:42.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.296+0000 7fcde5d9b700 1 -- 172.21.15.31:0/96947380 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde000b860 con 0x7fcde8067d70 2023-10-09T06:26:42.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.296+0000 7fcde5d9b700 1 -- 172.21.15.31:0/96947380 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde000bbe0 con 0x7fcde8067d70 2023-10-09T06:26:42.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.296+0000 7fcded180700 1 -- 172.21.15.31:0/96947380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde8067d70 msgr2=0x7fcde8164e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:42.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.296+0000 7fcded180700 1 --2- 172.21.15.31:0/96947380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde8067d70 0x7fcde8164e30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcde00098e0 tx=0x7fcde00091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:42.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.296+0000 7fcded180700 1 -- 172.21.15.31:0/96947380 shutdown_connections 2023-10-09T06:26:42.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.296+0000 7fcded180700 1 --2- 172.21.15.31:0/96947380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde8067d70 0x7fcde8164e30 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:42.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.296+0000 7fcded180700 1 -- 172.21.15.31:0/96947380 >> 172.21.15.31:0/96947380 conn(0x7fcde80d0dd0 msgr2=0x7fcde80d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:42.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.296+0000 7fcded180700 1 -- 172.21.15.31:0/96947380 shutdown_connections 2023-10-09T06:26:42.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.296+0000 7fcded180700 1 -- 172.21.15.31:0/96947380 wait complete. 2023-10-09T06:26:42.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.297+0000 7fcded180700 1 Processor -- start 2023-10-09T06:26:42.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.297+0000 7fcded180700 1 -- start start 2023-10-09T06:26:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.298+0000 7fcded180700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcde8067d70 0x7fcde80b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.298+0000 7fcded180700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde8154440 0x7fcde81468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.298+0000 7fcded180700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcde815da90 0x7fcde815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.298+0000 7fcded180700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde8153160 con 0x7fcde8154440 2023-10-09T06:26:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.298+0000 7fcded180700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde8146e20 con 0x7fcde815da90 2023-10-09T06:26:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.298+0000 7fcded180700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde80b23b0 con 0x7fcde8067d70 2023-10-09T06:26:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.298+0000 7fcde659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde8154440 0x7fcde81468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:42.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.298+0000 7fcde659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde8154440 0x7fcde81468e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53880/0 (socket says 172.21.15.31:53880) 2023-10-09T06:26:42.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.298+0000 7fcde659c700 1 -- 172.21.15.31:0/1122785440 learned_addr learned my addr 172.21.15.31:0/1122785440 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:42.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.299+0000 7fcde759e700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcde815da90 0x7fcde815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:42.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.299+0000 7fcde6d9d700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcde8067d70 0x7fcde80b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:42.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.299+0000 7fcde659c700 1 -- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcde8067d70 msgr2=0x7fcde80b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:42.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.299+0000 7fcde659c700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcde8067d70 0x7fcde80b3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:42.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.299+0000 7fcde659c700 1 -- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcde815da90 msgr2=0x7fcde815cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:42.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.299+0000 7fcde659c700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcde815da90 0x7fcde815cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:42.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.299+0000 7fcde659c700 1 -- 172.21.15.31:0/1122785440 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde0009420 con 0x7fcde8154440 2023-10-09T06:26:42.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.299+0000 7fcde659c700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde8154440 0x7fcde81468e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000c4e0 tx=0x7fcdd000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:42.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.299+0000 7fcddeffd700 1 -- 172.21.15.31:0/1122785440 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0011590 con 0x7fcde8154440 2023-10-09T06:26:42.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.299+0000 7fcddeffd700 1 -- 172.21.15.31:0/1122785440 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd0011710 con 0x7fcde8154440 2023-10-09T06:26:42.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.299+0000 7fcded180700 1 -- 172.21.15.31:0/1122785440 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde80b17e0 con 0x7fcde8154440 2023-10-09T06:26:42.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.299+0000 7fcddeffd700 1 -- 172.21.15.31:0/1122785440 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0011ad0 con 0x7fcde8154440 2023-10-09T06:26:42.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.299+0000 7fcded180700 1 -- 172.21.15.31:0/1122785440 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde80b1d60 con 0x7fcde8154440 2023-10-09T06:26:42.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.300+0000 7fcded180700 1 -- 172.21.15.31:0/1122785440 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde80b2740 con 0x7fcde8154440 2023-10-09T06:26:42.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.300+0000 7fcddeffd700 1 -- 172.21.15.31:0/1122785440 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcdd001b3b0 con 0x7fcde8154440 2023-10-09T06:26:42.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.301+0000 7fcddeffd700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcdc8066f30 0x7fcdc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:42.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.301+0000 7fcddeffd700 1 -- 172.21.15.31:0/1122785440 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcdd0083a70 con 0x7fcde8154440 2023-10-09T06:26:42.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.301+0000 7fcde6d9d700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcdc8066f30 0x7fcdc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:42.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.302+0000 7fcde6d9d700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcdc8066f30 0x7fcdc80693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8000f80 tx=0x7fcdd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:42.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.305+0000 7fcddeffd700 1 -- 172.21.15.31:0/1122785440 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdd0050ce0 con 0x7fcde8154440 2023-10-09T06:26:42.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:42.543+0000 7fcded180700 1 -- 172.21.15.31:0/1122785440 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcde80b2520 con 0x7fcde8154440 2023-10-09T06:26:43.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.155+0000 7fcddeffd700 1 -- 172.21.15.31:0/1122785440 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcdd0017070 con 0x7fcde8154440 2023-10-09T06:26:43.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.157+0000 7fcded180700 1 -- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcdc8066f30 msgr2=0x7fcdc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.157+0000 7fcded180700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcdc8066f30 0x7fcdc80693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8000f80 tx=0x7fcdd8009040 comp rx=0 tx=0).stop 2023-10-09T06:26:43.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.157+0000 7fcded180700 1 -- 172.21.15.31:0/1122785440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde8154440 msgr2=0x7fcde81468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.157+0000 7fcded180700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde8154440 0x7fcde81468e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000c4e0 tx=0x7fcdd000c8a0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.157+0000 7fcded180700 1 -- 172.21.15.31:0/1122785440 shutdown_connections 2023-10-09T06:26:43.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.157+0000 7fcded180700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcdc8066f30 0x7fcdc80693e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.157+0000 7fcded180700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcde8067d70 0x7fcde80b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.157+0000 7fcded180700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcde815da90 0x7fcde815cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.157+0000 7fcded180700 1 --2- 172.21.15.31:0/1122785440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde8154440 0x7fcde81468e0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.157+0000 7fcded180700 1 -- 172.21.15.31:0/1122785440 >> 172.21.15.31:0/1122785440 conn(0x7fcde80d0dd0 msgr2=0x7fcde80b6660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:43.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.157+0000 7fcded180700 1 -- 172.21.15.31:0/1122785440 shutdown_connections 2023-10-09T06:26:43.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.157+0000 7fcded180700 1 -- 172.21.15.31:0/1122785440 wait complete. 2023-10-09T06:26:43.171 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.290+0000 7fcd55aad700 1 Processor -- start 2023-10-09T06:26:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.290+0000 7fcd55aad700 1 -- start start 2023-10-09T06:26:43.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd55aad700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd500cdab0 0x7fcd5015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:43.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd55aad700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcd5015dda0 0x7fcd5015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:43.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd55aad700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd500cb7c0 con 0x7fcd500cd6e0 2023-10-09T06:26:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd55aad700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5015e850 con 0x7fcd5015dda0 2023-10-09T06:26:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd55aad700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500cc360 con 0x7fcd500cdab0 2023-10-09T06:26:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd54aab700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcd500cd6e0 0x7fcd500cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43718/0 (socket says 172.21.15.31:43718) 2023-10-09T06:26:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd54aab700 1 -- 172.21.15.31:0/1239019384 learned_addr learned my addr 172.21.15.31:0/1239019384 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd552ac700 1 --2- 172.21.15.31:0/1239019384 >> v2:172.21.15.31:3300/0 conn(0x7fcd5015dda0 0x7fcd5015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd4f7fe700 1 -- 172.21.15.31:0/1239019384 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277865957 0 0) 0x7fcd500cb7c0 con 0x7fcd500cd6e0 2023-10-09T06:26:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd4f7fe700 1 -- 172.21.15.31:0/1239019384 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd38003570 con 0x7fcd500cd6e0 2023-10-09T06:26:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd4ffff700 1 --2- 172.21.15.31:0/1239019384 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd500cdab0 0x7fcd5015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd552ac700 1 -- 172.21.15.31:0/1239019384 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd500cdab0 msgr2=0x7fcd5015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd552ac700 1 --2- 172.21.15.31:0/1239019384 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd500cdab0 0x7fcd5015d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd552ac700 1 -- 172.21.15.31:0/1239019384 >> v1:172.21.15.31:6789/0 conn(0x7fcd500cd6e0 legacy=0x7fcd500cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.291+0000 7fcd552ac700 1 -- 172.21.15.31:0/1239019384 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5015e290 con 0x7fcd5015dda0 2023-10-09T06:26:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.292+0000 7fcd552ac700 1 --2- 172.21.15.31:0/1239019384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd5015dda0 0x7fcd5015cbd0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009e60 tx=0x7fcd48009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e0efb2afb0555c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.292+0000 7fcd4f7fe700 1 -- 172.21.15.31:0/1239019384 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4800e070 con 0x7fcd5015dda0 2023-10-09T06:26:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.292+0000 7fcd4f7fe700 1 -- 172.21.15.31:0/1239019384 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4800bb60 con 0x7fcd5015dda0 2023-10-09T06:26:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.292+0000 7fcd4f7fe700 1 -- 172.21.15.31:0/1239019384 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48012430 con 0x7fcd5015dda0 2023-10-09T06:26:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.292+0000 7fcd55aad700 1 -- 172.21.15.31:0/1239019384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd5015dda0 msgr2=0x7fcd5015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.292+0000 7fcd55aad700 1 --2- 172.21.15.31:0/1239019384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd5015dda0 0x7fcd5015cbd0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009e60 tx=0x7fcd48009780 comp rx=0 tx=0).stop 2023-10-09T06:26:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.292+0000 7fcd55aad700 1 -- 172.21.15.31:0/1239019384 shutdown_connections 2023-10-09T06:26:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.292+0000 7fcd55aad700 1 --2- 172.21.15.31:0/1239019384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd5015dda0 0x7fcd5015cbd0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.292+0000 7fcd55aad700 1 --2- 172.21.15.31:0/1239019384 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd500cdab0 0x7fcd5015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.292+0000 7fcd55aad700 1 -- 172.21.15.31:0/1239019384 >> 172.21.15.31:0/1239019384 conn(0x7fcd50067660 msgr2=0x7fcd50067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:43.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.292+0000 7fcd55aad700 1 -- 172.21.15.31:0/1239019384 shutdown_connections 2023-10-09T06:26:43.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.292+0000 7fcd55aad700 1 -- 172.21.15.31:0/1239019384 wait complete. 2023-10-09T06:26:43.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.293+0000 7fcd55aad700 1 Processor -- start 2023-10-09T06:26:43.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.294+0000 7fcd55aad700 1 -- start start 2023-10-09T06:26:43.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.294+0000 7fcd55aad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd500cd6e0 0x7fcd5014d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:43.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.294+0000 7fcd55aad700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd500cdab0 0x7fcd500b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.294+0000 7fcd55aad700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5015dda0 0x7fcd5014b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.294+0000 7fcd55aad700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500b6840 con 0x7fcd500cd6e0 2023-10-09T06:26:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.294+0000 7fcd55aad700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500b15a0 con 0x7fcd500cdab0 2023-10-09T06:26:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.294+0000 7fcd55aad700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500b6560 con 0x7fcd5015dda0 2023-10-09T06:26:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.294+0000 7fcd54aab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd500cd6e0 0x7fcd5014d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.294+0000 7fcd54aab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd500cd6e0 0x7fcd5014d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53900/0 (socket says 172.21.15.31:53900) 2023-10-09T06:26:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.294+0000 7fcd54aab700 1 -- 172.21.15.31:0/2737477063 learned_addr learned my addr 172.21.15.31:0/2737477063 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.295+0000 7fcd4ffff700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd500cdab0 0x7fcd500b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.295+0000 7fcd552ac700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5015dda0 0x7fcd5014b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.295+0000 7fcd54aab700 1 -- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5015dda0 msgr2=0x7fcd5014b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.295+0000 7fcd54aab700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5015dda0 0x7fcd5014b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.295+0000 7fcd54aab700 1 -- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd500cdab0 msgr2=0x7fcd500b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.295+0000 7fcd54aab700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd500cdab0 0x7fcd500b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.295+0000 7fcd54aab700 1 -- 172.21.15.31:0/2737477063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd48009a20 con 0x7fcd500cd6e0 2023-10-09T06:26:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.295+0000 7fcd54aab700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd500cd6e0 0x7fcd5014d080 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000c7c0 tx=0x7fcd40007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.295+0000 7fcd4cff9700 1 -- 172.21.15.31:0/2737477063 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd40005b30 con 0x7fcd500cd6e0 2023-10-09T06:26:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.295+0000 7fcd4cff9700 1 -- 172.21.15.31:0/2737477063 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd40005c90 con 0x7fcd500cd6e0 2023-10-09T06:26:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.295+0000 7fcd55aad700 1 -- 172.21.15.31:0/2737477063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd500b0f50 con 0x7fcd500cd6e0 2023-10-09T06:26:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.295+0000 7fcd4cff9700 1 -- 172.21.15.31:0/2737477063 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd40007340 con 0x7fcd500cd6e0 2023-10-09T06:26:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.295+0000 7fcd55aad700 1 -- 172.21.15.31:0/2737477063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd500b6260 con 0x7fcd500cd6e0 2023-10-09T06:26:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.296+0000 7fcd55aad700 1 -- 172.21.15.31:0/2737477063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd50089280 con 0x7fcd500cd6e0 2023-10-09T06:26:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.297+0000 7fcd4cff9700 1 -- 172.21.15.31:0/2737477063 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd4001b400 con 0x7fcd500cd6e0 2023-10-09T06:26:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.297+0000 7fcd4cff9700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd3c066f30 0x7fcd3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.297+0000 7fcd4cff9700 1 -- 172.21.15.31:0/2737477063 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd40084040 con 0x7fcd500cd6e0 2023-10-09T06:26:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.297+0000 7fcd4ffff700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd3c066f30 0x7fcd3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.298+0000 7fcd4ffff700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd3c066f30 0x7fcd3c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcd5006b5a0 tx=0x7fcd44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.301+0000 7fcd4cff9700 1 -- 172.21.15.31:0/2737477063 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd40051330 con 0x7fcd500cd6e0 2023-10-09T06:26:43.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.539+0000 7fcd55aad700 1 -- 172.21.15.31:0/2737477063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd5015db80 con 0x7fcd500cd6e0 2023-10-09T06:26:43.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.540+0000 7fcd4cff9700 1 -- 172.21.15.31:0/2737477063 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fcd40054950 con 0x7fcd500cd6e0 2023-10-09T06:26:43.541 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:43.541 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/487353090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":487353090},{"type":"v1","addr":"172.21.15.158:6837","nonce":487353090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3396628353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3396628353},{"type":"v1","addr":"172.21.15.158:6836","nonce":3396628353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/1862816590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1862816590},{"type":"v1","addr":"172.21.15.31:6833","nonce":1862816590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:26:39.537650+0000","modified":"2023-10-09T06:26:43.150956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4187693404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4187693404},{"type":"v1","addr":"172.21.15.31:6835","nonce":4187693404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T06:26:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.542+0000 7fcd55aad700 1 -- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd3c066f30 msgr2=0x7fcd3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.542+0000 7fcd55aad700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd3c066f30 0x7fcd3c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcd5006b5a0 tx=0x7fcd44008040 comp rx=0 tx=0).stop 2023-10-09T06:26:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.542+0000 7fcd55aad700 1 -- 172.21.15.31:0/2737477063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd500cd6e0 msgr2=0x7fcd5014d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.542+0000 7fcd55aad700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd500cd6e0 0x7fcd5014d080 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000c7c0 tx=0x7fcd40007e00 comp rx=0 tx=0).stop 2023-10-09T06:26:43.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.542+0000 7fcd55aad700 1 -- 172.21.15.31:0/2737477063 shutdown_connections 2023-10-09T06:26:43.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.542+0000 7fcd55aad700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd3c066f30 0x7fcd3c0693e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.542+0000 7fcd55aad700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd5015dda0 0x7fcd5014b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.542+0000 7fcd55aad700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd500cd6e0 0x7fcd5014d080 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.542+0000 7fcd55aad700 1 --2- 172.21.15.31:0/2737477063 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd500cdab0 0x7fcd500b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.542+0000 7fcd55aad700 1 -- 172.21.15.31:0/2737477063 >> 172.21.15.31:0/2737477063 conn(0x7fcd50067660 msgr2=0x7fcd50156be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:43.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.542+0000 7fcd55aad700 1 -- 172.21.15.31:0/2737477063 shutdown_connections 2023-10-09T06:26:43.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.542+0000 7fcd55aad700 1 -- 172.21.15.31:0/2737477063 wait complete. 2023-10-09T06:26:43.545 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 58 2023-10-09T06:26:43.555 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:26:43.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.672+0000 7fdb72326700 1 Processor -- start 2023-10-09T06:26:43.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.672+0000 7fdb72326700 1 -- start start 2023-10-09T06:26:43.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.673+0000 7fdb72326700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb6c15a2b0 0x7fdb6c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:43.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.673+0000 7fdb72326700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c0c5d80 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.673+0000 7fdb72326700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c0c6060 con 0x7fdb6c0d1c30 2023-10-09T06:26:43.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.673+0000 7fdb72326700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c068470 con 0x7fdb6c15a2b0 2023-10-09T06:26:43.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.673+0000 7fdb708c3700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdb6c0cfe20 0x7fdb6c0c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43720/0 (socket says 172.21.15.31:43720) 2023-10-09T06:26:43.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.673+0000 7fdb708c3700 1 -- 172.21.15.31:0/284661619 learned_addr learned my addr 172.21.15.31:0/284661619 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:43.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.674+0000 7fdb6bfff700 1 --2- 172.21.15.31:0/284661619 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb6c15a2b0 0x7fdb6c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:43.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.674+0000 7fdb6affd700 1 -- 172.21.15.31:0/284661619 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573893135 0 0) 0x7fdb6c0c5d80 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.674+0000 7fdb6affd700 1 -- 172.21.15.31:0/284661619 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb58003570 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.674+0000 7fdb6affd700 1 -- 172.21.15.31:0/284661619 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057019884 0 0) 0x7fdb6c0c6060 con 0x7fdb6c0d1c30 2023-10-09T06:26:43.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.674+0000 7fdb6affd700 1 -- 172.21.15.31:0/284661619 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb6c0c5d80 con 0x7fdb6c0d1c30 2023-10-09T06:26:43.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.674+0000 7fdb6bfff700 1 -- 172.21.15.31:0/284661619 >> v1:172.21.15.158:6789/0 conn(0x7fdb6c0d1c30 legacy=0x7fdb6c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.674+0000 7fdb6bfff700 1 -- 172.21.15.31:0/284661619 >> v1:172.21.15.31:6789/0 conn(0x7fdb6c0cfe20 legacy=0x7fdb6c0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.674+0000 7fdb6bfff700 1 -- 172.21.15.31:0/284661619 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c0c6340 con 0x7fdb6c15a2b0 2023-10-09T06:26:43.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.674+0000 7fdb6bfff700 1 --2- 172.21.15.31:0/284661619 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb6c15a2b0 0x7fdb6c0b3da0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009900 tx=0x7fdb5c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72f375b44f9d21d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:43.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.674+0000 7fdb6affd700 1 -- 172.21.15.31:0/284661619 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c005c10 con 0x7fdb6c15a2b0 2023-10-09T06:26:43.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.674+0000 7fdb6affd700 1 -- 172.21.15.31:0/284661619 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c005d70 con 0x7fdb6c15a2b0 2023-10-09T06:26:43.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.674+0000 7fdb6affd700 1 -- 172.21.15.31:0/284661619 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c006260 con 0x7fdb6c15a2b0 2023-10-09T06:26:43.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.675+0000 7fdb72326700 1 -- 172.21.15.31:0/284661619 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb6c15a2b0 msgr2=0x7fdb6c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.675+0000 7fdb72326700 1 --2- 172.21.15.31:0/284661619 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb6c15a2b0 0x7fdb6c0b3da0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009900 tx=0x7fdb5c009120 comp rx=0 tx=0).stop 2023-10-09T06:26:43.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.675+0000 7fdb72326700 1 -- 172.21.15.31:0/284661619 shutdown_connections 2023-10-09T06:26:43.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.675+0000 7fdb72326700 1 --2- 172.21.15.31:0/284661619 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb6c15a2b0 0x7fdb6c0b3da0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.675+0000 7fdb72326700 1 -- 172.21.15.31:0/284661619 >> 172.21.15.31:0/284661619 conn(0x7fdb6c067e40 msgr2=0x7fdb6c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:43.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.675+0000 7fdb72326700 1 -- 172.21.15.31:0/284661619 shutdown_connections 2023-10-09T06:26:43.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.675+0000 7fdb72326700 1 -- 172.21.15.31:0/284661619 wait complete. 2023-10-09T06:26:43.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.676+0000 7fdb72326700 1 Processor -- start 2023-10-09T06:26:43.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.676+0000 7fdb72326700 1 -- start start 2023-10-09T06:26:43.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb72326700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb6c0cfe20 0x7fdb6c159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:43.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb72326700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb6c0d1c30 0x7fdb6c15b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:43.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb72326700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb6c15a2b0 0x7fdb6c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:43.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb72326700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c160bc0 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb72326700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c159d90 con 0x7fdb6c15a2b0 2023-10-09T06:26:43.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb72326700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c15f560 con 0x7fdb6c0d1c30 2023-10-09T06:26:43.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb6bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb6c0cfe20 0x7fdb6c159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:43.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb6bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb6c0cfe20 0x7fdb6c159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53902/0 (socket says 172.21.15.31:53902) 2023-10-09T06:26:43.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb6bfff700 1 -- 172.21.15.31:0/1685778038 learned_addr learned my addr 172.21.15.31:0/1685778038 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:43.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb708c3700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb6c15a2b0 0x7fdb6c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:43.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb6b7fe700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb6c0d1c30 0x7fdb6c15b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:43.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb6bfff700 1 -- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb6c0d1c30 msgr2=0x7fdb6c15b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb6bfff700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb6c0d1c30 0x7fdb6c15b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb6bfff700 1 -- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb6c15a2b0 msgr2=0x7fdb6c15a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb6bfff700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb6c15a2b0 0x7fdb6c15a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb6bfff700 1 -- 172.21.15.31:0/1685778038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c0093c0 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.677+0000 7fdb708c3700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb6c15a2b0 0x7fdb6c15a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:43.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.678+0000 7fdb6bfff700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb6c0cfe20 0x7fdb6c159850 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009390 tx=0x7fdb5c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:43.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.678+0000 7fdb63fff700 1 -- 172.21.15.31:0/1685778038 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c01d800 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.678+0000 7fdb63fff700 1 -- 172.21.15.31:0/1685778038 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c01d9a0 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.678+0000 7fdb72326700 1 -- 172.21.15.31:0/1685778038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c15f840 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.678+0000 7fdb63fff700 1 -- 172.21.15.31:0/1685778038 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c01dd60 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.678+0000 7fdb72326700 1 -- 172.21.15.31:0/1685778038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c160520 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.679+0000 7fdb72326700 1 -- 172.21.15.31:0/1685778038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c04c3c0 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.679+0000 7fdb63fff700 1 -- 172.21.15.31:0/1685778038 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb5c01b690 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.679+0000 7fdb63fff700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdb4c066f30 0x7fdb4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:43.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.680+0000 7fdb63fff700 1 -- 172.21.15.31:0/1685778038 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdb5c085ff0 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.680+0000 7fdb6b7fe700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdb4c066f30 0x7fdb4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:43.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.680+0000 7fdb6b7fe700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdb4c066f30 0x7fdb4c0693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdb54007fd0 tx=0x7fdb54007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:43.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.684+0000 7fdb63fff700 1 -- 172.21.15.31:0/1685778038 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb5c053310 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.881+0000 7fdb72326700 1 -- 172.21.15.31:0/1685778038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb6c160ea0 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.882+0000 7fdb63fff700 1 -- 172.21.15.31:0/1685778038 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+15365 (secure 0 0 0) 0x7fdb5c02a090 con 0x7fdb6c0cfe20 2023-10-09T06:26:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:43.883 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":121,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:26:41.140999+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:26:37.944788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T06:26:38.507409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:26:43.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.884+0000 7fdb72326700 1 -- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdb4c066f30 msgr2=0x7fdb4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.884+0000 7fdb72326700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdb4c066f30 0x7fdb4c0693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdb54007fd0 tx=0x7fdb54007d50 comp rx=0 tx=0).stop 2023-10-09T06:26:43.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.884+0000 7fdb72326700 1 -- 172.21.15.31:0/1685778038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb6c0cfe20 msgr2=0x7fdb6c159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:43.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.884+0000 7fdb72326700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb6c0cfe20 0x7fdb6c159850 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009390 tx=0x7fdb5c016000 comp rx=0 tx=0).stop 2023-10-09T06:26:43.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.884+0000 7fdb72326700 1 -- 172.21.15.31:0/1685778038 shutdown_connections 2023-10-09T06:26:43.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.884+0000 7fdb72326700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdb4c066f30 0x7fdb4c0693e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.884+0000 7fdb72326700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb6c15a2b0 0x7fdb6c15a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.884+0000 7fdb72326700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb6c0cfe20 0x7fdb6c159850 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.884+0000 7fdb72326700 1 --2- 172.21.15.31:0/1685778038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb6c0d1c30 0x7fdb6c15b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:43.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.884+0000 7fdb72326700 1 -- 172.21.15.31:0/1685778038 >> 172.21.15.31:0/1685778038 conn(0x7fdb6c067e40 msgr2=0x7fdb6c06a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:43.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.884+0000 7fdb72326700 1 -- 172.21.15.31:0/1685778038 shutdown_connections 2023-10-09T06:26:43.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:43.884+0000 7fdb72326700 1 -- 172.21.15.31:0/1685778038 wait complete. 2023-10-09T06:26:43.897 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:26:43.898 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:26:44.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.017+0000 7fd96c975700 1 Processor -- start 2023-10-09T06:26:44.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.017+0000 7fd96c975700 1 -- start start 2023-10-09T06:26:44.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96c975700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd968159e60 0x7fd9680b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96c975700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9680cffa0 0x7fd96806a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96c975700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd96815a230 0x7fd96806abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96c975700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd968069d70 con 0x7fd968159e60 2023-10-09T06:26:44.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96c975700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9680b3d40 con 0x7fd96815a230 2023-10-09T06:26:44.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96c975700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9680b4300 con 0x7fd9680cffa0 2023-10-09T06:26:44.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd968159e60 0x7fd9680b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd968159e60 0x7fd9680b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53912/0 (socket says 172.21.15.31:53912) 2023-10-09T06:26:44.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96659c700 1 -- 172.21.15.31:0/4154319037 learned_addr learned my addr 172.21.15.31:0/4154319037 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:44.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd965d9b700 1 --2- 172.21.15.31:0/4154319037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9680cffa0 0x7fd96806a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd966d9d700 1 --2- 172.21.15.31:0/4154319037 >> v2:172.21.15.158:3300/0 conn(0x7fd96815a230 0x7fd96806abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96659c700 1 -- 172.21.15.31:0/4154319037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9680cffa0 msgr2=0x7fd96806a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:44.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96659c700 1 --2- 172.21.15.31:0/4154319037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9680cffa0 0x7fd96806a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96659c700 1 -- 172.21.15.31:0/4154319037 >> v2:172.21.15.158:3300/0 conn(0x7fd96815a230 msgr2=0x7fd96806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:44.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96659c700 1 --2- 172.21.15.31:0/4154319037 >> v2:172.21.15.158:3300/0 conn(0x7fd96815a230 0x7fd96806abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96659c700 1 -- 172.21.15.31:0/4154319037 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9680d0480 con 0x7fd968159e60 2023-10-09T06:26:44.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd965d9b700 1 --2- 172.21.15.31:0/4154319037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9680cffa0 0x7fd96806a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:44.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd966d9d700 1 --2- 172.21.15.31:0/4154319037 >> v2:172.21.15.158:3300/0 conn(0x7fd96815a230 0x7fd96806abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:44.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.018+0000 7fd96659c700 1 --2- 172.21.15.31:0/4154319037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd968159e60 0x7fd9680b6890 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd96806a1d0 tx=0x7fd960009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfb64393af89c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:44.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.019+0000 7fd96559a700 1 -- 172.21.15.31:0/4154319037 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000e070 con 0x7fd968159e60 2023-10-09T06:26:44.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.019+0000 7fd96559a700 1 -- 172.21.15.31:0/4154319037 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96000ba50 con 0x7fd968159e60 2023-10-09T06:26:44.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.019+0000 7fd96559a700 1 -- 172.21.15.31:0/4154319037 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600092e0 con 0x7fd968159e60 2023-10-09T06:26:44.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.019+0000 7fd96c975700 1 -- 172.21.15.31:0/4154319037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd968159e60 msgr2=0x7fd9680b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.019+0000 7fd96c975700 1 --2- 172.21.15.31:0/4154319037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd968159e60 0x7fd9680b6890 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd96806a1d0 tx=0x7fd960009840 comp rx=0 tx=0).stop 2023-10-09T06:26:44.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.019+0000 7fd96c975700 1 -- 172.21.15.31:0/4154319037 shutdown_connections 2023-10-09T06:26:44.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.019+0000 7fd96c975700 1 --2- 172.21.15.31:0/4154319037 >> v2:172.21.15.158:3300/0 conn(0x7fd96815a230 0x7fd96806abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.019+0000 7fd96c975700 1 --2- 172.21.15.31:0/4154319037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd968159e60 0x7fd9680b6890 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.019+0000 7fd96c975700 1 --2- 172.21.15.31:0/4154319037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9680cffa0 0x7fd96806a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.019+0000 7fd96c975700 1 -- 172.21.15.31:0/4154319037 >> 172.21.15.31:0/4154319037 conn(0x7fd9680d1a50 msgr2=0x7fd968068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:44.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.019+0000 7fd96c975700 1 -- 172.21.15.31:0/4154319037 shutdown_connections 2023-10-09T06:26:44.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.019+0000 7fd96c975700 1 -- 172.21.15.31:0/4154319037 wait complete. 2023-10-09T06:26:44.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.020+0000 7fd96c975700 1 Processor -- start 2023-10-09T06:26:44.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.020+0000 7fd96c975700 1 -- start start 2023-10-09T06:26:44.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd96c975700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9680cffa0 0x7fd968153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd96c975700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd968159e60 0x7fd96815c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd96c975700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96815a230 0x7fd9680c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd96c975700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96816a590 con 0x7fd96815a230 2023-10-09T06:26:44.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd96c975700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96815ce10 con 0x7fd968159e60 2023-10-09T06:26:44.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd96c975700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96815d0f0 con 0x7fd9680cffa0 2023-10-09T06:26:44.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd966d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96815a230 0x7fd9680c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd966d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96815a230 0x7fd9680c5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53928/0 (socket says 172.21.15.31:53928) 2023-10-09T06:26:44.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd966d9d700 1 -- 172.21.15.31:0/2976586928 learned_addr learned my addr 172.21.15.31:0/2976586928 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:44.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd96659c700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9680cffa0 0x7fd968153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd965d9b700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd968159e60 0x7fd96815c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd966d9d700 1 -- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9680cffa0 msgr2=0x7fd968153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd966d9d700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9680cffa0 0x7fd968153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd966d9d700 1 -- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd968159e60 msgr2=0x7fd96815c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd966d9d700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd968159e60 0x7fd96815c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.021+0000 7fd966d9d700 1 -- 172.21.15.31:0/2976586928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd960009ae0 con 0x7fd96815a230 2023-10-09T06:26:44.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.022+0000 7fd966d9d700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96815a230 0x7fd9680c5d20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd95800c850 tx=0x7fd958008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:44.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.022+0000 7fd95e7fc700 1 -- 172.21.15.31:0/2976586928 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958011600 con 0x7fd96815a230 2023-10-09T06:26:44.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.022+0000 7fd95e7fc700 1 -- 172.21.15.31:0/2976586928 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd958011760 con 0x7fd96815a230 2023-10-09T06:26:44.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.022+0000 7fd96c975700 1 -- 172.21.15.31:0/2976586928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96815d3d0 con 0x7fd96815a230 2023-10-09T06:26:44.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.022+0000 7fd95e7fc700 1 -- 172.21.15.31:0/2976586928 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958011b20 con 0x7fd96815a230 2023-10-09T06:26:44.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.022+0000 7fd96c975700 1 -- 172.21.15.31:0/2976586928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96815cab0 con 0x7fd96815a230 2023-10-09T06:26:44.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.023+0000 7fd96c975700 1 -- 172.21.15.31:0/2976586928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96816a740 con 0x7fd96815a230 2023-10-09T06:26:44.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.023+0000 7fd95e7fc700 1 -- 172.21.15.31:0/2976586928 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd958018350 con 0x7fd96815a230 2023-10-09T06:26:44.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.023+0000 7fd95e7fc700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd948066f30 0x7fd9480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.024+0000 7fd95e7fc700 1 -- 172.21.15.31:0/2976586928 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd958084260 con 0x7fd96815a230 2023-10-09T06:26:44.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.024+0000 7fd96659c700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd948066f30 0x7fd9480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.024+0000 7fd96659c700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd948066f30 0x7fd9480693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd960009880 tx=0x7fd960018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:44.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.028+0000 7fd95e7fc700 1 -- 172.21.15.31:0/2976586928 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd96816a740 con 0x7fd96815a230 2023-10-09T06:26:44.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.217+0000 7fd96c975700 1 -- 172.21.15.31:0/2976586928 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd96804c3c0 con 0x7fd948066f30 2023-10-09T06:26:44.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.225+0000 7fd95e7fc700 1 -- 172.21.15.31:0/2976586928 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276018 (secure 0 0 0) 0x7fd96804c3c0 con 0x7fd948066f30 2023-10-09T06:26:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:44.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.228+0000 7fd96c975700 1 -- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd948066f30 msgr2=0x7fd9480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.228+0000 7fd96c975700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd948066f30 0x7fd9480693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd960009880 tx=0x7fd960018000 comp rx=0 tx=0).stop 2023-10-09T06:26:44.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.228+0000 7fd96c975700 1 -- 172.21.15.31:0/2976586928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96815a230 msgr2=0x7fd9680c5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.228+0000 7fd96c975700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96815a230 0x7fd9680c5d20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd95800c850 tx=0x7fd958008040 comp rx=0 tx=0).stop 2023-10-09T06:26:44.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.228+0000 7fd96c975700 1 -- 172.21.15.31:0/2976586928 shutdown_connections 2023-10-09T06:26:44.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.228+0000 7fd96c975700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd948066f30 0x7fd9480693e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.228+0000 7fd96c975700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd9680cffa0 0x7fd968153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.228+0000 7fd96c975700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96815a230 0x7fd9680c5d20 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.228+0000 7fd96c975700 1 --2- 172.21.15.31:0/2976586928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd968159e60 0x7fd96815c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.228+0000 7fd96c975700 1 -- 172.21.15.31:0/2976586928 >> 172.21.15.31:0/2976586928 conn(0x7fd9680d1a50 msgr2=0x7fd9680b6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:44.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.228+0000 7fd96c975700 1 -- 172.21.15.31:0/2976586928 shutdown_connections 2023-10-09T06:26:44.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.228+0000 7fd96c975700 1 -- 172.21.15.31:0/2976586928 wait complete. 2023-10-09T06:26:44.233 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:26:44.242 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2023-10-09T06:26:42.600515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556337,"statfs":{"total":1600000000,"available":1593690043,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.471830"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.132011+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:34.001786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.131958+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:07.821251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.131031+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:31.381359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.133198+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:27:33.492960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.132887+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:39.834270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.131646+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:57:08.241805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.129785+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:34.001786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.131966+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:17.485875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.131511+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:46.012927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.131400+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:08:33.863566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.130982+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:31:57.084642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.132019+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:30.369373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.133835+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:59.843992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.133113+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:15.103645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.132647+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:34.001786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.131156+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:40.285818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.132259+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:57:08.241805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.129996+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:27:33.492960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.130855+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:42.684622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.131262+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:30.369373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.130268+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:36.614496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.129779+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:02.442877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.132853+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:21:36.812847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.130657+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:31.381359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.130855+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:36.614496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.130855+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:02.442877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.129804+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:12:29.900130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.132477+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:12:29.900130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.129801+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:21:36.812847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.131427+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:31:57.084642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.133463+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:11:30.517124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:26:39.128477+0000","last_change":"2023-10-09T06:26:39.128477+0000","last_active":"2023-10-09T06:26:39.128477+0000","last_peered":"2023-10-09T06:26:39.128477+0000","last_clean":"2023-10-09T06:26:39.128477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:39.128477+0000","last_undegraded":"2023-10-09T06:26:39.128477+0000","last_fullsized":"2023-10-09T06:26:39.128477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:26:38.123430+0000","last_change":"2023-10-09T06:26:38.131493+0000","last_active":"2023-10-09T06:26:38.123430+0000","last_peered":"2023-10-09T06:26:38.123430+0000","last_clean":"2023-10-09T06:26:38.123430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:26:38.123430+0000","last_undegraded":"2023-10-09T06:26:38.123430+0000","last_fullsized":"2023-10-09T06:26:38.123430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:16:35.099029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":247,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-10-09T06:26:36.310215+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:26:36.310215+0000","last_peered":"2023-10-09T06:26:36.310215+0000","last_clean":"2023-10-09T06:26:36.310215+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:26:36.310215+0000","last_undegraded":"2023-10-09T06:26:36.310215+0000","last_fullsized":"2023-10-09T06:26:36.310215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194110,"statfs":{"total":200000000,"available":198769205,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.51100000000000001},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78800000000000003,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.376},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57399999999999995,"15min":0.52400000000000002},"min":{"1min":0.28799999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70699999999999996,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.39900000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54200000000000004,"15min":0.50600000000000001},"min":{"1min":0.39500000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53700000000000003,"15min":0.50800000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67700000000000005,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61699999999999999,"15min":0.57699999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71999999999999997,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58899999999999997,"15min":0.54000000000000004},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76400000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.53800000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65600000000000003,"15min":0.58199999999999996},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.84399999999999997,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.64400000000000002,"15min":0.56599999999999995},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78200000000000003,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.497}]},{"osd":4,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.28299999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.83099999999999996,"5min":0.872,"15min":0.872},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.79800000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48599999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.442},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.38600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91400000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59699999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88400000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.52000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194687,"statfs":{"total":200000000,"available":199359573,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59199999999999997,"15min":0.76800000000000002},"min":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63900000000000001,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":1.133,"15min":1.133},"last":0.41999999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.437,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64900000000000002,"5min":1.155,"15min":1.155},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.378,"5min":0.317,"15min":0.317},"max":{"1min":0.65500000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56599999999999995,"15min":0.59599999999999997},"min":{"1min":0.372,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66300000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.629},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.61499999999999999,"15min":0.77900000000000003},"min":{"1min":0.40200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.65500000000000003,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56899999999999995,"15min":0.59599999999999997},"min":{"1min":0.442,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.63800000000000001,"5min":1.337,"15min":1.337},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.56200000000000006,"15min":0.57999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.623,"5min":1.206,"15min":1.206},"last":0.53100000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65100000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48899999999999999,"15min":0.49399999999999999},"min":{"1min":0.34499999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.63100000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.64200000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.59499999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68200000000000005,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.69499999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.374,"5min":0.315,"15min":0.315},"max":{"1min":0.67300000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.66000000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194687,"statfs":{"total":200000000,"available":199359573,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35799999999999998,"15min":0.36899999999999999},"min":{"1min":0.26100000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.48299999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36899999999999999,"15min":0.33600000000000002},"min":{"1min":0.247,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.505,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.45900000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40500000000000003,"15min":0.38700000000000001},"min":{"1min":0.255,"5min":0.247,"15min":0.247},"max":{"1min":0.58499999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.45400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.41599999999999998},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.60799999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.434},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44900000000000001,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.622,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46600000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.91500000000000004,"5min":1.097,"15min":1.097},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67100000000000004,"15min":0.81100000000000005},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81299999999999994,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.56899999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65100000000000002,"15min":0.627},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90100000000000002,"5min":1.125,"15min":1.125},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94499999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65100000000000002,"15min":0.622},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89100000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93600000000000005,"5min":1.49,"15min":1.49},"last":0.49099999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.64400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67600000000000005,"15min":0.65700000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88400000000000001,"5min":1.052,"15min":1.052},"last":0.52500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194110,"statfs":{"total":200000000,"available":198769205,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.41399999999999998},"min":{"1min":0.23599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.50600000000000001,"5min":1.226,"15min":1.226},"last":0.434},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.54900000000000004,"5min":1.131,"15min":1.131},"last":0.29999999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.55700000000000005,"15min":0.99399999999999999},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":12.929,"15min":12.929},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.438,"15min":0.46300000000000002},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.55000000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.33200000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.47699999999999998},"min":{"1min":0.32200000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.749,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45300000000000001,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.314,"15min":0.314},"max":{"1min":0.57399999999999995,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.312}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.628,"15min":0.65600000000000003},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97099999999999997,"5min":1.335,"15min":1.335},"last":0.51500000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90700000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.81499999999999995,"5min":0.999,"15min":0.999},"last":0.53900000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83099999999999996,"5min":0.998,"15min":0.998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.58299999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65400000000000003,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.262,"15min":1.262},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.67000000000000004},"min":{"1min":0.52100000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.95599999999999996,"5min":1.103,"15min":1.103},"last":0.60999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194687,"statfs":{"total":200000000,"available":199359573,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.5,"15min":0.88600000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.48599999999999999,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.46200000000000002,"15min":0.67400000000000004},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57099999999999995,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.28999999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.436,"15min":0.63400000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68000000000000005,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.31},{"interface":"front","average":{"1min":0.44,"5min":0.53600000000000003,"15min":0.70399999999999996},"min":{"1min":0.28299999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.91400000000000003,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.40899999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.51700000000000002,"15min":0.70699999999999996},"min":{"1min":0.30299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70299999999999996,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.58299999999999996,"15min":0.94599999999999995},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.77000000000000002,"15min":1.1459999999999999},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.95299999999999996,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.71899999999999997,"15min":0.93100000000000005},"min":{"1min":0.46700000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1160000000000001,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.69899999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.90600000000000003},"min":{"1min":0.432,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93600000000000005,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72299999999999998,"15min":0.91300000000000003},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.006,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.56699999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.71099999999999997,"15min":0.89500000000000002},"min":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95599999999999996,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.78600000000000003,"15min":1.1439999999999999},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.028,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.54900000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70099999999999996,"15min":0.89100000000000001},"min":{"1min":0.44600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85299999999999998,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72099999999999997,"15min":0.90800000000000003},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0609999999999999,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.61199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194687,"statfs":{"total":200000000,"available":199359573,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.33000000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40799999999999997,"15min":0.379},"min":{"1min":0.29899999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.379}]},{"osd":1,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.32500000000000001},"min":{"1min":0.24299999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.35099999999999998},"min":{"1min":0.26700000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38,"15min":0.36199999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.52100000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.434},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45700000000000002,"15min":0.42099999999999999},"min":{"1min":0.33200000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.50700000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57999999999999996,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84799999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.45200000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.34999999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63600000000000001,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.441,"5min":0.372,"15min":0.372},"max":{"1min":0.77600000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.443,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90100000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.495}]},{"osd":7,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.625,"15min":0.58899999999999997},"min":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.629,"15min":0.60799999999999998},"min":{"1min":0.45200000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353768,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53100000000000003,"15min":0.498},"min":{"1min":0.372,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.72199999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52200000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.33000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.73999999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.71099999999999997},"min":{"1min":0.38500000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73299999999999998,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.53100000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.60099999999999998,"15min":0.70099999999999996},"min":{"1min":0.375,"5min":0.313,"15min":0.313},"max":{"1min":0.70599999999999996,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.70799999999999996,"15min":1.0780000000000001},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.74199999999999999,"5min":11.715,"15min":11.715},"last":0.46899999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56499999999999995,"15min":0.52500000000000002},"min":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.751,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.46100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77100000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54500000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.373},{"interface":"front","average":{"1min":0.495,"5min":0.50800000000000001,"15min":0.52100000000000002},"min":{"1min":0.34499999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.77300000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48799999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50900000000000001,"15min":0.504},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78100000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.502},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.879,"15min":0.879},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83399999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194687,"statfs":{"total":200000000,"available":199359573,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85399999999999998,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.54600000000000004,"15min":0.52000000000000002},"min":{"1min":0.45100000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77900000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54800000000000004,"15min":0.51800000000000002},"min":{"1min":0.38900000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82399999999999995,"5min":1.093,"15min":1.093},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.55200000000000005,"15min":0.52000000000000002},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83399999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.44800000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.433,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57599999999999996,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84199999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51900000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58399999999999996,"15min":0.55500000000000005},"min":{"1min":0.45600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.498},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.58599999999999997},"min":{"1min":0.47799999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.81299999999999994,"5min":1.071,"15min":1.071},"last":0.60499999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48899999999999999,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72399999999999998,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.37,"5min":0.309,"15min":0.309},"max":{"1min":0.75800000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55700000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.504,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73999999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.82799999999999996,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33200000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81000000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.623},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.36599999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84399999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.68300000000000005}]}]}],"pool_statfs":[]}} 2023-10-09T06:26:44.249 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:26:44.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.401+0000 7ffaec5a8700 1 Processor -- start 2023-10-09T06:26:44.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.401+0000 7ffaec5a8700 1 -- start start 2023-10-09T06:26:44.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.402+0000 7ffaec5a8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ffae415a620 0x7ffae415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.402+0000 7ffaec5a8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffae415d580 0x7ffae4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.402+0000 7ffaec5a8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae415cbb0 con 0x7ffae4157870 2023-10-09T06:26:44.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.402+0000 7ffaec5a8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae415bdb0 con 0x7ffae415d580 2023-10-09T06:26:44.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.402+0000 7ffaec5a8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae415bfa0 con 0x7ffae415a620 2023-10-09T06:26:44.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.402+0000 7ffaeab45700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffae415d580 0x7ffae4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.402+0000 7ffaea344700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ffae4157870 0x7ffae415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43722/0 (socket says 172.21.15.31:43722) 2023-10-09T06:26:44.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.402+0000 7ffaea344700 1 -- 172.21.15.31:0/2242234972 learned_addr learned my addr 172.21.15.31:0/2242234972 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:44.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.402+0000 7ffae9b43700 1 --2- 172.21.15.31:0/2242234972 >> v2:172.21.15.158:3300/0 conn(0x7ffae415a620 0x7ffae415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffaeab45700 1 -- 172.21.15.31:0/2242234972 >> v2:172.21.15.158:3300/0 conn(0x7ffae415a620 msgr2=0x7ffae415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:44.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffaeab45700 1 --2- 172.21.15.31:0/2242234972 >> v2:172.21.15.158:3300/0 conn(0x7ffae415a620 0x7ffae415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffaeab45700 1 -- 172.21.15.31:0/2242234972 >> v1:172.21.15.31:6789/0 conn(0x7ffae4157870 legacy=0x7ffae415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffaeab45700 1 -- 172.21.15.31:0/2242234972 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae415c280 con 0x7ffae415d580 2023-10-09T06:26:44.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffae9b43700 1 --2- 172.21.15.31:0/2242234972 >> v2:172.21.15.158:3300/0 conn(0x7ffae415a620 0x7ffae415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:44.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffaeab45700 1 --2- 172.21.15.31:0/2242234972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415d580 0x7ffae4158110 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ffae415cb20 tx=0x7ffad4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b104cc8f2013111a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:44.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffae9342700 1 -- 172.21.15.31:0/2242234972 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad400e070 con 0x7ffae415d580 2023-10-09T06:26:44.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffae9342700 1 -- 172.21.15.31:0/2242234972 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad400bc30 con 0x7ffae415d580 2023-10-09T06:26:44.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffae9342700 1 -- 172.21.15.31:0/2242234972 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad4012430 con 0x7ffae415d580 2023-10-09T06:26:44.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffaec5a8700 1 -- 172.21.15.31:0/2242234972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415d580 msgr2=0x7ffae4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffaec5a8700 1 --2- 172.21.15.31:0/2242234972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415d580 0x7ffae4158110 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ffae415cb20 tx=0x7ffad4009780 comp rx=0 tx=0).stop 2023-10-09T06:26:44.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffaec5a8700 1 -- 172.21.15.31:0/2242234972 shutdown_connections 2023-10-09T06:26:44.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffaec5a8700 1 --2- 172.21.15.31:0/2242234972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415d580 0x7ffae4158110 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffaec5a8700 1 --2- 172.21.15.31:0/2242234972 >> v2:172.21.15.158:3300/0 conn(0x7ffae415a620 0x7ffae415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffaec5a8700 1 -- 172.21.15.31:0/2242234972 >> 172.21.15.31:0/2242234972 conn(0x7ffae4068ce0 msgr2=0x7ffae40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:44.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffaec5a8700 1 -- 172.21.15.31:0/2242234972 shutdown_connections 2023-10-09T06:26:44.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.403+0000 7ffaec5a8700 1 -- 172.21.15.31:0/2242234972 wait complete. 2023-10-09T06:26:44.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.405+0000 7ffaec5a8700 1 Processor -- start 2023-10-09T06:26:44.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.405+0000 7ffaec5a8700 1 -- start start 2023-10-09T06:26:44.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.405+0000 7ffaec5a8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffae4157870 0x7ffae414bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.405+0000 7ffaec5a8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415a620 0x7ffae40b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.405+0000 7ffaec5a8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffae415d580 0x7ffae40b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.405+0000 7ffaec5a8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae414c040 con 0x7ffae415a620 2023-10-09T06:26:44.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.405+0000 7ffaec5a8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae40b0a30 con 0x7ffae4157870 2023-10-09T06:26:44.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.405+0000 7ffaec5a8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae40b0d10 con 0x7ffae415d580 2023-10-09T06:26:44.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.405+0000 7ffae9b43700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415a620 0x7ffae40b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.405+0000 7ffae9b43700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415a620 0x7ffae40b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53956/0 (socket says 172.21.15.31:53956) 2023-10-09T06:26:44.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.405+0000 7ffae9b43700 1 -- 172.21.15.31:0/259741325 learned_addr learned my addr 172.21.15.31:0/259741325 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:44.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.406+0000 7ffaeab45700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffae415d580 0x7ffae40b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.406+0000 7ffaea344700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffae4157870 0x7ffae414bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.406+0000 7ffae9b43700 1 -- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffae415d580 msgr2=0x7ffae40b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.406+0000 7ffae9b43700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffae415d580 0x7ffae40b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.406+0000 7ffae9b43700 1 -- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffae4157870 msgr2=0x7ffae414bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.406+0000 7ffae9b43700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffae4157870 0x7ffae414bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.406+0000 7ffae9b43700 1 -- 172.21.15.31:0/259741325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad4009a20 con 0x7ffae415a620 2023-10-09T06:26:44.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.406+0000 7ffae9b43700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415a620 0x7ffae40b1ad0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ffad800c880 tx=0x7ffad8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:44.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.406+0000 7ffae27fc700 1 -- 172.21.15.31:0/259741325 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8011600 con 0x7ffae415a620 2023-10-09T06:26:44.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.406+0000 7ffae27fc700 1 -- 172.21.15.31:0/259741325 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad8011760 con 0x7ffae415a620 2023-10-09T06:26:44.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.406+0000 7ffae27fc700 1 -- 172.21.15.31:0/259741325 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8011ae0 con 0x7ffae415a620 2023-10-09T06:26:44.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.406+0000 7ffaec5a8700 1 -- 172.21.15.31:0/259741325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae40b0ff0 con 0x7ffae415a620 2023-10-09T06:26:44.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.406+0000 7ffaec5a8700 1 -- 172.21.15.31:0/259741325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae40b15b0 con 0x7ffae415a620 2023-10-09T06:26:44.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.407+0000 7ffaec5a8700 1 -- 172.21.15.31:0/259741325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae40b17d0 con 0x7ffae415a620 2023-10-09T06:26:44.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.407+0000 7ffae27fc700 1 -- 172.21.15.31:0/259741325 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffad80193b0 con 0x7ffae415a620 2023-10-09T06:26:44.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.408+0000 7ffae27fc700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffad0066f30 0x7ffad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.408+0000 7ffae27fc700 1 -- 172.21.15.31:0/259741325 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffad8084480 con 0x7ffae415a620 2023-10-09T06:26:44.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.408+0000 7ffaea344700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffad0066f30 0x7ffad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.409+0000 7ffaea344700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffad0066f30 0x7ffad00693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ffadc007130 tx=0x7ffadc007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:44.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.412+0000 7ffae27fc700 1 -- 172.21.15.31:0/259741325 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffad80516f0 con 0x7ffae415a620 2023-10-09T06:26:44.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.603+0000 7ffaec5a8700 1 -- 172.21.15.31:0/259741325 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffae404c3c0 con 0x7ffad0066f30 2023-10-09T06:26:44.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.611+0000 7ffae27fc700 1 -- 172.21.15.31:0/259741325 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285256 (secure 0 0 0) 0x7ffae404c3c0 con 0x7ffad0066f30 2023-10-09T06:26:44.615 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:44.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.615+0000 7ffaec5a8700 1 -- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffad0066f30 msgr2=0x7ffad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.615+0000 7ffaec5a8700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffad0066f30 0x7ffad00693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ffadc007130 tx=0x7ffadc007eb0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.615+0000 7ffaec5a8700 1 -- 172.21.15.31:0/259741325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415a620 msgr2=0x7ffae40b1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.615+0000 7ffaec5a8700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415a620 0x7ffae40b1ad0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ffad800c880 tx=0x7ffad8008040 comp rx=0 tx=0).stop 2023-10-09T06:26:44.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.615+0000 7ffaec5a8700 1 -- 172.21.15.31:0/259741325 shutdown_connections 2023-10-09T06:26:44.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.615+0000 7ffaec5a8700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffad0066f30 0x7ffad00693e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.615+0000 7ffaec5a8700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffae415d580 0x7ffae40b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.615+0000 7ffaec5a8700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffae4157870 0x7ffae414bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.615+0000 7ffaec5a8700 1 --2- 172.21.15.31:0/259741325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415a620 0x7ffae40b1ad0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.615+0000 7ffaec5a8700 1 -- 172.21.15.31:0/259741325 >> 172.21.15.31:0/259741325 conn(0x7ffae4068ce0 msgr2=0x7ffae40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:44.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.615+0000 7ffaec5a8700 1 -- 172.21.15.31:0/259741325 shutdown_connections 2023-10-09T06:26:44.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.615+0000 7ffaec5a8700 1 -- 172.21.15.31:0/259741325 wait complete. 2023-10-09T06:26:44.619 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:26:44.627 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2023-10-09T06:26:44.601009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6357,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556142,"statfs":{"total":1600000000,"available":1593490284,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001592"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.147439+0000","last_change":"2023-10-09T06:26:40.147377+0000","last_active":"2023-10-09T06:26:40.147439+0000","last_peered":"2023-10-09T06:26:40.147439+0000","last_clean":"2023-10-09T06:26:40.147439+0000","last_became_active":"2023-10-09T06:26:40.147139+0000","last_became_peered":"2023-10-09T06:26:40.147139+0000","last_unstale":"2023-10-09T06:26:40.147439+0000","last_undegraded":"2023-10-09T06:26:40.147439+0000","last_fullsized":"2023-10-09T06:26:40.147439+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:28:11.296399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.153507+0000","last_change":"2023-10-09T06:26:40.153312+0000","last_active":"2023-10-09T06:26:40.153507+0000","last_peered":"2023-10-09T06:26:40.153507+0000","last_clean":"2023-10-09T06:26:40.153507+0000","last_became_active":"2023-10-09T06:26:40.152617+0000","last_became_peered":"2023-10-09T06:26:40.152617+0000","last_unstale":"2023-10-09T06:26:40.153507+0000","last_undegraded":"2023-10-09T06:26:40.153507+0000","last_fullsized":"2023-10-09T06:26:40.153507+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:06.119652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.147807+0000","last_change":"2023-10-09T06:26:40.147749+0000","last_active":"2023-10-09T06:26:40.147807+0000","last_peered":"2023-10-09T06:26:40.147807+0000","last_clean":"2023-10-09T06:26:40.147807+0000","last_became_active":"2023-10-09T06:26:40.147526+0000","last_became_peered":"2023-10-09T06:26:40.147526+0000","last_unstale":"2023-10-09T06:26:40.147807+0000","last_undegraded":"2023-10-09T06:26:40.147807+0000","last_fullsized":"2023-10-09T06:26:40.147807+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:41.945652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.152816+0000","last_change":"2023-10-09T06:26:40.151961+0000","last_active":"2023-10-09T06:26:40.152816+0000","last_peered":"2023-10-09T06:26:40.152816+0000","last_clean":"2023-10-09T06:26:40.152816+0000","last_became_active":"2023-10-09T06:26:40.150713+0000","last_became_peered":"2023-10-09T06:26:40.150713+0000","last_unstale":"2023-10-09T06:26:40.152816+0000","last_undegraded":"2023-10-09T06:26:40.152816+0000","last_fullsized":"2023-10-09T06:26:40.152816+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:36.928676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.157968+0000","last_change":"2023-10-09T06:26:40.157906+0000","last_active":"2023-10-09T06:26:40.157968+0000","last_peered":"2023-10-09T06:26:40.157968+0000","last_clean":"2023-10-09T06:26:40.157968+0000","last_became_active":"2023-10-09T06:26:40.157669+0000","last_became_peered":"2023-10-09T06:26:40.157669+0000","last_unstale":"2023-10-09T06:26:40.157968+0000","last_undegraded":"2023-10-09T06:26:40.157968+0000","last_fullsized":"2023-10-09T06:26:40.157968+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:12.609229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.146707+0000","last_change":"2023-10-09T06:26:40.143736+0000","last_active":"2023-10-09T06:26:40.146707+0000","last_peered":"2023-10-09T06:26:40.146707+0000","last_clean":"2023-10-09T06:26:40.146707+0000","last_became_active":"2023-10-09T06:26:40.143502+0000","last_became_peered":"2023-10-09T06:26:40.143502+0000","last_unstale":"2023-10-09T06:26:40.146707+0000","last_undegraded":"2023-10-09T06:26:40.146707+0000","last_fullsized":"2023-10-09T06:26:40.146707+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:29.174599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.146769+0000","last_change":"2023-10-09T06:26:40.146194+0000","last_active":"2023-10-09T06:26:40.146769+0000","last_peered":"2023-10-09T06:26:40.146769+0000","last_clean":"2023-10-09T06:26:40.146769+0000","last_became_active":"2023-10-09T06:26:40.145981+0000","last_became_peered":"2023-10-09T06:26:40.145981+0000","last_unstale":"2023-10-09T06:26:40.146769+0000","last_undegraded":"2023-10-09T06:26:40.146769+0000","last_fullsized":"2023-10-09T06:26:40.146769+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:36.001297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.153471+0000","last_change":"2023-10-09T06:26:40.153163+0000","last_active":"2023-10-09T06:26:40.153471+0000","last_peered":"2023-10-09T06:26:40.153471+0000","last_clean":"2023-10-09T06:26:40.153471+0000","last_became_active":"2023-10-09T06:26:40.152701+0000","last_became_peered":"2023-10-09T06:26:40.152701+0000","last_unstale":"2023-10-09T06:26:40.153471+0000","last_undegraded":"2023-10-09T06:26:40.153471+0000","last_fullsized":"2023-10-09T06:26:40.153471+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:29.174599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.158585+0000","last_change":"2023-10-09T06:26:40.158524+0000","last_active":"2023-10-09T06:26:40.158585+0000","last_peered":"2023-10-09T06:26:40.158585+0000","last_clean":"2023-10-09T06:26:40.158585+0000","last_became_active":"2023-10-09T06:26:40.158331+0000","last_became_peered":"2023-10-09T06:26:40.158331+0000","last_unstale":"2023-10-09T06:26:40.158585+0000","last_undegraded":"2023-10-09T06:26:40.158585+0000","last_fullsized":"2023-10-09T06:26:40.158585+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:08:25.568102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.159992+0000","last_change":"2023-10-09T06:26:40.159935+0000","last_active":"2023-10-09T06:26:40.159992+0000","last_peered":"2023-10-09T06:26:40.159992+0000","last_clean":"2023-10-09T06:26:40.159992+0000","last_became_active":"2023-10-09T06:26:40.159594+0000","last_became_peered":"2023-10-09T06:26:40.159594+0000","last_unstale":"2023-10-09T06:26:40.159992+0000","last_undegraded":"2023-10-09T06:26:40.159992+0000","last_fullsized":"2023-10-09T06:26:40.159992+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:05.342330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.146733+0000","last_change":"2023-10-09T06:26:40.145451+0000","last_active":"2023-10-09T06:26:40.146733+0000","last_peered":"2023-10-09T06:26:40.146733+0000","last_clean":"2023-10-09T06:26:40.146733+0000","last_became_active":"2023-10-09T06:26:40.144860+0000","last_became_peered":"2023-10-09T06:26:40.144860+0000","last_unstale":"2023-10-09T06:26:40.146733+0000","last_undegraded":"2023-10-09T06:26:40.146733+0000","last_fullsized":"2023-10-09T06:26:40.146733+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:46.854972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.153138+0000","last_change":"2023-10-09T06:26:40.153072+0000","last_active":"2023-10-09T06:26:40.153138+0000","last_peered":"2023-10-09T06:26:40.153138+0000","last_clean":"2023-10-09T06:26:40.153138+0000","last_became_active":"2023-10-09T06:26:40.152823+0000","last_became_peered":"2023-10-09T06:26:40.152823+0000","last_unstale":"2023-10-09T06:26:40.153138+0000","last_undegraded":"2023-10-09T06:26:40.153138+0000","last_fullsized":"2023-10-09T06:26:40.153138+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:07:13.674637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.151227+0000","last_change":"2023-10-09T06:26:40.149660+0000","last_active":"2023-10-09T06:26:40.151227+0000","last_peered":"2023-10-09T06:26:40.151227+0000","last_clean":"2023-10-09T06:26:40.151227+0000","last_became_active":"2023-10-09T06:26:40.149443+0000","last_became_peered":"2023-10-09T06:26:40.149443+0000","last_unstale":"2023-10-09T06:26:40.151227+0000","last_undegraded":"2023-10-09T06:26:40.151227+0000","last_fullsized":"2023-10-09T06:26:40.151227+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:36.001297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.144471+0000","last_change":"2023-10-09T06:26:40.144387+0000","last_active":"2023-10-09T06:26:40.144471+0000","last_peered":"2023-10-09T06:26:40.144471+0000","last_clean":"2023-10-09T06:26:40.144471+0000","last_became_active":"2023-10-09T06:26:40.143813+0000","last_became_peered":"2023-10-09T06:26:40.143813+0000","last_unstale":"2023-10-09T06:26:40.144471+0000","last_undegraded":"2023-10-09T06:26:40.144471+0000","last_fullsized":"2023-10-09T06:26:40.144471+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:43:04.965457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.155706+0000","last_change":"2023-10-09T06:26:40.155618+0000","last_active":"2023-10-09T06:26:40.155706+0000","last_peered":"2023-10-09T06:26:40.155706+0000","last_clean":"2023-10-09T06:26:40.155706+0000","last_became_active":"2023-10-09T06:26:40.155018+0000","last_became_peered":"2023-10-09T06:26:40.155018+0000","last_unstale":"2023-10-09T06:26:40.155706+0000","last_undegraded":"2023-10-09T06:26:40.155706+0000","last_fullsized":"2023-10-09T06:26:40.155706+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:49.035851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.151319+0000","last_change":"2023-10-09T06:26:40.151010+0000","last_active":"2023-10-09T06:26:40.151319+0000","last_peered":"2023-10-09T06:26:40.151319+0000","last_clean":"2023-10-09T06:26:40.151319+0000","last_became_active":"2023-10-09T06:26:40.150799+0000","last_became_peered":"2023-10-09T06:26:40.150799+0000","last_unstale":"2023-10-09T06:26:40.151319+0000","last_undegraded":"2023-10-09T06:26:40.151319+0000","last_fullsized":"2023-10-09T06:26:40.151319+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:42.733308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.153490+0000","last_change":"2023-10-09T06:26:40.153151+0000","last_active":"2023-10-09T06:26:40.153490+0000","last_peered":"2023-10-09T06:26:40.153490+0000","last_clean":"2023-10-09T06:26:40.153490+0000","last_became_active":"2023-10-09T06:26:40.152297+0000","last_became_peered":"2023-10-09T06:26:40.152297+0000","last_unstale":"2023-10-09T06:26:40.153490+0000","last_undegraded":"2023-10-09T06:26:40.153490+0000","last_fullsized":"2023-10-09T06:26:40.153490+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:34:20.951279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.142897+0000","last_change":"2023-10-09T06:26:40.142828+0000","last_active":"2023-10-09T06:26:40.142897+0000","last_peered":"2023-10-09T06:26:40.142897+0000","last_clean":"2023-10-09T06:26:40.142897+0000","last_became_active":"2023-10-09T06:26:40.142600+0000","last_became_peered":"2023-10-09T06:26:40.142600+0000","last_unstale":"2023-10-09T06:26:40.142897+0000","last_undegraded":"2023-10-09T06:26:40.142897+0000","last_fullsized":"2023-10-09T06:26:40.142897+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:37.510252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.147819+0000","last_change":"2023-10-09T06:26:40.147710+0000","last_active":"2023-10-09T06:26:40.147819+0000","last_peered":"2023-10-09T06:26:40.147819+0000","last_clean":"2023-10-09T06:26:40.147819+0000","last_became_active":"2023-10-09T06:26:40.147503+0000","last_became_peered":"2023-10-09T06:26:40.147503+0000","last_unstale":"2023-10-09T06:26:40.147819+0000","last_undegraded":"2023-10-09T06:26:40.147819+0000","last_fullsized":"2023-10-09T06:26:40.147819+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:21.969128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.157965+0000","last_change":"2023-10-09T06:26:40.157896+0000","last_active":"2023-10-09T06:26:40.157965+0000","last_peered":"2023-10-09T06:26:40.157965+0000","last_clean":"2023-10-09T06:26:40.157965+0000","last_became_active":"2023-10-09T06:26:40.157663+0000","last_became_peered":"2023-10-09T06:26:40.157663+0000","last_unstale":"2023-10-09T06:26:40.157965+0000","last_undegraded":"2023-10-09T06:26:40.157965+0000","last_fullsized":"2023-10-09T06:26:40.157965+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:09.792034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.151647+0000","last_change":"2023-10-09T06:26:40.151596+0000","last_active":"2023-10-09T06:26:40.151647+0000","last_peered":"2023-10-09T06:26:40.151647+0000","last_clean":"2023-10-09T06:26:40.151647+0000","last_became_active":"2023-10-09T06:26:40.151378+0000","last_became_peered":"2023-10-09T06:26:40.151378+0000","last_unstale":"2023-10-09T06:26:40.151647+0000","last_undegraded":"2023-10-09T06:26:40.151647+0000","last_fullsized":"2023-10-09T06:26:40.151647+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:21:29.397997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.153440+0000","last_change":"2023-10-09T06:26:40.152997+0000","last_active":"2023-10-09T06:26:40.153440+0000","last_peered":"2023-10-09T06:26:40.153440+0000","last_clean":"2023-10-09T06:26:40.153440+0000","last_became_active":"2023-10-09T06:26:40.151973+0000","last_became_peered":"2023-10-09T06:26:40.151973+0000","last_unstale":"2023-10-09T06:26:40.153440+0000","last_undegraded":"2023-10-09T06:26:40.153440+0000","last_fullsized":"2023-10-09T06:26:40.153440+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:46.854972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.153455+0000","last_change":"2023-10-09T06:26:40.153073+0000","last_active":"2023-10-09T06:26:40.153455+0000","last_peered":"2023-10-09T06:26:40.153455+0000","last_clean":"2023-10-09T06:26:40.153455+0000","last_became_active":"2023-10-09T06:26:40.152379+0000","last_became_peered":"2023-10-09T06:26:40.152379+0000","last_unstale":"2023-10-09T06:26:40.153455+0000","last_undegraded":"2023-10-09T06:26:40.153455+0000","last_fullsized":"2023-10-09T06:26:40.153455+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:36.928676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.147104+0000","last_change":"2023-10-09T06:26:40.146827+0000","last_active":"2023-10-09T06:26:40.147104+0000","last_peered":"2023-10-09T06:26:40.147104+0000","last_clean":"2023-10-09T06:26:40.147104+0000","last_became_active":"2023-10-09T06:26:40.146571+0000","last_became_peered":"2023-10-09T06:26:40.146571+0000","last_unstale":"2023-10-09T06:26:40.147104+0000","last_undegraded":"2023-10-09T06:26:40.147104+0000","last_fullsized":"2023-10-09T06:26:40.147104+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:34:20.951279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.150814+0000","last_change":"2023-10-09T06:26:40.150735+0000","last_active":"2023-10-09T06:26:40.150814+0000","last_peered":"2023-10-09T06:26:40.150814+0000","last_clean":"2023-10-09T06:26:40.150814+0000","last_became_active":"2023-10-09T06:26:40.150488+0000","last_became_peered":"2023-10-09T06:26:40.150488+0000","last_unstale":"2023-10-09T06:26:40.150814+0000","last_undegraded":"2023-10-09T06:26:40.150814+0000","last_fullsized":"2023-10-09T06:26:40.150814+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:53.597023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.156317+0000","last_change":"2023-10-09T06:26:40.155886+0000","last_active":"2023-10-09T06:26:40.156317+0000","last_peered":"2023-10-09T06:26:40.156317+0000","last_clean":"2023-10-09T06:26:40.156317+0000","last_became_active":"2023-10-09T06:26:40.155653+0000","last_became_peered":"2023-10-09T06:26:40.155653+0000","last_unstale":"2023-10-09T06:26:40.156317+0000","last_undegraded":"2023-10-09T06:26:40.156317+0000","last_fullsized":"2023-10-09T06:26:40.156317+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:36.001297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.146685+0000","last_change":"2023-10-09T06:26:40.143510+0000","last_active":"2023-10-09T06:26:40.146685+0000","last_peered":"2023-10-09T06:26:40.146685+0000","last_clean":"2023-10-09T06:26:40.146685+0000","last_became_active":"2023-10-09T06:26:40.143259+0000","last_became_peered":"2023-10-09T06:26:40.143259+0000","last_unstale":"2023-10-09T06:26:40.146685+0000","last_undegraded":"2023-10-09T06:26:40.146685+0000","last_fullsized":"2023-10-09T06:26:40.146685+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:38:04.809069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.150530+0000","last_change":"2023-10-09T06:26:40.150449+0000","last_active":"2023-10-09T06:26:40.150530+0000","last_peered":"2023-10-09T06:26:40.150530+0000","last_clean":"2023-10-09T06:26:40.150530+0000","last_became_active":"2023-10-09T06:26:40.150049+0000","last_became_peered":"2023-10-09T06:26:40.150049+0000","last_unstale":"2023-10-09T06:26:40.150530+0000","last_undegraded":"2023-10-09T06:26:40.150530+0000","last_fullsized":"2023-10-09T06:26:40.150530+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:07:13.674637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.156299+0000","last_change":"2023-10-09T06:26:40.155256+0000","last_active":"2023-10-09T06:26:40.156299+0000","last_peered":"2023-10-09T06:26:40.156299+0000","last_clean":"2023-10-09T06:26:40.156299+0000","last_became_active":"2023-10-09T06:26:40.155021+0000","last_became_peered":"2023-10-09T06:26:40.155021+0000","last_unstale":"2023-10-09T06:26:40.156299+0000","last_undegraded":"2023-10-09T06:26:40.156299+0000","last_fullsized":"2023-10-09T06:26:40.156299+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:37.510252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.146979+0000","last_change":"2023-10-09T06:26:40.146877+0000","last_active":"2023-10-09T06:26:40.146979+0000","last_peered":"2023-10-09T06:26:40.146979+0000","last_clean":"2023-10-09T06:26:40.146979+0000","last_became_active":"2023-10-09T06:26:40.146641+0000","last_became_peered":"2023-10-09T06:26:40.146641+0000","last_unstale":"2023-10-09T06:26:40.146979+0000","last_undegraded":"2023-10-09T06:26:40.146979+0000","last_fullsized":"2023-10-09T06:26:40.146979+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:51.021941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.149164+0000","last_change":"2023-10-09T06:26:40.149102+0000","last_active":"2023-10-09T06:26:40.149164+0000","last_peered":"2023-10-09T06:26:40.149164+0000","last_clean":"2023-10-09T06:26:40.149164+0000","last_became_active":"2023-10-09T06:26:40.148940+0000","last_became_peered":"2023-10-09T06:26:40.148940+0000","last_unstale":"2023-10-09T06:26:40.149164+0000","last_undegraded":"2023-10-09T06:26:40.149164+0000","last_fullsized":"2023-10-09T06:26:40.149164+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:12.609229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.158930+0000","last_change":"2023-10-09T06:26:40.157315+0000","last_active":"2023-10-09T06:26:40.158930+0000","last_peered":"2023-10-09T06:26:40.158930+0000","last_clean":"2023-10-09T06:26:40.158930+0000","last_became_active":"2023-10-09T06:26:40.157072+0000","last_became_peered":"2023-10-09T06:26:40.157072+0000","last_unstale":"2023-10-09T06:26:40.158930+0000","last_undegraded":"2023-10-09T06:26:40.158930+0000","last_fullsized":"2023-10-09T06:26:40.158930+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:32.386406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.144577+0000","last_change":"2023-10-09T06:26:40.144529+0000","last_active":"2023-10-09T06:26:40.144577+0000","last_peered":"2023-10-09T06:26:40.144577+0000","last_clean":"2023-10-09T06:26:40.144577+0000","last_became_active":"2023-10-09T06:26:40.144111+0000","last_became_peered":"2023-10-09T06:26:40.144111+0000","last_unstale":"2023-10-09T06:26:40.144577+0000","last_undegraded":"2023-10-09T06:26:40.144577+0000","last_fullsized":"2023-10-09T06:26:40.144577+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:18.902685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"120'4","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.157700+0000","last_change":"2023-10-09T06:26:39.144721+0000","last_active":"2023-10-09T06:26:40.157700+0000","last_peered":"2023-10-09T06:26:40.157700+0000","last_clean":"2023-10-09T06:26:40.157700+0000","last_became_active":"2023-10-09T06:26:39.144368+0000","last_became_peered":"2023-10-09T06:26:39.144368+0000","last_unstale":"2023-10-09T06:26:40.157700+0000","last_undegraded":"2023-10-09T06:26:40.157700+0000","last_fullsized":"2023-10-09T06:26:40.157700+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:25.974089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.152913+0000","last_change":"2023-10-09T06:26:40.152461+0000","last_active":"2023-10-09T06:26:40.152913+0000","last_peered":"2023-10-09T06:26:40.152913+0000","last_clean":"2023-10-09T06:26:40.152913+0000","last_became_active":"2023-10-09T06:26:40.152002+0000","last_became_peered":"2023-10-09T06:26:40.152002+0000","last_unstale":"2023-10-09T06:26:40.152913+0000","last_undegraded":"2023-10-09T06:26:40.152913+0000","last_fullsized":"2023-10-09T06:26:40.152913+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:53.597023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.152433+0000","last_change":"2023-10-09T06:26:39.139135+0000","last_active":"2023-10-09T06:26:40.152433+0000","last_peered":"2023-10-09T06:26:40.152433+0000","last_clean":"2023-10-09T06:26:40.152433+0000","last_became_active":"2023-10-09T06:26:39.138877+0000","last_became_peered":"2023-10-09T06:26:39.138877+0000","last_unstale":"2023-10-09T06:26:40.152433+0000","last_undegraded":"2023-10-09T06:26:40.152433+0000","last_fullsized":"2023-10-09T06:26:40.152433+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:47.182429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.155085+0000","last_change":"2023-10-09T06:26:40.155011+0000","last_active":"2023-10-09T06:26:40.155085+0000","last_peered":"2023-10-09T06:26:40.155085+0000","last_clean":"2023-10-09T06:26:40.155085+0000","last_became_active":"2023-10-09T06:26:40.154746+0000","last_became_peered":"2023-10-09T06:26:40.154746+0000","last_unstale":"2023-10-09T06:26:40.155085+0000","last_undegraded":"2023-10-09T06:26:40.155085+0000","last_fullsized":"2023-10-09T06:26:40.155085+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:21.969128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.156811+0000","last_change":"2023-10-09T06:26:39.143597+0000","last_active":"2023-10-09T06:26:40.156811+0000","last_peered":"2023-10-09T06:26:40.156811+0000","last_clean":"2023-10-09T06:26:40.156811+0000","last_became_active":"2023-10-09T06:26:39.143326+0000","last_became_peered":"2023-10-09T06:26:39.143326+0000","last_unstale":"2023-10-09T06:26:40.156811+0000","last_undegraded":"2023-10-09T06:26:40.156811+0000","last_fullsized":"2023-10-09T06:26:40.156811+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:07.821251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.144680+0000","last_change":"2023-10-09T06:26:40.143607+0000","last_active":"2023-10-09T06:26:40.144680+0000","last_peered":"2023-10-09T06:26:40.144680+0000","last_clean":"2023-10-09T06:26:40.144680+0000","last_became_active":"2023-10-09T06:26:40.143375+0000","last_became_peered":"2023-10-09T06:26:40.143375+0000","last_unstale":"2023-10-09T06:26:40.144680+0000","last_undegraded":"2023-10-09T06:26:40.144680+0000","last_fullsized":"2023-10-09T06:26:40.144680+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:06.195220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.152595+0000","last_change":"2023-10-09T06:26:39.144395+0000","last_active":"2023-10-09T06:26:40.152595+0000","last_peered":"2023-10-09T06:26:40.152595+0000","last_clean":"2023-10-09T06:26:40.152595+0000","last_became_active":"2023-10-09T06:26:39.143835+0000","last_became_peered":"2023-10-09T06:26:39.143835+0000","last_unstale":"2023-10-09T06:26:40.152595+0000","last_undegraded":"2023-10-09T06:26:40.152595+0000","last_fullsized":"2023-10-09T06:26:40.152595+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:57:33.060097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.147354+0000","last_change":"2023-10-09T06:26:40.147284+0000","last_active":"2023-10-09T06:26:40.147354+0000","last_peered":"2023-10-09T06:26:40.147354+0000","last_clean":"2023-10-09T06:26:40.147354+0000","last_became_active":"2023-10-09T06:26:40.147026+0000","last_became_peered":"2023-10-09T06:26:40.147026+0000","last_unstale":"2023-10-09T06:26:40.147354+0000","last_undegraded":"2023-10-09T06:26:40.147354+0000","last_fullsized":"2023-10-09T06:26:40.147354+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:36.660395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.159366+0000","last_change":"2023-10-09T06:26:39.139602+0000","last_active":"2023-10-09T06:26:40.159366+0000","last_peered":"2023-10-09T06:26:40.159366+0000","last_clean":"2023-10-09T06:26:40.159366+0000","last_became_active":"2023-10-09T06:26:39.139430+0000","last_became_peered":"2023-10-09T06:26:39.139430+0000","last_unstale":"2023-10-09T06:26:40.159366+0000","last_undegraded":"2023-10-09T06:26:40.159366+0000","last_fullsized":"2023-10-09T06:26:40.159366+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:25:17.484608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.141820+0000","last_change":"2023-10-09T06:26:40.140990+0000","last_active":"2023-10-09T06:26:40.141820+0000","last_peered":"2023-10-09T06:26:40.141820+0000","last_clean":"2023-10-09T06:26:40.141820+0000","last_became_active":"2023-10-09T06:26:40.140751+0000","last_became_peered":"2023-10-09T06:26:40.140751+0000","last_unstale":"2023-10-09T06:26:40.141820+0000","last_undegraded":"2023-10-09T06:26:40.141820+0000","last_fullsized":"2023-10-09T06:26:40.141820+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:53.597023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.159324+0000","last_change":"2023-10-09T06:26:39.149049+0000","last_active":"2023-10-09T06:26:40.159324+0000","last_peered":"2023-10-09T06:26:40.159324+0000","last_clean":"2023-10-09T06:26:40.159324+0000","last_became_active":"2023-10-09T06:26:39.148839+0000","last_became_peered":"2023-10-09T06:26:39.148839+0000","last_unstale":"2023-10-09T06:26:40.159324+0000","last_undegraded":"2023-10-09T06:26:40.159324+0000","last_fullsized":"2023-10-09T06:26:40.159324+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:17.722197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.155689+0000","last_change":"2023-10-09T06:26:40.155483+0000","last_active":"2023-10-09T06:26:40.155689+0000","last_peered":"2023-10-09T06:26:40.155689+0000","last_clean":"2023-10-09T06:26:40.155689+0000","last_became_active":"2023-10-09T06:26:40.154696+0000","last_became_peered":"2023-10-09T06:26:40.154696+0000","last_unstale":"2023-10-09T06:26:40.155689+0000","last_undegraded":"2023-10-09T06:26:40.155689+0000","last_fullsized":"2023-10-09T06:26:40.155689+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:05.342330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.139208+0000","last_change":"2023-10-09T06:26:39.142162+0000","last_active":"2023-10-09T06:26:40.139208+0000","last_peered":"2023-10-09T06:26:40.139208+0000","last_clean":"2023-10-09T06:26:40.139208+0000","last_became_active":"2023-10-09T06:26:39.141924+0000","last_became_peered":"2023-10-09T06:26:39.141924+0000","last_unstale":"2023-10-09T06:26:40.139208+0000","last_undegraded":"2023-10-09T06:26:40.139208+0000","last_fullsized":"2023-10-09T06:26:40.139208+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:08:33.863566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.143943+0000","last_change":"2023-10-09T06:26:40.143731+0000","last_active":"2023-10-09T06:26:40.143943+0000","last_peered":"2023-10-09T06:26:40.143943+0000","last_clean":"2023-10-09T06:26:40.143943+0000","last_became_active":"2023-10-09T06:26:40.143077+0000","last_became_peered":"2023-10-09T06:26:40.143077+0000","last_unstale":"2023-10-09T06:26:40.143943+0000","last_undegraded":"2023-10-09T06:26:40.143943+0000","last_fullsized":"2023-10-09T06:26:40.143943+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:52:43.955053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.139924+0000","last_change":"2023-10-09T06:26:39.145705+0000","last_active":"2023-10-09T06:26:40.139924+0000","last_peered":"2023-10-09T06:26:40.139924+0000","last_clean":"2023-10-09T06:26:40.139924+0000","last_became_active":"2023-10-09T06:26:39.145433+0000","last_became_peered":"2023-10-09T06:26:39.145433+0000","last_unstale":"2023-10-09T06:26:40.139924+0000","last_undegraded":"2023-10-09T06:26:40.139924+0000","last_fullsized":"2023-10-09T06:26:40.139924+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:08:12.081095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.153399+0000","last_change":"2023-10-09T06:26:40.152851+0000","last_active":"2023-10-09T06:26:40.153399+0000","last_peered":"2023-10-09T06:26:40.153399+0000","last_clean":"2023-10-09T06:26:40.153399+0000","last_became_active":"2023-10-09T06:26:40.151515+0000","last_became_peered":"2023-10-09T06:26:40.151515+0000","last_unstale":"2023-10-09T06:26:40.153399+0000","last_undegraded":"2023-10-09T06:26:40.153399+0000","last_fullsized":"2023-10-09T06:26:40.153399+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:42.733308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.139318+0000","last_change":"2023-10-09T06:26:39.143265+0000","last_active":"2023-10-09T06:26:40.139318+0000","last_peered":"2023-10-09T06:26:40.139318+0000","last_clean":"2023-10-09T06:26:40.139318+0000","last_became_active":"2023-10-09T06:26:39.142430+0000","last_became_peered":"2023-10-09T06:26:39.142430+0000","last_unstale":"2023-10-09T06:26:40.139318+0000","last_undegraded":"2023-10-09T06:26:40.139318+0000","last_fullsized":"2023-10-09T06:26:40.139318+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:07:36.084499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.143922+0000","last_change":"2023-10-09T06:26:40.143309+0000","last_active":"2023-10-09T06:26:40.143922+0000","last_peered":"2023-10-09T06:26:40.143922+0000","last_clean":"2023-10-09T06:26:40.143922+0000","last_became_active":"2023-10-09T06:26:40.143063+0000","last_became_peered":"2023-10-09T06:26:40.143063+0000","last_unstale":"2023-10-09T06:26:40.143922+0000","last_undegraded":"2023-10-09T06:26:40.143922+0000","last_fullsized":"2023-10-09T06:26:40.143922+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:15.925680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.138036+0000","last_change":"2023-10-09T06:26:39.148434+0000","last_active":"2023-10-09T06:26:40.138036+0000","last_peered":"2023-10-09T06:26:40.138036+0000","last_clean":"2023-10-09T06:26:40.138036+0000","last_became_active":"2023-10-09T06:26:39.148211+0000","last_became_peered":"2023-10-09T06:26:39.148211+0000","last_unstale":"2023-10-09T06:26:40.138036+0000","last_undegraded":"2023-10-09T06:26:40.138036+0000","last_fullsized":"2023-10-09T06:26:40.138036+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:07.821251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.150879+0000","last_change":"2023-10-09T06:26:40.150833+0000","last_active":"2023-10-09T06:26:40.150879+0000","last_peered":"2023-10-09T06:26:40.150879+0000","last_clean":"2023-10-09T06:26:40.150879+0000","last_became_active":"2023-10-09T06:26:40.150556+0000","last_became_peered":"2023-10-09T06:26:40.150556+0000","last_unstale":"2023-10-09T06:26:40.150879+0000","last_undegraded":"2023-10-09T06:26:40.150879+0000","last_fullsized":"2023-10-09T06:26:40.150879+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:36.928676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"120'3","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.150147+0000","last_change":"2023-10-09T06:26:39.142407+0000","last_active":"2023-10-09T06:26:40.150147+0000","last_peered":"2023-10-09T06:26:40.150147+0000","last_clean":"2023-10-09T06:26:40.150147+0000","last_became_active":"2023-10-09T06:26:39.140892+0000","last_became_peered":"2023-10-09T06:26:39.140892+0000","last_unstale":"2023-10-09T06:26:40.150147+0000","last_undegraded":"2023-10-09T06:26:40.150147+0000","last_fullsized":"2023-10-09T06:26:40.150147+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:58.795482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.152388+0000","last_change":"2023-10-09T06:26:40.152312+0000","last_active":"2023-10-09T06:26:40.152388+0000","last_peered":"2023-10-09T06:26:40.152388+0000","last_clean":"2023-10-09T06:26:40.152388+0000","last_became_active":"2023-10-09T06:26:40.152073+0000","last_became_peered":"2023-10-09T06:26:40.152073+0000","last_unstale":"2023-10-09T06:26:40.152388+0000","last_undegraded":"2023-10-09T06:26:40.152388+0000","last_fullsized":"2023-10-09T06:26:40.152388+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:06.119652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"120'6","reported_seq":16,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.160789+0000","last_change":"2023-10-09T06:26:39.141056+0000","last_active":"2023-10-09T06:26:40.160789+0000","last_peered":"2023-10-09T06:26:40.160789+0000","last_clean":"2023-10-09T06:26:40.160789+0000","last_became_active":"2023-10-09T06:26:39.140506+0000","last_became_peered":"2023-10-09T06:26:39.140506+0000","last_unstale":"2023-10-09T06:26:40.160789+0000","last_undegraded":"2023-10-09T06:26:40.160789+0000","last_fullsized":"2023-10-09T06:26:40.160789+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:21:36.812847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.146898+0000","last_change":"2023-10-09T06:26:40.146754+0000","last_active":"2023-10-09T06:26:40.146898+0000","last_peered":"2023-10-09T06:26:40.146898+0000","last_clean":"2023-10-09T06:26:40.146898+0000","last_became_active":"2023-10-09T06:26:40.146488+0000","last_became_peered":"2023-10-09T06:26:40.146488+0000","last_unstale":"2023-10-09T06:26:40.146898+0000","last_undegraded":"2023-10-09T06:26:40.146898+0000","last_fullsized":"2023-10-09T06:26:40.146898+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:09.792034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.153101+0000","last_change":"2023-10-09T06:26:39.146974+0000","last_active":"2023-10-09T06:26:40.153101+0000","last_peered":"2023-10-09T06:26:40.153101+0000","last_clean":"2023-10-09T06:26:40.153101+0000","last_became_active":"2023-10-09T06:26:39.144908+0000","last_became_peered":"2023-10-09T06:26:39.144908+0000","last_unstale":"2023-10-09T06:26:40.153101+0000","last_undegraded":"2023-10-09T06:26:40.153101+0000","last_fullsized":"2023-10-09T06:26:40.153101+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:26.820188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.146029+0000","last_change":"2023-10-09T06:26:40.145824+0000","last_active":"2023-10-09T06:26:40.146029+0000","last_peered":"2023-10-09T06:26:40.146029+0000","last_clean":"2023-10-09T06:26:40.146029+0000","last_became_active":"2023-10-09T06:26:40.144791+0000","last_became_peered":"2023-10-09T06:26:40.144791+0000","last_unstale":"2023-10-09T06:26:40.146029+0000","last_undegraded":"2023-10-09T06:26:40.146029+0000","last_fullsized":"2023-10-09T06:26:40.146029+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:43.689669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.138852+0000","last_change":"2023-10-09T06:26:39.138994+0000","last_active":"2023-10-09T06:26:40.138852+0000","last_peered":"2023-10-09T06:26:40.138852+0000","last_clean":"2023-10-09T06:26:40.138852+0000","last_became_active":"2023-10-09T06:26:39.138764+0000","last_became_peered":"2023-10-09T06:26:39.138764+0000","last_unstale":"2023-10-09T06:26:40.138852+0000","last_undegraded":"2023-10-09T06:26:40.138852+0000","last_fullsized":"2023-10-09T06:26:40.138852+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:59.625701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.144662+0000","last_change":"2023-10-09T06:26:40.144478+0000","last_active":"2023-10-09T06:26:40.144662+0000","last_peered":"2023-10-09T06:26:40.144662+0000","last_clean":"2023-10-09T06:26:40.144662+0000","last_became_active":"2023-10-09T06:26:40.144253+0000","last_became_peered":"2023-10-09T06:26:40.144253+0000","last_unstale":"2023-10-09T06:26:40.144662+0000","last_undegraded":"2023-10-09T06:26:40.144662+0000","last_fullsized":"2023-10-09T06:26:40.144662+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:37.968513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.136851+0000","last_change":"2023-10-09T06:26:39.140931+0000","last_active":"2023-10-09T06:26:40.136851+0000","last_peered":"2023-10-09T06:26:40.136851+0000","last_clean":"2023-10-09T06:26:40.136851+0000","last_became_active":"2023-10-09T06:26:39.139877+0000","last_became_peered":"2023-10-09T06:26:39.139877+0000","last_unstale":"2023-10-09T06:26:40.136851+0000","last_undegraded":"2023-10-09T06:26:40.136851+0000","last_fullsized":"2023-10-09T06:26:40.136851+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:12:29.900130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.149953+0000","last_change":"2023-10-09T06:26:40.149621+0000","last_active":"2023-10-09T06:26:40.149953+0000","last_peered":"2023-10-09T06:26:40.149953+0000","last_clean":"2023-10-09T06:26:40.149953+0000","last_became_active":"2023-10-09T06:26:40.149084+0000","last_became_peered":"2023-10-09T06:26:40.149084+0000","last_unstale":"2023-10-09T06:26:40.149953+0000","last_undegraded":"2023-10-09T06:26:40.149953+0000","last_fullsized":"2023-10-09T06:26:40.149953+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:41:06.866701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"120'8","reported_seq":18,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.160918+0000","last_change":"2023-10-09T06:26:39.141649+0000","last_active":"2023-10-09T06:26:40.160918+0000","last_peered":"2023-10-09T06:26:40.160918+0000","last_clean":"2023-10-09T06:26:40.160918+0000","last_became_active":"2023-10-09T06:26:39.140568+0000","last_became_peered":"2023-10-09T06:26:39.140568+0000","last_unstale":"2023-10-09T06:26:40.160918+0000","last_undegraded":"2023-10-09T06:26:40.160918+0000","last_fullsized":"2023-10-09T06:26:40.160918+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:37.567131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.140748+0000","last_change":"2023-10-09T06:26:40.140675+0000","last_active":"2023-10-09T06:26:40.140748+0000","last_peered":"2023-10-09T06:26:40.140748+0000","last_clean":"2023-10-09T06:26:40.140748+0000","last_became_active":"2023-10-09T06:26:40.140436+0000","last_became_peered":"2023-10-09T06:26:40.140436+0000","last_unstale":"2023-10-09T06:26:40.140748+0000","last_undegraded":"2023-10-09T06:26:40.140748+0000","last_fullsized":"2023-10-09T06:26:40.140748+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:37.510252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.152450+0000","last_change":"2023-10-09T06:26:39.142225+0000","last_active":"2023-10-09T06:26:40.152450+0000","last_peered":"2023-10-09T06:26:40.152450+0000","last_clean":"2023-10-09T06:26:40.152450+0000","last_became_active":"2023-10-09T06:26:39.141724+0000","last_became_peered":"2023-10-09T06:26:39.141724+0000","last_unstale":"2023-10-09T06:26:40.152450+0000","last_undegraded":"2023-10-09T06:26:40.152450+0000","last_fullsized":"2023-10-09T06:26:40.152450+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:27:33.492960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.144517+0000","last_change":"2023-10-09T06:26:40.144420+0000","last_active":"2023-10-09T06:26:40.144517+0000","last_peered":"2023-10-09T06:26:40.144517+0000","last_clean":"2023-10-09T06:26:40.144517+0000","last_became_active":"2023-10-09T06:26:40.144166+0000","last_became_peered":"2023-10-09T06:26:40.144166+0000","last_unstale":"2023-10-09T06:26:40.144517+0000","last_undegraded":"2023-10-09T06:26:40.144517+0000","last_fullsized":"2023-10-09T06:26:40.144517+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:18.727244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.149301+0000","last_change":"2023-10-09T06:26:39.140181+0000","last_active":"2023-10-09T06:26:40.149301+0000","last_peered":"2023-10-09T06:26:40.149301+0000","last_clean":"2023-10-09T06:26:40.149301+0000","last_became_active":"2023-10-09T06:26:39.139926+0000","last_became_peered":"2023-10-09T06:26:39.139926+0000","last_unstale":"2023-10-09T06:26:40.149301+0000","last_undegraded":"2023-10-09T06:26:40.149301+0000","last_fullsized":"2023-10-09T06:26:40.149301+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:17.722197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.146751+0000","last_change":"2023-10-09T06:26:40.145599+0000","last_active":"2023-10-09T06:26:40.146751+0000","last_peered":"2023-10-09T06:26:40.146751+0000","last_clean":"2023-10-09T06:26:40.146751+0000","last_became_active":"2023-10-09T06:26:40.145193+0000","last_became_peered":"2023-10-09T06:26:40.145193+0000","last_unstale":"2023-10-09T06:26:40.146751+0000","last_undegraded":"2023-10-09T06:26:40.146751+0000","last_fullsized":"2023-10-09T06:26:40.146751+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:36.928676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.148052+0000","last_change":"2023-10-09T06:26:39.147684+0000","last_active":"2023-10-09T06:26:40.148052+0000","last_peered":"2023-10-09T06:26:40.148052+0000","last_clean":"2023-10-09T06:26:40.148052+0000","last_became_active":"2023-10-09T06:26:39.146632+0000","last_became_peered":"2023-10-09T06:26:39.146632+0000","last_unstale":"2023-10-09T06:26:40.148052+0000","last_undegraded":"2023-10-09T06:26:40.148052+0000","last_fullsized":"2023-10-09T06:26:40.148052+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:31:57.084642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.155594+0000","last_change":"2023-10-09T06:26:40.155532+0000","last_active":"2023-10-09T06:26:40.155594+0000","last_peered":"2023-10-09T06:26:40.155594+0000","last_clean":"2023-10-09T06:26:40.155594+0000","last_became_active":"2023-10-09T06:26:40.155119+0000","last_became_peered":"2023-10-09T06:26:40.155119+0000","last_unstale":"2023-10-09T06:26:40.155594+0000","last_undegraded":"2023-10-09T06:26:40.155594+0000","last_fullsized":"2023-10-09T06:26:40.155594+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:25:18.489655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.158063+0000","last_change":"2023-10-09T06:26:39.144584+0000","last_active":"2023-10-09T06:26:40.158063+0000","last_peered":"2023-10-09T06:26:40.158063+0000","last_clean":"2023-10-09T06:26:40.158063+0000","last_became_active":"2023-10-09T06:26:39.143932+0000","last_became_peered":"2023-10-09T06:26:39.143932+0000","last_unstale":"2023-10-09T06:26:40.158063+0000","last_undegraded":"2023-10-09T06:26:40.158063+0000","last_fullsized":"2023-10-09T06:26:40.158063+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:47.182429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.156744+0000","last_change":"2023-10-09T06:26:40.156104+0000","last_active":"2023-10-09T06:26:40.156744+0000","last_peered":"2023-10-09T06:26:40.156744+0000","last_clean":"2023-10-09T06:26:40.156744+0000","last_became_active":"2023-10-09T06:26:40.155899+0000","last_became_peered":"2023-10-09T06:26:40.155899+0000","last_unstale":"2023-10-09T06:26:40.156744+0000","last_undegraded":"2023-10-09T06:26:40.156744+0000","last_fullsized":"2023-10-09T06:26:40.156744+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:30:45.115038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.142150+0000","last_change":"2023-10-09T06:26:39.142838+0000","last_active":"2023-10-09T06:26:40.142150+0000","last_peered":"2023-10-09T06:26:40.142150+0000","last_clean":"2023-10-09T06:26:40.142150+0000","last_became_active":"2023-10-09T06:26:39.142562+0000","last_became_peered":"2023-10-09T06:26:39.142562+0000","last_unstale":"2023-10-09T06:26:40.142150+0000","last_undegraded":"2023-10-09T06:26:40.142150+0000","last_fullsized":"2023-10-09T06:26:40.142150+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:57:08.241805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.148217+0000","last_change":"2023-10-09T06:26:40.148144+0000","last_active":"2023-10-09T06:26:40.148217+0000","last_peered":"2023-10-09T06:26:40.148217+0000","last_clean":"2023-10-09T06:26:40.148217+0000","last_became_active":"2023-10-09T06:26:40.147922+0000","last_became_peered":"2023-10-09T06:26:40.147922+0000","last_unstale":"2023-10-09T06:26:40.148217+0000","last_undegraded":"2023-10-09T06:26:40.148217+0000","last_fullsized":"2023-10-09T06:26:40.148217+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:18.737990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.141859+0000","last_change":"2023-10-09T06:26:39.142877+0000","last_active":"2023-10-09T06:26:40.141859+0000","last_peered":"2023-10-09T06:26:40.141859+0000","last_clean":"2023-10-09T06:26:40.141859+0000","last_became_active":"2023-10-09T06:26:39.142647+0000","last_became_peered":"2023-10-09T06:26:39.142647+0000","last_unstale":"2023-10-09T06:26:40.141859+0000","last_undegraded":"2023-10-09T06:26:40.141859+0000","last_fullsized":"2023-10-09T06:26:40.141859+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:30.369373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.159868+0000","last_change":"2023-10-09T06:26:40.159787+0000","last_active":"2023-10-09T06:26:40.159868+0000","last_peered":"2023-10-09T06:26:40.159868+0000","last_clean":"2023-10-09T06:26:40.159868+0000","last_became_active":"2023-10-09T06:26:40.159274+0000","last_became_peered":"2023-10-09T06:26:40.159274+0000","last_unstale":"2023-10-09T06:26:40.159868+0000","last_undegraded":"2023-10-09T06:26:40.159868+0000","last_fullsized":"2023-10-09T06:26:40.159868+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:09.792034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.141609+0000","last_change":"2023-10-09T06:26:39.148353+0000","last_active":"2023-10-09T06:26:40.141609+0000","last_peered":"2023-10-09T06:26:40.141609+0000","last_clean":"2023-10-09T06:26:40.141609+0000","last_became_active":"2023-10-09T06:26:39.148134+0000","last_became_peered":"2023-10-09T06:26:39.148134+0000","last_unstale":"2023-10-09T06:26:40.141609+0000","last_undegraded":"2023-10-09T06:26:40.141609+0000","last_fullsized":"2023-10-09T06:26:40.141609+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:35.655348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.153423+0000","last_change":"2023-10-09T06:26:40.152953+0000","last_active":"2023-10-09T06:26:40.153423+0000","last_peered":"2023-10-09T06:26:40.153423+0000","last_clean":"2023-10-09T06:26:40.153423+0000","last_became_active":"2023-10-09T06:26:40.152065+0000","last_became_peered":"2023-10-09T06:26:40.152065+0000","last_unstale":"2023-10-09T06:26:40.153423+0000","last_undegraded":"2023-10-09T06:26:40.153423+0000","last_fullsized":"2023-10-09T06:26:40.153423+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:53.597023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.152631+0000","last_change":"2023-10-09T06:26:39.143411+0000","last_active":"2023-10-09T06:26:40.152631+0000","last_peered":"2023-10-09T06:26:40.152631+0000","last_clean":"2023-10-09T06:26:40.152631+0000","last_became_active":"2023-10-09T06:26:39.143165+0000","last_became_peered":"2023-10-09T06:26:39.143165+0000","last_unstale":"2023-10-09T06:26:40.152631+0000","last_undegraded":"2023-10-09T06:26:40.152631+0000","last_fullsized":"2023-10-09T06:26:40.152631+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:34.001786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.151955+0000","last_change":"2023-10-09T06:26:40.151887+0000","last_active":"2023-10-09T06:26:40.151955+0000","last_peered":"2023-10-09T06:26:40.151955+0000","last_clean":"2023-10-09T06:26:40.151955+0000","last_became_active":"2023-10-09T06:26:40.151669+0000","last_became_peered":"2023-10-09T06:26:40.151669+0000","last_unstale":"2023-10-09T06:26:40.151955+0000","last_undegraded":"2023-10-09T06:26:40.151955+0000","last_fullsized":"2023-10-09T06:26:40.151955+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:45:03.447924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.151646+0000","last_change":"2023-10-09T06:26:39.144146+0000","last_active":"2023-10-09T06:26:40.151646+0000","last_peered":"2023-10-09T06:26:40.151646+0000","last_clean":"2023-10-09T06:26:40.151646+0000","last_became_active":"2023-10-09T06:26:39.143163+0000","last_became_peered":"2023-10-09T06:26:39.143163+0000","last_unstale":"2023-10-09T06:26:40.151646+0000","last_undegraded":"2023-10-09T06:26:40.151646+0000","last_fullsized":"2023-10-09T06:26:40.151646+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:58.795482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.158949+0000","last_change":"2023-10-09T06:26:40.157640+0000","last_active":"2023-10-09T06:26:40.158949+0000","last_peered":"2023-10-09T06:26:40.158949+0000","last_clean":"2023-10-09T06:26:40.158949+0000","last_became_active":"2023-10-09T06:26:40.157414+0000","last_became_peered":"2023-10-09T06:26:40.157414+0000","last_unstale":"2023-10-09T06:26:40.158949+0000","last_undegraded":"2023-10-09T06:26:40.158949+0000","last_fullsized":"2023-10-09T06:26:40.158949+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:37.619543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.142034+0000","last_change":"2023-10-09T06:26:39.143074+0000","last_active":"2023-10-09T06:26:40.142034+0000","last_peered":"2023-10-09T06:26:40.142034+0000","last_clean":"2023-10-09T06:26:40.142034+0000","last_became_active":"2023-10-09T06:26:39.142828+0000","last_became_peered":"2023-10-09T06:26:39.142828+0000","last_unstale":"2023-10-09T06:26:40.142034+0000","last_undegraded":"2023-10-09T06:26:40.142034+0000","last_fullsized":"2023-10-09T06:26:40.142034+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:08:33.863566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.158825+0000","last_change":"2023-10-09T06:26:40.158758+0000","last_active":"2023-10-09T06:26:40.158825+0000","last_peered":"2023-10-09T06:26:40.158825+0000","last_clean":"2023-10-09T06:26:40.158825+0000","last_became_active":"2023-10-09T06:26:40.158505+0000","last_became_peered":"2023-10-09T06:26:40.158505+0000","last_unstale":"2023-10-09T06:26:40.158825+0000","last_undegraded":"2023-10-09T06:26:40.158825+0000","last_fullsized":"2023-10-09T06:26:40.158825+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:49.035851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.142488+0000","last_change":"2023-10-09T06:26:39.140070+0000","last_active":"2023-10-09T06:26:40.142488+0000","last_peered":"2023-10-09T06:26:40.142488+0000","last_clean":"2023-10-09T06:26:40.142488+0000","last_became_active":"2023-10-09T06:26:39.139338+0000","last_became_peered":"2023-10-09T06:26:39.139338+0000","last_unstale":"2023-10-09T06:26:40.142488+0000","last_undegraded":"2023-10-09T06:26:40.142488+0000","last_fullsized":"2023-10-09T06:26:40.142488+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:35.655348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.149971+0000","last_change":"2023-10-09T06:26:40.149810+0000","last_active":"2023-10-09T06:26:40.149971+0000","last_peered":"2023-10-09T06:26:40.149971+0000","last_clean":"2023-10-09T06:26:40.149971+0000","last_became_active":"2023-10-09T06:26:40.149408+0000","last_became_peered":"2023-10-09T06:26:40.149408+0000","last_unstale":"2023-10-09T06:26:40.149971+0000","last_undegraded":"2023-10-09T06:26:40.149971+0000","last_fullsized":"2023-10-09T06:26:40.149971+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:38.572178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.141711+0000","last_change":"2023-10-09T06:26:39.144052+0000","last_active":"2023-10-09T06:26:40.141711+0000","last_peered":"2023-10-09T06:26:40.141711+0000","last_clean":"2023-10-09T06:26:40.141711+0000","last_became_active":"2023-10-09T06:26:39.143481+0000","last_became_peered":"2023-10-09T06:26:39.143481+0000","last_unstale":"2023-10-09T06:26:40.141711+0000","last_undegraded":"2023-10-09T06:26:40.141711+0000","last_fullsized":"2023-10-09T06:26:40.141711+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:16:35.099029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.143869+0000","last_change":"2023-10-09T06:26:40.142796+0000","last_active":"2023-10-09T06:26:40.143869+0000","last_peered":"2023-10-09T06:26:40.143869+0000","last_clean":"2023-10-09T06:26:40.143869+0000","last_became_active":"2023-10-09T06:26:40.141242+0000","last_became_peered":"2023-10-09T06:26:40.141242+0000","last_unstale":"2023-10-09T06:26:40.143869+0000","last_undegraded":"2023-10-09T06:26:40.143869+0000","last_fullsized":"2023-10-09T06:26:40.143869+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:48.187476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.137951+0000","last_change":"2023-10-09T06:26:39.139560+0000","last_active":"2023-10-09T06:26:40.137951+0000","last_peered":"2023-10-09T06:26:40.137951+0000","last_clean":"2023-10-09T06:26:40.137951+0000","last_became_active":"2023-10-09T06:26:39.139340+0000","last_became_peered":"2023-10-09T06:26:39.139340+0000","last_unstale":"2023-10-09T06:26:40.137951+0000","last_undegraded":"2023-10-09T06:26:40.137951+0000","last_fullsized":"2023-10-09T06:26:40.137951+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:25.974089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.146090+0000","last_change":"2023-10-09T06:26:40.145975+0000","last_active":"2023-10-09T06:26:40.146090+0000","last_peered":"2023-10-09T06:26:40.146090+0000","last_clean":"2023-10-09T06:26:40.146090+0000","last_became_active":"2023-10-09T06:26:40.145781+0000","last_became_peered":"2023-10-09T06:26:40.145781+0000","last_unstale":"2023-10-09T06:26:40.146090+0000","last_undegraded":"2023-10-09T06:26:40.146090+0000","last_fullsized":"2023-10-09T06:26:40.146090+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:07:37.089546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.138700+0000","last_change":"2023-10-09T06:26:39.146663+0000","last_active":"2023-10-09T06:26:40.138700+0000","last_peered":"2023-10-09T06:26:40.138700+0000","last_clean":"2023-10-09T06:26:40.138700+0000","last_became_active":"2023-10-09T06:26:39.146071+0000","last_became_peered":"2023-10-09T06:26:39.146071+0000","last_unstale":"2023-10-09T06:26:40.138700+0000","last_undegraded":"2023-10-09T06:26:40.138700+0000","last_fullsized":"2023-10-09T06:26:40.138700+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:16:35.099029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.150511+0000","last_change":"2023-10-09T06:26:40.150306+0000","last_active":"2023-10-09T06:26:40.150511+0000","last_peered":"2023-10-09T06:26:40.150511+0000","last_clean":"2023-10-09T06:26:40.150511+0000","last_became_active":"2023-10-09T06:26:40.149759+0000","last_became_peered":"2023-10-09T06:26:40.149759+0000","last_unstale":"2023-10-09T06:26:40.150511+0000","last_undegraded":"2023-10-09T06:26:40.150511+0000","last_fullsized":"2023-10-09T06:26:40.150511+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:48.187476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.137745+0000","last_change":"2023-10-09T06:26:39.143731+0000","last_active":"2023-10-09T06:26:40.137745+0000","last_peered":"2023-10-09T06:26:40.137745+0000","last_clean":"2023-10-09T06:26:40.137745+0000","last_became_active":"2023-10-09T06:26:39.143120+0000","last_became_peered":"2023-10-09T06:26:39.143120+0000","last_unstale":"2023-10-09T06:26:40.137745+0000","last_undegraded":"2023-10-09T06:26:40.137745+0000","last_fullsized":"2023-10-09T06:26:40.137745+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:04.446574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.154677+0000","last_change":"2023-10-09T06:26:40.154615+0000","last_active":"2023-10-09T06:26:40.154677+0000","last_peered":"2023-10-09T06:26:40.154677+0000","last_clean":"2023-10-09T06:26:40.154677+0000","last_became_active":"2023-10-09T06:26:40.154387+0000","last_became_peered":"2023-10-09T06:26:40.154387+0000","last_unstale":"2023-10-09T06:26:40.154677+0000","last_undegraded":"2023-10-09T06:26:40.154677+0000","last_fullsized":"2023-10-09T06:26:40.154677+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:39.128477+0000","last_clean_scrub_stamp":"2023-10-09T06:26:39.128477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:16:17.296441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.153271+0000","last_change":"2023-10-09T06:26:39.141796+0000","last_active":"2023-10-09T06:26:40.153271+0000","last_peered":"2023-10-09T06:26:40.153271+0000","last_clean":"2023-10-09T06:26:40.153271+0000","last_became_active":"2023-10-09T06:26:39.141168+0000","last_became_peered":"2023-10-09T06:26:39.141168+0000","last_unstale":"2023-10-09T06:26:40.153271+0000","last_undegraded":"2023-10-09T06:26:40.153271+0000","last_fullsized":"2023-10-09T06:26:40.153271+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:26:38.123430+0000","last_clean_scrub_stamp":"2023-10-09T06:26:38.123430+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:57:33.060097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T06:26:40.136191+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:26:40.136191+0000","last_peered":"2023-10-09T06:26:40.136191+0000","last_clean":"2023-10-09T06:26:40.136191+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:26:40.136191+0000","last_undegraded":"2023-10-09T06:26:40.136191+0000","last_fullsized":"2023-10-09T06:26:40.136191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194085,"statfs":{"total":200000000,"available":198743974,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.51100000000000001},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78800000000000003,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57399999999999995,"15min":0.52400000000000002},"min":{"1min":0.28799999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70699999999999996,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.48899999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54200000000000004,"15min":0.50600000000000001},"min":{"1min":0.39500000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53700000000000003,"15min":0.50800000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67700000000000005,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61699999999999999,"15min":0.57699999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71999999999999997,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58899999999999997,"15min":0.54000000000000004},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76400000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.54000000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65600000000000003,"15min":0.58199999999999996},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.84399999999999997,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.435},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.64400000000000002,"15min":0.56599999999999995},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78200000000000003,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.52300000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.28299999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.83099999999999996,"5min":0.872,"15min":0.872},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.79800000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.38600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91400000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63600000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88400000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.625}]}]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333830,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59199999999999997,"15min":0.76800000000000002},"min":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63900000000000001,"5min":7.0960000000000001,"15min":7.0960000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":1.133,"15min":1.133},"last":0.52200000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.437,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64900000000000002,"5min":1.155,"15min":1.155},"last":0.501},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.378,"5min":0.317,"15min":0.317},"max":{"1min":0.65500000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56599999999999995,"15min":0.59599999999999997},"min":{"1min":0.372,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66300000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.61499999999999999,"15min":0.77900000000000003},"min":{"1min":0.40200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.65500000000000003,"5min":7.1299999999999999,"15min":7.1299999999999999},"last":0.61599999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56899999999999995,"15min":0.59599999999999997},"min":{"1min":0.442,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.63800000000000001,"5min":1.337,"15min":1.337},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.56200000000000006,"15min":0.57999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.623,"5min":1.206,"15min":1.206},"last":0.59799999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65100000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48899999999999999,"15min":0.49399999999999999},"min":{"1min":0.34499999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.63100000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.59499999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68200000000000005,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.80500000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.374,"5min":0.315,"15min":0.315},"max":{"1min":0.67300000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.66000000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.77400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":649,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334454,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35799999999999998,"15min":0.36899999999999999},"min":{"1min":0.26100000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.48299999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.223},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36899999999999999,"15min":0.33600000000000002},"min":{"1min":0.247,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.505,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.28699999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.45900000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40500000000000003,"15min":0.38700000000000001},"min":{"1min":0.255,"5min":0.247,"15min":0.247},"max":{"1min":0.58499999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.30199999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.41599999999999998},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.60799999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44900000000000001,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.622,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.31900000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.91500000000000004,"5min":1.097,"15min":1.097},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67100000000000004,"15min":0.81100000000000005},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81299999999999994,"5min":5.5270000000000001,"15min":5.5270000000000001},"last":0.42699999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65100000000000002,"15min":0.627},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90100000000000002,"5min":1.125,"15min":1.125},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94499999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.502}]},{"osd":6,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65100000000000002,"15min":0.622},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89100000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93600000000000005,"5min":1.49,"15min":1.49},"last":0.46600000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.64400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67600000000000005,"15min":0.65700000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88400000000000001,"5min":1.052,"15min":1.052},"last":0.41599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194085,"statfs":{"total":200000000,"available":198743532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.41399999999999998},"min":{"1min":0.23599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.50600000000000001,"5min":1.226,"15min":1.226},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.54900000000000004,"5min":1.131,"15min":1.131},"last":0.28199999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.55700000000000005,"15min":0.99399999999999999},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":12.929,"15min":12.929},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.438,"15min":0.46300000000000002},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.55000000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.36599999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.47699999999999998},"min":{"1min":0.32200000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.749,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45300000000000001,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.314,"15min":0.314},"max":{"1min":0.57399999999999995,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.39600000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.628,"15min":0.65600000000000003},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97099999999999997,"5min":1.335,"15min":1.335},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90700000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.81499999999999995,"5min":0.999,"15min":0.999},"last":0.622}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83099999999999996,"5min":0.998,"15min":0.998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65400000000000003,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.262,"15min":1.262},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.67000000000000004},"min":{"1min":0.52100000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.95599999999999996,"5min":1.103,"15min":1.103},"last":0.64000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":649,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334420,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.5,"15min":0.88600000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.48599999999999999,"5min":14.981999999999999,"15min":14.981999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.46200000000000002,"15min":0.67400000000000004},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57099999999999995,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.502}]},{"osd":1,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.436,"15min":0.63400000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68000000000000005,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.436},{"interface":"front","average":{"1min":0.44,"5min":0.53600000000000003,"15min":0.70399999999999996},"min":{"1min":0.28299999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.91400000000000003,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.51700000000000002,"15min":0.70699999999999996},"min":{"1min":0.30299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70299999999999996,"5min":8.5190000000000001,"15min":8.5190000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.58299999999999996,"15min":0.94599999999999995},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.51600000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.77000000000000002,"15min":1.1459999999999999},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.95299999999999996,"5min":14.917999999999999,"15min":14.917999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.71899999999999997,"15min":0.93100000000000005},"min":{"1min":0.46700000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1160000000000001,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.69099999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.90600000000000003},"min":{"1min":0.432,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93600000000000005,"5min":8.9610000000000003,"15min":8.9610000000000003},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72299999999999998,"15min":0.91300000000000003},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.006,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.71099999999999997,"15min":0.89500000000000002},"min":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95599999999999996,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.78600000000000003,"15min":1.1439999999999999},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.028,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.70899999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70099999999999996,"15min":0.89100000000000001},"min":{"1min":0.44600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85299999999999998,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72099999999999997,"15min":0.90800000000000003},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0609999999999999,"5min":8.4640000000000004,"15min":8.4640000000000004},"last":0.58399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":651,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199332896,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.33000000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40799999999999997,"15min":0.379},"min":{"1min":0.29899999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.60099999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.32500000000000001},"min":{"1min":0.24299999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.35099999999999998},"min":{"1min":0.26700000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.504}]},{"osd":2,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38,"15min":0.36199999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.52100000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45700000000000002,"15min":0.42099999999999999},"min":{"1min":0.33200000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55400000000000005}]},{"osd":4,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57999999999999996,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84799999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.68999999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.34999999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63600000000000001,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.72199999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.441,"5min":0.372,"15min":0.372},"max":{"1min":0.77600000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.443,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90100000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73899999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.625,"15min":0.58899999999999997},"min":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.629,"15min":0.60799999999999998},"min":{"1min":0.45200000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.77200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":651,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194660,"statfs":{"total":200000000,"available":199332794,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53100000000000003,"15min":0.498},"min":{"1min":0.372,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.72199999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.56299999999999994}]},{"osd":1,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.33000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.73999999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.71099999999999997},"min":{"1min":0.38500000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73299999999999998,"5min":4.3250000000000002,"15min":4.3250000000000002},"last":0.57699999999999996}]},{"osd":2,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.60099999999999998,"15min":0.70099999999999996},"min":{"1min":0.375,"5min":0.313,"15min":0.313},"max":{"1min":0.70599999999999996,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.70799999999999996,"15min":1.0780000000000001},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.74199999999999999,"5min":11.715,"15min":11.715},"last":0.497}]},{"osd":3,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56499999999999995,"15min":0.52500000000000002},"min":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.751,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.46100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77100000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.50800000000000001,"15min":0.52100000000000002},"min":{"1min":0.34499999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.77300000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50900000000000001,"15min":0.504},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78100000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38300000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.879,"15min":0.879},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83399999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334384,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85399999999999998,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.54600000000000004,"15min":0.52000000000000002},"min":{"1min":0.45100000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77900000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.71899999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54800000000000004,"15min":0.51800000000000002},"min":{"1min":0.38900000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82399999999999995,"5min":1.093,"15min":1.093},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.55200000000000005,"15min":0.52000000000000002},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83399999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.433,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57599999999999996,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84199999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.624}]},{"osd":3,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58399999999999996,"15min":0.55500000000000005},"min":{"1min":0.45600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.58599999999999997},"min":{"1min":0.47799999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.81299999999999994,"5min":1.071,"15min":1.071},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48899999999999999,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72399999999999998,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.37,"5min":0.309,"15min":0.309},"max":{"1min":0.75800000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41399999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.504,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73999999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.82799999999999996,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33200000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81000000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.36599999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84399999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69199999999999995}]}]}],"pool_statfs":[]}} 2023-10-09T06:26:44.634 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:26:44.634 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:26:44.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.793+0000 7f48230cf700 1 Processor -- start 2023-10-09T06:26:44.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.793+0000 7f48230cf700 1 -- start start 2023-10-09T06:26:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f48230cf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f481c0b3570 0x7f481c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f48230cf700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f481c0b4c30 0x7f481c0b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f48230cf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481c0b14f0 con 0x7f481c0b4860 2023-10-09T06:26:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f48230cf700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c0b17d0 con 0x7f481c0b3570 2023-10-09T06:26:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f48230cf700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c0b1ab0 con 0x7f481c0b4c30 2023-10-09T06:26:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f481bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f481c0b3570 0x7f481c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f4820e6b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f481c0b4860 0x7f481c159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43736/0 (socket says 172.21.15.31:43736) 2023-10-09T06:26:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f4820e6b700 1 -- 172.21.15.31:0/2907242570 learned_addr learned my addr 172.21.15.31:0/2907242570 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f482166c700 1 --2- 172.21.15.31:0/2907242570 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f481c0b4c30 0x7f481c0b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f481bfff700 1 -- 172.21.15.31:0/2907242570 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f481c0b4c30 msgr2=0x7f481c0b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f481bfff700 1 --2- 172.21.15.31:0/2907242570 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f481c0b4c30 0x7f481c0b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f481bfff700 1 -- 172.21.15.31:0/2907242570 >> v1:172.21.15.31:6789/0 conn(0x7f481c0b4860 legacy=0x7f481c159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f481bfff700 1 -- 172.21.15.31:0/2907242570 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c0b1d90 con 0x7f481c0b3570 2023-10-09T06:26:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f481b7fe700 1 -- 172.21.15.31:0/2907242570 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657920679 0 0) 0x7f481c0b14f0 con 0x7f481c0b4860 2023-10-09T06:26:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.794+0000 7f481bfff700 1 --2- 172.21.15.31:0/2907242570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481c0b3570 0x7f481c15a1a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f48100098e0 tx=0x7f48100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb39abe0a1db8d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.795+0000 7f481b7fe700 1 -- 172.21.15.31:0/2907242570 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810009e80 con 0x7f481c0b3570 2023-10-09T06:26:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.795+0000 7f481b7fe700 1 -- 172.21.15.31:0/2907242570 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481000b8f0 con 0x7f481c0b3570 2023-10-09T06:26:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.795+0000 7f481b7fe700 1 -- 172.21.15.31:0/2907242570 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481000bc70 con 0x7f481c0b3570 2023-10-09T06:26:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.795+0000 7f48230cf700 1 -- 172.21.15.31:0/2907242570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481c0b3570 msgr2=0x7f481c15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.795+0000 7f48230cf700 1 --2- 172.21.15.31:0/2907242570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481c0b3570 0x7f481c15a1a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f48100098e0 tx=0x7f48100091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.795+0000 7f48230cf700 1 -- 172.21.15.31:0/2907242570 shutdown_connections 2023-10-09T06:26:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.795+0000 7f48230cf700 1 --2- 172.21.15.31:0/2907242570 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f481c0b4c30 0x7f481c0b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.795+0000 7f48230cf700 1 --2- 172.21.15.31:0/2907242570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481c0b3570 0x7f481c15a1a0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.795+0000 7f48230cf700 1 -- 172.21.15.31:0/2907242570 >> 172.21.15.31:0/2907242570 conn(0x7f481c09a0f0 msgr2=0x7f481c067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.795+0000 7f48230cf700 1 -- 172.21.15.31:0/2907242570 shutdown_connections 2023-10-09T06:26:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.795+0000 7f48230cf700 1 -- 172.21.15.31:0/2907242570 wait complete. 2023-10-09T06:26:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.796+0000 7f48230cf700 1 Processor -- start 2023-10-09T06:26:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.796+0000 7f48230cf700 1 -- start start 2023-10-09T06:26:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f48230cf700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f481c0b3570 0x7f481c1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f48230cf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481c0b4860 0x7f481c09e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f48230cf700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f481c0b4c30 0x7f481c09d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f48230cf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c09ce10 con 0x7f481c0b4860 2023-10-09T06:26:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f48230cf700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c09df20 con 0x7f481c0b4c30 2023-10-09T06:26:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f48230cf700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c09c200 con 0x7f481c0b3570 2023-10-09T06:26:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f481bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481c0b4860 0x7f481c09e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f481bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481c0b4860 0x7f481c09e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53978/0 (socket says 172.21.15.31:53978) 2023-10-09T06:26:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f481bfff700 1 -- 172.21.15.31:0/1582056737 learned_addr learned my addr 172.21.15.31:0/1582056737 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f4820e6b700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f481c0b3570 0x7f481c1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f482166c700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f481c0b4c30 0x7f481c09d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f481bfff700 1 -- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f481c0b3570 msgr2=0x7f481c1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f481bfff700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f481c0b3570 0x7f481c1583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f481bfff700 1 -- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f481c0b4c30 msgr2=0x7f481c09d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:44.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f481bfff700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f481c0b4c30 0x7f481c09d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:44.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.797+0000 7f481bfff700 1 -- 172.21.15.31:0/1582056737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4810009420 con 0x7f481c0b4860 2023-10-09T06:26:44.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.798+0000 7f481bfff700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481c0b4860 0x7f481c09e3e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f481000b3c0 tx=0x7f4810017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:44.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.798+0000 7f4818ff9700 1 -- 172.21.15.31:0/1582056737 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481000bc70 con 0x7f481c0b4860 2023-10-09T06:26:44.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.798+0000 7f4818ff9700 1 -- 172.21.15.31:0/1582056737 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4810011420 con 0x7f481c0b4860 2023-10-09T06:26:44.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.798+0000 7f48230cf700 1 -- 172.21.15.31:0/1582056737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481c09c4e0 con 0x7f481c0b4860 2023-10-09T06:26:44.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.798+0000 7f4818ff9700 1 -- 172.21.15.31:0/1582056737 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810011800 con 0x7f481c0b4860 2023-10-09T06:26:44.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.798+0000 7f48230cf700 1 -- 172.21.15.31:0/1582056737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481c09caa0 con 0x7f481c0b4860 2023-10-09T06:26:44.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.799+0000 7f48230cf700 1 -- 172.21.15.31:0/1582056737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481c04c3c0 con 0x7f481c0b4860 2023-10-09T06:26:44.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.799+0000 7f4818ff9700 1 -- 172.21.15.31:0/1582056737 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4810011bf0 con 0x7f481c0b4860 2023-10-09T06:26:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.800+0000 7f4818ff9700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4808066f30 0x7f48080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.800+0000 7f4818ff9700 1 -- 172.21.15.31:0/1582056737 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4810085fe0 con 0x7f481c0b4860 2023-10-09T06:26:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.800+0000 7f4820e6b700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4808066f30 0x7f48080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.800+0000 7f4820e6b700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4808066f30 0x7f48080693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f480c001360 tx=0x7f480c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:44.804+0000 7f4818ff9700 1 -- 172.21.15.31:0/1582056737 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4810053250 con 0x7f481c0b4860 2023-10-09T06:26:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.079+0000 7f48230cf700 1 -- 172.21.15.31:0/1582056737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f481c09cf50 con 0x7f481c0b4860 2023-10-09T06:26:45.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.083+0000 7f4818ff9700 1 -- 172.21.15.31:0/1582056737 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4810056870 con 0x7f481c0b4860 2023-10-09T06:26:45.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.085+0000 7f48230cf700 1 -- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4808066f30 msgr2=0x7f48080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:45.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.085+0000 7f48230cf700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4808066f30 0x7f48080693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f480c001360 tx=0x7f480c009040 comp rx=0 tx=0).stop 2023-10-09T06:26:45.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.085+0000 7f48230cf700 1 -- 172.21.15.31:0/1582056737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481c0b4860 msgr2=0x7f481c09e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:45.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.085+0000 7f48230cf700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481c0b4860 0x7f481c09e3e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f481000b3c0 tx=0x7f4810017000 comp rx=0 tx=0).stop 2023-10-09T06:26:45.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.085+0000 7f48230cf700 1 -- 172.21.15.31:0/1582056737 shutdown_connections 2023-10-09T06:26:45.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.085+0000 7f48230cf700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4808066f30 0x7f48080693e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:45.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.085+0000 7f48230cf700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f481c0b3570 0x7f481c1583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:45.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.085+0000 7f48230cf700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f481c0b4c30 0x7f481c09d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:45.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.085+0000 7f48230cf700 1 --2- 172.21.15.31:0/1582056737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481c0b4860 0x7f481c09e3e0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:45.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.085+0000 7f48230cf700 1 -- 172.21.15.31:0/1582056737 >> 172.21.15.31:0/1582056737 conn(0x7f481c09a0f0 msgr2=0x7f481c15c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:45.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.086+0000 7f48230cf700 1 -- 172.21.15.31:0/1582056737 shutdown_connections 2023-10-09T06:26:45.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.086+0000 7f48230cf700 1 -- 172.21.15.31:0/1582056737 wait complete. 2023-10-09T06:26:45.088 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2023-10-09T06:26:45.098 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:45.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.217+0000 7fc2a7881700 1 Processor -- start 2023-10-09T06:26:45.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.217+0000 7fc2a7881700 1 -- start start 2023-10-09T06:26:45.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a7881700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc2a0159e10 0x7fc2a00b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:45.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a7881700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc2a015a1e0 0x7fc2a00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:45.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a7881700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a015db80 con 0x7fc2a00b1610 2023-10-09T06:26:45.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a7881700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a015e800 con 0x7fc2a0159e10 2023-10-09T06:26:45.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a7881700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a015de60 con 0x7fc2a015a1e0 2023-10-09T06:26:45.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a561d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc2a0159e10 0x7fc2a00b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:45.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a561d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc2a0159e10 0x7fc2a00b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53988/0 (socket says 172.21.15.31:53988) 2023-10-09T06:26:45.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a561d700 1 -- 172.21.15.31:0/3734913684 learned_addr learned my addr 172.21.15.31:0/3734913684 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:45.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a4e1c700 1 --2- 172.21.15.31:0/3734913684 >> v2:172.21.15.158:3300/0 conn(0x7fc2a015a1e0 0x7fc2a00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:45.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a561d700 1 -- 172.21.15.31:0/3734913684 >> v2:172.21.15.158:3300/0 conn(0x7fc2a015a1e0 msgr2=0x7fc2a00b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:45.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a561d700 1 --2- 172.21.15.31:0/3734913684 >> v2:172.21.15.158:3300/0 conn(0x7fc2a015a1e0 0x7fc2a00b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:45.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a561d700 1 -- 172.21.15.31:0/3734913684 >> v1:172.21.15.158:6789/0 conn(0x7fc2a00b1610 legacy=0x7fc2a00cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:45.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a561d700 1 -- 172.21.15.31:0/3734913684 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a015e140 con 0x7fc2a0159e10 2023-10-09T06:26:45.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.218+0000 7fc2a561d700 1 --2- 172.21.15.31:0/3734913684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a0159e10 0x7fc2a00b2d20 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0068580 tx=0x7fc290009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2543cad47a3e0b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:45.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.219+0000 7fc29ffff700 1 -- 172.21.15.31:0/3734913684 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29000e070 con 0x7fc2a0159e10 2023-10-09T06:26:45.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.219+0000 7fc29ffff700 1 -- 172.21.15.31:0/3734913684 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29000ba10 con 0x7fc2a0159e10 2023-10-09T06:26:45.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.219+0000 7fc29ffff700 1 -- 172.21.15.31:0/3734913684 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2900092e0 con 0x7fc2a0159e10 2023-10-09T06:26:45.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.219+0000 7fc2a7881700 1 -- 172.21.15.31:0/3734913684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a0159e10 msgr2=0x7fc2a00b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:45.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.219+0000 7fc2a7881700 1 --2- 172.21.15.31:0/3734913684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a0159e10 0x7fc2a00b2d20 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0068580 tx=0x7fc290009840 comp rx=0 tx=0).stop 2023-10-09T06:26:45.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.219+0000 7fc2a7881700 1 -- 172.21.15.31:0/3734913684 shutdown_connections 2023-10-09T06:26:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.219+0000 7fc2a7881700 1 --2- 172.21.15.31:0/3734913684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a0159e10 0x7fc2a00b2d20 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.219+0000 7fc2a7881700 1 --2- 172.21.15.31:0/3734913684 >> v2:172.21.15.158:3300/0 conn(0x7fc2a015a1e0 0x7fc2a00b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.219+0000 7fc2a7881700 1 -- 172.21.15.31:0/3734913684 >> 172.21.15.31:0/3734913684 conn(0x7fc2a0067660 msgr2=0x7fc2a0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.219+0000 7fc2a7881700 1 -- 172.21.15.31:0/3734913684 shutdown_connections 2023-10-09T06:26:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.219+0000 7fc2a7881700 1 -- 172.21.15.31:0/3734913684 wait complete. 2023-10-09T06:26:45.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.220+0000 7fc2a7881700 1 Processor -- start 2023-10-09T06:26:45.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.220+0000 7fc2a7881700 1 -- start start 2023-10-09T06:26:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.221+0000 7fc2a7881700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2a00b1610 0x7fc2a01469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.221+0000 7fc2a7881700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2a0159e10 0x7fc2a015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.221+0000 7fc2a7881700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a015a1e0 0x7fc2a015d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.221+0000 7fc2a7881700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0158860 con 0x7fc2a015a1e0 2023-10-09T06:26:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.221+0000 7fc2a7881700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00ce870 con 0x7fc2a00b1610 2023-10-09T06:26:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.221+0000 7fc2a7881700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00ceb50 con 0x7fc2a0159e10 2023-10-09T06:26:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.221+0000 7fc2a5e1e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a015a1e0 0x7fc2a015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.221+0000 7fc2a5e1e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a015a1e0 0x7fc2a015d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54002/0 (socket says 172.21.15.31:54002) 2023-10-09T06:26:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.221+0000 7fc2a561d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2a00b1610 0x7fc2a01469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.221+0000 7fc2a5e1e700 1 -- 172.21.15.31:0/2438359615 learned_addr learned my addr 172.21.15.31:0/2438359615 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.221+0000 7fc2a4e1c700 1 --2- 172.21.15.31:0/2438359615 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2a0159e10 0x7fc2a015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.222+0000 7fc2a5e1e700 1 -- 172.21.15.31:0/2438359615 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2a0159e10 msgr2=0x7fc2a015cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.222+0000 7fc2a5e1e700 1 --2- 172.21.15.31:0/2438359615 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2a0159e10 0x7fc2a015cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.222+0000 7fc2a5e1e700 1 -- 172.21.15.31:0/2438359615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2a00b1610 msgr2=0x7fc2a01469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.222+0000 7fc2a5e1e700 1 --2- 172.21.15.31:0/2438359615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2a00b1610 0x7fc2a01469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.222+0000 7fc2a5e1e700 1 -- 172.21.15.31:0/2438359615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc290009ae0 con 0x7fc2a015a1e0 2023-10-09T06:26:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.222+0000 7fc2a5e1e700 1 --2- 172.21.15.31:0/2438359615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a015a1e0 0x7fc2a015d120 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c5b0 tx=0x7fc298007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.222+0000 7fc29d7fa700 1 -- 172.21.15.31:0/2438359615 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298011590 con 0x7fc2a015a1e0 2023-10-09T06:26:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.222+0000 7fc29d7fa700 1 -- 172.21.15.31:0/2438359615 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc298011710 con 0x7fc2a015a1e0 2023-10-09T06:26:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.222+0000 7fc2a7881700 1 -- 172.21.15.31:0/2438359615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a00c6ec0 con 0x7fc2a015a1e0 2023-10-09T06:26:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.222+0000 7fc29d7fa700 1 -- 172.21.15.31:0/2438359615 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298011ad0 con 0x7fc2a015a1e0 2023-10-09T06:26:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.222+0000 7fc2a7881700 1 -- 172.21.15.31:0/2438359615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a00c7480 con 0x7fc2a015a1e0 2023-10-09T06:26:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.223+0000 7fc2a7881700 1 -- 172.21.15.31:0/2438359615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a00ced00 con 0x7fc2a015a1e0 2023-10-09T06:26:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.223+0000 7fc29d7fa700 1 -- 172.21.15.31:0/2438359615 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc29801c460 con 0x7fc2a015a1e0 2023-10-09T06:26:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.224+0000 7fc29d7fa700 1 --2- 172.21.15.31:0/2438359615 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc28c066f30 0x7fc28c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.224+0000 7fc29d7fa700 1 -- 172.21.15.31:0/2438359615 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc2980840d0 con 0x7fc2a015a1e0 2023-10-09T06:26:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.224+0000 7fc2a561d700 1 --2- 172.21.15.31:0/2438359615 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc28c066f30 0x7fc28c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.224+0000 7fc2a561d700 1 --2- 172.21.15.31:0/2438359615 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc28c066f30 0x7fc28c0693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc290009880 tx=0x7fc290017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:45.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.228+0000 7fc29d7fa700 1 -- 172.21.15.31:0/2438359615 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2a00ced00 con 0x7fc2a015a1e0 2023-10-09T06:26:45.460 INFO:tasks.ceph.mds.a.smithi031.stderr:2023-10-09T06:26:45.459+0000 7ff659a5f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:26:45.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.465+0000 7fc2a7881700 1 -- 172.21.15.31:0/2438359615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2a00cecc0 con 0x7fc2a015a1e0 2023-10-09T06:26:45.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.466+0000 7fc29d7fa700 1 -- 172.21.15.31:0/2438359615 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fc298051340 con 0x7fc2a015a1e0 2023-10-09T06:26:45.467 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:45.467 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/487353090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":487353090},{"type":"v1","addr":"172.21.15.158:6837","nonce":487353090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3396628353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3396628353},{"type":"v1","addr":"172.21.15.158:6836","nonce":3396628353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/1862816590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1862816590},{"type":"v1","addr":"172.21.15.31:6833","nonce":1862816590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:26:39.537650+0000","modified":"2023-10-09T06:26:43.150956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4187693404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4187693404},{"type":"v1","addr":"172.21.15.31:6835","nonce":4187693404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T06:26:45.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.468+0000 7fc2a7881700 1 -- 172.21.15.31:0/2438359615 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc28c066f30 msgr2=0x7fc28c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:45.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.468+0000 7fc2a7881700 1 --2- 172.21.15.31:0/2438359615 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc28c066f30 0x7fc28c0693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc290009880 tx=0x7fc290017000 comp rx=0 tx=0).stop 2023-10-09T06:26:45.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.468+0000 7fc2a7881700 1 -- 172.21.15.31:0/2438359615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a015a1e0 msgr2=0x7fc2a015d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:45.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.468+0000 7fc2a7881700 1 --2- 172.21.15.31:0/2438359615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a015a1e0 0x7fc2a015d120 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c5b0 tx=0x7fc298007f60 comp rx=0 tx=0).stop 2023-10-09T06:26:45.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.468+0000 7fc2a7881700 1 -- 172.21.15.31:0/2438359615 shutdown_connections 2023-10-09T06:26:45.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.468+0000 7fc2a7881700 1 --2- 172.21.15.31:0/2438359615 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc28c066f30 0x7fc28c0693e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:45.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.468+0000 7fc2a7881700 1 --2- 172.21.15.31:0/2438359615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a015a1e0 0x7fc2a015d120 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:45.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.468+0000 7fc2a7881700 1 --2- 172.21.15.31:0/2438359615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2a00b1610 0x7fc2a01469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:45.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.468+0000 7fc2a7881700 1 --2- 172.21.15.31:0/2438359615 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2a0159e10 0x7fc2a015cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:45.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.468+0000 7fc2a7881700 1 -- 172.21.15.31:0/2438359615 >> 172.21.15.31:0/2438359615 conn(0x7fc2a0067660 msgr2=0x7fc2a0159110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:45.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.468+0000 7fc2a7881700 1 -- 172.21.15.31:0/2438359615 shutdown_connections 2023-10-09T06:26:45.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:45.468+0000 7fc2a7881700 1 -- 172.21.15.31:0/2438359615 wait complete. 2023-10-09T06:26:45.470 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 58 2023-10-09T06:26:45.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:26:39.537650+0000', 'modified': '2023-10-09T06:26:43.150956+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6666}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6666': {'gid': 6666, 'name': 'a', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/4187693404', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 4187693404}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 4187693404}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:26:45.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:26:45.884 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T06:26:46.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.005+0000 7fd1ea8a3700 1 Processor -- start 2023-10-09T06:26:46.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.005+0000 7fd1ea8a3700 1 -- start start 2023-10-09T06:26:46.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.006+0000 7fd1ea8a3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd1e4157870 0x7fd1e415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.006+0000 7fd1ea8a3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1e4157c40 0x7fd1e4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.006+0000 7fd1ea8a3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e415cbb0 con 0x7fd1e415a620 2023-10-09T06:26:46.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.006+0000 7fd1ea8a3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e415bfa0 con 0x7fd1e4157c40 2023-10-09T06:26:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.006+0000 7fd1ea8a3700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e415c280 con 0x7fd1e4157870 2023-10-09T06:26:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.006+0000 7fd1e8e40700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1e4157c40 0x7fd1e4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.006+0000 7fd1e8e40700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1e4157c40 0x7fd1e4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54010/0 (socket says 172.21.15.31:54010) 2023-10-09T06:26:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.006+0000 7fd1e8e40700 1 -- 172.21.15.31:0/1208037213 learned_addr learned my addr 172.21.15.31:0/1208037213 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.006+0000 7fd1e3fff700 1 --2- 172.21.15.31:0/1208037213 >> v2:172.21.15.158:3300/0 conn(0x7fd1e4157870 0x7fd1e415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.006+0000 7fd1e8e40700 1 -- 172.21.15.31:0/1208037213 >> v2:172.21.15.158:3300/0 conn(0x7fd1e4157870 msgr2=0x7fd1e415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.006+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/1208037213 >> v2:172.21.15.158:3300/0 conn(0x7fd1e4157870 0x7fd1e415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.006+0000 7fd1e8e40700 1 -- 172.21.15.31:0/1208037213 >> v1:172.21.15.158:6789/0 conn(0x7fd1e415a620 legacy=0x7fd1e415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.006+0000 7fd1e8e40700 1 -- 172.21.15.31:0/1208037213 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e415c560 con 0x7fd1e4157c40 2023-10-09T06:26:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.007+0000 7fd1e3fff700 1 --2- 172.21.15.31:0/1208037213 >> v2:172.21.15.158:3300/0 conn(0x7fd1e4157870 0x7fd1e415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.007+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/1208037213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e4157c40 0x7fd1e4158110 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4069d80 tx=0x7fd1dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfed80c543aa299 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.007+0000 7fd1e2ffd700 1 -- 172.21.15.31:0/1208037213 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc00e070 con 0x7fd1e4157c40 2023-10-09T06:26:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.007+0000 7fd1e2ffd700 1 -- 172.21.15.31:0/1208037213 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc00ba10 con 0x7fd1e4157c40 2023-10-09T06:26:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.007+0000 7fd1e2ffd700 1 -- 172.21.15.31:0/1208037213 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc0092e0 con 0x7fd1e4157c40 2023-10-09T06:26:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.007+0000 7fd1ea8a3700 1 -- 172.21.15.31:0/1208037213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e4157c40 msgr2=0x7fd1e4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.007+0000 7fd1ea8a3700 1 --2- 172.21.15.31:0/1208037213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e4157c40 0x7fd1e4158110 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4069d80 tx=0x7fd1dc009840 comp rx=0 tx=0).stop 2023-10-09T06:26:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.007+0000 7fd1ea8a3700 1 -- 172.21.15.31:0/1208037213 shutdown_connections 2023-10-09T06:26:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.007+0000 7fd1ea8a3700 1 --2- 172.21.15.31:0/1208037213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e4157c40 0x7fd1e4158110 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.007+0000 7fd1ea8a3700 1 --2- 172.21.15.31:0/1208037213 >> v2:172.21.15.158:3300/0 conn(0x7fd1e4157870 0x7fd1e415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.007+0000 7fd1ea8a3700 1 -- 172.21.15.31:0/1208037213 >> 172.21.15.31:0/1208037213 conn(0x7fd1e4068ce0 msgr2=0x7fd1e40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:46.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.007+0000 7fd1ea8a3700 1 -- 172.21.15.31:0/1208037213 shutdown_connections 2023-10-09T06:26:46.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.007+0000 7fd1ea8a3700 1 -- 172.21.15.31:0/1208037213 wait complete. 2023-10-09T06:26:46.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.008+0000 7fd1ea8a3700 1 Processor -- start 2023-10-09T06:26:46.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.009+0000 7fd1ea8a3700 1 -- start start 2023-10-09T06:26:46.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.009+0000 7fd1ea8a3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1e4157870 0x7fd1e41428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.009+0000 7fd1ea8a3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e4157c40 0x7fd1e416abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.009+0000 7fd1ea8a3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1e415a620 0x7fd1e4152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.009+0000 7fd1ea8a3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e416b120 con 0x7fd1e4157c40 2023-10-09T06:26:46.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.009+0000 7fd1ea8a3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e4151220 con 0x7fd1e415a620 2023-10-09T06:26:46.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.009+0000 7fd1ea8a3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e41524b0 con 0x7fd1e4157870 2023-10-09T06:26:46.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.009+0000 7fd1e37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e4157c40 0x7fd1e416abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1e37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e4157c40 0x7fd1e416abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54018/0 (socket says 172.21.15.31:54018) 2023-10-09T06:26:46.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1e37fe700 1 -- 172.21.15.31:0/2236055191 learned_addr learned my addr 172.21.15.31:0/2236055191 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:46.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1e415a620 0x7fd1e4152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1e3fff700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1e4157870 0x7fd1e41428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1e37fe700 1 -- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1e4157870 msgr2=0x7fd1e41428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1e37fe700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1e4157870 0x7fd1e41428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1e37fe700 1 -- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1e415a620 msgr2=0x7fd1e4152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1e37fe700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1e415a620 0x7fd1e4152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1e37fe700 1 -- 172.21.15.31:0/2236055191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc009ae0 con 0x7fd1e4157c40 2023-10-09T06:26:46.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1e3fff700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1e4157870 0x7fd1e41428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:46.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1e37fe700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e4157c40 0x7fd1e416abe0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400b610 tx=0x7fd1d40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:46.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1dbfff700 1 -- 172.21.15.31:0/2236055191 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d400f510 con 0x7fd1e4157c40 2023-10-09T06:26:46.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1dbfff700 1 -- 172.21.15.31:0/2236055191 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d400f6b0 con 0x7fd1e4157c40 2023-10-09T06:26:46.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1ea8a3700 1 -- 172.21.15.31:0/2236055191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e4151410 con 0x7fd1e4157c40 2023-10-09T06:26:46.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1dbfff700 1 -- 172.21.15.31:0/2236055191 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d400fa70 con 0x7fd1e4157c40 2023-10-09T06:26:46.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.010+0000 7fd1ea8a3700 1 -- 172.21.15.31:0/2236055191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e41519d0 con 0x7fd1e4157c40 2023-10-09T06:26:46.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.012+0000 7fd1dbfff700 1 -- 172.21.15.31:0/2236055191 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1d401a400 con 0x7fd1e4157c40 2023-10-09T06:26:46.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.012+0000 7fd1dbfff700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1c4066f30 0x7fd1c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.012+0000 7fd1dbfff700 1 -- 172.21.15.31:0/2236055191 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1d4083f90 con 0x7fd1e4157c40 2023-10-09T06:26:46.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.012+0000 7fd1e3fff700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1c4066f30 0x7fd1c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.013+0000 7fd1e3fff700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1c4066f30 0x7fd1c40693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd1e40d1710 tx=0x7fd1cc006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:46.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.014+0000 7fd1f3b9bb80 1 Processor -- start 2023-10-09T06:26:46.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.014+0000 7fd1f3b9bb80 1 -- start start 2023-10-09T06:26:46.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1f3b9bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86446a50 0x563a86446e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1f3b9bb80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a86490d00 0x563a8646fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1f3b9bb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a8646ff60 0x563a86442cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1f3b9bb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a8639da70 con 0x563a8646ff60 2023-10-09T06:26:46.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1f3b9bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a8639b270 con 0x563a86446a50 2023-10-09T06:26:46.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1f3b9bb80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a86397060 con 0x563a86490d00 2023-10-09T06:26:46.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1e8e40700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a8646ff60 0x563a86442cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1e8e40700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a8646ff60 0x563a86442cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54028/0 (socket says 172.21.15.31:54028) 2023-10-09T06:26:46.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1e8e40700 1 -- 172.21.15.31:0/2146309646 learned_addr learned my addr 172.21.15.31:0/2146309646 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:46.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1e3fff700 1 --2- 172.21.15.31:0/2146309646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86446a50 0x563a86446e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1e37fe700 1 --2- 172.21.15.31:0/2146309646 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a86490d00 0x563a8646fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1e8e40700 1 -- 172.21.15.31:0/2146309646 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a86490d00 msgr2=0x563a8646fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:46.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/2146309646 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a86490d00 0x563a8646fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1e8e40700 1 -- 172.21.15.31:0/2146309646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86446a50 msgr2=0x563a86446e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:46.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/2146309646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86446a50 0x563a86446e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1e8e40700 1 -- 172.21.15.31:0/2146309646 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a86231270 con 0x563a8646ff60 2023-10-09T06:26:46.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.015+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/2146309646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a8646ff60 0x563a86442cf0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009fd0 tx=0x7fd1dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb4de888e29e6c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:46.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.016+0000 7fd1d97fa700 1 -- 172.21.15.31:0/2146309646 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc00bc00 con 0x563a8646ff60 2023-10-09T06:26:46.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.016+0000 7fd1d97fa700 1 -- 172.21.15.31:0/2146309646 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc00bd80 con 0x563a8646ff60 2023-10-09T06:26:46.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.016+0000 7fd1d97fa700 1 -- 172.21.15.31:0/2146309646 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc012640 con 0x563a8646ff60 2023-10-09T06:26:46.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.016+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/2146309646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a8646ff60 msgr2=0x563a86442cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.016+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/2146309646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a8646ff60 0x563a86442cf0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009fd0 tx=0x7fd1dc017000 comp rx=0 tx=0).stop 2023-10-09T06:26:46.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.016+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/2146309646 shutdown_connections 2023-10-09T06:26:46.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.016+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/2146309646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a8646ff60 0x563a86442cf0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.016+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/2146309646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86446a50 0x563a86446e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.016+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/2146309646 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a86490d00 0x563a8646fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.016+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/2146309646 >> 172.21.15.31:0/2146309646 conn(0x563a86448370 msgr2=0x563a86448740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:46.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.016+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/2146309646 shutdown_connections 2023-10-09T06:26:46.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.016+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/2146309646 wait complete. 2023-10-09T06:26:46.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.017+0000 7fd1f3b9bb80 1 -- start start 2023-10-09T06:26:46.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.017+0000 7fd1f3b9bb80 1 Processor -- start 2023-10-09T06:26:46.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1f3b9bb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86446a50 0x563a86490520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1f3b9bb80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a8646ff60 0x563a86489460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1f3b9bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86490d00 0x563a864a0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1f3b9bb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a86342890 con 0x563a86446a50 2023-10-09T06:26:46.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1f3b9bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a8635dea0 con 0x563a86490d00 2023-10-09T06:26:46.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1f3b9bb80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a86219e30 con 0x563a8646ff60 2023-10-09T06:26:46.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1f3b9bb80 10 client.0 _ll_register_callbacks cb 0x563a8640a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:26:46.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1e3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86446a50 0x563a86490520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1e3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86446a50 0x563a86490520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54038/0 (socket says 172.21.15.31:54038) 2023-10-09T06:26:46.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1e3fff700 1 -- 172.21.15.31:0/134230132 learned_addr learned my addr 172.21.15.31:0/134230132 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:46.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86490d00 0x563a864a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1e37fe700 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a8646ff60 0x563a86489460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1e3fff700 1 -- 172.21.15.31:0/134230132 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a8646ff60 msgr2=0x563a86489460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:46.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1e3fff700 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a8646ff60 0x563a86489460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1e3fff700 1 -- 172.21.15.31:0/134230132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86490d00 msgr2=0x563a864a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:46.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1e3fff700 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86490d00 0x563a864a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1e3fff700 1 -- 172.21.15.31:0/134230132 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e415c560 con 0x563a86446a50 2023-10-09T06:26:46.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86490d00 0x563a864a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:46.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1e3fff700 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86446a50 0x563a86490520 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0147e0 tx=0x7fd1cc018040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ad4e4e5d2c3e1c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:46.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.018+0000 7fd1c27fc700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:26:46.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1c27fc700 1 -- 172.21.15.31:0/134230132 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc015720 con 0x563a86446a50 2023-10-09T06:26:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1c27fc700 1 -- 172.21.15.31:0/134230132 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1cc015880 con 0x563a86446a50 2023-10-09T06:26:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/134230132 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a8643bb70 con 0x563a86446a50 2023-10-09T06:26:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1c27fc700 1 -- 172.21.15.31:0/134230132 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1cc015c50 con 0x563a86446a50 2023-10-09T06:26:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1f3b9bb80 10 client.6801 fetch_fsmap learned FSMap version 58 2023-10-09T06:26:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/134230132 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x563a861d3fe0 con 0x563a86446a50 2023-10-09T06:26:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1c27fc700 1 -- 172.21.15.31:0/134230132 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563a8643bb70 con 0x563a86446a50 2023-10-09T06:26:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1c27fc700 1 -- 172.21.15.31:0/134230132 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 58) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd1cc021420 con 0x563a86446a50 2023-10-09T06:26:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1f3b9bb80 10 client.6801 fetch_fsmap finished waiting for FSMap version 58 2023-10-09T06:26:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1f3b9bb80 10 client.6801 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T06:26:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1f3b9bb80 20 client.6801 populate_metadata read hostname 'smithi031' 2023-10-09T06:26:46.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.31:6834/4187693404,v1:172.21.15.31:6835/4187693404] conn(0x563a86486f40 0x563a86487310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1f3b9bb80 4 client.6801 mds_command: new command op to 6666 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:26:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/134230132 --> [v2:172.21.15.31:6834/4187693404,v1:172.21.15.31:6835/4187693404] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a86418aa0 con 0x563a86486f40 2023-10-09T06:26:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1e37fe700 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.31:6834/4187693404,v1:172.21.15.31:6835/4187693404] conn(0x563a86486f40 0x563a86487310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1e37fe700 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.31:6834/4187693404,v1:172.21.15.31:6835/4187693404] conn(0x563a86486f40 0x563a86487310 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e81d35740d332c server_cookie=dd30a08b52393e33 in_seq=0 out_seq=0 2023-10-09T06:26:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.019+0000 7fd1c27fc700 10 client.6801 ms_handle_connect on v2:172.21.15.31:6834/4187693404 2023-10-09T06:26:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1c27fc700 1 -- 172.21.15.31:0/134230132 <== mds.0 v2:172.21.15.31:6834/4187693404 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563a86418aa0 con 0x563a86486f40 2023-10-09T06:26:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1c27fc700 10 client.6801 handle_command_reply: tid=0 2023-10-09T06:26:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1f3b9bb80 1 client.6801 shutdown 2023-10-09T06:26:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/134230132 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86446a50 msgr2=0x563a86490520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86446a50 0x563a86490520 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0147e0 tx=0x7fd1cc018040 comp rx=0 tx=0).stop 2023-10-09T06:26:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/134230132 shutdown_connections 2023-10-09T06:26:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.31:6834/4187693404,v1:172.21.15.31:6835/4187693404] conn(0x563a86486f40 0x563a86487310 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86490d00 0x563a864a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1c27fc700 0 client.6801 ms_handle_reset on v2:172.21.15.31:6834/4187693404 2023-10-09T06:26:46.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86446a50 0x563a86490520 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/134230132 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a8646ff60 0x563a86489460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/134230132 >> 172.21.15.31:0/134230132 conn(0x563a86448370 msgr2=0x563a8648c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:46.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/134230132 shutdown_connections 2023-10-09T06:26:46.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/134230132 wait complete. 2023-10-09T06:26:46.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.020+0000 7fd1f3b9bb80 20 client.6801 trim_cache size 0 max 16384 2023-10-09T06:26:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.037+0000 7fd1f3b9bb80 1 Processor -- start 2023-10-09T06:26:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.037+0000 7fd1f3b9bb80 1 -- start start 2023-10-09T06:26:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1f3b9bb80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a86446a50 0x563a86490500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1f3b9bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a8646ff60 0x563a86449b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1f3b9bb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 0x563a8649f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1f3b9bb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a8643bb70 con 0x563a86490d00 2023-10-09T06:26:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1f3b9bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a8641f410 con 0x563a8646ff60 2023-10-09T06:26:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1f3b9bb80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a864902e0 con 0x563a86446a50 2023-10-09T06:26:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1e8e40700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 0x563a8649f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1e8e40700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 0x563a8649f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54044/0 (socket says 172.21.15.31:54044) 2023-10-09T06:26:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1e8e40700 1 -- 172.21.15.31:0/3314163457 learned_addr learned my addr 172.21.15.31:0/3314163457 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1e8e40700 1 -- 172.21.15.31:0/3314163457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a86446a50 msgr2=0x563a86490500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/3314163457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a86446a50 0x563a86490500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1e8e40700 1 -- 172.21.15.31:0/3314163457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a8646ff60 msgr2=0x563a86449b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/3314163457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a8646ff60 0x563a86449b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.038+0000 7fd1e8e40700 1 -- 172.21.15.31:0/3314163457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a86365780 con 0x563a86490d00 2023-10-09T06:26:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.039+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/3314163457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 0x563a8649f1a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc000f80 tx=0x7fd1dc020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c64ea64793ffab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.039+0000 7fd1d9ffb700 1 -- 172.21.15.31:0/3314163457 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc02c070 con 0x563a86490d00 2023-10-09T06:26:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.039+0000 7fd1d9ffb700 1 -- 172.21.15.31:0/3314163457 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc012430 con 0x563a86490d00 2023-10-09T06:26:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.039+0000 7fd1d9ffb700 1 -- 172.21.15.31:0/3314163457 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc012620 con 0x563a86490d00 2023-10-09T06:26:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.039+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/3314163457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 msgr2=0x563a8649f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.039+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/3314163457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 0x563a8649f1a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc000f80 tx=0x7fd1dc020070 comp rx=0 tx=0).stop 2023-10-09T06:26:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.039+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/3314163457 shutdown_connections 2023-10-09T06:26:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.039+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/3314163457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a86446a50 0x563a86490500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.039+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/3314163457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 0x563a8649f1a0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.039+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/3314163457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a8646ff60 0x563a86449b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.039+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/3314163457 >> 172.21.15.31:0/3314163457 conn(0x563a86448370 msgr2=0x563a86443a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.039+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/3314163457 shutdown_connections 2023-10-09T06:26:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.039+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/3314163457 wait complete. 2023-10-09T06:26:46.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.040+0000 7fd1f3b9bb80 1 -- start start 2023-10-09T06:26:46.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.040+0000 7fd1f3b9bb80 1 Processor -- start 2023-10-09T06:26:46.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1f3b9bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86446a50 0x563a864a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1f3b9bb80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a8646ff60 0x563a86488700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1f3b9bb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 0x563a86488c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1f3b9bb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a864a2040 con 0x563a86490d00 2023-10-09T06:26:46.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1f3b9bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a86442a00 con 0x563a86446a50 2023-10-09T06:26:46.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1f3b9bb80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a864f3030 con 0x563a8646ff60 2023-10-09T06:26:46.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1f3b9bb80 10 client.0 _ll_register_callbacks cb 0x563a8640a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:26:46.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1e8e40700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 0x563a86488c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1e8e40700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 0x563a86488c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54048/0 (socket says 172.21.15.31:54048) 2023-10-09T06:26:46.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1e8e40700 1 -- 172.21.15.31:0/1430710052 learned_addr learned my addr 172.21.15.31:0/1430710052 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:46.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1e3fff700 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86446a50 0x563a864a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1e37fe700 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a8646ff60 0x563a86488700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1e8e40700 1 -- 172.21.15.31:0/1430710052 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a8646ff60 msgr2=0x563a86488700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a8646ff60 0x563a86488700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1e8e40700 1 -- 172.21.15.31:0/1430710052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86446a50 msgr2=0x563a864a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86446a50 0x563a864a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1e8e40700 1 -- 172.21.15.31:0/1430710052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a86231270 con 0x563a86490d00 2023-10-09T06:26:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1e37fe700 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a8646ff60 0x563a86488700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1e8e40700 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 0x563a86488c40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00d010 tx=0x7fd1dc014050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ecbf80aa70cee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1c27fc700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:26:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1c27fc700 1 -- 172.21.15.31:0/1430710052 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc02c040 con 0x563a86490d00 2023-10-09T06:26:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1c27fc700 1 -- 172.21.15.31:0/1430710052 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1dc03bab0 con 0x563a86490d00 2023-10-09T06:26:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.041+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/1430710052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1dc00bd80 con 0x563a86490d00 2023-10-09T06:26:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1c27fc700 1 -- 172.21.15.31:0/1430710052 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1dc03bea0 con 0x563a86490d00 2023-10-09T06:26:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1f3b9bb80 10 client.6807 fetch_fsmap learned FSMap version 58 2023-10-09T06:26:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/1430710052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x563a8634c470 con 0x563a86490d00 2023-10-09T06:26:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1c27fc700 1 -- 172.21.15.31:0/1430710052 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc00bd80 con 0x563a86490d00 2023-10-09T06:26:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1c27fc700 1 -- 172.21.15.31:0/1430710052 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 58) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd1dc027630 con 0x563a86490d00 2023-10-09T06:26:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1f3b9bb80 10 client.6807 fetch_fsmap finished waiting for FSMap version 58 2023-10-09T06:26:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1f3b9bb80 10 client.6807 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T06:26:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1f3b9bb80 20 client.6807 populate_metadata read hostname 'smithi031' 2023-10-09T06:26:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.31:6834/4187693404,v1:172.21.15.31:6835/4187693404] conn(0x563a86483560 0x563a86483930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1f3b9bb80 4 client.6807 mds_command: new command op to 6666 tid=0[{"prefix": "status"}] 2023-10-09T06:26:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/1430710052 --> [v2:172.21.15.31:6834/4187693404,v1:172.21.15.31:6835/4187693404] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563a86339e00 con 0x563a86483560 2023-10-09T06:26:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1e3fff700 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.31:6834/4187693404,v1:172.21.15.31:6835/4187693404] conn(0x563a86483560 0x563a86483930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1c27fc700 10 client.6807 ms_handle_connect on v2:172.21.15.31:6834/4187693404 2023-10-09T06:26:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.042+0000 7fd1e3fff700 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.31:6834/4187693404,v1:172.21.15.31:6835/4187693404] conn(0x563a86483560 0x563a86483930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d66b3308d61dc808 server_cookie=88868f1bd222c808 in_seq=0 out_seq=0 2023-10-09T06:26:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1c27fc700 1 -- 172.21.15.31:0/1430710052 <== mds.0 v2:172.21.15.31:6834/4187693404 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x563a86339e00 con 0x563a86483560 2023-10-09T06:26:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1c27fc700 10 client.6807 handle_command_reply: tid=0 2023-10-09T06:26:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1f3b9bb80 1 client.6807 shutdown 2023-10-09T06:26:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/1430710052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 msgr2=0x563a86488c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 0x563a86488c40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00d010 tx=0x7fd1dc014050 comp rx=0 tx=0).stop 2023-10-09T06:26:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/1430710052 shutdown_connections 2023-10-09T06:26:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.31:6834/4187693404,v1:172.21.15.31:6835/4187693404] conn(0x563a86483560 0x563a86483930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563a86490d00 0x563a86488c40 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1c27fc700 0 client.6807 ms_handle_reset on v2:172.21.15.31:6834/4187693404 2023-10-09T06:26:46.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563a86446a50 0x563a864a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1f3b9bb80 1 --2- 172.21.15.31:0/1430710052 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x563a8646ff60 0x563a86488700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/1430710052 >> 172.21.15.31:0/1430710052 conn(0x563a86448370 msgr2=0x563a86443a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:46.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/1430710052 shutdown_connections 2023-10-09T06:26:46.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1f3b9bb80 1 -- 172.21.15.31:0/1430710052 wait complete. 2023-10-09T06:26:46.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1f3b9bb80 20 client.6807 trim_cache size 0 max 16384 2023-10-09T06:26:46.051 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:26:46.051 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:26:46.052 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-10-09T06:26:46.052 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 6666, 2023-10-09T06:26:46.052 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-10-09T06:26:46.052 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-10-09T06:26:46.052 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-10-09T06:26:46.052 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 5.9092630210000001, 2023-10-09T06:26:46.052 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 58, 2023-10-09T06:26:46.052 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 121, 2023-10-09T06:26:46.052 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 121, 2023-10-09T06:26:46.052 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 10.984839470000001 2023-10-09T06:26:46.052 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:26:46.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1ea8a3700 1 -- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1c4066f30 msgr2=0x7fd1c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1ea8a3700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1c4066f30 0x7fd1c40693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd1e40d1710 tx=0x7fd1cc006f90 comp rx=0 tx=0).stop 2023-10-09T06:26:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1ea8a3700 1 -- 172.21.15.31:0/2236055191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e4157c40 msgr2=0x7fd1e416abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1ea8a3700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e4157c40 0x7fd1e416abe0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400b610 tx=0x7fd1d40090f0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1ea8a3700 1 -- 172.21.15.31:0/2236055191 shutdown_connections 2023-10-09T06:26:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1ea8a3700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1c4066f30 0x7fd1c40693e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1ea8a3700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1e4157870 0x7fd1e41428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1ea8a3700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1e415a620 0x7fd1e4152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1ea8a3700 1 --2- 172.21.15.31:0/2236055191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e4157c40 0x7fd1e416abe0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1ea8a3700 1 -- 172.21.15.31:0/2236055191 >> 172.21.15.31:0/2236055191 conn(0x7fd1e4068ce0 msgr2=0x7fd1e40b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.043+0000 7fd1ea8a3700 1 -- 172.21.15.31:0/2236055191 shutdown_connections 2023-10-09T06:26:46.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.044+0000 7fd1ea8a3700 1 -- 172.21.15.31:0/2236055191 wait complete. 2023-10-09T06:26:46.056 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:26:46.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.175+0000 7f6119234700 1 Processor -- start 2023-10-09T06:26:46.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.175+0000 7f6119234700 1 -- start start 2023-10-09T06:26:46.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.176+0000 7f6119234700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114070d20 0x7f61140cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.176+0000 7f6119234700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61140677f0 con 0x7f6114143700 2023-10-09T06:26:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.176+0000 7f6119234700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6114067ad0 con 0x7f6114070950 2023-10-09T06:26:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.176+0000 7f6119234700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6114067db0 con 0x7f6114070d20 2023-10-09T06:26:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.176+0000 7f611259c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6114143700 0x7f61140cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43742/0 (socket says 172.21.15.31:43742) 2023-10-09T06:26:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.176+0000 7f611259c700 1 -- 172.21.15.31:0/3695505722 learned_addr learned my addr 172.21.15.31:0/3695505722 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f611359e700 1 --2- 172.21.15.31:0/3695505722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114070d20 0x7f61140cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319031977 0 0) 0x7f61140677f0 con 0x7f6114143700 2023-10-09T06:26:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6100003570 con 0x7f6114143700 2023-10-09T06:26:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564806566 0 0) 0x7f6114067ad0 con 0x7f6114070950 2023-10-09T06:26:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61140677f0 con 0x7f6114070950 2023-10-09T06:26:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3413624375 0 0) 0x7f6100003570 con 0x7f6114143700 2023-10-09T06:26:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114070d20 msgr2=0x7f61140cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:46.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 --2- 172.21.15.31:0/3695505722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114070d20 0x7f61140cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 >> v1:172.21.15.158:6789/0 conn(0x7f6114070950 legacy=0x7f6114142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6114068090 con 0x7f6114143700 2023-10-09T06:26:46.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f60fc001470 con 0x7f6114143700 2023-10-09T06:26:46.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 >> v1:172.21.15.31:6789/0 conn(0x7f6114143700 legacy=0x7f61140cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 --2- 172.21.15.31:0/3695505722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114070d20 0x7f6100003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 --2- 172.21.15.31:0/3695505722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61000041d0 0x7f6100004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 --2- 172.21.15.31:0/3695505722 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6100004d50 0x7f61000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114067db0 con 0x7f61000041d0 2023-10-09T06:26:46.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610000bbf0 con 0x7f6100004d50 2023-10-09T06:26:46.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610000bdb0 con 0x7f6114070d20 2023-10-09T06:26:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f611259c700 1 --2- 172.21.15.31:0/3695505722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61000041d0 0x7f6100004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f611359e700 1 --2- 172.21.15.31:0/3695505722 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6100004d50 0x7f61000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f6112d9d700 1 --2- 172.21.15.31:0/3695505722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114070d20 0x7f6100003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f611259c700 1 -- 172.21.15.31:0/3695505722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114070d20 msgr2=0x7f6100003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.177+0000 7f611259c700 1 --2- 172.21.15.31:0/3695505722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114070d20 0x7f6100003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f611259c700 1 -- 172.21.15.31:0/3695505722 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6100004d50 msgr2=0x7f61000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f611259c700 1 --2- 172.21.15.31:0/3695505722 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6100004d50 0x7f61000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f611259c700 1 -- 172.21.15.31:0/3695505722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6100003570 con 0x7f61000041d0 2023-10-09T06:26:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f6112d9d700 1 --2- 172.21.15.31:0/3695505722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114070d20 0x7f6100003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f611259c700 1 --2- 172.21.15.31:0/3695505722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61000041d0 0x7f6100004810 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00c1e0 tx=0x7f61140cd750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff213e1bc26d829 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc00cb10 con 0x7f61000041d0 2023-10-09T06:26:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc00cc90 con 0x7f61000041d0 2023-10-09T06:26:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f6111d9b700 1 -- 172.21.15.31:0/3695505722 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc005b70 con 0x7f61000041d0 2023-10-09T06:26:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f6119234700 1 -- 172.21.15.31:0/3695505722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61000041d0 msgr2=0x7f6100004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f6119234700 1 --2- 172.21.15.31:0/3695505722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61000041d0 0x7f6100004810 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00c1e0 tx=0x7f61140cd750 comp rx=0 tx=0).stop 2023-10-09T06:26:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f611359e700 1 -- 172.21.15.31:0/3695505722 reap_dead start 2023-10-09T06:26:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f6119234700 1 -- 172.21.15.31:0/3695505722 shutdown_connections 2023-10-09T06:26:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f6119234700 1 -- 172.21.15.31:0/3695505722 >> 172.21.15.31:0/3695505722 conn(0x7f611406ad20 msgr2=0x7f61140cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f6119234700 1 -- 172.21.15.31:0/3695505722 shutdown_connections 2023-10-09T06:26:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.178+0000 7f6119234700 1 -- 172.21.15.31:0/3695505722 wait complete. 2023-10-09T06:26:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.180+0000 7f6119234700 1 Processor -- start 2023-10-09T06:26:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.180+0000 7f6119234700 1 -- start start 2023-10-09T06:26:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.180+0000 7f6119234700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61000041d0 0x7f6114138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.180+0000 7f6119234700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114156d80 0x7f61141571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.180+0000 7f6119234700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6114141100 0x7f6114141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.180+0000 7f6119234700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114156bf0 con 0x7f61000041d0 2023-10-09T06:26:46.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.180+0000 7f6119234700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114157730 con 0x7f6114141100 2023-10-09T06:26:46.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.180+0000 7f6119234700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61140b3a80 con 0x7f6114156d80 2023-10-09T06:26:46.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.180+0000 7f6112d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61000041d0 0x7f6114138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.180+0000 7f6112d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61000041d0 0x7f6114138ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54070/0 (socket says 172.21.15.31:54070) 2023-10-09T06:26:46.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.180+0000 7f6112d9d700 1 -- 172.21.15.31:0/2602249728 learned_addr learned my addr 172.21.15.31:0/2602249728 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:46.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.181+0000 7f611359e700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6114141100 0x7f6114141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.181+0000 7f611259c700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114156d80 0x7f61141571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.181+0000 7f6112d9d700 1 -- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114156d80 msgr2=0x7f61141571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.181+0000 7f6112d9d700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114156d80 0x7f61141571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.181+0000 7f6112d9d700 1 -- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6114141100 msgr2=0x7f6114141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.181+0000 7f6112d9d700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6114141100 0x7f6114141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.181+0000 7f6112d9d700 1 -- 172.21.15.31:0/2602249728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6114142940 con 0x7f61000041d0 2023-10-09T06:26:46.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.181+0000 7f6112d9d700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61000041d0 0x7f6114138ff0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f610c00e8c0 tx=0x7f610c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:46.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.181+0000 7f610affd700 1 -- 172.21.15.31:0/2602249728 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c006820 con 0x7f61000041d0 2023-10-09T06:26:46.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.181+0000 7f610affd700 1 -- 172.21.15.31:0/2602249728 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610c006980 con 0x7f61000041d0 2023-10-09T06:26:46.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.181+0000 7f6119234700 1 -- 172.21.15.31:0/2602249728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6114141ab0 con 0x7f61000041d0 2023-10-09T06:26:46.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.181+0000 7f610affd700 1 -- 172.21.15.31:0/2602249728 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c006d20 con 0x7f61000041d0 2023-10-09T06:26:46.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.181+0000 7f6119234700 1 -- 172.21.15.31:0/2602249728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6114142010 con 0x7f61000041d0 2023-10-09T06:26:46.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.182+0000 7f6119234700 1 -- 172.21.15.31:0/2602249728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611404c3c0 con 0x7f61000041d0 2023-10-09T06:26:46.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.182+0000 7f610affd700 1 -- 172.21.15.31:0/2602249728 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f610c007230 con 0x7f61000041d0 2023-10-09T06:26:46.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.183+0000 7f610affd700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f60f4066f30 0x7f60f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:46.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.183+0000 7f610affd700 1 -- 172.21.15.31:0/2602249728 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f610c084640 con 0x7f61000041d0 2023-10-09T06:26:46.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.183+0000 7f611259c700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f60f4066f30 0x7f60f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:46.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.184+0000 7f611259c700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f60f4066f30 0x7f60f40693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00c1e0 tx=0x7f60fc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:46.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.187+0000 7f610affd700 1 -- 172.21.15.31:0/2602249728 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f610c0518b0 con 0x7f61000041d0 2023-10-09T06:26:46.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.425+0000 7f6119234700 1 -- 172.21.15.31:0/2602249728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6114068370 con 0x7f61000041d0 2023-10-09T06:26:46.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.425+0000 7f610affd700 1 -- 172.21.15.31:0/2602249728 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7f610c054ed0 con 0x7f61000041d0 2023-10-09T06:26:46.426 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:26:46.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.427+0000 7f6119234700 1 -- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f60f4066f30 msgr2=0x7f60f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.427+0000 7f6119234700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f60f4066f30 0x7f60f40693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00c1e0 tx=0x7f60fc015000 comp rx=0 tx=0).stop 2023-10-09T06:26:46.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.427+0000 7f6119234700 1 -- 172.21.15.31:0/2602249728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61000041d0 msgr2=0x7f6114138ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:46.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.427+0000 7f6119234700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61000041d0 0x7f6114138ff0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f610c00e8c0 tx=0x7f610c009040 comp rx=0 tx=0).stop 2023-10-09T06:26:46.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.427+0000 7f6119234700 1 -- 172.21.15.31:0/2602249728 shutdown_connections 2023-10-09T06:26:46.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.427+0000 7f6119234700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f60f4066f30 0x7f60f40693e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.427+0000 7f6119234700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6114141100 0x7f6114141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.427+0000 7f6119234700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61000041d0 0x7f6114138ff0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.427+0000 7f6119234700 1 --2- 172.21.15.31:0/2602249728 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6114156d80 0x7f61141571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:46.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.427+0000 7f6119234700 1 -- 172.21.15.31:0/2602249728 >> 172.21.15.31:0/2602249728 conn(0x7f611406ad20 msgr2=0x7f61141585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:46.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.427+0000 7f6119234700 1 -- 172.21.15.31:0/2602249728 shutdown_connections 2023-10-09T06:26:46.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:46.427+0000 7f6119234700 1 -- 172.21.15.31:0/2602249728 wait complete. 2023-10-09T06:26:46.440 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:26:46.440 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:26:46.440 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-10-09T06:26:46.440 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:26:46.440 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:26:46.440 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:26:46.441 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:26:46.441 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:26:46.441 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:26:46.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:46.441 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-10-09T06:26:46.457 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:26:46.457 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:26:46.457 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:26:46.457 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:46.457 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:26:46.457 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:46.457 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:26:46.457 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:46.458 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-10-09T06:26:46.458 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:26:46.458 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:46.458 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-10-09T06:26:46.458 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:26:46.458 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:46.458 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-10-09T06:26:46.458 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T06:26:46.458 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42160sec preferred_lft 42160sec 2023-10-09T06:26:46.458 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-10-09T06:26:46.459 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:46.459 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:26:46.459 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:46.459 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-10-09T06:26:46.459 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:26:46.459 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:46.459 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:26:46.459 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:46.459 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::b4ad:53ff:fed3:a589/64 scope link 2023-10-09T06:26:46.459 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:46.459 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:26:46.460 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether f6:bf:b8:0f:49:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:26:46.460 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::f4bf:b8ff:fe0f:498b/64 scope link 2023-10-09T06:26:46.460 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:46.460 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:26:46.460 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:26:46.460 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::d8ab:b5ff:fe1d:e066/64 scope link 2023-10-09T06:26:46.460 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:46.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:46.461 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:26:46.521 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-10-09T06:26:46.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:46.523 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-10-09T06:26:46.578 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-10-09T06:26:46.579 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:26:46.579 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T06:26:46.579 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T06:26:46.579 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:26:46.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:46.580 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:26:46.580 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:26:46.580 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T06:26:46.580 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T06:26:46.580 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T06:26:46.580 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:26:46.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:46.681 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:26:46.695 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:26:46.695 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:26:46.696 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:26:46.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:46.696 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-10-09T06:26:46.761 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:26:46.761 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:26:46.816 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:26:46.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:26:46.817 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:26:46.871 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:26:46.871 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:26:46.871 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:46.952 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:46.952 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:26:46.971 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:46.971 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:26:46.972 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:26:46.972 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:26:46.972 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:26:46.972 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:26:46.972 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:26:46.972 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:26:46.993 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:46.993 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:26:46.993 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:26:46.993 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:26:46.993 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:26:46.993 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:26:46.993 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:26:46.994 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:26:46.994 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:26:46.994 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:26:46.994 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:26:46.995 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:26:46.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:46.996 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:26:47.061 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:26:47.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.222+0000 7f288895a700 1 Processor -- start 2023-10-09T06:26:47.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.222+0000 7f288895a700 1 -- start start 2023-10-09T06:26:47.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f288895a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2884159e10 0x7f28840b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:47.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f288895a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28840cde50 0x7f28840b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:47.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f288895a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288415db80 con 0x7f288415a1e0 2023-10-09T06:26:47.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f288895a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288415e800 con 0x7f28840cde50 2023-10-09T06:26:47.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f288895a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288415de60 con 0x7f2884159e10 2023-10-09T06:26:47.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f2882d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28840cde50 0x7f28840b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:47.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f2882d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28840cde50 0x7f28840b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54074/0 (socket says 172.21.15.31:54074) 2023-10-09T06:26:47.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f2882d9d700 1 -- 172.21.15.31:0/573897104 learned_addr learned my addr 172.21.15.31:0/573897104 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:47.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f288259c700 1 --2- 172.21.15.31:0/573897104 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2884159e10 0x7f28840b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:47.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f2882d9d700 1 -- 172.21.15.31:0/573897104 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2884159e10 msgr2=0x7f28840b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:47.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f2882d9d700 1 --2- 172.21.15.31:0/573897104 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2884159e10 0x7f28840b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:47.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f2882d9d700 1 -- 172.21.15.31:0/573897104 >> v1:172.21.15.158:6789/0 conn(0x7f288415a1e0 legacy=0x7f28840cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:47.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f288159a700 1 -- 172.21.15.31:0/573897104 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485882076 0 0) 0x7f288415db80 con 0x7f288415a1e0 2023-10-09T06:26:47.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f2882d9d700 1 -- 172.21.15.31:0/573897104 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288415e140 con 0x7f28840cde50 2023-10-09T06:26:47.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f2882d9d700 1 --2- 172.21.15.31:0/573897104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28840cde50 0x7f28840b3260 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f28740099b0 tx=0x7f2874009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac5f54dc9c09222 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:47.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f288159a700 1 -- 172.21.15.31:0/573897104 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874009ea0 con 0x7f28840cde50 2023-10-09T06:26:47.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f288159a700 1 -- 172.21.15.31:0/573897104 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287400b860 con 0x7f28840cde50 2023-10-09T06:26:47.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.223+0000 7f288159a700 1 -- 172.21.15.31:0/573897104 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400bc00 con 0x7f28840cde50 2023-10-09T06:26:47.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.224+0000 7f288895a700 1 -- 172.21.15.31:0/573897104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28840cde50 msgr2=0x7f28840b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:47.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.224+0000 7f288895a700 1 --2- 172.21.15.31:0/573897104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28840cde50 0x7f28840b3260 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f28740099b0 tx=0x7f2874009250 comp rx=0 tx=0).stop 2023-10-09T06:26:47.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.224+0000 7f288895a700 1 -- 172.21.15.31:0/573897104 shutdown_connections 2023-10-09T06:26:47.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.224+0000 7f288895a700 1 --2- 172.21.15.31:0/573897104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28840cde50 0x7f28840b3260 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:47.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.224+0000 7f288895a700 1 --2- 172.21.15.31:0/573897104 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2884159e10 0x7f28840b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:47.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.224+0000 7f288895a700 1 -- 172.21.15.31:0/573897104 >> 172.21.15.31:0/573897104 conn(0x7f2884067660 msgr2=0x7f2884067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:47.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.224+0000 7f288895a700 1 -- 172.21.15.31:0/573897104 shutdown_connections 2023-10-09T06:26:47.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.224+0000 7f288895a700 1 -- 172.21.15.31:0/573897104 wait complete. 2023-10-09T06:26:47.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.225+0000 7f288895a700 1 Processor -- start 2023-10-09T06:26:47.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.225+0000 7f288895a700 1 -- start start 2023-10-09T06:26:47.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288895a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28840cde50 0x7f288415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:47.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288895a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2884159e10 0x7f288415c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:47.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288895a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f288415a1e0 0x7f2884169d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288895a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840c9ab0 con 0x7f28840cde50 2023-10-09T06:26:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288895a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840c94d0 con 0x7f288415a1e0 2023-10-09T06:26:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288895a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28841597a0 con 0x7f2884159e10 2023-10-09T06:26:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28840cde50 0x7f288415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28840cde50 0x7f288415bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54088/0 (socket says 172.21.15.31:54088) 2023-10-09T06:26:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288259c700 1 -- 172.21.15.31:0/3427903554 learned_addr learned my addr 172.21.15.31:0/3427903554 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f2882d9d700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f288415a1e0 0x7f2884169d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f2881d9b700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2884159e10 0x7f288415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288259c700 1 -- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2884159e10 msgr2=0x7f288415c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288259c700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2884159e10 0x7f288415c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288259c700 1 -- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f288415a1e0 msgr2=0x7f2884169d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:47.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288259c700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f288415a1e0 0x7f2884169d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.226+0000 7f288259c700 1 -- 172.21.15.31:0/3427903554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28740094f0 con 0x7f28840cde50 2023-10-09T06:26:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.227+0000 7f288259c700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28840cde50 0x7f288415bed0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f287c009f20 tx=0x7f287c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.227+0000 7f287a7fc700 1 -- 172.21.15.31:0/3427903554 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00cb70 con 0x7f28840cde50 2023-10-09T06:26:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.227+0000 7f287a7fc700 1 -- 172.21.15.31:0/3427903554 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c00f040 con 0x7f28840cde50 2023-10-09T06:26:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.227+0000 7f288895a700 1 -- 172.21.15.31:0/3427903554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288415cd90 con 0x7f28840cde50 2023-10-09T06:26:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.227+0000 7f287a7fc700 1 -- 172.21.15.31:0/3427903554 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c014480 con 0x7f28840cde50 2023-10-09T06:26:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.227+0000 7f288895a700 1 -- 172.21.15.31:0/3427903554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288415d070 con 0x7f28840cde50 2023-10-09T06:26:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.228+0000 7f288895a700 1 -- 172.21.15.31:0/3427903554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28840c9d90 con 0x7f28840cde50 2023-10-09T06:26:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.228+0000 7f287a7fc700 1 -- 172.21.15.31:0/3427903554 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f287c0147f0 con 0x7f28840cde50 2023-10-09T06:26:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.229+0000 7f287a7fc700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2864066f30 0x7f28640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:47.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.229+0000 7f287a7fc700 1 -- 172.21.15.31:0/3427903554 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f287c084e60 con 0x7f28840cde50 2023-10-09T06:26:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.229+0000 7f2881d9b700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2864066f30 0x7f28640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:47.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.229+0000 7f2881d9b700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2864066f30 0x7f28640693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2884167960 tx=0x7f286c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:47.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.233+0000 7f287a7fc700 1 -- 172.21.15.31:0/3427903554 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f287c0520d0 con 0x7f28840cde50 2023-10-09T06:26:47.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.473+0000 7f288895a700 1 -- 172.21.15.31:0/3427903554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f288404c3c0 con 0x7f28840cde50 2023-10-09T06:26:47.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.474+0000 7f287a7fc700 1 -- 172.21.15.31:0/3427903554 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7f287c0556f0 con 0x7f28840cde50 2023-10-09T06:26:47.475 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:26:47.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.476+0000 7f288895a700 1 -- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2864066f30 msgr2=0x7f28640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:47.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.476+0000 7f288895a700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2864066f30 0x7f28640693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2884167960 tx=0x7f286c009040 comp rx=0 tx=0).stop 2023-10-09T06:26:47.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.476+0000 7f288895a700 1 -- 172.21.15.31:0/3427903554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28840cde50 msgr2=0x7f288415bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:47.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.476+0000 7f288895a700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28840cde50 0x7f288415bed0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f287c009f20 tx=0x7f287c00b040 comp rx=0 tx=0).stop 2023-10-09T06:26:47.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.476+0000 7f288895a700 1 -- 172.21.15.31:0/3427903554 shutdown_connections 2023-10-09T06:26:47.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.476+0000 7f288895a700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2864066f30 0x7f28640693e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:47.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.476+0000 7f288895a700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f288415a1e0 0x7f2884169d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:47.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.476+0000 7f288895a700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28840cde50 0x7f288415bed0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:47.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.476+0000 7f288895a700 1 --2- 172.21.15.31:0/3427903554 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2884159e10 0x7f288415c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:47.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.476+0000 7f288895a700 1 -- 172.21.15.31:0/3427903554 >> 172.21.15.31:0/3427903554 conn(0x7f2884067660 msgr2=0x7f28840b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:47.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.476+0000 7f288895a700 1 -- 172.21.15.31:0/3427903554 shutdown_connections 2023-10-09T06:26:47.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:47.476+0000 7f288895a700 1 -- 172.21.15.31:0/3427903554 wait complete. 2023-10-09T06:26:47.489 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:26:47.489 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:26:47.489 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-09T06:26:47.489 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T06:26:47.489 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T06:26:47.490 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:26:47.490 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:26:47.490 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:26:47.490 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:26:47.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:47.491 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-09T06:26:47.508 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:26:47.508 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:26:47.508 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:26:47.508 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:47.508 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:26:47.509 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:47.509 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:26:47.509 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:47.509 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-09T06:26:47.509 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:26:47.509 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:47.510 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-09T06:26:47.510 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:26:47.510 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:47.510 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:26:47.510 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:47.511 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:26:47.511 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42186sec preferred_lft 42186sec 2023-10-09T06:26:47.511 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-09T06:26:47.511 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:47.511 INFO:teuthology.orchestra.run.smithi158.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:26:47.511 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:26:47.512 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:26:47.512 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:47.512 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::c5:35ff:fec9:1844/64 scope link 2023-10-09T06:26:47.512 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:47.512 INFO:teuthology.orchestra.run.smithi158.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:26:47.512 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether e6:10:14:7c:a4:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:26:47.513 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::e410:14ff:fe7c:a4d7/64 scope link 2023-10-09T06:26:47.513 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:47.513 INFO:teuthology.orchestra.run.smithi158.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:26:47.513 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T06:26:47.513 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::44a9:f1ff:fe2b:babb/64 scope link 2023-10-09T06:26:47.514 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:26:47.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:47.514 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:26:47.572 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-09T06:26:47.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:47.574 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-09T06:26:47.631 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-09T06:26:47.631 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:26:47.632 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:26:47.632 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:26:47.632 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:26:47.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:47.632 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:26:47.632 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:26:47.632 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:26:47.632 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:26:47.632 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:26:47.633 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:26:47.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:47.735 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:26:47.749 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T06:26:47.749 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T06:26:47.749 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:26:47.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:47.750 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-09T06:26:47.813 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:26:47.813 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T06:26:47.868 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:26:47.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:26:47.869 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:26:47.923 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T06:26:47.924 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:26:47.924 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:48.003 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:48.004 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:26:48.022 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:48.022 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:26:48.022 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:26:48.022 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:26:48.023 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:26:48.023 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:26:48.023 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:26:48.023 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:26:48.044 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:26:48.044 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:26:48.044 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:26:48.044 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:26:48.044 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:26:48.044 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:26:48.045 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:26:48.045 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:26:48.045 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:26:48.045 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:26:48.045 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:26:48.046 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:26:48.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:48.046 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:26:48.111 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:48.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.234+0000 7f9521afe700 1 Processor -- start 2023-10-09T06:26:48.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.234+0000 7f9521afe700 1 -- start start 2023-10-09T06:26:48.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f9521afe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f951c06adb0 0x7f951c164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f9521afe700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f951c0b3d40 con 0x7f951c0cffa0 2023-10-09T06:26:48.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f9521afe700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f951c0b4300 con 0x7f951c159e60 2023-10-09T06:26:48.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f9521afe700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c069d70 con 0x7f951c06adb0 2023-10-09T06:26:48.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951affd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f951c0cffa0 0x7f951c06a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43754/0 (socket says 172.21.15.31:43754) 2023-10-09T06:26:48.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951affd700 1 -- 172.21.15.31:0/2758297722 learned_addr learned my addr 172.21.15.31:0/2758297722 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:48.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951bfff700 1 --2- 172.21.15.31:0/2758297722 >> v2:172.21.15.158:3300/0 conn(0x7f951c06adb0 0x7f951c164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486207609 0 0) 0x7f951c0b3d40 con 0x7f951c0cffa0 2023-10-09T06:26:48.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9508003570 con 0x7f951c0cffa0 2023-10-09T06:26:48.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285536087 0 0) 0x7f951c0b4300 con 0x7f951c159e60 2023-10-09T06:26:48.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f951c0b3d40 con 0x7f951c159e60 2023-10-09T06:26:48.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3514821126 0 0) 0x7f9508003570 con 0x7f951c0cffa0 2023-10-09T06:26:48.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 >> v2:172.21.15.158:3300/0 conn(0x7f951c06adb0 msgr2=0x7f951c164ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:48.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 --2- 172.21.15.31:0/2758297722 >> v2:172.21.15.158:3300/0 conn(0x7f951c06adb0 0x7f951c164ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 >> v1:172.21.15.158:6789/0 conn(0x7f951c159e60 legacy=0x7f951c0b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:48.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c0d0480 con 0x7f951c0cffa0 2023-10-09T06:26:48.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f9504001470 con 0x7f951c0cffa0 2023-10-09T06:26:48.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 >> v1:172.21.15.31:6789/0 conn(0x7f951c0cffa0 legacy=0x7f951c06a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:48.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 --2- 172.21.15.31:0/2758297722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9508003bf0 0x7f9508003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 --2- 172.21.15.31:0/2758297722 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9508004810 0x7f9508004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.235+0000 7f951a7fc700 1 --2- 172.21.15.31:0/2758297722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95080051c0 0x7f950800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c069d70 con 0x7f95080051c0 2023-10-09T06:26:48.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950800c0b0 con 0x7f9508004810 2023-10-09T06:26:48.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950800c270 con 0x7f9508003bf0 2023-10-09T06:26:48.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951bfff700 1 --2- 172.21.15.31:0/2758297722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95080051c0 0x7f950800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951b7fe700 1 --2- 172.21.15.31:0/2758297722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9508003bf0 0x7f9508003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951affd700 1 --2- 172.21.15.31:0/2758297722 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9508004810 0x7f9508004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951bfff700 1 -- 172.21.15.31:0/2758297722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9508003bf0 msgr2=0x7f9508003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:48.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951bfff700 1 --2- 172.21.15.31:0/2758297722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9508003bf0 0x7f9508003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951bfff700 1 -- 172.21.15.31:0/2758297722 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9508004810 msgr2=0x7f9508004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:48.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951bfff700 1 --2- 172.21.15.31:0/2758297722 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9508004810 0x7f9508004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951bfff700 1 -- 172.21.15.31:0/2758297722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9508003570 con 0x7f95080051c0 2023-10-09T06:26:48.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951affd700 1 --2- 172.21.15.31:0/2758297722 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9508004810 0x7f9508004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:48.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951bfff700 1 -- 172.21.15.31:0/2758297722 reap_dead start 2023-10-09T06:26:48.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951bfff700 1 --2- 172.21.15.31:0/2758297722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95080051c0 0x7f950800ba60 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f951c0d0a80 tx=0x7f951400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64681d01ccf1d62b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:48.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400ea60 con 0x7f95080051c0 2023-10-09T06:26:48.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951400f040 con 0x7f95080051c0 2023-10-09T06:26:48.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.236+0000 7f951a7fc700 1 -- 172.21.15.31:0/2758297722 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400ee10 con 0x7f95080051c0 2023-10-09T06:26:48.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.237+0000 7f9521afe700 1 -- 172.21.15.31:0/2758297722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95080051c0 msgr2=0x7f950800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:48.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.237+0000 7f9521afe700 1 --2- 172.21.15.31:0/2758297722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95080051c0 0x7f950800ba60 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f951c0d0a80 tx=0x7f951400b040 comp rx=0 tx=0).stop 2023-10-09T06:26:48.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.237+0000 7f9521afe700 1 -- 172.21.15.31:0/2758297722 shutdown_connections 2023-10-09T06:26:48.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.237+0000 7f9521afe700 1 --2- 172.21.15.31:0/2758297722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95080051c0 0x7f950800ba60 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.237+0000 7f9521afe700 1 -- 172.21.15.31:0/2758297722 >> 172.21.15.31:0/2758297722 conn(0x7f951c0d1a50 msgr2=0x7f951c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:48.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.237+0000 7f9521afe700 1 -- 172.21.15.31:0/2758297722 shutdown_connections 2023-10-09T06:26:48.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.237+0000 7f9521afe700 1 -- 172.21.15.31:0/2758297722 wait complete. 2023-10-09T06:26:48.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.238+0000 7f9521afe700 1 Processor -- start 2023-10-09T06:26:48.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.238+0000 7f9521afe700 1 -- start start 2023-10-09T06:26:48.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f9521afe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95080051c0 0x7f951c0c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f9521afe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f951c15a230 0x7f951c158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f9521afe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c152ca0 0x7f951c153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f9521afe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c153680 con 0x7f951c152ca0 2023-10-09T06:26:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f9521afe700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c15b2d0 con 0x7f95080051c0 2023-10-09T06:26:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f9521afe700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c15a6c0 con 0x7f951c15a230 2023-10-09T06:26:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f951bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c152ca0 0x7f951c153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f951bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c152ca0 0x7f951c153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54114/0 (socket says 172.21.15.31:54114) 2023-10-09T06:26:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f951bfff700 1 -- 172.21.15.31:0/779883781 learned_addr learned my addr 172.21.15.31:0/779883781 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f951b7fe700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95080051c0 0x7f951c0c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f951affd700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f951c15a230 0x7f951c158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f951bfff700 1 -- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f951c15a230 msgr2=0x7f951c158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f951bfff700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f951c15a230 0x7f951c158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f951bfff700 1 -- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95080051c0 msgr2=0x7f951c0c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f951bfff700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95080051c0 0x7f951c0c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f951bfff700 1 -- 172.21.15.31:0/779883781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c15a9a0 con 0x7f951c152ca0 2023-10-09T06:26:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f951b7fe700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95080051c0 0x7f951c0c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f951bfff700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c152ca0 0x7f951c153140 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f951c15dbc0 tx=0x7f9514019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f95137fe700 1 -- 172.21.15.31:0/779883781 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400ee60 con 0x7f951c152ca0 2023-10-09T06:26:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f95137fe700 1 -- 172.21.15.31:0/779883781 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9514022070 con 0x7f951c152ca0 2023-10-09T06:26:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f9521afe700 1 -- 172.21.15.31:0/779883781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c15ac80 con 0x7f951c152ca0 2023-10-09T06:26:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.239+0000 7f95137fe700 1 -- 172.21.15.31:0/779883781 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951401d8b0 con 0x7f951c152ca0 2023-10-09T06:26:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.240+0000 7f9521afe700 1 -- 172.21.15.31:0/779883781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c153a00 con 0x7f951c152ca0 2023-10-09T06:26:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.240+0000 7f9521afe700 1 -- 172.21.15.31:0/779883781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951c04c3c0 con 0x7f951c152ca0 2023-10-09T06:26:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.241+0000 7f95137fe700 1 -- 172.21.15.31:0/779883781 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9514003020 con 0x7f951c152ca0 2023-10-09T06:26:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.241+0000 7f95137fe700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f94fc066f60 0x7f94fc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.242+0000 7f95137fe700 1 -- 172.21.15.31:0/779883781 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9514024070 con 0x7f951c152ca0 2023-10-09T06:26:48.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.242+0000 7f951b7fe700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f94fc066f60 0x7f94fc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.242+0000 7f951b7fe700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f94fc066f60 0x7f94fc069410 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f950c007e40 tx=0x7f950c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:48.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.246+0000 7f95137fe700 1 -- 172.21.15.31:0/779883781 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9514053620 con 0x7f951c152ca0 2023-10-09T06:26:48.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.485+0000 7f9521afe700 1 -- 172.21.15.31:0/779883781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f951c15b410 con 0x7f951c152ca0 2023-10-09T06:26:48.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.486+0000 7f95137fe700 1 -- 172.21.15.31:0/779883781 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f9514056c40 con 0x7f951c152ca0 2023-10-09T06:26:48.487 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:48.487 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/487353090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":487353090},{"type":"v1","addr":"172.21.15.158:6837","nonce":487353090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3396628353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3396628353},{"type":"v1","addr":"172.21.15.158:6836","nonce":3396628353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/1862816590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1862816590},{"type":"v1","addr":"172.21.15.31:6833","nonce":1862816590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:26:39.537650+0000","modified":"2023-10-09T06:26:43.150956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4187693404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4187693404},{"type":"v1","addr":"172.21.15.31:6835","nonce":4187693404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T06:26:48.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.488+0000 7f9521afe700 1 -- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f94fc066f60 msgr2=0x7f94fc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:48.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.488+0000 7f9521afe700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f94fc066f60 0x7f94fc069410 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f950c007e40 tx=0x7f950c009040 comp rx=0 tx=0).stop 2023-10-09T06:26:48.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.488+0000 7f9521afe700 1 -- 172.21.15.31:0/779883781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c152ca0 msgr2=0x7f951c153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:48.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.488+0000 7f9521afe700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c152ca0 0x7f951c153140 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f951c15dbc0 tx=0x7f9514019000 comp rx=0 tx=0).stop 2023-10-09T06:26:48.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.488+0000 7f9521afe700 1 -- 172.21.15.31:0/779883781 shutdown_connections 2023-10-09T06:26:48.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.488+0000 7f9521afe700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f94fc066f60 0x7f94fc069410 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.488+0000 7f9521afe700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c152ca0 0x7f951c153140 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.488+0000 7f9521afe700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95080051c0 0x7f951c0c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.488+0000 7f9521afe700 1 --2- 172.21.15.31:0/779883781 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f951c15a230 0x7f951c158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.488+0000 7f9521afe700 1 -- 172.21.15.31:0/779883781 >> 172.21.15.31:0/779883781 conn(0x7f951c0d1a50 msgr2=0x7f951c155920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:48.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.488+0000 7f9521afe700 1 -- 172.21.15.31:0/779883781 shutdown_connections 2023-10-09T06:26:48.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.488+0000 7f9521afe700 1 -- 172.21.15.31:0/779883781 wait complete. 2023-10-09T06:26:48.490 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 58 2023-10-09T06:26:48.501 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-09T06:26:48.640 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":6666,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.4955965649999996,"mdsmap_epoch":58,"osdmap_epoch":121,"osdmap_epoch_barrier":121,"uptime":13.57117257} 2023-10-09T06:26:48.640 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 6666, "mdsmap_epoch": 58, "osdmap_epoch": 121, "osdmap_epoch_barrier": 121, "rank_uptime": 8.495596565, "state": "up:active", "uptime": 13.57117257, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:26:48.640 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-09T06:26:48.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.763+0000 7f19ebf7d700 1 Processor -- start 2023-10-09T06:26:48.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.763+0000 7f19ebf7d700 1 -- start start 2023-10-09T06:26:48.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19ebf7d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19e4070950 0x7f19e406ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19ebf7d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f19e41431f0 0x7f19e4143620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19ebf7d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e40c8640 con 0x7f19e4070d20 2023-10-09T06:26:48.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19ebf7d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e40c8e80 con 0x7f19e41431f0 2023-10-09T06:26:48.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19ebf7d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e406f630 con 0x7f19e4070950 2023-10-09T06:26:48.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19e9518700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f19e4070d20 0x7f19e4067e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43756/0 (socket says 172.21.15.31:43756) 2023-10-09T06:26:48.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19e9518700 1 -- 172.21.15.31:0/2191707155 learned_addr learned my addr 172.21.15.31:0/2191707155 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:48.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19e9d19700 1 --2- 172.21.15.31:0/2191707155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19e4070950 0x7f19e406ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19ea51a700 1 --2- 172.21.15.31:0/2191707155 >> v2:172.21.15.158:3300/0 conn(0x7f19e41431f0 0x7f19e4143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19e8d17700 1 -- 172.21.15.31:0/2191707155 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953673275 0 0) 0x7f19e40c8640 con 0x7f19e4070d20 2023-10-09T06:26:48.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19e8d17700 1 -- 172.21.15.31:0/2191707155 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19cc003570 con 0x7f19e4070d20 2023-10-09T06:26:48.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19ea51a700 1 -- 172.21.15.31:0/2191707155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19e4070950 msgr2=0x7f19e406ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:48.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19ea51a700 1 --2- 172.21.15.31:0/2191707155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19e4070950 0x7f19e406ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19ea51a700 1 -- 172.21.15.31:0/2191707155 >> v1:172.21.15.31:6789/0 conn(0x7f19e4070d20 legacy=0x7f19e4067e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:48.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19ea51a700 1 -- 172.21.15.31:0/2191707155 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e40c8870 con 0x7f19e41431f0 2023-10-09T06:26:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19e9d19700 1 --2- 172.21.15.31:0/2191707155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19e4070950 0x7f19e406ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:26:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.764+0000 7f19ea51a700 1 --2- 172.21.15.31:0/2191707155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19e41431f0 0x7f19e4143620 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009e60 tx=0x7f19d4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c5a7830fdaa3d16 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.765+0000 7f19e8d17700 1 -- 172.21.15.31:0/2191707155 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d400e070 con 0x7f19e41431f0 2023-10-09T06:26:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.765+0000 7f19e8d17700 1 -- 172.21.15.31:0/2191707155 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d400bab0 con 0x7f19e41431f0 2023-10-09T06:26:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.765+0000 7f19e8d17700 1 -- 172.21.15.31:0/2191707155 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d400be70 con 0x7f19e41431f0 2023-10-09T06:26:48.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.765+0000 7f19ebf7d700 1 -- 172.21.15.31:0/2191707155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19e41431f0 msgr2=0x7f19e4143620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:48.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.765+0000 7f19ebf7d700 1 --2- 172.21.15.31:0/2191707155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19e41431f0 0x7f19e4143620 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009e60 tx=0x7f19d4009780 comp rx=0 tx=0).stop 2023-10-09T06:26:48.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.765+0000 7f19ebf7d700 1 -- 172.21.15.31:0/2191707155 shutdown_connections 2023-10-09T06:26:48.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.765+0000 7f19ebf7d700 1 --2- 172.21.15.31:0/2191707155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19e41431f0 0x7f19e4143620 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.765+0000 7f19ebf7d700 1 --2- 172.21.15.31:0/2191707155 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19e4070950 0x7f19e406ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.765+0000 7f19ebf7d700 1 -- 172.21.15.31:0/2191707155 >> 172.21.15.31:0/2191707155 conn(0x7f19e40ce570 msgr2=0x7f19e40ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:48.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.765+0000 7f19ebf7d700 1 -- 172.21.15.31:0/2191707155 shutdown_connections 2023-10-09T06:26:48.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.765+0000 7f19ebf7d700 1 -- 172.21.15.31:0/2191707155 wait complete. 2023-10-09T06:26:48.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.766+0000 7f19ebf7d700 1 Processor -- start 2023-10-09T06:26:48.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.766+0000 7f19ebf7d700 1 -- start start 2023-10-09T06:26:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19ebf7d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e4070950 0x7f19e415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19ebf7d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19e4070d20 0x7f19e415a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19ebf7d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19e41431f0 0x7f19e416cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19ebf7d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e4141b90 con 0x7f19e4070950 2023-10-09T06:26:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19ebf7d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e4141260 con 0x7f19e4070d20 2023-10-09T06:26:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19ebf7d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e4141540 con 0x7f19e41431f0 2023-10-09T06:26:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19e9d19700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e4070950 0x7f19e415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19e9d19700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e4070950 0x7f19e415cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54120/0 (socket says 172.21.15.31:54120) 2023-10-09T06:26:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19e9d19700 1 -- 172.21.15.31:0/3127733287 learned_addr learned my addr 172.21.15.31:0/3127733287 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19e9518700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19e4070d20 0x7f19e415a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19ea51a700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19e41431f0 0x7f19e416cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19e9d19700 1 -- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19e41431f0 msgr2=0x7f19e416cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19e9d19700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19e41431f0 0x7f19e416cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19e9d19700 1 -- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19e4070d20 msgr2=0x7f19e415a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19e9d19700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19e4070d20 0x7f19e415a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19e9d19700 1 -- 172.21.15.31:0/3127733287 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc009420 con 0x7f19e4070950 2023-10-09T06:26:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.767+0000 7f19e9518700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19e4070d20 0x7f19e415a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.768+0000 7f19e9d19700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e4070950 0x7f19e415cbc0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00ec80 tx=0x7f19dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.768+0000 7f19e1ffb700 1 -- 172.21.15.31:0/3127733287 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00c9d0 con 0x7f19e4070950 2023-10-09T06:26:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.768+0000 7f19e1ffb700 1 -- 172.21.15.31:0/3127733287 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc00cb30 con 0x7f19e4070950 2023-10-09T06:26:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.768+0000 7f19e1ffb700 1 -- 172.21.15.31:0/3127733287 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00ceb0 con 0x7f19e4070950 2023-10-09T06:26:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.768+0000 7f19ebf7d700 1 -- 172.21.15.31:0/3127733287 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d4009a20 con 0x7f19e4070950 2023-10-09T06:26:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.768+0000 7f19ebf7d700 1 -- 172.21.15.31:0/3127733287 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e4140f30 con 0x7f19e4070950 2023-10-09T06:26:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.769+0000 7f19ebf7d700 1 -- 172.21.15.31:0/3127733287 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e4141e70 con 0x7f19e4070950 2023-10-09T06:26:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.769+0000 7f19e1ffb700 1 -- 172.21.15.31:0/3127733287 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19dc013680 con 0x7f19e4070950 2023-10-09T06:26:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.770+0000 7f19e1ffb700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f19d0066f30 0x7f19d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.770+0000 7f19e1ffb700 1 -- 172.21.15.31:0/3127733287 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19dc084980 con 0x7f19e4070950 2023-10-09T06:26:48.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.770+0000 7f19e9518700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f19d0066f30 0x7f19d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:48.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.771+0000 7f19e9518700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f19d0066f30 0x7f19d00693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f19e413c860 tx=0x7f19d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:48.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.774+0000 7f19e1ffb700 1 -- 172.21.15.31:0/3127733287 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19dc051bf0 con 0x7f19e4070950 2023-10-09T06:26:48.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:48.969+0000 7f19ebf7d700 1 -- 172.21.15.31:0/3127733287 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f19e404c3c0 con 0x7f19e4070950 2023-10-09T06:26:49.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.178+0000 7f19e1ffb700 1 -- 172.21.15.31:0/3127733287 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v122) v1 ==== 181+0+0 (secure 0 0 0) 0x7f19dc055210 con 0x7f19e4070950 2023-10-09T06:26:49.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.180+0000 7f19ebf7d700 1 -- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f19d0066f30 msgr2=0x7f19d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:49.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.180+0000 7f19ebf7d700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f19d0066f30 0x7f19d00693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f19e413c860 tx=0x7f19d8009040 comp rx=0 tx=0).stop 2023-10-09T06:26:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.180+0000 7f19ebf7d700 1 -- 172.21.15.31:0/3127733287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e4070950 msgr2=0x7f19e415cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.180+0000 7f19ebf7d700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e4070950 0x7f19e415cbc0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00ec80 tx=0x7f19dc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.181+0000 7f19ebf7d700 1 -- 172.21.15.31:0/3127733287 shutdown_connections 2023-10-09T06:26:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.181+0000 7f19ebf7d700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f19d0066f30 0x7f19d00693e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.181+0000 7f19ebf7d700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f19e41431f0 0x7f19e416cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.181+0000 7f19ebf7d700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e4070950 0x7f19e415cbc0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.181+0000 7f19ebf7d700 1 --2- 172.21.15.31:0/3127733287 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f19e4070d20 0x7f19e415a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.181+0000 7f19ebf7d700 1 -- 172.21.15.31:0/3127733287 >> 172.21.15.31:0/3127733287 conn(0x7f19e40ce570 msgr2=0x7f19e4158920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.181+0000 7f19ebf7d700 1 -- 172.21.15.31:0/3127733287 shutdown_connections 2023-10-09T06:26:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.181+0000 7f19ebf7d700 1 -- 172.21.15.31:0/3127733287 wait complete. 2023-10-09T06:26:49.183 INFO:teuthology.orchestra.run.smithi031.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-09T06:26:49.194 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T06:26:49.194 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-10-09T06:26:49.194 DEBUG:teuthology.orchestra.run.smithi031:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-09T06:26:49.194 DEBUG:teuthology.orchestra.run.smithi031:> os.fchmod(fd, 0O666) 2023-10-09T06:26:49.194 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(fd) 2023-10-09T06:26:49.194 DEBUG:teuthology.orchestra.run.smithi031:> os.close(fd) 2023-10-09T06:26:49.194 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-10-09T06:26:49.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:49.449 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T06:26:49.519 INFO:teuthology.orchestra.run.smithi031.stdout:client6391 2023-10-09T06:26:49.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:49.519 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.client6391/osdmap') 2023-10-09T06:26:49.597 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 121 barrier 121 flags 0x588000 2023-10-09T06:26:49.597 INFO:teuthology.orchestra.run.smithi031.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:26:49.598 INFO:teuthology.orchestra.run.smithi031.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:26:49.598 INFO:teuthology.orchestra.run.smithi031.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:26:49.598 INFO:teuthology.orchestra.run.smithi031.stdout:osd0 (1)172.21.15.31:6801 100% (exists, up) 100% -1 2023-10-09T06:26:49.598 INFO:teuthology.orchestra.run.smithi031.stdout:osd1 (1)172.21.15.31:6817 100% (exists, up) 100% -1 2023-10-09T06:26:49.598 INFO:teuthology.orchestra.run.smithi031.stdout:osd2 (1)172.21.15.31:6821 100% (exists, up) 100% -1 2023-10-09T06:26:49.598 INFO:teuthology.orchestra.run.smithi031.stdout:osd3 (1)172.21.15.31:6809 100% (exists, up) 100% -1 2023-10-09T06:26:49.598 INFO:teuthology.orchestra.run.smithi031.stdout:osd4 (1)172.21.15.158:6817 100% (exists, up) 100% -1 2023-10-09T06:26:49.598 INFO:teuthology.orchestra.run.smithi031.stdout:osd5 (1)172.21.15.158:6804 100% (exists, up) 100% -1 2023-10-09T06:26:49.598 INFO:teuthology.orchestra.run.smithi031.stdout:osd6 (1)172.21.15.158:6801 100% (exists, up) 100% -1 2023-10-09T06:26:49.598 INFO:teuthology.orchestra.run.smithi031.stdout:osd7 (1)172.21.15.158:6825 100% (exists, up) 100% -1 2023-10-09T06:26:49.599 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records in 2023-10-09T06:26:49.599 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records out 2023-10-09T06:26:49.600 INFO:teuthology.orchestra.run.smithi031.stderr:799 bytes copied, 4.0325e-05 s, 19.8 MB/s 2023-10-09T06:26:49.600 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-09T06:26:49.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.760+0000 7f9c04c72700 1 Processor -- start 2023-10-09T06:26:49.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.760+0000 7f9c04c72700 1 -- start start 2023-10-09T06:26:49.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.761+0000 7f9c04c72700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c0015a2b0 0x7f9c000b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:49.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.761+0000 7f9c04c72700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9c000d1c30 0x7f9c000cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:49.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.761+0000 7f9c04c72700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c000c5d80 con 0x7f9c0015a680 2023-10-09T06:26:49.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.761+0000 7f9c04c72700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c00068470 con 0x7f9c0015a2b0 2023-10-09T06:26:49.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.761+0000 7f9c04c72700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c000c6060 con 0x7f9c000d1c30 2023-10-09T06:26:49.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfe59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c0015a2b0 0x7f9c000b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:49.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfed9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9c0015a680 0x7f9c000c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33206/0 (socket says 172.21.15.31:33206) 2023-10-09T06:26:49.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfed9d700 1 -- 172.21.15.31:0/2036329825 learned_addr learned my addr 172.21.15.31:0/2036329825 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:49.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfe59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c0015a2b0 0x7f9c000b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44586/0 (socket says 172.21.15.31:44586) 2023-10-09T06:26:49.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfdd9b700 1 --2- 172.21.15.31:0/2036329825 >> v2:172.21.15.158:3300/0 conn(0x7f9c000d1c30 0x7f9c000cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:49.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfe59c700 1 -- 172.21.15.31:0/2036329825 >> v2:172.21.15.158:3300/0 conn(0x7f9c000d1c30 msgr2=0x7f9c000cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:49.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfe59c700 1 --2- 172.21.15.31:0/2036329825 >> v2:172.21.15.158:3300/0 conn(0x7f9c000d1c30 0x7f9c000cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:49.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfe59c700 1 -- 172.21.15.31:0/2036329825 >> v1:172.21.15.31:6789/0 conn(0x7f9c0015a680 legacy=0x7f9c000c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:49.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfe59c700 1 -- 172.21.15.31:0/2036329825 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c000c6340 con 0x7f9c0015a2b0 2023-10-09T06:26:49.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfd59a700 1 -- 172.21.15.31:0/2036329825 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689269361 0 0) 0x7f9c000c5d80 con 0x7f9c0015a680 2023-10-09T06:26:49.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfdd9b700 1 --2- 172.21.15.31:0/2036329825 >> v2:172.21.15.158:3300/0 conn(0x7f9c000d1c30 0x7f9c000cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:49.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfe59c700 1 --2- 172.21.15.31:0/2036329825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0015a2b0 0x7f9c000b3da0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f9c00089190 tx=0x7f9bf8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fdef849af9c5f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:49.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfd59a700 1 -- 172.21.15.31:0/2036329825 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8005c10 con 0x7f9c0015a2b0 2023-10-09T06:26:49.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfd59a700 1 -- 172.21.15.31:0/2036329825 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf8005d70 con 0x7f9c0015a2b0 2023-10-09T06:26:49.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.762+0000 7f9bfd59a700 1 -- 172.21.15.31:0/2036329825 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8006260 con 0x7f9c0015a2b0 2023-10-09T06:26:49.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.763+0000 7f9c04c72700 1 -- 172.21.15.31:0/2036329825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0015a2b0 msgr2=0x7f9c000b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:49.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.763+0000 7f9c04c72700 1 --2- 172.21.15.31:0/2036329825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0015a2b0 0x7f9c000b3da0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f9c00089190 tx=0x7f9bf8009120 comp rx=0 tx=0).stop 2023-10-09T06:26:49.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.763+0000 7f9c04c72700 1 -- 172.21.15.31:0/2036329825 shutdown_connections 2023-10-09T06:26:49.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.763+0000 7f9c04c72700 1 --2- 172.21.15.31:0/2036329825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0015a2b0 0x7f9c000b3da0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:49.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.763+0000 7f9c04c72700 1 --2- 172.21.15.31:0/2036329825 >> v2:172.21.15.158:3300/0 conn(0x7f9c000d1c30 0x7f9c000cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:49.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.763+0000 7f9c04c72700 1 -- 172.21.15.31:0/2036329825 >> 172.21.15.31:0/2036329825 conn(0x7f9c00067e40 msgr2=0x7f9c000d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:49.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.763+0000 7f9c04c72700 1 -- 172.21.15.31:0/2036329825 shutdown_connections 2023-10-09T06:26:49.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.763+0000 7f9c04c72700 1 -- 172.21.15.31:0/2036329825 wait complete. 2023-10-09T06:26:49.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.764+0000 7f9c04c72700 1 Processor -- start 2023-10-09T06:26:49.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.764+0000 7f9c04c72700 1 -- start start 2023-10-09T06:26:49.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9c04c72700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000d1c30 0x7f9c0016bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9c04c72700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9c0015a2b0 0x7f9c000c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9c04c72700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c0015a680 0x7f9c0009df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9c04c72700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000cb190 con 0x7f9c000d1c30 2023-10-09T06:26:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9c04c72700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0015fa50 con 0x7f9c0015a680 2023-10-09T06:26:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9c04c72700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0015f120 con 0x7f9c0015a2b0 2023-10-09T06:26:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bfe59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000d1c30 0x7f9c0016bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bfe59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000d1c30 0x7f9c0016bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44592/0 (socket says 172.21.15.31:44592) 2023-10-09T06:26:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bfe59c700 1 -- 172.21.15.31:0/2679339463 learned_addr learned my addr 172.21.15.31:0/2679339463 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bfed9d700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c0015a680 0x7f9c0009df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bfdd9b700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9c0015a2b0 0x7f9c000c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bfe59c700 1 -- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9c0015a2b0 msgr2=0x7f9c000c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bfe59c700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9c0015a2b0 0x7f9c000c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bfe59c700 1 -- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c0015a680 msgr2=0x7f9c0009df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bfe59c700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c0015a680 0x7f9c0009df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bfe59c700 1 -- 172.21.15.31:0/2679339463 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf80093c0 con 0x7f9c000d1c30 2023-10-09T06:26:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bfdd9b700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9c0015a2b0 0x7f9c000c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bfe59c700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000d1c30 0x7f9c0016bce0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f9c00089120 tx=0x7f9bf8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bf67fc700 1 -- 172.21.15.31:0/2679339463 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf800bdc0 con 0x7f9c000d1c30 2023-10-09T06:26:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bf67fc700 1 -- 172.21.15.31:0/2679339463 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf801a420 con 0x7f9c000d1c30 2023-10-09T06:26:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9c04c72700 1 -- 172.21.15.31:0/2679339463 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0015f400 con 0x7f9c000d1c30 2023-10-09T06:26:49.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9bf67fc700 1 -- 172.21.15.31:0/2679339463 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf801a7e0 con 0x7f9c000d1c30 2023-10-09T06:26:49.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.765+0000 7f9c04c72700 1 -- 172.21.15.31:0/2679339463 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0016c220 con 0x7f9c000d1c30 2023-10-09T06:26:49.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.766+0000 7f9c04c72700 1 -- 172.21.15.31:0/2679339463 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0015fd30 con 0x7f9c000d1c30 2023-10-09T06:26:49.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.767+0000 7f9bf67fc700 1 -- 172.21.15.31:0/2679339463 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9bf801ab50 con 0x7f9c000d1c30 2023-10-09T06:26:49.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.767+0000 7f9bf67fc700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:49.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.767+0000 7f9bf67fc700 1 -- 172.21.15.31:0/2679339463 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9bf8086050 con 0x7f9c000d1c30 2023-10-09T06:26:49.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.767+0000 7f9bfdd9b700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:49.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.768+0000 7f9bfdd9b700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9be0066f30 0x7f9be00693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9be8006fd0 tx=0x7f9be8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:49.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.771+0000 7f9bf67fc700 1 -- 172.21.15.31:0/2679339463 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9bf80532c0 con 0x7f9c000d1c30 2023-10-09T06:26:49.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:49.978+0000 7f9c04c72700 1 -- 172.21.15.31:0/2679339463 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f9c0004c3c0 con 0x7f9c000d1c30 2023-10-09T06:26:50.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.177+0000 7f9bf67fc700 1 -- 172.21.15.31:0/2679339463 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v123) v1 ==== 93+0+0 (secure 0 0 0) 0x7f9bf80568e0 con 0x7f9c000d1c30 2023-10-09T06:26:50.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.180+0000 7f9c04c72700 1 -- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9be0066f30 msgr2=0x7f9be00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.180+0000 7f9c04c72700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9be0066f30 0x7f9be00693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9be8006fd0 tx=0x7f9be8008040 comp rx=0 tx=0).stop 2023-10-09T06:26:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.180+0000 7f9c04c72700 1 -- 172.21.15.31:0/2679339463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000d1c30 msgr2=0x7f9c0016bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.180+0000 7f9c04c72700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000d1c30 0x7f9c0016bce0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f9c00089120 tx=0x7f9bf8016000 comp rx=0 tx=0).stop 2023-10-09T06:26:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.180+0000 7f9c04c72700 1 -- 172.21.15.31:0/2679339463 shutdown_connections 2023-10-09T06:26:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.180+0000 7f9c04c72700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.180+0000 7f9c04c72700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c0015a680 0x7f9c0009df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.180+0000 7f9c04c72700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000d1c30 0x7f9c0016bce0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.180+0000 7f9c04c72700 1 --2- 172.21.15.31:0/2679339463 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9c0015a2b0 0x7f9c000c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.180+0000 7f9c04c72700 1 -- 172.21.15.31:0/2679339463 >> 172.21.15.31:0/2679339463 conn(0x7f9c00067e40 msgr2=0x7f9c0006a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.180+0000 7f9c04c72700 1 -- 172.21.15.31:0/2679339463 shutdown_connections 2023-10-09T06:26:50.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.180+0000 7f9c04c72700 1 -- 172.21.15.31:0/2679339463 wait complete. 2023-10-09T06:26:50.182 INFO:teuthology.orchestra.run.smithi031.stderr:pauserd,pausewr is set 2023-10-09T06:26:50.193 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-09T06:26:50.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.312+0000 7fc61d910700 1 Processor -- start 2023-10-09T06:26:50.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.312+0000 7fc61d910700 1 -- start start 2023-10-09T06:26:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc61d910700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6180afc90 0x7fc6180688e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc61d910700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc618070e10 0x7fc61815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc61d910700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc618068310 con 0x7fc61806ec90 2023-10-09T06:26:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc61d910700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61815e930 con 0x7fc6180afc90 2023-10-09T06:26:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc61d910700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc618067700 con 0x7fc618070e10 2023-10-09T06:26:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc61c90e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6180afc90 0x7fc6180688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc617fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc61806ec90 0x7fc618070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33208/0 (socket says 172.21.15.31:33208) 2023-10-09T06:26:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc617fff700 1 -- 172.21.15.31:0/589259394 learned_addr learned my addr 172.21.15.31:0/589259394 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc61d10f700 1 --2- 172.21.15.31:0/589259394 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc618070e10 0x7fc61815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc61c90e700 1 -- 172.21.15.31:0/589259394 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc618070e10 msgr2=0x7fc61815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc61c90e700 1 --2- 172.21.15.31:0/589259394 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc618070e10 0x7fc61815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc61c90e700 1 -- 172.21.15.31:0/589259394 >> v1:172.21.15.31:6789/0 conn(0x7fc61806ec90 legacy=0x7fc618070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc61c90e700 1 -- 172.21.15.31:0/589259394 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6180679e0 con 0x7fc6180afc90 2023-10-09T06:26:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc6177fe700 1 -- 172.21.15.31:0/589259394 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315297459 0 0) 0x7fc618068310 con 0x7fc61806ec90 2023-10-09T06:26:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.313+0000 7fc61d10f700 1 --2- 172.21.15.31:0/589259394 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc618070e10 0x7fc61815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.314+0000 7fc61c90e700 1 --2- 172.21.15.31:0/589259394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6180afc90 0x7fc6180688e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc610009e60 tx=0x7fc610009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec4c184b3e77112 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.314+0000 7fc6177fe700 1 -- 172.21.15.31:0/589259394 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61000e070 con 0x7fc6180afc90 2023-10-09T06:26:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.314+0000 7fc6177fe700 1 -- 172.21.15.31:0/589259394 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61000bc30 con 0x7fc6180afc90 2023-10-09T06:26:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.314+0000 7fc6177fe700 1 -- 172.21.15.31:0/589259394 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610012430 con 0x7fc6180afc90 2023-10-09T06:26:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.314+0000 7fc61d910700 1 -- 172.21.15.31:0/589259394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6180afc90 msgr2=0x7fc6180688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.314+0000 7fc61d910700 1 --2- 172.21.15.31:0/589259394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6180afc90 0x7fc6180688e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc610009e60 tx=0x7fc610009780 comp rx=0 tx=0).stop 2023-10-09T06:26:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.314+0000 7fc61d910700 1 -- 172.21.15.31:0/589259394 shutdown_connections 2023-10-09T06:26:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.314+0000 7fc61d910700 1 --2- 172.21.15.31:0/589259394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6180afc90 0x7fc6180688e0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.314+0000 7fc61d910700 1 --2- 172.21.15.31:0/589259394 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc618070e10 0x7fc61815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.314+0000 7fc61d910700 1 -- 172.21.15.31:0/589259394 >> 172.21.15.31:0/589259394 conn(0x7fc6180cd890 msgr2=0x7fc6180cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.314+0000 7fc61d910700 1 -- 172.21.15.31:0/589259394 shutdown_connections 2023-10-09T06:26:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.314+0000 7fc61d910700 1 -- 172.21.15.31:0/589259394 wait complete. 2023-10-09T06:26:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.315+0000 7fc61d910700 1 Processor -- start 2023-10-09T06:26:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.316+0000 7fc61d910700 1 -- start start 2023-10-09T06:26:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.316+0000 7fc61d910700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61806ec90 0x7fc6180c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.316+0000 7fc61d910700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc618070e10 0x7fc6180c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.316+0000 7fc61d910700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6180afc90 0x7fc618169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.316+0000 7fc61d910700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180c9890 con 0x7fc61806ec90 2023-10-09T06:26:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.316+0000 7fc61d910700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180c5040 con 0x7fc6180afc90 2023-10-09T06:26:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.316+0000 7fc61d910700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180c9b50 con 0x7fc618070e10 2023-10-09T06:26:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.316+0000 7fc61c90e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61806ec90 0x7fc6180c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.316+0000 7fc61c90e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61806ec90 0x7fc6180c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44622/0 (socket says 172.21.15.31:44622) 2023-10-09T06:26:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc61c90e700 1 -- 172.21.15.31:0/2714302377 learned_addr learned my addr 172.21.15.31:0/2714302377 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc61d10f700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6180afc90 0x7fc618169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc617fff700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc618070e10 0x7fc6180c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc61c90e700 1 -- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc618070e10 msgr2=0x7fc6180c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc61c90e700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc618070e10 0x7fc6180c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc61c90e700 1 -- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6180afc90 msgr2=0x7fc618169d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc61c90e700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6180afc90 0x7fc618169d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc61c90e700 1 -- 172.21.15.31:0/2714302377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc610009a20 con 0x7fc61806ec90 2023-10-09T06:26:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc61c90e700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61806ec90 0x7fc6180c7830 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc6100097c0 tx=0x7fc610019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc614ff9700 1 -- 172.21.15.31:0/2714302377 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610027470 con 0x7fc61806ec90 2023-10-09T06:26:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc614ff9700 1 -- 172.21.15.31:0/2714302377 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6100275d0 con 0x7fc61806ec90 2023-10-09T06:26:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc61d910700 1 -- 172.21.15.31:0/2714302377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6180c9e30 con 0x7fc61806ec90 2023-10-09T06:26:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc614ff9700 1 -- 172.21.15.31:0/2714302377 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610027990 con 0x7fc61806ec90 2023-10-09T06:26:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.317+0000 7fc61d910700 1 -- 172.21.15.31:0/2714302377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6180ca630 con 0x7fc61806ec90 2023-10-09T06:26:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.318+0000 7fc61d910700 1 -- 172.21.15.31:0/2714302377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc618067cc0 con 0x7fc61806ec90 2023-10-09T06:26:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.319+0000 7fc614ff9700 1 -- 172.21.15.31:0/2714302377 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc610024070 con 0x7fc61806ec90 2023-10-09T06:26:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.319+0000 7fc614ff9700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc5f8066f30 0x7fc5f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.319+0000 7fc614ff9700 1 -- 172.21.15.31:0/2714302377 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc610086f20 con 0x7fc61806ec90 2023-10-09T06:26:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.319+0000 7fc614ff9700 1 -- 172.21.15.31:0/2714302377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=124+}) v3 -- 0x7fc5f806ea50 con 0x7fc61806ec90 2023-10-09T06:26:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.319+0000 7fc617fff700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc5f8066f30 0x7fc5f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.320+0000 7fc617fff700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc5f8066f30 0x7fc5f80693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc6180c3f70 tx=0x7fc600007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.323+0000 7fc614ff9700 1 -- 172.21.15.31:0/2714302377 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc610054190 con 0x7fc61806ec90 2023-10-09T06:26:50.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:50.530+0000 7fc61d910700 1 -- 172.21.15.31:0/2714302377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fc618067f00 con 0x7fc61806ec90 2023-10-09T06:26:51.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.184+0000 7fc614ff9700 1 -- 172.21.15.31:0/2714302377 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(124..124 src has 1..124) v4 ==== 280+0+0 (secure 0 0 0) 0x7fc610058550 con 0x7fc61806ec90 2023-10-09T06:26:51.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.184+0000 7fc614ff9700 1 -- 172.21.15.31:0/2714302377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=125}) v3 -- 0x7fc5f806f3f0 con 0x7fc61806ec90 2023-10-09T06:26:51.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.188+0000 7fc614ff9700 1 -- 172.21.15.31:0/2714302377 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v124) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc610058e60 con 0x7fc61806ec90 2023-10-09T06:26:51.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.190+0000 7fc61d910700 1 -- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc5f8066f30 msgr2=0x7fc5f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:51.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.190+0000 7fc61d910700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc5f8066f30 0x7fc5f80693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc6180c3f70 tx=0x7fc600007d30 comp rx=0 tx=0).stop 2023-10-09T06:26:51.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.190+0000 7fc61d910700 1 -- 172.21.15.31:0/2714302377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61806ec90 msgr2=0x7fc6180c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:51.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.190+0000 7fc61d910700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61806ec90 0x7fc6180c7830 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc6100097c0 tx=0x7fc610019000 comp rx=0 tx=0).stop 2023-10-09T06:26:51.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.190+0000 7fc61d910700 1 -- 172.21.15.31:0/2714302377 shutdown_connections 2023-10-09T06:26:51.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.190+0000 7fc61d910700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc5f8066f30 0x7fc5f80693e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.190+0000 7fc61d910700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6180afc90 0x7fc618169d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.190+0000 7fc61d910700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61806ec90 0x7fc6180c7830 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.190+0000 7fc61d910700 1 --2- 172.21.15.31:0/2714302377 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc618070e10 0x7fc6180c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.190+0000 7fc61d910700 1 -- 172.21.15.31:0/2714302377 >> 172.21.15.31:0/2714302377 conn(0x7fc6180cd890 msgr2=0x7fc6180b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.190+0000 7fc61d910700 1 -- 172.21.15.31:0/2714302377 shutdown_connections 2023-10-09T06:26:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.190+0000 7fc61d910700 1 -- 172.21.15.31:0/2714302377 wait complete. 2023-10-09T06:26:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:pauserd,pausewr is unset 2023-10-09T06:26:51.206 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:26:51.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.332+0000 7f48f56e9700 1 Processor -- start 2023-10-09T06:26:51.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.333+0000 7f48f56e9700 1 -- start start 2023-10-09T06:26:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.333+0000 7f48f56e9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f48f015a2b0 0x7f48f00b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.333+0000 7f48f56e9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48f00cfe20 0x7f48f00ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.333+0000 7f48f56e9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f00c5d80 con 0x7f48f00d1c30 2023-10-09T06:26:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.333+0000 7f48f56e9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f0068470 con 0x7f48f015a2b0 2023-10-09T06:26:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.333+0000 7f48f56e9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00c6060 con 0x7f48f00cfe20 2023-10-09T06:26:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.333+0000 7f48eeffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f48f015a2b0 0x7f48f00b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.334+0000 7f48ee7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f48f00d1c30 0x7f48f00cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33220/0 (socket says 172.21.15.31:33220) 2023-10-09T06:26:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.334+0000 7f48eeffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f48f015a2b0 0x7f48f00b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44626/0 (socket says 172.21.15.31:44626) 2023-10-09T06:26:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.334+0000 7f48ee7fc700 1 -- 172.21.15.31:0/3658462622 learned_addr learned my addr 172.21.15.31:0/3658462622 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.334+0000 7f48ef7fe700 1 --2- 172.21.15.31:0/3658462622 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48f00cfe20 0x7f48f00ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.334+0000 7f48eeffd700 1 -- 172.21.15.31:0/3658462622 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48f00cfe20 msgr2=0x7f48f00ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.334+0000 7f48eeffd700 1 --2- 172.21.15.31:0/3658462622 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48f00cfe20 0x7f48f00ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.334+0000 7f48eeffd700 1 -- 172.21.15.31:0/3658462622 >> v1:172.21.15.31:6789/0 conn(0x7f48f00d1c30 legacy=0x7f48f00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.334+0000 7f48eeffd700 1 -- 172.21.15.31:0/3658462622 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f00c6340 con 0x7f48f015a2b0 2023-10-09T06:26:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.334+0000 7f48edffb700 1 -- 172.21.15.31:0/3658462622 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214191388 0 0) 0x7f48f00c5d80 con 0x7f48f00d1c30 2023-10-09T06:26:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.334+0000 7f48eeffd700 1 --2- 172.21.15.31:0/3658462622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48f015a2b0 0x7f48f00b3da0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f48e0009eb0 tx=0x7f48e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6b542f031bb792 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.334+0000 7f48edffb700 1 -- 172.21.15.31:0/3658462622 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e000e070 con 0x7f48f015a2b0 2023-10-09T06:26:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.334+0000 7f48edffb700 1 -- 172.21.15.31:0/3658462622 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e000bc30 con 0x7f48f015a2b0 2023-10-09T06:26:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.334+0000 7f48edffb700 1 -- 172.21.15.31:0/3658462622 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0012430 con 0x7f48f015a2b0 2023-10-09T06:26:51.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.335+0000 7f48f56e9700 1 -- 172.21.15.31:0/3658462622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48f015a2b0 msgr2=0x7f48f00b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:51.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.335+0000 7f48f56e9700 1 --2- 172.21.15.31:0/3658462622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48f015a2b0 0x7f48f00b3da0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f48e0009eb0 tx=0x7f48e0009780 comp rx=0 tx=0).stop 2023-10-09T06:26:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.335+0000 7f48f56e9700 1 -- 172.21.15.31:0/3658462622 shutdown_connections 2023-10-09T06:26:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.335+0000 7f48f56e9700 1 --2- 172.21.15.31:0/3658462622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48f015a2b0 0x7f48f00b3da0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.335+0000 7f48f56e9700 1 --2- 172.21.15.31:0/3658462622 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48f00cfe20 0x7f48f00ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.335+0000 7f48f56e9700 1 -- 172.21.15.31:0/3658462622 >> 172.21.15.31:0/3658462622 conn(0x7f48f0067e40 msgr2=0x7f48f00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.335+0000 7f48f56e9700 1 -- 172.21.15.31:0/3658462622 shutdown_connections 2023-10-09T06:26:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.335+0000 7f48f56e9700 1 -- 172.21.15.31:0/3658462622 wait complete. 2023-10-09T06:26:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.336+0000 7f48f56e9700 1 Processor -- start 2023-10-09T06:26:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.336+0000 7f48f56e9700 1 -- start start 2023-10-09T06:26:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48f56e9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48f00cfe20 0x7f48f00c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48f56e9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48f00d1c30 0x7f48f015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48f56e9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48f015a2b0 0x7f48f015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48f56e9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f009ae30 con 0x7f48f00d1c30 2023-10-09T06:26:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48f56e9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00c96f0 con 0x7f48f015a2b0 2023-10-09T06:26:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48f56e9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00c99d0 con 0x7f48f00cfe20 2023-10-09T06:26:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48ee7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48f00d1c30 0x7f48f015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48ee7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48f00d1c30 0x7f48f015b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44632/0 (socket says 172.21.15.31:44632) 2023-10-09T06:26:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48ee7fc700 1 -- 172.21.15.31:0/1409439792 learned_addr learned my addr 172.21.15.31:0/1409439792 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48eeffd700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48f00cfe20 0x7f48f00c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48ef7fe700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48f015a2b0 0x7f48f015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48ee7fc700 1 -- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48f00cfe20 msgr2=0x7f48f00c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48ee7fc700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48f00cfe20 0x7f48f00c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48ee7fc700 1 -- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48f015a2b0 msgr2=0x7f48f015bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48ee7fc700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48f015a2b0 0x7f48f015bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48ee7fc700 1 -- 172.21.15.31:0/1409439792 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0009a20 con 0x7f48f00d1c30 2023-10-09T06:26:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48ef7fe700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48f015a2b0 0x7f48f015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.337+0000 7f48ee7fc700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48f00d1c30 0x7f48f015b6e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c5e0 tx=0x7f48d8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.338+0000 7f48e6ffd700 1 -- 172.21.15.31:0/1409439792 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8005b30 con 0x7f48f00d1c30 2023-10-09T06:26:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.338+0000 7f48e6ffd700 1 -- 172.21.15.31:0/1409439792 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d8005c90 con 0x7f48f00d1c30 2023-10-09T06:26:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.338+0000 7f48f56e9700 1 -- 172.21.15.31:0/1409439792 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f00c9cb0 con 0x7f48f00d1c30 2023-10-09T06:26:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.338+0000 7f48e6ffd700 1 -- 172.21.15.31:0/1409439792 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80072e0 con 0x7f48f00d1c30 2023-10-09T06:26:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.338+0000 7f48f56e9700 1 -- 172.21.15.31:0/1409439792 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f00ca270 con 0x7f48f00d1c30 2023-10-09T06:26:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.339+0000 7f48f56e9700 1 -- 172.21.15.31:0/1409439792 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f004c3c0 con 0x7f48f00d1c30 2023-10-09T06:26:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.339+0000 7f48e6ffd700 1 -- 172.21.15.31:0/1409439792 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48d801b3b0 con 0x7f48f00d1c30 2023-10-09T06:26:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.339+0000 7f48e6ffd700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48d0066f30 0x7f48d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.339+0000 7f48e6ffd700 1 -- 172.21.15.31:0/1409439792 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48d8083860 con 0x7f48f00d1c30 2023-10-09T06:26:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.340+0000 7f48eeffd700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48d0066f30 0x7f48d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.340+0000 7f48eeffd700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48d0066f30 0x7f48d00693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f48e0009eb0 tx=0x7f48e0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:51.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.344+0000 7f48e6ffd700 1 -- 172.21.15.31:0/1409439792 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48d804b5a0 con 0x7f48f00d1c30 2023-10-09T06:26:51.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.537+0000 7f48f56e9700 1 -- 172.21.15.31:0/1409439792 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48f0064a00 con 0x7f48f00d1c30 2023-10-09T06:26:51.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.538+0000 7f48e6ffd700 1 -- 172.21.15.31:0/1409439792 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f48d8017090 con 0x7f48f00d1c30 2023-10-09T06:26:51.539 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:51.540 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":124,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:26:51.181527+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:26:37.944788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T06:26:38.507409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:26:51.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.540+0000 7f48f56e9700 1 -- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48d0066f30 msgr2=0x7f48d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:51.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.540+0000 7f48f56e9700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48d0066f30 0x7f48d00693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f48e0009eb0 tx=0x7f48e0017000 comp rx=0 tx=0).stop 2023-10-09T06:26:51.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.540+0000 7f48f56e9700 1 -- 172.21.15.31:0/1409439792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48f00d1c30 msgr2=0x7f48f015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:51.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.540+0000 7f48f56e9700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48f00d1c30 0x7f48f015b6e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c5e0 tx=0x7f48d8000fe0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.540+0000 7f48f56e9700 1 -- 172.21.15.31:0/1409439792 shutdown_connections 2023-10-09T06:26:51.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.540+0000 7f48f56e9700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f48d0066f30 0x7f48d00693e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.540+0000 7f48f56e9700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f48f00cfe20 0x7f48f00c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.540+0000 7f48f56e9700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48f015a2b0 0x7f48f015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.540+0000 7f48f56e9700 1 --2- 172.21.15.31:0/1409439792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48f00d1c30 0x7f48f015b6e0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:51.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.540+0000 7f48f56e9700 1 -- 172.21.15.31:0/1409439792 >> 172.21.15.31:0/1409439792 conn(0x7f48f0067e40 msgr2=0x7f48f00d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:51.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.540+0000 7f48f56e9700 1 -- 172.21.15.31:0/1409439792 shutdown_connections 2023-10-09T06:26:51.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:51.540+0000 7f48f56e9700 1 -- 172.21.15.31:0/1409439792 wait complete. 2023-10-09T06:26:51.553 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T06:26:51.553 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-10-09T06:26:51.553 DEBUG:teuthology.orchestra.run.smithi031:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-09T06:26:51.553 DEBUG:teuthology.orchestra.run.smithi031:> os.fchmod(fd, 0O666) 2023-10-09T06:26:51.554 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(fd) 2023-10-09T06:26:51.554 DEBUG:teuthology.orchestra.run.smithi031:> os.close(fd) 2023-10-09T06:26:51.554 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-10-09T06:26:51.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:51.808 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T06:26:51.877 INFO:teuthology.orchestra.run.smithi031.stdout:client6391 2023-10-09T06:26:51.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:51.878 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.client6391/osdmap') 2023-10-09T06:26:51.955 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 121 barrier 121 flags 0x588000 2023-10-09T06:26:51.955 INFO:teuthology.orchestra.run.smithi031.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:26:51.955 INFO:teuthology.orchestra.run.smithi031.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:26:51.955 INFO:teuthology.orchestra.run.smithi031.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:26:51.955 INFO:teuthology.orchestra.run.smithi031.stdout:osd0 (1)172.21.15.31:6801 100% (exists, up) 100% -1 2023-10-09T06:26:51.955 INFO:teuthology.orchestra.run.smithi031.stdout:osd1 (1)172.21.15.31:6817 100% (exists, up) 100% -1 2023-10-09T06:26:51.955 INFO:teuthology.orchestra.run.smithi031.stdout:osd2 (1)172.21.15.31:6821 100% (exists, up) 100% -1 2023-10-09T06:26:51.956 INFO:teuthology.orchestra.run.smithi031.stdout:osd3 (1)172.21.15.31:6809 100% (exists, up) 100% -1 2023-10-09T06:26:51.956 INFO:teuthology.orchestra.run.smithi031.stdout:osd4 (1)172.21.15.158:6817 100% (exists, up) 100% -1 2023-10-09T06:26:51.956 INFO:teuthology.orchestra.run.smithi031.stdout:osd5 (1)172.21.15.158:6804 100% (exists, up) 100% -1 2023-10-09T06:26:51.956 INFO:teuthology.orchestra.run.smithi031.stdout:osd6 (1)172.21.15.158:6801 100% (exists, up) 100% -1 2023-10-09T06:26:51.956 INFO:teuthology.orchestra.run.smithi031.stdout:osd7 (1)172.21.15.158:6825 100% (exists, up) 100% -1 2023-10-09T06:26:51.957 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records in 2023-10-09T06:26:51.957 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records out 2023-10-09T06:26:51.957 INFO:teuthology.orchestra.run.smithi031.stderr:799 bytes copied, 3.5996e-05 s, 22.2 MB/s 2023-10-09T06:26:51.957 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:52.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.115+0000 7f9eeaf20700 1 Processor -- start 2023-10-09T06:26:52.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.115+0000 7f9eeaf20700 1 -- start start 2023-10-09T06:26:52.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.116+0000 7f9eeaf20700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9ee4070e10 0x7f9ee406ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:52.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.116+0000 7f9eeaf20700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee415e9b0 con 0x7f9ee40afff0 2023-10-09T06:26:52.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.116+0000 7f9eeaf20700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee40b03c0 con 0x7f9ee415e540 2023-10-09T06:26:52.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.116+0000 7f9eeaf20700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee406a870 con 0x7f9ee4070e10 2023-10-09T06:26:52.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.116+0000 7f9ee8cbc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9ee40afff0 0x7f9ee4069e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33232/0 (socket says 172.21.15.31:33232) 2023-10-09T06:26:52.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.116+0000 7f9ee94bd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9ee4070e10 0x7f9ee406ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:52.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.116+0000 7f9ee8cbc700 1 -- 172.21.15.31:0/1734109497 learned_addr learned my addr 172.21.15.31:0/1734109497 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:52.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9ee94bd700 1 -- 172.21.15.31:0/1734109497 >> v1:172.21.15.158:6789/0 conn(0x7f9ee415e540 legacy=0x7f9ee4070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:52.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9ee94bd700 1 -- 172.21.15.31:0/1734109497 >> v1:172.21.15.31:6789/0 conn(0x7f9ee40afff0 legacy=0x7f9ee4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:52.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9ee94bd700 1 -- 172.21.15.31:0/1734109497 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee406ab50 con 0x7f9ee4070e10 2023-10-09T06:26:52.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9ee37fe700 1 -- 172.21.15.31:0/1734109497 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859243073 0 0) 0x7f9ee415e9b0 con 0x7f9ee40afff0 2023-10-09T06:26:52.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9ee94bd700 1 --2- 172.21.15.31:0/1734109497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee4070e10 0x7f9ee406ea90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009e60 tx=0x7f9edc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f9cf790d6245d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:52.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9ee37fe700 1 -- 172.21.15.31:0/1734109497 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00e070 con 0x7f9ee4070e10 2023-10-09T06:26:52.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9ee37fe700 1 -- 172.21.15.31:0/1734109497 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc00bbf0 con 0x7f9ee4070e10 2023-10-09T06:26:52.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9ee37fe700 1 -- 172.21.15.31:0/1734109497 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc012430 con 0x7f9ee4070e10 2023-10-09T06:26:52.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1734109497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee4070e10 msgr2=0x7f9ee406ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:52.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9eeaf20700 1 --2- 172.21.15.31:0/1734109497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee4070e10 0x7f9ee406ea90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009e60 tx=0x7f9edc009780 comp rx=0 tx=0).stop 2023-10-09T06:26:52.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1734109497 shutdown_connections 2023-10-09T06:26:52.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9eeaf20700 1 --2- 172.21.15.31:0/1734109497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee4070e10 0x7f9ee406ea90 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:52.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1734109497 >> 172.21.15.31:0/1734109497 conn(0x7f9ee40cda50 msgr2=0x7f9ee40cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:52.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1734109497 shutdown_connections 2023-10-09T06:26:52.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.117+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1734109497 wait complete. 2023-10-09T06:26:52.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.118+0000 7f9eeaf20700 1 Processor -- start 2023-10-09T06:26:52.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.119+0000 7f9eeaf20700 1 -- start start 2023-10-09T06:26:52.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.119+0000 7f9eeaf20700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee4070e10 0x7f9ee41434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:52.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.119+0000 7f9eeaf20700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ee40afff0 0x7f9ee40c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:52.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.119+0000 7f9eeaf20700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ee415e540 0x7f9ee40c1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:52.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.119+0000 7f9eeaf20700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40c7200 con 0x7f9ee4070e10 2023-10-09T06:26:52.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.119+0000 7f9eeaf20700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40c65f0 con 0x7f9ee40afff0 2023-10-09T06:26:52.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.119+0000 7f9eeaf20700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40c68d0 con 0x7f9ee415e540 2023-10-09T06:26:52.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.119+0000 7f9ee8cbc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee4070e10 0x7f9ee41434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:52.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9ee8cbc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee4070e10 0x7f9ee41434a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44644/0 (socket says 172.21.15.31:44644) 2023-10-09T06:26:52.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9ee8cbc700 1 -- 172.21.15.31:0/1435635925 learned_addr learned my addr 172.21.15.31:0/1435635925 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:52.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9ee94bd700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ee415e540 0x7f9ee40c1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:52.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9ee3fff700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ee40afff0 0x7f9ee40c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:52.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9ee8cbc700 1 -- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ee415e540 msgr2=0x7f9ee40c1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:52.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9ee8cbc700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ee415e540 0x7f9ee40c1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:52.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9ee8cbc700 1 -- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ee40afff0 msgr2=0x7f9ee40c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:52.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9ee8cbc700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ee40afff0 0x7f9ee40c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:52.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9ee8cbc700 1 -- 172.21.15.31:0/1435635925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc009a20 con 0x7f9ee4070e10 2023-10-09T06:26:52.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9ee8cbc700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee4070e10 0x7f9ee41434a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800c7e0 tx=0x7f9ed8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:52.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9ee0ff9700 1 -- 172.21.15.31:0/1435635925 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8005b30 con 0x7f9ee4070e10 2023-10-09T06:26:52.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9ee0ff9700 1 -- 172.21.15.31:0/1435635925 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8005c90 con 0x7f9ee4070e10 2023-10-09T06:26:52.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9ee0ff9700 1 -- 172.21.15.31:0/1435635925 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8007300 con 0x7f9ee4070e10 2023-10-09T06:26:52.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1435635925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee40c6bb0 con 0x7f9ee4070e10 2023-10-09T06:26:52.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.120+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1435635925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee41439e0 con 0x7f9ee4070e10 2023-10-09T06:26:52.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.121+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1435635925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee404c3c0 con 0x7f9ee4070e10 2023-10-09T06:26:52.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.121+0000 7f9ee0ff9700 1 -- 172.21.15.31:0/1435635925 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ed801b400 con 0x7f9ee4070e10 2023-10-09T06:26:52.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.122+0000 7f9ee0ff9700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9ec8066f30 0x7f9ec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:52.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.122+0000 7f9ee0ff9700 1 -- 172.21.15.31:0/1435635925 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ed8084060 con 0x7f9ee4070e10 2023-10-09T06:26:52.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.122+0000 7f9ee3fff700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9ec8066f30 0x7f9ec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:52.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.123+0000 7f9ee3fff700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9ec8066f30 0x7f9ec80693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0006fd0 tx=0x7f9ed0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:52.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.126+0000 7f9ee0ff9700 1 -- 172.21.15.31:0/1435635925 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ed8051360 con 0x7f9ee4070e10 2023-10-09T06:26:52.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.365+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1435635925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ee415da60 con 0x7f9ee4070e10 2023-10-09T06:26:52.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.365+0000 7f9ee0ff9700 1 -- 172.21.15.31:0/1435635925 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f9ed8007730 con 0x7f9ee4070e10 2023-10-09T06:26:52.366 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:52.366 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/487353090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":487353090},{"type":"v1","addr":"172.21.15.158:6837","nonce":487353090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3396628353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3396628353},{"type":"v1","addr":"172.21.15.158:6836","nonce":3396628353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/1862816590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1862816590},{"type":"v1","addr":"172.21.15.31:6833","nonce":1862816590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:26:39.537650+0000","modified":"2023-10-09T06:26:43.150956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4187693404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4187693404},{"type":"v1","addr":"172.21.15.31:6835","nonce":4187693404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T06:26:52.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.367+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9ec8066f30 msgr2=0x7f9ec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:52.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.367+0000 7f9eeaf20700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9ec8066f30 0x7f9ec80693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0006fd0 tx=0x7f9ed0008040 comp rx=0 tx=0).stop 2023-10-09T06:26:52.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.367+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1435635925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee4070e10 msgr2=0x7f9ee41434a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:52.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.367+0000 7f9eeaf20700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee4070e10 0x7f9ee41434a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800c7e0 tx=0x7f9ed8007df0 comp rx=0 tx=0).stop 2023-10-09T06:26:52.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.367+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1435635925 shutdown_connections 2023-10-09T06:26:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.367+0000 7f9eeaf20700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9ec8066f30 0x7f9ec80693e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.367+0000 7f9eeaf20700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9ee415e540 0x7f9ee40c1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.367+0000 7f9eeaf20700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee4070e10 0x7f9ee41434a0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.367+0000 7f9eeaf20700 1 --2- 172.21.15.31:0/1435635925 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ee40afff0 0x7f9ee40c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.367+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1435635925 >> 172.21.15.31:0/1435635925 conn(0x7f9ee40cda50 msgr2=0x7f9ee4069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.367+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1435635925 shutdown_connections 2023-10-09T06:26:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:52.367+0000 7f9eeaf20700 1 -- 172.21.15.31:0/1435635925 wait complete. 2023-10-09T06:26:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 58 2023-10-09T06:26:52.380 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json osdmap barrier 124 2023-10-09T06:26:52.517 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-09T06:26:52.517 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T06:26:52.517 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-10-09T06:26:52.517 DEBUG:teuthology.orchestra.run.smithi031:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-09T06:26:52.517 DEBUG:teuthology.orchestra.run.smithi031:> os.fchmod(fd, 0O666) 2023-10-09T06:26:52.517 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(fd) 2023-10-09T06:26:52.517 DEBUG:teuthology.orchestra.run.smithi031:> os.close(fd) 2023-10-09T06:26:52.518 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-10-09T06:26:52.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:52.772 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T06:26:52.843 INFO:teuthology.orchestra.run.smithi031.stdout:client6391 2023-10-09T06:26:52.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:52.843 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.client6391/osdmap') 2023-10-09T06:26:52.921 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 124 barrier 124 flags 0x588000 2023-10-09T06:26:52.921 INFO:teuthology.orchestra.run.smithi031.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:26:52.921 INFO:teuthology.orchestra.run.smithi031.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:26:52.921 INFO:teuthology.orchestra.run.smithi031.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:26:52.921 INFO:teuthology.orchestra.run.smithi031.stdout:osd0 (1)172.21.15.31:6801 100% (exists, up) 100% -1 2023-10-09T06:26:52.921 INFO:teuthology.orchestra.run.smithi031.stdout:osd1 (1)172.21.15.31:6817 100% (exists, up) 100% -1 2023-10-09T06:26:52.921 INFO:teuthology.orchestra.run.smithi031.stdout:osd2 (1)172.21.15.31:6821 100% (exists, up) 100% -1 2023-10-09T06:26:52.922 INFO:teuthology.orchestra.run.smithi031.stdout:osd3 (1)172.21.15.31:6809 100% (exists, up) 100% -1 2023-10-09T06:26:52.922 INFO:teuthology.orchestra.run.smithi031.stdout:osd4 (1)172.21.15.158:6817 100% (exists, up) 100% -1 2023-10-09T06:26:52.922 INFO:teuthology.orchestra.run.smithi031.stdout:osd5 (1)172.21.15.158:6804 100% (exists, up) 100% -1 2023-10-09T06:26:52.922 INFO:teuthology.orchestra.run.smithi031.stdout:osd6 (1)172.21.15.158:6801 100% (exists, up) 100% -1 2023-10-09T06:26:52.922 INFO:teuthology.orchestra.run.smithi031.stdout:osd7 (1)172.21.15.158:6825 100% (exists, up) 100% -1 2023-10-09T06:26:52.923 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records in 2023-10-09T06:26:52.923 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records out 2023-10-09T06:26:52.923 INFO:teuthology.orchestra.run.smithi031.stderr:799 bytes copied, 3.5615e-05 s, 22.4 MB/s 2023-10-09T06:26:52.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:52.923 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T06:26:52.992 INFO:teuthology.orchestra.run.smithi031.stdout:client6391 2023-10-09T06:26:52.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:52.992 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.client6391/osdmap') 2023-10-09T06:26:53.070 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 124 barrier 124 flags 0x588000 2023-10-09T06:26:53.070 INFO:teuthology.orchestra.run.smithi031.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:26:53.070 INFO:teuthology.orchestra.run.smithi031.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:26:53.070 INFO:teuthology.orchestra.run.smithi031.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T06:26:53.070 INFO:teuthology.orchestra.run.smithi031.stdout:osd0 (1)172.21.15.31:6801 100% (exists, up) 100% -1 2023-10-09T06:26:53.070 INFO:teuthology.orchestra.run.smithi031.stdout:osd1 (1)172.21.15.31:6817 100% (exists, up) 100% -1 2023-10-09T06:26:53.070 INFO:teuthology.orchestra.run.smithi031.stdout:osd2 (1)172.21.15.31:6821 100% (exists, up) 100% -1 2023-10-09T06:26:53.070 INFO:teuthology.orchestra.run.smithi031.stdout:osd3 (1)172.21.15.31:6809 100% (exists, up) 100% -1 2023-10-09T06:26:53.071 INFO:teuthology.orchestra.run.smithi031.stdout:osd4 (1)172.21.15.158:6817 100% (exists, up) 100% -1 2023-10-09T06:26:53.071 INFO:teuthology.orchestra.run.smithi031.stdout:osd5 (1)172.21.15.158:6804 100% (exists, up) 100% -1 2023-10-09T06:26:53.071 INFO:teuthology.orchestra.run.smithi031.stdout:osd6 (1)172.21.15.158:6801 100% (exists, up) 100% -1 2023-10-09T06:26:53.071 INFO:teuthology.orchestra.run.smithi031.stdout:osd7 (1)172.21.15.158:6825 100% (exists, up) 100% -1 2023-10-09T06:26:53.072 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records in 2023-10-09T06:26:53.072 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records out 2023-10-09T06:26:53.072 INFO:teuthology.orchestra.run.smithi031.stderr:799 bytes copied, 3.7154e-05 s, 21.5 MB/s 2023-10-09T06:26:53.072 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T06:26:53.072 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:26:53.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:26:53.153 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:26:53.198 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:26:53.198 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:26:53.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:53.199 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:26:53.271 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:26:53.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:53.271 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:26:53.286 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T06:26:53.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:26:53.286 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T06:26:53.330 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:26:53.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:26:53.331 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T06:26:53.386 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:53.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.505+0000 7f43e58e8700 1 Processor -- start 2023-10-09T06:26:53.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.505+0000 7f43e58e8700 1 -- start start 2023-10-09T06:26:53.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.506+0000 7f43e58e8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43e00b32f0 0x7f43e0159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:53.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.506+0000 7f43e58e8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f43e0068b10 0x7f43e0068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:53.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.506+0000 7f43e58e8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e015a160 con 0x7f43e0159850 2023-10-09T06:26:53.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.506+0000 7f43e58e8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e00694f0 con 0x7f43e0068b10 2023-10-09T06:26:53.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.506+0000 7f43e58e8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00cbaa0 con 0x7f43e00b32f0 2023-10-09T06:26:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.506+0000 7f43deffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f43e0159850 0x7f43e00b2be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33244/0 (socket says 172.21.15.31:33244) 2023-10-09T06:26:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.506+0000 7f43deffd700 1 -- 172.21.15.31:0/936306235 learned_addr learned my addr 172.21.15.31:0/936306235 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.506+0000 7f43df7fe700 1 --2- 172.21.15.31:0/936306235 >> v2:172.21.15.158:3300/0 conn(0x7f43e0068b10 0x7f43e0068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.506+0000 7f43de7fc700 1 --2- 172.21.15.31:0/936306235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43e00b32f0 0x7f43e0159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.506+0000 7f43ddffb700 1 -- 172.21.15.31:0/936306235 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479159994 0 0) 0x7f43e015a160 con 0x7f43e0159850 2023-10-09T06:26:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.506+0000 7f43ddffb700 1 -- 172.21.15.31:0/936306235 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43c8003570 con 0x7f43e0159850 2023-10-09T06:26:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.507+0000 7f43de7fc700 1 -- 172.21.15.31:0/936306235 >> v2:172.21.15.158:3300/0 conn(0x7f43e0068b10 msgr2=0x7f43e0068fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.507+0000 7f43de7fc700 1 --2- 172.21.15.31:0/936306235 >> v2:172.21.15.158:3300/0 conn(0x7f43e0068b10 0x7f43e0068fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.507+0000 7f43ddffb700 1 -- 172.21.15.31:0/936306235 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 698978809 0 0) 0x7f43c8003570 con 0x7f43e0159850 2023-10-09T06:26:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.507+0000 7f43de7fc700 1 -- 172.21.15.31:0/936306235 >> v1:172.21.15.31:6789/0 conn(0x7f43e0159850 legacy=0x7f43e00b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.507+0000 7f43de7fc700 1 -- 172.21.15.31:0/936306235 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e00cbd80 con 0x7f43e00b32f0 2023-10-09T06:26:53.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.507+0000 7f43de7fc700 1 --2- 172.21.15.31:0/936306235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43e00b32f0 0x7f43e0159c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f43d40098e0 tx=0x7f43d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5593a96bcc629b99 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.507+0000 7f43ddffb700 1 -- 172.21.15.31:0/936306235 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0001470 con 0x7f43e00b32f0 2023-10-09T06:26:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.507+0000 7f43ddffb700 1 -- 172.21.15.31:0/936306235 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d4011420 con 0x7f43e00b32f0 2023-10-09T06:26:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.507+0000 7f43ddffb700 1 -- 172.21.15.31:0/936306235 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40117c0 con 0x7f43e00b32f0 2023-10-09T06:26:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.508+0000 7f43e58e8700 1 -- 172.21.15.31:0/936306235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43e00b32f0 msgr2=0x7f43e0159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.508+0000 7f43e58e8700 1 --2- 172.21.15.31:0/936306235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43e00b32f0 0x7f43e0159c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f43d40098e0 tx=0x7f43d40091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.508+0000 7f43e58e8700 1 -- 172.21.15.31:0/936306235 shutdown_connections 2023-10-09T06:26:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.508+0000 7f43e58e8700 1 --2- 172.21.15.31:0/936306235 >> v2:172.21.15.158:3300/0 conn(0x7f43e0068b10 0x7f43e0068fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.508+0000 7f43e58e8700 1 --2- 172.21.15.31:0/936306235 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43e00b32f0 0x7f43e0159c20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.508+0000 7f43e58e8700 1 -- 172.21.15.31:0/936306235 >> 172.21.15.31:0/936306235 conn(0x7f43e0067660 msgr2=0x7f43e0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.508+0000 7f43e58e8700 1 -- 172.21.15.31:0/936306235 shutdown_connections 2023-10-09T06:26:53.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.508+0000 7f43e58e8700 1 -- 172.21.15.31:0/936306235 wait complete. 2023-10-09T06:26:53.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.509+0000 7f43e58e8700 1 Processor -- start 2023-10-09T06:26:53.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.509+0000 7f43e58e8700 1 -- start start 2023-10-09T06:26:53.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43e58e8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43e0068b10 0x7f43e0157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:53.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43e58e8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43e00b32f0 0x7f43e00caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:53.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43e58e8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43e0159850 0x7f43e015bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:53.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43e58e8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00a74b0 con 0x7f43e00b32f0 2023-10-09T06:26:53.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43e58e8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00c7db0 con 0x7f43e0159850 2023-10-09T06:26:53.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43e58e8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e015b770 con 0x7f43e0068b10 2023-10-09T06:26:53.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43de7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43e00b32f0 0x7f43e00caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:53.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43de7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43e00b32f0 0x7f43e00caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44654/0 (socket says 172.21.15.31:44654) 2023-10-09T06:26:53.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43de7fc700 1 -- 172.21.15.31:0/3944415424 learned_addr learned my addr 172.21.15.31:0/3944415424 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:53.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43df7fe700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43e0159850 0x7f43e015bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:53.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43deffd700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43e0068b10 0x7f43e0157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:53.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43de7fc700 1 -- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43e0068b10 msgr2=0x7f43e0157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:53.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43de7fc700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43e0068b10 0x7f43e0157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43de7fc700 1 -- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43e0159850 msgr2=0x7f43e015bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:53.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43de7fc700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43e0159850 0x7f43e015bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43de7fc700 1 -- 172.21.15.31:0/3944415424 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4009420 con 0x7f43e00b32f0 2023-10-09T06:26:53.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43deffd700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43e0068b10 0x7f43e0157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:53.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43de7fc700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43e00b32f0 0x7f43e00caae0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009ed0 tx=0x7f43d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:53.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43c6ffd700 1 -- 172.21.15.31:0/3944415424 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d401cc40 con 0x7f43e00b32f0 2023-10-09T06:26:53.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43c6ffd700 1 -- 172.21.15.31:0/3944415424 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d401cdc0 con 0x7f43e00b32f0 2023-10-09T06:26:53.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43c6ffd700 1 -- 172.21.15.31:0/3944415424 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d401a6a0 con 0x7f43e00b32f0 2023-10-09T06:26:53.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43e58e8700 1 -- 172.21.15.31:0/3944415424 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e015aed0 con 0x7f43e00b32f0 2023-10-09T06:26:53.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.510+0000 7f43e58e8700 1 -- 172.21.15.31:0/3944415424 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e015b490 con 0x7f43e00b32f0 2023-10-09T06:26:53.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.511+0000 7f43e58e8700 1 -- 172.21.15.31:0/3944415424 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e00c7f60 con 0x7f43e00b32f0 2023-10-09T06:26:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.512+0000 7f43c6ffd700 1 -- 172.21.15.31:0/3944415424 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43d401aa10 con 0x7f43e00b32f0 2023-10-09T06:26:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.512+0000 7f43c6ffd700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f43cc066f30 0x7f43cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.512+0000 7f43c6ffd700 1 -- 172.21.15.31:0/3944415424 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43d4085fe0 con 0x7f43e00b32f0 2023-10-09T06:26:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.512+0000 7f43deffd700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f43cc066f30 0x7f43cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.513+0000 7f43deffd700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f43cc066f30 0x7f43cc0693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f43d0007c40 tx=0x7f43d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.517+0000 7f43c6ffd700 1 -- 172.21.15.31:0/3944415424 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43e00c7f60 con 0x7f43e00b32f0 2023-10-09T06:26:53.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.758+0000 7f43e58e8700 1 -- 172.21.15.31:0/3944415424 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43e00c7f60 con 0x7f43e00b32f0 2023-10-09T06:26:53.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.758+0000 7f43c6ffd700 1 -- 172.21.15.31:0/3944415424 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f43e00c7f60 con 0x7f43e00b32f0 2023-10-09T06:26:53.759 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:53.759 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/487353090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":487353090},{"type":"v1","addr":"172.21.15.158:6837","nonce":487353090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3396628353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3396628353},{"type":"v1","addr":"172.21.15.158:6836","nonce":3396628353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/1862816590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1862816590},{"type":"v1","addr":"172.21.15.31:6833","nonce":1862816590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:26:39.537650+0000","modified":"2023-10-09T06:26:43.150956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4187693404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4187693404},{"type":"v1","addr":"172.21.15.31:6835","nonce":4187693404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T06:26:53.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.760+0000 7f43e58e8700 1 -- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f43cc066f30 msgr2=0x7f43cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:53.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.760+0000 7f43e58e8700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f43cc066f30 0x7f43cc0693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f43d0007c40 tx=0x7f43d0009040 comp rx=0 tx=0).stop 2023-10-09T06:26:53.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.760+0000 7f43e58e8700 1 -- 172.21.15.31:0/3944415424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43e00b32f0 msgr2=0x7f43e00caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:53.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.760+0000 7f43e58e8700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43e00b32f0 0x7f43e00caae0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009ed0 tx=0x7f43d4016000 comp rx=0 tx=0).stop 2023-10-09T06:26:53.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.760+0000 7f43e58e8700 1 -- 172.21.15.31:0/3944415424 shutdown_connections 2023-10-09T06:26:53.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.760+0000 7f43e58e8700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f43cc066f30 0x7f43cc0693e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.760+0000 7f43e58e8700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f43e0068b10 0x7f43e0157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.760+0000 7f43e58e8700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43e0159850 0x7f43e015bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.760+0000 7f43e58e8700 1 --2- 172.21.15.31:0/3944415424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43e00b32f0 0x7f43e00caae0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.760+0000 7f43e58e8700 1 -- 172.21.15.31:0/3944415424 >> 172.21.15.31:0/3944415424 conn(0x7f43e0067660 msgr2=0x7f43e00c6590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:53.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.760+0000 7f43e58e8700 1 -- 172.21.15.31:0/3944415424 shutdown_connections 2023-10-09T06:26:53.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.760+0000 7f43e58e8700 1 -- 172.21.15.31:0/3944415424 wait complete. 2023-10-09T06:26:53.762 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 58 2023-10-09T06:26:53.773 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:26:53.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.891+0000 7fcfbb0e6700 1 Processor -- start 2023-10-09T06:26:53.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.891+0000 7fcfbb0e6700 1 -- start start 2023-10-09T06:26:53.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.892+0000 7fcfbb0e6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfb4068710 0x7fcfb406aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:53.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.892+0000 7fcfbb0e6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb406a050 con 0x7fcfb406f660 2023-10-09T06:26:53.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.892+0000 7fcfbb0e6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb40acdc0 con 0x7fcfb4068ae0 2023-10-09T06:26:53.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.892+0000 7fcfbb0e6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb40c9c20 con 0x7fcfb4068710 2023-10-09T06:26:53.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.892+0000 7fcfba0e4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfb4068710 0x7fcfb406aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:53.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.892+0000 7fcfb98e3700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcfb406f660 0x7fcfb40c9510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33246/0 (socket says 172.21.15.31:33246) 2023-10-09T06:26:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.892+0000 7fcfb98e3700 1 -- 172.21.15.31:0/1429064131 learned_addr learned my addr 172.21.15.31:0/1429064131 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.892+0000 7fcfba0e4700 1 -- 172.21.15.31:0/1429064131 >> v1:172.21.15.158:6789/0 conn(0x7fcfb4068ae0 legacy=0x7fcfb4070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.892+0000 7fcfba0e4700 1 -- 172.21.15.31:0/1429064131 >> v1:172.21.15.31:6789/0 conn(0x7fcfb406f660 legacy=0x7fcfb40c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.892+0000 7fcfba0e4700 1 -- 172.21.15.31:0/1429064131 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb40c9e00 con 0x7fcfb4068710 2023-10-09T06:26:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.892+0000 7fcfba0e4700 1 --2- 172.21.15.31:0/1429064131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb4068710 0x7fcfb406aaf0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0098e0 tx=0x7fcfac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44da5f4ba61d27e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.893+0000 7fcfb90e2700 1 -- 172.21.15.31:0/1429064131 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac009e80 con 0x7fcfb4068710 2023-10-09T06:26:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.893+0000 7fcfb90e2700 1 -- 172.21.15.31:0/1429064131 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac00b760 con 0x7fcfb4068710 2023-10-09T06:26:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.893+0000 7fcfb90e2700 1 -- 172.21.15.31:0/1429064131 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac00bb00 con 0x7fcfb4068710 2023-10-09T06:26:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.893+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1429064131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb4068710 msgr2=0x7fcfb406aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.893+0000 7fcfbb0e6700 1 --2- 172.21.15.31:0/1429064131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb4068710 0x7fcfb406aaf0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0098e0 tx=0x7fcfac0091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.893+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1429064131 shutdown_connections 2023-10-09T06:26:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.893+0000 7fcfbb0e6700 1 --2- 172.21.15.31:0/1429064131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb4068710 0x7fcfb406aaf0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.893+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1429064131 >> 172.21.15.31:0/1429064131 conn(0x7fcfb40cd8f0 msgr2=0x7fcfb40cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.893+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1429064131 shutdown_connections 2023-10-09T06:26:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.893+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1429064131 wait complete. 2023-10-09T06:26:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.894+0000 7fcfbb0e6700 1 Processor -- start 2023-10-09T06:26:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.894+0000 7fcfbb0e6700 1 -- start start 2023-10-09T06:26:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfbb0e6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb4068710 0x7fcfb416e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfbb0e6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfb4068ae0 0x7fcfb40b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfbb0e6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb406f660 0x7fcfb40b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfbb0e6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40b1f30 con 0x7fcfb4068710 2023-10-09T06:26:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfbb0e6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40b2890 con 0x7fcfb4068ae0 2023-10-09T06:26:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfbb0e6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40b3460 con 0x7fcfb406f660 2023-10-09T06:26:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfba0e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb4068710 0x7fcfb416e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfba0e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb4068710 0x7fcfb416e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44678/0 (socket says 172.21.15.31:44678) 2023-10-09T06:26:53.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfba0e4700 1 -- 172.21.15.31:0/1201282142 learned_addr learned my addr 172.21.15.31:0/1201282142 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfba0e4700 1 -- 172.21.15.31:0/1201282142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb406f660 msgr2=0x7fcfb40b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfba0e4700 1 --2- 172.21.15.31:0/1201282142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb406f660 0x7fcfb40b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfba0e4700 1 -- 172.21.15.31:0/1201282142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfb4068ae0 msgr2=0x7fcfb40b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfba0e4700 1 --2- 172.21.15.31:0/1201282142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfb4068ae0 0x7fcfb40b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.895+0000 7fcfba0e4700 1 -- 172.21.15.31:0/1201282142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac009420 con 0x7fcfb4068710 2023-10-09T06:26:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.896+0000 7fcfba0e4700 1 --2- 172.21.15.31:0/1201282142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb4068710 0x7fcfb416e530 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0091e0 tx=0x7fcfac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.896+0000 7fcfb27fc700 1 -- 172.21.15.31:0/1201282142 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac000d10 con 0x7fcfb4068710 2023-10-09T06:26:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.896+0000 7fcfb27fc700 1 -- 172.21.15.31:0/1201282142 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac011e30 con 0x7fcfb4068710 2023-10-09T06:26:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.896+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1201282142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb40b1590 con 0x7fcfb4068710 2023-10-09T06:26:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.896+0000 7fcfb27fc700 1 -- 172.21.15.31:0/1201282142 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac01b680 con 0x7fcfb4068710 2023-10-09T06:26:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.896+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1201282142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb40b1b50 con 0x7fcfb4068710 2023-10-09T06:26:53.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.897+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1201282142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb406d640 con 0x7fcfb4068710 2023-10-09T06:26:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.897+0000 7fcfb27fc700 1 -- 172.21.15.31:0/1201282142 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfac022020 con 0x7fcfb4068710 2023-10-09T06:26:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.898+0000 7fcfb27fc700 1 --2- 172.21.15.31:0/1201282142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfa0066f30 0x7fcfa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.898+0000 7fcfb27fc700 1 -- 172.21.15.31:0/1201282142 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcfac086050 con 0x7fcfb4068710 2023-10-09T06:26:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.898+0000 7fcfb98e3700 1 --2- 172.21.15.31:0/1201282142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfa0066f30 0x7fcfa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.898+0000 7fcfb98e3700 1 --2- 172.21.15.31:0/1201282142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfa0066f30 0x7fcfa00693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8007fd0 tx=0x7fcfa8007b00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:53.902+0000 7fcfb27fc700 1 -- 172.21.15.31:0/1201282142 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfac053340 con 0x7fcfb4068710 2023-10-09T06:26:54.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.095+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1201282142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfb406d640 con 0x7fcfb4068710 2023-10-09T06:26:54.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.096+0000 7fcfb27fc700 1 -- 172.21.15.31:0/1201282142 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+15372 (secure 0 0 0) 0x7fcfac056960 con 0x7fcfb4068710 2023-10-09T06:26:54.097 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:54.097 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":124,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:26:51.181527+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:26:37.944788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T06:26:38.507409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:26:54.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.098+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1201282142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfa0066f30 msgr2=0x7fcfa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.098+0000 7fcfbb0e6700 1 --2- 172.21.15.31:0/1201282142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfa0066f30 0x7fcfa00693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8007fd0 tx=0x7fcfa8007b00 comp rx=0 tx=0).stop 2023-10-09T06:26:54.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.098+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1201282142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb4068710 msgr2=0x7fcfb416e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.098+0000 7fcfbb0e6700 1 --2- 172.21.15.31:0/1201282142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb4068710 0x7fcfb416e530 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0091e0 tx=0x7fcfac016000 comp rx=0 tx=0).stop 2023-10-09T06:26:54.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.098+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1201282142 shutdown_connections 2023-10-09T06:26:54.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.098+0000 7fcfbb0e6700 1 --2- 172.21.15.31:0/1201282142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcfa0066f30 0x7fcfa00693e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.098+0000 7fcfbb0e6700 1 --2- 172.21.15.31:0/1201282142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcfb406f660 0x7fcfb40b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.098+0000 7fcfbb0e6700 1 --2- 172.21.15.31:0/1201282142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb4068710 0x7fcfb416e530 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.098+0000 7fcfbb0e6700 1 --2- 172.21.15.31:0/1201282142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcfb4068ae0 0x7fcfb40b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.098+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1201282142 >> 172.21.15.31:0/1201282142 conn(0x7fcfb40cd8f0 msgr2=0x7fcfb40ca020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:54.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.098+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1201282142 shutdown_connections 2023-10-09T06:26:54.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.098+0000 7fcfbb0e6700 1 -- 172.21.15.31:0/1201282142 wait complete. 2023-10-09T06:26:54.110 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:26:37.944788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:26:38.507409+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:26:54.111 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:26:54.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.232+0000 7f2e059b0700 1 Processor -- start 2023-10-09T06:26:54.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.233+0000 7f2e059b0700 1 -- start start 2023-10-09T06:26:54.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.233+0000 7f2e059b0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e00159ec0 0x7f2e000af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.233+0000 7f2e059b0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e000b0790 con 0x7f2e0006acb0 2023-10-09T06:26:54.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.233+0000 7f2e059b0700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e000ce1f0 con 0x7f2e0015a290 2023-10-09T06:26:54.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.233+0000 7f2e059b0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e000b0b20 con 0x7f2e00159ec0 2023-10-09T06:26:54.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.233+0000 7f2dff7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2e0006acb0 0x7f2e000cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33248/0 (socket says 172.21.15.31:33248) 2023-10-09T06:26:54.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.233+0000 7f2dff7fe700 1 -- 172.21.15.31:0/3172701441 learned_addr learned my addr 172.21.15.31:0/3172701441 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:54.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfeffd700 1 --2- 172.21.15.31:0/3172701441 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e00159ec0 0x7f2e000af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99355833 0 0) 0x7f2e000b0790 con 0x7f2e0006acb0 2023-10-09T06:26:54.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dec003570 con 0x7f2e0006acb0 2023-10-09T06:26:54.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 555815048 0 0) 0x7f2dec003570 con 0x7f2e0006acb0 2023-10-09T06:26:54.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e00159ec0 msgr2=0x7f2e000af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:54.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 --2- 172.21.15.31:0/3172701441 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e00159ec0 0x7f2e000af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 >> v1:172.21.15.158:6789/0 conn(0x7f2e0015a290 legacy=0x7f2e0006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e000b04b0 con 0x7f2e0006acb0 2023-10-09T06:26:54.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f2df00017f0 con 0x7f2e0006acb0 2023-10-09T06:26:54.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 >> v1:172.21.15.31:6789/0 conn(0x7f2e0006acb0 legacy=0x7f2e000cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 --2- 172.21.15.31:0/3172701441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dec003a90 0x7f2dec003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 --2- 172.21.15.31:0/3172701441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2dec004810 0x7f2dec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 --2- 172.21.15.31:0/3172701441 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e00159ec0 0x7f2dec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e000b0b20 con 0x7f2dec003a90 2023-10-09T06:26:54.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec00bb10 con 0x7f2dec004810 2023-10-09T06:26:54.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec00bcd0 con 0x7f2e00159ec0 2023-10-09T06:26:54.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfeffd700 1 --2- 172.21.15.31:0/3172701441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dec003a90 0x7f2dec003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dfe7fc700 1 --2- 172.21.15.31:0/3172701441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2dec004810 0x7f2dec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.234+0000 7f2dff7fe700 1 --2- 172.21.15.31:0/3172701441 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e00159ec0 0x7f2dec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2dfeffd700 1 -- 172.21.15.31:0/3172701441 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e00159ec0 msgr2=0x7f2dec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:54.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2dfeffd700 1 --2- 172.21.15.31:0/3172701441 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e00159ec0 0x7f2dec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2dfeffd700 1 -- 172.21.15.31:0/3172701441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2dec004810 msgr2=0x7f2dec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:54.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2dfeffd700 1 --2- 172.21.15.31:0/3172701441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2dec004810 0x7f2dec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2dfeffd700 1 -- 172.21.15.31:0/3172701441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec003570 con 0x7f2dec003a90 2023-10-09T06:26:54.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2dfe7fc700 1 --2- 172.21.15.31:0/3172701441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2dec004810 0x7f2dec004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:54.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2dfeffd700 1 --2- 172.21.15.31:0/3172701441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dec003a90 0x7f2dec003e60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009c00 tx=0x7f2df80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5758fe2549c80789 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:54.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800e710 con 0x7f2dec003a90 2023-10-09T06:26:54.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df800e870 con 0x7f2dec003a90 2023-10-09T06:26:54.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2dfdffb700 1 -- 172.21.15.31:0/3172701441 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800ec30 con 0x7f2dec003a90 2023-10-09T06:26:54.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2e059b0700 1 -- 172.21.15.31:0/3172701441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dec003a90 msgr2=0x7f2dec003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2e059b0700 1 --2- 172.21.15.31:0/3172701441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dec003a90 0x7f2dec003e60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009c00 tx=0x7f2df80091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2dff7fe700 1 -- 172.21.15.31:0/3172701441 reap_dead start 2023-10-09T06:26:54.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2e059b0700 1 -- 172.21.15.31:0/3172701441 shutdown_connections 2023-10-09T06:26:54.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2e059b0700 1 -- 172.21.15.31:0/3172701441 >> 172.21.15.31:0/3172701441 conn(0x7f2e000d1880 msgr2=0x7f2e000cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:54.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2e059b0700 1 -- 172.21.15.31:0/3172701441 shutdown_connections 2023-10-09T06:26:54.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.235+0000 7f2e059b0700 1 -- 172.21.15.31:0/3172701441 wait complete. 2023-10-09T06:26:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.237+0000 7f2e059b0700 1 Processor -- start 2023-10-09T06:26:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.237+0000 7f2e059b0700 1 -- start start 2023-10-09T06:26:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.237+0000 7f2e059b0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2dec003a90 0x7f2e00155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.237+0000 7f2e059b0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e00169f50 0x7f2e0015bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.237+0000 7f2e059b0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e0015c330 0x7f2e00158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.237+0000 7f2e059b0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e00155e60 con 0x7f2e00169f50 2023-10-09T06:26:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.237+0000 7f2e059b0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0015c860 con 0x7f2dec003a90 2023-10-09T06:26:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.237+0000 7f2e059b0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0015cb40 con 0x7f2e0015c330 2023-10-09T06:26:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.237+0000 7f2dfe7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e00169f50 0x7f2e0015bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2dfe7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e00169f50 0x7f2e0015bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44684/0 (socket says 172.21.15.31:44684) 2023-10-09T06:26:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2dfe7fc700 1 -- 172.21.15.31:0/2719173756 learned_addr learned my addr 172.21.15.31:0/2719173756 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2dfeffd700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2dec003a90 0x7f2e00155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2dff7fe700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e0015c330 0x7f2e00158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2dfe7fc700 1 -- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e0015c330 msgr2=0x7f2e00158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2dfe7fc700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e0015c330 0x7f2e00158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2dfe7fc700 1 -- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2dec003a90 msgr2=0x7f2e00155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2dfe7fc700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2dec003a90 0x7f2e00155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2dfe7fc700 1 -- 172.21.15.31:0/2719173756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0015ce20 con 0x7f2e00169f50 2023-10-09T06:26:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2dff7fe700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e0015c330 0x7f2e00158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2dfe7fc700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e00169f50 0x7f2e0015bdf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2de800e860 tx=0x7f2de8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2df6ffd700 1 -- 172.21.15.31:0/2719173756 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8012590 con 0x7f2e00169f50 2023-10-09T06:26:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2df6ffd700 1 -- 172.21.15.31:0/2719173756 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de80126f0 con 0x7f2e00169f50 2023-10-09T06:26:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2e059b0700 1 -- 172.21.15.31:0/2719173756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0015d100 con 0x7f2e00169f50 2023-10-09T06:26:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2df6ffd700 1 -- 172.21.15.31:0/2719173756 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8012a90 con 0x7f2e00169f50 2023-10-09T06:26:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.238+0000 7f2e059b0700 1 -- 172.21.15.31:0/2719173756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e00158cd0 con 0x7f2e00169f50 2023-10-09T06:26:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.239+0000 7f2e059b0700 1 -- 172.21.15.31:0/2719173756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0004c3c0 con 0x7f2e00169f50 2023-10-09T06:26:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.240+0000 7f2df6ffd700 1 -- 172.21.15.31:0/2719173756 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2de801d460 con 0x7f2e00169f50 2023-10-09T06:26:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.240+0000 7f2df6ffd700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2de0066f30 0x7f2de00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.240+0000 7f2df6ffd700 1 -- 172.21.15.31:0/2719173756 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2de80843e0 con 0x7f2e00169f50 2023-10-09T06:26:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.240+0000 7f2dfeffd700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2de0066f30 0x7f2de00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.241+0000 7f2dfeffd700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2de0066f30 0x7f2de00693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2df80091e0 tx=0x7f2df801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:54.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.244+0000 7f2df6ffd700 1 -- 172.21.15.31:0/2719173756 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2de8051650 con 0x7f2e00169f50 2023-10-09T06:26:54.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.434+0000 7f2e059b0700 1 -- 172.21.15.31:0/2719173756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e000ceab0 con 0x7f2e00169f50 2023-10-09T06:26:54.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.435+0000 7f2df6ffd700 1 -- 172.21.15.31:0/2719173756 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v124) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2de8054c70 con 0x7f2e00169f50 2023-10-09T06:26:54.435 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:26:54.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.437+0000 7f2e059b0700 1 -- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2de0066f30 msgr2=0x7f2de00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.437+0000 7f2e059b0700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2de0066f30 0x7f2de00693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2df80091e0 tx=0x7f2df801a000 comp rx=0 tx=0).stop 2023-10-09T06:26:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.437+0000 7f2e059b0700 1 -- 172.21.15.31:0/2719173756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e00169f50 msgr2=0x7f2e0015bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.437+0000 7f2e059b0700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e00169f50 0x7f2e0015bdf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2de800e860 tx=0x7f2de8009040 comp rx=0 tx=0).stop 2023-10-09T06:26:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.437+0000 7f2e059b0700 1 -- 172.21.15.31:0/2719173756 shutdown_connections 2023-10-09T06:26:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.437+0000 7f2e059b0700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2de0066f30 0x7f2de00693e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.437+0000 7f2e059b0700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e0015c330 0x7f2e00158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.437+0000 7f2e059b0700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2dec003a90 0x7f2e00155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.437+0000 7f2e059b0700 1 --2- 172.21.15.31:0/2719173756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e00169f50 0x7f2e0015bdf0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.437+0000 7f2e059b0700 1 -- 172.21.15.31:0/2719173756 >> 172.21.15.31:0/2719173756 conn(0x7f2e000d1880 msgr2=0x7f2e000b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:54.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.437+0000 7f2e059b0700 1 -- 172.21.15.31:0/2719173756 shutdown_connections 2023-10-09T06:26:54.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.437+0000 7f2e059b0700 1 -- 172.21.15.31:0/2719173756 wait complete. 2023-10-09T06:26:54.449 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:26:54.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.570+0000 7fda4d764700 1 Processor -- start 2023-10-09T06:26:54.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.570+0000 7fda4d764700 1 -- start start 2023-10-09T06:26:54.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.571+0000 7fda4d764700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda480b6580 0x7fda4806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.571+0000 7fda4d764700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda4806a830 0x7fda480b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.571+0000 7fda4d764700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4806ac90 con 0x7fda480cce30 2023-10-09T06:26:54.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.571+0000 7fda4d764700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda480b4d70 con 0x7fda480b6580 2023-10-09T06:26:54.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.571+0000 7fda4d764700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4815b3b0 con 0x7fda4806a830 2023-10-09T06:26:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.571+0000 7fda477fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda480b6580 0x7fda4806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.571+0000 7fda4cf63700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda4806a830 0x7fda480b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.571+0000 7fda47fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fda480cce30 0x7fda4815aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:46270/0 (socket says 172.21.15.31:46270) 2023-10-09T06:26:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.571+0000 7fda47fff700 1 -- 172.21.15.31:0/954858525 learned_addr learned my addr 172.21.15.31:0/954858525 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.572+0000 7fda477fe700 1 -- 172.21.15.31:0/954858525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda4806a830 msgr2=0x7fda480b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.572+0000 7fda477fe700 1 --2- 172.21.15.31:0/954858525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda4806a830 0x7fda480b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.572+0000 7fda477fe700 1 -- 172.21.15.31:0/954858525 >> v1:172.21.15.158:6789/0 conn(0x7fda480cce30 legacy=0x7fda4815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.572+0000 7fda477fe700 1 -- 172.21.15.31:0/954858525 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda480cd8d0 con 0x7fda480b6580 2023-10-09T06:26:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.572+0000 7fda46ffd700 1 -- 172.21.15.31:0/954858525 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714989770 0 0) 0x7fda3c001110 con 0x7fda480cce30 2023-10-09T06:26:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.572+0000 7fda477fe700 1 --2- 172.21.15.31:0/954858525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda480b6580 0x7fda4806a2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fda380098e0 tx=0x7fda380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c738283552f7089 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.572+0000 7fda46ffd700 1 -- 172.21.15.31:0/954858525 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3800b640 con 0x7fda480b6580 2023-10-09T06:26:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.572+0000 7fda46ffd700 1 -- 172.21.15.31:0/954858525 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3800b7a0 con 0x7fda480b6580 2023-10-09T06:26:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.572+0000 7fda46ffd700 1 -- 172.21.15.31:0/954858525 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3800bb40 con 0x7fda480b6580 2023-10-09T06:26:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.573+0000 7fda4d764700 1 -- 172.21.15.31:0/954858525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda480b6580 msgr2=0x7fda4806a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.573+0000 7fda4d764700 1 --2- 172.21.15.31:0/954858525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda480b6580 0x7fda4806a2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fda380098e0 tx=0x7fda380091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.573+0000 7fda4d764700 1 -- 172.21.15.31:0/954858525 shutdown_connections 2023-10-09T06:26:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.573+0000 7fda4d764700 1 --2- 172.21.15.31:0/954858525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda4806a830 0x7fda480b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.573+0000 7fda4d764700 1 --2- 172.21.15.31:0/954858525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda480b6580 0x7fda4806a2f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.573+0000 7fda4d764700 1 -- 172.21.15.31:0/954858525 >> 172.21.15.31:0/954858525 conn(0x7fda48068cb0 msgr2=0x7fda480690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.573+0000 7fda4d764700 1 -- 172.21.15.31:0/954858525 shutdown_connections 2023-10-09T06:26:54.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.573+0000 7fda4d764700 1 -- 172.21.15.31:0/954858525 wait complete. 2023-10-09T06:26:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.574+0000 7fda4d764700 1 Processor -- start 2023-10-09T06:26:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.574+0000 7fda4d764700 1 -- start start 2023-10-09T06:26:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda4d764700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda4806a830 0x7fda480b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda4d764700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda480b6580 0x7fda4815e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda4d764700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda480cce30 0x7fda4815ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda4d764700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda48155900 con 0x7fda4806a830 2023-10-09T06:26:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda4d764700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda480b16b0 con 0x7fda480b6580 2023-10-09T06:26:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda4d764700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda480b1950 con 0x7fda480cce30 2023-10-09T06:26:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda47fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda4806a830 0x7fda480b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda47fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda4806a830 0x7fda480b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44688/0 (socket says 172.21.15.31:44688) 2023-10-09T06:26:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda47fff700 1 -- 172.21.15.31:0/1835722029 learned_addr learned my addr 172.21.15.31:0/1835722029 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda4cf63700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda480cce30 0x7fda4815ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda477fe700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda480b6580 0x7fda4815e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda47fff700 1 -- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda480cce30 msgr2=0x7fda4815ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda47fff700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda480cce30 0x7fda4815ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda47fff700 1 -- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda480b6580 msgr2=0x7fda4815e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda47fff700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda480b6580 0x7fda4815e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda47fff700 1 -- 172.21.15.31:0/1835722029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda38009420 con 0x7fda4806a830 2023-10-09T06:26:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.575+0000 7fda47fff700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda4806a830 0x7fda480b1170 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00c5b0 tx=0x7fda3c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.576+0000 7fda2ffff700 1 -- 172.21.15.31:0/1835722029 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c005b30 con 0x7fda4806a830 2023-10-09T06:26:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.576+0000 7fda2ffff700 1 -- 172.21.15.31:0/1835722029 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c005c90 con 0x7fda4806a830 2023-10-09T06:26:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.576+0000 7fda4d764700 1 -- 172.21.15.31:0/1835722029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda48155ba0 con 0x7fda4806a830 2023-10-09T06:26:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.576+0000 7fda2ffff700 1 -- 172.21.15.31:0/1835722029 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c007300 con 0x7fda4806a830 2023-10-09T06:26:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.576+0000 7fda4d764700 1 -- 172.21.15.31:0/1835722029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda480b1c30 con 0x7fda4806a830 2023-10-09T06:26:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.576+0000 7fda4d764700 1 -- 172.21.15.31:0/1835722029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4815c370 con 0x7fda4806a830 2023-10-09T06:26:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.577+0000 7fda2ffff700 1 -- 172.21.15.31:0/1835722029 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda3c01b3b0 con 0x7fda4806a830 2023-10-09T06:26:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.577+0000 7fda2ffff700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda34066f30 0x7fda340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.577+0000 7fda2ffff700 1 -- 172.21.15.31:0/1835722029 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda3c083800 con 0x7fda4806a830 2023-10-09T06:26:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.578+0000 7fda477fe700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda34066f30 0x7fda340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.578+0000 7fda477fe700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda34066f30 0x7fda340693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fda380093f0 tx=0x7fda38017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:54.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.582+0000 7fda2ffff700 1 -- 172.21.15.31:0/1835722029 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda3c050a70 con 0x7fda4806a830 2023-10-09T06:26:54.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.772+0000 7fda4d764700 1 -- 172.21.15.31:0/1835722029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda4806ac90 con 0x7fda4806a830 2023-10-09T06:26:54.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.772+0000 7fda2ffff700 1 -- 172.21.15.31:0/1835722029 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v124) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda3c017020 con 0x7fda4806a830 2023-10-09T06:26:54.773 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:26:54.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.774+0000 7fda4d764700 1 -- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda34066f30 msgr2=0x7fda340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.774+0000 7fda4d764700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda34066f30 0x7fda340693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fda380093f0 tx=0x7fda38017000 comp rx=0 tx=0).stop 2023-10-09T06:26:54.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.774+0000 7fda4d764700 1 -- 172.21.15.31:0/1835722029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda4806a830 msgr2=0x7fda480b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.774+0000 7fda4d764700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda4806a830 0x7fda480b1170 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00c5b0 tx=0x7fda3c001070 comp rx=0 tx=0).stop 2023-10-09T06:26:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.774+0000 7fda4d764700 1 -- 172.21.15.31:0/1835722029 shutdown_connections 2023-10-09T06:26:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.774+0000 7fda4d764700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda34066f30 0x7fda340693e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.774+0000 7fda4d764700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda480cce30 0x7fda4815ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.774+0000 7fda4d764700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda4806a830 0x7fda480b1170 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.774+0000 7fda4d764700 1 --2- 172.21.15.31:0/1835722029 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda480b6580 0x7fda4815e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.774+0000 7fda4d764700 1 -- 172.21.15.31:0/1835722029 >> 172.21.15.31:0/1835722029 conn(0x7fda48068cb0 msgr2=0x7fda4815bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.775+0000 7fda4d764700 1 -- 172.21.15.31:0/1835722029 shutdown_connections 2023-10-09T06:26:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.775+0000 7fda4d764700 1 -- 172.21.15.31:0/1835722029 wait complete. 2023-10-09T06:26:54.787 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:26:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.908+0000 7f28273a1700 1 Processor -- start 2023-10-09T06:26:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.908+0000 7f28273a1700 1 -- start start 2023-10-09T06:26:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.909+0000 7f28273a1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2820159ec0 0x7f28200af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.909+0000 7f28273a1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f282015a290 0x7f28200afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.909+0000 7f28273a1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f282006a5a0 0x7f282006aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.909+0000 7f28273a1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282006af60 con 0x7f2820159ec0 2023-10-09T06:26:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.909+0000 7f28273a1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28200b0790 con 0x7f282006a5a0 2023-10-09T06:26:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.909+0000 7f28273a1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28200ce1f0 con 0x7f282015a290 2023-10-09T06:26:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.909+0000 7f282513d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2820159ec0 0x7f28200af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.909+0000 7f282513d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2820159ec0 0x7f28200af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44700/0 (socket says 172.21.15.31:44700) 2023-10-09T06:26:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.910+0000 7f282513d700 1 -- 172.21.15.31:0/3319182460 learned_addr learned my addr 172.21.15.31:0/3319182460 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.910+0000 7f282493c700 1 --2- 172.21.15.31:0/3319182460 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f282015a290 0x7f28200afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.910+0000 7f282593e700 1 --2- 172.21.15.31:0/3319182460 >> v2:172.21.15.158:3300/0 conn(0x7f282006a5a0 0x7f282006aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.910+0000 7f282513d700 1 -- 172.21.15.31:0/3319182460 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f282015a290 msgr2=0x7f28200afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.910+0000 7f282513d700 1 --2- 172.21.15.31:0/3319182460 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f282015a290 0x7f28200afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.910+0000 7f282513d700 1 -- 172.21.15.31:0/3319182460 >> v2:172.21.15.158:3300/0 conn(0x7f282006a5a0 msgr2=0x7f282006aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.910+0000 7f282513d700 1 --2- 172.21.15.31:0/3319182460 >> v2:172.21.15.158:3300/0 conn(0x7f282006a5a0 0x7f282006aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.910+0000 7f282513d700 1 -- 172.21.15.31:0/3319182460 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28200b0b20 con 0x7f2820159ec0 2023-10-09T06:26:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.910+0000 7f282593e700 1 --2- 172.21.15.31:0/3319182460 >> v2:172.21.15.158:3300/0 conn(0x7f282006a5a0 0x7f282006aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.910+0000 7f282513d700 1 --2- 172.21.15.31:0/3319182460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2820159ec0 0x7f28200af940 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f28200b03c0 tx=0x7f2818009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a394ca26ec76d79c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.910+0000 7f281ffff700 1 -- 172.21.15.31:0/3319182460 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281800b860 con 0x7f2820159ec0 2023-10-09T06:26:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.910+0000 7f281ffff700 1 -- 172.21.15.31:0/3319182460 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281800b9c0 con 0x7f2820159ec0 2023-10-09T06:26:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.910+0000 7f281ffff700 1 -- 172.21.15.31:0/3319182460 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281800bd60 con 0x7f2820159ec0 2023-10-09T06:26:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.911+0000 7f28273a1700 1 -- 172.21.15.31:0/3319182460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2820159ec0 msgr2=0x7f28200af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.911+0000 7f28273a1700 1 --2- 172.21.15.31:0/3319182460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2820159ec0 0x7f28200af940 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f28200b03c0 tx=0x7f2818009250 comp rx=0 tx=0).stop 2023-10-09T06:26:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.911+0000 7f28273a1700 1 -- 172.21.15.31:0/3319182460 shutdown_connections 2023-10-09T06:26:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.911+0000 7f28273a1700 1 --2- 172.21.15.31:0/3319182460 >> v2:172.21.15.158:3300/0 conn(0x7f282006a5a0 0x7f282006aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.911+0000 7f28273a1700 1 --2- 172.21.15.31:0/3319182460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2820159ec0 0x7f28200af940 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.911+0000 7f28273a1700 1 --2- 172.21.15.31:0/3319182460 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f282015a290 0x7f28200afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.911+0000 7f28273a1700 1 -- 172.21.15.31:0/3319182460 >> 172.21.15.31:0/3319182460 conn(0x7f28200d1880 msgr2=0x7f28200cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.911+0000 7f28273a1700 1 -- 172.21.15.31:0/3319182460 shutdown_connections 2023-10-09T06:26:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.911+0000 7f28273a1700 1 -- 172.21.15.31:0/3319182460 wait complete. 2023-10-09T06:26:54.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.912+0000 7f28273a1700 1 Processor -- start 2023-10-09T06:26:54.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.912+0000 7f28273a1700 1 -- start start 2023-10-09T06:26:54.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f28273a1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f282006a5a0 0x7f2820152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f28273a1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2820159ec0 0x7f28200b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f28273a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f282015a290 0x7f282014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f28273a1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28200b2030 con 0x7f282015a290 2023-10-09T06:26:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f28273a1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28200b1420 con 0x7f2820159ec0 2023-10-09T06:26:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f28273a1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28200b1700 con 0x7f282006a5a0 2023-10-09T06:26:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f282593e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f282015a290 0x7f282014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f282593e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f282015a290 0x7f282014c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44712/0 (socket says 172.21.15.31:44712) 2023-10-09T06:26:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f282593e700 1 -- 172.21.15.31:0/96935533 learned_addr learned my addr 172.21.15.31:0/96935533 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f282513d700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f282006a5a0 0x7f2820152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f282493c700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2820159ec0 0x7f28200b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f282593e700 1 -- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f282006a5a0 msgr2=0x7f2820152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f282593e700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f282006a5a0 0x7f2820152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f282593e700 1 -- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2820159ec0 msgr2=0x7f28200b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f282593e700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2820159ec0 0x7f28200b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f282593e700 1 -- 172.21.15.31:0/96935533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28180094f0 con 0x7f282015a290 2023-10-09T06:26:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f282493c700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2820159ec0 0x7f28200b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f282593e700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f282015a290 0x7f282014c950 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f281000a380 tx=0x7f2810007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f281d7fa700 1 -- 172.21.15.31:0/96935533 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281000ae10 con 0x7f282015a290 2023-10-09T06:26:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f281d7fa700 1 -- 172.21.15.31:0/96935533 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281000d650 con 0x7f282015a290 2023-10-09T06:26:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.913+0000 7f28273a1700 1 -- 172.21.15.31:0/96935533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28200b19e0 con 0x7f282015a290 2023-10-09T06:26:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.914+0000 7f281d7fa700 1 -- 172.21.15.31:0/96935533 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281000da10 con 0x7f282015a290 2023-10-09T06:26:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.914+0000 7f28273a1700 1 -- 172.21.15.31:0/96935533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28200b2a00 con 0x7f282015a290 2023-10-09T06:26:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.914+0000 7f28273a1700 1 -- 172.21.15.31:0/96935533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28200b21e0 con 0x7f282015a290 2023-10-09T06:26:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.915+0000 7f281d7fa700 1 -- 172.21.15.31:0/96935533 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f281001e3b0 con 0x7f282015a290 2023-10-09T06:26:54.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.915+0000 7f281d7fa700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f280c066f30 0x7f280c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:54.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.915+0000 7f281d7fa700 1 -- 172.21.15.31:0/96935533 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2810084ef0 con 0x7f282015a290 2023-10-09T06:26:54.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.915+0000 7f282513d700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f280c066f30 0x7f280c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:54.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.916+0000 7f282513d700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f280c066f30 0x7f280c0693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f28200b03c0 tx=0x7f2818017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:54.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:54.919+0000 7f281d7fa700 1 -- 172.21.15.31:0/96935533 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28200b21e0 con 0x7f282015a290 2023-10-09T06:26:55.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.113+0000 7f28273a1700 1 -- 172.21.15.31:0/96935533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f282004c3c0 con 0x7f282015a290 2023-10-09T06:26:55.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.113+0000 7f281d7fa700 1 -- 172.21.15.31:0/96935533 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v124) v1 ==== 100+0+11 (secure 0 0 0) 0x7f281001a020 con 0x7f282015a290 2023-10-09T06:26:55.114 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:26:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.115+0000 7f28273a1700 1 -- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f280c066f30 msgr2=0x7f280c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.115+0000 7f28273a1700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f280c066f30 0x7f280c0693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f28200b03c0 tx=0x7f2818017000 comp rx=0 tx=0).stop 2023-10-09T06:26:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.115+0000 7f28273a1700 1 -- 172.21.15.31:0/96935533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f282015a290 msgr2=0x7f282014c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.115+0000 7f28273a1700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f282015a290 0x7f282014c950 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f281000a380 tx=0x7f2810007900 comp rx=0 tx=0).stop 2023-10-09T06:26:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.115+0000 7f28273a1700 1 -- 172.21.15.31:0/96935533 shutdown_connections 2023-10-09T06:26:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.115+0000 7f28273a1700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f280c066f30 0x7f280c0693e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.115+0000 7f28273a1700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f282006a5a0 0x7f2820152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.115+0000 7f28273a1700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f282015a290 0x7f282014c950 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.115+0000 7f28273a1700 1 --2- 172.21.15.31:0/96935533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2820159ec0 0x7f28200b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.115+0000 7f28273a1700 1 -- 172.21.15.31:0/96935533 >> 172.21.15.31:0/96935533 conn(0x7f28200d1880 msgr2=0x7f28200c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.115+0000 7f28273a1700 1 -- 172.21.15.31:0/96935533 shutdown_connections 2023-10-09T06:26:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.115+0000 7f28273a1700 1 -- 172.21.15.31:0/96935533 wait complete. 2023-10-09T06:26:55.128 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:55.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.248+0000 7fbe0e9fc700 1 Processor -- start 2023-10-09T06:26:55.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.248+0000 7fbe0e9fc700 1 -- start start 2023-10-09T06:26:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.248+0000 7fbe0e9fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe080b1220 0x7fbe080c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.248+0000 7fbe0e9fc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbe080cb4f0 0x7fbe080cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.248+0000 7fbe0e9fc700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0815de60 con 0x7fbe080b0e50 2023-10-09T06:26:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.248+0000 7fbe0e9fc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080cbeb0 con 0x7fbe080b1220 2023-10-09T06:26:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.248+0000 7fbe0e9fc700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0815e140 con 0x7fbe080cb4f0 2023-10-09T06:26:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe077fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe080b1220 0x7fbe080c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe07fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbe080b0e50 0x7fbe0806d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33256/0 (socket says 172.21.15.31:33256) 2023-10-09T06:26:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe07fff700 1 -- 172.21.15.31:0/3076819488 learned_addr learned my addr 172.21.15.31:0/3076819488 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe06ffd700 1 -- 172.21.15.31:0/3076819488 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338703639 0 0) 0x7fbe0815de60 con 0x7fbe080b0e50 2023-10-09T06:26:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe06ffd700 1 -- 172.21.15.31:0/3076819488 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf0003570 con 0x7fbe080b0e50 2023-10-09T06:26:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe0cf99700 1 --2- 172.21.15.31:0/3076819488 >> v2:172.21.15.158:3300/0 conn(0x7fbe080cb4f0 0x7fbe080cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe077fe700 1 -- 172.21.15.31:0/3076819488 >> v2:172.21.15.158:3300/0 conn(0x7fbe080cb4f0 msgr2=0x7fbe080cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe077fe700 1 --2- 172.21.15.31:0/3076819488 >> v2:172.21.15.158:3300/0 conn(0x7fbe080cb4f0 0x7fbe080cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe077fe700 1 -- 172.21.15.31:0/3076819488 >> v1:172.21.15.31:6789/0 conn(0x7fbe080b0e50 legacy=0x7fbe0806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe077fe700 1 -- 172.21.15.31:0/3076819488 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0815e420 con 0x7fbe080b1220 2023-10-09T06:26:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe077fe700 1 --2- 172.21.15.31:0/3076819488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe080b1220 0x7fbe080c9180 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fbe0815e9e0 tx=0x7fbdfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2eb6434ec557f29 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe06ffd700 1 -- 172.21.15.31:0/3076819488 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc011630 con 0x7fbe080b1220 2023-10-09T06:26:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe06ffd700 1 -- 172.21.15.31:0/3076819488 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc011790 con 0x7fbe080b1220 2023-10-09T06:26:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.249+0000 7fbe06ffd700 1 -- 172.21.15.31:0/3076819488 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc011b30 con 0x7fbe080b1220 2023-10-09T06:26:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.250+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/3076819488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe080b1220 msgr2=0x7fbe080c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.250+0000 7fbe0e9fc700 1 --2- 172.21.15.31:0/3076819488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe080b1220 0x7fbe080c9180 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fbe0815e9e0 tx=0x7fbdfc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.250+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/3076819488 shutdown_connections 2023-10-09T06:26:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.250+0000 7fbe0e9fc700 1 --2- 172.21.15.31:0/3076819488 >> v2:172.21.15.158:3300/0 conn(0x7fbe080cb4f0 0x7fbe080cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.250+0000 7fbe0e9fc700 1 --2- 172.21.15.31:0/3076819488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe080b1220 0x7fbe080c9180 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.250+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/3076819488 >> 172.21.15.31:0/3076819488 conn(0x7fbe08069870 msgr2=0x7fbe08069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.250+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/3076819488 shutdown_connections 2023-10-09T06:26:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.250+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/3076819488 wait complete. 2023-10-09T06:26:55.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.251+0000 7fbe0e9fc700 1 Processor -- start 2023-10-09T06:26:55.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.251+0000 7fbe0e9fc700 1 -- start start 2023-10-09T06:26:55.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe0e9fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe080b0e50 0x7fbe080c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe0e9fc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbe080b1220 0x7fbe0814d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe0e9fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbe080cb4f0 0x7fbe080b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe0e9fc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080c38e0 con 0x7fbe080b0e50 2023-10-09T06:26:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe0e9fc700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080c4740 con 0x7fbe080cb4f0 2023-10-09T06:26:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe0e9fc700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080c3b30 con 0x7fbe080b1220 2023-10-09T06:26:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe07fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe080b0e50 0x7fbe080c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe07fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe080b0e50 0x7fbe080c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44740/0 (socket says 172.21.15.31:44740) 2023-10-09T06:26:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe07fff700 1 -- 172.21.15.31:0/1384910896 learned_addr learned my addr 172.21.15.31:0/1384910896 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe077fe700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbe080b1220 0x7fbe0814d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe0cf99700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbe080cb4f0 0x7fbe080b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe07fff700 1 -- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbe080b1220 msgr2=0x7fbe0814d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe07fff700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbe080b1220 0x7fbe0814d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe07fff700 1 -- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbe080cb4f0 msgr2=0x7fbe080b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe07fff700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbe080cb4f0 0x7fbe080b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe07fff700 1 -- 172.21.15.31:0/1384910896 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc009420 con 0x7fbe080b0e50 2023-10-09T06:26:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe077fe700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbe080b1220 0x7fbe0814d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.252+0000 7fbe07fff700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe080b0e50 0x7fbe080c4bd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800c7c0 tx=0x7fbdf8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.253+0000 7fbdeffff700 1 -- 172.21.15.31:0/1384910896 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8005b30 con 0x7fbe080b0e50 2023-10-09T06:26:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.253+0000 7fbdeffff700 1 -- 172.21.15.31:0/1384910896 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf8005c90 con 0x7fbe080b0e50 2023-10-09T06:26:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.253+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/1384910896 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe080c3e10 con 0x7fbe080b0e50 2023-10-09T06:26:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.253+0000 7fbdeffff700 1 -- 172.21.15.31:0/1384910896 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8007340 con 0x7fbe080b0e50 2023-10-09T06:26:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.253+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/1384910896 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe080c43d0 con 0x7fbe080b0e50 2023-10-09T06:26:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.254+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/1384910896 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0804c3c0 con 0x7fbe080b0e50 2023-10-09T06:26:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.254+0000 7fbdeffff700 1 -- 172.21.15.31:0/1384910896 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbdf801b400 con 0x7fbe080b0e50 2023-10-09T06:26:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.254+0000 7fbdeffff700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbdf4066f30 0x7fbdf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.255+0000 7fbdeffff700 1 -- 172.21.15.31:0/1384910896 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbdf8084040 con 0x7fbe080b0e50 2023-10-09T06:26:55.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.255+0000 7fbe077fe700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbdf4066f30 0x7fbdf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.255+0000 7fbe077fe700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbdf4066f30 0x7fbdf40693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbe080b1680 tx=0x7fbdfc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:55.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.259+0000 7fbdeffff700 1 -- 172.21.15.31:0/1384910896 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdf8051330 con 0x7fbe080b0e50 2023-10-09T06:26:55.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.497+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/1384910896 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe080c98f0 con 0x7fbe080b0e50 2023-10-09T06:26:55.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.498+0000 7fbdeffff700 1 -- 172.21.15.31:0/1384910896 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fbdf8054950 con 0x7fbe080b0e50 2023-10-09T06:26:55.499 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:55.499 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/487353090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":487353090},{"type":"v1","addr":"172.21.15.158:6837","nonce":487353090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3396628353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3396628353},{"type":"v1","addr":"172.21.15.158:6836","nonce":3396628353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/1862816590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1862816590},{"type":"v1","addr":"172.21.15.31:6833","nonce":1862816590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:26:39.537650+0000","modified":"2023-10-09T06:26:43.150956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4187693404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4187693404},{"type":"v1","addr":"172.21.15.31:6835","nonce":4187693404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T06:26:55.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.500+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbdf4066f30 msgr2=0x7fbdf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.500+0000 7fbe0e9fc700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbdf4066f30 0x7fbdf40693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbe080b1680 tx=0x7fbdfc017000 comp rx=0 tx=0).stop 2023-10-09T06:26:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.500+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/1384910896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe080b0e50 msgr2=0x7fbe080c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.500+0000 7fbe0e9fc700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe080b0e50 0x7fbe080c4bd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800c7c0 tx=0x7fbdf8007e00 comp rx=0 tx=0).stop 2023-10-09T06:26:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.500+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/1384910896 shutdown_connections 2023-10-09T06:26:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.500+0000 7fbe0e9fc700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbdf4066f30 0x7fbdf40693e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.500+0000 7fbe0e9fc700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbe080cb4f0 0x7fbe080b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.500+0000 7fbe0e9fc700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe080b0e50 0x7fbe080c4bd0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.500+0000 7fbe0e9fc700 1 --2- 172.21.15.31:0/1384910896 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbe080b1220 0x7fbe0814d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.500+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/1384910896 >> 172.21.15.31:0/1384910896 conn(0x7fbe08069870 msgr2=0x7fbe080ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:55.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.500+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/1384910896 shutdown_connections 2023-10-09T06:26:55.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.500+0000 7fbe0e9fc700 1 -- 172.21.15.31:0/1384910896 wait complete. 2023-10-09T06:26:55.502 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 58 2023-10-09T06:26:55.512 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:26:55.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.630+0000 7f035f304700 1 Processor -- start 2023-10-09T06:26:55.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.630+0000 7f035f304700 1 -- start start 2023-10-09T06:26:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.631+0000 7f035f304700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03580cdab0 0x7f035815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.631+0000 7f035f304700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03580cb7c0 con 0x7f03580cd6e0 2023-10-09T06:26:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.631+0000 7f035f304700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035815e290 con 0x7f035815dda0 2023-10-09T06:26:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.631+0000 7f035f304700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035815e850 con 0x7f03580cdab0 2023-10-09T06:26:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.631+0000 7f035e302700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f03580cd6e0 0x7f03580cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33272/0 (socket says 172.21.15.31:33272) 2023-10-09T06:26:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.631+0000 7f035e302700 1 -- 172.21.15.31:0/3721607211 learned_addr learned my addr 172.21.15.31:0/3721607211 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.631+0000 7f035db01700 1 --2- 172.21.15.31:0/3721607211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03580cdab0 0x7f035815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.631+0000 7f035d300700 1 -- 172.21.15.31:0/3721607211 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613860041 0 0) 0x7f03580cb7c0 con 0x7f03580cd6e0 2023-10-09T06:26:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.631+0000 7f035d300700 1 -- 172.21.15.31:0/3721607211 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0340003570 con 0x7f03580cd6e0 2023-10-09T06:26:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.632+0000 7f035d300700 1 -- 172.21.15.31:0/3721607211 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201363405 0 0) 0x7f035815e290 con 0x7f035815dda0 2023-10-09T06:26:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.632+0000 7f035d300700 1 -- 172.21.15.31:0/3721607211 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03580cb7c0 con 0x7f035815dda0 2023-10-09T06:26:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.632+0000 7f035db01700 1 -- 172.21.15.31:0/3721607211 >> v1:172.21.15.158:6789/0 conn(0x7f035815dda0 legacy=0x7f035815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.632+0000 7f035db01700 1 -- 172.21.15.31:0/3721607211 >> v1:172.21.15.31:6789/0 conn(0x7f03580cd6e0 legacy=0x7f03580cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.632+0000 7f035db01700 1 -- 172.21.15.31:0/3721607211 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035815e570 con 0x7f03580cdab0 2023-10-09T06:26:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.632+0000 7f035db01700 1 --2- 172.21.15.31:0/3721607211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03580cdab0 0x7f035815d860 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f034c009910 tx=0x7f034c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a19c6a8941bd9990 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.632+0000 7f035d300700 1 -- 172.21.15.31:0/3721607211 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c011630 con 0x7f03580cdab0 2023-10-09T06:26:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.632+0000 7f035d300700 1 -- 172.21.15.31:0/3721607211 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c011790 con 0x7f03580cdab0 2023-10-09T06:26:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.632+0000 7f035d300700 1 -- 172.21.15.31:0/3721607211 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c011b30 con 0x7f03580cdab0 2023-10-09T06:26:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.633+0000 7f035f304700 1 -- 172.21.15.31:0/3721607211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03580cdab0 msgr2=0x7f035815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.633+0000 7f035f304700 1 --2- 172.21.15.31:0/3721607211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03580cdab0 0x7f035815d860 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f034c009910 tx=0x7f034c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.633+0000 7f035f304700 1 -- 172.21.15.31:0/3721607211 shutdown_connections 2023-10-09T06:26:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.633+0000 7f035f304700 1 --2- 172.21.15.31:0/3721607211 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f03580cdab0 0x7f035815d860 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.633+0000 7f035f304700 1 -- 172.21.15.31:0/3721607211 >> 172.21.15.31:0/3721607211 conn(0x7f0358067660 msgr2=0x7f0358067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.633+0000 7f035f304700 1 -- 172.21.15.31:0/3721607211 shutdown_connections 2023-10-09T06:26:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.633+0000 7f035f304700 1 -- 172.21.15.31:0/3721607211 wait complete. 2023-10-09T06:26:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.634+0000 7f035f304700 1 Processor -- start 2023-10-09T06:26:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.634+0000 7f035f304700 1 -- start start 2023-10-09T06:26:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035f304700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03580cd6e0 0x7f0358139a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035f304700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03580cdab0 0x7f035816e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035f304700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f035815dda0 0x7f035816e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035f304700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03580cc360 con 0x7f03580cd6e0 2023-10-09T06:26:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035f304700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03580b2a40 con 0x7f03580cdab0 2023-10-09T06:26:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035f304700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03580b1e30 con 0x7f035815dda0 2023-10-09T06:26:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035e302700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03580cd6e0 0x7f0358139a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035e302700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03580cd6e0 0x7f0358139a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44756/0 (socket says 172.21.15.31:44756) 2023-10-09T06:26:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035e302700 1 -- 172.21.15.31:0/1039807388 learned_addr learned my addr 172.21.15.31:0/1039807388 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035eb03700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f035815dda0 0x7f035816e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035db01700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03580cdab0 0x7f035816e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035e302700 1 -- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f035815dda0 msgr2=0x7f035816e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035e302700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f035815dda0 0x7f035816e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035e302700 1 -- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03580cdab0 msgr2=0x7f035816e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035e302700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03580cdab0 0x7f035816e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035e302700 1 -- 172.21.15.31:0/1039807388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c009420 con 0x7f03580cd6e0 2023-10-09T06:26:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035e302700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03580cd6e0 0x7f0358139a50 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f035000c790 tx=0x7f0350007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f03567fc700 1 -- 172.21.15.31:0/1039807388 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350005b30 con 0x7f03580cd6e0 2023-10-09T06:26:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f03567fc700 1 -- 172.21.15.31:0/1039807388 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0350005c90 con 0x7f03580cd6e0 2023-10-09T06:26:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035f304700 1 -- 172.21.15.31:0/1039807388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03580b2110 con 0x7f03580cd6e0 2023-10-09T06:26:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f03567fc700 1 -- 172.21.15.31:0/1039807388 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350007300 con 0x7f03580cd6e0 2023-10-09T06:26:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.635+0000 7f035f304700 1 -- 172.21.15.31:0/1039807388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03580b26d0 con 0x7f03580cd6e0 2023-10-09T06:26:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.636+0000 7f035f304700 1 -- 172.21.15.31:0/1039807388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0358089280 con 0x7f03580cd6e0 2023-10-09T06:26:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.637+0000 7f03567fc700 1 -- 172.21.15.31:0/1039807388 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f035001b400 con 0x7f03580cd6e0 2023-10-09T06:26:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.637+0000 7f03567fc700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0344066f30 0x7f03440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.637+0000 7f03567fc700 1 -- 172.21.15.31:0/1039807388 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0350084060 con 0x7f03580cd6e0 2023-10-09T06:26:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.637+0000 7f035db01700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0344066f30 0x7f03440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.638+0000 7f035db01700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0344066f30 0x7f03440693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f034c009860 tx=0x7f034c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.642+0000 7f03567fc700 1 -- 172.21.15.31:0/1039807388 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0350054e90 con 0x7f03580cd6e0 2023-10-09T06:26:55.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.834+0000 7f035f304700 1 -- 172.21.15.31:0/1039807388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03580b43a0 con 0x7f03580cd6e0 2023-10-09T06:26:55.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.835+0000 7f03567fc700 1 -- 172.21.15.31:0/1039807388 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f03500076f0 con 0x7f03580cd6e0 2023-10-09T06:26:55.835 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:55.835 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":124,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:26:51.181527+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:26:37.944788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T06:26:38.507409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:26:55.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.836+0000 7f035f304700 1 -- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0344066f30 msgr2=0x7f03440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.836+0000 7f035f304700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0344066f30 0x7f03440693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f034c009860 tx=0x7f034c017000 comp rx=0 tx=0).stop 2023-10-09T06:26:55.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.836+0000 7f035f304700 1 -- 172.21.15.31:0/1039807388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03580cd6e0 msgr2=0x7f0358139a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.836+0000 7f035f304700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03580cd6e0 0x7f0358139a50 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f035000c790 tx=0x7f0350007ea0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.836+0000 7f035f304700 1 -- 172.21.15.31:0/1039807388 shutdown_connections 2023-10-09T06:26:55.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.836+0000 7f035f304700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0344066f30 0x7f03440693e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.836+0000 7f035f304700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f035815dda0 0x7f035816e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.836+0000 7f035f304700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03580cd6e0 0x7f0358139a50 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.836+0000 7f035f304700 1 --2- 172.21.15.31:0/1039807388 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03580cdab0 0x7f035816e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.836+0000 7f035f304700 1 -- 172.21.15.31:0/1039807388 >> 172.21.15.31:0/1039807388 conn(0x7f0358067660 msgr2=0x7f03580b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:55.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.837+0000 7f035f304700 1 -- 172.21.15.31:0/1039807388 shutdown_connections 2023-10-09T06:26:55.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.837+0000 7f035f304700 1 -- 172.21.15.31:0/1039807388 wait complete. 2023-10-09T06:26:55.849 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:26:55.849 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:55.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.968+0000 7f560759e700 1 Processor -- start 2023-10-09T06:26:55.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.968+0000 7f560759e700 1 -- start start 2023-10-09T06:26:55.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f560759e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5608159f10 0x7f56080c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f560759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f560815a2e0 0x7f56080cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f560759e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560815a730 con 0x7f56080cc240 2023-10-09T06:26:55.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f560759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56080ae320 con 0x7f560815a2e0 2023-10-09T06:26:55.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f560759e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080ad710 con 0x7f5608159f10 2023-10-09T06:26:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f5605d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f560815a2e0 0x7f56080cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f5606d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f56080cc240 0x7f56080ae7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33280/0 (socket says 172.21.15.31:33280) 2023-10-09T06:26:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f5605d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f560815a2e0 0x7f56080cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44768/0 (socket says 172.21.15.31:44768) 2023-10-09T06:26:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f5606d9d700 1 -- 172.21.15.31:0/4094860683 learned_addr learned my addr 172.21.15.31:0/4094860683 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:26:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f560659c700 1 --2- 172.21.15.31:0/4094860683 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5608159f10 0x7f56080c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f5605d9b700 1 -- 172.21.15.31:0/4094860683 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5608159f10 msgr2=0x7f56080c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f5605d9b700 1 --2- 172.21.15.31:0/4094860683 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5608159f10 0x7f56080c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f5605d9b700 1 -- 172.21.15.31:0/4094860683 >> v1:172.21.15.31:6789/0 conn(0x7f56080cc240 legacy=0x7f56080ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f5605d9b700 1 -- 172.21.15.31:0/4094860683 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56080ad9f0 con 0x7f560815a2e0 2023-10-09T06:26:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.969+0000 7f560559a700 1 -- 172.21.15.31:0/4094860683 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928298810 0 0) 0x7f55f8001110 con 0x7f56080cc240 2023-10-09T06:26:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.970+0000 7f5605d9b700 1 --2- 172.21.15.31:0/4094860683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f560815a2e0 0x7f56080cbd00 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f55f00098e0 tx=0x7f55f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ec8e7c034e61d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.970+0000 7f560559a700 1 -- 172.21.15.31:0/4094860683 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0009e80 con 0x7f560815a2e0 2023-10-09T06:26:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.970+0000 7f560559a700 1 -- 172.21.15.31:0/4094860683 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f000b860 con 0x7f560815a2e0 2023-10-09T06:26:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.970+0000 7f560559a700 1 -- 172.21.15.31:0/4094860683 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f000bbe0 con 0x7f560815a2e0 2023-10-09T06:26:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.970+0000 7f560759e700 1 -- 172.21.15.31:0/4094860683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f560815a2e0 msgr2=0x7f56080cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.970+0000 7f560759e700 1 --2- 172.21.15.31:0/4094860683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f560815a2e0 0x7f56080cbd00 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f55f00098e0 tx=0x7f55f00091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.970+0000 7f560759e700 1 -- 172.21.15.31:0/4094860683 shutdown_connections 2023-10-09T06:26:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.970+0000 7f560759e700 1 --2- 172.21.15.31:0/4094860683 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5608159f10 0x7f56080c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.970+0000 7f560759e700 1 --2- 172.21.15.31:0/4094860683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f560815a2e0 0x7f56080cbd00 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.970+0000 7f560759e700 1 -- 172.21.15.31:0/4094860683 >> 172.21.15.31:0/4094860683 conn(0x7f5608067e40 msgr2=0x7f56080d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.970+0000 7f560759e700 1 -- 172.21.15.31:0/4094860683 shutdown_connections 2023-10-09T06:26:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.970+0000 7f560759e700 1 -- 172.21.15.31:0/4094860683 wait complete. 2023-10-09T06:26:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.971+0000 7f560759e700 1 Processor -- start 2023-10-09T06:26:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.972+0000 7f560759e700 1 -- start start 2023-10-09T06:26:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.972+0000 7f560759e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56080cc240 0x7f5608157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.972+0000 7f560759e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5608159f10 0x7f5608155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.972+0000 7f560759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f560815a2e0 0x7f5608156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.972+0000 7f560759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080b39e0 con 0x7f560815a2e0 2023-10-09T06:26:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.972+0000 7f560759e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080b4280 con 0x7f56080cc240 2023-10-09T06:26:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.972+0000 7f560759e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c8c50 con 0x7f5608159f10 2023-10-09T06:26:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.972+0000 7f5606d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f560815a2e0 0x7f5608156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.972+0000 7f5606d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f560815a2e0 0x7f5608156080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44784/0 (socket says 172.21.15.31:44784) 2023-10-09T06:26:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.972+0000 7f5606d9d700 1 -- 172.21.15.31:0/3022541385 learned_addr learned my addr 172.21.15.31:0/3022541385 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.972+0000 7f5605d9b700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5608159f10 0x7f5608155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.972+0000 7f560659c700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56080cc240 0x7f5608157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.973+0000 7f5606d9d700 1 -- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5608159f10 msgr2=0x7f5608155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.973+0000 7f5606d9d700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5608159f10 0x7f5608155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.973+0000 7f5606d9d700 1 -- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56080cc240 msgr2=0x7f5608157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.973+0000 7f5606d9d700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56080cc240 0x7f5608157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.973+0000 7f5606d9d700 1 -- 172.21.15.31:0/3022541385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0009420 con 0x7f560815a2e0 2023-10-09T06:26:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.973+0000 7f560659c700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56080cc240 0x7f5608157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:26:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.973+0000 7f5606d9d700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f560815a2e0 0x7f5608156080 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f55f800c840 tx=0x7f55f8007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.973+0000 7f55fe7fc700 1 -- 172.21.15.31:0/3022541385 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8005b30 con 0x7f560815a2e0 2023-10-09T06:26:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.973+0000 7f55fe7fc700 1 -- 172.21.15.31:0/3022541385 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f8005c90 con 0x7f560815a2e0 2023-10-09T06:26:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.973+0000 7f560759e700 1 -- 172.21.15.31:0/3022541385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56080b3c30 con 0x7f560815a2e0 2023-10-09T06:26:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.973+0000 7f55fe7fc700 1 -- 172.21.15.31:0/3022541385 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8004a80 con 0x7f560815a2e0 2023-10-09T06:26:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.973+0000 7f560759e700 1 -- 172.21.15.31:0/3022541385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5608158520 con 0x7f560815a2e0 2023-10-09T06:26:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.974+0000 7f560759e700 1 -- 172.21.15.31:0/3022541385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5608089300 con 0x7f560815a2e0 2023-10-09T06:26:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.974+0000 7f55fe7fc700 1 -- 172.21.15.31:0/3022541385 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55f8005030 con 0x7f560815a2e0 2023-10-09T06:26:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.975+0000 7f55fe7fc700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55e8066f30 0x7f55e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.975+0000 7f55fe7fc700 1 -- 172.21.15.31:0/3022541385 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55f8083cb0 con 0x7f560815a2e0 2023-10-09T06:26:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.975+0000 7f560659c700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55e8066f30 0x7f55e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.975+0000 7f560659c700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55e8066f30 0x7f55e80693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f56000075e0 tx=0x7f56000097e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:55.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:55.979+0000 7f55fe7fc700 1 -- 172.21.15.31:0/3022541385 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55f8050f20 con 0x7f560815a2e0 2023-10-09T06:26:56.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.218+0000 7f560759e700 1 -- 172.21.15.31:0/3022541385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f560815a730 con 0x7f560815a2e0 2023-10-09T06:26:56.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.218+0000 7f55fe7fc700 1 -- 172.21.15.31:0/3022541385 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f560815a730 con 0x7f560815a2e0 2023-10-09T06:26:56.219 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:56.219 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/487353090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":487353090},{"type":"v1","addr":"172.21.15.158:6837","nonce":487353090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3396628353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3396628353},{"type":"v1","addr":"172.21.15.158:6836","nonce":3396628353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/1862816590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1862816590},{"type":"v1","addr":"172.21.15.31:6833","nonce":1862816590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:26:39.537650+0000","modified":"2023-10-09T06:26:43.150956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4187693404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4187693404},{"type":"v1","addr":"172.21.15.31:6835","nonce":4187693404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T06:26:56.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.220+0000 7f560759e700 1 -- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55e8066f30 msgr2=0x7f55e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.220+0000 7f560759e700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55e8066f30 0x7f55e80693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f56000075e0 tx=0x7f56000097e0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.220+0000 7f560759e700 1 -- 172.21.15.31:0/3022541385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f560815a2e0 msgr2=0x7f5608156080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.220+0000 7f560759e700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f560815a2e0 0x7f5608156080 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f55f800c840 tx=0x7f55f8007bd0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.220+0000 7f560759e700 1 -- 172.21.15.31:0/3022541385 shutdown_connections 2023-10-09T06:26:56.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.220+0000 7f560759e700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55e8066f30 0x7f55e80693e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.220+0000 7f560759e700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f560815a2e0 0x7f5608156080 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.220+0000 7f560759e700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56080cc240 0x7f5608157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.220+0000 7f560759e700 1 --2- 172.21.15.31:0/3022541385 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5608159f10 0x7f5608155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.220+0000 7f560759e700 1 -- 172.21.15.31:0/3022541385 >> 172.21.15.31:0/3022541385 conn(0x7f5608067e40 msgr2=0x7f56080c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:56.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.220+0000 7f560759e700 1 -- 172.21.15.31:0/3022541385 shutdown_connections 2023-10-09T06:26:56.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.220+0000 7f560759e700 1 -- 172.21.15.31:0/3022541385 wait complete. 2023-10-09T06:26:56.222 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 58 2023-10-09T06:26:56.233 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:26:56.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.350+0000 7fc5dff31700 1 Processor -- start 2023-10-09T06:26:56.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.351+0000 7fc5dff31700 1 -- start start 2023-10-09T06:26:56.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dff31700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5d815a620 0x7fc5d815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:56.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dff31700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5d815d580 0x7fc5d8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:56.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dff31700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d815cbb0 con 0x7fc5d8157870 2023-10-09T06:26:56.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dff31700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d815bdb0 con 0x7fc5d815a620 2023-10-09T06:26:56.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dff31700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d815bfa0 con 0x7fc5d815d580 2023-10-09T06:26:56.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dd4cc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5d815a620 0x7fc5d815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:56.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dd4cc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5d815a620 0x7fc5d815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44800/0 (socket says 172.21.15.31:44800) 2023-10-09T06:26:56.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dd4cc700 1 -- 172.21.15.31:0/2972947071 learned_addr learned my addr 172.21.15.31:0/2972947071 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:56.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5de4ce700 1 --2- 172.21.15.31:0/2972947071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5d815d580 0x7fc5d8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:56.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dd4cc700 1 -- 172.21.15.31:0/2972947071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5d815d580 msgr2=0x7fc5d8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:56.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dd4cc700 1 --2- 172.21.15.31:0/2972947071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5d815d580 0x7fc5d8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dd4cc700 1 -- 172.21.15.31:0/2972947071 >> v1:172.21.15.158:6789/0 conn(0x7fc5d8157870 legacy=0x7fc5d815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dd4cc700 1 -- 172.21.15.31:0/2972947071 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d815c280 con 0x7fc5d815a620 2023-10-09T06:26:56.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dd4cc700 1 --2- 172.21.15.31:0/2972947071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5d815a620 0x7fc5d815d040 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0099b0 tx=0x7fc5cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e850a6046c5b889 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:56.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dcccb700 1 -- 172.21.15.31:0/2972947071 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc009ea0 con 0x7fc5d815a620 2023-10-09T06:26:56.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dcccb700 1 -- 172.21.15.31:0/2972947071 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc00b860 con 0x7fc5d815a620 2023-10-09T06:26:56.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.352+0000 7fc5dcccb700 1 -- 172.21.15.31:0/2972947071 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc00bc00 con 0x7fc5d815a620 2023-10-09T06:26:56.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.353+0000 7fc5dff31700 1 -- 172.21.15.31:0/2972947071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5d815a620 msgr2=0x7fc5d815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.353+0000 7fc5dff31700 1 --2- 172.21.15.31:0/2972947071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5d815a620 0x7fc5d815d040 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0099b0 tx=0x7fc5cc009250 comp rx=0 tx=0).stop 2023-10-09T06:26:56.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.353+0000 7fc5dff31700 1 -- 172.21.15.31:0/2972947071 shutdown_connections 2023-10-09T06:26:56.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.353+0000 7fc5dff31700 1 --2- 172.21.15.31:0/2972947071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5d815d580 0x7fc5d8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.353+0000 7fc5dff31700 1 --2- 172.21.15.31:0/2972947071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5d815a620 0x7fc5d815d040 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.353+0000 7fc5dff31700 1 -- 172.21.15.31:0/2972947071 >> 172.21.15.31:0/2972947071 conn(0x7fc5d8068ce0 msgr2=0x7fc5d80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:56.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.353+0000 7fc5dff31700 1 -- 172.21.15.31:0/2972947071 shutdown_connections 2023-10-09T06:26:56.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.353+0000 7fc5dff31700 1 -- 172.21.15.31:0/2972947071 wait complete. 2023-10-09T06:26:56.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.354+0000 7fc5dff31700 1 Processor -- start 2023-10-09T06:26:56.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.354+0000 7fc5dff31700 1 -- start start 2023-10-09T06:26:56.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5dff31700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5d8157870 0x7fc5d80b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:56.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5dff31700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5d815a620 0x7fc5d8153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:56.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5dff31700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5d815d580 0x7fc5d8150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:56.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5dff31700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d8152a50 con 0x7fc5d815d580 2023-10-09T06:26:56.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5dff31700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80b1940 con 0x7fc5d8157870 2023-10-09T06:26:56.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5dff31700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80b0d30 con 0x7fc5d815a620 2023-10-09T06:26:56.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5de4ce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5d815d580 0x7fc5d8150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:56.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5de4ce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5d815d580 0x7fc5d8150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44814/0 (socket says 172.21.15.31:44814) 2023-10-09T06:26:56.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5de4ce700 1 -- 172.21.15.31:0/2019761379 learned_addr learned my addr 172.21.15.31:0/2019761379 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:56.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5ddccd700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5d8157870 0x7fc5d80b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:56.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5dd4cc700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5d815a620 0x7fc5d8153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5de4ce700 1 -- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5d815a620 msgr2=0x7fc5d8153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5de4ce700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5d815a620 0x7fc5d8153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5de4ce700 1 -- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5d8157870 msgr2=0x7fc5d80b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5de4ce700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5d8157870 0x7fc5d80b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5de4ce700 1 -- 172.21.15.31:0/2019761379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc0094f0 con 0x7fc5d815d580 2023-10-09T06:26:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.355+0000 7fc5de4ce700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5d815d580 0x7fc5d8150c70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009d70 tx=0x7fc5c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.356+0000 7fc5d5ffb700 1 -- 172.21.15.31:0/2019761379 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800caa0 con 0x7fc5d815d580 2023-10-09T06:26:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.356+0000 7fc5d5ffb700 1 -- 172.21.15.31:0/2019761379 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c800f040 con 0x7fc5d815d580 2023-10-09T06:26:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.356+0000 7fc5dff31700 1 -- 172.21.15.31:0/2019761379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d80b1010 con 0x7fc5d815d580 2023-10-09T06:26:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.356+0000 7fc5d5ffb700 1 -- 172.21.15.31:0/2019761379 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800ce50 con 0x7fc5d815d580 2023-10-09T06:26:56.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.356+0000 7fc5dff31700 1 -- 172.21.15.31:0/2019761379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d80b15d0 con 0x7fc5d815d580 2023-10-09T06:26:56.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.357+0000 7fc5dff31700 1 -- 172.21.15.31:0/2019761379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d80b1ab0 con 0x7fc5d815d580 2023-10-09T06:26:56.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.357+0000 7fc5d5ffb700 1 -- 172.21.15.31:0/2019761379 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5c8014690 con 0x7fc5d815d580 2023-10-09T06:26:56.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.357+0000 7fc5d5ffb700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc5c4066f30 0x7fc5c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:56.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.358+0000 7fc5d5ffb700 1 -- 172.21.15.31:0/2019761379 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5c8085030 con 0x7fc5d815d580 2023-10-09T06:26:56.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.358+0000 7fc5ddccd700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc5c4066f30 0x7fc5c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:56.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.358+0000 7fc5ddccd700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc5c4066f30 0x7fc5c40693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0003a80 tx=0x7fc5d0007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:56.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.362+0000 7fc5d5ffb700 1 -- 172.21.15.31:0/2019761379 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5c80522a0 con 0x7fc5d815d580 2023-10-09T06:26:56.475 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:26:56.478 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:26:56.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.600+0000 7fc5dff31700 1 -- 172.21.15.31:0/2019761379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5d804c3c0 con 0x7fc5d815d580 2023-10-09T06:26:56.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.601+0000 7fc5d5ffb700 1 -- 172.21.15.31:0/2019761379 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fc5c80558c0 con 0x7fc5d815d580 2023-10-09T06:26:56.602 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:56.602 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/487353090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":487353090},{"type":"v1","addr":"172.21.15.158:6837","nonce":487353090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3396628353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3396628353},{"type":"v1","addr":"172.21.15.158:6836","nonce":3396628353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/1862816590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1862816590},{"type":"v1","addr":"172.21.15.31:6833","nonce":1862816590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:26:39.537650+0000","modified":"2023-10-09T06:26:43.150956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4187693404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4187693404},{"type":"v1","addr":"172.21.15.31:6835","nonce":4187693404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T06:26:56.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.603+0000 7fc5dff31700 1 -- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc5c4066f30 msgr2=0x7fc5c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.603+0000 7fc5dff31700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc5c4066f30 0x7fc5c40693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0003a80 tx=0x7fc5d0007ec0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.603+0000 7fc5dff31700 1 -- 172.21.15.31:0/2019761379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5d815d580 msgr2=0x7fc5d8150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.603+0000 7fc5dff31700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5d815d580 0x7fc5d8150c70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009d70 tx=0x7fc5c800b040 comp rx=0 tx=0).stop 2023-10-09T06:26:56.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.603+0000 7fc5dff31700 1 -- 172.21.15.31:0/2019761379 shutdown_connections 2023-10-09T06:26:56.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.603+0000 7fc5dff31700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc5c4066f30 0x7fc5c40693e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.603+0000 7fc5dff31700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5d815d580 0x7fc5d8150c70 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.603+0000 7fc5dff31700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5d8157870 0x7fc5d80b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.603+0000 7fc5dff31700 1 --2- 172.21.15.31:0/2019761379 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc5d815a620 0x7fc5d8153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.603+0000 7fc5dff31700 1 -- 172.21.15.31:0/2019761379 >> 172.21.15.31:0/2019761379 conn(0x7fc5d8068ce0 msgr2=0x7fc5d81599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:56.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.603+0000 7fc5dff31700 1 -- 172.21.15.31:0/2019761379 shutdown_connections 2023-10-09T06:26:56.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.603+0000 7fc5dff31700 1 -- 172.21.15.31:0/2019761379 wait complete. 2023-10-09T06:26:56.605 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 58 2023-10-09T06:26:56.616 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:26:56.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.734+0000 7fee8622e700 1 Processor -- start 2023-10-09T06:26:56.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.734+0000 7fee8622e700 1 -- start start 2023-10-09T06:26:56.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee8622e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fee800d1c30 0x7fee800ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee8622e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fee8015a680 0x7fee800cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee8622e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee800c5d80 con 0x7fee8015a2b0 2023-10-09T06:26:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee8622e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee80068470 con 0x7fee8015a680 2023-10-09T06:26:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee8622e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee800c6060 con 0x7fee800d1c30 2023-10-09T06:26:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee7ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fee8015a680 0x7fee800cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee7ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fee8015a680 0x7fee800cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44828/0 (socket says 172.21.15.31:44828) 2023-10-09T06:26:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee7ffff700 1 -- 172.21.15.31:0/2294496671 learned_addr learned my addr 172.21.15.31:0/2294496671 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee7effd700 1 --2- 172.21.15.31:0/2294496671 >> v2:172.21.15.158:3300/0 conn(0x7fee800d1c30 0x7fee800ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee7ffff700 1 -- 172.21.15.31:0/2294496671 >> v2:172.21.15.158:3300/0 conn(0x7fee800d1c30 msgr2=0x7fee800ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee7ffff700 1 --2- 172.21.15.31:0/2294496671 >> v2:172.21.15.158:3300/0 conn(0x7fee800d1c30 0x7fee800ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee7ffff700 1 -- 172.21.15.31:0/2294496671 >> v1:172.21.15.158:6789/0 conn(0x7fee8015a2b0 legacy=0x7fee800b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee7ffff700 1 -- 172.21.15.31:0/2294496671 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee800c6340 con 0x7fee8015a680 2023-10-09T06:26:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee7ffff700 1 --2- 172.21.15.31:0/2294496671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee8015a680 0x7fee800cf710 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fee80089190 tx=0x7fee78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12ef4713eab803f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee7e7fc700 1 -- 172.21.15.31:0/2294496671 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7800e070 con 0x7fee8015a680 2023-10-09T06:26:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee7e7fc700 1 -- 172.21.15.31:0/2294496671 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7800ba50 con 0x7fee8015a680 2023-10-09T06:26:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.735+0000 7fee7e7fc700 1 -- 172.21.15.31:0/2294496671 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee780092e0 con 0x7fee8015a680 2023-10-09T06:26:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.736+0000 7fee8622e700 1 -- 172.21.15.31:0/2294496671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee8015a680 msgr2=0x7fee800cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.736+0000 7fee8622e700 1 --2- 172.21.15.31:0/2294496671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee8015a680 0x7fee800cf710 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fee80089190 tx=0x7fee78009840 comp rx=0 tx=0).stop 2023-10-09T06:26:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.736+0000 7fee8622e700 1 -- 172.21.15.31:0/2294496671 shutdown_connections 2023-10-09T06:26:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.736+0000 7fee8622e700 1 --2- 172.21.15.31:0/2294496671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee8015a680 0x7fee800cf710 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.736+0000 7fee8622e700 1 --2- 172.21.15.31:0/2294496671 >> v2:172.21.15.158:3300/0 conn(0x7fee800d1c30 0x7fee800ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.736+0000 7fee8622e700 1 -- 172.21.15.31:0/2294496671 >> 172.21.15.31:0/2294496671 conn(0x7fee80067e40 msgr2=0x7fee800d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:56.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.736+0000 7fee8622e700 1 -- 172.21.15.31:0/2294496671 shutdown_connections 2023-10-09T06:26:56.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.736+0000 7fee8622e700 1 -- 172.21.15.31:0/2294496671 wait complete. 2023-10-09T06:26:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.737+0000 7fee8622e700 1 Processor -- start 2023-10-09T06:26:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.737+0000 7fee8622e700 1 -- start start 2023-10-09T06:26:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.738+0000 7fee8622e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800d1c30 0x7fee8015e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.738+0000 7fee8622e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee8015a2b0 0x7fee800c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.738+0000 7fee8622e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fee8015a680 0x7fee80144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.738+0000 7fee8622e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee800c8cc0 con 0x7fee800d1c30 2023-10-09T06:26:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.738+0000 7fee8622e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee800c9ae0 con 0x7fee8015a2b0 2023-10-09T06:26:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.738+0000 7fee8622e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee800c8ed0 con 0x7fee8015a680 2023-10-09T06:26:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.738+0000 7fee7f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800d1c30 0x7fee8015e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.738+0000 7fee7f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800d1c30 0x7fee8015e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44836/0 (socket says 172.21.15.31:44836) 2023-10-09T06:26:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.738+0000 7fee7f7fe700 1 -- 172.21.15.31:0/1740176728 learned_addr learned my addr 172.21.15.31:0/1740176728 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.738+0000 7fee7effd700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee8015a2b0 0x7fee800c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.738+0000 7fee7ffff700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fee8015a680 0x7fee80144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.738+0000 7fee7f7fe700 1 -- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fee8015a680 msgr2=0x7fee80144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.739+0000 7fee7f7fe700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fee8015a680 0x7fee80144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.739+0000 7fee7f7fe700 1 -- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee8015a2b0 msgr2=0x7fee800c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.739+0000 7fee7f7fe700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee8015a2b0 0x7fee800c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.739+0000 7fee7f7fe700 1 -- 172.21.15.31:0/1740176728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78009ae0 con 0x7fee800d1c30 2023-10-09T06:26:56.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.739+0000 7fee7f7fe700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800d1c30 0x7fee8015e460 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c540 tx=0x7fee70001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:56.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.739+0000 7fee677fe700 1 -- 172.21.15.31:0/1740176728 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70011590 con 0x7fee800d1c30 2023-10-09T06:26:56.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.739+0000 7fee677fe700 1 -- 172.21.15.31:0/1740176728 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee700116f0 con 0x7fee800d1c30 2023-10-09T06:26:56.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.739+0000 7fee8622e700 1 -- 172.21.15.31:0/1740176728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee800c91b0 con 0x7fee800d1c30 2023-10-09T06:26:56.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.739+0000 7fee677fe700 1 -- 172.21.15.31:0/1740176728 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70011ab0 con 0x7fee800d1c30 2023-10-09T06:26:56.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.739+0000 7fee8622e700 1 -- 172.21.15.31:0/1740176728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee800c9770 con 0x7fee800d1c30 2023-10-09T06:26:56.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.740+0000 7fee8622e700 1 -- 172.21.15.31:0/1740176728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8004c3c0 con 0x7fee800d1c30 2023-10-09T06:26:56.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.740+0000 7fee677fe700 1 -- 172.21.15.31:0/1740176728 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee7001b3b0 con 0x7fee800d1c30 2023-10-09T06:26:56.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.741+0000 7fee677fe700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fee6c066f30 0x7fee6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:56.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.741+0000 7fee677fe700 1 -- 172.21.15.31:0/1740176728 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee70083810 con 0x7fee800d1c30 2023-10-09T06:26:56.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.741+0000 7fee7effd700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fee6c066f30 0x7fee6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:56.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.741+0000 7fee7effd700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fee6c066f30 0x7fee6c0693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fee8009ee40 tx=0x7fee74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.745+0000 7fee677fe700 1 -- 172.21.15.31:0/1740176728 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee70050b30 con 0x7fee800d1c30 2023-10-09T06:26:56.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.936+0000 7fee8622e700 1 -- 172.21.15.31:0/1740176728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee800c7dd0 con 0x7fee800d1c30 2023-10-09T06:26:56.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.937+0000 7fee677fe700 1 -- 172.21.15.31:0/1740176728 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+15372 (secure 0 0 0) 0x7fee70017070 con 0x7fee800d1c30 2023-10-09T06:26:56.937 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:26:56.938 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":124,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:26:51.181527+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:26:37.944788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T06:26:38.507409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:26:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.939+0000 7fee8622e700 1 -- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fee6c066f30 msgr2=0x7fee6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.939+0000 7fee8622e700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fee6c066f30 0x7fee6c0693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fee8009ee40 tx=0x7fee74008040 comp rx=0 tx=0).stop 2023-10-09T06:26:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.939+0000 7fee8622e700 1 -- 172.21.15.31:0/1740176728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800d1c30 msgr2=0x7fee8015e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.939+0000 7fee8622e700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800d1c30 0x7fee8015e460 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c540 tx=0x7fee70001070 comp rx=0 tx=0).stop 2023-10-09T06:26:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.939+0000 7fee8622e700 1 -- 172.21.15.31:0/1740176728 shutdown_connections 2023-10-09T06:26:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.939+0000 7fee8622e700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fee6c066f30 0x7fee6c0693e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.939+0000 7fee8622e700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fee8015a680 0x7fee80144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.939+0000 7fee8622e700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800d1c30 0x7fee8015e460 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.939+0000 7fee8622e700 1 --2- 172.21.15.31:0/1740176728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee8015a2b0 0x7fee800c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.939+0000 7fee8622e700 1 -- 172.21.15.31:0/1740176728 >> 172.21.15.31:0/1740176728 conn(0x7fee80067e40 msgr2=0x7fee8006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.939+0000 7fee8622e700 1 -- 172.21.15.31:0/1740176728 shutdown_connections 2023-10-09T06:26:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:56.939+0000 7fee8622e700 1 -- 172.21.15.31:0/1740176728 wait complete. 2023-10-09T06:26:56.952 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:26:57.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.071+0000 7f731453f700 1 Processor -- start 2023-10-09T06:26:57.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.071+0000 7f731453f700 1 -- start start 2023-10-09T06:26:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.072+0000 7f731453f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f730c159e10 0x7f730c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.072+0000 7f731453f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f730c15a1e0 0x7f730c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.072+0000 7f731453f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730c15db80 con 0x7f730c0b1610 2023-10-09T06:26:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.072+0000 7f731453f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730c15e800 con 0x7f730c15a1e0 2023-10-09T06:26:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.072+0000 7f731453f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c15de60 con 0x7f730c159e10 2023-10-09T06:26:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.072+0000 7f7311ada700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f730c15a1e0 0x7f730c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.072+0000 7f7311ada700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f730c15a1e0 0x7f730c0b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44850/0 (socket says 172.21.15.31:44850) 2023-10-09T06:26:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.072+0000 7f7311ada700 1 -- 172.21.15.31:0/2139823764 learned_addr learned my addr 172.21.15.31:0/2139823764 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.072+0000 7f73122db700 1 --2- 172.21.15.31:0/2139823764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f730c159e10 0x7f730c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.073+0000 7f7311ada700 1 -- 172.21.15.31:0/2139823764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f730c159e10 msgr2=0x7f730c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.073+0000 7f7311ada700 1 --2- 172.21.15.31:0/2139823764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f730c159e10 0x7f730c0b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.073+0000 7f7311ada700 1 -- 172.21.15.31:0/2139823764 >> v1:172.21.15.158:6789/0 conn(0x7f730c0b1610 legacy=0x7f730c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.073+0000 7f7311ada700 1 -- 172.21.15.31:0/2139823764 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c15e140 con 0x7f730c15a1e0 2023-10-09T06:26:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.073+0000 7f7311ada700 1 --2- 172.21.15.31:0/2139823764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c15a1e0 0x7f730c0b3260 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f73000099b0 tx=0x7f7300009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926a86ced5cc18c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.073+0000 7f73112d9700 1 -- 172.21.15.31:0/2139823764 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730000b860 con 0x7f730c15a1e0 2023-10-09T06:26:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.073+0000 7f73112d9700 1 -- 172.21.15.31:0/2139823764 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730000b9c0 con 0x7f730c15a1e0 2023-10-09T06:26:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.073+0000 7f73112d9700 1 -- 172.21.15.31:0/2139823764 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730000bd60 con 0x7f730c15a1e0 2023-10-09T06:26:57.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.073+0000 7f731453f700 1 -- 172.21.15.31:0/2139823764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c15a1e0 msgr2=0x7f730c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.073+0000 7f731453f700 1 --2- 172.21.15.31:0/2139823764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c15a1e0 0x7f730c0b3260 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f73000099b0 tx=0x7f7300009250 comp rx=0 tx=0).stop 2023-10-09T06:26:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.073+0000 7f731453f700 1 -- 172.21.15.31:0/2139823764 shutdown_connections 2023-10-09T06:26:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.073+0000 7f731453f700 1 --2- 172.21.15.31:0/2139823764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f730c159e10 0x7f730c0b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.073+0000 7f731453f700 1 --2- 172.21.15.31:0/2139823764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c15a1e0 0x7f730c0b3260 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.074+0000 7f731453f700 1 -- 172.21.15.31:0/2139823764 >> 172.21.15.31:0/2139823764 conn(0x7f730c067660 msgr2=0x7f730c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.074+0000 7f731453f700 1 -- 172.21.15.31:0/2139823764 shutdown_connections 2023-10-09T06:26:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.074+0000 7f731453f700 1 -- 172.21.15.31:0/2139823764 wait complete. 2023-10-09T06:26:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.075+0000 7f731453f700 1 Processor -- start 2023-10-09T06:26:57.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.075+0000 7f731453f700 1 -- start start 2023-10-09T06:26:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.075+0000 7f731453f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c0b1610 0x7f730c0d1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.075+0000 7f731453f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f730c159e10 0x7f730c15c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.075+0000 7f731453f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f730c15a1e0 0x7f730c15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.075+0000 7f731453f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0c9340 con 0x7f730c0b1610 2023-10-09T06:26:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.075+0000 7f731453f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0c7950 con 0x7f730c159e10 2023-10-09T06:26:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.075+0000 7f731453f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0c4760 con 0x7f730c15a1e0 2023-10-09T06:26:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f73122db700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c0b1610 0x7f730c0d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f73122db700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c0b1610 0x7f730c0d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44858/0 (socket says 172.21.15.31:44858) 2023-10-09T06:26:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f73122db700 1 -- 172.21.15.31:0/2419350996 learned_addr learned my addr 172.21.15.31:0/2419350996 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f7311ada700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f730c159e10 0x7f730c15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f7312adc700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f730c15a1e0 0x7f730c15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f73122db700 1 -- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f730c15a1e0 msgr2=0x7f730c15c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f73122db700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f730c15a1e0 0x7f730c15c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f73122db700 1 -- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f730c159e10 msgr2=0x7f730c15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f73122db700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f730c159e10 0x7f730c15c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f73122db700 1 -- 172.21.15.31:0/2419350996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000094f0 con 0x7f730c0b1610 2023-10-09T06:26:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f73122db700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c0b1610 0x7f730c0d1040 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f730400e190 tx=0x7f7304009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f730a7fc700 1 -- 172.21.15.31:0/2419350996 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730400ee30 con 0x7f730c0b1610 2023-10-09T06:26:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f730a7fc700 1 -- 172.21.15.31:0/2419350996 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7304014420 con 0x7f730c0b1610 2023-10-09T06:26:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f731453f700 1 -- 172.21.15.31:0/2419350996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730c0c4970 con 0x7f730c0b1610 2023-10-09T06:26:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f730a7fc700 1 -- 172.21.15.31:0/2419350996 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040147c0 con 0x7f730c0b1610 2023-10-09T06:26:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.076+0000 7f731453f700 1 -- 172.21.15.31:0/2419350996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730c0c4f30 con 0x7f730c0b1610 2023-10-09T06:26:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.077+0000 7f731453f700 1 -- 172.21.15.31:0/2419350996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730c04c3c0 con 0x7f730c0b1610 2023-10-09T06:26:57.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.078+0000 7f730a7fc700 1 -- 172.21.15.31:0/2419350996 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7304014b70 con 0x7f730c0b1610 2023-10-09T06:26:57.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.078+0000 7f730a7fc700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f72f8066f30 0x7f72f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:57.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.078+0000 7f730a7fc700 1 -- 172.21.15.31:0/2419350996 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7304084cb0 con 0x7f730c0b1610 2023-10-09T06:26:57.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.078+0000 7f7311ada700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f72f8066f30 0x7f72f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:57.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.079+0000 7f7311ada700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f72f8066f30 0x7f72f80693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f73000099b0 tx=0x7f7300017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:57.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.082+0000 7f730a7fc700 1 -- 172.21.15.31:0/2419350996 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7304051f20 con 0x7f730c0b1610 2023-10-09T06:26:57.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.320+0000 7f731453f700 1 -- 172.21.15.31:0/2419350996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f730c0c5580 con 0x7f730c0b1610 2023-10-09T06:26:57.321 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:26:57.321+0000 7fc5e82b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:26:57.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.326+0000 7f730a7fc700 1 -- 172.21.15.31:0/2419350996 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7f73040099b0 con 0x7f730c0b1610 2023-10-09T06:26:57.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.328+0000 7f731453f700 1 -- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f72f8066f30 msgr2=0x7f72f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:57.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.328+0000 7f731453f700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f72f8066f30 0x7f72f80693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f73000099b0 tx=0x7f7300017000 comp rx=0 tx=0).stop 2023-10-09T06:26:57.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.328+0000 7f731453f700 1 -- 172.21.15.31:0/2419350996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c0b1610 msgr2=0x7f730c0d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:57.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.328+0000 7f731453f700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c0b1610 0x7f730c0d1040 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f730400e190 tx=0x7f7304009920 comp rx=0 tx=0).stop 2023-10-09T06:26:57.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.328+0000 7f731453f700 1 -- 172.21.15.31:0/2419350996 shutdown_connections 2023-10-09T06:26:57.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.328+0000 7f731453f700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f72f8066f30 0x7f72f80693e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.328+0000 7f731453f700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f730c15a1e0 0x7f730c15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.328+0000 7f731453f700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c0b1610 0x7f730c0d1040 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.328+0000 7f731453f700 1 --2- 172.21.15.31:0/2419350996 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f730c159e10 0x7f730c15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.328+0000 7f731453f700 1 -- 172.21.15.31:0/2419350996 >> 172.21.15.31:0/2419350996 conn(0x7f730c067660 msgr2=0x7f730c15a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:57.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.328+0000 7f731453f700 1 -- 172.21.15.31:0/2419350996 shutdown_connections 2023-10-09T06:26:57.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.328+0000 7f731453f700 1 -- 172.21.15.31:0/2419350996 wait complete. 2023-10-09T06:26:57.330 INFO:tasks.ceph.mds.a.smithi031.stderr: -3301> 2023-10-09T06:26:45.459+0000 7ff659a5f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:26:57.330 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:26:57.341 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:26:57.354 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:26:57.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.463+0000 7f6337334700 1 Processor -- start 2023-10-09T06:26:57.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.463+0000 7f6337334700 1 -- start start 2023-10-09T06:26:57.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.464+0000 7f6337334700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f63300cce30 0x7f633015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:57.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.464+0000 7f6337334700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f63300b6580 0x7f633006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:57.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.464+0000 7f6337334700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f633006a830 0x7f633015d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:57.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.464+0000 7f6337334700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63300b4d70 con 0x7f633006a830 2023-10-09T06:26:57.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.464+0000 7f6337334700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633006ac70 con 0x7f63300b6580 2023-10-09T06:26:57.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.464+0000 7f6337334700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63300cd8d0 con 0x7f63300cce30 2023-10-09T06:26:57.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.464+0000 7f6336b33700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f633006a830 0x7f633015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:57.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.464+0000 7f6336b33700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f633006a830 0x7f633015d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44876/0 (socket says 172.21.15.31:44876) 2023-10-09T06:26:57.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.464+0000 7f6336b33700 1 -- 172.21.15.31:0/102322014 learned_addr learned my addr 172.21.15.31:0/102322014 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:57.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.464+0000 7f6335b31700 1 --2- 172.21.15.31:0/102322014 >> v2:172.21.15.158:3300/0 conn(0x7f63300b6580 0x7f633006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:57.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.464+0000 7f6336332700 1 --2- 172.21.15.31:0/102322014 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f63300cce30 0x7f633015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:57.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.465+0000 7f6336b33700 1 -- 172.21.15.31:0/102322014 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f63300cce30 msgr2=0x7f633015aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:57.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.465+0000 7f6336b33700 1 --2- 172.21.15.31:0/102322014 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f63300cce30 0x7f633015aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.465+0000 7f6336b33700 1 -- 172.21.15.31:0/102322014 >> v2:172.21.15.158:3300/0 conn(0x7f63300b6580 msgr2=0x7f633006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.465+0000 7f6336b33700 1 --2- 172.21.15.31:0/102322014 >> v2:172.21.15.158:3300/0 conn(0x7f63300b6580 0x7f633006a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.465+0000 7f6336b33700 1 -- 172.21.15.31:0/102322014 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63300b4440 con 0x7f633006a830 2023-10-09T06:26:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.465+0000 7f6336b33700 1 --2- 172.21.15.31:0/102322014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633006a830 0x7f633015d880 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f63300b36d0 tx=0x7f6328009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46ef78a50c2e857 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.465+0000 7f6335330700 1 -- 172.21.15.31:0/102322014 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800b640 con 0x7f633006a830 2023-10-09T06:26:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.465+0000 7f6335330700 1 -- 172.21.15.31:0/102322014 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632800b7a0 con 0x7f633006a830 2023-10-09T06:26:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.465+0000 7f6335330700 1 -- 172.21.15.31:0/102322014 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800bb60 con 0x7f633006a830 2023-10-09T06:26:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.465+0000 7f6337334700 1 -- 172.21.15.31:0/102322014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633006a830 msgr2=0x7f633015d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.465+0000 7f6337334700 1 --2- 172.21.15.31:0/102322014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633006a830 0x7f633015d880 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f63300b36d0 tx=0x7f6328009250 comp rx=0 tx=0).stop 2023-10-09T06:26:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.466+0000 7f6337334700 1 -- 172.21.15.31:0/102322014 shutdown_connections 2023-10-09T06:26:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.466+0000 7f6337334700 1 --2- 172.21.15.31:0/102322014 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f63300cce30 0x7f633015aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.466+0000 7f6337334700 1 --2- 172.21.15.31:0/102322014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633006a830 0x7f633015d880 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.466+0000 7f6337334700 1 --2- 172.21.15.31:0/102322014 >> v2:172.21.15.158:3300/0 conn(0x7f63300b6580 0x7f633006a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.466+0000 7f6337334700 1 -- 172.21.15.31:0/102322014 >> 172.21.15.31:0/102322014 conn(0x7f6330068cb0 msgr2=0x7f63300690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.466+0000 7f6337334700 1 -- 172.21.15.31:0/102322014 shutdown_connections 2023-10-09T06:26:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.466+0000 7f6337334700 1 -- 172.21.15.31:0/102322014 wait complete. 2023-10-09T06:26:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.467+0000 7f6337334700 1 Processor -- start 2023-10-09T06:26:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.467+0000 7f6337334700 1 -- start start 2023-10-09T06:26:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.467+0000 7f6337334700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f633006a830 0x7f633014e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.467+0000 7f6337334700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63300b6580 0x7f633015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.467+0000 7f6337334700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f63300cce30 0x7f633015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.467+0000 7f6337334700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63301512e0 con 0x7f63300b6580 2023-10-09T06:26:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.467+0000 7f6337334700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6330151e60 con 0x7f633006a830 2023-10-09T06:26:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.467+0000 7f6337334700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6330154a40 con 0x7f63300cce30 2023-10-09T06:26:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.467+0000 7f6335b31700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63300b6580 0x7f633015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f6335b31700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63300b6580 0x7f633015eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44886/0 (socket says 172.21.15.31:44886) 2023-10-09T06:26:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f6335b31700 1 -- 172.21.15.31:0/1718118944 learned_addr learned my addr 172.21.15.31:0/1718118944 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f6336332700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f633006a830 0x7f633014e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f6336b33700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f63300cce30 0x7f633015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f6335b31700 1 -- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f63300cce30 msgr2=0x7f633015f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:57.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f6335b31700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f63300cce30 0x7f633015f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f6335b31700 1 -- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f633006a830 msgr2=0x7f633014e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:57.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f6335b31700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f633006a830 0x7f633014e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:57.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f6335b31700 1 -- 172.21.15.31:0/1718118944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63280094f0 con 0x7f63300b6580 2023-10-09T06:26:57.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f6336332700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f633006a830 0x7f633014e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:57.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f6335b31700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63300b6580 0x7f633015eb70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f632400ec80 tx=0x7f63240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:57.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f632e7fc700 1 -- 172.21.15.31:0/1718118944 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632400c9d0 con 0x7f63300b6580 2023-10-09T06:26:57.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f632e7fc700 1 -- 172.21.15.31:0/1718118944 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632400cb30 con 0x7f63300b6580 2023-10-09T06:26:57.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f6337334700 1 -- 172.21.15.31:0/1718118944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6330151530 con 0x7f63300b6580 2023-10-09T06:26:57.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f632e7fc700 1 -- 172.21.15.31:0/1718118944 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324013470 con 0x7f63300b6580 2023-10-09T06:26:57.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.468+0000 7f6337334700 1 -- 172.21.15.31:0/1718118944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6330151af0 con 0x7f63300b6580 2023-10-09T06:26:57.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.469+0000 7f6337334700 1 -- 172.21.15.31:0/1718118944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6330089550 con 0x7f63300b6580 2023-10-09T06:26:57.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.470+0000 7f632e7fc700 1 -- 172.21.15.31:0/1718118944 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6324013860 con 0x7f63300b6580 2023-10-09T06:26:57.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.470+0000 7f632e7fc700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f631c066f30 0x7f631c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:57.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.470+0000 7f632e7fc700 1 -- 172.21.15.31:0/1718118944 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f63240848b0 con 0x7f63300b6580 2023-10-09T06:26:57.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.470+0000 7f6336332700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f631c066f30 0x7f631c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:57.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.471+0000 7f6336332700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f631c066f30 0x7f631c0693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6320007640 tx=0x7f632000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:57.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.474+0000 7f632e7fc700 1 -- 172.21.15.31:0/1718118944 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6324051ad0 con 0x7f63300b6580 2023-10-09T06:26:57.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:57.711+0000 7f6337334700 1 -- 172.21.15.31:0/1718118944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f63300b4720 con 0x7f63300b6580 2023-10-09T06:26:58.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.324+0000 7f632e7fc700 1 -- 172.21.15.31:0/1718118944 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7f63240550f0 con 0x7f63300b6580 2023-10-09T06:26:58.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.327+0000 7f6337334700 1 -- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f631c066f30 msgr2=0x7f631c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:58.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.327+0000 7f6337334700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f631c066f30 0x7f631c0693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6320007640 tx=0x7f632000b040 comp rx=0 tx=0).stop 2023-10-09T06:26:58.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.327+0000 7f6337334700 1 -- 172.21.15.31:0/1718118944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63300b6580 msgr2=0x7f633015eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:58.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.327+0000 7f6337334700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63300b6580 0x7f633015eb70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f632400ec80 tx=0x7f63240091a0 comp rx=0 tx=0).stop 2023-10-09T06:26:58.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.327+0000 7f6337334700 1 -- 172.21.15.31:0/1718118944 shutdown_connections 2023-10-09T06:26:58.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.327+0000 7f6337334700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f631c066f30 0x7f631c0693e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:58.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.327+0000 7f6337334700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f63300cce30 0x7f633015f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:58.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.327+0000 7f6337334700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f633006a830 0x7f633014e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:58.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.327+0000 7f6337334700 1 --2- 172.21.15.31:0/1718118944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63300b6580 0x7f633015eb70 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:58.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.327+0000 7f6337334700 1 -- 172.21.15.31:0/1718118944 >> 172.21.15.31:0/1718118944 conn(0x7f6330068cb0 msgr2=0x7f6330159650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:58.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.327+0000 7f6337334700 1 -- 172.21.15.31:0/1718118944 shutdown_connections 2023-10-09T06:26:58.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.327+0000 7f6337334700 1 -- 172.21.15.31:0/1718118944 wait complete. 2023-10-09T06:26:58.340 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:26:58.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.504+0000 7f55433bd700 1 Processor -- start 2023-10-09T06:26:58.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.505+0000 7f55433bd700 1 -- start start 2023-10-09T06:26:58.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.505+0000 7f55433bd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f553c15daf0 0x7f553c0c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:58.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.505+0000 7f55433bd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f553c0c55e0 0x7f553c15a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:58.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.505+0000 7f55433bd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553c067660 con 0x7f553c0b0f80 2023-10-09T06:26:58.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.505+0000 7f55433bd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553c15df90 con 0x7f553c15daf0 2023-10-09T06:26:58.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.505+0000 7f55433bd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553c06bfa0 con 0x7f553c0c55e0 2023-10-09T06:26:58.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.505+0000 7f5540958700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f553c15daf0 0x7f553c0c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:58.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.506+0000 7f5540958700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f553c15daf0 0x7f553c0c50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44892/0 (socket says 172.21.15.31:44892) 2023-10-09T06:26:58.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.506+0000 7f5540958700 1 -- 172.21.15.31:0/1124705945 learned_addr learned my addr 172.21.15.31:0/1124705945 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:58.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.506+0000 7f554195a700 1 --2- 172.21.15.31:0/1124705945 >> v2:172.21.15.158:3300/0 conn(0x7f553c0c55e0 0x7f553c15a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:58.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.506+0000 7f5540958700 1 -- 172.21.15.31:0/1124705945 >> v2:172.21.15.158:3300/0 conn(0x7f553c0c55e0 msgr2=0x7f553c15a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:58.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.506+0000 7f5540958700 1 --2- 172.21.15.31:0/1124705945 >> v2:172.21.15.158:3300/0 conn(0x7f553c0c55e0 0x7f553c15a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:58.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.506+0000 7f5540958700 1 -- 172.21.15.31:0/1124705945 >> v1:172.21.15.158:6789/0 conn(0x7f553c0b0f80 legacy=0x7f553c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:58.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.506+0000 7f5540958700 1 -- 172.21.15.31:0/1124705945 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c0684c0 con 0x7f553c15daf0 2023-10-09T06:26:58.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.506+0000 7f5540958700 1 --2- 172.21.15.31:0/1124705945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f553c15daf0 0x7f553c0c50a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f553c06f140 tx=0x7f5530009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84976973cef4d0d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:58.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.506+0000 7f553bfff700 1 -- 172.21.15.31:0/1124705945 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553000b820 con 0x7f553c15daf0 2023-10-09T06:26:58.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.506+0000 7f553bfff700 1 -- 172.21.15.31:0/1124705945 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553000b980 con 0x7f553c15daf0 2023-10-09T06:26:58.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.506+0000 7f553bfff700 1 -- 172.21.15.31:0/1124705945 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553000bd20 con 0x7f553c15daf0 2023-10-09T06:26:58.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.507+0000 7f55433bd700 1 -- 172.21.15.31:0/1124705945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f553c15daf0 msgr2=0x7f553c0c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:58.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.507+0000 7f55433bd700 1 --2- 172.21.15.31:0/1124705945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f553c15daf0 0x7f553c0c50a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f553c06f140 tx=0x7f5530009250 comp rx=0 tx=0).stop 2023-10-09T06:26:58.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.507+0000 7f55433bd700 1 -- 172.21.15.31:0/1124705945 shutdown_connections 2023-10-09T06:26:58.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.507+0000 7f55433bd700 1 --2- 172.21.15.31:0/1124705945 >> v2:172.21.15.158:3300/0 conn(0x7f553c0c55e0 0x7f553c15a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:58.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.507+0000 7f55433bd700 1 --2- 172.21.15.31:0/1124705945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f553c15daf0 0x7f553c0c50a0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:58.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.507+0000 7f55433bd700 1 -- 172.21.15.31:0/1124705945 >> 172.21.15.31:0/1124705945 conn(0x7f553c069870 msgr2=0x7f553c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:58.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.507+0000 7f55433bd700 1 -- 172.21.15.31:0/1124705945 shutdown_connections 2023-10-09T06:26:58.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.507+0000 7f55433bd700 1 -- 172.21.15.31:0/1124705945 wait complete. 2023-10-09T06:26:58.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.508+0000 7f55433bd700 1 Processor -- start 2023-10-09T06:26:58.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.508+0000 7f55433bd700 1 -- start start 2023-10-09T06:26:58.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f55433bd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f553c0b0f80 0x7f553c150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:58.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f55433bd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f553c0c55e0 0x7f553c15b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:58.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f55433bd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f553c15daf0 0x7f553c157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:58.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f55433bd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c1510d0 con 0x7f553c0c55e0 2023-10-09T06:26:58.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f55433bd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c156fe0 con 0x7f553c0b0f80 2023-10-09T06:26:58.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f55433bd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c15ba80 con 0x7f553c15daf0 2023-10-09T06:26:58.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f5540958700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f553c0c55e0 0x7f553c15b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:58.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f5540958700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f553c0c55e0 0x7f553c15b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44906/0 (socket says 172.21.15.31:44906) 2023-10-09T06:26:58.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f5540958700 1 -- 172.21.15.31:0/3462419003 learned_addr learned my addr 172.21.15.31:0/3462419003 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:58.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f554195a700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f553c15daf0 0x7f553c157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:58.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f5541159700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f553c0b0f80 0x7f553c150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:58.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f5540958700 1 -- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f553c15daf0 msgr2=0x7f553c157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:58.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f5540958700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f553c15daf0 0x7f553c157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:58.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f5540958700 1 -- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f553c0b0f80 msgr2=0x7f553c150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:58.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f5540958700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f553c0b0f80 0x7f553c150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:58.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f5540958700 1 -- 172.21.15.31:0/3462419003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55300094f0 con 0x7f553c0c55e0 2023-10-09T06:26:58.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f554195a700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f553c15daf0 0x7f553c157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:58.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f5541159700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f553c0b0f80 0x7f553c150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:26:58.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.509+0000 7f5540958700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f553c0c55e0 0x7f553c15b230 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f55300030c0 tx=0x7f5530016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:58.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.510+0000 7f55397fa700 1 -- 172.21.15.31:0/3462419003 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530011e60 con 0x7f553c0c55e0 2023-10-09T06:26:58.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.510+0000 7f55397fa700 1 -- 172.21.15.31:0/3462419003 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5530020070 con 0x7f553c0c55e0 2023-10-09T06:26:58.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.510+0000 7f55433bd700 1 -- 172.21.15.31:0/3462419003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553c15bd60 con 0x7f553c0c55e0 2023-10-09T06:26:58.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.510+0000 7f55397fa700 1 -- 172.21.15.31:0/3462419003 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553001b6a0 con 0x7f553c0c55e0 2023-10-09T06:26:58.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.510+0000 7f55433bd700 1 -- 172.21.15.31:0/3462419003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c156c70 con 0x7f553c0c55e0 2023-10-09T06:26:58.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.511+0000 7f55433bd700 1 -- 172.21.15.31:0/3462419003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c04c3c0 con 0x7f553c0c55e0 2023-10-09T06:26:58.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.511+0000 7f55397fa700 1 -- 172.21.15.31:0/3462419003 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5530022030 con 0x7f553c0c55e0 2023-10-09T06:26:58.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.511+0000 7f55397fa700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5528066f30 0x7f55280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:58.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.512+0000 7f55397fa700 1 -- 172.21.15.31:0/3462419003 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f55300864b0 con 0x7f553c0c55e0 2023-10-09T06:26:58.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.512+0000 7f5541159700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5528066f30 0x7f55280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:58.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.512+0000 7f5541159700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5528066f30 0x7f55280693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5534002880 tx=0x7f5534009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:58.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.516+0000 7f55397fa700 1 -- 172.21.15.31:0/3462419003 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55300536d0 con 0x7f553c0c55e0 2023-10-09T06:26:58.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:58.708+0000 7f55433bd700 1 -- 172.21.15.31:0/3462419003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f553c04c3c0 con 0x7f553c0c55e0 2023-10-09T06:26:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.329+0000 7f55397fa700 1 -- 172.21.15.31:0/3462419003 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v126) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5530056cf0 con 0x7f553c0c55e0 2023-10-09T06:26:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.332+0000 7f55433bd700 1 -- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5528066f30 msgr2=0x7f55280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.332+0000 7f55433bd700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5528066f30 0x7f55280693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5534002880 tx=0x7f5534009040 comp rx=0 tx=0).stop 2023-10-09T06:26:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.332+0000 7f55433bd700 1 -- 172.21.15.31:0/3462419003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f553c0c55e0 msgr2=0x7f553c15b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.332+0000 7f55433bd700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f553c0c55e0 0x7f553c15b230 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f55300030c0 tx=0x7f5530016000 comp rx=0 tx=0).stop 2023-10-09T06:26:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.332+0000 7f55433bd700 1 -- 172.21.15.31:0/3462419003 shutdown_connections 2023-10-09T06:26:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.332+0000 7f55433bd700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5528066f30 0x7f55280693e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.332+0000 7f55433bd700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f553c15daf0 0x7f553c157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.332+0000 7f55433bd700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f553c0b0f80 0x7f553c150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:59.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.332+0000 7f55433bd700 1 --2- 172.21.15.31:0/3462419003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f553c0c55e0 0x7f553c15b230 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:59.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.332+0000 7f55433bd700 1 -- 172.21.15.31:0/3462419003 >> 172.21.15.31:0/3462419003 conn(0x7f553c069870 msgr2=0x7f553c0c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:59.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.332+0000 7f55433bd700 1 -- 172.21.15.31:0/3462419003 shutdown_connections 2023-10-09T06:26:59.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.332+0000 7f55433bd700 1 -- 172.21.15.31:0/3462419003 wait complete. 2023-10-09T06:26:59.334 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:26:59.345 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:26:59.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.468+0000 7f7181773700 1 Processor -- start 2023-10-09T06:26:59.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.468+0000 7f7181773700 1 -- start start 2023-10-09T06:26:59.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.469+0000 7f7181773700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f717c159ef0 0x7f717c15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:59.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.469+0000 7f7181773700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f717c0b46f0 0x7f717c0b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:59.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.469+0000 7f7181773700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c0b5070 con 0x7f717c0b6a10 2023-10-09T06:26:59.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.469+0000 7f7181773700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717c0b17b0 con 0x7f717c159ef0 2023-10-09T06:26:59.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.469+0000 7f7181773700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0b1a60 con 0x7f717c0b46f0 2023-10-09T06:26:59.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.469+0000 7f717affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f717c159ef0 0x7f717c15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:59.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.469+0000 7f717affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f717c159ef0 0x7f717c15a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44918/0 (socket says 172.21.15.31:44918) 2023-10-09T06:26:59.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.469+0000 7f717affd700 1 -- 172.21.15.31:0/524494586 learned_addr learned my addr 172.21.15.31:0/524494586 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:59.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.470+0000 7f717affd700 1 -- 172.21.15.31:0/524494586 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f717c0b46f0 msgr2=0x7f717c0b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:59.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.470+0000 7f717affd700 1 --2- 172.21.15.31:0/524494586 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f717c0b46f0 0x7f717c0b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:59.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.470+0000 7f717affd700 1 -- 172.21.15.31:0/524494586 >> v1:172.21.15.158:6789/0 conn(0x7f717c0b6a10 legacy=0x7f717c0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:26:59.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.470+0000 7f717affd700 1 -- 172.21.15.31:0/524494586 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c0b1d40 con 0x7f717c159ef0 2023-10-09T06:26:59.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.470+0000 7f717affd700 1 --2- 172.21.15.31:0/524494586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f717c159ef0 0x7f717c15a2c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f716c009990 tx=0x7f716c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24951662ddc1143 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:59.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.470+0000 7f7179ffb700 1 -- 172.21.15.31:0/524494586 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c005c10 con 0x7f717c159ef0 2023-10-09T06:26:59.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.470+0000 7f7179ffb700 1 -- 172.21.15.31:0/524494586 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c005d70 con 0x7f717c159ef0 2023-10-09T06:26:59.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.470+0000 7f7179ffb700 1 -- 172.21.15.31:0/524494586 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c00b840 con 0x7f717c159ef0 2023-10-09T06:26:59.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.470+0000 7f7181773700 1 -- 172.21.15.31:0/524494586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f717c159ef0 msgr2=0x7f717c15a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:59.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.470+0000 7f7181773700 1 --2- 172.21.15.31:0/524494586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f717c159ef0 0x7f717c15a2c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f716c009990 tx=0x7f716c009220 comp rx=0 tx=0).stop 2023-10-09T06:26:59.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.471+0000 7f7181773700 1 -- 172.21.15.31:0/524494586 shutdown_connections 2023-10-09T06:26:59.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.471+0000 7f7181773700 1 --2- 172.21.15.31:0/524494586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f717c159ef0 0x7f717c15a2c0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:59.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.471+0000 7f7181773700 1 --2- 172.21.15.31:0/524494586 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f717c0b46f0 0x7f717c0b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:59.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.471+0000 7f7181773700 1 -- 172.21.15.31:0/524494586 >> 172.21.15.31:0/524494586 conn(0x7f717c09a0a0 msgr2=0x7f717c067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:26:59.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.471+0000 7f7181773700 1 -- 172.21.15.31:0/524494586 shutdown_connections 2023-10-09T06:26:59.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.471+0000 7f7181773700 1 -- 172.21.15.31:0/524494586 wait complete. 2023-10-09T06:26:59.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.472+0000 7f7181773700 1 Processor -- start 2023-10-09T06:26:59.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.472+0000 7f7181773700 1 -- start start 2023-10-09T06:26:59.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.472+0000 7f7181773700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f717c0b46f0 0x7f717c16a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:59.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.472+0000 7f7181773700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f717c0b6a10 0x7f717c16d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:59.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f7181773700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f717c159ef0 0x7f717c0abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:59.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f7181773700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c16d5c0 con 0x7f717c159ef0 2023-10-09T06:26:59.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f7181773700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0acec0 con 0x7f717c0b6a10 2023-10-09T06:26:59.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f7181773700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0afd40 con 0x7f717c0b46f0 2023-10-09T06:26:59.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f717b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f717c159ef0 0x7f717c0abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:59.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f717b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f717c159ef0 0x7f717c0abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44934/0 (socket says 172.21.15.31:44934) 2023-10-09T06:26:59.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f717b7fe700 1 -- 172.21.15.31:0/1811687360 learned_addr learned my addr 172.21.15.31:0/1811687360 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:26:59.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f717affd700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f717c0b46f0 0x7f717c16a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:59.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f717a7fc700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f717c0b6a10 0x7f717c16d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:59.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f717b7fe700 1 -- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f717c0b46f0 msgr2=0x7f717c16a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:59.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f717b7fe700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f717c0b46f0 0x7f717c16a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:59.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f717b7fe700 1 -- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f717c0b6a10 msgr2=0x7f717c16d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:26:59.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f717b7fe700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f717c0b6a10 0x7f717c16d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:26:59.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f717b7fe700 1 -- 172.21.15.31:0/1811687360 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c009480 con 0x7f717c159ef0 2023-10-09T06:26:59.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f717b7fe700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f717c159ef0 0x7f717c0abe60 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f717400bc30 tx=0x7f7174009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:59.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f7162ffd700 1 -- 172.21.15.31:0/1811687360 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71740092e0 con 0x7f717c159ef0 2023-10-09T06:26:59.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f7162ffd700 1 -- 172.21.15.31:0/1811687360 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717400c7a0 con 0x7f717c159ef0 2023-10-09T06:26:59.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f7181773700 1 -- 172.21.15.31:0/1811687360 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c0ac900 con 0x7f717c159ef0 2023-10-09T06:26:59.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f7162ffd700 1 -- 172.21.15.31:0/1811687360 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717400cb80 con 0x7f717c159ef0 2023-10-09T06:26:59.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.473+0000 7f7181773700 1 -- 172.21.15.31:0/1811687360 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717c0adc70 con 0x7f717c159ef0 2023-10-09T06:26:59.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.474+0000 7f7181773700 1 -- 172.21.15.31:0/1811687360 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717c04c3c0 con 0x7f717c159ef0 2023-10-09T06:26:59.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.475+0000 7f7162ffd700 1 -- 172.21.15.31:0/1811687360 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7174012070 con 0x7f717c159ef0 2023-10-09T06:26:59.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.475+0000 7f7162ffd700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7168066f30 0x7f71680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:26:59.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.475+0000 7f7162ffd700 1 -- 172.21.15.31:0/1811687360 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f7174084080 con 0x7f717c159ef0 2023-10-09T06:26:59.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.476+0000 7f717affd700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7168066f30 0x7f71680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:26:59.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.476+0000 7f717affd700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7168066f30 0x7f71680693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f716c003080 tx=0x7f716c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:26:59.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.479+0000 7f7162ffd700 1 -- 172.21.15.31:0/1811687360 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7174051450 con 0x7f717c159ef0 2023-10-09T06:26:59.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:26:59.673+0000 7f7181773700 1 -- 172.21.15.31:0/1811687360 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f717c0690e0 con 0x7f717c159ef0 2023-10-09T06:27:00.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.335+0000 7f7162ffd700 1 -- 172.21.15.31:0/1811687360 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v127) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7174054a70 con 0x7f717c159ef0 2023-10-09T06:27:00.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.338+0000 7f7181773700 1 -- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7168066f30 msgr2=0x7f71680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:00.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.338+0000 7f7181773700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7168066f30 0x7f71680693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f716c003080 tx=0x7f716c015000 comp rx=0 tx=0).stop 2023-10-09T06:27:00.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.338+0000 7f7181773700 1 -- 172.21.15.31:0/1811687360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f717c159ef0 msgr2=0x7f717c0abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:00.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.338+0000 7f7181773700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f717c159ef0 0x7f717c0abe60 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f717400bc30 tx=0x7f7174009840 comp rx=0 tx=0).stop 2023-10-09T06:27:00.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.341+0000 7f7181773700 1 -- 172.21.15.31:0/1811687360 shutdown_connections 2023-10-09T06:27:00.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.341+0000 7f7181773700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7168066f30 0x7f71680693e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.341+0000 7f7181773700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f717c0b46f0 0x7f717c16a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.341+0000 7f7181773700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f717c159ef0 0x7f717c0abe60 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.341+0000 7f7181773700 1 --2- 172.21.15.31:0/1811687360 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f717c0b6a10 0x7f717c16d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.341+0000 7f7181773700 1 -- 172.21.15.31:0/1811687360 >> 172.21.15.31:0/1811687360 conn(0x7f717c09a0a0 msgr2=0x7f717c0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:00.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.341+0000 7f7181773700 1 -- 172.21.15.31:0/1811687360 shutdown_connections 2023-10-09T06:27:00.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.341+0000 7f7181773700 1 -- 172.21.15.31:0/1811687360 wait complete. 2023-10-09T06:27:00.342 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2023-10-09T06:27:00.355 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:27:00.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.481+0000 7f934d5d3700 1 Processor -- start 2023-10-09T06:27:00.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.481+0000 7f934d5d3700 1 -- start start 2023-10-09T06:27:00.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.482+0000 7f934d5d3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f934815a080 0x7f934806c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:00.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.482+0000 7f934d5d3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9348067d20 0x7f9348068180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:00.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.482+0000 7f934d5d3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9348067890 con 0x7f9348159cb0 2023-10-09T06:27:00.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.482+0000 7f934d5d3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93480cc030 con 0x7f9348067d20 2023-10-09T06:27:00.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.482+0000 7f934d5d3700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93480cb790 con 0x7f934815a080 2023-10-09T06:27:00.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.482+0000 7f93477fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9348067d20 0x7f9348068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:00.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.482+0000 7f93477fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9348067d20 0x7f9348068180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49428/0 (socket says 172.21.15.31:49428) 2023-10-09T06:27:00.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.482+0000 7f93477fe700 1 -- 172.21.15.31:0/3266371742 learned_addr learned my addr 172.21.15.31:0/3266371742 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:00.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.483+0000 7f93467fc700 1 --2- 172.21.15.31:0/3266371742 >> v2:172.21.15.158:3300/0 conn(0x7f934815a080 0x7f934806c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:00.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.483+0000 7f93477fe700 1 -- 172.21.15.31:0/3266371742 >> v2:172.21.15.158:3300/0 conn(0x7f934815a080 msgr2=0x7f934806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:00.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.483+0000 7f93477fe700 1 --2- 172.21.15.31:0/3266371742 >> v2:172.21.15.158:3300/0 conn(0x7f934815a080 0x7f934806c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.483+0000 7f93477fe700 1 -- 172.21.15.31:0/3266371742 >> v1:172.21.15.158:6789/0 conn(0x7f9348159cb0 legacy=0x7f934806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:00.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.483+0000 7f93477fe700 1 -- 172.21.15.31:0/3266371742 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93480cba70 con 0x7f9348067d20 2023-10-09T06:27:00.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.483+0000 7f93477fe700 1 --2- 172.21.15.31:0/3266371742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9348067d20 0x7f9348068180 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f93400099b0 tx=0x7f9340009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c33098de4a51daf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:00.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.483+0000 7f9345ffb700 1 -- 172.21.15.31:0/3266371742 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340009ea0 con 0x7f9348067d20 2023-10-09T06:27:00.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.483+0000 7f9345ffb700 1 -- 172.21.15.31:0/3266371742 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934000b820 con 0x7f9348067d20 2023-10-09T06:27:00.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.483+0000 7f9345ffb700 1 -- 172.21.15.31:0/3266371742 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934000bbc0 con 0x7f9348067d20 2023-10-09T06:27:00.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.484+0000 7f934d5d3700 1 -- 172.21.15.31:0/3266371742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9348067d20 msgr2=0x7f9348068180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:00.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.484+0000 7f934d5d3700 1 --2- 172.21.15.31:0/3266371742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9348067d20 0x7f9348068180 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f93400099b0 tx=0x7f9340009250 comp rx=0 tx=0).stop 2023-10-09T06:27:00.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.484+0000 7f934d5d3700 1 -- 172.21.15.31:0/3266371742 shutdown_connections 2023-10-09T06:27:00.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.484+0000 7f934d5d3700 1 --2- 172.21.15.31:0/3266371742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9348067d20 0x7f9348068180 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.484+0000 7f934d5d3700 1 --2- 172.21.15.31:0/3266371742 >> v2:172.21.15.158:3300/0 conn(0x7f934815a080 0x7f934806c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.484+0000 7f934d5d3700 1 -- 172.21.15.31:0/3266371742 >> 172.21.15.31:0/3266371742 conn(0x7f934806fe50 msgr2=0x7f9348069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:00.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.484+0000 7f934d5d3700 1 -- 172.21.15.31:0/3266371742 shutdown_connections 2023-10-09T06:27:00.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.484+0000 7f934d5d3700 1 -- 172.21.15.31:0/3266371742 wait complete. 2023-10-09T06:27:00.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.485+0000 7f934d5d3700 1 Processor -- start 2023-10-09T06:27:00.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.485+0000 7f934d5d3700 1 -- start start 2023-10-09T06:27:00.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f934d5d3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9348067d20 0x7f9348157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:00.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f934d5d3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9348159cb0 0x7f93480b3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:00.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f934d5d3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f934815a080 0x7f93480b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:00.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f934d5d3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93480c36c0 con 0x7f9348067d20 2023-10-09T06:27:00.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f934d5d3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93480c2620 con 0x7f934815a080 2023-10-09T06:27:00.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f934d5d3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93480c2900 con 0x7f9348159cb0 2023-10-09T06:27:00.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f9346ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9348067d20 0x7f9348157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:00.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f9346ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9348067d20 0x7f9348157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49444/0 (socket says 172.21.15.31:49444) 2023-10-09T06:27:00.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f9346ffd700 1 -- 172.21.15.31:0/4175110735 learned_addr learned my addr 172.21.15.31:0/4175110735 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:00.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f93467fc700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9348159cb0 0x7f93480b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:00.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f93477fe700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f934815a080 0x7f93480b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:00.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f9346ffd700 1 -- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9348159cb0 msgr2=0x7f93480b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:00.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f9346ffd700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9348159cb0 0x7f93480b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f9346ffd700 1 -- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f934815a080 msgr2=0x7f93480b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:00.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f9346ffd700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f934815a080 0x7f93480b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f9346ffd700 1 -- 172.21.15.31:0/4175110735 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93400094f0 con 0x7f9348067d20 2023-10-09T06:27:00.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.486+0000 7f9346ffd700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9348067d20 0x7f9348157050 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f933800c8e0 tx=0x7f9338001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:00.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.487+0000 7f933effd700 1 -- 172.21.15.31:0/4175110735 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933800ce80 con 0x7f9348067d20 2023-10-09T06:27:00.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.487+0000 7f933effd700 1 -- 172.21.15.31:0/4175110735 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933800a7e0 con 0x7f9348067d20 2023-10-09T06:27:00.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.487+0000 7f934d5d3700 1 -- 172.21.15.31:0/4175110735 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93480c2be0 con 0x7f9348067d20 2023-10-09T06:27:00.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.487+0000 7f933effd700 1 -- 172.21.15.31:0/4175110735 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933800aba0 con 0x7f9348067d20 2023-10-09T06:27:00.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.487+0000 7f934d5d3700 1 -- 172.21.15.31:0/4175110735 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93480c31a0 con 0x7f9348067d20 2023-10-09T06:27:00.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.488+0000 7f934d5d3700 1 -- 172.21.15.31:0/4175110735 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934804c3c0 con 0x7f9348067d20 2023-10-09T06:27:00.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.488+0000 7f933effd700 1 -- 172.21.15.31:0/4175110735 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9338003030 con 0x7f9348067d20 2023-10-09T06:27:00.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.489+0000 7f933effd700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9328066f30 0x7f93280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:00.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.489+0000 7f933effd700 1 -- 172.21.15.31:0/4175110735 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9338084320 con 0x7f9348067d20 2023-10-09T06:27:00.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.489+0000 7f93467fc700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9328066f30 0x7f93280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:00.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.489+0000 7f93467fc700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9328066f30 0x7f93280693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f93480ce110 tx=0x7f9330008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:00.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.493+0000 7f933effd700 1 -- 172.21.15.31:0/4175110735 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9338051890 con 0x7f9348067d20 2023-10-09T06:27:00.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.688+0000 7f934d5d3700 1 -- 172.21.15.31:0/4175110735 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f93480cbd50 con 0x7f9348067d20 2023-10-09T06:27:00.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.694+0000 7f933effd700 1 -- 172.21.15.31:0/4175110735 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9338054eb0 con 0x7f9348067d20 2023-10-09T06:27:00.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.696+0000 7f934d5d3700 1 -- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9328066f30 msgr2=0x7f93280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:00.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.696+0000 7f934d5d3700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9328066f30 0x7f93280693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f93480ce110 tx=0x7f9330008040 comp rx=0 tx=0).stop 2023-10-09T06:27:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.696+0000 7f934d5d3700 1 -- 172.21.15.31:0/4175110735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9348067d20 msgr2=0x7f9348157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.696+0000 7f934d5d3700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9348067d20 0x7f9348157050 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f933800c8e0 tx=0x7f9338001710 comp rx=0 tx=0).stop 2023-10-09T06:27:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.696+0000 7f934d5d3700 1 -- 172.21.15.31:0/4175110735 shutdown_connections 2023-10-09T06:27:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.696+0000 7f934d5d3700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9328066f30 0x7f93280693e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.696+0000 7f934d5d3700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f934815a080 0x7f93480b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.696+0000 7f934d5d3700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9348067d20 0x7f9348157050 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.696+0000 7f934d5d3700 1 --2- 172.21.15.31:0/4175110735 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9348159cb0 0x7f93480b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.696+0000 7f934d5d3700 1 -- 172.21.15.31:0/4175110735 >> 172.21.15.31:0/4175110735 conn(0x7f934806fe50 msgr2=0x7f93480680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.696+0000 7f934d5d3700 1 -- 172.21.15.31:0/4175110735 shutdown_connections 2023-10-09T06:27:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.696+0000 7f934d5d3700 1 -- 172.21.15.31:0/4175110735 wait complete. 2023-10-09T06:27:00.709 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-09T06:27:00.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.827+0000 7f3654f91700 1 Processor -- start 2023-10-09T06:27:00.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.827+0000 7f3654f91700 1 -- start start 2023-10-09T06:27:00.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f3654f91700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f365015a2b0 0x7f36500b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:00.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f3654f91700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f36500d1c30 0x7f36500cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:00.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f3654f91700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f365015a680 0x7f36500cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:00.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f3654f91700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3650068470 con 0x7f365015a680 2023-10-09T06:27:00.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f3654f91700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36500c5d80 con 0x7f36500d1c30 2023-10-09T06:27:00.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f3654f91700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36500c6060 con 0x7f365015a2b0 2023-10-09T06:27:00.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f364ed9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f365015a680 0x7f36500cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:00.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f364ed9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f365015a680 0x7f36500cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49454/0 (socket says 172.21.15.31:49454) 2023-10-09T06:27:00.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f364ed9d700 1 -- 172.21.15.31:0/3420274602 learned_addr learned my addr 172.21.15.31:0/3420274602 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:00.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f364dd9b700 1 --2- 172.21.15.31:0/3420274602 >> v2:172.21.15.158:3300/0 conn(0x7f36500d1c30 0x7f36500cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:00.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f364e59c700 1 --2- 172.21.15.31:0/3420274602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f365015a2b0 0x7f36500b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:00.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f364ed9d700 1 -- 172.21.15.31:0/3420274602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f365015a2b0 msgr2=0x7f36500b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:00.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f364ed9d700 1 --2- 172.21.15.31:0/3420274602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f365015a2b0 0x7f36500b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f364ed9d700 1 -- 172.21.15.31:0/3420274602 >> v2:172.21.15.158:3300/0 conn(0x7f36500d1c30 msgr2=0x7f36500cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:00.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f364ed9d700 1 --2- 172.21.15.31:0/3420274602 >> v2:172.21.15.158:3300/0 conn(0x7f36500d1c30 0x7f36500cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.828+0000 7f364ed9d700 1 -- 172.21.15.31:0/3420274602 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36500c6340 con 0x7f365015a680 2023-10-09T06:27:00.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.829+0000 7f364ed9d700 1 --2- 172.21.15.31:0/3420274602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f365015a680 0x7f36500cfc50 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3650089050 tx=0x7f3640009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d9896a96358f2d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:00.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.829+0000 7f364d59a700 1 -- 172.21.15.31:0/3420274602 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364000e070 con 0x7f365015a680 2023-10-09T06:27:00.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.829+0000 7f364d59a700 1 -- 172.21.15.31:0/3420274602 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364000b970 con 0x7f365015a680 2023-10-09T06:27:00.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.829+0000 7f364d59a700 1 -- 172.21.15.31:0/3420274602 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400092e0 con 0x7f365015a680 2023-10-09T06:27:00.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.829+0000 7f3654f91700 1 -- 172.21.15.31:0/3420274602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f365015a680 msgr2=0x7f36500cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:00.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.829+0000 7f3654f91700 1 --2- 172.21.15.31:0/3420274602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f365015a680 0x7f36500cfc50 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3650089050 tx=0x7f3640009840 comp rx=0 tx=0).stop 2023-10-09T06:27:00.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.829+0000 7f3654f91700 1 -- 172.21.15.31:0/3420274602 shutdown_connections 2023-10-09T06:27:00.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.829+0000 7f3654f91700 1 --2- 172.21.15.31:0/3420274602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f365015a2b0 0x7f36500b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.829+0000 7f3654f91700 1 --2- 172.21.15.31:0/3420274602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f365015a680 0x7f36500cfc50 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.829+0000 7f3654f91700 1 --2- 172.21.15.31:0/3420274602 >> v2:172.21.15.158:3300/0 conn(0x7f36500d1c30 0x7f36500cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.829+0000 7f3654f91700 1 -- 172.21.15.31:0/3420274602 >> 172.21.15.31:0/3420274602 conn(0x7f3650067e40 msgr2=0x7f36500d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:00.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.829+0000 7f3654f91700 1 -- 172.21.15.31:0/3420274602 shutdown_connections 2023-10-09T06:27:00.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.829+0000 7f3654f91700 1 -- 172.21.15.31:0/3420274602 wait complete. 2023-10-09T06:27:00.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.830+0000 7f3654f91700 1 Processor -- start 2023-10-09T06:27:00.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.831+0000 7f3654f91700 1 -- start start 2023-10-09T06:27:00.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.831+0000 7f3654f91700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36500d1c30 0x7f36501556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:00.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.831+0000 7f3654f91700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f365015a2b0 0x7f36500b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:00.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.831+0000 7f3654f91700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f365015a680 0x7f365015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:00.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.831+0000 7f3654f91700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500b6910 con 0x7f36500d1c30 2023-10-09T06:27:00.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.831+0000 7f3654f91700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365015ca60 con 0x7f365015a680 2023-10-09T06:27:00.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.831+0000 7f3654f91700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365015dcb0 con 0x7f365015a2b0 2023-10-09T06:27:00.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.831+0000 7f364e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36500d1c30 0x7f36501556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:00.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.831+0000 7f364e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36500d1c30 0x7f36501556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49466/0 (socket says 172.21.15.31:49466) 2023-10-09T06:27:00.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.831+0000 7f364e59c700 1 -- 172.21.15.31:0/2229317764 learned_addr learned my addr 172.21.15.31:0/2229317764 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:00.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.831+0000 7f364ed9d700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f365015a680 0x7f365015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:00.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.831+0000 7f364dd9b700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f365015a2b0 0x7f36500b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:00.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.832+0000 7f364e59c700 1 -- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f365015a2b0 msgr2=0x7f36500b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:00.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.832+0000 7f364e59c700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f365015a2b0 0x7f36500b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.832+0000 7f364e59c700 1 -- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f365015a680 msgr2=0x7f365015d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:00.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.832+0000 7f364e59c700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f365015a680 0x7f365015d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:00.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.832+0000 7f364e59c700 1 -- 172.21.15.31:0/2229317764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009ae0 con 0x7f36500d1c30 2023-10-09T06:27:00.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.832+0000 7f364ed9d700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f365015a680 0x7f365015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:00.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.832+0000 7f364e59c700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36500d1c30 0x7f36501556e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f364800ea30 tx=0x7f3648009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:00.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.832+0000 7f36467fc700 1 -- 172.21.15.31:0/2229317764 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364800c850 con 0x7f36500d1c30 2023-10-09T06:27:00.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.832+0000 7f36467fc700 1 -- 172.21.15.31:0/2229317764 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364800c9b0 con 0x7f36500d1c30 2023-10-09T06:27:00.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.832+0000 7f3654f91700 1 -- 172.21.15.31:0/2229317764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36500b5f40 con 0x7f36500d1c30 2023-10-09T06:27:00.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.832+0000 7f36467fc700 1 -- 172.21.15.31:0/2229317764 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364800cd30 con 0x7f36500d1c30 2023-10-09T06:27:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.832+0000 7f3654f91700 1 -- 172.21.15.31:0/2229317764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36500cb160 con 0x7f36500d1c30 2023-10-09T06:27:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.833+0000 7f3654f91700 1 -- 172.21.15.31:0/2229317764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36500b6220 con 0x7f36500d1c30 2023-10-09T06:27:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.833+0000 7f36467fc700 1 -- 172.21.15.31:0/2229317764 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3648013680 con 0x7f36500d1c30 2023-10-09T06:27:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.834+0000 7f36467fc700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3630066f30 0x7f36300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.834+0000 7f36467fc700 1 -- 172.21.15.31:0/2229317764 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3648084920 con 0x7f36500d1c30 2023-10-09T06:27:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.834+0000 7f364dd9b700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3630066f30 0x7f36300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.834+0000 7f364dd9b700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3630066f30 0x7f36300693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3650156150 tx=0x7f3638008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:00.838+0000 7f36467fc700 1 -- 172.21.15.31:0/2229317764 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3648051e90 con 0x7f36500d1c30 2023-10-09T06:27:01.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.110+0000 7f3654f91700 1 -- 172.21.15.31:0/2229317764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f365004c3c0 con 0x7f36500d1c30 2023-10-09T06:27:01.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.340+0000 7f36467fc700 1 -- 172.21.15.31:0/2229317764 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v316) v1 ==== 128+0+0 (secure 0 0 0) 0x7f36480210c0 con 0x7f36500d1c30 2023-10-09T06:27:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.342+0000 7f3654f91700 1 -- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3630066f30 msgr2=0x7f36300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.342+0000 7f3654f91700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3630066f30 0x7f36300693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3650156150 tx=0x7f3638008040 comp rx=0 tx=0).stop 2023-10-09T06:27:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.342+0000 7f3654f91700 1 -- 172.21.15.31:0/2229317764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36500d1c30 msgr2=0x7f36501556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.342+0000 7f3654f91700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36500d1c30 0x7f36501556e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f364800ea30 tx=0x7f3648009120 comp rx=0 tx=0).stop 2023-10-09T06:27:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.342+0000 7f3654f91700 1 -- 172.21.15.31:0/2229317764 shutdown_connections 2023-10-09T06:27:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.342+0000 7f3654f91700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3630066f30 0x7f36300693e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.342+0000 7f3654f91700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f365015a680 0x7f365015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.342+0000 7f3654f91700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36500d1c30 0x7f36501556e0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.342+0000 7f3654f91700 1 --2- 172.21.15.31:0/2229317764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f365015a2b0 0x7f36500b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.342+0000 7f3654f91700 1 -- 172.21.15.31:0/2229317764 >> 172.21.15.31:0/2229317764 conn(0x7f3650067e40 msgr2=0x7f36500c7880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.342+0000 7f3654f91700 1 -- 172.21.15.31:0/2229317764 shutdown_connections 2023-10-09T06:27:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.343+0000 7f3654f91700 1 -- 172.21.15.31:0/2229317764 wait complete. 2023-10-09T06:27:01.355 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-09T06:27:01.355 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-09T06:27:01.356 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-09T06:27:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.475+0000 7fcc296b2700 1 Processor -- start 2023-10-09T06:27:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.475+0000 7fcc296b2700 1 -- start start 2023-10-09T06:27:01.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc296b2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcc24067d70 0x7fcc2415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:01.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc296b2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc240cb370 con 0x7fcc2406c630 2023-10-09T06:27:01.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc296b2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc240b0c60 con 0x7fcc240b0890 2023-10-09T06:27:01.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc296b2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2406a1e0 con 0x7fcc24067d70 2023-10-09T06:27:01.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc227fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcc2406c630 0x7fcc24067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48682/0 (socket says 172.21.15.31:48682) 2023-10-09T06:27:01.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc227fc700 1 -- 172.21.15.31:0/2337585935 learned_addr learned my addr 172.21.15.31:0/2337585935 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:01.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc237fe700 1 --2- 172.21.15.31:0/2337585935 >> v2:172.21.15.158:3300/0 conn(0x7fcc24067d70 0x7fcc2415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:01.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652279958 0 0) 0x7fcc240cb370 con 0x7fcc2406c630 2023-10-09T06:27:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc10003570 con 0x7fcc2406c630 2023-10-09T06:27:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982310420 0 0) 0x7fcc240b0c60 con 0x7fcc240b0890 2023-10-09T06:27:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc240cb370 con 0x7fcc240b0890 2023-10-09T06:27:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1151828654 0 0) 0x7fcc10003570 con 0x7fcc2406c630 2023-10-09T06:27:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 >> v2:172.21.15.158:3300/0 conn(0x7fcc24067d70 msgr2=0x7fcc2415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 --2- 172.21.15.31:0/2337585935 >> v2:172.21.15.158:3300/0 conn(0x7fcc24067d70 0x7fcc2415a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 >> v1:172.21.15.158:6789/0 conn(0x7fcc240b0890 legacy=0x7fcc240cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2406cb80 con 0x7fcc2406c630 2023-10-09T06:27:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fcc0c001470 con 0x7fcc2406c630 2023-10-09T06:27:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 >> v1:172.21.15.31:6789/0 conn(0x7fcc2406c630 legacy=0x7fcc24067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:01.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 --2- 172.21.15.31:0/2337585935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc10003bf0 0x7fcc10003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:01.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 --2- 172.21.15.31:0/2337585935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc10004810 0x7fcc10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:01.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.476+0000 7fcc21ffb700 1 --2- 172.21.15.31:0/2337585935 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc100051c0 0x7fcc1000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:01.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2406a1e0 con 0x7fcc10004810 2023-10-09T06:27:01.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1000c0b0 con 0x7fcc10003bf0 2023-10-09T06:27:01.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1000c270 con 0x7fcc100051c0 2023-10-09T06:27:01.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc227fc700 1 --2- 172.21.15.31:0/2337585935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc10004810 0x7fcc10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:01.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc22ffd700 1 --2- 172.21.15.31:0/2337585935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc10003bf0 0x7fcc10003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:01.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc237fe700 1 --2- 172.21.15.31:0/2337585935 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc100051c0 0x7fcc1000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:01.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc227fc700 1 -- 172.21.15.31:0/2337585935 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc100051c0 msgr2=0x7fcc1000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:01.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc227fc700 1 --2- 172.21.15.31:0/2337585935 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc100051c0 0x7fcc1000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:01.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc227fc700 1 -- 172.21.15.31:0/2337585935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc10003bf0 msgr2=0x7fcc10003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:01.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc227fc700 1 --2- 172.21.15.31:0/2337585935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc10003bf0 0x7fcc10003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:01.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc237fe700 1 -- 172.21.15.31:0/2337585935 reap_dead start 2023-10-09T06:27:01.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc227fc700 1 -- 172.21.15.31:0/2337585935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc10003570 con 0x7fcc10004810 2023-10-09T06:27:01.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc227fc700 1 --2- 172.21.15.31:0/2337585935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc10004810 0x7fcc10004c80 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00c2a0 tx=0x7fcc240cb2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1250d9eaab1d4ce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:01.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c00cb90 con 0x7fcc10004810 2023-10-09T06:27:01.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0c00ccf0 con 0x7fcc10004810 2023-10-09T06:27:01.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.477+0000 7fcc21ffb700 1 -- 172.21.15.31:0/2337585935 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c005b70 con 0x7fcc10004810 2023-10-09T06:27:01.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.478+0000 7fcc296b2700 1 -- 172.21.15.31:0/2337585935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc10004810 msgr2=0x7fcc10004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:01.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.478+0000 7fcc296b2700 1 --2- 172.21.15.31:0/2337585935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc10004810 0x7fcc10004c80 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00c2a0 tx=0x7fcc240cb2e0 comp rx=0 tx=0).stop 2023-10-09T06:27:01.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.478+0000 7fcc296b2700 1 -- 172.21.15.31:0/2337585935 shutdown_connections 2023-10-09T06:27:01.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.478+0000 7fcc296b2700 1 --2- 172.21.15.31:0/2337585935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc10004810 0x7fcc10004c80 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:01.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.478+0000 7fcc296b2700 1 -- 172.21.15.31:0/2337585935 >> 172.21.15.31:0/2337585935 conn(0x7fcc2406fe50 msgr2=0x7fcc24069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:01.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.478+0000 7fcc296b2700 1 -- 172.21.15.31:0/2337585935 shutdown_connections 2023-10-09T06:27:01.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.478+0000 7fcc296b2700 1 -- 172.21.15.31:0/2337585935 wait complete. 2023-10-09T06:27:01.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.479+0000 7fcc296b2700 1 Processor -- start 2023-10-09T06:27:01.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.479+0000 7fcc296b2700 1 -- start start 2023-10-09T06:27:01.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc296b2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc10004810 0x7fcc240c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:01.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc296b2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc240c6b80 0x7fcc240b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:01.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc296b2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc2415eb60 0x7fcc2415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:01.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc296b2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2415f510 con 0x7fcc10004810 2023-10-09T06:27:01.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc296b2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240c8410 con 0x7fcc2415eb60 2023-10-09T06:27:01.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc296b2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240c7800 con 0x7fcc240c6b80 2023-10-09T06:27:01.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc22ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc10004810 0x7fcc240c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:01.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc22ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc10004810 0x7fcc240c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49478/0 (socket says 172.21.15.31:49478) 2023-10-09T06:27:01.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc22ffd700 1 -- 172.21.15.31:0/4172674453 learned_addr learned my addr 172.21.15.31:0/4172674453 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:01.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc237fe700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc2415eb60 0x7fcc2415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:01.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc227fc700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc240c6b80 0x7fcc240b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:01.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc22ffd700 1 -- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc240c6b80 msgr2=0x7fcc240b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:01.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc22ffd700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc240c6b80 0x7fcc240b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:01.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc22ffd700 1 -- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc2415eb60 msgr2=0x7fcc2415efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:01.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc22ffd700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc2415eb60 0x7fcc2415efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:01.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc22ffd700 1 -- 172.21.15.31:0/4172674453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc240c7ae0 con 0x7fcc10004810 2023-10-09T06:27:01.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.480+0000 7fcc22ffd700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc10004810 0x7fcc240c4f80 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c002b00 tx=0x7fcc1c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:01.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.481+0000 7fcc1affd700 1 -- 172.21.15.31:0/4172674453 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c006a30 con 0x7fcc10004810 2023-10-09T06:27:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.481+0000 7fcc1affd700 1 -- 172.21.15.31:0/4172674453 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c006bb0 con 0x7fcc10004810 2023-10-09T06:27:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.481+0000 7fcc296b2700 1 -- 172.21.15.31:0/4172674453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc240c7dc0 con 0x7fcc10004810 2023-10-09T06:27:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.481+0000 7fcc1affd700 1 -- 172.21.15.31:0/4172674453 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c007050 con 0x7fcc10004810 2023-10-09T06:27:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.481+0000 7fcc296b2700 1 -- 172.21.15.31:0/4172674453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc240c7490 con 0x7fcc10004810 2023-10-09T06:27:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.482+0000 7fcc296b2700 1 -- 172.21.15.31:0/4172674453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2404c3c0 con 0x7fcc10004810 2023-10-09T06:27:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.482+0000 7fcc1affd700 1 -- 172.21.15.31:0/4172674453 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc1c0073c0 con 0x7fcc10004810 2023-10-09T06:27:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.482+0000 7fcc1affd700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc04066f30 0x7fcc040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.482+0000 7fcc1affd700 1 -- 172.21.15.31:0/4172674453 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcc1c084550 con 0x7fcc10004810 2023-10-09T06:27:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.482+0000 7fcc227fc700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc04066f30 0x7fcc040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.483+0000 7fcc227fc700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc04066f30 0x7fcc040693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcc240c5580 tx=0x7fcc0c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:01.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.486+0000 7fcc1affd700 1 -- 172.21.15.31:0/4172674453 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc1c055550 con 0x7fcc10004810 2023-10-09T06:27:01.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:01.758+0000 7fcc296b2700 1 -- 172.21.15.31:0/4172674453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fcc2406cdc0 con 0x7fcc10004810 2023-10-09T06:27:02.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.342+0000 7fcc1affd700 1 -- 172.21.15.31:0/4172674453 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v317) v1 ==== 143+0+0 (secure 0 0 0) 0x7fcc1c0550e0 con 0x7fcc10004810 2023-10-09T06:27:02.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.345+0000 7fcc296b2700 1 -- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc04066f30 msgr2=0x7fcc040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:02.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.345+0000 7fcc296b2700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc04066f30 0x7fcc040693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcc240c5580 tx=0x7fcc0c015000 comp rx=0 tx=0).stop 2023-10-09T06:27:02.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.345+0000 7fcc296b2700 1 -- 172.21.15.31:0/4172674453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc10004810 msgr2=0x7fcc240c4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:02.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.345+0000 7fcc296b2700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc10004810 0x7fcc240c4f80 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c002b00 tx=0x7fcc1c007d30 comp rx=0 tx=0).stop 2023-10-09T06:27:02.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.345+0000 7fcc296b2700 1 -- 172.21.15.31:0/4172674453 shutdown_connections 2023-10-09T06:27:02.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.345+0000 7fcc296b2700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc04066f30 0x7fcc040693e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.345+0000 7fcc296b2700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc2415eb60 0x7fcc2415efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.345+0000 7fcc296b2700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc10004810 0x7fcc240c4f80 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.345+0000 7fcc296b2700 1 --2- 172.21.15.31:0/4172674453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc240c6b80 0x7fcc240b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.345+0000 7fcc296b2700 1 -- 172.21.15.31:0/4172674453 >> 172.21.15.31:0/4172674453 conn(0x7fcc2406fe50 msgr2=0x7fcc2415c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:02.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.345+0000 7fcc296b2700 1 -- 172.21.15.31:0/4172674453 shutdown_connections 2023-10-09T06:27:02.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.345+0000 7fcc296b2700 1 -- 172.21.15.31:0/4172674453 wait complete. 2023-10-09T06:27:02.362 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:27:02.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.490+0000 7fc865311700 1 Processor -- start 2023-10-09T06:27:02.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.490+0000 7fc865311700 1 -- start start 2023-10-09T06:27:02.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.491+0000 7fc865311700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc8600cd520 0x7fc8600ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.491+0000 7fc865311700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc8600cc720 0x7fc8600d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.491+0000 7fc865311700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc8600c7ea0 0x7fc8600c8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.491+0000 7fc865311700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8600cbbd0 con 0x7fc8600cd520 2023-10-09T06:27:02.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.491+0000 7fc865311700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86015a560 con 0x7fc8600c7ea0 2023-10-09T06:27:02.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.491+0000 7fc865311700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8600cf2d0 con 0x7fc8600cc720 2023-10-09T06:27:02.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.491+0000 7fc85effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc8600cd520 0x7fc8600ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.491+0000 7fc85effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc8600cd520 0x7fc8600ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49480/0 (socket says 172.21.15.31:49480) 2023-10-09T06:27:02.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.491+0000 7fc85effd700 1 -- 172.21.15.31:0/3365750350 learned_addr learned my addr 172.21.15.31:0/3365750350 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:02.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.491+0000 7fc85f7fe700 1 --2- 172.21.15.31:0/3365750350 >> v2:172.21.15.158:3300/0 conn(0x7fc8600c7ea0 0x7fc8600c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.491+0000 7fc85e7fc700 1 --2- 172.21.15.31:0/3365750350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc8600cc720 0x7fc8600d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.491+0000 7fc85effd700 1 -- 172.21.15.31:0/3365750350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc8600cc720 msgr2=0x7fc8600d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:02.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.491+0000 7fc85effd700 1 --2- 172.21.15.31:0/3365750350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc8600cc720 0x7fc8600d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc85effd700 1 -- 172.21.15.31:0/3365750350 >> v2:172.21.15.158:3300/0 conn(0x7fc8600c7ea0 msgr2=0x7fc8600c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:02.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc85effd700 1 --2- 172.21.15.31:0/3365750350 >> v2:172.21.15.158:3300/0 conn(0x7fc8600c7ea0 0x7fc8600c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc85effd700 1 -- 172.21.15.31:0/3365750350 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8600d0110 con 0x7fc8600cd520 2023-10-09T06:27:02.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc85f7fe700 1 --2- 172.21.15.31:0/3365750350 >> v2:172.21.15.158:3300/0 conn(0x7fc8600c7ea0 0x7fc8600c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:02.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc85effd700 1 --2- 172.21.15.31:0/3365750350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600cd520 0x7fc8600ced90 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fc86008a2a0 tx=0x7fc858009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b4ed515dbe576f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:02.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc85dffb700 1 -- 172.21.15.31:0/3365750350 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858005c10 con 0x7fc8600cd520 2023-10-09T06:27:02.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc85dffb700 1 -- 172.21.15.31:0/3365750350 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc858005d70 con 0x7fc8600cd520 2023-10-09T06:27:02.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc85dffb700 1 -- 172.21.15.31:0/3365750350 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85800b880 con 0x7fc8600cd520 2023-10-09T06:27:02.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc865311700 1 -- 172.21.15.31:0/3365750350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600cd520 msgr2=0x7fc8600ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:02.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc865311700 1 --2- 172.21.15.31:0/3365750350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600cd520 0x7fc8600ced90 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fc86008a2a0 tx=0x7fc858009220 comp rx=0 tx=0).stop 2023-10-09T06:27:02.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc865311700 1 -- 172.21.15.31:0/3365750350 shutdown_connections 2023-10-09T06:27:02.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc865311700 1 --2- 172.21.15.31:0/3365750350 >> v2:172.21.15.158:3300/0 conn(0x7fc8600c7ea0 0x7fc8600c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc865311700 1 --2- 172.21.15.31:0/3365750350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600cd520 0x7fc8600ced90 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc865311700 1 --2- 172.21.15.31:0/3365750350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc8600cc720 0x7fc8600d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc865311700 1 -- 172.21.15.31:0/3365750350 >> 172.21.15.31:0/3365750350 conn(0x7fc86009a170 msgr2=0x7fc860067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:02.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc865311700 1 -- 172.21.15.31:0/3365750350 shutdown_connections 2023-10-09T06:27:02.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.492+0000 7fc865311700 1 -- 172.21.15.31:0/3365750350 wait complete. 2023-10-09T06:27:02.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.494+0000 7fc865311700 1 Processor -- start 2023-10-09T06:27:02.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.494+0000 7fc865311700 1 -- start start 2023-10-09T06:27:02.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.494+0000 7fc865311700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc8600c7ea0 0x7fc860156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.494+0000 7fc865311700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600cc720 0x7fc86016b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.494+0000 7fc865311700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc8600cd520 0x7fc8600c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.494+0000 7fc865311700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86016b250 con 0x7fc8600cc720 2023-10-09T06:27:02.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc865311700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86009cbf0 con 0x7fc8600c7ea0 2023-10-09T06:27:02.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc865311700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc860157240 con 0x7fc8600cd520 2023-10-09T06:27:02.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc85e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600cc720 0x7fc86016b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc85e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600cc720 0x7fc86016b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49484/0 (socket says 172.21.15.31:49484) 2023-10-09T06:27:02.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc85e7fc700 1 -- 172.21.15.31:0/752818860 learned_addr learned my addr 172.21.15.31:0/752818860 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:02.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc85effd700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc8600c7ea0 0x7fc860156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc85f7fe700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc8600cd520 0x7fc8600c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc85e7fc700 1 -- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc8600cd520 msgr2=0x7fc8600c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:02.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc85e7fc700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc8600cd520 0x7fc8600c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc85e7fc700 1 -- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc8600c7ea0 msgr2=0x7fc860156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:02.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc85e7fc700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc8600c7ea0 0x7fc860156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc85e7fc700 1 -- 172.21.15.31:0/752818860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858009480 con 0x7fc8600cc720 2023-10-09T06:27:02.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc85effd700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc8600c7ea0 0x7fc860156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:02.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc85e7fc700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600cc720 0x7fc86016b430 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc84800c880 tx=0x7fc848008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:02.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc856ffd700 1 -- 172.21.15.31:0/752818860 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc848011600 con 0x7fc8600cc720 2023-10-09T06:27:02.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc856ffd700 1 -- 172.21.15.31:0/752818860 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc848011780 con 0x7fc8600cc720 2023-10-09T06:27:02.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc856ffd700 1 -- 172.21.15.31:0/752818860 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc848011b40 con 0x7fc8600cc720 2023-10-09T06:27:02.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc865311700 1 -- 172.21.15.31:0/752818860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86009c2c0 con 0x7fc8600cc720 2023-10-09T06:27:02.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.495+0000 7fc865311700 1 -- 172.21.15.31:0/752818860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86009c880 con 0x7fc8600cc720 2023-10-09T06:27:02.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.496+0000 7fc865311700 1 -- 172.21.15.31:0/752818860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86009cda0 con 0x7fc8600cc720 2023-10-09T06:27:02.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.497+0000 7fc856ffd700 1 -- 172.21.15.31:0/752818860 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc848018360 con 0x7fc8600cc720 2023-10-09T06:27:02.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.497+0000 7fc856ffd700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc840066f30 0x7fc8400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.497+0000 7fc856ffd700 1 -- 172.21.15.31:0/752818860 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc848083f30 con 0x7fc8600cc720 2023-10-09T06:27:02.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.497+0000 7fc85effd700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc840066f30 0x7fc8400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.498+0000 7fc85effd700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc840066f30 0x7fc8400693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc858009260 tx=0x7fc858016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:02.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.501+0000 7fc856ffd700 1 -- 172.21.15.31:0/752818860 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc86009cda0 con 0x7fc8600cc720 2023-10-09T06:27:02.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.692+0000 7fc865311700 1 -- 172.21.15.31:0/752818860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc86009cd60 con 0x7fc8600cc720 2023-10-09T06:27:02.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.696+0000 7fc856ffd700 1 -- 172.21.15.31:0/752818860 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc8480150c0 con 0x7fc8600cc720 2023-10-09T06:27:02.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.698+0000 7fc865311700 1 -- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc840066f30 msgr2=0x7fc8400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:02.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.698+0000 7fc865311700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc840066f30 0x7fc8400693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc858009260 tx=0x7fc858016000 comp rx=0 tx=0).stop 2023-10-09T06:27:02.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.698+0000 7fc865311700 1 -- 172.21.15.31:0/752818860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600cc720 msgr2=0x7fc86016b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:02.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.698+0000 7fc865311700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600cc720 0x7fc86016b430 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc84800c880 tx=0x7fc848008040 comp rx=0 tx=0).stop 2023-10-09T06:27:02.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.698+0000 7fc865311700 1 -- 172.21.15.31:0/752818860 shutdown_connections 2023-10-09T06:27:02.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.698+0000 7fc865311700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc840066f30 0x7fc8400693e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.698+0000 7fc865311700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc8600cd520 0x7fc8600c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.698+0000 7fc865311700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc8600c7ea0 0x7fc860156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.698+0000 7fc865311700 1 --2- 172.21.15.31:0/752818860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600cc720 0x7fc86016b430 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.698+0000 7fc865311700 1 -- 172.21.15.31:0/752818860 >> 172.21.15.31:0/752818860 conn(0x7fc86009a170 msgr2=0x7fc860067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:02.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.698+0000 7fc865311700 1 -- 172.21.15.31:0/752818860 shutdown_connections 2023-10-09T06:27:02.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.698+0000 7fc865311700 1 -- 172.21.15.31:0/752818860 wait complete. 2023-10-09T06:27:02.710 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:27:02.711 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:27:02.748 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:27:02.797 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:27:02.797 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:27:02.797 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:27:02.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.915+0000 7efdba854700 1 Processor -- start 2023-10-09T06:27:02.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.915+0000 7efdba854700 1 -- start start 2023-10-09T06:27:02.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdba854700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb4157c40 0x7efdb4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdba854700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb415cbb0 con 0x7efdb415a620 2023-10-09T06:27:02.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdba854700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb415bfa0 con 0x7efdb4157870 2023-10-09T06:27:02.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdba854700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb415bdb0 con 0x7efdb4157c40 2023-10-09T06:27:02.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdb37fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efdb415a620 0x7efdb415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48696/0 (socket says 172.21.15.31:48696) 2023-10-09T06:27:02.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdb37fe700 1 -- 172.21.15.31:0/906010270 learned_addr learned my addr 172.21.15.31:0/906010270 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:02.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649085055 0 0) 0x7efdb415cbb0 con 0x7efdb415a620 2023-10-09T06:27:02.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdb8df1700 1 --2- 172.21.15.31:0/906010270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb4157c40 0x7efdb4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd9c003570 con 0x7efdb415a620 2023-10-09T06:27:02.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3523791917 0 0) 0x7efd9c003570 con 0x7efdb415a620 2023-10-09T06:27:02.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb4157c40 msgr2=0x7efdb4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:02.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdb2ffd700 1 --2- 172.21.15.31:0/906010270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb4157c40 0x7efdb4158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 >> v1:172.21.15.158:6789/0 conn(0x7efdb4157870 legacy=0x7efdb415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:02.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb415c280 con 0x7efdb415a620 2023-10-09T06:27:02.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7efda8001470 con 0x7efdb415a620 2023-10-09T06:27:02.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.916+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 >> v1:172.21.15.31:6789/0 conn(0x7efdb415a620 legacy=0x7efdb415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:02.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb2ffd700 1 --2- 172.21.15.31:0/906010270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb4157c40 0x7efd9c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb2ffd700 1 --2- 172.21.15.31:0/906010270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c0040c0 0x7efd9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb2ffd700 1 --2- 172.21.15.31:0/906010270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd9c004da0 0x7efd9c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c00bc40 con 0x7efd9c0040c0 2023-10-09T06:27:02.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c00bdb0 con 0x7efd9c004da0 2023-10-09T06:27:02.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c00bf70 con 0x7efdb4157c40 2023-10-09T06:27:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb37fe700 1 --2- 172.21.15.31:0/906010270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c0040c0 0x7efd9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb8df1700 1 --2- 172.21.15.31:0/906010270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd9c004da0 0x7efd9c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb3fff700 1 --2- 172.21.15.31:0/906010270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb4157c40 0x7efd9c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb37fe700 1 -- 172.21.15.31:0/906010270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb4157c40 msgr2=0x7efd9c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb37fe700 1 --2- 172.21.15.31:0/906010270 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb4157c40 0x7efd9c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb37fe700 1 -- 172.21.15.31:0/906010270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd9c004da0 msgr2=0x7efd9c0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb37fe700 1 --2- 172.21.15.31:0/906010270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd9c004da0 0x7efd9c0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb37fe700 1 -- 172.21.15.31:0/906010270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c003570 con 0x7efd9c0040c0 2023-10-09T06:27:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb37fe700 1 --2- 172.21.15.31:0/906010270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c0040c0 0x7efd9c004810 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7efda800c390 tx=0x7efda8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bb49657cb596a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800cc60 con 0x7efd9c0040c0 2023-10-09T06:27:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda800cde0 con 0x7efd9c0040c0 2023-10-09T06:27:02.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.917+0000 7efdb2ffd700 1 -- 172.21.15.31:0/906010270 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8005b70 con 0x7efd9c0040c0 2023-10-09T06:27:02.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.918+0000 7efdba854700 1 -- 172.21.15.31:0/906010270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c0040c0 msgr2=0x7efd9c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:02.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.918+0000 7efdba854700 1 --2- 172.21.15.31:0/906010270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c0040c0 0x7efd9c004810 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7efda800c390 tx=0x7efda8001e50 comp rx=0 tx=0).stop 2023-10-09T06:27:02.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.918+0000 7efdb8df1700 1 -- 172.21.15.31:0/906010270 reap_dead start 2023-10-09T06:27:02.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.918+0000 7efdba854700 1 -- 172.21.15.31:0/906010270 shutdown_connections 2023-10-09T06:27:02.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.918+0000 7efdba854700 1 -- 172.21.15.31:0/906010270 >> 172.21.15.31:0/906010270 conn(0x7efdb4068ce0 msgr2=0x7efdb40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:02.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.918+0000 7efdba854700 1 -- 172.21.15.31:0/906010270 shutdown_connections 2023-10-09T06:27:02.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.918+0000 7efdba854700 1 -- 172.21.15.31:0/906010270 wait complete. 2023-10-09T06:27:02.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.919+0000 7efdba854700 1 Processor -- start 2023-10-09T06:27:02.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.919+0000 7efdba854700 1 -- start start 2023-10-09T06:27:02.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdba854700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd9c0040c0 0x7efdb41489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdba854700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdb40c6900 0x7efdb415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdba854700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb40c73c0 0x7efdb40c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdba854700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb40c7d70 con 0x7efdb40c6900 2023-10-09T06:27:02.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdba854700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb415e710 con 0x7efd9c0040c0 2023-10-09T06:27:02.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdba854700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb4148ef0 con 0x7efdb40c73c0 2023-10-09T06:27:02.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdb37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdb40c6900 0x7efdb415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdb37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdb40c6900 0x7efdb415d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49504/0 (socket says 172.21.15.31:49504) 2023-10-09T06:27:02.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdb37fe700 1 -- 172.21.15.31:0/3047936055 learned_addr learned my addr 172.21.15.31:0/3047936055 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:02.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdb3fff700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd9c0040c0 0x7efdb41489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdb8df1700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb40c73c0 0x7efdb40c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdb37fe700 1 -- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb40c73c0 msgr2=0x7efdb40c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:02.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdb37fe700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb40c73c0 0x7efdb40c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdb37fe700 1 -- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd9c0040c0 msgr2=0x7efdb41489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:02.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdb37fe700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd9c0040c0 0x7efdb41489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:02.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.920+0000 7efdb37fe700 1 -- 172.21.15.31:0/3047936055 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb415db00 con 0x7efdb40c6900 2023-10-09T06:27:02.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.921+0000 7efdb37fe700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdb40c6900 0x7efdb415d200 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7efda800c980 tx=0x7efda8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:02.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.921+0000 7efd9bfff700 1 -- 172.21.15.31:0/3047936055 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800cc60 con 0x7efdb40c6900 2023-10-09T06:27:02.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.921+0000 7efd9bfff700 1 -- 172.21.15.31:0/3047936055 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda80072e0 con 0x7efdb40c6900 2023-10-09T06:27:02.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.921+0000 7efdba854700 1 -- 172.21.15.31:0/3047936055 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb415dde0 con 0x7efdb40c6900 2023-10-09T06:27:02.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.921+0000 7efd9bfff700 1 -- 172.21.15.31:0/3047936055 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80076a0 con 0x7efdb40c6900 2023-10-09T06:27:02.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.921+0000 7efdba854700 1 -- 172.21.15.31:0/3047936055 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb415e3a0 con 0x7efdb40c6900 2023-10-09T06:27:02.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.922+0000 7efdba854700 1 -- 172.21.15.31:0/3047936055 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb415e8c0 con 0x7efdb40c6900 2023-10-09T06:27:02.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.922+0000 7efd9bfff700 1 -- 172.21.15.31:0/3047936055 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efda8019030 con 0x7efdb40c6900 2023-10-09T06:27:02.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.922+0000 7efd9bfff700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efda0066f30 0x7efda00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:02.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.923+0000 7efd9bfff700 1 -- 172.21.15.31:0/3047936055 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efda8085120 con 0x7efdb40c6900 2023-10-09T06:27:02.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.923+0000 7efdb3fff700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efda0066f30 0x7efda00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:02.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.923+0000 7efdb3fff700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efda0066f30 0x7efda00693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efda4000c00 tx=0x7efda4007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:02.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:02.927+0000 7efd9bfff700 1 -- 172.21.15.31:0/3047936055 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdb415e8c0 con 0x7efdb40c6900 2023-10-09T06:27:03.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.163+0000 7efdba854700 1 -- 172.21.15.31:0/3047936055 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdb415e8c0 con 0x7efdb40c6900 2023-10-09T06:27:03.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.163+0000 7efd9bfff700 1 -- 172.21.15.31:0/3047936055 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3529 (secure 0 0 0) 0x7efda8017de0 con 0x7efdb40c6900 2023-10-09T06:27:03.164 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:03.164 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":60,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/487353090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":487353090},{"type":"v1","addr":"172.21.15.158:6837","nonce":487353090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/3396628353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3396628353},{"type":"v1","addr":"172.21.15.158:6836","nonce":3396628353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/1862816590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1862816590},{"type":"v1","addr":"172.21.15.31:6833","nonce":1862816590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/975812546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":975812546},{"type":"v1","addr":"172.21.15.31:6835","nonce":975812546}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[]} 2023-10-09T06:27:03.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.165+0000 7efdba854700 1 -- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efda0066f30 msgr2=0x7efda00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:03.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.165+0000 7efdba854700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efda0066f30 0x7efda00693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efda4000c00 tx=0x7efda4007d30 comp rx=0 tx=0).stop 2023-10-09T06:27:03.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.165+0000 7efdba854700 1 -- 172.21.15.31:0/3047936055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdb40c6900 msgr2=0x7efdb415d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:03.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.165+0000 7efdba854700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdb40c6900 0x7efdb415d200 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7efda800c980 tx=0x7efda8015000 comp rx=0 tx=0).stop 2023-10-09T06:27:03.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.165+0000 7efdba854700 1 -- 172.21.15.31:0/3047936055 shutdown_connections 2023-10-09T06:27:03.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.165+0000 7efdba854700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efda0066f30 0x7efda00693e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:03.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.165+0000 7efdba854700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efdb40c73c0 0x7efdb40c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:03.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.165+0000 7efdba854700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd9c0040c0 0x7efdb41489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:03.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.165+0000 7efdba854700 1 --2- 172.21.15.31:0/3047936055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdb40c6900 0x7efdb415d200 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:03.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.165+0000 7efdba854700 1 -- 172.21.15.31:0/3047936055 >> 172.21.15.31:0/3047936055 conn(0x7efdb4068ce0 msgr2=0x7efdb40cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:03.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.165+0000 7efdba854700 1 -- 172.21.15.31:0/3047936055 shutdown_connections 2023-10-09T06:27:03.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.165+0000 7efdba854700 1 -- 172.21.15.31:0/3047936055 wait complete. 2023-10-09T06:27:03.167 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 60 2023-10-09T06:27:03.178 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:27:03.178 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:27:03.179 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:27:03.179 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:27:03.179 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:27:03.179 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:27:03.179 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:27:03.179 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:27:03.179 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:27:03.180 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:27:03.180 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:27:03.180 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:27:03.180 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:27:03.180 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:27:03.180 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:27:03.180 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:27:03.187 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:27:03.187 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:27:03.188 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:27:03.188 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:27:03.190 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:27:03.190 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:27:03.191 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:27:03.191 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:27:03.230 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:27:03.230 DEBUG:teuthology.parallel:result is None 2023-10-09T06:27:03.232 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:27:03.232 DEBUG:teuthology.parallel:result is None 2023-10-09T06:27:03.233 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:27:03.233 DEBUG:teuthology.parallel:result is None 2023-10-09T06:27:03.233 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:27:03.234 DEBUG:teuthology.parallel:result is None 2023-10-09T06:27:03.234 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:27:03.307 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-10-09T06:27:03.307 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:27:03.312 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-09T06:27:03.313 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:27:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.365+0000 7fe7e2940700 1 Processor -- start 2023-10-09T06:27:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.365+0000 7fe7e2940700 1 -- start start 2023-10-09T06:27:03.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.365+0000 7fe7e2940700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe7dc0aedb0 0x7fe7dc0af180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:03.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.365+0000 7fe7e2940700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7dc0c90f0 0x7fe7dc0c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:03.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.365+0000 7fe7e2940700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7dc06efc0 con 0x7fe7dc06f450 2023-10-09T06:27:03.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7e2940700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc158470 con 0x7fe7dc0aedb0 2023-10-09T06:27:03.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7e2940700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0af6c0 con 0x7fe7dc0c90f0 2023-10-09T06:27:03.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7dbfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe7dc0aedb0 0x7fe7dc0af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:03.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7db7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe7dc06f450 0x7fe7dc0b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48710/0 (socket says 172.21.15.31:48710) 2023-10-09T06:27:03.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7db7fe700 1 -- 172.21.15.31:0/2742186071 learned_addr learned my addr 172.21.15.31:0/2742186071 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:03.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7e0edd700 1 --2- 172.21.15.31:0/2742186071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7dc0c90f0 0x7fe7dc0c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:03.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7dbfff700 1 -- 172.21.15.31:0/2742186071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7dc0c90f0 msgr2=0x7fe7dc0c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:03.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7dbfff700 1 --2- 172.21.15.31:0/2742186071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7dc0c90f0 0x7fe7dc0c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:03.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7dbfff700 1 -- 172.21.15.31:0/2742186071 >> v1:172.21.15.31:6789/0 conn(0x7fe7dc06f450 legacy=0x7fe7dc0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:03.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7dbfff700 1 -- 172.21.15.31:0/2742186071 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc0b2100 con 0x7fe7dc0aedb0 2023-10-09T06:27:03.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7e0edd700 1 --2- 172.21.15.31:0/2742186071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7dc0c90f0 0x7fe7dc0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:03.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7dbfff700 1 --2- 172.21.15.31:0/2742186071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7dc0aedb0 0x7fe7dc0af180 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0098e0 tx=0x7fe7cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec2b25cc590fd57 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:03.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7daffd700 1 -- 172.21.15.31:0/2742186071 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc009e80 con 0x7fe7dc0aedb0 2023-10-09T06:27:03.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7daffd700 1 -- 172.21.15.31:0/2742186071 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc00b860 con 0x7fe7dc0aedb0 2023-10-09T06:27:03.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.366+0000 7fe7daffd700 1 -- 172.21.15.31:0/2742186071 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00bbe0 con 0x7fe7dc0aedb0 2023-10-09T06:27:03.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.367+0000 7fe7e2940700 1 -- 172.21.15.31:0/2742186071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7dc0aedb0 msgr2=0x7fe7dc0af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:03.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.367+0000 7fe7e2940700 1 --2- 172.21.15.31:0/2742186071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7dc0aedb0 0x7fe7dc0af180 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0098e0 tx=0x7fe7cc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:03.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.367+0000 7fe7e2940700 1 -- 172.21.15.31:0/2742186071 shutdown_connections 2023-10-09T06:27:03.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.367+0000 7fe7e2940700 1 --2- 172.21.15.31:0/2742186071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7dc0aedb0 0x7fe7dc0af180 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:03.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.367+0000 7fe7e2940700 1 --2- 172.21.15.31:0/2742186071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7dc0c90f0 0x7fe7dc0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:03.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.367+0000 7fe7e2940700 1 -- 172.21.15.31:0/2742186071 >> 172.21.15.31:0/2742186071 conn(0x7fe7dc0cd1e0 msgr2=0x7fe7dc0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:03.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.367+0000 7fe7e2940700 1 -- 172.21.15.31:0/2742186071 shutdown_connections 2023-10-09T06:27:03.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.367+0000 7fe7e2940700 1 -- 172.21.15.31:0/2742186071 wait complete. 2023-10-09T06:27:03.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.368+0000 7fe7e2940700 1 Processor -- start 2023-10-09T06:27:03.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.368+0000 7fe7e2940700 1 -- start start 2023-10-09T06:27:03.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.369+0000 7fe7e2940700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7dc06f450 0x7fe7dc0c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:03.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.369+0000 7fe7e2940700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7dc0aedb0 0x7fe7dc14e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:03.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.369+0000 7fe7e2940700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7dc0c90f0 0x7fe7dc0c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:03.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.369+0000 7fe7e2940700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0c6ba0 con 0x7fe7dc0c90f0 2023-10-09T06:27:03.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.369+0000 7fe7e2940700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0c7120 con 0x7fe7dc0aedb0 2023-10-09T06:27:03.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.369+0000 7fe7e2940700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0c6e40 con 0x7fe7dc06f450 2023-10-09T06:27:03.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.369+0000 7fe7e0edd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7dc0c90f0 0x7fe7dc0c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:03.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.369+0000 7fe7e0edd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7dc0c90f0 0x7fe7dc0c6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49542/0 (socket says 172.21.15.31:49542) 2023-10-09T06:27:03.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.369+0000 7fe7e0edd700 1 -- 172.21.15.31:0/406149611 learned_addr learned my addr 172.21.15.31:0/406149611 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:03.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.369+0000 7fe7dbfff700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7dc06f450 0x7fe7dc0c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:03.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.369+0000 7fe7db7fe700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7dc0aedb0 0x7fe7dc14e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:03.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.370+0000 7fe7e0edd700 1 -- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7dc06f450 msgr2=0x7fe7dc0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:03.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.370+0000 7fe7e0edd700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7dc06f450 0x7fe7dc0c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:03.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.370+0000 7fe7e0edd700 1 -- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7dc0aedb0 msgr2=0x7fe7dc14e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:03.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.370+0000 7fe7e0edd700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7dc0aedb0 0x7fe7dc14e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:03.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.370+0000 7fe7e0edd700 1 -- 172.21.15.31:0/406149611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc009420 con 0x7fe7dc0c90f0 2023-10-09T06:27:03.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.370+0000 7fe7e0edd700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7dc0c90f0 0x7fe7dc0c6660 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4009fc0 tx=0x7fe7d40099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:03.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.370+0000 7fe7c3fff700 1 -- 172.21.15.31:0/406149611 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d400dbe0 con 0x7fe7dc0c90f0 2023-10-09T06:27:03.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.370+0000 7fe7c3fff700 1 -- 172.21.15.31:0/406149611 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d400f040 con 0x7fe7dc0c90f0 2023-10-09T06:27:03.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.370+0000 7fe7e2940700 1 -- 172.21.15.31:0/406149611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc0acc40 con 0x7fe7dc0c90f0 2023-10-09T06:27:03.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.370+0000 7fe7c3fff700 1 -- 172.21.15.31:0/406149611 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4015440 con 0x7fe7dc0c90f0 2023-10-09T06:27:03.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.370+0000 7fe7e2940700 1 -- 172.21.15.31:0/406149611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7dc0ad200 con 0x7fe7dc0c90f0 2023-10-09T06:27:03.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.371+0000 7fe7e2940700 1 -- 172.21.15.31:0/406149611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7dc04c3c0 con 0x7fe7dc0c90f0 2023-10-09T06:27:03.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.371+0000 7fe7c3fff700 1 -- 172.21.15.31:0/406149611 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7d401e3b0 con 0x7fe7dc0c90f0 2023-10-09T06:27:03.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.372+0000 7fe7c3fff700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe7c8066f30 0x7fe7c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:03.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.372+0000 7fe7c3fff700 1 -- 172.21.15.31:0/406149611 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe7d4084580 con 0x7fe7dc0c90f0 2023-10-09T06:27:03.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.372+0000 7fe7dbfff700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe7c8066f30 0x7fe7c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:03.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.372+0000 7fe7dbfff700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe7c8066f30 0x7fe7c80693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0091e0 tx=0x7fe7cc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:03.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.376+0000 7fe7c3fff700 1 -- 172.21.15.31:0/406149611 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7d4051af0 con 0x7fe7dc0c90f0 2023-10-09T06:27:03.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:03.585+0000 7fe7e2940700 1 -- 172.21.15.31:0/406149611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe7dc0b23e0 con 0x7fe7dc0c90f0 2023-10-09T06:27:04.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.354+0000 7fe7c3fff700 1 -- 172.21.15.31:0/406149611 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v132) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe7d4055110 con 0x7fe7dc0c90f0 2023-10-09T06:27:04.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.357+0000 7fe7e2940700 1 -- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe7c8066f30 msgr2=0x7fe7c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:04.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.357+0000 7fe7e2940700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe7c8066f30 0x7fe7c80693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0091e0 tx=0x7fe7cc017000 comp rx=0 tx=0).stop 2023-10-09T06:27:04.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.357+0000 7fe7e2940700 1 -- 172.21.15.31:0/406149611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7dc0c90f0 msgr2=0x7fe7dc0c6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:04.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.357+0000 7fe7e2940700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7dc0c90f0 0x7fe7dc0c6660 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4009fc0 tx=0x7fe7d40099b0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.357+0000 7fe7e2940700 1 -- 172.21.15.31:0/406149611 shutdown_connections 2023-10-09T06:27:04.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.357+0000 7fe7e2940700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe7c8066f30 0x7fe7c80693e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.357+0000 7fe7e2940700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7dc06f450 0x7fe7dc0c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.357+0000 7fe7e2940700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7dc0c90f0 0x7fe7dc0c6660 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.357+0000 7fe7e2940700 1 --2- 172.21.15.31:0/406149611 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7dc0aedb0 0x7fe7dc14e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.357+0000 7fe7e2940700 1 -- 172.21.15.31:0/406149611 >> 172.21.15.31:0/406149611 conn(0x7fe7dc0cd1e0 msgr2=0x7fe7dc157790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:04.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.357+0000 7fe7e2940700 1 -- 172.21.15.31:0/406149611 shutdown_connections 2023-10-09T06:27:04.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.357+0000 7fe7e2940700 1 -- 172.21.15.31:0/406149611 wait complete. 2023-10-09T06:27:04.359 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2023-10-09T06:27:04.371 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:27:04.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.493+0000 7f55e700d700 1 Processor -- start 2023-10-09T06:27:04.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.493+0000 7f55e700d700 1 -- start start 2023-10-09T06:27:04.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.494+0000 7f55e700d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55e006ac30 0x7f55e0164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:04.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.494+0000 7f55e700d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e015c360 con 0x7f55e0157ba0 2023-10-09T06:27:04.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.494+0000 7f55e700d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e015b790 con 0x7f55e01577d0 2023-10-09T06:27:04.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.494+0000 7f55e700d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e015d800 con 0x7f55e006ac30 2023-10-09T06:27:04.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.494+0000 7f55dffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f55e0157ba0 0x7f55e006a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48720/0 (socket says 172.21.15.31:48720) 2023-10-09T06:27:04.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.494+0000 7f55dffff700 1 -- 172.21.15.31:0/730530602 learned_addr learned my addr 172.21.15.31:0/730530602 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:04.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.495+0000 7f55e55aa700 1 --2- 172.21.15.31:0/730530602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55e006ac30 0x7f55e0164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:04.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.495+0000 7f55df7fe700 1 -- 172.21.15.31:0/730530602 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1295764772 0 0) 0x7f55e015c360 con 0x7f55e0157ba0 2023-10-09T06:27:04.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.495+0000 7f55df7fe700 1 -- 172.21.15.31:0/730530602 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55cc003570 con 0x7f55e0157ba0 2023-10-09T06:27:04.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.495+0000 7f55df7fe700 1 -- 172.21.15.31:0/730530602 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861423275 0 0) 0x7f55e015b790 con 0x7f55e01577d0 2023-10-09T06:27:04.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.495+0000 7f55df7fe700 1 -- 172.21.15.31:0/730530602 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e015c360 con 0x7f55e01577d0 2023-10-09T06:27:04.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.495+0000 7f55e55aa700 1 -- 172.21.15.31:0/730530602 >> v1:172.21.15.158:6789/0 conn(0x7f55e01577d0 legacy=0x7f55e00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:04.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.495+0000 7f55df7fe700 1 -- 172.21.15.31:0/730530602 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3125219071 0 0) 0x7f55cc003570 con 0x7f55e0157ba0 2023-10-09T06:27:04.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.495+0000 7f55e55aa700 1 -- 172.21.15.31:0/730530602 >> v1:172.21.15.31:6789/0 conn(0x7f55e0157ba0 legacy=0x7f55e006a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:04.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.495+0000 7f55e55aa700 1 -- 172.21.15.31:0/730530602 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e015ba30 con 0x7f55e006ac30 2023-10-09T06:27:04.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.495+0000 7f55e55aa700 1 --2- 172.21.15.31:0/730530602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55e006ac30 0x7f55e0164e30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009910 tx=0x7f55d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ae21cfffa34c5d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:04.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.495+0000 7f55df7fe700 1 -- 172.21.15.31:0/730530602 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d00017f0 con 0x7f55e006ac30 2023-10-09T06:27:04.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.496+0000 7f55df7fe700 1 -- 172.21.15.31:0/730530602 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d8011420 con 0x7f55e006ac30 2023-10-09T06:27:04.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.496+0000 7f55df7fe700 1 -- 172.21.15.31:0/730530602 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80117c0 con 0x7f55e006ac30 2023-10-09T06:27:04.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.496+0000 7f55e700d700 1 -- 172.21.15.31:0/730530602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55e006ac30 msgr2=0x7f55e0164e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:04.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.496+0000 7f55e700d700 1 --2- 172.21.15.31:0/730530602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55e006ac30 0x7f55e0164e30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009910 tx=0x7f55d80091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.496+0000 7f55e700d700 1 -- 172.21.15.31:0/730530602 shutdown_connections 2023-10-09T06:27:04.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.496+0000 7f55e700d700 1 --2- 172.21.15.31:0/730530602 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55e006ac30 0x7f55e0164e30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.496+0000 7f55e700d700 1 -- 172.21.15.31:0/730530602 >> 172.21.15.31:0/730530602 conn(0x7f55e0068ce0 msgr2=0x7f55e00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:04.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.496+0000 7f55e700d700 1 -- 172.21.15.31:0/730530602 shutdown_connections 2023-10-09T06:27:04.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.496+0000 7f55e700d700 1 -- 172.21.15.31:0/730530602 wait complete. 2023-10-09T06:27:04.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.497+0000 7f55e700d700 1 Processor -- start 2023-10-09T06:27:04.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.497+0000 7f55e700d700 1 -- start start 2023-10-09T06:27:04.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.498+0000 7f55e700d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55e006ac30 0x7f55e00b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:04.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.498+0000 7f55e700d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55e01577d0 0x7f55e01417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:04.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.498+0000 7f55e700d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55e0157ba0 0x7f55e015ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:04.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.498+0000 7f55e700d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e016dc20 con 0x7f55e01577d0 2023-10-09T06:27:04.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.498+0000 7f55e700d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e016df00 con 0x7f55e006ac30 2023-10-09T06:27:04.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.498+0000 7f55e700d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e016e1e0 con 0x7f55e0157ba0 2023-10-09T06:27:04.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.498+0000 7f55dffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55e01577d0 0x7f55e01417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:04.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.498+0000 7f55dffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55e01577d0 0x7f55e01417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49546/0 (socket says 172.21.15.31:49546) 2023-10-09T06:27:04.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.498+0000 7f55dffff700 1 -- 172.21.15.31:0/300264745 learned_addr learned my addr 172.21.15.31:0/300264745 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:04.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.498+0000 7f55e55aa700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55e0157ba0 0x7f55e015ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:04.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.498+0000 7f55e4da9700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55e006ac30 0x7f55e00b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:04.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.499+0000 7f55dffff700 1 -- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55e0157ba0 msgr2=0x7f55e015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:04.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.499+0000 7f55dffff700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55e0157ba0 0x7f55e015ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.499+0000 7f55dffff700 1 -- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55e006ac30 msgr2=0x7f55e00b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:04.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.499+0000 7f55dffff700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55e006ac30 0x7f55e00b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.499+0000 7f55dffff700 1 -- 172.21.15.31:0/300264745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d8009420 con 0x7f55e01577d0 2023-10-09T06:27:04.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.499+0000 7f55e4da9700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55e006ac30 0x7f55e00b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:04.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.499+0000 7f55dffff700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55e01577d0 0x7f55e01417a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f55d0002250 tx=0x7f55d0007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:04.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.499+0000 7f55dcff9700 1 -- 172.21.15.31:0/300264745 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d0004dc0 con 0x7f55e01577d0 2023-10-09T06:27:04.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.499+0000 7f55dcff9700 1 -- 172.21.15.31:0/300264745 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d000a6a0 con 0x7f55e01577d0 2023-10-09T06:27:04.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.499+0000 7f55e700d700 1 -- 172.21.15.31:0/300264745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e016e4c0 con 0x7f55e01577d0 2023-10-09T06:27:04.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.499+0000 7f55dcff9700 1 -- 172.21.15.31:0/300264745 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d000aa60 con 0x7f55e01577d0 2023-10-09T06:27:04.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.499+0000 7f55e700d700 1 -- 172.21.15.31:0/300264745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e016d840 con 0x7f55e01577d0 2023-10-09T06:27:04.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.500+0000 7f55e700d700 1 -- 172.21.15.31:0/300264745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e004c3c0 con 0x7f55e01577d0 2023-10-09T06:27:04.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.500+0000 7f55dcff9700 1 -- 172.21.15.31:0/300264745 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55d0007150 con 0x7f55e01577d0 2023-10-09T06:27:04.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.501+0000 7f55dcff9700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55c0066f30 0x7f55c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:04.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.501+0000 7f55dcff9700 1 -- 172.21.15.31:0/300264745 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f55d0083cb0 con 0x7f55e01577d0 2023-10-09T06:27:04.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.501+0000 7f55e4da9700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55c0066f30 0x7f55c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:04.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.502+0000 7f55e4da9700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55c0066f30 0x7f55c00693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f55c8003990 tx=0x7f55c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:04.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.505+0000 7f55dcff9700 1 -- 172.21.15.31:0/300264745 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55d00512f0 con 0x7f55e01577d0 2023-10-09T06:27:04.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.777+0000 7f55e700d700 1 -- 172.21.15.31:0/300264745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f55e0069b30 con 0x7f55e01577d0 2023-10-09T06:27:04.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.777+0000 7f55dcff9700 1 -- 172.21.15.31:0/300264745 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f55d0018020 con 0x7f55e01577d0 2023-10-09T06:27:04.778 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:04.778 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:27:04.778 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2023-10-09T06:27:04.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.778 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2023-10-09T06:27:04.778 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl/nWKAxAA1kcqjt4lPGPkmDivDpIVjQ==", 2023-10-09T06:27:04.779 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.779 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:04.779 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:27:04.779 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:27:04.779 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.779 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.779 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2023-10-09T06:27:04.780 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl9xYEDxAAQJeaqz7lkrArv45vLGb34g==", 2023-10-09T06:27:04.780 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.780 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:04.780 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:27:04.780 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:27:04.780 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.780 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.781 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2023-10-09T06:27:04.781 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlJOp0ChAADGiI4SX7ZLvDrtjDtU905A==", 2023-10-09T06:27:04.781 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.781 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:04.781 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:27:04.781 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:27:04.781 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.782 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.782 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2023-10-09T06:27:04.782 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlbnnJFRAAO+XoxRQDaHv0ZicyggniLQ==", 2023-10-09T06:27:04.782 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.782 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:04.782 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:27:04.783 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:27:04.783 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.783 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.783 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2023-10-09T06:27:04.783 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNloyZ+LxAApAHpPxV7R1OVE2wlIaU+PA==", 2023-10-09T06:27:04.783 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.783 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:04.784 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:04.784 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.784 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.784 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2023-10-09T06:27:04.784 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNlvHeUNhAAXblIEmmsc5eTo5VcZVirfA==", 2023-10-09T06:27:04.785 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.785 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:04.785 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:04.785 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.785 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.785 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2023-10-09T06:27:04.786 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlxfIaBBAAE8WbXh4Q4SxaW2k7MkSTHg==", 2023-10-09T06:27:04.786 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.786 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:04.786 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:04.786 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.786 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.787 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2023-10-09T06:27:04.787 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlUtX3DRAA5NEq+lFMzqhu1GF1ZWT2ag==", 2023-10-09T06:27:04.787 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.787 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:04.787 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:04.787 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.787 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.788 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2023-10-09T06:27:04.788 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlcWc5IBAA5e62AwhIuHdw4dTjnNS8hQ==", 2023-10-09T06:27:04.788 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.788 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:04.788 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:04.788 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.788 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.789 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2023-10-09T06:27:04.789 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlX5S6JhAAzvzO2YEqEtq2fJ3FW9Fddg==", 2023-10-09T06:27:04.789 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.789 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:04.789 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:04.790 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.790 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.790 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.790 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2023-10-09T06:27:04.790 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl9jy5LxAAxgMslSN6ayxB2MFRf2dwNQ==", 2023-10-09T06:27:04.790 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.791 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:04.791 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:04.791 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.791 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.791 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2023-10-09T06:27:04.792 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl8M+TOBAARhk2wEaXO9Pi4TP9d+L5Gg==", 2023-10-09T06:27:04.792 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.792 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:04.792 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:04.792 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.792 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.792 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.792 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2023-10-09T06:27:04.793 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlfsC2GRAAlm37QI8DkNclcBpD5ZBR7A==", 2023-10-09T06:27:04.793 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.793 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:04.793 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2023-10-09T06:27:04.793 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T06:27:04.793 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.794 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.794 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2023-10-09T06:27:04.794 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlapIxIhAAiBZUkpnf6tyFHwySGKhRpQ==", 2023-10-09T06:27:04.794 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.794 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:04.794 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:27:04.794 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:27:04.794 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:27:04.794 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.795 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2023-10-09T06:27:04.795 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEZYuHxAA7WEH0vXmAEH5Wki8ESrDBg==", 2023-10-09T06:27:04.795 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.795 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:04.795 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:27:04.795 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:27:04.795 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:27:04.795 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.796 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2023-10-09T06:27:04.796 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlFvuIJxAAGuTp4gsXrvUzDd1B7d5vcg==", 2023-10-09T06:27:04.796 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.796 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:04.796 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:27:04.796 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:27:04.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:27:04.796 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.797 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2023-10-09T06:27:04.797 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlS8AlJBAAg8lLRVasKHyhbFlOTfgt9g==", 2023-10-09T06:27:04.797 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.797 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:27:04.797 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:27:04.797 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:27:04.797 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.797 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.798 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2023-10-09T06:27:04.798 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEE9eABAAHbJ1yvlmOUNo6n2uAhPrnw==", 2023-10-09T06:27:04.798 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.798 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:27:04.798 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:27:04.798 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.798 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:04.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:04.799 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2023-10-09T06:27:04.799 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlhol5OBAAZSZ+PbojVwsOJtLlTl6wAA==", 2023-10-09T06:27:04.799 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:04.799 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:27:04.799 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:27:04.799 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:04.799 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.799 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:04.799 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:04.799 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:27:04.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.779+0000 7f55e700d700 1 -- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55c0066f30 msgr2=0x7f55c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:04.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.779+0000 7f55e700d700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55c0066f30 0x7f55c00693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f55c8003990 tx=0x7f55c8009040 comp rx=0 tx=0).stop 2023-10-09T06:27:04.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.779+0000 7f55e700d700 1 -- 172.21.15.31:0/300264745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55e01577d0 msgr2=0x7f55e01417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:04.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.779+0000 7f55e700d700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55e01577d0 0x7f55e01417a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f55d0002250 tx=0x7f55d0007d50 comp rx=0 tx=0).stop 2023-10-09T06:27:04.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.779+0000 7f55e700d700 1 -- 172.21.15.31:0/300264745 shutdown_connections 2023-10-09T06:27:04.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.779+0000 7f55e700d700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f55c0066f30 0x7f55c00693e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.779+0000 7f55e700d700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f55e0157ba0 0x7f55e015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.779+0000 7f55e700d700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f55e006ac30 0x7f55e00b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.779+0000 7f55e700d700 1 --2- 172.21.15.31:0/300264745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55e01577d0 0x7f55e01417a0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.779+0000 7f55e700d700 1 -- 172.21.15.31:0/300264745 >> 172.21.15.31:0/300264745 conn(0x7f55e0068ce0 msgr2=0x7f55e015d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:04.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.779+0000 7f55e700d700 1 -- 172.21.15.31:0/300264745 shutdown_connections 2023-10-09T06:27:04.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.779+0000 7f55e700d700 1 -- 172.21.15.31:0/300264745 wait complete. 2023-10-09T06:27:04.803 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:27:04.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.921+0000 7f96152a7700 1 Processor -- start 2023-10-09T06:27:04.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.921+0000 7f96152a7700 1 -- start start 2023-10-09T06:27:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f96152a7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f961015a2b0 0x7f96100b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f96152a7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f96100d1c30 0x7f96100cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f96152a7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96100c5d80 con 0x7f961015a680 2023-10-09T06:27:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f96152a7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9610068470 con 0x7f961015a2b0 2023-10-09T06:27:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f96152a7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96100c6060 con 0x7f96100d1c30 2023-10-09T06:27:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f960effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f961015a2b0 0x7f96100b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f960f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f961015a680 0x7f96100c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48728/0 (socket says 172.21.15.31:48728) 2023-10-09T06:27:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f960f7fe700 1 -- 172.21.15.31:0/1220449961 learned_addr learned my addr 172.21.15.31:0/1220449961 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f960e7fc700 1 --2- 172.21.15.31:0/1220449961 >> v2:172.21.15.158:3300/0 conn(0x7f96100d1c30 0x7f96100cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f960effd700 1 -- 172.21.15.31:0/1220449961 >> v2:172.21.15.158:3300/0 conn(0x7f96100d1c30 msgr2=0x7f96100cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f960effd700 1 --2- 172.21.15.31:0/1220449961 >> v2:172.21.15.158:3300/0 conn(0x7f96100d1c30 0x7f96100cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f960effd700 1 -- 172.21.15.31:0/1220449961 >> v1:172.21.15.31:6789/0 conn(0x7f961015a680 legacy=0x7f96100c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f960effd700 1 -- 172.21.15.31:0/1220449961 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100c6340 con 0x7f961015a2b0 2023-10-09T06:27:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f960effd700 1 --2- 172.21.15.31:0/1220449961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015a2b0 0x7f96100b3da0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f9610089190 tx=0x7f9600009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f1a02b10cea7a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f960dffb700 1 -- 172.21.15.31:0/1220449961 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600005c10 con 0x7f961015a2b0 2023-10-09T06:27:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f960dffb700 1 -- 172.21.15.31:0/1220449961 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600005d70 con 0x7f961015a2b0 2023-10-09T06:27:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.922+0000 7f960dffb700 1 -- 172.21.15.31:0/1220449961 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600006260 con 0x7f961015a2b0 2023-10-09T06:27:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.923+0000 7f96152a7700 1 -- 172.21.15.31:0/1220449961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015a2b0 msgr2=0x7f96100b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.923+0000 7f96152a7700 1 --2- 172.21.15.31:0/1220449961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015a2b0 0x7f96100b3da0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f9610089190 tx=0x7f9600009120 comp rx=0 tx=0).stop 2023-10-09T06:27:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.923+0000 7f96152a7700 1 -- 172.21.15.31:0/1220449961 shutdown_connections 2023-10-09T06:27:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.923+0000 7f96152a7700 1 --2- 172.21.15.31:0/1220449961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015a2b0 0x7f96100b3da0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.923+0000 7f96152a7700 1 --2- 172.21.15.31:0/1220449961 >> v2:172.21.15.158:3300/0 conn(0x7f96100d1c30 0x7f96100cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.923+0000 7f96152a7700 1 -- 172.21.15.31:0/1220449961 >> 172.21.15.31:0/1220449961 conn(0x7f9610067e40 msgr2=0x7f96100d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.923+0000 7f96152a7700 1 -- 172.21.15.31:0/1220449961 shutdown_connections 2023-10-09T06:27:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.923+0000 7f96152a7700 1 -- 172.21.15.31:0/1220449961 wait complete. 2023-10-09T06:27:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.924+0000 7f96152a7700 1 Processor -- start 2023-10-09T06:27:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.924+0000 7f96152a7700 1 -- start start 2023-10-09T06:27:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f96152a7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96100d1c30 0x7f9610149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f96152a7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f961015a2b0 0x7f961015e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f96152a7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015a680 0x7f961015fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f96152a7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96100c81c0 con 0x7f961015a680 2023-10-09T06:27:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f96152a7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961014a0e0 con 0x7f96100d1c30 2023-10-09T06:27:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f96152a7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961015f360 con 0x7f961015a2b0 2023-10-09T06:27:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f960f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015a680 0x7f961015fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f960f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015a680 0x7f961015fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49554/0 (socket says 172.21.15.31:49554) 2023-10-09T06:27:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f960f7fe700 1 -- 172.21.15.31:0/3061981459 learned_addr learned my addr 172.21.15.31:0/3061981459 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f960effd700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96100d1c30 0x7f9610149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f960e7fc700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f961015a2b0 0x7f961015e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f960f7fe700 1 -- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f961015a2b0 msgr2=0x7f961015e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f960f7fe700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f961015a2b0 0x7f961015e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f960f7fe700 1 -- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96100d1c30 msgr2=0x7f9610149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f960f7fe700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96100d1c30 0x7f9610149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f960f7fe700 1 -- 172.21.15.31:0/3061981459 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000093c0 con 0x7f961015a680 2023-10-09T06:27:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.925+0000 7f960f7fe700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015a680 0x7f961015fba0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f960800cbf0 tx=0x7f96080019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.926+0000 7f95f6ffd700 1 -- 172.21.15.31:0/3061981459 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800a870 con 0x7f961015a680 2023-10-09T06:27:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.926+0000 7f95f6ffd700 1 -- 172.21.15.31:0/3061981459 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960800a9d0 con 0x7f961015a680 2023-10-09T06:27:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.926+0000 7f95f6ffd700 1 -- 172.21.15.31:0/3061981459 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800ad50 con 0x7f961015a680 2023-10-09T06:27:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.926+0000 7f96152a7700 1 -- 172.21.15.31:0/3061981459 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961015eac0 con 0x7f961015a680 2023-10-09T06:27:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.926+0000 7f96152a7700 1 -- 172.21.15.31:0/3061981459 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961015f080 con 0x7f961015a680 2023-10-09T06:27:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.927+0000 7f96152a7700 1 -- 172.21.15.31:0/3061981459 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96100c8330 con 0x7f961015a680 2023-10-09T06:27:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.927+0000 7f95f6ffd700 1 -- 172.21.15.31:0/3061981459 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9608007300 con 0x7f961015a680 2023-10-09T06:27:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.928+0000 7f95f6ffd700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f95fc066f30 0x7f95fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.928+0000 7f95f6ffd700 1 -- 172.21.15.31:0/3061981459 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9608084480 con 0x7f961015a680 2023-10-09T06:27:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.928+0000 7f960effd700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f95fc066f30 0x7f95fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.928+0000 7f960effd700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f95fc066f30 0x7f95fc0693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9600009160 tx=0x7f9600016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:04.932+0000 7f95f6ffd700 1 -- 172.21.15.31:0/3061981459 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9608051a30 con 0x7f961015a680 2023-10-09T06:27:05.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.130+0000 7f96152a7700 1 -- 172.21.15.31:0/3061981459 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f961004c3c0 con 0x7f961015a680 2023-10-09T06:27:05.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.130+0000 7f95f6ffd700 1 -- 172.21.15.31:0/3061981459 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+12145 (secure 0 0 0) 0x7f9608055050 con 0x7f961015a680 2023-10-09T06:27:05.185 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:05.185 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":132,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:27:04.353494+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:27:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.132+0000 7f96152a7700 1 -- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f95fc066f30 msgr2=0x7f95fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.132+0000 7f96152a7700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f95fc066f30 0x7f95fc0693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9600009160 tx=0x7f9600016000 comp rx=0 tx=0).stop 2023-10-09T06:27:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.132+0000 7f96152a7700 1 -- 172.21.15.31:0/3061981459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015a680 msgr2=0x7f961015fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.132+0000 7f96152a7700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015a680 0x7f961015fba0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f960800cbf0 tx=0x7f96080019c0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.132+0000 7f96152a7700 1 -- 172.21.15.31:0/3061981459 shutdown_connections 2023-10-09T06:27:05.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.132+0000 7f96152a7700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f95fc066f30 0x7f95fc0693e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.132+0000 7f96152a7700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015a680 0x7f961015fba0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.132+0000 7f96152a7700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96100d1c30 0x7f9610149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.132+0000 7f96152a7700 1 --2- 172.21.15.31:0/3061981459 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f961015a2b0 0x7f961015e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.132+0000 7f96152a7700 1 -- 172.21.15.31:0/3061981459 >> 172.21.15.31:0/3061981459 conn(0x7f9610067e40 msgr2=0x7f96100b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:05.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.132+0000 7f96152a7700 1 -- 172.21.15.31:0/3061981459 shutdown_connections 2023-10-09T06:27:05.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.132+0000 7f96152a7700 1 -- 172.21.15.31:0/3061981459 wait complete. 2023-10-09T06:27:05.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:27:05.188 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:27:05.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.310+0000 7fe71d78c700 1 Processor -- start 2023-10-09T06:27:05.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.310+0000 7fe71d78c700 1 -- start start 2023-10-09T06:27:05.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.311+0000 7fe71d78c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe7180cce30 0x7fe71815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:05.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.311+0000 7fe71d78c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7180b4d70 con 0x7fe71806aa00 2023-10-09T06:27:05.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.311+0000 7fe71d78c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7180cd8d0 con 0x7fe7180b6580 2023-10-09T06:27:05.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.311+0000 7fe71d78c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7180b4440 con 0x7fe7180cce30 2023-10-09T06:27:05.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.311+0000 7fe717fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe7180cce30 0x7fe71815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:05.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.311+0000 7fe717fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe7180cce30 0x7fe71815aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49564/0 (socket says 172.21.15.31:49564) 2023-10-09T06:27:05.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.311+0000 7fe717fff700 1 -- 172.21.15.31:0/1133451223 learned_addr learned my addr 172.21.15.31:0/1133451223 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:05.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.311+0000 7fe71cf8b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe71806aa00 0x7fe7180b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48736/0 (socket says 172.21.15.31:48736) 2023-10-09T06:27:05.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.311+0000 7fe717fff700 1 -- 172.21.15.31:0/1133451223 >> v1:172.21.15.158:6789/0 conn(0x7fe7180b6580 legacy=0x7fe71806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:05.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.311+0000 7fe717fff700 1 -- 172.21.15.31:0/1133451223 >> v1:172.21.15.31:6789/0 conn(0x7fe71806aa00 legacy=0x7fe7180b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.311+0000 7fe717fff700 1 -- 172.21.15.31:0/1133451223 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7180b4720 con 0x7fe7180cce30 2023-10-09T06:27:05.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.311+0000 7fe716ffd700 1 -- 172.21.15.31:0/1133451223 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337339302 0 0) 0x7fe7180b4d70 con 0x7fe71806aa00 2023-10-09T06:27:05.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.311+0000 7fe717fff700 1 --2- 172.21.15.31:0/1133451223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7180cce30 0x7fe71815aca0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fe7080099b0 tx=0x7fe708009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05a6d304006239b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:05.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.312+0000 7fe716ffd700 1 -- 172.21.15.31:0/1133451223 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70800b820 con 0x7fe7180cce30 2023-10-09T06:27:05.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.312+0000 7fe716ffd700 1 -- 172.21.15.31:0/1133451223 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70800b980 con 0x7fe7180cce30 2023-10-09T06:27:05.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.312+0000 7fe716ffd700 1 -- 172.21.15.31:0/1133451223 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70800bd20 con 0x7fe7180cce30 2023-10-09T06:27:05.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.312+0000 7fe71d78c700 1 -- 172.21.15.31:0/1133451223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7180cce30 msgr2=0x7fe71815aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.312+0000 7fe71d78c700 1 --2- 172.21.15.31:0/1133451223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7180cce30 0x7fe71815aca0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fe7080099b0 tx=0x7fe708009250 comp rx=0 tx=0).stop 2023-10-09T06:27:05.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.312+0000 7fe71d78c700 1 -- 172.21.15.31:0/1133451223 shutdown_connections 2023-10-09T06:27:05.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.312+0000 7fe71d78c700 1 --2- 172.21.15.31:0/1133451223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7180cce30 0x7fe71815aca0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.312+0000 7fe71d78c700 1 -- 172.21.15.31:0/1133451223 >> 172.21.15.31:0/1133451223 conn(0x7fe718068cb0 msgr2=0x7fe7180690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:05.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.312+0000 7fe71d78c700 1 -- 172.21.15.31:0/1133451223 shutdown_connections 2023-10-09T06:27:05.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.312+0000 7fe71d78c700 1 -- 172.21.15.31:0/1133451223 wait complete. 2023-10-09T06:27:05.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.313+0000 7fe71d78c700 1 Processor -- start 2023-10-09T06:27:05.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.313+0000 7fe71d78c700 1 -- start start 2023-10-09T06:27:05.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.314+0000 7fe71d78c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe71806aa00 0x7fe71814f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:05.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.314+0000 7fe71d78c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7180b6580 0x7fe718152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:05.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.314+0000 7fe71d78c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7180cce30 0x7fe718153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:05.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.314+0000 7fe71d78c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe718158a20 con 0x7fe7180cce30 2023-10-09T06:27:05.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.314+0000 7fe71d78c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe718158d00 con 0x7fe7180b6580 2023-10-09T06:27:05.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.314+0000 7fe71d78c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe718158fe0 con 0x7fe71806aa00 2023-10-09T06:27:05.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.314+0000 7fe71cf8b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7180cce30 0x7fe718153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:05.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.314+0000 7fe71cf8b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7180cce30 0x7fe718153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49574/0 (socket says 172.21.15.31:49574) 2023-10-09T06:27:05.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.314+0000 7fe71cf8b700 1 -- 172.21.15.31:0/1555637742 learned_addr learned my addr 172.21.15.31:0/1555637742 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:05.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.314+0000 7fe7177fe700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7180b6580 0x7fe718152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:05.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.314+0000 7fe717fff700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe71806aa00 0x7fe71814f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:05.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.315+0000 7fe71cf8b700 1 -- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe71806aa00 msgr2=0x7fe71814f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.315+0000 7fe71cf8b700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe71806aa00 0x7fe71814f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.315+0000 7fe71cf8b700 1 -- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7180b6580 msgr2=0x7fe718152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.315+0000 7fe71cf8b700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7180b6580 0x7fe718152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.315+0000 7fe71cf8b700 1 -- 172.21.15.31:0/1555637742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7080094f0 con 0x7fe7180cce30 2023-10-09T06:27:05.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.315+0000 7fe71cf8b700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7180cce30 0x7fe718153330 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fe71000cd80 tx=0x7fe710001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:05.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.315+0000 7fe70ffff700 1 -- 172.21.15.31:0/1555637742 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe710005df0 con 0x7fe7180cce30 2023-10-09T06:27:05.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.315+0000 7fe70ffff700 1 -- 172.21.15.31:0/1555637742 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71000a850 con 0x7fe7180cce30 2023-10-09T06:27:05.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.315+0000 7fe71d78c700 1 -- 172.21.15.31:0/1555637742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7181592c0 con 0x7fe7180cce30 2023-10-09T06:27:05.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.315+0000 7fe70ffff700 1 -- 172.21.15.31:0/1555637742 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71000ac10 con 0x7fe7180cce30 2023-10-09T06:27:05.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.315+0000 7fe71d78c700 1 -- 172.21.15.31:0/1555637742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71814ff20 con 0x7fe7180cce30 2023-10-09T06:27:05.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.316+0000 7fe71d78c700 1 -- 172.21.15.31:0/1555637742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe718089550 con 0x7fe7180cce30 2023-10-09T06:27:05.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.316+0000 7fe70ffff700 1 -- 172.21.15.31:0/1555637742 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7100070f0 con 0x7fe7180cce30 2023-10-09T06:27:05.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.317+0000 7fe70ffff700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe6f8066f30 0x7fe6f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:05.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.317+0000 7fe70ffff700 1 -- 172.21.15.31:0/1555637742 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe7100841e0 con 0x7fe7180cce30 2023-10-09T06:27:05.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.317+0000 7fe717fff700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe6f8066f30 0x7fe6f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:05.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.317+0000 7fe717fff700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe6f8066f30 0x7fe6f80693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe7080099b0 tx=0x7fe708016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:05.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.321+0000 7fe70ffff700 1 -- 172.21.15.31:0/1555637742 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe710051820 con 0x7fe7180cce30 2023-10-09T06:27:05.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.514+0000 7fe71d78c700 1 -- 172.21.15.31:0/1555637742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7180b4a00 con 0x7fe7180cce30 2023-10-09T06:27:05.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.514+0000 7fe70ffff700 1 -- 172.21.15.31:0/1555637742 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe710054e40 con 0x7fe7180cce30 2023-10-09T06:27:05.516 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:27:05.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.516+0000 7fe71d78c700 1 -- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe6f8066f30 msgr2=0x7fe6f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.516+0000 7fe71d78c700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe6f8066f30 0x7fe6f80693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe7080099b0 tx=0x7fe708016000 comp rx=0 tx=0).stop 2023-10-09T06:27:05.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.516+0000 7fe71d78c700 1 -- 172.21.15.31:0/1555637742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7180cce30 msgr2=0x7fe718153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.517+0000 7fe71d78c700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7180cce30 0x7fe718153330 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fe71000cd80 tx=0x7fe710001ae0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.517+0000 7fe71d78c700 1 -- 172.21.15.31:0/1555637742 shutdown_connections 2023-10-09T06:27:05.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.517+0000 7fe71d78c700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe6f8066f30 0x7fe6f80693e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.517+0000 7fe71d78c700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe71806aa00 0x7fe71814f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.517+0000 7fe71d78c700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7180cce30 0x7fe718153330 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.517+0000 7fe71d78c700 1 --2- 172.21.15.31:0/1555637742 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7180b6580 0x7fe718152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.517+0000 7fe71d78c700 1 -- 172.21.15.31:0/1555637742 >> 172.21.15.31:0/1555637742 conn(0x7fe718068cb0 msgr2=0x7fe718150360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:05.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.517+0000 7fe71d78c700 1 -- 172.21.15.31:0/1555637742 shutdown_connections 2023-10-09T06:27:05.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.517+0000 7fe71d78c700 1 -- 172.21.15.31:0/1555637742 wait complete. 2023-10-09T06:27:05.530 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:27:05.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.649+0000 7f4e16ab6700 1 Processor -- start 2023-10-09T06:27:05.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.649+0000 7f4e16ab6700 1 -- start start 2023-10-09T06:27:05.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.650+0000 7f4e16ab6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e10159f10 0x7f4e100c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:05.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.650+0000 7f4e16ab6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e100ae320 con 0x7f4e100cc410 2023-10-09T06:27:05.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.650+0000 7f4e16ab6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e100ad710 con 0x7f4e1015a2e0 2023-10-09T06:27:05.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.650+0000 7f4e16ab6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1015a760 con 0x7f4e10159f10 2023-10-09T06:27:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.650+0000 7f4e15ab4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e10159f10 0x7f4e100c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.650+0000 7f4e162b5700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4e100cc410 0x7f4e100cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48750/0 (socket says 172.21.15.31:48750) 2023-10-09T06:27:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.650+0000 7f4e162b5700 1 -- 172.21.15.31:0/2256669260 learned_addr learned my addr 172.21.15.31:0/2256669260 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.650+0000 7f4e15ab4700 1 -- 172.21.15.31:0/2256669260 >> v1:172.21.15.158:6789/0 conn(0x7f4e1015a2e0 legacy=0x7f4e100cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.650+0000 7f4e15ab4700 1 -- 172.21.15.31:0/2256669260 >> v1:172.21.15.31:6789/0 conn(0x7f4e100cc410 legacy=0x7f4e100cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.650+0000 7f4e15ab4700 1 -- 172.21.15.31:0/2256669260 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100ad9f0 con 0x7f4e10159f10 2023-10-09T06:27:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.651+0000 7f4e15ab4700 1 --2- 172.21.15.31:0/2256669260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e10159f10 0x7f4e100c59e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f4e000098e0 tx=0x7f4e000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378ded732f897a2c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.651+0000 7f4e14ab2700 1 -- 172.21.15.31:0/2256669260 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00009e80 con 0x7f4e10159f10 2023-10-09T06:27:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.651+0000 7f4e14ab2700 1 -- 172.21.15.31:0/2256669260 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0000b820 con 0x7f4e10159f10 2023-10-09T06:27:05.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.651+0000 7f4e14ab2700 1 -- 172.21.15.31:0/2256669260 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0000bba0 con 0x7f4e10159f10 2023-10-09T06:27:05.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.651+0000 7f4e16ab6700 1 -- 172.21.15.31:0/2256669260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e10159f10 msgr2=0x7f4e100c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.651+0000 7f4e16ab6700 1 --2- 172.21.15.31:0/2256669260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e10159f10 0x7f4e100c59e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f4e000098e0 tx=0x7f4e000091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.651+0000 7f4e16ab6700 1 -- 172.21.15.31:0/2256669260 shutdown_connections 2023-10-09T06:27:05.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.651+0000 7f4e16ab6700 1 --2- 172.21.15.31:0/2256669260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e10159f10 0x7f4e100c59e0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.651+0000 7f4e16ab6700 1 -- 172.21.15.31:0/2256669260 >> 172.21.15.31:0/2256669260 conn(0x7f4e10067e40 msgr2=0x7f4e100d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:05.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.651+0000 7f4e16ab6700 1 -- 172.21.15.31:0/2256669260 shutdown_connections 2023-10-09T06:27:05.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.651+0000 7f4e16ab6700 1 -- 172.21.15.31:0/2256669260 wait complete. 2023-10-09T06:27:05.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.652+0000 7f4e16ab6700 1 Processor -- start 2023-10-09T06:27:05.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.653+0000 7f4e16ab6700 1 -- start start 2023-10-09T06:27:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.653+0000 7f4e16ab6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e100cc410 0x7f4e100b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.653+0000 7f4e16ab6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e10159f10 0x7f4e100b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.653+0000 7f4e16ab6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e1015a2e0 0x7f4e1015ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.653+0000 7f4e16ab6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100b4fd0 con 0x7f4e10159f10 2023-10-09T06:27:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.653+0000 7f4e16ab6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100b43c0 con 0x7f4e1015a2e0 2023-10-09T06:27:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.653+0000 7f4e16ab6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100b46a0 con 0x7f4e100cc410 2023-10-09T06:27:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.653+0000 7f4e152b3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e10159f10 0x7f4e100b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:05.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.653+0000 7f4e152b3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e10159f10 0x7f4e100b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49594/0 (socket says 172.21.15.31:49594) 2023-10-09T06:27:05.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.653+0000 7f4e152b3700 1 -- 172.21.15.31:0/4248299613 learned_addr learned my addr 172.21.15.31:0/4248299613 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:05.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.653+0000 7f4e15ab4700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e100cc410 0x7f4e100b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:05.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.653+0000 7f4e162b5700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e1015a2e0 0x7f4e1015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:05.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.654+0000 7f4e152b3700 1 -- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e100cc410 msgr2=0x7f4e100b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.654+0000 7f4e152b3700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e100cc410 0x7f4e100b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.654+0000 7f4e152b3700 1 -- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e1015a2e0 msgr2=0x7f4e1015ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.654+0000 7f4e152b3700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e1015a2e0 0x7f4e1015ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.654+0000 7f4e152b3700 1 -- 172.21.15.31:0/4248299613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e00009420 con 0x7f4e10159f10 2023-10-09T06:27:05.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.654+0000 7f4e152b3700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e10159f10 0x7f4e100b39e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400b5e0 tx=0x7f4e04009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:05.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.654+0000 7f4e0dffb700 1 -- 172.21.15.31:0/4248299613 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400f510 con 0x7f4e10159f10 2023-10-09T06:27:05.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.654+0000 7f4e0dffb700 1 -- 172.21.15.31:0/4248299613 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0400f670 con 0x7f4e10159f10 2023-10-09T06:27:05.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.654+0000 7f4e16ab6700 1 -- 172.21.15.31:0/4248299613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e100b4980 con 0x7f4e10159f10 2023-10-09T06:27:05.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.654+0000 7f4e0dffb700 1 -- 172.21.15.31:0/4248299613 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400fa30 con 0x7f4e10159f10 2023-10-09T06:27:05.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.654+0000 7f4e16ab6700 1 -- 172.21.15.31:0/4248299613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e100b59a0 con 0x7f4e10159f10 2023-10-09T06:27:05.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.655+0000 7f4e16ab6700 1 -- 172.21.15.31:0/4248299613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e10089300 con 0x7f4e10159f10 2023-10-09T06:27:05.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.655+0000 7f4e0dffb700 1 -- 172.21.15.31:0/4248299613 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e0401a400 con 0x7f4e10159f10 2023-10-09T06:27:05.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.656+0000 7f4e0dffb700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4dfc066f30 0x7f4dfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:05.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.656+0000 7f4e0dffb700 1 -- 172.21.15.31:0/4248299613 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4e04083cd0 con 0x7f4e10159f10 2023-10-09T06:27:05.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.656+0000 7f4e15ab4700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4dfc066f30 0x7f4dfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:05.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.657+0000 7f4e15ab4700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4dfc066f30 0x7f4dfc0693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4e000030c0 tx=0x7f4e00016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:05.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.660+0000 7f4e0dffb700 1 -- 172.21.15.31:0/4248299613 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e04051310 con 0x7f4e10159f10 2023-10-09T06:27:05.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.859+0000 7f4e16ab6700 1 -- 172.21.15.31:0/4248299613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4e100890a0 con 0x7f4e10159f10 2023-10-09T06:27:05.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.859+0000 7f4e0dffb700 1 -- 172.21.15.31:0/4248299613 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v132) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4e04054930 con 0x7f4e10159f10 2023-10-09T06:27:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:05.860 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-10-09T06:27:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-10-09T06:27:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-10-09T06:27:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:05.861 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-10-09T06:27:05.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.861+0000 7f4e16ab6700 1 -- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4dfc066f30 msgr2=0x7f4dfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.861+0000 7f4e16ab6700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4dfc066f30 0x7f4dfc0693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4e000030c0 tx=0x7f4e00016000 comp rx=0 tx=0).stop 2023-10-09T06:27:05.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.861+0000 7f4e16ab6700 1 -- 172.21.15.31:0/4248299613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e10159f10 msgr2=0x7f4e100b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:05.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.861+0000 7f4e16ab6700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e10159f10 0x7f4e100b39e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400b5e0 tx=0x7f4e04009120 comp rx=0 tx=0).stop 2023-10-09T06:27:05.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.861+0000 7f4e16ab6700 1 -- 172.21.15.31:0/4248299613 shutdown_connections 2023-10-09T06:27:05.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.861+0000 7f4e16ab6700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4dfc066f30 0x7f4dfc0693e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.861+0000 7f4e16ab6700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e100cc410 0x7f4e100b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.861+0000 7f4e16ab6700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e1015a2e0 0x7f4e1015ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.861+0000 7f4e16ab6700 1 --2- 172.21.15.31:0/4248299613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e10159f10 0x7f4e100b39e0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:05.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.861+0000 7f4e16ab6700 1 -- 172.21.15.31:0/4248299613 >> 172.21.15.31:0/4248299613 conn(0x7f4e10067e40 msgr2=0x7f4e10158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:05.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.861+0000 7f4e16ab6700 1 -- 172.21.15.31:0/4248299613 shutdown_connections 2023-10-09T06:27:05.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.861+0000 7f4e16ab6700 1 -- 172.21.15.31:0/4248299613 wait complete. 2023-10-09T06:27:05.874 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:27:05.874 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:27:05.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.996+0000 7f7d402f0700 1 Processor -- start 2023-10-09T06:27:05.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.997+0000 7f7d402f0700 1 -- start start 2023-10-09T06:27:06.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.997+0000 7f7d402f0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7d380b6a10 0x7f7d3815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:06.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.997+0000 7f7d402f0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7d380b46f0 0x7f7d380b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:06.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.997+0000 7f7d402f0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d380b17b0 con 0x7f7d38159ef0 2023-10-09T06:27:06.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.997+0000 7f7d402f0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d380b5020 con 0x7f7d380b46f0 2023-10-09T06:27:06.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.997+0000 7f7d402f0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d380b1a60 con 0x7f7d380b6a10 2023-10-09T06:27:06.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.998+0000 7f7d3e88d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7d380b46f0 0x7f7d380b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:06.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.998+0000 7f7d3e08c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7d38159ef0 0x7f7d380b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48758/0 (socket says 172.21.15.31:48758) 2023-10-09T06:27:06.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.998+0000 7f7d3e08c700 1 -- 172.21.15.31:0/3968825059 learned_addr learned my addr 172.21.15.31:0/3968825059 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:06.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.998+0000 7f7d3e88d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7d380b46f0 0x7f7d380b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49600/0 (socket says 172.21.15.31:49600) 2023-10-09T06:27:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.998+0000 7f7d3d88b700 1 --2- 172.21.15.31:0/3968825059 >> v2:172.21.15.158:3300/0 conn(0x7f7d380b6a10 0x7f7d3815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.998+0000 7f7d3e88d700 1 -- 172.21.15.31:0/3968825059 >> v2:172.21.15.158:3300/0 conn(0x7f7d380b6a10 msgr2=0x7f7d3815a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.998+0000 7f7d3e88d700 1 --2- 172.21.15.31:0/3968825059 >> v2:172.21.15.158:3300/0 conn(0x7f7d380b6a10 0x7f7d3815a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.998+0000 7f7d3e88d700 1 -- 172.21.15.31:0/3968825059 >> v1:172.21.15.31:6789/0 conn(0x7f7d38159ef0 legacy=0x7f7d380b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.998+0000 7f7d3e88d700 1 -- 172.21.15.31:0/3968825059 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d380b1d40 con 0x7f7d380b46f0 2023-10-09T06:27:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.998+0000 7f7d3e88d700 1 --2- 172.21.15.31:0/3968825059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b46f0 0x7f7d380b4ae0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f7d38089550 tx=0x7f7d28009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4a439fce15ef1d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.998+0000 7f7d3d08a700 1 -- 172.21.15.31:0/3968825059 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2800e070 con 0x7f7d380b46f0 2023-10-09T06:27:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.998+0000 7f7d3d08a700 1 -- 172.21.15.31:0/3968825059 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2800bc30 con 0x7f7d380b46f0 2023-10-09T06:27:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.998+0000 7f7d3d08a700 1 -- 172.21.15.31:0/3968825059 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28012430 con 0x7f7d380b46f0 2023-10-09T06:27:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.999+0000 7f7d402f0700 1 -- 172.21.15.31:0/3968825059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b46f0 msgr2=0x7f7d380b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.999+0000 7f7d402f0700 1 --2- 172.21.15.31:0/3968825059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b46f0 0x7f7d380b4ae0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f7d38089550 tx=0x7f7d28009780 comp rx=0 tx=0).stop 2023-10-09T06:27:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.999+0000 7f7d402f0700 1 -- 172.21.15.31:0/3968825059 shutdown_connections 2023-10-09T06:27:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.999+0000 7f7d402f0700 1 --2- 172.21.15.31:0/3968825059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b46f0 0x7f7d380b4ae0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.999+0000 7f7d402f0700 1 --2- 172.21.15.31:0/3968825059 >> v2:172.21.15.158:3300/0 conn(0x7f7d380b6a10 0x7f7d3815a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.999+0000 7f7d402f0700 1 -- 172.21.15.31:0/3968825059 >> 172.21.15.31:0/3968825059 conn(0x7f7d3809a0a0 msgr2=0x7f7d38067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.999+0000 7f7d402f0700 1 -- 172.21.15.31:0/3968825059 shutdown_connections 2023-10-09T06:27:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:05.999+0000 7f7d402f0700 1 -- 172.21.15.31:0/3968825059 wait complete. 2023-10-09T06:27:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.000+0000 7f7d402f0700 1 Processor -- start 2023-10-09T06:27:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.000+0000 7f7d402f0700 1 -- start start 2023-10-09T06:27:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d402f0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d380b46f0 0x7f7d3816dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d402f0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b6a10 0x7f7d3816b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d402f0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d38159ef0 0x7f7d38146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d402f0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380ae1f0 con 0x7f7d380b6a10 2023-10-09T06:27:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d402f0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380ae4d0 con 0x7f7d380b46f0 2023-10-09T06:27:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d402f0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380ae7b0 con 0x7f7d38159ef0 2023-10-09T06:27:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d3d88b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b6a10 0x7f7d3816b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d3d88b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b6a10 0x7f7d3816b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49616/0 (socket says 172.21.15.31:49616) 2023-10-09T06:27:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d3d88b700 1 -- 172.21.15.31:0/2377987943 learned_addr learned my addr 172.21.15.31:0/2377987943 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d3e88d700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d38159ef0 0x7f7d38146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d3e08c700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d380b46f0 0x7f7d3816dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d3d88b700 1 -- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d38159ef0 msgr2=0x7f7d38146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d3d88b700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d38159ef0 0x7f7d38146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d3d88b700 1 -- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d380b46f0 msgr2=0x7f7d3816dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d3d88b700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d380b46f0 0x7f7d3816dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d3d88b700 1 -- 172.21.15.31:0/2377987943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28009a20 con 0x7f7d380b6a10 2023-10-09T06:27:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d3d88b700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b6a10 0x7f7d3816b120 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c00d860 tx=0x7f7d2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d367fc700 1 -- 172.21.15.31:0/2377987943 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0125f0 con 0x7f7d380b6a10 2023-10-09T06:27:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d367fc700 1 -- 172.21.15.31:0/2377987943 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c012750 con 0x7f7d380b6a10 2023-10-09T06:27:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d402f0700 1 -- 172.21.15.31:0/2377987943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d380aea90 con 0x7f7d380b6a10 2023-10-09T06:27:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d367fc700 1 -- 172.21.15.31:0/2377987943 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c012ad0 con 0x7f7d380b6a10 2023-10-09T06:27:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.001+0000 7f7d402f0700 1 -- 172.21.15.31:0/2377987943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d381561f0 con 0x7f7d380b6a10 2023-10-09T06:27:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.002+0000 7f7d402f0700 1 -- 172.21.15.31:0/2377987943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d380aec80 con 0x7f7d380b6a10 2023-10-09T06:27:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.003+0000 7f7d367fc700 1 -- 172.21.15.31:0/2377987943 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d2c01e460 con 0x7f7d380b6a10 2023-10-09T06:27:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.003+0000 7f7d367fc700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7d24066f30 0x7f7d240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.003+0000 7f7d367fc700 1 -- 172.21.15.31:0/2377987943 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7d2c084840 con 0x7f7d380b6a10 2023-10-09T06:27:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.003+0000 7f7d3e08c700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7d24066f30 0x7f7d240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.004+0000 7f7d3e08c700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7d24066f30 0x7f7d240693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7d30000c00 tx=0x7f7d30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:06.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.007+0000 7f7d367fc700 1 -- 172.21.15.31:0/2377987943 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d2c055890 con 0x7f7d380b6a10 2023-10-09T06:27:06.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.200+0000 7f7d402f0700 1 -- 172.21.15.31:0/2377987943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7d380ae330 con 0x7f7d380b6a10 2023-10-09T06:27:06.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.363+0000 7f7d367fc700 1 -- 172.21.15.31:0/2377987943 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v133) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7d380ae330 con 0x7f7d380b6a10 2023-10-09T06:27:06.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.367+0000 7f7d402f0700 1 -- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7d24066f30 msgr2=0x7f7d240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:06.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.367+0000 7f7d402f0700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7d24066f30 0x7f7d240693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7d30000c00 tx=0x7f7d30009040 comp rx=0 tx=0).stop 2023-10-09T06:27:06.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.367+0000 7f7d402f0700 1 -- 172.21.15.31:0/2377987943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b6a10 msgr2=0x7f7d3816b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:06.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.367+0000 7f7d402f0700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b6a10 0x7f7d3816b120 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c00d860 tx=0x7f7d2c008040 comp rx=0 tx=0).stop 2023-10-09T06:27:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.367+0000 7f7d402f0700 1 -- 172.21.15.31:0/2377987943 shutdown_connections 2023-10-09T06:27:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.367+0000 7f7d402f0700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7d24066f30 0x7f7d240693e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.367+0000 7f7d402f0700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7d38159ef0 0x7f7d38146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:06.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.367+0000 7f7d402f0700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d380b46f0 0x7f7d3816dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:06.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.367+0000 7f7d402f0700 1 --2- 172.21.15.31:0/2377987943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b6a10 0x7f7d3816b120 secure :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c00d860 tx=0x7f7d2c008040 comp rx=0 tx=0).stop 2023-10-09T06:27:06.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.367+0000 7f7d402f0700 1 -- 172.21.15.31:0/2377987943 >> 172.21.15.31:0/2377987943 conn(0x7f7d3809a0a0 msgr2=0x7f7d38157d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:06.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.367+0000 7f7d402f0700 1 -- 172.21.15.31:0/2377987943 shutdown_connections 2023-10-09T06:27:06.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.369+0000 7f7d402f0700 1 -- 172.21.15.31:0/2377987943 wait complete. 2023-10-09T06:27:06.370 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-10-09T06:27:06.381 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:27:06.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.506+0000 7f70f34e3700 1 Processor -- start 2023-10-09T06:27:06.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.507+0000 7f70f34e3700 1 -- start start 2023-10-09T06:27:06.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.507+0000 7f70f34e3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f70ec159e60 0x7f70ec15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:06.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.507+0000 7f70f34e3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f70ec0697c0 0x7f70ec0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:06.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.507+0000 7f70f34e3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec15ea90 con 0x7f70ec15a230 2023-10-09T06:27:06.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.507+0000 7f70f34e3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ec0d1cf0 con 0x7f70ec0697c0 2023-10-09T06:27:06.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.507+0000 7f70f34e3700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ec0b3100 con 0x7f70ec159e60 2023-10-09T06:27:06.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.507+0000 7f70f1a80700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f70ec0697c0 0x7f70ec0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:06.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.508+0000 7f70f1a80700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f70ec0697c0 0x7f70ec0af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49622/0 (socket says 172.21.15.31:49622) 2023-10-09T06:27:06.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.508+0000 7f70f1a80700 1 -- 172.21.15.31:0/625230887 learned_addr learned my addr 172.21.15.31:0/625230887 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:06.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.508+0000 7f70f127f700 1 --2- 172.21.15.31:0/625230887 >> v2:172.21.15.158:3300/0 conn(0x7f70ec159e60 0x7f70ec15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:06.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.508+0000 7f70f1a80700 1 -- 172.21.15.31:0/625230887 >> v2:172.21.15.158:3300/0 conn(0x7f70ec159e60 msgr2=0x7f70ec15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:06.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.508+0000 7f70f1a80700 1 --2- 172.21.15.31:0/625230887 >> v2:172.21.15.158:3300/0 conn(0x7f70ec159e60 0x7f70ec15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:06.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.508+0000 7f70f1a80700 1 -- 172.21.15.31:0/625230887 >> v1:172.21.15.158:6789/0 conn(0x7f70ec15a230 legacy=0x7f70ec0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:06.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.508+0000 7f70f1a80700 1 -- 172.21.15.31:0/625230887 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec0d10e0 con 0x7f70ec0697c0 2023-10-09T06:27:06.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.508+0000 7f70f1a80700 1 --2- 172.21.15.31:0/625230887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70ec0697c0 0x7f70ec0af730 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0cdf30 tx=0x7f70dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6c2298a2f96abb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:06.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.508+0000 7f70ebfff700 1 -- 172.21.15.31:0/625230887 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00e070 con 0x7f70ec0697c0 2023-10-09T06:27:06.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.508+0000 7f70ebfff700 1 -- 172.21.15.31:0/625230887 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc00ba50 con 0x7f70ec0697c0 2023-10-09T06:27:06.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.508+0000 7f70ebfff700 1 -- 172.21.15.31:0/625230887 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0092e0 con 0x7f70ec0697c0 2023-10-09T06:27:06.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.509+0000 7f70f34e3700 1 -- 172.21.15.31:0/625230887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70ec0697c0 msgr2=0x7f70ec0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:06.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.509+0000 7f70f34e3700 1 --2- 172.21.15.31:0/625230887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70ec0697c0 0x7f70ec0af730 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0cdf30 tx=0x7f70dc009840 comp rx=0 tx=0).stop 2023-10-09T06:27:06.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.509+0000 7f70f34e3700 1 -- 172.21.15.31:0/625230887 shutdown_connections 2023-10-09T06:27:06.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.509+0000 7f70f34e3700 1 --2- 172.21.15.31:0/625230887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70ec0697c0 0x7f70ec0af730 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:06.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.509+0000 7f70f34e3700 1 --2- 172.21.15.31:0/625230887 >> v2:172.21.15.158:3300/0 conn(0x7f70ec159e60 0x7f70ec15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:06.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.509+0000 7f70f34e3700 1 -- 172.21.15.31:0/625230887 >> 172.21.15.31:0/625230887 conn(0x7f70ec070700 msgr2=0x7f70ec070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.509+0000 7f70f34e3700 1 -- 172.21.15.31:0/625230887 shutdown_connections 2023-10-09T06:27:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.509+0000 7f70f34e3700 1 -- 172.21.15.31:0/625230887 wait complete. 2023-10-09T06:27:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.510+0000 7f70f34e3700 1 Processor -- start 2023-10-09T06:27:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.510+0000 7f70f34e3700 1 -- start start 2023-10-09T06:27:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f34e3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70ec0697c0 0x7f70ec16a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f34e3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70ec159e60 0x7f70ec16deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f34e3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70ec15a230 0x7f70ec14d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f34e3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec16da20 con 0x7f70ec159e60 2023-10-09T06:27:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f34e3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec16a920 con 0x7f70ec0697c0 2023-10-09T06:27:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f34e3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec16ac00 con 0x7f70ec15a230 2023-10-09T06:27:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f0a7e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70ec159e60 0x7f70ec16deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f0a7e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70ec159e60 0x7f70ec16deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49624/0 (socket says 172.21.15.31:49624) 2023-10-09T06:27:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f0a7e700 1 -- 172.21.15.31:0/1043196146 learned_addr learned my addr 172.21.15.31:0/1043196146 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f1a80700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70ec15a230 0x7f70ec14d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f127f700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70ec0697c0 0x7f70ec16a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f0a7e700 1 -- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70ec15a230 msgr2=0x7f70ec14d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f0a7e700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70ec15a230 0x7f70ec14d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f0a7e700 1 -- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70ec0697c0 msgr2=0x7f70ec16a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f0a7e700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70ec0697c0 0x7f70ec16a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f0a7e700 1 -- 172.21.15.31:0/1043196146 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc009ae0 con 0x7f70ec159e60 2023-10-09T06:27:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f127f700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70ec0697c0 0x7f70ec16a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.511+0000 7f70f0a7e700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70ec159e60 0x7f70ec16deb0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f70e000c590 tx=0x7f70e0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.512+0000 7f70e97fa700 1 -- 172.21.15.31:0/1043196146 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0011590 con 0x7f70ec159e60 2023-10-09T06:27:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.512+0000 7f70e97fa700 1 -- 172.21.15.31:0/1043196146 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e0011710 con 0x7f70ec159e60 2023-10-09T06:27:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.512+0000 7f70f34e3700 1 -- 172.21.15.31:0/1043196146 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ec16aee0 con 0x7f70ec159e60 2023-10-09T06:27:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.512+0000 7f70e97fa700 1 -- 172.21.15.31:0/1043196146 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0011ad0 con 0x7f70ec159e60 2023-10-09T06:27:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.512+0000 7f70f34e3700 1 -- 172.21.15.31:0/1043196146 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ec16a5d0 con 0x7f70ec159e60 2023-10-09T06:27:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.513+0000 7f70f34e3700 1 -- 172.21.15.31:0/1043196146 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ec16db90 con 0x7f70ec159e60 2023-10-09T06:27:06.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.513+0000 7f70e97fa700 1 -- 172.21.15.31:0/1043196146 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70e001a360 con 0x7f70ec159e60 2023-10-09T06:27:06.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.514+0000 7f70e97fa700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f70d8066f30 0x7f70d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:06.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.514+0000 7f70e97fa700 1 -- 172.21.15.31:0/1043196146 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f70e0083320 con 0x7f70ec159e60 2023-10-09T06:27:06.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.514+0000 7f70f127f700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f70d8066f30 0x7f70d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:06.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.514+0000 7f70f127f700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f70d8066f30 0x7f70d80693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f70e4006fd0 tx=0x7f70e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:06.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.519+0000 7f70e97fa700 1 -- 172.21.15.31:0/1043196146 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70e0050770 con 0x7f70ec159e60 2023-10-09T06:27:06.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:06.711+0000 7f70f34e3700 1 -- 172.21.15.31:0/1043196146 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f70ec04c3c0 con 0x7f70ec159e60 2023-10-09T06:27:07.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.379+0000 7f70e97fa700 1 -- 172.21.15.31:0/1043196146 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v134) v1 ==== 170+0+0 (secure 0 0 0) 0x7f70e0053d90 con 0x7f70ec159e60 2023-10-09T06:27:07.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.388+0000 7f70f34e3700 1 -- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f70d8066f30 msgr2=0x7f70d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:07.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.388+0000 7f70f34e3700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f70d8066f30 0x7f70d80693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f70e4006fd0 tx=0x7f70e4008040 comp rx=0 tx=0).stop 2023-10-09T06:27:07.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.388+0000 7f70f34e3700 1 -- 172.21.15.31:0/1043196146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70ec159e60 msgr2=0x7f70ec16deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:07.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.388+0000 7f70f34e3700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70ec159e60 0x7f70ec16deb0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f70e000c590 tx=0x7f70e0007f50 comp rx=0 tx=0).stop 2023-10-09T06:27:07.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.388+0000 7f70f34e3700 1 -- 172.21.15.31:0/1043196146 shutdown_connections 2023-10-09T06:27:07.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.388+0000 7f70f34e3700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f70d8066f30 0x7f70d80693e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:07.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.388+0000 7f70f34e3700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70ec15a230 0x7f70ec14d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:07.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.388+0000 7f70f34e3700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70ec0697c0 0x7f70ec16a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:07.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.388+0000 7f70f34e3700 1 --2- 172.21.15.31:0/1043196146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70ec159e60 0x7f70ec16deb0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:07.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.388+0000 7f70f34e3700 1 -- 172.21.15.31:0/1043196146 >> 172.21.15.31:0/1043196146 conn(0x7f70ec070700 msgr2=0x7f70ec159300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:07.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.388+0000 7f70f34e3700 1 -- 172.21.15.31:0/1043196146 shutdown_connections 2023-10-09T06:27:07.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.388+0000 7f70f34e3700 1 -- 172.21.15.31:0/1043196146 wait complete. 2023-10-09T06:27:07.390 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-10-09T06:27:07.402 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:27:07.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.526+0000 7f2659bae700 1 Processor -- start 2023-10-09T06:27:07.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.526+0000 7f2659bae700 1 -- start start 2023-10-09T06:27:07.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f2659bae700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f26540b6580 0x7f265406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:07.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f2659bae700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f265406a830 0x7f26540b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:07.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f2659bae700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f265406ac90 con 0x7f26540cce30 2023-10-09T06:27:07.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f2659bae700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26540b4d70 con 0x7f26540b6580 2023-10-09T06:27:07.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f2659bae700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265415b3b0 con 0x7f265406a830 2023-10-09T06:27:07.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f2653fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f26540b6580 0x7f265406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:07.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f2658bac700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f26540cce30 0x7f265415aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48770/0 (socket says 172.21.15.31:48770) 2023-10-09T06:27:07.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f2658bac700 1 -- 172.21.15.31:0/240473357 learned_addr learned my addr 172.21.15.31:0/240473357 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:07.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f26593ad700 1 --2- 172.21.15.31:0/240473357 >> v2:172.21.15.158:3300/0 conn(0x7f265406a830 0x7f26540b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:07.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f2653fff700 1 -- 172.21.15.31:0/240473357 >> v2:172.21.15.158:3300/0 conn(0x7f265406a830 msgr2=0x7f26540b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:07.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f2653fff700 1 --2- 172.21.15.31:0/240473357 >> v2:172.21.15.158:3300/0 conn(0x7f265406a830 0x7f26540b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:07.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f2653fff700 1 -- 172.21.15.31:0/240473357 >> v1:172.21.15.31:6789/0 conn(0x7f26540cce30 legacy=0x7f265415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:07.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f26537fe700 1 -- 172.21.15.31:0/240473357 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217034591 0 0) 0x7f264c001110 con 0x7f26540cce30 2023-10-09T06:27:07.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.527+0000 7f2653fff700 1 -- 172.21.15.31:0/240473357 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26540cd8d0 con 0x7f26540b6580 2023-10-09T06:27:07.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.528+0000 7f2653fff700 1 --2- 172.21.15.31:0/240473357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26540b6580 0x7f265406a2f0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f26540b4ce0 tx=0x7f2644009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96362daf250c2735 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:07.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.528+0000 7f26537fe700 1 -- 172.21.15.31:0/240473357 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400e070 con 0x7f26540b6580 2023-10-09T06:27:07.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.528+0000 7f26537fe700 1 -- 172.21.15.31:0/240473357 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264400bc30 con 0x7f26540b6580 2023-10-09T06:27:07.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.528+0000 7f26537fe700 1 -- 172.21.15.31:0/240473357 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644012430 con 0x7f26540b6580 2023-10-09T06:27:07.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.528+0000 7f2659bae700 1 -- 172.21.15.31:0/240473357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26540b6580 msgr2=0x7f265406a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:07.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.528+0000 7f2659bae700 1 --2- 172.21.15.31:0/240473357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26540b6580 0x7f265406a2f0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f26540b4ce0 tx=0x7f2644009780 comp rx=0 tx=0).stop 2023-10-09T06:27:07.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.528+0000 7f2659bae700 1 -- 172.21.15.31:0/240473357 shutdown_connections 2023-10-09T06:27:07.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.528+0000 7f2659bae700 1 --2- 172.21.15.31:0/240473357 >> v2:172.21.15.158:3300/0 conn(0x7f265406a830 0x7f26540b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:07.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.528+0000 7f2659bae700 1 --2- 172.21.15.31:0/240473357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26540b6580 0x7f265406a2f0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:07.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.528+0000 7f2659bae700 1 -- 172.21.15.31:0/240473357 >> 172.21.15.31:0/240473357 conn(0x7f2654068cb0 msgr2=0x7f26540690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:07.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.528+0000 7f2659bae700 1 -- 172.21.15.31:0/240473357 shutdown_connections 2023-10-09T06:27:07.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.528+0000 7f2659bae700 1 -- 172.21.15.31:0/240473357 wait complete. 2023-10-09T06:27:07.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.529+0000 7f2659bae700 1 Processor -- start 2023-10-09T06:27:07.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.530+0000 7f2659bae700 1 -- start start 2023-10-09T06:27:07.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.530+0000 7f2659bae700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f265406a830 0x7f265414e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:07.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.530+0000 7f2659bae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26540b6580 0x7f265416a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:07.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.530+0000 7f2659bae700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26540cce30 0x7f265416b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:07.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.530+0000 7f2659bae700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265416a310 con 0x7f26540b6580 2023-10-09T06:27:07.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.530+0000 7f2659bae700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2654169fc0 con 0x7f265406a830 2023-10-09T06:27:07.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.530+0000 7f2659bae700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2654153e60 con 0x7f26540cce30 2023-10-09T06:27:07.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.530+0000 7f2653fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26540b6580 0x7f265416a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:07.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.530+0000 7f2653fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26540b6580 0x7f265416a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49638/0 (socket says 172.21.15.31:49638) 2023-10-09T06:27:07.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.530+0000 7f2653fff700 1 -- 172.21.15.31:0/3997915161 learned_addr learned my addr 172.21.15.31:0/3997915161 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:07.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.531+0000 7f2658bac700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f265406a830 0x7f265414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:07.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.531+0000 7f26593ad700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26540cce30 0x7f265416b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:07.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.531+0000 7f2653fff700 1 -- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26540cce30 msgr2=0x7f265416b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:07.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.531+0000 7f2653fff700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26540cce30 0x7f265416b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:07.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.531+0000 7f2653fff700 1 -- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f265406a830 msgr2=0x7f265414e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:07.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.531+0000 7f2653fff700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f265406a830 0x7f265414e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:07.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.531+0000 7f2653fff700 1 -- 172.21.15.31:0/3997915161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644009a20 con 0x7f26540b6580 2023-10-09T06:27:07.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.531+0000 7f2653fff700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26540b6580 0x7f265416a7a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f2644012580 tx=0x7f2644019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:07.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.531+0000 7f2650ff9700 1 -- 172.21.15.31:0/3997915161 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644012e80 con 0x7f26540b6580 2023-10-09T06:27:07.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.531+0000 7f2650ff9700 1 -- 172.21.15.31:0/3997915161 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2644027470 con 0x7f26540b6580 2023-10-09T06:27:07.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.531+0000 7f2659bae700 1 -- 172.21.15.31:0/3997915161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2654154140 con 0x7f26540b6580 2023-10-09T06:27:07.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.531+0000 7f2650ff9700 1 -- 172.21.15.31:0/3997915161 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644027810 con 0x7f26540b6580 2023-10-09T06:27:07.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.531+0000 7f2659bae700 1 -- 172.21.15.31:0/3997915161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265414ed90 con 0x7f26540b6580 2023-10-09T06:27:07.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.532+0000 7f2659bae700 1 -- 172.21.15.31:0/3997915161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2654089550 con 0x7f26540b6580 2023-10-09T06:27:07.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.533+0000 7f2650ff9700 1 -- 172.21.15.31:0/3997915161 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2644024070 con 0x7f26540b6580 2023-10-09T06:27:07.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.533+0000 7f2650ff9700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2634066f30 0x7f26340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:07.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.533+0000 7f2650ff9700 1 -- 172.21.15.31:0/3997915161 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f2644086b20 con 0x7f26540b6580 2023-10-09T06:27:07.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.533+0000 7f2658bac700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2634066f30 0x7f26340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:07.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.534+0000 7f2658bac700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2634066f30 0x7f26340693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f264c00c8f0 tx=0x7f264c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:07.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.538+0000 7f2650ff9700 1 -- 172.21.15.31:0/3997915161 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2644053df0 con 0x7f26540b6580 2023-10-09T06:27:07.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:07.779+0000 7f2659bae700 1 -- 172.21.15.31:0/3997915161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f26540b4440 con 0x7f26540b6580 2023-10-09T06:27:08.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.376+0000 7f2650ff9700 1 -- 172.21.15.31:0/3997915161 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v62) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2644057410 con 0x7f26540b6580 2023-10-09T06:27:08.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.383+0000 7f2659bae700 1 -- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2634066f30 msgr2=0x7f26340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:08.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.383+0000 7f2659bae700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2634066f30 0x7f26340693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f264c00c8f0 tx=0x7f264c009040 comp rx=0 tx=0).stop 2023-10-09T06:27:08.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.383+0000 7f2659bae700 1 -- 172.21.15.31:0/3997915161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26540b6580 msgr2=0x7f265416a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:08.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.383+0000 7f2659bae700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26540b6580 0x7f265416a7a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f2644012580 tx=0x7f2644019000 comp rx=0 tx=0).stop 2023-10-09T06:27:08.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.385+0000 7f2659bae700 1 -- 172.21.15.31:0/3997915161 shutdown_connections 2023-10-09T06:27:08.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.385+0000 7f2659bae700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2634066f30 0x7f26340693e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.385+0000 7f2659bae700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26540cce30 0x7f265416b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.385+0000 7f2659bae700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f265406a830 0x7f265414e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.385+0000 7f2659bae700 1 --2- 172.21.15.31:0/3997915161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26540b6580 0x7f265416a7a0 secure :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f2644012580 tx=0x7f2644019000 comp rx=0 tx=0).stop 2023-10-09T06:27:08.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.385+0000 7f2659bae700 1 -- 172.21.15.31:0/3997915161 >> 172.21.15.31:0/3997915161 conn(0x7f2654068cb0 msgr2=0x7f2654158650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:08.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.400+0000 7f2659bae700 1 -- 172.21.15.31:0/3997915161 shutdown_connections 2023-10-09T06:27:08.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.400+0000 7f2659bae700 1 -- 172.21.15.31:0/3997915161 wait complete. 2023-10-09T06:27:08.400 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 16 and data pool 17 2023-10-09T06:27:08.413 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:27:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.534+0000 7f26cd485700 1 Processor -- start 2023-10-09T06:27:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.534+0000 7f26cd485700 1 -- start start 2023-10-09T06:27:08.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26cd485700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f26c8159c60 0x7f26c815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:08.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26cd485700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f26c815a030 0x7f26c80b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:08.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26cd485700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c8068de0 con 0x7f26c806a060 2023-10-09T06:27:08.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26cd485700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c80affc0 con 0x7f26c8159c60 2023-10-09T06:27:08.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26cd485700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c815b370 con 0x7f26c815a030 2023-10-09T06:27:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26c7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f26c8159c60 0x7f26c815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26c77fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f26c806a060 0x7f26c80ce990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48774/0 (socket says 172.21.15.31:48774) 2023-10-09T06:27:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26c77fe700 1 -- 172.21.15.31:0/3835561872 learned_addr learned my addr 172.21.15.31:0/3835561872 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26ccc84700 1 --2- 172.21.15.31:0/3835561872 >> v2:172.21.15.158:3300/0 conn(0x7f26c815a030 0x7f26c80b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26c7fff700 1 -- 172.21.15.31:0/3835561872 >> v2:172.21.15.158:3300/0 conn(0x7f26c815a030 msgr2=0x7f26c80b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26c7fff700 1 --2- 172.21.15.31:0/3835561872 >> v2:172.21.15.158:3300/0 conn(0x7f26c815a030 0x7f26c80b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26c7fff700 1 -- 172.21.15.31:0/3835561872 >> v1:172.21.15.31:6789/0 conn(0x7f26c806a060 legacy=0x7f26c80ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26c7fff700 1 -- 172.21.15.31:0/3835561872 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c80695f0 con 0x7f26c8159c60 2023-10-09T06:27:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26c6ffd700 1 -- 172.21.15.31:0/3835561872 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569162633 0 0) 0x7f26c8068de0 con 0x7f26c806a060 2023-10-09T06:27:08.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.535+0000 7f26ccc84700 1 --2- 172.21.15.31:0/3835561872 >> v2:172.21.15.158:3300/0 conn(0x7f26c815a030 0x7f26c80b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.536+0000 7f26c7fff700 1 --2- 172.21.15.31:0/3835561872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26c8159c60 0x7f26c815ae30 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f26c80ae790 tx=0x7f26b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fad99f85e03c25 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.536+0000 7f26c6ffd700 1 -- 172.21.15.31:0/3835561872 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b800b6b0 con 0x7f26c8159c60 2023-10-09T06:27:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.536+0000 7f26c6ffd700 1 -- 172.21.15.31:0/3835561872 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b800b810 con 0x7f26c8159c60 2023-10-09T06:27:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.536+0000 7f26c6ffd700 1 -- 172.21.15.31:0/3835561872 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b800bbb0 con 0x7f26c8159c60 2023-10-09T06:27:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.536+0000 7f26cd485700 1 -- 172.21.15.31:0/3835561872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26c8159c60 msgr2=0x7f26c815ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.536+0000 7f26cd485700 1 --2- 172.21.15.31:0/3835561872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26c8159c60 0x7f26c815ae30 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f26c80ae790 tx=0x7f26b80091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.536+0000 7f26cd485700 1 -- 172.21.15.31:0/3835561872 shutdown_connections 2023-10-09T06:27:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.536+0000 7f26cd485700 1 --2- 172.21.15.31:0/3835561872 >> v2:172.21.15.158:3300/0 conn(0x7f26c815a030 0x7f26c80b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.536+0000 7f26cd485700 1 --2- 172.21.15.31:0/3835561872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26c8159c60 0x7f26c815ae30 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.536+0000 7f26cd485700 1 -- 172.21.15.31:0/3835561872 >> 172.21.15.31:0/3835561872 conn(0x7f26c806c740 msgr2=0x7f26c8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:08.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.536+0000 7f26cd485700 1 -- 172.21.15.31:0/3835561872 shutdown_connections 2023-10-09T06:27:08.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.536+0000 7f26cd485700 1 -- 172.21.15.31:0/3835561872 wait complete. 2023-10-09T06:27:08.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.537+0000 7f26cd485700 1 Processor -- start 2023-10-09T06:27:08.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.538+0000 7f26cd485700 1 -- start start 2023-10-09T06:27:08.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.538+0000 7f26cd485700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26c806a060 0x7f26c80ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:08.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.538+0000 7f26cd485700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26c8159c60 0x7f26c80b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:08.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.538+0000 7f26cd485700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26c815a030 0x7f26c814e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:08.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.538+0000 7f26cd485700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c80b27a0 con 0x7f26c815a030 2023-10-09T06:27:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.538+0000 7f26cd485700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c80b3600 con 0x7f26c806a060 2023-10-09T06:27:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.538+0000 7f26cd485700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c80ad990 con 0x7f26c8159c60 2023-10-09T06:27:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26ccc84700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26c815a030 0x7f26c814e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26ccc84700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26c815a030 0x7f26c814e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49654/0 (socket says 172.21.15.31:49654) 2023-10-09T06:27:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26ccc84700 1 -- 172.21.15.31:0/3735585507 learned_addr learned my addr 172.21.15.31:0/3735585507 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26c77fe700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26c8159c60 0x7f26c80b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26c7fff700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26c806a060 0x7f26c80ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26ccc84700 1 -- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26c8159c60 msgr2=0x7f26c80b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26ccc84700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26c8159c60 0x7f26c80b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26ccc84700 1 -- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26c806a060 msgr2=0x7f26c80ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26ccc84700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26c806a060 0x7f26c80ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26ccc84700 1 -- 172.21.15.31:0/3735585507 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8009420 con 0x7f26c815a030 2023-10-09T06:27:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26c7fff700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26c806a060 0x7f26c80ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26ccc84700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26c815a030 0x7f26c814e4c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f26c000cef0 tx=0x7f26c0007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26bffff700 1 -- 172.21.15.31:0/3735585507 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c000add0 con 0x7f26c815a030 2023-10-09T06:27:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26bffff700 1 -- 172.21.15.31:0/3735585507 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c0016420 con 0x7f26c815a030 2023-10-09T06:27:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26cd485700 1 -- 172.21.15.31:0/3735585507 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c80b29f0 con 0x7f26c815a030 2023-10-09T06:27:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26bffff700 1 -- 172.21.15.31:0/3735585507 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00167e0 con 0x7f26c815a030 2023-10-09T06:27:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.539+0000 7f26cd485700 1 -- 172.21.15.31:0/3735585507 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c80b2fb0 con 0x7f26c815a030 2023-10-09T06:27:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.540+0000 7f26cd485700 1 -- 172.21.15.31:0/3735585507 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c80b3770 con 0x7f26c815a030 2023-10-09T06:27:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.541+0000 7f26bffff700 1 -- 172.21.15.31:0/3735585507 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26c0016bd0 con 0x7f26c815a030 2023-10-09T06:27:08.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.541+0000 7f26bffff700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26a8066f30 0x7f26a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:08.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.541+0000 7f26bffff700 1 -- 172.21.15.31:0/3735585507 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f26c0012070 con 0x7f26c815a030 2023-10-09T06:27:08.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.541+0000 7f26c7fff700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26a8066f30 0x7f26a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:08.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.542+0000 7f26c7fff700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26a8066f30 0x7f26a80693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f26b80091e0 tx=0x7f26b8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:08.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.545+0000 7f26bffff700 1 -- 172.21.15.31:0/3735585507 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26c004e5a0 con 0x7f26c815a030 2023-10-09T06:27:08.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.740+0000 7f26cd485700 1 -- 172.21.15.31:0/3735585507 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26c804bb80 con 0x7f26c815a030 2023-10-09T06:27:08.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.741+0000 7f26bffff700 1 -- 172.21.15.31:0/3735585507 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f26c0052070 con 0x7f26c815a030 2023-10-09T06:27:08.741 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:08.741 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":135,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:27:07.779566+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:27:06.232021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T06:27:06.742407+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:27:08.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.743+0000 7f26cd485700 1 -- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26a8066f30 msgr2=0x7f26a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:08.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.743+0000 7f26cd485700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26a8066f30 0x7f26a80693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f26b80091e0 tx=0x7f26b8017000 comp rx=0 tx=0).stop 2023-10-09T06:27:08.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.743+0000 7f26cd485700 1 -- 172.21.15.31:0/3735585507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26c815a030 msgr2=0x7f26c814e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:08.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.743+0000 7f26cd485700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26c815a030 0x7f26c814e4c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f26c000cef0 tx=0x7f26c0007860 comp rx=0 tx=0).stop 2023-10-09T06:27:08.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.743+0000 7f26cd485700 1 -- 172.21.15.31:0/3735585507 shutdown_connections 2023-10-09T06:27:08.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.743+0000 7f26cd485700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f26a8066f30 0x7f26a80693e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.743+0000 7f26cd485700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26c815a030 0x7f26c814e4c0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.743+0000 7f26cd485700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26c806a060 0x7f26c80ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.743+0000 7f26cd485700 1 --2- 172.21.15.31:0/3735585507 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f26c8159c60 0x7f26c80b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.743+0000 7f26cd485700 1 -- 172.21.15.31:0/3735585507 >> 172.21.15.31:0/3735585507 conn(0x7f26c806c740 msgr2=0x7f26c815f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:08.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.743+0000 7f26cd485700 1 -- 172.21.15.31:0/3735585507 shutdown_connections 2023-10-09T06:27:08.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.743+0000 7f26cd485700 1 -- 172.21.15.31:0/3735585507 wait complete. 2023-10-09T06:27:08.755 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:27:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.874+0000 7f7127038700 1 Processor -- start 2023-10-09T06:27:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.874+0000 7f7127038700 1 -- start start 2023-10-09T06:27:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.875+0000 7f7127038700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7120152020 0x7f71200ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.875+0000 7f7127038700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f71201523f0 0x7f712006c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.875+0000 7f7127038700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f712015b7f0 0x7f712015bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.875+0000 7f7127038700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712015c1d0 con 0x7f7120152020 2023-10-09T06:27:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.875+0000 7f7127038700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71200cbb10 con 0x7f71201523f0 2023-10-09T06:27:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.875+0000 7f7127038700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71200cbfa0 con 0x7f712015b7f0 2023-10-09T06:27:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.875+0000 7f7124dd4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7120152020 0x7f71200ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.875+0000 7f7124dd4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7120152020 0x7f71200ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49656/0 (socket says 172.21.15.31:49656) 2023-10-09T06:27:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.875+0000 7f7124dd4700 1 -- 172.21.15.31:0/1593708444 learned_addr learned my addr 172.21.15.31:0/1593708444 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.875+0000 7f71255d5700 1 --2- 172.21.15.31:0/1593708444 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f712015b7f0 0x7f712015bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.875+0000 7f711ffff700 1 --2- 172.21.15.31:0/1593708444 >> v2:172.21.15.158:3300/0 conn(0x7f71201523f0 0x7f712006c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.876+0000 7f7124dd4700 1 -- 172.21.15.31:0/1593708444 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f712015b7f0 msgr2=0x7f712015bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.876+0000 7f7124dd4700 1 --2- 172.21.15.31:0/1593708444 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f712015b7f0 0x7f712015bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.876+0000 7f7124dd4700 1 -- 172.21.15.31:0/1593708444 >> v2:172.21.15.158:3300/0 conn(0x7f71201523f0 msgr2=0x7f712006c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.876+0000 7f7124dd4700 1 --2- 172.21.15.31:0/1593708444 >> v2:172.21.15.158:3300/0 conn(0x7f71201523f0 0x7f712006c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.876+0000 7f7124dd4700 1 -- 172.21.15.31:0/1593708444 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71200caca0 con 0x7f7120152020 2023-10-09T06:27:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.876+0000 7f7124dd4700 1 --2- 172.21.15.31:0/1593708444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7120152020 0x7f71200ca760 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f712006d160 tx=0x7f7118009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4498ee86190ebf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.876+0000 7f711f7fe700 1 -- 172.21.15.31:0/1593708444 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711800e070 con 0x7f7120152020 2023-10-09T06:27:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.876+0000 7f711f7fe700 1 -- 172.21.15.31:0/1593708444 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711800b970 con 0x7f7120152020 2023-10-09T06:27:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.876+0000 7f711f7fe700 1 -- 172.21.15.31:0/1593708444 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71180092e0 con 0x7f7120152020 2023-10-09T06:27:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.877+0000 7f7127038700 1 -- 172.21.15.31:0/1593708444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7120152020 msgr2=0x7f71200ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.877+0000 7f7127038700 1 --2- 172.21.15.31:0/1593708444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7120152020 0x7f71200ca760 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f712006d160 tx=0x7f7118009840 comp rx=0 tx=0).stop 2023-10-09T06:27:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.877+0000 7f7127038700 1 -- 172.21.15.31:0/1593708444 shutdown_connections 2023-10-09T06:27:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.877+0000 7f7127038700 1 --2- 172.21.15.31:0/1593708444 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f712015b7f0 0x7f712015bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.877+0000 7f7127038700 1 --2- 172.21.15.31:0/1593708444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7120152020 0x7f71200ca760 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.877+0000 7f7127038700 1 --2- 172.21.15.31:0/1593708444 >> v2:172.21.15.158:3300/0 conn(0x7f71201523f0 0x7f712006c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.877+0000 7f7127038700 1 -- 172.21.15.31:0/1593708444 >> 172.21.15.31:0/1593708444 conn(0x7f7120069870 msgr2=0x7f7120069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:08.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.877+0000 7f7127038700 1 -- 172.21.15.31:0/1593708444 shutdown_connections 2023-10-09T06:27:08.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.877+0000 7f7127038700 1 -- 172.21.15.31:0/1593708444 wait complete. 2023-10-09T06:27:08.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.878+0000 7f7127038700 1 Processor -- start 2023-10-09T06:27:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.878+0000 7f7127038700 1 -- start start 2023-10-09T06:27:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f7127038700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7120152020 0x7f712014a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f7127038700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71201523f0 0x7f71200ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f7127038700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f712015b7f0 0x7f71200ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f7127038700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71200cd440 con 0x7f71201523f0 2023-10-09T06:27:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f7127038700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71200cd720 con 0x7f7120152020 2023-10-09T06:27:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f7127038700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71200cda00 con 0x7f712015b7f0 2023-10-09T06:27:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f711ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71201523f0 0x7f71200ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:08.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f711ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71201523f0 0x7f71200ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49662/0 (socket says 172.21.15.31:49662) 2023-10-09T06:27:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f711ffff700 1 -- 172.21.15.31:0/1674893669 learned_addr learned my addr 172.21.15.31:0/1674893669 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f7124dd4700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7120152020 0x7f712014a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f71255d5700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f712015b7f0 0x7f71200ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f711ffff700 1 -- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f712015b7f0 msgr2=0x7f71200ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f711ffff700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f712015b7f0 0x7f71200ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f711ffff700 1 -- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7120152020 msgr2=0x7f712014a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f711ffff700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7120152020 0x7f712014a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f711ffff700 1 -- 172.21.15.31:0/1674893669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7118009ae0 con 0x7f71201523f0 2023-10-09T06:27:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f711ffff700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71201523f0 0x7f71200ce4a0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f711000ec50 tx=0x7f71100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.879+0000 7f711cff9700 1 -- 172.21.15.31:0/1674893669 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711000c850 con 0x7f71201523f0 2023-10-09T06:27:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.880+0000 7f711cff9700 1 -- 172.21.15.31:0/1674893669 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711000c9b0 con 0x7f71201523f0 2023-10-09T06:27:08.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.880+0000 7f7127038700 1 -- 172.21.15.31:0/1674893669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71200cdce0 con 0x7f71201523f0 2023-10-09T06:27:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.880+0000 7f711cff9700 1 -- 172.21.15.31:0/1674893669 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711000cd70 con 0x7f71201523f0 2023-10-09T06:27:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.880+0000 7f7127038700 1 -- 172.21.15.31:0/1674893669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712014af20 con 0x7f71201523f0 2023-10-09T06:27:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.880+0000 7f7127038700 1 -- 172.21.15.31:0/1674893669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71200b18e0 con 0x7f71201523f0 2023-10-09T06:27:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.881+0000 7f711cff9700 1 -- 172.21.15.31:0/1674893669 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7110013680 con 0x7f71201523f0 2023-10-09T06:27:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.881+0000 7f711cff9700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7100066f30 0x7f71000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.881+0000 7f711cff9700 1 -- 172.21.15.31:0/1674893669 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7110084760 con 0x7f71201523f0 2023-10-09T06:27:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.882+0000 7f7124dd4700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7100066f30 0x7f71000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.882+0000 7f7124dd4700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7100066f30 0x7f71000693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7118009880 tx=0x7f7118018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:08.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:08.885+0000 7f711cff9700 1 -- 172.21.15.31:0/1674893669 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71200b18e0 con 0x7f71201523f0 2023-10-09T06:27:09.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.079+0000 7f7127038700 1 -- 172.21.15.31:0/1674893669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71200b18e0 con 0x7f71201523f0 2023-10-09T06:27:09.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.080+0000 7f711cff9700 1 -- 172.21.15.31:0/1674893669 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f71200b18e0 con 0x7f71201523f0 2023-10-09T06:27:09.080 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:09.080 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":135,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:27:07.779566+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:27:06.232021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T06:27:06.742407+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:27:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.082+0000 7f7127038700 1 -- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7100066f30 msgr2=0x7f71000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.082+0000 7f7127038700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7100066f30 0x7f71000693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7118009880 tx=0x7f7118018000 comp rx=0 tx=0).stop 2023-10-09T06:27:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.082+0000 7f7127038700 1 -- 172.21.15.31:0/1674893669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71201523f0 msgr2=0x7f71200ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.082+0000 7f7127038700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71201523f0 0x7f71200ce4a0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f711000ec50 tx=0x7f71100091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:09.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.082+0000 7f7127038700 1 -- 172.21.15.31:0/1674893669 shutdown_connections 2023-10-09T06:27:09.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.082+0000 7f7127038700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7100066f30 0x7f71000693e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:09.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.082+0000 7f7127038700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f712015b7f0 0x7f71200ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:09.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.082+0000 7f7127038700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7120152020 0x7f712014a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:09.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.082+0000 7f7127038700 1 --2- 172.21.15.31:0/1674893669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71201523f0 0x7f71200ce4a0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:09.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.082+0000 7f7127038700 1 -- 172.21.15.31:0/1674893669 >> 172.21.15.31:0/1674893669 conn(0x7f7120069870 msgr2=0x7f712014ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:09.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.082+0000 7f7127038700 1 -- 172.21.15.31:0/1674893669 shutdown_connections 2023-10-09T06:27:09.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.082+0000 7f7127038700 1 -- 172.21.15.31:0/1674893669 wait complete. 2023-10-09T06:27:09.094 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:27:09.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.217+0000 7f6c52079700 1 Processor -- start 2023-10-09T06:27:09.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.217+0000 7f6c52079700 1 -- start start 2023-10-09T06:27:09.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c52079700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6c4c143970 0x7f6c4c069e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:09.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c52079700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6c4c070e10 0x7f6c4c06a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:09.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c52079700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4c15e380 con 0x7f6c4c1435a0 2023-10-09T06:27:09.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c52079700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c06fb70 con 0x7f6c4c143970 2023-10-09T06:27:09.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c52079700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c06a8c0 con 0x7f6c4c070e10 2023-10-09T06:27:09.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c4affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6c4c143970 0x7f6c4c069e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:09.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c4b7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6c4c1435a0 0x7f6c4c070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48780/0 (socket says 172.21.15.31:48780) 2023-10-09T06:27:09.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c4b7fe700 1 -- 172.21.15.31:0/3962370569 learned_addr learned my addr 172.21.15.31:0/3962370569 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c4bfff700 1 --2- 172.21.15.31:0/3962370569 >> v2:172.21.15.158:3300/0 conn(0x7f6c4c070e10 0x7f6c4c06a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c4affd700 1 -- 172.21.15.31:0/3962370569 >> v2:172.21.15.158:3300/0 conn(0x7f6c4c070e10 msgr2=0x7f6c4c06a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c4affd700 1 --2- 172.21.15.31:0/3962370569 >> v2:172.21.15.158:3300/0 conn(0x7f6c4c070e10 0x7f6c4c06a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c4affd700 1 -- 172.21.15.31:0/3962370569 >> v1:172.21.15.31:6789/0 conn(0x7f6c4c1435a0 legacy=0x7f6c4c070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c4affd700 1 -- 172.21.15.31:0/3962370569 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c06ab70 con 0x7f6c4c143970 2023-10-09T06:27:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c4a7fc700 1 -- 172.21.15.31:0/3962370569 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140672623 0 0) 0x7f6c4c15e380 con 0x7f6c4c1435a0 2023-10-09T06:27:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.218+0000 7f6c4affd700 1 --2- 172.21.15.31:0/3962370569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c4c143970 0x7f6c4c069e40 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0ca4d0 tx=0x7f6c400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef659bfdb2359779 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.219+0000 7f6c4a7fc700 1 -- 172.21.15.31:0/3962370569 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4000b6b0 con 0x7f6c4c143970 2023-10-09T06:27:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.219+0000 7f6c4a7fc700 1 -- 172.21.15.31:0/3962370569 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4000b810 con 0x7f6c4c143970 2023-10-09T06:27:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.219+0000 7f6c4a7fc700 1 -- 172.21.15.31:0/3962370569 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4000bbb0 con 0x7f6c4c143970 2023-10-09T06:27:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.219+0000 7f6c52079700 1 -- 172.21.15.31:0/3962370569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c4c143970 msgr2=0x7f6c4c069e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:09.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.219+0000 7f6c52079700 1 --2- 172.21.15.31:0/3962370569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c4c143970 0x7f6c4c069e40 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0ca4d0 tx=0x7f6c400091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:09.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.219+0000 7f6c52079700 1 -- 172.21.15.31:0/3962370569 shutdown_connections 2023-10-09T06:27:09.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.219+0000 7f6c52079700 1 --2- 172.21.15.31:0/3962370569 >> v2:172.21.15.158:3300/0 conn(0x7f6c4c070e10 0x7f6c4c06a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:09.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.219+0000 7f6c52079700 1 --2- 172.21.15.31:0/3962370569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c4c143970 0x7f6c4c069e40 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:09.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.219+0000 7f6c52079700 1 -- 172.21.15.31:0/3962370569 >> 172.21.15.31:0/3962370569 conn(0x7f6c4c0ca520 msgr2=0x7f6c4c0ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:09.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.219+0000 7f6c52079700 1 -- 172.21.15.31:0/3962370569 shutdown_connections 2023-10-09T06:27:09.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.219+0000 7f6c52079700 1 -- 172.21.15.31:0/3962370569 wait complete. 2023-10-09T06:27:09.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.220+0000 7f6c52079700 1 Processor -- start 2023-10-09T06:27:09.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.220+0000 7f6c52079700 1 -- start start 2023-10-09T06:27:09.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.221+0000 7f6c52079700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c4c070e10 0x7f6c4c0ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:09.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.221+0000 7f6c52079700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c4c1435a0 0x7f6c4c0aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:09.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.221+0000 7f6c52079700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c4c143970 0x7f6c4c13e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:09.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.221+0000 7f6c52079700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c0aadb0 con 0x7f6c4c1435a0 2023-10-09T06:27:09.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.221+0000 7f6c52079700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c0b1470 con 0x7f6c4c070e10 2023-10-09T06:27:09.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.221+0000 7f6c52079700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c0ab010 con 0x7f6c4c143970 2023-10-09T06:27:09.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.221+0000 7f6c4affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c4c1435a0 0x7f6c4c0aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:09.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.221+0000 7f6c4affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c4c1435a0 0x7f6c4c0aa870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49682/0 (socket says 172.21.15.31:49682) 2023-10-09T06:27:09.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.221+0000 7f6c4affd700 1 -- 172.21.15.31:0/383424991 learned_addr learned my addr 172.21.15.31:0/383424991 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:09.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.221+0000 7f6c4b7fe700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c4c070e10 0x7f6c4c0ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:09.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.221+0000 7f6c4bfff700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c4c143970 0x7f6c4c13e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:09.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.222+0000 7f6c4affd700 1 -- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c4c143970 msgr2=0x7f6c4c13e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:09.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.222+0000 7f6c4affd700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c4c143970 0x7f6c4c13e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:09.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.222+0000 7f6c4affd700 1 -- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c4c070e10 msgr2=0x7f6c4c0ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:09.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.222+0000 7f6c4affd700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c4c070e10 0x7f6c4c0ac750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:09.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.222+0000 7f6c4affd700 1 -- 172.21.15.31:0/383424991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c40009420 con 0x7f6c4c1435a0 2023-10-09T06:27:09.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.222+0000 7f6c4b7fe700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c4c070e10 0x7f6c4c0ac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:09.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.222+0000 7f6c4affd700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c4c1435a0 0x7f6c4c0aa870 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c06b080 tx=0x7f6c40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:09.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.222+0000 7f6c337fe700 1 -- 172.21.15.31:0/383424991 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4000b980 con 0x7f6c4c1435a0 2023-10-09T06:27:09.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.222+0000 7f6c337fe700 1 -- 172.21.15.31:0/383424991 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4000bb00 con 0x7f6c4c1435a0 2023-10-09T06:27:09.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.222+0000 7f6c52079700 1 -- 172.21.15.31:0/383424991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c0ab2f0 con 0x7f6c4c1435a0 2023-10-09T06:27:09.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.222+0000 7f6c337fe700 1 -- 172.21.15.31:0/383424991 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40025670 con 0x7f6c4c1435a0 2023-10-09T06:27:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.222+0000 7f6c52079700 1 -- 172.21.15.31:0/383424991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c0b1710 con 0x7f6c4c1435a0 2023-10-09T06:27:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.223+0000 7f6c52079700 1 -- 172.21.15.31:0/383424991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c0ab810 con 0x7f6c4c1435a0 2023-10-09T06:27:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.224+0000 7f6c337fe700 1 -- 172.21.15.31:0/383424991 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c40023070 con 0x7f6c4c1435a0 2023-10-09T06:27:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.224+0000 7f6c337fe700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6c38066f30 0x7f6c380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.224+0000 7f6c337fe700 1 -- 172.21.15.31:0/383424991 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6c40085db0 con 0x7f6c4c1435a0 2023-10-09T06:27:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.225+0000 7f6c4b7fe700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6c38066f30 0x7f6c380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.225+0000 7f6c4b7fe700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6c38066f30 0x7f6c380693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0011e0 tx=0x7f6c3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.228+0000 7f6c337fe700 1 -- 172.21.15.31:0/383424991 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c400530a0 con 0x7f6c4c1435a0 2023-10-09T06:27:09.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:09.470+0000 7f6c52079700 1 -- 172.21.15.31:0/383424991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6c4c0ab810 con 0x7f6c4c1435a0 2023-10-09T06:27:10.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:10.399+0000 7f6c337fe700 1 -- 172.21.15.31:0/383424991 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v65) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6c4c0ab810 con 0x7f6c4c1435a0 2023-10-09T06:27:11.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:10.402+0000 7f6c52079700 1 -- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6c38066f30 msgr2=0x7f6c380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:11.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:10.402+0000 7f6c52079700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6c38066f30 0x7f6c380693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0011e0 tx=0x7f6c3c009040 comp rx=0 tx=0).stop 2023-10-09T06:27:11.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:10.402+0000 7f6c52079700 1 -- 172.21.15.31:0/383424991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c4c1435a0 msgr2=0x7f6c4c0aa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:11.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:10.402+0000 7f6c52079700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c4c1435a0 0x7f6c4c0aa870 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c06b080 tx=0x7f6c40017000 comp rx=0 tx=0).stop 2023-10-09T06:27:11.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:10.402+0000 7f6c52079700 1 -- 172.21.15.31:0/383424991 shutdown_connections 2023-10-09T06:27:11.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:10.402+0000 7f6c52079700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6c38066f30 0x7f6c380693e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:11.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:10.402+0000 7f6c52079700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6c4c143970 0x7f6c4c13e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:11.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:10.402+0000 7f6c52079700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c4c070e10 0x7f6c4c0ac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:11.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:10.402+0000 7f6c52079700 1 --2- 172.21.15.31:0/383424991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c4c1435a0 0x7f6c4c0aa870 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:11.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:10.402+0000 7f6c52079700 1 -- 172.21.15.31:0/383424991 >> 172.21.15.31:0/383424991 conn(0x7f6c4c0ca520 msgr2=0x7f6c4c070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:11.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:10.402+0000 7f6c52079700 1 -- 172.21.15.31:0/383424991 shutdown_connections 2023-10-09T06:27:11.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:10.402+0000 7f6c52079700 1 -- 172.21.15.31:0/383424991 wait complete. 2023-10-09T06:27:11.035 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:27:11.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.172+0000 7fc7b5447700 1 Processor -- start 2023-10-09T06:27:11.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.172+0000 7fc7b5447700 1 -- start start 2023-10-09T06:27:11.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.172+0000 7fc7b5447700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7b00cf5a0 0x7fc7b00b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:11.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.172+0000 7fc7b5447700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b0159ec0 0x7fc7b00b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:11.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.172+0000 7fc7b5447700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b00ce7e0 con 0x7fc7b00b06b0 2023-10-09T06:27:11.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.172+0000 7fc7b5447700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b00ceac0 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.172+0000 7fc7b5447700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00ceda0 con 0x7fc7b0159ec0 2023-10-09T06:27:11.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7af7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7b00cf5a0 0x7fc7b00b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:11.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7af7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7b00cf5a0 0x7fc7b00b0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39614/0 (socket says 172.21.15.31:39614) 2023-10-09T06:27:11.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7af7fe700 1 -- 172.21.15.31:0/1276232749 learned_addr learned my addr 172.21.15.31:0/1276232749 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:11.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7affff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc7b00b06b0 0x7fc7b01597b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38284/0 (socket says 172.21.15.31:38284) 2023-10-09T06:27:11.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7b4c46700 1 --2- 172.21.15.31:0/1276232749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b0159ec0 0x7fc7b00b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:11.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7af7fe700 1 -- 172.21.15.31:0/1276232749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b0159ec0 msgr2=0x7fc7b00b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:11.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7af7fe700 1 --2- 172.21.15.31:0/1276232749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b0159ec0 0x7fc7b00b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:11.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7af7fe700 1 -- 172.21.15.31:0/1276232749 >> v1:172.21.15.31:6789/0 conn(0x7fc7b00b06b0 legacy=0x7fc7b01597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:11.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7aeffd700 1 -- 172.21.15.31:0/1276232749 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892707799 0 0) 0x7fc7b00ce7e0 con 0x7fc7b00b06b0 2023-10-09T06:27:11.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7af7fe700 1 -- 172.21.15.31:0/1276232749 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b00cf080 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7b4c46700 1 --2- 172.21.15.31:0/1276232749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b0159ec0 0x7fc7b00b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:11.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7af7fe700 1 --2- 172.21.15.31:0/1276232749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b00cf5a0 0x7fc7b00b0a80 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40099b0 tx=0x7fc7a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef531ebdb6c5a2e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:11.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7aeffd700 1 -- 172.21.15.31:0/1276232749 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400b860 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7aeffd700 1 -- 172.21.15.31:0/1276232749 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a400b9c0 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.173+0000 7fc7aeffd700 1 -- 172.21.15.31:0/1276232749 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400bd60 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.174+0000 7fc7b5447700 1 -- 172.21.15.31:0/1276232749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b00cf5a0 msgr2=0x7fc7b00b0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:11.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.174+0000 7fc7b5447700 1 --2- 172.21.15.31:0/1276232749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b00cf5a0 0x7fc7b00b0a80 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40099b0 tx=0x7fc7a4009250 comp rx=0 tx=0).stop 2023-10-09T06:27:11.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.174+0000 7fc7b5447700 1 -- 172.21.15.31:0/1276232749 shutdown_connections 2023-10-09T06:27:11.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.174+0000 7fc7b5447700 1 --2- 172.21.15.31:0/1276232749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b0159ec0 0x7fc7b00b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:11.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.174+0000 7fc7b5447700 1 --2- 172.21.15.31:0/1276232749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b00cf5a0 0x7fc7b00b0a80 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:11.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.174+0000 7fc7b5447700 1 -- 172.21.15.31:0/1276232749 >> 172.21.15.31:0/1276232749 conn(0x7fc7b006c700 msgr2=0x7fc7b0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:11.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.174+0000 7fc7b5447700 1 -- 172.21.15.31:0/1276232749 shutdown_connections 2023-10-09T06:27:11.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.174+0000 7fc7b5447700 1 -- 172.21.15.31:0/1276232749 wait complete. 2023-10-09T06:27:11.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.175+0000 7fc7b5447700 1 Processor -- start 2023-10-09T06:27:11.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.175+0000 7fc7b5447700 1 -- start start 2023-10-09T06:27:11.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7b5447700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b00b06b0 0x7fc7b015cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:11.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7b5447700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b00cf5a0 0x7fc7b00682c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:11.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7b5447700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7b0159ec0 0x7fc7b0148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:11.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7b5447700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b0068800 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7b5447700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b0148a90 con 0x7fc7b0159ec0 2023-10-09T06:27:11.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7b5447700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b0068a10 con 0x7fc7b00b06b0 2023-10-09T06:27:11.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7af7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b00cf5a0 0x7fc7b00682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:11.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7af7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b00cf5a0 0x7fc7b00682c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39624/0 (socket says 172.21.15.31:39624) 2023-10-09T06:27:11.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7af7fe700 1 -- 172.21.15.31:0/2515550244 learned_addr learned my addr 172.21.15.31:0/2515550244 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:11.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7af7fe700 1 -- 172.21.15.31:0/2515550244 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b00b06b0 msgr2=0x7fc7b015cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:11.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7af7fe700 1 --2- 172.21.15.31:0/2515550244 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b00b06b0 0x7fc7b015cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:11.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7af7fe700 1 -- 172.21.15.31:0/2515550244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7b0159ec0 msgr2=0x7fc7b0148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:11.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7af7fe700 1 --2- 172.21.15.31:0/2515550244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7b0159ec0 0x7fc7b0148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:11.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7af7fe700 1 -- 172.21.15.31:0/2515550244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a40094f0 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.176+0000 7fc7af7fe700 1 --2- 172.21.15.31:0/2515550244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b00cf5a0 0x7fc7b00682c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00ae420 tx=0x7fc7a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:11.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.177+0000 7fc797fff700 1 -- 172.21.15.31:0/2515550244 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a401a420 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.177+0000 7fc797fff700 1 -- 172.21.15.31:0/2515550244 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a401a5a0 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.177+0000 7fc7b5447700 1 -- 172.21.15.31:0/2515550244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b00c9e70 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.177+0000 7fc797fff700 1 -- 172.21.15.31:0/2515550244 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a401a960 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.177+0000 7fc7b5447700 1 -- 172.21.15.31:0/2515550244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b00ca430 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.178+0000 7fc7b5447700 1 -- 172.21.15.31:0/2515550244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b004c3c0 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.178+0000 7fc797fff700 1 -- 172.21.15.31:0/2515550244 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7a401ad50 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.178+0000 7fc797fff700 1 --2- 172.21.15.31:0/2515550244 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc79c066f60 0x7fc79c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:11.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.179+0000 7fc797fff700 1 -- 172.21.15.31:0/2515550244 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7a4086050 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.179+0000 7fc7affff700 1 --2- 172.21.15.31:0/2515550244 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc79c066f60 0x7fc79c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.179+0000 7fc7affff700 1 --2- 172.21.15.31:0/2515550244 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc79c066f60 0x7fc79c069410 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00011e0 tx=0x7fc7a00079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.183+0000 7fc797fff700 1 -- 172.21.15.31:0/2515550244 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7a40532c0 con 0x7fc7b00cf5a0 2023-10-09T06:27:11.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:11.421+0000 7fc7b5447700 1 -- 172.21.15.31:0/2515550244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc7b00b1ec0 con 0x7fc7b00cf5a0 2023-10-09T06:27:12.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.408+0000 7fc797fff700 1 -- 172.21.15.31:0/2515550244 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v66) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc7a40150c0 con 0x7fc7b00cf5a0 2023-10-09T06:27:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.411+0000 7fc7b5447700 1 -- 172.21.15.31:0/2515550244 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc79c066f60 msgr2=0x7fc79c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.411+0000 7fc7b5447700 1 --2- 172.21.15.31:0/2515550244 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc79c066f60 0x7fc79c069410 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00011e0 tx=0x7fc7a00079b0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.411+0000 7fc7b5447700 1 -- 172.21.15.31:0/2515550244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b00cf5a0 msgr2=0x7fc7b00682c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.411+0000 7fc7b5447700 1 --2- 172.21.15.31:0/2515550244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b00cf5a0 0x7fc7b00682c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00ae420 tx=0x7fc7a4017000 comp rx=0 tx=0).stop 2023-10-09T06:27:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.411+0000 7fc7b5447700 1 -- 172.21.15.31:0/2515550244 shutdown_connections 2023-10-09T06:27:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.411+0000 7fc7b5447700 1 --2- 172.21.15.31:0/2515550244 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc79c066f60 0x7fc79c069410 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.411+0000 7fc7b5447700 1 --2- 172.21.15.31:0/2515550244 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc7b00b06b0 0x7fc7b015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.411+0000 7fc7b5447700 1 --2- 172.21.15.31:0/2515550244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc7b0159ec0 0x7fc7b0148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.411+0000 7fc7b5447700 1 --2- 172.21.15.31:0/2515550244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b00cf5a0 0x7fc7b00682c0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.411+0000 7fc7b5447700 1 -- 172.21.15.31:0/2515550244 >> 172.21.15.31:0/2515550244 conn(0x7fc7b006c700 msgr2=0x7fc7b015e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.411+0000 7fc7b5447700 1 -- 172.21.15.31:0/2515550244 shutdown_connections 2023-10-09T06:27:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.411+0000 7fc7b5447700 1 -- 172.21.15.31:0/2515550244 wait complete. 2023-10-09T06:27:12.426 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:27:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.553+0000 7f9487c37700 1 Processor -- start 2023-10-09T06:27:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.553+0000 7f9487c37700 1 -- start start 2023-10-09T06:27:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.554+0000 7f9487c37700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9480157c40 0x7f9480158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.554+0000 7f9487c37700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948015cbb0 con 0x7f9480157870 2023-10-09T06:27:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.554+0000 7f9487c37700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948015bfa0 con 0x7f948015a620 2023-10-09T06:27:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.554+0000 7f9487c37700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948015bdb0 con 0x7f9480157c40 2023-10-09T06:27:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.554+0000 7f94861d4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9480157c40 0x7f9480158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.554+0000 7f94861d4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9480157c40 0x7f9480158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39628/0 (socket says 172.21.15.31:39628) 2023-10-09T06:27:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.554+0000 7f94861d4700 1 -- 172.21.15.31:0/1091215007 learned_addr learned my addr 172.21.15.31:0/1091215007 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.554+0000 7f94859d3700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9480157870 0x7f948015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38296/0 (socket says 172.21.15.31:38296) 2023-10-09T06:27:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.555+0000 7f94861d4700 1 -- 172.21.15.31:0/1091215007 >> v1:172.21.15.158:6789/0 conn(0x7f948015a620 legacy=0x7f948015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.555+0000 7f94861d4700 1 -- 172.21.15.31:0/1091215007 >> v1:172.21.15.31:6789/0 conn(0x7f9480157870 legacy=0x7f948015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.555+0000 7f94861d4700 1 -- 172.21.15.31:0/1091215007 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948015c280 con 0x7f9480157c40 2023-10-09T06:27:12.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.555+0000 7f94861d4700 1 --2- 172.21.15.31:0/1091215007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9480157c40 0x7f9480158110 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f9478009f20 tx=0x7f9478009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3948724da16fb29b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:12.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.555+0000 7f94849d1700 1 -- 172.21.15.31:0/1091215007 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947800e070 con 0x7f9480157c40 2023-10-09T06:27:12.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.555+0000 7f94849d1700 1 -- 172.21.15.31:0/1091215007 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947800ba40 con 0x7f9480157c40 2023-10-09T06:27:12.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.555+0000 7f94849d1700 1 -- 172.21.15.31:0/1091215007 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94780092e0 con 0x7f9480157c40 2023-10-09T06:27:12.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.556+0000 7f9487c37700 1 -- 172.21.15.31:0/1091215007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9480157c40 msgr2=0x7f9480158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:12.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.556+0000 7f9487c37700 1 --2- 172.21.15.31:0/1091215007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9480157c40 0x7f9480158110 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f9478009f20 tx=0x7f9478009840 comp rx=0 tx=0).stop 2023-10-09T06:27:12.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.556+0000 7f9487c37700 1 -- 172.21.15.31:0/1091215007 shutdown_connections 2023-10-09T06:27:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.556+0000 7f9487c37700 1 --2- 172.21.15.31:0/1091215007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9480157c40 0x7f9480158110 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.556+0000 7f9487c37700 1 -- 172.21.15.31:0/1091215007 >> 172.21.15.31:0/1091215007 conn(0x7f9480068ce0 msgr2=0x7f94800690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.556+0000 7f9487c37700 1 -- 172.21.15.31:0/1091215007 shutdown_connections 2023-10-09T06:27:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.556+0000 7f9487c37700 1 -- 172.21.15.31:0/1091215007 wait complete. 2023-10-09T06:27:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.557+0000 7f9487c37700 1 Processor -- start 2023-10-09T06:27:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.557+0000 7f9487c37700 1 -- start start 2023-10-09T06:27:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f9487c37700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9480157870 0x7f948016a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f9487c37700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9480157c40 0x7f948016a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f9487c37700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f948015a620 0x7f94800b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f9487c37700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948014e720 con 0x7f9480157c40 2023-10-09T06:27:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f9487c37700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9480153f40 con 0x7f9480157870 2023-10-09T06:27:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f9487c37700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9480154220 con 0x7f948015a620 2023-10-09T06:27:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f94851d2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9480157c40 0x7f948016a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f94851d2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9480157c40 0x7f948016a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39638/0 (socket says 172.21.15.31:39638) 2023-10-09T06:27:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f94851d2700 1 -- 172.21.15.31:0/2989806663 learned_addr learned my addr 172.21.15.31:0/2989806663 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f94861d4700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f948015a620 0x7f94800b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f94859d3700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9480157870 0x7f948016a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f94851d2700 1 -- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f948015a620 msgr2=0x7f94800b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f94851d2700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f948015a620 0x7f94800b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f94851d2700 1 -- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9480157870 msgr2=0x7f948016a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f94851d2700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9480157870 0x7f948016a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f94851d2700 1 -- 172.21.15.31:0/2989806663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9478009ae0 con 0x7f9480157c40 2023-10-09T06:27:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f94851d2700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9480157c40 0x7f948016a780 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f947400b5e0 tx=0x7f94740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f947dffb700 1 -- 172.21.15.31:0/2989806663 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947400f510 con 0x7f9480157c40 2023-10-09T06:27:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f947dffb700 1 -- 172.21.15.31:0/2989806663 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947400f6b0 con 0x7f9480157c40 2023-10-09T06:27:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f947dffb700 1 -- 172.21.15.31:0/2989806663 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947400fa70 con 0x7f9480157c40 2023-10-09T06:27:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.558+0000 7f9487c37700 1 -- 172.21.15.31:0/2989806663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948014e0d0 con 0x7f9480157c40 2023-10-09T06:27:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.559+0000 7f9487c37700 1 -- 172.21.15.31:0/2989806663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9480151180 con 0x7f9480157c40 2023-10-09T06:27:12.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.559+0000 7f9487c37700 1 -- 172.21.15.31:0/2989806663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948014e8d0 con 0x7f9480157c40 2023-10-09T06:27:12.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.560+0000 7f947dffb700 1 -- 172.21.15.31:0/2989806663 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f947401a400 con 0x7f9480157c40 2023-10-09T06:27:12.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.560+0000 7f947dffb700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f946c066f30 0x7f946c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:12.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.560+0000 7f947dffb700 1 -- 172.21.15.31:0/2989806663 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9474084050 con 0x7f9480157c40 2023-10-09T06:27:12.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.560+0000 7f94859d3700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f946c066f30 0x7f946c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:12.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.561+0000 7f94859d3700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f946c066f30 0x7f946c0693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9470007fd0 tx=0x7f9470007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:12.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.565+0000 7f947dffb700 1 -- 172.21.15.31:0/2989806663 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f948014e8d0 con 0x7f9480157c40 2023-10-09T06:27:12.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.803+0000 7f9487c37700 1 -- 172.21.15.31:0/2989806663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94800b4840 con 0x7f9480157c40 2023-10-09T06:27:12.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.804+0000 7f947dffb700 1 -- 172.21.15.31:0/2989806663 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f9474051340 con 0x7f9480157c40 2023-10-09T06:27:12.803 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:12.804 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/1232957657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1232957657},{"type":"v1","addr":"172.21.15.158:6836","nonce":1232957657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2947695434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2947695434},{"type":"v1","addr":"172.21.15.158:6837","nonce":2947695434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/912397379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":912397379},{"type":"v1","addr":"172.21.15.31:6834","nonce":912397379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:07.779885+0000","modified":"2023-10-09T06:27:12.402382+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7005},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7005":{"gid":7005,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1684509217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1684509217},{"type":"v1","addr":"172.21.15.31:6835","nonce":1684509217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T06:27:12.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.806+0000 7f9487c37700 1 -- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f946c066f30 msgr2=0x7f946c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:12.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.806+0000 7f9487c37700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f946c066f30 0x7f946c0693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9470007fd0 tx=0x7f9470007d70 comp rx=0 tx=0).stop 2023-10-09T06:27:12.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.806+0000 7f9487c37700 1 -- 172.21.15.31:0/2989806663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9480157c40 msgr2=0x7f948016a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:12.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.806+0000 7f9487c37700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9480157c40 0x7f948016a780 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f947400b5e0 tx=0x7f94740090f0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.806+0000 7f9487c37700 1 -- 172.21.15.31:0/2989806663 shutdown_connections 2023-10-09T06:27:12.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.806+0000 7f9487c37700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f946c066f30 0x7f946c0693e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.806+0000 7f9487c37700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f948015a620 0x7f94800b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.806+0000 7f9487c37700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9480157870 0x7f948016a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.806+0000 7f9487c37700 1 --2- 172.21.15.31:0/2989806663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9480157c40 0x7f948016a780 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.806+0000 7f9487c37700 1 -- 172.21.15.31:0/2989806663 >> 172.21.15.31:0/2989806663 conn(0x7f9480068ce0 msgr2=0x7f94800d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:12.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.806+0000 7f9487c37700 1 -- 172.21.15.31:0/2989806663 shutdown_connections 2023-10-09T06:27:12.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.806+0000 7f9487c37700 1 -- 172.21.15.31:0/2989806663 wait complete. 2023-10-09T06:27:12.807 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 66 2023-10-09T06:27:12.818 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:27:12.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.937+0000 7f84d6d5e700 1 Processor -- start 2023-10-09T06:27:12.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.937+0000 7f84d6d5e700 1 -- start start 2023-10-09T06:27:12.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.938+0000 7f84d6d5e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f84d006e580 0x7f84d00cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:12.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.938+0000 7f84d6d5e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f84d00ac1a0 0x7f84d0167ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:12.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.938+0000 7f84d6d5e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d00cb790 con 0x7f84d00adcb0 2023-10-09T06:27:12.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.938+0000 7f84d6d5e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d006d120 con 0x7f84d00ac1a0 2023-10-09T06:27:12.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.938+0000 7f84d6d5e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d00cba70 con 0x7f84d006e580 2023-10-09T06:27:12.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.938+0000 7f84d655d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f84d00ac1a0 0x7f84d0167ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.938+0000 7f84d5d5c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f84d00adcb0 0x7f84d00ae080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38300/0 (socket says 172.21.15.31:38300) 2023-10-09T06:27:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.938+0000 7f84d5d5c700 1 -- 172.21.15.31:0/1072146328 learned_addr learned my addr 172.21.15.31:0/1072146328 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.938+0000 7f84d555b700 1 --2- 172.21.15.31:0/1072146328 >> v2:172.21.15.158:3300/0 conn(0x7f84d006e580 0x7f84d00cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d655d700 1 -- 172.21.15.31:0/1072146328 >> v2:172.21.15.158:3300/0 conn(0x7f84d006e580 msgr2=0x7f84d00cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d655d700 1 --2- 172.21.15.31:0/1072146328 >> v2:172.21.15.158:3300/0 conn(0x7f84d006e580 0x7f84d00cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d655d700 1 -- 172.21.15.31:0/1072146328 >> v1:172.21.15.31:6789/0 conn(0x7f84d00adcb0 legacy=0x7f84d00ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d655d700 1 -- 172.21.15.31:0/1072146328 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d00cbd50 con 0x7f84d00ac1a0 2023-10-09T06:27:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d4d5a700 1 -- 172.21.15.31:0/1072146328 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178287048 0 0) 0x7f84d00cb790 con 0x7f84d00adcb0 2023-10-09T06:27:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d555b700 1 --2- 172.21.15.31:0/1072146328 >> v2:172.21.15.158:3300/0 conn(0x7f84d006e580 0x7f84d00cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:12.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d655d700 1 --2- 172.21.15.31:0/1072146328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d00ac1a0 0x7f84d0167ea0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f84d00cc750 tx=0x7f84c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a6cbf9d29941b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d4d5a700 1 -- 172.21.15.31:0/1072146328 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800b6b0 con 0x7f84d00ac1a0 2023-10-09T06:27:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d4d5a700 1 -- 172.21.15.31:0/1072146328 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c800b810 con 0x7f84d00ac1a0 2023-10-09T06:27:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d4d5a700 1 -- 172.21.15.31:0/1072146328 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800bbb0 con 0x7f84d00ac1a0 2023-10-09T06:27:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d6d5e700 1 -- 172.21.15.31:0/1072146328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d00ac1a0 msgr2=0x7f84d0167ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d6d5e700 1 --2- 172.21.15.31:0/1072146328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d00ac1a0 0x7f84d0167ea0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f84d00cc750 tx=0x7f84c80091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d6d5e700 1 -- 172.21.15.31:0/1072146328 shutdown_connections 2023-10-09T06:27:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d6d5e700 1 --2- 172.21.15.31:0/1072146328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d00ac1a0 0x7f84d0167ea0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d6d5e700 1 --2- 172.21.15.31:0/1072146328 >> v2:172.21.15.158:3300/0 conn(0x7f84d006e580 0x7f84d00cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.939+0000 7f84d6d5e700 1 -- 172.21.15.31:0/1072146328 >> 172.21.15.31:0/1072146328 conn(0x7f84d00680e0 msgr2=0x7f84d00cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.940+0000 7f84d6d5e700 1 -- 172.21.15.31:0/1072146328 shutdown_connections 2023-10-09T06:27:12.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.940+0000 7f84d6d5e700 1 -- 172.21.15.31:0/1072146328 wait complete. 2023-10-09T06:27:12.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.941+0000 7f84d6d5e700 1 Processor -- start 2023-10-09T06:27:12.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.941+0000 7f84d6d5e700 1 -- start start 2023-10-09T06:27:12.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.941+0000 7f84d6d5e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d006e580 0x7f84d00b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:12.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.941+0000 7f84d6d5e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84d00ac1a0 0x7f84d016dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:12.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.941+0000 7f84d6d5e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f84d00adcb0 0x7f84d016e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:12.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.941+0000 7f84d6d5e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d015c740 con 0x7f84d006e580 2023-10-09T06:27:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.941+0000 7f84d6d5e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d00b15a0 con 0x7f84d00adcb0 2023-10-09T06:27:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.941+0000 7f84d6d5e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d0160830 con 0x7f84d00ac1a0 2023-10-09T06:27:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.941+0000 7f84d5d5c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d006e580 0x7f84d00b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.941+0000 7f84d5d5c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d006e580 0x7f84d00b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39670/0 (socket says 172.21.15.31:39670) 2023-10-09T06:27:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.941+0000 7f84d5d5c700 1 -- 172.21.15.31:0/209274713 learned_addr learned my addr 172.21.15.31:0/209274713 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84d655d700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f84d00adcb0 0x7f84d016e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84d555b700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84d00ac1a0 0x7f84d016dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84d5d5c700 1 -- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84d00ac1a0 msgr2=0x7f84d016dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84d5d5c700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84d00ac1a0 0x7f84d016dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84d5d5c700 1 -- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f84d00adcb0 msgr2=0x7f84d016e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84d5d5c700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f84d00adcb0 0x7f84d016e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84d5d5c700 1 -- 172.21.15.31:0/209274713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c8009420 con 0x7f84d006e580 2023-10-09T06:27:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84d655d700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f84d00adcb0 0x7f84d016e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84d555b700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84d00ac1a0 0x7f84d016dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84d5d5c700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d006e580 0x7f84d00b2020 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f84c000cca0 tx=0x7f84c0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84cdffb700 1 -- 172.21.15.31:0/209274713 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c000aad0 con 0x7f84d006e580 2023-10-09T06:27:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84cdffb700 1 -- 172.21.15.31:0/209274713 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c000ac30 con 0x7f84d006e580 2023-10-09T06:27:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84d6d5e700 1 -- 172.21.15.31:0/209274713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d00a6840 con 0x7f84d006e580 2023-10-09T06:27:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84cdffb700 1 -- 172.21.15.31:0/209274713 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c00070f0 con 0x7f84d006e580 2023-10-09T06:27:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.942+0000 7f84d6d5e700 1 -- 172.21.15.31:0/209274713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d01604c0 con 0x7f84d006e580 2023-10-09T06:27:12.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.943+0000 7f84d6d5e700 1 -- 172.21.15.31:0/209274713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d006bc70 con 0x7f84d006e580 2023-10-09T06:27:12.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.943+0000 7f84cdffb700 1 -- 172.21.15.31:0/209274713 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84c00074e0 con 0x7f84d006e580 2023-10-09T06:27:12.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.944+0000 7f84cdffb700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f84bc066f30 0x7f84bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:12.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.944+0000 7f84cdffb700 1 -- 172.21.15.31:0/209274713 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84c0084980 con 0x7f84d006e580 2023-10-09T06:27:12.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.944+0000 7f84d555b700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f84bc066f30 0x7f84bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:12.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.945+0000 7f84d555b700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f84bc066f30 0x7f84bc0693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f84d0171110 tx=0x7f84c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:12.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:12.948+0000 7f84cdffb700 1 -- 172.21.15.31:0/209274713 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84c0051c70 con 0x7f84d006e580 2023-10-09T06:27:13.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.141+0000 7f84d6d5e700 1 -- 172.21.15.31:0/209274713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84d004bb80 con 0x7f84d006e580 2023-10-09T06:27:13.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.142+0000 7f84cdffb700 1 -- 172.21.15.31:0/209274713 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+15365 (secure 0 0 0) 0x7f84c0055290 con 0x7f84d006e580 2023-10-09T06:27:13.141 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:13.142 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":136,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:27:09.371838+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:27:06.232021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T06:27:06.742407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:27:13.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.144+0000 7f84d6d5e700 1 -- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f84bc066f30 msgr2=0x7f84bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.144+0000 7f84d6d5e700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f84bc066f30 0x7f84bc0693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f84d0171110 tx=0x7f84c4008040 comp rx=0 tx=0).stop 2023-10-09T06:27:13.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.144+0000 7f84d6d5e700 1 -- 172.21.15.31:0/209274713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d006e580 msgr2=0x7f84d00b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.144+0000 7f84d6d5e700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d006e580 0x7f84d00b2020 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f84c000cca0 tx=0x7f84c0001a30 comp rx=0 tx=0).stop 2023-10-09T06:27:13.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.144+0000 7f84d6d5e700 1 -- 172.21.15.31:0/209274713 shutdown_connections 2023-10-09T06:27:13.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.144+0000 7f84d6d5e700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f84bc066f30 0x7f84bc0693e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.144+0000 7f84d6d5e700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f84d00adcb0 0x7f84d016e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.144+0000 7f84d6d5e700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d006e580 0x7f84d00b2020 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.144+0000 7f84d6d5e700 1 --2- 172.21.15.31:0/209274713 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84d00ac1a0 0x7f84d016dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.144+0000 7f84d6d5e700 1 -- 172.21.15.31:0/209274713 >> 172.21.15.31:0/209274713 conn(0x7f84d00680e0 msgr2=0x7f84d00cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:13.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.144+0000 7f84d6d5e700 1 -- 172.21.15.31:0/209274713 shutdown_connections 2023-10-09T06:27:13.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.144+0000 7f84d6d5e700 1 -- 172.21.15.31:0/209274713 wait complete. 2023-10-09T06:27:13.156 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:27:13.156 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:27:13.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.275+0000 7f9a8d84a700 1 Processor -- start 2023-10-09T06:27:13.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.275+0000 7f9a8d84a700 1 -- start start 2023-10-09T06:27:13.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.276+0000 7f9a8d84a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9a88159c60 0x7f9a8815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:13.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.276+0000 7f9a8d84a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a88068de0 con 0x7f9a8806a060 2023-10-09T06:27:13.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.276+0000 7f9a8d84a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a880affc0 con 0x7f9a8815a030 2023-10-09T06:27:13.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.276+0000 7f9a8d84a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a8815b370 con 0x7f9a88159c60 2023-10-09T06:27:13.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.276+0000 7f9a87fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9a8806a060 0x7f9a880ce990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38302/0 (socket says 172.21.15.31:38302) 2023-10-09T06:27:13.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.276+0000 7f9a87fff700 1 -- 172.21.15.31:0/2319797347 learned_addr learned my addr 172.21.15.31:0/2319797347 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:13.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.276+0000 7f9a8c848700 1 --2- 172.21.15.31:0/2319797347 >> v2:172.21.15.158:3300/0 conn(0x7f9a88159c60 0x7f9a8815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:13.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.276+0000 7f9a877fe700 1 -- 172.21.15.31:0/2319797347 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767225803 0 0) 0x7f9a88068de0 con 0x7f9a8806a060 2023-10-09T06:27:13.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.276+0000 7f9a877fe700 1 -- 172.21.15.31:0/2319797347 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a74003570 con 0x7f9a8806a060 2023-10-09T06:27:13.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.276+0000 7f9a8c848700 1 -- 172.21.15.31:0/2319797347 >> v1:172.21.15.158:6789/0 conn(0x7f9a8815a030 legacy=0x7f9a880b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.276+0000 7f9a877fe700 1 -- 172.21.15.31:0/2319797347 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3626431897 0 0) 0x7f9a74003570 con 0x7f9a8806a060 2023-10-09T06:27:13.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.276+0000 7f9a8c848700 1 -- 172.21.15.31:0/2319797347 >> v1:172.21.15.31:6789/0 conn(0x7f9a8806a060 legacy=0x7f9a880ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.276+0000 7f9a8c848700 1 -- 172.21.15.31:0/2319797347 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a880695f0 con 0x7f9a88159c60 2023-10-09T06:27:13.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.277+0000 7f9a8c848700 1 --2- 172.21.15.31:0/2319797347 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a88159c60 0x7f9a8815ae30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009e60 tx=0x7f9a80009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8811b86a66b7898 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:13.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.277+0000 7f9a877fe700 1 -- 172.21.15.31:0/2319797347 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8000e070 con 0x7f9a88159c60 2023-10-09T06:27:13.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.277+0000 7f9a877fe700 1 -- 172.21.15.31:0/2319797347 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8000b850 con 0x7f9a88159c60 2023-10-09T06:27:13.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.277+0000 7f9a877fe700 1 -- 172.21.15.31:0/2319797347 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78001470 con 0x7f9a88159c60 2023-10-09T06:27:13.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.277+0000 7f9a8d84a700 1 -- 172.21.15.31:0/2319797347 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a88159c60 msgr2=0x7f9a8815ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.277+0000 7f9a8d84a700 1 --2- 172.21.15.31:0/2319797347 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a88159c60 0x7f9a8815ae30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009e60 tx=0x7f9a80009780 comp rx=0 tx=0).stop 2023-10-09T06:27:13.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.277+0000 7f9a8d84a700 1 -- 172.21.15.31:0/2319797347 shutdown_connections 2023-10-09T06:27:13.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.277+0000 7f9a8d84a700 1 --2- 172.21.15.31:0/2319797347 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a88159c60 0x7f9a8815ae30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.277+0000 7f9a8d84a700 1 -- 172.21.15.31:0/2319797347 >> 172.21.15.31:0/2319797347 conn(0x7f9a8806c740 msgr2=0x7f9a88069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:13.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.277+0000 7f9a8d84a700 1 -- 172.21.15.31:0/2319797347 shutdown_connections 2023-10-09T06:27:13.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.277+0000 7f9a8d84a700 1 -- 172.21.15.31:0/2319797347 wait complete. 2023-10-09T06:27:13.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.279+0000 7f9a8d84a700 1 Processor -- start 2023-10-09T06:27:13.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.279+0000 7f9a8d84a700 1 -- start start 2023-10-09T06:27:13.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.279+0000 7f9a8d84a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a8806a060 0x7f9a880b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:13.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.279+0000 7f9a8d84a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a88159c60 0x7f9a88154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:13.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.279+0000 7f9a8d84a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a8815a030 0x7f9a8816b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:13.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.279+0000 7f9a8d84a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a88155220 con 0x7f9a8815a030 2023-10-09T06:27:13.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.279+0000 7f9a8d84a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8816a500 con 0x7f9a8806a060 2023-10-09T06:27:13.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.279+0000 7f9a8d84a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a880b2c60 con 0x7f9a88159c60 2023-10-09T06:27:13.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a8d049700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a8815a030 0x7f9a8816b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:13.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a8d049700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a8815a030 0x7f9a8816b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39684/0 (socket says 172.21.15.31:39684) 2023-10-09T06:27:13.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a8d049700 1 -- 172.21.15.31:0/1988056057 learned_addr learned my addr 172.21.15.31:0/1988056057 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:13.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a8c848700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a8806a060 0x7f9a880b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:13.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a87fff700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a88159c60 0x7f9a88154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:13.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a8d049700 1 -- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a88159c60 msgr2=0x7f9a88154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a8d049700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a88159c60 0x7f9a88154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a8d049700 1 -- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a8806a060 msgr2=0x7f9a880b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a8d049700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a8806a060 0x7f9a880b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a8d049700 1 -- 172.21.15.31:0/1988056057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80009a20 con 0x7f9a8815a030 2023-10-09T06:27:13.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a8d049700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a8815a030 0x7f9a8816b6e0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000c560 tx=0x7f9a70007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:13.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a84ff9700 1 -- 172.21.15.31:0/1988056057 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70011590 con 0x7f9a8815a030 2023-10-09T06:27:13.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a84ff9700 1 -- 172.21.15.31:0/1988056057 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a700116f0 con 0x7f9a8815a030 2023-10-09T06:27:13.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a8d84a700 1 -- 172.21.15.31:0/1988056057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a880b2f40 con 0x7f9a8815a030 2023-10-09T06:27:13.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a84ff9700 1 -- 172.21.15.31:0/1988056057 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70011ab0 con 0x7f9a8815a030 2023-10-09T06:27:13.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.280+0000 7f9a8d84a700 1 -- 172.21.15.31:0/1988056057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a880b3500 con 0x7f9a8815a030 2023-10-09T06:27:13.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.281+0000 7f9a8d84a700 1 -- 172.21.15.31:0/1988056057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8816a730 con 0x7f9a8815a030 2023-10-09T06:27:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.282+0000 7f9a84ff9700 1 -- 172.21.15.31:0/1988056057 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a7001b3b0 con 0x7f9a8815a030 2023-10-09T06:27:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.282+0000 7f9a84ff9700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9a68066f30 0x7f9a680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.282+0000 7f9a84ff9700 1 -- 172.21.15.31:0/1988056057 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a70083a50 con 0x7f9a8815a030 2023-10-09T06:27:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.282+0000 7f9a8c848700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9a68066f30 0x7f9a680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:13.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.283+0000 7f9a8c848700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9a68066f30 0x7f9a680693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9a800099f0 tx=0x7f9a80017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:13.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.286+0000 7f9a84ff9700 1 -- 172.21.15.31:0/1988056057 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a70050cc0 con 0x7f9a8815a030 2023-10-09T06:27:13.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.474+0000 7f9a8d84a700 1 -- 172.21.15.31:0/1988056057 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a8804bb80 con 0x7f9a68066f30 2023-10-09T06:27:13.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.483+0000 7f9a84ff9700 1 -- 172.21.15.31:0/1988056057 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285379 (secure 0 0 0) 0x7f9a8804bb80 con 0x7f9a68066f30 2023-10-09T06:27:13.487 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:13.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.486+0000 7f9a8d84a700 1 -- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9a68066f30 msgr2=0x7f9a680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.486+0000 7f9a8d84a700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9a68066f30 0x7f9a680693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9a800099f0 tx=0x7f9a80017000 comp rx=0 tx=0).stop 2023-10-09T06:27:13.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.486+0000 7f9a8d84a700 1 -- 172.21.15.31:0/1988056057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a8815a030 msgr2=0x7f9a8816b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.486+0000 7f9a8d84a700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a8815a030 0x7f9a8816b6e0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000c560 tx=0x7f9a70007ef0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.486+0000 7f9a8d84a700 1 -- 172.21.15.31:0/1988056057 shutdown_connections 2023-10-09T06:27:13.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.486+0000 7f9a8d84a700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9a68066f30 0x7f9a680693e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.486+0000 7f9a8d84a700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a8815a030 0x7f9a8816b6e0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.486+0000 7f9a8d84a700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a8806a060 0x7f9a880b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.486+0000 7f9a8d84a700 1 --2- 172.21.15.31:0/1988056057 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9a88159c60 0x7f9a88154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.486+0000 7f9a8d84a700 1 -- 172.21.15.31:0/1988056057 >> 172.21.15.31:0/1988056057 conn(0x7f9a8806c740 msgr2=0x7f9a880683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:13.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.487+0000 7f9a8d84a700 1 -- 172.21.15.31:0/1988056057 shutdown_connections 2023-10-09T06:27:13.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.487+0000 7f9a8d84a700 1 -- 172.21.15.31:0/1988056057 wait complete. 2023-10-09T06:27:13.490 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:27:13.499 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2023-10-09T06:27:12.608092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6939,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555560,"statfs":{"total":1600000000,"available":1592894030,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001448"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.391475+0000","last_change":"2023-10-09T06:27:08.391475+0000","last_active":"2023-10-09T06:27:08.391475+0000","last_peered":"2023-10-09T06:27:08.391475+0000","last_clean":"2023-10-09T06:27:08.391475+0000","last_became_active":"2023-10-09T06:27:08.390379+0000","last_became_peered":"2023-10-09T06:27:08.390379+0000","last_unstale":"2023-10-09T06:27:08.391475+0000","last_undegraded":"2023-10-09T06:27:08.391475+0000","last_fullsized":"2023-10-09T06:27:08.391475+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:20.700634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.393693+0000","last_change":"2023-10-09T06:27:08.393693+0000","last_active":"2023-10-09T06:27:08.393693+0000","last_peered":"2023-10-09T06:27:08.393693+0000","last_clean":"2023-10-09T06:27:08.393693+0000","last_became_active":"2023-10-09T06:27:08.393301+0000","last_became_peered":"2023-10-09T06:27:08.393301+0000","last_unstale":"2023-10-09T06:27:08.393693+0000","last_undegraded":"2023-10-09T06:27:08.393693+0000","last_fullsized":"2023-10-09T06:27:08.393693+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:27:36.915461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.381882+0000","last_change":"2023-10-09T06:27:08.381882+0000","last_active":"2023-10-09T06:27:08.381882+0000","last_peered":"2023-10-09T06:27:08.381882+0000","last_clean":"2023-10-09T06:27:08.381882+0000","last_became_active":"2023-10-09T06:27:08.381500+0000","last_became_peered":"2023-10-09T06:27:08.381500+0000","last_unstale":"2023-10-09T06:27:08.381882+0000","last_undegraded":"2023-10-09T06:27:08.381882+0000","last_fullsized":"2023-10-09T06:27:08.381882+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:39.209987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.389229+0000","last_change":"2023-10-09T06:27:08.389229+0000","last_active":"2023-10-09T06:27:08.389229+0000","last_peered":"2023-10-09T06:27:08.389229+0000","last_clean":"2023-10-09T06:27:08.389229+0000","last_became_active":"2023-10-09T06:27:08.387183+0000","last_became_peered":"2023-10-09T06:27:08.387183+0000","last_unstale":"2023-10-09T06:27:08.389229+0000","last_undegraded":"2023-10-09T06:27:08.389229+0000","last_fullsized":"2023-10-09T06:27:08.389229+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:59:49.295571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.395739+0000","last_change":"2023-10-09T06:27:08.395739+0000","last_active":"2023-10-09T06:27:08.395739+0000","last_peered":"2023-10-09T06:27:08.395739+0000","last_clean":"2023-10-09T06:27:08.395739+0000","last_became_active":"2023-10-09T06:27:08.395521+0000","last_became_peered":"2023-10-09T06:27:08.395521+0000","last_unstale":"2023-10-09T06:27:08.395739+0000","last_undegraded":"2023-10-09T06:27:08.395739+0000","last_fullsized":"2023-10-09T06:27:08.395739+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:11.534338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.383442+0000","last_change":"2023-10-09T06:27:08.383442+0000","last_active":"2023-10-09T06:27:08.383442+0000","last_peered":"2023-10-09T06:27:08.383442+0000","last_clean":"2023-10-09T06:27:08.383442+0000","last_became_active":"2023-10-09T06:27:08.383081+0000","last_became_peered":"2023-10-09T06:27:08.383081+0000","last_unstale":"2023-10-09T06:27:08.383442+0000","last_undegraded":"2023-10-09T06:27:08.383442+0000","last_fullsized":"2023-10-09T06:27:08.383442+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:16.768230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384272+0000","last_change":"2023-10-09T06:27:08.384272+0000","last_active":"2023-10-09T06:27:08.384272+0000","last_peered":"2023-10-09T06:27:08.384272+0000","last_clean":"2023-10-09T06:27:08.384272+0000","last_became_active":"2023-10-09T06:27:08.383857+0000","last_became_peered":"2023-10-09T06:27:08.383857+0000","last_unstale":"2023-10-09T06:27:08.384272+0000","last_undegraded":"2023-10-09T06:27:08.384272+0000","last_fullsized":"2023-10-09T06:27:08.384272+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:51.105470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.388457+0000","last_change":"2023-10-09T06:27:08.388457+0000","last_active":"2023-10-09T06:27:08.388457+0000","last_peered":"2023-10-09T06:27:08.388457+0000","last_clean":"2023-10-09T06:27:08.388457+0000","last_became_active":"2023-10-09T06:27:08.387753+0000","last_became_peered":"2023-10-09T06:27:08.387753+0000","last_unstale":"2023-10-09T06:27:08.388457+0000","last_undegraded":"2023-10-09T06:27:08.388457+0000","last_fullsized":"2023-10-09T06:27:08.388457+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:29.638984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.391784+0000","last_change":"2023-10-09T06:27:08.391784+0000","last_active":"2023-10-09T06:27:08.391784+0000","last_peered":"2023-10-09T06:27:08.391784+0000","last_clean":"2023-10-09T06:27:08.391784+0000","last_became_active":"2023-10-09T06:27:08.391541+0000","last_became_peered":"2023-10-09T06:27:08.391541+0000","last_unstale":"2023-10-09T06:27:08.391784+0000","last_undegraded":"2023-10-09T06:27:08.391784+0000","last_fullsized":"2023-10-09T06:27:08.391784+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:23:02.619560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.390166+0000","last_change":"2023-10-09T06:27:08.390166+0000","last_active":"2023-10-09T06:27:08.390166+0000","last_peered":"2023-10-09T06:27:08.390166+0000","last_clean":"2023-10-09T06:27:08.390166+0000","last_became_active":"2023-10-09T06:27:08.389918+0000","last_became_peered":"2023-10-09T06:27:08.389918+0000","last_unstale":"2023-10-09T06:27:08.390166+0000","last_undegraded":"2023-10-09T06:27:08.390166+0000","last_fullsized":"2023-10-09T06:27:08.390166+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:51:43.122022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.378751+0000","last_change":"2023-10-09T06:27:08.378751+0000","last_active":"2023-10-09T06:27:08.378751+0000","last_peered":"2023-10-09T06:27:08.378751+0000","last_clean":"2023-10-09T06:27:08.378751+0000","last_became_active":"2023-10-09T06:27:08.378525+0000","last_became_peered":"2023-10-09T06:27:08.378525+0000","last_unstale":"2023-10-09T06:27:08.378751+0000","last_undegraded":"2023-10-09T06:27:08.378751+0000","last_fullsized":"2023-10-09T06:27:08.378751+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:17.672729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.390244+0000","last_change":"2023-10-09T06:27:08.390244+0000","last_active":"2023-10-09T06:27:08.390244+0000","last_peered":"2023-10-09T06:27:08.390244+0000","last_clean":"2023-10-09T06:27:08.390244+0000","last_became_active":"2023-10-09T06:27:08.389809+0000","last_became_peered":"2023-10-09T06:27:08.389809+0000","last_unstale":"2023-10-09T06:27:08.390244+0000","last_undegraded":"2023-10-09T06:27:08.390244+0000","last_fullsized":"2023-10-09T06:27:08.390244+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:27.357574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.389032+0000","last_change":"2023-10-09T06:27:08.389032+0000","last_active":"2023-10-09T06:27:08.389032+0000","last_peered":"2023-10-09T06:27:08.389032+0000","last_clean":"2023-10-09T06:27:08.389032+0000","last_became_active":"2023-10-09T06:27:08.388803+0000","last_became_peered":"2023-10-09T06:27:08.388803+0000","last_unstale":"2023-10-09T06:27:08.389032+0000","last_undegraded":"2023-10-09T06:27:08.389032+0000","last_fullsized":"2023-10-09T06:27:08.389032+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:20.162647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384799+0000","last_change":"2023-10-09T06:27:08.384799+0000","last_active":"2023-10-09T06:27:08.384799+0000","last_peered":"2023-10-09T06:27:08.384799+0000","last_clean":"2023-10-09T06:27:08.384799+0000","last_became_active":"2023-10-09T06:27:08.384055+0000","last_became_peered":"2023-10-09T06:27:08.384055+0000","last_unstale":"2023-10-09T06:27:08.384799+0000","last_undegraded":"2023-10-09T06:27:08.384799+0000","last_fullsized":"2023-10-09T06:27:08.384799+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:41.346115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.397880+0000","last_change":"2023-10-09T06:27:08.397880+0000","last_active":"2023-10-09T06:27:08.397880+0000","last_peered":"2023-10-09T06:27:08.397880+0000","last_clean":"2023-10-09T06:27:08.397880+0000","last_became_active":"2023-10-09T06:27:08.397375+0000","last_became_peered":"2023-10-09T06:27:08.397375+0000","last_unstale":"2023-10-09T06:27:08.397880+0000","last_undegraded":"2023-10-09T06:27:08.397880+0000","last_fullsized":"2023-10-09T06:27:08.397880+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:48.331541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.391692+0000","last_change":"2023-10-09T06:27:08.391692+0000","last_active":"2023-10-09T06:27:08.391692+0000","last_peered":"2023-10-09T06:27:08.391692+0000","last_clean":"2023-10-09T06:27:08.391692+0000","last_became_active":"2023-10-09T06:27:08.390732+0000","last_became_peered":"2023-10-09T06:27:08.390732+0000","last_unstale":"2023-10-09T06:27:08.391692+0000","last_undegraded":"2023-10-09T06:27:08.391692+0000","last_fullsized":"2023-10-09T06:27:08.391692+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:27:05.515914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.377058+0000","last_change":"2023-10-09T06:27:08.377058+0000","last_active":"2023-10-09T06:27:08.377058+0000","last_peered":"2023-10-09T06:27:08.377058+0000","last_clean":"2023-10-09T06:27:08.377058+0000","last_became_active":"2023-10-09T06:27:08.376804+0000","last_became_peered":"2023-10-09T06:27:08.376804+0000","last_unstale":"2023-10-09T06:27:08.377058+0000","last_undegraded":"2023-10-09T06:27:08.377058+0000","last_fullsized":"2023-10-09T06:27:08.377058+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:58:51.451073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.377086+0000","last_change":"2023-10-09T06:27:08.377086+0000","last_active":"2023-10-09T06:27:08.377086+0000","last_peered":"2023-10-09T06:27:08.377086+0000","last_clean":"2023-10-09T06:27:08.377086+0000","last_became_active":"2023-10-09T06:27:08.376842+0000","last_became_peered":"2023-10-09T06:27:08.376842+0000","last_unstale":"2023-10-09T06:27:08.377086+0000","last_undegraded":"2023-10-09T06:27:08.377086+0000","last_fullsized":"2023-10-09T06:27:08.377086+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:45:24.125420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384303+0000","last_change":"2023-10-09T06:27:08.384303+0000","last_active":"2023-10-09T06:27:08.384303+0000","last_peered":"2023-10-09T06:27:08.384303+0000","last_clean":"2023-10-09T06:27:08.384303+0000","last_became_active":"2023-10-09T06:27:08.382706+0000","last_became_peered":"2023-10-09T06:27:08.382706+0000","last_unstale":"2023-10-09T06:27:08.384303+0000","last_undegraded":"2023-10-09T06:27:08.384303+0000","last_fullsized":"2023-10-09T06:27:08.384303+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:10:00.732431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.381975+0000","last_change":"2023-10-09T06:27:08.381975+0000","last_active":"2023-10-09T06:27:08.381975+0000","last_peered":"2023-10-09T06:27:08.381975+0000","last_clean":"2023-10-09T06:27:08.381975+0000","last_became_active":"2023-10-09T06:27:08.381733+0000","last_became_peered":"2023-10-09T06:27:08.381733+0000","last_unstale":"2023-10-09T06:27:08.381975+0000","last_undegraded":"2023-10-09T06:27:08.381975+0000","last_fullsized":"2023-10-09T06:27:08.381975+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:45:24.125420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.386672+0000","last_change":"2023-10-09T06:27:08.386672+0000","last_active":"2023-10-09T06:27:08.386672+0000","last_peered":"2023-10-09T06:27:08.386672+0000","last_clean":"2023-10-09T06:27:08.386672+0000","last_became_active":"2023-10-09T06:27:08.386475+0000","last_became_peered":"2023-10-09T06:27:08.386475+0000","last_unstale":"2023-10-09T06:27:08.386672+0000","last_undegraded":"2023-10-09T06:27:08.386672+0000","last_fullsized":"2023-10-09T06:27:08.386672+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:36.473523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.394227+0000","last_change":"2023-10-09T06:27:08.394227+0000","last_active":"2023-10-09T06:27:08.394227+0000","last_peered":"2023-10-09T06:27:08.394227+0000","last_clean":"2023-10-09T06:27:08.394227+0000","last_became_active":"2023-10-09T06:27:08.389743+0000","last_became_peered":"2023-10-09T06:27:08.389743+0000","last_unstale":"2023-10-09T06:27:08.394227+0000","last_undegraded":"2023-10-09T06:27:08.394227+0000","last_fullsized":"2023-10-09T06:27:08.394227+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:20.162647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.380650+0000","last_change":"2023-10-09T06:27:08.380650+0000","last_active":"2023-10-09T06:27:08.380650+0000","last_peered":"2023-10-09T06:27:08.380650+0000","last_clean":"2023-10-09T06:27:08.380650+0000","last_became_active":"2023-10-09T06:27:08.380371+0000","last_became_peered":"2023-10-09T06:27:08.380371+0000","last_unstale":"2023-10-09T06:27:08.380650+0000","last_undegraded":"2023-10-09T06:27:08.380650+0000","last_fullsized":"2023-10-09T06:27:08.380650+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:33:05.093021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.389967+0000","last_change":"2023-10-09T06:27:08.389967+0000","last_active":"2023-10-09T06:27:08.389967+0000","last_peered":"2023-10-09T06:27:08.389967+0000","last_clean":"2023-10-09T06:27:08.389967+0000","last_became_active":"2023-10-09T06:27:08.389339+0000","last_became_peered":"2023-10-09T06:27:08.389339+0000","last_unstale":"2023-10-09T06:27:08.389967+0000","last_undegraded":"2023-10-09T06:27:08.389967+0000","last_fullsized":"2023-10-09T06:27:08.389967+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:03.479306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.377133+0000","last_change":"2023-10-09T06:27:08.377133+0000","last_active":"2023-10-09T06:27:08.377133+0000","last_peered":"2023-10-09T06:27:08.377133+0000","last_clean":"2023-10-09T06:27:08.377133+0000","last_became_active":"2023-10-09T06:27:08.376905+0000","last_became_peered":"2023-10-09T06:27:08.376905+0000","last_unstale":"2023-10-09T06:27:08.377133+0000","last_undegraded":"2023-10-09T06:27:08.377133+0000","last_fullsized":"2023-10-09T06:27:08.377133+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:19.955023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.392191+0000","last_change":"2023-10-09T06:27:08.392191+0000","last_active":"2023-10-09T06:27:08.392191+0000","last_peered":"2023-10-09T06:27:08.392191+0000","last_clean":"2023-10-09T06:27:08.392191+0000","last_became_active":"2023-10-09T06:27:08.391245+0000","last_became_peered":"2023-10-09T06:27:08.391245+0000","last_unstale":"2023-10-09T06:27:08.392191+0000","last_undegraded":"2023-10-09T06:27:08.392191+0000","last_fullsized":"2023-10-09T06:27:08.392191+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:05:34.657942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.396493+0000","last_change":"2023-10-09T06:27:08.396493+0000","last_active":"2023-10-09T06:27:08.396493+0000","last_peered":"2023-10-09T06:27:08.396493+0000","last_clean":"2023-10-09T06:27:08.396493+0000","last_became_active":"2023-10-09T06:27:08.395860+0000","last_became_peered":"2023-10-09T06:27:08.395860+0000","last_unstale":"2023-10-09T06:27:08.396493+0000","last_undegraded":"2023-10-09T06:27:08.396493+0000","last_fullsized":"2023-10-09T06:27:08.396493+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:44:42.982062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.396399+0000","last_change":"2023-10-09T06:27:08.396399+0000","last_active":"2023-10-09T06:27:08.396399+0000","last_peered":"2023-10-09T06:27:08.396399+0000","last_clean":"2023-10-09T06:27:08.396399+0000","last_became_active":"2023-10-09T06:27:08.395975+0000","last_became_peered":"2023-10-09T06:27:08.395975+0000","last_unstale":"2023-10-09T06:27:08.396399+0000","last_undegraded":"2023-10-09T06:27:08.396399+0000","last_fullsized":"2023-10-09T06:27:08.396399+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:29.638984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.381621+0000","last_change":"2023-10-09T06:27:08.381621+0000","last_active":"2023-10-09T06:27:08.381621+0000","last_peered":"2023-10-09T06:27:08.381621+0000","last_clean":"2023-10-09T06:27:08.381621+0000","last_became_active":"2023-10-09T06:27:08.381375+0000","last_became_peered":"2023-10-09T06:27:08.381375+0000","last_unstale":"2023-10-09T06:27:08.381621+0000","last_undegraded":"2023-10-09T06:27:08.381621+0000","last_fullsized":"2023-10-09T06:27:08.381621+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:29.093514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.397460+0000","last_change":"2023-10-09T06:27:08.397460+0000","last_active":"2023-10-09T06:27:08.397460+0000","last_peered":"2023-10-09T06:27:08.397460+0000","last_clean":"2023-10-09T06:27:08.397460+0000","last_became_active":"2023-10-09T06:27:08.397253+0000","last_became_peered":"2023-10-09T06:27:08.397253+0000","last_unstale":"2023-10-09T06:27:08.397460+0000","last_undegraded":"2023-10-09T06:27:08.397460+0000","last_fullsized":"2023-10-09T06:27:08.397460+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:47.500660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.391903+0000","last_change":"2023-10-09T06:27:08.391903+0000","last_active":"2023-10-09T06:27:08.391903+0000","last_peered":"2023-10-09T06:27:08.391903+0000","last_clean":"2023-10-09T06:27:08.391903+0000","last_became_active":"2023-10-09T06:27:08.391009+0000","last_became_peered":"2023-10-09T06:27:08.391009+0000","last_unstale":"2023-10-09T06:27:08.391903+0000","last_undegraded":"2023-10-09T06:27:08.391903+0000","last_fullsized":"2023-10-09T06:27:08.391903+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:01:59.752470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.390922+0000","last_change":"2023-10-09T06:27:08.390922+0000","last_active":"2023-10-09T06:27:08.390922+0000","last_peered":"2023-10-09T06:27:08.390922+0000","last_clean":"2023-10-09T06:27:08.390922+0000","last_became_active":"2023-10-09T06:27:08.390693+0000","last_became_peered":"2023-10-09T06:27:08.390693+0000","last_unstale":"2023-10-09T06:27:08.390922+0000","last_undegraded":"2023-10-09T06:27:08.390922+0000","last_fullsized":"2023-10-09T06:27:08.390922+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:15.398265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.389139+0000","last_change":"2023-10-09T06:27:08.389139+0000","last_active":"2023-10-09T06:27:08.389139+0000","last_peered":"2023-10-09T06:27:08.389139+0000","last_clean":"2023-10-09T06:27:08.389139+0000","last_became_active":"2023-10-09T06:27:08.388927+0000","last_became_peered":"2023-10-09T06:27:08.388927+0000","last_unstale":"2023-10-09T06:27:08.389139+0000","last_undegraded":"2023-10-09T06:27:08.389139+0000","last_fullsized":"2023-10-09T06:27:08.389139+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:25.305619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"135'4","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.388570+0000","last_change":"2023-10-09T06:27:07.379275+0000","last_active":"2023-10-09T06:27:08.388570+0000","last_peered":"2023-10-09T06:27:08.388570+0000","last_clean":"2023-10-09T06:27:08.388570+0000","last_became_active":"2023-10-09T06:27:07.378947+0000","last_became_peered":"2023-10-09T06:27:07.378947+0000","last_unstale":"2023-10-09T06:27:08.388570+0000","last_undegraded":"2023-10-09T06:27:08.388570+0000","last_fullsized":"2023-10-09T06:27:08.388570+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:47.326557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.380192+0000","last_change":"2023-10-09T06:27:08.380192+0000","last_active":"2023-10-09T06:27:08.380192+0000","last_peered":"2023-10-09T06:27:08.380192+0000","last_clean":"2023-10-09T06:27:08.380192+0000","last_became_active":"2023-10-09T06:27:08.379964+0000","last_became_peered":"2023-10-09T06:27:08.379964+0000","last_unstale":"2023-10-09T06:27:08.380192+0000","last_undegraded":"2023-10-09T06:27:08.380192+0000","last_fullsized":"2023-10-09T06:27:08.380192+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:29.093514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"135'1","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.377610+0000","last_change":"2023-10-09T06:27:07.380723+0000","last_active":"2023-10-09T06:27:08.377610+0000","last_peered":"2023-10-09T06:27:08.377610+0000","last_clean":"2023-10-09T06:27:08.377610+0000","last_became_active":"2023-10-09T06:27:07.380503+0000","last_became_peered":"2023-10-09T06:27:07.380503+0000","last_unstale":"2023-10-09T06:27:08.377610+0000","last_undegraded":"2023-10-09T06:27:08.377610+0000","last_fullsized":"2023-10-09T06:27:08.377610+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:58:45.581064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.383289+0000","last_change":"2023-10-09T06:27:08.383289+0000","last_active":"2023-10-09T06:27:08.383289+0000","last_peered":"2023-10-09T06:27:08.383289+0000","last_clean":"2023-10-09T06:27:08.383289+0000","last_became_active":"2023-10-09T06:27:08.382801+0000","last_became_peered":"2023-10-09T06:27:08.382801+0000","last_unstale":"2023-10-09T06:27:08.383289+0000","last_undegraded":"2023-10-09T06:27:08.383289+0000","last_fullsized":"2023-10-09T06:27:08.383289+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:55.943136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"135'2","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.395175+0000","last_change":"2023-10-09T06:27:07.384567+0000","last_active":"2023-10-09T06:27:08.395175+0000","last_peered":"2023-10-09T06:27:08.395175+0000","last_clean":"2023-10-09T06:27:08.395175+0000","last_became_active":"2023-10-09T06:27:07.383921+0000","last_became_peered":"2023-10-09T06:27:07.383921+0000","last_unstale":"2023-10-09T06:27:08.395175+0000","last_undegraded":"2023-10-09T06:27:08.395175+0000","last_fullsized":"2023-10-09T06:27:08.395175+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:59:11.638276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.380320+0000","last_change":"2023-10-09T06:27:08.380320+0000","last_active":"2023-10-09T06:27:08.380320+0000","last_peered":"2023-10-09T06:27:08.380320+0000","last_clean":"2023-10-09T06:27:08.380320+0000","last_became_active":"2023-10-09T06:27:08.380021+0000","last_became_peered":"2023-10-09T06:27:08.380021+0000","last_unstale":"2023-10-09T06:27:08.380320+0000","last_undegraded":"2023-10-09T06:27:08.380320+0000","last_fullsized":"2023-10-09T06:27:08.380320+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:10.473419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"135'2","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.393083+0000","last_change":"2023-10-09T06:27:07.380711+0000","last_active":"2023-10-09T06:27:08.393083+0000","last_peered":"2023-10-09T06:27:08.393083+0000","last_clean":"2023-10-09T06:27:08.393083+0000","last_became_active":"2023-10-09T06:27:07.380359+0000","last_became_peered":"2023-10-09T06:27:07.380359+0000","last_unstale":"2023-10-09T06:27:08.393083+0000","last_undegraded":"2023-10-09T06:27:08.393083+0000","last_fullsized":"2023-10-09T06:27:08.393083+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:34:48.181739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.395930+0000","last_change":"2023-10-09T06:27:08.395930+0000","last_active":"2023-10-09T06:27:08.395930+0000","last_peered":"2023-10-09T06:27:08.395930+0000","last_clean":"2023-10-09T06:27:08.395930+0000","last_became_active":"2023-10-09T06:27:08.395715+0000","last_became_peered":"2023-10-09T06:27:08.395715+0000","last_unstale":"2023-10-09T06:27:08.395930+0000","last_undegraded":"2023-10-09T06:27:08.395930+0000","last_fullsized":"2023-10-09T06:27:08.395930+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:24.349154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"135'1","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.382514+0000","last_change":"2023-10-09T06:27:07.380625+0000","last_active":"2023-10-09T06:27:08.382514+0000","last_peered":"2023-10-09T06:27:08.382514+0000","last_clean":"2023-10-09T06:27:08.382514+0000","last_became_active":"2023-10-09T06:27:07.380390+0000","last_became_peered":"2023-10-09T06:27:07.380390+0000","last_unstale":"2023-10-09T06:27:08.382514+0000","last_undegraded":"2023-10-09T06:27:08.382514+0000","last_fullsized":"2023-10-09T06:27:08.382514+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:15.763246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.393549+0000","last_change":"2023-10-09T06:27:08.393549+0000","last_active":"2023-10-09T06:27:08.393549+0000","last_peered":"2023-10-09T06:27:08.393549+0000","last_clean":"2023-10-09T06:27:08.393549+0000","last_became_active":"2023-10-09T06:27:08.392994+0000","last_became_peered":"2023-10-09T06:27:08.392994+0000","last_unstale":"2023-10-09T06:27:08.393549+0000","last_undegraded":"2023-10-09T06:27:08.393549+0000","last_fullsized":"2023-10-09T06:27:08.393549+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:13.127385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"135'1","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.380017+0000","last_change":"2023-10-09T06:27:07.381771+0000","last_active":"2023-10-09T06:27:08.380017+0000","last_peered":"2023-10-09T06:27:08.380017+0000","last_clean":"2023-10-09T06:27:08.380017+0000","last_became_active":"2023-10-09T06:27:07.381498+0000","last_became_peered":"2023-10-09T06:27:07.381498+0000","last_unstale":"2023-10-09T06:27:08.380017+0000","last_undegraded":"2023-10-09T06:27:08.380017+0000","last_fullsized":"2023-10-09T06:27:08.380017+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:45:23.838601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.393607+0000","last_change":"2023-10-09T06:27:08.393607+0000","last_active":"2023-10-09T06:27:08.393607+0000","last_peered":"2023-10-09T06:27:08.393607+0000","last_clean":"2023-10-09T06:27:08.393607+0000","last_became_active":"2023-10-09T06:27:08.393330+0000","last_became_peered":"2023-10-09T06:27:08.393330+0000","last_unstale":"2023-10-09T06:27:08.393607+0000","last_undegraded":"2023-10-09T06:27:08.393607+0000","last_fullsized":"2023-10-09T06:27:08.393607+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:31.578252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.379937+0000","last_change":"2023-10-09T06:27:07.379863+0000","last_active":"2023-10-09T06:27:07.379937+0000","last_peered":"2023-10-09T06:27:07.379937+0000","last_clean":"2023-10-09T06:27:07.379937+0000","last_became_active":"2023-10-09T06:27:07.379613+0000","last_became_peered":"2023-10-09T06:27:07.379613+0000","last_unstale":"2023-10-09T06:27:07.379937+0000","last_undegraded":"2023-10-09T06:27:07.379937+0000","last_fullsized":"2023-10-09T06:27:07.379937+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:04.222808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.382929+0000","last_change":"2023-10-09T06:27:08.382929+0000","last_active":"2023-10-09T06:27:08.382929+0000","last_peered":"2023-10-09T06:27:08.382929+0000","last_clean":"2023-10-09T06:27:08.382929+0000","last_became_active":"2023-10-09T06:27:08.382313+0000","last_became_peered":"2023-10-09T06:27:08.382313+0000","last_unstale":"2023-10-09T06:27:08.382929+0000","last_undegraded":"2023-10-09T06:27:08.382929+0000","last_fullsized":"2023-10-09T06:27:08.382929+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:36:29.756527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.381654+0000","last_change":"2023-10-09T06:27:07.381534+0000","last_active":"2023-10-09T06:27:07.381654+0000","last_peered":"2023-10-09T06:27:07.381654+0000","last_clean":"2023-10-09T06:27:07.381654+0000","last_became_active":"2023-10-09T06:27:07.381049+0000","last_became_peered":"2023-10-09T06:27:07.381049+0000","last_unstale":"2023-10-09T06:27:07.381654+0000","last_undegraded":"2023-10-09T06:27:07.381654+0000","last_fullsized":"2023-10-09T06:27:07.381654+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:27.481425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384116+0000","last_change":"2023-10-09T06:27:08.384116+0000","last_active":"2023-10-09T06:27:08.384116+0000","last_peered":"2023-10-09T06:27:08.384116+0000","last_clean":"2023-10-09T06:27:08.384116+0000","last_became_active":"2023-10-09T06:27:08.383408+0000","last_became_peered":"2023-10-09T06:27:08.383408+0000","last_unstale":"2023-10-09T06:27:08.384116+0000","last_undegraded":"2023-10-09T06:27:08.384116+0000","last_fullsized":"2023-10-09T06:27:08.384116+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:05.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.380708+0000","last_change":"2023-10-09T06:27:07.380570+0000","last_active":"2023-10-09T06:27:07.380708+0000","last_peered":"2023-10-09T06:27:07.380708+0000","last_clean":"2023-10-09T06:27:07.380708+0000","last_became_active":"2023-10-09T06:27:07.380041+0000","last_became_peered":"2023-10-09T06:27:07.380041+0000","last_unstale":"2023-10-09T06:27:07.380708+0000","last_undegraded":"2023-10-09T06:27:07.380708+0000","last_fullsized":"2023-10-09T06:27:07.380708+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:33.350112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.391174+0000","last_change":"2023-10-09T06:27:08.391174+0000","last_active":"2023-10-09T06:27:08.391174+0000","last_peered":"2023-10-09T06:27:08.391174+0000","last_clean":"2023-10-09T06:27:08.391174+0000","last_became_active":"2023-10-09T06:27:08.391002+0000","last_became_peered":"2023-10-09T06:27:08.391002+0000","last_unstale":"2023-10-09T06:27:08.391174+0000","last_undegraded":"2023-10-09T06:27:08.391174+0000","last_fullsized":"2023-10-09T06:27:08.391174+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:17.672729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.379864+0000","last_change":"2023-10-09T06:27:07.379747+0000","last_active":"2023-10-09T06:27:07.379864+0000","last_peered":"2023-10-09T06:27:07.379864+0000","last_clean":"2023-10-09T06:27:07.379864+0000","last_became_active":"2023-10-09T06:27:07.379506+0000","last_became_peered":"2023-10-09T06:27:07.379506+0000","last_unstale":"2023-10-09T06:27:07.379864+0000","last_undegraded":"2023-10-09T06:27:07.379864+0000","last_fullsized":"2023-10-09T06:27:07.379864+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:39.062921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.394752+0000","last_change":"2023-10-09T06:27:08.394752+0000","last_active":"2023-10-09T06:27:08.394752+0000","last_peered":"2023-10-09T06:27:08.394752+0000","last_clean":"2023-10-09T06:27:08.394752+0000","last_became_active":"2023-10-09T06:27:08.389637+0000","last_became_peered":"2023-10-09T06:27:08.389637+0000","last_unstale":"2023-10-09T06:27:08.394752+0000","last_undegraded":"2023-10-09T06:27:08.394752+0000","last_fullsized":"2023-10-09T06:27:08.394752+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:10.473419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"135'3","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.401270+0000","last_change":"2023-10-09T06:27:07.382571+0000","last_active":"2023-10-09T06:27:08.401270+0000","last_peered":"2023-10-09T06:27:08.401270+0000","last_clean":"2023-10-09T06:27:08.401270+0000","last_became_active":"2023-10-09T06:27:07.381917+0000","last_became_peered":"2023-10-09T06:27:07.381917+0000","last_unstale":"2023-10-09T06:27:08.401270+0000","last_undegraded":"2023-10-09T06:27:08.401270+0000","last_fullsized":"2023-10-09T06:27:08.401270+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:44.335912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.381822+0000","last_change":"2023-10-09T06:27:08.381822+0000","last_active":"2023-10-09T06:27:08.381822+0000","last_peered":"2023-10-09T06:27:08.381822+0000","last_clean":"2023-10-09T06:27:08.381822+0000","last_became_active":"2023-10-09T06:27:08.381597+0000","last_became_peered":"2023-10-09T06:27:08.381597+0000","last_unstale":"2023-10-09T06:27:08.381822+0000","last_undegraded":"2023-10-09T06:27:08.381822+0000","last_fullsized":"2023-10-09T06:27:08.381822+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:28:47.933705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"135'6","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.400947+0000","last_change":"2023-10-09T06:27:07.383635+0000","last_active":"2023-10-09T06:27:08.400947+0000","last_peered":"2023-10-09T06:27:08.400947+0000","last_clean":"2023-10-09T06:27:08.400947+0000","last_became_active":"2023-10-09T06:27:07.382658+0000","last_became_peered":"2023-10-09T06:27:07.382658+0000","last_unstale":"2023-10-09T06:27:08.400947+0000","last_undegraded":"2023-10-09T06:27:08.400947+0000","last_fullsized":"2023-10-09T06:27:08.400947+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:27:35.910477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.382403+0000","last_change":"2023-10-09T06:27:08.382403+0000","last_active":"2023-10-09T06:27:08.382403+0000","last_peered":"2023-10-09T06:27:08.382403+0000","last_clean":"2023-10-09T06:27:08.382403+0000","last_became_active":"2023-10-09T06:27:08.382152+0000","last_became_peered":"2023-10-09T06:27:08.382152+0000","last_unstale":"2023-10-09T06:27:08.382403+0000","last_undegraded":"2023-10-09T06:27:08.382403+0000","last_fullsized":"2023-10-09T06:27:08.382403+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:39:31.069062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"135'2","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.397098+0000","last_change":"2023-10-09T06:27:07.382532+0000","last_active":"2023-10-09T06:27:08.397098+0000","last_peered":"2023-10-09T06:27:08.397098+0000","last_clean":"2023-10-09T06:27:08.397098+0000","last_became_active":"2023-10-09T06:27:07.382261+0000","last_became_peered":"2023-10-09T06:27:07.382261+0000","last_unstale":"2023-10-09T06:27:08.397098+0000","last_undegraded":"2023-10-09T06:27:08.397098+0000","last_fullsized":"2023-10-09T06:27:08.397098+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:59:11.638276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.394626+0000","last_change":"2023-10-09T06:27:08.394626+0000","last_active":"2023-10-09T06:27:08.394626+0000","last_peered":"2023-10-09T06:27:08.394626+0000","last_clean":"2023-10-09T06:27:08.394626+0000","last_became_active":"2023-10-09T06:27:08.393787+0000","last_became_peered":"2023-10-09T06:27:08.393787+0000","last_unstale":"2023-10-09T06:27:08.394626+0000","last_undegraded":"2023-10-09T06:27:08.394626+0000","last_fullsized":"2023-10-09T06:27:08.394626+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:41.346115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.383779+0000","last_change":"2023-10-09T06:27:07.383707+0000","last_active":"2023-10-09T06:27:07.383779+0000","last_peered":"2023-10-09T06:27:07.383779+0000","last_clean":"2023-10-09T06:27:07.383779+0000","last_became_active":"2023-10-09T06:27:07.383334+0000","last_became_peered":"2023-10-09T06:27:07.383334+0000","last_unstale":"2023-10-09T06:27:07.383779+0000","last_undegraded":"2023-10-09T06:27:07.383779+0000","last_fullsized":"2023-10-09T06:27:07.383779+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:58:45.581064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.394368+0000","last_change":"2023-10-09T06:27:08.394368+0000","last_active":"2023-10-09T06:27:08.394368+0000","last_peered":"2023-10-09T06:27:08.394368+0000","last_clean":"2023-10-09T06:27:08.394368+0000","last_became_active":"2023-10-09T06:27:08.390022+0000","last_became_peered":"2023-10-09T06:27:08.390022+0000","last_unstale":"2023-10-09T06:27:08.394368+0000","last_undegraded":"2023-10-09T06:27:08.394368+0000","last_fullsized":"2023-10-09T06:27:08.394368+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:18:43.616024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"135'8","reported_seq":17,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.398555+0000","last_change":"2023-10-09T06:27:07.383738+0000","last_active":"2023-10-09T06:27:08.398555+0000","last_peered":"2023-10-09T06:27:08.398555+0000","last_clean":"2023-10-09T06:27:08.398555+0000","last_became_active":"2023-10-09T06:27:07.383352+0000","last_became_peered":"2023-10-09T06:27:07.383352+0000","last_unstale":"2023-10-09T06:27:08.398555+0000","last_undegraded":"2023-10-09T06:27:08.398555+0000","last_fullsized":"2023-10-09T06:27:08.398555+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:04:30.599488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.391358+0000","last_change":"2023-10-09T06:27:08.391358+0000","last_active":"2023-10-09T06:27:08.391358+0000","last_peered":"2023-10-09T06:27:08.391358+0000","last_clean":"2023-10-09T06:27:08.391358+0000","last_became_active":"2023-10-09T06:27:08.390967+0000","last_became_peered":"2023-10-09T06:27:08.390967+0000","last_unstale":"2023-10-09T06:27:08.391358+0000","last_undegraded":"2023-10-09T06:27:08.391358+0000","last_fullsized":"2023-10-09T06:27:08.391358+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:55.782445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"135'1","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384315+0000","last_change":"2023-10-09T06:27:07.383910+0000","last_active":"2023-10-09T06:27:08.384315+0000","last_peered":"2023-10-09T06:27:08.384315+0000","last_clean":"2023-10-09T06:27:08.384315+0000","last_became_active":"2023-10-09T06:27:07.383289+0000","last_became_peered":"2023-10-09T06:27:07.383289+0000","last_unstale":"2023-10-09T06:27:08.384315+0000","last_undegraded":"2023-10-09T06:27:08.384315+0000","last_fullsized":"2023-10-09T06:27:08.384315+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:35.468539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.385802+0000","last_change":"2023-10-09T06:27:08.385802+0000","last_active":"2023-10-09T06:27:08.385802+0000","last_peered":"2023-10-09T06:27:08.385802+0000","last_clean":"2023-10-09T06:27:08.385802+0000","last_became_active":"2023-10-09T06:27:08.385569+0000","last_became_peered":"2023-10-09T06:27:08.385569+0000","last_unstale":"2023-10-09T06:27:08.385802+0000","last_undegraded":"2023-10-09T06:27:08.385802+0000","last_fullsized":"2023-10-09T06:27:08.385802+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:07:26.606672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"135'2","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.387604+0000","last_change":"2023-10-09T06:27:07.378519+0000","last_active":"2023-10-09T06:27:08.387604+0000","last_peered":"2023-10-09T06:27:08.387604+0000","last_clean":"2023-10-09T06:27:08.387604+0000","last_became_active":"2023-10-09T06:27:07.378287+0000","last_became_peered":"2023-10-09T06:27:07.378287+0000","last_unstale":"2023-10-09T06:27:08.387604+0000","last_undegraded":"2023-10-09T06:27:08.387604+0000","last_fullsized":"2023-10-09T06:27:08.387604+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:05.333297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.390094+0000","last_change":"2023-10-09T06:27:08.390094+0000","last_active":"2023-10-09T06:27:08.390094+0000","last_peered":"2023-10-09T06:27:08.390094+0000","last_clean":"2023-10-09T06:27:08.390094+0000","last_became_active":"2023-10-09T06:27:08.389869+0000","last_became_peered":"2023-10-09T06:27:08.389869+0000","last_unstale":"2023-10-09T06:27:08.390094+0000","last_undegraded":"2023-10-09T06:27:08.390094+0000","last_fullsized":"2023-10-09T06:27:08.390094+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:39:31.069062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"135'1","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.374768+0000","last_change":"2023-10-09T06:27:07.379721+0000","last_active":"2023-10-09T06:27:08.374768+0000","last_peered":"2023-10-09T06:27:08.374768+0000","last_clean":"2023-10-09T06:27:08.374768+0000","last_became_active":"2023-10-09T06:27:07.379489+0000","last_became_peered":"2023-10-09T06:27:07.379489+0000","last_unstale":"2023-10-09T06:27:08.374768+0000","last_undegraded":"2023-10-09T06:27:08.374768+0000","last_fullsized":"2023-10-09T06:27:08.374768+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:19:58.425004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.382431+0000","last_change":"2023-10-09T06:27:08.382431+0000","last_active":"2023-10-09T06:27:08.382431+0000","last_peered":"2023-10-09T06:27:08.382431+0000","last_clean":"2023-10-09T06:27:08.382431+0000","last_became_active":"2023-10-09T06:27:08.382031+0000","last_became_peered":"2023-10-09T06:27:08.382031+0000","last_unstale":"2023-10-09T06:27:08.382431+0000","last_undegraded":"2023-10-09T06:27:08.382431+0000","last_fullsized":"2023-10-09T06:27:08.382431+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:17.672729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.381752+0000","last_change":"2023-10-09T06:27:07.381690+0000","last_active":"2023-10-09T06:27:07.381752+0000","last_peered":"2023-10-09T06:27:07.381752+0000","last_clean":"2023-10-09T06:27:07.381752+0000","last_became_active":"2023-10-09T06:27:07.381483+0000","last_became_peered":"2023-10-09T06:27:07.381483+0000","last_unstale":"2023-10-09T06:27:07.381752+0000","last_undegraded":"2023-10-09T06:27:07.381752+0000","last_fullsized":"2023-10-09T06:27:07.381752+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:54.938152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384444+0000","last_change":"2023-10-09T06:27:08.384444+0000","last_active":"2023-10-09T06:27:08.384444+0000","last_peered":"2023-10-09T06:27:08.384444+0000","last_clean":"2023-10-09T06:27:08.384444+0000","last_became_active":"2023-10-09T06:27:08.383501+0000","last_became_peered":"2023-10-09T06:27:08.383501+0000","last_unstale":"2023-10-09T06:27:08.384444+0000","last_undegraded":"2023-10-09T06:27:08.384444+0000","last_fullsized":"2023-10-09T06:27:08.384444+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:18:43.616024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"135'2","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.393620+0000","last_change":"2023-10-09T06:27:07.385762+0000","last_active":"2023-10-09T06:27:08.393620+0000","last_peered":"2023-10-09T06:27:08.393620+0000","last_clean":"2023-10-09T06:27:08.393620+0000","last_became_active":"2023-10-09T06:27:07.385545+0000","last_became_peered":"2023-10-09T06:27:07.385545+0000","last_unstale":"2023-10-09T06:27:08.393620+0000","last_undegraded":"2023-10-09T06:27:08.393620+0000","last_fullsized":"2023-10-09T06:27:08.393620+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:31.772554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.392649+0000","last_change":"2023-10-09T06:27:08.392649+0000","last_active":"2023-10-09T06:27:08.392649+0000","last_peered":"2023-10-09T06:27:08.392649+0000","last_clean":"2023-10-09T06:27:08.392649+0000","last_became_active":"2023-10-09T06:27:08.386884+0000","last_became_peered":"2023-10-09T06:27:08.386884+0000","last_unstale":"2023-10-09T06:27:08.392649+0000","last_undegraded":"2023-10-09T06:27:08.392649+0000","last_fullsized":"2023-10-09T06:27:08.392649+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:27.209194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.380374+0000","last_change":"2023-10-09T06:27:07.380024+0000","last_active":"2023-10-09T06:27:07.380374+0000","last_peered":"2023-10-09T06:27:07.380374+0000","last_clean":"2023-10-09T06:27:07.380374+0000","last_became_active":"2023-10-09T06:27:07.379786+0000","last_became_peered":"2023-10-09T06:27:07.379786+0000","last_unstale":"2023-10-09T06:27:07.380374+0000","last_undegraded":"2023-10-09T06:27:07.380374+0000","last_fullsized":"2023-10-09T06:27:07.380374+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:14.085432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.388510+0000","last_change":"2023-10-09T06:27:08.388510+0000","last_active":"2023-10-09T06:27:08.388510+0000","last_peered":"2023-10-09T06:27:08.388510+0000","last_clean":"2023-10-09T06:27:08.388510+0000","last_became_active":"2023-10-09T06:27:08.388282+0000","last_became_peered":"2023-10-09T06:27:08.388282+0000","last_unstale":"2023-10-09T06:27:08.388510+0000","last_undegraded":"2023-10-09T06:27:08.388510+0000","last_fullsized":"2023-10-09T06:27:08.388510+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:58:51.451073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.383677+0000","last_change":"2023-10-09T06:27:07.383544+0000","last_active":"2023-10-09T06:27:07.383677+0000","last_peered":"2023-10-09T06:27:07.383677+0000","last_clean":"2023-10-09T06:27:07.383677+0000","last_became_active":"2023-10-09T06:27:07.383296+0000","last_became_peered":"2023-10-09T06:27:07.383296+0000","last_unstale":"2023-10-09T06:27:07.383677+0000","last_undegraded":"2023-10-09T06:27:07.383677+0000","last_fullsized":"2023-10-09T06:27:07.383677+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:02.865195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.399398+0000","last_change":"2023-10-09T06:27:08.399398+0000","last_active":"2023-10-09T06:27:08.399398+0000","last_peered":"2023-10-09T06:27:08.399398+0000","last_clean":"2023-10-09T06:27:08.399398+0000","last_became_active":"2023-10-09T06:27:08.396943+0000","last_became_peered":"2023-10-09T06:27:08.396943+0000","last_unstale":"2023-10-09T06:27:08.399398+0000","last_undegraded":"2023-10-09T06:27:08.399398+0000","last_fullsized":"2023-10-09T06:27:08.399398+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:36.473523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.385434+0000","last_change":"2023-10-09T06:27:07.385001+0000","last_active":"2023-10-09T06:27:07.385434+0000","last_peered":"2023-10-09T06:27:07.385434+0000","last_clean":"2023-10-09T06:27:07.385434+0000","last_became_active":"2023-10-09T06:27:07.381932+0000","last_became_peered":"2023-10-09T06:27:07.381932+0000","last_unstale":"2023-10-09T06:27:07.385434+0000","last_undegraded":"2023-10-09T06:27:07.385434+0000","last_fullsized":"2023-10-09T06:27:07.385434+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:58:50.446089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.386139+0000","last_change":"2023-10-09T06:27:08.386139+0000","last_active":"2023-10-09T06:27:08.386139+0000","last_peered":"2023-10-09T06:27:08.386139+0000","last_clean":"2023-10-09T06:27:08.386139+0000","last_became_active":"2023-10-09T06:27:08.385891+0000","last_became_peered":"2023-10-09T06:27:08.385891+0000","last_unstale":"2023-10-09T06:27:08.386139+0000","last_undegraded":"2023-10-09T06:27:08.386139+0000","last_fullsized":"2023-10-09T06:27:08.386139+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:33:05.093021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"135'2","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.399060+0000","last_change":"2023-10-09T06:27:07.385763+0000","last_active":"2023-10-09T06:27:08.399060+0000","last_peered":"2023-10-09T06:27:08.399060+0000","last_clean":"2023-10-09T06:27:08.399060+0000","last_became_active":"2023-10-09T06:27:07.385539+0000","last_became_peered":"2023-10-09T06:27:07.385539+0000","last_unstale":"2023-10-09T06:27:08.399060+0000","last_undegraded":"2023-10-09T06:27:08.399060+0000","last_fullsized":"2023-10-09T06:27:08.399060+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:59.423310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.390114+0000","last_change":"2023-10-09T06:27:08.390114+0000","last_active":"2023-10-09T06:27:08.390114+0000","last_peered":"2023-10-09T06:27:08.390114+0000","last_clean":"2023-10-09T06:27:08.390114+0000","last_became_active":"2023-10-09T06:27:08.389496+0000","last_became_peered":"2023-10-09T06:27:08.389496+0000","last_unstale":"2023-10-09T06:27:08.390114+0000","last_undegraded":"2023-10-09T06:27:08.390114+0000","last_fullsized":"2023-10-09T06:27:08.390114+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:19:23.125037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.380952+0000","last_change":"2023-10-09T06:27:07.380880+0000","last_active":"2023-10-09T06:27:07.380952+0000","last_peered":"2023-10-09T06:27:07.380952+0000","last_clean":"2023-10-09T06:27:07.380952+0000","last_became_active":"2023-10-09T06:27:07.380616+0000","last_became_peered":"2023-10-09T06:27:07.380616+0000","last_unstale":"2023-10-09T06:27:07.380952+0000","last_undegraded":"2023-10-09T06:27:07.380952+0000","last_fullsized":"2023-10-09T06:27:07.380952+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:35.182739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.389660+0000","last_change":"2023-10-09T06:27:08.389660+0000","last_active":"2023-10-09T06:27:08.389660+0000","last_peered":"2023-10-09T06:27:08.389660+0000","last_clean":"2023-10-09T06:27:08.389660+0000","last_became_active":"2023-10-09T06:27:08.386710+0000","last_became_peered":"2023-10-09T06:27:08.386710+0000","last_unstale":"2023-10-09T06:27:08.389660+0000","last_undegraded":"2023-10-09T06:27:08.389660+0000","last_fullsized":"2023-10-09T06:27:08.389660+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:15.191104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.384025+0000","last_change":"2023-10-09T06:27:07.383776+0000","last_active":"2023-10-09T06:27:07.384025+0000","last_peered":"2023-10-09T06:27:07.384025+0000","last_clean":"2023-10-09T06:27:07.384025+0000","last_became_active":"2023-10-09T06:27:07.383000+0000","last_became_peered":"2023-10-09T06:27:07.383000+0000","last_unstale":"2023-10-09T06:27:07.384025+0000","last_undegraded":"2023-10-09T06:27:07.384025+0000","last_fullsized":"2023-10-09T06:27:07.384025+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:12.122401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.386458+0000","last_change":"2023-10-09T06:27:08.386458+0000","last_active":"2023-10-09T06:27:08.386458+0000","last_peered":"2023-10-09T06:27:08.386458+0000","last_clean":"2023-10-09T06:27:08.386458+0000","last_became_active":"2023-10-09T06:27:08.385844+0000","last_became_peered":"2023-10-09T06:27:08.385844+0000","last_unstale":"2023-10-09T06:27:08.386458+0000","last_undegraded":"2023-10-09T06:27:08.386458+0000","last_fullsized":"2023-10-09T06:27:08.386458+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:58:51.451073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.382069+0000","last_change":"2023-10-09T06:27:07.381965+0000","last_active":"2023-10-09T06:27:07.382069+0000","last_peered":"2023-10-09T06:27:07.382069+0000","last_clean":"2023-10-09T06:27:07.382069+0000","last_became_active":"2023-10-09T06:27:07.381743+0000","last_became_peered":"2023-10-09T06:27:07.381743+0000","last_unstale":"2023-10-09T06:27:07.382069+0000","last_undegraded":"2023-10-09T06:27:07.382069+0000","last_fullsized":"2023-10-09T06:27:07.382069+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:58:45.581064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384178+0000","last_change":"2023-10-09T06:27:08.384178+0000","last_active":"2023-10-09T06:27:08.384178+0000","last_peered":"2023-10-09T06:27:08.384178+0000","last_clean":"2023-10-09T06:27:08.384178+0000","last_became_active":"2023-10-09T06:27:08.383935+0000","last_became_peered":"2023-10-09T06:27:08.383935+0000","last_unstale":"2023-10-09T06:27:08.384178+0000","last_undegraded":"2023-10-09T06:27:08.384178+0000","last_fullsized":"2023-10-09T06:27:08.384178+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:39:31.069062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.379871+0000","last_change":"2023-10-09T06:27:07.379534+0000","last_active":"2023-10-09T06:27:07.379871+0000","last_peered":"2023-10-09T06:27:07.379871+0000","last_clean":"2023-10-09T06:27:07.379871+0000","last_became_active":"2023-10-09T06:27:07.379276+0000","last_became_peered":"2023-10-09T06:27:07.379276+0000","last_unstale":"2023-10-09T06:27:07.379871+0000","last_undegraded":"2023-10-09T06:27:07.379871+0000","last_fullsized":"2023-10-09T06:27:07.379871+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:50.111575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.379945+0000","last_change":"2023-10-09T06:27:08.379945+0000","last_active":"2023-10-09T06:27:08.379945+0000","last_peered":"2023-10-09T06:27:08.379945+0000","last_clean":"2023-10-09T06:27:08.379945+0000","last_became_active":"2023-10-09T06:27:08.379680+0000","last_became_peered":"2023-10-09T06:27:08.379680+0000","last_unstale":"2023-10-09T06:27:08.379945+0000","last_undegraded":"2023-10-09T06:27:08.379945+0000","last_fullsized":"2023-10-09T06:27:08.379945+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:00.855382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.380826+0000","last_change":"2023-10-09T06:27:07.380723+0000","last_active":"2023-10-09T06:27:07.380826+0000","last_peered":"2023-10-09T06:27:07.380826+0000","last_clean":"2023-10-09T06:27:07.380826+0000","last_became_active":"2023-10-09T06:27:07.380500+0000","last_became_peered":"2023-10-09T06:27:07.380500+0000","last_unstale":"2023-10-09T06:27:07.380826+0000","last_undegraded":"2023-10-09T06:27:07.380826+0000","last_fullsized":"2023-10-09T06:27:07.380826+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:28:46.928721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384596+0000","last_change":"2023-10-09T06:27:08.384596+0000","last_active":"2023-10-09T06:27:08.384596+0000","last_peered":"2023-10-09T06:27:08.384596+0000","last_clean":"2023-10-09T06:27:08.384596+0000","last_became_active":"2023-10-09T06:27:08.383695+0000","last_became_peered":"2023-10-09T06:27:08.383695+0000","last_unstale":"2023-10-09T06:27:08.384596+0000","last_undegraded":"2023-10-09T06:27:08.384596+0000","last_fullsized":"2023-10-09T06:27:08.384596+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:03.479306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.383811+0000","last_change":"2023-10-09T06:27:07.383600+0000","last_active":"2023-10-09T06:27:07.383811+0000","last_peered":"2023-10-09T06:27:07.383811+0000","last_clean":"2023-10-09T06:27:07.383811+0000","last_became_active":"2023-10-09T06:27:07.383007+0000","last_became_peered":"2023-10-09T06:27:07.383007+0000","last_unstale":"2023-10-09T06:27:07.383811+0000","last_undegraded":"2023-10-09T06:27:07.383811+0000","last_fullsized":"2023-10-09T06:27:07.383811+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:31.772554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.394362+0000","last_change":"2023-10-09T06:27:08.394362+0000","last_active":"2023-10-09T06:27:08.394362+0000","last_peered":"2023-10-09T06:27:08.394362+0000","last_clean":"2023-10-09T06:27:08.394362+0000","last_became_active":"2023-10-09T06:27:08.394133+0000","last_became_peered":"2023-10-09T06:27:08.394133+0000","last_unstale":"2023-10-09T06:27:08.394362+0000","last_undegraded":"2023-10-09T06:27:08.394362+0000","last_fullsized":"2023-10-09T06:27:08.394362+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:02.023350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.383991+0000","last_change":"2023-10-09T06:27:07.383503+0000","last_active":"2023-10-09T06:27:07.383991+0000","last_peered":"2023-10-09T06:27:07.383991+0000","last_clean":"2023-10-09T06:27:07.383991+0000","last_became_active":"2023-10-09T06:27:07.382395+0000","last_became_peered":"2023-10-09T06:27:07.382395+0000","last_unstale":"2023-10-09T06:27:07.383991+0000","last_undegraded":"2023-10-09T06:27:07.383991+0000","last_fullsized":"2023-10-09T06:27:07.383991+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:59.850398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.382248+0000","last_change":"2023-10-09T06:27:08.382248+0000","last_active":"2023-10-09T06:27:08.382248+0000","last_peered":"2023-10-09T06:27:08.382248+0000","last_clean":"2023-10-09T06:27:08.382248+0000","last_became_active":"2023-10-09T06:27:08.382047+0000","last_became_peered":"2023-10-09T06:27:08.382047+0000","last_unstale":"2023-10-09T06:27:08.382248+0000","last_undegraded":"2023-10-09T06:27:08.382248+0000","last_fullsized":"2023-10-09T06:27:08.382248+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:27:36.915461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.384708+0000","last_change":"2023-10-09T06:27:07.384630+0000","last_active":"2023-10-09T06:27:07.384708+0000","last_peered":"2023-10-09T06:27:07.384708+0000","last_clean":"2023-10-09T06:27:07.384708+0000","last_became_active":"2023-10-09T06:27:07.384355+0000","last_became_peered":"2023-10-09T06:27:07.384355+0000","last_unstale":"2023-10-09T06:27:07.384708+0000","last_undegraded":"2023-10-09T06:27:07.384708+0000","last_fullsized":"2023-10-09T06:27:07.384708+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:14.393281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":262,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.374075+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:27:07.374075+0000","last_peered":"2023-10-09T06:27:07.374075+0000","last_clean":"2023-10-09T06:27:07.374075+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:27:07.374075+0000","last_undegraded":"2023-10-09T06:27:07.374075+0000","last_fullsized":"2023-10-09T06:27:07.374075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1298,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194014,"statfs":{"total":200000000,"available":198670684,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53900000000000003,"15min":0.51100000000000001},"min":{"1min":0.32900000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79600000000000004,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.52700000000000002},"min":{"1min":0.33500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81100000000000005,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.48099999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.50600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64200000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54200000000000004,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76300000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.434}]},{"osd":2,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81899999999999995,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59199999999999997,"15min":0.54100000000000004},"min":{"1min":0.33700000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73999999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.61799999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.65000000000000002,"15min":0.57999999999999996},"min":{"1min":0.373,"5min":0.318,"15min":0.318},"max":{"1min":0.80900000000000005,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.64900000000000002,"15min":0.56699999999999995},"min":{"1min":0.435,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77400000000000002,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.54100000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45800000000000002,"15min":0.46999999999999997},"min":{"1min":0.27700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.64100000000000001,"5min":0.872,"15min":0.872},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77800000000000002,"5min":0.79800000000000004,"15min":0.86099999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48599999999999999,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.255,"15min":0.255},"max":{"1min":0.71799999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73999999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83599999999999997,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.74299999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.73199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":721,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194590,"statfs":{"total":200000000,"available":199261052,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.74399999999999999},"min":{"1min":0.35299999999999998,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.71699999999999997,"5min":0.77100000000000002,"15min":7.0960000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54600000000000004,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.133},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":1.155},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.317},"max":{"1min":0.75600000000000001,"5min":0.79300000000000004,"15min":1.1459999999999999},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.86499999999999999,"15min":1.2290000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55300000000000005,"15min":0.75800000000000001},"min":{"1min":0.378,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":7.1299999999999999},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.59399999999999997},"min":{"1min":0.44500000000000001,"5min":0.39100000000000001,"15min":0.34499999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":1.337},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73699999999999999,"5min":0.90400000000000003,"15min":1.206},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.498,"15min":0.497},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.33300000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.65500000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.501}]},{"osd":7,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.315},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.42699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194584,"statfs":{"total":200000000,"available":199254165,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34999999999999998,"15min":0.36599999999999999},"min":{"1min":0.223,"5min":0.219,"15min":0.219},"max":{"1min":0.41699999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.33800000000000002},"min":{"1min":0.247,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46899999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.27600000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.35099999999999998,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.46600000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.254},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40799999999999997,"15min":0.38800000000000001},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.48599999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.38400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45200000000000001,"15min":0.41699999999999998},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.29199999999999998},"max":{"1min":0.52800000000000002,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.443,"15min":0.42899999999999999},"min":{"1min":0.28999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.504,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59699999999999998,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.83199999999999996,"5min":1.097,"15min":1.097},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60999999999999999,"15min":0.79100000000000004},"min":{"1min":0.42699999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76400000000000001,"5min":1.0309999999999999,"15min":5.5270000000000001},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.47699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":1.125,"15min":1.125},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64400000000000002,"15min":0.66300000000000003},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":1.175,"15min":1.4219999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65200000000000002,"15min":0.622},"min":{"1min":0.45800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82599999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.46600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92300000000000004,"5min":1.125,"15min":1.49},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83599999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.67200000000000004,"15min":0.65600000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78600000000000003,"5min":1.052,"15min":1.052},"last":0.72699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1298,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194014,"statfs":{"total":200000000,"available":198670684,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35799999999999998,"15min":0.40799999999999997},"min":{"1min":0.23899999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.47199999999999998,"5min":0.65800000000000003,"15min":1.226},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.38400000000000001,"15min":0.41999999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58899999999999997,"5min":0.71899999999999997,"15min":1.131},"last":0.40200000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38900000000000001,"15min":0.93799999999999994},"min":{"1min":0.30099999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52200000000000002,"5min":0.65200000000000002,"15min":12.929},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42099999999999999,"15min":0.45700000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.57199999999999995,"5min":0.70899999999999996,"15min":1.1599999999999999},"last":0.315}]},{"osd":3,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44400000000000001,"15min":0.47299999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.25600000000000001},"max":{"1min":0.66300000000000003,"5min":0.76100000000000001,"15min":1.1859999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.438,"15min":0.48399999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61899999999999999,"5min":0.69199999999999995,"15min":1.3089999999999999},"last":0.433}]},{"osd":4,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59799999999999998,"15min":0.61299999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73299999999999998,"5min":0.86299999999999999,"15min":0.93200000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.60699999999999998,"15min":0.64900000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.41099999999999998},"max":{"1min":0.72799999999999998,"5min":0.97099999999999997,"15min":1.335},"last":0.65400000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.74099999999999999,"5min":0.90700000000000003,"15min":1.0580000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.999},"last":0.57099999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86499999999999999,"5min":0.93899999999999995,"15min":1.2849999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64000000000000001,"15min":0.67400000000000004},"min":{"1min":0.40500000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.262},"last":0.62},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64700000000000002,"15min":0.66500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.95599999999999996,"15min":1.103},"last":0.52000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":721,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194590,"statfs":{"total":200000000,"available":199261052,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.35199999999999998,"15min":0.83599999999999997},"min":{"1min":0.24299999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.60899999999999999,"5min":0.79000000000000004,"15min":14.981999999999999},"last":0.371},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.379,"15min":0.64600000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":9.1600000000000001},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35799999999999998,"15min":0.60799999999999998},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.52500000000000002,"5min":0.73099999999999998,"15min":8.4930000000000003},"last":0.438},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.45800000000000002,"15min":0.67800000000000005},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.254},"max":{"1min":0.56499999999999995,"5min":4.6870000000000003,"15min":9.0239999999999991},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.44,"15min":0.68100000000000005},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.622,"5min":0.84299999999999997,"15min":8.5190000000000001},"last":0.5},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.441,"15min":0.89900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.60699999999999998,"5min":0.87,"15min":15.007999999999999},"last":0.52200000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.625,"15min":1.097},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":14.917999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.90500000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92300000000000004,"5min":1.1160000000000001,"15min":8.9930000000000003},"last":0.90300000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63800000000000001,"15min":0.88200000000000001},"min":{"1min":0.436,"5min":0.376,"15min":0.35899999999999999},"max":{"1min":0.78000000000000003,"5min":0.96299999999999997,"15min":8.9610000000000003},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64800000000000002,"15min":0.88800000000000001},"min":{"1min":0.433,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.872,"5min":1.006,"15min":8.3919999999999995},"last":0.96699999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.87},"min":{"1min":0.48899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79600000000000004,"5min":1.026,"15min":8.4339999999999993},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64800000000000002,"15min":1.0980000000000001},"min":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.85099999999999998,"5min":1.028,"15min":14.954000000000001},"last":0.99099999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.86699999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.874,"5min":1.0049999999999999,"15min":8.9160000000000004},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.88300000000000001},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89200000000000002,"5min":1.0609999999999999,"15min":8.4640000000000004},"last":0.83199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":721,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194590,"statfs":{"total":200000000,"available":199261052,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58599999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.247},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41699999999999998,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.39500000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35599999999999998,"15min":0.32800000000000001},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.215},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.312},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.40000000000000002,"15min":0.35699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.51700000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38800000000000001,"15min":0.36499999999999999},"min":{"1min":0.27000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46899999999999997,"15min":0.42499999999999999},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.375}]},{"osd":4,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.375},"max":{"1min":0.77700000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.434,"5min":0.372,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.84799999999999998,"15min":0.91500000000000004},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64200000000000002,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.65200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.623}]},{"osd":7,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64000000000000001,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.38800000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63600000000000001,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.91700000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194584,"statfs":{"total":200000000,"available":199254289,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.53000000000000003,"15min":0.498},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.29299999999999998},"max":{"1min":0.66400000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.318},"max":{"1min":0.63100000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53500000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53400000000000003,"15min":0.51400000000000001},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.254},"max":{"1min":0.60399999999999998,"5min":0.74399999999999999,"15min":0.77000000000000002},"last":0.495},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.69599999999999995},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.34499999999999997},"max":{"1min":0.66700000000000004,"5min":1.5680000000000001,"15min":4.3250000000000002},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.68600000000000005},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.67800000000000005,"5min":1.7110000000000001,"15min":4.7320000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":1.03},"min":{"1min":0.41299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78200000000000003,"5min":0.80200000000000005,"15min":11.715},"last":0.51600000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56799999999999995,"15min":0.52600000000000002},"min":{"1min":0.38900000000000001,"5min":0.35199999999999998,"15min":0.34899999999999998},"max":{"1min":0.68400000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.44700000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72399999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61899999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.49299999999999999},"min":{"1min":0.27200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65200000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.502,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65900000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.38300000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.628}]},{"osd":7,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.754,"5min":0.879,"15min":0.879},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81200000000000006,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":721,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194590,"statfs":{"total":200000000,"available":199261052,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73699999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55800000000000005,"15min":0.52400000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35399999999999998},"max":{"1min":0.78500000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55000000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.752,"5min":1.093,"15min":1.093},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.52300000000000002},"min":{"1min":0.379,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81699999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58799999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57299999999999995,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70899999999999996,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.67700000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.55800000000000005},"min":{"1min":0.45800000000000002,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.745,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.628},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.58799999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76600000000000001,"5min":1.071,"15min":1.071},"last":0.66700000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71599999999999997,"5min":0.79000000000000004,"15min":0.84399999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.746,"5min":0.76900000000000002,"15min":0.81000000000000005},"last":0.47499999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49299999999999999,"15min":0.53300000000000003},"min":{"1min":0.36099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73299999999999998,"5min":0.85199999999999998,"15min":1.0680000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.67500000000000004,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.56299999999999994}]},{"osd":7,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":0.78200000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.435},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76600000000000001,"5min":0.84399999999999997,"15min":1.0269999999999999},"last":0.498}]}]}],"pool_statfs":[]}} 2023-10-09T06:27:13.508 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:27:13.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.659+0000 7f393ef10700 1 Processor -- start 2023-10-09T06:27:13.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.659+0000 7f393ef10700 1 -- start start 2023-10-09T06:27:13.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.660+0000 7f393ef10700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3938159f10 0x7f39380c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:13.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.660+0000 7f393ef10700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393815a730 con 0x7f393815a2e0 2023-10-09T06:27:13.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.660+0000 7f393ef10700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39380ae320 con 0x7f39380cc410 2023-10-09T06:27:13.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.660+0000 7f393ef10700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39380ad710 con 0x7f3938159f10 2023-10-09T06:27:13.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.660+0000 7f393d70d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f393815a2e0 0x7f39380cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38310/0 (socket says 172.21.15.31:38310) 2023-10-09T06:27:13.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.660+0000 7f393d70d700 1 -- 172.21.15.31:0/2801567613 learned_addr learned my addr 172.21.15.31:0/2801567613 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:13.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.660+0000 7f393df0e700 1 --2- 172.21.15.31:0/2801567613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3938159f10 0x7f39380c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:13.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.660+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224245496 0 0) 0x7f3928001110 con 0x7f393815a2e0 2023-10-09T06:27:13.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.660+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3924003570 con 0x7f393815a2e0 2023-10-09T06:27:13.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3022091449 0 0) 0x7f3924003570 con 0x7f393815a2e0 2023-10-09T06:27:13.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3938159f10 msgr2=0x7f39380c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:13.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 --2- 172.21.15.31:0/2801567613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3938159f10 0x7f39380c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 >> v1:172.21.15.158:6789/0 conn(0x7f39380cc410 legacy=0x7f39380cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39380ad9f0 con 0x7f393815a2e0 2023-10-09T06:27:13.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f3928001600 con 0x7f393815a2e0 2023-10-09T06:27:13.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 >> v1:172.21.15.31:6789/0 conn(0x7f393815a2e0 legacy=0x7f39380cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 --2- 172.21.15.31:0/2801567613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3924003a90 0x7f3924003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:13.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 --2- 172.21.15.31:0/2801567613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3924004810 0x7f3924004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:13.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 --2- 172.21.15.31:0/2801567613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3938159f10 0x7f39240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:13.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380ad710 con 0x7f3924003a90 2023-10-09T06:27:13.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392400bb10 con 0x7f3924004810 2023-10-09T06:27:13.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392400bcd0 con 0x7f3938159f10 2023-10-09T06:27:13.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393df0e700 1 --2- 172.21.15.31:0/2801567613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3924003a90 0x7f3924003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:13.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393d70d700 1 --2- 172.21.15.31:0/2801567613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3924004810 0x7f3924004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:13.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393e70f700 1 --2- 172.21.15.31:0/2801567613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3938159f10 0x7f39240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:13.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393df0e700 1 -- 172.21.15.31:0/2801567613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3938159f10 msgr2=0x7f39240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:13.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393df0e700 1 --2- 172.21.15.31:0/2801567613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3938159f10 0x7f39240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393df0e700 1 -- 172.21.15.31:0/2801567613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3924004810 msgr2=0x7f3924004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:13.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393df0e700 1 --2- 172.21.15.31:0/2801567613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3924004810 0x7f3924004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393df0e700 1 -- 172.21.15.31:0/2801567613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3924003570 con 0x7f3924003a90 2023-10-09T06:27:13.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393df0e700 1 --2- 172.21.15.31:0/2801567613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3924003a90 0x7f3924003e60 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f3934009c00 tx=0x7f39340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90219e23dda681cb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400e710 con 0x7f3924003a90 2023-10-09T06:27:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393400e870 con 0x7f3924003a90 2023-10-09T06:27:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.661+0000 7f393cf0c700 1 -- 172.21.15.31:0/2801567613 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400ec30 con 0x7f3924003a90 2023-10-09T06:27:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.662+0000 7f393ef10700 1 -- 172.21.15.31:0/2801567613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3924003a90 msgr2=0x7f3924003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.662+0000 7f393ef10700 1 --2- 172.21.15.31:0/2801567613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3924003a90 0x7f3924003e60 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f3934009c00 tx=0x7f39340091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.662+0000 7f393e70f700 1 -- 172.21.15.31:0/2801567613 reap_dead start 2023-10-09T06:27:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.662+0000 7f393ef10700 1 -- 172.21.15.31:0/2801567613 shutdown_connections 2023-10-09T06:27:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.662+0000 7f393ef10700 1 -- 172.21.15.31:0/2801567613 >> 172.21.15.31:0/2801567613 conn(0x7f3938067e40 msgr2=0x7f39380d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.662+0000 7f393ef10700 1 -- 172.21.15.31:0/2801567613 shutdown_connections 2023-10-09T06:27:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.662+0000 7f393ef10700 1 -- 172.21.15.31:0/2801567613 wait complete. 2023-10-09T06:27:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.663+0000 7f393ef10700 1 Processor -- start 2023-10-09T06:27:13.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.663+0000 7f393ef10700 1 -- start start 2023-10-09T06:27:13.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393ef10700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3924003a90 0x7f3938154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:13.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393ef10700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39381564c0 0x7f39380b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:13.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393ef10700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39380d0d70 0x7f39380d11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:13.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393ef10700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3938154870 con 0x7f39380d0d70 2023-10-09T06:27:13.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393ef10700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380d1730 con 0x7f39381564c0 2023-10-09T06:27:13.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393ef10700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39380c9a10 con 0x7f3924003a90 2023-10-09T06:27:13.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393e70f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39380d0d70 0x7f39380d11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:13.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393e70f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39380d0d70 0x7f39380d11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39708/0 (socket says 172.21.15.31:39708) 2023-10-09T06:27:13.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393e70f700 1 -- 172.21.15.31:0/1824531898 learned_addr learned my addr 172.21.15.31:0/1824531898 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:13.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393d70d700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39381564c0 0x7f39380b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:13.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393df0e700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3924003a90 0x7f3938154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393e70f700 1 -- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3924003a90 msgr2=0x7f3938154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393e70f700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3924003a90 0x7f3938154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393e70f700 1 -- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39381564c0 msgr2=0x7f39380b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393e70f700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39381564c0 0x7f39380b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.664+0000 7f393e70f700 1 -- 172.21.15.31:0/1824531898 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39380b4930 con 0x7f39380d0d70 2023-10-09T06:27:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.665+0000 7f393e70f700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39380d0d70 0x7f39380d11f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f39380711d0 tx=0x7f39300016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.665+0000 7f392dffb700 1 -- 172.21.15.31:0/1824531898 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930018070 con 0x7f39380d0d70 2023-10-09T06:27:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.665+0000 7f392dffb700 1 -- 172.21.15.31:0/1824531898 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393000c7e0 con 0x7f39380d0d70 2023-10-09T06:27:13.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.665+0000 7f393ef10700 1 -- 172.21.15.31:0/1824531898 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39380b4ed0 con 0x7f39380d0d70 2023-10-09T06:27:13.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.665+0000 7f392dffb700 1 -- 172.21.15.31:0/1824531898 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000cbc0 con 0x7f39380d0d70 2023-10-09T06:27:13.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.665+0000 7f393ef10700 1 -- 172.21.15.31:0/1824531898 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39380b5490 con 0x7f39380d0d70 2023-10-09T06:27:13.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.666+0000 7f393ef10700 1 -- 172.21.15.31:0/1824531898 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3938089300 con 0x7f39380d0d70 2023-10-09T06:27:13.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.666+0000 7f392dffb700 1 -- 172.21.15.31:0/1824531898 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3930014480 con 0x7f39380d0d70 2023-10-09T06:27:13.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.666+0000 7f392dffb700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f391c066f30 0x7f391c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:13.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.667+0000 7f392dffb700 1 -- 172.21.15.31:0/1824531898 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3930084230 con 0x7f39380d0d70 2023-10-09T06:27:13.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.667+0000 7f393df0e700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f391c066f30 0x7f391c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:13.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.667+0000 7f393df0e700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f391c066f30 0x7f391c0693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f39340091e0 tx=0x7f393401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:13.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.671+0000 7f392dffb700 1 -- 172.21.15.31:0/1824531898 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3930051560 con 0x7f39380d0d70 2023-10-09T06:27:13.701 INFO:tasks.ceph.mds.c.smithi031.stderr:2023-10-09T06:27:13.701+0000 7f4337ac3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:27:13.858 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.858+0000 7f393ef10700 1 -- 172.21.15.31:0/1824531898 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39380890a0 con 0x7f391c066f30 2023-10-09T06:27:13.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.867+0000 7f392dffb700 1 -- 172.21.15.31:0/1824531898 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285379 (secure 0 0 0) 0x7f39380890a0 con 0x7f391c066f30 2023-10-09T06:27:13.870 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.870+0000 7f393ef10700 1 -- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f391c066f30 msgr2=0x7f391c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.870+0000 7f393ef10700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f391c066f30 0x7f391c0693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f39340091e0 tx=0x7f393401a000 comp rx=0 tx=0).stop 2023-10-09T06:27:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.870+0000 7f393ef10700 1 -- 172.21.15.31:0/1824531898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39380d0d70 msgr2=0x7f39380d11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.870+0000 7f393ef10700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39380d0d70 0x7f39380d11f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f39380711d0 tx=0x7f39300016d0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.870+0000 7f393ef10700 1 -- 172.21.15.31:0/1824531898 shutdown_connections 2023-10-09T06:27:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.870+0000 7f393ef10700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f391c066f30 0x7f391c0693e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.870+0000 7f393ef10700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3924003a90 0x7f3938154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.870+0000 7f393ef10700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39380d0d70 0x7f39380d11f0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.870+0000 7f393ef10700 1 --2- 172.21.15.31:0/1824531898 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39381564c0 0x7f39380b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.870+0000 7f393ef10700 1 -- 172.21.15.31:0/1824531898 >> 172.21.15.31:0/1824531898 conn(0x7f3938067e40 msgr2=0x7f39381580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.870+0000 7f393ef10700 1 -- 172.21.15.31:0/1824531898 shutdown_connections 2023-10-09T06:27:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:13.870+0000 7f393ef10700 1 -- 172.21.15.31:0/1824531898 wait complete. 2023-10-09T06:27:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:27:13.882 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2023-10-09T06:27:12.608092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6939,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555560,"statfs":{"total":1600000000,"available":1592894030,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001448"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.391475+0000","last_change":"2023-10-09T06:27:08.391475+0000","last_active":"2023-10-09T06:27:08.391475+0000","last_peered":"2023-10-09T06:27:08.391475+0000","last_clean":"2023-10-09T06:27:08.391475+0000","last_became_active":"2023-10-09T06:27:08.390379+0000","last_became_peered":"2023-10-09T06:27:08.390379+0000","last_unstale":"2023-10-09T06:27:08.391475+0000","last_undegraded":"2023-10-09T06:27:08.391475+0000","last_fullsized":"2023-10-09T06:27:08.391475+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:20.700634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.393693+0000","last_change":"2023-10-09T06:27:08.393693+0000","last_active":"2023-10-09T06:27:08.393693+0000","last_peered":"2023-10-09T06:27:08.393693+0000","last_clean":"2023-10-09T06:27:08.393693+0000","last_became_active":"2023-10-09T06:27:08.393301+0000","last_became_peered":"2023-10-09T06:27:08.393301+0000","last_unstale":"2023-10-09T06:27:08.393693+0000","last_undegraded":"2023-10-09T06:27:08.393693+0000","last_fullsized":"2023-10-09T06:27:08.393693+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:27:36.915461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.381882+0000","last_change":"2023-10-09T06:27:08.381882+0000","last_active":"2023-10-09T06:27:08.381882+0000","last_peered":"2023-10-09T06:27:08.381882+0000","last_clean":"2023-10-09T06:27:08.381882+0000","last_became_active":"2023-10-09T06:27:08.381500+0000","last_became_peered":"2023-10-09T06:27:08.381500+0000","last_unstale":"2023-10-09T06:27:08.381882+0000","last_undegraded":"2023-10-09T06:27:08.381882+0000","last_fullsized":"2023-10-09T06:27:08.381882+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:39.209987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.389229+0000","last_change":"2023-10-09T06:27:08.389229+0000","last_active":"2023-10-09T06:27:08.389229+0000","last_peered":"2023-10-09T06:27:08.389229+0000","last_clean":"2023-10-09T06:27:08.389229+0000","last_became_active":"2023-10-09T06:27:08.387183+0000","last_became_peered":"2023-10-09T06:27:08.387183+0000","last_unstale":"2023-10-09T06:27:08.389229+0000","last_undegraded":"2023-10-09T06:27:08.389229+0000","last_fullsized":"2023-10-09T06:27:08.389229+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:59:49.295571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.395739+0000","last_change":"2023-10-09T06:27:08.395739+0000","last_active":"2023-10-09T06:27:08.395739+0000","last_peered":"2023-10-09T06:27:08.395739+0000","last_clean":"2023-10-09T06:27:08.395739+0000","last_became_active":"2023-10-09T06:27:08.395521+0000","last_became_peered":"2023-10-09T06:27:08.395521+0000","last_unstale":"2023-10-09T06:27:08.395739+0000","last_undegraded":"2023-10-09T06:27:08.395739+0000","last_fullsized":"2023-10-09T06:27:08.395739+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:11.534338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.383442+0000","last_change":"2023-10-09T06:27:08.383442+0000","last_active":"2023-10-09T06:27:08.383442+0000","last_peered":"2023-10-09T06:27:08.383442+0000","last_clean":"2023-10-09T06:27:08.383442+0000","last_became_active":"2023-10-09T06:27:08.383081+0000","last_became_peered":"2023-10-09T06:27:08.383081+0000","last_unstale":"2023-10-09T06:27:08.383442+0000","last_undegraded":"2023-10-09T06:27:08.383442+0000","last_fullsized":"2023-10-09T06:27:08.383442+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:16.768230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384272+0000","last_change":"2023-10-09T06:27:08.384272+0000","last_active":"2023-10-09T06:27:08.384272+0000","last_peered":"2023-10-09T06:27:08.384272+0000","last_clean":"2023-10-09T06:27:08.384272+0000","last_became_active":"2023-10-09T06:27:08.383857+0000","last_became_peered":"2023-10-09T06:27:08.383857+0000","last_unstale":"2023-10-09T06:27:08.384272+0000","last_undegraded":"2023-10-09T06:27:08.384272+0000","last_fullsized":"2023-10-09T06:27:08.384272+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:51.105470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.388457+0000","last_change":"2023-10-09T06:27:08.388457+0000","last_active":"2023-10-09T06:27:08.388457+0000","last_peered":"2023-10-09T06:27:08.388457+0000","last_clean":"2023-10-09T06:27:08.388457+0000","last_became_active":"2023-10-09T06:27:08.387753+0000","last_became_peered":"2023-10-09T06:27:08.387753+0000","last_unstale":"2023-10-09T06:27:08.388457+0000","last_undegraded":"2023-10-09T06:27:08.388457+0000","last_fullsized":"2023-10-09T06:27:08.388457+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:29.638984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.391784+0000","last_change":"2023-10-09T06:27:08.391784+0000","last_active":"2023-10-09T06:27:08.391784+0000","last_peered":"2023-10-09T06:27:08.391784+0000","last_clean":"2023-10-09T06:27:08.391784+0000","last_became_active":"2023-10-09T06:27:08.391541+0000","last_became_peered":"2023-10-09T06:27:08.391541+0000","last_unstale":"2023-10-09T06:27:08.391784+0000","last_undegraded":"2023-10-09T06:27:08.391784+0000","last_fullsized":"2023-10-09T06:27:08.391784+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:23:02.619560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.390166+0000","last_change":"2023-10-09T06:27:08.390166+0000","last_active":"2023-10-09T06:27:08.390166+0000","last_peered":"2023-10-09T06:27:08.390166+0000","last_clean":"2023-10-09T06:27:08.390166+0000","last_became_active":"2023-10-09T06:27:08.389918+0000","last_became_peered":"2023-10-09T06:27:08.389918+0000","last_unstale":"2023-10-09T06:27:08.390166+0000","last_undegraded":"2023-10-09T06:27:08.390166+0000","last_fullsized":"2023-10-09T06:27:08.390166+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:51:43.122022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.378751+0000","last_change":"2023-10-09T06:27:08.378751+0000","last_active":"2023-10-09T06:27:08.378751+0000","last_peered":"2023-10-09T06:27:08.378751+0000","last_clean":"2023-10-09T06:27:08.378751+0000","last_became_active":"2023-10-09T06:27:08.378525+0000","last_became_peered":"2023-10-09T06:27:08.378525+0000","last_unstale":"2023-10-09T06:27:08.378751+0000","last_undegraded":"2023-10-09T06:27:08.378751+0000","last_fullsized":"2023-10-09T06:27:08.378751+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:17.672729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.390244+0000","last_change":"2023-10-09T06:27:08.390244+0000","last_active":"2023-10-09T06:27:08.390244+0000","last_peered":"2023-10-09T06:27:08.390244+0000","last_clean":"2023-10-09T06:27:08.390244+0000","last_became_active":"2023-10-09T06:27:08.389809+0000","last_became_peered":"2023-10-09T06:27:08.389809+0000","last_unstale":"2023-10-09T06:27:08.390244+0000","last_undegraded":"2023-10-09T06:27:08.390244+0000","last_fullsized":"2023-10-09T06:27:08.390244+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:27.357574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.389032+0000","last_change":"2023-10-09T06:27:08.389032+0000","last_active":"2023-10-09T06:27:08.389032+0000","last_peered":"2023-10-09T06:27:08.389032+0000","last_clean":"2023-10-09T06:27:08.389032+0000","last_became_active":"2023-10-09T06:27:08.388803+0000","last_became_peered":"2023-10-09T06:27:08.388803+0000","last_unstale":"2023-10-09T06:27:08.389032+0000","last_undegraded":"2023-10-09T06:27:08.389032+0000","last_fullsized":"2023-10-09T06:27:08.389032+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:20.162647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384799+0000","last_change":"2023-10-09T06:27:08.384799+0000","last_active":"2023-10-09T06:27:08.384799+0000","last_peered":"2023-10-09T06:27:08.384799+0000","last_clean":"2023-10-09T06:27:08.384799+0000","last_became_active":"2023-10-09T06:27:08.384055+0000","last_became_peered":"2023-10-09T06:27:08.384055+0000","last_unstale":"2023-10-09T06:27:08.384799+0000","last_undegraded":"2023-10-09T06:27:08.384799+0000","last_fullsized":"2023-10-09T06:27:08.384799+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:41.346115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.397880+0000","last_change":"2023-10-09T06:27:08.397880+0000","last_active":"2023-10-09T06:27:08.397880+0000","last_peered":"2023-10-09T06:27:08.397880+0000","last_clean":"2023-10-09T06:27:08.397880+0000","last_became_active":"2023-10-09T06:27:08.397375+0000","last_became_peered":"2023-10-09T06:27:08.397375+0000","last_unstale":"2023-10-09T06:27:08.397880+0000","last_undegraded":"2023-10-09T06:27:08.397880+0000","last_fullsized":"2023-10-09T06:27:08.397880+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:48.331541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.391692+0000","last_change":"2023-10-09T06:27:08.391692+0000","last_active":"2023-10-09T06:27:08.391692+0000","last_peered":"2023-10-09T06:27:08.391692+0000","last_clean":"2023-10-09T06:27:08.391692+0000","last_became_active":"2023-10-09T06:27:08.390732+0000","last_became_peered":"2023-10-09T06:27:08.390732+0000","last_unstale":"2023-10-09T06:27:08.391692+0000","last_undegraded":"2023-10-09T06:27:08.391692+0000","last_fullsized":"2023-10-09T06:27:08.391692+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:27:05.515914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.377058+0000","last_change":"2023-10-09T06:27:08.377058+0000","last_active":"2023-10-09T06:27:08.377058+0000","last_peered":"2023-10-09T06:27:08.377058+0000","last_clean":"2023-10-09T06:27:08.377058+0000","last_became_active":"2023-10-09T06:27:08.376804+0000","last_became_peered":"2023-10-09T06:27:08.376804+0000","last_unstale":"2023-10-09T06:27:08.377058+0000","last_undegraded":"2023-10-09T06:27:08.377058+0000","last_fullsized":"2023-10-09T06:27:08.377058+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:58:51.451073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.377086+0000","last_change":"2023-10-09T06:27:08.377086+0000","last_active":"2023-10-09T06:27:08.377086+0000","last_peered":"2023-10-09T06:27:08.377086+0000","last_clean":"2023-10-09T06:27:08.377086+0000","last_became_active":"2023-10-09T06:27:08.376842+0000","last_became_peered":"2023-10-09T06:27:08.376842+0000","last_unstale":"2023-10-09T06:27:08.377086+0000","last_undegraded":"2023-10-09T06:27:08.377086+0000","last_fullsized":"2023-10-09T06:27:08.377086+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:45:24.125420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384303+0000","last_change":"2023-10-09T06:27:08.384303+0000","last_active":"2023-10-09T06:27:08.384303+0000","last_peered":"2023-10-09T06:27:08.384303+0000","last_clean":"2023-10-09T06:27:08.384303+0000","last_became_active":"2023-10-09T06:27:08.382706+0000","last_became_peered":"2023-10-09T06:27:08.382706+0000","last_unstale":"2023-10-09T06:27:08.384303+0000","last_undegraded":"2023-10-09T06:27:08.384303+0000","last_fullsized":"2023-10-09T06:27:08.384303+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:10:00.732431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.381975+0000","last_change":"2023-10-09T06:27:08.381975+0000","last_active":"2023-10-09T06:27:08.381975+0000","last_peered":"2023-10-09T06:27:08.381975+0000","last_clean":"2023-10-09T06:27:08.381975+0000","last_became_active":"2023-10-09T06:27:08.381733+0000","last_became_peered":"2023-10-09T06:27:08.381733+0000","last_unstale":"2023-10-09T06:27:08.381975+0000","last_undegraded":"2023-10-09T06:27:08.381975+0000","last_fullsized":"2023-10-09T06:27:08.381975+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:45:24.125420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.386672+0000","last_change":"2023-10-09T06:27:08.386672+0000","last_active":"2023-10-09T06:27:08.386672+0000","last_peered":"2023-10-09T06:27:08.386672+0000","last_clean":"2023-10-09T06:27:08.386672+0000","last_became_active":"2023-10-09T06:27:08.386475+0000","last_became_peered":"2023-10-09T06:27:08.386475+0000","last_unstale":"2023-10-09T06:27:08.386672+0000","last_undegraded":"2023-10-09T06:27:08.386672+0000","last_fullsized":"2023-10-09T06:27:08.386672+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:36.473523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.394227+0000","last_change":"2023-10-09T06:27:08.394227+0000","last_active":"2023-10-09T06:27:08.394227+0000","last_peered":"2023-10-09T06:27:08.394227+0000","last_clean":"2023-10-09T06:27:08.394227+0000","last_became_active":"2023-10-09T06:27:08.389743+0000","last_became_peered":"2023-10-09T06:27:08.389743+0000","last_unstale":"2023-10-09T06:27:08.394227+0000","last_undegraded":"2023-10-09T06:27:08.394227+0000","last_fullsized":"2023-10-09T06:27:08.394227+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:20.162647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.380650+0000","last_change":"2023-10-09T06:27:08.380650+0000","last_active":"2023-10-09T06:27:08.380650+0000","last_peered":"2023-10-09T06:27:08.380650+0000","last_clean":"2023-10-09T06:27:08.380650+0000","last_became_active":"2023-10-09T06:27:08.380371+0000","last_became_peered":"2023-10-09T06:27:08.380371+0000","last_unstale":"2023-10-09T06:27:08.380650+0000","last_undegraded":"2023-10-09T06:27:08.380650+0000","last_fullsized":"2023-10-09T06:27:08.380650+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:33:05.093021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.389967+0000","last_change":"2023-10-09T06:27:08.389967+0000","last_active":"2023-10-09T06:27:08.389967+0000","last_peered":"2023-10-09T06:27:08.389967+0000","last_clean":"2023-10-09T06:27:08.389967+0000","last_became_active":"2023-10-09T06:27:08.389339+0000","last_became_peered":"2023-10-09T06:27:08.389339+0000","last_unstale":"2023-10-09T06:27:08.389967+0000","last_undegraded":"2023-10-09T06:27:08.389967+0000","last_fullsized":"2023-10-09T06:27:08.389967+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:03.479306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.377133+0000","last_change":"2023-10-09T06:27:08.377133+0000","last_active":"2023-10-09T06:27:08.377133+0000","last_peered":"2023-10-09T06:27:08.377133+0000","last_clean":"2023-10-09T06:27:08.377133+0000","last_became_active":"2023-10-09T06:27:08.376905+0000","last_became_peered":"2023-10-09T06:27:08.376905+0000","last_unstale":"2023-10-09T06:27:08.377133+0000","last_undegraded":"2023-10-09T06:27:08.377133+0000","last_fullsized":"2023-10-09T06:27:08.377133+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:19.955023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.392191+0000","last_change":"2023-10-09T06:27:08.392191+0000","last_active":"2023-10-09T06:27:08.392191+0000","last_peered":"2023-10-09T06:27:08.392191+0000","last_clean":"2023-10-09T06:27:08.392191+0000","last_became_active":"2023-10-09T06:27:08.391245+0000","last_became_peered":"2023-10-09T06:27:08.391245+0000","last_unstale":"2023-10-09T06:27:08.392191+0000","last_undegraded":"2023-10-09T06:27:08.392191+0000","last_fullsized":"2023-10-09T06:27:08.392191+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:05:34.657942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.396493+0000","last_change":"2023-10-09T06:27:08.396493+0000","last_active":"2023-10-09T06:27:08.396493+0000","last_peered":"2023-10-09T06:27:08.396493+0000","last_clean":"2023-10-09T06:27:08.396493+0000","last_became_active":"2023-10-09T06:27:08.395860+0000","last_became_peered":"2023-10-09T06:27:08.395860+0000","last_unstale":"2023-10-09T06:27:08.396493+0000","last_undegraded":"2023-10-09T06:27:08.396493+0000","last_fullsized":"2023-10-09T06:27:08.396493+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:44:42.982062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.396399+0000","last_change":"2023-10-09T06:27:08.396399+0000","last_active":"2023-10-09T06:27:08.396399+0000","last_peered":"2023-10-09T06:27:08.396399+0000","last_clean":"2023-10-09T06:27:08.396399+0000","last_became_active":"2023-10-09T06:27:08.395975+0000","last_became_peered":"2023-10-09T06:27:08.395975+0000","last_unstale":"2023-10-09T06:27:08.396399+0000","last_undegraded":"2023-10-09T06:27:08.396399+0000","last_fullsized":"2023-10-09T06:27:08.396399+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:29.638984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.381621+0000","last_change":"2023-10-09T06:27:08.381621+0000","last_active":"2023-10-09T06:27:08.381621+0000","last_peered":"2023-10-09T06:27:08.381621+0000","last_clean":"2023-10-09T06:27:08.381621+0000","last_became_active":"2023-10-09T06:27:08.381375+0000","last_became_peered":"2023-10-09T06:27:08.381375+0000","last_unstale":"2023-10-09T06:27:08.381621+0000","last_undegraded":"2023-10-09T06:27:08.381621+0000","last_fullsized":"2023-10-09T06:27:08.381621+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:29.093514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.397460+0000","last_change":"2023-10-09T06:27:08.397460+0000","last_active":"2023-10-09T06:27:08.397460+0000","last_peered":"2023-10-09T06:27:08.397460+0000","last_clean":"2023-10-09T06:27:08.397460+0000","last_became_active":"2023-10-09T06:27:08.397253+0000","last_became_peered":"2023-10-09T06:27:08.397253+0000","last_unstale":"2023-10-09T06:27:08.397460+0000","last_undegraded":"2023-10-09T06:27:08.397460+0000","last_fullsized":"2023-10-09T06:27:08.397460+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:47.500660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.391903+0000","last_change":"2023-10-09T06:27:08.391903+0000","last_active":"2023-10-09T06:27:08.391903+0000","last_peered":"2023-10-09T06:27:08.391903+0000","last_clean":"2023-10-09T06:27:08.391903+0000","last_became_active":"2023-10-09T06:27:08.391009+0000","last_became_peered":"2023-10-09T06:27:08.391009+0000","last_unstale":"2023-10-09T06:27:08.391903+0000","last_undegraded":"2023-10-09T06:27:08.391903+0000","last_fullsized":"2023-10-09T06:27:08.391903+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:01:59.752470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.390922+0000","last_change":"2023-10-09T06:27:08.390922+0000","last_active":"2023-10-09T06:27:08.390922+0000","last_peered":"2023-10-09T06:27:08.390922+0000","last_clean":"2023-10-09T06:27:08.390922+0000","last_became_active":"2023-10-09T06:27:08.390693+0000","last_became_peered":"2023-10-09T06:27:08.390693+0000","last_unstale":"2023-10-09T06:27:08.390922+0000","last_undegraded":"2023-10-09T06:27:08.390922+0000","last_fullsized":"2023-10-09T06:27:08.390922+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:15.398265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.389139+0000","last_change":"2023-10-09T06:27:08.389139+0000","last_active":"2023-10-09T06:27:08.389139+0000","last_peered":"2023-10-09T06:27:08.389139+0000","last_clean":"2023-10-09T06:27:08.389139+0000","last_became_active":"2023-10-09T06:27:08.388927+0000","last_became_peered":"2023-10-09T06:27:08.388927+0000","last_unstale":"2023-10-09T06:27:08.389139+0000","last_undegraded":"2023-10-09T06:27:08.389139+0000","last_fullsized":"2023-10-09T06:27:08.389139+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:25.305619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"135'4","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.388570+0000","last_change":"2023-10-09T06:27:07.379275+0000","last_active":"2023-10-09T06:27:08.388570+0000","last_peered":"2023-10-09T06:27:08.388570+0000","last_clean":"2023-10-09T06:27:08.388570+0000","last_became_active":"2023-10-09T06:27:07.378947+0000","last_became_peered":"2023-10-09T06:27:07.378947+0000","last_unstale":"2023-10-09T06:27:08.388570+0000","last_undegraded":"2023-10-09T06:27:08.388570+0000","last_fullsized":"2023-10-09T06:27:08.388570+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:47.326557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.380192+0000","last_change":"2023-10-09T06:27:08.380192+0000","last_active":"2023-10-09T06:27:08.380192+0000","last_peered":"2023-10-09T06:27:08.380192+0000","last_clean":"2023-10-09T06:27:08.380192+0000","last_became_active":"2023-10-09T06:27:08.379964+0000","last_became_peered":"2023-10-09T06:27:08.379964+0000","last_unstale":"2023-10-09T06:27:08.380192+0000","last_undegraded":"2023-10-09T06:27:08.380192+0000","last_fullsized":"2023-10-09T06:27:08.380192+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:29.093514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"135'1","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.377610+0000","last_change":"2023-10-09T06:27:07.380723+0000","last_active":"2023-10-09T06:27:08.377610+0000","last_peered":"2023-10-09T06:27:08.377610+0000","last_clean":"2023-10-09T06:27:08.377610+0000","last_became_active":"2023-10-09T06:27:07.380503+0000","last_became_peered":"2023-10-09T06:27:07.380503+0000","last_unstale":"2023-10-09T06:27:08.377610+0000","last_undegraded":"2023-10-09T06:27:08.377610+0000","last_fullsized":"2023-10-09T06:27:08.377610+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:58:45.581064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.383289+0000","last_change":"2023-10-09T06:27:08.383289+0000","last_active":"2023-10-09T06:27:08.383289+0000","last_peered":"2023-10-09T06:27:08.383289+0000","last_clean":"2023-10-09T06:27:08.383289+0000","last_became_active":"2023-10-09T06:27:08.382801+0000","last_became_peered":"2023-10-09T06:27:08.382801+0000","last_unstale":"2023-10-09T06:27:08.383289+0000","last_undegraded":"2023-10-09T06:27:08.383289+0000","last_fullsized":"2023-10-09T06:27:08.383289+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:55.943136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"135'2","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.395175+0000","last_change":"2023-10-09T06:27:07.384567+0000","last_active":"2023-10-09T06:27:08.395175+0000","last_peered":"2023-10-09T06:27:08.395175+0000","last_clean":"2023-10-09T06:27:08.395175+0000","last_became_active":"2023-10-09T06:27:07.383921+0000","last_became_peered":"2023-10-09T06:27:07.383921+0000","last_unstale":"2023-10-09T06:27:08.395175+0000","last_undegraded":"2023-10-09T06:27:08.395175+0000","last_fullsized":"2023-10-09T06:27:08.395175+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:59:11.638276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.380320+0000","last_change":"2023-10-09T06:27:08.380320+0000","last_active":"2023-10-09T06:27:08.380320+0000","last_peered":"2023-10-09T06:27:08.380320+0000","last_clean":"2023-10-09T06:27:08.380320+0000","last_became_active":"2023-10-09T06:27:08.380021+0000","last_became_peered":"2023-10-09T06:27:08.380021+0000","last_unstale":"2023-10-09T06:27:08.380320+0000","last_undegraded":"2023-10-09T06:27:08.380320+0000","last_fullsized":"2023-10-09T06:27:08.380320+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:10.473419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"135'2","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.393083+0000","last_change":"2023-10-09T06:27:07.380711+0000","last_active":"2023-10-09T06:27:08.393083+0000","last_peered":"2023-10-09T06:27:08.393083+0000","last_clean":"2023-10-09T06:27:08.393083+0000","last_became_active":"2023-10-09T06:27:07.380359+0000","last_became_peered":"2023-10-09T06:27:07.380359+0000","last_unstale":"2023-10-09T06:27:08.393083+0000","last_undegraded":"2023-10-09T06:27:08.393083+0000","last_fullsized":"2023-10-09T06:27:08.393083+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:34:48.181739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.395930+0000","last_change":"2023-10-09T06:27:08.395930+0000","last_active":"2023-10-09T06:27:08.395930+0000","last_peered":"2023-10-09T06:27:08.395930+0000","last_clean":"2023-10-09T06:27:08.395930+0000","last_became_active":"2023-10-09T06:27:08.395715+0000","last_became_peered":"2023-10-09T06:27:08.395715+0000","last_unstale":"2023-10-09T06:27:08.395930+0000","last_undegraded":"2023-10-09T06:27:08.395930+0000","last_fullsized":"2023-10-09T06:27:08.395930+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:24.349154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"135'1","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.382514+0000","last_change":"2023-10-09T06:27:07.380625+0000","last_active":"2023-10-09T06:27:08.382514+0000","last_peered":"2023-10-09T06:27:08.382514+0000","last_clean":"2023-10-09T06:27:08.382514+0000","last_became_active":"2023-10-09T06:27:07.380390+0000","last_became_peered":"2023-10-09T06:27:07.380390+0000","last_unstale":"2023-10-09T06:27:08.382514+0000","last_undegraded":"2023-10-09T06:27:08.382514+0000","last_fullsized":"2023-10-09T06:27:08.382514+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:15.763246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.393549+0000","last_change":"2023-10-09T06:27:08.393549+0000","last_active":"2023-10-09T06:27:08.393549+0000","last_peered":"2023-10-09T06:27:08.393549+0000","last_clean":"2023-10-09T06:27:08.393549+0000","last_became_active":"2023-10-09T06:27:08.392994+0000","last_became_peered":"2023-10-09T06:27:08.392994+0000","last_unstale":"2023-10-09T06:27:08.393549+0000","last_undegraded":"2023-10-09T06:27:08.393549+0000","last_fullsized":"2023-10-09T06:27:08.393549+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:13.127385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"135'1","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.380017+0000","last_change":"2023-10-09T06:27:07.381771+0000","last_active":"2023-10-09T06:27:08.380017+0000","last_peered":"2023-10-09T06:27:08.380017+0000","last_clean":"2023-10-09T06:27:08.380017+0000","last_became_active":"2023-10-09T06:27:07.381498+0000","last_became_peered":"2023-10-09T06:27:07.381498+0000","last_unstale":"2023-10-09T06:27:08.380017+0000","last_undegraded":"2023-10-09T06:27:08.380017+0000","last_fullsized":"2023-10-09T06:27:08.380017+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:45:23.838601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.393607+0000","last_change":"2023-10-09T06:27:08.393607+0000","last_active":"2023-10-09T06:27:08.393607+0000","last_peered":"2023-10-09T06:27:08.393607+0000","last_clean":"2023-10-09T06:27:08.393607+0000","last_became_active":"2023-10-09T06:27:08.393330+0000","last_became_peered":"2023-10-09T06:27:08.393330+0000","last_unstale":"2023-10-09T06:27:08.393607+0000","last_undegraded":"2023-10-09T06:27:08.393607+0000","last_fullsized":"2023-10-09T06:27:08.393607+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:31.578252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.379937+0000","last_change":"2023-10-09T06:27:07.379863+0000","last_active":"2023-10-09T06:27:07.379937+0000","last_peered":"2023-10-09T06:27:07.379937+0000","last_clean":"2023-10-09T06:27:07.379937+0000","last_became_active":"2023-10-09T06:27:07.379613+0000","last_became_peered":"2023-10-09T06:27:07.379613+0000","last_unstale":"2023-10-09T06:27:07.379937+0000","last_undegraded":"2023-10-09T06:27:07.379937+0000","last_fullsized":"2023-10-09T06:27:07.379937+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:04.222808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.382929+0000","last_change":"2023-10-09T06:27:08.382929+0000","last_active":"2023-10-09T06:27:08.382929+0000","last_peered":"2023-10-09T06:27:08.382929+0000","last_clean":"2023-10-09T06:27:08.382929+0000","last_became_active":"2023-10-09T06:27:08.382313+0000","last_became_peered":"2023-10-09T06:27:08.382313+0000","last_unstale":"2023-10-09T06:27:08.382929+0000","last_undegraded":"2023-10-09T06:27:08.382929+0000","last_fullsized":"2023-10-09T06:27:08.382929+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:36:29.756527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.381654+0000","last_change":"2023-10-09T06:27:07.381534+0000","last_active":"2023-10-09T06:27:07.381654+0000","last_peered":"2023-10-09T06:27:07.381654+0000","last_clean":"2023-10-09T06:27:07.381654+0000","last_became_active":"2023-10-09T06:27:07.381049+0000","last_became_peered":"2023-10-09T06:27:07.381049+0000","last_unstale":"2023-10-09T06:27:07.381654+0000","last_undegraded":"2023-10-09T06:27:07.381654+0000","last_fullsized":"2023-10-09T06:27:07.381654+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:27.481425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384116+0000","last_change":"2023-10-09T06:27:08.384116+0000","last_active":"2023-10-09T06:27:08.384116+0000","last_peered":"2023-10-09T06:27:08.384116+0000","last_clean":"2023-10-09T06:27:08.384116+0000","last_became_active":"2023-10-09T06:27:08.383408+0000","last_became_peered":"2023-10-09T06:27:08.383408+0000","last_unstale":"2023-10-09T06:27:08.384116+0000","last_undegraded":"2023-10-09T06:27:08.384116+0000","last_fullsized":"2023-10-09T06:27:08.384116+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:47:05.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.380708+0000","last_change":"2023-10-09T06:27:07.380570+0000","last_active":"2023-10-09T06:27:07.380708+0000","last_peered":"2023-10-09T06:27:07.380708+0000","last_clean":"2023-10-09T06:27:07.380708+0000","last_became_active":"2023-10-09T06:27:07.380041+0000","last_became_peered":"2023-10-09T06:27:07.380041+0000","last_unstale":"2023-10-09T06:27:07.380708+0000","last_undegraded":"2023-10-09T06:27:07.380708+0000","last_fullsized":"2023-10-09T06:27:07.380708+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:33.350112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.391174+0000","last_change":"2023-10-09T06:27:08.391174+0000","last_active":"2023-10-09T06:27:08.391174+0000","last_peered":"2023-10-09T06:27:08.391174+0000","last_clean":"2023-10-09T06:27:08.391174+0000","last_became_active":"2023-10-09T06:27:08.391002+0000","last_became_peered":"2023-10-09T06:27:08.391002+0000","last_unstale":"2023-10-09T06:27:08.391174+0000","last_undegraded":"2023-10-09T06:27:08.391174+0000","last_fullsized":"2023-10-09T06:27:08.391174+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:17.672729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.379864+0000","last_change":"2023-10-09T06:27:07.379747+0000","last_active":"2023-10-09T06:27:07.379864+0000","last_peered":"2023-10-09T06:27:07.379864+0000","last_clean":"2023-10-09T06:27:07.379864+0000","last_became_active":"2023-10-09T06:27:07.379506+0000","last_became_peered":"2023-10-09T06:27:07.379506+0000","last_unstale":"2023-10-09T06:27:07.379864+0000","last_undegraded":"2023-10-09T06:27:07.379864+0000","last_fullsized":"2023-10-09T06:27:07.379864+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:39.062921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.394752+0000","last_change":"2023-10-09T06:27:08.394752+0000","last_active":"2023-10-09T06:27:08.394752+0000","last_peered":"2023-10-09T06:27:08.394752+0000","last_clean":"2023-10-09T06:27:08.394752+0000","last_became_active":"2023-10-09T06:27:08.389637+0000","last_became_peered":"2023-10-09T06:27:08.389637+0000","last_unstale":"2023-10-09T06:27:08.394752+0000","last_undegraded":"2023-10-09T06:27:08.394752+0000","last_fullsized":"2023-10-09T06:27:08.394752+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:10.473419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"135'3","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.401270+0000","last_change":"2023-10-09T06:27:07.382571+0000","last_active":"2023-10-09T06:27:08.401270+0000","last_peered":"2023-10-09T06:27:08.401270+0000","last_clean":"2023-10-09T06:27:08.401270+0000","last_became_active":"2023-10-09T06:27:07.381917+0000","last_became_peered":"2023-10-09T06:27:07.381917+0000","last_unstale":"2023-10-09T06:27:08.401270+0000","last_undegraded":"2023-10-09T06:27:08.401270+0000","last_fullsized":"2023-10-09T06:27:08.401270+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:44.335912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.381822+0000","last_change":"2023-10-09T06:27:08.381822+0000","last_active":"2023-10-09T06:27:08.381822+0000","last_peered":"2023-10-09T06:27:08.381822+0000","last_clean":"2023-10-09T06:27:08.381822+0000","last_became_active":"2023-10-09T06:27:08.381597+0000","last_became_peered":"2023-10-09T06:27:08.381597+0000","last_unstale":"2023-10-09T06:27:08.381822+0000","last_undegraded":"2023-10-09T06:27:08.381822+0000","last_fullsized":"2023-10-09T06:27:08.381822+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:28:47.933705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"135'6","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.400947+0000","last_change":"2023-10-09T06:27:07.383635+0000","last_active":"2023-10-09T06:27:08.400947+0000","last_peered":"2023-10-09T06:27:08.400947+0000","last_clean":"2023-10-09T06:27:08.400947+0000","last_became_active":"2023-10-09T06:27:07.382658+0000","last_became_peered":"2023-10-09T06:27:07.382658+0000","last_unstale":"2023-10-09T06:27:08.400947+0000","last_undegraded":"2023-10-09T06:27:08.400947+0000","last_fullsized":"2023-10-09T06:27:08.400947+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:27:35.910477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.382403+0000","last_change":"2023-10-09T06:27:08.382403+0000","last_active":"2023-10-09T06:27:08.382403+0000","last_peered":"2023-10-09T06:27:08.382403+0000","last_clean":"2023-10-09T06:27:08.382403+0000","last_became_active":"2023-10-09T06:27:08.382152+0000","last_became_peered":"2023-10-09T06:27:08.382152+0000","last_unstale":"2023-10-09T06:27:08.382403+0000","last_undegraded":"2023-10-09T06:27:08.382403+0000","last_fullsized":"2023-10-09T06:27:08.382403+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:39:31.069062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"135'2","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.397098+0000","last_change":"2023-10-09T06:27:07.382532+0000","last_active":"2023-10-09T06:27:08.397098+0000","last_peered":"2023-10-09T06:27:08.397098+0000","last_clean":"2023-10-09T06:27:08.397098+0000","last_became_active":"2023-10-09T06:27:07.382261+0000","last_became_peered":"2023-10-09T06:27:07.382261+0000","last_unstale":"2023-10-09T06:27:08.397098+0000","last_undegraded":"2023-10-09T06:27:08.397098+0000","last_fullsized":"2023-10-09T06:27:08.397098+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:59:11.638276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.394626+0000","last_change":"2023-10-09T06:27:08.394626+0000","last_active":"2023-10-09T06:27:08.394626+0000","last_peered":"2023-10-09T06:27:08.394626+0000","last_clean":"2023-10-09T06:27:08.394626+0000","last_became_active":"2023-10-09T06:27:08.393787+0000","last_became_peered":"2023-10-09T06:27:08.393787+0000","last_unstale":"2023-10-09T06:27:08.394626+0000","last_undegraded":"2023-10-09T06:27:08.394626+0000","last_fullsized":"2023-10-09T06:27:08.394626+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:41.346115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.383779+0000","last_change":"2023-10-09T06:27:07.383707+0000","last_active":"2023-10-09T06:27:07.383779+0000","last_peered":"2023-10-09T06:27:07.383779+0000","last_clean":"2023-10-09T06:27:07.383779+0000","last_became_active":"2023-10-09T06:27:07.383334+0000","last_became_peered":"2023-10-09T06:27:07.383334+0000","last_unstale":"2023-10-09T06:27:07.383779+0000","last_undegraded":"2023-10-09T06:27:07.383779+0000","last_fullsized":"2023-10-09T06:27:07.383779+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:58:45.581064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.394368+0000","last_change":"2023-10-09T06:27:08.394368+0000","last_active":"2023-10-09T06:27:08.394368+0000","last_peered":"2023-10-09T06:27:08.394368+0000","last_clean":"2023-10-09T06:27:08.394368+0000","last_became_active":"2023-10-09T06:27:08.390022+0000","last_became_peered":"2023-10-09T06:27:08.390022+0000","last_unstale":"2023-10-09T06:27:08.394368+0000","last_undegraded":"2023-10-09T06:27:08.394368+0000","last_fullsized":"2023-10-09T06:27:08.394368+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:18:43.616024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"135'8","reported_seq":17,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.398555+0000","last_change":"2023-10-09T06:27:07.383738+0000","last_active":"2023-10-09T06:27:08.398555+0000","last_peered":"2023-10-09T06:27:08.398555+0000","last_clean":"2023-10-09T06:27:08.398555+0000","last_became_active":"2023-10-09T06:27:07.383352+0000","last_became_peered":"2023-10-09T06:27:07.383352+0000","last_unstale":"2023-10-09T06:27:08.398555+0000","last_undegraded":"2023-10-09T06:27:08.398555+0000","last_fullsized":"2023-10-09T06:27:08.398555+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:04:30.599488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.391358+0000","last_change":"2023-10-09T06:27:08.391358+0000","last_active":"2023-10-09T06:27:08.391358+0000","last_peered":"2023-10-09T06:27:08.391358+0000","last_clean":"2023-10-09T06:27:08.391358+0000","last_became_active":"2023-10-09T06:27:08.390967+0000","last_became_peered":"2023-10-09T06:27:08.390967+0000","last_unstale":"2023-10-09T06:27:08.391358+0000","last_undegraded":"2023-10-09T06:27:08.391358+0000","last_fullsized":"2023-10-09T06:27:08.391358+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:55.782445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"135'1","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384315+0000","last_change":"2023-10-09T06:27:07.383910+0000","last_active":"2023-10-09T06:27:08.384315+0000","last_peered":"2023-10-09T06:27:08.384315+0000","last_clean":"2023-10-09T06:27:08.384315+0000","last_became_active":"2023-10-09T06:27:07.383289+0000","last_became_peered":"2023-10-09T06:27:07.383289+0000","last_unstale":"2023-10-09T06:27:08.384315+0000","last_undegraded":"2023-10-09T06:27:08.384315+0000","last_fullsized":"2023-10-09T06:27:08.384315+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:35.468539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.385802+0000","last_change":"2023-10-09T06:27:08.385802+0000","last_active":"2023-10-09T06:27:08.385802+0000","last_peered":"2023-10-09T06:27:08.385802+0000","last_clean":"2023-10-09T06:27:08.385802+0000","last_became_active":"2023-10-09T06:27:08.385569+0000","last_became_peered":"2023-10-09T06:27:08.385569+0000","last_unstale":"2023-10-09T06:27:08.385802+0000","last_undegraded":"2023-10-09T06:27:08.385802+0000","last_fullsized":"2023-10-09T06:27:08.385802+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:07:26.606672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"135'2","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.387604+0000","last_change":"2023-10-09T06:27:07.378519+0000","last_active":"2023-10-09T06:27:08.387604+0000","last_peered":"2023-10-09T06:27:08.387604+0000","last_clean":"2023-10-09T06:27:08.387604+0000","last_became_active":"2023-10-09T06:27:07.378287+0000","last_became_peered":"2023-10-09T06:27:07.378287+0000","last_unstale":"2023-10-09T06:27:08.387604+0000","last_undegraded":"2023-10-09T06:27:08.387604+0000","last_fullsized":"2023-10-09T06:27:08.387604+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:05.333297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.390094+0000","last_change":"2023-10-09T06:27:08.390094+0000","last_active":"2023-10-09T06:27:08.390094+0000","last_peered":"2023-10-09T06:27:08.390094+0000","last_clean":"2023-10-09T06:27:08.390094+0000","last_became_active":"2023-10-09T06:27:08.389869+0000","last_became_peered":"2023-10-09T06:27:08.389869+0000","last_unstale":"2023-10-09T06:27:08.390094+0000","last_undegraded":"2023-10-09T06:27:08.390094+0000","last_fullsized":"2023-10-09T06:27:08.390094+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:39:31.069062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"135'1","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.374768+0000","last_change":"2023-10-09T06:27:07.379721+0000","last_active":"2023-10-09T06:27:08.374768+0000","last_peered":"2023-10-09T06:27:08.374768+0000","last_clean":"2023-10-09T06:27:08.374768+0000","last_became_active":"2023-10-09T06:27:07.379489+0000","last_became_peered":"2023-10-09T06:27:07.379489+0000","last_unstale":"2023-10-09T06:27:08.374768+0000","last_undegraded":"2023-10-09T06:27:08.374768+0000","last_fullsized":"2023-10-09T06:27:08.374768+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:19:58.425004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.382431+0000","last_change":"2023-10-09T06:27:08.382431+0000","last_active":"2023-10-09T06:27:08.382431+0000","last_peered":"2023-10-09T06:27:08.382431+0000","last_clean":"2023-10-09T06:27:08.382431+0000","last_became_active":"2023-10-09T06:27:08.382031+0000","last_became_peered":"2023-10-09T06:27:08.382031+0000","last_unstale":"2023-10-09T06:27:08.382431+0000","last_undegraded":"2023-10-09T06:27:08.382431+0000","last_fullsized":"2023-10-09T06:27:08.382431+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:17.672729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.381752+0000","last_change":"2023-10-09T06:27:07.381690+0000","last_active":"2023-10-09T06:27:07.381752+0000","last_peered":"2023-10-09T06:27:07.381752+0000","last_clean":"2023-10-09T06:27:07.381752+0000","last_became_active":"2023-10-09T06:27:07.381483+0000","last_became_peered":"2023-10-09T06:27:07.381483+0000","last_unstale":"2023-10-09T06:27:07.381752+0000","last_undegraded":"2023-10-09T06:27:07.381752+0000","last_fullsized":"2023-10-09T06:27:07.381752+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:54.938152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384444+0000","last_change":"2023-10-09T06:27:08.384444+0000","last_active":"2023-10-09T06:27:08.384444+0000","last_peered":"2023-10-09T06:27:08.384444+0000","last_clean":"2023-10-09T06:27:08.384444+0000","last_became_active":"2023-10-09T06:27:08.383501+0000","last_became_peered":"2023-10-09T06:27:08.383501+0000","last_unstale":"2023-10-09T06:27:08.384444+0000","last_undegraded":"2023-10-09T06:27:08.384444+0000","last_fullsized":"2023-10-09T06:27:08.384444+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:18:43.616024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"135'2","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.393620+0000","last_change":"2023-10-09T06:27:07.385762+0000","last_active":"2023-10-09T06:27:08.393620+0000","last_peered":"2023-10-09T06:27:08.393620+0000","last_clean":"2023-10-09T06:27:08.393620+0000","last_became_active":"2023-10-09T06:27:07.385545+0000","last_became_peered":"2023-10-09T06:27:07.385545+0000","last_unstale":"2023-10-09T06:27:08.393620+0000","last_undegraded":"2023-10-09T06:27:08.393620+0000","last_fullsized":"2023-10-09T06:27:08.393620+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:31.772554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.392649+0000","last_change":"2023-10-09T06:27:08.392649+0000","last_active":"2023-10-09T06:27:08.392649+0000","last_peered":"2023-10-09T06:27:08.392649+0000","last_clean":"2023-10-09T06:27:08.392649+0000","last_became_active":"2023-10-09T06:27:08.386884+0000","last_became_peered":"2023-10-09T06:27:08.386884+0000","last_unstale":"2023-10-09T06:27:08.392649+0000","last_undegraded":"2023-10-09T06:27:08.392649+0000","last_fullsized":"2023-10-09T06:27:08.392649+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:27.209194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.380374+0000","last_change":"2023-10-09T06:27:07.380024+0000","last_active":"2023-10-09T06:27:07.380374+0000","last_peered":"2023-10-09T06:27:07.380374+0000","last_clean":"2023-10-09T06:27:07.380374+0000","last_became_active":"2023-10-09T06:27:07.379786+0000","last_became_peered":"2023-10-09T06:27:07.379786+0000","last_unstale":"2023-10-09T06:27:07.380374+0000","last_undegraded":"2023-10-09T06:27:07.380374+0000","last_fullsized":"2023-10-09T06:27:07.380374+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:14.085432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.388510+0000","last_change":"2023-10-09T06:27:08.388510+0000","last_active":"2023-10-09T06:27:08.388510+0000","last_peered":"2023-10-09T06:27:08.388510+0000","last_clean":"2023-10-09T06:27:08.388510+0000","last_became_active":"2023-10-09T06:27:08.388282+0000","last_became_peered":"2023-10-09T06:27:08.388282+0000","last_unstale":"2023-10-09T06:27:08.388510+0000","last_undegraded":"2023-10-09T06:27:08.388510+0000","last_fullsized":"2023-10-09T06:27:08.388510+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:58:51.451073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.383677+0000","last_change":"2023-10-09T06:27:07.383544+0000","last_active":"2023-10-09T06:27:07.383677+0000","last_peered":"2023-10-09T06:27:07.383677+0000","last_clean":"2023-10-09T06:27:07.383677+0000","last_became_active":"2023-10-09T06:27:07.383296+0000","last_became_peered":"2023-10-09T06:27:07.383296+0000","last_unstale":"2023-10-09T06:27:07.383677+0000","last_undegraded":"2023-10-09T06:27:07.383677+0000","last_fullsized":"2023-10-09T06:27:07.383677+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:02.865195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.399398+0000","last_change":"2023-10-09T06:27:08.399398+0000","last_active":"2023-10-09T06:27:08.399398+0000","last_peered":"2023-10-09T06:27:08.399398+0000","last_clean":"2023-10-09T06:27:08.399398+0000","last_became_active":"2023-10-09T06:27:08.396943+0000","last_became_peered":"2023-10-09T06:27:08.396943+0000","last_unstale":"2023-10-09T06:27:08.399398+0000","last_undegraded":"2023-10-09T06:27:08.399398+0000","last_fullsized":"2023-10-09T06:27:08.399398+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:36.473523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.385434+0000","last_change":"2023-10-09T06:27:07.385001+0000","last_active":"2023-10-09T06:27:07.385434+0000","last_peered":"2023-10-09T06:27:07.385434+0000","last_clean":"2023-10-09T06:27:07.385434+0000","last_became_active":"2023-10-09T06:27:07.381932+0000","last_became_peered":"2023-10-09T06:27:07.381932+0000","last_unstale":"2023-10-09T06:27:07.385434+0000","last_undegraded":"2023-10-09T06:27:07.385434+0000","last_fullsized":"2023-10-09T06:27:07.385434+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:58:50.446089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.386139+0000","last_change":"2023-10-09T06:27:08.386139+0000","last_active":"2023-10-09T06:27:08.386139+0000","last_peered":"2023-10-09T06:27:08.386139+0000","last_clean":"2023-10-09T06:27:08.386139+0000","last_became_active":"2023-10-09T06:27:08.385891+0000","last_became_peered":"2023-10-09T06:27:08.385891+0000","last_unstale":"2023-10-09T06:27:08.386139+0000","last_undegraded":"2023-10-09T06:27:08.386139+0000","last_fullsized":"2023-10-09T06:27:08.386139+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:33:05.093021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"135'2","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.399060+0000","last_change":"2023-10-09T06:27:07.385763+0000","last_active":"2023-10-09T06:27:08.399060+0000","last_peered":"2023-10-09T06:27:08.399060+0000","last_clean":"2023-10-09T06:27:08.399060+0000","last_became_active":"2023-10-09T06:27:07.385539+0000","last_became_peered":"2023-10-09T06:27:07.385539+0000","last_unstale":"2023-10-09T06:27:08.399060+0000","last_undegraded":"2023-10-09T06:27:08.399060+0000","last_fullsized":"2023-10-09T06:27:08.399060+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:59.423310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.390114+0000","last_change":"2023-10-09T06:27:08.390114+0000","last_active":"2023-10-09T06:27:08.390114+0000","last_peered":"2023-10-09T06:27:08.390114+0000","last_clean":"2023-10-09T06:27:08.390114+0000","last_became_active":"2023-10-09T06:27:08.389496+0000","last_became_peered":"2023-10-09T06:27:08.389496+0000","last_unstale":"2023-10-09T06:27:08.390114+0000","last_undegraded":"2023-10-09T06:27:08.390114+0000","last_fullsized":"2023-10-09T06:27:08.390114+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:19:23.125037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.380952+0000","last_change":"2023-10-09T06:27:07.380880+0000","last_active":"2023-10-09T06:27:07.380952+0000","last_peered":"2023-10-09T06:27:07.380952+0000","last_clean":"2023-10-09T06:27:07.380952+0000","last_became_active":"2023-10-09T06:27:07.380616+0000","last_became_peered":"2023-10-09T06:27:07.380616+0000","last_unstale":"2023-10-09T06:27:07.380952+0000","last_undegraded":"2023-10-09T06:27:07.380952+0000","last_fullsized":"2023-10-09T06:27:07.380952+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:35.182739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.389660+0000","last_change":"2023-10-09T06:27:08.389660+0000","last_active":"2023-10-09T06:27:08.389660+0000","last_peered":"2023-10-09T06:27:08.389660+0000","last_clean":"2023-10-09T06:27:08.389660+0000","last_became_active":"2023-10-09T06:27:08.386710+0000","last_became_peered":"2023-10-09T06:27:08.386710+0000","last_unstale":"2023-10-09T06:27:08.389660+0000","last_undegraded":"2023-10-09T06:27:08.389660+0000","last_fullsized":"2023-10-09T06:27:08.389660+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:15.191104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.384025+0000","last_change":"2023-10-09T06:27:07.383776+0000","last_active":"2023-10-09T06:27:07.384025+0000","last_peered":"2023-10-09T06:27:07.384025+0000","last_clean":"2023-10-09T06:27:07.384025+0000","last_became_active":"2023-10-09T06:27:07.383000+0000","last_became_peered":"2023-10-09T06:27:07.383000+0000","last_unstale":"2023-10-09T06:27:07.384025+0000","last_undegraded":"2023-10-09T06:27:07.384025+0000","last_fullsized":"2023-10-09T06:27:07.384025+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:12.122401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.386458+0000","last_change":"2023-10-09T06:27:08.386458+0000","last_active":"2023-10-09T06:27:08.386458+0000","last_peered":"2023-10-09T06:27:08.386458+0000","last_clean":"2023-10-09T06:27:08.386458+0000","last_became_active":"2023-10-09T06:27:08.385844+0000","last_became_peered":"2023-10-09T06:27:08.385844+0000","last_unstale":"2023-10-09T06:27:08.386458+0000","last_undegraded":"2023-10-09T06:27:08.386458+0000","last_fullsized":"2023-10-09T06:27:08.386458+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:58:51.451073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.382069+0000","last_change":"2023-10-09T06:27:07.381965+0000","last_active":"2023-10-09T06:27:07.382069+0000","last_peered":"2023-10-09T06:27:07.382069+0000","last_clean":"2023-10-09T06:27:07.382069+0000","last_became_active":"2023-10-09T06:27:07.381743+0000","last_became_peered":"2023-10-09T06:27:07.381743+0000","last_unstale":"2023-10-09T06:27:07.382069+0000","last_undegraded":"2023-10-09T06:27:07.382069+0000","last_fullsized":"2023-10-09T06:27:07.382069+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:58:45.581064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384178+0000","last_change":"2023-10-09T06:27:08.384178+0000","last_active":"2023-10-09T06:27:08.384178+0000","last_peered":"2023-10-09T06:27:08.384178+0000","last_clean":"2023-10-09T06:27:08.384178+0000","last_became_active":"2023-10-09T06:27:08.383935+0000","last_became_peered":"2023-10-09T06:27:08.383935+0000","last_unstale":"2023-10-09T06:27:08.384178+0000","last_undegraded":"2023-10-09T06:27:08.384178+0000","last_fullsized":"2023-10-09T06:27:08.384178+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:39:31.069062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.379871+0000","last_change":"2023-10-09T06:27:07.379534+0000","last_active":"2023-10-09T06:27:07.379871+0000","last_peered":"2023-10-09T06:27:07.379871+0000","last_clean":"2023-10-09T06:27:07.379871+0000","last_became_active":"2023-10-09T06:27:07.379276+0000","last_became_peered":"2023-10-09T06:27:07.379276+0000","last_unstale":"2023-10-09T06:27:07.379871+0000","last_undegraded":"2023-10-09T06:27:07.379871+0000","last_fullsized":"2023-10-09T06:27:07.379871+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:50.111575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.379945+0000","last_change":"2023-10-09T06:27:08.379945+0000","last_active":"2023-10-09T06:27:08.379945+0000","last_peered":"2023-10-09T06:27:08.379945+0000","last_clean":"2023-10-09T06:27:08.379945+0000","last_became_active":"2023-10-09T06:27:08.379680+0000","last_became_peered":"2023-10-09T06:27:08.379680+0000","last_unstale":"2023-10-09T06:27:08.379945+0000","last_undegraded":"2023-10-09T06:27:08.379945+0000","last_fullsized":"2023-10-09T06:27:08.379945+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:00.855382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.380826+0000","last_change":"2023-10-09T06:27:07.380723+0000","last_active":"2023-10-09T06:27:07.380826+0000","last_peered":"2023-10-09T06:27:07.380826+0000","last_clean":"2023-10-09T06:27:07.380826+0000","last_became_active":"2023-10-09T06:27:07.380500+0000","last_became_peered":"2023-10-09T06:27:07.380500+0000","last_unstale":"2023-10-09T06:27:07.380826+0000","last_undegraded":"2023-10-09T06:27:07.380826+0000","last_fullsized":"2023-10-09T06:27:07.380826+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:28:46.928721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.384596+0000","last_change":"2023-10-09T06:27:08.384596+0000","last_active":"2023-10-09T06:27:08.384596+0000","last_peered":"2023-10-09T06:27:08.384596+0000","last_clean":"2023-10-09T06:27:08.384596+0000","last_became_active":"2023-10-09T06:27:08.383695+0000","last_became_peered":"2023-10-09T06:27:08.383695+0000","last_unstale":"2023-10-09T06:27:08.384596+0000","last_undegraded":"2023-10-09T06:27:08.384596+0000","last_fullsized":"2023-10-09T06:27:08.384596+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:03.479306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.383811+0000","last_change":"2023-10-09T06:27:07.383600+0000","last_active":"2023-10-09T06:27:07.383811+0000","last_peered":"2023-10-09T06:27:07.383811+0000","last_clean":"2023-10-09T06:27:07.383811+0000","last_became_active":"2023-10-09T06:27:07.383007+0000","last_became_peered":"2023-10-09T06:27:07.383007+0000","last_unstale":"2023-10-09T06:27:07.383811+0000","last_undegraded":"2023-10-09T06:27:07.383811+0000","last_fullsized":"2023-10-09T06:27:07.383811+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:31.772554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.394362+0000","last_change":"2023-10-09T06:27:08.394362+0000","last_active":"2023-10-09T06:27:08.394362+0000","last_peered":"2023-10-09T06:27:08.394362+0000","last_clean":"2023-10-09T06:27:08.394362+0000","last_became_active":"2023-10-09T06:27:08.394133+0000","last_became_peered":"2023-10-09T06:27:08.394133+0000","last_unstale":"2023-10-09T06:27:08.394362+0000","last_undegraded":"2023-10-09T06:27:08.394362+0000","last_fullsized":"2023-10-09T06:27:08.394362+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:02.023350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.383991+0000","last_change":"2023-10-09T06:27:07.383503+0000","last_active":"2023-10-09T06:27:07.383991+0000","last_peered":"2023-10-09T06:27:07.383991+0000","last_clean":"2023-10-09T06:27:07.383991+0000","last_became_active":"2023-10-09T06:27:07.382395+0000","last_became_peered":"2023-10-09T06:27:07.382395+0000","last_unstale":"2023-10-09T06:27:07.383991+0000","last_undegraded":"2023-10-09T06:27:07.383991+0000","last_fullsized":"2023-10-09T06:27:07.383991+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:59.850398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-09T06:27:08.382248+0000","last_change":"2023-10-09T06:27:08.382248+0000","last_active":"2023-10-09T06:27:08.382248+0000","last_peered":"2023-10-09T06:27:08.382248+0000","last_clean":"2023-10-09T06:27:08.382248+0000","last_became_active":"2023-10-09T06:27:08.382047+0000","last_became_peered":"2023-10-09T06:27:08.382047+0000","last_unstale":"2023-10-09T06:27:08.382248+0000","last_undegraded":"2023-10-09T06:27:08.382248+0000","last_fullsized":"2023-10-09T06:27:08.382248+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:07.363921+0000","last_clean_scrub_stamp":"2023-10-09T06:27:07.363921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:27:36.915461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.384708+0000","last_change":"2023-10-09T06:27:07.384630+0000","last_active":"2023-10-09T06:27:07.384708+0000","last_peered":"2023-10-09T06:27:07.384708+0000","last_clean":"2023-10-09T06:27:07.384708+0000","last_became_active":"2023-10-09T06:27:07.384355+0000","last_became_peered":"2023-10-09T06:27:07.384355+0000","last_unstale":"2023-10-09T06:27:07.384708+0000","last_undegraded":"2023-10-09T06:27:07.384708+0000","last_fullsized":"2023-10-09T06:27:07.384708+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:06.358937+0000","last_clean_scrub_stamp":"2023-10-09T06:27:06.358937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:14.393281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":262,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-09T06:27:07.374075+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:27:07.374075+0000","last_peered":"2023-10-09T06:27:07.374075+0000","last_clean":"2023-10-09T06:27:07.374075+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:27:07.374075+0000","last_undegraded":"2023-10-09T06:27:07.374075+0000","last_fullsized":"2023-10-09T06:27:07.374075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1298,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194014,"statfs":{"total":200000000,"available":198670684,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53900000000000003,"15min":0.51100000000000001},"min":{"1min":0.32900000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79600000000000004,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.52700000000000002},"min":{"1min":0.33500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81100000000000005,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.48099999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.50600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64200000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54200000000000004,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76300000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.434}]},{"osd":2,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81899999999999995,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59199999999999997,"15min":0.54100000000000004},"min":{"1min":0.33700000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73999999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.61799999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.65000000000000002,"15min":0.57999999999999996},"min":{"1min":0.373,"5min":0.318,"15min":0.318},"max":{"1min":0.80900000000000005,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.64900000000000002,"15min":0.56699999999999995},"min":{"1min":0.435,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77400000000000002,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.54100000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45800000000000002,"15min":0.46999999999999997},"min":{"1min":0.27700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.64100000000000001,"5min":0.872,"15min":0.872},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77800000000000002,"5min":0.79800000000000004,"15min":0.86099999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48599999999999999,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.255,"15min":0.255},"max":{"1min":0.71799999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73999999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83599999999999997,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.74299999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.73199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":721,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194590,"statfs":{"total":200000000,"available":199261052,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.74399999999999999},"min":{"1min":0.35299999999999998,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.71699999999999997,"5min":0.77100000000000002,"15min":7.0960000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54600000000000004,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.133},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":1.155},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.317},"max":{"1min":0.75600000000000001,"5min":0.79300000000000004,"15min":1.1459999999999999},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.86499999999999999,"15min":1.2290000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55300000000000005,"15min":0.75800000000000001},"min":{"1min":0.378,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":7.1299999999999999},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.59399999999999997},"min":{"1min":0.44500000000000001,"5min":0.39100000000000001,"15min":0.34499999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":1.337},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73699999999999999,"5min":0.90400000000000003,"15min":1.206},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.498,"15min":0.497},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.33300000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.65500000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.501}]},{"osd":7,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.315},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.42699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194584,"statfs":{"total":200000000,"available":199254165,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34999999999999998,"15min":0.36599999999999999},"min":{"1min":0.223,"5min":0.219,"15min":0.219},"max":{"1min":0.41699999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.33800000000000002},"min":{"1min":0.247,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46899999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.27600000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.35099999999999998,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.46600000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.254},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40799999999999997,"15min":0.38800000000000001},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.48599999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.38400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45200000000000001,"15min":0.41699999999999998},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.29199999999999998},"max":{"1min":0.52800000000000002,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.443,"15min":0.42899999999999999},"min":{"1min":0.28999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.504,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59699999999999998,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.83199999999999996,"5min":1.097,"15min":1.097},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60999999999999999,"15min":0.79100000000000004},"min":{"1min":0.42699999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76400000000000001,"5min":1.0309999999999999,"15min":5.5270000000000001},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.47699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":1.125,"15min":1.125},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64400000000000002,"15min":0.66300000000000003},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":1.175,"15min":1.4219999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65200000000000002,"15min":0.622},"min":{"1min":0.45800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82599999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.46600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92300000000000004,"5min":1.125,"15min":1.49},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83599999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.67200000000000004,"15min":0.65600000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78600000000000003,"5min":1.052,"15min":1.052},"last":0.72699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1298,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194014,"statfs":{"total":200000000,"available":198670684,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35799999999999998,"15min":0.40799999999999997},"min":{"1min":0.23899999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.47199999999999998,"5min":0.65800000000000003,"15min":1.226},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.38400000000000001,"15min":0.41999999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58899999999999997,"5min":0.71899999999999997,"15min":1.131},"last":0.40200000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38900000000000001,"15min":0.93799999999999994},"min":{"1min":0.30099999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52200000000000002,"5min":0.65200000000000002,"15min":12.929},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42099999999999999,"15min":0.45700000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.57199999999999995,"5min":0.70899999999999996,"15min":1.1599999999999999},"last":0.315}]},{"osd":3,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44400000000000001,"15min":0.47299999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.25600000000000001},"max":{"1min":0.66300000000000003,"5min":0.76100000000000001,"15min":1.1859999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.438,"15min":0.48399999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61899999999999999,"5min":0.69199999999999995,"15min":1.3089999999999999},"last":0.433}]},{"osd":4,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59799999999999998,"15min":0.61299999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73299999999999998,"5min":0.86299999999999999,"15min":0.93200000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.60699999999999998,"15min":0.64900000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.41099999999999998},"max":{"1min":0.72799999999999998,"5min":0.97099999999999997,"15min":1.335},"last":0.65400000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.74099999999999999,"5min":0.90700000000000003,"15min":1.0580000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.999},"last":0.57099999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86499999999999999,"5min":0.93899999999999995,"15min":1.2849999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64000000000000001,"15min":0.67400000000000004},"min":{"1min":0.40500000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.262},"last":0.62},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64700000000000002,"15min":0.66500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.95599999999999996,"15min":1.103},"last":0.52000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":721,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194590,"statfs":{"total":200000000,"available":199261052,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.35199999999999998,"15min":0.83599999999999997},"min":{"1min":0.24299999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.60899999999999999,"5min":0.79000000000000004,"15min":14.981999999999999},"last":0.371},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.379,"15min":0.64600000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":9.1600000000000001},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35799999999999998,"15min":0.60799999999999998},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.52500000000000002,"5min":0.73099999999999998,"15min":8.4930000000000003},"last":0.438},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.45800000000000002,"15min":0.67800000000000005},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.254},"max":{"1min":0.56499999999999995,"5min":4.6870000000000003,"15min":9.0239999999999991},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.44,"15min":0.68100000000000005},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.622,"5min":0.84299999999999997,"15min":8.5190000000000001},"last":0.5},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.441,"15min":0.89900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.60699999999999998,"5min":0.87,"15min":15.007999999999999},"last":0.52200000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.625,"15min":1.097},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":14.917999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.90500000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92300000000000004,"5min":1.1160000000000001,"15min":8.9930000000000003},"last":0.90300000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63800000000000001,"15min":0.88200000000000001},"min":{"1min":0.436,"5min":0.376,"15min":0.35899999999999999},"max":{"1min":0.78000000000000003,"5min":0.96299999999999997,"15min":8.9610000000000003},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64800000000000002,"15min":0.88800000000000001},"min":{"1min":0.433,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.872,"5min":1.006,"15min":8.3919999999999995},"last":0.96699999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.87},"min":{"1min":0.48899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79600000000000004,"5min":1.026,"15min":8.4339999999999993},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64800000000000002,"15min":1.0980000000000001},"min":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.85099999999999998,"5min":1.028,"15min":14.954000000000001},"last":0.99099999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.86699999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.874,"5min":1.0049999999999999,"15min":8.9160000000000004},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.88300000000000001},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89200000000000002,"5min":1.0609999999999999,"15min":8.4640000000000004},"last":0.83199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":721,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194590,"statfs":{"total":200000000,"available":199261052,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58599999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.247},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41699999999999998,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.39500000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35599999999999998,"15min":0.32800000000000001},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.215},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.312},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.40000000000000002,"15min":0.35699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.51700000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38800000000000001,"15min":0.36499999999999999},"min":{"1min":0.27000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46899999999999997,"15min":0.42499999999999999},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.375}]},{"osd":4,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.375},"max":{"1min":0.77700000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.434,"5min":0.372,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.84799999999999998,"15min":0.91500000000000004},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64200000000000002,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.65200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.623}]},{"osd":7,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64000000000000001,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.38800000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63600000000000001,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.91700000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194584,"statfs":{"total":200000000,"available":199254289,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.53000000000000003,"15min":0.498},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.29299999999999998},"max":{"1min":0.66400000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.318},"max":{"1min":0.63100000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53500000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53400000000000003,"15min":0.51400000000000001},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.254},"max":{"1min":0.60399999999999998,"5min":0.74399999999999999,"15min":0.77000000000000002},"last":0.495},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.69599999999999995},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.34499999999999997},"max":{"1min":0.66700000000000004,"5min":1.5680000000000001,"15min":4.3250000000000002},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.68600000000000005},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.67800000000000005,"5min":1.7110000000000001,"15min":4.7320000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":1.03},"min":{"1min":0.41299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78200000000000003,"5min":0.80200000000000005,"15min":11.715},"last":0.51600000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56799999999999995,"15min":0.52600000000000002},"min":{"1min":0.38900000000000001,"5min":0.35199999999999998,"15min":0.34899999999999998},"max":{"1min":0.68400000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.44700000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72399999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61899999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.49299999999999999},"min":{"1min":0.27200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65200000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.502,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65900000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.38300000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.628}]},{"osd":7,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.754,"5min":0.879,"15min":0.879},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81200000000000006,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":721,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194590,"statfs":{"total":200000000,"available":199261052,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73699999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55800000000000005,"15min":0.52400000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35399999999999998},"max":{"1min":0.78500000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55000000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.752,"5min":1.093,"15min":1.093},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.52300000000000002},"min":{"1min":0.379,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81699999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58799999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57299999999999995,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70899999999999996,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.67700000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.55800000000000005},"min":{"1min":0.45800000000000002,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.745,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.628},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.58799999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76600000000000001,"5min":1.071,"15min":1.071},"last":0.66700000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71599999999999997,"5min":0.79000000000000004,"15min":0.84399999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.746,"5min":0.76900000000000002,"15min":0.81000000000000005},"last":0.47499999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49299999999999999,"15min":0.53300000000000003},"min":{"1min":0.36099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73299999999999998,"5min":0.85199999999999998,"15min":1.0680000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.67500000000000004,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.56299999999999994}]},{"osd":7,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":0.78200000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.435},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76600000000000001,"5min":0.84399999999999997,"15min":1.0269999999999999},"last":0.498}]}]}],"pool_statfs":[]}} 2023-10-09T06:27:13.887 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:27:13.888 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:27:14.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.049+0000 7f3d5759e700 1 Processor -- start 2023-10-09T06:27:14.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.049+0000 7f3d5759e700 1 -- start start 2023-10-09T06:27:14.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.050+0000 7f3d5759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3d581542a0 0x7f3d580b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:14.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.050+0000 7f3d5759e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d580cd630 0x7f3d5806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:14.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.050+0000 7f3d5759e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5806ac70 con 0x7f3d5806a830 2023-10-09T06:27:14.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.050+0000 7f3d5759e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5815b2e0 con 0x7f3d581542a0 2023-10-09T06:27:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.050+0000 7f3d5759e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5806b0a0 con 0x7f3d580cd630 2023-10-09T06:27:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.050+0000 7f3d5659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3d581542a0 0x7f3d580b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.050+0000 7f3d56d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3d5806a830 0x7f3d5815d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38322/0 (socket says 172.21.15.31:38322) 2023-10-09T06:27:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.050+0000 7f3d56d9d700 1 -- 172.21.15.31:0/1377321885 learned_addr learned my addr 172.21.15.31:0/1377321885 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.050+0000 7f3d5659c700 1 --2- 172.21.15.31:0/1377321885 >> v2:172.21.15.31:3300/0 conn(0x7f3d581542a0 0x7f3d580b65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39714/0 (socket says 172.21.15.31:39714) 2023-10-09T06:27:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.050+0000 7f3d55d9b700 1 --2- 172.21.15.31:0/1377321885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d580cd630 0x7f3d5806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.050+0000 7f3d5659c700 1 -- 172.21.15.31:0/1377321885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d580cd630 msgr2=0x7f3d5806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.050+0000 7f3d5659c700 1 --2- 172.21.15.31:0/1377321885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d580cd630 0x7f3d5806a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5659c700 1 -- 172.21.15.31:0/1377321885 >> v1:172.21.15.31:6789/0 conn(0x7f3d5806a830 legacy=0x7f3d5815d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5559a700 1 -- 172.21.15.31:0/1377321885 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529493101 0 0) 0x7f3d5806ac70 con 0x7f3d5806a830 2023-10-09T06:27:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5659c700 1 -- 172.21.15.31:0/1377321885 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5815ad20 con 0x7f3d581542a0 2023-10-09T06:27:14.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5659c700 1 --2- 172.21.15.31:0/1377321885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d581542a0 0x7f3d580b65a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009eb0 tx=0x7f3d48009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172c1ca7456a5857 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:14.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5559a700 1 -- 172.21.15.31:0/1377321885 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4800e070 con 0x7f3d581542a0 2023-10-09T06:27:14.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5559a700 1 -- 172.21.15.31:0/1377321885 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4800bc30 con 0x7f3d581542a0 2023-10-09T06:27:14.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5559a700 1 -- 172.21.15.31:0/1377321885 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48012430 con 0x7f3d581542a0 2023-10-09T06:27:14.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5759e700 1 -- 172.21.15.31:0/1377321885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d581542a0 msgr2=0x7f3d580b65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:14.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5759e700 1 --2- 172.21.15.31:0/1377321885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d581542a0 0x7f3d580b65a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009eb0 tx=0x7f3d48009780 comp rx=0 tx=0).stop 2023-10-09T06:27:14.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5759e700 1 -- 172.21.15.31:0/1377321885 shutdown_connections 2023-10-09T06:27:14.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5759e700 1 --2- 172.21.15.31:0/1377321885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d581542a0 0x7f3d580b65a0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5759e700 1 --2- 172.21.15.31:0/1377321885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d580cd630 0x7f3d5806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5759e700 1 -- 172.21.15.31:0/1377321885 >> 172.21.15.31:0/1377321885 conn(0x7f3d58068cb0 msgr2=0x7f3d580690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:14.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5759e700 1 -- 172.21.15.31:0/1377321885 shutdown_connections 2023-10-09T06:27:14.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.051+0000 7f3d5759e700 1 -- 172.21.15.31:0/1377321885 wait complete. 2023-10-09T06:27:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.052+0000 7f3d5759e700 1 Processor -- start 2023-10-09T06:27:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.053+0000 7f3d5759e700 1 -- start start 2023-10-09T06:27:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.053+0000 7f3d5759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d5806a830 0x7f3d581595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.053+0000 7f3d5759e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d580cd630 0x7f3d58158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.053+0000 7f3d5759e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d581542a0 0x7f3d581527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.053+0000 7f3d5759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580c6050 con 0x7f3d5806a830 2023-10-09T06:27:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.053+0000 7f3d5759e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580c5a70 con 0x7f3d580cd630 2023-10-09T06:27:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.053+0000 7f3d5759e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d58158840 con 0x7f3d581542a0 2023-10-09T06:27:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.053+0000 7f3d5659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d5806a830 0x7f3d581595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.053+0000 7f3d5659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d5806a830 0x7f3d581595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39718/0 (socket says 172.21.15.31:39718) 2023-10-09T06:27:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.053+0000 7f3d5659c700 1 -- 172.21.15.31:0/269814748 learned_addr learned my addr 172.21.15.31:0/269814748 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.053+0000 7f3d55d9b700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d580cd630 0x7f3d58158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.053+0000 7f3d56d9d700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d581542a0 0x7f3d581527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.054+0000 7f3d5659c700 1 -- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d581542a0 msgr2=0x7f3d581527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.054+0000 7f3d5659c700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d581542a0 0x7f3d581527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.054+0000 7f3d5659c700 1 -- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d580cd630 msgr2=0x7f3d58158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:14.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.054+0000 7f3d5659c700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d580cd630 0x7f3d58158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.054+0000 7f3d5659c700 1 -- 172.21.15.31:0/269814748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d48009a20 con 0x7f3d5806a830 2023-10-09T06:27:14.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.054+0000 7f3d5659c700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d5806a830 0x7f3d581595e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f3d48013000 tx=0x7f3d48019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:14.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.054+0000 7f3d4e7fc700 1 -- 172.21.15.31:0/269814748 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48012d20 con 0x7f3d5806a830 2023-10-09T06:27:14.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.054+0000 7f3d4e7fc700 1 -- 172.21.15.31:0/269814748 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d48027470 con 0x7f3d5806a830 2023-10-09T06:27:14.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.054+0000 7f3d5759e700 1 -- 172.21.15.31:0/269814748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d580c5ce0 con 0x7f3d5806a830 2023-10-09T06:27:14.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.054+0000 7f3d4e7fc700 1 -- 172.21.15.31:0/269814748 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48027830 con 0x7f3d5806a830 2023-10-09T06:27:14.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.054+0000 7f3d5759e700 1 -- 172.21.15.31:0/269814748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d58158b20 con 0x7f3d5806a830 2023-10-09T06:27:14.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.055+0000 7f3d5759e700 1 -- 172.21.15.31:0/269814748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d580c5e70 con 0x7f3d5806a830 2023-10-09T06:27:14.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.055+0000 7f3d4e7fc700 1 -- 172.21.15.31:0/269814748 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d48024070 con 0x7f3d5806a830 2023-10-09T06:27:14.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.056+0000 7f3d4e7fc700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3d38066f30 0x7f3d380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:14.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.056+0000 7f3d4e7fc700 1 -- 172.21.15.31:0/269814748 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d48086b40 con 0x7f3d5806a830 2023-10-09T06:27:14.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.056+0000 7f3d55d9b700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3d38066f30 0x7f3d380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:14.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.057+0000 7f3d55d9b700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3d38066f30 0x7f3d380693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3d580afcc0 tx=0x7f3d400091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:14.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.060+0000 7f3d4e7fc700 1 -- 172.21.15.31:0/269814748 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d48053db0 con 0x7f3d5806a830 2023-10-09T06:27:14.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.332+0000 7f3d5759e700 1 -- 172.21.15.31:0/269814748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3d5815d610 con 0x7f3d5806a830 2023-10-09T06:27:14.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.335+0000 7f3d4e7fc700 1 -- 172.21.15.31:0/269814748 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3d4802c020 con 0x7f3d5806a830 2023-10-09T06:27:14.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.338+0000 7f3d5759e700 1 -- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3d38066f30 msgr2=0x7f3d380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:14.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.338+0000 7f3d5759e700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3d38066f30 0x7f3d380693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3d580afcc0 tx=0x7f3d400091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.338+0000 7f3d5759e700 1 -- 172.21.15.31:0/269814748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d5806a830 msgr2=0x7f3d581595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:14.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.338+0000 7f3d5759e700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d5806a830 0x7f3d581595e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f3d48013000 tx=0x7f3d48019000 comp rx=0 tx=0).stop 2023-10-09T06:27:14.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.338+0000 7f3d5759e700 1 -- 172.21.15.31:0/269814748 shutdown_connections 2023-10-09T06:27:14.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.338+0000 7f3d5759e700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3d38066f30 0x7f3d380693e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.338+0000 7f3d5759e700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d581542a0 0x7f3d581527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.338+0000 7f3d5759e700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d5806a830 0x7f3d581595e0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.338+0000 7f3d5759e700 1 --2- 172.21.15.31:0/269814748 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d580cd630 0x7f3d58158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.338+0000 7f3d5759e700 1 -- 172.21.15.31:0/269814748 >> 172.21.15.31:0/269814748 conn(0x7f3d58068cb0 msgr2=0x7f3d580b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:14.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.338+0000 7f3d5759e700 1 -- 172.21.15.31:0/269814748 shutdown_connections 2023-10-09T06:27:14.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.338+0000 7f3d5759e700 1 -- 172.21.15.31:0/269814748 wait complete. 2023-10-09T06:27:14.339 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2023-10-09T06:27:14.349 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:27:14.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.469+0000 7fa61a81c700 1 Processor -- start 2023-10-09T06:27:14.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.469+0000 7fa61a81c700 1 -- start start 2023-10-09T06:27:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.470+0000 7fa61a81c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa61415a620 0x7fa61415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.470+0000 7fa61a81c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa61415d580 0x7fa614158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.470+0000 7fa61a81c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61415cbb0 con 0x7fa614157870 2023-10-09T06:27:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.470+0000 7fa61a81c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61415bdb0 con 0x7fa61415a620 2023-10-09T06:27:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.470+0000 7fa61a81c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61415bfa0 con 0x7fa61415d580 2023-10-09T06:27:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.470+0000 7fa6137fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa61415a620 0x7fa61415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.470+0000 7fa618db9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa61415d580 0x7fa614158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.471+0000 7fa613fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fa614157870 0x7fa61415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:36244/0 (socket says 172.21.15.31:36244) 2023-10-09T06:27:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.471+0000 7fa6137fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa61415a620 0x7fa61415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:35902/0 (socket says 172.21.15.31:35902) 2023-10-09T06:27:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.471+0000 7fa618db9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa61415d580 0x7fa614158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:33556/0 (socket says 172.21.15.31:33556) 2023-10-09T06:27:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.471+0000 7fa613fff700 1 -- 172.21.15.31:0/1538423852 learned_addr learned my addr 172.21.15.31:0/1538423852 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:14.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.471+0000 7fa6137fe700 1 -- 172.21.15.31:0/1538423852 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa61415d580 msgr2=0x7fa614158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:14.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.471+0000 7fa6137fe700 1 --2- 172.21.15.31:0/1538423852 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa61415d580 0x7fa614158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.471+0000 7fa6137fe700 1 -- 172.21.15.31:0/1538423852 >> v1:172.21.15.158:6789/0 conn(0x7fa614157870 legacy=0x7fa61415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:14.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.471+0000 7fa6137fe700 1 -- 172.21.15.31:0/1538423852 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61415c280 con 0x7fa61415a620 2023-10-09T06:27:14.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.471+0000 7fa612ffd700 1 -- 172.21.15.31:0/1538423852 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281848367 0 0) 0x7fa61415cbb0 con 0x7fa614157870 2023-10-09T06:27:14.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.471+0000 7fa6137fe700 1 --2- 172.21.15.31:0/1538423852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa61415a620 0x7fa61415d040 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0098e0 tx=0x7fa5fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da2f5e52cef92d49 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:14.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.471+0000 7fa612ffd700 1 -- 172.21.15.31:0/1538423852 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc00b640 con 0x7fa61415a620 2023-10-09T06:27:14.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.471+0000 7fa612ffd700 1 -- 172.21.15.31:0/1538423852 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc00b7a0 con 0x7fa61415a620 2023-10-09T06:27:14.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.471+0000 7fa612ffd700 1 -- 172.21.15.31:0/1538423852 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc00bb40 con 0x7fa61415a620 2023-10-09T06:27:14.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.472+0000 7fa61a81c700 1 -- 172.21.15.31:0/1538423852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa61415a620 msgr2=0x7fa61415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:14.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.472+0000 7fa61a81c700 1 --2- 172.21.15.31:0/1538423852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa61415a620 0x7fa61415d040 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0098e0 tx=0x7fa5fc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.472+0000 7fa61a81c700 1 -- 172.21.15.31:0/1538423852 shutdown_connections 2023-10-09T06:27:14.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.472+0000 7fa61a81c700 1 --2- 172.21.15.31:0/1538423852 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa61415d580 0x7fa614158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.472+0000 7fa61a81c700 1 --2- 172.21.15.31:0/1538423852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa61415a620 0x7fa61415d040 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.472+0000 7fa61a81c700 1 -- 172.21.15.31:0/1538423852 >> 172.21.15.31:0/1538423852 conn(0x7fa614068ce0 msgr2=0x7fa6140690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:14.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.472+0000 7fa61a81c700 1 -- 172.21.15.31:0/1538423852 shutdown_connections 2023-10-09T06:27:14.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.472+0000 7fa61a81c700 1 -- 172.21.15.31:0/1538423852 wait complete. 2023-10-09T06:27:14.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.473+0000 7fa61a81c700 1 Processor -- start 2023-10-09T06:27:14.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.473+0000 7fa61a81c700 1 -- start start 2023-10-09T06:27:14.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa61a81c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa614157870 0x7fa61416b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:14.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa61a81c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa61415a620 0x7fa6140b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:14.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa61a81c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa61415d580 0x7fa614152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:14.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa61a81c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140b65f0 con 0x7fa61415d580 2023-10-09T06:27:14.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa61a81c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140b06c0 con 0x7fa614157870 2023-10-09T06:27:14.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa61a81c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140b0c80 con 0x7fa61415a620 2023-10-09T06:27:14.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa618db9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa61415d580 0x7fa614152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:14.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa618db9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa61415d580 0x7fa614152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39720/0 (socket says 172.21.15.31:39720) 2023-10-09T06:27:14.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa618db9700 1 -- 172.21.15.31:0/1256186670 learned_addr learned my addr 172.21.15.31:0/1256186670 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:14.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa6137fe700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa61415a620 0x7fa6140b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:14.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa618db9700 1 -- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa61415a620 msgr2=0x7fa6140b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:14.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa613fff700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa614157870 0x7fa61416b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:14.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa618db9700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa61415a620 0x7fa6140b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa618db9700 1 -- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa614157870 msgr2=0x7fa61416b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:14.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa618db9700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa614157870 0x7fa61416b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa618db9700 1 -- 172.21.15.31:0/1256186670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc009420 con 0x7fa61415d580 2023-10-09T06:27:14.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.474+0000 7fa613fff700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa614157870 0x7fa61416b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:14.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.475+0000 7fa618db9700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa61415d580 0x7fa614152dc0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009dd0 tx=0x7fa60c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:14.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.475+0000 7fa60bfff700 1 -- 172.21.15.31:0/1256186670 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c00cb50 con 0x7fa61415d580 2023-10-09T06:27:14.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.475+0000 7fa60bfff700 1 -- 172.21.15.31:0/1256186670 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c00f040 con 0x7fa61415d580 2023-10-09T06:27:14.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.475+0000 7fa61a81c700 1 -- 172.21.15.31:0/1256186670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6140b6810 con 0x7fa61415d580 2023-10-09T06:27:14.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.475+0000 7fa60bfff700 1 -- 172.21.15.31:0/1256186670 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c014480 con 0x7fa61415d580 2023-10-09T06:27:14.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.475+0000 7fa61a81c700 1 -- 172.21.15.31:0/1256186670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6140b0910 con 0x7fa61415d580 2023-10-09T06:27:14.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.476+0000 7fa61a81c700 1 -- 172.21.15.31:0/1256186670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61404c3c0 con 0x7fa61415d580 2023-10-09T06:27:14.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.476+0000 7fa60bfff700 1 -- 172.21.15.31:0/1256186670 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa60c014830 con 0x7fa61415d580 2023-10-09T06:27:14.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.477+0000 7fa60bfff700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:14.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.477+0000 7fa60bfff700 1 -- 172.21.15.31:0/1256186670 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa60c085180 con 0x7fa61415d580 2023-10-09T06:27:14.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.477+0000 7fa613fff700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:14.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.477+0000 7fa613fff700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa5f4066f30 0x7fa5f40693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa6040018d0 tx=0x7fa604009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:14.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.481+0000 7fa60bfff700 1 -- 172.21.15.31:0/1256186670 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa60c0523f0 con 0x7fa61415d580 2023-10-09T06:27:14.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.719+0000 7fa61a81c700 1 -- 172.21.15.31:0/1256186670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6140b0dc0 con 0x7fa61415d580 2023-10-09T06:27:14.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.720+0000 7fa60bfff700 1 -- 172.21.15.31:0/1256186670 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fa60c055a10 con 0x7fa61415d580 2023-10-09T06:27:14.720 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:14.720 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/1232957657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1232957657},{"type":"v1","addr":"172.21.15.158:6836","nonce":1232957657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2947695434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2947695434},{"type":"v1","addr":"172.21.15.158:6837","nonce":2947695434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/912397379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":912397379},{"type":"v1","addr":"172.21.15.31:6834","nonce":912397379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:07.779885+0000","modified":"2023-10-09T06:27:12.402382+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7005},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7005":{"gid":7005,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1684509217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1684509217},{"type":"v1","addr":"172.21.15.31:6835","nonce":1684509217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T06:27:14.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.722+0000 7fa61a81c700 1 -- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa5f4066f30 msgr2=0x7fa5f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:14.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.722+0000 7fa61a81c700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa5f4066f30 0x7fa5f40693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa6040018d0 tx=0x7fa604009040 comp rx=0 tx=0).stop 2023-10-09T06:27:14.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.722+0000 7fa61a81c700 1 -- 172.21.15.31:0/1256186670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa61415d580 msgr2=0x7fa614152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:14.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.722+0000 7fa61a81c700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa61415d580 0x7fa614152dc0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009dd0 tx=0x7fa60c00b040 comp rx=0 tx=0).stop 2023-10-09T06:27:14.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.722+0000 7fa61a81c700 1 -- 172.21.15.31:0/1256186670 shutdown_connections 2023-10-09T06:27:14.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.722+0000 7fa61a81c700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.722+0000 7fa61a81c700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa61415d580 0x7fa614152dc0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.722+0000 7fa61a81c700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa614157870 0x7fa61416b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.722+0000 7fa61a81c700 1 --2- 172.21.15.31:0/1256186670 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa61415a620 0x7fa6140b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:14.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.722+0000 7fa61a81c700 1 -- 172.21.15.31:0/1256186670 >> 172.21.15.31:0/1256186670 conn(0x7fa614068ce0 msgr2=0x7fa61414c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:14.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.722+0000 7fa61a81c700 1 -- 172.21.15.31:0/1256186670 shutdown_connections 2023-10-09T06:27:14.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:14.722+0000 7fa61a81c700 1 -- 172.21.15.31:0/1256186670 wait complete. 2023-10-09T06:27:14.727 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 66 2023-10-09T06:27:15.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:27:07.779885+0000', 'modified': '2023-10-09T06:27:12.402382+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7005}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7005': {'gid': 7005, 'name': 'c', 'rank': 0, 'incarnation': 62, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/1684509217', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6832', 'nonce': 1684509217}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 1684509217}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:27:15.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:27:15.137 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T06:27:15.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.262+0000 7f3229920700 1 Processor -- start 2023-10-09T06:27:15.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.262+0000 7f3229920700 1 -- start start 2023-10-09T06:27:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3229920700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f322415a1e0 0x7f32240cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3229920700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322415db80 con 0x7f3224159e10 2023-10-09T06:27:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3229920700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322415de60 con 0x7f32240b3430 2023-10-09T06:27:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3229920700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322415e800 con 0x7f322415a1e0 2023-10-09T06:27:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3222ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3224159e10 0x7f32240b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38336/0 (socket says 172.21.15.31:38336) 2023-10-09T06:27:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3222ffd700 1 -- 172.21.15.31:0/1269829015 learned_addr learned my addr 172.21.15.31:0/1269829015 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f32227fc700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f322415a1e0 0x7f32240cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803558908 0 0) 0x7f322415db80 con 0x7f3224159e10 2023-10-09T06:27:15.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3210003570 con 0x7f3224159e10 2023-10-09T06:27:15.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2608782188 0 0) 0x7f3210003570 con 0x7f3224159e10 2023-10-09T06:27:15.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f322415a1e0 msgr2=0x7f32240cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3221ffb700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f322415a1e0 0x7f32240cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 >> v1:172.21.15.158:6789/0 conn(0x7f32240b3430 legacy=0x7f32240cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322415e140 con 0x7f3224159e10 2023-10-09T06:27:15.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f321c001470 con 0x7f3224159e10 2023-10-09T06:27:15.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 >> v1:172.21.15.31:6789/0 conn(0x7f3224159e10 legacy=0x7f32240b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3221ffb700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3210003a90 0x7f3210003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3221ffb700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3210004810 0x7f3210004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3221ffb700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f322415a1e0 0x7f3210005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.263+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322415e800 con 0x7f3210003a90 2023-10-09T06:27:15.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321000bbf0 con 0x7f3210004810 2023-10-09T06:27:15.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321000bd80 con 0x7f322415a1e0 2023-10-09T06:27:15.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f3222ffd700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3210003a90 0x7f3210003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f32227fc700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3210004810 0x7f3210004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f3222ffd700 1 -- 172.21.15.31:0/1269829015 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f322415a1e0 msgr2=0x7f3210005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f32237fe700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f322415a1e0 0x7f3210005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f3222ffd700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f322415a1e0 0x7f3210005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f3222ffd700 1 -- 172.21.15.31:0/1269829015 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3210004810 msgr2=0x7f3210004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f3222ffd700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3210004810 0x7f3210004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f3222ffd700 1 -- 172.21.15.31:0/1269829015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3210003570 con 0x7f3210003a90 2023-10-09T06:27:15.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f32227fc700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3210004810 0x7f3210004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:15.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f32237fe700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f322415a1e0 0x7f3210005270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:15.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f3222ffd700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3210003a90 0x7f3210003ea0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f321c00c300 tx=0x7f321c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2149c4fc5f5871b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:15.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c00cb90 con 0x7f3210003a90 2023-10-09T06:27:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c00ccf0 con 0x7f3210003a90 2023-10-09T06:27:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.264+0000 7f3221ffb700 1 -- 172.21.15.31:0/1269829015 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c005b50 con 0x7f3210003a90 2023-10-09T06:27:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.265+0000 7f3229920700 1 -- 172.21.15.31:0/1269829015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3210003a90 msgr2=0x7f3210003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.265+0000 7f3229920700 1 --2- 172.21.15.31:0/1269829015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3210003a90 0x7f3210003ea0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f321c00c300 tx=0x7f321c001d80 comp rx=0 tx=0).stop 2023-10-09T06:27:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.265+0000 7f32237fe700 1 -- 172.21.15.31:0/1269829015 reap_dead start 2023-10-09T06:27:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.265+0000 7f3229920700 1 -- 172.21.15.31:0/1269829015 shutdown_connections 2023-10-09T06:27:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.265+0000 7f3229920700 1 -- 172.21.15.31:0/1269829015 >> 172.21.15.31:0/1269829015 conn(0x7f3224067660 msgr2=0x7f3224067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.265+0000 7f3229920700 1 -- 172.21.15.31:0/1269829015 shutdown_connections 2023-10-09T06:27:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.265+0000 7f3229920700 1 -- 172.21.15.31:0/1269829015 wait complete. 2023-10-09T06:27:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.266+0000 7f3229920700 1 Processor -- start 2023-10-09T06:27:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.266+0000 7f3229920700 1 -- start start 2023-10-09T06:27:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3229920700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3210003a90 0x7f3224158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3229920700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3224157770 0x7f32240d1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3229920700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f32240b3cb0 0x7f3224147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3229920700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3224158bd0 con 0x7f3210003a90 2023-10-09T06:27:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3229920700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32240d0da0 con 0x7f32240b3cb0 2023-10-09T06:27:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3229920700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32240cfef0 con 0x7f3224157770 2023-10-09T06:27:15.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3222ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3210003a90 0x7f3224158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3222ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3210003a90 0x7f3224158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39744/0 (socket says 172.21.15.31:39744) 2023-10-09T06:27:15.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3222ffd700 1 -- 172.21.15.31:0/978443930 learned_addr learned my addr 172.21.15.31:0/978443930 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:15.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3222ffd700 1 -- 172.21.15.31:0/978443930 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3224157770 msgr2=0x7f32240d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3222ffd700 1 --2- 172.21.15.31:0/978443930 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3224157770 0x7f32240d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3222ffd700 1 -- 172.21.15.31:0/978443930 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f32240b3cb0 msgr2=0x7f3224147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3222ffd700 1 --2- 172.21.15.31:0/978443930 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f32240b3cb0 0x7f3224147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3222ffd700 1 -- 172.21.15.31:0/978443930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32240d0190 con 0x7f3210003a90 2023-10-09T06:27:15.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3222ffd700 1 --2- 172.21.15.31:0/978443930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3210003a90 0x7f3224158690 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f321c011000 tx=0x7f321c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:15.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f321affd700 1 -- 172.21.15.31:0/978443930 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c00ce60 con 0x7f3210003a90 2023-10-09T06:27:15.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f321affd700 1 -- 172.21.15.31:0/978443930 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c0070d0 con 0x7f3210003a90 2023-10-09T06:27:15.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f3229920700 1 -- 172.21.15.31:0/978443930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32240d0470 con 0x7f3210003a90 2023-10-09T06:27:15.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.267+0000 7f321affd700 1 -- 172.21.15.31:0/978443930 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c007490 con 0x7f3210003a90 2023-10-09T06:27:15.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.268+0000 7f3229920700 1 -- 172.21.15.31:0/978443930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32240d0a30 con 0x7f3210003a90 2023-10-09T06:27:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.269+0000 7f321affd700 1 -- 172.21.15.31:0/978443930 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f321c019030 con 0x7f3210003a90 2023-10-09T06:27:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.269+0000 7f321affd700 1 --2- 172.21.15.31:0/978443930 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3204066f60 0x7f3204069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.270+0000 7f321affd700 1 -- 172.21.15.31:0/978443930 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f321c085500 con 0x7f3210003a90 2023-10-09T06:27:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.270+0000 7f32227fc700 1 --2- 172.21.15.31:0/978443930 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3204066f60 0x7f3204069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.270+0000 7f32227fc700 1 --2- 172.21.15.31:0/978443930 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3204066f60 0x7f3204069410 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f320c006dc0 tx=0x7f320c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:15.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.271+0000 7f3232c18b80 1 Processor -- start 2023-10-09T06:27:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.272+0000 7f3232c18b80 1 -- start start 2023-10-09T06:27:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.272+0000 7f3232c18b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441a8a50 0x5629441a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.272+0000 7f3232c18b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441f2d00 0x5629441d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.272+0000 7f3232c18b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 0x5629441a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.272+0000 7f3232c18b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629440ffa70 con 0x5629441d1f60 2023-10-09T06:27:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.272+0000 7f3232c18b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629440fd270 con 0x5629441f2d00 2023-10-09T06:27:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.272+0000 7f3232c18b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629440f9060 con 0x5629441a8a50 2023-10-09T06:27:15.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f32237fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 0x5629441a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f32237fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 0x5629441a4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39760/0 (socket says 172.21.15.31:39760) 2023-10-09T06:27:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f32237fe700 1 -- 172.21.15.31:0/3621488573 learned_addr learned my addr 172.21.15.31:0/3621488573 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f32227fc700 1 --2- 172.21.15.31:0/3621488573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441f2d00 0x5629441d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f3222ffd700 1 --2- 172.21.15.31:0/3621488573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441a8a50 0x5629441a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f32237fe700 1 -- 172.21.15.31:0/3621488573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441a8a50 msgr2=0x5629441a8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f32237fe700 1 --2- 172.21.15.31:0/3621488573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441a8a50 0x5629441a8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f32237fe700 1 -- 172.21.15.31:0/3621488573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441f2d00 msgr2=0x5629441d1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f32237fe700 1 --2- 172.21.15.31:0/3621488573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441f2d00 0x5629441d1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f32237fe700 1 -- 172.21.15.31:0/3621488573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562943f93270 con 0x5629441d1f60 2023-10-09T06:27:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f32237fe700 1 --2- 172.21.15.31:0/3621488573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 0x5629441a4cf0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3224069d20 tx=0x7f3214009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a740aace701e962 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:15.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f3203fff700 1 -- 172.21.15.31:0/3621488573 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321400f510 con 0x5629441d1f60 2023-10-09T06:27:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f3203fff700 1 -- 172.21.15.31:0/3621488573 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321400d050 con 0x5629441d1f60 2023-10-09T06:27:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.273+0000 7f3203fff700 1 -- 172.21.15.31:0/3621488573 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321400f8c0 con 0x5629441d1f60 2023-10-09T06:27:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.274+0000 7f3232c18b80 1 -- 172.21.15.31:0/3621488573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 msgr2=0x5629441a4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.274+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3621488573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 0x5629441a4cf0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3224069d20 tx=0x7f3214009040 comp rx=0 tx=0).stop 2023-10-09T06:27:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.274+0000 7f3232c18b80 1 -- 172.21.15.31:0/3621488573 shutdown_connections 2023-10-09T06:27:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.274+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3621488573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441a8a50 0x5629441a8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.274+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3621488573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 0x5629441a4cf0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.274+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3621488573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441f2d00 0x5629441d1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.274+0000 7f3232c18b80 1 -- 172.21.15.31:0/3621488573 >> 172.21.15.31:0/3621488573 conn(0x5629441aa370 msgr2=0x5629441aa740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.274+0000 7f3232c18b80 1 -- 172.21.15.31:0/3621488573 shutdown_connections 2023-10-09T06:27:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.274+0000 7f3232c18b80 1 -- 172.21.15.31:0/3621488573 wait complete. 2023-10-09T06:27:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.274+0000 7f3232c18b80 1 -- start start 2023-10-09T06:27:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.275+0000 7f3232c18b80 1 Processor -- start 2023-10-09T06:27:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.275+0000 7f3232c18b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 0x5629441e9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.275+0000 7f3232c18b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441d1f60 0x5629441a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.275+0000 7f3232c18b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441f2d00 0x5629441a4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.275+0000 7f3232c18b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629440a4890 con 0x5629441a8a50 2023-10-09T06:27:15.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.275+0000 7f3232c18b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629440bfea0 con 0x5629441f2d00 2023-10-09T06:27:15.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.275+0000 7f3232c18b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x562943f7be30 con 0x5629441d1f60 2023-10-09T06:27:15.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f3232c18b80 10 client.0 _ll_register_callbacks cb 0x56294416c110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:27:15.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f3222ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 0x5629441e9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f3222ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 0x5629441e9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39768/0 (socket says 172.21.15.31:39768) 2023-10-09T06:27:15.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f3222ffd700 1 -- 172.21.15.31:0/3684303619 learned_addr learned my addr 172.21.15.31:0/3684303619 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:15.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f32227fc700 1 --2- 172.21.15.31:0/3684303619 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441d1f60 0x5629441a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f32237fe700 1 --2- 172.21.15.31:0/3684303619 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441f2d00 0x5629441a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f3222ffd700 1 -- 172.21.15.31:0/3684303619 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441d1f60 msgr2=0x5629441a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f3222ffd700 1 --2- 172.21.15.31:0/3684303619 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441d1f60 0x5629441a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f3222ffd700 1 -- 172.21.15.31:0/3684303619 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441f2d00 msgr2=0x5629441a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f3222ffd700 1 --2- 172.21.15.31:0/3684303619 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441f2d00 0x5629441a4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f3222ffd700 1 -- 172.21.15.31:0/3684303619 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322415de60 con 0x5629441a8a50 2023-10-09T06:27:15.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f3222ffd700 1 --2- 172.21.15.31:0/3684303619 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 0x5629441e9a90 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f321c0529e0 tx=0x7f321c020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270e093178c3a82b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:15.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f32017fa700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:27:15.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f32017fa700 1 -- 172.21.15.31:0/3684303619 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c0850f0 con 0x5629441a8a50 2023-10-09T06:27:15.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f32017fa700 1 -- 172.21.15.31:0/3684303619 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f321c083e40 con 0x5629441a8a50 2023-10-09T06:27:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f3232c18b80 1 -- 172.21.15.31:0/3684303619 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56294419db70 con 0x5629441a8a50 2023-10-09T06:27:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f32017fa700 1 -- 172.21.15.31:0/3684303619 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f321c056740 con 0x5629441a8a50 2023-10-09T06:27:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f3232c18b80 10 client.7170 fetch_fsmap learned FSMap version 66 2023-10-09T06:27:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f3232c18b80 1 -- 172.21.15.31:0/3684303619 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x562943f35fe0 con 0x5629441a8a50 2023-10-09T06:27:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f32017fa700 1 -- 172.21.15.31:0/3684303619 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56294419db70 con 0x5629441a8a50 2023-10-09T06:27:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.276+0000 7f32017fa700 1 -- 172.21.15.31:0/3684303619 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 66) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f321c0559d0 con 0x5629441a8a50 2023-10-09T06:27:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.277+0000 7f3232c18b80 10 client.7170 fetch_fsmap finished waiting for FSMap version 66 2023-10-09T06:27:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.277+0000 7f3232c18b80 10 client.7170 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T06:27:15.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.277+0000 7f3232c18b80 20 client.7170 populate_metadata read hostname 'smithi031' 2023-10-09T06:27:15.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.277+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3684303619 >> [v2:172.21.15.31:6832/1684509217,v1:172.21.15.31:6835/1684509217] conn(0x5629441e83b0 0x5629442029c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.277+0000 7f3232c18b80 4 client.7170 mds_command: new command op to 7005 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:27:15.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.277+0000 7f3232c18b80 1 -- 172.21.15.31:0/3684303619 --> [v2:172.21.15.31:6832/1684509217,v1:172.21.15.31:6835/1684509217] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56294417aaa0 con 0x5629441e83b0 2023-10-09T06:27:15.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.277+0000 7f32227fc700 1 --2- 172.21.15.31:0/3684303619 >> [v2:172.21.15.31:6832/1684509217,v1:172.21.15.31:6835/1684509217] conn(0x5629441e83b0 0x5629442029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.277+0000 7f32017fa700 10 client.7170 ms_handle_connect on v2:172.21.15.31:6832/1684509217 2023-10-09T06:27:15.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.277+0000 7f32227fc700 1 --2- 172.21.15.31:0/3684303619 >> [v2:172.21.15.31:6832/1684509217,v1:172.21.15.31:6835/1684509217] conn(0x5629441e83b0 0x5629442029c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69d30efc17aefda3 server_cookie=5e25d4a612c212cd in_seq=0 out_seq=0 2023-10-09T06:27:15.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f32017fa700 1 -- 172.21.15.31:0/3684303619 <== mds.0 v2:172.21.15.31:6832/1684509217 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56294417aaa0 con 0x5629441e83b0 2023-10-09T06:27:15.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f32017fa700 10 client.7170 handle_command_reply: tid=0 2023-10-09T06:27:15.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f3232c18b80 1 client.7170 shutdown 2023-10-09T06:27:15.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f3232c18b80 1 -- 172.21.15.31:0/3684303619 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 msgr2=0x5629441e9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3684303619 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 0x5629441e9a90 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f321c0529e0 tx=0x7f321c020040 comp rx=0 tx=0).stop 2023-10-09T06:27:15.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f3232c18b80 1 -- 172.21.15.31:0/3684303619 shutdown_connections 2023-10-09T06:27:15.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3684303619 >> [v2:172.21.15.31:6832/1684509217,v1:172.21.15.31:6835/1684509217] conn(0x5629441e83b0 0x5629442029c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3684303619 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441f2d00 0x5629441a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f32017fa700 0 client.7170 ms_handle_reset on v2:172.21.15.31:6832/1684509217 2023-10-09T06:27:15.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3684303619 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 0x5629441e9a90 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3684303619 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441d1f60 0x5629441a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f3232c18b80 1 -- 172.21.15.31:0/3684303619 >> 172.21.15.31:0/3684303619 conn(0x5629441aa370 msgr2=0x5629441a5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:15.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f3232c18b80 1 -- 172.21.15.31:0/3684303619 shutdown_connections 2023-10-09T06:27:15.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f3232c18b80 1 -- 172.21.15.31:0/3684303619 wait complete. 2023-10-09T06:27:15.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.278+0000 7f3232c18b80 20 client.7170 trim_cache size 0 max 16384 2023-10-09T06:27:15.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.295+0000 7f3232c18b80 1 Processor -- start 2023-10-09T06:27:15.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.295+0000 7f3232c18b80 1 -- start start 2023-10-09T06:27:15.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f3232c18b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441a8a50 0x5629441fe750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f3232c18b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 0x5629441a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f3232c18b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441f2d00 0x5629441a4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f3232c18b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x562944209460 con 0x5629441d1f60 2023-10-09T06:27:15.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f3232c18b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629441a79b0 con 0x5629441a8a50 2023-10-09T06:27:15.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f3232c18b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x562944188510 con 0x5629441f2d00 2023-10-09T06:27:15.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f32227fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 0x5629441a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f32227fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 0x5629441a3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39784/0 (socket says 172.21.15.31:39784) 2023-10-09T06:27:15.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f32227fc700 1 -- 172.21.15.31:0/3934202879 learned_addr learned my addr 172.21.15.31:0/3934202879 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:15.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f32227fc700 1 -- 172.21.15.31:0/3934202879 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441f2d00 msgr2=0x5629441a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f32227fc700 1 --2- 172.21.15.31:0/3934202879 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441f2d00 0x5629441a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f32227fc700 1 -- 172.21.15.31:0/3934202879 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441a8a50 msgr2=0x5629441fe750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f32227fc700 1 --2- 172.21.15.31:0/3934202879 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441a8a50 0x5629441fe750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f32227fc700 1 -- 172.21.15.31:0/3934202879 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629440c7780 con 0x5629441d1f60 2023-10-09T06:27:15.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f32227fc700 1 --2- 172.21.15.31:0/3934202879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 0x5629441a3c20 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f320c009fd0 tx=0x7f320c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecb45de0b848610 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:15.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.296+0000 7f3218ff9700 1 -- 172.21.15.31:0/3934202879 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c015c30 con 0x5629441d1f60 2023-10-09T06:27:15.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.297+0000 7f3218ff9700 1 -- 172.21.15.31:0/3934202879 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c015d90 con 0x5629441d1f60 2023-10-09T06:27:15.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.297+0000 7f3218ff9700 1 -- 172.21.15.31:0/3934202879 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c02c440 con 0x5629441d1f60 2023-10-09T06:27:15.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.297+0000 7f3232c18b80 1 -- 172.21.15.31:0/3934202879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 msgr2=0x5629441a3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.297+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3934202879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 0x5629441a3c20 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f320c009fd0 tx=0x7f320c018000 comp rx=0 tx=0).stop 2023-10-09T06:27:15.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.297+0000 7f3232c18b80 1 -- 172.21.15.31:0/3934202879 shutdown_connections 2023-10-09T06:27:15.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.297+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3934202879 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441f2d00 0x5629441a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.297+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3934202879 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441a8a50 0x5629441fe750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.297+0000 7f3232c18b80 1 --2- 172.21.15.31:0/3934202879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441d1f60 0x5629441a3c20 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.297+0000 7f3232c18b80 1 -- 172.21.15.31:0/3934202879 >> 172.21.15.31:0/3934202879 conn(0x5629441aa370 msgr2=0x5629441d86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:15.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.297+0000 7f3232c18b80 1 -- 172.21.15.31:0/3934202879 shutdown_connections 2023-10-09T06:27:15.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.297+0000 7f3232c18b80 1 -- 172.21.15.31:0/3934202879 wait complete. 2023-10-09T06:27:15.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.298+0000 7f3232c18b80 1 -- start start 2023-10-09T06:27:15.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.298+0000 7f3232c18b80 1 Processor -- start 2023-10-09T06:27:15.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3232c18b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 0x5629442019e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3232c18b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441d1f60 0x5629441a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3232c18b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441f2d00 0x56294423a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3232c18b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x562944208f40 con 0x5629441a8a50 2023-10-09T06:27:15.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3232c18b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629441d4a00 con 0x5629441d1f60 2023-10-09T06:27:15.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3232c18b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x562944259210 con 0x5629441f2d00 2023-10-09T06:27:15.304 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3232c18b80 10 client.0 _ll_register_callbacks cb 0x56294416c110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:27:15.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3222ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 0x5629442019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3222ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 0x5629442019e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39788/0 (socket says 172.21.15.31:39788) 2023-10-09T06:27:15.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3222ffd700 1 -- 172.21.15.31:0/4176857928 learned_addr learned my addr 172.21.15.31:0/4176857928 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:15.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f32227fc700 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441d1f60 0x5629441a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f32237fe700 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441f2d00 0x56294423a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3222ffd700 1 -- 172.21.15.31:0/4176857928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441f2d00 msgr2=0x56294423a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3222ffd700 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441f2d00 0x56294423a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3222ffd700 1 -- 172.21.15.31:0/4176857928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441d1f60 msgr2=0x5629441a4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3222ffd700 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441d1f60 0x5629441a4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3222ffd700 1 -- 172.21.15.31:0/4176857928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320c011b70 con 0x5629441a8a50 2023-10-09T06:27:15.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f32227fc700 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441d1f60 0x5629441a4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:15.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3222ffd700 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 0x5629442019e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f321c052840 tx=0x7f321c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8859dac567d8e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:15.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f32017fa700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:27:15.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f32017fa700 1 -- 172.21.15.31:0/4176857928 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c085070 con 0x5629441a8a50 2023-10-09T06:27:15.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f32017fa700 1 -- 172.21.15.31:0/4176857928 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f321c083e40 con 0x5629441a8a50 2023-10-09T06:27:15.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.299+0000 7f3232c18b80 1 -- 172.21.15.31:0/4176857928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f321400d050 con 0x5629441a8a50 2023-10-09T06:27:15.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f32017fa700 1 -- 172.21.15.31:0/4176857928 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f321c0559d0 con 0x5629441a8a50 2023-10-09T06:27:15.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f3232c18b80 10 client.7176 fetch_fsmap learned FSMap version 66 2023-10-09T06:27:15.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f3232c18b80 1 -- 172.21.15.31:0/4176857928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x5629440ae470 con 0x5629441a8a50 2023-10-09T06:27:15.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f32017fa700 1 -- 172.21.15.31:0/4176857928 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321400d050 con 0x5629441a8a50 2023-10-09T06:27:15.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f32017fa700 1 -- 172.21.15.31:0/4176857928 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 66) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f321c073080 con 0x5629441a8a50 2023-10-09T06:27:15.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f3232c18b80 10 client.7176 fetch_fsmap finished waiting for FSMap version 66 2023-10-09T06:27:15.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f3232c18b80 10 client.7176 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T06:27:15.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f3232c18b80 20 client.7176 populate_metadata read hostname 'smithi031' 2023-10-09T06:27:15.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f3232c18b80 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.31:6832/1684509217,v1:172.21.15.31:6835/1684509217] conn(0x5629442584b0 0x562944258880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f3232c18b80 4 client.7176 mds_command: new command op to 7005 tid=0[{"prefix": "status"}] 2023-10-09T06:27:15.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f3232c18b80 1 -- 172.21.15.31:0/4176857928 --> [v2:172.21.15.31:6832/1684509217,v1:172.21.15.31:6835/1684509217] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56294409be00 con 0x5629442584b0 2023-10-09T06:27:15.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f32227fc700 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.31:6832/1684509217,v1:172.21.15.31:6835/1684509217] conn(0x5629442584b0 0x562944258880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f32017fa700 10 client.7176 ms_handle_connect on v2:172.21.15.31:6832/1684509217 2023-10-09T06:27:15.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.300+0000 7f32227fc700 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.31:6832/1684509217,v1:172.21.15.31:6835/1684509217] conn(0x5629442584b0 0x562944258880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b47401eb06869538 server_cookie=7489718884d56abd in_seq=0 out_seq=0 2023-10-09T06:27:15.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f32017fa700 1 -- 172.21.15.31:0/4176857928 <== mds.0 v2:172.21.15.31:6832/1684509217 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x56294409be00 con 0x5629442584b0 2023-10-09T06:27:15.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f32017fa700 10 client.7176 handle_command_reply: tid=0 2023-10-09T06:27:15.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3232c18b80 1 client.7176 shutdown 2023-10-09T06:27:15.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3232c18b80 1 -- 172.21.15.31:0/4176857928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 msgr2=0x5629442019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3232c18b80 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 0x5629442019e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f321c052840 tx=0x7f321c013000 comp rx=0 tx=0).stop 2023-10-09T06:27:15.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3232c18b80 1 -- 172.21.15.31:0/4176857928 shutdown_connections 2023-10-09T06:27:15.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3232c18b80 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.31:6832/1684509217,v1:172.21.15.31:6835/1684509217] conn(0x5629442584b0 0x562944258880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3232c18b80 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5629441f2d00 0x56294423a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f32017fa700 0 client.7176 ms_handle_reset on v2:172.21.15.31:6832/1684509217 2023-10-09T06:27:15.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3232c18b80 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629441a8a50 0x5629442019e0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3232c18b80 1 --2- 172.21.15.31:0/4176857928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5629441d1f60 0x5629441a4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3232c18b80 1 -- 172.21.15.31:0/4176857928 >> 172.21.15.31:0/4176857928 conn(0x5629441aa370 msgr2=0x5629441a3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:15.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3232c18b80 1 -- 172.21.15.31:0/4176857928 shutdown_connections 2023-10-09T06:27:15.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3232c18b80 1 -- 172.21.15.31:0/4176857928 wait complete. 2023-10-09T06:27:15.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3232c18b80 20 client.7176 trim_cache size 0 max 16384 2023-10-09T06:27:15.309 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:27:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:27:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-10-09T06:27:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 7005, 2023-10-09T06:27:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-10-09T06:27:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-10-09T06:27:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-10-09T06:27:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 6.9287934519999999, 2023-10-09T06:27:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 66, 2023-10-09T06:27:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 136, 2023-10-09T06:27:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 136, 2023-10-09T06:27:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 11.991267301000001 2023-10-09T06:27:15.310 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:27:15.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3229920700 1 -- 172.21.15.31:0/978443930 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3204066f60 msgr2=0x7f3204069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3229920700 1 --2- 172.21.15.31:0/978443930 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3204066f60 0x7f3204069410 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f320c006dc0 tx=0x7f320c008040 comp rx=0 tx=0).stop 2023-10-09T06:27:15.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3229920700 1 -- 172.21.15.31:0/978443930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3210003a90 msgr2=0x7f3224158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3229920700 1 --2- 172.21.15.31:0/978443930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3210003a90 0x7f3224158690 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f321c011000 tx=0x7f321c015000 comp rx=0 tx=0).stop 2023-10-09T06:27:15.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3229920700 1 -- 172.21.15.31:0/978443930 shutdown_connections 2023-10-09T06:27:15.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3229920700 1 --2- 172.21.15.31:0/978443930 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3204066f60 0x7f3204069410 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3229920700 1 --2- 172.21.15.31:0/978443930 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f32240b3cb0 0x7f3224147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3229920700 1 --2- 172.21.15.31:0/978443930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3210003a90 0x7f3224158690 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3229920700 1 --2- 172.21.15.31:0/978443930 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3224157770 0x7f32240d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.301+0000 7f3229920700 1 -- 172.21.15.31:0/978443930 >> 172.21.15.31:0/978443930 conn(0x7f3224067660 msgr2=0x7f322415eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:15.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.302+0000 7f3229920700 1 -- 172.21.15.31:0/978443930 shutdown_connections 2023-10-09T06:27:15.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.302+0000 7f3229920700 1 -- 172.21.15.31:0/978443930 wait complete. 2023-10-09T06:27:15.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:27:15.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.435+0000 7fba75157700 1 Processor -- start 2023-10-09T06:27:15.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.435+0000 7fba75157700 1 -- start start 2023-10-09T06:27:15.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.436+0000 7fba75157700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba7015cbd0 0x7fba7015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.436+0000 7fba75157700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba700cb7c0 con 0x7fba700cdab0 2023-10-09T06:27:15.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.436+0000 7fba75157700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7015e290 con 0x7fba700cd6e0 2023-10-09T06:27:15.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.436+0000 7fba75157700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7015e850 con 0x7fba7015cbd0 2023-10-09T06:27:15.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.436+0000 7fba6f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fba700cdab0 0x7fba7015d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38340/0 (socket says 172.21.15.31:38340) 2023-10-09T06:27:15.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.436+0000 7fba6f7fe700 1 -- 172.21.15.31:0/74315380 learned_addr learned my addr 172.21.15.31:0/74315380 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:15.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.436+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272111075 0 0) 0x7fba700cb7c0 con 0x7fba700cdab0 2023-10-09T06:27:15.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba58003570 con 0x7fba700cdab0 2023-10-09T06:27:15.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba74956700 1 --2- 172.21.15.31:0/74315380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba7015cbd0 0x7fba7015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4042468529 0 0) 0x7fba58003570 con 0x7fba700cdab0 2023-10-09T06:27:15.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba7015cbd0 msgr2=0x7fba7015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 --2- 172.21.15.31:0/74315380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba7015cbd0 0x7fba7015d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 >> v1:172.21.15.158:6789/0 conn(0x7fba700cd6e0 legacy=0x7fba700cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7015e570 con 0x7fba700cdab0 2023-10-09T06:27:15.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fba60001470 con 0x7fba700cdab0 2023-10-09T06:27:15.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 >> v1:172.21.15.31:6789/0 conn(0x7fba700cdab0 legacy=0x7fba7015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 --2- 172.21.15.31:0/74315380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba58003a90 0x7fba58003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 --2- 172.21.15.31:0/74315380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba7015cbd0 0x7fba58004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 --2- 172.21.15.31:0/74315380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba58004d50 0x7fba580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7015e850 con 0x7fba58003a90 2023-10-09T06:27:15.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5800bb10 con 0x7fba58004d50 2023-10-09T06:27:15.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5800bcd0 con 0x7fba7015cbd0 2023-10-09T06:27:15.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6ffff700 1 --2- 172.21.15.31:0/74315380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba58003a90 0x7fba58003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba74956700 1 --2- 172.21.15.31:0/74315380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba58004d50 0x7fba580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6f7fe700 1 --2- 172.21.15.31:0/74315380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba7015cbd0 0x7fba58004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6ffff700 1 -- 172.21.15.31:0/74315380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba7015cbd0 msgr2=0x7fba58004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6ffff700 1 --2- 172.21.15.31:0/74315380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba7015cbd0 0x7fba58004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6ffff700 1 -- 172.21.15.31:0/74315380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba58004d50 msgr2=0x7fba580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:15.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6ffff700 1 --2- 172.21.15.31:0/74315380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba58004d50 0x7fba580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.437+0000 7fba6ffff700 1 -- 172.21.15.31:0/74315380 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba58003570 con 0x7fba58003a90 2023-10-09T06:27:15.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.438+0000 7fba6ffff700 1 --2- 172.21.15.31:0/74315380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba58003a90 0x7fba58003e60 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fba640019a0 tx=0x7fba64007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434f5f1312998022 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:15.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.438+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6400c5d0 con 0x7fba58003a90 2023-10-09T06:27:15.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.438+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6400c730 con 0x7fba58003a90 2023-10-09T06:27:15.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.438+0000 7fba6effd700 1 -- 172.21.15.31:0/74315380 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6400cad0 con 0x7fba58003a90 2023-10-09T06:27:15.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.438+0000 7fba75157700 1 -- 172.21.15.31:0/74315380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba58003a90 msgr2=0x7fba58003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.438+0000 7fba75157700 1 --2- 172.21.15.31:0/74315380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba58003a90 0x7fba58003e60 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fba640019a0 tx=0x7fba64007d10 comp rx=0 tx=0).stop 2023-10-09T06:27:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.438+0000 7fba74956700 1 -- 172.21.15.31:0/74315380 reap_dead start 2023-10-09T06:27:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.438+0000 7fba75157700 1 -- 172.21.15.31:0/74315380 shutdown_connections 2023-10-09T06:27:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.438+0000 7fba75157700 1 -- 172.21.15.31:0/74315380 >> 172.21.15.31:0/74315380 conn(0x7fba70067660 msgr2=0x7fba70067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.438+0000 7fba75157700 1 -- 172.21.15.31:0/74315380 shutdown_connections 2023-10-09T06:27:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.438+0000 7fba75157700 1 -- 172.21.15.31:0/74315380 wait complete. 2023-10-09T06:27:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.439+0000 7fba75157700 1 Processor -- start 2023-10-09T06:27:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.440+0000 7fba75157700 1 -- start start 2023-10-09T06:27:15.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.440+0000 7fba75157700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba58003a90 0x7fba7015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.440+0000 7fba75157700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba70159ee0 0x7fba7016da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.440+0000 7fba75157700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba70155c10 0x7fba700b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.440+0000 7fba75157700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba700cc360 con 0x7fba70159ee0 2023-10-09T06:27:15.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.440+0000 7fba75157700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7015b610 con 0x7fba70155c10 2023-10-09T06:27:15.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.440+0000 7fba75157700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7016e990 con 0x7fba58003a90 2023-10-09T06:27:15.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.440+0000 7fba6f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba70159ee0 0x7fba7016da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.440+0000 7fba6f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba70159ee0 0x7fba7016da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39794/0 (socket says 172.21.15.31:39794) 2023-10-09T06:27:15.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.440+0000 7fba6f7fe700 1 -- 172.21.15.31:0/3921470808 learned_addr learned my addr 172.21.15.31:0/3921470808 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:15.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.441+0000 7fba6ffff700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba58003a90 0x7fba7015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.441+0000 7fba74956700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba70155c10 0x7fba700b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.441+0000 7fba6f7fe700 1 -- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba58003a90 msgr2=0x7fba7015c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.441+0000 7fba6f7fe700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba58003a90 0x7fba7015c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.441+0000 7fba6f7fe700 1 -- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba70155c10 msgr2=0x7fba700b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.441+0000 7fba6f7fe700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba70155c10 0x7fba700b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.441+0000 7fba6f7fe700 1 -- 172.21.15.31:0/3921470808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7015bbb0 con 0x7fba70159ee0 2023-10-09T06:27:15.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.441+0000 7fba6f7fe700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba70159ee0 0x7fba7016da80 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fba60007420 tx=0x7fba60001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:15.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.441+0000 7fba57fff700 1 -- 172.21.15.31:0/3921470808 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6000f7f0 con 0x7fba70159ee0 2023-10-09T06:27:15.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.441+0000 7fba57fff700 1 -- 172.21.15.31:0/3921470808 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6000f970 con 0x7fba70159ee0 2023-10-09T06:27:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.441+0000 7fba75157700 1 -- 172.21.15.31:0/3921470808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7016e3d0 con 0x7fba70159ee0 2023-10-09T06:27:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.441+0000 7fba57fff700 1 -- 172.21.15.31:0/3921470808 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6000fd30 con 0x7fba70159ee0 2023-10-09T06:27:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.441+0000 7fba75157700 1 -- 172.21.15.31:0/3921470808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7015b840 con 0x7fba70159ee0 2023-10-09T06:27:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.442+0000 7fba75157700 1 -- 172.21.15.31:0/3921470808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7015bd40 con 0x7fba70159ee0 2023-10-09T06:27:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.442+0000 7fba57fff700 1 -- 172.21.15.31:0/3921470808 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba600135c0 con 0x7fba70159ee0 2023-10-09T06:27:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.443+0000 7fba57fff700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fba5c066f30 0x7fba5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.443+0000 7fba57fff700 1 -- 172.21.15.31:0/3921470808 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba60084270 con 0x7fba70159ee0 2023-10-09T06:27:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.443+0000 7fba6ffff700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fba5c066f30 0x7fba5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.444+0000 7fba6ffff700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fba5c066f30 0x7fba5c0693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fba64000fd0 tx=0x7fba64015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.447+0000 7fba57fff700 1 -- 172.21.15.31:0/3921470808 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba60054f70 con 0x7fba70159ee0 2023-10-09T06:27:15.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.688+0000 7fba75157700 1 -- 172.21.15.31:0/3921470808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fba7004bb80 con 0x7fba70159ee0 2023-10-09T06:27:15.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.688+0000 7fba57fff700 1 -- 172.21.15.31:0/3921470808 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7fba60054b00 con 0x7fba70159ee0 2023-10-09T06:27:15.688 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:27:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.690+0000 7fba75157700 1 -- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fba5c066f30 msgr2=0x7fba5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.690+0000 7fba75157700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fba5c066f30 0x7fba5c0693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fba64000fd0 tx=0x7fba64015000 comp rx=0 tx=0).stop 2023-10-09T06:27:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.690+0000 7fba75157700 1 -- 172.21.15.31:0/3921470808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba70159ee0 msgr2=0x7fba7016da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.690+0000 7fba75157700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba70159ee0 0x7fba7016da80 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fba60007420 tx=0x7fba60001e70 comp rx=0 tx=0).stop 2023-10-09T06:27:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.690+0000 7fba75157700 1 -- 172.21.15.31:0/3921470808 shutdown_connections 2023-10-09T06:27:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.690+0000 7fba75157700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fba5c066f30 0x7fba5c0693e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.690+0000 7fba75157700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fba58003a90 0x7fba7015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.690+0000 7fba75157700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba70155c10 0x7fba700b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.690+0000 7fba75157700 1 --2- 172.21.15.31:0/3921470808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba70159ee0 0x7fba7016da80 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:15.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.690+0000 7fba75157700 1 -- 172.21.15.31:0/3921470808 >> 172.21.15.31:0/3921470808 conn(0x7fba70067660 msgr2=0x7fba7006a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:15.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.690+0000 7fba75157700 1 -- 172.21.15.31:0/3921470808 shutdown_connections 2023-10-09T06:27:15.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:15.690+0000 7fba75157700 1 -- 172.21.15.31:0/3921470808 wait complete. 2023-10-09T06:27:15.702 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:27:15.702 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:27:15.702 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-10-09T06:27:15.702 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:27:15.702 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:27:15.702 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:27:15.702 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:27:15.702 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:27:15.703 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:27:15.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:15.703 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-10-09T06:27:15.719 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:27:15.719 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:27:15.719 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:27:15.719 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:15.720 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:27:15.720 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:15.720 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:27:15.720 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T06:27:15.720 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-10-09T06:27:15.720 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:27:15.720 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T06:27:15.720 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-10-09T06:27:15.720 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:27:15.721 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-10-09T06:27:15.721 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-10-09T06:27:15.721 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T06:27:15.721 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42131sec preferred_lft 42131sec 2023-10-09T06:27:15.721 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-10-09T06:27:15.721 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:15.721 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:27:15.721 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:27:15.721 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-10-09T06:27:15.721 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:27:15.721 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:27:15.721 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:27:15.722 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:15.722 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::b4ad:53ff:fed3:a589/64 scope link 2023-10-09T06:27:15.722 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:15.722 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:27:15.722 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether f6:bf:b8:0f:49:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:27:15.722 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::f4bf:b8ff:fe0f:498b/64 scope link 2023-10-09T06:27:15.722 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:15.722 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:27:15.722 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:27:15.722 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::d8ab:b5ff:fe1d:e066/64 scope link 2023-10-09T06:27:15.722 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:15.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:15.723 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:27:15.783 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-10-09T06:27:15.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:15.785 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-10-09T06:27:15.840 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-10-09T06:27:15.840 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:27:15.840 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T06:27:15.840 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T06:27:15.840 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:27:15.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:15.841 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:27:15.841 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:27:15.841 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T06:27:15.841 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T06:27:15.841 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T06:27:15.841 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:27:15.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:15.943 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:27:15.958 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:27:15.958 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:27:15.958 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:27:15.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:15.958 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-10-09T06:27:16.023 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:27:16.023 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:27:16.079 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:27:16.079 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:27:16.079 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:27:16.134 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:27:16.134 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:27:16.134 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:27:16.214 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:27:16.215 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:27:16.234 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:27:16.236 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:27:16.236 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:27:16.236 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:27:16.236 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:27:16.236 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:27:16.236 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:27:16.236 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:27:16.255 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:27:16.255 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:27:16.255 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:27:16.256 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:27:16.256 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:27:16.256 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:27:16.256 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:27:16.256 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:27:16.256 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:27:16.256 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:27:16.256 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:27:16.258 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:27:16.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:16.258 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:27:16.324 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:27:16.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.486+0000 7f64b0a5d700 1 Processor -- start 2023-10-09T06:27:16.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.486+0000 7f64b0a5d700 1 -- start start 2023-10-09T06:27:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.487+0000 7f64b0a5d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f64ac159f10 0x7f64ac0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.487+0000 7f64b0a5d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f64ac15a2e0 0x7f64ac0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.487+0000 7f64b0a5d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac0ae320 con 0x7f64ac0cc240 2023-10-09T06:27:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.487+0000 7f64b0a5d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ac15a760 con 0x7f64ac159f10 2023-10-09T06:27:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.487+0000 7f64b0a5d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ac0ad710 con 0x7f64ac15a2e0 2023-10-09T06:27:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.487+0000 7f64ab7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f64ac159f10 0x7f64ac0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.487+0000 7f64ab7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f64ac159f10 0x7f64ac0c59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39810/0 (socket says 172.21.15.31:39810) 2023-10-09T06:27:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.487+0000 7f64ab7fe700 1 -- 172.21.15.31:0/903429790 learned_addr learned my addr 172.21.15.31:0/903429790 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.487+0000 7f64aaffd700 1 --2- 172.21.15.31:0/903429790 >> v2:172.21.15.158:3300/0 conn(0x7f64ac15a2e0 0x7f64ac0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.487+0000 7f64ab7fe700 1 -- 172.21.15.31:0/903429790 >> v2:172.21.15.158:3300/0 conn(0x7f64ac15a2e0 msgr2=0x7f64ac0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.487+0000 7f64ab7fe700 1 --2- 172.21.15.31:0/903429790 >> v2:172.21.15.158:3300/0 conn(0x7f64ac15a2e0 0x7f64ac0cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.487+0000 7f64ab7fe700 1 -- 172.21.15.31:0/903429790 >> v1:172.21.15.158:6789/0 conn(0x7f64ac0cc240 legacy=0x7f64ac0ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.487+0000 7f64ab7fe700 1 -- 172.21.15.31:0/903429790 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac0ad9f0 con 0x7f64ac159f10 2023-10-09T06:27:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.488+0000 7f64ab7fe700 1 --2- 172.21.15.31:0/903429790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ac159f10 0x7f64ac0c59e0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0c7a10 tx=0x7f649c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896311f668d6ad39 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.488+0000 7f64aa7fc700 1 -- 172.21.15.31:0/903429790 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c00b860 con 0x7f64ac159f10 2023-10-09T06:27:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.488+0000 7f64aa7fc700 1 -- 172.21.15.31:0/903429790 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649c00b9c0 con 0x7f64ac159f10 2023-10-09T06:27:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.488+0000 7f64aa7fc700 1 -- 172.21.15.31:0/903429790 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c00bd60 con 0x7f64ac159f10 2023-10-09T06:27:16.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.488+0000 7f64b0a5d700 1 -- 172.21.15.31:0/903429790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ac159f10 msgr2=0x7f64ac0c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:16.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.488+0000 7f64b0a5d700 1 --2- 172.21.15.31:0/903429790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ac159f10 0x7f64ac0c59e0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0c7a10 tx=0x7f649c009250 comp rx=0 tx=0).stop 2023-10-09T06:27:16.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.488+0000 7f64b0a5d700 1 -- 172.21.15.31:0/903429790 shutdown_connections 2023-10-09T06:27:16.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.488+0000 7f64b0a5d700 1 --2- 172.21.15.31:0/903429790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ac159f10 0x7f64ac0c59e0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.488+0000 7f64b0a5d700 1 --2- 172.21.15.31:0/903429790 >> v2:172.21.15.158:3300/0 conn(0x7f64ac15a2e0 0x7f64ac0cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.488+0000 7f64b0a5d700 1 -- 172.21.15.31:0/903429790 >> 172.21.15.31:0/903429790 conn(0x7f64ac067e40 msgr2=0x7f64ac0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.488+0000 7f64b0a5d700 1 -- 172.21.15.31:0/903429790 shutdown_connections 2023-10-09T06:27:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.488+0000 7f64b0a5d700 1 -- 172.21.15.31:0/903429790 wait complete. 2023-10-09T06:27:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.490+0000 7f64b0a5d700 1 Processor -- start 2023-10-09T06:27:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.490+0000 7f64b0a5d700 1 -- start start 2023-10-09T06:27:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.490+0000 7f64b0a5d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f64ac0cc240 0x7f64ac0c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.490+0000 7f64b0a5d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f64ac159f10 0x7f64ac157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.490+0000 7f64b0a5d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ac15a2e0 0x7f64ac14e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.490+0000 7f64b0a5d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac14f000 con 0x7f64ac15a2e0 2023-10-09T06:27:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.490+0000 7f64b0a5d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac14f860 con 0x7f64ac0cc240 2023-10-09T06:27:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.490+0000 7f64b0a5d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0ca9d0 con 0x7f64ac159f10 2023-10-09T06:27:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64abfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ac15a2e0 0x7f64ac14e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64abfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ac15a2e0 0x7f64ac14e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39820/0 (socket says 172.21.15.31:39820) 2023-10-09T06:27:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64abfff700 1 -- 172.21.15.31:0/3861037928 learned_addr learned my addr 172.21.15.31:0/3861037928 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64ab7fe700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f64ac0cc240 0x7f64ac0c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64aaffd700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f64ac159f10 0x7f64ac157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64abfff700 1 -- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f64ac159f10 msgr2=0x7f64ac157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64abfff700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f64ac159f10 0x7f64ac157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64abfff700 1 -- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f64ac0cc240 msgr2=0x7f64ac0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64abfff700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f64ac0cc240 0x7f64ac0c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64abfff700 1 -- 172.21.15.31:0/3861037928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649c0094f0 con 0x7f64ac15a2e0 2023-10-09T06:27:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64abfff700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ac15a2e0 0x7f64ac14e450 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f64a400c8e0 tx=0x7f64a4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64937fe700 1 -- 172.21.15.31:0/3861037928 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4012630 con 0x7f64ac15a2e0 2023-10-09T06:27:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64937fe700 1 -- 172.21.15.31:0/3861037928 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a4012790 con 0x7f64ac15a2e0 2023-10-09T06:27:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64b0a5d700 1 -- 172.21.15.31:0/3861037928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac152090 con 0x7f64ac15a2e0 2023-10-09T06:27:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64937fe700 1 -- 172.21.15.31:0/3861037928 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4012b50 con 0x7f64ac15a2e0 2023-10-09T06:27:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.491+0000 7f64b0a5d700 1 -- 172.21.15.31:0/3861037928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac14f4f0 con 0x7f64ac15a2e0 2023-10-09T06:27:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.492+0000 7f64b0a5d700 1 -- 172.21.15.31:0/3861037928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac0b2ba0 con 0x7f64ac15a2e0 2023-10-09T06:27:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.493+0000 7f64937fe700 1 -- 172.21.15.31:0/3861037928 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64a401a3a0 con 0x7f64ac15a2e0 2023-10-09T06:27:16.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.493+0000 7f64937fe700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6498066f30 0x7f64980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:16.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.493+0000 7f64937fe700 1 -- 172.21.15.31:0/3861037928 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f64a40846a0 con 0x7f64ac15a2e0 2023-10-09T06:27:16.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.493+0000 7f64ab7fe700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6498066f30 0x7f64980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:16.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.494+0000 7f64ab7fe700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6498066f30 0x7f64980693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0c7a10 tx=0x7f649c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:16.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.497+0000 7f64937fe700 1 -- 172.21.15.31:0/3861037928 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64a40553a0 con 0x7f64ac15a2e0 2023-10-09T06:27:16.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.736+0000 7f64b0a5d700 1 -- 172.21.15.31:0/3861037928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f64ac089330 con 0x7f64ac15a2e0 2023-10-09T06:27:16.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.736+0000 7f64937fe700 1 -- 172.21.15.31:0/3861037928 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7f64a4054f30 con 0x7f64ac15a2e0 2023-10-09T06:27:16.736 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:27:16.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.738+0000 7f64b0a5d700 1 -- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6498066f30 msgr2=0x7f64980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:16.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.738+0000 7f64b0a5d700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6498066f30 0x7f64980693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0c7a10 tx=0x7f649c017000 comp rx=0 tx=0).stop 2023-10-09T06:27:16.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.738+0000 7f64b0a5d700 1 -- 172.21.15.31:0/3861037928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ac15a2e0 msgr2=0x7f64ac14e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:16.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.738+0000 7f64b0a5d700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ac15a2e0 0x7f64ac14e450 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f64a400c8e0 tx=0x7f64a4001710 comp rx=0 tx=0).stop 2023-10-09T06:27:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.738+0000 7f64b0a5d700 1 -- 172.21.15.31:0/3861037928 shutdown_connections 2023-10-09T06:27:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.738+0000 7f64b0a5d700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6498066f30 0x7f64980693e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.738+0000 7f64b0a5d700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ac15a2e0 0x7f64ac14e450 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.738+0000 7f64b0a5d700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f64ac0cc240 0x7f64ac0c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.738+0000 7f64b0a5d700 1 --2- 172.21.15.31:0/3861037928 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f64ac159f10 0x7f64ac157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.738+0000 7f64b0a5d700 1 -- 172.21.15.31:0/3861037928 >> 172.21.15.31:0/3861037928 conn(0x7f64ac067e40 msgr2=0x7f64ac0d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.738+0000 7f64b0a5d700 1 -- 172.21.15.31:0/3861037928 shutdown_connections 2023-10-09T06:27:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:16.738+0000 7f64b0a5d700 1 -- 172.21.15.31:0/3861037928 wait complete. 2023-10-09T06:27:16.750 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:27:16.750 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:27:16.750 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-09T06:27:16.750 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T06:27:16.751 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T06:27:16.751 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:27:16.751 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:27:16.751 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:27:16.751 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:27:16.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:16.751 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-09T06:27:16.770 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:27:16.771 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:27:16.771 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:27:16.771 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:16.771 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:27:16.771 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:16.771 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:27:16.771 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:27:16.771 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-09T06:27:16.771 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:27:16.771 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:27:16.772 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-09T06:27:16.772 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:27:16.772 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-09T06:27:16.772 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:27:16.772 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:27:16.772 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:27:16.772 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42157sec preferred_lft 42157sec 2023-10-09T06:27:16.772 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-09T06:27:16.772 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:16.772 INFO:teuthology.orchestra.run.smithi158.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:27:16.772 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:27:16.772 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:27:16.773 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:16.773 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::c5:35ff:fec9:1844/64 scope link 2023-10-09T06:27:16.773 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:16.773 INFO:teuthology.orchestra.run.smithi158.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:27:16.773 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether e6:10:14:7c:a4:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:27:16.773 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::e410:14ff:fe7c:a4d7/64 scope link 2023-10-09T06:27:16.773 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:16.773 INFO:teuthology.orchestra.run.smithi158.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:27:16.773 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T06:27:16.773 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::44a9:f1ff:fe2b:babb/64 scope link 2023-10-09T06:27:16.773 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:27:16.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:16.774 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:27:16.838 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-09T06:27:16.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:16.840 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-09T06:27:16.899 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-09T06:27:16.899 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:27:16.899 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:27:16.899 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:27:16.899 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:27:16.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:16.900 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:27:16.900 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:27:16.900 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:27:16.900 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:27:16.900 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:27:16.900 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:27:17.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:17.007 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:27:17.022 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T06:27:17.022 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T06:27:17.022 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:27:17.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:17.022 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-09T06:27:17.087 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:27:17.087 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T06:27:17.142 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:27:17.142 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:27:17.142 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:27:17.196 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T06:27:17.196 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:27:17.196 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:27:17.276 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:27:17.276 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:27:17.294 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:27:17.294 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:27:17.295 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:27:17.295 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:27:17.295 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:27:17.295 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:27:17.295 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:27:17.295 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:27:17.316 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:27:17.317 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:27:17.317 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:27:17.317 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:27:17.317 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:27:17.317 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:27:17.317 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:27:17.317 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:27:17.317 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:27:17.317 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:27:17.317 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:27:17.319 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:27:17.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:17.319 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:27:17.384 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:27:17.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.509+0000 7f326c012700 1 Processor -- start 2023-10-09T06:27:17.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.509+0000 7f326c012700 1 -- start start 2023-10-09T06:27:17.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.510+0000 7f326c012700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3264156570 0x7f326406d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:17.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.510+0000 7f326c012700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3264157c30 con 0x7f3264157050 2023-10-09T06:27:17.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.510+0000 7f326c012700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32641584f0 con 0x7f326415a330 2023-10-09T06:27:17.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.510+0000 7f326c012700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264157670 con 0x7f3264156570 2023-10-09T06:27:17.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.510+0000 7f326a5af700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3264157050 0x7f3264158980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38344/0 (socket says 172.21.15.31:38344) 2023-10-09T06:27:17.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.510+0000 7f326a5af700 1 -- 172.21.15.31:0/498396529 learned_addr learned my addr 172.21.15.31:0/498396529 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:17.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.510+0000 7f3269dae700 1 --2- 172.21.15.31:0/498396529 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3264156570 0x7f326406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:17.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.511+0000 7f3268dac700 1 -- 172.21.15.31:0/498396529 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318275694 0 0) 0x7f3264157c30 con 0x7f3264157050 2023-10-09T06:27:17.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.511+0000 7f3268dac700 1 -- 172.21.15.31:0/498396529 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f324c004680 con 0x7f3264157050 2023-10-09T06:27:17.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.511+0000 7f3268dac700 1 -- 172.21.15.31:0/498396529 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129544435 0 0) 0x7f32641584f0 con 0x7f326415a330 2023-10-09T06:27:17.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.511+0000 7f3268dac700 1 -- 172.21.15.31:0/498396529 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3264157c30 con 0x7f326415a330 2023-10-09T06:27:17.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.511+0000 7f3268dac700 1 -- 172.21.15.31:0/498396529 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1172157666 0 0) 0x7f324c004680 con 0x7f3264157050 2023-10-09T06:27:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.511+0000 7f3269dae700 1 -- 172.21.15.31:0/498396529 >> v1:172.21.15.158:6789/0 conn(0x7f326415a330 legacy=0x7f3264156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.511+0000 7f3269dae700 1 -- 172.21.15.31:0/498396529 >> v1:172.21.15.31:6789/0 conn(0x7f3264157050 legacy=0x7f3264158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.511+0000 7f3269dae700 1 -- 172.21.15.31:0/498396529 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3264157950 con 0x7f3264156570 2023-10-09T06:27:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.511+0000 7f3269dae700 1 --2- 172.21.15.31:0/498396529 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3264156570 0x7f326406d380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f325c009910 tx=0x7f325c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbbb33c68f9f5f3a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.511+0000 7f3268dac700 1 -- 172.21.15.31:0/498396529 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32540017f0 con 0x7f3264156570 2023-10-09T06:27:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.511+0000 7f3268dac700 1 -- 172.21.15.31:0/498396529 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c011420 con 0x7f3264156570 2023-10-09T06:27:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.511+0000 7f3268dac700 1 -- 172.21.15.31:0/498396529 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c0117c0 con 0x7f3264156570 2023-10-09T06:27:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.512+0000 7f326c012700 1 -- 172.21.15.31:0/498396529 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3264156570 msgr2=0x7f326406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.512+0000 7f326c012700 1 --2- 172.21.15.31:0/498396529 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3264156570 0x7f326406d380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f325c009910 tx=0x7f325c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.512+0000 7f326c012700 1 -- 172.21.15.31:0/498396529 shutdown_connections 2023-10-09T06:27:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.512+0000 7f326c012700 1 --2- 172.21.15.31:0/498396529 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3264156570 0x7f326406d380 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:17.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.512+0000 7f326c012700 1 -- 172.21.15.31:0/498396529 >> 172.21.15.31:0/498396529 conn(0x7f3264067660 msgr2=0x7f3264067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:17.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.512+0000 7f326c012700 1 -- 172.21.15.31:0/498396529 shutdown_connections 2023-10-09T06:27:17.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.512+0000 7f326c012700 1 -- 172.21.15.31:0/498396529 wait complete. 2023-10-09T06:27:17.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.513+0000 7f326c012700 1 Processor -- start 2023-10-09T06:27:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.513+0000 7f326c012700 1 -- start start 2023-10-09T06:27:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326c012700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3264156570 0x7f32640b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326c012700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3264157050 0x7f32640c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326c012700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f326415a330 0x7f32640c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326c012700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32641663e0 con 0x7f326415a330 2023-10-09T06:27:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326c012700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640c0370 con 0x7f3264157050 2023-10-09T06:27:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326c012700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32640c1140 con 0x7f3264156570 2023-10-09T06:27:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326a5af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f326415a330 0x7f32640c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326a5af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f326415a330 0x7f32640c63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39836/0 (socket says 172.21.15.31:39836) 2023-10-09T06:27:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326a5af700 1 -- 172.21.15.31:0/2405881559 learned_addr learned my addr 172.21.15.31:0/2405881559 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f3269dae700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3264156570 0x7f32640b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f32695ad700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3264157050 0x7f32640c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326a5af700 1 -- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3264156570 msgr2=0x7f32640b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326a5af700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3264156570 0x7f32640b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326a5af700 1 -- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3264157050 msgr2=0x7f32640c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326a5af700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3264157050 0x7f32640c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326a5af700 1 -- 172.21.15.31:0/2405881559 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c009420 con 0x7f326415a330 2023-10-09T06:27:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326a5af700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f326415a330 0x7f32640c63c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f325400ccb0 tx=0x7f3254007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f3261ffb700 1 -- 172.21.15.31:0/2405881559 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325400ce60 con 0x7f326415a330 2023-10-09T06:27:17.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f3261ffb700 1 -- 172.21.15.31:0/2405881559 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3254004dc0 con 0x7f326415a330 2023-10-09T06:27:17.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f326c012700 1 -- 172.21.15.31:0/2405881559 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326406a2c0 con 0x7f326415a330 2023-10-09T06:27:17.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.514+0000 7f3261ffb700 1 -- 172.21.15.31:0/2405881559 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325400ab10 con 0x7f326415a330 2023-10-09T06:27:17.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.515+0000 7f326c012700 1 -- 172.21.15.31:0/2405881559 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32640c08a0 con 0x7f326415a330 2023-10-09T06:27:17.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.516+0000 7f326c012700 1 -- 172.21.15.31:0/2405881559 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3264166550 con 0x7f326415a330 2023-10-09T06:27:17.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.516+0000 7f3261ffb700 1 -- 172.21.15.31:0/2405881559 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3254007150 con 0x7f326415a330 2023-10-09T06:27:17.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.516+0000 7f3261ffb700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3250066f30 0x7f32500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:17.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.517+0000 7f3261ffb700 1 -- 172.21.15.31:0/2405881559 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3254083de0 con 0x7f326415a330 2023-10-09T06:27:17.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.517+0000 7f3269dae700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3250066f30 0x7f32500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:17.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.517+0000 7f3269dae700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3250066f30 0x7f32500693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f325c0030c0 tx=0x7f325c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:17.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.521+0000 7f3261ffb700 1 -- 172.21.15.31:0/2405881559 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3264166550 con 0x7f326415a330 2023-10-09T06:27:17.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.756+0000 7f326c012700 1 -- 172.21.15.31:0/2405881559 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3264166520 con 0x7f326415a330 2023-10-09T06:27:17.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.756+0000 7f3261ffb700 1 -- 172.21.15.31:0/2405881559 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f3254018090 con 0x7f326415a330 2023-10-09T06:27:17.756 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:17.756 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/1232957657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1232957657},{"type":"v1","addr":"172.21.15.158:6836","nonce":1232957657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2947695434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2947695434},{"type":"v1","addr":"172.21.15.158:6837","nonce":2947695434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/912397379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":912397379},{"type":"v1","addr":"172.21.15.31:6834","nonce":912397379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:07.779885+0000","modified":"2023-10-09T06:27:12.402382+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7005},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7005":{"gid":7005,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1684509217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1684509217},{"type":"v1","addr":"172.21.15.31:6835","nonce":1684509217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T06:27:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.758+0000 7f326c012700 1 -- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3250066f30 msgr2=0x7f32500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.758+0000 7f326c012700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3250066f30 0x7f32500693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f325c0030c0 tx=0x7f325c016000 comp rx=0 tx=0).stop 2023-10-09T06:27:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.758+0000 7f326c012700 1 -- 172.21.15.31:0/2405881559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f326415a330 msgr2=0x7f32640c63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.758+0000 7f326c012700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f326415a330 0x7f32640c63c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f325400ccb0 tx=0x7f3254007d20 comp rx=0 tx=0).stop 2023-10-09T06:27:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.758+0000 7f326c012700 1 -- 172.21.15.31:0/2405881559 shutdown_connections 2023-10-09T06:27:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.758+0000 7f326c012700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3250066f30 0x7f32500693e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.758+0000 7f326c012700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3264156570 0x7f32640b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.758+0000 7f326c012700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f326415a330 0x7f32640c63c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.758+0000 7f326c012700 1 --2- 172.21.15.31:0/2405881559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3264157050 0x7f32640c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.758+0000 7f326c012700 1 -- 172.21.15.31:0/2405881559 >> 172.21.15.31:0/2405881559 conn(0x7f3264067660 msgr2=0x7f3264158980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.758+0000 7f326c012700 1 -- 172.21.15.31:0/2405881559 shutdown_connections 2023-10-09T06:27:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:17.758+0000 7f326c012700 1 -- 172.21.15.31:0/2405881559 wait complete. 2023-10-09T06:27:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 66 2023-10-09T06:27:17.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-09T06:27:17.910 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":7005,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.5279851840000003,"mdsmap_epoch":66,"osdmap_epoch":136,"osdmap_epoch_barrier":136,"uptime":14.590461778} 2023-10-09T06:27:17.910 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 7005, "mdsmap_epoch": 66, "osdmap_epoch": 136, "osdmap_epoch_barrier": 136, "rank_uptime": 9.527985184, "state": "up:active", "uptime": 14.590461778, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:27:17.910 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-09T06:27:18.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.034+0000 7f784d262700 1 Processor -- start 2023-10-09T06:27:18.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.034+0000 7f784d262700 1 -- start start 2023-10-09T06:27:18.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f784d262700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f78480ab9b0 0x7f78480ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f784d262700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78480abd80 0x7f784806dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f784d262700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f784806e020 0x7f78481577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f784d262700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78480adc10 con 0x7f78480ab9b0 2023-10-09T06:27:18.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f784d262700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784806eb90 con 0x7f784806e020 2023-10-09T06:27:18.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f784d262700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78480adda0 con 0x7f78480abd80 2023-10-09T06:27:18.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f7846ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f78480ab9b0 0x7f78480ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f7846ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f78480ab9b0 0x7f78480ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39848/0 (socket says 172.21.15.31:39848) 2023-10-09T06:27:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f7846ffd700 1 -- 172.21.15.31:0/1572148559 learned_addr learned my addr 172.21.15.31:0/1572148559 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f78467fc700 1 --2- 172.21.15.31:0/1572148559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78480abd80 0x7f784806dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f78477fe700 1 --2- 172.21.15.31:0/1572148559 >> v2:172.21.15.158:3300/0 conn(0x7f784806e020 0x7f78481577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f7846ffd700 1 -- 172.21.15.31:0/1572148559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78480abd80 msgr2=0x7f784806dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f7846ffd700 1 --2- 172.21.15.31:0/1572148559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78480abd80 0x7f784806dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f7846ffd700 1 -- 172.21.15.31:0/1572148559 >> v2:172.21.15.158:3300/0 conn(0x7f784806e020 msgr2=0x7f78481577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f7846ffd700 1 --2- 172.21.15.31:0/1572148559 >> v2:172.21.15.158:3300/0 conn(0x7f784806e020 0x7f78481577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f7846ffd700 1 -- 172.21.15.31:0/1572148559 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784806ede0 con 0x7f78480ab9b0 2023-10-09T06:27:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f7846ffd700 1 --2- 172.21.15.31:0/1572148559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78480ab9b0 0x7f78480ca880 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f78480ad750 tx=0x7f7840009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2644d9084af67edd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.035+0000 7f7845ffb700 1 -- 172.21.15.31:0/1572148559 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000b640 con 0x7f78480ab9b0 2023-10-09T06:27:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.036+0000 7f7845ffb700 1 -- 172.21.15.31:0/1572148559 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784000b7a0 con 0x7f78480ab9b0 2023-10-09T06:27:18.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.036+0000 7f7845ffb700 1 -- 172.21.15.31:0/1572148559 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000bb60 con 0x7f78480ab9b0 2023-10-09T06:27:18.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.036+0000 7f784d262700 1 -- 172.21.15.31:0/1572148559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78480ab9b0 msgr2=0x7f78480ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:18.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.036+0000 7f784d262700 1 --2- 172.21.15.31:0/1572148559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78480ab9b0 0x7f78480ca880 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f78480ad750 tx=0x7f7840009250 comp rx=0 tx=0).stop 2023-10-09T06:27:18.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.036+0000 7f784d262700 1 -- 172.21.15.31:0/1572148559 shutdown_connections 2023-10-09T06:27:18.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.036+0000 7f784d262700 1 --2- 172.21.15.31:0/1572148559 >> v2:172.21.15.158:3300/0 conn(0x7f784806e020 0x7f78481577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.036+0000 7f784d262700 1 --2- 172.21.15.31:0/1572148559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78480ab9b0 0x7f78480ca880 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.036+0000 7f784d262700 1 --2- 172.21.15.31:0/1572148559 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78480abd80 0x7f784806dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.036+0000 7f784d262700 1 -- 172.21.15.31:0/1572148559 >> 172.21.15.31:0/1572148559 conn(0x7f78480cd450 msgr2=0x7f78480c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:18.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.036+0000 7f784d262700 1 -- 172.21.15.31:0/1572148559 shutdown_connections 2023-10-09T06:27:18.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.036+0000 7f784d262700 1 -- 172.21.15.31:0/1572148559 wait complete. 2023-10-09T06:27:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.037+0000 7f784d262700 1 Processor -- start 2023-10-09T06:27:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.037+0000 7f784d262700 1 -- start start 2023-10-09T06:27:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.038+0000 7f784d262700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784806e020 0x7f784816e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.038+0000 7f784d262700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78480ab9b0 0x7f784814b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.038+0000 7f784d262700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78480abd80 0x7f784814d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.038+0000 7f784d262700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784816ecd0 con 0x7f784806e020 2023-10-09T06:27:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.038+0000 7f784d262700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784814c040 con 0x7f78480ab9b0 2023-10-09T06:27:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.038+0000 7f784d262700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784814c320 con 0x7f78480abd80 2023-10-09T06:27:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.038+0000 7f7846ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784806e020 0x7f784816e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.038+0000 7f7846ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784806e020 0x7f784816e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39862/0 (socket says 172.21.15.31:39862) 2023-10-09T06:27:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.038+0000 7f7846ffd700 1 -- 172.21.15.31:0/1371776084 learned_addr learned my addr 172.21.15.31:0/1371776084 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.038+0000 7f78467fc700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78480ab9b0 0x7f784814b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.038+0000 7f78477fe700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78480abd80 0x7f784814d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.039+0000 7f7846ffd700 1 -- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78480abd80 msgr2=0x7f784814d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.039+0000 7f7846ffd700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78480abd80 0x7f784814d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.039+0000 7f7846ffd700 1 -- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78480ab9b0 msgr2=0x7f784814b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.039+0000 7f7846ffd700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78480ab9b0 0x7f784814b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.039+0000 7f7846ffd700 1 -- 172.21.15.31:0/1371776084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78400094f0 con 0x7f784806e020 2023-10-09T06:27:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.039+0000 7f7846ffd700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784806e020 0x7f784816e790 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f784806c790 tx=0x7f7840017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.039+0000 7f783effd700 1 -- 172.21.15.31:0/1371776084 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000b910 con 0x7f784806e020 2023-10-09T06:27:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.039+0000 7f783effd700 1 -- 172.21.15.31:0/1371776084 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784000ba70 con 0x7f784806e020 2023-10-09T06:27:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.039+0000 7f784d262700 1 -- 172.21.15.31:0/1371776084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784814c600 con 0x7f784806e020 2023-10-09T06:27:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.039+0000 7f783effd700 1 -- 172.21.15.31:0/1371776084 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840011630 con 0x7f784806e020 2023-10-09T06:27:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.039+0000 7f784d262700 1 -- 172.21.15.31:0/1371776084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784814cbc0 con 0x7f784806e020 2023-10-09T06:27:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.040+0000 7f784d262700 1 -- 172.21.15.31:0/1371776084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784804c3c0 con 0x7f784806e020 2023-10-09T06:27:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.040+0000 7f783effd700 1 -- 172.21.15.31:0/1371776084 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78400119a0 con 0x7f784806e020 2023-10-09T06:27:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.041+0000 7f783effd700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7828066f30 0x7f78280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.041+0000 7f783effd700 1 -- 172.21.15.31:0/1371776084 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7840085b80 con 0x7f784806e020 2023-10-09T06:27:18.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.041+0000 7f78467fc700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7828066f30 0x7f78280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.041+0000 7f78467fc700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7828066f30 0x7f78280693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f784815ea70 tx=0x7f78300091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:18.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.045+0000 7f783effd700 1 -- 172.21.15.31:0/1371776084 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7840052df0 con 0x7f784806e020 2023-10-09T06:27:18.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.238+0000 7f784d262700 1 -- 172.21.15.31:0/1371776084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f78480cc5b0 con 0x7f784806e020 2023-10-09T06:27:18.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.436+0000 7f783effd700 1 -- 172.21.15.31:0/1371776084 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v137) v1 ==== 181+0+0 (secure 0 0 0) 0x7f78400150c0 con 0x7f784806e020 2023-10-09T06:27:18.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.438+0000 7f784d262700 1 -- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7828066f30 msgr2=0x7f78280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:18.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.438+0000 7f784d262700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7828066f30 0x7f78280693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f784815ea70 tx=0x7f78300091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.439+0000 7f784d262700 1 -- 172.21.15.31:0/1371776084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784806e020 msgr2=0x7f784816e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:18.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.439+0000 7f784d262700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784806e020 0x7f784816e790 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f784806c790 tx=0x7f7840017000 comp rx=0 tx=0).stop 2023-10-09T06:27:18.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.439+0000 7f784d262700 1 -- 172.21.15.31:0/1371776084 shutdown_connections 2023-10-09T06:27:18.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.439+0000 7f784d262700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7828066f30 0x7f78280693e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.439+0000 7f784d262700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f78480abd80 0x7f784814d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.439+0000 7f784d262700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784806e020 0x7f784816e790 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.439+0000 7f784d262700 1 --2- 172.21.15.31:0/1371776084 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78480ab9b0 0x7f784814b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.439+0000 7f784d262700 1 -- 172.21.15.31:0/1371776084 >> 172.21.15.31:0/1371776084 conn(0x7f78480cd450 msgr2=0x7f78480690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:18.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.439+0000 7f784d262700 1 -- 172.21.15.31:0/1371776084 shutdown_connections 2023-10-09T06:27:18.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.439+0000 7f784d262700 1 -- 172.21.15.31:0/1371776084 wait complete. 2023-10-09T06:27:18.440 INFO:teuthology.orchestra.run.smithi031.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-09T06:27:18.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T06:27:18.585 INFO:teuthology.orchestra.run.smithi031.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T06:27:18.586 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T06:27:18.586 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-09T06:27:18.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:27:18.586 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-09T06:27:18.698 INFO:teuthology.orchestra.run.smithi031.stderr:16+0 records in 2023-10-09T06:27:18.699 INFO:teuthology.orchestra.run.smithi031.stderr:16+0 records out 2023-10-09T06:27:18.699 INFO:teuthology.orchestra.run.smithi031.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0934242 s, 180 MB/s 2023-10-09T06:27:18.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:27:18.700 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-09T06:27:18.817 INFO:teuthology.orchestra.run.smithi031.stderr:17+0 records in 2023-10-09T06:27:18.818 INFO:teuthology.orchestra.run.smithi031.stderr:17+0 records out 2023-10-09T06:27:18.818 INFO:teuthology.orchestra.run.smithi031.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.102017 s, 175 MB/s 2023-10-09T06:27:18.819 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-09T06:27:18.819 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:27:18.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.937+0000 7fe404ae9700 1 Processor -- start 2023-10-09T06:27:18.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.937+0000 7fe404ae9700 1 -- start start 2023-10-09T06:27:18.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe404ae9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe40015a030 0x7fe40015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe404ae9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4000cf100 0x7fe4000cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe404ae9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe4000b40b0 0x7fe4000b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe404ae9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4000d1960 con 0x7fe4000cf100 2023-10-09T06:27:18.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe404ae9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4000d0610 con 0x7fe4000b40b0 2023-10-09T06:27:18.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe404ae9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40015a940 con 0x7fe40015a030 2023-10-09T06:27:18.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe3feffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4000cf100 0x7fe4000cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe3feffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4000cf100 0x7fe4000cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39866/0 (socket says 172.21.15.31:39866) 2023-10-09T06:27:18.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe3feffd700 1 -- 172.21.15.31:0/3793572818 learned_addr learned my addr 172.21.15.31:0/3793572818 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:18.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe3ff7fe700 1 --2- 172.21.15.31:0/3793572818 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe40015a030 0x7fe40015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe3fffff700 1 --2- 172.21.15.31:0/3793572818 >> v2:172.21.15.158:3300/0 conn(0x7fe4000b40b0 0x7fe4000b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe3feffd700 1 -- 172.21.15.31:0/3793572818 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe40015a030 msgr2=0x7fe40015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:18.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe3feffd700 1 --2- 172.21.15.31:0/3793572818 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe40015a030 0x7fe40015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe3feffd700 1 -- 172.21.15.31:0/3793572818 >> v2:172.21.15.158:3300/0 conn(0x7fe4000b40b0 msgr2=0x7fe4000b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:18.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe3feffd700 1 --2- 172.21.15.31:0/3793572818 >> v2:172.21.15.158:3300/0 conn(0x7fe4000b40b0 0x7fe4000b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe3feffd700 1 -- 172.21.15.31:0/3793572818 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4000cfab0 con 0x7fe4000cf100 2023-10-09T06:27:18.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.938+0000 7fe3feffd700 1 --2- 172.21.15.31:0/3793572818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4000cf100 0x7fe4000cf570 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fe4000711d0 tx=0x7fe3f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16efd5175b85f31 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:18.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.939+0000 7fe3fe7fc700 1 -- 172.21.15.31:0/3793572818 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400b640 con 0x7fe4000cf100 2023-10-09T06:27:18.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.939+0000 7fe3fe7fc700 1 -- 172.21.15.31:0/3793572818 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f400b7a0 con 0x7fe4000cf100 2023-10-09T06:27:18.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.939+0000 7fe3fe7fc700 1 -- 172.21.15.31:0/3793572818 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400bb60 con 0x7fe4000cf100 2023-10-09T06:27:18.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.939+0000 7fe404ae9700 1 -- 172.21.15.31:0/3793572818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4000cf100 msgr2=0x7fe4000cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:18.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.939+0000 7fe404ae9700 1 --2- 172.21.15.31:0/3793572818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4000cf100 0x7fe4000cf570 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fe4000711d0 tx=0x7fe3f4009250 comp rx=0 tx=0).stop 2023-10-09T06:27:18.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.939+0000 7fe404ae9700 1 -- 172.21.15.31:0/3793572818 shutdown_connections 2023-10-09T06:27:18.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.939+0000 7fe404ae9700 1 --2- 172.21.15.31:0/3793572818 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe40015a030 0x7fe40015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.939+0000 7fe404ae9700 1 --2- 172.21.15.31:0/3793572818 >> v2:172.21.15.158:3300/0 conn(0x7fe4000b40b0 0x7fe4000b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.939+0000 7fe404ae9700 1 --2- 172.21.15.31:0/3793572818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4000cf100 0x7fe4000cf570 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.939+0000 7fe404ae9700 1 -- 172.21.15.31:0/3793572818 >> 172.21.15.31:0/3793572818 conn(0x7fe400067e40 msgr2=0x7fe4000d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:18.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.939+0000 7fe404ae9700 1 -- 172.21.15.31:0/3793572818 shutdown_connections 2023-10-09T06:27:18.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.939+0000 7fe404ae9700 1 -- 172.21.15.31:0/3793572818 wait complete. 2023-10-09T06:27:18.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.940+0000 7fe404ae9700 1 Processor -- start 2023-10-09T06:27:18.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.940+0000 7fe404ae9700 1 -- start start 2023-10-09T06:27:18.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.941+0000 7fe404ae9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4000b40b0 0x7fe40015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.941+0000 7fe404ae9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4000cf100 0x7fe40016afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.941+0000 7fe404ae9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe40015a030 0x7fe4000b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.941+0000 7fe404ae9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40016b500 con 0x7fe4000cf100 2023-10-09T06:27:18.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.941+0000 7fe404ae9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40015cd20 con 0x7fe4000b40b0 2023-10-09T06:27:18.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.941+0000 7fe404ae9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000b31f0 con 0x7fe40015a030 2023-10-09T06:27:18.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.941+0000 7fe3feffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4000cf100 0x7fe40016afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.941+0000 7fe3feffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4000cf100 0x7fe40016afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39882/0 (socket says 172.21.15.31:39882) 2023-10-09T06:27:18.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.941+0000 7fe3feffd700 1 -- 172.21.15.31:0/222375384 learned_addr learned my addr 172.21.15.31:0/222375384 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:18.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.941+0000 7fe3fffff700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe40015a030 0x7fe4000b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.941+0000 7fe3ff7fe700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4000b40b0 0x7fe40015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.942+0000 7fe3feffd700 1 -- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe40015a030 msgr2=0x7fe4000b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:18.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.942+0000 7fe3feffd700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe40015a030 0x7fe4000b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.942+0000 7fe3feffd700 1 -- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4000b40b0 msgr2=0x7fe40015d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:18.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.942+0000 7fe3feffd700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4000b40b0 0x7fe40015d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:18.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.942+0000 7fe3feffd700 1 -- 172.21.15.31:0/222375384 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f40094f0 con 0x7fe4000cf100 2023-10-09T06:27:18.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.942+0000 7fe3feffd700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4000cf100 0x7fe40016afc0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fe400089600 tx=0x7fe3f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:18.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.942+0000 7fe3e77fe700 1 -- 172.21.15.31:0/222375384 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400b910 con 0x7fe4000cf100 2023-10-09T06:27:18.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.942+0000 7fe3e77fe700 1 -- 172.21.15.31:0/222375384 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f400ba70 con 0x7fe4000cf100 2023-10-09T06:27:18.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.942+0000 7fe404ae9700 1 -- 172.21.15.31:0/222375384 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40015c110 con 0x7fe4000cf100 2023-10-09T06:27:18.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.942+0000 7fe3e77fe700 1 -- 172.21.15.31:0/222375384 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4011630 con 0x7fe4000cf100 2023-10-09T06:27:18.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.942+0000 7fe404ae9700 1 -- 172.21.15.31:0/222375384 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40015c6d0 con 0x7fe4000cf100 2023-10-09T06:27:18.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.943+0000 7fe404ae9700 1 -- 172.21.15.31:0/222375384 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe400089300 con 0x7fe4000cf100 2023-10-09T06:27:18.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.943+0000 7fe3e77fe700 1 -- 172.21.15.31:0/222375384 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3f40119a0 con 0x7fe4000cf100 2023-10-09T06:27:18.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.944+0000 7fe3e77fe700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe3ec066f30 0x7fe3ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:18.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.944+0000 7fe3e77fe700 1 -- 172.21.15.31:0/222375384 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3f4085c70 con 0x7fe4000cf100 2023-10-09T06:27:18.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.944+0000 7fe3ff7fe700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe3ec066f30 0x7fe3ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:18.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.944+0000 7fe3ff7fe700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe3ec066f30 0x7fe3ec0693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe40016ec50 tx=0x7fe3f0009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:18.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:18.948+0000 7fe3e77fe700 1 -- 172.21.15.31:0/222375384 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3f4052ee0 con 0x7fe4000cf100 2023-10-09T06:27:19.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.142+0000 7fe404ae9700 1 -- 172.21.15.31:0/222375384 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe4000890a0 con 0x7fe4000cf100 2023-10-09T06:27:19.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.143+0000 7fe3e77fe700 1 -- 172.21.15.31:0/222375384 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v137) v1 ==== 81+0+32282 (secure 0 0 0) 0x7fe3f4015090 con 0x7fe4000cf100 2023-10-09T06:27:19.144 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:19.144 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:27:19.144 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 137, 2023-10-09T06:27:19.144 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:27:19.144 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:27:19.144 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:27:18.429025+0000", 2023-10-09T06:27:19.144 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:27:19.145 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:27:19.145 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:27:19.145 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:27:19.145 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:27:19.145 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:27:19.145 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:27:19.145 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:27:19.145 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:27:19.145 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:19.145 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:27:19.145 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:27:19.146 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:27:19.146 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:27:19.146 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:27:19.146 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 17, 2023-10-09T06:27:19.146 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:27:19.146 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:27:19.146 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:27:19.146 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:27:19.147 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:27:19.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.147 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:27:19.147 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:27:19.147 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:27:19.147 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:19.147 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:19.147 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:19.147 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:19.147 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:19.147 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:19.148 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:19.148 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:19.148 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:19.148 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:19.148 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:19.148 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:19.148 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:27:19.148 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:27:19.149 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:27:19.149 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:27:19.149 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:27:19.149 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:19.149 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:19.149 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:19.149 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:19.149 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:19.149 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:19.149 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:19.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.150 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:27:19.150 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:19.150 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:19.150 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:19.150 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:19.150 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:19.151 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:19.151 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:19.151 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:19.151 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:19.151 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:19.151 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:19.151 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:19.151 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:19.152 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:19.152 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:19.152 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:19.152 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:19.152 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:19.152 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:19.152 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:19.152 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:19.153 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:19.153 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:19.153 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:19.153 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:19.153 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:19.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.153 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:19.153 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:19.153 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:19.154 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:19.154 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:19.154 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:19.154 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:19.154 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:19.154 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:19.154 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:19.154 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:19.155 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:19.155 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:27:19.155 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:27:19.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.155 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:19.155 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:27:19.155 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.155 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 16, 2023-10-09T06:27:19.155 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:27:19.155 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.232021+0000", 2023-10-09T06:27:19.156 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:19.156 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:19.156 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:19.156 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:19.156 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:19.156 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:19.156 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:19.156 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:19.156 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:19.156 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:19.156 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:19.156 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:19.157 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:27:19.157 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:27:19.157 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:27:19.157 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:27:19.157 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:27:19.157 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:19.157 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:19.157 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:19.157 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:19.157 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:19.157 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:19.158 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:19.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.158 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "135", 2023-10-09T06:27:19.158 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:19.158 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:19.158 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:19.158 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:19.158 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:19.158 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:19.158 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:19.158 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:19.159 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:19.159 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:19.159 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:19.159 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:19.159 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:19.159 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:19.159 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:19.159 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:19.159 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:19.159 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:19.159 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:19.159 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:19.160 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:19.160 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:19.160 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:19.160 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:19.160 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:19.160 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:19.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.160 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:19.160 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:19.160 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:19.160 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:19.160 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:19.161 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:19.161 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:19.161 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:19.161 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:19.161 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:19.161 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:19.161 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:19.161 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:27:19.161 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:27:19.161 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:27:19.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.161 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:19.162 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:19.162 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:27:19.162 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.162 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.162 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 17, 2023-10-09T06:27:19.162 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:27:19.162 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.742407+0000", 2023-10-09T06:27:19.162 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:19.162 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:19.162 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:19.163 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:19.163 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:19.163 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:19.163 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:19.163 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:19.163 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:19.163 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:19.163 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:19.163 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:19.163 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:27:19.163 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:27:19.163 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:27:19.164 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:27:19.164 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:27:19.164 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:19.164 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:19.164 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:19.164 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:19.164 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:19.164 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:19.164 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:19.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.164 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "137", 2023-10-09T06:27:19.164 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:19.165 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:19.165 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:19.165 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:19.165 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:19.165 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:19.165 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:19.165 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:19.165 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:19.165 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:27:19.165 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:19.165 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:19.165 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:19.165 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:19.166 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:19.166 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:19.166 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:19.166 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:19.166 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:19.166 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:19.166 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:19.166 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:19.166 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:19.166 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:19.167 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:19.167 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:19.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.167 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:19.167 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:19.167 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:19.167 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:19.167 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:19.167 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:19.167 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:19.167 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:19.167 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:19.168 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:19.168 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:19.168 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:19.168 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:27:19.168 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:27:19.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.168 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:19.168 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:19.168 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:27:19.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.168 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:19.169 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:27:19.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.169 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:19.169 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:19.169 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:19.169 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:19.169 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:19.169 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:19.169 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:19.169 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:19.169 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:19.169 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:19.170 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:19.170 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:19.170 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:19.170 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.170 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.170 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:27:19.170 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:19.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.170 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.170 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:27:19.171 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:19.171 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.171 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.171 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:19.171 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.171 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.171 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:27:19.171 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:19.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.172 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.172 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:27:19.172 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:19.172 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.172 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.172 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:19.172 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.172 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.172 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:27:19.172 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:19.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.173 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.173 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:27:19.173 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:19.173 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.173 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.173 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:19.173 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.173 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.173 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:27:19.174 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:19.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.174 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.174 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:27:19.174 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:19.174 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.174 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.174 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:27:19.174 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:27:19.175 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:27:19.175 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:27:19.175 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:19.175 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:19.175 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:19.175 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.175 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:19.176 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:19.176 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:19.176 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:19.176 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:19.176 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:19.176 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:19.176 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:19.176 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:19.176 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:19.176 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:19.176 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:19.176 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:19.177 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.177 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.177 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:27:19.177 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:19.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.177 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.177 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:27:19.177 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:19.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.177 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.178 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.178 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:19.178 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.178 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.178 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:27:19.178 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:19.178 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.178 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.178 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:27:19.179 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:19.179 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.179 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.179 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:19.179 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.179 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.179 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:27:19.179 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:19.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.180 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.180 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:27:19.180 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:19.180 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.180 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.180 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:19.180 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.181 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.181 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:27:19.181 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:19.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.181 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.181 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:27:19.181 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:19.181 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.181 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.182 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:27:19.182 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:27:19.182 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:27:19.182 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:27:19.182 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:19.182 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:19.182 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:19.182 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.183 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.183 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:19.183 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:19.183 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:19.183 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:19.183 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:19.183 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:19.183 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:19.183 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:19.183 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:19.183 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:19.183 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:19.184 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:19.184 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:19.184 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.184 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.184 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:27:19.184 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:19.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.185 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.185 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:27:19.185 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:19.185 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.185 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.185 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:19.185 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.185 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.186 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:27:19.186 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:19.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.186 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.186 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:27:19.187 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:19.187 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.187 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.187 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:19.187 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.187 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.187 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:27:19.188 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:19.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.188 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.188 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:27:19.188 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:19.188 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.188 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.189 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:19.189 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.189 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.189 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:27:19.189 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:19.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.190 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.190 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:27:19.190 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:19.190 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.190 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.190 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:27:19.191 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:27:19.191 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:27:19.191 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:27:19.191 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:19.191 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:19.191 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:19.191 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.191 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:19.191 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:19.191 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:19.192 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:19.192 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:19.192 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:19.192 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:19.192 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:19.192 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:19.192 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:19.192 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:19.192 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:19.192 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:19.192 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.193 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.193 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:27:19.193 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:19.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.193 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.193 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:27:19.193 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:19.193 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.193 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.193 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:19.194 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.194 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.194 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:27:19.194 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:19.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.194 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.194 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:27:19.194 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:19.194 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.195 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.195 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:19.195 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.195 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.195 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:27:19.195 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:19.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.195 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.195 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:27:19.196 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:19.196 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.196 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.196 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:19.196 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.196 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.196 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:27:19.196 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:19.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.197 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.197 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:27:19.197 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:19.197 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.197 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.197 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:27:19.197 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:27:19.197 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:27:19.197 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:27:19.198 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:19.198 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:19.198 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:19.198 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.198 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:19.198 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:19.198 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:19.198 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:19.198 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:19.198 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:19.199 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:19.199 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:19.199 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:19.199 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:19.199 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:19.199 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:19.199 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:19.199 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.199 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.199 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:27:19.199 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:19.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.200 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.200 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:27:19.200 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:19.200 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.200 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.200 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:19.200 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.200 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.201 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:27:19.201 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:19.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.201 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.201 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:27:19.201 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:19.201 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.201 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.201 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:19.201 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.202 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.202 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:27:19.202 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:19.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.202 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.202 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:27:19.202 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:19.202 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.202 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.202 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:19.203 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.203 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.203 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:27:19.203 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:19.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.203 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.203 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:27:19.203 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:19.203 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.203 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.204 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:27:19.204 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:27:19.204 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:27:19.204 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:27:19.204 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:19.204 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:19.204 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:19.204 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.204 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:19.204 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:19.205 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:19.205 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:19.205 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:19.205 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:19.205 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:19.205 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:19.205 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:19.205 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:19.205 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:19.205 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:19.205 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:19.206 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.206 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.206 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:27:19.206 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:19.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.206 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.206 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:27:19.206 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:19.206 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.207 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.207 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:19.207 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.207 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.207 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:27:19.207 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:19.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.207 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.208 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:27:19.208 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:19.208 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.208 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.208 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:19.208 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.208 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.208 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:27:19.208 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:19.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.209 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.209 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:27:19.209 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:19.209 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.209 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.209 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:19.209 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.209 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.209 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:27:19.210 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:19.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.210 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.210 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:27:19.210 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:19.210 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.210 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.210 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:27:19.210 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:27:19.210 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:27:19.211 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:27:19.211 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:19.211 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:19.211 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:19.211 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.211 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.213 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:27:19.213 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:19.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.213 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:27:19.214 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:19.214 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.214 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.214 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:19.214 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.214 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.214 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:27:19.214 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:19.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.214 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.215 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:27:19.215 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:19.215 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.215 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.215 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:19.215 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.216 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.217 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:27:19.218 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:19.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.218 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.218 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:27:19.218 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:19.218 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.218 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.218 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:19.219 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.219 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.219 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:27:19.219 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:19.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.219 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.219 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:27:19.219 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:19.220 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.220 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.220 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:27:19.220 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:27:19.220 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:27:19.220 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:27:19.220 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:19.220 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:19.220 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:19.221 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.221 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:19.221 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:19.221 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:19.221 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:19.221 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:19.222 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:19.222 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:19.222 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:19.222 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:19.222 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:19.222 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:19.222 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:19.222 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:19.223 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.223 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.223 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:27:19.223 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:19.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.223 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.224 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:27:19.224 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:19.224 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.224 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.224 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:19.224 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.224 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.224 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:27:19.224 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:19.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.225 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.225 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:27:19.225 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:19.225 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.225 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.225 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:19.225 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.225 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.226 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:27:19.226 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:19.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.226 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.226 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:27:19.226 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:19.226 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.226 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.226 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:19.226 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:19.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.227 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:19.227 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:27:19.227 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:19.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.227 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:19.227 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:27:19.227 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:19.227 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.227 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.228 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:27:19.228 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:27:19.228 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:27:19.228 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:27:19.228 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:19.228 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:19.228 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:19.228 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:19.228 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.228 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:19.228 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:27:19.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.229 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:19.229 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:19.229 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:19.229 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:19.229 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:19.229 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:19.229 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:27:19.229 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:19.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.229 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:19.229 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:19.229 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:19.230 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:19.230 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:19.230 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:19.230 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:27:19.230 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:19.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.230 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:19.230 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:19.230 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:19.230 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:19.231 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:19.231 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:19.231 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:27:19.231 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:19.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.231 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:19.231 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:19.231 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:19.231 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:19.231 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:27:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:19.232 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:27:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:27:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:19.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:27:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:19.234 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:19.235 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:19.235 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:19.235 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:19.235 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:19.235 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:19.235 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:27:19.235 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:19.235 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.235 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:19.235 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:27:19.235 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:27:19.235 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:27:19.235 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:27:19.236 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:27:19.236 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:27:19.236 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:27:19.236 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:27:19.236 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:27:19.236 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:27:19.236 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:27:19.236 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:27:19.236 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:27:19.236 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:19.236 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:27:19.236 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:27:19.237 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:27:19.237 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:27:19.237 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:27:19.237 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:27:19.237 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:27:19.237 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:27:19.237 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:27:19.237 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:27:19.237 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:27:19.237 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:19.237 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:27:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.145+0000 7fe404ae9700 1 -- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe3ec066f30 msgr2=0x7fe3ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.145+0000 7fe404ae9700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe3ec066f30 0x7fe3ec0693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe40016ec50 tx=0x7fe3f0009120 comp rx=0 tx=0).stop 2023-10-09T06:27:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.145+0000 7fe404ae9700 1 -- 172.21.15.31:0/222375384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4000cf100 msgr2=0x7fe40016afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.145+0000 7fe404ae9700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4000cf100 0x7fe40016afc0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fe400089600 tx=0x7fe3f4017000 comp rx=0 tx=0).stop 2023-10-09T06:27:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.145+0000 7fe404ae9700 1 -- 172.21.15.31:0/222375384 shutdown_connections 2023-10-09T06:27:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.145+0000 7fe404ae9700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe3ec066f30 0x7fe3ec0693e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:19.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.145+0000 7fe404ae9700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe40015a030 0x7fe4000b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:19.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.145+0000 7fe404ae9700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe4000b40b0 0x7fe40015d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:19.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.145+0000 7fe404ae9700 1 --2- 172.21.15.31:0/222375384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4000cf100 0x7fe40016afc0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:19.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.145+0000 7fe404ae9700 1 -- 172.21.15.31:0/222375384 >> 172.21.15.31:0/222375384 conn(0x7fe400067e40 msgr2=0x7fe4000b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:19.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.145+0000 7fe404ae9700 1 -- 172.21.15.31:0/222375384 shutdown_connections 2023-10-09T06:27:19.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:19.145+0000 7fe404ae9700 1 -- 172.21.15.31:0/222375384 wait complete. 2023-10-09T06:27:19.240 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:27:24.242 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:27:24.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.374+0000 7f9733558700 1 Processor -- start 2023-10-09T06:27:24.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.375+0000 7f9733558700 1 -- start start 2023-10-09T06:27:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.375+0000 7f9733558700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f972c157870 0x7f972c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.375+0000 7f9733558700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f972c15a620 0x7f972c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.375+0000 7f9733558700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972c15cbb0 con 0x7f972c15d580 2023-10-09T06:27:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.375+0000 7f9733558700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f972c15bfa0 con 0x7f972c157870 2023-10-09T06:27:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.375+0000 7f9733558700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972c15c280 con 0x7f972c15a620 2023-10-09T06:27:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.375+0000 7f9731af5700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f972c15d580 0x7f972c158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40566/0 (socket says 172.21.15.31:40566) 2023-10-09T06:27:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9731af5700 1 -- 172.21.15.31:0/1939985977 learned_addr learned my addr 172.21.15.31:0/1939985977 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9730af3700 1 --2- 172.21.15.31:0/1939985977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f972c15a620 0x7f972c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f97312f4700 1 --2- 172.21.15.31:0/1939985977 >> v2:172.21.15.158:3300/0 conn(0x7f972c157870 0x7f972c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37785295 0 0) 0x7f972c15cbb0 con 0x7f972c15d580 2023-10-09T06:27:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9718003570 con 0x7f972c15d580 2023-10-09T06:27:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3716985666 0 0) 0x7f9718003570 con 0x7f972c15d580 2023-10-09T06:27:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f972c15a620 msgr2=0x7f972c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 --2- 172.21.15.31:0/1939985977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f972c15a620 0x7f972c15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 >> v2:172.21.15.158:3300/0 conn(0x7f972c157870 msgr2=0x7f972c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 --2- 172.21.15.31:0/1939985977 >> v2:172.21.15.158:3300/0 conn(0x7f972c157870 0x7f972c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c15c560 con 0x7f972c15d580 2023-10-09T06:27:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f97240017f0 con 0x7f972c15d580 2023-10-09T06:27:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 >> v1:172.21.15.31:6789/0 conn(0x7f972c15d580 legacy=0x7f972c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 --2- 172.21.15.31:0/1939985977 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9718003ae0 0x7f9718003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 --2- 172.21.15.31:0/1939985977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f972c15a620 0x7f9718004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:24.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 --2- 172.21.15.31:0/1939985977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9718004d50 0x7f97180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:24.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c15bfa0 con 0x7f9718004d50 2023-10-09T06:27:24.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c15c280 con 0x7f9718003ae0 2023-10-09T06:27:24.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971800bb40 con 0x7f972c15a620 2023-10-09T06:27:24.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9731af5700 1 --2- 172.21.15.31:0/1939985977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9718004d50 0x7f97180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:24.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f97312f4700 1 --2- 172.21.15.31:0/1939985977 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9718003ae0 0x7f9718003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:24.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.376+0000 7f9730af3700 1 --2- 172.21.15.31:0/1939985977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f972c15a620 0x7f9718004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:24.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.377+0000 7f9731af5700 1 -- 172.21.15.31:0/1939985977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f972c15a620 msgr2=0x7f9718004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:24.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.377+0000 7f9731af5700 1 --2- 172.21.15.31:0/1939985977 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f972c15a620 0x7f9718004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:24.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.377+0000 7f9731af5700 1 -- 172.21.15.31:0/1939985977 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9718003ae0 msgr2=0x7f9718003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:24.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.377+0000 7f9731af5700 1 --2- 172.21.15.31:0/1939985977 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9718003ae0 0x7f9718003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:24.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.377+0000 7f9731af5700 1 -- 172.21.15.31:0/1939985977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9718003570 con 0x7f9718004d50 2023-10-09T06:27:24.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.377+0000 7f9731af5700 1 --2- 172.21.15.31:0/1939985977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9718004d50 0x7f97180051c0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f972400a870 tx=0x7f9724002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51434b146ce08b61 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:24.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.377+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97240070f0 con 0x7f9718004d50 2023-10-09T06:27:24.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.377+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9724007270 con 0x7f9718004d50 2023-10-09T06:27:24.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.377+0000 7f9723fff700 1 -- 172.21.15.31:0/1939985977 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724007630 con 0x7f9718004d50 2023-10-09T06:27:24.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.377+0000 7f9733558700 1 -- 172.21.15.31:0/1939985977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9718004d50 msgr2=0x7f97180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:24.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.378+0000 7f9733558700 1 --2- 172.21.15.31:0/1939985977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9718004d50 0x7f97180051c0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f972400a870 tx=0x7f9724002140 comp rx=0 tx=0).stop 2023-10-09T06:27:24.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.378+0000 7f9731af5700 1 -- 172.21.15.31:0/1939985977 reap_dead start 2023-10-09T06:27:24.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.378+0000 7f9733558700 1 -- 172.21.15.31:0/1939985977 shutdown_connections 2023-10-09T06:27:24.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.378+0000 7f9733558700 1 -- 172.21.15.31:0/1939985977 >> 172.21.15.31:0/1939985977 conn(0x7f972c068ce0 msgr2=0x7f972c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:24.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.378+0000 7f9733558700 1 -- 172.21.15.31:0/1939985977 shutdown_connections 2023-10-09T06:27:24.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.378+0000 7f9733558700 1 -- 172.21.15.31:0/1939985977 wait complete. 2023-10-09T06:27:24.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.379+0000 7f9733558700 1 Processor -- start 2023-10-09T06:27:24.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.379+0000 7f9733558700 1 -- start start 2023-10-09T06:27:24.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9733558700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9718004d50 0x7f972c16a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:24.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9733558700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f972c15da10 0x7f972c15e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:24.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9733558700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f972c16d050 0x7f972c0a7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:24.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9733558700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c0b18d0 con 0x7f972c15da10 2023-10-09T06:27:24.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9733558700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c15f180 con 0x7f972c16d050 2023-10-09T06:27:24.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9733558700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972c0b1280 con 0x7f9718004d50 2023-10-09T06:27:24.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9730af3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f972c15da10 0x7f972c15e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:24.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9730af3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f972c15da10 0x7f972c15e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35130/0 (socket says 172.21.15.31:35130) 2023-10-09T06:27:24.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9730af3700 1 -- 172.21.15.31:0/1489753816 learned_addr learned my addr 172.21.15.31:0/1489753816 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:24.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9731af5700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f972c16d050 0x7f972c0a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:24.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f97312f4700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9718004d50 0x7f972c16a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:24.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9730af3700 1 -- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9718004d50 msgr2=0x7f972c16a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:24.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9730af3700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9718004d50 0x7f972c16a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:24.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9730af3700 1 -- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f972c16d050 msgr2=0x7f972c0a7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:24.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9730af3700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f972c16d050 0x7f972c0a7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:24.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9730af3700 1 -- 172.21.15.31:0/1489753816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c0b1560 con 0x7f972c15da10 2023-10-09T06:27:24.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f97312f4700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9718004d50 0x7f972c16a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:24.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f9730af3700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f972c15da10 0x7f972c15e930 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f9728011b40 tx=0x7f97280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:24.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.380+0000 7f97217fa700 1 -- 172.21.15.31:0/1489753816 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972800f940 con 0x7f972c15da10 2023-10-09T06:27:24.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.381+0000 7f97217fa700 1 -- 172.21.15.31:0/1489753816 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972800faa0 con 0x7f972c15da10 2023-10-09T06:27:24.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.381+0000 7f9733558700 1 -- 172.21.15.31:0/1489753816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972c15ee70 con 0x7f972c15da10 2023-10-09T06:27:24.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.381+0000 7f97217fa700 1 -- 172.21.15.31:0/1489753816 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972800fe20 con 0x7f972c15da10 2023-10-09T06:27:24.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.381+0000 7f9733558700 1 -- 172.21.15.31:0/1489753816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972c0a7b50 con 0x7f972c15da10 2023-10-09T06:27:24.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.382+0000 7f9733558700 1 -- 172.21.15.31:0/1489753816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972c0b10e0 con 0x7f972c15da10 2023-10-09T06:27:24.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.382+0000 7f97217fa700 1 -- 172.21.15.31:0/1489753816 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9728014650 con 0x7f972c15da10 2023-10-09T06:27:24.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.382+0000 7f97217fa700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9710066f30 0x7f97100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:24.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.383+0000 7f97217fa700 1 -- 172.21.15.31:0/1489753816 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9728018030 con 0x7f972c15da10 2023-10-09T06:27:24.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.383+0000 7f97312f4700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9710066f30 0x7f97100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:24.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.383+0000 7f97312f4700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9710066f30 0x7f97100693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f971c006f00 tx=0x7f971c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:24.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.387+0000 7f97217fa700 1 -- 172.21.15.31:0/1489753816 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f972c0b10e0 con 0x7f972c15da10 2023-10-09T06:27:24.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.582+0000 7f9733558700 1 -- 172.21.15.31:0/1489753816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f972c0b10e0 con 0x7f972c15da10 2023-10-09T06:27:24.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.583+0000 7f97217fa700 1 -- 172.21.15.31:0/1489753816 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v137) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f972c0b10e0 con 0x7f972c15da10 2023-10-09T06:27:24.584 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:24.584 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:27:24.584 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 137, 2023-10-09T06:27:24.585 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:27:24.585 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:27:24.585 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:27:18.429025+0000", 2023-10-09T06:27:24.585 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:27:24.585 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:27:24.585 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:27:24.585 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:27:24.585 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:27:24.585 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:27:24.585 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:27:24.586 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:27:24.586 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:27:24.586 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:24.586 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:27:24.586 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:27:24.586 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:27:24.586 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:27:24.586 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:27:24.586 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 17, 2023-10-09T06:27:24.586 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:27:24.586 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:27:24.587 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:27:24.587 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:27:24.587 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:27:24.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.587 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:27:24.587 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:27:24.587 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:27:24.587 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:24.587 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:24.587 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:24.587 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:24.587 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:24.588 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:24.588 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:24.588 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:24.588 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:24.588 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:24.588 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:24.588 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:24.588 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:27:24.588 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:27:24.588 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:27:24.588 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:27:24.588 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:27:24.589 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:24.589 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:24.589 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:24.589 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:24.589 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:24.589 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:24.589 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:24.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.589 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:27:24.589 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:24.589 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:24.589 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:24.590 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:24.590 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:24.590 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:24.590 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:24.590 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:24.590 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:24.590 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:24.590 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:24.590 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:24.590 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:24.590 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:24.590 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:24.591 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:24.591 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:24.591 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:24.591 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:24.591 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:24.591 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:24.591 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:24.591 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:24.591 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:24.591 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:24.591 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:24.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.592 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:24.592 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:24.592 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:24.592 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:24.592 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:24.592 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:24.592 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:24.592 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:24.592 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:24.592 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:24.593 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:24.593 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:24.593 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:27:24.593 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:27:24.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.593 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:24.593 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:27:24.593 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.593 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 16, 2023-10-09T06:27:24.594 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:27:24.594 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.232021+0000", 2023-10-09T06:27:24.594 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:24.594 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:24.594 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:24.594 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:24.594 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:24.594 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:24.594 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:24.594 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:24.594 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:24.595 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:24.595 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:24.595 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:24.595 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:27:24.595 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:27:24.595 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:27:24.595 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:27:24.595 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:27:24.595 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:24.595 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:24.595 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:24.595 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:24.596 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:24.596 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:24.596 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:24.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.596 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "135", 2023-10-09T06:27:24.596 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:24.596 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:24.596 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:24.596 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:24.596 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:24.596 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:24.596 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:24.597 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:24.597 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:24.597 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:24.597 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:24.597 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:24.597 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:24.597 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:24.597 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:24.597 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:24.597 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:24.597 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:24.597 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:24.598 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:24.598 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:24.598 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:24.598 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:24.598 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:24.598 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:24.598 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:24.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.598 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:24.598 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:24.598 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:24.598 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:24.599 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:24.599 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:24.599 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:24.599 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:24.599 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:24.599 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:24.599 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:24.599 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:24.599 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:27:24.599 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:27:24.599 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:27:24.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.600 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:24.600 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:24.600 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:27:24.600 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.600 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.600 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 17, 2023-10-09T06:27:24.600 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:27:24.600 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.742407+0000", 2023-10-09T06:27:24.600 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:24.601 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:24.601 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:24.601 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:24.601 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:24.601 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:24.601 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:24.601 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:24.601 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:24.601 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:24.601 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:24.601 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:24.601 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:27:24.602 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:27:24.602 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:27:24.602 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:27:24.602 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:27:24.602 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:24.602 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:24.602 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:24.602 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:24.602 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:24.602 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:24.602 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:24.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.603 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "137", 2023-10-09T06:27:24.603 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:24.603 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:24.603 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:24.603 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:24.603 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:24.603 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:24.603 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:24.603 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:24.603 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:24.603 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:27:24.603 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:24.604 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:24.604 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:24.604 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:24.604 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:24.604 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:24.604 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:24.604 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:24.604 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:24.604 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:24.604 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:24.604 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:24.604 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:24.605 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:24.605 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:24.605 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:24.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.605 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:24.605 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:24.605 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:24.605 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:24.605 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:24.605 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:24.605 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:24.605 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:24.606 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:24.606 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:24.606 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:24.606 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:24.606 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:27:24.606 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:27:24.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.606 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:24.606 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:24.606 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:27:24.606 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.607 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.607 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.607 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:24.607 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:27:24.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.607 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:24.607 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:24.607 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:24.607 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:24.607 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:24.608 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:24.608 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:24.608 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:24.608 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:24.608 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:24.608 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:24.608 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:24.608 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:24.608 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.608 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.609 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:27:24.609 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:24.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.609 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.609 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:27:24.609 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:24.609 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.609 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.609 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:24.610 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.610 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.610 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:27:24.610 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:24.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.610 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.610 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:27:24.610 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:24.610 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.610 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.611 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:24.611 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.611 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.611 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:27:24.611 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:24.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.611 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.611 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:27:24.611 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:24.612 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.612 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.612 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:24.612 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.612 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.612 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:27:24.612 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:24.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.612 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.613 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:27:24.613 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:24.613 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.613 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.613 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:27:24.613 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:27:24.613 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:27:24.613 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:27:24.613 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:24.613 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:24.613 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:24.614 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.614 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:24.614 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:24.614 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:24.614 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:24.614 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:24.614 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:24.614 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:24.614 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:24.615 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:24.615 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:24.615 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:24.615 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:24.615 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:24.615 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.615 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.615 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:27:24.615 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:24.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.616 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.616 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:27:24.616 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:24.616 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.616 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.616 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:24.616 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.616 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.616 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:27:24.616 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:24.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.617 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.617 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:27:24.617 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:24.617 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.617 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.617 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:24.617 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.618 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.618 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:27:24.618 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:24.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.618 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.618 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:27:24.618 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:24.618 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.618 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.618 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:24.619 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.619 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.619 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:27:24.619 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:24.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.619 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.619 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:27:24.619 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:24.619 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.620 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.620 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:27:24.620 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:27:24.620 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:27:24.620 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:27:24.620 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:24.620 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:24.620 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:24.620 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.621 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:24.621 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:24.621 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:24.621 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:24.621 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:24.621 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:24.621 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:24.621 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:24.621 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:24.621 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:24.621 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:24.621 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:24.622 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:24.622 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.622 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.622 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:27:24.622 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:24.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.622 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.622 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:27:24.622 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:24.622 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:27:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:27:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:24.624 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.624 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.624 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:24.624 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.624 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.624 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:27:24.624 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:24.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.625 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.625 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:27:24.625 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:24.625 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.625 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.625 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:24.625 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.625 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.625 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:27:24.625 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:24.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.626 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.626 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.626 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:27:24.626 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:24.626 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.626 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.626 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:27:24.626 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:27:24.626 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:27:24.626 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:27:24.627 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:24.627 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:24.627 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:24.627 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.627 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:24.627 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:24.627 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:24.627 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:24.627 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:24.628 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:24.628 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:24.628 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:24.628 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:24.628 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:24.628 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:24.628 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:24.628 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:24.628 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.628 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.628 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:27:24.628 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:24.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.629 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.629 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:27:24.629 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:24.629 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.629 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.629 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:24.629 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.629 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.630 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:27:24.630 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:24.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.631 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.631 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:27:24.631 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:24.631 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.631 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.631 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:24.631 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.632 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.632 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:27:24.632 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:24.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.632 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.632 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:27:24.632 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:24.632 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.632 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.633 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:24.633 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.633 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.633 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:27:24.633 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:24.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.633 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.633 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:27:24.633 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:24.633 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.634 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.634 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:27:24.634 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:27:24.634 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:27:24.634 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:27:24.634 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:24.634 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:24.634 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:24.634 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.635 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:24.635 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:24.635 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:24.635 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:24.635 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:24.635 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:24.635 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:24.635 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:24.635 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:24.635 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:24.635 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:24.635 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:24.636 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:24.636 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.636 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.636 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:27:24.636 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:24.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.636 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.636 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:27:24.636 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:24.636 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.637 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.637 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:24.637 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.637 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.637 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:27:24.637 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:24.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.637 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.637 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:27:24.637 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:24.638 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.638 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.638 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:24.638 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.638 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.638 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:27:24.638 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:24.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.638 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.639 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:27:24.639 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:24.639 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.639 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.639 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:24.639 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.639 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.639 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:27:24.639 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:24.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.640 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.640 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:27:24.640 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:24.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.640 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.640 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:27:24.640 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:27:24.640 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:27:24.640 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:27:24.640 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:27:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:27:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:27:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:27:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:27:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:27:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:27:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:27:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:27:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:27:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:27:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:27:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:27:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:27:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:27:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:27:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:27:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:27:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:27:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:27:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:27:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:27:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:27:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:27:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:27:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:27:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:27:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:27:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:27:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:27:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:27:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:27:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:27:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:27:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:27:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:27:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:27:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:27:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:27:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:27:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:27:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:27:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:27:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:27:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:27:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:27:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:27:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:27:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:27:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:27:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:27:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:27:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:27:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:27:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:27:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:27:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:27:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:27:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:27:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:27:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:27:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:27:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:27:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:27:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:27:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:27:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:27:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:27:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:27:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:24.670 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:27:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.585+0000 7f9733558700 1 -- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9710066f30 msgr2=0x7f97100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.585+0000 7f9733558700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9710066f30 0x7f97100693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f971c006f00 tx=0x7f971c008040 comp rx=0 tx=0).stop 2023-10-09T06:27:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.585+0000 7f9733558700 1 -- 172.21.15.31:0/1489753816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f972c15da10 msgr2=0x7f972c15e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.585+0000 7f9733558700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f972c15da10 0x7f972c15e930 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f9728011b40 tx=0x7f97280091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.585+0000 7f9733558700 1 -- 172.21.15.31:0/1489753816 shutdown_connections 2023-10-09T06:27:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.585+0000 7f9733558700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9710066f30 0x7f97100693e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:24.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.585+0000 7f9733558700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9718004d50 0x7f972c16a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:24.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.585+0000 7f9733558700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f972c16d050 0x7f972c0a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:24.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.585+0000 7f9733558700 1 --2- 172.21.15.31:0/1489753816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f972c15da10 0x7f972c15e930 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:24.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.585+0000 7f9733558700 1 -- 172.21.15.31:0/1489753816 >> 172.21.15.31:0/1489753816 conn(0x7f972c068ce0 msgr2=0x7f972c155730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:24.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.585+0000 7f9733558700 1 -- 172.21.15.31:0/1489753816 shutdown_connections 2023-10-09T06:27:24.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:24.585+0000 7f9733558700 1 -- 172.21.15.31:0/1489753816 wait complete. 2023-10-09T06:27:24.674 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:27:26.536 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:27:26.539 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:27:29.674 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:27:29.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.806+0000 7f3150eba700 1 Processor -- start 2023-10-09T06:27:29.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.806+0000 7f3150eba700 1 -- start start 2023-10-09T06:27:29.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.807+0000 7f3150eba700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f314c0cf1c0 0x7f314c15e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:29.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.807+0000 7f3150eba700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c15a0c0 0x7f314c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.807+0000 7f3150eba700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c0cca20 con 0x7f314c159cf0 2023-10-09T06:27:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.807+0000 7f3150eba700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c15ea40 con 0x7f314c0cf1c0 2023-10-09T06:27:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.807+0000 7f3150eba700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c067660 con 0x7f314c15a0c0 2023-10-09T06:27:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314a59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f314c159cf0 0x7f314c0ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48512/0 (socket says 172.21.15.31:48512) 2023-10-09T06:27:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314a59c700 1 -- 172.21.15.31:0/1052530193 learned_addr learned my addr 172.21.15.31:0/1052530193 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314ad9d700 1 --2- 172.21.15.31:0/1052530193 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c15a0c0 0x7f314c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f3149d9b700 1 --2- 172.21.15.31:0/1052530193 >> v2:172.21.15.158:3300/0 conn(0x7f314c0cf1c0 0x7f314c15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005005979 0 0) 0x7f314c0cca20 con 0x7f314c159cf0 2023-10-09T06:27:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3138003570 con 0x7f314c159cf0 2023-10-09T06:27:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2745832316 0 0) 0x7f3138003570 con 0x7f314c159cf0 2023-10-09T06:27:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c15a0c0 msgr2=0x7f314c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 --2- 172.21.15.31:0/1052530193 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c15a0c0 0x7f314c068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:29.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 >> v2:172.21.15.158:3300/0 conn(0x7f314c0cf1c0 msgr2=0x7f314c15e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:29.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 --2- 172.21.15.31:0/1052530193 >> v2:172.21.15.158:3300/0 conn(0x7f314c0cf1c0 0x7f314c15e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:29.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c067f00 con 0x7f314c159cf0 2023-10-09T06:27:29.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f313c001470 con 0x7f314c159cf0 2023-10-09T06:27:29.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 >> v1:172.21.15.31:6789/0 conn(0x7f314c159cf0 legacy=0x7f314c0ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:29.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 --2- 172.21.15.31:0/1052530193 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3138003a60 0x7f3138003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:29.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 --2- 172.21.15.31:0/1052530193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3138004810 0x7f3138004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:29.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 --2- 172.21.15.31:0/1052530193 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c15a0c0 0x7f31380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:29.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c15ea40 con 0x7f3138004810 2023-10-09T06:27:29.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c067660 con 0x7f3138003a60 2023-10-09T06:27:29.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313800ba60 con 0x7f314c15a0c0 2023-10-09T06:27:29.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f3149d9b700 1 --2- 172.21.15.31:0/1052530193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3138004810 0x7f3138004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:29.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314a59c700 1 --2- 172.21.15.31:0/1052530193 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3138003a60 0x7f3138003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:29.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.808+0000 7f314ad9d700 1 --2- 172.21.15.31:0/1052530193 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c15a0c0 0x7f31380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:29.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.809+0000 7f3149d9b700 1 -- 172.21.15.31:0/1052530193 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c15a0c0 msgr2=0x7f31380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:29.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.809+0000 7f3149d9b700 1 --2- 172.21.15.31:0/1052530193 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c15a0c0 0x7f31380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:29.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.809+0000 7f3149d9b700 1 -- 172.21.15.31:0/1052530193 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3138003a60 msgr2=0x7f3138003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:29.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.809+0000 7f3149d9b700 1 --2- 172.21.15.31:0/1052530193 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3138003a60 0x7f3138003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:29.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.809+0000 7f3149d9b700 1 -- 172.21.15.31:0/1052530193 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3138003570 con 0x7f3138004810 2023-10-09T06:27:29.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.809+0000 7f3149d9b700 1 --2- 172.21.15.31:0/1052530193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3138004810 0x7f3138004c80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f3134009c30 tx=0x7f31340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141fb3870a085051 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:29.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.809+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313400e710 con 0x7f3138004810 2023-10-09T06:27:29.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.809+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313400e870 con 0x7f3138004810 2023-10-09T06:27:29.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.809+0000 7f314959a700 1 -- 172.21.15.31:0/1052530193 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313400ec30 con 0x7f3138004810 2023-10-09T06:27:29.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.809+0000 7f3150eba700 1 -- 172.21.15.31:0/1052530193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3138004810 msgr2=0x7f3138004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:29.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.809+0000 7f3150eba700 1 --2- 172.21.15.31:0/1052530193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3138004810 0x7f3138004c80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f3134009c30 tx=0x7f31340091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:29.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.809+0000 7f314ad9d700 1 -- 172.21.15.31:0/1052530193 reap_dead start 2023-10-09T06:27:29.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.810+0000 7f3150eba700 1 -- 172.21.15.31:0/1052530193 shutdown_connections 2023-10-09T06:27:29.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.810+0000 7f3150eba700 1 -- 172.21.15.31:0/1052530193 >> 172.21.15.31:0/1052530193 conn(0x7f314c06c6e0 msgr2=0x7f314c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:29.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.810+0000 7f3150eba700 1 -- 172.21.15.31:0/1052530193 shutdown_connections 2023-10-09T06:27:29.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.810+0000 7f3150eba700 1 -- 172.21.15.31:0/1052530193 wait complete. 2023-10-09T06:27:29.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.811+0000 7f3150eba700 1 Processor -- start 2023-10-09T06:27:29.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.811+0000 7f3150eba700 1 -- start start 2023-10-09T06:27:29.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3150eba700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3138004810 0x7f314c0c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:29.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3150eba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f314c0c7c20 0x7f314c169c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:29.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3150eba700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c16a1a0 0x7f314c157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:29.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3150eba700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c16ac70 con 0x7f314c0c7c20 2023-10-09T06:27:29.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3150eba700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c156ed0 con 0x7f3138004810 2023-10-09T06:27:29.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3150eba700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c16a6b0 con 0x7f314c16a1a0 2023-10-09T06:27:29.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3149d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f314c0c7c20 0x7f314c169c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:29.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3149d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f314c0c7c20 0x7f314c169c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57780/0 (socket says 172.21.15.31:57780) 2023-10-09T06:27:29.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3149d9b700 1 -- 172.21.15.31:0/98166397 learned_addr learned my addr 172.21.15.31:0/98166397 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:29.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f314a59c700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3138004810 0x7f314c0c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:29.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f314ad9d700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c16a1a0 0x7f314c157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:29.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3149d9b700 1 -- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c16a1a0 msgr2=0x7f314c157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:29.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3149d9b700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c16a1a0 0x7f314c157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:29.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3149d9b700 1 -- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3138004810 msgr2=0x7f314c0c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:29.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3149d9b700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3138004810 0x7f314c0c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:29.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3149d9b700 1 -- 172.21.15.31:0/98166397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c16a990 con 0x7f314c0c7c20 2023-10-09T06:27:29.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f314ad9d700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c16a1a0 0x7f314c157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:29.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3149d9b700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f314c0c7c20 0x7f314c169c60 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f31380046d0 tx=0x7f313401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:29.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f31427fc700 1 -- 172.21.15.31:0/98166397 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134022070 con 0x7f314c0c7c20 2023-10-09T06:27:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f31427fc700 1 -- 172.21.15.31:0/98166397 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313400e9e0 con 0x7f314c0c7c20 2023-10-09T06:27:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f31427fc700 1 -- 172.21.15.31:0/98166397 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313401c450 con 0x7f314c0c7c20 2023-10-09T06:27:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.812+0000 7f3150eba700 1 -- 172.21.15.31:0/98166397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c156b60 con 0x7f314c0c7c20 2023-10-09T06:27:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.813+0000 7f3150eba700 1 -- 172.21.15.31:0/98166397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c1578a0 con 0x7f314c0c7c20 2023-10-09T06:27:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.813+0000 7f3150eba700 1 -- 172.21.15.31:0/98166397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c1569c0 con 0x7f314c0c7c20 2023-10-09T06:27:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.814+0000 7f31427fc700 1 -- 172.21.15.31:0/98166397 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f313401c840 con 0x7f314c0c7c20 2023-10-09T06:27:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.814+0000 7f31427fc700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f312c066f30 0x7f312c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.814+0000 7f31427fc700 1 -- 172.21.15.31:0/98166397 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3134085cc0 con 0x7f314c0c7c20 2023-10-09T06:27:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.814+0000 7f31427fc700 1 -- 172.21.15.31:0/98166397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=139}) v3 -- 0x7f312c06ea50 con 0x7f314c0c7c20 2023-10-09T06:27:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.815+0000 7f314a59c700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f312c066f30 0x7f312c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.815+0000 7f314a59c700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f312c066f30 0x7f312c0693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f313c001d20 tx=0x7f313c001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:29.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:29.819+0000 7f31427fc700 1 -- 172.21.15.31:0/98166397 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f313402b060 con 0x7f314c0c7c20 2023-10-09T06:27:30.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.014+0000 7f3150eba700 1 -- 172.21.15.31:0/98166397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f314c157040 con 0x7f314c0c7c20 2023-10-09T06:27:30.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.015+0000 7f31427fc700 1 -- 172.21.15.31:0/98166397 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f313402b030 con 0x7f314c0c7c20 2023-10-09T06:27:30.015 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:30.016 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:27:30.016 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 138, 2023-10-09T06:27:30.016 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:27:30.016 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:27:30.016 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:27:26.747057+0000", 2023-10-09T06:27:30.016 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:27:30.016 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:27:30.016 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:27:30.016 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:27:30.016 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:27:30.017 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:27:30.017 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:27:30.017 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:27:30.017 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:27:30.017 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:30.017 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:27:30.017 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:27:30.017 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:27:30.017 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:27:30.017 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:27:30.017 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 17, 2023-10-09T06:27:30.017 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:27:30.018 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:27:30.018 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:27:30.018 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:27:30.018 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:27:30.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.018 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:27:30.018 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:27:30.018 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:27:30.018 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:30.018 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:30.018 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:30.018 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:30.019 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:30.019 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:30.019 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:30.019 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:30.019 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:30.019 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:30.019 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:30.019 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:30.019 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:27:30.019 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:27:30.019 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:27:30.019 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:27:30.020 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:27:30.020 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:30.020 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:30.020 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:30.020 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:30.020 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:30.020 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:30.020 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:30.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.020 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:27:30.020 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:30.020 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:30.021 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:30.021 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:30.021 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:30.021 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:30.021 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:30.021 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:30.021 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:30.021 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:30.021 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:30.021 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:30.021 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:30.021 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:30.022 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:30.022 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:30.022 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:30.022 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:30.022 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:30.022 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:30.022 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:30.022 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:30.022 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:30.022 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:30.022 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:30.022 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:30.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.023 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:30.023 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:30.023 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:30.023 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:30.023 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:30.023 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:30.023 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:30.023 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:30.023 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:30.023 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:30.024 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:30.024 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:30.024 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:27:30.024 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:27:30.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.024 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:30.024 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:27:30.024 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.024 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 16, 2023-10-09T06:27:30.024 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:27:30.025 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.232021+0000", 2023-10-09T06:27:30.025 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:30.025 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:30.025 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:30.025 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:30.025 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:30.025 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:30.025 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:30.025 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:30.025 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:30.025 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:30.025 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:30.026 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:30.026 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:27:30.026 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:27:30.026 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:27:30.026 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:27:30.026 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:27:30.026 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:30.026 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:30.026 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:30.026 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:30.026 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:30.026 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "135", 2023-10-09T06:27:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:27:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:27:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:27:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:27:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 17, 2023-10-09T06:27:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:27:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.742407+0000", 2023-10-09T06:27:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1027, 2023-10-09T06:27:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T06:27:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:27:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:27:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:27:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:27:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:27:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "138", 2023-10-09T06:27:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:27:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:27:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:27:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:27:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:27:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:27:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:27:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:27:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:27:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:27:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:27:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:27:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:27:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:27:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:27:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:27:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:27:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:27:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:27:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:27:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:27:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:27:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:27:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:27:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:27:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:27:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:27:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:27:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:27:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:27:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:27:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:27:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:27:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:27:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:27:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:27:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:27:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:27:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:27:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:27:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:27:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:27:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:27:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:27:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:27:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:27:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:27:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:27:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:27:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:27:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:27:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:27:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:27:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:27:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:27:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:27:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:27:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:27:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:27:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:27:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:27:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:27:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:27:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:27:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:27:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:27:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:27:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:27:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:27:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:27:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:27:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:27:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:27:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:27:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:27:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:27:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:27:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:27:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:27:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:27:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:27:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:27:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:27:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:27:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:27:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:27:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:27:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:27:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:27:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:27:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:27:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:27:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:27:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:27:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:27:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:27:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:27:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:27:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:27:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:27:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:27:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:27:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:27:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:27:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:27:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:27:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:27:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:27:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:27:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.099 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:27:30.099 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.099 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.099 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:30.099 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:27:30.099 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:27:30.099 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:27:30.099 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:27:30.099 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:27:30.099 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:27:30.099 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:27:30.099 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:27:30.100 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:27:30.100 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:27:30.100 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:27:30.100 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:27:30.100 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:27:30.100 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.100 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:27:30.100 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:27:30.100 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:27:30.100 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:27:30.100 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:27:30.100 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:27:30.101 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:27:30.101 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:27:30.101 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:27:30.101 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:27:30.101 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:27:30.101 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.101 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:27:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.017+0000 7f3150eba700 1 -- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f312c066f30 msgr2=0x7f312c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.017+0000 7f3150eba700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f312c066f30 0x7f312c0693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f313c001d20 tx=0x7f313c001e90 comp rx=0 tx=0).stop 2023-10-09T06:27:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.017+0000 7f3150eba700 1 -- 172.21.15.31:0/98166397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f314c0c7c20 msgr2=0x7f314c169c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.017+0000 7f3150eba700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f314c0c7c20 0x7f314c169c60 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f31380046d0 tx=0x7f313401a000 comp rx=0 tx=0).stop 2023-10-09T06:27:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.017+0000 7f3150eba700 1 -- 172.21.15.31:0/98166397 shutdown_connections 2023-10-09T06:27:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.017+0000 7f3150eba700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f312c066f30 0x7f312c0693e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.017+0000 7f3150eba700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f314c16a1a0 0x7f314c157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.017+0000 7f3150eba700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3138004810 0x7f314c0c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.017+0000 7f3150eba700 1 --2- 172.21.15.31:0/98166397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f314c0c7c20 0x7f314c169c60 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.017+0000 7f3150eba700 1 -- 172.21.15.31:0/98166397 >> 172.21.15.31:0/98166397 conn(0x7f314c06c6e0 msgr2=0x7f314c0c52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:30.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.017+0000 7f3150eba700 1 -- 172.21.15.31:0/98166397 shutdown_connections 2023-10-09T06:27:30.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.017+0000 7f3150eba700 1 -- 172.21.15.31:0/98166397 wait complete. 2023-10-09T06:27:30.104 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-09T06:27:30.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:27:30.105 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-09T06:27:30.353 INFO:teuthology.orchestra.run.smithi031.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-09T06:27:30.353 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records in 2023-10-09T06:27:30.353 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records out 2023-10-09T06:27:30.353 INFO:teuthology.orchestra.run.smithi031.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.230351 s, 228 MB/s 2023-10-09T06:27:30.354 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:27:30.354 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:27:30.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.480+0000 7f869cb98700 1 Processor -- start 2023-10-09T06:27:30.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.480+0000 7f869cb98700 1 -- start start 2023-10-09T06:27:30.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.481+0000 7f869cb98700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f86981510f0 0x7f869806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.481+0000 7f869cb98700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86980ca0b0 con 0x7f8698070700 2023-10-09T06:27:30.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.481+0000 7f869cb98700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8698068a10 con 0x7f86980c9af0 2023-10-09T06:27:30.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.481+0000 7f869cb98700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8698068cf0 con 0x7f86981510f0 2023-10-09T06:27:30.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f8696d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8698070700 0x7f8698070b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48522/0 (socket says 172.21.15.31:48522) 2023-10-09T06:27:30.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f8696d9d700 1 -- 172.21.15.31:0/3856765386 learned_addr learned my addr 172.21.15.31:0/3856765386 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:30.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703238252 0 0) 0x7f86980ca0b0 con 0x7f8698070700 2023-10-09T06:27:30.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869659c700 1 --2- 172.21.15.31:0/3856765386 >> v2:172.21.15.158:3300/0 conn(0x7f86981510f0 0x7f869806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8684003570 con 0x7f8698070700 2023-10-09T06:27:30.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3688761266 0 0) 0x7f8684003570 con 0x7f8698070700 2023-10-09T06:27:30.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 >> v2:172.21.15.158:3300/0 conn(0x7f86981510f0 msgr2=0x7f869806ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:30.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 --2- 172.21.15.31:0/3856765386 >> v2:172.21.15.158:3300/0 conn(0x7f86981510f0 0x7f869806ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 >> v1:172.21.15.158:6789/0 conn(0x7f86980c9af0 legacy=0x7f869815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:30.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86980cb230 con 0x7f8698070700 2023-10-09T06:27:30.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f86880017f0 con 0x7f8698070700 2023-10-09T06:27:30.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869659c700 1 --2- 172.21.15.31:0/3856765386 >> v2:172.21.15.158:3300/0 conn(0x7f86981510f0 0x7f869806ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:30.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 >> v1:172.21.15.31:6789/0 conn(0x7f8698070700 legacy=0x7f8698070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:30.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 --2- 172.21.15.31:0/3856765386 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8684003a60 0x7f8684003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 --2- 172.21.15.31:0/3856765386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8684004810 0x7f8684004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 --2- 172.21.15.31:0/3856765386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86840052e0 0x7f868400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8698068cf0 con 0x7f8684004810 2023-10-09T06:27:30.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868400c190 con 0x7f8684003a60 2023-10-09T06:27:30.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868400c350 con 0x7f86840052e0 2023-10-09T06:27:30.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f8695d9b700 1 --2- 172.21.15.31:0/3856765386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8684004810 0x7f8684004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f869659c700 1 --2- 172.21.15.31:0/3856765386 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8684003a60 0x7f8684003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.482+0000 7f8696d9d700 1 --2- 172.21.15.31:0/3856765386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86840052e0 0x7f868400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.483+0000 7f8695d9b700 1 -- 172.21.15.31:0/3856765386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86840052e0 msgr2=0x7f868400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:30.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.483+0000 7f8695d9b700 1 --2- 172.21.15.31:0/3856765386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86840052e0 0x7f868400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.483+0000 7f8695d9b700 1 -- 172.21.15.31:0/3856765386 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8684003a60 msgr2=0x7f8684003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:30.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.483+0000 7f8695d9b700 1 --2- 172.21.15.31:0/3856765386 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8684003a60 0x7f8684003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.483+0000 7f8695d9b700 1 -- 172.21.15.31:0/3856765386 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8684003570 con 0x7f8684004810 2023-10-09T06:27:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.483+0000 7f8696d9d700 1 -- 172.21.15.31:0/3856765386 reap_dead start 2023-10-09T06:27:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.483+0000 7f8695d9b700 1 --2- 172.21.15.31:0/3856765386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8684004810 0x7f8684004c80 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f86800018b0 tx=0x7f8680007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb00bbf5eeb328 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.483+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680012420 con 0x7f8684004810 2023-10-09T06:27:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.483+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86800125a0 con 0x7f8684004810 2023-10-09T06:27:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.483+0000 7f869559a700 1 -- 172.21.15.31:0/3856765386 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680012960 con 0x7f8684004810 2023-10-09T06:27:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.483+0000 7f869cb98700 1 -- 172.21.15.31:0/3856765386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8684004810 msgr2=0x7f8684004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.483+0000 7f869cb98700 1 --2- 172.21.15.31:0/3856765386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8684004810 0x7f8684004c80 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f86800018b0 tx=0x7f8680007d30 comp rx=0 tx=0).stop 2023-10-09T06:27:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.484+0000 7f869cb98700 1 -- 172.21.15.31:0/3856765386 shutdown_connections 2023-10-09T06:27:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.484+0000 7f869cb98700 1 --2- 172.21.15.31:0/3856765386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8684004810 0x7f8684004c80 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.484+0000 7f869cb98700 1 -- 172.21.15.31:0/3856765386 >> 172.21.15.31:0/3856765386 conn(0x7f86980ca4f0 msgr2=0x7f86980ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:30.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.484+0000 7f869cb98700 1 -- 172.21.15.31:0/3856765386 shutdown_connections 2023-10-09T06:27:30.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.484+0000 7f869cb98700 1 -- 172.21.15.31:0/3856765386 wait complete. 2023-10-09T06:27:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.485+0000 7f869cb98700 1 Processor -- start 2023-10-09T06:27:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.485+0000 7f869cb98700 1 -- start start 2023-10-09T06:27:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.485+0000 7f869cb98700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8684004810 0x7f86980c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.485+0000 7f869cb98700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86980b1850 0x7f86980b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f869cb98700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980c4b30 0x7f86980c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f869cb98700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86980b2eb0 con 0x7f86980c4b30 2023-10-09T06:27:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f869cb98700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86980c54c0 con 0x7f8684004810 2023-10-09T06:27:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f869cb98700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86980b22a0 con 0x7f86980b1850 2023-10-09T06:27:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f8696d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980c4b30 0x7f86980c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f8696d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980c4b30 0x7f86980c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57802/0 (socket says 172.21.15.31:57802) 2023-10-09T06:27:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f8696d9d700 1 -- 172.21.15.31:0/398699358 learned_addr learned my addr 172.21.15.31:0/398699358 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f869659c700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8684004810 0x7f86980c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f8695d9b700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86980b1850 0x7f86980b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f8696d9d700 1 -- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86980b1850 msgr2=0x7f86980b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f8696d9d700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86980b1850 0x7f86980b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f8696d9d700 1 -- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8684004810 msgr2=0x7f86980c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f8696d9d700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8684004810 0x7f86980c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f8696d9d700 1 -- 172.21.15.31:0/398699358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86980b2580 con 0x7f86980c4b30 2023-10-09T06:27:30.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f8695d9b700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86980b1850 0x7f86980b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:30.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f8696d9d700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980c4b30 0x7f86980c4f80 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f86980c8050 tx=0x7f86880021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:30.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f868e7fc700 1 -- 172.21.15.31:0/398699358 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868800ad40 con 0x7f86980c4b30 2023-10-09T06:27:30.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f868e7fc700 1 -- 172.21.15.31:0/398699358 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86880133f0 con 0x7f86980c4b30 2023-10-09T06:27:30.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f869cb98700 1 -- 172.21.15.31:0/398699358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86980b2860 con 0x7f86980c4b30 2023-10-09T06:27:30.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f868e7fc700 1 -- 172.21.15.31:0/398699358 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86880137b0 con 0x7f86980c4b30 2023-10-09T06:27:30.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.486+0000 7f869cb98700 1 -- 172.21.15.31:0/398699358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86980c7840 con 0x7f86980c4b30 2023-10-09T06:27:30.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.487+0000 7f869cb98700 1 -- 172.21.15.31:0/398699358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86980b3020 con 0x7f86980c4b30 2023-10-09T06:27:30.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.488+0000 7f868e7fc700 1 -- 172.21.15.31:0/398699358 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8688013b60 con 0x7f86980c4b30 2023-10-09T06:27:30.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.488+0000 7f868e7fc700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8678066f60 0x7f8678069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.488+0000 7f868e7fc700 1 -- 172.21.15.31:0/398699358 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8688084dc0 con 0x7f86980c4b30 2023-10-09T06:27:30.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.488+0000 7f868e7fc700 1 -- 172.21.15.31:0/398699358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=139}) v3 -- 0x7f867806ea80 con 0x7f86980c4b30 2023-10-09T06:27:30.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.488+0000 7f869659c700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8678066f60 0x7f8678069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.489+0000 7f869659c700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8678066f60 0x7f8678069410 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f869804d1b0 tx=0x7f8690008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:30.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.492+0000 7f868e7fc700 1 -- 172.21.15.31:0/398699358 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8688052030 con 0x7f86980c4b30 2023-10-09T06:27:30.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.687+0000 7f869cb98700 1 -- 172.21.15.31:0/398699358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f869804c3c0 con 0x7f86980c4b30 2023-10-09T06:27:30.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.688+0000 7f868e7fc700 1 -- 172.21.15.31:0/398699358 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f8688055650 con 0x7f86980c4b30 2023-10-09T06:27:30.689 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:30.689 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:27:30.689 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 138, 2023-10-09T06:27:30.689 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:27:30.689 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:27:30.690 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:27:26.747057+0000", 2023-10-09T06:27:30.690 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:27:30.690 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:27:30.690 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:27:30.690 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:27:30.690 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:27:30.690 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:27:30.690 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:27:30.690 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:27:30.690 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:27:30.691 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:30.691 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:27:30.691 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:27:30.691 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:27:30.691 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:27:30.691 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:27:30.691 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 17, 2023-10-09T06:27:30.691 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:27:30.691 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:27:30.691 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:27:30.691 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:27:30.691 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:27:30.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.692 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:27:30.692 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:27:30.692 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:27:30.692 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:30.692 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:30.692 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:30.692 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:30.692 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:30.692 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:30.692 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:30.692 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:30.692 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:30.693 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:30.693 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:30.693 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:30.693 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:27:30.693 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:27:30.693 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:27:30.693 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:27:30.693 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:27:30.693 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:30.693 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:30.693 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:30.693 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:30.694 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:30.694 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:30.694 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:30.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.694 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:27:30.694 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:30.694 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:30.694 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:30.694 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:30.694 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:30.694 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:30.695 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:30.695 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:30.695 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:30.695 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:30.695 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:30.695 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:30.695 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:30.695 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:30.695 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:30.695 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:30.695 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:30.695 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:30.696 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:30.696 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:30.696 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:30.696 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:30.696 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:30.696 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:30.696 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:30.696 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:30.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.696 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:30.696 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:30.696 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:30.697 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:30.697 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:30.697 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:30.697 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:30.697 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:30.697 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:30.697 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:30.697 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:30.697 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:30.697 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:27:30.697 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:27:30.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.698 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:30.698 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:27:30.698 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.698 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 16, 2023-10-09T06:27:30.698 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:27:30.698 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.232021+0000", 2023-10-09T06:27:30.698 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:30.698 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:30.698 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:30.699 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:30.699 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:30.699 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:30.699 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:30.699 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:30.699 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:30.699 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:30.699 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:30.699 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:30.699 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:27:30.699 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:27:30.699 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:27:30.700 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:27:30.700 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:27:30.700 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:30.700 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:30.700 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:30.700 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:30.700 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:30.700 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:30.700 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:30.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.700 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "135", 2023-10-09T06:27:30.700 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:30.701 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:30.701 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:30.701 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:30.701 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:30.701 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:30.701 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:30.701 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:30.701 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:30.701 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:30.701 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:30.701 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:30.701 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:30.702 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:30.702 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:30.702 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:30.702 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:30.702 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:30.702 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:30.702 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:30.702 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:30.702 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:30.702 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:30.702 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:30.702 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:30.703 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:30.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.703 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:30.703 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:30.703 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:30.703 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:30.703 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:30.703 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:30.703 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:30.703 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:30.703 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:30.703 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:30.704 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:30.704 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:30.704 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:27:30.704 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:27:30.704 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:27:30.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.704 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:30.704 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:30.704 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:27:30.704 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.704 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.705 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 17, 2023-10-09T06:27:30.705 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:27:30.705 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.742407+0000", 2023-10-09T06:27:30.705 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1027, 2023-10-09T06:27:30.705 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T06:27:30.705 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:30.705 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:30.705 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:30.705 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:30.705 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:30.705 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:30.706 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:30.706 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:30.706 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:30.706 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:30.706 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:27:30.706 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:27:30.706 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:27:30.706 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:27:30.706 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:27:30.706 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:30.706 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:30.706 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:30.707 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:30.707 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:30.707 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:30.707 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:30.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.707 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "138", 2023-10-09T06:27:30.707 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:30.707 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:30.707 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:30.707 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:30.707 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:30.707 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:30.708 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:30.708 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:30.708 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:30.708 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:27:30.708 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:30.708 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:30.708 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:30.708 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:30.708 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:30.708 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:30.708 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:30.709 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:30.709 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:30.709 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:30.709 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:30.709 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:30.709 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:30.709 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:30.709 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:30.709 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:30.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.709 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:30.709 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:30.710 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:30.710 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:30.710 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:30.710 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:30.710 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:30.710 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:30.710 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:30.710 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:30.710 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:30.710 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:30.710 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:27:30.710 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:27:30.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.711 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:30.711 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:30.711 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:27:30.711 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.711 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.711 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.711 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:30.711 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:27:30.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.711 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:30.712 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.712 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.712 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.712 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.712 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.712 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.712 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.712 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.712 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.712 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.712 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.712 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.713 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.713 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.713 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:27:30.713 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.713 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.713 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:27:30.713 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.713 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.713 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.714 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.714 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.714 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.714 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:27:30.714 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.714 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.714 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:27:30.715 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.715 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.715 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.715 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.715 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.715 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.715 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:27:30.715 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.716 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.716 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:27:30.716 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.716 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.716 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.716 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.716 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.716 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.716 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:27:30.716 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.717 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.717 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:27:30.717 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:30.717 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.717 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.717 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:27:30.717 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:27:30.717 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:27:30.717 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:27:30.718 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.718 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.718 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.718 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.718 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:30.718 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.718 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.718 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.718 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.718 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.719 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.719 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.719 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.719 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.719 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.719 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.719 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.719 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.719 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.719 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:27:30.719 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.720 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.720 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:27:30.720 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.720 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.720 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.720 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.720 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.720 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.721 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:27:30.721 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.721 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.721 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:27:30.721 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.721 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.721 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.721 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.721 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.722 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.722 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:27:30.722 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.722 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.722 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:27:30.722 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.722 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.723 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.723 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.723 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.723 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.723 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:27:30.723 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.723 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.723 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:27:30.723 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:30.724 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.724 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.724 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:27:30.724 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:27:30.724 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:27:30.724 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:27:30.724 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.724 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.724 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.724 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.725 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.725 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:30.725 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.725 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.725 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.725 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.725 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.725 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.725 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.725 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.726 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.726 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.726 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.726 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.726 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.726 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.726 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:27:30.726 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.726 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.727 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:27:30.727 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.727 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.727 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.727 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.727 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.727 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.727 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.727 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:27:30.727 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.728 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.728 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:27:30.728 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.728 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.728 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.728 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.728 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.728 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.729 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:27:30.729 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.729 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.729 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:27:30.729 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.729 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.729 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.729 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.729 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.730 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.730 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:27:30.730 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.730 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.730 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:27:30.730 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:30.730 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.730 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.731 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:27:30.731 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:27:30.731 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:27:30.731 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:27:30.731 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.731 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.731 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.731 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.732 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:30.732 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.732 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.732 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.732 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.732 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.732 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.732 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.732 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.732 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.732 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.732 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.733 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.733 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.733 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.733 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:27:30.733 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.733 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.733 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:27:30.733 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.734 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.734 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.734 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.734 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.734 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.734 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:27:30.734 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.734 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.735 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:27:30.735 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.735 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.735 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.735 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.735 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.735 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.735 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.736 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:27:30.736 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.736 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.736 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:27:30.736 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.736 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.736 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.736 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.737 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.737 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.737 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:27:30.737 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.737 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.737 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:27:30.737 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:30.737 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.738 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.738 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:27:30.738 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:27:30.738 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:27:30.738 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:27:30.738 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.738 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.738 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.738 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.739 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:30.739 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.739 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.739 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.739 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.739 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.739 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.739 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.739 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.740 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.740 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.740 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.740 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.740 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.740 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.740 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:27:30.740 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.741 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.741 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:27:30.741 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.741 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.741 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.741 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.741 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.741 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.741 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:27:30.741 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.742 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.742 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.742 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:27:30.742 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.742 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.742 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.742 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.742 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.743 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.743 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:27:30.743 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.743 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.744 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:27:30.744 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.744 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.744 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.744 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.744 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.744 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.744 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:27:30.744 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.745 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.745 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:27:30.745 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:30.745 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.745 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.745 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:27:30.745 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:27:30.745 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:27:30.745 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:27:30.746 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.746 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.746 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.746 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.746 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:30.746 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.746 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.746 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.746 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.747 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.747 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.747 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.747 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.747 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.747 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.747 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.747 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.747 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.747 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.747 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:27:30.747 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.748 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.748 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:27:30.748 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.748 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.748 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.748 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.748 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.748 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.749 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:27:30.749 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.749 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.749 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:27:30.749 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.749 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.749 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.749 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.750 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.750 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.750 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:27:30.750 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.750 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.750 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:27:30.750 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.750 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.750 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.751 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.751 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.751 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.751 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:27:30.751 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.751 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.751 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:27:30.752 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:30.752 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.752 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.752 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:27:30.752 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:27:30.752 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:27:30.752 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:27:30.752 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.752 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.752 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.753 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.753 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:30.753 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.753 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.753 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.753 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.753 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.753 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.753 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.754 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.754 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.754 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.754 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.754 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.754 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.754 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.754 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:27:30.754 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.755 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.755 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:27:30.755 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.755 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.755 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.755 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.755 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.755 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.756 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:27:30.756 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.756 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.756 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:27:30.756 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.756 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.756 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.756 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.757 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.757 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.757 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:27:30.757 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.757 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.757 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:27:30.757 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.757 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.757 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.758 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.758 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.758 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.758 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:27:30.758 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.758 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.758 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:27:30.759 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:30.759 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.759 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.759 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:27:30.759 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:27:30.759 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:27:30.759 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:27:30.759 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.759 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.759 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.759 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.760 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:30.760 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:30.760 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:30.760 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:30.760 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:30.760 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:30.760 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:30.760 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:30.760 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:30.761 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:30.761 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:30.761 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:30.761 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:30.761 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.761 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.761 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:27:30.761 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.762 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.762 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:27:30.762 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.762 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.762 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.762 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:30.762 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.762 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.762 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:27:30.763 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.763 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.763 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:27:30.763 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.763 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.763 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.763 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:30.763 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.764 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.764 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:27:30.764 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.764 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.764 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:27:30.764 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.764 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.764 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.765 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:30.765 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:30.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.765 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:30.765 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:27:30.765 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.765 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:30.765 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:27:30.766 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:30.766 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.766 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.766 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:27:30.766 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:27:30.766 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:27:30.766 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:27:30.766 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:30.766 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:30.766 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:30.767 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:30.767 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.767 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:30.767 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:27:30.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.767 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:30.767 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.767 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.767 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.767 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.767 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.768 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:27:30.768 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.768 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:30.768 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.768 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.768 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.768 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.768 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.768 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:27:30.768 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.769 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:30.769 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.769 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.769 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.769 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.769 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.769 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:27:30.769 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.770 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:30.770 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.770 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.770 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.770 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.770 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.770 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:27:30.770 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.771 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:30.771 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.771 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.771 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.771 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.771 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.771 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:27:30.771 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.771 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:30.772 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.772 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.772 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.772 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.772 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.772 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:27:30.772 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.772 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:30.772 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.772 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.773 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.773 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.773 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.773 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:27:30.773 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:30.773 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:30.773 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:30.773 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:30.773 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:30.773 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:30.774 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:30.774 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:27:30.774 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:30.774 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.774 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:30.774 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:27:30.774 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:27:30.774 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:27:30.774 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:27:30.774 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:27:30.774 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:27:30.774 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:27:30.775 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:27:30.775 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:27:30.775 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:27:30.775 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:27:30.775 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:27:30.775 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:27:30.775 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:30.775 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:27:30.775 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:27:30.775 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:27:30.776 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:27:30.776 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:27:30.776 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:27:30.776 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:27:30.776 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:27:30.776 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:27:30.776 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:27:30.776 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:27:30.776 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:30.776 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:27:30.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.690+0000 7f869cb98700 1 -- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8678066f60 msgr2=0x7f8678069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:30.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.690+0000 7f869cb98700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8678066f60 0x7f8678069410 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f869804d1b0 tx=0x7f8690008040 comp rx=0 tx=0).stop 2023-10-09T06:27:30.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.690+0000 7f869cb98700 1 -- 172.21.15.31:0/398699358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980c4b30 msgr2=0x7f86980c4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:30.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.690+0000 7f869cb98700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980c4b30 0x7f86980c4f80 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f86980c8050 tx=0x7f86880021d0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.690+0000 7f869cb98700 1 -- 172.21.15.31:0/398699358 shutdown_connections 2023-10-09T06:27:30.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.690+0000 7f869cb98700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8678066f60 0x7f8678069410 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.690+0000 7f869cb98700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980c4b30 0x7f86980c4f80 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.690+0000 7f869cb98700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8684004810 0x7f86980c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.690+0000 7f869cb98700 1 --2- 172.21.15.31:0/398699358 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86980b1850 0x7f86980b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.690+0000 7f869cb98700 1 -- 172.21.15.31:0/398699358 >> 172.21.15.31:0/398699358 conn(0x7f86980ca4f0 msgr2=0x7f8698150580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:30.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.690+0000 7f869cb98700 1 -- 172.21.15.31:0/398699358 shutdown_connections 2023-10-09T06:27:30.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.691+0000 7f869cb98700 1 -- 172.21.15.31:0/398699358 wait complete. 2023-10-09T06:27:30.779 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:27:30.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.898+0000 7fdf09532700 1 Processor -- start 2023-10-09T06:27:30.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.898+0000 7fdf09532700 1 -- start start 2023-10-09T06:27:30.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.899+0000 7fdf09532700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdf04159e60 0x7fdf040b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.899+0000 7fdf09532700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf0406adb0 0x7fdf04163c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.899+0000 7fdf09532700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf040b3d40 con 0x7fdf040cffa0 2023-10-09T06:27:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.899+0000 7fdf09532700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf04069d70 con 0x7fdf04159e60 2023-10-09T06:27:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.899+0000 7fdf09532700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040b4300 con 0x7fdf0406adb0 2023-10-09T06:27:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.899+0000 7fdf02ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdf04159e60 0x7fdf040b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.899+0000 7fdf02ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdf04159e60 0x7fdf040b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57812/0 (socket says 172.21.15.31:57812) 2023-10-09T06:27:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.899+0000 7fdf02ffd700 1 -- 172.21.15.31:0/4237705590 learned_addr learned my addr 172.21.15.31:0/4237705590 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.899+0000 7fdf037fe700 1 --2- 172.21.15.31:0/4237705590 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf0406adb0 0x7fdf04163c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.900+0000 7fdf02ffd700 1 -- 172.21.15.31:0/4237705590 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf0406adb0 msgr2=0x7fdf04163c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.900+0000 7fdf02ffd700 1 --2- 172.21.15.31:0/4237705590 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf0406adb0 0x7fdf04163c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.900+0000 7fdf02ffd700 1 -- 172.21.15.31:0/4237705590 >> v1:172.21.15.158:6789/0 conn(0x7fdf040cffa0 legacy=0x7fdf0406a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.900+0000 7fdf02ffd700 1 -- 172.21.15.31:0/4237705590 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf040d0480 con 0x7fdf04159e60 2023-10-09T06:27:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.900+0000 7fdf02ffd700 1 --2- 172.21.15.31:0/4237705590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf04159e60 0x7fdf040b6890 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fdef40099b0 tx=0x7fdef4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a805c11d837ea491 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.900+0000 7fdf01ffb700 1 -- 172.21.15.31:0/4237705590 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef400b860 con 0x7fdf04159e60 2023-10-09T06:27:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.900+0000 7fdf01ffb700 1 -- 172.21.15.31:0/4237705590 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef400b9c0 con 0x7fdf04159e60 2023-10-09T06:27:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.900+0000 7fdf01ffb700 1 -- 172.21.15.31:0/4237705590 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef400bd60 con 0x7fdf04159e60 2023-10-09T06:27:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.900+0000 7fdf09532700 1 -- 172.21.15.31:0/4237705590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf04159e60 msgr2=0x7fdf040b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.900+0000 7fdf09532700 1 --2- 172.21.15.31:0/4237705590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf04159e60 0x7fdf040b6890 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fdef40099b0 tx=0x7fdef4009250 comp rx=0 tx=0).stop 2023-10-09T06:27:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.900+0000 7fdf09532700 1 -- 172.21.15.31:0/4237705590 shutdown_connections 2023-10-09T06:27:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.900+0000 7fdf09532700 1 --2- 172.21.15.31:0/4237705590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf04159e60 0x7fdf040b6890 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.900+0000 7fdf09532700 1 --2- 172.21.15.31:0/4237705590 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf0406adb0 0x7fdf04163c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.901+0000 7fdf09532700 1 -- 172.21.15.31:0/4237705590 >> 172.21.15.31:0/4237705590 conn(0x7fdf040d1a50 msgr2=0x7fdf04068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.901+0000 7fdf09532700 1 -- 172.21.15.31:0/4237705590 shutdown_connections 2023-10-09T06:27:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.901+0000 7fdf09532700 1 -- 172.21.15.31:0/4237705590 wait complete. 2023-10-09T06:27:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.902+0000 7fdf09532700 1 Processor -- start 2023-10-09T06:27:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.902+0000 7fdf09532700 1 -- start start 2023-10-09T06:27:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.902+0000 7fdf09532700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf0406adb0 0x7fdf0415cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.902+0000 7fdf09532700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf040cffa0 0x7fdf04153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.902+0000 7fdf09532700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf04159e60 0x7fdf040c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.902+0000 7fdf09532700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf04153bb0 con 0x7fdf0406adb0 2023-10-09T06:27:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.902+0000 7fdf09532700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0416bc10 con 0x7fdf040cffa0 2023-10-09T06:27:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.902+0000 7fdf09532700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0416bef0 con 0x7fdf04159e60 2023-10-09T06:27:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdf02ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf0406adb0 0x7fdf0415cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdf02ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf0406adb0 0x7fdf0415cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57820/0 (socket says 172.21.15.31:57820) 2023-10-09T06:27:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdf02ffd700 1 -- 172.21.15.31:0/1358024660 learned_addr learned my addr 172.21.15.31:0/1358024660 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdf037fe700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf04159e60 0x7fdf040c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdf027fc700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf040cffa0 0x7fdf04153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdf02ffd700 1 -- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf04159e60 msgr2=0x7fdf040c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdf02ffd700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf04159e60 0x7fdf040c66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdf02ffd700 1 -- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf040cffa0 msgr2=0x7fdf04153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdf02ffd700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf040cffa0 0x7fdf04153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdf02ffd700 1 -- 172.21.15.31:0/1358024660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef40094f0 con 0x7fdf0406adb0 2023-10-09T06:27:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdf02ffd700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf0406adb0 0x7fdf0415cdd0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fdf04089730 tx=0x7fdef4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdefaffd700 1 -- 172.21.15.31:0/1358024660 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4024440 con 0x7fdf0406adb0 2023-10-09T06:27:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdefaffd700 1 -- 172.21.15.31:0/1358024660 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef40245c0 con 0x7fdf0406adb0 2023-10-09T06:27:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdf09532700 1 -- 172.21.15.31:0/1358024660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0416b210 con 0x7fdf0406adb0 2023-10-09T06:27:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdefaffd700 1 -- 172.21.15.31:0/1358024660 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4024980 con 0x7fdf0406adb0 2023-10-09T06:27:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.903+0000 7fdf09532700 1 -- 172.21.15.31:0/1358024660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0416b4b0 con 0x7fdf0406adb0 2023-10-09T06:27:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.904+0000 7fdf09532700 1 -- 172.21.15.31:0/1358024660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0404c3c0 con 0x7fdf0406adb0 2023-10-09T06:27:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.905+0000 7fdefaffd700 1 -- 172.21.15.31:0/1358024660 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdef401a420 con 0x7fdf0406adb0 2023-10-09T06:27:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.905+0000 7fdefaffd700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdee4066f30 0x7fdee40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.905+0000 7fdefaffd700 1 -- 172.21.15.31:0/1358024660 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdef40862e0 con 0x7fdf0406adb0 2023-10-09T06:27:30.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.905+0000 7fdefaffd700 1 -- 172.21.15.31:0/1358024660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=139}) v3 -- 0x7fdee406ea50 con 0x7fdf0406adb0 2023-10-09T06:27:30.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.905+0000 7fdf027fc700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdee4066f30 0x7fdee40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:30.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.906+0000 7fdf027fc700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdee4066f30 0x7fdee40693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdf040695e0 tx=0x7fdeec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:30.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:30.909+0000 7fdefaffd700 1 -- 172.21.15.31:0/1358024660 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdef4053550 con 0x7fdf0406adb0 2023-10-09T06:27:31.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.147+0000 7fdf09532700 1 -- 172.21.15.31:0/1358024660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf040d0760 con 0x7fdf0406adb0 2023-10-09T06:27:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.147+0000 7fdefaffd700 1 -- 172.21.15.31:0/1358024660 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fdef4015070 con 0x7fdf0406adb0 2023-10-09T06:27:31.310 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:31.310 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/1232957657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1232957657},{"type":"v1","addr":"172.21.15.158:6836","nonce":1232957657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2947695434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2947695434},{"type":"v1","addr":"172.21.15.158:6837","nonce":2947695434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/912397379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":912397379},{"type":"v1","addr":"172.21.15.31:6834","nonce":912397379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:07.779885+0000","modified":"2023-10-09T06:27:12.402382+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7005},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7005":{"gid":7005,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1684509217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1684509217},{"type":"v1","addr":"172.21.15.31:6835","nonce":1684509217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T06:27:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.150+0000 7fdf09532700 1 -- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdee4066f30 msgr2=0x7fdee40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.150+0000 7fdf09532700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdee4066f30 0x7fdee40693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdf040695e0 tx=0x7fdeec009040 comp rx=0 tx=0).stop 2023-10-09T06:27:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.150+0000 7fdf09532700 1 -- 172.21.15.31:0/1358024660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf0406adb0 msgr2=0x7fdf0415cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.150+0000 7fdf09532700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf0406adb0 0x7fdf0415cdd0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fdf04089730 tx=0x7fdef4017000 comp rx=0 tx=0).stop 2023-10-09T06:27:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.150+0000 7fdf09532700 1 -- 172.21.15.31:0/1358024660 shutdown_connections 2023-10-09T06:27:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.150+0000 7fdf09532700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdee4066f30 0x7fdee40693e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.150+0000 7fdf09532700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf04159e60 0x7fdf040c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.150+0000 7fdf09532700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf0406adb0 0x7fdf0415cdd0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.150+0000 7fdf09532700 1 --2- 172.21.15.31:0/1358024660 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf040cffa0 0x7fdf04153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.150+0000 7fdf09532700 1 -- 172.21.15.31:0/1358024660 >> 172.21.15.31:0/1358024660 conn(0x7fdf040d1a50 msgr2=0x7fdf04155810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.150+0000 7fdf09532700 1 -- 172.21.15.31:0/1358024660 shutdown_connections 2023-10-09T06:27:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.150+0000 7fdf09532700 1 -- 172.21.15.31:0/1358024660 wait complete. 2023-10-09T06:27:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 66 2023-10-09T06:27:31.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-09T06:27:31.453 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":7005,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":23.071344919000001,"mdsmap_epoch":66,"osdmap_epoch":138,"osdmap_epoch_barrier":138,"uptime":28.133822367} 2023-10-09T06:27:31.453 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 7005, "mdsmap_epoch": 66, "osdmap_epoch": 138, "osdmap_epoch_barrier": 138, "rank_uptime": 23.071344919, "state": "up:active", "uptime": 28.133822367, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:27:31.453 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T06:27:31.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:27:31.453 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-09T06:27:31.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:27:31.469 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-09T06:27:31.527 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:27:31.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.685+0000 7f3219154700 1 Processor -- start 2023-10-09T06:27:31.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.685+0000 7f3219154700 1 -- start start 2023-10-09T06:27:31.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.686+0000 7f3219154700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f321415a2b0 0x7f32140b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:31.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.686+0000 7f3219154700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f32140d1c30 0x7f32140cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:31.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.686+0000 7f3219154700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32140c5d80 con 0x7f321415a680 2023-10-09T06:27:31.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.686+0000 7f3219154700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3214068470 con 0x7f32140d1c30 2023-10-09T06:27:31.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.686+0000 7f3219154700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32140c6060 con 0x7f321415a2b0 2023-10-09T06:27:31.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.686+0000 7f321259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f32140d1c30 0x7f32140cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:31.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.686+0000 7f321259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f32140d1c30 0x7f32140cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57826/0 (socket says 172.21.15.31:57826) 2023-10-09T06:27:31.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.686+0000 7f321259c700 1 -- 172.21.15.31:0/1773980684 learned_addr learned my addr 172.21.15.31:0/1773980684 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:31.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.686+0000 7f321259c700 1 -- 172.21.15.31:0/1773980684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f321415a2b0 msgr2=0x7f32140b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:31.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.686+0000 7f3212d9d700 1 --2- 172.21.15.31:0/1773980684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f321415a2b0 0x7f32140b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:31.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.686+0000 7f321259c700 1 --2- 172.21.15.31:0/1773980684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f321415a2b0 0x7f32140b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:31.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.686+0000 7f321259c700 1 -- 172.21.15.31:0/1773980684 >> v1:172.21.15.158:6789/0 conn(0x7f321415a680 legacy=0x7f32140c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:31.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.687+0000 7f321259c700 1 -- 172.21.15.31:0/1773980684 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32140c6340 con 0x7f32140d1c30 2023-10-09T06:27:31.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.687+0000 7f321259c700 1 --2- 172.21.15.31:0/1773980684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32140d1c30 0x7f32140cf710 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0099b0 tx=0x7f31fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86017af3fe5abb88 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:31.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.687+0000 7f3211d9b700 1 -- 172.21.15.31:0/1773980684 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00b820 con 0x7f32140d1c30 2023-10-09T06:27:31.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.687+0000 7f3211d9b700 1 -- 172.21.15.31:0/1773980684 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc00b980 con 0x7f32140d1c30 2023-10-09T06:27:31.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.687+0000 7f3211d9b700 1 -- 172.21.15.31:0/1773980684 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00bd20 con 0x7f32140d1c30 2023-10-09T06:27:31.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.687+0000 7f3219154700 1 -- 172.21.15.31:0/1773980684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32140d1c30 msgr2=0x7f32140cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:31.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.687+0000 7f3219154700 1 --2- 172.21.15.31:0/1773980684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32140d1c30 0x7f32140cf710 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0099b0 tx=0x7f31fc009250 comp rx=0 tx=0).stop 2023-10-09T06:27:31.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.687+0000 7f3219154700 1 -- 172.21.15.31:0/1773980684 shutdown_connections 2023-10-09T06:27:31.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.687+0000 7f3219154700 1 --2- 172.21.15.31:0/1773980684 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f321415a2b0 0x7f32140b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:31.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.687+0000 7f3219154700 1 --2- 172.21.15.31:0/1773980684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32140d1c30 0x7f32140cf710 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:31.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.687+0000 7f3219154700 1 -- 172.21.15.31:0/1773980684 >> 172.21.15.31:0/1773980684 conn(0x7f3214067e40 msgr2=0x7f32140d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:31.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.687+0000 7f3219154700 1 -- 172.21.15.31:0/1773980684 shutdown_connections 2023-10-09T06:27:31.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.687+0000 7f3219154700 1 -- 172.21.15.31:0/1773980684 wait complete. 2023-10-09T06:27:31.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.689+0000 7f3219154700 1 Processor -- start 2023-10-09T06:27:31.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.689+0000 7f3219154700 1 -- start start 2023-10-09T06:27:31.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.689+0000 7f3219154700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32140d1c30 0x7f32141445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:31.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.689+0000 7f3219154700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f321415a2b0 0x7f321415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:31.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.689+0000 7f3219154700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321415a680 0x7f321415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:31.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.689+0000 7f3219154700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321415dde0 con 0x7f321415a680 2023-10-09T06:27:31.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.689+0000 7f3219154700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32140b5410 con 0x7f321415a2b0 2023-10-09T06:27:31.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.689+0000 7f3219154700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321415d820 con 0x7f32140d1c30 2023-10-09T06:27:31.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.689+0000 7f321359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321415a680 0x7f321415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:31.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.689+0000 7f321359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321415a680 0x7f321415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57840/0 (socket says 172.21.15.31:57840) 2023-10-09T06:27:31.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.689+0000 7f321359e700 1 -- 172.21.15.31:0/4225186090 learned_addr learned my addr 172.21.15.31:0/4225186090 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:31.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f321259c700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f321415a2b0 0x7f321415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:31.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f3212d9d700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32140d1c30 0x7f32141445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:31.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f321359e700 1 -- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32140d1c30 msgr2=0x7f32141445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:31.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f321359e700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32140d1c30 0x7f32141445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:31.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f321359e700 1 -- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f321415a2b0 msgr2=0x7f321415ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:31.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f321359e700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f321415a2b0 0x7f321415ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:31.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f321359e700 1 -- 172.21.15.31:0/4225186090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc0094f0 con 0x7f321415a680 2023-10-09T06:27:31.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f3212d9d700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32140d1c30 0x7f32141445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:31.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f321259c700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f321415a2b0 0x7f321415ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:31.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f321359e700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321415a680 0x7f321415b0a0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f320c00bc30 tx=0x7f320c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:31.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f320affd700 1 -- 172.21.15.31:0/4225186090 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c00c9b0 con 0x7f321415a680 2023-10-09T06:27:31.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f320affd700 1 -- 172.21.15.31:0/4225186090 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c00cb50 con 0x7f321415a680 2023-10-09T06:27:31.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f3219154700 1 -- 172.21.15.31:0/4225186090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321415db00 con 0x7f321415a680 2023-10-09T06:27:31.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f320affd700 1 -- 172.21.15.31:0/4225186090 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c014410 con 0x7f321415a680 2023-10-09T06:27:31.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.690+0000 7f3219154700 1 -- 172.21.15.31:0/4225186090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321416ba20 con 0x7f321415a680 2023-10-09T06:27:31.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.691+0000 7f3219154700 1 -- 172.21.15.31:0/4225186090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32140b55a0 con 0x7f321415a680 2023-10-09T06:27:31.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.691+0000 7f320affd700 1 -- 172.21.15.31:0/4225186090 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f320c014800 con 0x7f321415a680 2023-10-09T06:27:31.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.692+0000 7f320affd700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f31f4066f30 0x7f31f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:31.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.692+0000 7f320affd700 1 -- 172.21.15.31:0/4225186090 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f320c0845e0 con 0x7f321415a680 2023-10-09T06:27:31.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.692+0000 7f320affd700 1 -- 172.21.15.31:0/4225186090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=139}) v3 -- 0x7f31f406ea50 con 0x7f321415a680 2023-10-09T06:27:31.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.692+0000 7f3212d9d700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f31f4066f30 0x7f31f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:31.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.693+0000 7f3212d9d700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f31f4066f30 0x7f31f40693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f320400aa80 tx=0x7f3204008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:31.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.696+0000 7f320affd700 1 -- 172.21.15.31:0/4225186090 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f320c04c5a0 con 0x7f321415a680 2023-10-09T06:27:31.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.893+0000 7f3219154700 1 -- 172.21.15.31:0/4225186090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f321404c3c0 con 0x7f321415a680 2023-10-09T06:27:31.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.894+0000 7f320affd700 1 -- 172.21.15.31:0/4225186090 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f320c051850 con 0x7f321415a680 2023-10-09T06:27:31.895 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:31.895 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:27:31.895 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 138, 2023-10-09T06:27:31.895 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:27:31.895 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:27:31.895 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:27:26.747057+0000", 2023-10-09T06:27:31.895 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:27:31.895 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:27:31.895 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:27:31.895 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:27:31.896 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:27:31.896 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:27:31.896 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:27:31.896 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:27:31.896 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:27:31.896 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:31.896 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:27:31.896 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:27:31.896 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:27:31.896 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:27:31.897 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:27:31.897 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 17, 2023-10-09T06:27:31.897 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:27:31.897 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:27:31.897 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:27:31.897 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:27:31.897 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:27:31.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.897 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:27:31.897 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:27:31.897 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:27:31.897 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:31.899 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:27:31.899 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:27:31.899 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:27:31.899 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:27:31.899 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:27:31.899 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:31.899 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:31.899 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:31.899 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:31.899 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:31.899 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:31.900 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:31.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.900 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:27:31.900 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:31.900 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:31.900 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:31.900 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:31.900 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:31.900 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:31.900 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:31.900 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:31.901 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:31.901 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:31.901 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:31.901 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:31.901 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:31.901 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:31.901 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:31.901 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:31.901 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:31.901 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:31.901 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:31.901 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:31.902 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:31.902 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:31.902 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:31.902 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:31.902 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:31.902 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:31.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.902 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:31.902 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:31.902 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:31.902 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:31.902 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:31.903 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:31.903 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:31.903 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:31.903 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:31.903 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:31.903 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:31.903 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:31.903 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:27:31.903 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:27:31.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.903 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:31.903 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:27:31.904 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.904 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 16, 2023-10-09T06:27:31.904 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:27:31.904 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.232021+0000", 2023-10-09T06:27:31.904 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:31.904 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:31.904 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:31.904 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:31.904 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:31.905 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:31.905 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:31.905 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:31.905 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:31.905 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:31.905 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:31.905 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:31.905 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:27:31.905 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:27:31.905 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:27:31.905 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:27:31.905 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:27:31.906 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:31.906 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:31.906 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:31.906 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:31.906 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:31.906 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:31.906 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:31.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.906 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "135", 2023-10-09T06:27:31.906 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:31.906 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:31.906 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:31.907 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:31.907 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:31.907 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:31.907 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:31.907 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:31.907 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:31.907 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:31.907 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:31.907 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:31.907 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:31.907 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:31.908 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:31.908 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:31.908 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:31.908 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:31.908 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:31.908 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:31.908 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:31.908 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:31.908 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:31.908 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:31.909 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:31.909 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:31.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.909 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:31.909 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:31.909 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:31.909 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:31.909 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:31.909 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:31.909 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:31.909 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:31.910 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:31.910 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:31.910 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:31.910 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:31.910 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:27:31.910 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:27:31.910 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:27:31.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.910 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:31.910 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:31.911 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:27:31.911 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.911 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.911 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 17, 2023-10-09T06:27:31.911 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:27:31.911 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.742407+0000", 2023-10-09T06:27:31.911 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1027, 2023-10-09T06:27:31.911 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T06:27:31.911 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:31.911 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:31.912 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:31.912 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:31.912 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:31.912 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:31.912 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:31.912 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:31.912 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:31.912 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:31.912 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:27:31.912 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:27:31.913 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:27:31.913 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:27:31.913 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:27:31.913 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:31.913 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:31.913 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:31.913 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:31.913 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:31.913 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:31.913 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:31.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.913 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "138", 2023-10-09T06:27:31.914 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:31.914 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:31.914 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:31.914 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:31.914 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:31.914 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:31.914 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:31.914 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:31.914 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:31.914 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:27:31.914 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:31.914 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:31.915 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:31.915 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:31.915 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:31.915 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:31.915 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:31.915 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:31.915 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:31.915 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:31.915 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:31.915 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:31.916 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:31.916 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:31.916 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:31.916 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:31.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.916 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:31.916 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:31.916 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:31.916 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:31.916 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:31.916 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:31.917 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:31.917 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:31.917 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:31.917 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:31.917 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:31.917 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:31.917 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:27:31.917 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:27:31.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.917 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:31.918 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:31.918 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:27:31.918 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.918 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.918 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.918 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:31.918 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:27:31.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.918 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:31.918 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:31.918 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:31.919 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:31.919 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:31.919 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:31.919 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:31.919 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:31.919 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:31.919 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:31.919 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:31.919 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:31.919 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:31.919 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.920 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.920 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:27:31.920 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:31.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.920 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.920 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:27:31.920 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:31.920 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.920 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.921 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:31.921 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.921 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.921 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:27:31.921 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:31.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.921 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.921 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:27:31.921 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:31.922 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.922 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.922 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:31.922 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.922 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.922 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:27:31.922 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:31.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.923 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.923 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:27:31.923 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:31.923 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.923 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.923 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:31.923 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.923 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.924 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:27:31.924 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:31.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.924 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.924 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:27:31.924 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:31.924 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.924 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.924 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:27:31.925 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:27:31.925 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:27:31.925 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:27:31.925 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:31.925 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:31.925 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:31.925 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.925 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:31.925 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:31.926 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:31.926 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:31.926 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:31.926 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:31.926 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:31.926 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:31.926 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:31.926 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:31.926 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:31.926 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:31.926 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:31.926 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.927 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.927 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:27:31.927 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:31.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.927 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.927 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:27:31.927 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:31.928 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.928 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.928 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:31.928 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.928 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.928 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:27:31.928 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:31.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.928 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.929 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:27:31.929 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:31.929 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.929 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.929 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:31.929 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.929 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.930 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:27:31.930 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:31.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.930 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.930 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:27:31.930 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:31.930 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.930 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.930 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:31.930 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.931 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.931 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:27:31.931 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:31.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.931 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.931 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:27:31.931 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:31.931 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.931 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.932 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:27:31.932 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:27:31.932 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:27:31.932 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:27:31.932 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:31.932 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:31.932 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:31.932 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.932 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:31.932 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:31.933 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:31.933 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:31.933 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:31.933 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:31.933 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:31.933 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:31.933 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:31.933 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:31.933 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:31.933 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:31.933 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:31.934 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.934 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.934 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:27:31.934 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:31.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.934 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.934 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:27:31.934 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:31.934 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.935 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.935 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:31.935 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.935 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.935 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:27:31.935 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:31.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.935 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.935 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:27:31.936 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:31.936 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.936 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.936 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:31.936 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.936 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.936 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:27:31.936 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:31.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.937 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.937 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:27:31.937 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:31.937 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.937 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.937 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:31.937 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.937 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.937 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:27:31.938 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:31.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.938 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.938 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:27:31.938 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:31.938 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.938 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.938 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:27:31.938 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:27:31.938 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:27:31.939 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:27:31.939 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:31.939 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:31.939 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:31.939 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.939 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:31.939 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:31.939 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:31.939 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:31.939 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:31.940 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:31.940 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:31.940 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:31.940 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:31.940 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:31.940 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:31.940 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:31.940 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:31.940 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.940 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.940 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:27:31.941 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:31.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.941 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.941 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:27:31.941 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:31.941 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.941 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.941 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:31.941 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.942 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.942 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:27:31.942 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:31.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.942 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.942 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:27:31.942 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:31.942 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.942 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.943 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:31.943 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.943 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.943 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:27:31.943 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:31.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.943 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.943 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:27:31.943 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:31.944 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.944 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.944 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:31.944 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.944 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.944 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:27:31.944 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:31.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.945 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.945 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:27:31.945 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:31.945 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.945 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.945 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:27:31.945 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:27:31.945 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:27:31.946 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:27:31.946 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:31.946 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:31.946 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:31.946 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.946 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:31.946 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:31.946 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:31.946 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:31.946 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:31.947 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:31.947 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:31.947 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:31.947 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:31.947 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:31.947 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:31.947 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:31.947 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:31.947 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.947 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.948 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:27:31.948 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:31.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.948 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.948 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:27:31.948 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:31.948 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.948 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.948 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:31.948 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.949 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.949 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:27:31.949 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:31.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.949 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.949 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:27:31.949 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:31.949 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.949 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.950 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:31.950 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.950 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.950 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:27:31.950 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:31.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.950 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.950 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:27:31.950 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:31.951 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.951 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.951 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:31.951 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.951 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.951 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:27:31.951 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:31.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.951 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.952 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:27:31.952 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:31.952 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.952 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.952 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:27:31.952 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:27:31.952 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:27:31.952 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:27:31.952 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:31.952 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:31.953 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:31.953 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.953 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:31.953 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:31.953 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:31.953 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:31.953 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:31.953 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:31.953 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:31.953 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:31.954 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:31.954 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:31.954 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:31.954 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:31.954 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:31.954 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.954 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.954 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:27:31.954 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:31.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.955 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.955 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:27:31.955 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:31.955 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.955 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.955 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:31.955 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.956 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.956 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:27:31.956 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:31.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.956 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.956 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:27:31.956 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:31.956 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.957 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.957 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:31.957 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.957 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.957 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:27:31.957 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:31.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.957 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.958 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:27:31.958 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:31.958 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.958 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.958 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:31.958 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.958 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.958 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:27:31.959 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:31.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.959 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.959 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.959 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:27:31.959 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:31.959 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.959 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.959 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:27:31.959 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:27:31.959 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:27:31.960 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:27:31.960 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:31.960 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:31.960 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:31.960 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.960 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.960 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:31.960 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:31.960 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:31.960 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:31.960 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:31.961 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:31.961 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:31.961 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:31.961 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:31.961 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:31.961 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:31.961 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:31.961 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:31.961 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.961 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.961 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:27:31.962 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:31.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.962 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.962 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:27:31.962 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:31.962 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.962 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.962 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:31.962 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.963 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.963 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:27:31.963 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:31.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.963 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.963 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:27:31.963 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:31.963 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.963 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.964 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:31.964 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.964 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.964 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:27:31.964 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:31.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.964 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.964 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:27:31.964 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:31.965 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.965 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.965 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:31.965 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.965 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.965 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:27:31.965 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:31.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.965 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:27:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:27:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:27:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:27:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:27:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:27:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.969 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.969 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:27:31.969 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:31.969 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.969 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.969 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:31.969 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.969 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.970 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:27:31.970 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:31.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.970 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.970 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:27:31.970 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:31.970 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.970 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.970 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:31.971 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.971 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.971 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:27:31.971 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:31.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.971 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.971 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:27:31.971 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:31.971 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.971 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.972 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:31.972 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:31.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.972 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:31.972 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:27:31.972 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:31.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.972 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:31.972 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:27:31.973 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:31.973 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.973 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.973 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:27:31.973 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:27:31.973 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:27:31.973 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:27:31.973 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:31.973 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:31.973 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:31.973 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:31.974 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.974 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:31.974 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:27:31.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.974 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:31.974 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:31.974 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:31.974 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:31.974 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:31.974 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:31.975 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:27:31.975 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:31.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.975 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:31.975 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:31.975 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:31.975 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:31.975 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:31.975 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:31.975 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:27:31.976 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:31.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.976 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.976 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:31.976 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:31.976 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:31.976 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:31.976 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:31.976 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:31.976 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:27:31.976 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:31.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.977 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:31.977 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:31.977 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:31.977 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:31.977 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:31.977 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:31.977 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:27:31.977 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:31.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.978 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:31.978 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:31.979 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:31.979 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:31.979 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:31.979 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:31.979 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:27:31.979 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:31.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.979 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.979 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:31.979 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:31.980 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:31.980 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:31.980 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:31.980 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:31.980 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:27:31.980 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:31.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.980 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.980 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:31.980 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:31.980 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:31.981 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:31.981 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:31.981 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:31.981 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:27:31.981 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:31.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:31.981 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:31.981 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:31.981 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:31.981 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:31.982 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:31.982 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:31.982 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:27:31.982 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:31.982 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.982 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:31.982 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:27:31.982 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:27:31.982 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:27:31.982 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:27:31.982 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:27:31.982 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:27:31.983 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:27:31.983 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:27:31.983 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:27:31.983 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:27:31.983 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:27:31.983 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:27:31.983 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:27:31.983 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:31.983 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:27:31.983 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:27:31.983 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:27:31.984 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:27:31.984 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:27:31.984 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:27:31.984 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:27:31.984 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:27:31.984 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:27:31.984 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:27:31.984 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:27:31.984 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:31.984 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:27:31.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.896+0000 7f3219154700 1 -- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f31f4066f30 msgr2=0x7f31f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:31.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.896+0000 7f3219154700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f31f4066f30 0x7f31f40693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f320400aa80 tx=0x7f3204008040 comp rx=0 tx=0).stop 2023-10-09T06:27:31.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.896+0000 7f3219154700 1 -- 172.21.15.31:0/4225186090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321415a680 msgr2=0x7f321415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:31.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.896+0000 7f3219154700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321415a680 0x7f321415b0a0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f320c00bc30 tx=0x7f320c009820 comp rx=0 tx=0).stop 2023-10-09T06:27:31.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.896+0000 7f3219154700 1 -- 172.21.15.31:0/4225186090 shutdown_connections 2023-10-09T06:27:31.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.896+0000 7f3219154700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f31f4066f30 0x7f31f40693e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:31.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.896+0000 7f3219154700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f32140d1c30 0x7f32141445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:31.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.896+0000 7f3219154700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321415a680 0x7f321415b0a0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:31.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.896+0000 7f3219154700 1 --2- 172.21.15.31:0/4225186090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f321415a2b0 0x7f321415ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:31.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.896+0000 7f3219154700 1 -- 172.21.15.31:0/4225186090 >> 172.21.15.31:0/4225186090 conn(0x7f3214067e40 msgr2=0x7f3214069910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:31.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.896+0000 7f3219154700 1 -- 172.21.15.31:0/4225186090 shutdown_connections 2023-10-09T06:27:31.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:31.896+0000 7f3219154700 1 -- 172.21.15.31:0/4225186090 wait complete. 2023-10-09T06:27:31.988 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:27:36.988 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:27:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.120+0000 7fc8719c9700 1 Processor -- start 2023-10-09T06:27:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.120+0000 7fc8719c9700 1 -- start start 2023-10-09T06:27:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.121+0000 7fc8719c9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc86c159be0 0x7fc86c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.121+0000 7fc8719c9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc86c159fb0 0x7fc86c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.121+0000 7fc8719c9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86c067800 con 0x7fc86c0692f0 2023-10-09T06:27:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.121+0000 7fc8719c9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86c0701f0 con 0x7fc86c159be0 2023-10-09T06:27:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.121+0000 7fc8719c9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86c067ae0 con 0x7fc86c159fb0 2023-10-09T06:27:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.121+0000 7fc8709c7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc86c159be0 0x7fc86c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.121+0000 7fc8709c7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc86c159be0 0x7fc86c068db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57856/0 (socket says 172.21.15.31:57856) 2023-10-09T06:27:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.121+0000 7fc8709c7700 1 -- 172.21.15.31:0/3849070532 learned_addr learned my addr 172.21.15.31:0/3849070532 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.121+0000 7fc86bfff700 1 --2- 172.21.15.31:0/3849070532 >> v2:172.21.15.158:3300/0 conn(0x7fc86c159fb0 0x7fc86c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.121+0000 7fc8709c7700 1 -- 172.21.15.31:0/3849070532 >> v2:172.21.15.158:3300/0 conn(0x7fc86c159fb0 msgr2=0x7fc86c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc8709c7700 1 --2- 172.21.15.31:0/3849070532 >> v2:172.21.15.158:3300/0 conn(0x7fc86c159fb0 0x7fc86c0ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc8709c7700 1 -- 172.21.15.31:0/3849070532 >> v1:172.21.15.158:6789/0 conn(0x7fc86c0692f0 legacy=0x7fc86c0b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc8709c7700 1 -- 172.21.15.31:0/3849070532 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c067dc0 con 0x7fc86c159be0 2023-10-09T06:27:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc86bfff700 1 --2- 172.21.15.31:0/3849070532 >> v2:172.21.15.158:3300/0 conn(0x7fc86c159fb0 0x7fc86c0ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc8709c7700 1 --2- 172.21.15.31:0/3849070532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc86c159be0 0x7fc86c068db0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fc86c06ec40 tx=0x7fc85c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df750f38fea4072d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc86b7fe700 1 -- 172.21.15.31:0/3849070532 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c00b860 con 0x7fc86c159be0 2023-10-09T06:27:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc86b7fe700 1 -- 172.21.15.31:0/3849070532 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c00b9c0 con 0x7fc86c159be0 2023-10-09T06:27:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc86b7fe700 1 -- 172.21.15.31:0/3849070532 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c00bd60 con 0x7fc86c159be0 2023-10-09T06:27:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc8719c9700 1 -- 172.21.15.31:0/3849070532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc86c159be0 msgr2=0x7fc86c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc8719c9700 1 --2- 172.21.15.31:0/3849070532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc86c159be0 0x7fc86c068db0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fc86c06ec40 tx=0x7fc85c009250 comp rx=0 tx=0).stop 2023-10-09T06:27:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc8719c9700 1 -- 172.21.15.31:0/3849070532 shutdown_connections 2023-10-09T06:27:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc8719c9700 1 --2- 172.21.15.31:0/3849070532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc86c159be0 0x7fc86c068db0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc8719c9700 1 --2- 172.21.15.31:0/3849070532 >> v2:172.21.15.158:3300/0 conn(0x7fc86c159fb0 0x7fc86c0ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc8719c9700 1 -- 172.21.15.31:0/3849070532 >> 172.21.15.31:0/3849070532 conn(0x7fc86c06bc70 msgr2=0x7fc86c06c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc8719c9700 1 -- 172.21.15.31:0/3849070532 shutdown_connections 2023-10-09T06:27:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.122+0000 7fc8719c9700 1 -- 172.21.15.31:0/3849070532 wait complete. 2023-10-09T06:27:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.124+0000 7fc8719c9700 1 Processor -- start 2023-10-09T06:27:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.124+0000 7fc8719c9700 1 -- start start 2023-10-09T06:27:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.124+0000 7fc8719c9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc86c0692f0 0x7fc86c0b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.124+0000 7fc8719c9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc86c159be0 0x7fc86c158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc8719c9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc86c159fb0 0x7fc86c0b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc8719c9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c0b2540 con 0x7fc86c159be0 2023-10-09T06:27:37.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc8719c9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c0c5b70 con 0x7fc86c159fb0 2023-10-09T06:27:37.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc8719c9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c0b4040 con 0x7fc86c0692f0 2023-10-09T06:27:37.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc86bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc86c159be0 0x7fc86c158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc86bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc86c159be0 0x7fc86c158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57870/0 (socket says 172.21.15.31:57870) 2023-10-09T06:27:37.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc86bfff700 1 -- 172.21.15.31:0/416677756 learned_addr learned my addr 172.21.15.31:0/416677756 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:37.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc8709c7700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc86c0692f0 0x7fc86c0b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc8711c8700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc86c159fb0 0x7fc86c0b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc86bfff700 1 -- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc86c0692f0 msgr2=0x7fc86c0b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc86bfff700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc86c0692f0 0x7fc86c0b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc86bfff700 1 -- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc86c159fb0 msgr2=0x7fc86c0b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc86bfff700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc86c159fb0 0x7fc86c0b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc86bfff700 1 -- 172.21.15.31:0/416677756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c0094f0 con 0x7fc86c159be0 2023-10-09T06:27:37.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc8709c7700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc86c0692f0 0x7fc86c0b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:37.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc8711c8700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc86c159fb0 0x7fc86c0b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc86bfff700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc86c159be0 0x7fc86c158070 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc86000e870 tx=0x7fc860008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc868ff9700 1 -- 172.21.15.31:0/416677756 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86000c430 con 0x7fc86c159be0 2023-10-09T06:27:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc868ff9700 1 -- 172.21.15.31:0/416677756 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86000c590 con 0x7fc86c159be0 2023-10-09T06:27:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc868ff9700 1 -- 172.21.15.31:0/416677756 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86000c930 con 0x7fc86c159be0 2023-10-09T06:27:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc8719c9700 1 -- 172.21.15.31:0/416677756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86c0b3a80 con 0x7fc86c159be0 2023-10-09T06:27:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.125+0000 7fc8719c9700 1 -- 172.21.15.31:0/416677756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86c0c5e10 con 0x7fc86c159be0 2023-10-09T06:27:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.126+0000 7fc8719c9700 1 -- 172.21.15.31:0/416677756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86c0c59d0 con 0x7fc86c159be0 2023-10-09T06:27:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.127+0000 7fc868ff9700 1 -- 172.21.15.31:0/416677756 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc86000cce0 con 0x7fc86c159be0 2023-10-09T06:27:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.127+0000 7fc868ff9700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc858066f60 0x7fc858069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.127+0000 7fc868ff9700 1 -- 172.21.15.31:0/416677756 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc860084250 con 0x7fc86c159be0 2023-10-09T06:27:37.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.127+0000 7fc8709c7700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc858066f60 0x7fc858069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.128+0000 7fc8709c7700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc858066f60 0x7fc858069410 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc86c06ec40 tx=0x7fc85c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:37.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.131+0000 7fc868ff9700 1 -- 172.21.15.31:0/416677756 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc86c0c59d0 con 0x7fc86c159be0 2023-10-09T06:27:37.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.325+0000 7fc8719c9700 1 -- 172.21.15.31:0/416677756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc86c0c59d0 con 0x7fc86c159be0 2023-10-09T06:27:37.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.326+0000 7fc868ff9700 1 -- 172.21.15.31:0/416677756 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+32282 (secure 0 0 0) 0x7fc86c0c59d0 con 0x7fc86c159be0 2023-10-09T06:27:37.327 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:37.327 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:27:37.327 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 139, 2023-10-09T06:27:37.327 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:27:37.328 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:27:37.328 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:27:36.748970+0000", 2023-10-09T06:27:37.328 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:27:37.328 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:27:37.328 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:27:37.328 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:27:37.328 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:27:37.328 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:27:37.328 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:27:37.328 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:27:37.329 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:27:37.329 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:37.329 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:27:37.329 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:27:37.329 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:27:37.329 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:27:37.329 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:27:37.329 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 17, 2023-10-09T06:27:37.329 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:27:37.329 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:27:37.329 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:27:37.330 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:27:37.330 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:27:37.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.330 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:27:37.330 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:27:37.330 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:27:37.330 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:37.330 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:37.330 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:37.330 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:37.330 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:37.331 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:37.331 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:37.331 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:37.331 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:37.331 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:37.331 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:37.331 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:37.331 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:27:37.331 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:27:37.331 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:27:37.331 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:27:37.332 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:27:37.332 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:37.332 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:37.332 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:37.332 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:37.332 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:37.332 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:37.332 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:37.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.332 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:27:37.332 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:37.332 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:37.333 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:37.333 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:37.333 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:37.333 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:37.333 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:37.333 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:37.333 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:37.333 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:37.333 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:37.333 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:37.333 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:37.334 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:37.334 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:37.334 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:37.334 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:37.334 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:37.334 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:37.334 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:37.334 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:37.334 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:37.334 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:37.335 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:37.335 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:37.335 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:37.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.335 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:37.335 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:37.335 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:37.335 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:37.335 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:37.335 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:37.335 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:37.336 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:37.336 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:37.336 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:37.336 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:37.336 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:37.336 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:27:37.336 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:27:37.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.337 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:37.337 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:27:37.337 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.337 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 16, 2023-10-09T06:27:37.337 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:27:37.337 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.232021+0000", 2023-10-09T06:27:37.337 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:37.338 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:37.338 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:37.338 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:37.338 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:37.338 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:37.338 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:37.338 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:37.338 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:37.338 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:37.338 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:37.338 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:37.339 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:27:37.339 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:27:37.339 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:27:37.339 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:27:37.339 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:27:37.339 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:37.339 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:37.339 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:37.339 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:37.339 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:37.339 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:37.340 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:37.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.340 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "135", 2023-10-09T06:27:37.340 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:37.340 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:37.340 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:37.340 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:37.340 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:37.340 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:37.340 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:37.340 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:37.341 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:37.341 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:37.341 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:37.341 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:37.341 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:37.341 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:37.341 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:37.341 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:37.341 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:37.341 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:37.341 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:37.342 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:37.342 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:37.342 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:37.342 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:37.342 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:37.342 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:37.342 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:37.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.342 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:37.342 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:37.343 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:37.343 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:37.343 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:37.343 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:37.343 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:37.343 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:37.343 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:37.343 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:37.343 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:37.343 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:37.344 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:27:37.344 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:27:37.344 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:27:37.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.344 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:37.344 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:37.344 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:27:37.344 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.344 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.345 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 17, 2023-10-09T06:27:37.345 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:27:37.345 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.742407+0000", 2023-10-09T06:27:37.345 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:37.345 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:37.345 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:37.345 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:37.345 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:37.345 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:37.345 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:37.346 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:37.346 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:37.346 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:37.346 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:37.346 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:37.346 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:27:37.346 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:27:37.346 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:27:37.346 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:27:37.346 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:27:37.346 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:37.347 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:37.347 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:37.347 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:37.347 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:37.347 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:37.347 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:37.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.347 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "139", 2023-10-09T06:27:37.347 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:37.347 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:37.347 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:37.347 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:37.348 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:37.348 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:37.348 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:37.348 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:37.348 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:37.348 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:27:37.348 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:37.348 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:37.348 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:37.348 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:37.348 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:37.349 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:37.349 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:37.349 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:37.349 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:37.349 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:37.349 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:37.349 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:37.349 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:37.349 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:37.349 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:37.349 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:37.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.350 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:37.350 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:37.350 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:37.350 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:37.350 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:37.350 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:37.350 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:37.350 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:37.350 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:37.351 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:37.351 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:37.351 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:37.351 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:27:37.351 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:27:37.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.351 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:37.351 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:37.351 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:27:37.351 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.351 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.352 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.352 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:37.352 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:27:37.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.352 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:37.352 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.352 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.352 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.352 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.352 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.352 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.352 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.353 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.353 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.353 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.353 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.353 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.353 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.353 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.353 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:27:37.353 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.354 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.354 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:27:37.354 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.354 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.354 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.354 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.354 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.355 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.355 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:27:37.355 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.355 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.355 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:27:37.355 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.355 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.355 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.356 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.356 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.356 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.356 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:27:37.356 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.356 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.357 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:27:37.357 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.357 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.357 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.357 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.357 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.357 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.357 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:27:37.357 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.358 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.358 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:27:37.358 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.358 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.358 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.358 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:27:37.358 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:27:37.358 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:27:37.359 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:27:37.359 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.359 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.359 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.359 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.359 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:37.359 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.359 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.360 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.360 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.360 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.360 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.360 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.360 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.360 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.360 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.360 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.360 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.360 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.361 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.361 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:27:37.361 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.361 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.361 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:27:37.361 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.361 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.361 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.362 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.362 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.362 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.362 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:27:37.362 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.362 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.362 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:27:37.362 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.363 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.363 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.363 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.363 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.363 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.363 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:27:37.363 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.363 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.364 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:27:37.364 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.364 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.364 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.364 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.364 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.364 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.364 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:27:37.364 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.365 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.365 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:27:37.365 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.365 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.365 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.365 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:27:37.365 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:27:37.365 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:27:37.366 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:27:37.366 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.366 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.366 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.366 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.366 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:37.366 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.366 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.366 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.367 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.367 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.367 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.367 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.367 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.367 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.367 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.367 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.367 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.367 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.367 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.368 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:27:37.368 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.368 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.368 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:27:37.368 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.368 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.368 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.368 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.368 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.369 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.369 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:27:37.369 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.369 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.369 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:27:37.369 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.369 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.369 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.370 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.370 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.370 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.370 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:27:37.370 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.370 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.370 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:27:37.370 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.371 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.371 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.371 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.371 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.371 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.371 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:27:37.371 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.372 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.372 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:27:37.372 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.372 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.372 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.372 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:27:37.372 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:27:37.372 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:27:37.372 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:27:37.372 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.373 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.373 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.373 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.373 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:37.373 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.373 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.373 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.373 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.373 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.373 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.374 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.374 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.374 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.374 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.374 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.374 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.374 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.374 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.374 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:27:37.374 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.375 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.375 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:27:37.375 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.375 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.375 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.375 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.375 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.375 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.376 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:27:37.376 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.376 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.376 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:27:37.376 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.376 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.376 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.376 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.377 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.377 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.377 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:27:37.377 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.377 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.377 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:27:37.377 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.377 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.377 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.378 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.378 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.378 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.378 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:27:37.378 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.378 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.378 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:27:37.379 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.379 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.379 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.379 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:27:37.379 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:27:37.379 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:27:37.379 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:27:37.379 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.379 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.380 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.380 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.380 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:37.380 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.380 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.380 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.380 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.380 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.381 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.381 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.381 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.381 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.381 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.381 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.381 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.381 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.381 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.382 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:27:37.382 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.382 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.382 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:27:37.382 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.382 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.382 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.382 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.383 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.383 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.383 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:27:37.383 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.383 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.383 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:27:37.383 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.383 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.383 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.384 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.384 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.384 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.384 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:27:37.384 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.384 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.384 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:27:37.384 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.385 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.385 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.385 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.385 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.385 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.385 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:27:37.385 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.385 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.386 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:27:37.386 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.386 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.386 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.386 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:27:37.386 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:27:37.386 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:27:37.386 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:27:37.386 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.386 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.387 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.387 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.387 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:37.387 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.387 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.387 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.387 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.387 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.387 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.387 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.388 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.388 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.388 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.388 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.388 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.388 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.388 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.388 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:27:37.388 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.389 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.389 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:27:37.389 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.389 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.389 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.389 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.389 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.389 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.389 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:27:37.390 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.390 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.390 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:27:37.390 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.390 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.390 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.390 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.390 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.391 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.391 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:27:37.391 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.391 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.391 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:27:37.391 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.391 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.391 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.392 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.392 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.392 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.392 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:27:37.392 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.392 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.392 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:27:37.393 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.393 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.393 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.393 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:27:37.393 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:27:37.393 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:27:37.393 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:27:37.393 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.393 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.393 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.393 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.394 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:37.394 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.394 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.394 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.394 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.394 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.394 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.394 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.394 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.395 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.395 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.395 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.395 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.395 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.395 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.395 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:27:37.395 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.396 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.396 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:27:37.396 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.396 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.396 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.396 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.396 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.396 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.397 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:27:37.397 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.397 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.397 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:27:37.397 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.397 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.397 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.397 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.397 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.398 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.398 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:27:37.398 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.398 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.398 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:27:37.398 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.398 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.399 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.399 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.399 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.399 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.399 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:27:37.399 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.399 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.400 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:27:37.400 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.400 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.400 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.400 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:27:37.400 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:27:37.400 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:27:37.400 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:27:37.400 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.400 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.400 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.401 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.401 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:37.401 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.401 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.401 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.401 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.401 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.401 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.401 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.401 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.402 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.402 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.402 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.402 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.402 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.402 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.402 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:27:37.402 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.403 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.403 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:27:37.403 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.403 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.403 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.403 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.403 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.403 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.403 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:27:37.404 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.404 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.404 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:27:37.404 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.404 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.404 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.404 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.404 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.405 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.405 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:27:37.405 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.405 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.405 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:27:37.405 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.405 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.405 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.406 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.406 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.406 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.406 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:27:37.406 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.407 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.407 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:27:37.407 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.407 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.407 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.407 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:27:37.407 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:27:37.407 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:27:37.407 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:27:37.407 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.408 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.408 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.408 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.408 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.408 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:37.408 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:27:37.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.408 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:37.408 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.408 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.409 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.409 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.409 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.409 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:27:37.409 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.409 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:37.409 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.409 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.409 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.410 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.410 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.410 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:27:37.410 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.413 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:37.413 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.413 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.413 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.413 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.413 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.413 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:27:37.414 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.414 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:37.414 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.414 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.414 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.414 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.414 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.414 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:27:37.414 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.415 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:37.415 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.415 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.415 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.415 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.415 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.415 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:27:37.415 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.416 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:37.416 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.416 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.416 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.416 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.416 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.416 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:27:37.416 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.416 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.416 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:37.416 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.417 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.417 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.417 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.417 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.417 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:27:37.417 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.417 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:37.417 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.417 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.417 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.418 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.418 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.418 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:27:37.418 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.418 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.418 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:37.418 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:27:37.418 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:27:37.418 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:27:37.418 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:27:37.418 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:27:37.418 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:27:37.419 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:27:37.419 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:27:37.419 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:27:37.419 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:27:37.419 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:27:37.419 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:27:37.419 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:27:37.419 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.419 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:27:37.420 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:27:37.420 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:27:37.420 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:27:37.420 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:27:37.420 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:27:37.420 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:27:37.420 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:27:37.420 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:27:37.420 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:27:37.420 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:27:37.420 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.420 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:27:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.328+0000 7fc8719c9700 1 -- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc858066f60 msgr2=0x7fc858069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.328+0000 7fc8719c9700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc858066f60 0x7fc858069410 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc86c06ec40 tx=0x7fc85c017000 comp rx=0 tx=0).stop 2023-10-09T06:27:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.328+0000 7fc8719c9700 1 -- 172.21.15.31:0/416677756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc86c159be0 msgr2=0x7fc86c158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.328+0000 7fc8719c9700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc86c159be0 0x7fc86c158070 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc86000e870 tx=0x7fc860008040 comp rx=0 tx=0).stop 2023-10-09T06:27:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.328+0000 7fc8719c9700 1 -- 172.21.15.31:0/416677756 shutdown_connections 2023-10-09T06:27:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.328+0000 7fc8719c9700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc858066f60 0x7fc858069410 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.328+0000 7fc8719c9700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc86c0692f0 0x7fc86c0b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.328+0000 7fc8719c9700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc86c159fb0 0x7fc86c0b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.328+0000 7fc8719c9700 1 --2- 172.21.15.31:0/416677756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc86c159be0 0x7fc86c158070 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.328+0000 7fc8719c9700 1 -- 172.21.15.31:0/416677756 >> 172.21.15.31:0/416677756 conn(0x7fc86c06bc70 msgr2=0x7fc86c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.329+0000 7fc8719c9700 1 -- 172.21.15.31:0/416677756 shutdown_connections 2023-10-09T06:27:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.329+0000 7fc8719c9700 1 -- 172.21.15.31:0/416677756 wait complete. 2023-10-09T06:27:37.424 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-09T06:27:37.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:27:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.542+0000 7f2f2eaa2700 1 Processor -- start 2023-10-09T06:27:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.543+0000 7f2f2eaa2700 1 -- start start 2023-10-09T06:27:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.543+0000 7f2f2eaa2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f281577d0 0x7f2f280cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.543+0000 7f2f2eaa2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2815c360 con 0x7f2f28157ba0 2023-10-09T06:27:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.543+0000 7f2f2eaa2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2815b790 con 0x7f2f2806ac30 2023-10-09T06:27:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.543+0000 7f2f2eaa2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2815ba30 con 0x7f2f281577d0 2023-10-09T06:27:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.543+0000 7f2f27fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2f28157ba0 0x7f2f2806a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48538/0 (socket says 172.21.15.31:48538) 2023-10-09T06:27:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.544+0000 7f2f27fff700 1 -- 172.21.15.31:0/4053452228 learned_addr learned my addr 172.21.15.31:0/4053452228 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.544+0000 7f2f2c83e700 1 --2- 172.21.15.31:0/4053452228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f281577d0 0x7f2f280cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.544+0000 7f2f277fe700 1 -- 172.21.15.31:0/4053452228 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085273987 0 0) 0x7f2f2815c360 con 0x7f2f28157ba0 2023-10-09T06:27:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.544+0000 7f2f277fe700 1 -- 172.21.15.31:0/4053452228 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f14003570 con 0x7f2f28157ba0 2023-10-09T06:27:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.544+0000 7f2f277fe700 1 -- 172.21.15.31:0/4053452228 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113116691 0 0) 0x7f2f2815b790 con 0x7f2f2806ac30 2023-10-09T06:27:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.544+0000 7f2f2c83e700 1 -- 172.21.15.31:0/4053452228 >> v1:172.21.15.158:6789/0 conn(0x7f2f2806ac30 legacy=0x7f2f2815c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.544+0000 7f2f2c83e700 1 -- 172.21.15.31:0/4053452228 >> v1:172.21.15.31:6789/0 conn(0x7f2f28157ba0 legacy=0x7f2f2806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.544+0000 7f2f2c83e700 1 -- 172.21.15.31:0/4053452228 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2815bd10 con 0x7f2f281577d0 2023-10-09T06:27:37.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.544+0000 7f2f2c83e700 1 --2- 172.21.15.31:0/4053452228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f281577d0 0x7f2f280cd770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009910 tx=0x7f2f200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bc57f68b749fde7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:37.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.544+0000 7f2f277fe700 1 -- 172.21.15.31:0/4053452228 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2000b680 con 0x7f2f281577d0 2023-10-09T06:27:37.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.544+0000 7f2f277fe700 1 -- 172.21.15.31:0/4053452228 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2000b7e0 con 0x7f2f281577d0 2023-10-09T06:27:37.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.544+0000 7f2f277fe700 1 -- 172.21.15.31:0/4053452228 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2000bba0 con 0x7f2f281577d0 2023-10-09T06:27:37.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.545+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/4053452228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f281577d0 msgr2=0x7f2f280cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.545+0000 7f2f2eaa2700 1 --2- 172.21.15.31:0/4053452228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f281577d0 0x7f2f280cd770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009910 tx=0x7f2f200091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.545+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/4053452228 shutdown_connections 2023-10-09T06:27:37.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.545+0000 7f2f2eaa2700 1 --2- 172.21.15.31:0/4053452228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f281577d0 0x7f2f280cd770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.545+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/4053452228 >> 172.21.15.31:0/4053452228 conn(0x7f2f28068ce0 msgr2=0x7f2f280690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:37.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.545+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/4053452228 shutdown_connections 2023-10-09T06:27:37.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.545+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/4053452228 wait complete. 2023-10-09T06:27:37.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.546+0000 7f2f2eaa2700 1 Processor -- start 2023-10-09T06:27:37.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.546+0000 7f2f2eaa2700 1 -- start start 2023-10-09T06:27:37.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2eaa2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f2806ac30 0x7f2f2814d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2eaa2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f281577d0 0x7f2f28151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2eaa2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f28157ba0 0x7f2f280b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2eaa2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f28152e90 con 0x7f2f28157ba0 2023-10-09T06:27:37.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2eaa2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f28152280 con 0x7f2f2806ac30 2023-10-09T06:27:37.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2eaa2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f28152560 con 0x7f2f281577d0 2023-10-09T06:27:37.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2d03f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f28157ba0 0x7f2f280b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2d03f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f28157ba0 0x7f2f280b2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57886/0 (socket says 172.21.15.31:57886) 2023-10-09T06:27:37.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2d03f700 1 -- 172.21.15.31:0/1016402548 learned_addr learned my addr 172.21.15.31:0/1016402548 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:37.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2c83e700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f2806ac30 0x7f2f2814d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f27fff700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f281577d0 0x7f2f28151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2d03f700 1 -- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f281577d0 msgr2=0x7f2f28151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2d03f700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f281577d0 0x7f2f28151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2d03f700 1 -- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f2806ac30 msgr2=0x7f2f2814d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2d03f700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f2806ac30 0x7f2f2814d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.547+0000 7f2f2d03f700 1 -- 172.21.15.31:0/1016402548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f20009420 con 0x7f2f28157ba0 2023-10-09T06:27:37.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.548+0000 7f2f2d03f700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f28157ba0 0x7f2f280b2710 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f2f10001eb0 tx=0x7f2f10007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:37.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.548+0000 7f2f24ff9700 1 -- 172.21.15.31:0/1016402548 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10011590 con 0x7f2f28157ba0 2023-10-09T06:27:37.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.548+0000 7f2f24ff9700 1 -- 172.21.15.31:0/1016402548 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f100116f0 con 0x7f2f28157ba0 2023-10-09T06:27:37.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.548+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/1016402548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f28152840 con 0x7f2f28157ba0 2023-10-09T06:27:37.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.548+0000 7f2f24ff9700 1 -- 172.21.15.31:0/1016402548 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10011ab0 con 0x7f2f28157ba0 2023-10-09T06:27:37.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.548+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/1016402548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2814d6f0 con 0x7f2f28157ba0 2023-10-09T06:27:37.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.549+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/1016402548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2804c3c0 con 0x7f2f28157ba0 2023-10-09T06:27:37.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.549+0000 7f2f24ff9700 1 -- 172.21.15.31:0/1016402548 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f1001b3b0 con 0x7f2f28157ba0 2023-10-09T06:27:37.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.550+0000 7f2f24ff9700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f08066f30 0x7f2f080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.550+0000 7f2f24ff9700 1 -- 172.21.15.31:0/1016402548 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f10083ae0 con 0x7f2f28157ba0 2023-10-09T06:27:37.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.550+0000 7f2f2c83e700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f08066f30 0x7f2f080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.550+0000 7f2f2c83e700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f08066f30 0x7f2f080693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2f200093f0 tx=0x7f2f20017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:37.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.554+0000 7f2f24ff9700 1 -- 172.21.15.31:0/1016402548 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f10050d50 con 0x7f2f28157ba0 2023-10-09T06:27:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.748+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/1016402548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2f2815bff0 con 0x7f2f28157ba0 2023-10-09T06:27:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.749+0000 7f2f24ff9700 1 -- 172.21.15.31:0/1016402548 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f2f10017070 con 0x7f2f28157ba0 2023-10-09T06:27:37.750 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:37.750 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:27:37.750 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 139, 2023-10-09T06:27:37.750 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:27:37.750 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:27:37.750 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:27:36.748970+0000", 2023-10-09T06:27:37.750 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:27:37.751 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:27:37.751 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:27:37.751 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:27:37.751 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:27:37.751 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:27:37.751 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:27:37.752 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:27:37.752 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:27:37.752 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:37.752 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:27:37.752 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:27:37.752 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:27:37.752 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:27:37.752 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:27:37.752 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 17, 2023-10-09T06:27:37.752 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:27:37.752 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:27:37.753 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:27:37.753 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:27:37.753 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:27:37.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.753 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:27:37.753 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:27:37.753 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:27:37.754 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:37.754 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:37.754 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:37.754 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:37.754 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:37.755 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:37.755 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:37.755 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:37.755 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:37.755 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:37.756 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:37.756 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:37.756 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:27:37.756 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:27:37.756 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:27:37.756 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:27:37.757 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:27:37.757 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:37.757 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:37.757 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:37.757 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:37.758 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:37.758 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:37.758 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:37.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.758 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:27:37.758 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:37.758 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:37.758 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:37.758 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:37.758 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:37.759 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:37.759 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:37.759 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:37.759 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:37.759 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:37.759 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:37.759 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:37.759 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:37.759 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:37.760 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:37.760 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:37.760 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:37.760 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:37.760 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:37.760 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:37.760 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:37.760 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:37.760 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:37.760 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:37.760 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:37.761 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:37.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.761 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:37.761 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:37.761 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:37.761 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:37.761 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:37.761 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:37.761 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:37.761 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:37.761 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:37.761 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:37.762 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:37.762 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:37.762 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:27:37.762 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:27:37.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.762 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:37.762 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:27:37.762 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.763 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 16, 2023-10-09T06:27:37.763 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:27:37.763 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.232021+0000", 2023-10-09T06:27:37.763 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:37.763 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:37.763 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:37.763 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:37.763 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:37.764 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:37.764 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:37.764 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:37.764 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:37.764 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:37.764 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:37.764 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:37.764 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:27:37.764 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:27:37.764 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:27:37.765 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:27:37.765 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:27:37.765 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:37.765 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:37.765 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:37.765 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:37.765 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:37.765 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:37.765 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:37.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.765 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "135", 2023-10-09T06:27:37.765 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:37.766 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:37.766 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:37.766 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:37.766 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:37.766 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:37.766 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:37.766 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:37.766 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:37.766 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:27:37.767 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:37.767 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:37.767 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:37.767 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:37.767 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:37.767 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:37.767 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:37.767 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:37.767 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:37.768 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:37.768 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:37.768 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:37.768 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:37.768 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:37.768 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:37.768 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:37.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.768 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:37.768 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:37.768 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:37.768 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:37.769 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:37.769 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:37.769 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:37.769 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:37.769 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:37.769 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:37.769 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:37.769 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:37.769 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:27:37.769 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:27:37.769 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:27:37.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.770 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:37.770 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:37.770 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:27:37.770 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.770 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.770 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 17, 2023-10-09T06:27:37.770 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:27:37.770 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:27:06.742407+0000", 2023-10-09T06:27:37.770 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:27:37.771 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:27:37.771 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:27:37.771 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:27:37.771 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:27:37.771 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:27:37.771 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:27:37.771 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:27:37.771 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:27:37.771 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:27:37.771 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:27:37.771 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:27:37.772 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:27:37.772 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:27:37.772 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:27:37.772 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:27:37.772 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:27:37.772 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:27:37.772 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:27:37.772 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:27:37.772 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:27:37.772 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:27:37.772 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:27:37.772 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:27:37.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.773 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "139", 2023-10-09T06:27:37.773 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:27:37.773 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:27:37.773 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:27:37.773 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:27:37.773 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:27:37.773 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:27:37.773 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:27:37.773 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:27:37.773 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:27:37.774 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:27:37.774 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:27:37.774 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:27:37.774 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:27:37.774 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:27:37.774 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:27:37.774 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:27:37.774 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:27:37.774 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:27:37.774 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:27:37.774 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:27:37.774 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:27:37.775 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:27:37.775 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:27:37.775 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:27:37.775 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:27:37.775 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:27:37.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.775 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:27:37.775 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:27:37.775 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:27:37.775 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:27:37.775 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:27:37.776 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:27:37.776 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:27:37.776 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:27:37.776 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:27:37.776 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:27:37.776 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:27:37.776 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:27:37.776 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:27:37.776 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:27:37.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.776 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:27:37.777 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:27:37.777 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:27:37.777 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.777 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.777 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.777 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:37.777 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:27:37.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.777 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:37.777 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.777 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.778 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.778 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.778 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.778 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.778 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.778 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.778 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.778 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.778 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.778 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.778 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:27:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:27:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.780 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.780 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.780 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.780 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:27:37.780 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.780 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.780 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:27:37.781 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.781 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.781 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.781 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.781 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.781 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.781 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:27:37.781 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.782 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.782 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:27:37.782 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.782 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.782 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.782 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.782 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.783 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.783 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:27:37.783 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.783 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.783 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:27:37.783 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:27:37.783 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.783 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.783 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:27:37.784 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:27:37.784 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:27:37.784 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:27:37.784 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.784 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.784 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.784 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.784 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:37.785 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.785 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.785 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.785 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.785 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.785 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.785 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.785 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.785 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.785 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.785 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.785 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:27:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:27:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.786 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:27:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.787 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:27:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:27:37.788 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:27:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:27:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:27:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:27:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.790 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:27:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:27:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:27:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:27:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.792 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:27:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.793 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:27:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.794 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:27:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:27:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.795 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:27:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:27:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:27:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:27:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:27:37.797 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:27:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:27:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:27:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:27:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.799 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:27:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:27:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.800 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:27:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.801 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:27:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:27:37.802 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:27:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.803 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:27:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:27:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:27:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.804 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:27:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:27:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:27:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:27:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:37.805 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.806 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:27:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:27:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.807 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:27:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:27:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:27:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:27:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:27:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:27:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:27:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:27:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:27:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:27:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:27:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:37.812 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.813 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:27:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:27:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:27:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:27:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.815 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:27:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.816 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:27:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:27:37.817 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:27:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:27:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:27:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:27:37.818 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:27:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:27:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.820 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:27:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:27:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:27:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:27:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:27:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:27:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:27:37.824 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:27:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:27:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:27:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:27:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.825 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:27:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:27:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:27:37.826 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:27:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:27:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:27:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:27:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:27:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 134, 2023-10-09T06:27:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:27:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:27:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:27:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:27:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:27:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.828 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:27:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:27:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:27:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:27:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:27:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:27:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.831 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:27:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:27:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:27:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:27:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.832 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:27:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:27:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:27:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:27:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:27:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:27:37.833 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:27:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:27:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:27:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:27:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:27:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:27:37.834 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:27:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:27:37.835 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:27:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:27:37.836 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:27:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:27:37.837 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:27:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.838 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:27:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:27:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.839 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:27:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:27:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.840 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:27:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:27:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:37.841 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:27:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:27:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:27:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:27:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:27:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:27:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:27:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:27:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.842 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:27:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:27:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:27:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:27:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:27:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:27:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:27:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:27:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:27:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:27:37.843 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:27:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:27:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:27:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:27:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:27:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:27:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:27:37.844 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:27:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:27:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:27:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:27:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:27:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:27:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:27:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:27:37.845 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:27:37.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.751+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f08066f30 msgr2=0x7f2f080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.751+0000 7f2f2eaa2700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f08066f30 0x7f2f080693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2f200093f0 tx=0x7f2f20017000 comp rx=0 tx=0).stop 2023-10-09T06:27:37.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.751+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/1016402548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f28157ba0 msgr2=0x7f2f280b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.751+0000 7f2f2eaa2700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f28157ba0 0x7f2f280b2710 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f2f10001eb0 tx=0x7f2f10007d40 comp rx=0 tx=0).stop 2023-10-09T06:27:37.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.751+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/1016402548 shutdown_connections 2023-10-09T06:27:37.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.751+0000 7f2f2eaa2700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f08066f30 0x7f2f080693e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.751+0000 7f2f2eaa2700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f28157ba0 0x7f2f280b2710 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.751+0000 7f2f2eaa2700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f2806ac30 0x7f2f2814d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.751+0000 7f2f2eaa2700 1 --2- 172.21.15.31:0/1016402548 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f281577d0 0x7f2f28151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.751+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/1016402548 >> 172.21.15.31:0/1016402548 conn(0x7f2f28068ce0 msgr2=0x7f2f280d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:37.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.751+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/1016402548 shutdown_connections 2023-10-09T06:27:37.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.751+0000 7f2f2eaa2700 1 -- 172.21.15.31:0/1016402548 wait complete. 2023-10-09T06:27:37.849 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:27:37.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.968+0000 7f3c6205c700 1 Processor -- start 2023-10-09T06:27:37.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.968+0000 7f3c6205c700 1 -- start start 2023-10-09T06:27:37.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.969+0000 7f3c6205c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3c5c06adb0 0x7f3c5c164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.969+0000 7f3c6205c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c0b3d40 con 0x7f3c5c0cffa0 2023-10-09T06:27:37.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.969+0000 7f3c6205c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c0b4300 con 0x7f3c5c159e60 2023-10-09T06:27:37.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.969+0000 7f3c6205c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c069d70 con 0x7f3c5c06adb0 2023-10-09T06:27:37.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.969+0000 7f3c5affd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3c5c0cffa0 0x7f3c5c06a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48546/0 (socket says 172.21.15.31:48546) 2023-10-09T06:27:37.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.969+0000 7f3c5affd700 1 -- 172.21.15.31:0/1995165911 learned_addr learned my addr 172.21.15.31:0/1995165911 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:37.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.969+0000 7f3c5bfff700 1 --2- 172.21.15.31:0/1995165911 >> v2:172.21.15.31:3300/0 conn(0x7f3c5c06adb0 0x7f3c5c164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.970+0000 7f3c5a7fc700 1 -- 172.21.15.31:0/1995165911 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375076711 0 0) 0x7f3c5c0b3d40 con 0x7f3c5c0cffa0 2023-10-09T06:27:37.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.970+0000 7f3c5a7fc700 1 -- 172.21.15.31:0/1995165911 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c44003570 con 0x7f3c5c0cffa0 2023-10-09T06:27:37.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.970+0000 7f3c5bfff700 1 -- 172.21.15.31:0/1995165911 >> v1:172.21.15.158:6789/0 conn(0x7f3c5c159e60 legacy=0x7f3c5c0b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:37.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.970+0000 7f3c5bfff700 1 -- 172.21.15.31:0/1995165911 >> v1:172.21.15.31:6789/0 conn(0x7f3c5c0cffa0 legacy=0x7f3c5c06a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.970+0000 7f3c5bfff700 1 -- 172.21.15.31:0/1995165911 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c0d0480 con 0x7f3c5c06adb0 2023-10-09T06:27:37.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.970+0000 7f3c5bfff700 1 --2- 172.21.15.31:0/1995165911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5c06adb0 0x7f3c5c164ca0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009e60 tx=0x7f3c54009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36545850dd93b571 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:37.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.970+0000 7f3c5a7fc700 1 -- 172.21.15.31:0/1995165911 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400e070 con 0x7f3c5c06adb0 2023-10-09T06:27:37.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.970+0000 7f3c5a7fc700 1 -- 172.21.15.31:0/1995165911 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5400bb20 con 0x7f3c5c06adb0 2023-10-09T06:27:37.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.970+0000 7f3c5a7fc700 1 -- 172.21.15.31:0/1995165911 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54012430 con 0x7f3c5c06adb0 2023-10-09T06:27:37.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.970+0000 7f3c6205c700 1 -- 172.21.15.31:0/1995165911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5c06adb0 msgr2=0x7f3c5c164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.970+0000 7f3c6205c700 1 --2- 172.21.15.31:0/1995165911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5c06adb0 0x7f3c5c164ca0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009e60 tx=0x7f3c54009780 comp rx=0 tx=0).stop 2023-10-09T06:27:37.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.971+0000 7f3c6205c700 1 -- 172.21.15.31:0/1995165911 shutdown_connections 2023-10-09T06:27:37.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.971+0000 7f3c6205c700 1 --2- 172.21.15.31:0/1995165911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5c06adb0 0x7f3c5c164ca0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.971+0000 7f3c6205c700 1 -- 172.21.15.31:0/1995165911 >> 172.21.15.31:0/1995165911 conn(0x7f3c5c0d1a50 msgr2=0x7f3c5c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:37.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.971+0000 7f3c6205c700 1 -- 172.21.15.31:0/1995165911 shutdown_connections 2023-10-09T06:27:37.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.971+0000 7f3c6205c700 1 -- 172.21.15.31:0/1995165911 wait complete. 2023-10-09T06:27:37.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.972+0000 7f3c6205c700 1 Processor -- start 2023-10-09T06:27:37.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.972+0000 7f3c6205c700 1 -- start start 2023-10-09T06:27:37.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c6205c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5c06adb0 0x7f3c5c146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c6205c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c5c0cffa0 0x7f3c5c0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c6205c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c5c159e60 0x7f3c5c0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c6205c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c147720 con 0x7f3c5c06adb0 2023-10-09T06:27:37.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c6205c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c146b10 con 0x7f3c5c0cffa0 2023-10-09T06:27:37.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c6205c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c146df0 con 0x7f3c5c159e60 2023-10-09T06:27:37.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c5b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5c06adb0 0x7f3c5c146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c5b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5c06adb0 0x7f3c5c146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57896/0 (socket says 172.21.15.31:57896) 2023-10-09T06:27:37.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c5b7fe700 1 -- 172.21.15.31:0/982793247 learned_addr learned my addr 172.21.15.31:0/982793247 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:37.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c5bfff700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c5c159e60 0x7f3c5c0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c5affd700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c5c0cffa0 0x7f3c5c0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c5b7fe700 1 -- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c5c159e60 msgr2=0x7f3c5c0b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c5b7fe700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c5c159e60 0x7f3c5c0b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c5b7fe700 1 -- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c5c0cffa0 msgr2=0x7f3c5c0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:37.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c5b7fe700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c5c0cffa0 0x7f3c5c0b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:37.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c5b7fe700 1 -- 172.21.15.31:0/982793247 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c54009a20 con 0x7f3c5c06adb0 2023-10-09T06:27:37.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c5affd700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c5c0cffa0 0x7f3c5c0b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:37.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c5bfff700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c5c159e60 0x7f3c5c0b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:37.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c5b7fe700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5c06adb0 0x7f3c5c146450 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00b5e0 tx=0x7f3c4c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:37.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c437fe700 1 -- 172.21.15.31:0/982793247 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00f510 con 0x7f3c5c06adb0 2023-10-09T06:27:37.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c437fe700 1 -- 172.21.15.31:0/982793247 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c00f670 con 0x7f3c5c06adb0 2023-10-09T06:27:37.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c6205c700 1 -- 172.21.15.31:0/982793247 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c1470d0 con 0x7f3c5c06adb0 2023-10-09T06:27:37.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c437fe700 1 -- 172.21.15.31:0/982793247 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00fa30 con 0x7f3c5c06adb0 2023-10-09T06:27:37.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.973+0000 7f3c6205c700 1 -- 172.21.15.31:0/982793247 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c15b680 con 0x7f3c5c06adb0 2023-10-09T06:27:37.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.974+0000 7f3c6205c700 1 -- 172.21.15.31:0/982793247 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c159510 con 0x7f3c5c06adb0 2023-10-09T06:27:37.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.975+0000 7f3c437fe700 1 -- 172.21.15.31:0/982793247 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c4c01a400 con 0x7f3c5c06adb0 2023-10-09T06:27:37.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.975+0000 7f3c437fe700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c48066f30 0x7f3c480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:37.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.975+0000 7f3c437fe700 1 -- 172.21.15.31:0/982793247 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c4c084060 con 0x7f3c5c06adb0 2023-10-09T06:27:37.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.975+0000 7f3c5affd700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c48066f30 0x7f3c480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:37.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.976+0000 7f3c5affd700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c48066f30 0x7f3c480693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c149550 tx=0x7f3c50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:37.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:37.979+0000 7f3c437fe700 1 -- 172.21.15.31:0/982793247 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c4c051350 con 0x7f3c5c06adb0 2023-10-09T06:27:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.215+0000 7f3c6205c700 1 -- 172.21.15.31:0/982793247 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c5c156400 con 0x7f3c5c06adb0 2023-10-09T06:27:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.215+0000 7f3c437fe700 1 -- 172.21.15.31:0/982793247 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f3c4c054970 con 0x7f3c5c06adb0 2023-10-09T06:27:38.216 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:38.216 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/1232957657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1232957657},{"type":"v1","addr":"172.21.15.158:6836","nonce":1232957657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2947695434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2947695434},{"type":"v1","addr":"172.21.15.158:6837","nonce":2947695434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/912397379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":912397379},{"type":"v1","addr":"172.21.15.31:6834","nonce":912397379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:07.779885+0000","modified":"2023-10-09T06:27:12.402382+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7005},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7005":{"gid":7005,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1684509217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1684509217},{"type":"v1","addr":"172.21.15.31:6835","nonce":1684509217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T06:27:38.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.218+0000 7f3c6205c700 1 -- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c48066f30 msgr2=0x7f3c480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.218+0000 7f3c6205c700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c48066f30 0x7f3c480693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c149550 tx=0x7f3c50009040 comp rx=0 tx=0).stop 2023-10-09T06:27:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.218+0000 7f3c6205c700 1 -- 172.21.15.31:0/982793247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5c06adb0 msgr2=0x7f3c5c146450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.218+0000 7f3c6205c700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5c06adb0 0x7f3c5c146450 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00b5e0 tx=0x7f3c4c009120 comp rx=0 tx=0).stop 2023-10-09T06:27:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.218+0000 7f3c6205c700 1 -- 172.21.15.31:0/982793247 shutdown_connections 2023-10-09T06:27:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.218+0000 7f3c6205c700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3c48066f30 0x7f3c480693e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.218+0000 7f3c6205c700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3c5c159e60 0x7f3c5c0b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.218+0000 7f3c6205c700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5c06adb0 0x7f3c5c146450 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.218+0000 7f3c6205c700 1 --2- 172.21.15.31:0/982793247 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3c5c0cffa0 0x7f3c5c0b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.218+0000 7f3c6205c700 1 -- 172.21.15.31:0/982793247 >> 172.21.15.31:0/982793247 conn(0x7f3c5c0d1a50 msgr2=0x7f3c5c06a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.218+0000 7f3c6205c700 1 -- 172.21.15.31:0/982793247 shutdown_connections 2023-10-09T06:27:38.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:38.218+0000 7f3c6205c700 1 -- 172.21.15.31:0/982793247 wait complete. 2023-10-09T06:27:38.220 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 66 2023-10-09T06:27:38.230 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-09T06:27:38.369 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":7005,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":29.987615892000001,"mdsmap_epoch":66,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":35.050092839000001} 2023-10-09T06:27:38.369 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 7005, "mdsmap_epoch": 66, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 29.987615892, "state": "up:active", "uptime": 35.050092839, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:27:38.370 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T06:27:38.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:27:38.370 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-09T06:27:38.654 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records in 2023-10-09T06:27:38.654 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records out 2023-10-09T06:27:38.654 INFO:teuthology.orchestra.run.smithi031.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.265653 s, 197 MB/s 2023-10-09T06:27:38.655 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:27:38.655 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:27:38.706 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:27:38.750 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:27:38.750 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:27:38.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:27:38.751 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:27:38.808 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:27:38.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:38.809 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:27:38.832 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T06:27:38.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:27:38.832 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T06:27:38.874 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:27:38.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:27:38.874 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T06:27:38.928 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:27:39.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.047+0000 7f1eedec8700 1 Processor -- start 2023-10-09T06:27:39.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.048+0000 7f1eedec8700 1 -- start start 2023-10-09T06:27:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.048+0000 7f1eedec8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ee815a1e0 0x7f1ee80cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.048+0000 7f1eedec8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee815db80 con 0x7f1ee8159e10 2023-10-09T06:27:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.048+0000 7f1eedec8700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee815de60 con 0x7f1ee80b3430 2023-10-09T06:27:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.048+0000 7f1eedec8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee815e800 con 0x7f1ee815a1e0 2023-10-09T06:27:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.048+0000 7f1ee77fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1ee8159e10 0x7f1ee80b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48554/0 (socket says 172.21.15.31:48554) 2023-10-09T06:27:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.048+0000 7f1ee77fe700 1 -- 172.21.15.31:0/3628281216 learned_addr learned my addr 172.21.15.31:0/3628281216 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.048+0000 7f1ee6ffd700 1 --2- 172.21.15.31:0/3628281216 >> v2:172.21.15.31:3300/0 conn(0x7f1ee815a1e0 0x7f1ee80cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.049+0000 7f1ee67fc700 1 -- 172.21.15.31:0/3628281216 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099103972 0 0) 0x7f1ee815db80 con 0x7f1ee8159e10 2023-10-09T06:27:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.049+0000 7f1ee67fc700 1 -- 172.21.15.31:0/3628281216 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed0003570 con 0x7f1ee8159e10 2023-10-09T06:27:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.049+0000 7f1ee6ffd700 1 -- 172.21.15.31:0/3628281216 >> v1:172.21.15.158:6789/0 conn(0x7f1ee80b3430 legacy=0x7f1ee80cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.049+0000 7f1ee6ffd700 1 -- 172.21.15.31:0/3628281216 >> v1:172.21.15.31:6789/0 conn(0x7f1ee8159e10 legacy=0x7f1ee80b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.049+0000 7f1ee6ffd700 1 -- 172.21.15.31:0/3628281216 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee815e140 con 0x7f1ee815a1e0 2023-10-09T06:27:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.049+0000 7f1ee6ffd700 1 --2- 172.21.15.31:0/3628281216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ee815a1e0 0x7f1ee80cd740 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0098e0 tx=0x7f1edc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72dcb0d0224a1c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.049+0000 7f1ee67fc700 1 -- 172.21.15.31:0/3628281216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc00b640 con 0x7f1ee815a1e0 2023-10-09T06:27:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.049+0000 7f1ee67fc700 1 -- 172.21.15.31:0/3628281216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1edc00b7a0 con 0x7f1ee815a1e0 2023-10-09T06:27:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.049+0000 7f1ee67fc700 1 -- 172.21.15.31:0/3628281216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc00bb40 con 0x7f1ee815a1e0 2023-10-09T06:27:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.050+0000 7f1eedec8700 1 -- 172.21.15.31:0/3628281216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ee815a1e0 msgr2=0x7f1ee80cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.050+0000 7f1eedec8700 1 --2- 172.21.15.31:0/3628281216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ee815a1e0 0x7f1ee80cd740 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0098e0 tx=0x7f1edc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.050+0000 7f1eedec8700 1 -- 172.21.15.31:0/3628281216 shutdown_connections 2023-10-09T06:27:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.050+0000 7f1eedec8700 1 --2- 172.21.15.31:0/3628281216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ee815a1e0 0x7f1ee80cd740 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.050+0000 7f1eedec8700 1 -- 172.21.15.31:0/3628281216 >> 172.21.15.31:0/3628281216 conn(0x7f1ee8067660 msgr2=0x7f1ee8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.050+0000 7f1eedec8700 1 -- 172.21.15.31:0/3628281216 shutdown_connections 2023-10-09T06:27:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.050+0000 7f1eedec8700 1 -- 172.21.15.31:0/3628281216 wait complete. 2023-10-09T06:27:39.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.051+0000 7f1eedec8700 1 Processor -- start 2023-10-09T06:27:39.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.051+0000 7f1eedec8700 1 -- start start 2023-10-09T06:27:39.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1eedec8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ee80b3430 0x7f1ee80c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1eedec8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ee8159e10 0x7f1ee80ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1eedec8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ee815a1e0 0x7f1ee814b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1eedec8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee80cfc90 con 0x7f1ee815a1e0 2023-10-09T06:27:39.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1eedec8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee80cedb0 con 0x7f1ee80b3430 2023-10-09T06:27:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1eedec8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee80cf080 con 0x7f1ee8159e10 2023-10-09T06:27:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1ee7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ee815a1e0 0x7f1ee814b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1ee7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ee815a1e0 0x7f1ee814b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57916/0 (socket says 172.21.15.31:57916) 2023-10-09T06:27:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1ee7fff700 1 -- 172.21.15.31:0/2171701843 learned_addr learned my addr 172.21.15.31:0/2171701843 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1ee6ffd700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ee8159e10 0x7f1ee80ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1ee77fe700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ee80b3430 0x7f1ee80c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1ee7fff700 1 -- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ee8159e10 msgr2=0x7f1ee80ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1ee7fff700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ee8159e10 0x7f1ee80ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1ee7fff700 1 -- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ee80b3430 msgr2=0x7f1ee80c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1ee7fff700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ee80b3430 0x7f1ee80c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1ee7fff700 1 -- 172.21.15.31:0/2171701843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc009420 con 0x7f1ee815a1e0 2023-10-09T06:27:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.052+0000 7f1ee7fff700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ee815a1e0 0x7f1ee814b1f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000c8e0 tx=0x7f1ee0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.053+0000 7f1ecf7fe700 1 -- 172.21.15.31:0/2171701843 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0012630 con 0x7f1ee815a1e0 2023-10-09T06:27:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.053+0000 7f1ecf7fe700 1 -- 172.21.15.31:0/2171701843 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee0012790 con 0x7f1ee815a1e0 2023-10-09T06:27:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.053+0000 7f1eedec8700 1 -- 172.21.15.31:0/2171701843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee80cf360 con 0x7f1ee815a1e0 2023-10-09T06:27:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.053+0000 7f1ecf7fe700 1 -- 172.21.15.31:0/2171701843 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0012b50 con 0x7f1ee815a1e0 2023-10-09T06:27:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.053+0000 7f1eedec8700 1 -- 172.21.15.31:0/2171701843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee80cf920 con 0x7f1ee815a1e0 2023-10-09T06:27:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.053+0000 7f1eedec8700 1 -- 172.21.15.31:0/2171701843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee80cfe00 con 0x7f1ee815a1e0 2023-10-09T06:27:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.054+0000 7f1ecf7fe700 1 -- 172.21.15.31:0/2171701843 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ee001a3a0 con 0x7f1ee815a1e0 2023-10-09T06:27:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.054+0000 7f1ecf7fe700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ed4066f60 0x7f1ed4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.054+0000 7f1ecf7fe700 1 -- 172.21.15.31:0/2171701843 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ee00847a0 con 0x7f1ee815a1e0 2023-10-09T06:27:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.054+0000 7f1ee77fe700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ed4066f60 0x7f1ed4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.055+0000 7f1ee77fe700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ed4066f60 0x7f1ed4069410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8007fd0 tx=0x7f1ed8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:39.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.059+0000 7f1ecf7fe700 1 -- 172.21.15.31:0/2171701843 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ee0051a10 con 0x7f1ee815a1e0 2023-10-09T06:27:39.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.299+0000 7f1eedec8700 1 -- 172.21.15.31:0/2171701843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ee804c3c0 con 0x7f1ee815a1e0 2023-10-09T06:27:39.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.299+0000 7f1ecf7fe700 1 -- 172.21.15.31:0/2171701843 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f1ee0055030 con 0x7f1ee815a1e0 2023-10-09T06:27:39.300 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:39.300 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/1232957657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1232957657},{"type":"v1","addr":"172.21.15.158:6836","nonce":1232957657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2947695434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2947695434},{"type":"v1","addr":"172.21.15.158:6837","nonce":2947695434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/912397379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":912397379},{"type":"v1","addr":"172.21.15.31:6834","nonce":912397379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:07.779885+0000","modified":"2023-10-09T06:27:12.402382+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7005},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7005":{"gid":7005,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1684509217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1684509217},{"type":"v1","addr":"172.21.15.31:6835","nonce":1684509217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T06:27:39.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.301+0000 7f1eedec8700 1 -- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ed4066f60 msgr2=0x7f1ed4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.301+0000 7f1eedec8700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ed4066f60 0x7f1ed4069410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8007fd0 tx=0x7f1ed8009040 comp rx=0 tx=0).stop 2023-10-09T06:27:39.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.301+0000 7f1eedec8700 1 -- 172.21.15.31:0/2171701843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ee815a1e0 msgr2=0x7f1ee814b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.301+0000 7f1eedec8700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ee815a1e0 0x7f1ee814b1f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000c8e0 tx=0x7f1ee0001710 comp rx=0 tx=0).stop 2023-10-09T06:27:39.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.301+0000 7f1eedec8700 1 -- 172.21.15.31:0/2171701843 shutdown_connections 2023-10-09T06:27:39.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.301+0000 7f1eedec8700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1ed4066f60 0x7f1ed4069410 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.301+0000 7f1eedec8700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ee815a1e0 0x7f1ee814b1f0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.301+0000 7f1eedec8700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1ee80b3430 0x7f1ee80c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.301+0000 7f1eedec8700 1 --2- 172.21.15.31:0/2171701843 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1ee8159e10 0x7f1ee80ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.301+0000 7f1eedec8700 1 -- 172.21.15.31:0/2171701843 >> 172.21.15.31:0/2171701843 conn(0x7f1ee8067660 msgr2=0x7f1ee815a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:39.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.301+0000 7f1eedec8700 1 -- 172.21.15.31:0/2171701843 shutdown_connections 2023-10-09T06:27:39.303 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.301+0000 7f1eedec8700 1 -- 172.21.15.31:0/2171701843 wait complete. 2023-10-09T06:27:39.304 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 66 2023-10-09T06:27:39.314 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:27:39.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.434+0000 7fe925491700 1 Processor -- start 2023-10-09T06:27:39.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.434+0000 7fe925491700 1 -- start start 2023-10-09T06:27:39.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.435+0000 7fe925491700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe9200c8c00 0x7fe920158230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.435+0000 7fe925491700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9201591f0 con 0x7fe920155710 2023-10-09T06:27:39.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.435+0000 7fe925491700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe920069cb0 con 0x7fe92015be30 2023-10-09T06:27:39.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.435+0000 7fe925491700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe920158770 con 0x7fe9200c8c00 2023-10-09T06:27:39.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.435+0000 7fe91effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe920155710 0x7fe9200695a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48560/0 (socket says 172.21.15.31:48560) 2023-10-09T06:27:39.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.435+0000 7fe91e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe9200c8c00 0x7fe920158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.435+0000 7fe91effd700 1 -- 172.21.15.31:0/2964269613 learned_addr learned my addr 172.21.15.31:0/2964269613 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:39.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.436+0000 7fe91e7fc700 1 -- 172.21.15.31:0/2964269613 >> v1:172.21.15.158:6789/0 conn(0x7fe92015be30 legacy=0x7fe92015c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.436+0000 7fe91e7fc700 1 -- 172.21.15.31:0/2964269613 >> v1:172.21.15.31:6789/0 conn(0x7fe920155710 legacy=0x7fe9200695a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.436+0000 7fe91e7fc700 1 -- 172.21.15.31:0/2964269613 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe920158950 con 0x7fe9200c8c00 2023-10-09T06:27:39.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.436+0000 7fe91dffb700 1 -- 172.21.15.31:0/2964269613 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945298670 0 0) 0x7fe9201591f0 con 0x7fe920155710 2023-10-09T06:27:39.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.436+0000 7fe91e7fc700 1 --2- 172.21.15.31:0/2964269613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9200c8c00 0x7fe920158230 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe9080098e0 tx=0x7fe9080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a121fcd6f850ef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:39.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.436+0000 7fe91dffb700 1 -- 172.21.15.31:0/2964269613 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908009e80 con 0x7fe9200c8c00 2023-10-09T06:27:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.436+0000 7fe91dffb700 1 -- 172.21.15.31:0/2964269613 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90800b860 con 0x7fe9200c8c00 2023-10-09T06:27:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.436+0000 7fe91dffb700 1 -- 172.21.15.31:0/2964269613 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90800bbe0 con 0x7fe9200c8c00 2023-10-09T06:27:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.437+0000 7fe925491700 1 -- 172.21.15.31:0/2964269613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9200c8c00 msgr2=0x7fe920158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.437+0000 7fe925491700 1 --2- 172.21.15.31:0/2964269613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9200c8c00 0x7fe920158230 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe9080098e0 tx=0x7fe9080091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.437+0000 7fe925491700 1 -- 172.21.15.31:0/2964269613 shutdown_connections 2023-10-09T06:27:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.437+0000 7fe925491700 1 --2- 172.21.15.31:0/2964269613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9200c8c00 0x7fe920158230 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.437+0000 7fe925491700 1 -- 172.21.15.31:0/2964269613 >> 172.21.15.31:0/2964269613 conn(0x7fe9200cd200 msgr2=0x7fe9200cd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.437+0000 7fe925491700 1 -- 172.21.15.31:0/2964269613 shutdown_connections 2023-10-09T06:27:39.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.437+0000 7fe925491700 1 -- 172.21.15.31:0/2964269613 wait complete. 2023-10-09T06:27:39.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.438+0000 7fe925491700 1 Processor -- start 2023-10-09T06:27:39.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.438+0000 7fe925491700 1 -- start start 2023-10-09T06:27:39.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe925491700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9200c8c00 0x7fe92009a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe925491700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe920155710 0x7fe9200c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe925491700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe92015be30 0x7fe920168c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe925491700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe920168500 con 0x7fe920155710 2023-10-09T06:27:39.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe925491700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200aad80 con 0x7fe92015be30 2023-10-09T06:27:39.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe925491700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200aafd0 con 0x7fe9200c8c00 2023-10-09T06:27:39.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe91e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe920155710 0x7fe9200c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe91e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe920155710 0x7fe9200c6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57932/0 (socket says 172.21.15.31:57932) 2023-10-09T06:27:39.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe91e7fc700 1 -- 172.21.15.31:0/1534536411 learned_addr learned my addr 172.21.15.31:0/1534536411 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:39.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe91effd700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9200c8c00 0x7fe92009a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe91f7fe700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe92015be30 0x7fe920168c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe91e7fc700 1 -- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9200c8c00 msgr2=0x7fe92009a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe91e7fc700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9200c8c00 0x7fe92009a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe91e7fc700 1 -- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe92015be30 msgr2=0x7fe920168c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe91e7fc700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe92015be30 0x7fe920168c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe91e7fc700 1 -- 172.21.15.31:0/1534536411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe908009420 con 0x7fe920155710 2023-10-09T06:27:39.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe91e7fc700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe920155710 0x7fe9200c6bf0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe90800b3c0 tx=0x7fe908017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:39.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe916ffd700 1 -- 172.21.15.31:0/1534536411 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90801f070 con 0x7fe920155710 2023-10-09T06:27:39.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe916ffd700 1 -- 172.21.15.31:0/1534536411 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe908000c90 con 0x7fe920155710 2023-10-09T06:27:39.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe925491700 1 -- 172.21.15.31:0/1534536411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9200ab2b0 con 0x7fe920155710 2023-10-09T06:27:39.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.439+0000 7fe916ffd700 1 -- 172.21.15.31:0/1534536411 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908025420 con 0x7fe920155710 2023-10-09T06:27:39.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.440+0000 7fe925491700 1 -- 172.21.15.31:0/1534536411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9201686f0 con 0x7fe920155710 2023-10-09T06:27:39.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.440+0000 7fe925491700 1 -- 172.21.15.31:0/1534536411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9200ab7d0 con 0x7fe920155710 2023-10-09T06:27:39.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.441+0000 7fe916ffd700 1 -- 172.21.15.31:0/1534536411 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe908023070 con 0x7fe920155710 2023-10-09T06:27:39.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.441+0000 7fe916ffd700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe900066f30 0x7fe9000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.441+0000 7fe916ffd700 1 -- 172.21.15.31:0/1534536411 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe908085990 con 0x7fe920155710 2023-10-09T06:27:39.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.441+0000 7fe91effd700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe900066f30 0x7fe9000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.442+0000 7fe91effd700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe900066f30 0x7fe9000693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe910007fd0 tx=0x7fe910007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:39.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.445+0000 7fe916ffd700 1 -- 172.21.15.31:0/1534536411 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9200ab7d0 con 0x7fe920155710 2023-10-09T06:27:39.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.639+0000 7fe925491700 1 -- 172.21.15.31:0/1534536411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9200ab7d0 con 0x7fe920155710 2023-10-09T06:27:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.640+0000 7fe916ffd700 1 -- 172.21.15.31:0/1534536411 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+15372 (secure 0 0 0) 0x7fe9200ab7d0 con 0x7fe920155710 2023-10-09T06:27:39.641 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:39.641 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":139,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:27:36.748970+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:27:06.232021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T06:27:06.742407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:27:39.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.642+0000 7fe925491700 1 -- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe900066f30 msgr2=0x7fe9000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.642+0000 7fe925491700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe900066f30 0x7fe9000693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe910007fd0 tx=0x7fe910007d10 comp rx=0 tx=0).stop 2023-10-09T06:27:39.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.642+0000 7fe925491700 1 -- 172.21.15.31:0/1534536411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe920155710 msgr2=0x7fe9200c6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.642+0000 7fe925491700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe920155710 0x7fe9200c6bf0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe90800b3c0 tx=0x7fe908017000 comp rx=0 tx=0).stop 2023-10-09T06:27:39.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.642+0000 7fe925491700 1 -- 172.21.15.31:0/1534536411 shutdown_connections 2023-10-09T06:27:39.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.642+0000 7fe925491700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe900066f30 0x7fe9000693e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.642+0000 7fe925491700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9200c8c00 0x7fe92009a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.642+0000 7fe925491700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe92015be30 0x7fe920168c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.642+0000 7fe925491700 1 --2- 172.21.15.31:0/1534536411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe920155710 0x7fe9200c6bf0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.642+0000 7fe925491700 1 -- 172.21.15.31:0/1534536411 >> 172.21.15.31:0/1534536411 conn(0x7fe9200cd200 msgr2=0x7fe920157fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.642+0000 7fe925491700 1 -- 172.21.15.31:0/1534536411 shutdown_connections 2023-10-09T06:27:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.642+0000 7fe925491700 1 -- 172.21.15.31:0/1534536411 wait complete. 2023-10-09T06:27:39.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:27:06.232021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:27:06.742407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:27:39.655 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:27:39.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.776+0000 7fce83302700 1 Processor -- start 2023-10-09T06:27:39.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.776+0000 7fce83302700 1 -- start start 2023-10-09T06:27:39.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.777+0000 7fce83302700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fce7c0cbf10 0x7fce7c15e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.777+0000 7fce83302700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce7c0c9390 0x7fce7c15a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.777+0000 7fce83302700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c0cae70 con 0x7fce7c0678b0 2023-10-09T06:27:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.777+0000 7fce83302700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7c0cb150 con 0x7fce7c0cbf10 2023-10-09T06:27:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.777+0000 7fce83302700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0cb430 con 0x7fce7c0c9390 2023-10-09T06:27:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.777+0000 7fce8109e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fce7c0678b0 0x7fce7c15db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45994/0 (socket says 172.21.15.31:45994) 2023-10-09T06:27:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.777+0000 7fce8109e700 1 -- 172.21.15.31:0/2905628865 learned_addr learned my addr 172.21.15.31:0/2905628865 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.777+0000 7fce8089d700 1 --2- 172.21.15.31:0/2905628865 >> v2:172.21.15.158:3300/0 conn(0x7fce7c0cbf10 0x7fce7c15e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.777+0000 7fce8189f700 1 --2- 172.21.15.31:0/2905628865 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce7c0c9390 0x7fce7c15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.778+0000 7fce7bfff700 1 -- 172.21.15.31:0/2905628865 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202624917 0 0) 0x7fce7c0cae70 con 0x7fce7c0678b0 2023-10-09T06:27:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.778+0000 7fce7bfff700 1 -- 172.21.15.31:0/2905628865 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce64003570 con 0x7fce7c0678b0 2023-10-09T06:27:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.778+0000 7fce8189f700 1 -- 172.21.15.31:0/2905628865 >> v2:172.21.15.158:3300/0 conn(0x7fce7c0cbf10 msgr2=0x7fce7c15e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.778+0000 7fce8189f700 1 --2- 172.21.15.31:0/2905628865 >> v2:172.21.15.158:3300/0 conn(0x7fce7c0cbf10 0x7fce7c15e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.778+0000 7fce8189f700 1 -- 172.21.15.31:0/2905628865 >> v1:172.21.15.31:6789/0 conn(0x7fce7c0678b0 legacy=0x7fce7c15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.778+0000 7fce8189f700 1 -- 172.21.15.31:0/2905628865 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c0cb710 con 0x7fce7c0c9390 2023-10-09T06:27:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.778+0000 7fce8089d700 1 --2- 172.21.15.31:0/2905628865 >> v2:172.21.15.158:3300/0 conn(0x7fce7c0cbf10 0x7fce7c15e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:27:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.778+0000 7fce8189f700 1 --2- 172.21.15.31:0/2905628865 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce7c0c9390 0x7fce7c15a370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fce740098e0 tx=0x7fce740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a354f1c3ae47e37 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.778+0000 7fce7bfff700 1 -- 172.21.15.31:0/2905628865 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74011630 con 0x7fce7c0c9390 2023-10-09T06:27:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.778+0000 7fce7bfff700 1 -- 172.21.15.31:0/2905628865 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74011790 con 0x7fce7c0c9390 2023-10-09T06:27:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.778+0000 7fce7bfff700 1 -- 172.21.15.31:0/2905628865 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74011b10 con 0x7fce7c0c9390 2023-10-09T06:27:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.779+0000 7fce83302700 1 -- 172.21.15.31:0/2905628865 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce7c0c9390 msgr2=0x7fce7c15a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.779+0000 7fce83302700 1 --2- 172.21.15.31:0/2905628865 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce7c0c9390 0x7fce7c15a370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fce740098e0 tx=0x7fce740091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.779+0000 7fce83302700 1 -- 172.21.15.31:0/2905628865 shutdown_connections 2023-10-09T06:27:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.779+0000 7fce83302700 1 --2- 172.21.15.31:0/2905628865 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce7c0c9390 0x7fce7c15a370 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.779+0000 7fce83302700 1 --2- 172.21.15.31:0/2905628865 >> v2:172.21.15.158:3300/0 conn(0x7fce7c0cbf10 0x7fce7c15e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.779+0000 7fce83302700 1 -- 172.21.15.31:0/2905628865 >> 172.21.15.31:0/2905628865 conn(0x7fce7c069870 msgr2=0x7fce7c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:39.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.779+0000 7fce83302700 1 -- 172.21.15.31:0/2905628865 shutdown_connections 2023-10-09T06:27:39.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.779+0000 7fce83302700 1 -- 172.21.15.31:0/2905628865 wait complete. 2023-10-09T06:27:39.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.780+0000 7fce83302700 1 Processor -- start 2023-10-09T06:27:39.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.780+0000 7fce83302700 1 -- start start 2023-10-09T06:27:39.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce83302700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce7c0678b0 0x7fce7c1504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce83302700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce7c0c9390 0x7fce7c14fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce83302700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce7c0cbf10 0x7fce7c15e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce83302700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c15d120 con 0x7fce7c0678b0 2023-10-09T06:27:39.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce83302700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0cd100 con 0x7fce7c0cbf10 2023-10-09T06:27:39.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce83302700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0ccb10 con 0x7fce7c0c9390 2023-10-09T06:27:39.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce8109e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce7c0678b0 0x7fce7c1504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce8109e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce7c0678b0 0x7fce7c1504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47640/0 (socket says 172.21.15.31:47640) 2023-10-09T06:27:39.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce8109e700 1 -- 172.21.15.31:0/2590516106 learned_addr learned my addr 172.21.15.31:0/2590516106 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:39.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce8089d700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce7c0c9390 0x7fce7c14fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce8189f700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce7c0cbf10 0x7fce7c15e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce8109e700 1 -- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce7c0c9390 msgr2=0x7fce7c14fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce8109e700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce7c0c9390 0x7fce7c14fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce8109e700 1 -- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce7c0cbf10 msgr2=0x7fce7c15e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce8109e700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce7c0cbf10 0x7fce7c15e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce8109e700 1 -- 172.21.15.31:0/2590516106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce70009420 con 0x7fce7c0678b0 2023-10-09T06:27:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.781+0000 7fce8109e700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce7c0678b0 0x7fce7c1504f0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00cc40 tx=0x7fce6c001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.782+0000 7fce797fa700 1 -- 172.21.15.31:0/2590516106 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00a980 con 0x7fce7c0678b0 2023-10-09T06:27:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.782+0000 7fce797fa700 1 -- 172.21.15.31:0/2590516106 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c00aae0 con 0x7fce7c0678b0 2023-10-09T06:27:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.782+0000 7fce83302700 1 -- 172.21.15.31:0/2590516106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce74009420 con 0x7fce7c0678b0 2023-10-09T06:27:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.782+0000 7fce797fa700 1 -- 172.21.15.31:0/2590516106 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00ae80 con 0x7fce7c0678b0 2023-10-09T06:27:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.782+0000 7fce83302700 1 -- 172.21.15.31:0/2590516106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c15d650 con 0x7fce7c0678b0 2023-10-09T06:27:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.783+0000 7fce83302700 1 -- 172.21.15.31:0/2590516106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c04c3c0 con 0x7fce7c0678b0 2023-10-09T06:27:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.783+0000 7fce797fa700 1 -- 172.21.15.31:0/2590516106 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce6c007300 con 0x7fce7c0678b0 2023-10-09T06:27:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.783+0000 7fce797fa700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fce68066f30 0x7fce680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.784+0000 7fce797fa700 1 -- 172.21.15.31:0/2590516106 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce6c0849e0 con 0x7fce7c0678b0 2023-10-09T06:27:39.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.784+0000 7fce8089d700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fce68066f30 0x7fce680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:39.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.784+0000 7fce8089d700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fce68066f30 0x7fce680693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fce700093f0 tx=0x7fce70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:39.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.788+0000 7fce797fa700 1 -- 172.21.15.31:0/2590516106 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce6c051c30 con 0x7fce7c0678b0 2023-10-09T06:27:39.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.978+0000 7fce83302700 1 -- 172.21.15.31:0/2590516106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce7c068da0 con 0x7fce7c0678b0 2023-10-09T06:27:39.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.979+0000 7fce797fa700 1 -- 172.21.15.31:0/2590516106 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v139) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce6c055250 con 0x7fce7c0678b0 2023-10-09T06:27:39.979 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:27:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.980+0000 7fce83302700 1 -- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fce68066f30 msgr2=0x7fce680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.980+0000 7fce83302700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fce68066f30 0x7fce680693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fce700093f0 tx=0x7fce70008040 comp rx=0 tx=0).stop 2023-10-09T06:27:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.981+0000 7fce83302700 1 -- 172.21.15.31:0/2590516106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce7c0678b0 msgr2=0x7fce7c1504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.981+0000 7fce83302700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce7c0678b0 0x7fce7c1504f0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00cc40 tx=0x7fce6c001a60 comp rx=0 tx=0).stop 2023-10-09T06:27:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.981+0000 7fce83302700 1 -- 172.21.15.31:0/2590516106 shutdown_connections 2023-10-09T06:27:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.981+0000 7fce83302700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fce68066f30 0x7fce680693e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.981+0000 7fce83302700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce7c0cbf10 0x7fce7c15e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.981+0000 7fce83302700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce7c0678b0 0x7fce7c1504f0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.981+0000 7fce83302700 1 --2- 172.21.15.31:0/2590516106 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce7c0c9390 0x7fce7c14fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.981+0000 7fce83302700 1 -- 172.21.15.31:0/2590516106 >> 172.21.15.31:0/2590516106 conn(0x7fce7c069870 msgr2=0x7fce7c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.981+0000 7fce83302700 1 -- 172.21.15.31:0/2590516106 shutdown_connections 2023-10-09T06:27:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:39.981+0000 7fce83302700 1 -- 172.21.15.31:0/2590516106 wait complete. 2023-10-09T06:27:39.993 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:27:40.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.114+0000 7f548b105700 1 Processor -- start 2023-10-09T06:27:40.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.114+0000 7f548b105700 1 -- start start 2023-10-09T06:27:40.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.115+0000 7f548b105700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54840b6580 0x7f548406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.115+0000 7f548b105700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f548406a830 0x7f54840b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.115+0000 7f548b105700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548406ac90 con 0x7f54840cce30 2023-10-09T06:27:40.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.115+0000 7f548b105700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54840b4d70 con 0x7f54840b6580 2023-10-09T06:27:40.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.115+0000 7f548b105700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548415b3b0 con 0x7f548406a830 2023-10-09T06:27:40.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.115+0000 7f5489902700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54840b6580 0x7f548406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.115+0000 7f548a904700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f548406a830 0x7f54840b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.115+0000 7f548a103700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f54840cce30 0x7f548415aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:47260/0 (socket says 172.21.15.31:47260) 2023-10-09T06:27:40.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.115+0000 7f548a103700 1 -- 172.21.15.31:0/1908073983 learned_addr learned my addr 172.21.15.31:0/1908073983 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:40.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.115+0000 7f5489902700 1 -- 172.21.15.31:0/1908073983 >> v2:172.21.15.158:3300/0 conn(0x7f548406a830 msgr2=0x7f54840b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:40.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.115+0000 7f5489902700 1 --2- 172.21.15.31:0/1908073983 >> v2:172.21.15.158:3300/0 conn(0x7f548406a830 0x7f54840b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.115+0000 7f5489902700 1 -- 172.21.15.31:0/1908073983 >> v1:172.21.15.158:6789/0 conn(0x7f54840cce30 legacy=0x7f548415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.115+0000 7f5489902700 1 -- 172.21.15.31:0/1908073983 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54840cd8d0 con 0x7f54840b6580 2023-10-09T06:27:40.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.116+0000 7f5489902700 1 --2- 172.21.15.31:0/1908073983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54840b6580 0x7f548406a2f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f54840b4ce0 tx=0x7f54780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6131bbe80b89b501 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:40.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.116+0000 7f5489101700 1 -- 172.21.15.31:0/1908073983 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478011630 con 0x7f54840b6580 2023-10-09T06:27:40.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.116+0000 7f5489101700 1 -- 172.21.15.31:0/1908073983 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5478011790 con 0x7f54840b6580 2023-10-09T06:27:40.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.116+0000 7f5489101700 1 -- 172.21.15.31:0/1908073983 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478011b30 con 0x7f54840b6580 2023-10-09T06:27:40.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.116+0000 7f548b105700 1 -- 172.21.15.31:0/1908073983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54840b6580 msgr2=0x7f548406a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.116+0000 7f548b105700 1 --2- 172.21.15.31:0/1908073983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54840b6580 0x7f548406a2f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f54840b4ce0 tx=0x7f54780091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.116+0000 7f548b105700 1 -- 172.21.15.31:0/1908073983 shutdown_connections 2023-10-09T06:27:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.116+0000 7f548b105700 1 --2- 172.21.15.31:0/1908073983 >> v2:172.21.15.158:3300/0 conn(0x7f548406a830 0x7f54840b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.116+0000 7f548b105700 1 --2- 172.21.15.31:0/1908073983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54840b6580 0x7f548406a2f0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.116+0000 7f548b105700 1 -- 172.21.15.31:0/1908073983 >> 172.21.15.31:0/1908073983 conn(0x7f5484068cb0 msgr2=0x7f54840690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.116+0000 7f548b105700 1 -- 172.21.15.31:0/1908073983 shutdown_connections 2023-10-09T06:27:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.116+0000 7f548b105700 1 -- 172.21.15.31:0/1908073983 wait complete. 2023-10-09T06:27:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.117+0000 7f548b105700 1 Processor -- start 2023-10-09T06:27:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.117+0000 7f548b105700 1 -- start start 2023-10-09T06:27:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f548b105700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f548406a830 0x7f548416dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f548b105700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54840b6580 0x7f548415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f548b105700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54840cce30 0x7f548414c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f548b105700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548416e2e0 con 0x7f54840b6580 2023-10-09T06:27:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f548b105700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5484154320 con 0x7f548406a830 2023-10-09T06:27:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f548b105700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5484154040 con 0x7f54840cce30 2023-10-09T06:27:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f5489902700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54840b6580 0x7f548415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f5489902700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54840b6580 0x7f548415cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47662/0 (socket says 172.21.15.31:47662) 2023-10-09T06:27:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f5489902700 1 -- 172.21.15.31:0/923116013 learned_addr learned my addr 172.21.15.31:0/923116013 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f548a904700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54840cce30 0x7f548414c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f548a103700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f548406a830 0x7f548416dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f5489902700 1 -- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54840cce30 msgr2=0x7f548414c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f5489902700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54840cce30 0x7f548414c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f5489902700 1 -- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f548406a830 msgr2=0x7f548416dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f5489902700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f548406a830 0x7f548416dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.118+0000 7f5489902700 1 -- 172.21.15.31:0/923116013 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5478009420 con 0x7f54840b6580 2023-10-09T06:27:40.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.119+0000 7f548a103700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f548406a830 0x7f548416dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:40.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.119+0000 7f5489902700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54840b6580 0x7f548415cc20 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f548406b300 tx=0x7f5478017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:40.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.119+0000 7f54827fc700 1 -- 172.21.15.31:0/923116013 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478011b10 con 0x7f54840b6580 2023-10-09T06:27:40.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.119+0000 7f54827fc700 1 -- 172.21.15.31:0/923116013 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54780233f0 con 0x7f54840b6580 2023-10-09T06:27:40.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.119+0000 7f548b105700 1 -- 172.21.15.31:0/923116013 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5484169f70 con 0x7f54840b6580 2023-10-09T06:27:40.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.119+0000 7f54827fc700 1 -- 172.21.15.31:0/923116013 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478023790 con 0x7f54840b6580 2023-10-09T06:27:40.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.119+0000 7f548b105700 1 -- 172.21.15.31:0/923116013 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548416a530 con 0x7f54840b6580 2023-10-09T06:27:40.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.120+0000 7f548b105700 1 -- 172.21.15.31:0/923116013 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548416a720 con 0x7f54840b6580 2023-10-09T06:27:40.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.120+0000 7f54827fc700 1 -- 172.21.15.31:0/923116013 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5478023b80 con 0x7f54840b6580 2023-10-09T06:27:40.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.121+0000 7f54827fc700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5470066f60 0x7f5470069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.121+0000 7f54827fc700 1 -- 172.21.15.31:0/923116013 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5478085830 con 0x7f54840b6580 2023-10-09T06:27:40.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.121+0000 7f548a103700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5470066f60 0x7f5470069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.121+0000 7f548a103700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5470066f60 0x7f5470069410 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f547c0017a0 tx=0x7f547c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:40.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.125+0000 7f54827fc700 1 -- 172.21.15.31:0/923116013 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5478052b20 con 0x7f54840b6580 2023-10-09T06:27:40.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.314+0000 7f548b105700 1 -- 172.21.15.31:0/923116013 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54840b4440 con 0x7f54840b6580 2023-10-09T06:27:40.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.314+0000 7f54827fc700 1 -- 172.21.15.31:0/923116013 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5478015020 con 0x7f54840b6580 2023-10-09T06:27:40.315 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:27:40.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.316+0000 7f548b105700 1 -- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5470066f60 msgr2=0x7f5470069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.316+0000 7f548b105700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5470066f60 0x7f5470069410 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f547c0017a0 tx=0x7f547c009040 comp rx=0 tx=0).stop 2023-10-09T06:27:40.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.316+0000 7f548b105700 1 -- 172.21.15.31:0/923116013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54840b6580 msgr2=0x7f548415cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.316+0000 7f548b105700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54840b6580 0x7f548415cc20 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f548406b300 tx=0x7f5478017000 comp rx=0 tx=0).stop 2023-10-09T06:27:40.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.316+0000 7f548b105700 1 -- 172.21.15.31:0/923116013 shutdown_connections 2023-10-09T06:27:40.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.316+0000 7f548b105700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5470066f60 0x7f5470069410 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.316+0000 7f548b105700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f54840cce30 0x7f548414c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.316+0000 7f548b105700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f548406a830 0x7f548416dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.316+0000 7f548b105700 1 --2- 172.21.15.31:0/923116013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54840b6580 0x7f548415cc20 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.316+0000 7f548b105700 1 -- 172.21.15.31:0/923116013 >> 172.21.15.31:0/923116013 conn(0x7f5484068cb0 msgr2=0x7f54840cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:40.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.316+0000 7f548b105700 1 -- 172.21.15.31:0/923116013 shutdown_connections 2023-10-09T06:27:40.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.316+0000 7f548b105700 1 -- 172.21.15.31:0/923116013 wait complete. 2023-10-09T06:27:40.328 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:27:40.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.451+0000 7f5a5abf1700 1 Processor -- start 2023-10-09T06:27:40.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.451+0000 7f5a5abf1700 1 -- start start 2023-10-09T06:27:40.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5abf1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5a540b4860 0x7f5a540b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5abf1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a540b4c30 0x7f5a54159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5abf1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5a54159fd0 0x7f5a540cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5abf1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a540b14f0 con 0x7f5a54159fd0 2023-10-09T06:27:40.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5abf1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a540b17d0 con 0x7f5a540b4860 2023-10-09T06:27:40.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5abf1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a540b1ab0 con 0x7f5a540b4c30 2023-10-09T06:27:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5918e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5a54159fd0 0x7f5a540cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5918e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5a54159fd0 0x7f5a540cfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47670/0 (socket says 172.21.15.31:47670) 2023-10-09T06:27:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5918e700 1 -- 172.21.15.31:0/542316263 learned_addr learned my addr 172.21.15.31:0/542316263 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a53fff700 1 --2- 172.21.15.31:0/542316263 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a540b4c30 0x7f5a54159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5898d700 1 --2- 172.21.15.31:0/542316263 >> v2:172.21.15.158:3300/0 conn(0x7f5a540b4860 0x7f5a540b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5918e700 1 -- 172.21.15.31:0/542316263 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a540b4c30 msgr2=0x7f5a54159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5918e700 1 --2- 172.21.15.31:0/542316263 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a540b4c30 0x7f5a54159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5918e700 1 -- 172.21.15.31:0/542316263 >> v2:172.21.15.158:3300/0 conn(0x7f5a540b4860 msgr2=0x7f5a540b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5918e700 1 --2- 172.21.15.31:0/542316263 >> v2:172.21.15.158:3300/0 conn(0x7f5a540b4860 0x7f5a540b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5918e700 1 -- 172.21.15.31:0/542316263 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a540b1d90 con 0x7f5a54159fd0 2023-10-09T06:27:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.452+0000 7f5a5918e700 1 --2- 172.21.15.31:0/542316263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a54159fd0 0x7f5a540cfe90 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f5a540d1e70 tx=0x7f5a4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa0612716156924 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.453+0000 7f5a537fe700 1 -- 172.21.15.31:0/542316263 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c00e070 con 0x7f5a54159fd0 2023-10-09T06:27:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.453+0000 7f5a537fe700 1 -- 172.21.15.31:0/542316263 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4c00ba00 con 0x7f5a54159fd0 2023-10-09T06:27:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.453+0000 7f5a537fe700 1 -- 172.21.15.31:0/542316263 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0092e0 con 0x7f5a54159fd0 2023-10-09T06:27:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.453+0000 7f5a5abf1700 1 -- 172.21.15.31:0/542316263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a54159fd0 msgr2=0x7f5a540cfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.453+0000 7f5a5abf1700 1 --2- 172.21.15.31:0/542316263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a54159fd0 0x7f5a540cfe90 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f5a540d1e70 tx=0x7f5a4c009840 comp rx=0 tx=0).stop 2023-10-09T06:27:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.453+0000 7f5a5abf1700 1 -- 172.21.15.31:0/542316263 shutdown_connections 2023-10-09T06:27:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.453+0000 7f5a5abf1700 1 --2- 172.21.15.31:0/542316263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a54159fd0 0x7f5a540cfe90 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.453+0000 7f5a5abf1700 1 --2- 172.21.15.31:0/542316263 >> v2:172.21.15.158:3300/0 conn(0x7f5a540b4860 0x7f5a540b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.453+0000 7f5a5abf1700 1 --2- 172.21.15.31:0/542316263 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a540b4c30 0x7f5a54159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.453+0000 7f5a5abf1700 1 -- 172.21.15.31:0/542316263 >> 172.21.15.31:0/542316263 conn(0x7f5a5409a0f0 msgr2=0x7f5a54067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.453+0000 7f5a5abf1700 1 -- 172.21.15.31:0/542316263 shutdown_connections 2023-10-09T06:27:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.453+0000 7f5a5abf1700 1 -- 172.21.15.31:0/542316263 wait complete. 2023-10-09T06:27:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.454+0000 7f5a5abf1700 1 Processor -- start 2023-10-09T06:27:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.455+0000 7f5a5abf1700 1 -- start start 2023-10-09T06:27:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.455+0000 7f5a5abf1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a540b4860 0x7f5a5409e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.455+0000 7f5a5abf1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a540b4c30 0x7f5a54169dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.455+0000 7f5a5abf1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a54159fd0 0x7f5a5416d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.455+0000 7f5a5abf1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5416a310 con 0x7f5a540b4c30 2023-10-09T06:27:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.455+0000 7f5a5abf1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a540ad8a0 con 0x7f5a540b4860 2023-10-09T06:27:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.455+0000 7f5a5abf1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a540ade60 con 0x7f5a54159fd0 2023-10-09T06:27:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.455+0000 7f5a53fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a540b4c30 0x7f5a54169dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.455+0000 7f5a53fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a540b4c30 0x7f5a54169dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47684/0 (socket says 172.21.15.31:47684) 2023-10-09T06:27:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.455+0000 7f5a53fff700 1 -- 172.21.15.31:0/267384771 learned_addr learned my addr 172.21.15.31:0/267384771 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.455+0000 7f5a5898d700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a540b4860 0x7f5a5409e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.455+0000 7f5a5918e700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a54159fd0 0x7f5a5416d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.456+0000 7f5a53fff700 1 -- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a54159fd0 msgr2=0x7f5a5416d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.456+0000 7f5a53fff700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a54159fd0 0x7f5a5416d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.456+0000 7f5a53fff700 1 -- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a540b4860 msgr2=0x7f5a5409e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.456+0000 7f5a53fff700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a540b4860 0x7f5a5409e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.456+0000 7f5a53fff700 1 -- 172.21.15.31:0/267384771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c009ae0 con 0x7f5a540b4c30 2023-10-09T06:27:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.456+0000 7f5a53fff700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a540b4c30 0x7f5a54169dd0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000ec80 tx=0x7f5a400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.456+0000 7f5a50ff9700 1 -- 172.21.15.31:0/267384771 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000c850 con 0x7f5a540b4c30 2023-10-09T06:27:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.456+0000 7f5a50ff9700 1 -- 172.21.15.31:0/267384771 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4000c9b0 con 0x7f5a540b4c30 2023-10-09T06:27:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.456+0000 7f5a5abf1700 1 -- 172.21.15.31:0/267384771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a540afd30 con 0x7f5a540b4c30 2023-10-09T06:27:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.456+0000 7f5a50ff9700 1 -- 172.21.15.31:0/267384771 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000cd50 con 0x7f5a540b4c30 2023-10-09T06:27:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.456+0000 7f5a5abf1700 1 -- 172.21.15.31:0/267384771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a540adaf0 con 0x7f5a540b4c30 2023-10-09T06:27:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.457+0000 7f5a5abf1700 1 -- 172.21.15.31:0/267384771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5404c3c0 con 0x7f5a540b4c30 2023-10-09T06:27:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.457+0000 7f5a50ff9700 1 -- 172.21.15.31:0/267384771 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a40013680 con 0x7f5a540b4c30 2023-10-09T06:27:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.458+0000 7f5a50ff9700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a38066f30 0x7f5a380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.458+0000 7f5a50ff9700 1 -- 172.21.15.31:0/267384771 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a40084760 con 0x7f5a540b4c30 2023-10-09T06:27:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.458+0000 7f5a5898d700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a38066f30 0x7f5a380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.459+0000 7f5a5898d700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a38066f30 0x7f5a380693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009da0 tx=0x7f5a48009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:40.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.462+0000 7f5a50ff9700 1 -- 172.21.15.31:0/267384771 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a400519d0 con 0x7f5a540b4c30 2023-10-09T06:27:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.654+0000 7f5a5abf1700 1 -- 172.21.15.31:0/267384771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a540adfa0 con 0x7f5a540b4c30 2023-10-09T06:27:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.655+0000 7f5a50ff9700 1 -- 172.21.15.31:0/267384771 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a40054ff0 con 0x7f5a540b4c30 2023-10-09T06:27:40.655 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:27:40.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.656+0000 7f5a5abf1700 1 -- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a38066f30 msgr2=0x7f5a380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.656+0000 7f5a5abf1700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a38066f30 0x7f5a380693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009da0 tx=0x7f5a48009120 comp rx=0 tx=0).stop 2023-10-09T06:27:40.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.656+0000 7f5a5abf1700 1 -- 172.21.15.31:0/267384771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a540b4c30 msgr2=0x7f5a54169dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.656+0000 7f5a5abf1700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a540b4c30 0x7f5a54169dd0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000ec80 tx=0x7f5a400091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.657+0000 7f5a5abf1700 1 -- 172.21.15.31:0/267384771 shutdown_connections 2023-10-09T06:27:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.657+0000 7f5a5abf1700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a38066f30 0x7f5a380693e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.657+0000 7f5a5abf1700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a54159fd0 0x7f5a5416d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.657+0000 7f5a5abf1700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a540b4860 0x7f5a5409e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.657+0000 7f5a5abf1700 1 --2- 172.21.15.31:0/267384771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a540b4c30 0x7f5a54169dd0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.657+0000 7f5a5abf1700 1 -- 172.21.15.31:0/267384771 >> 172.21.15.31:0/267384771 conn(0x7f5a5409a0f0 msgr2=0x7f5a5415ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.657+0000 7f5a5abf1700 1 -- 172.21.15.31:0/267384771 shutdown_connections 2023-10-09T06:27:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.657+0000 7f5a5abf1700 1 -- 172.21.15.31:0/267384771 wait complete. 2023-10-09T06:27:40.669 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:27:40.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.787+0000 7fb005c1e700 1 Processor -- start 2023-10-09T06:27:40.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.788+0000 7fb005c1e700 1 -- start start 2023-10-09T06:27:40.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.788+0000 7fb005c1e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0000b1220 0x7fb0000c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.788+0000 7fb005c1e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb0000cb4f0 0x7fb0000cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.788+0000 7fb005c1e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00015de60 con 0x7fb0000b0e50 2023-10-09T06:27:40.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.788+0000 7fb005c1e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0000cbed0 con 0x7fb0000cb4f0 2023-10-09T06:27:40.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.788+0000 7fb005c1e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00015e140 con 0x7fb0000b1220 2023-10-09T06:27:40.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.788+0000 7faffffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb0000cb4f0 0x7fb0000cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.789+0000 7faffffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb0000cb4f0 0x7fb0000cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47694/0 (socket says 172.21.15.31:47694) 2023-10-09T06:27:40.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.789+0000 7faffffff700 1 -- 172.21.15.31:0/4251259373 learned_addr learned my addr 172.21.15.31:0/4251259373 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:40.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.789+0000 7faffeffd700 1 --2- 172.21.15.31:0/4251259373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0000b1220 0x7fb0000c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.789+0000 7faffffff700 1 -- 172.21.15.31:0/4251259373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0000b1220 msgr2=0x7fb0000c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:40.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.789+0000 7faffffff700 1 --2- 172.21.15.31:0/4251259373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0000b1220 0x7fb0000c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.789+0000 7faffffff700 1 -- 172.21.15.31:0/4251259373 >> v1:172.21.15.158:6789/0 conn(0x7fb0000b0e50 legacy=0x7fb00006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.789+0000 7faffffff700 1 -- 172.21.15.31:0/4251259373 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00015e420 con 0x7fb0000cb4f0 2023-10-09T06:27:40.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.789+0000 7faffe7fc700 1 -- 172.21.15.31:0/4251259373 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123032791 0 0) 0x7fb00015de60 con 0x7fb0000b0e50 2023-10-09T06:27:40.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.789+0000 7faffffff700 1 --2- 172.21.15.31:0/4251259373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000cb4f0 0x7fb0000cb990 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7faff8009f20 tx=0x7faff8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940c845f335d8583 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.789+0000 7faffe7fc700 1 -- 172.21.15.31:0/4251259373 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff800e070 con 0x7fb0000cb4f0 2023-10-09T06:27:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.789+0000 7faffe7fc700 1 -- 172.21.15.31:0/4251259373 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff800b9d0 con 0x7fb0000cb4f0 2023-10-09T06:27:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.789+0000 7faffe7fc700 1 -- 172.21.15.31:0/4251259373 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff80092e0 con 0x7fb0000cb4f0 2023-10-09T06:27:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.790+0000 7fb005c1e700 1 -- 172.21.15.31:0/4251259373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000cb4f0 msgr2=0x7fb0000cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.790+0000 7fb005c1e700 1 --2- 172.21.15.31:0/4251259373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000cb4f0 0x7fb0000cb990 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7faff8009f20 tx=0x7faff8009840 comp rx=0 tx=0).stop 2023-10-09T06:27:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.790+0000 7fb005c1e700 1 -- 172.21.15.31:0/4251259373 shutdown_connections 2023-10-09T06:27:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.790+0000 7fb005c1e700 1 --2- 172.21.15.31:0/4251259373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000cb4f0 0x7fb0000cb990 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.790+0000 7fb005c1e700 1 --2- 172.21.15.31:0/4251259373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0000b1220 0x7fb0000c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.790+0000 7fb005c1e700 1 -- 172.21.15.31:0/4251259373 >> 172.21.15.31:0/4251259373 conn(0x7fb000069870 msgr2=0x7fb000069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.790+0000 7fb005c1e700 1 -- 172.21.15.31:0/4251259373 shutdown_connections 2023-10-09T06:27:40.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.790+0000 7fb005c1e700 1 -- 172.21.15.31:0/4251259373 wait complete. 2023-10-09T06:27:40.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.791+0000 7fb005c1e700 1 Processor -- start 2023-10-09T06:27:40.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.791+0000 7fb005c1e700 1 -- start start 2023-10-09T06:27:40.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.792+0000 7fb005c1e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0000b0e50 0x7fb0000c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.792+0000 7fb005c1e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0000b1220 0x7fb0000b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.792+0000 7fb005c1e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000cb4f0 0x7fb0000b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.792+0000 7fb005c1e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000c5bf0 con 0x7fb0000cb4f0 2023-10-09T06:27:40.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.792+0000 7fb005c1e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000c6450 con 0x7fb0000b1220 2023-10-09T06:27:40.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.792+0000 7fb005c1e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb000158c70 con 0x7fb0000b0e50 2023-10-09T06:27:40.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.792+0000 7faffffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000cb4f0 0x7fb0000b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.792+0000 7faffffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000cb4f0 0x7fb0000b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47702/0 (socket says 172.21.15.31:47702) 2023-10-09T06:27:40.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.792+0000 7faffffff700 1 -- 172.21.15.31:0/2010560336 learned_addr learned my addr 172.21.15.31:0/2010560336 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:40.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.792+0000 7faffeffd700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0000b1220 0x7fb0000b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.792+0000 7fafff7fe700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0000b0e50 0x7fb0000c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.793+0000 7faffffff700 1 -- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0000b0e50 msgr2=0x7fb0000c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.793+0000 7faffffff700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0000b0e50 0x7fb0000c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.793+0000 7faffffff700 1 -- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0000b1220 msgr2=0x7fb0000b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:40.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.793+0000 7faffffff700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0000b1220 0x7fb0000b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:40.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.793+0000 7faffffff700 1 -- 172.21.15.31:0/2010560336 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff8009ae0 con 0x7fb0000cb4f0 2023-10-09T06:27:40.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.793+0000 7faffffff700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000cb4f0 0x7fb0000b36b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fb0000c59e0 tx=0x7faff8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:40.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.795+0000 7fafe77fe700 1 -- 172.21.15.31:0/2010560336 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8003300 con 0x7fb0000cb4f0 2023-10-09T06:27:40.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.795+0000 7fafe77fe700 1 -- 172.21.15.31:0/2010560336 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff8007b40 con 0x7fb0000cb4f0 2023-10-09T06:27:40.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.795+0000 7fb005c1e700 1 -- 172.21.15.31:0/2010560336 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0000c5e00 con 0x7fb0000cb4f0 2023-10-09T06:27:40.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.795+0000 7fafe77fe700 1 -- 172.21.15.31:0/2010560336 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff801c410 con 0x7fb0000cb4f0 2023-10-09T06:27:40.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.795+0000 7fb005c1e700 1 -- 172.21.15.31:0/2010560336 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0000b3bf0 con 0x7fb0000cb4f0 2023-10-09T06:27:40.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.796+0000 7fb005c1e700 1 -- 172.21.15.31:0/2010560336 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0000c65e0 con 0x7fb0000cb4f0 2023-10-09T06:27:40.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.796+0000 7fafe77fe700 1 -- 172.21.15.31:0/2010560336 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faff8003050 con 0x7fb0000cb4f0 2023-10-09T06:27:40.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.797+0000 7fafe77fe700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fafec066f30 0x7fafec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:40.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.797+0000 7fafe77fe700 1 -- 172.21.15.31:0/2010560336 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faff8085f70 con 0x7fb0000cb4f0 2023-10-09T06:27:40.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.797+0000 7fafff7fe700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fafec066f30 0x7fafec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:40.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.797+0000 7fafff7fe700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fafec066f30 0x7fafec0693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faff0007fd0 tx=0x7faff0007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:40.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:40.801+0000 7fafe77fe700 1 -- 172.21.15.31:0/2010560336 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faff80531e0 con 0x7fb0000cb4f0 2023-10-09T06:27:41.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.040+0000 7fb005c1e700 1 -- 172.21.15.31:0/2010560336 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb00004c3c0 con 0x7fb0000cb4f0 2023-10-09T06:27:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.040+0000 7fafe77fe700 1 -- 172.21.15.31:0/2010560336 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4602 (secure 0 0 0) 0x7faff8056800 con 0x7fb0000cb4f0 2023-10-09T06:27:41.041 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:41.041 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/1232957657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1232957657},{"type":"v1","addr":"172.21.15.158:6836","nonce":1232957657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2947695434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2947695434},{"type":"v1","addr":"172.21.15.158:6837","nonce":2947695434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/912397379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":912397379},{"type":"v1","addr":"172.21.15.31:6834","nonce":912397379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:07.779885+0000","modified":"2023-10-09T06:27:12.402382+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7005},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7005":{"gid":7005,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1684509217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1684509217},{"type":"v1","addr":"172.21.15.31:6835","nonce":1684509217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T06:27:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.043+0000 7fb005c1e700 1 -- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fafec066f30 msgr2=0x7fafec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.043+0000 7fb005c1e700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fafec066f30 0x7fafec0693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faff0007fd0 tx=0x7faff0007d30 comp rx=0 tx=0).stop 2023-10-09T06:27:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.043+0000 7fb005c1e700 1 -- 172.21.15.31:0/2010560336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000cb4f0 msgr2=0x7fb0000b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.043+0000 7fb005c1e700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000cb4f0 0x7fb0000b36b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fb0000c59e0 tx=0x7faff8018000 comp rx=0 tx=0).stop 2023-10-09T06:27:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.043+0000 7fb005c1e700 1 -- 172.21.15.31:0/2010560336 shutdown_connections 2023-10-09T06:27:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.043+0000 7fb005c1e700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fafec066f30 0x7fafec0693e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.043+0000 7fb005c1e700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb0000b0e50 0x7fb0000c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.043+0000 7fb005c1e700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0000cb4f0 0x7fb0000b36b0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.043+0000 7fb005c1e700 1 --2- 172.21.15.31:0/2010560336 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0000b1220 0x7fb0000b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.043+0000 7fb005c1e700 1 -- 172.21.15.31:0/2010560336 >> 172.21.15.31:0/2010560336 conn(0x7fb000069870 msgr2=0x7fb000069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.043+0000 7fb005c1e700 1 -- 172.21.15.31:0/2010560336 shutdown_connections 2023-10-09T06:27:41.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.043+0000 7fb005c1e700 1 -- 172.21.15.31:0/2010560336 wait complete. 2023-10-09T06:27:41.045 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 66 2023-10-09T06:27:41.055 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:27:41.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.173+0000 7f16f571c700 1 Processor -- start 2023-10-09T06:27:41.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.173+0000 7f16f571c700 1 -- start start 2023-10-09T06:27:41.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.174+0000 7f16f571c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f16f0159ae0 0x7f16f00ae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.174+0000 7f16f571c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16f0069a90 0x7f16f0069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.174+0000 7f16f571c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f006a3d0 con 0x7f16f0159eb0 2023-10-09T06:27:41.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.174+0000 7f16f571c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f00c9140 con 0x7f16f0069a90 2023-10-09T06:27:41.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.174+0000 7f16f571c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f015dcb0 con 0x7f16f0159ae0 2023-10-09T06:27:41.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.174+0000 7f16ef7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16f0069a90 0x7f16f0069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.174+0000 7f16ef7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16f0069a90 0x7f16f0069e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47710/0 (socket says 172.21.15.31:47710) 2023-10-09T06:27:41.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.174+0000 7f16ef7fe700 1 -- 172.21.15.31:0/1282339925 learned_addr learned my addr 172.21.15.31:0/1282339925 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:41.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.174+0000 7f16eeffd700 1 --2- 172.21.15.31:0/1282339925 >> v2:172.21.15.158:3300/0 conn(0x7f16f0159ae0 0x7f16f00ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.174+0000 7f16ef7fe700 1 -- 172.21.15.31:0/1282339925 >> v2:172.21.15.158:3300/0 conn(0x7f16f0159ae0 msgr2=0x7f16f00ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:41.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.174+0000 7f16ef7fe700 1 --2- 172.21.15.31:0/1282339925 >> v2:172.21.15.158:3300/0 conn(0x7f16f0159ae0 0x7f16f00ae250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.174+0000 7f16ef7fe700 1 -- 172.21.15.31:0/1282339925 >> v1:172.21.15.158:6789/0 conn(0x7f16f0159eb0 legacy=0x7f16f0068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:41.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.175+0000 7f16ef7fe700 1 -- 172.21.15.31:0/1282339925 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f015df90 con 0x7f16f0069a90 2023-10-09T06:27:41.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.175+0000 7f16ef7fe700 1 --2- 172.21.15.31:0/1282339925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16f0069a90 0x7f16f0069e90 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f16f00cbb30 tx=0x7f16e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6d35af840e18e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:41.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.175+0000 7f16edffb700 1 -- 172.21.15.31:0/1282339925 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e000e070 con 0x7f16f0069a90 2023-10-09T06:27:41.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.175+0000 7f16edffb700 1 -- 172.21.15.31:0/1282339925 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e000ba10 con 0x7f16f0069a90 2023-10-09T06:27:41.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.175+0000 7f16edffb700 1 -- 172.21.15.31:0/1282339925 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00092e0 con 0x7f16f0069a90 2023-10-09T06:27:41.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.175+0000 7f16f571c700 1 -- 172.21.15.31:0/1282339925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16f0069a90 msgr2=0x7f16f0069e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.175+0000 7f16f571c700 1 --2- 172.21.15.31:0/1282339925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16f0069a90 0x7f16f0069e90 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f16f00cbb30 tx=0x7f16e0009840 comp rx=0 tx=0).stop 2023-10-09T06:27:41.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.175+0000 7f16f571c700 1 -- 172.21.15.31:0/1282339925 shutdown_connections 2023-10-09T06:27:41.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.175+0000 7f16f571c700 1 --2- 172.21.15.31:0/1282339925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16f0069a90 0x7f16f0069e90 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.175+0000 7f16f571c700 1 --2- 172.21.15.31:0/1282339925 >> v2:172.21.15.158:3300/0 conn(0x7f16f0159ae0 0x7f16f00ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.175+0000 7f16f571c700 1 -- 172.21.15.31:0/1282339925 >> 172.21.15.31:0/1282339925 conn(0x7f16f0070700 msgr2=0x7f16f0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:41.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.175+0000 7f16f571c700 1 -- 172.21.15.31:0/1282339925 shutdown_connections 2023-10-09T06:27:41.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.175+0000 7f16f571c700 1 -- 172.21.15.31:0/1282339925 wait complete. 2023-10-09T06:27:41.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.177+0000 7f16f571c700 1 Processor -- start 2023-10-09T06:27:41.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.177+0000 7f16f571c700 1 -- start start 2023-10-09T06:27:41.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.177+0000 7f16f571c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16f0069a90 0x7f16f0158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.177+0000 7f16f571c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16f0159ae0 0x7f16f016a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.177+0000 7f16f571c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16f0159eb0 0x7f16f016abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.177+0000 7f16f571c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f00c6c60 con 0x7f16f0159ae0 2023-10-09T06:27:41.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.177+0000 7f16f571c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f00c5230 con 0x7f16f0159eb0 2023-10-09T06:27:41.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.177+0000 7f16f571c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f00c3940 con 0x7f16f0069a90 2023-10-09T06:27:41.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16ee7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16f0159ae0 0x7f16f016a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16ee7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16f0159ae0 0x7f16f016a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47718/0 (socket says 172.21.15.31:47718) 2023-10-09T06:27:41.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16ee7fc700 1 -- 172.21.15.31:0/1893052367 learned_addr learned my addr 172.21.15.31:0/1893052367 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:41.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16eeffd700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16f0069a90 0x7f16f0158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16ef7fe700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16f0159eb0 0x7f16f016abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16ee7fc700 1 -- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16f0069a90 msgr2=0x7f16f0158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16ee7fc700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16f0069a90 0x7f16f0158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16ee7fc700 1 -- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16f0159eb0 msgr2=0x7f16f016abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16ee7fc700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16f0159eb0 0x7f16f016abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16ee7fc700 1 -- 172.21.15.31:0/1893052367 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e0009ae0 con 0x7f16f0159ae0 2023-10-09T06:27:41.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16ee7fc700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16f0159ae0 0x7f16f016a680 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f16d800b5e0 tx=0x7f16d8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:41.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16e6ffd700 1 -- 172.21.15.31:0/1893052367 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d800f510 con 0x7f16f0159ae0 2023-10-09T06:27:41.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16e6ffd700 1 -- 172.21.15.31:0/1893052367 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d800f670 con 0x7f16f0159ae0 2023-10-09T06:27:41.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16f571c700 1 -- 172.21.15.31:0/1893052367 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f00c3c20 con 0x7f16f0159ae0 2023-10-09T06:27:41.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16e6ffd700 1 -- 172.21.15.31:0/1893052367 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d800fa30 con 0x7f16f0159ae0 2023-10-09T06:27:41.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.178+0000 7f16f571c700 1 -- 172.21.15.31:0/1893052367 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f00c41e0 con 0x7f16f0159ae0 2023-10-09T06:27:41.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.179+0000 7f16f571c700 1 -- 172.21.15.31:0/1893052367 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f00c6dd0 con 0x7f16f0159ae0 2023-10-09T06:27:41.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.180+0000 7f16e6ffd700 1 -- 172.21.15.31:0/1893052367 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16d801a400 con 0x7f16f0159ae0 2023-10-09T06:27:41.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.180+0000 7f16e6ffd700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f16d0066f30 0x7f16d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.180+0000 7f16e6ffd700 1 -- 172.21.15.31:0/1893052367 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f16d80840f0 con 0x7f16f0159ae0 2023-10-09T06:27:41.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.180+0000 7f16eeffd700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f16d0066f30 0x7f16d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.181+0000 7f16eeffd700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f16d0066f30 0x7f16d00693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f16f0069630 tx=0x7f16e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:41.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.184+0000 7f16e6ffd700 1 -- 172.21.15.31:0/1893052367 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16f00c6dd0 con 0x7f16f0159ae0 2023-10-09T06:27:41.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.379+0000 7f16f571c700 1 -- 172.21.15.31:0/1893052367 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16f00c6da0 con 0x7f16f0159ae0 2023-10-09T06:27:41.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.379+0000 7f16e6ffd700 1 -- 172.21.15.31:0/1893052367 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f16d8054e70 con 0x7f16f0159ae0 2023-10-09T06:27:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:41.381 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":139,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:27:36.748970+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:27:06.232021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T06:27:06.742407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:27:41.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.382+0000 7f16f571c700 1 -- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f16d0066f30 msgr2=0x7f16d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.382+0000 7f16f571c700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f16d0066f30 0x7f16d00693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f16f0069630 tx=0x7f16e8008040 comp rx=0 tx=0).stop 2023-10-09T06:27:41.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.382+0000 7f16f571c700 1 -- 172.21.15.31:0/1893052367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16f0159ae0 msgr2=0x7f16f016a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.382+0000 7f16f571c700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16f0159ae0 0x7f16f016a680 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f16d800b5e0 tx=0x7f16d8009120 comp rx=0 tx=0).stop 2023-10-09T06:27:41.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.382+0000 7f16f571c700 1 -- 172.21.15.31:0/1893052367 shutdown_connections 2023-10-09T06:27:41.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.382+0000 7f16f571c700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f16d0066f30 0x7f16d00693e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.382+0000 7f16f571c700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f16f0069a90 0x7f16f0158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.382+0000 7f16f571c700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16f0159eb0 0x7f16f016abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.382+0000 7f16f571c700 1 --2- 172.21.15.31:0/1893052367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16f0159ae0 0x7f16f016a680 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.382+0000 7f16f571c700 1 -- 172.21.15.31:0/1893052367 >> 172.21.15.31:0/1893052367 conn(0x7f16f0070700 msgr2=0x7f16f00cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:41.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.382+0000 7f16f571c700 1 -- 172.21.15.31:0/1893052367 shutdown_connections 2023-10-09T06:27:41.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.382+0000 7f16f571c700 1 -- 172.21.15.31:0/1893052367 wait complete. 2023-10-09T06:27:41.395 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:27:41.396 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:27:41.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.514+0000 7faedbf95700 1 Processor -- start 2023-10-09T06:27:41.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.514+0000 7faedbf95700 1 -- start start 2023-10-09T06:27:41.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.515+0000 7faedbf95700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faed415a2b0 0x7faed40b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.515+0000 7faedbf95700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faed40cfe20 0x7faed40ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.515+0000 7faedbf95700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed40c5d80 con 0x7faed40d1c30 2023-10-09T06:27:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.515+0000 7faedbf95700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed4068470 con 0x7faed40cfe20 2023-10-09T06:27:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.515+0000 7faedbf95700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed40c6060 con 0x7faed415a2b0 2023-10-09T06:27:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.515+0000 7faeda532700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faed40cfe20 0x7faed40ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.515+0000 7faeda532700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faed40cfe20 0x7faed40ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47730/0 (socket says 172.21.15.31:47730) 2023-10-09T06:27:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.515+0000 7faeda532700 1 -- 172.21.15.31:0/1555672225 learned_addr learned my addr 172.21.15.31:0/1555672225 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.515+0000 7faed9d31700 1 --2- 172.21.15.31:0/1555672225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faed415a2b0 0x7faed40b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.516+0000 7faeda532700 1 -- 172.21.15.31:0/1555672225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faed415a2b0 msgr2=0x7faed40b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.516+0000 7faeda532700 1 --2- 172.21.15.31:0/1555672225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faed415a2b0 0x7faed40b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.516+0000 7faeda532700 1 -- 172.21.15.31:0/1555672225 >> v1:172.21.15.158:6789/0 conn(0x7faed40d1c30 legacy=0x7faed40cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.516+0000 7faeda532700 1 -- 172.21.15.31:0/1555672225 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed40c6340 con 0x7faed40cfe20 2023-10-09T06:27:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.516+0000 7faeda532700 1 --2- 172.21.15.31:0/1555672225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed40cfe20 0x7faed40ccdd0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7faec4009f20 tx=0x7faec4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde32998e1f6c551 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.516+0000 7faed8d2f700 1 -- 172.21.15.31:0/1555672225 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec400e070 con 0x7faed40cfe20 2023-10-09T06:27:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.516+0000 7faed8d2f700 1 -- 172.21.15.31:0/1555672225 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec400b9d0 con 0x7faed40cfe20 2023-10-09T06:27:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.516+0000 7faed8d2f700 1 -- 172.21.15.31:0/1555672225 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec40092e0 con 0x7faed40cfe20 2023-10-09T06:27:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.516+0000 7faedbf95700 1 -- 172.21.15.31:0/1555672225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed40cfe20 msgr2=0x7faed40ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.516+0000 7faedbf95700 1 --2- 172.21.15.31:0/1555672225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed40cfe20 0x7faed40ccdd0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7faec4009f20 tx=0x7faec4009840 comp rx=0 tx=0).stop 2023-10-09T06:27:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.517+0000 7faedbf95700 1 -- 172.21.15.31:0/1555672225 shutdown_connections 2023-10-09T06:27:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.517+0000 7faedbf95700 1 --2- 172.21.15.31:0/1555672225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed40cfe20 0x7faed40ccdd0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.517+0000 7faedbf95700 1 --2- 172.21.15.31:0/1555672225 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faed415a2b0 0x7faed40b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.517+0000 7faedbf95700 1 -- 172.21.15.31:0/1555672225 >> 172.21.15.31:0/1555672225 conn(0x7faed4067e40 msgr2=0x7faed40d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.517+0000 7faedbf95700 1 -- 172.21.15.31:0/1555672225 shutdown_connections 2023-10-09T06:27:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.517+0000 7faedbf95700 1 -- 172.21.15.31:0/1555672225 wait complete. 2023-10-09T06:27:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.518+0000 7faedbf95700 1 Processor -- start 2023-10-09T06:27:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.518+0000 7faedbf95700 1 -- start start 2023-10-09T06:27:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.518+0000 7faedbf95700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed40cfe20 0x7faed40c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.518+0000 7faedbf95700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faed40d1c30 0x7faed415c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.518+0000 7faedbf95700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415a2b0 0x7faed415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.518+0000 7faedbf95700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed40c94f0 con 0x7faed415a2b0 2023-10-09T06:27:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.518+0000 7faedbf95700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed40c9980 con 0x7faed40cfe20 2023-10-09T06:27:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.518+0000 7faedbf95700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed40c88e0 con 0x7faed40d1c30 2023-10-09T06:27:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faeda532700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415a2b0 0x7faed415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faeda532700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415a2b0 0x7faed415cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47742/0 (socket says 172.21.15.31:47742) 2023-10-09T06:27:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faeda532700 1 -- 172.21.15.31:0/2519752549 learned_addr learned my addr 172.21.15.31:0/2519752549 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faed9d31700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed40cfe20 0x7faed40c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faed9530700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faed40d1c30 0x7faed415c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faeda532700 1 -- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faed40d1c30 msgr2=0x7faed415c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faeda532700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faed40d1c30 0x7faed415c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faeda532700 1 -- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed40cfe20 msgr2=0x7faed40c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faeda532700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed40cfe20 0x7faed40c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faeda532700 1 -- 172.21.15.31:0/2519752549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec4009ae0 con 0x7faed415a2b0 2023-10-09T06:27:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faeda532700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415a2b0 0x7faed415cdf0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7faed4089120 tx=0x7faec4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faed1ffb700 1 -- 172.21.15.31:0/2519752549 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4008ad0 con 0x7faed415a2b0 2023-10-09T06:27:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faed1ffb700 1 -- 172.21.15.31:0/2519752549 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec4008c30 con 0x7faed415a2b0 2023-10-09T06:27:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faedbf95700 1 -- 172.21.15.31:0/2519752549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed40c8bc0 con 0x7faed415a2b0 2023-10-09T06:27:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faed1ffb700 1 -- 172.21.15.31:0/2519752549 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec401c410 con 0x7faed415a2b0 2023-10-09T06:27:41.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.519+0000 7faedbf95700 1 -- 172.21.15.31:0/2519752549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed40c9180 con 0x7faed415a2b0 2023-10-09T06:27:41.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.520+0000 7faedbf95700 1 -- 172.21.15.31:0/2519752549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed40c9660 con 0x7faed415a2b0 2023-10-09T06:27:41.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.521+0000 7faed1ffb700 1 -- 172.21.15.31:0/2519752549 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faec4003040 con 0x7faed415a2b0 2023-10-09T06:27:41.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.521+0000 7faed1ffb700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.521+0000 7faed1ffb700 1 -- 172.21.15.31:0/2519752549 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faec4085fc0 con 0x7faed415a2b0 2023-10-09T06:27:41.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.521+0000 7faed9d31700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.522+0000 7faed9d31700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faec0066f30 0x7faec00693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7faecc009d00 tx=0x7faecc009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:41.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.526+0000 7faed1ffb700 1 -- 172.21.15.31:0/2519752549 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faec4053230 con 0x7faed415a2b0 2023-10-09T06:27:41.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.764+0000 7faedbf95700 1 -- 172.21.15.31:0/2519752549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faed404c3c0 con 0x7faed415a2b0 2023-10-09T06:27:41.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.764+0000 7faed1ffb700 1 -- 172.21.15.31:0/2519752549 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4602 (secure 0 0 0) 0x7faec4056850 con 0x7faed415a2b0 2023-10-09T06:27:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:41.767 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/1232957657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1232957657},{"type":"v1","addr":"172.21.15.158:6836","nonce":1232957657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2947695434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2947695434},{"type":"v1","addr":"172.21.15.158:6837","nonce":2947695434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/912397379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":912397379},{"type":"v1","addr":"172.21.15.31:6834","nonce":912397379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:07.779885+0000","modified":"2023-10-09T06:27:12.402382+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7005},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7005":{"gid":7005,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1684509217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1684509217},{"type":"v1","addr":"172.21.15.31:6835","nonce":1684509217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T06:27:41.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.766+0000 7faedbf95700 1 -- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faec0066f30 msgr2=0x7faec00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.766+0000 7faedbf95700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faec0066f30 0x7faec00693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7faecc009d00 tx=0x7faecc009120 comp rx=0 tx=0).stop 2023-10-09T06:27:41.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.766+0000 7faedbf95700 1 -- 172.21.15.31:0/2519752549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415a2b0 msgr2=0x7faed415cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.766+0000 7faedbf95700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415a2b0 0x7faed415cdf0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7faed4089120 tx=0x7faec4018000 comp rx=0 tx=0).stop 2023-10-09T06:27:41.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.766+0000 7faedbf95700 1 -- 172.21.15.31:0/2519752549 shutdown_connections 2023-10-09T06:27:41.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.766+0000 7faedbf95700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.766+0000 7faedbf95700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415a2b0 0x7faed415cdf0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.766+0000 7faedbf95700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faed40cfe20 0x7faed40c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.766+0000 7faedbf95700 1 --2- 172.21.15.31:0/2519752549 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faed40d1c30 0x7faed415c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.766+0000 7faedbf95700 1 -- 172.21.15.31:0/2519752549 >> 172.21.15.31:0/2519752549 conn(0x7faed4067e40 msgr2=0x7faed40cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:41.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.766+0000 7faedbf95700 1 -- 172.21.15.31:0/2519752549 shutdown_connections 2023-10-09T06:27:41.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.767+0000 7faedbf95700 1 -- 172.21.15.31:0/2519752549 wait complete. 2023-10-09T06:27:41.769 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 66 2023-10-09T06:27:41.779 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:27:41.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.899+0000 7f8e94119700 1 Processor -- start 2023-10-09T06:27:41.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.899+0000 7f8e94119700 1 -- start start 2023-10-09T06:27:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e94119700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e8c0af1e0 0x7f8e8c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e94119700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8e8c0b1680 0x7f8e8c159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e94119700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8c0b2890 con 0x7f8e8c0af5b0 2023-10-09T06:27:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e94119700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8c0b1c80 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e94119700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8c0b1f60 con 0x7f8e8c0b1680 2023-10-09T06:27:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e91eb5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e8c0af1e0 0x7f8e8c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e916b4700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8e8c0af5b0 0x7f8e8c06f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46010/0 (socket says 172.21.15.31:46010) 2023-10-09T06:27:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e916b4700 1 -- 172.21.15.31:0/4168482238 learned_addr learned my addr 172.21.15.31:0/4168482238 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e926b6700 1 --2- 172.21.15.31:0/4168482238 >> v2:172.21.15.158:3300/0 conn(0x7f8e8c0b1680 0x7f8e8c159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e91eb5700 1 -- 172.21.15.31:0/4168482238 >> v2:172.21.15.158:3300/0 conn(0x7f8e8c0b1680 msgr2=0x7f8e8c159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e91eb5700 1 --2- 172.21.15.31:0/4168482238 >> v2:172.21.15.158:3300/0 conn(0x7f8e8c0b1680 0x7f8e8c159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e91eb5700 1 -- 172.21.15.31:0/4168482238 >> v1:172.21.15.31:6789/0 conn(0x7f8e8c0af5b0 legacy=0x7f8e8c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e91eb5700 1 -- 172.21.15.31:0/4168482238 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c0b2240 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e90eb3700 1 -- 172.21.15.31:0/4168482238 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468710956 0 0) 0x7f8e8c0b2890 con 0x7f8e8c0af5b0 2023-10-09T06:27:41.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.900+0000 7f8e91eb5700 1 --2- 172.21.15.31:0/4168482238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c0af1e0 0x7f8e8c0b2d20 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0ce2f0 tx=0x7f8e84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ed3269955ef767 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:41.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.901+0000 7f8e90eb3700 1 -- 172.21.15.31:0/4168482238 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8400e070 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.901+0000 7f8e90eb3700 1 -- 172.21.15.31:0/4168482238 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8400bc30 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.901+0000 7f8e90eb3700 1 -- 172.21.15.31:0/4168482238 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84012430 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.901+0000 7f8e94119700 1 -- 172.21.15.31:0/4168482238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c0af1e0 msgr2=0x7f8e8c0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.901+0000 7f8e94119700 1 --2- 172.21.15.31:0/4168482238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c0af1e0 0x7f8e8c0b2d20 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0ce2f0 tx=0x7f8e84009780 comp rx=0 tx=0).stop 2023-10-09T06:27:41.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.901+0000 7f8e94119700 1 -- 172.21.15.31:0/4168482238 shutdown_connections 2023-10-09T06:27:41.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.901+0000 7f8e94119700 1 --2- 172.21.15.31:0/4168482238 >> v2:172.21.15.158:3300/0 conn(0x7f8e8c0b1680 0x7f8e8c159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.901+0000 7f8e94119700 1 --2- 172.21.15.31:0/4168482238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c0af1e0 0x7f8e8c0b2d20 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.901+0000 7f8e94119700 1 -- 172.21.15.31:0/4168482238 >> 172.21.15.31:0/4168482238 conn(0x7f8e8c0cd1e0 msgr2=0x7f8e8c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:41.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.901+0000 7f8e94119700 1 -- 172.21.15.31:0/4168482238 shutdown_connections 2023-10-09T06:27:41.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.901+0000 7f8e94119700 1 -- 172.21.15.31:0/4168482238 wait complete. 2023-10-09T06:27:41.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.902+0000 7f8e94119700 1 Processor -- start 2023-10-09T06:27:41.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.902+0000 7f8e94119700 1 -- start start 2023-10-09T06:27:41.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e94119700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c0af1e0 0x7f8e8c14c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e94119700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e8c0af5b0 0x7f8e8c099dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e94119700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e8c0b1680 0x7f8e8c09a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e94119700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0ad1e0 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e94119700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c14cd50 con 0x7f8e8c0af5b0 2023-10-09T06:27:41.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e94119700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c09a840 con 0x7f8e8c0b1680 2023-10-09T06:27:41.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e91eb5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c0af1e0 0x7f8e8c14c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e91eb5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c0af1e0 0x7f8e8c14c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47766/0 (socket says 172.21.15.31:47766) 2023-10-09T06:27:41.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e91eb5700 1 -- 172.21.15.31:0/2617838240 learned_addr learned my addr 172.21.15.31:0/2617838240 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:41.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e916b4700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e8c0af5b0 0x7f8e8c099dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e926b6700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e8c0b1680 0x7f8e8c09a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e91eb5700 1 -- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e8c0b1680 msgr2=0x7f8e8c09a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e91eb5700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e8c0b1680 0x7f8e8c09a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e91eb5700 1 -- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e8c0af5b0 msgr2=0x7f8e8c099dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:41.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e91eb5700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e8c0af5b0 0x7f8e8c099dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:41.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.903+0000 7f8e91eb5700 1 -- 172.21.15.31:0/2617838240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e84009a20 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.904+0000 7f8e91eb5700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c0af1e0 0x7f8e8c14c810 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8e840099f0 tx=0x7f8e84019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:41.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.904+0000 7f8e81ffb700 1 -- 172.21.15.31:0/2617838240 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84027470 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.904+0000 7f8e81ffb700 1 -- 172.21.15.31:0/2617838240 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e84027610 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.904+0000 7f8e94119700 1 -- 172.21.15.31:0/2617838240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c160700 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.904+0000 7f8e81ffb700 1 -- 172.21.15.31:0/2617838240 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e840279d0 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.904+0000 7f8e94119700 1 -- 172.21.15.31:0/2617838240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c160420 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.905+0000 7f8e94119700 1 -- 172.21.15.31:0/2617838240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c04c3c0 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.905+0000 7f8e81ffb700 1 -- 172.21.15.31:0/2617838240 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e84024070 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.906+0000 7f8e81ffb700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e70066f30 0x7f8e700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:41.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.906+0000 7f8e81ffb700 1 -- 172.21.15.31:0/2617838240 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e84086b30 con 0x7f8e8c0af1e0 2023-10-09T06:27:41.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.906+0000 7f8e916b4700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e70066f30 0x7f8e700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:41.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.907+0000 7f8e916b4700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e70066f30 0x7f8e700693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c155450 tx=0x7f8e7c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:41.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:41.910+0000 7f8e81ffb700 1 -- 172.21.15.31:0/2617838240 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e84053e50 con 0x7f8e8c0af1e0 2023-10-09T06:27:42.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.149+0000 7f8e94119700 1 -- 172.21.15.31:0/2617838240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e8c063c00 con 0x7f8e8c0af1e0 2023-10-09T06:27:42.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.149+0000 7f8e81ffb700 1 -- 172.21.15.31:0/2617838240 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f8e84057470 con 0x7f8e8c0af1e0 2023-10-09T06:27:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:42.151 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/1232957657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1232957657},{"type":"v1","addr":"172.21.15.158:6836","nonce":1232957657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2947695434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2947695434},{"type":"v1","addr":"172.21.15.158:6837","nonce":2947695434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/912397379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":912397379},{"type":"v1","addr":"172.21.15.31:6834","nonce":912397379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:07.779885+0000","modified":"2023-10-09T06:27:12.402382+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7005},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7005":{"gid":7005,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1684509217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1684509217},{"type":"v1","addr":"172.21.15.31:6835","nonce":1684509217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T06:27:42.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.151+0000 7f8e94119700 1 -- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e70066f30 msgr2=0x7f8e700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.151+0000 7f8e94119700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e70066f30 0x7f8e700693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c155450 tx=0x7f8e7c007d30 comp rx=0 tx=0).stop 2023-10-09T06:27:42.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.151+0000 7f8e94119700 1 -- 172.21.15.31:0/2617838240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c0af1e0 msgr2=0x7f8e8c14c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.151+0000 7f8e94119700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c0af1e0 0x7f8e8c14c810 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8e840099f0 tx=0x7f8e84019000 comp rx=0 tx=0).stop 2023-10-09T06:27:42.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.151+0000 7f8e94119700 1 -- 172.21.15.31:0/2617838240 shutdown_connections 2023-10-09T06:27:42.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.151+0000 7f8e94119700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e70066f30 0x7f8e700693e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.151+0000 7f8e94119700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8e8c0b1680 0x7f8e8c09a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.151+0000 7f8e94119700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c0af1e0 0x7f8e8c14c810 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.151+0000 7f8e94119700 1 --2- 172.21.15.31:0/2617838240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e8c0af5b0 0x7f8e8c099dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.151+0000 7f8e94119700 1 -- 172.21.15.31:0/2617838240 >> 172.21.15.31:0/2617838240 conn(0x7f8e8c0cd1e0 msgr2=0x7f8e8c1577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.152+0000 7f8e94119700 1 -- 172.21.15.31:0/2617838240 shutdown_connections 2023-10-09T06:27:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.152+0000 7f8e94119700 1 -- 172.21.15.31:0/2617838240 wait complete. 2023-10-09T06:27:42.154 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 66 2023-10-09T06:27:42.165 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:27:42.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.285+0000 7fce88598700 1 Processor -- start 2023-10-09T06:27:42.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.285+0000 7fce88598700 1 -- start start 2023-10-09T06:27:42.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.286+0000 7fce88598700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce80157870 0x7fce8015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:42.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.286+0000 7fce88598700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce80157c40 0x7fce80158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:42.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.286+0000 7fce88598700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8015cbb0 con 0x7fce8015a620 2023-10-09T06:27:42.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.286+0000 7fce88598700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8015bfa0 con 0x7fce80157c40 2023-10-09T06:27:42.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.286+0000 7fce88598700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8015c280 con 0x7fce80157870 2023-10-09T06:27:42.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.287+0000 7fce86b35700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce80157c40 0x7fce80158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:42.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.287+0000 7fce85b33700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fce8015a620 0x7fce8015d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46020/0 (socket says 172.21.15.31:46020) 2023-10-09T06:27:42.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.287+0000 7fce85b33700 1 -- 172.21.15.31:0/1377036073 learned_addr learned my addr 172.21.15.31:0/1377036073 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:42.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.287+0000 7fce86b35700 1 -- 172.21.15.31:0/1377036073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce80157870 msgr2=0x7fce8015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:42.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.287+0000 7fce86b35700 1 --2- 172.21.15.31:0/1377036073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce80157870 0x7fce8015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.287+0000 7fce86b35700 1 -- 172.21.15.31:0/1377036073 >> v1:172.21.15.31:6789/0 conn(0x7fce8015a620 legacy=0x7fce8015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.287+0000 7fce85332700 1 -- 172.21.15.31:0/1377036073 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949885950 0 0) 0x7fce8015cbb0 con 0x7fce8015a620 2023-10-09T06:27:42.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.287+0000 7fce86b35700 1 -- 172.21.15.31:0/1377036073 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8015c560 con 0x7fce80157c40 2023-10-09T06:27:42.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.287+0000 7fce86b35700 1 --2- 172.21.15.31:0/1377036073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce80157c40 0x7fce80158110 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fce700098e0 tx=0x7fce700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623a18ea9f8ce049 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:42.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.287+0000 7fce85332700 1 -- 172.21.15.31:0/1377036073 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70009e80 con 0x7fce80157c40 2023-10-09T06:27:42.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.287+0000 7fce85332700 1 -- 172.21.15.31:0/1377036073 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7000b860 con 0x7fce80157c40 2023-10-09T06:27:42.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.287+0000 7fce85332700 1 -- 172.21.15.31:0/1377036073 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7000bbe0 con 0x7fce80157c40 2023-10-09T06:27:42.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.288+0000 7fce88598700 1 -- 172.21.15.31:0/1377036073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce80157c40 msgr2=0x7fce80158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.288+0000 7fce88598700 1 --2- 172.21.15.31:0/1377036073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce80157c40 0x7fce80158110 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fce700098e0 tx=0x7fce700091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.288+0000 7fce88598700 1 -- 172.21.15.31:0/1377036073 shutdown_connections 2023-10-09T06:27:42.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.288+0000 7fce88598700 1 --2- 172.21.15.31:0/1377036073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce80157c40 0x7fce80158110 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.288+0000 7fce88598700 1 --2- 172.21.15.31:0/1377036073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce80157870 0x7fce8015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.288+0000 7fce88598700 1 -- 172.21.15.31:0/1377036073 >> 172.21.15.31:0/1377036073 conn(0x7fce80068ce0 msgr2=0x7fce800690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:42.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.288+0000 7fce88598700 1 -- 172.21.15.31:0/1377036073 shutdown_connections 2023-10-09T06:27:42.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.288+0000 7fce88598700 1 -- 172.21.15.31:0/1377036073 wait complete. 2023-10-09T06:27:42.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.289+0000 7fce88598700 1 Processor -- start 2023-10-09T06:27:42.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.289+0000 7fce88598700 1 -- start start 2023-10-09T06:27:42.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce88598700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce80157870 0x7fce800b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:42.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce88598700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce80157c40 0x7fce80167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:42.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce88598700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce8015a620 0x7fce8016a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:42.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce88598700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8015de60 con 0x7fce80157c40 2023-10-09T06:27:42.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce88598700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800b25d0 con 0x7fce8015a620 2023-10-09T06:27:42.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce88598700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce800b28b0 con 0x7fce80157870 2023-10-09T06:27:42.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce85b33700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce80157c40 0x7fce80167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:42.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce85b33700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce80157c40 0x7fce80167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47784/0 (socket says 172.21.15.31:47784) 2023-10-09T06:27:42.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce85b33700 1 -- 172.21.15.31:0/2318673234 learned_addr learned my addr 172.21.15.31:0/2318673234 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:42.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce86b35700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce8015a620 0x7fce8016a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:42.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce86334700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce80157870 0x7fce800b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:42.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce85b33700 1 -- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce80157870 msgr2=0x7fce800b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce85b33700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce80157870 0x7fce800b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce85b33700 1 -- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce8015a620 msgr2=0x7fce8016a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce85b33700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce8015a620 0x7fce8016a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce85b33700 1 -- 172.21.15.31:0/2318673234 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce70009420 con 0x7fce80157c40 2023-10-09T06:27:42.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce86b35700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce8015a620 0x7fce8016a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:42.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce85b33700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce80157c40 0x7fce80167d70 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c5b0 tx=0x7fce74001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:42.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce7e7fc700 1 -- 172.21.15.31:0/2318673234 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74005b30 con 0x7fce80157c40 2023-10-09T06:27:42.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce7e7fc700 1 -- 172.21.15.31:0/2318673234 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74005c90 con 0x7fce80157c40 2023-10-09T06:27:42.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce88598700 1 -- 172.21.15.31:0/2318673234 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce800b2b90 con 0x7fce80157c40 2023-10-09T06:27:42.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce7e7fc700 1 -- 172.21.15.31:0/2318673234 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74007300 con 0x7fce80157c40 2023-10-09T06:27:42.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.290+0000 7fce88598700 1 -- 172.21.15.31:0/2318673234 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce801537a0 con 0x7fce80157c40 2023-10-09T06:27:42.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.291+0000 7fce88598700 1 -- 172.21.15.31:0/2318673234 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8015dfd0 con 0x7fce80157c40 2023-10-09T06:27:42.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.292+0000 7fce7e7fc700 1 -- 172.21.15.31:0/2318673234 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce7401b3b0 con 0x7fce80157c40 2023-10-09T06:27:42.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.292+0000 7fce7e7fc700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fce6c066f30 0x7fce6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:42.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.292+0000 7fce7e7fc700 1 -- 172.21.15.31:0/2318673234 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce74083a70 con 0x7fce80157c40 2023-10-09T06:27:42.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.292+0000 7fce86334700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fce6c066f30 0x7fce6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:42.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.293+0000 7fce86334700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fce6c066f30 0x7fce6c0693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fce78001250 tx=0x7fce78009620 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:42.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.297+0000 7fce7e7fc700 1 -- 172.21.15.31:0/2318673234 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce74050ce0 con 0x7fce80157c40 2023-10-09T06:27:42.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.492+0000 7fce88598700 1 -- 172.21.15.31:0/2318673234 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce8004c3c0 con 0x7fce80157c40 2023-10-09T06:27:42.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.493+0000 7fce7e7fc700 1 -- 172.21.15.31:0/2318673234 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+15372 (secure 0 0 0) 0x7fce74017090 con 0x7fce80157c40 2023-10-09T06:27:42.494 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:42.494 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":139,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:27:36.748970+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:27:06.232021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T06:27:06.742407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:27:42.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.495+0000 7fce88598700 1 -- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fce6c066f30 msgr2=0x7fce6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.495+0000 7fce88598700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fce6c066f30 0x7fce6c0693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fce78001250 tx=0x7fce78009620 comp rx=0 tx=0).stop 2023-10-09T06:27:42.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.495+0000 7fce88598700 1 -- 172.21.15.31:0/2318673234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce80157c40 msgr2=0x7fce80167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.495+0000 7fce88598700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce80157c40 0x7fce80167d70 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c5b0 tx=0x7fce74001070 comp rx=0 tx=0).stop 2023-10-09T06:27:42.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.495+0000 7fce88598700 1 -- 172.21.15.31:0/2318673234 shutdown_connections 2023-10-09T06:27:42.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.495+0000 7fce88598700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fce6c066f30 0x7fce6c0693e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.495+0000 7fce88598700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fce80157870 0x7fce800b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.495+0000 7fce88598700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce8015a620 0x7fce8016a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.495+0000 7fce88598700 1 --2- 172.21.15.31:0/2318673234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce80157c40 0x7fce80167d70 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.495+0000 7fce88598700 1 -- 172.21.15.31:0/2318673234 >> 172.21.15.31:0/2318673234 conn(0x7fce80068ce0 msgr2=0x7fce800b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:42.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.495+0000 7fce88598700 1 -- 172.21.15.31:0/2318673234 shutdown_connections 2023-10-09T06:27:42.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.495+0000 7fce88598700 1 -- 172.21.15.31:0/2318673234 wait complete. 2023-10-09T06:27:42.508 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:27:42.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.628+0000 7fd2f23f3700 1 Processor -- start 2023-10-09T06:27:42.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.628+0000 7fd2f23f3700 1 -- start start 2023-10-09T06:27:42.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.628+0000 7fd2f23f3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2ec159e10 0x7fd2ec0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:42.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.628+0000 7fd2f23f3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ec15db80 con 0x7fd2ec15a1e0 2023-10-09T06:27:42.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.628+0000 7fd2f23f3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ec15de60 con 0x7fd2ec0cde50 2023-10-09T06:27:42.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.628+0000 7fd2f23f3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ec15e800 con 0x7fd2ec159e10 2023-10-09T06:27:42.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.629+0000 7fd2ebfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2ec159e10 0x7fd2ec0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:42.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.629+0000 7fd2eb7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd2ec15a1e0 0x7fd2ec0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46028/0 (socket says 172.21.15.31:46028) 2023-10-09T06:27:42.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.629+0000 7fd2eb7fe700 1 -- 172.21.15.31:0/2062359021 learned_addr learned my addr 172.21.15.31:0/2062359021 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:42.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.629+0000 7fd2ebfff700 1 -- 172.21.15.31:0/2062359021 >> v1:172.21.15.158:6789/0 conn(0x7fd2ec0cde50 legacy=0x7fd2ec0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.629+0000 7fd2ebfff700 1 -- 172.21.15.31:0/2062359021 >> v1:172.21.15.31:6789/0 conn(0x7fd2ec15a1e0 legacy=0x7fd2ec0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.629+0000 7fd2eaffd700 1 -- 172.21.15.31:0/2062359021 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290512328 0 0) 0x7fd2ec15db80 con 0x7fd2ec15a1e0 2023-10-09T06:27:42.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.629+0000 7fd2ebfff700 1 -- 172.21.15.31:0/2062359021 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec15e140 con 0x7fd2ec159e10 2023-10-09T06:27:42.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.629+0000 7fd2ebfff700 1 --2- 172.21.15.31:0/2062359021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ec159e10 0x7fd2ec0b2d20 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40098e0 tx=0x7fd2d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ce97418d1f8fbd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:42.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.629+0000 7fd2eaffd700 1 -- 172.21.15.31:0/2062359021 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4009e80 con 0x7fd2ec159e10 2023-10-09T06:27:42.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.629+0000 7fd2eaffd700 1 -- 172.21.15.31:0/2062359021 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d400b860 con 0x7fd2ec159e10 2023-10-09T06:27:42.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.629+0000 7fd2eaffd700 1 -- 172.21.15.31:0/2062359021 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400bbe0 con 0x7fd2ec159e10 2023-10-09T06:27:42.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.630+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2062359021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ec159e10 msgr2=0x7fd2ec0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.630+0000 7fd2f23f3700 1 --2- 172.21.15.31:0/2062359021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ec159e10 0x7fd2ec0b2d20 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40098e0 tx=0x7fd2d40091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.630+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2062359021 shutdown_connections 2023-10-09T06:27:42.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.630+0000 7fd2f23f3700 1 --2- 172.21.15.31:0/2062359021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ec159e10 0x7fd2ec0b2d20 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.630+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2062359021 >> 172.21.15.31:0/2062359021 conn(0x7fd2ec067660 msgr2=0x7fd2ec067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:42.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.630+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2062359021 shutdown_connections 2023-10-09T06:27:42.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.630+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2062359021 wait complete. 2023-10-09T06:27:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.631+0000 7fd2f23f3700 1 Processor -- start 2023-10-09T06:27:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.631+0000 7fd2f23f3700 1 -- start start 2023-10-09T06:27:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2f23f3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ec0cde50 0x7fd2ec0c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2f23f3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd2ec159e10 0x7fd2ec158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2f23f3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2ec15a1e0 0x7fd2ec15b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2f23f3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0c6950 con 0x7fd2ec0cde50 2023-10-09T06:27:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2f23f3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0b0890 con 0x7fd2ec15a1e0 2023-10-09T06:27:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2f23f3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0c5f80 con 0x7fd2ec159e10 2023-10-09T06:27:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ec0cde50 0x7fd2ec0c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ec0cde50 0x7fd2ec0c6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47808/0 (socket says 172.21.15.31:47808) 2023-10-09T06:27:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2ebfff700 1 -- 172.21.15.31:0/2372328233 learned_addr learned my addr 172.21.15.31:0/2372328233 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2f0990700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2ec15a1e0 0x7fd2ec15b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2eb7fe700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd2ec159e10 0x7fd2ec158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2ebfff700 1 -- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd2ec159e10 msgr2=0x7fd2ec158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2ebfff700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd2ec159e10 0x7fd2ec158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2ebfff700 1 -- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2ec15a1e0 msgr2=0x7fd2ec15b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2ebfff700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2ec15a1e0 0x7fd2ec15b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2ebfff700 1 -- 172.21.15.31:0/2372328233 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d4009420 con 0x7fd2ec0cde50 2023-10-09T06:27:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2f0990700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2ec15a1e0 0x7fd2ec15b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2eb7fe700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd2ec159e10 0x7fd2ec158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2ebfff700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ec0cde50 0x7fd2ec0c6410 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009fc0 tx=0x7fd2d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2e3fff700 1 -- 172.21.15.31:0/2372328233 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d401f070 con 0x7fd2ec0cde50 2023-10-09T06:27:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2e3fff700 1 -- 172.21.15.31:0/2372328233 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d4011420 con 0x7fd2ec0cde50 2023-10-09T06:27:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.632+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2372328233 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ec0c5370 con 0x7fd2ec0cde50 2023-10-09T06:27:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.633+0000 7fd2e3fff700 1 -- 172.21.15.31:0/2372328233 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400bbe0 con 0x7fd2ec0cde50 2023-10-09T06:27:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.633+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2372328233 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ec0c59b0 con 0x7fd2ec0cde50 2023-10-09T06:27:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.634+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2372328233 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ec0c5d30 con 0x7fd2ec0cde50 2023-10-09T06:27:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.634+0000 7fd2e3fff700 1 -- 172.21.15.31:0/2372328233 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2d4011a50 con 0x7fd2ec0cde50 2023-10-09T06:27:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.634+0000 7fd2e3fff700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd2cc066f30 0x7fd2cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.634+0000 7fd2e3fff700 1 -- 172.21.15.31:0/2372328233 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd2d4085a20 con 0x7fd2ec0cde50 2023-10-09T06:27:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.635+0000 7fd2eb7fe700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd2cc066f30 0x7fd2cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.635+0000 7fd2eb7fe700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd2cc066f30 0x7fd2cc0693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec15c3b0 tx=0x7fd2dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:42.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.639+0000 7fd2e3fff700 1 -- 172.21.15.31:0/2372328233 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2d4052c90 con 0x7fd2ec0cde50 2023-10-09T06:27:42.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.879+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2372328233 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd2ec04c3c0 con 0x7fd2ec0cde50 2023-10-09T06:27:42.880 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:27:42.879+0000 7fc5e82b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:27:42.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.883+0000 7fd2e3fff700 1 -- 172.21.15.31:0/2372328233 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd2d40562b0 con 0x7fd2ec0cde50 2023-10-09T06:27:42.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.886+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd2cc066f30 msgr2=0x7fd2cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.886+0000 7fd2f23f3700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd2cc066f30 0x7fd2cc0693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec15c3b0 tx=0x7fd2dc009040 comp rx=0 tx=0).stop 2023-10-09T06:27:42.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.886+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2372328233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ec0cde50 msgr2=0x7fd2ec0c6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.886+0000 7fd2f23f3700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ec0cde50 0x7fd2ec0c6410 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009fc0 tx=0x7fd2d4017000 comp rx=0 tx=0).stop 2023-10-09T06:27:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.887+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2372328233 shutdown_connections 2023-10-09T06:27:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.887+0000 7fd2f23f3700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd2cc066f30 0x7fd2cc0693e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.887+0000 7fd2f23f3700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2ec15a1e0 0x7fd2ec15b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.887+0000 7fd2f23f3700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ec0cde50 0x7fd2ec0c6410 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.887+0000 7fd2f23f3700 1 --2- 172.21.15.31:0/2372328233 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd2ec159e10 0x7fd2ec158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.887+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2372328233 >> 172.21.15.31:0/2372328233 conn(0x7fd2ec067660 msgr2=0x7fd2ec159210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.887+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2372328233 shutdown_connections 2023-10-09T06:27:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:42.887+0000 7fd2f23f3700 1 -- 172.21.15.31:0/2372328233 wait complete. 2023-10-09T06:27:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:27:42.889 INFO:tasks.ceph.mds.c.smithi031.stderr: -7442> 2023-10-09T06:27:13.701+0000 7f4337ac3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:27:42.905 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:27:42.925 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-10-09T06:27:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.028+0000 7f37cb156700 1 Processor -- start 2023-10-09T06:27:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.028+0000 7f37cb156700 1 -- start start 2023-10-09T06:27:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.029+0000 7f37cb156700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f37c41569c0 0x7f37c40a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.029+0000 7f37cb156700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37c406ea00 0x7f37c40cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.029+0000 7f37cb156700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c40cdb90 con 0x7f37c4156d90 2023-10-09T06:27:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.029+0000 7f37cb156700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c40c78c0 con 0x7f37c41569c0 2023-10-09T06:27:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.029+0000 7f37cb156700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40c7ba0 con 0x7f37c406ea00 2023-10-09T06:27:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.029+0000 7f37c3fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f37c4156d90 0x7f37c406e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46046/0 (socket says 172.21.15.31:46046) 2023-10-09T06:27:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.029+0000 7f37c3fff700 1 -- 172.21.15.31:0/1021159792 learned_addr learned my addr 172.21.15.31:0/1021159792 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.029+0000 7f37c96f3700 1 --2- 172.21.15.31:0/1021159792 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37c406ea00 0x7f37c40cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.029+0000 7f37c8ef2700 1 --2- 172.21.15.31:0/1021159792 >> v2:172.21.15.158:3300/0 conn(0x7f37c41569c0 0x7f37c40a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.029+0000 7f37c37fe700 1 -- 172.21.15.31:0/1021159792 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537998726 0 0) 0x7f37c40cdb90 con 0x7f37c4156d90 2023-10-09T06:27:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.029+0000 7f37c37fe700 1 -- 172.21.15.31:0/1021159792 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37ac003570 con 0x7f37c4156d90 2023-10-09T06:27:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.029+0000 7f37c96f3700 1 -- 172.21.15.31:0/1021159792 >> v2:172.21.15.158:3300/0 conn(0x7f37c41569c0 msgr2=0x7f37c40a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.029+0000 7f37c96f3700 1 --2- 172.21.15.31:0/1021159792 >> v2:172.21.15.158:3300/0 conn(0x7f37c41569c0 0x7f37c40a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37c96f3700 1 -- 172.21.15.31:0/1021159792 >> v1:172.21.15.31:6789/0 conn(0x7f37c4156d90 legacy=0x7f37c406e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37c37fe700 1 -- 172.21.15.31:0/1021159792 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1584240336 0 0) 0x7f37ac003570 con 0x7f37c4156d90 2023-10-09T06:27:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37c96f3700 1 -- 172.21.15.31:0/1021159792 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c40c7e80 con 0x7f37c406ea00 2023-10-09T06:27:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37c8ef2700 1 --2- 172.21.15.31:0/1021159792 >> v2:172.21.15.158:3300/0 conn(0x7f37c41569c0 0x7f37c40a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:27:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37c96f3700 1 --2- 172.21.15.31:0/1021159792 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37c406ea00 0x7f37c40cbe30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009e90 tx=0x7f37bc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b165c5225b5f952 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37c37fe700 1 -- 172.21.15.31:0/1021159792 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc00e070 con 0x7f37c406ea00 2023-10-09T06:27:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37c37fe700 1 -- 172.21.15.31:0/1021159792 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc00b870 con 0x7f37c406ea00 2023-10-09T06:27:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37c37fe700 1 -- 172.21.15.31:0/1021159792 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8001470 con 0x7f37c406ea00 2023-10-09T06:27:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37cb156700 1 -- 172.21.15.31:0/1021159792 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37c406ea00 msgr2=0x7f37c40cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37cb156700 1 --2- 172.21.15.31:0/1021159792 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37c406ea00 0x7f37c40cbe30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009e90 tx=0x7f37bc009780 comp rx=0 tx=0).stop 2023-10-09T06:27:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37cb156700 1 -- 172.21.15.31:0/1021159792 shutdown_connections 2023-10-09T06:27:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37cb156700 1 --2- 172.21.15.31:0/1021159792 >> v2:172.21.15.158:3300/0 conn(0x7f37c41569c0 0x7f37c40a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37cb156700 1 --2- 172.21.15.31:0/1021159792 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37c406ea00 0x7f37c40cbe30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.030+0000 7f37cb156700 1 -- 172.21.15.31:0/1021159792 >> 172.21.15.31:0/1021159792 conn(0x7f37c4068170 msgr2=0x7f37c40cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.031+0000 7f37cb156700 1 -- 172.21.15.31:0/1021159792 shutdown_connections 2023-10-09T06:27:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.031+0000 7f37cb156700 1 -- 172.21.15.31:0/1021159792 wait complete. 2023-10-09T06:27:43.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.032+0000 7f37cb156700 1 Processor -- start 2023-10-09T06:27:43.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.032+0000 7f37cb156700 1 -- start start 2023-10-09T06:27:43.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.032+0000 7f37cb156700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37c406ea00 0x7f37c40bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:43.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37cb156700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37c41569c0 0x7f37c4155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:43.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37cb156700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37c4156d90 0x7f37c4155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:43.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37cb156700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c416b1a0 con 0x7f37c406ea00 2023-10-09T06:27:43.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37cb156700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c4099680 con 0x7f37c41569c0 2023-10-09T06:27:43.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37cb156700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40c0380 con 0x7f37c4156d90 2023-10-09T06:27:43.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c8ef2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37c406ea00 0x7f37c40bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:43.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c8ef2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37c406ea00 0x7f37c40bfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47832/0 (socket says 172.21.15.31:47832) 2023-10-09T06:27:43.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c8ef2700 1 -- 172.21.15.31:0/1769320209 learned_addr learned my addr 172.21.15.31:0/1769320209 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:43.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c3fff700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37c41569c0 0x7f37c4155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:43.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c8ef2700 1 -- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37c4156d90 msgr2=0x7f37c4155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:43.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c96f3700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37c4156d90 0x7f37c4155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:43.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c8ef2700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37c4156d90 0x7f37c4155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:43.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c8ef2700 1 -- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37c41569c0 msgr2=0x7f37c4155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:43.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c8ef2700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37c41569c0 0x7f37c4155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:43.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c8ef2700 1 -- 172.21.15.31:0/1769320209 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4009420 con 0x7f37c406ea00 2023-10-09T06:27:43.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c3fff700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37c41569c0 0x7f37c4155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:43.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c8ef2700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37c406ea00 0x7f37c40bfe40 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f37b400ecb0 tx=0x7f37b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:43.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c0ff9700 1 -- 172.21.15.31:0/1769320209 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b400ee60 con 0x7f37c406ea00 2023-10-09T06:27:43.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c0ff9700 1 -- 172.21.15.31:0/1769320209 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b400cbe0 con 0x7f37c406ea00 2023-10-09T06:27:43.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37c0ff9700 1 -- 172.21.15.31:0/1769320209 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4013470 con 0x7f37c406ea00 2023-10-09T06:27:43.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37cb156700 1 -- 172.21.15.31:0/1769320209 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc009a20 con 0x7f37c406ea00 2023-10-09T06:27:43.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.033+0000 7f37cb156700 1 -- 172.21.15.31:0/1769320209 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c4099030 con 0x7f37c406ea00 2023-10-09T06:27:43.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.034+0000 7f37cb156700 1 -- 172.21.15.31:0/1769320209 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c4099960 con 0x7f37c406ea00 2023-10-09T06:27:43.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.035+0000 7f37c0ff9700 1 -- 172.21.15.31:0/1769320209 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37b4013820 con 0x7f37c406ea00 2023-10-09T06:27:43.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.035+0000 7f37c0ff9700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f37b0066f30 0x7f37b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:43.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.035+0000 7f37c0ff9700 1 -- 172.21.15.31:0/1769320209 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f37b4084a20 con 0x7f37c406ea00 2023-10-09T06:27:43.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.035+0000 7f37c3fff700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f37b0066f30 0x7f37b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:43.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.036+0000 7f37c3fff700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f37b0066f30 0x7f37b00693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f37b80011e0 tx=0x7f37b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:43.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.039+0000 7f37c0ff9700 1 -- 172.21.15.31:0/1769320209 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37b4051c00 con 0x7f37c406ea00 2023-10-09T06:27:43.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.277+0000 7f37cb156700 1 -- 172.21.15.31:0/1769320209 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f37c404c3c0 con 0x7f37c406ea00 2023-10-09T06:27:43.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.885+0000 7f37c0ff9700 1 -- 172.21.15.31:0/1769320209 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7f37b4055220 con 0x7f37c406ea00 2023-10-09T06:27:43.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.888+0000 7f37cb156700 1 -- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f37b0066f30 msgr2=0x7f37b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:43.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.888+0000 7f37cb156700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f37b0066f30 0x7f37b00693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f37b80011e0 tx=0x7f37b8009040 comp rx=0 tx=0).stop 2023-10-09T06:27:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.888+0000 7f37cb156700 1 -- 172.21.15.31:0/1769320209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37c406ea00 msgr2=0x7f37c40bfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.888+0000 7f37cb156700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37c406ea00 0x7f37c40bfe40 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f37b400ecb0 tx=0x7f37b40091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.888+0000 7f37cb156700 1 -- 172.21.15.31:0/1769320209 shutdown_connections 2023-10-09T06:27:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.888+0000 7f37cb156700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f37b0066f30 0x7f37b00693e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.888+0000 7f37cb156700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f37c4156d90 0x7f37c4155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.888+0000 7f37cb156700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37c406ea00 0x7f37c40bfe40 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.888+0000 7f37cb156700 1 --2- 172.21.15.31:0/1769320209 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f37c41569c0 0x7f37c4155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.888+0000 7f37cb156700 1 -- 172.21.15.31:0/1769320209 >> 172.21.15.31:0/1769320209 conn(0x7f37c4068170 msgr2=0x7f37c406a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.888+0000 7f37cb156700 1 -- 172.21.15.31:0/1769320209 shutdown_connections 2023-10-09T06:27:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:43.888+0000 7f37cb156700 1 -- 172.21.15.31:0/1769320209 wait complete. 2023-10-09T06:27:43.901 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:27:44.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.065+0000 7fdc663fa700 1 Processor -- start 2023-10-09T06:27:44.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.065+0000 7fdc663fa700 1 -- start start 2023-10-09T06:27:44.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.066+0000 7fdc663fa700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc600b0f80 0x7fdc6015daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:44.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.066+0000 7fdc663fa700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc60067660 con 0x7fdc600c57b0 2023-10-09T06:27:44.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.066+0000 7fdc663fa700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc600684c0 con 0x7fdc6006d4c0 2023-10-09T06:27:44.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.066+0000 7fdc663fa700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6006bfa0 con 0x7fdc600b0f80 2023-10-09T06:27:44.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.066+0000 7fdc64997700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdc600c57b0 0x7fdc6015a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46062/0 (socket says 172.21.15.31:46062) 2023-10-09T06:27:44.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.066+0000 7fdc64997700 1 -- 172.21.15.31:0/191863144 learned_addr learned my addr 172.21.15.31:0/191863144 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:44.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.066+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982091747 0 0) 0x7fdc60067660 con 0x7fdc600c57b0 2023-10-09T06:27:44.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.066+0000 7fdc5ffff700 1 --2- 172.21.15.31:0/191863144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc600b0f80 0x7fdc6015daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:44.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.066+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc4c003570 con 0x7fdc600c57b0 2023-10-09T06:27:44.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 660403620 0 0) 0x7fdc4c003570 con 0x7fdc600c57b0 2023-10-09T06:27:44.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc600b0f80 msgr2=0x7fdc6015daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:44.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 --2- 172.21.15.31:0/191863144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc600b0f80 0x7fdc6015daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:44.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 >> v1:172.21.15.158:6789/0 conn(0x7fdc6006d4c0 legacy=0x7fdc600c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:44.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc600678b0 con 0x7fdc600c57b0 2023-10-09T06:27:44.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fdc580017f0 con 0x7fdc600c57b0 2023-10-09T06:27:44.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 >> v1:172.21.15.31:6789/0 conn(0x7fdc600c57b0 legacy=0x7fdc6015a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:44.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 --2- 172.21.15.31:0/191863144 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc4c003a90 0x7fdc4c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:44.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 --2- 172.21.15.31:0/191863144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc600b0f80 0x7fdc4c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:44.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 --2- 172.21.15.31:0/191863144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc4c004d50 0x7fdc4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:44.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6006bfa0 con 0x7fdc4c004d50 2023-10-09T06:27:44.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c00bb70 con 0x7fdc4c003a90 2023-10-09T06:27:44.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c00bd30 con 0x7fdc600b0f80 2023-10-09T06:27:44.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc64997700 1 --2- 172.21.15.31:0/191863144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc4c004d50 0x7fdc4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:44.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5f7fe700 1 --2- 172.21.15.31:0/191863144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc600b0f80 0x7fdc4c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:44.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5ffff700 1 --2- 172.21.15.31:0/191863144 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc4c003a90 0x7fdc4c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:44.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc64997700 1 -- 172.21.15.31:0/191863144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc600b0f80 msgr2=0x7fdc4c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:44.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc64997700 1 --2- 172.21.15.31:0/191863144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc600b0f80 0x7fdc4c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:44.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc64997700 1 -- 172.21.15.31:0/191863144 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc4c003a90 msgr2=0x7fdc4c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:44.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc64997700 1 --2- 172.21.15.31:0/191863144 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc4c003a90 0x7fdc4c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:44.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc64997700 1 -- 172.21.15.31:0/191863144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c003570 con 0x7fdc4c004d50 2023-10-09T06:27:44.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc64997700 1 --2- 172.21.15.31:0/191863144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc4c004d50 0x7fdc4c0051c0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800a930 tx=0x7fdc580021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7768a0ee8e9a532b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:44.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.067+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580070d0 con 0x7fdc4c004d50 2023-10-09T06:27:44.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.068+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc58007230 con 0x7fdc4c004d50 2023-10-09T06:27:44.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.068+0000 7fdc5effd700 1 -- 172.21.15.31:0/191863144 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580075d0 con 0x7fdc4c004d50 2023-10-09T06:27:44.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.068+0000 7fdc663fa700 1 -- 172.21.15.31:0/191863144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc4c004d50 msgr2=0x7fdc4c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:44.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.068+0000 7fdc663fa700 1 --2- 172.21.15.31:0/191863144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc4c004d50 0x7fdc4c0051c0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800a930 tx=0x7fdc580021d0 comp rx=0 tx=0).stop 2023-10-09T06:27:44.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.068+0000 7fdc64997700 1 -- 172.21.15.31:0/191863144 reap_dead start 2023-10-09T06:27:44.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.068+0000 7fdc663fa700 1 -- 172.21.15.31:0/191863144 shutdown_connections 2023-10-09T06:27:44.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.068+0000 7fdc663fa700 1 -- 172.21.15.31:0/191863144 >> 172.21.15.31:0/191863144 conn(0x7fdc60069870 msgr2=0x7fdc60069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:44.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.068+0000 7fdc663fa700 1 -- 172.21.15.31:0/191863144 shutdown_connections 2023-10-09T06:27:44.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.068+0000 7fdc663fa700 1 -- 172.21.15.31:0/191863144 wait complete. 2023-10-09T06:27:44.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.069+0000 7fdc663fa700 1 Processor -- start 2023-10-09T06:27:44.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.069+0000 7fdc663fa700 1 -- start start 2023-10-09T06:27:44.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc663fa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc4c004d50 0x7fdc600b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:44.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc663fa700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc60140160 0x7fdc600b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:44.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc663fa700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc601405d0 0x7fdc600b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:44.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc663fa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6015af40 con 0x7fdc4c004d50 2023-10-09T06:27:44.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc663fa700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6015b7e0 con 0x7fdc60140160 2023-10-09T06:27:44.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc663fa700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600b3d70 con 0x7fdc601405d0 2023-10-09T06:27:44.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc5ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc4c004d50 0x7fdc600b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:44.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc5ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc4c004d50 0x7fdc600b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47846/0 (socket says 172.21.15.31:47846) 2023-10-09T06:27:44.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc5ffff700 1 -- 172.21.15.31:0/2016539030 learned_addr learned my addr 172.21.15.31:0/2016539030 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:44.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc5f7fe700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc60140160 0x7fdc600b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:44.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc64997700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc601405d0 0x7fdc600b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:44.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc5ffff700 1 -- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc601405d0 msgr2=0x7fdc600b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:44.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc5ffff700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc601405d0 0x7fdc600b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:44.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc5ffff700 1 -- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc60140160 msgr2=0x7fdc600b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:44.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc5ffff700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc60140160 0x7fdc600b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:44.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.070+0000 7fdc5ffff700 1 -- 172.21.15.31:0/2016539030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc60154a90 con 0x7fdc4c004d50 2023-10-09T06:27:44.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.071+0000 7fdc5f7fe700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc60140160 0x7fdc600b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:44.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.071+0000 7fdc5ffff700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc4c004d50 0x7fdc600b1a00 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fdc48011b10 tx=0x7fdc480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:44.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.071+0000 7fdc57fff700 1 -- 172.21.15.31:0/2016539030 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4800f9f0 con 0x7fdc4c004d50 2023-10-09T06:27:44.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.071+0000 7fdc57fff700 1 -- 172.21.15.31:0/2016539030 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4800fb50 con 0x7fdc4c004d50 2023-10-09T06:27:44.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.071+0000 7fdc663fa700 1 -- 172.21.15.31:0/2016539030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6015b190 con 0x7fdc4c004d50 2023-10-09T06:27:44.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.071+0000 7fdc57fff700 1 -- 172.21.15.31:0/2016539030 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4800fed0 con 0x7fdc4c004d50 2023-10-09T06:27:44.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.071+0000 7fdc663fa700 1 -- 172.21.15.31:0/2016539030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6015bc70 con 0x7fdc4c004d50 2023-10-09T06:27:44.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.072+0000 7fdc663fa700 1 -- 172.21.15.31:0/2016539030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6004c3c0 con 0x7fdc4c004d50 2023-10-09T06:27:44.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.072+0000 7fdc57fff700 1 -- 172.21.15.31:0/2016539030 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc48014650 con 0x7fdc4c004d50 2023-10-09T06:27:44.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.072+0000 7fdc57fff700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdc40066f30 0x7fdc400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:44.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.073+0000 7fdc57fff700 1 -- 172.21.15.31:0/2016539030 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fdc48018030 con 0x7fdc4c004d50 2023-10-09T06:27:44.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.073+0000 7fdc5f7fe700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdc40066f30 0x7fdc400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:44.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.073+0000 7fdc5f7fe700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdc40066f30 0x7fdc400693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdc6006da20 tx=0x7fdc50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:44.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.077+0000 7fdc57fff700 1 -- 172.21.15.31:0/2016539030 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc48052280 con 0x7fdc4c004d50 2023-10-09T06:27:44.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.269+0000 7fdc663fa700 1 -- 172.21.15.31:0/2016539030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdc60068be0 con 0x7fdc4c004d50 2023-10-09T06:27:44.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.889+0000 7fdc57fff700 1 -- 172.21.15.31:0/2016539030 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v142) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdc480220d0 con 0x7fdc4c004d50 2023-10-09T06:27:44.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.891+0000 7fdc663fa700 1 -- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdc40066f30 msgr2=0x7fdc400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:44.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.891+0000 7fdc663fa700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdc40066f30 0x7fdc400693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdc6006da20 tx=0x7fdc50009040 comp rx=0 tx=0).stop 2023-10-09T06:27:44.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.891+0000 7fdc663fa700 1 -- 172.21.15.31:0/2016539030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc4c004d50 msgr2=0x7fdc600b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:44.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.891+0000 7fdc663fa700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc4c004d50 0x7fdc600b1a00 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fdc48011b10 tx=0x7fdc480091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:44.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.891+0000 7fdc663fa700 1 -- 172.21.15.31:0/2016539030 shutdown_connections 2023-10-09T06:27:44.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.891+0000 7fdc663fa700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdc40066f30 0x7fdc400693e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:44.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.891+0000 7fdc663fa700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdc601405d0 0x7fdc600b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:44.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.891+0000 7fdc663fa700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc4c004d50 0x7fdc600b1a00 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:44.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.891+0000 7fdc663fa700 1 --2- 172.21.15.31:0/2016539030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc60140160 0x7fdc600b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:44.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.891+0000 7fdc663fa700 1 -- 172.21.15.31:0/2016539030 >> 172.21.15.31:0/2016539030 conn(0x7fdc60069870 msgr2=0x7fdc60152b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:44.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.891+0000 7fdc663fa700 1 -- 172.21.15.31:0/2016539030 shutdown_connections 2023-10-09T06:27:44.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:44.892+0000 7fdc663fa700 1 -- 172.21.15.31:0/2016539030 wait complete. 2023-10-09T06:27:44.893 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:27:44.906 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:27:45.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.033+0000 7f0ed0084700 1 Processor -- start 2023-10-09T06:27:45.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.033+0000 7f0ed0084700 1 -- start start 2023-10-09T06:27:45.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.034+0000 7f0ed0084700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ec80b11f0 0x7f0ec80b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:45.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.034+0000 7f0ed0084700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec80b0d60 con 0x7f0ec8068cb0 2023-10-09T06:27:45.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.034+0000 7f0ed0084700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec80b3540 con 0x7f0ec8159e50 2023-10-09T06:27:45.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.034+0000 7f0ed0084700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80d15b0 con 0x7f0ec80b11f0 2023-10-09T06:27:45.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.034+0000 7f0ece621700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0ec8068cb0 0x7f0ec80cb310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46066/0 (socket says 172.21.15.31:46066) 2023-10-09T06:27:45.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.034+0000 7f0ece621700 1 -- 172.21.15.31:0/4059116592 learned_addr learned my addr 172.21.15.31:0/4059116592 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:45.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.034+0000 7f0ecd61f700 1 --2- 172.21.15.31:0/4059116592 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ec80b11f0 0x7f0ec80b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:45.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.035+0000 7f0ecce1e700 1 -- 172.21.15.31:0/4059116592 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360900912 0 0) 0x7f0ec80b0d60 con 0x7f0ec8068cb0 2023-10-09T06:27:45.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.035+0000 7f0ecce1e700 1 -- 172.21.15.31:0/4059116592 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb0003570 con 0x7f0ec8068cb0 2023-10-09T06:27:45.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.035+0000 7f0ecce1e700 1 -- 172.21.15.31:0/4059116592 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281176068 0 0) 0x7f0ec80b3540 con 0x7f0ec8159e50 2023-10-09T06:27:45.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.035+0000 7f0ecce1e700 1 -- 172.21.15.31:0/4059116592 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec80b0d60 con 0x7f0ec8159e50 2023-10-09T06:27:45.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.035+0000 7f0ecd61f700 1 -- 172.21.15.31:0/4059116592 >> v1:172.21.15.158:6789/0 conn(0x7f0ec8159e50 legacy=0x7f0ec80b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:45.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.035+0000 7f0ecd61f700 1 -- 172.21.15.31:0/4059116592 >> v1:172.21.15.31:6789/0 conn(0x7f0ec8068cb0 legacy=0x7f0ec80cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:45.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.035+0000 7f0ecce1e700 1 -- 172.21.15.31:0/4059116592 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2102152167 0 0) 0x7f0eb0003570 con 0x7f0ec8068cb0 2023-10-09T06:27:45.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.035+0000 7f0ecd61f700 1 -- 172.21.15.31:0/4059116592 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec80d1890 con 0x7f0ec80b11f0 2023-10-09T06:27:45.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.035+0000 7f0ecd61f700 1 --2- 172.21.15.31:0/4059116592 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ec80b11f0 0x7f0ec80b1660 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc009910 tx=0x7f0ebc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=175771a07e6c537d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:45.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.035+0000 7f0ecce1e700 1 -- 172.21.15.31:0/4059116592 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb80017f0 con 0x7f0ec80b11f0 2023-10-09T06:27:45.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.035+0000 7f0ecce1e700 1 -- 172.21.15.31:0/4059116592 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc011420 con 0x7f0ec80b11f0 2023-10-09T06:27:45.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.035+0000 7f0ecce1e700 1 -- 172.21.15.31:0/4059116592 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc0117a0 con 0x7f0ec80b11f0 2023-10-09T06:27:45.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.036+0000 7f0ed0084700 1 -- 172.21.15.31:0/4059116592 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ec80b11f0 msgr2=0x7f0ec80b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:45.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.036+0000 7f0ed0084700 1 --2- 172.21.15.31:0/4059116592 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ec80b11f0 0x7f0ec80b1660 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc009910 tx=0x7f0ebc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:45.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.036+0000 7f0ed0084700 1 -- 172.21.15.31:0/4059116592 shutdown_connections 2023-10-09T06:27:45.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.036+0000 7f0ed0084700 1 --2- 172.21.15.31:0/4059116592 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ec80b11f0 0x7f0ec80b1660 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:45.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.036+0000 7f0ed0084700 1 -- 172.21.15.31:0/4059116592 >> 172.21.15.31:0/4059116592 conn(0x7f0ec8068130 msgr2=0x7f0ec80d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:45.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.036+0000 7f0ed0084700 1 -- 172.21.15.31:0/4059116592 shutdown_connections 2023-10-09T06:27:45.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.036+0000 7f0ed0084700 1 -- 172.21.15.31:0/4059116592 wait complete. 2023-10-09T06:27:45.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.037+0000 7f0ed0084700 1 Processor -- start 2023-10-09T06:27:45.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.037+0000 7f0ed0084700 1 -- start start 2023-10-09T06:27:45.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ed0084700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec8068cb0 0x7f0ec816aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:45.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ed0084700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ec80b11f0 0x7f0ec80b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:45.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ed0084700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ec8159e50 0x7f0ec816de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:45.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ed0084700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec816b8b0 con 0x7f0ec8068cb0 2023-10-09T06:27:45.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ed0084700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec816c430 con 0x7f0ec80b11f0 2023-10-09T06:27:45.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ed0084700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec816bb00 con 0x7f0ec8159e50 2023-10-09T06:27:45.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ecde20700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec8068cb0 0x7f0ec816aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:45.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ecde20700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec8068cb0 0x7f0ec816aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47856/0 (socket says 172.21.15.31:47856) 2023-10-09T06:27:45.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ecde20700 1 -- 172.21.15.31:0/650567171 learned_addr learned my addr 172.21.15.31:0/650567171 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:45.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ece621700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ec8159e50 0x7f0ec816de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ecd61f700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ec80b11f0 0x7f0ec80b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ecde20700 1 -- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ec8159e50 msgr2=0x7f0ec816de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ecde20700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ec8159e50 0x7f0ec816de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ecde20700 1 -- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ec80b11f0 msgr2=0x7f0ec80b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ecde20700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ec80b11f0 0x7f0ec80b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ecde20700 1 -- 172.21.15.31:0/650567171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc009420 con 0x7f0ec8068cb0 2023-10-09T06:27:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ecd61f700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ec80b11f0 0x7f0ec80b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.038+0000 7f0ecde20700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec8068cb0 0x7f0ec816aed0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000c5b0 tx=0x7f0ec0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.039+0000 7f0ec5ffb700 1 -- 172.21.15.31:0/650567171 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0010510 con 0x7f0ec8068cb0 2023-10-09T06:27:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.039+0000 7f0ec5ffb700 1 -- 172.21.15.31:0/650567171 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec0010670 con 0x7f0ec8068cb0 2023-10-09T06:27:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.039+0000 7f0ed0084700 1 -- 172.21.15.31:0/650567171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec816bde0 con 0x7f0ec8068cb0 2023-10-09T06:27:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.039+0000 7f0ec5ffb700 1 -- 172.21.15.31:0/650567171 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0010a30 con 0x7f0ec8068cb0 2023-10-09T06:27:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.039+0000 7f0ed0084700 1 -- 172.21.15.31:0/650567171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec816b410 con 0x7f0ec8068cb0 2023-10-09T06:27:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.040+0000 7f0ed0084700 1 -- 172.21.15.31:0/650567171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec804c3c0 con 0x7f0ec8068cb0 2023-10-09T06:27:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.040+0000 7f0ec5ffb700 1 -- 172.21.15.31:0/650567171 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ec001b400 con 0x7f0ec8068cb0 2023-10-09T06:27:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.041+0000 7f0ec5ffb700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0eb4066fb0 0x7f0eb4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.041+0000 7f0ec5ffb700 1 -- 172.21.15.31:0/650567171 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f0ec0084170 con 0x7f0ec8068cb0 2023-10-09T06:27:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.041+0000 7f0ecd61f700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0eb4066fb0 0x7f0eb4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:45.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.041+0000 7f0ecd61f700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0eb4066fb0 0x7f0eb4069460 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc009860 tx=0x7f0ebc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:45.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.045+0000 7f0ec5ffb700 1 -- 172.21.15.31:0/650567171 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ec0051460 con 0x7f0ec8068cb0 2023-10-09T06:27:45.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.236+0000 7f0ed0084700 1 -- 172.21.15.31:0/650567171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ec80b0470 con 0x7f0ec8068cb0 2023-10-09T06:27:45.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.892+0000 7f0ec5ffb700 1 -- 172.21.15.31:0/650567171 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v143) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0ec0054a80 con 0x7f0ec8068cb0 2023-10-09T06:27:45.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.895+0000 7f0ed0084700 1 -- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0eb4066fb0 msgr2=0x7f0eb4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:45.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.895+0000 7f0ed0084700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0eb4066fb0 0x7f0eb4069460 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc009860 tx=0x7f0ebc016000 comp rx=0 tx=0).stop 2023-10-09T06:27:45.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.895+0000 7f0ed0084700 1 -- 172.21.15.31:0/650567171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec8068cb0 msgr2=0x7f0ec816aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:45.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.895+0000 7f0ed0084700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec8068cb0 0x7f0ec816aed0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000c5b0 tx=0x7f0ec0007e10 comp rx=0 tx=0).stop 2023-10-09T06:27:45.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.896+0000 7f0ed0084700 1 -- 172.21.15.31:0/650567171 shutdown_connections 2023-10-09T06:27:45.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.896+0000 7f0ed0084700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0eb4066fb0 0x7f0eb4069460 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:45.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.896+0000 7f0ed0084700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ec8159e50 0x7f0ec816de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:45.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.896+0000 7f0ed0084700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ec8068cb0 0x7f0ec816aed0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:45.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.896+0000 7f0ed0084700 1 --2- 172.21.15.31:0/650567171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ec80b11f0 0x7f0ec80b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:45.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.896+0000 7f0ed0084700 1 -- 172.21.15.31:0/650567171 >> 172.21.15.31:0/650567171 conn(0x7f0ec8068130 msgr2=0x7f0ec80d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:45.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.896+0000 7f0ed0084700 1 -- 172.21.15.31:0/650567171 shutdown_connections 2023-10-09T06:27:45.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:45.896+0000 7f0ed0084700 1 -- 172.21.15.31:0/650567171 wait complete. 2023-10-09T06:27:45.898 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2023-10-09T06:27:45.909 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:27:46.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.030+0000 7f6ad0d19700 1 Processor -- start 2023-10-09T06:27:46.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.030+0000 7f6ad0d19700 1 -- start start 2023-10-09T06:27:46.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.031+0000 7f6ad0d19700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6acc15a730 0x7f6acc0caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:46.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.031+0000 7f6ad0d19700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6acc0abce0 0x7f6acc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:46.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.031+0000 7f6ad0d19700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6acc0c3430 con 0x7f6acc0ab910 2023-10-09T06:27:46.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.031+0000 7f6ad0d19700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6acc0c9100 con 0x7f6acc15a730 2023-10-09T06:27:46.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.031+0000 7f6ad0d19700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc158050 con 0x7f6acc0abce0 2023-10-09T06:27:46.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.031+0000 7f6aca59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6acc0ab910 0x7f6acc0c2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46076/0 (socket says 172.21.15.31:46076) 2023-10-09T06:27:46.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.031+0000 7f6aca59c700 1 -- 172.21.15.31:0/1808647378 learned_addr learned my addr 172.21.15.31:0/1808647378 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.032+0000 7f6ac9d9b700 1 --2- 172.21.15.31:0/1808647378 >> v2:172.21.15.158:3300/0 conn(0x7f6acc15a730 0x7f6acc0caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.032+0000 7f6acad9d700 1 --2- 172.21.15.31:0/1808647378 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6acc0abce0 0x7f6acc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.032+0000 7f6ac959a700 1 -- 172.21.15.31:0/1808647378 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796190741 0 0) 0x7f6acc0c3430 con 0x7f6acc0ab910 2023-10-09T06:27:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.032+0000 7f6ac959a700 1 -- 172.21.15.31:0/1808647378 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab8003570 con 0x7f6acc0ab910 2023-10-09T06:27:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.032+0000 7f6ac9d9b700 1 -- 172.21.15.31:0/1808647378 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6acc0abce0 msgr2=0x7f6acc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.032+0000 7f6ac9d9b700 1 --2- 172.21.15.31:0/1808647378 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6acc0abce0 0x7f6acc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.032+0000 7f6ac9d9b700 1 -- 172.21.15.31:0/1808647378 >> v1:172.21.15.31:6789/0 conn(0x7f6acc0ab910 legacy=0x7f6acc0c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.032+0000 7f6ac9d9b700 1 -- 172.21.15.31:0/1808647378 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc15abc0 con 0x7f6acc15a730 2023-10-09T06:27:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.032+0000 7f6acad9d700 1 --2- 172.21.15.31:0/1808647378 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6acc0abce0 0x7f6acc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:27:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.032+0000 7f6ac9d9b700 1 --2- 172.21.15.31:0/1808647378 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6acc15a730 0x7f6acc0caf50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009910 tx=0x7f6ab40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10fabb8ab672689a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.032+0000 7f6ac959a700 1 -- 172.21.15.31:0/1808647378 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4011630 con 0x7f6acc15a730 2023-10-09T06:27:46.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.032+0000 7f6ac959a700 1 -- 172.21.15.31:0/1808647378 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab4011790 con 0x7f6acc15a730 2023-10-09T06:27:46.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.032+0000 7f6ac959a700 1 -- 172.21.15.31:0/1808647378 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4011b30 con 0x7f6acc15a730 2023-10-09T06:27:46.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.033+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1808647378 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6acc15a730 msgr2=0x7f6acc0caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:46.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.033+0000 7f6ad0d19700 1 --2- 172.21.15.31:0/1808647378 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6acc15a730 0x7f6acc0caf50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009910 tx=0x7f6ab40091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.033+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1808647378 shutdown_connections 2023-10-09T06:27:46.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.033+0000 7f6ad0d19700 1 --2- 172.21.15.31:0/1808647378 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6acc0abce0 0x7f6acc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.033+0000 7f6ad0d19700 1 --2- 172.21.15.31:0/1808647378 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6acc15a730 0x7f6acc0caf50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.033+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1808647378 >> 172.21.15.31:0/1808647378 conn(0x7f6acc067660 msgr2=0x7f6acc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.033+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1808647378 shutdown_connections 2023-10-09T06:27:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.033+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1808647378 wait complete. 2023-10-09T06:27:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.034+0000 7f6ad0d19700 1 Processor -- start 2023-10-09T06:27:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.034+0000 7f6ad0d19700 1 -- start start 2023-10-09T06:27:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6ad0d19700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6acc0ab910 0x7f6acc159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6ad0d19700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6acc0abce0 0x7f6acc14bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6ad0d19700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6acc15a730 0x7f6acc1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6ad0d19700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc158da0 con 0x7f6acc15a730 2023-10-09T06:27:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6ad0d19700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc159080 con 0x7f6acc0abce0 2023-10-09T06:27:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6ad0d19700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc159360 con 0x7f6acc0ab910 2023-10-09T06:27:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6acad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6acc15a730 0x7f6acc1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6acad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6acc15a730 0x7f6acc1582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47868/0 (socket says 172.21.15.31:47868) 2023-10-09T06:27:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6acad9d700 1 -- 172.21.15.31:0/1125444830 learned_addr learned my addr 172.21.15.31:0/1125444830 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6aca59c700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6acc0ab910 0x7f6acc159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6ac9d9b700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6acc0abce0 0x7f6acc14bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6acad9d700 1 -- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6acc0ab910 msgr2=0x7f6acc159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6acad9d700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6acc0ab910 0x7f6acc159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6acad9d700 1 -- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6acc0abce0 msgr2=0x7f6acc14bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6acad9d700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6acc0abce0 0x7f6acc14bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6acad9d700 1 -- 172.21.15.31:0/1125444830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc009420 con 0x7f6acc15a730 2023-10-09T06:27:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6acad9d700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6acc15a730 0x7f6acc1582e0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00ec80 tx=0x7f6abc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6ac27fc700 1 -- 172.21.15.31:0/1125444830 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc00c9d0 con 0x7f6acc15a730 2023-10-09T06:27:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.035+0000 7f6ac27fc700 1 -- 172.21.15.31:0/1125444830 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc00cb30 con 0x7f6acc15a730 2023-10-09T06:27:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.036+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1125444830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab4009420 con 0x7f6acc15a730 2023-10-09T06:27:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.036+0000 7f6ac27fc700 1 -- 172.21.15.31:0/1125444830 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc013470 con 0x7f6acc15a730 2023-10-09T06:27:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.036+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1125444830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6acc159920 con 0x7f6acc15a730 2023-10-09T06:27:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.037+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1125444830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6acc159b40 con 0x7f6acc15a730 2023-10-09T06:27:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.037+0000 7f6ac27fc700 1 -- 172.21.15.31:0/1125444830 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6abc013860 con 0x7f6acc15a730 2023-10-09T06:27:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.037+0000 7f6ac27fc700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6aac067000 0x7f6aac0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.037+0000 7f6ac27fc700 1 -- 172.21.15.31:0/1125444830 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6abc0843b0 con 0x7f6acc15a730 2023-10-09T06:27:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.038+0000 7f6aca59c700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6aac067000 0x7f6aac0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.038+0000 7f6aca59c700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6aac067000 0x7f6aac0694b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4005c50 tx=0x7f6ac4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.042+0000 7f6ac27fc700 1 -- 172.21.15.31:0/1125444830 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6abc0519a0 con 0x7f6acc15a730 2023-10-09T06:27:46.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.238+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1125444830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6acc15a440 con 0x7f6acc15a730 2023-10-09T06:27:46.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.241+0000 7f6ac27fc700 1 -- 172.21.15.31:0/1125444830 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6abc054fc0 con 0x7f6acc15a730 2023-10-09T06:27:46.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.243+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6aac067000 msgr2=0x7f6aac0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.243+0000 7f6ad0d19700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6aac067000 0x7f6aac0694b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4005c50 tx=0x7f6ac4009040 comp rx=0 tx=0).stop 2023-10-09T06:27:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.244+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1125444830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6acc15a730 msgr2=0x7f6acc1582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.244+0000 7f6ad0d19700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6acc15a730 0x7f6acc1582e0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00ec80 tx=0x7f6abc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.244+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1125444830 shutdown_connections 2023-10-09T06:27:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.244+0000 7f6ad0d19700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6aac067000 0x7f6aac0694b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.244+0000 7f6ad0d19700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6acc0ab910 0x7f6acc159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.244+0000 7f6ad0d19700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6acc15a730 0x7f6acc1582e0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.244+0000 7f6ad0d19700 1 --2- 172.21.15.31:0/1125444830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6acc0abce0 0x7f6acc14bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.244+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1125444830 >> 172.21.15.31:0/1125444830 conn(0x7f6acc067660 msgr2=0x7f6acc06ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.244+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1125444830 shutdown_connections 2023-10-09T06:27:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.244+0000 7f6ad0d19700 1 -- 172.21.15.31:0/1125444830 wait complete. 2023-10-09T06:27:46.256 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-09T06:27:46.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.374+0000 7fe8e5ee1700 1 Processor -- start 2023-10-09T06:27:46.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.374+0000 7fe8e5ee1700 1 -- start start 2023-10-09T06:27:46.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.375+0000 7fe8e5ee1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe8e006f310 0x7fe8e00b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:46.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.375+0000 7fe8e5ee1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e00c9f90 0x7fe8e0159870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:46.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.375+0000 7fe8e5ee1700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e00cb300 con 0x7fe8e006f6e0 2023-10-09T06:27:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.375+0000 7fe8e5ee1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e00af4b0 con 0x7fe8e006f310 2023-10-09T06:27:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.375+0000 7fe8e5ee1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00b12e0 con 0x7fe8e00c9f90 2023-10-09T06:27:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.375+0000 7fe8e4edf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe8e006f310 0x7fe8e00b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.375+0000 7fe8e4edf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe8e006f310 0x7fe8e00b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47884/0 (socket says 172.21.15.31:47884) 2023-10-09T06:27:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.375+0000 7fe8e4edf700 1 -- 172.21.15.31:0/636854164 learned_addr learned my addr 172.21.15.31:0/636854164 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8e56e0700 1 --2- 172.21.15.31:0/636854164 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e00c9f90 0x7fe8e0159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8e4edf700 1 -- 172.21.15.31:0/636854164 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e00c9f90 msgr2=0x7fe8e0159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8e4edf700 1 --2- 172.21.15.31:0/636854164 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e00c9f90 0x7fe8e0159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8e4edf700 1 -- 172.21.15.31:0/636854164 >> v1:172.21.15.158:6789/0 conn(0x7fe8e006f6e0 legacy=0x7fe8e00cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8e4edf700 1 -- 172.21.15.31:0/636854164 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e00ca6f0 con 0x7fe8e006f310 2023-10-09T06:27:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8e4edf700 1 --2- 172.21.15.31:0/636854164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e006f310 0x7fe8e00b0da0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009f20 tx=0x7fe8d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463d80f946c8019f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8df7fe700 1 -- 172.21.15.31:0/636854164 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d800e070 con 0x7fe8e006f310 2023-10-09T06:27:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8df7fe700 1 -- 172.21.15.31:0/636854164 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d800ba40 con 0x7fe8e006f310 2023-10-09T06:27:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8df7fe700 1 -- 172.21.15.31:0/636854164 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80092e0 con 0x7fe8e006f310 2023-10-09T06:27:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/636854164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e006f310 msgr2=0x7fe8e00b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8e5ee1700 1 --2- 172.21.15.31:0/636854164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e006f310 0x7fe8e00b0da0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009f20 tx=0x7fe8d8009840 comp rx=0 tx=0).stop 2023-10-09T06:27:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/636854164 shutdown_connections 2023-10-09T06:27:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8e5ee1700 1 --2- 172.21.15.31:0/636854164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e006f310 0x7fe8e00b0da0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.376+0000 7fe8e5ee1700 1 --2- 172.21.15.31:0/636854164 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e00c9f90 0x7fe8e0159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.377+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/636854164 >> 172.21.15.31:0/636854164 conn(0x7fe8e006bc70 msgr2=0x7fe8e006c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.377+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/636854164 shutdown_connections 2023-10-09T06:27:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.377+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/636854164 wait complete. 2023-10-09T06:27:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.378+0000 7fe8e5ee1700 1 Processor -- start 2023-10-09T06:27:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.378+0000 7fe8e5ee1700 1 -- start start 2023-10-09T06:27:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.378+0000 7fe8e5ee1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e006f310 0x7fe8e00ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.378+0000 7fe8e5ee1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e006f6e0 0x7fe8e015cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.378+0000 7fe8e5ee1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e00c9f90 0x7fe8e015d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.378+0000 7fe8e5ee1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00680c0 con 0x7fe8e006f6e0 2023-10-09T06:27:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.378+0000 7fe8e5ee1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e016aff0 con 0x7fe8e006f310 2023-10-09T06:27:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.378+0000 7fe8e5ee1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e0067790 con 0x7fe8e00c9f90 2023-10-09T06:27:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8dffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e006f6e0 0x7fe8e015cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8dffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e006f6e0 0x7fe8e015cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47892/0 (socket says 172.21.15.31:47892) 2023-10-09T06:27:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8dffff700 1 -- 172.21.15.31:0/433778864 learned_addr learned my addr 172.21.15.31:0/433778864 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8e4edf700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e006f310 0x7fe8e00ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8e56e0700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e00c9f90 0x7fe8e015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8dffff700 1 -- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e00c9f90 msgr2=0x7fe8e015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8dffff700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e00c9f90 0x7fe8e015d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8dffff700 1 -- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e006f310 msgr2=0x7fe8e00ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8dffff700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e006f310 0x7fe8e00ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8dffff700 1 -- 172.21.15.31:0/433778864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8009ae0 con 0x7fe8e006f6e0 2023-10-09T06:27:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8e4edf700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e006f310 0x7fe8e00ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8dffff700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e006f6e0 0x7fe8e015cb20 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800c5d0 tx=0x7fe8c8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8dcff9700 1 -- 172.21.15.31:0/433778864 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8011590 con 0x7fe8e006f6e0 2023-10-09T06:27:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8dcff9700 1 -- 172.21.15.31:0/433778864 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c8011710 con 0x7fe8e006f6e0 2023-10-09T06:27:46.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8dcff9700 1 -- 172.21.15.31:0/433778864 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8011ad0 con 0x7fe8e006f6e0 2023-10-09T06:27:46.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/433778864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e0067a70 con 0x7fe8e006f6e0 2023-10-09T06:27:46.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.379+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/433778864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e0068550 con 0x7fe8e006f6e0 2023-10-09T06:27:46.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.380+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/433778864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e006e120 con 0x7fe8e006f6e0 2023-10-09T06:27:46.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.381+0000 7fe8dcff9700 1 -- 172.21.15.31:0/433778864 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8c801c460 con 0x7fe8e006f6e0 2023-10-09T06:27:46.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.381+0000 7fe8dcff9700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8c0066f30 0x7fe8c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:46.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.381+0000 7fe8dcff9700 1 -- 172.21.15.31:0/433778864 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe8c8084030 con 0x7fe8e006f6e0 2023-10-09T06:27:46.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.381+0000 7fe8e4edf700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8c0066f30 0x7fe8c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:46.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.382+0000 7fe8e4edf700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8c0066f30 0x7fe8c00693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009ab0 tx=0x7fe8d8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:46.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.385+0000 7fe8dcff9700 1 -- 172.21.15.31:0/433778864 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8c80515a0 con 0x7fe8e006f6e0 2023-10-09T06:27:46.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.658+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/433778864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fe8e00ca9d0 con 0x7fe8e006f6e0 2023-10-09T06:27:46.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.896+0000 7fe8dcff9700 1 -- 172.21.15.31:0/433778864 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v357) v1 ==== 140+0+0 (secure 0 0 0) 0x7fe8c8054bc0 con 0x7fe8e006f6e0 2023-10-09T06:27:46.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.898+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8c0066f30 msgr2=0x7fe8c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:46.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.898+0000 7fe8e5ee1700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8c0066f30 0x7fe8c00693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009ab0 tx=0x7fe8d8017000 comp rx=0 tx=0).stop 2023-10-09T06:27:46.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.899+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/433778864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e006f6e0 msgr2=0x7fe8e015cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:46.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.899+0000 7fe8e5ee1700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e006f6e0 0x7fe8e015cb20 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800c5d0 tx=0x7fe8c8007f60 comp rx=0 tx=0).stop 2023-10-09T06:27:46.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.899+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/433778864 shutdown_connections 2023-10-09T06:27:46.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.899+0000 7fe8e5ee1700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8c0066f30 0x7fe8c00693e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.899+0000 7fe8e5ee1700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e00c9f90 0x7fe8e015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.899+0000 7fe8e5ee1700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e006f310 0x7fe8e00ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.899+0000 7fe8e5ee1700 1 --2- 172.21.15.31:0/433778864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e006f6e0 0x7fe8e015cb20 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:46.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.899+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/433778864 >> 172.21.15.31:0/433778864 conn(0x7fe8e006bc70 msgr2=0x7fe8e00ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:46.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.899+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/433778864 shutdown_connections 2023-10-09T06:27:46.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:46.899+0000 7fe8e5ee1700 1 -- 172.21.15.31:0/433778864 wait complete. 2023-10-09T06:27:46.912 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-09T06:27:46.912 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-10-09T06:27:46.912 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-09T06:27:47.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.036+0000 7f04d59e0700 1 Processor -- start 2023-10-09T06:27:47.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.036+0000 7f04d59e0700 1 -- start start 2023-10-09T06:27:47.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.037+0000 7f04d59e0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04d00b1220 0x7f04d00c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:47.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.037+0000 7f04d59e0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f04d00cb4f0 0x7f04d00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:47.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.037+0000 7f04d59e0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d015de60 con 0x7f04d00b0e50 2023-10-09T06:27:47.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.037+0000 7f04d59e0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d00cbeb0 con 0x7f04d00b1220 2023-10-09T06:27:47.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.037+0000 7f04d59e0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d015e140 con 0x7f04d00cb4f0 2023-10-09T06:27:47.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.037+0000 7f04ce7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04d00b1220 0x7f04d00c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:47.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.037+0000 7f04ceffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f04d00b0e50 0x7f04d006d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46088/0 (socket says 172.21.15.31:46088) 2023-10-09T06:27:47.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.037+0000 7f04ceffd700 1 -- 172.21.15.31:0/3540876565 learned_addr learned my addr 172.21.15.31:0/3540876565 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:47.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.037+0000 7f04ce7fc700 1 -- 172.21.15.31:0/3540876565 >> v2:172.21.15.158:3300/0 conn(0x7f04d00cb4f0 msgr2=0x7f04d00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:47.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.037+0000 7f04ce7fc700 1 --2- 172.21.15.31:0/3540876565 >> v2:172.21.15.158:3300/0 conn(0x7f04d00cb4f0 0x7f04d00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:47.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.037+0000 7f04ce7fc700 1 -- 172.21.15.31:0/3540876565 >> v1:172.21.15.31:6789/0 conn(0x7f04d00b0e50 legacy=0x7f04d006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:47.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.037+0000 7f04ce7fc700 1 -- 172.21.15.31:0/3540876565 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d015e420 con 0x7f04d00b1220 2023-10-09T06:27:47.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.037+0000 7f04cdffb700 1 -- 172.21.15.31:0/3540876565 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805476709 0 0) 0x7f04d015de60 con 0x7f04d00b0e50 2023-10-09T06:27:47.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.038+0000 7f04ce7fc700 1 --2- 172.21.15.31:0/3540876565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b1220 0x7f04d00c9180 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f04d015e9e0 tx=0x7f04b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705e0e609c8fd57 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:47.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.038+0000 7f04cdffb700 1 -- 172.21.15.31:0/3540876565 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b800b6b0 con 0x7f04d00b1220 2023-10-09T06:27:47.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.038+0000 7f04cdffb700 1 -- 172.21.15.31:0/3540876565 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b800b810 con 0x7f04d00b1220 2023-10-09T06:27:47.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.038+0000 7f04cdffb700 1 -- 172.21.15.31:0/3540876565 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b800bbb0 con 0x7f04d00b1220 2023-10-09T06:27:47.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.038+0000 7f04d59e0700 1 -- 172.21.15.31:0/3540876565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b1220 msgr2=0x7f04d00c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:47.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.038+0000 7f04d59e0700 1 --2- 172.21.15.31:0/3540876565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b1220 0x7f04d00c9180 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f04d015e9e0 tx=0x7f04b80091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:47.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.038+0000 7f04d59e0700 1 -- 172.21.15.31:0/3540876565 shutdown_connections 2023-10-09T06:27:47.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.038+0000 7f04d59e0700 1 --2- 172.21.15.31:0/3540876565 >> v2:172.21.15.158:3300/0 conn(0x7f04d00cb4f0 0x7f04d00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:47.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.038+0000 7f04d59e0700 1 --2- 172.21.15.31:0/3540876565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b1220 0x7f04d00c9180 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:47.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.038+0000 7f04d59e0700 1 -- 172.21.15.31:0/3540876565 >> 172.21.15.31:0/3540876565 conn(0x7f04d0069870 msgr2=0x7f04d0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:47.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.038+0000 7f04d59e0700 1 -- 172.21.15.31:0/3540876565 shutdown_connections 2023-10-09T06:27:47.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.038+0000 7f04d59e0700 1 -- 172.21.15.31:0/3540876565 wait complete. 2023-10-09T06:27:47.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.040+0000 7f04d59e0700 1 Processor -- start 2023-10-09T06:27:47.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.040+0000 7f04d59e0700 1 -- start start 2023-10-09T06:27:47.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.040+0000 7f04d59e0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04d00b0e50 0x7f04d016d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:47.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.040+0000 7f04d59e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b1220 0x7f04d0157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:47.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.040+0000 7f04d59e0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04d00cb4f0 0x7f04d0141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:47.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.040+0000 7f04d59e0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d0156210 con 0x7f04d00b1220 2023-10-09T06:27:47.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.040+0000 7f04d59e0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d016b490 con 0x7f04d00cb4f0 2023-10-09T06:27:47.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.040+0000 7f04d59e0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d0157c80 con 0x7f04d00b0e50 2023-10-09T06:27:47.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.040+0000 7f04ce7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b1220 0x7f04d0157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:47.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.040+0000 7f04ce7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b1220 0x7f04d0157740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47910/0 (socket says 172.21.15.31:47910) 2023-10-09T06:27:47.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.040+0000 7f04ce7fc700 1 -- 172.21.15.31:0/3136250108 learned_addr learned my addr 172.21.15.31:0/3136250108 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:47.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04cf7fe700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04d00cb4f0 0x7f04d0141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:47.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04ceffd700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04d00b0e50 0x7f04d016d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:47.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04ce7fc700 1 -- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04d00b0e50 msgr2=0x7f04d016d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:47.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04ce7fc700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04d00b0e50 0x7f04d016d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:47.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04ce7fc700 1 -- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04d00cb4f0 msgr2=0x7f04d0141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:47.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04ce7fc700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04d00cb4f0 0x7f04d0141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:47.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04ce7fc700 1 -- 172.21.15.31:0/3136250108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b8009420 con 0x7f04d00b1220 2023-10-09T06:27:47.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04cf7fe700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04d00cb4f0 0x7f04d0141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:47.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04ceffd700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04d00b0e50 0x7f04d016d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:47.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04ce7fc700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b1220 0x7f04d0157740 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f04b8013000 tx=0x7f04b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:47.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04c6ffd700 1 -- 172.21.15.31:0/3136250108 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b8006af0 con 0x7f04d00b1220 2023-10-09T06:27:47.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04c6ffd700 1 -- 172.21.15.31:0/3136250108 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b800bb90 con 0x7f04d00b1220 2023-10-09T06:27:47.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04c6ffd700 1 -- 172.21.15.31:0/3136250108 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b8011670 con 0x7f04d00b1220 2023-10-09T06:27:47.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04d59e0700 1 -- 172.21.15.31:0/3136250108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d016e720 con 0x7f04d00b1220 2023-10-09T06:27:47.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.041+0000 7f04d59e0700 1 -- 172.21.15.31:0/3136250108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d016e160 con 0x7f04d00b1220 2023-10-09T06:27:47.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.042+0000 7f04d59e0700 1 -- 172.21.15.31:0/3136250108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d016b620 con 0x7f04d00b1220 2023-10-09T06:27:47.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.043+0000 7f04c6ffd700 1 -- 172.21.15.31:0/3136250108 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04b8011aa0 con 0x7f04d00b1220 2023-10-09T06:27:47.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.043+0000 7f04c6ffd700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f04b0066f30 0x7f04b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:47.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.043+0000 7f04c6ffd700 1 -- 172.21.15.31:0/3136250108 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f04b8085b40 con 0x7f04d00b1220 2023-10-09T06:27:47.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.043+0000 7f04ceffd700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f04b0066f30 0x7f04b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:47.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.044+0000 7f04ceffd700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f04b0066f30 0x7f04b00693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f04c80018d0 tx=0x7f04c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:47.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.047+0000 7f04c6ffd700 1 -- 172.21.15.31:0/3136250108 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04b80530b0 con 0x7f04d00b1220 2023-10-09T06:27:47.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.332+0000 7f04d59e0700 1 -- 172.21.15.31:0/3136250108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f04d004c3c0 con 0x7f04d00b1220 2023-10-09T06:27:47.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.899+0000 7f04c6ffd700 1 -- 172.21.15.31:0/3136250108 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v358) v1 ==== 135+0+0 (secure 0 0 0) 0x7f04b80566d0 con 0x7f04d00b1220 2023-10-09T06:27:47.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.901+0000 7f04d59e0700 1 -- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f04b0066f30 msgr2=0x7f04b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:47.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.901+0000 7f04d59e0700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f04b0066f30 0x7f04b00693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f04c80018d0 tx=0x7f04c8009040 comp rx=0 tx=0).stop 2023-10-09T06:27:47.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.901+0000 7f04d59e0700 1 -- 172.21.15.31:0/3136250108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b1220 msgr2=0x7f04d0157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:47.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.901+0000 7f04d59e0700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b1220 0x7f04d0157740 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f04b8013000 tx=0x7f04b8017000 comp rx=0 tx=0).stop 2023-10-09T06:27:47.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.901+0000 7f04d59e0700 1 -- 172.21.15.31:0/3136250108 shutdown_connections 2023-10-09T06:27:47.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.901+0000 7f04d59e0700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f04b0066f30 0x7f04b00693e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:47.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.901+0000 7f04d59e0700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04d00b0e50 0x7f04d016d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:47.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.901+0000 7f04d59e0700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04d00cb4f0 0x7f04d0141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:47.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.901+0000 7f04d59e0700 1 --2- 172.21.15.31:0/3136250108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04d00b1220 0x7f04d0157740 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:47.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.901+0000 7f04d59e0700 1 -- 172.21.15.31:0/3136250108 >> 172.21.15.31:0/3136250108 conn(0x7f04d0069870 msgr2=0x7f04d00c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:47.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.901+0000 7f04d59e0700 1 -- 172.21.15.31:0/3136250108 shutdown_connections 2023-10-09T06:27:47.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:47.901+0000 7f04d59e0700 1 -- 172.21.15.31:0/3136250108 wait complete. 2023-10-09T06:27:47.915 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:27:48.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.039+0000 7f0eea076700 1 Processor -- start 2023-10-09T06:27:48.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.039+0000 7f0eea076700 1 -- start start 2023-10-09T06:27:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.040+0000 7f0eea076700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0ee415a290 0x7f0ee406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.040+0000 7f0eea076700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ee406aae0 0x7f0ee40cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.040+0000 7f0eea076700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee40b0790 con 0x7f0ee4159ec0 2023-10-09T06:27:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.040+0000 7f0eea076700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee406af60 con 0x7f0ee415a290 2023-10-09T06:27:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.040+0000 7f0eea076700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40ce1f0 con 0x7f0ee406aae0 2023-10-09T06:27:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.040+0000 7f0ee2ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0ee415a290 0x7f0ee406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.040+0000 7f0ee3fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ee406aae0 0x7f0ee40cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.040+0000 7f0ee37fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f0ee4159ec0 0x7f0ee40af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:47322/0 (socket says 172.21.15.31:47322) 2023-10-09T06:27:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.040+0000 7f0ee37fe700 1 -- 172.21.15.31:0/3345586410 learned_addr learned my addr 172.21.15.31:0/3345586410 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.041+0000 7f0ee3fff700 1 -- 172.21.15.31:0/3345586410 >> v2:172.21.15.158:3300/0 conn(0x7f0ee415a290 msgr2=0x7f0ee406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.041+0000 7f0ee3fff700 1 --2- 172.21.15.31:0/3345586410 >> v2:172.21.15.158:3300/0 conn(0x7f0ee415a290 0x7f0ee406a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.041+0000 7f0ee3fff700 1 -- 172.21.15.31:0/3345586410 >> v1:172.21.15.158:6789/0 conn(0x7f0ee4159ec0 legacy=0x7f0ee40af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.041+0000 7f0ee27fc700 1 -- 172.21.15.31:0/3345586410 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383414419 0 0) 0x7f0ee40b0790 con 0x7f0ee4159ec0 2023-10-09T06:27:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.041+0000 7f0ee3fff700 1 -- 172.21.15.31:0/3345586410 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40b0b20 con 0x7f0ee406aae0 2023-10-09T06:27:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.041+0000 7f0ee2ffd700 1 --2- 172.21.15.31:0/3345586410 >> v2:172.21.15.158:3300/0 conn(0x7f0ee415a290 0x7f0ee406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:27:48.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.041+0000 7f0ee3fff700 1 --2- 172.21.15.31:0/3345586410 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ee406aae0 0x7f0ee40cf590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009e60 tx=0x7f0edc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19afa48d4dfa5567 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:48.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.041+0000 7f0ee27fc700 1 -- 172.21.15.31:0/3345586410 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00e070 con 0x7f0ee406aae0 2023-10-09T06:27:48.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.041+0000 7f0ee27fc700 1 -- 172.21.15.31:0/3345586410 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc00bb60 con 0x7f0ee406aae0 2023-10-09T06:27:48.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.041+0000 7f0ee27fc700 1 -- 172.21.15.31:0/3345586410 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc012430 con 0x7f0ee406aae0 2023-10-09T06:27:48.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.042+0000 7f0eea076700 1 -- 172.21.15.31:0/3345586410 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ee406aae0 msgr2=0x7f0ee40cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.042+0000 7f0eea076700 1 --2- 172.21.15.31:0/3345586410 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ee406aae0 0x7f0ee40cf590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009e60 tx=0x7f0edc009780 comp rx=0 tx=0).stop 2023-10-09T06:27:48.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.042+0000 7f0eea076700 1 -- 172.21.15.31:0/3345586410 shutdown_connections 2023-10-09T06:27:48.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.042+0000 7f0eea076700 1 --2- 172.21.15.31:0/3345586410 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ee406aae0 0x7f0ee40cf590 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.042+0000 7f0eea076700 1 --2- 172.21.15.31:0/3345586410 >> v2:172.21.15.158:3300/0 conn(0x7f0ee415a290 0x7f0ee406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.042+0000 7f0eea076700 1 -- 172.21.15.31:0/3345586410 >> 172.21.15.31:0/3345586410 conn(0x7f0ee40d1880 msgr2=0x7f0ee40cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:48.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.042+0000 7f0eea076700 1 -- 172.21.15.31:0/3345586410 shutdown_connections 2023-10-09T06:27:48.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.042+0000 7f0eea076700 1 -- 172.21.15.31:0/3345586410 wait complete. 2023-10-09T06:27:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.043+0000 7f0eea076700 1 Processor -- start 2023-10-09T06:27:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.043+0000 7f0eea076700 1 -- start start 2023-10-09T06:27:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0eea076700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ee406aae0 0x7f0ee4155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0eea076700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ee4159ec0 0x7f0ee40c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0eea076700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ee415a290 0x7f0ee40b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0eea076700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee4155f60 con 0x7f0ee406aae0 2023-10-09T06:27:48.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0eea076700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40b4c60 con 0x7f0ee4159ec0 2023-10-09T06:27:48.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0eea076700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40b4050 con 0x7f0ee415a290 2023-10-09T06:27:48.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ee37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ee406aae0 0x7f0ee4155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ee37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ee406aae0 0x7f0ee4155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47916/0 (socket says 172.21.15.31:47916) 2023-10-09T06:27:48.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ee37fe700 1 -- 172.21.15.31:0/1247892452 learned_addr learned my addr 172.21.15.31:0/1247892452 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:48.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ee3fff700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ee415a290 0x7f0ee40b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ee2ffd700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ee4159ec0 0x7f0ee40c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ee37fe700 1 -- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ee415a290 msgr2=0x7f0ee40b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ee37fe700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ee415a290 0x7f0ee40b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ee37fe700 1 -- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ee4159ec0 msgr2=0x7f0ee40c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ee37fe700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ee4159ec0 0x7f0ee40c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ee37fe700 1 -- 172.21.15.31:0/1247892452 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8009420 con 0x7f0ee406aae0 2023-10-09T06:27:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ee37fe700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ee406aae0 0x7f0ee4155a20 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400c7e0 tx=0x7f0ed4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ecb7fe700 1 -- 172.21.15.31:0/1247892452 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4005b30 con 0x7f0ee406aae0 2023-10-09T06:27:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0eea076700 1 -- 172.21.15.31:0/1247892452 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0edc009a20 con 0x7f0ee406aae0 2023-10-09T06:27:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ecb7fe700 1 -- 172.21.15.31:0/1247892452 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed4005c90 con 0x7f0ee406aae0 2023-10-09T06:27:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0ecb7fe700 1 -- 172.21.15.31:0/1247892452 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4007300 con 0x7f0ee406aae0 2023-10-09T06:27:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.044+0000 7f0eea076700 1 -- 172.21.15.31:0/1247892452 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee40b4610 con 0x7f0ee406aae0 2023-10-09T06:27:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.046+0000 7f0eea076700 1 -- 172.21.15.31:0/1247892452 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee404c3c0 con 0x7f0ee406aae0 2023-10-09T06:27:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.046+0000 7f0ecb7fe700 1 -- 172.21.15.31:0/1247892452 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ed401b400 con 0x7f0ee406aae0 2023-10-09T06:27:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.046+0000 7f0ecb7fe700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0ed0066f30 0x7f0ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.046+0000 7f0ecb7fe700 1 -- 172.21.15.31:0/1247892452 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0ed4083e20 con 0x7f0ee406aae0 2023-10-09T06:27:48.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.046+0000 7f0ee2ffd700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0ed0066f30 0x7f0ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.047+0000 7f0ee2ffd700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0ed0066f30 0x7f0ed00693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8006f00 tx=0x7f0ed8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:48.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.051+0000 7f0ecb7fe700 1 -- 172.21.15.31:0/1247892452 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ed4051390 con 0x7f0ee406aae0 2023-10-09T06:27:48.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.242+0000 7f0eea076700 1 -- 172.21.15.31:0/1247892452 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0ee40b04b0 con 0x7f0ee406aae0 2023-10-09T06:27:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.246+0000 7f0ecb7fe700 1 -- 172.21.15.31:0/1247892452 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0ed40549b0 con 0x7f0ee406aae0 2023-10-09T06:27:48.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.248+0000 7f0eea076700 1 -- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0ed0066f30 msgr2=0x7f0ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.248+0000 7f0eea076700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0ed0066f30 0x7f0ed00693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8006f00 tx=0x7f0ed8008040 comp rx=0 tx=0).stop 2023-10-09T06:27:48.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.248+0000 7f0eea076700 1 -- 172.21.15.31:0/1247892452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ee406aae0 msgr2=0x7f0ee4155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.248+0000 7f0eea076700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ee406aae0 0x7f0ee4155a20 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400c7e0 tx=0x7f0ed4007df0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.248+0000 7f0eea076700 1 -- 172.21.15.31:0/1247892452 shutdown_connections 2023-10-09T06:27:48.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.248+0000 7f0eea076700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0ed0066f30 0x7f0ed00693e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.248+0000 7f0eea076700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ee415a290 0x7f0ee40b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.248+0000 7f0eea076700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ee406aae0 0x7f0ee4155a20 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.248+0000 7f0eea076700 1 --2- 172.21.15.31:0/1247892452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ee4159ec0 0x7f0ee40c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.248+0000 7f0eea076700 1 -- 172.21.15.31:0/1247892452 >> 172.21.15.31:0/1247892452 conn(0x7f0ee40d1880 msgr2=0x7f0ee4157bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.248+0000 7f0eea076700 1 -- 172.21.15.31:0/1247892452 shutdown_connections 2023-10-09T06:27:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.248+0000 7f0eea076700 1 -- 172.21.15.31:0/1247892452 wait complete. 2023-10-09T06:27:48.261 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:27:48.261 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:27:48.299 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:27:48.344 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:27:48.344 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:27:48.344 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:27:48.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.462+0000 7f927b913700 1 Processor -- start 2023-10-09T06:27:48.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.463+0000 7f927b913700 1 -- start start 2023-10-09T06:27:48.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.463+0000 7f927b913700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f92741523e0 0x7f927406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.463+0000 7f927b913700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9274158e50 0x7f92740cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.463+0000 7f927b913700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927406c010 con 0x7f9274152010 2023-10-09T06:27:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.463+0000 7f927b913700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927406bd10 con 0x7f9274158e50 2023-10-09T06:27:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.463+0000 7f927b913700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927415c060 con 0x7f92741523e0 2023-10-09T06:27:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.463+0000 7f9279eb0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9274158e50 0x7f92740cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.464+0000 7f9279eb0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9274158e50 0x7f92740cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47932/0 (socket says 172.21.15.31:47932) 2023-10-09T06:27:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.464+0000 7f9279eb0700 1 -- 172.21.15.31:0/146302398 learned_addr learned my addr 172.21.15.31:0/146302398 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.464+0000 7f9278eae700 1 --2- 172.21.15.31:0/146302398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f92741523e0 0x7f927406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.464+0000 7f9279eb0700 1 -- 172.21.15.31:0/146302398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f92741523e0 msgr2=0x7f927406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.464+0000 7f9279eb0700 1 --2- 172.21.15.31:0/146302398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f92741523e0 0x7f927406c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.464+0000 7f9279eb0700 1 -- 172.21.15.31:0/146302398 >> v1:172.21.15.158:6789/0 conn(0x7f9274152010 legacy=0x7f927415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.464+0000 7f9279eb0700 1 -- 172.21.15.31:0/146302398 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927415c340 con 0x7f9274158e50 2023-10-09T06:27:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.464+0000 7f9279eb0700 1 --2- 172.21.15.31:0/146302398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9274158e50 0x7f92740cdf30 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f9264009f20 tx=0x7f9264009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace987547bc41a7b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.464+0000 7f9273fff700 1 -- 172.21.15.31:0/146302398 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400e070 con 0x7f9274158e50 2023-10-09T06:27:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.464+0000 7f9273fff700 1 -- 172.21.15.31:0/146302398 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926400ba80 con 0x7f9274158e50 2023-10-09T06:27:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.464+0000 7f9273fff700 1 -- 172.21.15.31:0/146302398 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92640092e0 con 0x7f9274158e50 2023-10-09T06:27:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.465+0000 7f927b913700 1 -- 172.21.15.31:0/146302398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9274158e50 msgr2=0x7f92740cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.465+0000 7f927b913700 1 --2- 172.21.15.31:0/146302398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9274158e50 0x7f92740cdf30 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f9264009f20 tx=0x7f9264009840 comp rx=0 tx=0).stop 2023-10-09T06:27:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.465+0000 7f927b913700 1 -- 172.21.15.31:0/146302398 shutdown_connections 2023-10-09T06:27:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.465+0000 7f927b913700 1 --2- 172.21.15.31:0/146302398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9274158e50 0x7f92740cdf30 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.465+0000 7f927b913700 1 --2- 172.21.15.31:0/146302398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f92741523e0 0x7f927406c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.465+0000 7f927b913700 1 -- 172.21.15.31:0/146302398 >> 172.21.15.31:0/146302398 conn(0x7f9274069870 msgr2=0x7f9274069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.465+0000 7f927b913700 1 -- 172.21.15.31:0/146302398 shutdown_connections 2023-10-09T06:27:48.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.465+0000 7f927b913700 1 -- 172.21.15.31:0/146302398 wait complete. 2023-10-09T06:27:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.466+0000 7f927b913700 1 Processor -- start 2023-10-09T06:27:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.466+0000 7f927b913700 1 -- start start 2023-10-09T06:27:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f927b913700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9274152010 0x7f927416bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f927b913700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92741523e0 0x7f927413d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f927b913700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9274158e50 0x7f92740c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f927b913700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927416c260 con 0x7f92741523e0 2023-10-09T06:27:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f927b913700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92740c40d0 con 0x7f9274152010 2023-10-09T06:27:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f927b913700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92740c5bf0 con 0x7f9274158e50 2023-10-09T06:27:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f9278eae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92741523e0 0x7f927413d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f9278eae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92741523e0 0x7f927413d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47938/0 (socket says 172.21.15.31:47938) 2023-10-09T06:27:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f9278eae700 1 -- 172.21.15.31:0/2244257971 learned_addr learned my addr 172.21.15.31:0/2244257971 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f9279eb0700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9274158e50 0x7f92740c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f92796af700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9274152010 0x7f927416bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f9278eae700 1 -- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9274158e50 msgr2=0x7f92740c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f9278eae700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9274158e50 0x7f92740c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f9278eae700 1 -- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9274152010 msgr2=0x7f927416bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f9278eae700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9274152010 0x7f927416bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f9278eae700 1 -- 172.21.15.31:0/2244257971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9264009ae0 con 0x7f92741523e0 2023-10-09T06:27:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f9278eae700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92741523e0 0x7f927413d390 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f926800d860 tx=0x7f9268008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f92717fa700 1 -- 172.21.15.31:0/2244257971 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680125f0 con 0x7f92741523e0 2023-10-09T06:27:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f92717fa700 1 -- 172.21.15.31:0/2244257971 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9268012750 con 0x7f92741523e0 2023-10-09T06:27:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.467+0000 7f927b913700 1 -- 172.21.15.31:0/2244257971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92740c5ed0 con 0x7f92741523e0 2023-10-09T06:27:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.468+0000 7f92717fa700 1 -- 172.21.15.31:0/2244257971 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268012af0 con 0x7f92741523e0 2023-10-09T06:27:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.468+0000 7f927b913700 1 -- 172.21.15.31:0/2244257971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92740c3d60 con 0x7f92741523e0 2023-10-09T06:27:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.468+0000 7f927b913700 1 -- 172.21.15.31:0/2244257971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92740c3ef0 con 0x7f92741523e0 2023-10-09T06:27:48.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.469+0000 7f92717fa700 1 -- 172.21.15.31:0/2244257971 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9268013480 con 0x7f92741523e0 2023-10-09T06:27:48.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.469+0000 7f92717fa700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9260066f60 0x7f9260069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.469+0000 7f92717fa700 1 -- 172.21.15.31:0/2244257971 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9268084560 con 0x7f92741523e0 2023-10-09T06:27:48.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.470+0000 7f92796af700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9260066f60 0x7f9260069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.470+0000 7f92796af700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9260066f60 0x7f9260069410 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f926c0039e0 tx=0x7f926c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:48.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.474+0000 7f92717fa700 1 -- 172.21.15.31:0/2244257971 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9268055560 con 0x7f92741523e0 2023-10-09T06:27:48.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.711+0000 7f927b913700 1 -- 172.21.15.31:0/2244257971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92740c38e0 con 0x7f92741523e0 2023-10-09T06:27:48.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.711+0000 7f92717fa700 1 -- 172.21.15.31:0/2244257971 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f92740c38e0 con 0x7f92741523e0 2023-10-09T06:27:48.712 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:48.712 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/1232957657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1232957657},{"type":"v1","addr":"172.21.15.158:6836","nonce":1232957657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/2947695434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":2947695434},{"type":"v1","addr":"172.21.15.158:6837","nonce":2947695434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/912397379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":912397379},{"type":"v1","addr":"172.21.15.31:6834","nonce":912397379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/4213442753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":4213442753},{"type":"v1","addr":"172.21.15.31:6835","nonce":4213442753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[]} 2023-10-09T06:27:48.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.714+0000 7f927b913700 1 -- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9260066f60 msgr2=0x7f9260069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.714+0000 7f927b913700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9260066f60 0x7f9260069410 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f926c0039e0 tx=0x7f926c007ec0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.714+0000 7f927b913700 1 -- 172.21.15.31:0/2244257971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92741523e0 msgr2=0x7f927413d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.714+0000 7f927b913700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92741523e0 0x7f927413d390 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f926800d860 tx=0x7f9268008040 comp rx=0 tx=0).stop 2023-10-09T06:27:48.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.714+0000 7f927b913700 1 -- 172.21.15.31:0/2244257971 shutdown_connections 2023-10-09T06:27:48.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.714+0000 7f927b913700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9260066f60 0x7f9260069410 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.714+0000 7f927b913700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9274158e50 0x7f92740c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.714+0000 7f927b913700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9274152010 0x7f927416bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.714+0000 7f927b913700 1 --2- 172.21.15.31:0/2244257971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92741523e0 0x7f927413d390 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.714+0000 7f927b913700 1 -- 172.21.15.31:0/2244257971 >> 172.21.15.31:0/2244257971 conn(0x7f9274069870 msgr2=0x7f927414cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:48.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.714+0000 7f927b913700 1 -- 172.21.15.31:0/2244257971 shutdown_connections 2023-10-09T06:27:48.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.714+0000 7f927b913700 1 -- 172.21.15.31:0/2244257971 wait complete. 2023-10-09T06:27:48.716 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 68 2023-10-09T06:27:48.727 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:27:48.727 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:27:48.727 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:27:48.727 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:27:48.727 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:27:48.727 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:27:48.728 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:27:48.728 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:27:48.728 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:27:48.728 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:27:48.728 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:27:48.728 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:27:48.728 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:27:48.728 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:27:48.729 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:27:48.729 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:27:48.736 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:27:48.736 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:27:48.736 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:27:48.737 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:27:48.739 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:27:48.739 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:27:48.739 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:27:48.740 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:27:48.778 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:27:48.778 DEBUG:teuthology.parallel:result is None 2023-10-09T06:27:48.778 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:27:48.779 DEBUG:teuthology.parallel:result is None 2023-10-09T06:27:48.781 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:27:48.781 DEBUG:teuthology.parallel:result is None 2023-10-09T06:27:48.782 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:27:48.782 DEBUG:teuthology.parallel:result is None 2023-10-09T06:27:48.782 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:27:48.853 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:27:48.854 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-10-09T06:27:48.861 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:27:48.861 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-09T06:27:48.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.906+0000 7efe8abe8700 1 Processor -- start 2023-10-09T06:27:48.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.907+0000 7efe8abe8700 1 -- start start 2023-10-09T06:27:48.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe8abe8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efe8415e000 0x7efe840abe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe8abe8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efe840cabc0 0x7efe84159df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe8abe8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe840cb3a0 con 0x7efe84159a20 2023-10-09T06:27:48.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe8abe8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8415e770 con 0x7efe840cabc0 2023-10-09T06:27:48.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe8abe8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe840aba00 con 0x7efe8415e000 2023-10-09T06:27:48.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe8a3e7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efe840cabc0 0x7efe84159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe8a3e7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efe840cabc0 0x7efe84159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47978/0 (socket says 172.21.15.31:47978) 2023-10-09T06:27:48.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe89be6700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efe84159a20 0x7efe8415d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46108/0 (socket says 172.21.15.31:46108) 2023-10-09T06:27:48.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe8a3e7700 1 -- 172.21.15.31:0/238008914 learned_addr learned my addr 172.21.15.31:0/238008914 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:48.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe893e5700 1 --2- 172.21.15.31:0/238008914 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efe8415e000 0x7efe840abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe8a3e7700 1 -- 172.21.15.31:0/238008914 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efe8415e000 msgr2=0x7efe840abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:48.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe8a3e7700 1 --2- 172.21.15.31:0/238008914 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efe8415e000 0x7efe840abe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe8a3e7700 1 -- 172.21.15.31:0/238008914 >> v1:172.21.15.31:6789/0 conn(0x7efe84159a20 legacy=0x7efe8415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe8a3e7700 1 -- 172.21.15.31:0/238008914 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe840cb0c0 con 0x7efe840cabc0 2023-10-09T06:27:48.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.908+0000 7efe8a3e7700 1 --2- 172.21.15.31:0/238008914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe840cabc0 0x7efe84159df0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009f20 tx=0x7efe7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d629a3bb36e0b9c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:48.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.911+0000 7efe88be4700 1 -- 172.21.15.31:0/238008914 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00e070 con 0x7efe840cabc0 2023-10-09T06:27:48.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.911+0000 7efe88be4700 1 -- 172.21.15.31:0/238008914 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c00b9d0 con 0x7efe840cabc0 2023-10-09T06:27:48.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.911+0000 7efe88be4700 1 -- 172.21.15.31:0/238008914 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0092e0 con 0x7efe840cabc0 2023-10-09T06:27:48.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.912+0000 7efe8abe8700 1 -- 172.21.15.31:0/238008914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe840cabc0 msgr2=0x7efe84159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.912+0000 7efe8abe8700 1 --2- 172.21.15.31:0/238008914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe840cabc0 0x7efe84159df0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009f20 tx=0x7efe7c009840 comp rx=0 tx=0).stop 2023-10-09T06:27:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.912+0000 7efe8abe8700 1 -- 172.21.15.31:0/238008914 shutdown_connections 2023-10-09T06:27:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.912+0000 7efe8abe8700 1 --2- 172.21.15.31:0/238008914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe840cabc0 0x7efe84159df0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.912+0000 7efe8abe8700 1 --2- 172.21.15.31:0/238008914 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efe8415e000 0x7efe840abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.912+0000 7efe8abe8700 1 -- 172.21.15.31:0/238008914 >> 172.21.15.31:0/238008914 conn(0x7efe840ccff0 msgr2=0x7efe840cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.912+0000 7efe8abe8700 1 -- 172.21.15.31:0/238008914 shutdown_connections 2023-10-09T06:27:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.912+0000 7efe8abe8700 1 -- 172.21.15.31:0/238008914 wait complete. 2023-10-09T06:27:48.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.913+0000 7efe8abe8700 1 Processor -- start 2023-10-09T06:27:48.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.913+0000 7efe8abe8700 1 -- start start 2023-10-09T06:27:48.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8abe8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe840cabc0 0x7efe8415c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8abe8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efe84159a20 0x7efe84154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8abe8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe8415e000 0x7efe8415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8abe8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8415ca80 con 0x7efe8415e000 2023-10-09T06:27:48.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8abe8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8415cc70 con 0x7efe840cabc0 2023-10-09T06:27:48.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8abe8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8415cf50 con 0x7efe84159a20 2023-10-09T06:27:48.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8a3e7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe8415e000 0x7efe8415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8a3e7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe8415e000 0x7efe8415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47984/0 (socket says 172.21.15.31:47984) 2023-10-09T06:27:48.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8a3e7700 1 -- 172.21.15.31:0/795070056 learned_addr learned my addr 172.21.15.31:0/795070056 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:48.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe89be6700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe840cabc0 0x7efe8415c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe893e5700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efe84159a20 0x7efe84154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8a3e7700 1 -- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efe84159a20 msgr2=0x7efe84154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8a3e7700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efe84159a20 0x7efe84154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8a3e7700 1 -- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe840cabc0 msgr2=0x7efe8415c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:48.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8a3e7700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe840cabc0 0x7efe8415c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:48.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8a3e7700 1 -- 172.21.15.31:0/795070056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c009ae0 con 0x7efe8415e000 2023-10-09T06:27:48.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe89be6700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe840cabc0 0x7efe8415c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:48.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.914+0000 7efe8a3e7700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe8415e000 0x7efe8415a360 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7efe8406d0d0 tx=0x7efe7c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:48.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.915+0000 7efe79ffb700 1 -- 172.21.15.31:0/795070056 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c008c30 con 0x7efe8415e000 2023-10-09T06:27:48.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.915+0000 7efe79ffb700 1 -- 172.21.15.31:0/795070056 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c008d90 con 0x7efe8415e000 2023-10-09T06:27:48.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.915+0000 7efe8abe8700 1 -- 172.21.15.31:0/795070056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe840694a0 con 0x7efe8415e000 2023-10-09T06:27:48.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.915+0000 7efe79ffb700 1 -- 172.21.15.31:0/795070056 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0266b0 con 0x7efe8415e000 2023-10-09T06:27:48.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.915+0000 7efe8abe8700 1 -- 172.21.15.31:0/795070056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe84155060 con 0x7efe8415e000 2023-10-09T06:27:48.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.916+0000 7efe8abe8700 1 -- 172.21.15.31:0/795070056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe84069300 con 0x7efe8415e000 2023-10-09T06:27:48.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.916+0000 7efe79ffb700 1 -- 172.21.15.31:0/795070056 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe7c003040 con 0x7efe8415e000 2023-10-09T06:27:48.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.917+0000 7efe79ffb700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efe68066f30 0x7efe680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:48.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.917+0000 7efe79ffb700 1 -- 172.21.15.31:0/795070056 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efe7c0861a0 con 0x7efe8415e000 2023-10-09T06:27:48.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.917+0000 7efe89be6700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efe68066f30 0x7efe680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:48.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.917+0000 7efe89be6700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efe68066f30 0x7efe680693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7efe80007fd0 tx=0x7efe80007db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:48.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:48.921+0000 7efe79ffb700 1 -- 172.21.15.31:0/795070056 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe84069300 con 0x7efe8415e000 2023-10-09T06:27:49.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.130+0000 7efe8abe8700 1 -- 172.21.15.31:0/795070056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7efe84069300 con 0x7efe8415e000 2023-10-09T06:27:49.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.909+0000 7efe79ffb700 1 -- 172.21.15.31:0/795070056 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v148) v1 ==== 97+0+0 (secure 0 0 0) 0x7efe84069300 con 0x7efe8415e000 2023-10-09T06:27:49.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.912+0000 7efe8abe8700 1 -- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efe68066f30 msgr2=0x7efe680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:49.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.912+0000 7efe8abe8700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efe68066f30 0x7efe680693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7efe80007fd0 tx=0x7efe80007db0 comp rx=0 tx=0).stop 2023-10-09T06:27:49.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.912+0000 7efe8abe8700 1 -- 172.21.15.31:0/795070056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe8415e000 msgr2=0x7efe8415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:49.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.912+0000 7efe8abe8700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe8415e000 0x7efe8415a360 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7efe8406d0d0 tx=0x7efe7c018000 comp rx=0 tx=0).stop 2023-10-09T06:27:49.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.912+0000 7efe8abe8700 1 -- 172.21.15.31:0/795070056 shutdown_connections 2023-10-09T06:27:49.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.912+0000 7efe8abe8700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efe68066f30 0x7efe680693e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:49.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.912+0000 7efe8abe8700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe8415e000 0x7efe8415a360 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:49.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.912+0000 7efe8abe8700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe840cabc0 0x7efe8415c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:49.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.912+0000 7efe8abe8700 1 --2- 172.21.15.31:0/795070056 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efe84159a20 0x7efe84154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:49.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.912+0000 7efe8abe8700 1 -- 172.21.15.31:0/795070056 >> 172.21.15.31:0/795070056 conn(0x7efe840ccff0 msgr2=0x7efe84156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:49.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.912+0000 7efe8abe8700 1 -- 172.21.15.31:0/795070056 shutdown_connections 2023-10-09T06:27:49.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:49.912+0000 7efe8abe8700 1 -- 172.21.15.31:0/795070056 wait complete. 2023-10-09T06:27:49.914 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2023-10-09T06:27:49.925 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:27:50.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.046+0000 7fdeeddc1700 1 Processor -- start 2023-10-09T06:27:50.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.046+0000 7fdeeddc1700 1 -- start start 2023-10-09T06:27:50.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.047+0000 7fdeeddc1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdee81577d0 0x7fdee80cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.047+0000 7fdeeddc1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdee806ac30 0x7fdee815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.047+0000 7fdeeddc1700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee815c360 con 0x7fdee8157ba0 2023-10-09T06:27:50.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.047+0000 7fdeeddc1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee815b790 con 0x7fdee806ac30 2023-10-09T06:27:50.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.047+0000 7fdeeddc1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee815ba30 con 0x7fdee81577d0 2023-10-09T06:27:50.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdee806ac30 0x7fdee815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee77fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdee81577d0 0x7fdee80cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdee806ac30 0x7fdee815c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:45358/0 (socket says 172.21.15.31:45358) 2023-10-09T06:27:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee77fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdee81577d0 0x7fdee80cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:59312/0 (socket says 172.21.15.31:59312) 2023-10-09T06:27:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee7fff700 1 -- 172.21.15.31:0/2503530168 learned_addr learned my addr 172.21.15.31:0/2503530168 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee6ffd700 1 --1- 172.21.15.31:0/2503530168 >> v1:172.21.15.158:6789/0 conn(0x7fdee8157ba0 0x7fdee806a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:35872/0 (socket says 172.21.15.31:35872) 2023-10-09T06:27:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee7fff700 1 -- 172.21.15.31:0/2503530168 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdee81577d0 msgr2=0x7fdee80cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee7fff700 1 --2- 172.21.15.31:0/2503530168 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdee81577d0 0x7fdee80cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee7fff700 1 -- 172.21.15.31:0/2503530168 >> v1:172.21.15.158:6789/0 conn(0x7fdee8157ba0 legacy=0x7fdee806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee7fff700 1 -- 172.21.15.31:0/2503530168 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee815bd10 con 0x7fdee806ac30 2023-10-09T06:27:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee67fc700 1 -- 172.21.15.31:0/2503530168 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090477313 0 0) 0x7fdee815c360 con 0x7fdee8157ba0 2023-10-09T06:27:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee77fe700 1 --2- 172.21.15.31:0/2503530168 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdee81577d0 0x7fdee80cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:27:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee7fff700 1 --2- 172.21.15.31:0/2503530168 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdee806ac30 0x7fdee815c7f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009f20 tx=0x7fdee0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fb6c7ee1326f3c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:50.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee67fc700 1 -- 172.21.15.31:0/2503530168 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee000e070 con 0x7fdee806ac30 2023-10-09T06:27:50.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.048+0000 7fdee67fc700 1 -- 172.21.15.31:0/2503530168 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee000b9d0 con 0x7fdee806ac30 2023-10-09T06:27:50.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.049+0000 7fdee67fc700 1 -- 172.21.15.31:0/2503530168 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00092e0 con 0x7fdee806ac30 2023-10-09T06:27:50.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.049+0000 7fdeeddc1700 1 -- 172.21.15.31:0/2503530168 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdee806ac30 msgr2=0x7fdee815c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.049+0000 7fdeeddc1700 1 --2- 172.21.15.31:0/2503530168 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdee806ac30 0x7fdee815c7f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009f20 tx=0x7fdee0009840 comp rx=0 tx=0).stop 2023-10-09T06:27:50.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.049+0000 7fdeeddc1700 1 -- 172.21.15.31:0/2503530168 shutdown_connections 2023-10-09T06:27:50.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.049+0000 7fdeeddc1700 1 --2- 172.21.15.31:0/2503530168 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdee806ac30 0x7fdee815c7f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.049+0000 7fdeeddc1700 1 --2- 172.21.15.31:0/2503530168 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdee81577d0 0x7fdee80cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.049+0000 7fdeeddc1700 1 -- 172.21.15.31:0/2503530168 >> 172.21.15.31:0/2503530168 conn(0x7fdee8068ce0 msgr2=0x7fdee80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:50.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.049+0000 7fdeeddc1700 1 -- 172.21.15.31:0/2503530168 shutdown_connections 2023-10-09T06:27:50.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.049+0000 7fdeeddc1700 1 -- 172.21.15.31:0/2503530168 wait complete. 2023-10-09T06:27:50.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.050+0000 7fdeeddc1700 1 Processor -- start 2023-10-09T06:27:50.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.050+0000 7fdeeddc1700 1 -- start start 2023-10-09T06:27:50.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdeeddc1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdee806ac30 0x7fdee815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdeeddc1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee81577d0 0x7fdee80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdeeddc1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdee8157ba0 0x7fdee80b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdeeddc1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee814faa0 con 0x7fdee81577d0 2023-10-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdeeddc1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee815f6e0 con 0x7fdee8157ba0 2023-10-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdeeddc1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee816b060 con 0x7fdee806ac30 2023-10-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdee6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee81577d0 0x7fdee80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdee6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee81577d0 0x7fdee80b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43590/0 (socket says 172.21.15.31:43590) 2023-10-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdee6ffd700 1 -- 172.21.15.31:0/841545880 learned_addr learned my addr 172.21.15.31:0/841545880 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdee7fff700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdee8157ba0 0x7fdee80b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdee77fe700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdee806ac30 0x7fdee815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdee6ffd700 1 -- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdee806ac30 msgr2=0x7fdee815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdee6ffd700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdee806ac30 0x7fdee815cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdee6ffd700 1 -- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdee8157ba0 msgr2=0x7fdee80b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.051+0000 7fdee6ffd700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdee8157ba0 0x7fdee80b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.052+0000 7fdee6ffd700 1 -- 172.21.15.31:0/841545880 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded8009420 con 0x7fdee81577d0 2023-10-09T06:27:50.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.052+0000 7fdee6ffd700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee81577d0 0x7fdee80b5f80 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00c5b0 tx=0x7fdedc001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:50.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.052+0000 7fdecf7fe700 1 -- 172.21.15.31:0/841545880 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc005a70 con 0x7fdee81577d0 2023-10-09T06:27:50.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.052+0000 7fdecf7fe700 1 -- 172.21.15.31:0/841545880 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc005bd0 con 0x7fdee81577d0 2023-10-09T06:27:50.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.052+0000 7fdeeddc1700 1 -- 172.21.15.31:0/841545880 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee0009ae0 con 0x7fdee81577d0 2023-10-09T06:27:50.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.052+0000 7fdecf7fe700 1 -- 172.21.15.31:0/841545880 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0070d0 con 0x7fdee81577d0 2023-10-09T06:27:50.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.052+0000 7fdeeddc1700 1 -- 172.21.15.31:0/841545880 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee814f450 con 0x7fdee81577d0 2023-10-09T06:27:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.053+0000 7fdeeddc1700 1 -- 172.21.15.31:0/841545880 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee804c3c0 con 0x7fdee81577d0 2023-10-09T06:27:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.053+0000 7fdecf7fe700 1 -- 172.21.15.31:0/841545880 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdedc007480 con 0x7fdee81577d0 2023-10-09T06:27:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.053+0000 7fdecf7fe700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fded4066f30 0x7fded40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.054+0000 7fdecf7fe700 1 -- 172.21.15.31:0/841545880 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdedc083700 con 0x7fdee81577d0 2023-10-09T06:27:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.054+0000 7fdee77fe700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fded4066f30 0x7fded40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.054+0000 7fdee77fe700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fded4066f30 0x7fded40693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fded80093f0 tx=0x7fded8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.058+0000 7fdecf7fe700 1 -- 172.21.15.31:0/841545880 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdedc050cc0 con 0x7fdee81577d0 2023-10-09T06:27:50.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.330+0000 7fdeeddc1700 1 -- 172.21.15.31:0/841545880 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdee814fbe0 con 0x7fdee81577d0 2023-10-09T06:27:50.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.330+0000 7fdecf7fe700 1 -- 172.21.15.31:0/841545880 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdedc017090 con 0x7fdee81577d0 2023-10-09T06:27:50.331 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:50.331 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:27:50.331 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2023-10-09T06:27:50.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.332 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2023-10-09T06:27:50.332 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl/nWKAxAA1kcqjt4lPGPkmDivDpIVjQ==", 2023-10-09T06:27:50.332 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.332 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:50.332 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:27:50.332 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:27:50.332 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.332 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.333 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2023-10-09T06:27:50.333 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl9xYEDxAAQJeaqz7lkrArv45vLGb34g==", 2023-10-09T06:27:50.333 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.333 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:50.333 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:27:50.333 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:27:50.333 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.333 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.334 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2023-10-09T06:27:50.334 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlJOp0ChAADGiI4SX7ZLvDrtjDtU905A==", 2023-10-09T06:27:50.334 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.334 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:50.334 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:27:50.334 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:27:50.334 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.334 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.334 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2023-10-09T06:27:50.335 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlbnnJFRAAO+XoxRQDaHv0ZicyggniLQ==", 2023-10-09T06:27:50.335 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.335 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:50.335 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:27:50.335 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:27:50.335 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.335 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.335 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2023-10-09T06:27:50.335 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNloyZ+LxAApAHpPxV7R1OVE2wlIaU+PA==", 2023-10-09T06:27:50.335 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.336 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:50.336 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:50.336 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.336 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.336 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2023-10-09T06:27:50.336 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNlvHeUNhAAXblIEmmsc5eTo5VcZVirfA==", 2023-10-09T06:27:50.336 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.336 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:50.336 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:50.336 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.337 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.337 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2023-10-09T06:27:50.337 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlxfIaBBAAE8WbXh4Q4SxaW2k7MkSTHg==", 2023-10-09T06:27:50.337 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.337 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:50.337 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:50.337 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.337 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.338 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2023-10-09T06:27:50.338 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlUtX3DRAA5NEq+lFMzqhu1GF1ZWT2ag==", 2023-10-09T06:27:50.338 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.338 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:50.338 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:50.338 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.338 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.338 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2023-10-09T06:27:50.338 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlcWc5IBAA5e62AwhIuHdw4dTjnNS8hQ==", 2023-10-09T06:27:50.338 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.339 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:50.339 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:50.339 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.339 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.339 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2023-10-09T06:27:50.339 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlX5S6JhAAzvzO2YEqEtq2fJ3FW9Fddg==", 2023-10-09T06:27:50.339 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.339 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:50.339 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:50.339 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.340 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.340 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2023-10-09T06:27:50.340 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl9jy5LxAAxgMslSN6ayxB2MFRf2dwNQ==", 2023-10-09T06:27:50.340 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.340 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:50.340 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:50.340 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.340 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.341 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2023-10-09T06:27:50.341 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl8M+TOBAARhk2wEaXO9Pi4TP9d+L5Gg==", 2023-10-09T06:27:50.341 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.341 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:27:50.341 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:27:50.341 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.341 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.341 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2023-10-09T06:27:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlfsC2GRAAlm37QI8DkNclcBpD5ZBR7A==", 2023-10-09T06:27:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2023-10-09T06:27:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T06:27:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2023-10-09T06:27:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlapIxIhAAiBZUkpnf6tyFHwySGKhRpQ==", 2023-10-09T06:27:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:50.343 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:27:50.343 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:27:50.343 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:27:50.343 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.343 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2023-10-09T06:27:50.343 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEZYuHxAA7WEH0vXmAEH5Wki8ESrDBg==", 2023-10-09T06:27:50.343 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.343 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:50.343 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:27:50.344 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:27:50.344 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:27:50.344 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.344 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2023-10-09T06:27:50.344 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlFvuIJxAAGuTp4gsXrvUzDd1B7d5vcg==", 2023-10-09T06:27:50.344 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.344 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:27:50.344 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:27:50.344 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:27:50.344 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:27:50.345 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.345 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2023-10-09T06:27:50.345 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlS8AlJBAAg8lLRVasKHyhbFlOTfgt9g==", 2023-10-09T06:27:50.345 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.345 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:27:50.345 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:27:50.345 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:27:50.345 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.345 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.346 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2023-10-09T06:27:50.346 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEE9eABAAHbJ1yvlmOUNo6n2uAhPrnw==", 2023-10-09T06:27:50.346 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.346 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:27:50.346 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:27:50.346 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.346 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:27:50.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:50.346 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2023-10-09T06:27:50.347 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlhol5OBAAZSZ+PbojVwsOJtLlTl6wAA==", 2023-10-09T06:27:50.347 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:27:50.347 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:27:50.347 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:27:50.347 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:27:50.347 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.347 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:50.347 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:27:50.347 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:27:50.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.332+0000 7fdeeddc1700 1 -- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fded4066f30 msgr2=0x7fded40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.332+0000 7fdeeddc1700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fded4066f30 0x7fded40693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fded80093f0 tx=0x7fded8008040 comp rx=0 tx=0).stop 2023-10-09T06:27:50.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.332+0000 7fdeeddc1700 1 -- 172.21.15.31:0/841545880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee81577d0 msgr2=0x7fdee80b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.332+0000 7fdeeddc1700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee81577d0 0x7fdee80b5f80 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00c5b0 tx=0x7fdedc001040 comp rx=0 tx=0).stop 2023-10-09T06:27:50.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.332+0000 7fdeeddc1700 1 -- 172.21.15.31:0/841545880 shutdown_connections 2023-10-09T06:27:50.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.332+0000 7fdeeddc1700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fded4066f30 0x7fded40693e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.332+0000 7fdeeddc1700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdee806ac30 0x7fdee815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.332+0000 7fdeeddc1700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdee8157ba0 0x7fdee80b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.332+0000 7fdeeddc1700 1 --2- 172.21.15.31:0/841545880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee81577d0 0x7fdee80b5f80 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.332+0000 7fdeeddc1700 1 -- 172.21.15.31:0/841545880 >> 172.21.15.31:0/841545880 conn(0x7fdee8068ce0 msgr2=0x7fdee80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:50.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.332+0000 7fdeeddc1700 1 -- 172.21.15.31:0/841545880 shutdown_connections 2023-10-09T06:27:50.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.332+0000 7fdeeddc1700 1 -- 172.21.15.31:0/841545880 wait complete. 2023-10-09T06:27:50.350 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:27:50.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.468+0000 7ff42b59e700 1 Processor -- start 2023-10-09T06:27:50.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.468+0000 7ff42b59e700 1 -- start start 2023-10-09T06:27:50.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42b59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff42c15cbd0 0x7ff42c15d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42b59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c0cb7c0 con 0x7ff42c0cd6e0 2023-10-09T06:27:50.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42b59e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c15e290 con 0x7ff42c0cdab0 2023-10-09T06:27:50.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42b59e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c15e850 con 0x7ff42c15cbd0 2023-10-09T06:27:50.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42a59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff42c0cd6e0 0x7ff42c0cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58134/0 (socket says 172.21.15.31:58134) 2023-10-09T06:27:50.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42a59c700 1 -- 172.21.15.31:0/2121860073 learned_addr learned my addr 172.21.15.31:0/2121860073 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:50.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42ad9d700 1 --2- 172.21.15.31:0/2121860073 >> v2:172.21.15.158:3300/0 conn(0x7ff42c15cbd0 0x7ff42c15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174863549 0 0) 0x7ff42c0cb7c0 con 0x7ff42c0cd6e0 2023-10-09T06:27:50.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff418003570 con 0x7ff42c0cd6e0 2023-10-09T06:27:50.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 234802798 0 0) 0x7ff418003570 con 0x7ff42c0cd6e0 2023-10-09T06:27:50.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 >> v2:172.21.15.158:3300/0 conn(0x7ff42c15cbd0 msgr2=0x7ff42c15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:50.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 --2- 172.21.15.31:0/2121860073 >> v2:172.21.15.158:3300/0 conn(0x7ff42c15cbd0 0x7ff42c15d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 >> v1:172.21.15.158:6789/0 conn(0x7ff42c0cdab0 legacy=0x7ff42c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c15e570 con 0x7ff42c0cd6e0 2023-10-09T06:27:50.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7ff424001470 con 0x7ff42c0cd6e0 2023-10-09T06:27:50.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 >> v1:172.21.15.31:6789/0 conn(0x7ff42c0cd6e0 legacy=0x7ff42c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 --2- 172.21.15.31:0/2121860073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff418003a60 0x7ff418003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 --2- 172.21.15.31:0/2121860073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff418004810 0x7ff418004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 --2- 172.21.15.31:0/2121860073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4180051c0 0x7ff41800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c15e850 con 0x7ff418004810 2023-10-09T06:27:50.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41800c0d0 con 0x7ff4180051c0 2023-10-09T06:27:50.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.469+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41800c290 con 0x7ff418003a60 2023-10-09T06:27:50.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.470+0000 7ff429d9b700 1 --2- 172.21.15.31:0/2121860073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff418004810 0x7ff418004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.470+0000 7ff42a59c700 1 --2- 172.21.15.31:0/2121860073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff418003a60 0x7ff418003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.470+0000 7ff42ad9d700 1 --2- 172.21.15.31:0/2121860073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4180051c0 0x7ff41800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.470+0000 7ff429d9b700 1 -- 172.21.15.31:0/2121860073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff418003a60 msgr2=0x7ff418003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:50.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.470+0000 7ff429d9b700 1 --2- 172.21.15.31:0/2121860073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff418003a60 0x7ff418003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.470+0000 7ff429d9b700 1 -- 172.21.15.31:0/2121860073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4180051c0 msgr2=0x7ff41800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:50.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.470+0000 7ff429d9b700 1 --2- 172.21.15.31:0/2121860073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4180051c0 0x7ff41800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.470+0000 7ff42ad9d700 1 -- 172.21.15.31:0/2121860073 reap_dead start 2023-10-09T06:27:50.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.470+0000 7ff429d9b700 1 -- 172.21.15.31:0/2121860073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff418003570 con 0x7ff418004810 2023-10-09T06:27:50.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.470+0000 7ff429d9b700 1 --2- 172.21.15.31:0/2121860073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff418004810 0x7ff418004c80 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7ff4140018b0 tx=0x7ff414007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94be9ac0084b5f9e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:50.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.470+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414012420 con 0x7ff418004810 2023-10-09T06:27:50.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.470+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4140125a0 con 0x7ff418004810 2023-10-09T06:27:50.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.470+0000 7ff42959a700 1 -- 172.21.15.31:0/2121860073 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414012960 con 0x7ff418004810 2023-10-09T06:27:50.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.471+0000 7ff42b59e700 1 -- 172.21.15.31:0/2121860073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff418004810 msgr2=0x7ff418004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.471+0000 7ff42b59e700 1 --2- 172.21.15.31:0/2121860073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff418004810 0x7ff418004c80 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7ff4140018b0 tx=0x7ff414007d30 comp rx=0 tx=0).stop 2023-10-09T06:27:50.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.471+0000 7ff42b59e700 1 -- 172.21.15.31:0/2121860073 shutdown_connections 2023-10-09T06:27:50.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.471+0000 7ff42b59e700 1 --2- 172.21.15.31:0/2121860073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff418004810 0x7ff418004c80 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.471+0000 7ff42b59e700 1 -- 172.21.15.31:0/2121860073 >> 172.21.15.31:0/2121860073 conn(0x7ff42c067660 msgr2=0x7ff42c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:50.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.471+0000 7ff42b59e700 1 -- 172.21.15.31:0/2121860073 shutdown_connections 2023-10-09T06:27:50.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.471+0000 7ff42b59e700 1 -- 172.21.15.31:0/2121860073 wait complete. 2023-10-09T06:27:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.472+0000 7ff42b59e700 1 Processor -- start 2023-10-09T06:27:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.472+0000 7ff42b59e700 1 -- start start 2023-10-09T06:27:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff42b59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff418004810 0x7ff42c15c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff42b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff42c16b470 0x7ff42c0c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff42b59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff42c0ca190 0x7ff42c16e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff42b59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0cc360 con 0x7ff42c16b470 2023-10-09T06:27:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff42b59e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c15c720 con 0x7ff42c0ca190 2023-10-09T06:27:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff42b59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0c8ca0 con 0x7ff418004810 2023-10-09T06:27:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff429d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff42c16b470 0x7ff42c0c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff429d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff42c16b470 0x7ff42c0c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43602/0 (socket says 172.21.15.31:43602) 2023-10-09T06:27:50.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff429d9b700 1 -- 172.21.15.31:0/1766744401 learned_addr learned my addr 172.21.15.31:0/1766744401 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:50.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff42ad9d700 1 --2- 172.21.15.31:0/1766744401 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff42c0ca190 0x7ff42c16e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff429d9b700 1 -- 172.21.15.31:0/1766744401 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff418004810 msgr2=0x7ff42c15c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff429d9b700 1 --2- 172.21.15.31:0/1766744401 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff418004810 0x7ff42c15c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff429d9b700 1 -- 172.21.15.31:0/1766744401 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff42c0ca190 msgr2=0x7ff42c16e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff429d9b700 1 --2- 172.21.15.31:0/1766744401 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff42c0ca190 0x7ff42c16e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff429d9b700 1 -- 172.21.15.31:0/1766744401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c0ca5f0 con 0x7ff42c16b470 2023-10-09T06:27:50.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff429d9b700 1 --2- 172.21.15.31:0/1766744401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff42c16b470 0x7ff42c0c9c50 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7ff41800c0a0 tx=0x7ff414015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:50.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff4227fc700 1 -- 172.21.15.31:0/1766744401 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41400c780 con 0x7ff42c16b470 2023-10-09T06:27:50.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff4227fc700 1 -- 172.21.15.31:0/1766744401 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41400c8e0 con 0x7ff42c16b470 2023-10-09T06:27:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff42b59e700 1 -- 172.21.15.31:0/1766744401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c0c89c0 con 0x7ff42c16b470 2023-10-09T06:27:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff4227fc700 1 -- 172.21.15.31:0/1766744401 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41400cc80 con 0x7ff42c16b470 2023-10-09T06:27:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.473+0000 7ff42b59e700 1 -- 172.21.15.31:0/1766744401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c0c8370 con 0x7ff42c16b470 2023-10-09T06:27:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.474+0000 7ff42b59e700 1 -- 172.21.15.31:0/1766744401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42c0ccb60 con 0x7ff42c16b470 2023-10-09T06:27:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.475+0000 7ff4227fc700 1 -- 172.21.15.31:0/1766744401 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff41401f410 con 0x7ff42c16b470 2023-10-09T06:27:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.475+0000 7ff4227fc700 1 --2- 172.21.15.31:0/1766744401 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff40c066f30 0x7ff40c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.475+0000 7ff4227fc700 1 -- 172.21.15.31:0/1766744401 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff414085840 con 0x7ff42c16b470 2023-10-09T06:27:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.476+0000 7ff42a59c700 1 --2- 172.21.15.31:0/1766744401 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff40c066f30 0x7ff40c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.476+0000 7ff42a59c700 1 --2- 172.21.15.31:0/1766744401 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff40c066f30 0x7ff40c0693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff424001ce0 tx=0x7ff424001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.480+0000 7ff4227fc700 1 -- 172.21.15.31:0/1766744401 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff414052d60 con 0x7ff42c16b470 2023-10-09T06:27:50.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.672+0000 7ff42b59e700 1 -- 172.21.15.31:0/1766744401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff42c0ca5f0 con 0x7ff42c16b470 2023-10-09T06:27:50.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.673+0000 7ff4227fc700 1 -- 172.21.15.31:0/1766744401 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+12145 (secure 0 0 0) 0x7ff42c0ca5f0 con 0x7ff42c16b470 2023-10-09T06:27:50.674 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:50.674 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":148,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:27:49.908219+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:27:50.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.675+0000 7ff42b59e700 1 -- 172.21.15.31:0/1766744401 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff40c066f30 msgr2=0x7ff40c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.675+0000 7ff42b59e700 1 --2- 172.21.15.31:0/1766744401 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff40c066f30 0x7ff40c0693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff424001ce0 tx=0x7ff424001e50 comp rx=0 tx=0).stop 2023-10-09T06:27:50.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.675+0000 7ff42b59e700 1 -- 172.21.15.31:0/1766744401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff42c16b470 msgr2=0x7ff42c0c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.675+0000 7ff42b59e700 1 --2- 172.21.15.31:0/1766744401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff42c16b470 0x7ff42c0c9c50 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7ff41800c0a0 tx=0x7ff414015000 comp rx=0 tx=0).stop 2023-10-09T06:27:50.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.675+0000 7ff42b59e700 1 -- 172.21.15.31:0/1766744401 shutdown_connections 2023-10-09T06:27:50.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.675+0000 7ff42b59e700 1 --2- 172.21.15.31:0/1766744401 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff40c066f30 0x7ff40c0693e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.675+0000 7ff42b59e700 1 --2- 172.21.15.31:0/1766744401 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff418004810 0x7ff42c15c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.675+0000 7ff42b59e700 1 --2- 172.21.15.31:0/1766744401 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff42c0ca190 0x7ff42c16e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.675+0000 7ff42b59e700 1 --2- 172.21.15.31:0/1766744401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff42c16b470 0x7ff42c0c9c50 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.675+0000 7ff42b59e700 1 -- 172.21.15.31:0/1766744401 >> 172.21.15.31:0/1766744401 conn(0x7ff42c067660 msgr2=0x7ff42c0c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:50.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.675+0000 7ff42b59e700 1 -- 172.21.15.31:0/1766744401 shutdown_connections 2023-10-09T06:27:50.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.675+0000 7ff42b59e700 1 -- 172.21.15.31:0/1766744401 wait complete. 2023-10-09T06:27:50.688 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:27:50.689 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:27:50.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.809+0000 7f4e70bd8700 1 Processor -- start 2023-10-09T06:27:50.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.809+0000 7f4e70bd8700 1 -- start start 2023-10-09T06:27:50.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.810+0000 7f4e70bd8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e6c15a290 0x7f4e6c06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.810+0000 7f4e70bd8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6c0b0790 con 0x7f4e6c159ec0 2023-10-09T06:27:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.810+0000 7f4e70bd8700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6c06af20 con 0x7f4e6c06aae0 2023-10-09T06:27:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.810+0000 7f4e70bd8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6c0ce1f0 con 0x7f4e6c15a290 2023-10-09T06:27:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.810+0000 7f4e6a59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4e6c159ec0 0x7f4e6c0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58144/0 (socket says 172.21.15.31:58144) 2023-10-09T06:27:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.810+0000 7f4e6a59c700 1 -- 172.21.15.31:0/36596480 learned_addr learned my addr 172.21.15.31:0/36596480 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.810+0000 7f4e69d9b700 1 --2- 172.21.15.31:0/36596480 >> v2:172.21.15.31:3300/0 conn(0x7f4e6c15a290 0x7f4e6c06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.811+0000 7f4e6959a700 1 -- 172.21.15.31:0/36596480 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255858568 0 0) 0x7f4e6c0b0790 con 0x7f4e6c159ec0 2023-10-09T06:27:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.811+0000 7f4e6959a700 1 -- 172.21.15.31:0/36596480 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e58003570 con 0x7f4e6c159ec0 2023-10-09T06:27:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.811+0000 7f4e69d9b700 1 -- 172.21.15.31:0/36596480 >> v1:172.21.15.158:6789/0 conn(0x7f4e6c06aae0 legacy=0x7f4e6c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.811+0000 7f4e69d9b700 1 -- 172.21.15.31:0/36596480 >> v1:172.21.15.31:6789/0 conn(0x7f4e6c159ec0 legacy=0x7f4e6c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.811+0000 7f4e69d9b700 1 -- 172.21.15.31:0/36596480 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c0b0b20 con 0x7f4e6c15a290 2023-10-09T06:27:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.811+0000 7f4e69d9b700 1 --2- 172.21.15.31:0/36596480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c15a290 0x7f4e6c06a5a0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f4e540098e0 tx=0x7f4e540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299ca851316ac865 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.811+0000 7f4e6959a700 1 -- 172.21.15.31:0/36596480 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400b640 con 0x7f4e6c15a290 2023-10-09T06:27:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.811+0000 7f4e6959a700 1 -- 172.21.15.31:0/36596480 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5400b7a0 con 0x7f4e6c15a290 2023-10-09T06:27:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.811+0000 7f4e6959a700 1 -- 172.21.15.31:0/36596480 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400bb40 con 0x7f4e6c15a290 2023-10-09T06:27:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.811+0000 7f4e70bd8700 1 -- 172.21.15.31:0/36596480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c15a290 msgr2=0x7f4e6c06a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.811+0000 7f4e70bd8700 1 --2- 172.21.15.31:0/36596480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c15a290 0x7f4e6c06a5a0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f4e540098e0 tx=0x7f4e540091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.812+0000 7f4e70bd8700 1 -- 172.21.15.31:0/36596480 shutdown_connections 2023-10-09T06:27:50.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.812+0000 7f4e70bd8700 1 --2- 172.21.15.31:0/36596480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c15a290 0x7f4e6c06a5a0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.812+0000 7f4e70bd8700 1 -- 172.21.15.31:0/36596480 >> 172.21.15.31:0/36596480 conn(0x7f4e6c0d1880 msgr2=0x7f4e6c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:50.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.812+0000 7f4e70bd8700 1 -- 172.21.15.31:0/36596480 shutdown_connections 2023-10-09T06:27:50.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.812+0000 7f4e70bd8700 1 -- 172.21.15.31:0/36596480 wait complete. 2023-10-09T06:27:50.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.813+0000 7f4e70bd8700 1 Processor -- start 2023-10-09T06:27:50.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.813+0000 7f4e70bd8700 1 -- start start 2023-10-09T06:27:50.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.813+0000 7f4e70bd8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c06aae0 0x7f4e6c16af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.813+0000 7f4e70bd8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e6c159ec0 0x7f4e6c0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.813+0000 7f4e70bd8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e6c15a290 0x7f4e6c16d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.813+0000 7f4e70bd8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c0b6a10 con 0x7f4e6c06aae0 2023-10-09T06:27:50.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.813+0000 7f4e70bd8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c0ca7f0 con 0x7f4e6c15a290 2023-10-09T06:27:50.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.813+0000 7f4e70bd8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c0b4100 con 0x7f4e6c159ec0 2023-10-09T06:27:50.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e6a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c06aae0 0x7f4e6c16af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e6a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c06aae0 0x7f4e6c16af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43620/0 (socket says 172.21.15.31:43620) 2023-10-09T06:27:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e6a59c700 1 -- 172.21.15.31:0/2804611003 learned_addr learned my addr 172.21.15.31:0/2804611003 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e6ad9d700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e6c15a290 0x7f4e6c16d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e69d9b700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e6c159ec0 0x7f4e6c0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e6a59c700 1 -- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e6c159ec0 msgr2=0x7f4e6c0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e6a59c700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e6c159ec0 0x7f4e6c0b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e6a59c700 1 -- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e6c15a290 msgr2=0x7f4e6c16d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e6a59c700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e6c15a290 0x7f4e6c16d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e6a59c700 1 -- 172.21.15.31:0/2804611003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e54009420 con 0x7f4e6c06aae0 2023-10-09T06:27:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e69d9b700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e6c159ec0 0x7f4e6c0b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e6a59c700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c06aae0 0x7f4e6c16af30 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00cd30 tx=0x7f4e5c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e627fc700 1 -- 172.21.15.31:0/2804611003 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c00ce90 con 0x7f4e6c06aae0 2023-10-09T06:27:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e627fc700 1 -- 172.21.15.31:0/2804611003 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c00ab10 con 0x7f4e6c06aae0 2023-10-09T06:27:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e70bd8700 1 -- 172.21.15.31:0/2804611003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6c0b14f0 con 0x7f4e6c06aae0 2023-10-09T06:27:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e627fc700 1 -- 172.21.15.31:0/2804611003 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0070f0 con 0x7f4e6c06aae0 2023-10-09T06:27:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.814+0000 7f4e70bd8700 1 -- 172.21.15.31:0/2804611003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6c0b0ea0 con 0x7f4e6c06aae0 2023-10-09T06:27:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.815+0000 7f4e70bd8700 1 -- 172.21.15.31:0/2804611003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6c0b0d00 con 0x7f4e6c06aae0 2023-10-09T06:27:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.816+0000 7f4e627fc700 1 -- 172.21.15.31:0/2804611003 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e5c007520 con 0x7f4e6c06aae0 2023-10-09T06:27:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.816+0000 7f4e627fc700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e4c066f30 0x7f4e4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.816+0000 7f4e627fc700 1 -- 172.21.15.31:0/2804611003 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4e5c084700 con 0x7f4e6c06aae0 2023-10-09T06:27:50.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.816+0000 7f4e69d9b700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e4c066f30 0x7f4e4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:50.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.817+0000 7f4e69d9b700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e4c066f30 0x7f4e4c0693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4e540093f0 tx=0x7f4e54017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:50.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:50.820+0000 7f4e627fc700 1 -- 172.21.15.31:0/2804611003 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e6c0b0d00 con 0x7f4e6c06aae0 2023-10-09T06:27:51.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.012+0000 7f4e70bd8700 1 -- 172.21.15.31:0/2804611003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e6c0b0d00 con 0x7f4e6c06aae0 2023-10-09T06:27:51.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.013+0000 7f4e627fc700 1 -- 172.21.15.31:0/2804611003 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v148) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e6c0b0d00 con 0x7f4e6c06aae0 2023-10-09T06:27:51.014 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:27:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.015+0000 7f4e70bd8700 1 -- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e4c066f30 msgr2=0x7f4e4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.015+0000 7f4e70bd8700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e4c066f30 0x7f4e4c0693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4e540093f0 tx=0x7f4e54017000 comp rx=0 tx=0).stop 2023-10-09T06:27:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.015+0000 7f4e70bd8700 1 -- 172.21.15.31:0/2804611003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c06aae0 msgr2=0x7f4e6c16af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.015+0000 7f4e70bd8700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c06aae0 0x7f4e6c16af30 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00cd30 tx=0x7f4e5c001b10 comp rx=0 tx=0).stop 2023-10-09T06:27:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.015+0000 7f4e70bd8700 1 -- 172.21.15.31:0/2804611003 shutdown_connections 2023-10-09T06:27:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.015+0000 7f4e70bd8700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4e4c066f30 0x7f4e4c0693e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.015+0000 7f4e70bd8700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e6c15a290 0x7f4e6c16d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.015+0000 7f4e70bd8700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c06aae0 0x7f4e6c16af30 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.015+0000 7f4e70bd8700 1 --2- 172.21.15.31:0/2804611003 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4e6c159ec0 0x7f4e6c0b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.015+0000 7f4e70bd8700 1 -- 172.21.15.31:0/2804611003 >> 172.21.15.31:0/2804611003 conn(0x7f4e6c0d1880 msgr2=0x7f4e6c157550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:51.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.015+0000 7f4e70bd8700 1 -- 172.21.15.31:0/2804611003 shutdown_connections 2023-10-09T06:27:51.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.015+0000 7f4e70bd8700 1 -- 172.21.15.31:0/2804611003 wait complete. 2023-10-09T06:27:51.027 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:27:51.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.146+0000 7f6b3995c700 1 Processor -- start 2023-10-09T06:27:51.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.146+0000 7f6b3995c700 1 -- start start 2023-10-09T06:27:51.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b3995c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6b3415a2b0 0x7f6b340b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:51.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b3995c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b340cfe20 0x7f6b340ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:51.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b3995c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b340c5d80 con 0x7f6b340d1c30 2023-10-09T06:27:51.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b3995c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b34068470 con 0x7f6b340cfe20 2023-10-09T06:27:51.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b3995c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b340c6060 con 0x7f6b3415a2b0 2023-10-09T06:27:51.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b337fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b340cfe20 0x7f6b340ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:51.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b337fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b340cfe20 0x7f6b340ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43636/0 (socket says 172.21.15.31:43636) 2023-10-09T06:27:51.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b327fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6b340d1c30 0x7f6b340cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58148/0 (socket says 172.21.15.31:58148) 2023-10-09T06:27:51.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b337fe700 1 -- 172.21.15.31:0/1820597807 learned_addr learned my addr 172.21.15.31:0/1820597807 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:51.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b32ffd700 1 --2- 172.21.15.31:0/1820597807 >> v2:172.21.15.158:3300/0 conn(0x7f6b3415a2b0 0x7f6b340b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:51.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b337fe700 1 -- 172.21.15.31:0/1820597807 >> v2:172.21.15.158:3300/0 conn(0x7f6b3415a2b0 msgr2=0x7f6b340b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:51.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b337fe700 1 --2- 172.21.15.31:0/1820597807 >> v2:172.21.15.158:3300/0 conn(0x7f6b3415a2b0 0x7f6b340b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b337fe700 1 -- 172.21.15.31:0/1820597807 >> v1:172.21.15.31:6789/0 conn(0x7f6b340d1c30 legacy=0x7f6b340cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b337fe700 1 -- 172.21.15.31:0/1820597807 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b340c6340 con 0x7f6b340cfe20 2023-10-09T06:27:51.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b31ffb700 1 -- 172.21.15.31:0/1820597807 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117155331 0 0) 0x7f6b340c5d80 con 0x7f6b340d1c30 2023-10-09T06:27:51.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.147+0000 7f6b337fe700 1 --2- 172.21.15.31:0/1820597807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b340cfe20 0x7f6b340ccdd0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6b34089220 tx=0x7f6b24009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe1ed6553cd05fa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:51.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.148+0000 7f6b31ffb700 1 -- 172.21.15.31:0/1820597807 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2400e070 con 0x7f6b340cfe20 2023-10-09T06:27:51.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.148+0000 7f6b31ffb700 1 -- 172.21.15.31:0/1820597807 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2400ba50 con 0x7f6b340cfe20 2023-10-09T06:27:51.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.148+0000 7f6b31ffb700 1 -- 172.21.15.31:0/1820597807 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b240092e0 con 0x7f6b340cfe20 2023-10-09T06:27:51.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.148+0000 7f6b3995c700 1 -- 172.21.15.31:0/1820597807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b340cfe20 msgr2=0x7f6b340ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.148+0000 7f6b3995c700 1 --2- 172.21.15.31:0/1820597807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b340cfe20 0x7f6b340ccdd0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6b34089220 tx=0x7f6b24009840 comp rx=0 tx=0).stop 2023-10-09T06:27:51.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.148+0000 7f6b3995c700 1 -- 172.21.15.31:0/1820597807 shutdown_connections 2023-10-09T06:27:51.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.148+0000 7f6b3995c700 1 --2- 172.21.15.31:0/1820597807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b340cfe20 0x7f6b340ccdd0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.148+0000 7f6b3995c700 1 --2- 172.21.15.31:0/1820597807 >> v2:172.21.15.158:3300/0 conn(0x7f6b3415a2b0 0x7f6b340b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.148+0000 7f6b3995c700 1 -- 172.21.15.31:0/1820597807 >> 172.21.15.31:0/1820597807 conn(0x7f6b34067e40 msgr2=0x7f6b340d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:51.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.148+0000 7f6b3995c700 1 -- 172.21.15.31:0/1820597807 shutdown_connections 2023-10-09T06:27:51.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.148+0000 7f6b3995c700 1 -- 172.21.15.31:0/1820597807 wait complete. 2023-10-09T06:27:51.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.149+0000 7f6b3995c700 1 Processor -- start 2023-10-09T06:27:51.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.150+0000 7f6b3995c700 1 -- start start 2023-10-09T06:27:51.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.150+0000 7f6b3995c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b340cfe20 0x7f6b3416b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:51.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.150+0000 7f6b3995c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b340d1c30 0x7f6b3416b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:51.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.150+0000 7f6b3995c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b3415a2b0 0x7f6b3415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:51.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.150+0000 7f6b3995c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3415ab60 con 0x7f6b340d1c30 2023-10-09T06:27:51.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.150+0000 7f6b3995c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3415ae40 con 0x7f6b340cfe20 2023-10-09T06:27:51.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.150+0000 7f6b3995c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3415b120 con 0x7f6b3415a2b0 2023-10-09T06:27:51.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.150+0000 7f6b327fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b340d1c30 0x7f6b3416b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:51.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.150+0000 7f6b327fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b340d1c30 0x7f6b3416b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43640/0 (socket says 172.21.15.31:43640) 2023-10-09T06:27:51.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.150+0000 7f6b327fc700 1 -- 172.21.15.31:0/870978221 learned_addr learned my addr 172.21.15.31:0/870978221 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:51.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.150+0000 7f6b32ffd700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b340cfe20 0x7f6b3416b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:51.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.150+0000 7f6b337fe700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b3415a2b0 0x7f6b3415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:51.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.151+0000 7f6b327fc700 1 -- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b3415a2b0 msgr2=0x7f6b3415bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.151+0000 7f6b327fc700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b3415a2b0 0x7f6b3415bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.151+0000 7f6b327fc700 1 -- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b340cfe20 msgr2=0x7f6b3416b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.151+0000 7f6b327fc700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b340cfe20 0x7f6b3416b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.151+0000 7f6b327fc700 1 -- 172.21.15.31:0/870978221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b24009ae0 con 0x7f6b340d1c30 2023-10-09T06:27:51.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.151+0000 7f6b327fc700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b340d1c30 0x7f6b3416b760 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00c510 tx=0x7f6b1c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:51.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.151+0000 7f6b2affd700 1 -- 172.21.15.31:0/870978221 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c005a70 con 0x7f6b340d1c30 2023-10-09T06:27:51.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.151+0000 7f6b2affd700 1 -- 172.21.15.31:0/870978221 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c005bf0 con 0x7f6b340d1c30 2023-10-09T06:27:51.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.151+0000 7f6b3995c700 1 -- 172.21.15.31:0/870978221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3415b400 con 0x7f6b340d1c30 2023-10-09T06:27:51.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.151+0000 7f6b2affd700 1 -- 172.21.15.31:0/870978221 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0070d0 con 0x7f6b340d1c30 2023-10-09T06:27:51.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.151+0000 7f6b3995c700 1 -- 172.21.15.31:0/870978221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b34159210 con 0x7f6b340d1c30 2023-10-09T06:27:51.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.152+0000 7f6b3995c700 1 -- 172.21.15.31:0/870978221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b34159430 con 0x7f6b340d1c30 2023-10-09T06:27:51.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.152+0000 7f6b2affd700 1 -- 172.21.15.31:0/870978221 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b1c007480 con 0x7f6b340d1c30 2023-10-09T06:27:51.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.153+0000 7f6b2affd700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b14066f60 0x7f6b14069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:51.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.153+0000 7f6b2affd700 1 -- 172.21.15.31:0/870978221 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6b1c083570 con 0x7f6b340d1c30 2023-10-09T06:27:51.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.153+0000 7f6b32ffd700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b14066f60 0x7f6b14069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:51.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.153+0000 7f6b32ffd700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b14066f60 0x7f6b14069410 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0061f0 tx=0x7f6b2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:51.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.157+0000 7f6b2affd700 1 -- 172.21.15.31:0/870978221 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b34159430 con 0x7f6b340d1c30 2023-10-09T06:27:51.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.354+0000 7f6b3995c700 1 -- 172.21.15.31:0/870978221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6b3415b920 con 0x7f6b340d1c30 2023-10-09T06:27:51.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.354+0000 7f6b2affd700 1 -- 172.21.15.31:0/870978221 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v148) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6b3415b920 con 0x7f6b340d1c30 2023-10-09T06:27:51.355 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:51.355 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-10-09T06:27:51.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:27:51.355 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-10-09T06:27:51.355 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-10-09T06:27:51.355 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:27:51.355 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-10-09T06:27:51.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.356+0000 7f6b3995c700 1 -- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b14066f60 msgr2=0x7f6b14069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.356+0000 7f6b3995c700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b14066f60 0x7f6b14069410 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0061f0 tx=0x7f6b2c008040 comp rx=0 tx=0).stop 2023-10-09T06:27:51.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.356+0000 7f6b3995c700 1 -- 172.21.15.31:0/870978221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b340d1c30 msgr2=0x7f6b3416b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.356+0000 7f6b3995c700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b340d1c30 0x7f6b3416b760 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00c510 tx=0x7f6b1c00c820 comp rx=0 tx=0).stop 2023-10-09T06:27:51.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.356+0000 7f6b3995c700 1 -- 172.21.15.31:0/870978221 shutdown_connections 2023-10-09T06:27:51.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.356+0000 7f6b3995c700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6b14066f60 0x7f6b14069410 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.356+0000 7f6b3995c700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6b3415a2b0 0x7f6b3415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.356+0000 7f6b3995c700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b340cfe20 0x7f6b3416b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.356+0000 7f6b3995c700 1 --2- 172.21.15.31:0/870978221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b340d1c30 0x7f6b3416b760 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.356+0000 7f6b3995c700 1 -- 172.21.15.31:0/870978221 >> 172.21.15.31:0/870978221 conn(0x7f6b34067e40 msgr2=0x7f6b34069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:51.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.356+0000 7f6b3995c700 1 -- 172.21.15.31:0/870978221 shutdown_connections 2023-10-09T06:27:51.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.356+0000 7f6b3995c700 1 -- 172.21.15.31:0/870978221 wait complete. 2023-10-09T06:27:51.369 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:27:51.369 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:27:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.491+0000 7f7014d65700 1 Processor -- start 2023-10-09T06:27:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.491+0000 7f7014d65700 1 -- start start 2023-10-09T06:27:51.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.492+0000 7f7014d65700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70100b1950 0x7f7010158e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:51.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.492+0000 7f7014d65700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7010152520 0x7f70100ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:51.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.492+0000 7f7014d65700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7010159350 con 0x7f70100b36c0 2023-10-09T06:27:51.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.492+0000 7f7014d65700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70100b1110 con 0x7f7010152520 2023-10-09T06:27:51.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.492+0000 7f7014d65700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70100ae4e0 con 0x7f70100b1950 2023-10-09T06:27:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.493+0000 7f700dd9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70100b1950 0x7f7010158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.493+0000 7f700ed9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7010152520 0x7f70100ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.493+0000 7f700e59c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f70100b36c0 0x7f7010151e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:35914/0 (socket says 172.21.15.31:35914) 2023-10-09T06:27:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.493+0000 7f700e59c700 1 -- 172.21.15.31:0/3570719162 learned_addr learned my addr 172.21.15.31:0/3570719162 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.493+0000 7f700d59a700 1 -- 172.21.15.31:0/3570719162 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602832419 0 0) 0x7f7010159350 con 0x7f70100b36c0 2023-10-09T06:27:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.493+0000 7f700dd9b700 1 -- 172.21.15.31:0/3570719162 >> v2:172.21.15.158:3300/0 conn(0x7f7010152520 msgr2=0x7f70100ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.493+0000 7f700dd9b700 1 --2- 172.21.15.31:0/3570719162 >> v2:172.21.15.158:3300/0 conn(0x7f7010152520 0x7f70100ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.493+0000 7f700dd9b700 1 -- 172.21.15.31:0/3570719162 >> v1:172.21.15.158:6789/0 conn(0x7f70100b36c0 legacy=0x7f7010151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.493+0000 7f700dd9b700 1 -- 172.21.15.31:0/3570719162 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70100b1ea0 con 0x7f70100b1950 2023-10-09T06:27:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.493+0000 7f700ed9d700 1 --2- 172.21.15.31:0/3570719162 >> v2:172.21.15.158:3300/0 conn(0x7f7010152520 0x7f70100ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:27:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.493+0000 7f700dd9b700 1 --2- 172.21.15.31:0/3570719162 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70100b1950 0x7f7010158e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80098e0 tx=0x7f6ff80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a041cd12fef8706b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.494+0000 7f700d59a700 1 -- 172.21.15.31:0/3570719162 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800b640 con 0x7f70100b1950 2023-10-09T06:27:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.494+0000 7f700d59a700 1 -- 172.21.15.31:0/3570719162 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff800b7a0 con 0x7f70100b1950 2023-10-09T06:27:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.494+0000 7f700d59a700 1 -- 172.21.15.31:0/3570719162 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800bb40 con 0x7f70100b1950 2023-10-09T06:27:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.494+0000 7f7014d65700 1 -- 172.21.15.31:0/3570719162 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70100b1950 msgr2=0x7f7010158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.494+0000 7f7014d65700 1 --2- 172.21.15.31:0/3570719162 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70100b1950 0x7f7010158e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80098e0 tx=0x7f6ff80091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.494+0000 7f7014d65700 1 -- 172.21.15.31:0/3570719162 shutdown_connections 2023-10-09T06:27:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.494+0000 7f7014d65700 1 --2- 172.21.15.31:0/3570719162 >> v2:172.21.15.158:3300/0 conn(0x7f7010152520 0x7f70100ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.494+0000 7f7014d65700 1 --2- 172.21.15.31:0/3570719162 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70100b1950 0x7f7010158e10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.494+0000 7f7014d65700 1 -- 172.21.15.31:0/3570719162 >> 172.21.15.31:0/3570719162 conn(0x7f7010069870 msgr2=0x7f7010069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:51.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.494+0000 7f7014d65700 1 -- 172.21.15.31:0/3570719162 shutdown_connections 2023-10-09T06:27:51.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.494+0000 7f7014d65700 1 -- 172.21.15.31:0/3570719162 wait complete. 2023-10-09T06:27:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.495+0000 7f7014d65700 1 Processor -- start 2023-10-09T06:27:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.495+0000 7f7014d65700 1 -- start start 2023-10-09T06:27:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f7014d65700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70100b1950 0x7f701014ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f7014d65700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70100b36c0 0x7f70100cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f7014d65700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7010152520 0x7f70100ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f7014d65700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701006ca10 con 0x7f70100b36c0 2023-10-09T06:27:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f7014d65700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70100cb620 con 0x7f70100b1950 2023-10-09T06:27:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f7014d65700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70100ac930 con 0x7f7010152520 2023-10-09T06:27:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f700dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70100b36c0 0x7f70100cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f700dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70100b36c0 0x7f70100cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43652/0 (socket says 172.21.15.31:43652) 2023-10-09T06:27:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f700dd9b700 1 -- 172.21.15.31:0/1153003764 learned_addr learned my addr 172.21.15.31:0/1153003764 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f700ed9d700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7010152520 0x7f70100ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f700e59c700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70100b1950 0x7f701014ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f700dd9b700 1 -- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7010152520 msgr2=0x7f70100ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f700dd9b700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7010152520 0x7f70100ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f700dd9b700 1 -- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70100b1950 msgr2=0x7f701014ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f700dd9b700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70100b1950 0x7f701014ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.496+0000 7f700dd9b700 1 -- 172.21.15.31:0/1153003764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7000009420 con 0x7f70100b36c0 2023-10-09T06:27:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.497+0000 7f700dd9b700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70100b36c0 0x7f70100cb0e0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009f80 tx=0x7f6ff8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:51.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.497+0000 7f70067fc700 1 -- 172.21.15.31:0/1153003764 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800bb20 con 0x7f70100b36c0 2023-10-09T06:27:51.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.497+0000 7f70067fc700 1 -- 172.21.15.31:0/1153003764 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff8000c90 con 0x7f70100b36c0 2023-10-09T06:27:51.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.497+0000 7f7014d65700 1 -- 172.21.15.31:0/1153003764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff8009420 con 0x7f70100b36c0 2023-10-09T06:27:51.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.497+0000 7f70067fc700 1 -- 172.21.15.31:0/1153003764 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8011630 con 0x7f70100b36c0 2023-10-09T06:27:51.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.497+0000 7f7014d65700 1 -- 172.21.15.31:0/1153003764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701006c350 con 0x7f70100b36c0 2023-10-09T06:27:51.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.498+0000 7f7014d65700 1 -- 172.21.15.31:0/1153003764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701006cb50 con 0x7f70100b36c0 2023-10-09T06:27:51.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.498+0000 7f70067fc700 1 -- 172.21.15.31:0/1153003764 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ff80119a0 con 0x7f70100b36c0 2023-10-09T06:27:51.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.499+0000 7f70067fc700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ff0066f30 0x7f6ff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:51.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.499+0000 7f70067fc700 1 -- 172.21.15.31:0/1153003764 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6ff80853a0 con 0x7f70100b36c0 2023-10-09T06:27:51.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.499+0000 7f700e59c700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ff0066f30 0x7f6ff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:51.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.499+0000 7f700e59c700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ff0066f30 0x7f6ff00693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7008007240 tx=0x7f7008001970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:51.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.503+0000 7f70067fc700 1 -- 172.21.15.31:0/1153003764 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f701006cb50 con 0x7f70100b36c0 2023-10-09T06:27:51.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.695+0000 7f7014d65700 1 -- 172.21.15.31:0/1153003764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f701006cb50 con 0x7f70100b36c0 2023-10-09T06:27:51.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.918+0000 7f70067fc700 1 -- 172.21.15.31:0/1153003764 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v149) v1 ==== 138+0+0 (secure 0 0 0) 0x7f701006cb50 con 0x7f70100b36c0 2023-10-09T06:27:51.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.921+0000 7f7014d65700 1 -- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ff0066f30 msgr2=0x7f6ff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.921+0000 7f7014d65700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ff0066f30 0x7f6ff00693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7008007240 tx=0x7f7008001970 comp rx=0 tx=0).stop 2023-10-09T06:27:51.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.921+0000 7f7014d65700 1 -- 172.21.15.31:0/1153003764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70100b36c0 msgr2=0x7f70100cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:51.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.921+0000 7f7014d65700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70100b36c0 0x7f70100cb0e0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009f80 tx=0x7f6ff8017000 comp rx=0 tx=0).stop 2023-10-09T06:27:51.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.923+0000 7f7014d65700 1 -- 172.21.15.31:0/1153003764 shutdown_connections 2023-10-09T06:27:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.923+0000 7f7014d65700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6ff0066f30 0x7f6ff00693e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.923+0000 7f7014d65700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7010152520 0x7f70100ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.923+0000 7f7014d65700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70100b1950 0x7f701014ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.923+0000 7f7014d65700 1 --2- 172.21.15.31:0/1153003764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70100b36c0 0x7f70100cb0e0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.923+0000 7f7014d65700 1 -- 172.21.15.31:0/1153003764 >> 172.21.15.31:0/1153003764 conn(0x7f7010069870 msgr2=0x7f7010156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.923+0000 7f7014d65700 1 -- 172.21.15.31:0/1153003764 shutdown_connections 2023-10-09T06:27:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:51.923+0000 7f7014d65700 1 -- 172.21.15.31:0/1153003764 wait complete. 2023-10-09T06:27:51.925 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-10-09T06:27:51.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:27:52.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.062+0000 7f6138345700 1 Processor -- start 2023-10-09T06:27:52.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.063+0000 7f6138345700 1 -- start start 2023-10-09T06:27:52.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.063+0000 7f6138345700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6130159ec0 0x7f61300af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:52.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.063+0000 7f6138345700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61300b0790 con 0x7f613006acb0 2023-10-09T06:27:52.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.063+0000 7f6138345700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61300ce1f0 con 0x7f613015a290 2023-10-09T06:27:52.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.063+0000 7f6138345700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61300b0b20 con 0x7f6130159ec0 2023-10-09T06:27:52.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.064+0000 7f61360e1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6130159ec0 0x7f61300af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:52.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.064+0000 7f61368e2700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f613006acb0 0x7f61300cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58154/0 (socket says 172.21.15.31:58154) 2023-10-09T06:27:52.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.064+0000 7f61368e2700 1 -- 172.21.15.31:0/522583671 learned_addr learned my addr 172.21.15.31:0/522583671 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:52.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.064+0000 7f61360e1700 1 -- 172.21.15.31:0/522583671 >> v1:172.21.15.158:6789/0 conn(0x7f613015a290 legacy=0x7f613006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:52.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.064+0000 7f61360e1700 1 -- 172.21.15.31:0/522583671 >> v1:172.21.15.31:6789/0 conn(0x7f613006acb0 legacy=0x7f61300cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:52.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.064+0000 7f61360e1700 1 -- 172.21.15.31:0/522583671 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61300b04b0 con 0x7f6130159ec0 2023-10-09T06:27:52.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.064+0000 7f61350df700 1 -- 172.21.15.31:0/522583671 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156025122 0 0) 0x7f61300b0790 con 0x7f613006acb0 2023-10-09T06:27:52.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.064+0000 7f61360e1700 1 --2- 172.21.15.31:0/522583671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6130159ec0 0x7f61300af940 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f6120009e60 tx=0x7f6120009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e254706ca208431 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:52.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.064+0000 7f61350df700 1 -- 172.21.15.31:0/522583671 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612000e070 con 0x7f6130159ec0 2023-10-09T06:27:52.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.064+0000 7f61350df700 1 -- 172.21.15.31:0/522583671 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612000bc30 con 0x7f6130159ec0 2023-10-09T06:27:52.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.064+0000 7f61350df700 1 -- 172.21.15.31:0/522583671 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120012430 con 0x7f6130159ec0 2023-10-09T06:27:52.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.065+0000 7f6138345700 1 -- 172.21.15.31:0/522583671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6130159ec0 msgr2=0x7f61300af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:52.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.065+0000 7f6138345700 1 --2- 172.21.15.31:0/522583671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6130159ec0 0x7f61300af940 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f6120009e60 tx=0x7f6120009780 comp rx=0 tx=0).stop 2023-10-09T06:27:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.065+0000 7f6138345700 1 -- 172.21.15.31:0/522583671 shutdown_connections 2023-10-09T06:27:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.065+0000 7f6138345700 1 --2- 172.21.15.31:0/522583671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6130159ec0 0x7f61300af940 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.065+0000 7f6138345700 1 -- 172.21.15.31:0/522583671 >> 172.21.15.31:0/522583671 conn(0x7f61300d1880 msgr2=0x7f61300cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.065+0000 7f6138345700 1 -- 172.21.15.31:0/522583671 shutdown_connections 2023-10-09T06:27:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.065+0000 7f6138345700 1 -- 172.21.15.31:0/522583671 wait complete. 2023-10-09T06:27:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.066+0000 7f6138345700 1 Processor -- start 2023-10-09T06:27:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.066+0000 7f6138345700 1 -- start start 2023-10-09T06:27:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f6138345700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613006acb0 0x7f61300b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f6138345700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6130159ec0 0x7f613015d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f6138345700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f613015a290 0x7f6130158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f6138345700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61300b5b80 con 0x7f613006acb0 2023-10-09T06:27:52.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f6138345700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61300b4f70 con 0x7f6130159ec0 2023-10-09T06:27:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f6138345700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61300b5250 con 0x7f613015a290 2023-10-09T06:27:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f61360e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613006acb0 0x7f61300b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f61360e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613006acb0 0x7f61300b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43666/0 (socket says 172.21.15.31:43666) 2023-10-09T06:27:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f61360e1700 1 -- 172.21.15.31:0/1264025191 learned_addr learned my addr 172.21.15.31:0/1264025191 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f61360e1700 1 -- 172.21.15.31:0/1264025191 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f613015a290 msgr2=0x7f6130158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f61360e1700 1 --2- 172.21.15.31:0/1264025191 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f613015a290 0x7f6130158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f61360e1700 1 -- 172.21.15.31:0/1264025191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6130159ec0 msgr2=0x7f613015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f61360e1700 1 --2- 172.21.15.31:0/1264025191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6130159ec0 0x7f613015d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f61360e1700 1 -- 172.21.15.31:0/1264025191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6120009a20 con 0x7f613006acb0 2023-10-09T06:27:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f61360e1700 1 --2- 172.21.15.31:0/1264025191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613006acb0 0x7f61300b6010 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f61200099f0 tx=0x7f6120019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:52.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f612e7fc700 1 -- 172.21.15.31:0/1264025191 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120027470 con 0x7f613006acb0 2023-10-09T06:27:52.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f612e7fc700 1 -- 172.21.15.31:0/1264025191 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61200275d0 con 0x7f613006acb0 2023-10-09T06:27:52.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f6138345700 1 -- 172.21.15.31:0/1264025191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61300b5530 con 0x7f613006acb0 2023-10-09T06:27:52.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.067+0000 7f612e7fc700 1 -- 172.21.15.31:0/1264025191 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120027990 con 0x7f613006acb0 2023-10-09T06:27:52.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.068+0000 7f6138345700 1 -- 172.21.15.31:0/1264025191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613015d7a0 con 0x7f613006acb0 2023-10-09T06:27:52.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.069+0000 7f6138345700 1 -- 172.21.15.31:0/1264025191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613004c3c0 con 0x7f613006acb0 2023-10-09T06:27:52.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.069+0000 7f612e7fc700 1 -- 172.21.15.31:0/1264025191 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6120024070 con 0x7f613006acb0 2023-10-09T06:27:52.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.069+0000 7f612e7fc700 1 --2- 172.21.15.31:0/1264025191 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f611c066f30 0x7f611c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:52.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.070+0000 7f612e7fc700 1 -- 172.21.15.31:0/1264025191 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f6120086e20 con 0x7f613006acb0 2023-10-09T06:27:52.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.070+0000 7f61358e0700 1 --2- 172.21.15.31:0/1264025191 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f611c066f30 0x7f611c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:52.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.070+0000 7f61358e0700 1 --2- 172.21.15.31:0/1264025191 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f611c066f30 0x7f611c0693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6124007fd0 tx=0x7f6124007b20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:52.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.074+0000 7f612e7fc700 1 -- 172.21.15.31:0/1264025191 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6120054270 con 0x7f613006acb0 2023-10-09T06:27:52.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.271+0000 7f6138345700 1 -- 172.21.15.31:0/1264025191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f61300ceab0 con 0x7f613006acb0 2023-10-09T06:27:52.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.924+0000 7f612e7fc700 1 -- 172.21.15.31:0/1264025191 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v150) v1 ==== 170+0+0 (secure 0 0 0) 0x7f612002c020 con 0x7f613006acb0 2023-10-09T06:27:52.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.932+0000 7f6138345700 1 -- 172.21.15.31:0/1264025191 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f611c066f30 msgr2=0x7f611c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:52.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.932+0000 7f6138345700 1 --2- 172.21.15.31:0/1264025191 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f611c066f30 0x7f611c0693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6124007fd0 tx=0x7f6124007b20 comp rx=0 tx=0).stop 2023-10-09T06:27:52.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.932+0000 7f6138345700 1 -- 172.21.15.31:0/1264025191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613006acb0 msgr2=0x7f61300b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:52.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.932+0000 7f6138345700 1 --2- 172.21.15.31:0/1264025191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613006acb0 0x7f61300b6010 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f61200099f0 tx=0x7f6120019000 comp rx=0 tx=0).stop 2023-10-09T06:27:52.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.932+0000 7f6138345700 1 -- 172.21.15.31:0/1264025191 shutdown_connections 2023-10-09T06:27:52.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.932+0000 7f6138345700 1 --2- 172.21.15.31:0/1264025191 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f611c066f30 0x7f611c0693e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:52.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.932+0000 7f6138345700 1 --2- 172.21.15.31:0/1264025191 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f613015a290 0x7f6130158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:52.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.932+0000 7f6138345700 1 --2- 172.21.15.31:0/1264025191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613006acb0 0x7f61300b6010 secure :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f61200099f0 tx=0x7f6120019000 comp rx=0 tx=0).stop 2023-10-09T06:27:52.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.932+0000 7f6138345700 1 --2- 172.21.15.31:0/1264025191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6130159ec0 0x7f613015d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:52.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.932+0000 7f6138345700 1 -- 172.21.15.31:0/1264025191 >> 172.21.15.31:0/1264025191 conn(0x7f61300d1880 msgr2=0x7f61300b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:52.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.937+0000 7f6138345700 1 -- 172.21.15.31:0/1264025191 shutdown_connections 2023-10-09T06:27:52.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:52.937+0000 7f6138345700 1 -- 172.21.15.31:0/1264025191 wait complete. 2023-10-09T06:27:52.938 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-10-09T06:27:52.953 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:27:53.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.075+0000 7f6e78ecc700 1 Processor -- start 2023-10-09T06:27:53.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.075+0000 7f6e78ecc700 1 -- start start 2023-10-09T06:27:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.076+0000 7f6e78ecc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6e741520b0 0x7f6e7406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.076+0000 7f6e78ecc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e7406f2e0 0x7f6e74158080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.076+0000 7f6e78ecc700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7415c3c0 con 0x7f6e74151ce0 2023-10-09T06:27:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.076+0000 7f6e78ecc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7406f700 con 0x7f6e741520b0 2023-10-09T06:27:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.076+0000 7f6e78ecc700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e74152500 con 0x7f6e7406f2e0 2023-10-09T06:27:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.076+0000 7f6e737fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6e74151ce0 0x7f6e740ca250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58170/0 (socket says 172.21.15.31:58170) 2023-10-09T06:27:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.076+0000 7f6e737fe700 1 -- 172.21.15.31:0/1902605547 learned_addr learned my addr 172.21.15.31:0/1902605547 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.076+0000 7f6e72ffd700 1 --2- 172.21.15.31:0/1902605547 >> v2:172.21.15.31:3300/0 conn(0x7f6e741520b0 0x7f6e7406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e72ffd700 1 -- 172.21.15.31:0/1902605547 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e7406f2e0 msgr2=0x7f6e74158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e73fff700 1 --2- 172.21.15.31:0/1902605547 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e7406f2e0 0x7f6e74158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e727fc700 1 -- 172.21.15.31:0/1902605547 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658014286 0 0) 0x7f6e7415c3c0 con 0x7f6e74151ce0 2023-10-09T06:27:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e72ffd700 1 --2- 172.21.15.31:0/1902605547 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e7406f2e0 0x7f6e74158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e72ffd700 1 -- 172.21.15.31:0/1902605547 >> v1:172.21.15.31:6789/0 conn(0x7f6e74151ce0 legacy=0x7f6e740ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e72ffd700 1 -- 172.21.15.31:0/1902605547 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7415b7b0 con 0x7f6e741520b0 2023-10-09T06:27:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e73fff700 1 --2- 172.21.15.31:0/1902605547 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e7406f2e0 0x7f6e74158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e72ffd700 1 --2- 172.21.15.31:0/1902605547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e741520b0 0x7f6e7406eda0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f6e680098e0 tx=0x7f6e680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3fd1f930e7cd84 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:53.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e727fc700 1 -- 172.21.15.31:0/1902605547 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68009e80 con 0x7f6e741520b0 2023-10-09T06:27:53.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e727fc700 1 -- 172.21.15.31:0/1902605547 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6800b860 con 0x7f6e741520b0 2023-10-09T06:27:53.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e727fc700 1 -- 172.21.15.31:0/1902605547 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6800bbe0 con 0x7f6e741520b0 2023-10-09T06:27:53.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1902605547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e741520b0 msgr2=0x7f6e7406eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:53.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e78ecc700 1 --2- 172.21.15.31:0/1902605547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e741520b0 0x7f6e7406eda0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f6e680098e0 tx=0x7f6e680091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:53.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1902605547 shutdown_connections 2023-10-09T06:27:53.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e78ecc700 1 --2- 172.21.15.31:0/1902605547 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e7406f2e0 0x7f6e74158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:53.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.077+0000 7f6e78ecc700 1 --2- 172.21.15.31:0/1902605547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e741520b0 0x7f6e7406eda0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:53.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.078+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1902605547 >> 172.21.15.31:0/1902605547 conn(0x7f6e740cdba0 msgr2=0x7f6e740c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:53.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.078+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1902605547 shutdown_connections 2023-10-09T06:27:53.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.078+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1902605547 wait complete. 2023-10-09T06:27:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.079+0000 7f6e78ecc700 1 Processor -- start 2023-10-09T06:27:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.079+0000 7f6e78ecc700 1 -- start start 2023-10-09T06:27:53.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e78ecc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7406f2e0 0x7f6e7414f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e78ecc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e74151ce0 0x7f6e74150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e78ecc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e741520b0 0x7f6e741514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e78ecc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e74152c10 con 0x7f6e7406f2e0 2023-10-09T06:27:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e78ecc700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7414fbd0 con 0x7f6e74151ce0 2023-10-09T06:27:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e78ecc700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740adeb0 con 0x7f6e741520b0 2023-10-09T06:27:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e737fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7406f2e0 0x7f6e7414f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e737fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7406f2e0 0x7f6e7414f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43682/0 (socket says 172.21.15.31:43682) 2023-10-09T06:27:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e737fe700 1 -- 172.21.15.31:0/1755268312 learned_addr learned my addr 172.21.15.31:0/1755268312 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e737fe700 1 -- 172.21.15.31:0/1755268312 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e741520b0 msgr2=0x7f6e741514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e737fe700 1 --2- 172.21.15.31:0/1755268312 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e741520b0 0x7f6e741514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e737fe700 1 -- 172.21.15.31:0/1755268312 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e74151ce0 msgr2=0x7f6e74150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e737fe700 1 --2- 172.21.15.31:0/1755268312 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e74151ce0 0x7f6e74150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e737fe700 1 -- 172.21.15.31:0/1755268312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68009420 con 0x7f6e7406f2e0 2023-10-09T06:27:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e737fe700 1 --2- 172.21.15.31:0/1755268312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7406f2e0 0x7f6e7414f690 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400c7e0 tx=0x7f6e64007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e5b7fe700 1 -- 172.21.15.31:0/1755268312 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64005b30 con 0x7f6e7406f2e0 2023-10-09T06:27:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e5b7fe700 1 -- 172.21.15.31:0/1755268312 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e64005c90 con 0x7f6e7406f2e0 2023-10-09T06:27:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1755268312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e740ae190 con 0x7f6e7406f2e0 2023-10-09T06:27:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e5b7fe700 1 -- 172.21.15.31:0/1755268312 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64007300 con 0x7f6e7406f2e0 2023-10-09T06:27:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.080+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1755268312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e740ae750 con 0x7f6e7406f2e0 2023-10-09T06:27:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.081+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1755268312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7406cb50 con 0x7f6e7406f2e0 2023-10-09T06:27:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.082+0000 7f6e5b7fe700 1 -- 172.21.15.31:0/1755268312 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e6401b400 con 0x7f6e7406f2e0 2023-10-09T06:27:53.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.082+0000 7f6e5b7fe700 1 --2- 172.21.15.31:0/1755268312 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6e60066f30 0x7f6e600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:53.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.082+0000 7f6e5b7fe700 1 -- 172.21.15.31:0/1755268312 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f6e64083fe0 con 0x7f6e7406f2e0 2023-10-09T06:27:53.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.083+0000 7f6e72ffd700 1 --2- 172.21.15.31:0/1755268312 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6e60066f30 0x7f6e600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:53.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.083+0000 7f6e72ffd700 1 --2- 172.21.15.31:0/1755268312 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6e60066f30 0x7f6e600693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6e7409aeb0 tx=0x7f6e68017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:53.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.087+0000 7f6e5b7fe700 1 -- 172.21.15.31:0/1755268312 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e64051330 con 0x7f6e7406f2e0 2023-10-09T06:27:53.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.328+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1755268312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6e7415ba90 con 0x7f6e7406f2e0 2023-10-09T06:27:53.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.936+0000 7f6e5b7fe700 1 -- 172.21.15.31:0/1755268312 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v70) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6e64054950 con 0x7f6e7406f2e0 2023-10-09T06:27:53.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.939+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1755268312 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6e60066f30 msgr2=0x7f6e600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:53.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.939+0000 7f6e78ecc700 1 --2- 172.21.15.31:0/1755268312 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6e60066f30 0x7f6e600693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6e7409aeb0 tx=0x7f6e68017000 comp rx=0 tx=0).stop 2023-10-09T06:27:53.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.939+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1755268312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7406f2e0 msgr2=0x7f6e7414f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:53.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.939+0000 7f6e78ecc700 1 --2- 172.21.15.31:0/1755268312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7406f2e0 0x7f6e7414f690 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400c7e0 tx=0x7f6e64007df0 comp rx=0 tx=0).stop 2023-10-09T06:27:53.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.939+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1755268312 shutdown_connections 2023-10-09T06:27:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.939+0000 7f6e78ecc700 1 --2- 172.21.15.31:0/1755268312 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6e60066f30 0x7f6e600693e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.939+0000 7f6e78ecc700 1 --2- 172.21.15.31:0/1755268312 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6e741520b0 0x7f6e741514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.939+0000 7f6e78ecc700 1 --2- 172.21.15.31:0/1755268312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7406f2e0 0x7f6e7414f690 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.939+0000 7f6e78ecc700 1 --2- 172.21.15.31:0/1755268312 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e74151ce0 0x7f6e74150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.939+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1755268312 >> 172.21.15.31:0/1755268312 conn(0x7f6e740cdba0 msgr2=0x7f6e7406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.939+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1755268312 shutdown_connections 2023-10-09T06:27:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:53.939+0000 7f6e78ecc700 1 -- 172.21.15.31:0/1755268312 wait complete. 2023-10-09T06:27:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 18 and data pool 19 2023-10-09T06:27:53.954 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:27:54.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.073+0000 7faad0060700 1 Processor -- start 2023-10-09T06:27:54.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.073+0000 7faad0060700 1 -- start start 2023-10-09T06:27:54.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.073+0000 7faad0060700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faac8157870 0x7faac815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.073+0000 7faad0060700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faac815a620 0x7faac815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faad0060700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faac815d580 0x7faac8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faad0060700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac815cbb0 con 0x7faac8157870 2023-10-09T06:27:54.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faad0060700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac815bfa0 con 0x7faac815a620 2023-10-09T06:27:54.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faad0060700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac815c280 con 0x7faac815d580 2023-10-09T06:27:54.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faacddfc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faac8157870 0x7faac815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faacddfc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faac8157870 0x7faac815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43688/0 (socket says 172.21.15.31:43688) 2023-10-09T06:27:54.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faacddfc700 1 -- 172.21.15.31:0/2549232151 learned_addr learned my addr 172.21.15.31:0/2549232151 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:54.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faacd5fb700 1 --2- 172.21.15.31:0/2549232151 >> v2:172.21.15.158:3300/0 conn(0x7faac815a620 0x7faac815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faace5fd700 1 --2- 172.21.15.31:0/2549232151 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faac815d580 0x7faac8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faacddfc700 1 -- 172.21.15.31:0/2549232151 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faac815d580 msgr2=0x7faac8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:54.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faacddfc700 1 --2- 172.21.15.31:0/2549232151 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faac815d580 0x7faac8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faacddfc700 1 -- 172.21.15.31:0/2549232151 >> v2:172.21.15.158:3300/0 conn(0x7faac815a620 msgr2=0x7faac815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:54.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faacddfc700 1 --2- 172.21.15.31:0/2549232151 >> v2:172.21.15.158:3300/0 conn(0x7faac815a620 0x7faac815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faacddfc700 1 -- 172.21.15.31:0/2549232151 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac815c560 con 0x7faac8157870 2023-10-09T06:27:54.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faacddfc700 1 --2- 172.21.15.31:0/2549232151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac8157870 0x7faac815b6a0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7faac815cb20 tx=0x7faac0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85d2875f6a4de69 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:54.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faaccdfa700 1 -- 172.21.15.31:0/2549232151 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac000b640 con 0x7faac8157870 2023-10-09T06:27:54.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faaccdfa700 1 -- 172.21.15.31:0/2549232151 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac000b7a0 con 0x7faac8157870 2023-10-09T06:27:54.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.074+0000 7faaccdfa700 1 -- 172.21.15.31:0/2549232151 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac000bb60 con 0x7faac8157870 2023-10-09T06:27:54.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.075+0000 7faad0060700 1 -- 172.21.15.31:0/2549232151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac8157870 msgr2=0x7faac815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.075+0000 7faad0060700 1 --2- 172.21.15.31:0/2549232151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac8157870 0x7faac815b6a0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7faac815cb20 tx=0x7faac0009250 comp rx=0 tx=0).stop 2023-10-09T06:27:54.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.075+0000 7faad0060700 1 -- 172.21.15.31:0/2549232151 shutdown_connections 2023-10-09T06:27:54.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.075+0000 7faad0060700 1 --2- 172.21.15.31:0/2549232151 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faac815d580 0x7faac8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.075+0000 7faad0060700 1 --2- 172.21.15.31:0/2549232151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac8157870 0x7faac815b6a0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.075+0000 7faad0060700 1 --2- 172.21.15.31:0/2549232151 >> v2:172.21.15.158:3300/0 conn(0x7faac815a620 0x7faac815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.075+0000 7faad0060700 1 -- 172.21.15.31:0/2549232151 >> 172.21.15.31:0/2549232151 conn(0x7faac8068ce0 msgr2=0x7faac80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:54.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.075+0000 7faad0060700 1 -- 172.21.15.31:0/2549232151 shutdown_connections 2023-10-09T06:27:54.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.075+0000 7faad0060700 1 -- 172.21.15.31:0/2549232151 wait complete. 2023-10-09T06:27:54.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.076+0000 7faad0060700 1 Processor -- start 2023-10-09T06:27:54.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.076+0000 7faad0060700 1 -- start start 2023-10-09T06:27:54.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.077+0000 7faad0060700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faac8157870 0x7faac80b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.077+0000 7faad0060700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac815a620 0x7faac80b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.077+0000 7faad0060700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faac815d580 0x7faac8154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.077+0000 7faad0060700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac80b21d0 con 0x7faac815a620 2023-10-09T06:27:54.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.077+0000 7faad0060700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac80b18b0 con 0x7faac8157870 2023-10-09T06:27:54.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.077+0000 7faad0060700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac80b0ca0 con 0x7faac815d580 2023-10-09T06:27:54.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.077+0000 7faacd5fb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac815a620 0x7faac80b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.077+0000 7faacd5fb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac815a620 0x7faac80b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43692/0 (socket says 172.21.15.31:43692) 2023-10-09T06:27:54.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.077+0000 7faacd5fb700 1 -- 172.21.15.31:0/2781167317 learned_addr learned my addr 172.21.15.31:0/2781167317 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:54.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.077+0000 7faacddfc700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faac8157870 0x7faac80b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.077+0000 7faace5fd700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faac815d580 0x7faac8154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.078+0000 7faacd5fb700 1 -- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faac815d580 msgr2=0x7faac8154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.078+0000 7faacd5fb700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faac815d580 0x7faac8154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.078+0000 7faacd5fb700 1 -- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faac8157870 msgr2=0x7faac80b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.078+0000 7faacd5fb700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faac8157870 0x7faac80b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.078+0000 7faacd5fb700 1 -- 172.21.15.31:0/2781167317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac00094f0 con 0x7faac815a620 2023-10-09T06:27:54.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.078+0000 7faacddfc700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faac8157870 0x7faac80b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:27:54.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.078+0000 7faacd5fb700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac815a620 0x7faac80b2570 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7faabc00ec50 tx=0x7faabc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:54.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.078+0000 7faac5ffb700 1 -- 172.21.15.31:0/2781167317 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc00c850 con 0x7faac815a620 2023-10-09T06:27:54.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.078+0000 7faac5ffb700 1 -- 172.21.15.31:0/2781167317 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc00c9b0 con 0x7faac815a620 2023-10-09T06:27:54.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.078+0000 7faad0060700 1 -- 172.21.15.31:0/2781167317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac80b0f80 con 0x7faac815a620 2023-10-09T06:27:54.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.078+0000 7faac5ffb700 1 -- 172.21.15.31:0/2781167317 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc00cd70 con 0x7faac815a620 2023-10-09T06:27:54.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.078+0000 7faad0060700 1 -- 172.21.15.31:0/2781167317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac80b1540 con 0x7faac815a620 2023-10-09T06:27:54.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.079+0000 7faad0060700 1 -- 172.21.15.31:0/2781167317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac80b1a40 con 0x7faac815a620 2023-10-09T06:27:54.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.080+0000 7faac5ffb700 1 -- 172.21.15.31:0/2781167317 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faabc013680 con 0x7faac815a620 2023-10-09T06:27:54.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.080+0000 7faac5ffb700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faab4066f30 0x7faab40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.080+0000 7faac5ffb700 1 -- 172.21.15.31:0/2781167317 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faabc084740 con 0x7faac815a620 2023-10-09T06:27:54.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.080+0000 7faacddfc700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faab4066f30 0x7faab40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.081+0000 7faacddfc700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faab4066f30 0x7faab40693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7faac815cb20 tx=0x7faac0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:54.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.084+0000 7faac5ffb700 1 -- 172.21.15.31:0/2781167317 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faabc0519b0 con 0x7faac815a620 2023-10-09T06:27:54.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.278+0000 7faad0060700 1 -- 172.21.15.31:0/2781167317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faac804c3c0 con 0x7faac815a620 2023-10-09T06:27:54.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.279+0000 7faac5ffb700 1 -- 172.21.15.31:0/2781167317 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+15378 (secure 0 0 0) 0x7faabc054fd0 con 0x7faac815a620 2023-10-09T06:27:54.280 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:54.280 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":151,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:27:53.330520+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:27:51.726909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T06:27:52.302903+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:27:54.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.281+0000 7faad0060700 1 -- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faab4066f30 msgr2=0x7faab40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.281+0000 7faad0060700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faab4066f30 0x7faab40693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7faac815cb20 tx=0x7faac0017000 comp rx=0 tx=0).stop 2023-10-09T06:27:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.282+0000 7faad0060700 1 -- 172.21.15.31:0/2781167317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac815a620 msgr2=0x7faac80b2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.282+0000 7faad0060700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac815a620 0x7faac80b2570 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7faabc00ec50 tx=0x7faabc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.282+0000 7faad0060700 1 -- 172.21.15.31:0/2781167317 shutdown_connections 2023-10-09T06:27:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.282+0000 7faad0060700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faab4066f30 0x7faab40693e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.282+0000 7faad0060700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faac815d580 0x7faac8154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.282+0000 7faad0060700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faac8157870 0x7faac80b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.282+0000 7faad0060700 1 --2- 172.21.15.31:0/2781167317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac815a620 0x7faac80b2570 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.282+0000 7faad0060700 1 -- 172.21.15.31:0/2781167317 >> 172.21.15.31:0/2781167317 conn(0x7faac8068ce0 msgr2=0x7faac81582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.282+0000 7faad0060700 1 -- 172.21.15.31:0/2781167317 shutdown_connections 2023-10-09T06:27:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.282+0000 7faad0060700 1 -- 172.21.15.31:0/2781167317 wait complete. 2023-10-09T06:27:54.294 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:27:54.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.412+0000 7fef55ebb700 1 Processor -- start 2023-10-09T06:27:54.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.413+0000 7fef55ebb700 1 -- start start 2023-10-09T06:27:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.413+0000 7fef55ebb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fef50158e50 0x7fef500cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.413+0000 7fef55ebb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5006c010 con 0x7fef50152010 2023-10-09T06:27:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.413+0000 7fef55ebb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5006bd10 con 0x7fef501523e0 2023-10-09T06:27:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.413+0000 7fef55ebb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5015c060 con 0x7fef50158e50 2023-10-09T06:27:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.414+0000 7fef4f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fef50152010 0x7fef5015b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58174/0 (socket says 172.21.15.31:58174) 2023-10-09T06:27:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.414+0000 7fef4f7fe700 1 -- 172.21.15.31:0/1402612452 learned_addr learned my addr 172.21.15.31:0/1402612452 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.414+0000 7fef4ffff700 1 --2- 172.21.15.31:0/1402612452 >> v2:172.21.15.31:3300/0 conn(0x7fef50158e50 0x7fef500cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.414+0000 7fef4e7fc700 1 -- 172.21.15.31:0/1402612452 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540829239 0 0) 0x7fef5006c010 con 0x7fef50152010 2023-10-09T06:27:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.414+0000 7fef4e7fc700 1 -- 172.21.15.31:0/1402612452 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef38003570 con 0x7fef50152010 2023-10-09T06:27:54.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.414+0000 7fef4ffff700 1 -- 172.21.15.31:0/1402612452 >> v1:172.21.15.158:6789/0 conn(0x7fef501523e0 legacy=0x7fef5006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:54.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.414+0000 7fef4ffff700 1 -- 172.21.15.31:0/1402612452 >> v1:172.21.15.31:6789/0 conn(0x7fef50152010 legacy=0x7fef5015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.414+0000 7fef4ffff700 1 -- 172.21.15.31:0/1402612452 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5015c340 con 0x7fef50158e50 2023-10-09T06:27:54.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.414+0000 7fef4ffff700 1 --2- 172.21.15.31:0/1402612452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef50158e50 0x7fef500cb750 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fef48009e60 tx=0x7fef48009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e132d0961970c67e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:54.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.414+0000 7fef4e7fc700 1 -- 172.21.15.31:0/1402612452 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4800e070 con 0x7fef50158e50 2023-10-09T06:27:54.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.414+0000 7fef4e7fc700 1 -- 172.21.15.31:0/1402612452 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4800bb20 con 0x7fef50158e50 2023-10-09T06:27:54.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.414+0000 7fef4e7fc700 1 -- 172.21.15.31:0/1402612452 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48012430 con 0x7fef50158e50 2023-10-09T06:27:54.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.415+0000 7fef55ebb700 1 -- 172.21.15.31:0/1402612452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef50158e50 msgr2=0x7fef500cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.415+0000 7fef55ebb700 1 --2- 172.21.15.31:0/1402612452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef50158e50 0x7fef500cb750 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fef48009e60 tx=0x7fef48009780 comp rx=0 tx=0).stop 2023-10-09T06:27:54.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.415+0000 7fef55ebb700 1 -- 172.21.15.31:0/1402612452 shutdown_connections 2023-10-09T06:27:54.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.415+0000 7fef55ebb700 1 --2- 172.21.15.31:0/1402612452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef50158e50 0x7fef500cb750 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.415+0000 7fef55ebb700 1 -- 172.21.15.31:0/1402612452 >> 172.21.15.31:0/1402612452 conn(0x7fef50069870 msgr2=0x7fef50069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:54.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.415+0000 7fef55ebb700 1 -- 172.21.15.31:0/1402612452 shutdown_connections 2023-10-09T06:27:54.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.415+0000 7fef55ebb700 1 -- 172.21.15.31:0/1402612452 wait complete. 2023-10-09T06:27:54.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.416+0000 7fef55ebb700 1 Processor -- start 2023-10-09T06:27:54.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.416+0000 7fef55ebb700 1 -- start start 2023-10-09T06:27:54.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef55ebb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef50152010 0x7fef500c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef55ebb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef501523e0 0x7fef50142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef55ebb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef50158e50 0x7fef5015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef55ebb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef500c3e20 con 0x7fef501523e0 2023-10-09T06:27:54.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef55ebb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5014e050 con 0x7fef50152010 2023-10-09T06:27:54.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef55ebb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5014e330 con 0x7fef50158e50 2023-10-09T06:27:54.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef4effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef501523e0 0x7fef50142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef4effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef501523e0 0x7fef50142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43716/0 (socket says 172.21.15.31:43716) 2023-10-09T06:27:54.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef4effd700 1 -- 172.21.15.31:0/899770575 learned_addr learned my addr 172.21.15.31:0/899770575 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:54.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef4ffff700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef50158e50 0x7fef5015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef4effd700 1 -- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef50158e50 msgr2=0x7fef5015a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef4effd700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef50158e50 0x7fef5015a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef4f7fe700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef50152010 0x7fef500c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef4effd700 1 -- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef50152010 msgr2=0x7fef500c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef4effd700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef50152010 0x7fef500c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef4effd700 1 -- 172.21.15.31:0/899770575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48009a20 con 0x7fef501523e0 2023-10-09T06:27:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.417+0000 7fef4f7fe700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef50152010 0x7fef500c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.418+0000 7fef4effd700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef501523e0 0x7fef50142840 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c5d0 tx=0x7fef44007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.418+0000 7fef377fe700 1 -- 172.21.15.31:0/899770575 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44011590 con 0x7fef501523e0 2023-10-09T06:27:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.418+0000 7fef377fe700 1 -- 172.21.15.31:0/899770575 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef44011710 con 0x7fef501523e0 2023-10-09T06:27:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.418+0000 7fef55ebb700 1 -- 172.21.15.31:0/899770575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef50159d80 con 0x7fef501523e0 2023-10-09T06:27:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.418+0000 7fef377fe700 1 -- 172.21.15.31:0/899770575 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44011ad0 con 0x7fef501523e0 2023-10-09T06:27:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.418+0000 7fef55ebb700 1 -- 172.21.15.31:0/899770575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5014e610 con 0x7fef501523e0 2023-10-09T06:27:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.419+0000 7fef55ebb700 1 -- 172.21.15.31:0/899770575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5015a280 con 0x7fef501523e0 2023-10-09T06:27:54.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.419+0000 7fef377fe700 1 -- 172.21.15.31:0/899770575 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef4401c460 con 0x7fef501523e0 2023-10-09T06:27:54.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.420+0000 7fef377fe700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fef3c066f30 0x7fef3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.420+0000 7fef377fe700 1 -- 172.21.15.31:0/899770575 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef44084330 con 0x7fef501523e0 2023-10-09T06:27:54.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.420+0000 7fef4f7fe700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fef3c066f30 0x7fef3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.420+0000 7fef4f7fe700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fef3c066f30 0x7fef3c0693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fef400058d0 tx=0x7fef40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:54.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.424+0000 7fef377fe700 1 -- 172.21.15.31:0/899770575 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef440515a0 con 0x7fef501523e0 2023-10-09T06:27:54.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.616+0000 7fef55ebb700 1 -- 172.21.15.31:0/899770575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef5004c3c0 con 0x7fef501523e0 2023-10-09T06:27:54.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.617+0000 7fef377fe700 1 -- 172.21.15.31:0/899770575 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fef44054bc0 con 0x7fef501523e0 2023-10-09T06:27:54.618 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:54.618 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":151,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:27:53.330520+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:27:51.726909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T06:27:52.302903+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:27:54.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.619+0000 7fef55ebb700 1 -- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fef3c066f30 msgr2=0x7fef3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.619+0000 7fef55ebb700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fef3c066f30 0x7fef3c0693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fef400058d0 tx=0x7fef40009040 comp rx=0 tx=0).stop 2023-10-09T06:27:54.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.619+0000 7fef55ebb700 1 -- 172.21.15.31:0/899770575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef501523e0 msgr2=0x7fef50142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.619+0000 7fef55ebb700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef501523e0 0x7fef50142840 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c5d0 tx=0x7fef44007f60 comp rx=0 tx=0).stop 2023-10-09T06:27:54.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.619+0000 7fef55ebb700 1 -- 172.21.15.31:0/899770575 shutdown_connections 2023-10-09T06:27:54.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.619+0000 7fef55ebb700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fef3c066f30 0x7fef3c0693e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.619+0000 7fef55ebb700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fef50158e50 0x7fef5015a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.619+0000 7fef55ebb700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef50152010 0x7fef500c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.619+0000 7fef55ebb700 1 --2- 172.21.15.31:0/899770575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef501523e0 0x7fef50142840 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.619+0000 7fef55ebb700 1 -- 172.21.15.31:0/899770575 >> 172.21.15.31:0/899770575 conn(0x7fef50069870 msgr2=0x7fef5006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:54.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.619+0000 7fef55ebb700 1 -- 172.21.15.31:0/899770575 shutdown_connections 2023-10-09T06:27:54.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.619+0000 7fef55ebb700 1 -- 172.21.15.31:0/899770575 wait complete. 2023-10-09T06:27:54.632 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:27:54.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.754+0000 7fc506df1700 1 Processor -- start 2023-10-09T06:27:54.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.754+0000 7fc506df1700 1 -- start start 2023-10-09T06:27:54.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.754+0000 7fc506df1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc500159ec0 0x7fc5000af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.754+0000 7fc506df1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc50006acb0 0x7fc5000afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.754+0000 7fc506df1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5000b0790 con 0x7fc50015a290 2023-10-09T06:27:54.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.754+0000 7fc506df1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5000ce1f0 con 0x7fc500159ec0 2023-10-09T06:27:54.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.754+0000 7fc506df1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5000b0b20 con 0x7fc50006acb0 2023-10-09T06:27:54.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc4fffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc50015a290 0x7fc50006a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58182/0 (socket says 172.21.15.31:58182) 2023-10-09T06:27:54.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc4fffff700 1 -- 172.21.15.31:0/287199515 learned_addr learned my addr 172.21.15.31:0/287199515 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:54.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc50538e700 1 --2- 172.21.15.31:0/287199515 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc50006acb0 0x7fc5000afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc504b8d700 1 --2- 172.21.15.31:0/287199515 >> v2:172.21.15.158:3300/0 conn(0x7fc500159ec0 0x7fc5000af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc4ff7fe700 1 -- 172.21.15.31:0/287199515 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927255192 0 0) 0x7fc5000b0790 con 0x7fc50015a290 2023-10-09T06:27:54.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc4ff7fe700 1 -- 172.21.15.31:0/287199515 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4e8003570 con 0x7fc50015a290 2023-10-09T06:27:54.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc50538e700 1 -- 172.21.15.31:0/287199515 >> v2:172.21.15.158:3300/0 conn(0x7fc500159ec0 msgr2=0x7fc5000af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:54.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc50538e700 1 --2- 172.21.15.31:0/287199515 >> v2:172.21.15.158:3300/0 conn(0x7fc500159ec0 0x7fc5000af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc50538e700 1 -- 172.21.15.31:0/287199515 >> v1:172.21.15.31:6789/0 conn(0x7fc50015a290 legacy=0x7fc50006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc50538e700 1 -- 172.21.15.31:0/287199515 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5000b04b0 con 0x7fc50006acb0 2023-10-09T06:27:54.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc50538e700 1 --2- 172.21.15.31:0/287199515 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc50006acb0 0x7fc5000afe80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00098e0 tx=0x7fc4f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=195f3e4b126b0d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:54.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc4ff7fe700 1 -- 172.21.15.31:0/287199515 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0011630 con 0x7fc50006acb0 2023-10-09T06:27:54.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc4ff7fe700 1 -- 172.21.15.31:0/287199515 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f0011790 con 0x7fc50006acb0 2023-10-09T06:27:54.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.755+0000 7fc4ff7fe700 1 -- 172.21.15.31:0/287199515 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0011b30 con 0x7fc50006acb0 2023-10-09T06:27:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.756+0000 7fc506df1700 1 -- 172.21.15.31:0/287199515 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc50006acb0 msgr2=0x7fc5000afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.756+0000 7fc506df1700 1 --2- 172.21.15.31:0/287199515 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc50006acb0 0x7fc5000afe80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00098e0 tx=0x7fc4f00091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.756+0000 7fc506df1700 1 -- 172.21.15.31:0/287199515 shutdown_connections 2023-10-09T06:27:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.756+0000 7fc506df1700 1 --2- 172.21.15.31:0/287199515 >> v2:172.21.15.158:3300/0 conn(0x7fc500159ec0 0x7fc5000af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.756+0000 7fc506df1700 1 --2- 172.21.15.31:0/287199515 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc50006acb0 0x7fc5000afe80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.756+0000 7fc506df1700 1 -- 172.21.15.31:0/287199515 >> 172.21.15.31:0/287199515 conn(0x7fc5000d1880 msgr2=0x7fc5000cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.756+0000 7fc506df1700 1 -- 172.21.15.31:0/287199515 shutdown_connections 2023-10-09T06:27:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.756+0000 7fc506df1700 1 -- 172.21.15.31:0/287199515 wait complete. 2023-10-09T06:27:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.757+0000 7fc506df1700 1 Processor -- start 2023-10-09T06:27:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.757+0000 7fc506df1700 1 -- start start 2023-10-09T06:27:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc506df1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc50006acb0 0x7fc5001554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc506df1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc500159ec0 0x7fc5000b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc506df1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50015a290 0x7fc5000c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc506df1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc500155a00 con 0x7fc50015a290 2023-10-09T06:27:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc506df1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5000b4a60 con 0x7fc50006acb0 2023-10-09T06:27:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc506df1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5000b4d40 con 0x7fc500159ec0 2023-10-09T06:27:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc50538e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50015a290 0x7fc5000c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc50538e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50015a290 0x7fc5000c9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43726/0 (socket says 172.21.15.31:43726) 2023-10-09T06:27:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc50538e700 1 -- 172.21.15.31:0/431979857 learned_addr learned my addr 172.21.15.31:0/431979857 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc4fffff700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc500159ec0 0x7fc5000b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc50538e700 1 -- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc500159ec0 msgr2=0x7fc5000b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc504b8d700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc50006acb0 0x7fc5001554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc50538e700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc500159ec0 0x7fc5000b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc50538e700 1 -- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc50006acb0 msgr2=0x7fc5001554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc50538e700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc50006acb0 0x7fc5001554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.758+0000 7fc50538e700 1 -- 172.21.15.31:0/431979857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f0009420 con 0x7fc50015a290 2023-10-09T06:27:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.759+0000 7fc50538e700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50015a290 0x7fc5000c9de0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0013000 tx=0x7fc4f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.759+0000 7fc4fcff9700 1 -- 172.21.15.31:0/431979857 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00233f0 con 0x7fc50015a290 2023-10-09T06:27:54.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.759+0000 7fc4fcff9700 1 -- 172.21.15.31:0/431979857 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f0023550 con 0x7fc50015a290 2023-10-09T06:27:54.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.759+0000 7fc506df1700 1 -- 172.21.15.31:0/431979857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5000b5020 con 0x7fc50015a290 2023-10-09T06:27:54.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.759+0000 7fc4fcff9700 1 -- 172.21.15.31:0/431979857 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00238f0 con 0x7fc50015a290 2023-10-09T06:27:54.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.759+0000 7fc506df1700 1 -- 172.21.15.31:0/431979857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5000b55e0 con 0x7fc50015a290 2023-10-09T06:27:54.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.760+0000 7fc506df1700 1 -- 172.21.15.31:0/431979857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5000b57d0 con 0x7fc50015a290 2023-10-09T06:27:54.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.760+0000 7fc4fcff9700 1 -- 172.21.15.31:0/431979857 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc4f0023ce0 con 0x7fc50015a290 2023-10-09T06:27:54.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.760+0000 7fc4fcff9700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc4ec066f30 0x7fc4ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:54.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.761+0000 7fc4fcff9700 1 -- 172.21.15.31:0/431979857 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc4f0085a20 con 0x7fc50015a290 2023-10-09T06:27:54.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.761+0000 7fc504b8d700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc4ec066f30 0x7fc4ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:54.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.761+0000 7fc504b8d700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc4ec066f30 0x7fc4ec0693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009fd0 tx=0x7fc4f800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:54.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:54.765+0000 7fc4fcff9700 1 -- 172.21.15.31:0/431979857 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4f0052d10 con 0x7fc50015a290 2023-10-09T06:27:55.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.004+0000 7fc506df1700 1 -- 172.21.15.31:0/431979857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc50004c3c0 con 0x7fc50015a290 2023-10-09T06:27:55.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.943+0000 7fc4fcff9700 1 -- 172.21.15.31:0/431979857 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc4f0015020 con 0x7fc50015a290 2023-10-09T06:27:55.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.945+0000 7fc506df1700 1 -- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc4ec066f30 msgr2=0x7fc4ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:55.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.945+0000 7fc506df1700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc4ec066f30 0x7fc4ec0693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009fd0 tx=0x7fc4f800b040 comp rx=0 tx=0).stop 2023-10-09T06:27:55.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.945+0000 7fc506df1700 1 -- 172.21.15.31:0/431979857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50015a290 msgr2=0x7fc5000c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:55.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.945+0000 7fc506df1700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50015a290 0x7fc5000c9de0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0013000 tx=0x7fc4f0017000 comp rx=0 tx=0).stop 2023-10-09T06:27:55.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.945+0000 7fc506df1700 1 -- 172.21.15.31:0/431979857 shutdown_connections 2023-10-09T06:27:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.945+0000 7fc506df1700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc4ec066f30 0x7fc4ec0693e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.945+0000 7fc506df1700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50015a290 0x7fc5000c9de0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.945+0000 7fc506df1700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc50006acb0 0x7fc5001554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.945+0000 7fc506df1700 1 --2- 172.21.15.31:0/431979857 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc500159ec0 0x7fc5000b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.945+0000 7fc506df1700 1 -- 172.21.15.31:0/431979857 >> 172.21.15.31:0/431979857 conn(0x7fc5000d1880 msgr2=0x7fc5000c7510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.945+0000 7fc506df1700 1 -- 172.21.15.31:0/431979857 shutdown_connections 2023-10-09T06:27:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:55.945+0000 7fc506df1700 1 -- 172.21.15.31:0/431979857 wait complete. 2023-10-09T06:27:55.959 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:27:56.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.084+0000 7f415d9ed700 1 Processor -- start 2023-10-09T06:27:56.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.084+0000 7f415d9ed700 1 -- start start 2023-10-09T06:27:56.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.085+0000 7f415d9ed700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41580b01c0 0x7f4158157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:56.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.085+0000 7f415d9ed700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f415806f610 0x7f4158070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:56.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.085+0000 7f415d9ed700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415806e2d0 con 0x7f4158157bd0 2023-10-09T06:27:56.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.085+0000 7f415d9ed700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415806e570 con 0x7f41580b01c0 2023-10-09T06:27:56.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.085+0000 7f415d9ed700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415806e850 con 0x7f415806f610 2023-10-09T06:27:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.085+0000 7f41567fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41580b01c0 0x7f4158157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.085+0000 7f4156ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4158157bd0 0x7f41580afab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58184/0 (socket says 172.21.15.31:58184) 2023-10-09T06:27:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.085+0000 7f41567fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41580b01c0 0x7f4158157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43732/0 (socket says 172.21.15.31:43732) 2023-10-09T06:27:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.085+0000 7f4156ffd700 1 -- 172.21.15.31:0/2660197879 learned_addr learned my addr 172.21.15.31:0/2660197879 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f41567fc700 1 -- 172.21.15.31:0/2660197879 >> v2:172.21.15.158:3300/0 conn(0x7f415806f610 msgr2=0x7f4158070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f41567fc700 1 --2- 172.21.15.31:0/2660197879 >> v2:172.21.15.158:3300/0 conn(0x7f415806f610 0x7f4158070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f41567fc700 1 -- 172.21.15.31:0/2660197879 >> v1:172.21.15.31:6789/0 conn(0x7f4158157bd0 legacy=0x7f41580afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f41567fc700 1 -- 172.21.15.31:0/2660197879 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415806eb30 con 0x7f41580b01c0 2023-10-09T06:27:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f4155ffb700 1 -- 172.21.15.31:0/2660197879 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200165483 0 0) 0x7f415806e2d0 con 0x7f4158157bd0 2023-10-09T06:27:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f41567fc700 1 --2- 172.21.15.31:0/2660197879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41580b01c0 0x7f4158157fa0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f4158069160 tx=0x7f41400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaacea5d51ec1224 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f4155ffb700 1 -- 172.21.15.31:0/2660197879 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414000b6b0 con 0x7f41580b01c0 2023-10-09T06:27:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f4155ffb700 1 -- 172.21.15.31:0/2660197879 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414000b810 con 0x7f41580b01c0 2023-10-09T06:27:56.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f4155ffb700 1 -- 172.21.15.31:0/2660197879 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414000bbb0 con 0x7f41580b01c0 2023-10-09T06:27:56.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f415d9ed700 1 -- 172.21.15.31:0/2660197879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41580b01c0 msgr2=0x7f4158157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:56.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f415d9ed700 1 --2- 172.21.15.31:0/2660197879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41580b01c0 0x7f4158157fa0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f4158069160 tx=0x7f41400091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:56.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f415d9ed700 1 -- 172.21.15.31:0/2660197879 shutdown_connections 2023-10-09T06:27:56.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f415d9ed700 1 --2- 172.21.15.31:0/2660197879 >> v2:172.21.15.158:3300/0 conn(0x7f415806f610 0x7f4158070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:56.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f415d9ed700 1 --2- 172.21.15.31:0/2660197879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41580b01c0 0x7f4158157fa0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:56.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.086+0000 7f415d9ed700 1 -- 172.21.15.31:0/2660197879 >> 172.21.15.31:0/2660197879 conn(0x7f415806ad80 msgr2=0x7f41580cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:56.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.087+0000 7f415d9ed700 1 -- 172.21.15.31:0/2660197879 shutdown_connections 2023-10-09T06:27:56.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.087+0000 7f415d9ed700 1 -- 172.21.15.31:0/2660197879 wait complete. 2023-10-09T06:27:56.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.088+0000 7f415d9ed700 1 Processor -- start 2023-10-09T06:27:56.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.088+0000 7f415d9ed700 1 -- start start 2023-10-09T06:27:56.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.088+0000 7f415d9ed700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f415806f610 0x7f4158154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:56.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.088+0000 7f415d9ed700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41580b01c0 0x7f415815c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:56.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.088+0000 7f415d9ed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4158157bd0 0x7f415815ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:56.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f415d9ed700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41580acd50 con 0x7f4158157bd0 2023-10-09T06:27:56.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f415d9ed700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415816e320 con 0x7f41580b01c0 2023-10-09T06:27:56.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f415d9ed700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41580aca70 con 0x7f415806f610 2023-10-09T06:27:56.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f41577fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4158157bd0 0x7f415815ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:56.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f41577fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4158157bd0 0x7f415815ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43748/0 (socket says 172.21.15.31:43748) 2023-10-09T06:27:56.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f41577fe700 1 -- 172.21.15.31:0/4098012539 learned_addr learned my addr 172.21.15.31:0/4098012539 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:56.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f4156ffd700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f415806f610 0x7f4158154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:56.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f41567fc700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41580b01c0 0x7f415815c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:56.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f41577fe700 1 -- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f415806f610 msgr2=0x7f4158154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:56.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f41577fe700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f415806f610 0x7f4158154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:56.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f41577fe700 1 -- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41580b01c0 msgr2=0x7f415815c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:56.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f41577fe700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41580b01c0 0x7f415815c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:56.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f41577fe700 1 -- 172.21.15.31:0/4098012539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4140009420 con 0x7f4158157bd0 2023-10-09T06:27:56.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f41577fe700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4158157bd0 0x7f415815ceb0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f415000b840 tx=0x7f41500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:56.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f414effd700 1 -- 172.21.15.31:0/4098012539 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000f510 con 0x7f4158157bd0 2023-10-09T06:27:56.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f414effd700 1 -- 172.21.15.31:0/4098012539 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415000f670 con 0x7f4158157bd0 2023-10-09T06:27:56.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f415d9ed700 1 -- 172.21.15.31:0/4098012539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415816dcd0 con 0x7f4158157bd0 2023-10-09T06:27:56.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f414effd700 1 -- 172.21.15.31:0/4098012539 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000fa30 con 0x7f4158157bd0 2023-10-09T06:27:56.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.089+0000 7f415d9ed700 1 -- 172.21.15.31:0/4098012539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41581545c0 con 0x7f4158157bd0 2023-10-09T06:27:56.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.090+0000 7f415d9ed700 1 -- 172.21.15.31:0/4098012539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415816db30 con 0x7f4158157bd0 2023-10-09T06:27:56.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.091+0000 7f414effd700 1 -- 172.21.15.31:0/4098012539 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f415001a400 con 0x7f4158157bd0 2023-10-09T06:27:56.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.091+0000 7f414effd700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4138066f30 0x7f41380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:56.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.091+0000 7f414effd700 1 -- 172.21.15.31:0/4098012539 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4150084110 con 0x7f4158157bd0 2023-10-09T06:27:56.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.091+0000 7f4156ffd700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4138066f30 0x7f41380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:56.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.092+0000 7f4156ffd700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4138066f30 0x7f41380693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f41580683f0 tx=0x7f4148009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:56.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.095+0000 7f414effd700 1 -- 172.21.15.31:0/4098012539 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f415816db30 con 0x7f4158157bd0 2023-10-09T06:27:56.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.332+0000 7f415d9ed700 1 -- 172.21.15.31:0/4098012539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f415816db30 con 0x7f4158157bd0 2023-10-09T06:27:56.604 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:27:56.607 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:27:56.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.947+0000 7f414effd700 1 -- 172.21.15.31:0/4098012539 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) v1 ==== 122+0+0 (secure 0 0 0) 0x7f415816db30 con 0x7f4158157bd0 2023-10-09T06:27:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.950+0000 7f415d9ed700 1 -- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4138066f30 msgr2=0x7f41380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.950+0000 7f415d9ed700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4138066f30 0x7f41380693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f41580683f0 tx=0x7f4148009040 comp rx=0 tx=0).stop 2023-10-09T06:27:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.950+0000 7f415d9ed700 1 -- 172.21.15.31:0/4098012539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4158157bd0 msgr2=0x7f415815ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.950+0000 7f415d9ed700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4158157bd0 0x7f415815ceb0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f415000b840 tx=0x7f41500091d0 comp rx=0 tx=0).stop 2023-10-09T06:27:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.950+0000 7f415d9ed700 1 -- 172.21.15.31:0/4098012539 shutdown_connections 2023-10-09T06:27:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.950+0000 7f415d9ed700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4138066f30 0x7f41380693e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.950+0000 7f415d9ed700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f415806f610 0x7f4158154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.950+0000 7f415d9ed700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4158157bd0 0x7f415815ceb0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.950+0000 7f415d9ed700 1 --2- 172.21.15.31:0/4098012539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41580b01c0 0x7f415815c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:56.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.950+0000 7f415d9ed700 1 -- 172.21.15.31:0/4098012539 >> 172.21.15.31:0/4098012539 conn(0x7f415806ad80 msgr2=0x7f41580ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:56.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.950+0000 7f415d9ed700 1 -- 172.21.15.31:0/4098012539 shutdown_connections 2023-10-09T06:27:56.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:56.950+0000 7f415d9ed700 1 -- 172.21.15.31:0/4098012539 wait complete. 2023-10-09T06:27:56.963 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:27:57.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.083+0000 7f34e3224700 1 Processor -- start 2023-10-09T06:27:57.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.083+0000 7f34e3224700 1 -- start start 2023-10-09T06:27:57.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34e3224700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f34dc15a1e0 0x7f34dc0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34e3224700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34dc0b3430 0x7f34dc0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34e3224700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34dc15db80 con 0x7f34dc159e10 2023-10-09T06:27:57.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34e3224700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34dc15e800 con 0x7f34dc15a1e0 2023-10-09T06:27:57.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34e3224700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc15de60 con 0x7f34dc0b3430 2023-10-09T06:27:57.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34dbfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f34dc15a1e0 0x7f34dc0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34e0fc0700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f34dc159e10 0x7f34dc0b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58196/0 (socket says 172.21.15.31:58196) 2023-10-09T06:27:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34e0fc0700 1 -- 172.21.15.31:0/1128525898 learned_addr learned my addr 172.21.15.31:0/1128525898 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34e17c1700 1 --2- 172.21.15.31:0/1128525898 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34dc0b3430 0x7f34dc0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34dbfff700 1 -- 172.21.15.31:0/1128525898 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34dc0b3430 msgr2=0x7f34dc0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34dbfff700 1 --2- 172.21.15.31:0/1128525898 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34dc0b3430 0x7f34dc0cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34dbfff700 1 -- 172.21.15.31:0/1128525898 >> v1:172.21.15.31:6789/0 conn(0x7f34dc159e10 legacy=0x7f34dc0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34db7fe700 1 -- 172.21.15.31:0/1128525898 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799499466 0 0) 0x7f34dc15db80 con 0x7f34dc159e10 2023-10-09T06:27:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34dbfff700 1 -- 172.21.15.31:0/1128525898 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc15e140 con 0x7f34dc15a1e0 2023-10-09T06:27:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34e17c1700 1 --2- 172.21.15.31:0/1128525898 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34dc0b3430 0x7f34dc0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34dbfff700 1 --2- 172.21.15.31:0/1128525898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc15a1e0 0x7f34dc0cd740 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0098e0 tx=0x7f34cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d5b878032f70f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.084+0000 7f34db7fe700 1 -- 172.21.15.31:0/1128525898 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc009e80 con 0x7f34dc15a1e0 2023-10-09T06:27:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.085+0000 7f34db7fe700 1 -- 172.21.15.31:0/1128525898 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc00b860 con 0x7f34dc15a1e0 2023-10-09T06:27:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.085+0000 7f34db7fe700 1 -- 172.21.15.31:0/1128525898 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc00bbe0 con 0x7f34dc15a1e0 2023-10-09T06:27:57.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.085+0000 7f34e3224700 1 -- 172.21.15.31:0/1128525898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc15a1e0 msgr2=0x7f34dc0cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.085+0000 7f34e3224700 1 --2- 172.21.15.31:0/1128525898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc15a1e0 0x7f34dc0cd740 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0098e0 tx=0x7f34cc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.085+0000 7f34e3224700 1 -- 172.21.15.31:0/1128525898 shutdown_connections 2023-10-09T06:27:57.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.085+0000 7f34e3224700 1 --2- 172.21.15.31:0/1128525898 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34dc0b3430 0x7f34dc0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.085+0000 7f34e3224700 1 --2- 172.21.15.31:0/1128525898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc15a1e0 0x7f34dc0cd740 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.085+0000 7f34e3224700 1 -- 172.21.15.31:0/1128525898 >> 172.21.15.31:0/1128525898 conn(0x7f34dc067660 msgr2=0x7f34dc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:57.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.085+0000 7f34e3224700 1 -- 172.21.15.31:0/1128525898 shutdown_connections 2023-10-09T06:27:57.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.085+0000 7f34e3224700 1 -- 172.21.15.31:0/1128525898 wait complete. 2023-10-09T06:27:57.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.086+0000 7f34e3224700 1 Processor -- start 2023-10-09T06:27:57.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.086+0000 7f34e3224700 1 -- start start 2023-10-09T06:27:57.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.087+0000 7f34e3224700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc0b3430 0x7f34dc158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.087+0000 7f34e3224700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34dc159e10 0x7f34dc0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.087+0000 7f34e3224700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34dc15a1e0 0x7f34dc0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.087+0000 7f34e3224700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc158890 con 0x7f34dc0b3430 2023-10-09T06:27:57.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.087+0000 7f34e3224700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0c4760 con 0x7f34dc159e10 2023-10-09T06:27:57.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.087+0000 7f34e3224700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0c5000 con 0x7f34dc15a1e0 2023-10-09T06:27:57.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.087+0000 7f34e0fc0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc0b3430 0x7f34dc158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.087+0000 7f34e0fc0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc0b3430 0x7f34dc158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43760/0 (socket says 172.21.15.31:43760) 2023-10-09T06:27:57.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.087+0000 7f34e0fc0700 1 -- 172.21.15.31:0/1217206924 learned_addr learned my addr 172.21.15.31:0/1217206924 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:57.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.087+0000 7f34e17c1700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34dc15a1e0 0x7f34dc0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.088+0000 7f34dbfff700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34dc159e10 0x7f34dc0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.088+0000 7f34e0fc0700 1 -- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34dc15a1e0 msgr2=0x7f34dc0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.088+0000 7f34e0fc0700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34dc15a1e0 0x7f34dc0d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.088+0000 7f34e0fc0700 1 -- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34dc159e10 msgr2=0x7f34dc0c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.088+0000 7f34e0fc0700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34dc159e10 0x7f34dc0c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.088+0000 7f34e0fc0700 1 -- 172.21.15.31:0/1217206924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc009420 con 0x7f34dc0b3430 2023-10-09T06:27:57.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.088+0000 7f34dbfff700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34dc159e10 0x7f34dc0c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:57.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.088+0000 7f34e0fc0700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc0b3430 0x7f34dc158350 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f34d400cdb0 tx=0x7f34d4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:57.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.088+0000 7f34d8ff9700 1 -- 172.21.15.31:0/1217206924 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d400aad0 con 0x7f34dc0b3430 2023-10-09T06:27:57.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.088+0000 7f34d8ff9700 1 -- 172.21.15.31:0/1217206924 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d400ac30 con 0x7f34dc0b3430 2023-10-09T06:27:57.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.088+0000 7f34e3224700 1 -- 172.21.15.31:0/1217206924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc0c8ba0 con 0x7f34dc0b3430 2023-10-09T06:27:57.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.088+0000 7f34d8ff9700 1 -- 172.21.15.31:0/1217206924 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d40070f0 con 0x7f34dc0b3430 2023-10-09T06:27:57.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.088+0000 7f34e3224700 1 -- 172.21.15.31:0/1217206924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34dc0c4c90 con 0x7f34dc0b3430 2023-10-09T06:27:57.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.089+0000 7f34e3224700 1 -- 172.21.15.31:0/1217206924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34dc04c3c0 con 0x7f34dc0b3430 2023-10-09T06:27:57.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.089+0000 7f34d8ff9700 1 -- 172.21.15.31:0/1217206924 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34d40074a0 con 0x7f34dc0b3430 2023-10-09T06:27:57.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.090+0000 7f34d8ff9700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34bc066f30 0x7f34bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.090+0000 7f34d8ff9700 1 -- 172.21.15.31:0/1217206924 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34d4084ad0 con 0x7f34dc0b3430 2023-10-09T06:27:57.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.090+0000 7f34dbfff700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34bc066f30 0x7f34bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.090+0000 7f34dbfff700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34bc066f30 0x7f34bc0693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f34dc08a0b0 tx=0x7f34cc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:57.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.094+0000 7f34d8ff9700 1 -- 172.21.15.31:0/1217206924 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34d4051d40 con 0x7f34dc0b3430 2023-10-09T06:27:57.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.329+0000 7f34e3224700 1 -- 172.21.15.31:0/1217206924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34dc0c52e0 con 0x7f34dc0b3430 2023-10-09T06:27:57.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.330+0000 7f34d8ff9700 1 -- 172.21.15.31:0/1217206924 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f34d4055360 con 0x7f34dc0b3430 2023-10-09T06:27:57.331 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:57.331 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/52086276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":52086276},{"type":"v1","addr":"172.21.15.158:6836","nonce":52086276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3440717183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3440717183},{"type":"v1","addr":"172.21.15.31:6834","nonce":3440717183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1719024262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1719024262},{"type":"v1","addr":"172.21.15.31:6835","nonce":1719024262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:53.330823+0000","modified":"2023-10-09T06:27:56.943663+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7419":{"gid":7419,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1416230741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1416230741},{"type":"v1","addr":"172.21.15.158:6837","nonce":1416230741}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T06:27:57.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.332+0000 7f34e3224700 1 -- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34bc066f30 msgr2=0x7f34bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.332+0000 7f34e3224700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34bc066f30 0x7f34bc0693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f34dc08a0b0 tx=0x7f34cc017000 comp rx=0 tx=0).stop 2023-10-09T06:27:57.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.332+0000 7f34e3224700 1 -- 172.21.15.31:0/1217206924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc0b3430 msgr2=0x7f34dc158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.332+0000 7f34e3224700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc0b3430 0x7f34dc158350 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f34d400cdb0 tx=0x7f34d4001ae0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.332+0000 7f34e3224700 1 -- 172.21.15.31:0/1217206924 shutdown_connections 2023-10-09T06:27:57.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.332+0000 7f34e3224700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34bc066f30 0x7f34bc0693e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.332+0000 7f34e3224700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34dc15a1e0 0x7f34dc0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.332+0000 7f34e3224700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34dc0b3430 0x7f34dc158350 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.332+0000 7f34e3224700 1 --2- 172.21.15.31:0/1217206924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34dc159e10 0x7f34dc0c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.332+0000 7f34e3224700 1 -- 172.21.15.31:0/1217206924 >> 172.21.15.31:0/1217206924 conn(0x7f34dc067660 msgr2=0x7f34dc067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:57.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.332+0000 7f34e3224700 1 -- 172.21.15.31:0/1217206924 shutdown_connections 2023-10-09T06:27:57.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.332+0000 7f34e3224700 1 -- 172.21.15.31:0/1217206924 wait complete. 2023-10-09T06:27:57.334 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 74 2023-10-09T06:27:57.345 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:27:57.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.463+0000 7fc2fc49b700 1 Processor -- start 2023-10-09T06:27:57.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.464+0000 7fc2fc49b700 1 -- start start 2023-10-09T06:27:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.464+0000 7fc2fc49b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2f40cf1c0 0x7fc2f415e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.464+0000 7fc2fc49b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f40cca20 con 0x7fc2f415a0c0 2023-10-09T06:27:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.464+0000 7fc2fc49b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f415ea40 con 0x7fc2f4159cf0 2023-10-09T06:27:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2fc49b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f4067660 con 0x7fc2f40cf1c0 2023-10-09T06:27:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2faa38700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc2f415a0c0 0x7fc2f4068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58198/0 (socket says 172.21.15.31:58198) 2023-10-09T06:27:57.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2faa38700 1 -- 172.21.15.31:0/3218989249 learned_addr learned my addr 172.21.15.31:0/3218989249 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9a36700 1 --2- 172.21.15.31:0/3218989249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2f40cf1c0 0x7fc2f415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257553408 0 0) 0x7fc2f40cca20 con 0x7fc2f415a0c0 2023-10-09T06:27:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2dc003570 con 0x7fc2f415a0c0 2023-10-09T06:27:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809900143 0 0) 0x7fc2ec001110 con 0x7fc2f4159cf0 2023-10-09T06:27:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2f40cca20 con 0x7fc2f4159cf0 2023-10-09T06:27:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2977394244 0 0) 0x7fc2dc003570 con 0x7fc2f415a0c0 2023-10-09T06:27:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2f40cf1c0 msgr2=0x7fc2f415e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 --2- 172.21.15.31:0/3218989249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2f40cf1c0 0x7fc2f415e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 >> v1:172.21.15.158:6789/0 conn(0x7fc2f4159cf0 legacy=0x7fc2f40ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4067f00 con 0x7fc2f415a0c0 2023-10-09T06:27:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fc2e40017f0 con 0x7fc2f415a0c0 2023-10-09T06:27:57.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 >> v1:172.21.15.31:6789/0 conn(0x7fc2f415a0c0 legacy=0x7fc2f4068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 --2- 172.21.15.31:0/3218989249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2f40cf1c0 0x7fc2dc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 --2- 172.21.15.31:0/3218989249 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2dc004180 0x7fc2dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 --2- 172.21.15.31:0/3218989249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2dc004d50 0x7fc2dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f4067660 con 0x7fc2dc004d50 2023-10-09T06:27:57.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00bba0 con 0x7fc2dc004180 2023-10-09T06:27:57.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.465+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00bd60 con 0x7fc2f40cf1c0 2023-10-09T06:27:57.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.466+0000 7fc2faa38700 1 --2- 172.21.15.31:0/3218989249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2dc004d50 0x7fc2dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.466+0000 7fc2fa237700 1 --2- 172.21.15.31:0/3218989249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2f40cf1c0 0x7fc2dc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.466+0000 7fc2f9a36700 1 --2- 172.21.15.31:0/3218989249 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2dc004180 0x7fc2dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.466+0000 7fc2faa38700 1 -- 172.21.15.31:0/3218989249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2f40cf1c0 msgr2=0x7fc2dc003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:57.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.466+0000 7fc2faa38700 1 --2- 172.21.15.31:0/3218989249 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2f40cf1c0 0x7fc2dc003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.466+0000 7fc2faa38700 1 -- 172.21.15.31:0/3218989249 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2dc004180 msgr2=0x7fc2dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.466+0000 7fc2faa38700 1 --2- 172.21.15.31:0/3218989249 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2dc004180 0x7fc2dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.466+0000 7fc2faa38700 1 -- 172.21.15.31:0/3218989249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc003570 con 0x7fc2dc004d50 2023-10-09T06:27:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.466+0000 7fc2faa38700 1 --2- 172.21.15.31:0/3218989249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2dc004d50 0x7fc2dc0051c0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400a8d0 tx=0x7fc2e4002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8352f0bd6a6b3c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.466+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40070d0 con 0x7fc2dc004d50 2023-10-09T06:27:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.466+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e4007230 con 0x7fc2dc004d50 2023-10-09T06:27:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.466+0000 7fc2f9235700 1 -- 172.21.15.31:0/3218989249 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40075f0 con 0x7fc2dc004d50 2023-10-09T06:27:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.467+0000 7fc2fc49b700 1 -- 172.21.15.31:0/3218989249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2dc004d50 msgr2=0x7fc2dc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.467+0000 7fc2fc49b700 1 --2- 172.21.15.31:0/3218989249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2dc004d50 0x7fc2dc0051c0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400a8d0 tx=0x7fc2e4002190 comp rx=0 tx=0).stop 2023-10-09T06:27:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.467+0000 7fc2faa38700 1 -- 172.21.15.31:0/3218989249 reap_dead start 2023-10-09T06:27:57.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.467+0000 7fc2fc49b700 1 -- 172.21.15.31:0/3218989249 shutdown_connections 2023-10-09T06:27:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.467+0000 7fc2fc49b700 1 -- 172.21.15.31:0/3218989249 >> 172.21.15.31:0/3218989249 conn(0x7fc2f406c6e0 msgr2=0x7fc2f4069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.467+0000 7fc2fc49b700 1 -- 172.21.15.31:0/3218989249 shutdown_connections 2023-10-09T06:27:57.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.467+0000 7fc2fc49b700 1 -- 172.21.15.31:0/3218989249 wait complete. 2023-10-09T06:27:57.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.468+0000 7fc2fc49b700 1 Processor -- start 2023-10-09T06:27:57.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.468+0000 7fc2fc49b700 1 -- start start 2023-10-09T06:27:57.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2fc49b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2dc004d50 0x7fc2f414fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2fc49b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f40b2ef0 0x7fc2f40b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2fc49b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2f4155510 0x7fc2f4155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2fc49b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f4155ed0 con 0x7fc2f40b2ef0 2023-10-09T06:27:57.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2fc49b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f4151720 con 0x7fc2f4155510 2023-10-09T06:27:57.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2fc49b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40b39b0 con 0x7fc2dc004d50 2023-10-09T06:27:57.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2f9a36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f40b2ef0 0x7fc2f40b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2f9a36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f40b2ef0 0x7fc2f40b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43772/0 (socket says 172.21.15.31:43772) 2023-10-09T06:27:57.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2f9a36700 1 -- 172.21.15.31:0/1263043502 learned_addr learned my addr 172.21.15.31:0/1263043502 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:57.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2f9a36700 1 -- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2dc004d50 msgr2=0x7fc2f414fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2f9a36700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2dc004d50 0x7fc2f414fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2f9a36700 1 -- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2f4155510 msgr2=0x7fc2f4155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2faa38700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2f4155510 0x7fc2f4155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2f9a36700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2f4155510 0x7fc2f4155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2f9a36700 1 -- 172.21.15.31:0/1263043502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f40b3c90 con 0x7fc2f40b2ef0 2023-10-09T06:27:57.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2faa38700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2f4155510 0x7fc2f4155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:57.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2f9a36700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f40b2ef0 0x7fc2f40b3360 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8011b40 tx=0x7fc2e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:57.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2f27fc700 1 -- 172.21.15.31:0/1263043502 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800fa10 con 0x7fc2f40b2ef0 2023-10-09T06:27:57.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2f27fc700 1 -- 172.21.15.31:0/1263043502 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e800fb70 con 0x7fc2f40b2ef0 2023-10-09T06:27:57.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2fc49b700 1 -- 172.21.15.31:0/1263043502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f40b3f70 con 0x7fc2f40b2ef0 2023-10-09T06:27:57.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2f27fc700 1 -- 172.21.15.31:0/1263043502 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8014440 con 0x7fc2f40b2ef0 2023-10-09T06:27:57.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.469+0000 7fc2fc49b700 1 -- 172.21.15.31:0/1263043502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f40b4530 con 0x7fc2f40b2ef0 2023-10-09T06:27:57.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.470+0000 7fc2fc49b700 1 -- 172.21.15.31:0/1263043502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f404c3c0 con 0x7fc2f40b2ef0 2023-10-09T06:27:57.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.471+0000 7fc2f27fc700 1 -- 172.21.15.31:0/1263043502 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2e8014830 con 0x7fc2f40b2ef0 2023-10-09T06:27:57.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.471+0000 7fc2f27fc700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc2e0066f30 0x7fc2e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.471+0000 7fc2f27fc700 1 -- 172.21.15.31:0/1263043502 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc2e8018030 con 0x7fc2f40b2ef0 2023-10-09T06:27:57.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.471+0000 7fc2fa237700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc2e0066f30 0x7fc2e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.472+0000 7fc2fa237700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc2e0066f30 0x7fc2e00693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec007e40 tx=0x7fc2ec007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:57.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.476+0000 7fc2f27fc700 1 -- 172.21.15.31:0/1263043502 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2e8052250 con 0x7fc2f40b2ef0 2023-10-09T06:27:57.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.671+0000 7fc2fc49b700 1 -- 172.21.15.31:0/1263043502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2f40ce730 con 0x7fc2f40b2ef0 2023-10-09T06:27:57.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.672+0000 7fc2f27fc700 1 -- 172.21.15.31:0/1263043502 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+15365 (secure 0 0 0) 0x7fc2e8022090 con 0x7fc2f40b2ef0 2023-10-09T06:27:57.673 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:57.673 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":152,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:27:54.921166+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:27:51.726909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T06:27:52.302903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:27:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.674+0000 7fc2fc49b700 1 -- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc2e0066f30 msgr2=0x7fc2e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.674+0000 7fc2fc49b700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc2e0066f30 0x7fc2e00693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec007e40 tx=0x7fc2ec007d30 comp rx=0 tx=0).stop 2023-10-09T06:27:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.674+0000 7fc2fc49b700 1 -- 172.21.15.31:0/1263043502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f40b2ef0 msgr2=0x7fc2f40b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.674+0000 7fc2fc49b700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f40b2ef0 0x7fc2f40b3360 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8011b40 tx=0x7fc2e80091a0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.674+0000 7fc2fc49b700 1 -- 172.21.15.31:0/1263043502 shutdown_connections 2023-10-09T06:27:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.674+0000 7fc2fc49b700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc2e0066f30 0x7fc2e00693e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.674+0000 7fc2fc49b700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc2dc004d50 0x7fc2f414fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.674+0000 7fc2fc49b700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc2f4155510 0x7fc2f4155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.674+0000 7fc2fc49b700 1 --2- 172.21.15.31:0/1263043502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f40b2ef0 0x7fc2f40b3360 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.674+0000 7fc2fc49b700 1 -- 172.21.15.31:0/1263043502 >> 172.21.15.31:0/1263043502 conn(0x7fc2f406c6e0 msgr2=0x7fc2f40c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:57.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.674+0000 7fc2fc49b700 1 -- 172.21.15.31:0/1263043502 shutdown_connections 2023-10-09T06:27:57.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.674+0000 7fc2fc49b700 1 -- 172.21.15.31:0/1263043502 wait complete. 2023-10-09T06:27:57.687 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:27:57.687 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:27:57.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.806+0000 7f2dadba5700 1 Processor -- start 2023-10-09T06:27:57.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.806+0000 7f2dadba5700 1 -- start start 2023-10-09T06:27:57.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2dadba5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2da8157870 0x7f2da815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2dadba5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2da8157c40 0x7f2da8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2dadba5700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da815cbb0 con 0x7f2da815a620 2023-10-09T06:27:57.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2dadba5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da815bfa0 con 0x7f2da8157c40 2023-10-09T06:27:57.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2dadba5700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da815c280 con 0x7f2da8157870 2023-10-09T06:27:57.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2da7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2da8157c40 0x7f2da8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2da7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2da8157c40 0x7f2da8158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43788/0 (socket says 172.21.15.31:43788) 2023-10-09T06:27:57.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2da7fff700 1 -- 172.21.15.31:0/1956186818 learned_addr learned my addr 172.21.15.31:0/1956186818 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:57.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2da77fe700 1 --2- 172.21.15.31:0/1956186818 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2da8157870 0x7f2da815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2da7fff700 1 -- 172.21.15.31:0/1956186818 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2da8157870 msgr2=0x7f2da815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:57.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2da7fff700 1 --2- 172.21.15.31:0/1956186818 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2da8157870 0x7f2da815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2da7fff700 1 -- 172.21.15.31:0/1956186818 >> v1:172.21.15.158:6789/0 conn(0x7f2da815a620 legacy=0x7f2da815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2da7fff700 1 -- 172.21.15.31:0/1956186818 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da815c560 con 0x7f2da8157c40 2023-10-09T06:27:57.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2da7fff700 1 --2- 172.21.15.31:0/1956186818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da8157c40 0x7f2da8158110 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009f20 tx=0x7f2da0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8874db0f3e0c239 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:57.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2da67fc700 1 -- 172.21.15.31:0/1956186818 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da000e070 con 0x7f2da8157c40 2023-10-09T06:27:57.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2da67fc700 1 -- 172.21.15.31:0/1956186818 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da000ba80 con 0x7f2da8157c40 2023-10-09T06:27:57.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.807+0000 7f2da67fc700 1 -- 172.21.15.31:0/1956186818 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00092e0 con 0x7f2da8157c40 2023-10-09T06:27:57.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.808+0000 7f2dadba5700 1 -- 172.21.15.31:0/1956186818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da8157c40 msgr2=0x7f2da8158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.808+0000 7f2dadba5700 1 --2- 172.21.15.31:0/1956186818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da8157c40 0x7f2da8158110 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009f20 tx=0x7f2da0009840 comp rx=0 tx=0).stop 2023-10-09T06:27:57.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.808+0000 7f2dadba5700 1 -- 172.21.15.31:0/1956186818 shutdown_connections 2023-10-09T06:27:57.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.808+0000 7f2dadba5700 1 --2- 172.21.15.31:0/1956186818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da8157c40 0x7f2da8158110 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.808+0000 7f2dadba5700 1 --2- 172.21.15.31:0/1956186818 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2da8157870 0x7f2da815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.808+0000 7f2dadba5700 1 -- 172.21.15.31:0/1956186818 >> 172.21.15.31:0/1956186818 conn(0x7f2da8068ce0 msgr2=0x7f2da80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:57.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.808+0000 7f2dadba5700 1 -- 172.21.15.31:0/1956186818 shutdown_connections 2023-10-09T06:27:57.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.808+0000 7f2dadba5700 1 -- 172.21.15.31:0/1956186818 wait complete. 2023-10-09T06:27:57.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.809+0000 7f2dadba5700 1 Processor -- start 2023-10-09T06:27:57.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.809+0000 7f2dadba5700 1 -- start start 2023-10-09T06:27:57.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2dadba5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da8157870 0x7f2da8139090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2dadba5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2da8157c40 0x7f2da814d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2dadba5700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2da815a620 0x7f2da814de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2dadba5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8151990 con 0x7f2da8157870 2023-10-09T06:27:57.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2dadba5700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8151c00 con 0x7f2da815a620 2023-10-09T06:27:57.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2dadba5700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8151ee0 con 0x7f2da8157c40 2023-10-09T06:27:57.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2da77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da8157870 0x7f2da8139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2da77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da8157870 0x7f2da8139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43800/0 (socket says 172.21.15.31:43800) 2023-10-09T06:27:57.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2da77fe700 1 -- 172.21.15.31:0/2628789881 learned_addr learned my addr 172.21.15.31:0/2628789881 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:57.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2da6ffd700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2da8157c40 0x7f2da814d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2da7fff700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2da815a620 0x7f2da814de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2da77fe700 1 -- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2da8157c40 msgr2=0x7f2da814d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2da77fe700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2da8157c40 0x7f2da814d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2da77fe700 1 -- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2da815a620 msgr2=0x7f2da814de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:57.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2da77fe700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2da815a620 0x7f2da814de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:57.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.810+0000 7f2da77fe700 1 -- 172.21.15.31:0/2628789881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0009ae0 con 0x7f2da8157870 2023-10-09T06:27:57.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.811+0000 7f2da77fe700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da8157870 0x7f2da8139090 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800d890 tx=0x7f2d98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:57.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.811+0000 7f2d8f7fe700 1 -- 172.21.15.31:0/2628789881 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d980125f0 con 0x7f2da8157870 2023-10-09T06:27:57.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.811+0000 7f2d8f7fe700 1 -- 172.21.15.31:0/2628789881 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d98012750 con 0x7f2da8157870 2023-10-09T06:27:57.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.811+0000 7f2dadba5700 1 -- 172.21.15.31:0/2628789881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da81521c0 con 0x7f2da8157870 2023-10-09T06:27:57.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.811+0000 7f2d8f7fe700 1 -- 172.21.15.31:0/2628789881 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98012af0 con 0x7f2da8157870 2023-10-09T06:27:57.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.811+0000 7f2dadba5700 1 -- 172.21.15.31:0/2628789881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da81395d0 con 0x7f2da8157870 2023-10-09T06:27:57.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.812+0000 7f2dadba5700 1 -- 172.21.15.31:0/2628789881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da8152660 con 0x7f2da8157870 2023-10-09T06:27:57.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.812+0000 7f2d8f7fe700 1 -- 172.21.15.31:0/2628789881 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d9801e460 con 0x7f2da8157870 2023-10-09T06:27:57.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.812+0000 7f2d8f7fe700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d94066f30 0x7f2d940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:57.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.813+0000 7f2d8f7fe700 1 -- 172.21.15.31:0/2628789881 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d98084aa0 con 0x7f2da8157870 2023-10-09T06:27:57.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.813+0000 7f2da6ffd700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d94066f30 0x7f2d940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:57.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.813+0000 7f2da6ffd700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d94066f30 0x7f2d940693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c0039e0 tx=0x7f2d9c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:57.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:57.817+0000 7f2d8f7fe700 1 -- 172.21.15.31:0/2628789881 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d98051d10 con 0x7f2da8157870 2023-10-09T06:27:58.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.007+0000 7f2dadba5700 1 -- 172.21.15.31:0/2628789881 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2da80d1760 con 0x7f2d94066f30 2023-10-09T06:27:58.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.016+0000 7f2d8f7fe700 1 -- 172.21.15.31:0/2628789881 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282519 (secure 0 0 0) 0x7f2da80d1760 con 0x7f2d94066f30 2023-10-09T06:27:58.020 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.019+0000 7f2dadba5700 1 -- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d94066f30 msgr2=0x7f2d940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.019+0000 7f2dadba5700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d94066f30 0x7f2d940693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c0039e0 tx=0x7f2d9c007ec0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.019+0000 7f2dadba5700 1 -- 172.21.15.31:0/2628789881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da8157870 msgr2=0x7f2da8139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.019+0000 7f2dadba5700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da8157870 0x7f2da8139090 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800d890 tx=0x7f2d98008040 comp rx=0 tx=0).stop 2023-10-09T06:27:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.019+0000 7f2dadba5700 1 -- 172.21.15.31:0/2628789881 shutdown_connections 2023-10-09T06:27:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.019+0000 7f2dadba5700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2d94066f30 0x7f2d940693e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.019+0000 7f2dadba5700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2da815a620 0x7f2da814de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.019+0000 7f2dadba5700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da8157870 0x7f2da8139090 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.019+0000 7f2dadba5700 1 --2- 172.21.15.31:0/2628789881 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2da8157c40 0x7f2da814d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.019+0000 7f2dadba5700 1 -- 172.21.15.31:0/2628789881 >> 172.21.15.31:0/2628789881 conn(0x7f2da8068ce0 msgr2=0x7f2da80b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:58.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.019+0000 7f2dadba5700 1 -- 172.21.15.31:0/2628789881 shutdown_connections 2023-10-09T06:27:58.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.019+0000 7f2dadba5700 1 -- 172.21.15.31:0/2628789881 wait complete. 2023-10-09T06:27:58.023 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:27:58.032 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2023-10-09T06:27:56.619214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554874,"statfs":{"total":1600000000,"available":1592191683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.700337"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.936760+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:39.693231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931172+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:07.101614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.929368+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.029150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.934409+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:59:10.891187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.929138+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:37.007536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.932761+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:54.277929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931037+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:17:02.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928913+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:43.355926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927147+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:57.800112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931770+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:44.999564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.929835+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:35:17.223115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.926677+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:30.199496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.932737+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:49.764228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931155+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:51.778135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.934783+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:12.456656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930447+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:37.007536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931810+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:37:13.894431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930978+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:24.340452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930794+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:46.370243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927908+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:00:58.002430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.929318+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:21:36.823652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928797+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:20.816863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928514+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:16.687263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930465+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:15.194288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931415+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:59:21.186206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928266+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:05:47.754354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.935935+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:44.302702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927674+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:57.800112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.933231+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:14.775803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.934428+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:24.838017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928672+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:24:43.832042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931413+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:04.253773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.929123+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:24:43.832042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935663+0000","last_change":"2023-10-09T06:27:52.935663+0000","last_active":"2023-10-09T06:27:52.935663+0000","last_peered":"2023-10-09T06:27:52.935663+0000","last_clean":"2023-10-09T06:27:52.935663+0000","last_became_active":"2023-10-09T06:27:52.935442+0000","last_became_peered":"2023-10-09T06:27:52.935442+0000","last_unstale":"2023-10-09T06:27:52.935663+0000","last_undegraded":"2023-10-09T06:27:52.935663+0000","last_fullsized":"2023-10-09T06:27:52.935663+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:17.467616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928148+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:39:52.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935490+0000","last_change":"2023-10-09T06:27:52.935490+0000","last_active":"2023-10-09T06:27:52.935490+0000","last_peered":"2023-10-09T06:27:52.935490+0000","last_clean":"2023-10-09T06:27:52.935490+0000","last_became_active":"2023-10-09T06:27:52.935253+0000","last_became_peered":"2023-10-09T06:27:52.935253+0000","last_unstale":"2023-10-09T06:27:52.935490+0000","last_undegraded":"2023-10-09T06:27:52.935490+0000","last_fullsized":"2023-10-09T06:27:52.935490+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:32.422666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928373+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:00:58.002430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935839+0000","last_change":"2023-10-09T06:27:52.935839+0000","last_active":"2023-10-09T06:27:52.935839+0000","last_peered":"2023-10-09T06:27:52.935839+0000","last_clean":"2023-10-09T06:27:52.935839+0000","last_became_active":"2023-10-09T06:27:52.935587+0000","last_became_peered":"2023-10-09T06:27:52.935587+0000","last_unstale":"2023-10-09T06:27:52.935839+0000","last_undegraded":"2023-10-09T06:27:52.935839+0000","last_fullsized":"2023-10-09T06:27:52.935839+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:08.477367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928383+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:20.308885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933698+0000","last_change":"2023-10-09T06:27:52.933698+0000","last_active":"2023-10-09T06:27:52.933698+0000","last_peered":"2023-10-09T06:27:52.933698+0000","last_clean":"2023-10-09T06:27:52.933698+0000","last_became_active":"2023-10-09T06:27:52.933257+0000","last_became_peered":"2023-10-09T06:27:52.933257+0000","last_unstale":"2023-10-09T06:27:52.933698+0000","last_undegraded":"2023-10-09T06:27:52.933698+0000","last_fullsized":"2023-10-09T06:27:52.933698+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:38.688820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927966+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:20.308885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.931663+0000","last_change":"2023-10-09T06:27:52.931663+0000","last_active":"2023-10-09T06:27:52.931663+0000","last_peered":"2023-10-09T06:27:52.931663+0000","last_clean":"2023-10-09T06:27:52.931663+0000","last_became_active":"2023-10-09T06:27:52.930668+0000","last_became_peered":"2023-10-09T06:27:52.930668+0000","last_unstale":"2023-10-09T06:27:52.931663+0000","last_undegraded":"2023-10-09T06:27:52.931663+0000","last_fullsized":"2023-10-09T06:27:52.931663+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:46.138879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930645+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:43.355926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.927612+0000","last_change":"2023-10-09T06:27:52.927612+0000","last_active":"2023-10-09T06:27:52.927612+0000","last_peered":"2023-10-09T06:27:52.927612+0000","last_clean":"2023-10-09T06:27:52.927612+0000","last_became_active":"2023-10-09T06:27:52.927332+0000","last_became_peered":"2023-10-09T06:27:52.927332+0000","last_unstale":"2023-10-09T06:27:52.927612+0000","last_undegraded":"2023-10-09T06:27:52.927612+0000","last_fullsized":"2023-10-09T06:27:52.927612+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:42.815093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.926781+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:30:57.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.936229+0000","last_change":"2023-10-09T06:27:52.936229+0000","last_active":"2023-10-09T06:27:52.936229+0000","last_peered":"2023-10-09T06:27:52.936229+0000","last_clean":"2023-10-09T06:27:52.936229+0000","last_became_active":"2023-10-09T06:27:52.936013+0000","last_became_peered":"2023-10-09T06:27:52.936013+0000","last_unstale":"2023-10-09T06:27:52.936229+0000","last_undegraded":"2023-10-09T06:27:52.936229+0000","last_fullsized":"2023-10-09T06:27:52.936229+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:56.795700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930743+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:09:41.794786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933160+0000","last_change":"2023-10-09T06:27:52.933160+0000","last_active":"2023-10-09T06:27:52.933160+0000","last_peered":"2023-10-09T06:27:52.933160+0000","last_clean":"2023-10-09T06:27:52.933160+0000","last_became_active":"2023-10-09T06:27:52.932999+0000","last_became_peered":"2023-10-09T06:27:52.932999+0000","last_unstale":"2023-10-09T06:27:52.933160+0000","last_undegraded":"2023-10-09T06:27:52.933160+0000","last_fullsized":"2023-10-09T06:27:52.933160+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:17.202095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.935596+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:18.206507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933145+0000","last_change":"2023-10-09T06:27:52.933145+0000","last_active":"2023-10-09T06:27:52.933145+0000","last_peered":"2023-10-09T06:27:52.933145+0000","last_clean":"2023-10-09T06:27:52.933145+0000","last_became_active":"2023-10-09T06:27:52.932892+0000","last_became_peered":"2023-10-09T06:27:52.932892+0000","last_unstale":"2023-10-09T06:27:52.933145+0000","last_undegraded":"2023-10-09T06:27:52.933145+0000","last_fullsized":"2023-10-09T06:27:52.933145+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:31.043111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927146+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:30:57.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.932076+0000","last_change":"2023-10-09T06:27:52.932076+0000","last_active":"2023-10-09T06:27:52.932076+0000","last_peered":"2023-10-09T06:27:52.932076+0000","last_clean":"2023-10-09T06:27:52.932076+0000","last_became_active":"2023-10-09T06:27:52.931652+0000","last_became_peered":"2023-10-09T06:27:52.931652+0000","last_unstale":"2023-10-09T06:27:52.932076+0000","last_undegraded":"2023-10-09T06:27:52.932076+0000","last_fullsized":"2023-10-09T06:27:52.932076+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:53.938974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928641+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:50.083326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.931973+0000","last_change":"2023-10-09T06:27:52.931973+0000","last_active":"2023-10-09T06:27:52.931973+0000","last_peered":"2023-10-09T06:27:52.931973+0000","last_clean":"2023-10-09T06:27:52.931973+0000","last_became_active":"2023-10-09T06:27:52.931677+0000","last_became_peered":"2023-10-09T06:27:52.931677+0000","last_unstale":"2023-10-09T06:27:52.931973+0000","last_undegraded":"2023-10-09T06:27:52.931973+0000","last_fullsized":"2023-10-09T06:27:52.931973+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:52:38.654562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928521+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:05:47.754354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933173+0000","last_change":"2023-10-09T06:27:52.933173+0000","last_active":"2023-10-09T06:27:52.933173+0000","last_peered":"2023-10-09T06:27:52.933173+0000","last_clean":"2023-10-09T06:27:52.933173+0000","last_became_active":"2023-10-09T06:27:52.932948+0000","last_became_peered":"2023-10-09T06:27:52.932948+0000","last_unstale":"2023-10-09T06:27:52.933173+0000","last_undegraded":"2023-10-09T06:27:52.933173+0000","last_fullsized":"2023-10-09T06:27:52.933173+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:01.012691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.934090+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:08:12.039272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.937327+0000","last_change":"2023-10-09T06:27:52.937327+0000","last_active":"2023-10-09T06:27:52.937327+0000","last_peered":"2023-10-09T06:27:52.937327+0000","last_clean":"2023-10-09T06:27:52.937327+0000","last_became_active":"2023-10-09T06:27:52.937095+0000","last_became_peered":"2023-10-09T06:27:52.937095+0000","last_unstale":"2023-10-09T06:27:52.937327+0000","last_undegraded":"2023-10-09T06:27:52.937327+0000","last_fullsized":"2023-10-09T06:27:52.937327+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:44.302806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.932105+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:16.441845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.931810+0000","last_change":"2023-10-09T06:27:52.931810+0000","last_active":"2023-10-09T06:27:52.931810+0000","last_peered":"2023-10-09T06:27:52.931810+0000","last_clean":"2023-10-09T06:27:52.931810+0000","last_became_active":"2023-10-09T06:27:52.931440+0000","last_became_peered":"2023-10-09T06:27:52.931440+0000","last_unstale":"2023-10-09T06:27:52.931810+0000","last_undegraded":"2023-10-09T06:27:52.931810+0000","last_fullsized":"2023-10-09T06:27:52.931810+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:32.963211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.926297+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:00.721099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935565+0000","last_change":"2023-10-09T06:27:52.935565+0000","last_active":"2023-10-09T06:27:52.935565+0000","last_peered":"2023-10-09T06:27:52.935565+0000","last_clean":"2023-10-09T06:27:52.935565+0000","last_became_active":"2023-10-09T06:27:52.935254+0000","last_became_peered":"2023-10-09T06:27:52.935254+0000","last_unstale":"2023-10-09T06:27:52.935565+0000","last_undegraded":"2023-10-09T06:27:52.935565+0000","last_fullsized":"2023-10-09T06:27:52.935565+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:32.422666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.926412+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:15.353816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.931092+0000","last_change":"2023-10-09T06:27:52.931092+0000","last_active":"2023-10-09T06:27:52.931092+0000","last_peered":"2023-10-09T06:27:52.931092+0000","last_clean":"2023-10-09T06:27:52.931092+0000","last_became_active":"2023-10-09T06:27:52.930803+0000","last_became_peered":"2023-10-09T06:27:52.930803+0000","last_unstale":"2023-10-09T06:27:52.931092+0000","last_undegraded":"2023-10-09T06:27:52.931092+0000","last_fullsized":"2023-10-09T06:27:52.931092+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:15.437434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.926007+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:15.353816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.932657+0000","last_change":"2023-10-09T06:27:52.932657+0000","last_active":"2023-10-09T06:27:52.932657+0000","last_peered":"2023-10-09T06:27:52.932657+0000","last_clean":"2023-10-09T06:27:52.932657+0000","last_became_active":"2023-10-09T06:27:52.932402+0000","last_became_peered":"2023-10-09T06:27:52.932402+0000","last_unstale":"2023-10-09T06:27:52.932657+0000","last_undegraded":"2023-10-09T06:27:52.932657+0000","last_fullsized":"2023-10-09T06:27:52.932657+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:51.366885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927790+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:34.259293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935532+0000","last_change":"2023-10-09T06:27:52.935532+0000","last_active":"2023-10-09T06:27:52.935532+0000","last_peered":"2023-10-09T06:27:52.935532+0000","last_clean":"2023-10-09T06:27:52.935532+0000","last_became_active":"2023-10-09T06:27:52.935305+0000","last_became_peered":"2023-10-09T06:27:52.935305+0000","last_unstale":"2023-10-09T06:27:52.935532+0000","last_undegraded":"2023-10-09T06:27:52.935532+0000","last_fullsized":"2023-10-09T06:27:52.935532+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:30:56.562227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.932614+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:52:39.658973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.932310+0000","last_change":"2023-10-09T06:27:52.932310+0000","last_active":"2023-10-09T06:27:52.932310+0000","last_peered":"2023-10-09T06:27:52.932310+0000","last_clean":"2023-10-09T06:27:52.932310+0000","last_became_active":"2023-10-09T06:27:52.932078+0000","last_became_peered":"2023-10-09T06:27:52.932078+0000","last_unstale":"2023-10-09T06:27:52.932310+0000","last_undegraded":"2023-10-09T06:27:52.932310+0000","last_fullsized":"2023-10-09T06:27:52.932310+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:41.167438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.932829+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:23:35.364984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.934337+0000","last_change":"2023-10-09T06:27:52.934337+0000","last_active":"2023-10-09T06:27:52.934337+0000","last_peered":"2023-10-09T06:27:52.934337+0000","last_clean":"2023-10-09T06:27:52.934337+0000","last_became_active":"2023-10-09T06:27:52.934093+0000","last_became_peered":"2023-10-09T06:27:52.934093+0000","last_unstale":"2023-10-09T06:27:52.934337+0000","last_undegraded":"2023-10-09T06:27:52.934337+0000","last_fullsized":"2023-10-09T06:27:52.934337+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:01.012691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.933009+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:18.472028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933464+0000","last_change":"2023-10-09T06:27:52.933464+0000","last_active":"2023-10-09T06:27:52.933464+0000","last_peered":"2023-10-09T06:27:52.933464+0000","last_clean":"2023-10-09T06:27:52.933464+0000","last_became_active":"2023-10-09T06:27:52.933028+0000","last_became_peered":"2023-10-09T06:27:52.933028+0000","last_unstale":"2023-10-09T06:27:52.933464+0000","last_undegraded":"2023-10-09T06:27:52.933464+0000","last_fullsized":"2023-10-09T06:27:52.933464+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:17.467616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.932248+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:42.171850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.928446+0000","last_change":"2023-10-09T06:27:52.928446+0000","last_active":"2023-10-09T06:27:52.928446+0000","last_peered":"2023-10-09T06:27:52.928446+0000","last_clean":"2023-10-09T06:27:52.928446+0000","last_became_active":"2023-10-09T06:27:52.928210+0000","last_became_peered":"2023-10-09T06:27:52.928210+0000","last_unstale":"2023-10-09T06:27:52.928446+0000","last_undegraded":"2023-10-09T06:27:52.928446+0000","last_fullsized":"2023-10-09T06:27:52.928446+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:34.395434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927872+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:43.819504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.932636+0000","last_change":"2023-10-09T06:27:52.932636+0000","last_active":"2023-10-09T06:27:52.932636+0000","last_peered":"2023-10-09T06:27:52.932636+0000","last_clean":"2023-10-09T06:27:52.932636+0000","last_became_active":"2023-10-09T06:27:52.932394+0000","last_became_peered":"2023-10-09T06:27:52.932394+0000","last_unstale":"2023-10-09T06:27:52.932636+0000","last_undegraded":"2023-10-09T06:27:52.932636+0000","last_fullsized":"2023-10-09T06:27:52.932636+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:12.418152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930991+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:32:48.606592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.936108+0000","last_change":"2023-10-09T06:27:52.936108+0000","last_active":"2023-10-09T06:27:52.936108+0000","last_peered":"2023-10-09T06:27:52.936108+0000","last_clean":"2023-10-09T06:27:52.936108+0000","last_became_active":"2023-10-09T06:27:52.933621+0000","last_became_peered":"2023-10-09T06:27:52.933621+0000","last_unstale":"2023-10-09T06:27:52.936108+0000","last_undegraded":"2023-10-09T06:27:52.936108+0000","last_fullsized":"2023-10-09T06:27:52.936108+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:19.208277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.934106+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:49:38.474462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.936079+0000","last_change":"2023-10-09T06:27:52.936079+0000","last_active":"2023-10-09T06:27:52.936079+0000","last_peered":"2023-10-09T06:27:52.936079+0000","last_clean":"2023-10-09T06:27:52.936079+0000","last_became_active":"2023-10-09T06:27:52.935872+0000","last_became_peered":"2023-10-09T06:27:52.935872+0000","last_unstale":"2023-10-09T06:27:52.936079+0000","last_undegraded":"2023-10-09T06:27:52.936079+0000","last_fullsized":"2023-10-09T06:27:52.936079+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:53.273517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930758+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:54:03.907542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.936040+0000","last_change":"2023-10-09T06:27:52.936040+0000","last_active":"2023-10-09T06:27:52.936040+0000","last_peered":"2023-10-09T06:27:52.936040+0000","last_clean":"2023-10-09T06:27:52.936040+0000","last_became_active":"2023-10-09T06:27:52.935583+0000","last_became_peered":"2023-10-09T06:27:52.935583+0000","last_unstale":"2023-10-09T06:27:52.936040+0000","last_undegraded":"2023-10-09T06:27:52.936040+0000","last_fullsized":"2023-10-09T06:27:52.936040+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:11.452245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930815+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.029150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.934153+0000","last_change":"2023-10-09T06:27:52.934153+0000","last_active":"2023-10-09T06:27:52.934153+0000","last_peered":"2023-10-09T06:27:52.934153+0000","last_clean":"2023-10-09T06:27:52.934153+0000","last_became_active":"2023-10-09T06:27:52.933922+0000","last_became_peered":"2023-10-09T06:27:52.933922+0000","last_unstale":"2023-10-09T06:27:52.934153+0000","last_undegraded":"2023-10-09T06:27:52.934153+0000","last_fullsized":"2023-10-09T06:27:52.934153+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:02.855389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928080+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:34.259293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933533+0000","last_change":"2023-10-09T06:27:52.933533+0000","last_active":"2023-10-09T06:27:52.933533+0000","last_peered":"2023-10-09T06:27:52.933533+0000","last_clean":"2023-10-09T06:27:52.933533+0000","last_became_active":"2023-10-09T06:27:52.932880+0000","last_became_peered":"2023-10-09T06:27:52.932880+0000","last_unstale":"2023-10-09T06:27:52.933533+0000","last_undegraded":"2023-10-09T06:27:52.933533+0000","last_fullsized":"2023-10-09T06:27:52.933533+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:06.132532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.926776+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:30.199496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933739+0000","last_change":"2023-10-09T06:27:52.933739+0000","last_active":"2023-10-09T06:27:52.933739+0000","last_peered":"2023-10-09T06:27:52.933739+0000","last_clean":"2023-10-09T06:27:52.933739+0000","last_became_active":"2023-10-09T06:27:52.933302+0000","last_became_peered":"2023-10-09T06:27:52.933302+0000","last_unstale":"2023-10-09T06:27:52.933739+0000","last_undegraded":"2023-10-09T06:27:52.933739+0000","last_fullsized":"2023-10-09T06:27:52.933739+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:03.249361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928764+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:50.083326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935717+0000","last_change":"2023-10-09T06:27:52.935717+0000","last_active":"2023-10-09T06:27:52.935717+0000","last_peered":"2023-10-09T06:27:52.935717+0000","last_clean":"2023-10-09T06:27:52.935717+0000","last_became_active":"2023-10-09T06:27:52.935414+0000","last_became_peered":"2023-10-09T06:27:52.935414+0000","last_unstale":"2023-10-09T06:27:52.935717+0000","last_undegraded":"2023-10-09T06:27:52.935717+0000","last_fullsized":"2023-10-09T06:27:52.935717+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:40.048060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931748+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:06.413749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935326+0000","last_change":"2023-10-09T06:27:52.935326+0000","last_active":"2023-10-09T06:27:52.935326+0000","last_peered":"2023-10-09T06:27:52.935326+0000","last_clean":"2023-10-09T06:27:52.935326+0000","last_became_active":"2023-10-09T06:27:52.935101+0000","last_became_peered":"2023-10-09T06:27:52.935101+0000","last_unstale":"2023-10-09T06:27:52.935326+0000","last_undegraded":"2023-10-09T06:27:52.935326+0000","last_fullsized":"2023-10-09T06:27:52.935326+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:59.555036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927893+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:52.041346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.932778+0000","last_change":"2023-10-09T06:27:52.932778+0000","last_active":"2023-10-09T06:27:52.932778+0000","last_peered":"2023-10-09T06:27:52.932778+0000","last_clean":"2023-10-09T06:27:52.932778+0000","last_became_active":"2023-10-09T06:27:52.932545+0000","last_became_peered":"2023-10-09T06:27:52.932545+0000","last_unstale":"2023-10-09T06:27:52.932778+0000","last_undegraded":"2023-10-09T06:27:52.932778+0000","last_fullsized":"2023-10-09T06:27:52.932778+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:53.938974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":274,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-09T06:27:51.920741+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:27:51.920741+0000","last_peered":"2023-10-09T06:27:51.920741+0000","last_clean":"2023-10-09T06:27:51.920741+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:27:51.920741+0000","last_undegraded":"2023-10-09T06:27:51.920741+0000","last_fullsized":"2023-10-09T06:27:51.920741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1383,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193929,"statfs":{"total":200000000,"available":198583533,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53900000000000003,"15min":0.51100000000000001},"min":{"1min":0.32900000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79600000000000004,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.52700000000000002},"min":{"1min":0.33500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81100000000000005,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.502}]},{"osd":1,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.50600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64200000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54200000000000004,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76300000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.48399999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81899999999999995,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59199999999999997,"15min":0.54100000000000004},"min":{"1min":0.33700000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73999999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.61399999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.65000000000000002,"15min":0.57999999999999996},"min":{"1min":0.373,"5min":0.318,"15min":0.318},"max":{"1min":0.80900000000000005,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.64900000000000002,"15min":0.56699999999999995},"min":{"1min":0.435,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77400000000000002,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.59699999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45800000000000002,"15min":0.46999999999999997},"min":{"1min":0.27700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.64100000000000001,"5min":0.872,"15min":0.872},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77800000000000002,"5min":0.79800000000000004,"15min":0.86099999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48599999999999999,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.255,"15min":0.255},"max":{"1min":0.71799999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73999999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83599999999999997,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.74299999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.79900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194505,"statfs":{"total":200000000,"available":199173901,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.74399999999999999},"min":{"1min":0.35299999999999998,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.71699999999999997,"5min":0.77100000000000002,"15min":7.0960000000000001},"last":0.502},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54600000000000004,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.133},"last":0.46200000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":1.155},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.317},"max":{"1min":0.75600000000000001,"5min":0.79300000000000004,"15min":1.1459999999999999},"last":0.70399999999999996}]},{"osd":2,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.86499999999999999,"15min":1.2290000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55300000000000005,"15min":0.75800000000000001},"min":{"1min":0.378,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":7.1299999999999999},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.59399999999999997},"min":{"1min":0.44500000000000001,"5min":0.39100000000000001,"15min":0.34499999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":1.337},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73699999999999999,"5min":0.90400000000000003,"15min":1.206},"last":0.755}]},{"osd":4,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.498,"15min":0.497},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.52200000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.33300000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.65500000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.61099999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.315},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194505,"statfs":{"total":200000000,"available":199173901,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34999999999999998,"15min":0.36599999999999999},"min":{"1min":0.223,"5min":0.219,"15min":0.219},"max":{"1min":0.41699999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.33800000000000002},"min":{"1min":0.247,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46899999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.35199999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.35099999999999998,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.46600000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.307},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40799999999999997,"15min":0.38800000000000001},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.48599999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.36699999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45200000000000001,"15min":0.41699999999999998},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.29199999999999998},"max":{"1min":0.52800000000000002,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.443,"15min":0.42899999999999999},"min":{"1min":0.28999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.504,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59699999999999998,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.83199999999999996,"5min":1.097,"15min":1.097},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60999999999999999,"15min":0.79100000000000004},"min":{"1min":0.42699999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76400000000000001,"5min":1.0309999999999999,"15min":5.5270000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.47699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":1.125,"15min":1.125},"last":0.624},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64400000000000002,"15min":0.66300000000000003},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":1.175,"15min":1.4219999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65200000000000002,"15min":0.622},"min":{"1min":0.45800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82599999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.46600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92300000000000004,"5min":1.125,"15min":1.49},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83599999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.67200000000000004,"15min":0.65600000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78600000000000003,"5min":1.052,"15min":1.052},"last":0.503}]}]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1383,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193929,"statfs":{"total":200000000,"available":198583533,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.35599999999999998,"15min":0.40200000000000002},"min":{"1min":0.216,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51600000000000001,"5min":0.65800000000000003,"15min":1.226},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.41599999999999998},"min":{"1min":0.26900000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.64300000000000002,"5min":0.71899999999999997,"15min":1.131},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38500000000000001,"15min":0.88200000000000001},"min":{"1min":0.28299999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.44500000000000001,"5min":0.64400000000000002,"15min":12.929},"last":0.313},{"interface":"front","average":{"1min":0.372,"5min":0.41599999999999998,"15min":0.45100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53600000000000003,"5min":0.70899999999999996,"15min":1.1599999999999999},"last":0.32800000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44,"15min":0.46700000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58499999999999996,"5min":0.76100000000000001,"15min":1.1859999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.441,"15min":0.47899999999999998},"min":{"1min":0.36699999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55800000000000005,"5min":0.69199999999999995,"15min":1.3089999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76000000000000001,"5min":0.86299999999999999,"15min":0.93200000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59899999999999998,"15min":0.64300000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41099999999999998},"max":{"1min":0.754,"5min":0.97099999999999997,"15min":1.335},"last":0.57499999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.61399999999999999},"min":{"1min":0.40799999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77800000000000002,"5min":0.90700000000000003,"15min":1.0580000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.66900000000000004,"5min":0.82199999999999995,"15min":0.999},"last":0.55600000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59199999999999997,"15min":0.61299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78600000000000003,"5min":0.83099999999999996,"15min":0.998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.82899999999999996,"5min":0.93899999999999995,"15min":1.2849999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40400000000000003},"max":{"1min":0.80100000000000005,"5min":0.92800000000000005,"15min":1.262},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64400000000000002,"15min":0.66100000000000003},"min":{"1min":0.48299999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76100000000000001,"5min":0.95599999999999996,"15min":1.103},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194505,"statfs":{"total":200000000,"available":199173901,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.35499999999999998,"15min":0.78600000000000003},"min":{"1min":0.24199999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.46700000000000003,"5min":0.79000000000000004,"15min":14.981999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38400000000000001,"15min":0.62},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.59699999999999998,"5min":0.64100000000000001,"15min":9.1600000000000001},"last":0.26600000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36899999999999999,"15min":0.58399999999999996},"min":{"1min":0.28199999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.55400000000000005,"5min":0.73099999999999998,"15min":8.4930000000000003},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.42599999999999999,"15min":0.65200000000000002},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":0.53500000000000003,"5min":0.91400000000000003,"15min":9.0239999999999991},"last":0.34300000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44800000000000001,"15min":0.65600000000000003},"min":{"1min":0.33000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61599999999999999,"5min":0.84299999999999997,"15min":8.5190000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.44700000000000001,"15min":0.85099999999999998},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.56100000000000005,"5min":0.87,"15min":15.007999999999999},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63700000000000001,"15min":1.052},"min":{"1min":0.41399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93799999999999994,"5min":0.95299999999999996,"15min":14.917999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65400000000000003,"15min":0.879},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90300000000000002,"5min":1.1160000000000001,"15min":8.9930000000000003},"last":0.69099999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65200000000000002,"15min":0.85799999999999998},"min":{"1min":0.439,"5min":0.432,"15min":0.35899999999999999},"max":{"1min":0.94599999999999995,"5min":0.96299999999999997,"15min":8.9610000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.86299999999999999},"min":{"1min":0.45100000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.03,"5min":1.03,"15min":8.3919999999999995},"last":0.56200000000000006}]},{"osd":6,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64900000000000002,"15min":0.84799999999999998},"min":{"1min":0.498,"5min":0.42499999999999999,"15min":0.39900000000000002},"max":{"1min":0.97299999999999998,"5min":1.026,"15min":8.4339999999999993},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66200000000000003,"15min":1.054},"min":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.028,"15min":14.954000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64300000000000002,"15min":0.84399999999999997},"min":{"1min":0.42599999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":8.9160000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65500000000000003,"15min":0.85899999999999999},"min":{"1min":0.46800000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":1.0609999999999999,"15min":8.4640000000000004},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194499,"statfs":{"total":200000000,"available":199167638,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58599999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41699999999999998,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.498}]},{"osd":1,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35599999999999998,"15min":0.32800000000000001},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.215},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.40000000000000002,"15min":0.35699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.51500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38800000000000001,"15min":0.36499999999999999},"min":{"1min":0.27000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46899999999999997,"15min":0.42499999999999999},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54100000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.375},"max":{"1min":0.77700000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.434,"5min":0.372,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.84799999999999998,"15min":0.91500000000000004},"last":0.76200000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64200000000000002,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.84099999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.85499999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64000000000000001,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.38800000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.75},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63600000000000001,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.91700000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.86899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194499,"statfs":{"total":200000000,"available":199167638,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.53000000000000003,"15min":0.498},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.29299999999999998},"max":{"1min":0.66400000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.318},"max":{"1min":0.63100000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.441}]},{"osd":1,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53400000000000003,"15min":0.51400000000000001},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.254},"max":{"1min":0.60399999999999998,"5min":0.74399999999999999,"15min":0.77000000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.69599999999999995},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.34499999999999997},"max":{"1min":0.66700000000000004,"5min":1.5680000000000001,"15min":4.3250000000000002},"last":0.60899999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.68600000000000005},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.67800000000000005,"5min":1.7110000000000001,"15min":4.7320000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":1.03},"min":{"1min":0.41299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78200000000000003,"5min":0.80200000000000005,"15min":11.715},"last":0.51100000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56799999999999995,"15min":0.52600000000000002},"min":{"1min":0.38900000000000001,"5min":0.35199999999999998,"15min":0.34899999999999998},"max":{"1min":0.68400000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.496},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.44700000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72399999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.49299999999999999},"min":{"1min":0.27200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65200000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.502,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65900000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.38300000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.629},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.66300000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.754,"5min":0.879,"15min":0.879},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81200000000000006,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.73799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194499,"statfs":{"total":200000000,"available":199167638,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73699999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55800000000000005,"15min":0.52400000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35399999999999998},"max":{"1min":0.78500000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63100000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.752,"5min":1.093,"15min":1.093},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.52300000000000002},"min":{"1min":0.379,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81699999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58099999999999996}]},{"osd":2,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57299999999999995,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70899999999999996,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59999999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.55800000000000005},"min":{"1min":0.45800000000000002,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.745,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.58799999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76600000000000001,"5min":1.071,"15min":1.071},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71599999999999997,"5min":0.79000000000000004,"15min":0.84399999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.746,"5min":0.76900000000000002,"15min":0.81000000000000005},"last":0.34799999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49299999999999999,"15min":0.53300000000000003},"min":{"1min":0.36099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73299999999999998,"5min":0.85199999999999998,"15min":1.0680000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.67500000000000004,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.433}]},{"osd":7,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":0.78200000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76600000000000001,"5min":0.84399999999999997,"15min":1.0269999999999999},"last":0.45800000000000002}]}]}],"pool_statfs":[]}} 2023-10-09T06:27:58.039 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:27:58.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.189+0000 7faeae635700 1 Processor -- start 2023-10-09T06:27:58.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.190+0000 7faeae635700 1 -- start start 2023-10-09T06:27:58.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.190+0000 7faeae635700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faea8152010 0x7faea815b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.190+0000 7faeae635700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faea81523e0 0x7faea806c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.190+0000 7faeae635700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faea8158e50 0x7faea80cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.190+0000 7faeae635700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea806c010 con 0x7faea8152010 2023-10-09T06:27:58.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.190+0000 7faeae635700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea806bd10 con 0x7faea81523e0 2023-10-09T06:27:58.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.190+0000 7faeae635700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea815c060 con 0x7faea8158e50 2023-10-09T06:27:58.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.190+0000 7faea7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faea8152010 0x7faea815b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faea7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faea8152010 0x7faea815b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43816/0 (socket says 172.21.15.31:43816) 2023-10-09T06:27:58.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faea7fff700 1 -- 172.21.15.31:0/531183674 learned_addr learned my addr 172.21.15.31:0/531183674 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faeacbd2700 1 --2- 172.21.15.31:0/531183674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faea8158e50 0x7faea80cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faea77fe700 1 --2- 172.21.15.31:0/531183674 >> v2:172.21.15.158:3300/0 conn(0x7faea81523e0 0x7faea806c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faea7fff700 1 -- 172.21.15.31:0/531183674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faea8158e50 msgr2=0x7faea80cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faea7fff700 1 --2- 172.21.15.31:0/531183674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faea8158e50 0x7faea80cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faea7fff700 1 -- 172.21.15.31:0/531183674 >> v2:172.21.15.158:3300/0 conn(0x7faea81523e0 msgr2=0x7faea806c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faea7fff700 1 --2- 172.21.15.31:0/531183674 >> v2:172.21.15.158:3300/0 conn(0x7faea81523e0 0x7faea806c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faea7fff700 1 -- 172.21.15.31:0/531183674 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea815c340 con 0x7faea8152010 2023-10-09T06:27:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faea77fe700 1 --2- 172.21.15.31:0/531183674 >> v2:172.21.15.158:3300/0 conn(0x7faea81523e0 0x7faea806c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faeacbd2700 1 --2- 172.21.15.31:0/531183674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faea8158e50 0x7faea80cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:27:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faea7fff700 1 --2- 172.21.15.31:0/531183674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faea8152010 0x7faea815b810 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7faea80ceae0 tx=0x7fae98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29961ba4d589d901 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faea6ffd700 1 -- 172.21.15.31:0/531183674 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9800b860 con 0x7faea8152010 2023-10-09T06:27:58.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faea6ffd700 1 -- 172.21.15.31:0/531183674 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9800b9c0 con 0x7faea8152010 2023-10-09T06:27:58.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.191+0000 7faea6ffd700 1 -- 172.21.15.31:0/531183674 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9800bd60 con 0x7faea8152010 2023-10-09T06:27:58.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.192+0000 7faeae635700 1 -- 172.21.15.31:0/531183674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faea8152010 msgr2=0x7faea815b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.192+0000 7faeae635700 1 --2- 172.21.15.31:0/531183674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faea8152010 0x7faea815b810 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7faea80ceae0 tx=0x7fae98009250 comp rx=0 tx=0).stop 2023-10-09T06:27:58.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.192+0000 7faeae635700 1 -- 172.21.15.31:0/531183674 shutdown_connections 2023-10-09T06:27:58.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.192+0000 7faeae635700 1 --2- 172.21.15.31:0/531183674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faea8158e50 0x7faea80cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.192+0000 7faeae635700 1 --2- 172.21.15.31:0/531183674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faea8152010 0x7faea815b810 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.192+0000 7faeae635700 1 --2- 172.21.15.31:0/531183674 >> v2:172.21.15.158:3300/0 conn(0x7faea81523e0 0x7faea806c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.192+0000 7faeae635700 1 -- 172.21.15.31:0/531183674 >> 172.21.15.31:0/531183674 conn(0x7faea8069870 msgr2=0x7faea8069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:58.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.192+0000 7faeae635700 1 -- 172.21.15.31:0/531183674 shutdown_connections 2023-10-09T06:27:58.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.192+0000 7faeae635700 1 -- 172.21.15.31:0/531183674 wait complete. 2023-10-09T06:27:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.193+0000 7faeae635700 1 Processor -- start 2023-10-09T06:27:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.193+0000 7faeae635700 1 -- start start 2023-10-09T06:27:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faeae635700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faea8152010 0x7faea814fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faeae635700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faea81523e0 0x7faea815d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faeae635700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faea8158e50 0x7faea815dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faeae635700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea815b010 con 0x7faea81523e0 2023-10-09T06:27:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faeae635700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea815a400 con 0x7faea8152010 2023-10-09T06:27:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faeae635700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea815a6e0 con 0x7faea8158e50 2023-10-09T06:27:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faea77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faea81523e0 0x7faea815d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faea77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faea81523e0 0x7faea815d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43820/0 (socket says 172.21.15.31:43820) 2023-10-09T06:27:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faea77fe700 1 -- 172.21.15.31:0/3969138715 learned_addr learned my addr 172.21.15.31:0/3969138715 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faeacbd2700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faea8158e50 0x7faea815dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faea7fff700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faea8152010 0x7faea814fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faea77fe700 1 -- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faea8158e50 msgr2=0x7faea815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faea77fe700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faea8158e50 0x7faea815dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faea77fe700 1 -- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faea8152010 msgr2=0x7faea814fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faea77fe700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faea8152010 0x7faea814fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.194+0000 7faea77fe700 1 -- 172.21.15.31:0/3969138715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae980094f0 con 0x7faea81523e0 2023-10-09T06:27:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.195+0000 7faea77fe700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faea81523e0 0x7faea815d830 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00c880 tx=0x7fae9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.195+0000 7fae8ffff700 1 -- 172.21.15.31:0/3969138715 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c011600 con 0x7faea81523e0 2023-10-09T06:27:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.195+0000 7fae8ffff700 1 -- 172.21.15.31:0/3969138715 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c011760 con 0x7faea81523e0 2023-10-09T06:27:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.195+0000 7faeae635700 1 -- 172.21.15.31:0/3969138715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea815a9c0 con 0x7faea81523e0 2023-10-09T06:27:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.195+0000 7fae8ffff700 1 -- 172.21.15.31:0/3969138715 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c011ae0 con 0x7faea81523e0 2023-10-09T06:27:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.195+0000 7faeae635700 1 -- 172.21.15.31:0/3969138715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea81502c0 con 0x7faea81523e0 2023-10-09T06:27:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.196+0000 7faeae635700 1 -- 172.21.15.31:0/3969138715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea815b180 con 0x7faea81523e0 2023-10-09T06:27:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.196+0000 7fae8ffff700 1 -- 172.21.15.31:0/3969138715 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae9c0073e0 con 0x7faea81523e0 2023-10-09T06:27:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.197+0000 7fae8ffff700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fae94066f30 0x7fae940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.197+0000 7fae8ffff700 1 -- 172.21.15.31:0/3969138715 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fae9c084520 con 0x7faea81523e0 2023-10-09T06:27:58.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.197+0000 7faea7fff700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fae94066f30 0x7fae940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.197+0000 7faea7fff700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fae94066f30 0x7fae940693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faea80ceae0 tx=0x7fae98017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:58.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.201+0000 7fae8ffff700 1 -- 172.21.15.31:0/3969138715 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae9c055220 con 0x7faea81523e0 2023-10-09T06:27:58.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.389+0000 7faeae635700 1 -- 172.21.15.31:0/3969138715 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faea804c3c0 con 0x7fae94066f30 2023-10-09T06:27:58.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.398+0000 7fae8ffff700 1 -- 172.21.15.31:0/3969138715 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282519 (secure 0 0 0) 0x7faea804c3c0 con 0x7fae94066f30 2023-10-09T06:27:58.402 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:58.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.401+0000 7faeae635700 1 -- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fae94066f30 msgr2=0x7fae940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.401+0000 7faeae635700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fae94066f30 0x7fae940693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faea80ceae0 tx=0x7fae98017000 comp rx=0 tx=0).stop 2023-10-09T06:27:58.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.401+0000 7faeae635700 1 -- 172.21.15.31:0/3969138715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faea81523e0 msgr2=0x7faea815d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.401+0000 7faeae635700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faea81523e0 0x7faea815d830 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00c880 tx=0x7fae9c008040 comp rx=0 tx=0).stop 2023-10-09T06:27:58.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.401+0000 7faeae635700 1 -- 172.21.15.31:0/3969138715 shutdown_connections 2023-10-09T06:27:58.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.401+0000 7faeae635700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fae94066f30 0x7fae940693e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.401+0000 7faeae635700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faea8158e50 0x7faea815dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.401+0000 7faeae635700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faea8152010 0x7faea814fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.401+0000 7faeae635700 1 --2- 172.21.15.31:0/3969138715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faea81523e0 0x7faea815d830 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.401+0000 7faeae635700 1 -- 172.21.15.31:0/3969138715 >> 172.21.15.31:0/3969138715 conn(0x7faea8069870 msgr2=0x7faea8158250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:58.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.401+0000 7faeae635700 1 -- 172.21.15.31:0/3969138715 shutdown_connections 2023-10-09T06:27:58.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.401+0000 7faeae635700 1 -- 172.21.15.31:0/3969138715 wait complete. 2023-10-09T06:27:58.405 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:27:58.414 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2023-10-09T06:27:56.619214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554874,"statfs":{"total":1600000000,"available":1592191683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.700337"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.936760+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:39.693231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931172+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:07.101614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.929368+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.029150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.934409+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:59:10.891187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.929138+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:37.007536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.932761+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:54.277929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931037+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:17:02.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928913+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:43.355926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927147+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:57.800112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931770+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:44.999564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.929835+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:35:17.223115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.926677+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:30.199496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.932737+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:49.764228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931155+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:51.778135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.934783+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:12.456656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930447+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:37.007536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931810+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:37:13.894431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930978+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:24.340452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930794+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:46.370243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927908+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:00:58.002430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.929318+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:21:36.823652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928797+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:20.816863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928514+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:16.687263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930465+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:15.194288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931415+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:59:21.186206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928266+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:05:47.754354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.935935+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:44.302702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927674+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:57.800112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.933231+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:14.775803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.934428+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:24.838017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928672+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:24:43.832042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931413+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:04.253773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.929123+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:24:43.832042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935663+0000","last_change":"2023-10-09T06:27:52.935663+0000","last_active":"2023-10-09T06:27:52.935663+0000","last_peered":"2023-10-09T06:27:52.935663+0000","last_clean":"2023-10-09T06:27:52.935663+0000","last_became_active":"2023-10-09T06:27:52.935442+0000","last_became_peered":"2023-10-09T06:27:52.935442+0000","last_unstale":"2023-10-09T06:27:52.935663+0000","last_undegraded":"2023-10-09T06:27:52.935663+0000","last_fullsized":"2023-10-09T06:27:52.935663+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:17.467616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928148+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:39:52.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935490+0000","last_change":"2023-10-09T06:27:52.935490+0000","last_active":"2023-10-09T06:27:52.935490+0000","last_peered":"2023-10-09T06:27:52.935490+0000","last_clean":"2023-10-09T06:27:52.935490+0000","last_became_active":"2023-10-09T06:27:52.935253+0000","last_became_peered":"2023-10-09T06:27:52.935253+0000","last_unstale":"2023-10-09T06:27:52.935490+0000","last_undegraded":"2023-10-09T06:27:52.935490+0000","last_fullsized":"2023-10-09T06:27:52.935490+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:32.422666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928373+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:00:58.002430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935839+0000","last_change":"2023-10-09T06:27:52.935839+0000","last_active":"2023-10-09T06:27:52.935839+0000","last_peered":"2023-10-09T06:27:52.935839+0000","last_clean":"2023-10-09T06:27:52.935839+0000","last_became_active":"2023-10-09T06:27:52.935587+0000","last_became_peered":"2023-10-09T06:27:52.935587+0000","last_unstale":"2023-10-09T06:27:52.935839+0000","last_undegraded":"2023-10-09T06:27:52.935839+0000","last_fullsized":"2023-10-09T06:27:52.935839+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:08.477367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928383+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:20.308885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933698+0000","last_change":"2023-10-09T06:27:52.933698+0000","last_active":"2023-10-09T06:27:52.933698+0000","last_peered":"2023-10-09T06:27:52.933698+0000","last_clean":"2023-10-09T06:27:52.933698+0000","last_became_active":"2023-10-09T06:27:52.933257+0000","last_became_peered":"2023-10-09T06:27:52.933257+0000","last_unstale":"2023-10-09T06:27:52.933698+0000","last_undegraded":"2023-10-09T06:27:52.933698+0000","last_fullsized":"2023-10-09T06:27:52.933698+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:38.688820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927966+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:20.308885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.931663+0000","last_change":"2023-10-09T06:27:52.931663+0000","last_active":"2023-10-09T06:27:52.931663+0000","last_peered":"2023-10-09T06:27:52.931663+0000","last_clean":"2023-10-09T06:27:52.931663+0000","last_became_active":"2023-10-09T06:27:52.930668+0000","last_became_peered":"2023-10-09T06:27:52.930668+0000","last_unstale":"2023-10-09T06:27:52.931663+0000","last_undegraded":"2023-10-09T06:27:52.931663+0000","last_fullsized":"2023-10-09T06:27:52.931663+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:46.138879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930645+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:43.355926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.927612+0000","last_change":"2023-10-09T06:27:52.927612+0000","last_active":"2023-10-09T06:27:52.927612+0000","last_peered":"2023-10-09T06:27:52.927612+0000","last_clean":"2023-10-09T06:27:52.927612+0000","last_became_active":"2023-10-09T06:27:52.927332+0000","last_became_peered":"2023-10-09T06:27:52.927332+0000","last_unstale":"2023-10-09T06:27:52.927612+0000","last_undegraded":"2023-10-09T06:27:52.927612+0000","last_fullsized":"2023-10-09T06:27:52.927612+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:42.815093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.926781+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:30:57.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.936229+0000","last_change":"2023-10-09T06:27:52.936229+0000","last_active":"2023-10-09T06:27:52.936229+0000","last_peered":"2023-10-09T06:27:52.936229+0000","last_clean":"2023-10-09T06:27:52.936229+0000","last_became_active":"2023-10-09T06:27:52.936013+0000","last_became_peered":"2023-10-09T06:27:52.936013+0000","last_unstale":"2023-10-09T06:27:52.936229+0000","last_undegraded":"2023-10-09T06:27:52.936229+0000","last_fullsized":"2023-10-09T06:27:52.936229+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:56.795700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930743+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:09:41.794786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933160+0000","last_change":"2023-10-09T06:27:52.933160+0000","last_active":"2023-10-09T06:27:52.933160+0000","last_peered":"2023-10-09T06:27:52.933160+0000","last_clean":"2023-10-09T06:27:52.933160+0000","last_became_active":"2023-10-09T06:27:52.932999+0000","last_became_peered":"2023-10-09T06:27:52.932999+0000","last_unstale":"2023-10-09T06:27:52.933160+0000","last_undegraded":"2023-10-09T06:27:52.933160+0000","last_fullsized":"2023-10-09T06:27:52.933160+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:17.202095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.935596+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:18.206507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933145+0000","last_change":"2023-10-09T06:27:52.933145+0000","last_active":"2023-10-09T06:27:52.933145+0000","last_peered":"2023-10-09T06:27:52.933145+0000","last_clean":"2023-10-09T06:27:52.933145+0000","last_became_active":"2023-10-09T06:27:52.932892+0000","last_became_peered":"2023-10-09T06:27:52.932892+0000","last_unstale":"2023-10-09T06:27:52.933145+0000","last_undegraded":"2023-10-09T06:27:52.933145+0000","last_fullsized":"2023-10-09T06:27:52.933145+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:31.043111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927146+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:30:57.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.932076+0000","last_change":"2023-10-09T06:27:52.932076+0000","last_active":"2023-10-09T06:27:52.932076+0000","last_peered":"2023-10-09T06:27:52.932076+0000","last_clean":"2023-10-09T06:27:52.932076+0000","last_became_active":"2023-10-09T06:27:52.931652+0000","last_became_peered":"2023-10-09T06:27:52.931652+0000","last_unstale":"2023-10-09T06:27:52.932076+0000","last_undegraded":"2023-10-09T06:27:52.932076+0000","last_fullsized":"2023-10-09T06:27:52.932076+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:53.938974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928641+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:50.083326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.931973+0000","last_change":"2023-10-09T06:27:52.931973+0000","last_active":"2023-10-09T06:27:52.931973+0000","last_peered":"2023-10-09T06:27:52.931973+0000","last_clean":"2023-10-09T06:27:52.931973+0000","last_became_active":"2023-10-09T06:27:52.931677+0000","last_became_peered":"2023-10-09T06:27:52.931677+0000","last_unstale":"2023-10-09T06:27:52.931973+0000","last_undegraded":"2023-10-09T06:27:52.931973+0000","last_fullsized":"2023-10-09T06:27:52.931973+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:52:38.654562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928521+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:05:47.754354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933173+0000","last_change":"2023-10-09T06:27:52.933173+0000","last_active":"2023-10-09T06:27:52.933173+0000","last_peered":"2023-10-09T06:27:52.933173+0000","last_clean":"2023-10-09T06:27:52.933173+0000","last_became_active":"2023-10-09T06:27:52.932948+0000","last_became_peered":"2023-10-09T06:27:52.932948+0000","last_unstale":"2023-10-09T06:27:52.933173+0000","last_undegraded":"2023-10-09T06:27:52.933173+0000","last_fullsized":"2023-10-09T06:27:52.933173+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:01.012691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.934090+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:08:12.039272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.937327+0000","last_change":"2023-10-09T06:27:52.937327+0000","last_active":"2023-10-09T06:27:52.937327+0000","last_peered":"2023-10-09T06:27:52.937327+0000","last_clean":"2023-10-09T06:27:52.937327+0000","last_became_active":"2023-10-09T06:27:52.937095+0000","last_became_peered":"2023-10-09T06:27:52.937095+0000","last_unstale":"2023-10-09T06:27:52.937327+0000","last_undegraded":"2023-10-09T06:27:52.937327+0000","last_fullsized":"2023-10-09T06:27:52.937327+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:44.302806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.932105+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:16.441845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.931810+0000","last_change":"2023-10-09T06:27:52.931810+0000","last_active":"2023-10-09T06:27:52.931810+0000","last_peered":"2023-10-09T06:27:52.931810+0000","last_clean":"2023-10-09T06:27:52.931810+0000","last_became_active":"2023-10-09T06:27:52.931440+0000","last_became_peered":"2023-10-09T06:27:52.931440+0000","last_unstale":"2023-10-09T06:27:52.931810+0000","last_undegraded":"2023-10-09T06:27:52.931810+0000","last_fullsized":"2023-10-09T06:27:52.931810+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:32.963211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.926297+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:00.721099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935565+0000","last_change":"2023-10-09T06:27:52.935565+0000","last_active":"2023-10-09T06:27:52.935565+0000","last_peered":"2023-10-09T06:27:52.935565+0000","last_clean":"2023-10-09T06:27:52.935565+0000","last_became_active":"2023-10-09T06:27:52.935254+0000","last_became_peered":"2023-10-09T06:27:52.935254+0000","last_unstale":"2023-10-09T06:27:52.935565+0000","last_undegraded":"2023-10-09T06:27:52.935565+0000","last_fullsized":"2023-10-09T06:27:52.935565+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:32.422666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.926412+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:15.353816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.931092+0000","last_change":"2023-10-09T06:27:52.931092+0000","last_active":"2023-10-09T06:27:52.931092+0000","last_peered":"2023-10-09T06:27:52.931092+0000","last_clean":"2023-10-09T06:27:52.931092+0000","last_became_active":"2023-10-09T06:27:52.930803+0000","last_became_peered":"2023-10-09T06:27:52.930803+0000","last_unstale":"2023-10-09T06:27:52.931092+0000","last_undegraded":"2023-10-09T06:27:52.931092+0000","last_fullsized":"2023-10-09T06:27:52.931092+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:15.437434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.926007+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:15.353816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.932657+0000","last_change":"2023-10-09T06:27:52.932657+0000","last_active":"2023-10-09T06:27:52.932657+0000","last_peered":"2023-10-09T06:27:52.932657+0000","last_clean":"2023-10-09T06:27:52.932657+0000","last_became_active":"2023-10-09T06:27:52.932402+0000","last_became_peered":"2023-10-09T06:27:52.932402+0000","last_unstale":"2023-10-09T06:27:52.932657+0000","last_undegraded":"2023-10-09T06:27:52.932657+0000","last_fullsized":"2023-10-09T06:27:52.932657+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:51.366885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927790+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:34.259293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935532+0000","last_change":"2023-10-09T06:27:52.935532+0000","last_active":"2023-10-09T06:27:52.935532+0000","last_peered":"2023-10-09T06:27:52.935532+0000","last_clean":"2023-10-09T06:27:52.935532+0000","last_became_active":"2023-10-09T06:27:52.935305+0000","last_became_peered":"2023-10-09T06:27:52.935305+0000","last_unstale":"2023-10-09T06:27:52.935532+0000","last_undegraded":"2023-10-09T06:27:52.935532+0000","last_fullsized":"2023-10-09T06:27:52.935532+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:30:56.562227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.932614+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:52:39.658973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.932310+0000","last_change":"2023-10-09T06:27:52.932310+0000","last_active":"2023-10-09T06:27:52.932310+0000","last_peered":"2023-10-09T06:27:52.932310+0000","last_clean":"2023-10-09T06:27:52.932310+0000","last_became_active":"2023-10-09T06:27:52.932078+0000","last_became_peered":"2023-10-09T06:27:52.932078+0000","last_unstale":"2023-10-09T06:27:52.932310+0000","last_undegraded":"2023-10-09T06:27:52.932310+0000","last_fullsized":"2023-10-09T06:27:52.932310+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:41.167438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.932829+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:23:35.364984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.934337+0000","last_change":"2023-10-09T06:27:52.934337+0000","last_active":"2023-10-09T06:27:52.934337+0000","last_peered":"2023-10-09T06:27:52.934337+0000","last_clean":"2023-10-09T06:27:52.934337+0000","last_became_active":"2023-10-09T06:27:52.934093+0000","last_became_peered":"2023-10-09T06:27:52.934093+0000","last_unstale":"2023-10-09T06:27:52.934337+0000","last_undegraded":"2023-10-09T06:27:52.934337+0000","last_fullsized":"2023-10-09T06:27:52.934337+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:01.012691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.933009+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:18.472028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933464+0000","last_change":"2023-10-09T06:27:52.933464+0000","last_active":"2023-10-09T06:27:52.933464+0000","last_peered":"2023-10-09T06:27:52.933464+0000","last_clean":"2023-10-09T06:27:52.933464+0000","last_became_active":"2023-10-09T06:27:52.933028+0000","last_became_peered":"2023-10-09T06:27:52.933028+0000","last_unstale":"2023-10-09T06:27:52.933464+0000","last_undegraded":"2023-10-09T06:27:52.933464+0000","last_fullsized":"2023-10-09T06:27:52.933464+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:17.467616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.932248+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:42.171850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.928446+0000","last_change":"2023-10-09T06:27:52.928446+0000","last_active":"2023-10-09T06:27:52.928446+0000","last_peered":"2023-10-09T06:27:52.928446+0000","last_clean":"2023-10-09T06:27:52.928446+0000","last_became_active":"2023-10-09T06:27:52.928210+0000","last_became_peered":"2023-10-09T06:27:52.928210+0000","last_unstale":"2023-10-09T06:27:52.928446+0000","last_undegraded":"2023-10-09T06:27:52.928446+0000","last_fullsized":"2023-10-09T06:27:52.928446+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:34.395434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927872+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:43.819504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.932636+0000","last_change":"2023-10-09T06:27:52.932636+0000","last_active":"2023-10-09T06:27:52.932636+0000","last_peered":"2023-10-09T06:27:52.932636+0000","last_clean":"2023-10-09T06:27:52.932636+0000","last_became_active":"2023-10-09T06:27:52.932394+0000","last_became_peered":"2023-10-09T06:27:52.932394+0000","last_unstale":"2023-10-09T06:27:52.932636+0000","last_undegraded":"2023-10-09T06:27:52.932636+0000","last_fullsized":"2023-10-09T06:27:52.932636+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:12.418152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930991+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:32:48.606592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.936108+0000","last_change":"2023-10-09T06:27:52.936108+0000","last_active":"2023-10-09T06:27:52.936108+0000","last_peered":"2023-10-09T06:27:52.936108+0000","last_clean":"2023-10-09T06:27:52.936108+0000","last_became_active":"2023-10-09T06:27:52.933621+0000","last_became_peered":"2023-10-09T06:27:52.933621+0000","last_unstale":"2023-10-09T06:27:52.936108+0000","last_undegraded":"2023-10-09T06:27:52.936108+0000","last_fullsized":"2023-10-09T06:27:52.936108+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:19.208277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.934106+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:49:38.474462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.936079+0000","last_change":"2023-10-09T06:27:52.936079+0000","last_active":"2023-10-09T06:27:52.936079+0000","last_peered":"2023-10-09T06:27:52.936079+0000","last_clean":"2023-10-09T06:27:52.936079+0000","last_became_active":"2023-10-09T06:27:52.935872+0000","last_became_peered":"2023-10-09T06:27:52.935872+0000","last_unstale":"2023-10-09T06:27:52.936079+0000","last_undegraded":"2023-10-09T06:27:52.936079+0000","last_fullsized":"2023-10-09T06:27:52.936079+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:53.273517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930758+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:54:03.907542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.936040+0000","last_change":"2023-10-09T06:27:52.936040+0000","last_active":"2023-10-09T06:27:52.936040+0000","last_peered":"2023-10-09T06:27:52.936040+0000","last_clean":"2023-10-09T06:27:52.936040+0000","last_became_active":"2023-10-09T06:27:52.935583+0000","last_became_peered":"2023-10-09T06:27:52.935583+0000","last_unstale":"2023-10-09T06:27:52.936040+0000","last_undegraded":"2023-10-09T06:27:52.936040+0000","last_fullsized":"2023-10-09T06:27:52.936040+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:11.452245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.930815+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.029150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.934153+0000","last_change":"2023-10-09T06:27:52.934153+0000","last_active":"2023-10-09T06:27:52.934153+0000","last_peered":"2023-10-09T06:27:52.934153+0000","last_clean":"2023-10-09T06:27:52.934153+0000","last_became_active":"2023-10-09T06:27:52.933922+0000","last_became_peered":"2023-10-09T06:27:52.933922+0000","last_unstale":"2023-10-09T06:27:52.934153+0000","last_undegraded":"2023-10-09T06:27:52.934153+0000","last_fullsized":"2023-10-09T06:27:52.934153+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:02.855389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928080+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:34.259293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933533+0000","last_change":"2023-10-09T06:27:52.933533+0000","last_active":"2023-10-09T06:27:52.933533+0000","last_peered":"2023-10-09T06:27:52.933533+0000","last_clean":"2023-10-09T06:27:52.933533+0000","last_became_active":"2023-10-09T06:27:52.932880+0000","last_became_peered":"2023-10-09T06:27:52.932880+0000","last_unstale":"2023-10-09T06:27:52.933533+0000","last_undegraded":"2023-10-09T06:27:52.933533+0000","last_fullsized":"2023-10-09T06:27:52.933533+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:06.132532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.926776+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:30.199496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.933739+0000","last_change":"2023-10-09T06:27:52.933739+0000","last_active":"2023-10-09T06:27:52.933739+0000","last_peered":"2023-10-09T06:27:52.933739+0000","last_clean":"2023-10-09T06:27:52.933739+0000","last_became_active":"2023-10-09T06:27:52.933302+0000","last_became_peered":"2023-10-09T06:27:52.933302+0000","last_unstale":"2023-10-09T06:27:52.933739+0000","last_undegraded":"2023-10-09T06:27:52.933739+0000","last_fullsized":"2023-10-09T06:27:52.933739+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:03.249361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.928764+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:50.083326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935717+0000","last_change":"2023-10-09T06:27:52.935717+0000","last_active":"2023-10-09T06:27:52.935717+0000","last_peered":"2023-10-09T06:27:52.935717+0000","last_clean":"2023-10-09T06:27:52.935717+0000","last_became_active":"2023-10-09T06:27:52.935414+0000","last_became_peered":"2023-10-09T06:27:52.935414+0000","last_unstale":"2023-10-09T06:27:52.935717+0000","last_undegraded":"2023-10-09T06:27:52.935717+0000","last_fullsized":"2023-10-09T06:27:52.935717+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:40.048060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.931748+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:06.413749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.935326+0000","last_change":"2023-10-09T06:27:52.935326+0000","last_active":"2023-10-09T06:27:52.935326+0000","last_peered":"2023-10-09T06:27:52.935326+0000","last_clean":"2023-10-09T06:27:52.935326+0000","last_became_active":"2023-10-09T06:27:52.935101+0000","last_became_peered":"2023-10-09T06:27:52.935101+0000","last_unstale":"2023-10-09T06:27:52.935326+0000","last_undegraded":"2023-10-09T06:27:52.935326+0000","last_fullsized":"2023-10-09T06:27:52.935326+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:59.555036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:27:52.918668+0000","last_change":"2023-10-09T06:27:52.927893+0000","last_active":"2023-10-09T06:27:52.918668+0000","last_peered":"2023-10-09T06:27:52.918668+0000","last_clean":"2023-10-09T06:27:52.918668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:27:52.918668+0000","last_undegraded":"2023-10-09T06:27:52.918668+0000","last_fullsized":"2023-10-09T06:27:52.918668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:52.041346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":8,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-09T06:27:52.932778+0000","last_change":"2023-10-09T06:27:52.932778+0000","last_active":"2023-10-09T06:27:52.932778+0000","last_peered":"2023-10-09T06:27:52.932778+0000","last_clean":"2023-10-09T06:27:52.932778+0000","last_became_active":"2023-10-09T06:27:52.932545+0000","last_became_peered":"2023-10-09T06:27:52.932545+0000","last_unstale":"2023-10-09T06:27:52.932778+0000","last_undegraded":"2023-10-09T06:27:52.932778+0000","last_fullsized":"2023-10-09T06:27:52.932778+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:53.938974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":274,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-09T06:27:51.920741+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:27:51.920741+0000","last_peered":"2023-10-09T06:27:51.920741+0000","last_clean":"2023-10-09T06:27:51.920741+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:27:51.920741+0000","last_undegraded":"2023-10-09T06:27:51.920741+0000","last_fullsized":"2023-10-09T06:27:51.920741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1383,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193929,"statfs":{"total":200000000,"available":198583533,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53900000000000003,"15min":0.51100000000000001},"min":{"1min":0.32900000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79600000000000004,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.52700000000000002},"min":{"1min":0.33500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81100000000000005,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.502}]},{"osd":1,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.50600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64200000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54200000000000004,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76300000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.48399999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81899999999999995,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59199999999999997,"15min":0.54100000000000004},"min":{"1min":0.33700000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73999999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.61399999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.65000000000000002,"15min":0.57999999999999996},"min":{"1min":0.373,"5min":0.318,"15min":0.318},"max":{"1min":0.80900000000000005,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.64900000000000002,"15min":0.56699999999999995},"min":{"1min":0.435,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77400000000000002,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.59699999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45800000000000002,"15min":0.46999999999999997},"min":{"1min":0.27700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.64100000000000001,"5min":0.872,"15min":0.872},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77800000000000002,"5min":0.79800000000000004,"15min":0.86099999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48599999999999999,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.255,"15min":0.255},"max":{"1min":0.71799999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73999999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83599999999999997,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.74299999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.79900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194505,"statfs":{"total":200000000,"available":199173901,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.74399999999999999},"min":{"1min":0.35299999999999998,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.71699999999999997,"5min":0.77100000000000002,"15min":7.0960000000000001},"last":0.502},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54600000000000004,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.133},"last":0.46200000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":1.155},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.317},"max":{"1min":0.75600000000000001,"5min":0.79300000000000004,"15min":1.1459999999999999},"last":0.70399999999999996}]},{"osd":2,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.86499999999999999,"15min":1.2290000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55300000000000005,"15min":0.75800000000000001},"min":{"1min":0.378,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":7.1299999999999999},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.59399999999999997},"min":{"1min":0.44500000000000001,"5min":0.39100000000000001,"15min":0.34499999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":1.337},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73699999999999999,"5min":0.90400000000000003,"15min":1.206},"last":0.755}]},{"osd":4,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.498,"15min":0.497},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.52200000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.33300000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.65500000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.61099999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.315},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194505,"statfs":{"total":200000000,"available":199173901,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34999999999999998,"15min":0.36599999999999999},"min":{"1min":0.223,"5min":0.219,"15min":0.219},"max":{"1min":0.41699999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.33800000000000002},"min":{"1min":0.247,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46899999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.35199999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.35099999999999998,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.46600000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.307},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40799999999999997,"15min":0.38800000000000001},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.48599999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.36699999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45200000000000001,"15min":0.41699999999999998},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.29199999999999998},"max":{"1min":0.52800000000000002,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.443,"15min":0.42899999999999999},"min":{"1min":0.28999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.504,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59699999999999998,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.83199999999999996,"5min":1.097,"15min":1.097},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60999999999999999,"15min":0.79100000000000004},"min":{"1min":0.42699999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76400000000000001,"5min":1.0309999999999999,"15min":5.5270000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.47699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":1.125,"15min":1.125},"last":0.624},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64400000000000002,"15min":0.66300000000000003},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":1.175,"15min":1.4219999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65200000000000002,"15min":0.622},"min":{"1min":0.45800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82599999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.46600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92300000000000004,"5min":1.125,"15min":1.49},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83599999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.67200000000000004,"15min":0.65600000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78600000000000003,"5min":1.052,"15min":1.052},"last":0.503}]}]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1383,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193929,"statfs":{"total":200000000,"available":198583533,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.35599999999999998,"15min":0.40200000000000002},"min":{"1min":0.216,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51600000000000001,"5min":0.65800000000000003,"15min":1.226},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.41599999999999998},"min":{"1min":0.26900000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.64300000000000002,"5min":0.71899999999999997,"15min":1.131},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38500000000000001,"15min":0.88200000000000001},"min":{"1min":0.28299999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.44500000000000001,"5min":0.64400000000000002,"15min":12.929},"last":0.313},{"interface":"front","average":{"1min":0.372,"5min":0.41599999999999998,"15min":0.45100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53600000000000003,"5min":0.70899999999999996,"15min":1.1599999999999999},"last":0.32800000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44,"15min":0.46700000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58499999999999996,"5min":0.76100000000000001,"15min":1.1859999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.441,"15min":0.47899999999999998},"min":{"1min":0.36699999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55800000000000005,"5min":0.69199999999999995,"15min":1.3089999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76000000000000001,"5min":0.86299999999999999,"15min":0.93200000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59899999999999998,"15min":0.64300000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41099999999999998},"max":{"1min":0.754,"5min":0.97099999999999997,"15min":1.335},"last":0.57499999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.61399999999999999},"min":{"1min":0.40799999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77800000000000002,"5min":0.90700000000000003,"15min":1.0580000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.66900000000000004,"5min":0.82199999999999995,"15min":0.999},"last":0.55600000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59199999999999997,"15min":0.61299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78600000000000003,"5min":0.83099999999999996,"15min":0.998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.82899999999999996,"5min":0.93899999999999995,"15min":1.2849999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40400000000000003},"max":{"1min":0.80100000000000005,"5min":0.92800000000000005,"15min":1.262},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64400000000000002,"15min":0.66100000000000003},"min":{"1min":0.48299999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76100000000000001,"5min":0.95599999999999996,"15min":1.103},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194505,"statfs":{"total":200000000,"available":199173901,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.35499999999999998,"15min":0.78600000000000003},"min":{"1min":0.24199999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.46700000000000003,"5min":0.79000000000000004,"15min":14.981999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38400000000000001,"15min":0.62},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.59699999999999998,"5min":0.64100000000000001,"15min":9.1600000000000001},"last":0.26600000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36899999999999999,"15min":0.58399999999999996},"min":{"1min":0.28199999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.55400000000000005,"5min":0.73099999999999998,"15min":8.4930000000000003},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.42599999999999999,"15min":0.65200000000000002},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":0.53500000000000003,"5min":0.91400000000000003,"15min":9.0239999999999991},"last":0.34300000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44800000000000001,"15min":0.65600000000000003},"min":{"1min":0.33000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61599999999999999,"5min":0.84299999999999997,"15min":8.5190000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.44700000000000001,"15min":0.85099999999999998},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.56100000000000005,"5min":0.87,"15min":15.007999999999999},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63700000000000001,"15min":1.052},"min":{"1min":0.41399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93799999999999994,"5min":0.95299999999999996,"15min":14.917999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65400000000000003,"15min":0.879},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90300000000000002,"5min":1.1160000000000001,"15min":8.9930000000000003},"last":0.69099999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65200000000000002,"15min":0.85799999999999998},"min":{"1min":0.439,"5min":0.432,"15min":0.35899999999999999},"max":{"1min":0.94599999999999995,"5min":0.96299999999999997,"15min":8.9610000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.86299999999999999},"min":{"1min":0.45100000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.03,"5min":1.03,"15min":8.3919999999999995},"last":0.56200000000000006}]},{"osd":6,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64900000000000002,"15min":0.84799999999999998},"min":{"1min":0.498,"5min":0.42499999999999999,"15min":0.39900000000000002},"max":{"1min":0.97299999999999998,"5min":1.026,"15min":8.4339999999999993},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66200000000000003,"15min":1.054},"min":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.028,"15min":14.954000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64300000000000002,"15min":0.84399999999999997},"min":{"1min":0.42599999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":8.9160000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65500000000000003,"15min":0.85899999999999999},"min":{"1min":0.46800000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":1.0609999999999999,"15min":8.4640000000000004},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194499,"statfs":{"total":200000000,"available":199167638,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58599999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41699999999999998,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.498}]},{"osd":1,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35599999999999998,"15min":0.32800000000000001},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.215},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.40000000000000002,"15min":0.35699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.51500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38800000000000001,"15min":0.36499999999999999},"min":{"1min":0.27000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46899999999999997,"15min":0.42499999999999999},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54100000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.375},"max":{"1min":0.77700000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.434,"5min":0.372,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.84799999999999998,"15min":0.91500000000000004},"last":0.76200000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64200000000000002,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.84099999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.85499999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64000000000000001,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.38800000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.75},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63600000000000001,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.91700000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.86899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194499,"statfs":{"total":200000000,"available":199167638,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.53000000000000003,"15min":0.498},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.29299999999999998},"max":{"1min":0.66400000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.318},"max":{"1min":0.63100000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.441}]},{"osd":1,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53400000000000003,"15min":0.51400000000000001},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.254},"max":{"1min":0.60399999999999998,"5min":0.74399999999999999,"15min":0.77000000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.69599999999999995},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.34499999999999997},"max":{"1min":0.66700000000000004,"5min":1.5680000000000001,"15min":4.3250000000000002},"last":0.60899999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.68600000000000005},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.67800000000000005,"5min":1.7110000000000001,"15min":4.7320000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":1.03},"min":{"1min":0.41299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78200000000000003,"5min":0.80200000000000005,"15min":11.715},"last":0.51100000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56799999999999995,"15min":0.52600000000000002},"min":{"1min":0.38900000000000001,"5min":0.35199999999999998,"15min":0.34899999999999998},"max":{"1min":0.68400000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.496},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.44700000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72399999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.49299999999999999},"min":{"1min":0.27200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65200000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.502,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65900000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.38300000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.629},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.66300000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:26:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.754,"5min":0.879,"15min":0.879},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81200000000000006,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.73799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194499,"statfs":{"total":200000000,"available":199167638,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73699999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55800000000000005,"15min":0.52400000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35399999999999998},"max":{"1min":0.78500000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63100000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.752,"5min":1.093,"15min":1.093},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.52300000000000002},"min":{"1min":0.379,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81699999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58099999999999996}]},{"osd":2,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57299999999999995,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70899999999999996,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59999999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.55800000000000005},"min":{"1min":0.45800000000000002,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.745,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.58799999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76600000000000001,"5min":1.071,"15min":1.071},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71599999999999997,"5min":0.79000000000000004,"15min":0.84399999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.746,"5min":0.76900000000000002,"15min":0.81000000000000005},"last":0.34799999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49299999999999999,"15min":0.53300000000000003},"min":{"1min":0.36099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73299999999999998,"5min":0.85199999999999998,"15min":1.0680000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.67500000000000004,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.433}]},{"osd":7,"last update":"Mon Oct 9 06:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":0.78200000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76600000000000001,"5min":0.84399999999999997,"15min":1.0269999999999999},"last":0.45800000000000002}]}]}],"pool_statfs":[]}} 2023-10-09T06:27:58.419 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:27:58.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.573+0000 7fa525c07700 1 Processor -- start 2023-10-09T06:27:58.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.573+0000 7fa525c07700 1 -- start start 2023-10-09T06:27:58.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.574+0000 7fa525c07700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa520159e60 0x7fa5200b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.574+0000 7fa525c07700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5200b3d40 con 0x7fa5200cffa0 2023-10-09T06:27:58.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.574+0000 7fa525c07700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5200b4300 con 0x7fa52006adb0 2023-10-09T06:27:58.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.574+0000 7fa525c07700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa520069d70 con 0x7fa520159e60 2023-10-09T06:27:58.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.574+0000 7fa51effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa5200cffa0 0x7fa52006a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58204/0 (socket says 172.21.15.31:58204) 2023-10-09T06:27:58.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.574+0000 7fa51effd700 1 -- 172.21.15.31:0/3834546373 learned_addr learned my addr 172.21.15.31:0/3834546373 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:58.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51f7fe700 1 --2- 172.21.15.31:0/3834546373 >> v2:172.21.15.158:3300/0 conn(0x7fa520159e60 0x7fa5200b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272969563 0 0) 0x7fa5200b3d40 con 0x7fa5200cffa0 2023-10-09T06:27:58.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa508003570 con 0x7fa5200cffa0 2023-10-09T06:27:58.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3603985181 0 0) 0x7fa508003570 con 0x7fa5200cffa0 2023-10-09T06:27:58.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 >> v2:172.21.15.158:3300/0 conn(0x7fa520159e60 msgr2=0x7fa5200b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:58.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 --2- 172.21.15.31:0/3834546373 >> v2:172.21.15.158:3300/0 conn(0x7fa520159e60 0x7fa5200b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 >> v1:172.21.15.158:6789/0 conn(0x7fa52006adb0 legacy=0x7fa520163c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5200d0480 con 0x7fa5200cffa0 2023-10-09T06:27:58.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fa514001470 con 0x7fa5200cffa0 2023-10-09T06:27:58.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 >> v1:172.21.15.31:6789/0 conn(0x7fa5200cffa0 legacy=0x7fa52006a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 --2- 172.21.15.31:0/3834546373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa508003a60 0x7fa508003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 --2- 172.21.15.31:0/3834546373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508004810 0x7fa508004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 --2- 172.21.15.31:0/3834546373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5080051c0 0x7fa50800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa520069d70 con 0x7fa5080051c0 2023-10-09T06:27:58.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50800c0d0 con 0x7fa508004810 2023-10-09T06:27:58.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50800c290 con 0x7fa508003a60 2023-10-09T06:27:58.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51ffff700 1 --2- 172.21.15.31:0/3834546373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5080051c0 0x7fa50800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51effd700 1 --2- 172.21.15.31:0/3834546373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508004810 0x7fa508004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51f7fe700 1 --2- 172.21.15.31:0/3834546373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa508003a60 0x7fa508003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51ffff700 1 -- 172.21.15.31:0/3834546373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa508003a60 msgr2=0x7fa508003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:58.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51ffff700 1 --2- 172.21.15.31:0/3834546373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa508003a60 0x7fa508003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51ffff700 1 -- 172.21.15.31:0/3834546373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508004810 msgr2=0x7fa508004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:58.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51ffff700 1 --2- 172.21.15.31:0/3834546373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508004810 0x7fa508004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51ffff700 1 -- 172.21.15.31:0/3834546373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa508003570 con 0x7fa5080051c0 2023-10-09T06:27:58.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.575+0000 7fa51f7fe700 1 --2- 172.21.15.31:0/3834546373 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa508003a60 0x7fa508003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:58.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.576+0000 7fa51ffff700 1 -- 172.21.15.31:0/3834546373 reap_dead start 2023-10-09T06:27:58.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.576+0000 7fa51ffff700 1 --2- 172.21.15.31:0/3834546373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5080051c0 0x7fa50800ba60 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa52006b1b0 tx=0x7fa518001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87b170f7064f71d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:58.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.576+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518001950 con 0x7fa5080051c0 2023-10-09T06:27:58.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.576+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa518004030 con 0x7fa5080051c0 2023-10-09T06:27:58.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.576+0000 7fa51e7fc700 1 -- 172.21.15.31:0/3834546373 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51800cae0 con 0x7fa5080051c0 2023-10-09T06:27:58.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.576+0000 7fa525c07700 1 -- 172.21.15.31:0/3834546373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5080051c0 msgr2=0x7fa50800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.576+0000 7fa525c07700 1 --2- 172.21.15.31:0/3834546373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5080051c0 0x7fa50800ba60 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa52006b1b0 tx=0x7fa518001640 comp rx=0 tx=0).stop 2023-10-09T06:27:58.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.576+0000 7fa525c07700 1 -- 172.21.15.31:0/3834546373 shutdown_connections 2023-10-09T06:27:58.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.576+0000 7fa525c07700 1 --2- 172.21.15.31:0/3834546373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5080051c0 0x7fa50800ba60 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.576+0000 7fa525c07700 1 -- 172.21.15.31:0/3834546373 >> 172.21.15.31:0/3834546373 conn(0x7fa5200d1a50 msgr2=0x7fa520068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:58.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.576+0000 7fa525c07700 1 -- 172.21.15.31:0/3834546373 shutdown_connections 2023-10-09T06:27:58.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.576+0000 7fa525c07700 1 -- 172.21.15.31:0/3834546373 wait complete. 2023-10-09T06:27:58.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.578+0000 7fa525c07700 1 Processor -- start 2023-10-09T06:27:58.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.578+0000 7fa525c07700 1 -- start start 2023-10-09T06:27:58.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.578+0000 7fa525c07700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5080051c0 0x7fa5200cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.578+0000 7fa525c07700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa5200b45e0 0x7fa5200b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.578+0000 7fa525c07700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa52015a580 0x7fa52015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.578+0000 7fa525c07700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5200b4f90 con 0x7fa5080051c0 2023-10-09T06:27:58.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.578+0000 7fa525c07700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5200cdba0 con 0x7fa5200b45e0 2023-10-09T06:27:58.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.578+0000 7fa525c07700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5200c7690 con 0x7fa52015a580 2023-10-09T06:27:58.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.578+0000 7fa51f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5080051c0 0x7fa5200cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.578+0000 7fa51f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5080051c0 0x7fa5200cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43826/0 (socket says 172.21.15.31:43826) 2023-10-09T06:27:58.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.578+0000 7fa51f7fe700 1 -- 172.21.15.31:0/3479008923 learned_addr learned my addr 172.21.15.31:0/3479008923 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:58.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.578+0000 7fa51effd700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa5200b45e0 0x7fa5200b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.578+0000 7fa51ffff700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa52015a580 0x7fa52015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.579+0000 7fa51f7fe700 1 -- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa52015a580 msgr2=0x7fa52015aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.579+0000 7fa51f7fe700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa52015a580 0x7fa52015aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.579+0000 7fa51f7fe700 1 -- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa5200b45e0 msgr2=0x7fa5200b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.579+0000 7fa51f7fe700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa5200b45e0 0x7fa5200b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.579+0000 7fa51f7fe700 1 -- 172.21.15.31:0/3479008923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5200c68d0 con 0x7fa5080051c0 2023-10-09T06:27:58.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.579+0000 7fa51f7fe700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5080051c0 0x7fa5200cd660 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fa510009fd0 tx=0x7fa510008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:58.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.579+0000 7fa5077fe700 1 -- 172.21.15.31:0/3479008923 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510015740 con 0x7fa5080051c0 2023-10-09T06:27:58.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.579+0000 7fa5077fe700 1 -- 172.21.15.31:0/3479008923 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5100158a0 con 0x7fa5080051c0 2023-10-09T06:27:58.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.579+0000 7fa525c07700 1 -- 172.21.15.31:0/3479008923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5200c6bb0 con 0x7fa5080051c0 2023-10-09T06:27:58.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.579+0000 7fa5077fe700 1 -- 172.21.15.31:0/3479008923 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510015c40 con 0x7fa5080051c0 2023-10-09T06:27:58.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.579+0000 7fa525c07700 1 -- 172.21.15.31:0/3479008923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5200c7170 con 0x7fa5080051c0 2023-10-09T06:27:58.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.580+0000 7fa525c07700 1 -- 172.21.15.31:0/3479008923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52004c3c0 con 0x7fa5080051c0 2023-10-09T06:27:58.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.581+0000 7fa5077fe700 1 -- 172.21.15.31:0/3479008923 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa510013410 con 0x7fa5080051c0 2023-10-09T06:27:58.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.581+0000 7fa5077fe700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa50c066f30 0x7fa50c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.581+0000 7fa5077fe700 1 -- 172.21.15.31:0/3479008923 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa510084830 con 0x7fa5080051c0 2023-10-09T06:27:58.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.581+0000 7fa51effd700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa50c066f30 0x7fa50c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.582+0000 7fa51effd700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa50c066f30 0x7fa50c0693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa5140015a0 tx=0x7fa514001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:58.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.585+0000 7fa5077fe700 1 -- 172.21.15.31:0/3479008923 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa510051b60 con 0x7fa5080051c0 2023-10-09T06:27:58.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.772+0000 7fa525c07700 1 -- 172.21.15.31:0/3479008923 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5200d0760 con 0x7fa50c066f30 2023-10-09T06:27:58.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.780+0000 7fa5077fe700 1 -- 172.21.15.31:0/3479008923 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285392 (secure 0 0 0) 0x7fa5200d0760 con 0x7fa50c066f30 2023-10-09T06:27:58.784 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:58.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.784+0000 7fa525c07700 1 -- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa50c066f30 msgr2=0x7fa50c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.784+0000 7fa525c07700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa50c066f30 0x7fa50c0693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa5140015a0 tx=0x7fa514001e50 comp rx=0 tx=0).stop 2023-10-09T06:27:58.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.784+0000 7fa525c07700 1 -- 172.21.15.31:0/3479008923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5080051c0 msgr2=0x7fa5200cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.784+0000 7fa525c07700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5080051c0 0x7fa5200cd660 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fa510009fd0 tx=0x7fa510008040 comp rx=0 tx=0).stop 2023-10-09T06:27:58.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.784+0000 7fa525c07700 1 -- 172.21.15.31:0/3479008923 shutdown_connections 2023-10-09T06:27:58.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.784+0000 7fa525c07700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa50c066f30 0x7fa50c0693e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.784+0000 7fa525c07700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa52015a580 0x7fa52015aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.784+0000 7fa525c07700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5080051c0 0x7fa5200cd660 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.784+0000 7fa525c07700 1 --2- 172.21.15.31:0/3479008923 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa5200b45e0 0x7fa5200b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.784+0000 7fa525c07700 1 -- 172.21.15.31:0/3479008923 >> 172.21.15.31:0/3479008923 conn(0x7fa5200d1a50 msgr2=0x7fa5200b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:58.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.784+0000 7fa525c07700 1 -- 172.21.15.31:0/3479008923 shutdown_connections 2023-10-09T06:27:58.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.784+0000 7fa525c07700 1 -- 172.21.15.31:0/3479008923 wait complete. 2023-10-09T06:27:58.787 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:27:58.797 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2023-10-09T06:27:58.619594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7762,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554737,"statfs":{"total":1600000000,"available":1592051348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001167"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931157+0000","last_change":"2023-10-09T06:27:53.931079+0000","last_active":"2023-10-09T06:27:53.931157+0000","last_peered":"2023-10-09T06:27:53.931157+0000","last_clean":"2023-10-09T06:27:53.931157+0000","last_became_active":"2023-10-09T06:27:53.930657+0000","last_became_peered":"2023-10-09T06:27:53.930657+0000","last_unstale":"2023-10-09T06:27:53.931157+0000","last_undegraded":"2023-10-09T06:27:53.931157+0000","last_fullsized":"2023-10-09T06:27:53.931157+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:54:03.907542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.925903+0000","last_change":"2023-10-09T06:27:53.925366+0000","last_active":"2023-10-09T06:27:53.925903+0000","last_peered":"2023-10-09T06:27:53.925903+0000","last_clean":"2023-10-09T06:27:53.925903+0000","last_became_active":"2023-10-09T06:27:53.925120+0000","last_became_peered":"2023-10-09T06:27:53.925120+0000","last_unstale":"2023-10-09T06:27:53.925903+0000","last_undegraded":"2023-10-09T06:27:53.925903+0000","last_fullsized":"2023-10-09T06:27:53.925903+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:32.047523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.930114+0000","last_change":"2023-10-09T06:27:53.929645+0000","last_active":"2023-10-09T06:27:53.930114+0000","last_peered":"2023-10-09T06:27:53.930114+0000","last_clean":"2023-10-09T06:27:53.930114+0000","last_became_active":"2023-10-09T06:27:53.929416+0000","last_became_peered":"2023-10-09T06:27:53.929416+0000","last_unstale":"2023-10-09T06:27:53.930114+0000","last_undegraded":"2023-10-09T06:27:53.930114+0000","last_fullsized":"2023-10-09T06:27:53.930114+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:54.277929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936804+0000","last_change":"2023-10-09T06:27:53.934571+0000","last_active":"2023-10-09T06:27:53.936804+0000","last_peered":"2023-10-09T06:27:53.936804+0000","last_clean":"2023-10-09T06:27:53.936804+0000","last_became_active":"2023-10-09T06:27:53.933993+0000","last_became_peered":"2023-10-09T06:27:53.933993+0000","last_unstale":"2023-10-09T06:27:53.936804+0000","last_undegraded":"2023-10-09T06:27:53.936804+0000","last_fullsized":"2023-10-09T06:27:53.936804+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:59:21.186206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935619+0000","last_change":"2023-10-09T06:27:53.935452+0000","last_active":"2023-10-09T06:27:53.935619+0000","last_peered":"2023-10-09T06:27:53.935619+0000","last_clean":"2023-10-09T06:27:53.935619+0000","last_became_active":"2023-10-09T06:27:53.932073+0000","last_became_peered":"2023-10-09T06:27:53.932073+0000","last_unstale":"2023-10-09T06:27:53.935619+0000","last_undegraded":"2023-10-09T06:27:53.935619+0000","last_fullsized":"2023-10-09T06:27:53.935619+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:53.233334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929855+0000","last_change":"2023-10-09T06:27:53.929750+0000","last_active":"2023-10-09T06:27:53.929855+0000","last_peered":"2023-10-09T06:27:53.929855+0000","last_clean":"2023-10-09T06:27:53.929855+0000","last_became_active":"2023-10-09T06:27:53.929021+0000","last_became_peered":"2023-10-09T06:27:53.929021+0000","last_unstale":"2023-10-09T06:27:53.929855+0000","last_undegraded":"2023-10-09T06:27:53.929855+0000","last_fullsized":"2023-10-09T06:27:53.929855+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:00:58.002430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928014+0000","last_change":"2023-10-09T06:27:53.926233+0000","last_active":"2023-10-09T06:27:53.928014+0000","last_peered":"2023-10-09T06:27:53.928014+0000","last_clean":"2023-10-09T06:27:53.928014+0000","last_became_active":"2023-10-09T06:27:53.925764+0000","last_became_peered":"2023-10-09T06:27:53.925764+0000","last_unstale":"2023-10-09T06:27:53.928014+0000","last_undegraded":"2023-10-09T06:27:53.928014+0000","last_fullsized":"2023-10-09T06:27:53.928014+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:52.041346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934364+0000","last_change":"2023-10-09T06:27:53.934291+0000","last_active":"2023-10-09T06:27:53.934364+0000","last_peered":"2023-10-09T06:27:53.934364+0000","last_clean":"2023-10-09T06:27:53.934364+0000","last_became_active":"2023-10-09T06:27:53.933988+0000","last_became_peered":"2023-10-09T06:27:53.933988+0000","last_unstale":"2023-10-09T06:27:53.934364+0000","last_undegraded":"2023-10-09T06:27:53.934364+0000","last_fullsized":"2023-10-09T06:27:53.934364+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:41.052472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934633+0000","last_change":"2023-10-09T06:27:53.934432+0000","last_active":"2023-10-09T06:27:53.934633+0000","last_peered":"2023-10-09T06:27:53.934633+0000","last_clean":"2023-10-09T06:27:53.934633+0000","last_became_active":"2023-10-09T06:27:53.934138+0000","last_became_peered":"2023-10-09T06:27:53.934138+0000","last_unstale":"2023-10-09T06:27:53.934633+0000","last_undegraded":"2023-10-09T06:27:53.934633+0000","last_fullsized":"2023-10-09T06:27:53.934633+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:32:48.606592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928844+0000","last_change":"2023-10-09T06:27:53.927444+0000","last_active":"2023-10-09T06:27:53.928844+0000","last_peered":"2023-10-09T06:27:53.928844+0000","last_clean":"2023-10-09T06:27:53.928844+0000","last_became_active":"2023-10-09T06:27:53.927183+0000","last_became_peered":"2023-10-09T06:27:53.927183+0000","last_unstale":"2023-10-09T06:27:53.928844+0000","last_undegraded":"2023-10-09T06:27:53.928844+0000","last_fullsized":"2023-10-09T06:27:53.928844+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:57.800112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932719+0000","last_change":"2023-10-09T06:27:53.931130+0000","last_active":"2023-10-09T06:27:53.932719+0000","last_peered":"2023-10-09T06:27:53.932719+0000","last_clean":"2023-10-09T06:27:53.932719+0000","last_became_active":"2023-10-09T06:27:53.930912+0000","last_became_peered":"2023-10-09T06:27:53.930912+0000","last_unstale":"2023-10-09T06:27:53.932719+0000","last_undegraded":"2023-10-09T06:27:53.932719+0000","last_fullsized":"2023-10-09T06:27:53.932719+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:03.328092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931658+0000","last_change":"2023-10-09T06:27:53.931531+0000","last_active":"2023-10-09T06:27:53.931658+0000","last_peered":"2023-10-09T06:27:53.931658+0000","last_clean":"2023-10-09T06:27:53.931658+0000","last_became_active":"2023-10-09T06:27:53.931172+0000","last_became_peered":"2023-10-09T06:27:53.931172+0000","last_unstale":"2023-10-09T06:27:53.931658+0000","last_undegraded":"2023-10-09T06:27:53.931658+0000","last_fullsized":"2023-10-09T06:27:53.931658+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:04.253773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929951+0000","last_change":"2023-10-09T06:27:53.929876+0000","last_active":"2023-10-09T06:27:53.929951+0000","last_peered":"2023-10-09T06:27:53.929951+0000","last_clean":"2023-10-09T06:27:53.929951+0000","last_became_active":"2023-10-09T06:27:53.929662+0000","last_became_peered":"2023-10-09T06:27:53.929662+0000","last_unstale":"2023-10-09T06:27:53.929951+0000","last_undegraded":"2023-10-09T06:27:53.929951+0000","last_fullsized":"2023-10-09T06:27:53.929951+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:47.143291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932605+0000","last_change":"2023-10-09T06:27:53.932111+0000","last_active":"2023-10-09T06:27:53.932605+0000","last_peered":"2023-10-09T06:27:53.932605+0000","last_clean":"2023-10-09T06:27:53.932605+0000","last_became_active":"2023-10-09T06:27:53.931590+0000","last_became_peered":"2023-10-09T06:27:53.931590+0000","last_unstale":"2023-10-09T06:27:53.932605+0000","last_undegraded":"2023-10-09T06:27:53.932605+0000","last_fullsized":"2023-10-09T06:27:53.932605+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:15.353816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936868+0000","last_change":"2023-10-09T06:27:53.935770+0000","last_active":"2023-10-09T06:27:53.936868+0000","last_peered":"2023-10-09T06:27:53.936868+0000","last_clean":"2023-10-09T06:27:53.936868+0000","last_became_active":"2023-10-09T06:27:53.935568+0000","last_became_peered":"2023-10-09T06:27:53.935568+0000","last_unstale":"2023-10-09T06:27:53.936868+0000","last_undegraded":"2023-10-09T06:27:53.936868+0000","last_fullsized":"2023-10-09T06:27:53.936868+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:44.999564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.937757+0000","last_change":"2023-10-09T06:27:53.937694+0000","last_active":"2023-10-09T06:27:53.937757+0000","last_peered":"2023-10-09T06:27:53.937757+0000","last_clean":"2023-10-09T06:27:53.937757+0000","last_became_active":"2023-10-09T06:27:53.937257+0000","last_became_peered":"2023-10-09T06:27:53.937257+0000","last_unstale":"2023-10-09T06:27:53.937757+0000","last_undegraded":"2023-10-09T06:27:53.937757+0000","last_fullsized":"2023-10-09T06:27:53.937757+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:46.105971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934363+0000","last_change":"2023-10-09T06:27:53.933906+0000","last_active":"2023-10-09T06:27:53.934363+0000","last_peered":"2023-10-09T06:27:53.934363+0000","last_clean":"2023-10-09T06:27:53.934363+0000","last_became_active":"2023-10-09T06:27:53.933686+0000","last_became_peered":"2023-10-09T06:27:53.933686+0000","last_unstale":"2023-10-09T06:27:53.934363+0000","last_undegraded":"2023-10-09T06:27:53.934363+0000","last_fullsized":"2023-10-09T06:27:53.934363+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:41.052472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.938142+0000","last_change":"2023-10-09T06:27:53.937954+0000","last_active":"2023-10-09T06:27:53.938142+0000","last_peered":"2023-10-09T06:27:53.938142+0000","last_clean":"2023-10-09T06:27:53.938142+0000","last_became_active":"2023-10-09T06:27:53.937446+0000","last_became_peered":"2023-10-09T06:27:53.937446+0000","last_unstale":"2023-10-09T06:27:53.938142+0000","last_undegraded":"2023-10-09T06:27:53.938142+0000","last_fullsized":"2023-10-09T06:27:53.938142+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:13.422563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932699+0000","last_change":"2023-10-09T06:27:53.930521+0000","last_active":"2023-10-09T06:27:53.932699+0000","last_peered":"2023-10-09T06:27:53.932699+0000","last_clean":"2023-10-09T06:27:53.932699+0000","last_became_active":"2023-10-09T06:27:53.929878+0000","last_became_peered":"2023-10-09T06:27:53.929878+0000","last_unstale":"2023-10-09T06:27:53.932699+0000","last_undegraded":"2023-10-09T06:27:53.932699+0000","last_fullsized":"2023-10-09T06:27:53.932699+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:28.851401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934655+0000","last_change":"2023-10-09T06:27:53.934514+0000","last_active":"2023-10-09T06:27:53.934655+0000","last_peered":"2023-10-09T06:27:53.934655+0000","last_clean":"2023-10-09T06:27:53.934655+0000","last_became_active":"2023-10-09T06:27:53.934162+0000","last_became_peered":"2023-10-09T06:27:53.934162+0000","last_unstale":"2023-10-09T06:27:53.934655+0000","last_undegraded":"2023-10-09T06:27:53.934655+0000","last_fullsized":"2023-10-09T06:27:53.934655+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:53.233334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931910+0000","last_change":"2023-10-09T06:27:53.929981+0000","last_active":"2023-10-09T06:27:53.931910+0000","last_peered":"2023-10-09T06:27:53.931910+0000","last_clean":"2023-10-09T06:27:53.931910+0000","last_became_active":"2023-10-09T06:27:53.929704+0000","last_became_peered":"2023-10-09T06:27:53.929704+0000","last_unstale":"2023-10-09T06:27:53.931910+0000","last_undegraded":"2023-10-09T06:27:53.931910+0000","last_fullsized":"2023-10-09T06:27:53.931910+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:08.541119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933836+0000","last_change":"2023-10-09T06:27:53.933774+0000","last_active":"2023-10-09T06:27:53.933836+0000","last_peered":"2023-10-09T06:27:53.933836+0000","last_clean":"2023-10-09T06:27:53.933836+0000","last_became_active":"2023-10-09T06:27:53.933400+0000","last_became_peered":"2023-10-09T06:27:53.933400+0000","last_unstale":"2023-10-09T06:27:53.933836+0000","last_undegraded":"2023-10-09T06:27:53.933836+0000","last_fullsized":"2023-10-09T06:27:53.933836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:19.247833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932320+0000","last_change":"2023-10-09T06:27:53.932149+0000","last_active":"2023-10-09T06:27:53.932320+0000","last_peered":"2023-10-09T06:27:53.932320+0000","last_clean":"2023-10-09T06:27:53.932320+0000","last_became_active":"2023-10-09T06:27:53.931915+0000","last_became_peered":"2023-10-09T06:27:53.931915+0000","last_unstale":"2023-10-09T06:27:53.932320+0000","last_undegraded":"2023-10-09T06:27:53.932320+0000","last_fullsized":"2023-10-09T06:27:53.932320+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:54.943386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936737+0000","last_change":"2023-10-09T06:27:53.936102+0000","last_active":"2023-10-09T06:27:53.936737+0000","last_peered":"2023-10-09T06:27:53.936737+0000","last_clean":"2023-10-09T06:27:53.936737+0000","last_became_active":"2023-10-09T06:27:53.935870+0000","last_became_peered":"2023-10-09T06:27:53.935870+0000","last_unstale":"2023-10-09T06:27:53.936737+0000","last_undegraded":"2023-10-09T06:27:53.936737+0000","last_fullsized":"2023-10-09T06:27:53.936737+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:10.148649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932675+0000","last_change":"2023-10-09T06:27:53.932545+0000","last_active":"2023-10-09T06:27:53.932675+0000","last_peered":"2023-10-09T06:27:53.932675+0000","last_clean":"2023-10-09T06:27:53.932675+0000","last_became_active":"2023-10-09T06:27:53.932183+0000","last_became_peered":"2023-10-09T06:27:53.932183+0000","last_unstale":"2023-10-09T06:27:53.932675+0000","last_undegraded":"2023-10-09T06:27:53.932675+0000","last_fullsized":"2023-10-09T06:27:53.932675+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:30.199496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933969+0000","last_change":"2023-10-09T06:27:53.933324+0000","last_active":"2023-10-09T06:27:53.933969+0000","last_peered":"2023-10-09T06:27:53.933969+0000","last_clean":"2023-10-09T06:27:53.933969+0000","last_became_active":"2023-10-09T06:27:53.933084+0000","last_became_peered":"2023-10-09T06:27:53.933084+0000","last_unstale":"2023-10-09T06:27:53.933969+0000","last_undegraded":"2023-10-09T06:27:53.933969+0000","last_fullsized":"2023-10-09T06:27:53.933969+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:21:36.823652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931066+0000","last_change":"2023-10-09T06:27:53.931005+0000","last_active":"2023-10-09T06:27:53.931066+0000","last_peered":"2023-10-09T06:27:53.931066+0000","last_clean":"2023-10-09T06:27:53.931066+0000","last_became_active":"2023-10-09T06:27:53.930776+0000","last_became_peered":"2023-10-09T06:27:53.930776+0000","last_unstale":"2023-10-09T06:27:53.931066+0000","last_undegraded":"2023-10-09T06:27:53.931066+0000","last_fullsized":"2023-10-09T06:27:53.931066+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:09.846466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936519+0000","last_change":"2023-10-09T06:27:53.936453+0000","last_active":"2023-10-09T06:27:53.936519+0000","last_peered":"2023-10-09T06:27:53.936519+0000","last_clean":"2023-10-09T06:27:53.936519+0000","last_became_active":"2023-10-09T06:27:53.936204+0000","last_became_peered":"2023-10-09T06:27:53.936204+0000","last_unstale":"2023-10-09T06:27:53.936519+0000","last_undegraded":"2023-10-09T06:27:53.936519+0000","last_fullsized":"2023-10-09T06:27:53.936519+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:16.687263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936785+0000","last_change":"2023-10-09T06:27:53.934421+0000","last_active":"2023-10-09T06:27:53.936785+0000","last_peered":"2023-10-09T06:27:53.936785+0000","last_clean":"2023-10-09T06:27:53.936785+0000","last_became_active":"2023-10-09T06:27:53.933677+0000","last_became_peered":"2023-10-09T06:27:53.933677+0000","last_unstale":"2023-10-09T06:27:53.936785+0000","last_undegraded":"2023-10-09T06:27:53.936785+0000","last_fullsized":"2023-10-09T06:27:53.936785+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:51.778135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936819+0000","last_change":"2023-10-09T06:27:53.934598+0000","last_active":"2023-10-09T06:27:53.936819+0000","last_peered":"2023-10-09T06:27:53.936819+0000","last_clean":"2023-10-09T06:27:53.936819+0000","last_became_active":"2023-10-09T06:27:53.934282+0000","last_became_peered":"2023-10-09T06:27:53.934282+0000","last_unstale":"2023-10-09T06:27:53.936819+0000","last_undegraded":"2023-10-09T06:27:53.936819+0000","last_fullsized":"2023-10-09T06:27:53.936819+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:06.413749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934504+0000","last_change":"2023-10-09T06:27:53.934424+0000","last_active":"2023-10-09T06:27:53.934504+0000","last_peered":"2023-10-09T06:27:53.934504+0000","last_clean":"2023-10-09T06:27:53.934504+0000","last_became_active":"2023-10-09T06:27:53.934180+0000","last_became_peered":"2023-10-09T06:27:53.934180+0000","last_unstale":"2023-10-09T06:27:53.934504+0000","last_undegraded":"2023-10-09T06:27:53.934504+0000","last_fullsized":"2023-10-09T06:27:53.934504+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:21:15.952486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933511+0000","last_change":"2023-10-09T06:27:53.933431+0000","last_active":"2023-10-09T06:27:53.933511+0000","last_peered":"2023-10-09T06:27:53.933511+0000","last_clean":"2023-10-09T06:27:53.933511+0000","last_became_active":"2023-10-09T06:27:53.933020+0000","last_became_peered":"2023-10-09T06:27:53.933020+0000","last_unstale":"2023-10-09T06:27:53.933511+0000","last_undegraded":"2023-10-09T06:27:53.933511+0000","last_fullsized":"2023-10-09T06:27:53.933511+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:43.819504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934638+0000","last_change":"2023-10-09T06:27:53.934244+0000","last_active":"2023-10-09T06:27:53.934638+0000","last_peered":"2023-10-09T06:27:53.934638+0000","last_clean":"2023-10-09T06:27:53.934638+0000","last_became_active":"2023-10-09T06:27:53.933816+0000","last_became_peered":"2023-10-09T06:27:53.933816+0000","last_unstale":"2023-10-09T06:27:53.934638+0000","last_undegraded":"2023-10-09T06:27:53.934638+0000","last_fullsized":"2023-10-09T06:27:53.934638+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:36.790853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"151'4","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945243+0000","last_change":"2023-10-09T06:27:52.935663+0000","last_active":"2023-10-09T06:27:53.945243+0000","last_peered":"2023-10-09T06:27:53.945243+0000","last_clean":"2023-10-09T06:27:53.945243+0000","last_became_active":"2023-10-09T06:27:52.935442+0000","last_became_peered":"2023-10-09T06:27:52.935442+0000","last_unstale":"2023-10-09T06:27:53.945243+0000","last_undegraded":"2023-10-09T06:27:53.945243+0000","last_fullsized":"2023-10-09T06:27:53.945243+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:17.467616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931066+0000","last_change":"2023-10-09T06:27:53.930969+0000","last_active":"2023-10-09T06:27:53.931066+0000","last_peered":"2023-10-09T06:27:53.931066+0000","last_clean":"2023-10-09T06:27:53.931066+0000","last_became_active":"2023-10-09T06:27:53.930634+0000","last_became_peered":"2023-10-09T06:27:53.930634+0000","last_unstale":"2023-10-09T06:27:53.931066+0000","last_undegraded":"2023-10-09T06:27:53.931066+0000","last_fullsized":"2023-10-09T06:27:53.931066+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:18.472028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944722+0000","last_change":"2023-10-09T06:27:52.935490+0000","last_active":"2023-10-09T06:27:53.944722+0000","last_peered":"2023-10-09T06:27:53.944722+0000","last_clean":"2023-10-09T06:27:53.944722+0000","last_became_active":"2023-10-09T06:27:52.935253+0000","last_became_peered":"2023-10-09T06:27:52.935253+0000","last_unstale":"2023-10-09T06:27:53.944722+0000","last_undegraded":"2023-10-09T06:27:53.944722+0000","last_fullsized":"2023-10-09T06:27:53.944722+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:32.422666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931949+0000","last_change":"2023-10-09T06:27:53.931529+0000","last_active":"2023-10-09T06:27:53.931949+0000","last_peered":"2023-10-09T06:27:53.931949+0000","last_clean":"2023-10-09T06:27:53.931949+0000","last_became_active":"2023-10-09T06:27:53.931272+0000","last_became_peered":"2023-10-09T06:27:53.931272+0000","last_unstale":"2023-10-09T06:27:53.931949+0000","last_undegraded":"2023-10-09T06:27:53.931949+0000","last_fullsized":"2023-10-09T06:27:53.931949+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:52.371297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.943796+0000","last_change":"2023-10-09T06:27:52.935839+0000","last_active":"2023-10-09T06:27:53.943796+0000","last_peered":"2023-10-09T06:27:53.943796+0000","last_clean":"2023-10-09T06:27:53.943796+0000","last_became_active":"2023-10-09T06:27:52.935587+0000","last_became_peered":"2023-10-09T06:27:52.935587+0000","last_unstale":"2023-10-09T06:27:53.943796+0000","last_undegraded":"2023-10-09T06:27:53.943796+0000","last_fullsized":"2023-10-09T06:27:53.943796+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:08.477367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936389+0000","last_change":"2023-10-09T06:27:53.936220+0000","last_active":"2023-10-09T06:27:53.936389+0000","last_peered":"2023-10-09T06:27:53.936389+0000","last_clean":"2023-10-09T06:27:53.936389+0000","last_became_active":"2023-10-09T06:27:53.935141+0000","last_became_peered":"2023-10-09T06:27:53.935141+0000","last_unstale":"2023-10-09T06:27:53.936389+0000","last_undegraded":"2023-10-09T06:27:53.936389+0000","last_fullsized":"2023-10-09T06:27:53.936389+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:32.142862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944534+0000","last_change":"2023-10-09T06:27:52.933698+0000","last_active":"2023-10-09T06:27:53.944534+0000","last_peered":"2023-10-09T06:27:53.944534+0000","last_clean":"2023-10-09T06:27:53.944534+0000","last_became_active":"2023-10-09T06:27:52.933257+0000","last_became_peered":"2023-10-09T06:27:52.933257+0000","last_unstale":"2023-10-09T06:27:53.944534+0000","last_undegraded":"2023-10-09T06:27:53.944534+0000","last_fullsized":"2023-10-09T06:27:53.944534+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:38.688820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.938160+0000","last_change":"2023-10-09T06:27:53.938087+0000","last_active":"2023-10-09T06:27:53.938160+0000","last_peered":"2023-10-09T06:27:53.938160+0000","last_clean":"2023-10-09T06:27:53.938160+0000","last_became_active":"2023-10-09T06:27:53.937736+0000","last_became_peered":"2023-10-09T06:27:53.937736+0000","last_unstale":"2023-10-09T06:27:53.938160+0000","last_undegraded":"2023-10-09T06:27:53.938160+0000","last_fullsized":"2023-10-09T06:27:53.938160+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:08.541119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945458+0000","last_change":"2023-10-09T06:27:52.931663+0000","last_active":"2023-10-09T06:27:53.945458+0000","last_peered":"2023-10-09T06:27:53.945458+0000","last_clean":"2023-10-09T06:27:53.945458+0000","last_became_active":"2023-10-09T06:27:52.930668+0000","last_became_peered":"2023-10-09T06:27:52.930668+0000","last_unstale":"2023-10-09T06:27:53.945458+0000","last_undegraded":"2023-10-09T06:27:53.945458+0000","last_fullsized":"2023-10-09T06:27:53.945458+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:46.138879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933381+0000","last_change":"2023-10-09T06:27:53.933267+0000","last_active":"2023-10-09T06:27:53.933381+0000","last_peered":"2023-10-09T06:27:53.933381+0000","last_clean":"2023-10-09T06:27:53.933381+0000","last_became_active":"2023-10-09T06:27:53.932673+0000","last_became_peered":"2023-10-09T06:27:53.932673+0000","last_unstale":"2023-10-09T06:27:53.933381+0000","last_undegraded":"2023-10-09T06:27:53.933381+0000","last_fullsized":"2023-10-09T06:27:53.933381+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:54.943386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945803+0000","last_change":"2023-10-09T06:27:52.927612+0000","last_active":"2023-10-09T06:27:53.945803+0000","last_peered":"2023-10-09T06:27:53.945803+0000","last_clean":"2023-10-09T06:27:53.945803+0000","last_became_active":"2023-10-09T06:27:52.927332+0000","last_became_peered":"2023-10-09T06:27:52.927332+0000","last_unstale":"2023-10-09T06:27:53.945803+0000","last_undegraded":"2023-10-09T06:27:53.945803+0000","last_fullsized":"2023-10-09T06:27:53.945803+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:42.815093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933858+0000","last_change":"2023-10-09T06:27:53.933645+0000","last_active":"2023-10-09T06:27:53.933858+0000","last_peered":"2023-10-09T06:27:53.933858+0000","last_clean":"2023-10-09T06:27:53.933858+0000","last_became_active":"2023-10-09T06:27:53.933048+0000","last_became_peered":"2023-10-09T06:27:53.933048+0000","last_unstale":"2023-10-09T06:27:53.933858+0000","last_undegraded":"2023-10-09T06:27:53.933858+0000","last_fullsized":"2023-10-09T06:27:53.933858+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:35.399846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.923358+0000","last_change":"2023-10-09T06:27:52.936229+0000","last_active":"2023-10-09T06:27:53.923358+0000","last_peered":"2023-10-09T06:27:53.923358+0000","last_clean":"2023-10-09T06:27:53.923358+0000","last_became_active":"2023-10-09T06:27:52.936013+0000","last_became_peered":"2023-10-09T06:27:52.936013+0000","last_unstale":"2023-10-09T06:27:53.923358+0000","last_undegraded":"2023-10-09T06:27:53.923358+0000","last_fullsized":"2023-10-09T06:27:53.923358+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:56.795700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932645+0000","last_change":"2023-10-09T06:27:53.932244+0000","last_active":"2023-10-09T06:27:53.932645+0000","last_peered":"2023-10-09T06:27:53.932645+0000","last_clean":"2023-10-09T06:27:53.932645+0000","last_became_active":"2023-10-09T06:27:53.931886+0000","last_became_peered":"2023-10-09T06:27:53.931886+0000","last_unstale":"2023-10-09T06:27:53.932645+0000","last_undegraded":"2023-10-09T06:27:53.932645+0000","last_fullsized":"2023-10-09T06:27:53.932645+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:39:52.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.923451+0000","last_change":"2023-10-09T06:27:52.933160+0000","last_active":"2023-10-09T06:27:53.923451+0000","last_peered":"2023-10-09T06:27:53.923451+0000","last_clean":"2023-10-09T06:27:53.923451+0000","last_became_active":"2023-10-09T06:27:52.932999+0000","last_became_peered":"2023-10-09T06:27:52.932999+0000","last_unstale":"2023-10-09T06:27:53.923451+0000","last_undegraded":"2023-10-09T06:27:53.923451+0000","last_fullsized":"2023-10-09T06:27:53.923451+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:17.202095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936884+0000","last_change":"2023-10-09T06:27:53.936338+0000","last_active":"2023-10-09T06:27:53.936884+0000","last_peered":"2023-10-09T06:27:53.936884+0000","last_clean":"2023-10-09T06:27:53.936884+0000","last_became_active":"2023-10-09T06:27:53.936068+0000","last_became_peered":"2023-10-09T06:27:53.936068+0000","last_unstale":"2023-10-09T06:27:53.936884+0000","last_undegraded":"2023-10-09T06:27:53.936884+0000","last_fullsized":"2023-10-09T06:27:53.936884+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:07.136944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928236+0000","last_change":"2023-10-09T06:27:52.933145+0000","last_active":"2023-10-09T06:27:53.928236+0000","last_peered":"2023-10-09T06:27:53.928236+0000","last_clean":"2023-10-09T06:27:53.928236+0000","last_became_active":"2023-10-09T06:27:52.932892+0000","last_became_peered":"2023-10-09T06:27:52.932892+0000","last_unstale":"2023-10-09T06:27:53.928236+0000","last_undegraded":"2023-10-09T06:27:53.928236+0000","last_fullsized":"2023-10-09T06:27:53.928236+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:31.043111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935284+0000","last_change":"2023-10-09T06:27:53.935205+0000","last_active":"2023-10-09T06:27:53.935284+0000","last_peered":"2023-10-09T06:27:53.935284+0000","last_clean":"2023-10-09T06:27:53.935284+0000","last_became_active":"2023-10-09T06:27:53.934775+0000","last_became_peered":"2023-10-09T06:27:53.934775+0000","last_unstale":"2023-10-09T06:27:53.935284+0000","last_undegraded":"2023-10-09T06:27:53.935284+0000","last_fullsized":"2023-10-09T06:27:53.935284+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:39:52.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928582+0000","last_change":"2023-10-09T06:27:52.932076+0000","last_active":"2023-10-09T06:27:53.928582+0000","last_peered":"2023-10-09T06:27:53.928582+0000","last_clean":"2023-10-09T06:27:53.928582+0000","last_became_active":"2023-10-09T06:27:52.931652+0000","last_became_peered":"2023-10-09T06:27:52.931652+0000","last_unstale":"2023-10-09T06:27:53.928582+0000","last_undegraded":"2023-10-09T06:27:53.928582+0000","last_fullsized":"2023-10-09T06:27:53.928582+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:53.938974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934487+0000","last_change":"2023-10-09T06:27:53.934378+0000","last_active":"2023-10-09T06:27:53.934487+0000","last_peered":"2023-10-09T06:27:53.934487+0000","last_clean":"2023-10-09T06:27:53.934487+0000","last_became_active":"2023-10-09T06:27:53.934156+0000","last_became_peered":"2023-10-09T06:27:53.934156+0000","last_unstale":"2023-10-09T06:27:53.934487+0000","last_undegraded":"2023-10-09T06:27:53.934487+0000","last_fullsized":"2023-10-09T06:27:53.934487+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:24.340452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"151'3","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945951+0000","last_change":"2023-10-09T06:27:52.931973+0000","last_active":"2023-10-09T06:27:53.945951+0000","last_peered":"2023-10-09T06:27:53.945951+0000","last_clean":"2023-10-09T06:27:53.945951+0000","last_became_active":"2023-10-09T06:27:52.931677+0000","last_became_peered":"2023-10-09T06:27:52.931677+0000","last_unstale":"2023-10-09T06:27:53.945951+0000","last_undegraded":"2023-10-09T06:27:53.945951+0000","last_fullsized":"2023-10-09T06:27:53.945951+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:52:38.654562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935456+0000","last_change":"2023-10-09T06:27:53.935392+0000","last_active":"2023-10-09T06:27:53.935456+0000","last_peered":"2023-10-09T06:27:53.935456+0000","last_clean":"2023-10-09T06:27:53.935456+0000","last_became_active":"2023-10-09T06:27:53.934928+0000","last_became_peered":"2023-10-09T06:27:53.934928+0000","last_unstale":"2023-10-09T06:27:53.935456+0000","last_undegraded":"2023-10-09T06:27:53.935456+0000","last_fullsized":"2023-10-09T06:27:53.935456+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:00.559448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"151'6","reported_seq":16,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.946402+0000","last_change":"2023-10-09T06:27:52.933173+0000","last_active":"2023-10-09T06:27:53.946402+0000","last_peered":"2023-10-09T06:27:53.946402+0000","last_clean":"2023-10-09T06:27:53.946402+0000","last_became_active":"2023-10-09T06:27:52.932948+0000","last_became_peered":"2023-10-09T06:27:52.932948+0000","last_unstale":"2023-10-09T06:27:53.946402+0000","last_undegraded":"2023-10-09T06:27:53.946402+0000","last_fullsized":"2023-10-09T06:27:53.946402+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:01.012691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933660+0000","last_change":"2023-10-09T06:27:53.933596+0000","last_active":"2023-10-09T06:27:53.933660+0000","last_peered":"2023-10-09T06:27:53.933660+0000","last_clean":"2023-10-09T06:27:53.933660+0000","last_became_active":"2023-10-09T06:27:53.933330+0000","last_became_peered":"2023-10-09T06:27:53.933330+0000","last_unstale":"2023-10-09T06:27:53.933660+0000","last_undegraded":"2023-10-09T06:27:53.933660+0000","last_fullsized":"2023-10-09T06:27:53.933660+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:33.967623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.926380+0000","last_change":"2023-10-09T06:27:52.937327+0000","last_active":"2023-10-09T06:27:53.926380+0000","last_peered":"2023-10-09T06:27:53.926380+0000","last_clean":"2023-10-09T06:27:53.926380+0000","last_became_active":"2023-10-09T06:27:52.937095+0000","last_became_peered":"2023-10-09T06:27:52.937095+0000","last_unstale":"2023-10-09T06:27:53.926380+0000","last_undegraded":"2023-10-09T06:27:53.926380+0000","last_fullsized":"2023-10-09T06:27:53.926380+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:44.302806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.926399+0000","last_change":"2023-10-09T06:27:53.926335+0000","last_active":"2023-10-09T06:27:53.926399+0000","last_peered":"2023-10-09T06:27:53.926399+0000","last_clean":"2023-10-09T06:27:53.926399+0000","last_became_active":"2023-10-09T06:27:53.926099+0000","last_became_peered":"2023-10-09T06:27:53.926099+0000","last_unstale":"2023-10-09T06:27:53.926399+0000","last_undegraded":"2023-10-09T06:27:53.926399+0000","last_fullsized":"2023-10-09T06:27:53.926399+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:16.687263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.922841+0000","last_change":"2023-10-09T06:27:52.931810+0000","last_active":"2023-10-09T06:27:53.922841+0000","last_peered":"2023-10-09T06:27:53.922841+0000","last_clean":"2023-10-09T06:27:53.922841+0000","last_became_active":"2023-10-09T06:27:52.931440+0000","last_became_peered":"2023-10-09T06:27:52.931440+0000","last_unstale":"2023-10-09T06:27:53.922841+0000","last_undegraded":"2023-10-09T06:27:53.922841+0000","last_fullsized":"2023-10-09T06:27:53.922841+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:32.963211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931638+0000","last_change":"2023-10-09T06:27:53.931392+0000","last_active":"2023-10-09T06:27:53.931638+0000","last_peered":"2023-10-09T06:27:53.931638+0000","last_clean":"2023-10-09T06:27:53.931638+0000","last_became_active":"2023-10-09T06:27:53.930853+0000","last_became_peered":"2023-10-09T06:27:53.930853+0000","last_unstale":"2023-10-09T06:27:53.931638+0000","last_undegraded":"2023-10-09T06:27:53.931638+0000","last_fullsized":"2023-10-09T06:27:53.931638+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:17:02.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"151'8","reported_seq":18,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.946781+0000","last_change":"2023-10-09T06:27:52.935565+0000","last_active":"2023-10-09T06:27:53.946781+0000","last_peered":"2023-10-09T06:27:53.946781+0000","last_clean":"2023-10-09T06:27:53.946781+0000","last_became_active":"2023-10-09T06:27:52.935254+0000","last_became_peered":"2023-10-09T06:27:52.935254+0000","last_unstale":"2023-10-09T06:27:53.946781+0000","last_undegraded":"2023-10-09T06:27:53.946781+0000","last_fullsized":"2023-10-09T06:27:53.946781+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:32.422666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933875+0000","last_change":"2023-10-09T06:27:53.933786+0000","last_active":"2023-10-09T06:27:53.933875+0000","last_peered":"2023-10-09T06:27:53.933875+0000","last_clean":"2023-10-09T06:27:53.933875+0000","last_became_active":"2023-10-09T06:27:53.933351+0000","last_became_peered":"2023-10-09T06:27:53.933351+0000","last_unstale":"2023-10-09T06:27:53.933875+0000","last_undegraded":"2023-10-09T06:27:53.933875+0000","last_fullsized":"2023-10-09T06:27:53.933875+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:37:13.894431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944881+0000","last_change":"2023-10-09T06:27:52.931092+0000","last_active":"2023-10-09T06:27:53.944881+0000","last_peered":"2023-10-09T06:27:53.944881+0000","last_clean":"2023-10-09T06:27:53.944881+0000","last_became_active":"2023-10-09T06:27:52.930803+0000","last_became_peered":"2023-10-09T06:27:52.930803+0000","last_unstale":"2023-10-09T06:27:53.944881+0000","last_undegraded":"2023-10-09T06:27:53.944881+0000","last_fullsized":"2023-10-09T06:27:53.944881+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:15.437434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.939322+0000","last_change":"2023-10-09T06:27:53.939245+0000","last_active":"2023-10-09T06:27:53.939322+0000","last_peered":"2023-10-09T06:27:53.939322+0000","last_clean":"2023-10-09T06:27:53.939322+0000","last_became_active":"2023-10-09T06:27:53.938801+0000","last_became_peered":"2023-10-09T06:27:53.938801+0000","last_unstale":"2023-10-09T06:27:53.939322+0000","last_undegraded":"2023-10-09T06:27:53.939322+0000","last_fullsized":"2023-10-09T06:27:53.939322+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.029150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945515+0000","last_change":"2023-10-09T06:27:52.932657+0000","last_active":"2023-10-09T06:27:53.945515+0000","last_peered":"2023-10-09T06:27:53.945515+0000","last_clean":"2023-10-09T06:27:53.945515+0000","last_became_active":"2023-10-09T06:27:52.932402+0000","last_became_peered":"2023-10-09T06:27:52.932402+0000","last_unstale":"2023-10-09T06:27:53.945515+0000","last_undegraded":"2023-10-09T06:27:53.945515+0000","last_fullsized":"2023-10-09T06:27:53.945515+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:51.366885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933951+0000","last_change":"2023-10-09T06:27:53.933290+0000","last_active":"2023-10-09T06:27:53.933951+0000","last_peered":"2023-10-09T06:27:53.933951+0000","last_clean":"2023-10-09T06:27:53.933951+0000","last_became_active":"2023-10-09T06:27:53.933030+0000","last_became_peered":"2023-10-09T06:27:53.933030+0000","last_unstale":"2023-10-09T06:27:53.933951+0000","last_undegraded":"2023-10-09T06:27:53.933951+0000","last_fullsized":"2023-10-09T06:27:53.933951+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:21:15.952486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.943364+0000","last_change":"2023-10-09T06:27:52.935532+0000","last_active":"2023-10-09T06:27:53.943364+0000","last_peered":"2023-10-09T06:27:53.943364+0000","last_clean":"2023-10-09T06:27:53.943364+0000","last_became_active":"2023-10-09T06:27:52.935305+0000","last_became_peered":"2023-10-09T06:27:52.935305+0000","last_unstale":"2023-10-09T06:27:53.943364+0000","last_undegraded":"2023-10-09T06:27:53.943364+0000","last_fullsized":"2023-10-09T06:27:53.943364+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:30:56.562227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935623+0000","last_change":"2023-10-09T06:27:53.935424+0000","last_active":"2023-10-09T06:27:53.935623+0000","last_peered":"2023-10-09T06:27:53.935623+0000","last_clean":"2023-10-09T06:27:53.935623+0000","last_became_active":"2023-10-09T06:27:53.934889+0000","last_became_peered":"2023-10-09T06:27:53.934889+0000","last_unstale":"2023-10-09T06:27:53.935623+0000","last_undegraded":"2023-10-09T06:27:53.935623+0000","last_fullsized":"2023-10-09T06:27:53.935623+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:30:57.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929879+0000","last_change":"2023-10-09T06:27:52.932310+0000","last_active":"2023-10-09T06:27:53.929879+0000","last_peered":"2023-10-09T06:27:53.929879+0000","last_clean":"2023-10-09T06:27:53.929879+0000","last_became_active":"2023-10-09T06:27:52.932078+0000","last_became_peered":"2023-10-09T06:27:52.932078+0000","last_unstale":"2023-10-09T06:27:53.929879+0000","last_undegraded":"2023-10-09T06:27:53.929879+0000","last_fullsized":"2023-10-09T06:27:53.929879+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:41.167438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936847+0000","last_change":"2023-10-09T06:27:53.935211+0000","last_active":"2023-10-09T06:27:53.936847+0000","last_peered":"2023-10-09T06:27:53.936847+0000","last_clean":"2023-10-09T06:27:53.936847+0000","last_became_active":"2023-10-09T06:27:53.934962+0000","last_became_peered":"2023-10-09T06:27:53.934962+0000","last_unstale":"2023-10-09T06:27:53.936847+0000","last_undegraded":"2023-10-09T06:27:53.936847+0000","last_fullsized":"2023-10-09T06:27:53.936847+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:09:41.794786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944429+0000","last_change":"2023-10-09T06:27:52.934337+0000","last_active":"2023-10-09T06:27:53.944429+0000","last_peered":"2023-10-09T06:27:53.944429+0000","last_clean":"2023-10-09T06:27:53.944429+0000","last_became_active":"2023-10-09T06:27:52.934093+0000","last_became_peered":"2023-10-09T06:27:52.934093+0000","last_unstale":"2023-10-09T06:27:53.944429+0000","last_undegraded":"2023-10-09T06:27:53.944429+0000","last_fullsized":"2023-10-09T06:27:53.944429+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:01.012691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.927994+0000","last_change":"2023-10-09T06:27:53.926120+0000","last_active":"2023-10-09T06:27:53.927994+0000","last_peered":"2023-10-09T06:27:53.927994+0000","last_clean":"2023-10-09T06:27:53.927994+0000","last_became_active":"2023-10-09T06:27:53.925870+0000","last_became_peered":"2023-10-09T06:27:53.925870+0000","last_unstale":"2023-10-09T06:27:53.927994+0000","last_undegraded":"2023-10-09T06:27:53.927994+0000","last_fullsized":"2023-10-09T06:27:53.927994+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:34.259293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928683+0000","last_change":"2023-10-09T06:27:52.933464+0000","last_active":"2023-10-09T06:27:53.928683+0000","last_peered":"2023-10-09T06:27:53.928683+0000","last_clean":"2023-10-09T06:27:53.928683+0000","last_became_active":"2023-10-09T06:27:52.933028+0000","last_became_peered":"2023-10-09T06:27:52.933028+0000","last_unstale":"2023-10-09T06:27:53.928683+0000","last_undegraded":"2023-10-09T06:27:53.928683+0000","last_fullsized":"2023-10-09T06:27:53.928683+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:17.467616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935640+0000","last_change":"2023-10-09T06:27:53.935550+0000","last_active":"2023-10-09T06:27:53.935640+0000","last_peered":"2023-10-09T06:27:53.935640+0000","last_clean":"2023-10-09T06:27:53.935640+0000","last_became_active":"2023-10-09T06:27:53.935183+0000","last_became_peered":"2023-10-09T06:27:53.935183+0000","last_unstale":"2023-10-09T06:27:53.935640+0000","last_undegraded":"2023-10-09T06:27:53.935640+0000","last_fullsized":"2023-10-09T06:27:53.935640+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:33.427078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929270+0000","last_change":"2023-10-09T06:27:52.928446+0000","last_active":"2023-10-09T06:27:53.929270+0000","last_peered":"2023-10-09T06:27:53.929270+0000","last_clean":"2023-10-09T06:27:53.929270+0000","last_became_active":"2023-10-09T06:27:52.928210+0000","last_became_peered":"2023-10-09T06:27:52.928210+0000","last_unstale":"2023-10-09T06:27:53.929270+0000","last_undegraded":"2023-10-09T06:27:53.929270+0000","last_fullsized":"2023-10-09T06:27:53.929270+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:34.395434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936406+0000","last_change":"2023-10-09T06:27:53.936346+0000","last_active":"2023-10-09T06:27:53.936406+0000","last_peered":"2023-10-09T06:27:53.936406+0000","last_clean":"2023-10-09T06:27:53.936406+0000","last_became_active":"2023-10-09T06:27:53.935987+0000","last_became_peered":"2023-10-09T06:27:53.935987+0000","last_unstale":"2023-10-09T06:27:53.936406+0000","last_undegraded":"2023-10-09T06:27:53.936406+0000","last_fullsized":"2023-10-09T06:27:53.936406+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:36.790853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929540+0000","last_change":"2023-10-09T06:27:52.932636+0000","last_active":"2023-10-09T06:27:53.929540+0000","last_peered":"2023-10-09T06:27:53.929540+0000","last_clean":"2023-10-09T06:27:53.929540+0000","last_became_active":"2023-10-09T06:27:52.932394+0000","last_became_peered":"2023-10-09T06:27:52.932394+0000","last_unstale":"2023-10-09T06:27:53.929540+0000","last_undegraded":"2023-10-09T06:27:53.929540+0000","last_fullsized":"2023-10-09T06:27:53.929540+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:12.418152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933150+0000","last_change":"2023-10-09T06:27:53.933075+0000","last_active":"2023-10-09T06:27:53.933150+0000","last_peered":"2023-10-09T06:27:53.933150+0000","last_clean":"2023-10-09T06:27:53.933150+0000","last_became_active":"2023-10-09T06:27:53.932578+0000","last_became_peered":"2023-10-09T06:27:53.932578+0000","last_unstale":"2023-10-09T06:27:53.933150+0000","last_undegraded":"2023-10-09T06:27:53.933150+0000","last_fullsized":"2023-10-09T06:27:53.933150+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:35.399846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.943627+0000","last_change":"2023-10-09T06:27:52.936108+0000","last_active":"2023-10-09T06:27:53.943627+0000","last_peered":"2023-10-09T06:27:53.943627+0000","last_clean":"2023-10-09T06:27:53.943627+0000","last_became_active":"2023-10-09T06:27:52.933621+0000","last_became_peered":"2023-10-09T06:27:52.933621+0000","last_unstale":"2023-10-09T06:27:53.943627+0000","last_undegraded":"2023-10-09T06:27:53.943627+0000","last_fullsized":"2023-10-09T06:27:53.943627+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:19.208277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932631+0000","last_change":"2023-10-09T06:27:53.932560+0000","last_active":"2023-10-09T06:27:53.932631+0000","last_peered":"2023-10-09T06:27:53.932631+0000","last_clean":"2023-10-09T06:27:53.932631+0000","last_became_active":"2023-10-09T06:27:53.932325+0000","last_became_peered":"2023-10-09T06:27:53.932325+0000","last_unstale":"2023-10-09T06:27:53.932631+0000","last_undegraded":"2023-10-09T06:27:53.932631+0000","last_fullsized":"2023-10-09T06:27:53.932631+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:07.101614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929099+0000","last_change":"2023-10-09T06:27:52.936079+0000","last_active":"2023-10-09T06:27:53.929099+0000","last_peered":"2023-10-09T06:27:53.929099+0000","last_clean":"2023-10-09T06:27:53.929099+0000","last_became_active":"2023-10-09T06:27:52.935872+0000","last_became_peered":"2023-10-09T06:27:52.935872+0000","last_unstale":"2023-10-09T06:27:53.929099+0000","last_undegraded":"2023-10-09T06:27:53.929099+0000","last_fullsized":"2023-10-09T06:27:53.929099+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:53.273517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932660+0000","last_change":"2023-10-09T06:27:53.932416+0000","last_active":"2023-10-09T06:27:53.932660+0000","last_peered":"2023-10-09T06:27:53.932660+0000","last_clean":"2023-10-09T06:27:53.932660+0000","last_became_active":"2023-10-09T06:27:53.931881+0000","last_became_peered":"2023-10-09T06:27:53.931881+0000","last_unstale":"2023-10-09T06:27:53.932660+0000","last_undegraded":"2023-10-09T06:27:53.932660+0000","last_fullsized":"2023-10-09T06:27:53.932660+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:00.721099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.922920+0000","last_change":"2023-10-09T06:27:52.936040+0000","last_active":"2023-10-09T06:27:53.922920+0000","last_peered":"2023-10-09T06:27:53.922920+0000","last_clean":"2023-10-09T06:27:53.922920+0000","last_became_active":"2023-10-09T06:27:52.935583+0000","last_became_peered":"2023-10-09T06:27:52.935583+0000","last_unstale":"2023-10-09T06:27:53.922920+0000","last_undegraded":"2023-10-09T06:27:53.922920+0000","last_fullsized":"2023-10-09T06:27:53.922920+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:11.452245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932055+0000","last_change":"2023-10-09T06:27:53.931942+0000","last_active":"2023-10-09T06:27:53.932055+0000","last_peered":"2023-10-09T06:27:53.932055+0000","last_clean":"2023-10-09T06:27:53.932055+0000","last_became_active":"2023-10-09T06:27:53.931696+0000","last_became_peered":"2023-10-09T06:27:53.931696+0000","last_unstale":"2023-10-09T06:27:53.932055+0000","last_undegraded":"2023-10-09T06:27:53.932055+0000","last_fullsized":"2023-10-09T06:27:53.932055+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:20.308885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928512+0000","last_change":"2023-10-09T06:27:52.934153+0000","last_active":"2023-10-09T06:27:53.928512+0000","last_peered":"2023-10-09T06:27:53.928512+0000","last_clean":"2023-10-09T06:27:53.928512+0000","last_became_active":"2023-10-09T06:27:52.933922+0000","last_became_peered":"2023-10-09T06:27:52.933922+0000","last_unstale":"2023-10-09T06:27:53.928512+0000","last_undegraded":"2023-10-09T06:27:53.928512+0000","last_fullsized":"2023-10-09T06:27:53.928512+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:02.855389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931930+0000","last_change":"2023-10-09T06:27:53.930498+0000","last_active":"2023-10-09T06:27:53.931930+0000","last_peered":"2023-10-09T06:27:53.931930+0000","last_clean":"2023-10-09T06:27:53.931930+0000","last_became_active":"2023-10-09T06:27:53.930280+0000","last_became_peered":"2023-10-09T06:27:53.930280+0000","last_unstale":"2023-10-09T06:27:53.931930+0000","last_undegraded":"2023-10-09T06:27:53.931930+0000","last_fullsized":"2023-10-09T06:27:53.931930+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:13.422563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.923333+0000","last_change":"2023-10-09T06:27:52.933533+0000","last_active":"2023-10-09T06:27:53.923333+0000","last_peered":"2023-10-09T06:27:53.923333+0000","last_clean":"2023-10-09T06:27:53.923333+0000","last_became_active":"2023-10-09T06:27:52.932880+0000","last_became_peered":"2023-10-09T06:27:52.932880+0000","last_unstale":"2023-10-09T06:27:53.923333+0000","last_undegraded":"2023-10-09T06:27:53.923333+0000","last_fullsized":"2023-10-09T06:27:53.923333+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:06.132532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935267+0000","last_change":"2023-10-09T06:27:53.935031+0000","last_active":"2023-10-09T06:27:53.935267+0000","last_peered":"2023-10-09T06:27:53.935267+0000","last_clean":"2023-10-09T06:27:53.935267+0000","last_became_active":"2023-10-09T06:27:53.932569+0000","last_became_peered":"2023-10-09T06:27:53.932569+0000","last_unstale":"2023-10-09T06:27:53.935267+0000","last_undegraded":"2023-10-09T06:27:53.935267+0000","last_fullsized":"2023-10-09T06:27:53.935267+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:43.355926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.926693+0000","last_change":"2023-10-09T06:27:52.933739+0000","last_active":"2023-10-09T06:27:53.926693+0000","last_peered":"2023-10-09T06:27:53.926693+0000","last_clean":"2023-10-09T06:27:53.926693+0000","last_became_active":"2023-10-09T06:27:52.933302+0000","last_became_peered":"2023-10-09T06:27:52.933302+0000","last_unstale":"2023-10-09T06:27:53.926693+0000","last_undegraded":"2023-10-09T06:27:53.926693+0000","last_fullsized":"2023-10-09T06:27:53.926693+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:03.249361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933919+0000","last_change":"2023-10-09T06:27:53.932522+0000","last_active":"2023-10-09T06:27:53.933919+0000","last_peered":"2023-10-09T06:27:53.933919+0000","last_clean":"2023-10-09T06:27:53.933919+0000","last_became_active":"2023-10-09T06:27:53.932210+0000","last_became_peered":"2023-10-09T06:27:53.932210+0000","last_unstale":"2023-10-09T06:27:53.933919+0000","last_undegraded":"2023-10-09T06:27:53.933919+0000","last_fullsized":"2023-10-09T06:27:53.933919+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:32.142862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933393+0000","last_change":"2023-10-09T06:27:52.935717+0000","last_active":"2023-10-09T06:27:53.933393+0000","last_peered":"2023-10-09T06:27:53.933393+0000","last_clean":"2023-10-09T06:27:53.933393+0000","last_became_active":"2023-10-09T06:27:52.935414+0000","last_became_peered":"2023-10-09T06:27:52.935414+0000","last_unstale":"2023-10-09T06:27:53.933393+0000","last_undegraded":"2023-10-09T06:27:53.933393+0000","last_fullsized":"2023-10-09T06:27:53.933393+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:40.048060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932624+0000","last_change":"2023-10-09T06:27:53.932120+0000","last_active":"2023-10-09T06:27:53.932624+0000","last_peered":"2023-10-09T06:27:53.932624+0000","last_clean":"2023-10-09T06:27:53.932624+0000","last_became_active":"2023-10-09T06:27:53.931913+0000","last_became_peered":"2023-10-09T06:27:53.931913+0000","last_unstale":"2023-10-09T06:27:53.932624+0000","last_undegraded":"2023-10-09T06:27:53.932624+0000","last_fullsized":"2023-10-09T06:27:53.932624+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:02.017103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928803+0000","last_change":"2023-10-09T06:27:52.935326+0000","last_active":"2023-10-09T06:27:53.928803+0000","last_peered":"2023-10-09T06:27:53.928803+0000","last_clean":"2023-10-09T06:27:53.928803+0000","last_became_active":"2023-10-09T06:27:52.935101+0000","last_became_peered":"2023-10-09T06:27:52.935101+0000","last_unstale":"2023-10-09T06:27:53.928803+0000","last_undegraded":"2023-10-09T06:27:53.928803+0000","last_fullsized":"2023-10-09T06:27:53.928803+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:59.555036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.937929+0000","last_change":"2023-10-09T06:27:53.937851+0000","last_active":"2023-10-09T06:27:53.937929+0000","last_peered":"2023-10-09T06:27:53.937929+0000","last_clean":"2023-10-09T06:27:53.937929+0000","last_became_active":"2023-10-09T06:27:53.937623+0000","last_became_peered":"2023-10-09T06:27:53.937623+0000","last_unstale":"2023-10-09T06:27:53.937929+0000","last_undegraded":"2023-10-09T06:27:53.937929+0000","last_fullsized":"2023-10-09T06:27:53.937929+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:46.105971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944011+0000","last_change":"2023-10-09T06:27:52.932778+0000","last_active":"2023-10-09T06:27:53.944011+0000","last_peered":"2023-10-09T06:27:53.944011+0000","last_clean":"2023-10-09T06:27:53.944011+0000","last_became_active":"2023-10-09T06:27:52.932545+0000","last_became_peered":"2023-10-09T06:27:52.932545+0000","last_unstale":"2023-10-09T06:27:53.944011+0000","last_undegraded":"2023-10-09T06:27:53.944011+0000","last_fullsized":"2023-10-09T06:27:53.944011+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:53.938974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.926486+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:27:53.926486+0000","last_peered":"2023-10-09T06:27:53.926486+0000","last_clean":"2023-10-09T06:27:53.926486+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:27:53.926486+0000","last_undegraded":"2023-10-09T06:27:53.926486+0000","last_fullsized":"2023-10-09T06:27:53.926486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1404,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193908,"statfs":{"total":200000000,"available":198562073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.64400000000000002,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.58199999999999996,"15min":0.52700000000000002},"min":{"1min":0.378,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.73099999999999998,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.443}]},{"osd":1,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54700000000000004,"15min":0.50900000000000001},"min":{"1min":0.40400000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77600000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.51300000000000001},"min":{"1min":0.42999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71499999999999997,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.71499999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61799999999999999,"15min":0.57899999999999996},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69799999999999995,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.622},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59599999999999997,"15min":0.54400000000000004},"min":{"1min":0.44900000000000001,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.76500000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.64800000000000002,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.318},"max":{"1min":0.73199999999999998,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":0.56999999999999995},"min":{"1min":0.377,"5min":0.374,"15min":0.32400000000000001},"max":{"1min":0.76500000000000001,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.69199999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.30499999999999999,"5min":0.27200000000000002,"15min":0.23799999999999999},"max":{"1min":0.74199999999999999,"5min":0.872,"15min":0.872},"last":0.495},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.34699999999999998,"5min":0.27000000000000002,"15min":0.25600000000000001},"max":{"1min":0.76900000000000002,"5min":0.79800000000000004,"15min":0.86099999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.495,"15min":0.48399999999999999},"min":{"1min":0.375,"5min":0.255,"15min":0.255},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.47699999999999998,"5min":0.33400000000000002,"15min":0.29199999999999998},"max":{"1min":0.79900000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.61199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":827,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194485,"statfs":{"total":200000000,"available":199153051,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53100000000000003,"15min":0.72499999999999998},"min":{"1min":0.41499999999999998,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.746,"5min":0.77100000000000002,"15min":7.0960000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.80900000000000005,"15min":1.133},"last":0.628}]},{"osd":1,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":1.155},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.443,"5min":0.378,"15min":0.317},"max":{"1min":0.748,"5min":0.75600000000000001,"15min":1.1459999999999999},"last":0.64200000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.59099999999999997},"min":{"1min":0.48799999999999999,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.746,"5min":0.82999999999999996,"15min":1.2290000000000001},"last":0.502},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56200000000000006,"15min":0.73999999999999999},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.81200000000000006,"5min":0.89100000000000001,"15min":7.1299999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.59199999999999997},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.80100000000000005,"5min":0.85599999999999998,"15min":1.337},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.755,"5min":0.81299999999999994,"15min":1.206},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.749,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.371},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.505,"15min":0.5},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.40600000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48099999999999998,"15min":0.47499999999999998},"min":{"1min":0.377,"5min":0.312,"15min":0.312},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.80000000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35599999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.315},"max":{"1min":0.81100000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77900000000000003,"5min":0.80100000000000005,"15min":0.82399999999999995},"last":0.46500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154587,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35599999999999998,"15min":0.36599999999999999},"min":{"1min":0.24199999999999999,"5min":0.223,"15min":0.219},"max":{"1min":0.56699999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.378,"15min":0.34000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.54400000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.37}]},{"osd":2,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.34899999999999998,"15min":0.34599999999999997},"min":{"1min":0.251,"5min":0.23599999999999999,"15min":0.222},"max":{"1min":0.503,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41999999999999998,"15min":0.39100000000000001},"min":{"1min":0.28699999999999998,"5min":0.255,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.437}]},{"osd":3,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.41999999999999998},"min":{"1min":0.33400000000000002,"5min":0.30199999999999999,"15min":0.29199999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.443,"15min":0.42799999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58899999999999997,"15min":0.56299999999999994},"min":{"1min":0.35699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.70699999999999996,"5min":1.097,"15min":1.097},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60999999999999999,"15min":0.77200000000000002},"min":{"1min":0.45300000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81299999999999994,"5min":0.90200000000000002,"15min":5.5270000000000001},"last":0.57599999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64000000000000001,"15min":0.626},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.83999999999999997,"5min":1.125,"15min":1.125},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64200000000000002,"15min":0.65800000000000003},"min":{"1min":0.42699999999999999,"5min":0.40400000000000003,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":1.175,"15min":1.4219999999999999},"last":0.64400000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64900000000000002,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94099999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.38500000000000001},"max":{"1min":0.88400000000000001,"5min":1.125,"15min":1.49},"last":0.66900000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.64400000000000002},"min":{"1min":0.44,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93000000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78900000000000003,"5min":1.052,"15min":1.052},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1402,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193910,"statfs":{"total":200000000,"available":198564219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.35599999999999998,"15min":0.40200000000000002},"min":{"1min":0.216,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51600000000000001,"5min":0.65800000000000003,"15min":1.226},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.41599999999999998},"min":{"1min":0.26900000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.64300000000000002,"5min":0.71899999999999997,"15min":1.131},"last":0.32700000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38500000000000001,"15min":0.88200000000000001},"min":{"1min":0.28299999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.44500000000000001,"5min":0.64400000000000002,"15min":12.929},"last":0.312},{"interface":"front","average":{"1min":0.372,"5min":0.41599999999999998,"15min":0.45100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53600000000000003,"5min":0.70899999999999996,"15min":1.1599999999999999},"last":0.26500000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44,"15min":0.46700000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58499999999999996,"5min":0.76100000000000001,"15min":1.1859999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.441,"15min":0.47899999999999998},"min":{"1min":0.36699999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55800000000000005,"5min":0.69199999999999995,"15min":1.3089999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76000000000000001,"5min":0.86299999999999999,"15min":0.93200000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59899999999999998,"15min":0.64300000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41099999999999998},"max":{"1min":0.754,"5min":0.97099999999999997,"15min":1.335},"last":0.68999999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.61399999999999999},"min":{"1min":0.40799999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77800000000000002,"5min":0.90700000000000003,"15min":1.0580000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.66900000000000004,"5min":0.82199999999999995,"15min":0.999},"last":0.622}]},{"osd":6,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59199999999999997,"15min":0.61299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78600000000000003,"5min":0.83099999999999996,"15min":0.998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.82899999999999996,"5min":0.93899999999999995,"15min":1.2849999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40400000000000003},"max":{"1min":0.80100000000000005,"5min":0.92800000000000005,"15min":1.262},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64400000000000002,"15min":0.66100000000000003},"min":{"1min":0.48299999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76100000000000001,"5min":0.95599999999999996,"15min":1.103},"last":0.54900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":826,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199153999,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.35499999999999998,"15min":0.78600000000000003},"min":{"1min":0.24199999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.46700000000000003,"5min":0.79000000000000004,"15min":14.981999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38400000000000001,"15min":0.62},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.59699999999999998,"5min":0.64100000000000001,"15min":9.1600000000000001},"last":0.312}]},{"osd":1,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36899999999999999,"15min":0.58399999999999996},"min":{"1min":0.28199999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.55400000000000005,"5min":0.73099999999999998,"15min":8.4930000000000003},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.42599999999999999,"15min":0.65200000000000002},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":0.53500000000000003,"5min":0.91400000000000003,"15min":9.0239999999999991},"last":0.35599999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44800000000000001,"15min":0.65600000000000003},"min":{"1min":0.33000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61599999999999999,"5min":0.84299999999999997,"15min":8.5190000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.44700000000000001,"15min":0.85099999999999998},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.56100000000000005,"5min":0.87,"15min":15.007999999999999},"last":0.33000000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63700000000000001,"15min":1.052},"min":{"1min":0.41399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93799999999999994,"5min":0.95299999999999996,"15min":14.917999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65400000000000003,"15min":0.879},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90300000000000002,"5min":1.1160000000000001,"15min":8.9930000000000003},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65200000000000002,"15min":0.85799999999999998},"min":{"1min":0.439,"5min":0.432,"15min":0.35899999999999999},"max":{"1min":0.94599999999999995,"5min":0.96299999999999997,"15min":8.9610000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.86299999999999999},"min":{"1min":0.45100000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.03,"5min":1.03,"15min":8.3919999999999995},"last":0.45200000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64900000000000002,"15min":0.84799999999999998},"min":{"1min":0.498,"5min":0.42499999999999999,"15min":0.39900000000000002},"max":{"1min":0.97299999999999998,"5min":1.026,"15min":8.4339999999999993},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66200000000000003,"15min":1.054},"min":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.028,"15min":14.954000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64300000000000002,"15min":0.84399999999999997},"min":{"1min":0.42599999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":8.9160000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65500000000000003,"15min":0.85899999999999999},"min":{"1min":0.46800000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":1.0609999999999999,"15min":8.4640000000000004},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574937,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154427,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58599999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41699999999999998,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35599999999999998,"15min":0.32800000000000001},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.215},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.433},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.40000000000000002,"15min":0.35699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38800000000000001,"15min":0.36499999999999999},"min":{"1min":0.27000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46899999999999997,"15min":0.42499999999999999},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53800000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.375},"max":{"1min":0.77700000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.434,"5min":0.372,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.84799999999999998,"15min":0.91500000000000004},"last":0.68899999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64200000000000002,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.77100000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64000000000000001,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.38800000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63600000000000001,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.91700000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.64000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154517,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52500000000000002,"15min":0.498},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.29299999999999998},"max":{"1min":0.624,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.53300000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.70199999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.254},"max":{"1min":0.68300000000000005,"5min":0.73999999999999999,"15min":0.77000000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.68000000000000005},"min":{"1min":0.433,"5min":0.38500000000000001,"15min":0.34499999999999997},"max":{"1min":0.67400000000000004,"5min":0.83299999999999996,"15min":4.3250000000000002},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54300000000000004,"15min":0.67200000000000004},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.71299999999999997,"5min":0.79900000000000004,"15min":4.7320000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.98099999999999998},"min":{"1min":0.40999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65100000000000002,"5min":0.80200000000000005,"15min":11.715},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56299999999999994,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.35199999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.39000000000000001},"max":{"1min":0.73999999999999999,"5min":0.81299999999999994,"15min":0.85599999999999998},"last":0.63}]},{"osd":5,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.503,"15min":0.51500000000000001},"min":{"1min":0.28799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.77100000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.315,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":0.75700000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.36399999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74299999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64200000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.81599999999999995,"5min":0.879,"15min":0.879},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.38500000000000001,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.83399999999999996,"15min":0.88600000000000001},"last":0.54700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154475,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54600000000000004,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56399999999999995,"15min":0.52700000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.753,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55200000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.52400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82299999999999995,"5min":1.093,"15min":1.093},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57599999999999996,"15min":0.52800000000000002},"min":{"1min":0.46400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.745,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59399999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55100000000000005,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68000000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79800000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45300000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.78300000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61499999999999999,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77700000000000002,"5min":1.071,"15min":1.071},"last":0.58099999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47799999999999998,"15min":0.497},"min":{"1min":0.29199999999999998,"5min":0.28899999999999998,"15min":0.27500000000000002},"max":{"1min":0.65200000000000002,"5min":0.79000000000000004,"15min":0.84399999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.5,"15min":0.503},"min":{"1min":0.32300000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.72599999999999998,"5min":0.76900000000000002,"15min":0.81000000000000005},"last":0.48399999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.52800000000000002},"min":{"1min":0.308,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59999999999999998,"5min":0.85199999999999998,"15min":1.0680000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.31},"max":{"1min":0.74099999999999999,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.60599999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.30399999999999999},"max":{"1min":0.76700000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.626},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.32600000000000001},"max":{"1min":0.75800000000000001,"5min":0.84399999999999997,"15min":1.0269999999999999},"last":0.53800000000000003}]}]}],"pool_statfs":[]}} 2023-10-09T06:27:58.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T06:27:58.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.954+0000 7f9e4a8eb700 1 Processor -- start 2023-10-09T06:27:58.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.955+0000 7f9e4a8eb700 1 -- start start 2023-10-09T06:27:58.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.955+0000 7f9e4a8eb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e440b0e50 0x7f9e440c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.955+0000 7f9e4a8eb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9e440cb4f0 0x7f9e440cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.955+0000 7f9e4a8eb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4415de60 con 0x7f9e440b1220 2023-10-09T06:27:58.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.955+0000 7f9e4a8eb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e440cbed0 con 0x7f9e440cb4f0 2023-10-09T06:27:58.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.955+0000 7f9e4a8eb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4415e140 con 0x7f9e440b0e50 2023-10-09T06:27:58.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.955+0000 7f9e437fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9e440b1220 0x7f9e4406d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58218/0 (socket says 172.21.15.31:58218) 2023-10-09T06:27:58.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.955+0000 7f9e437fe700 1 -- 172.21.15.31:0/3048747615 learned_addr learned my addr 172.21.15.31:0/3048747615 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:58.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e48e88700 1 --2- 172.21.15.31:0/3048747615 >> v2:172.21.15.158:3300/0 conn(0x7f9e440cb4f0 0x7f9e440cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e43fff700 1 --2- 172.21.15.31:0/3048747615 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e440b0e50 0x7f9e440c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e42ffd700 1 -- 172.21.15.31:0/3048747615 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809424373 0 0) 0x7f9e4415de60 con 0x7f9e440b1220 2023-10-09T06:27:58.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e42ffd700 1 -- 172.21.15.31:0/3048747615 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e30003570 con 0x7f9e440b1220 2023-10-09T06:27:58.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e48e88700 1 -- 172.21.15.31:0/3048747615 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e440b0e50 msgr2=0x7f9e440c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:58.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e48e88700 1 --2- 172.21.15.31:0/3048747615 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e440b0e50 0x7f9e440c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e48e88700 1 -- 172.21.15.31:0/3048747615 >> v1:172.21.15.31:6789/0 conn(0x7f9e440b1220 legacy=0x7f9e4406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e42ffd700 1 -- 172.21.15.31:0/3048747615 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2802355644 0 0) 0x7f9e30003570 con 0x7f9e440b1220 2023-10-09T06:27:58.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e48e88700 1 -- 172.21.15.31:0/3048747615 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4415e420 con 0x7f9e440cb4f0 2023-10-09T06:27:58.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e43fff700 1 --2- 172.21.15.31:0/3048747615 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e440b0e50 0x7f9e440c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:27:58.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e48e88700 1 --2- 172.21.15.31:0/3048747615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e440cb4f0 0x7f9e440cb990 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009e60 tx=0x7f9e3c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faba139cb1d6d5b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:58.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e42ffd700 1 -- 172.21.15.31:0/3048747615 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00e070 con 0x7f9e440cb4f0 2023-10-09T06:27:58.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e42ffd700 1 -- 172.21.15.31:0/3048747615 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c00b7a0 con 0x7f9e440cb4f0 2023-10-09T06:27:58.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.956+0000 7f9e42ffd700 1 -- 172.21.15.31:0/3048747615 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c001470 con 0x7f9e440cb4f0 2023-10-09T06:27:58.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.957+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/3048747615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e440cb4f0 msgr2=0x7f9e440cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.957+0000 7f9e4a8eb700 1 --2- 172.21.15.31:0/3048747615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e440cb4f0 0x7f9e440cb990 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009e60 tx=0x7f9e3c009780 comp rx=0 tx=0).stop 2023-10-09T06:27:58.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.957+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/3048747615 shutdown_connections 2023-10-09T06:27:58.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.957+0000 7f9e4a8eb700 1 --2- 172.21.15.31:0/3048747615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e440cb4f0 0x7f9e440cb990 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.957+0000 7f9e4a8eb700 1 --2- 172.21.15.31:0/3048747615 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e440b0e50 0x7f9e440c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.957+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/3048747615 >> 172.21.15.31:0/3048747615 conn(0x7f9e44069870 msgr2=0x7f9e44069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:58.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.957+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/3048747615 shutdown_connections 2023-10-09T06:27:58.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.957+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/3048747615 wait complete. 2023-10-09T06:27:58.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.958+0000 7f9e4a8eb700 1 Processor -- start 2023-10-09T06:27:58.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.958+0000 7f9e4a8eb700 1 -- start start 2023-10-09T06:27:58.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e4a8eb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e440b0e50 0x7f9e4416a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e4a8eb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e440b1220 0x7f9e440b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e4a8eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e440cb4f0 0x7f9e44155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e4a8eb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4416a5b0 con 0x7f9e440cb4f0 2023-10-09T06:27:58.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e4a8eb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440b4370 con 0x7f9e440b0e50 2023-10-09T06:27:58.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e4a8eb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440b4650 con 0x7f9e440b1220 2023-10-09T06:27:58.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e48e88700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e440cb4f0 0x7f9e44155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e48e88700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e440cb4f0 0x7f9e44155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43840/0 (socket says 172.21.15.31:43840) 2023-10-09T06:27:58.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e48e88700 1 -- 172.21.15.31:0/1313735102 learned_addr learned my addr 172.21.15.31:0/1313735102 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:58.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e43fff700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e440b0e50 0x7f9e4416a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e437fe700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e440b1220 0x7f9e440b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e48e88700 1 -- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e440b1220 msgr2=0x7f9e440b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e48e88700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e440b1220 0x7f9e440b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e48e88700 1 -- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e440b0e50 msgr2=0x7f9e4416a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:58.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e48e88700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e440b0e50 0x7f9e4416a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:58.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.959+0000 7f9e48e88700 1 -- 172.21.15.31:0/1313735102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e34009420 con 0x7f9e440cb4f0 2023-10-09T06:27:58.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.960+0000 7f9e43fff700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e440b0e50 0x7f9e4416a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:58.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.960+0000 7f9e48e88700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e440cb4f0 0x7f9e44155a70 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00b610 tx=0x7f9e3c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.960+0000 7f9e3bfff700 1 -- 172.21.15.31:0/1313735102 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c012cc0 con 0x7f9e440cb4f0 2023-10-09T06:27:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.960+0000 7f9e3bfff700 1 -- 172.21.15.31:0/1313735102 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c012e20 con 0x7f9e440cb4f0 2023-10-09T06:27:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.960+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/1313735102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c009a20 con 0x7f9e440cb4f0 2023-10-09T06:27:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.960+0000 7f9e3bfff700 1 -- 172.21.15.31:0/1313735102 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0256b0 con 0x7f9e440cb4f0 2023-10-09T06:27:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.960+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/1313735102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e440b1e20 con 0x7f9e440cb4f0 2023-10-09T06:27:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.961+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/1313735102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e440b4870 con 0x7f9e440cb4f0 2023-10-09T06:27:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.961+0000 7f9e3bfff700 1 -- 172.21.15.31:0/1313735102 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e3c025ae0 con 0x7f9e440cb4f0 2023-10-09T06:27:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.962+0000 7f9e3bfff700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9e24066f30 0x7f9e240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.962+0000 7f9e3bfff700 1 -- 172.21.15.31:0/1313735102 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e3c086440 con 0x7f9e440cb4f0 2023-10-09T06:27:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.962+0000 7f9e43fff700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9e24066f30 0x7f9e240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.962+0000 7f9e43fff700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9e24066f30 0x7f9e240693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9e340093f0 tx=0x7f9e34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:58.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:58.966+0000 7f9e3bfff700 1 -- 172.21.15.31:0/1313735102 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e3c0536b0 con 0x7f9e440cb4f0 2023-10-09T06:27:59.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.239+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/1313735102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9e44158270 con 0x7f9e440cb4f0 2023-10-09T06:27:59.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.239+0000 7f9e3bfff700 1 -- 172.21.15.31:0/1313735102 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1009 (secure 0 0 0) 0x7f9e3c056cd0 con 0x7f9e440cb4f0 2023-10-09T06:27:59.240 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:59.240 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":442,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":152,"num_osds":8,"num_up_osds":8,"osd_up_since":1696832442,"num_in_osds":8,"osd_in_since":1696832439,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":7948652,"bytes_avail":1592051348,"bytes_total":1600000000,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":74,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":7419}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-09T06:24:12.564850+0000","services":{}},"progress_events":{}} 2023-10-09T06:27:59.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.241+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9e24066f30 msgr2=0x7f9e240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:59.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.241+0000 7f9e4a8eb700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9e24066f30 0x7f9e240693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9e340093f0 tx=0x7f9e34008040 comp rx=0 tx=0).stop 2023-10-09T06:27:59.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.241+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/1313735102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e440cb4f0 msgr2=0x7f9e44155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:59.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.241+0000 7f9e4a8eb700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e440cb4f0 0x7f9e44155a70 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00b610 tx=0x7f9e3c018000 comp rx=0 tx=0).stop 2023-10-09T06:27:59.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.241+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/1313735102 shutdown_connections 2023-10-09T06:27:59.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.241+0000 7f9e4a8eb700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9e24066f30 0x7f9e240693e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.241+0000 7f9e4a8eb700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e440cb4f0 0x7f9e44155a70 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.241+0000 7f9e4a8eb700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e440b0e50 0x7f9e4416a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.241+0000 7f9e4a8eb700 1 --2- 172.21.15.31:0/1313735102 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e440b1220 0x7f9e440b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.241+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/1313735102 >> 172.21.15.31:0/1313735102 conn(0x7f9e44069870 msgr2=0x7f9e4406cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:59.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.241+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/1313735102 shutdown_connections 2023-10-09T06:27:59.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.241+0000 7f9e4a8eb700 1 -- 172.21.15.31:0/1313735102 wait complete. 2023-10-09T06:27:59.254 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T06:27:59.254 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:27:59.259 INFO:tasks.ceph.mds.d.smithi158.stderr:2023-10-09T06:27:59.259+0000 7f118b0e5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:27:59.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.372+0000 7f62c3c59700 1 Processor -- start 2023-10-09T06:27:59.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.373+0000 7f62c3c59700 1 -- start start 2023-10-09T06:27:59.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.373+0000 7f62c3c59700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f62bc157870 0x7f62bc15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:59.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.373+0000 7f62c3c59700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62bc157c40 0x7f62bc158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:59.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.373+0000 7f62c3c59700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62bc15cbb0 con 0x7f62bc15a620 2023-10-09T06:27:59.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.373+0000 7f62c3c59700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc15bfa0 con 0x7f62bc157870 2023-10-09T06:27:59.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.373+0000 7f62c3c59700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc15c280 con 0x7f62bc157c40 2023-10-09T06:27:59.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c11f4700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f62bc15a620 0x7f62bc15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58224/0 (socket says 172.21.15.31:58224) 2023-10-09T06:27:59.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c11f4700 1 -- 172.21.15.31:0/1155139716 learned_addr learned my addr 172.21.15.31:0/1155139716 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:27:59.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c19f5700 1 --2- 172.21.15.31:0/1155139716 >> v2:172.21.15.158:3300/0 conn(0x7f62bc157870 0x7f62bc15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:59.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c21f6700 1 --2- 172.21.15.31:0/1155139716 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62bc157c40 0x7f62bc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:59.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169920300 0 0) 0x7f62bc15cbb0 con 0x7f62bc15a620 2023-10-09T06:27:59.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62a4003570 con 0x7f62bc15a620 2023-10-09T06:27:59.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3984839305 0 0) 0x7f62a4003570 con 0x7f62bc15a620 2023-10-09T06:27:59.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62bc157c40 msgr2=0x7f62bc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:59.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 --2- 172.21.15.31:0/1155139716 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62bc157c40 0x7f62bc158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 >> v2:172.21.15.158:3300/0 conn(0x7f62bc157870 msgr2=0x7f62bc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:59.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 --2- 172.21.15.31:0/1155139716 >> v2:172.21.15.158:3300/0 conn(0x7f62bc157870 0x7f62bc15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc15c560 con 0x7f62bc15a620 2023-10-09T06:27:59.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f62b0001470 con 0x7f62bc15a620 2023-10-09T06:27:59.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 >> v1:172.21.15.31:6789/0 conn(0x7f62bc15a620 legacy=0x7f62bc15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:59.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 --2- 172.21.15.31:0/1155139716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a4003a60 0x7f62a4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:59.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 --2- 172.21.15.31:0/1155139716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62a4004810 0x7f62a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:59.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 --2- 172.21.15.31:0/1155139716 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62bc157c40 0x7f62a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:59.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc15bfa0 con 0x7f62a4003a60 2023-10-09T06:27:59.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc15c280 con 0x7f62a4004810 2023-10-09T06:27:59.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a400ba60 con 0x7f62bc157c40 2023-10-09T06:27:59.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c19f5700 1 --2- 172.21.15.31:0/1155139716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a4003a60 0x7f62a4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:59.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.374+0000 7f62c11f4700 1 --2- 172.21.15.31:0/1155139716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62a4004810 0x7f62a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:59.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.375+0000 7f62c21f6700 1 --2- 172.21.15.31:0/1155139716 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62bc157c40 0x7f62a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:59.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.375+0000 7f62c19f5700 1 -- 172.21.15.31:0/1155139716 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62bc157c40 msgr2=0x7f62a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:59.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.375+0000 7f62c19f5700 1 --2- 172.21.15.31:0/1155139716 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62bc157c40 0x7f62a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.375+0000 7f62c19f5700 1 -- 172.21.15.31:0/1155139716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62a4004810 msgr2=0x7f62a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:27:59.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.375+0000 7f62c19f5700 1 --2- 172.21.15.31:0/1155139716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62a4004810 0x7f62a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.375+0000 7f62c19f5700 1 -- 172.21.15.31:0/1155139716 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a4003570 con 0x7f62a4003a60 2023-10-09T06:27:59.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.375+0000 7f62c11f4700 1 --2- 172.21.15.31:0/1155139716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62a4004810 0x7f62a4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:27:59.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.375+0000 7f62c19f5700 1 --2- 172.21.15.31:0/1155139716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a4003a60 0x7f62a4003e70 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00e240 tx=0x7f62ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cda009d255587bf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:59.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.375+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00eaf0 con 0x7f62a4003a60 2023-10-09T06:27:59.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.375+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac00f040 con 0x7f62a4003a60 2023-10-09T06:27:59.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.375+0000 7f62c09f3700 1 -- 172.21.15.31:0/1155139716 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00eea0 con 0x7f62a4003a60 2023-10-09T06:27:59.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.375+0000 7f62c3c59700 1 -- 172.21.15.31:0/1155139716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a4003a60 msgr2=0x7f62a4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:59.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.375+0000 7f62c3c59700 1 --2- 172.21.15.31:0/1155139716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a4003a60 0x7f62a4003e70 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00e240 tx=0x7f62ac00b040 comp rx=0 tx=0).stop 2023-10-09T06:27:59.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.376+0000 7f62c21f6700 1 -- 172.21.15.31:0/1155139716 reap_dead start 2023-10-09T06:27:59.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.376+0000 7f62c3c59700 1 -- 172.21.15.31:0/1155139716 shutdown_connections 2023-10-09T06:27:59.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.376+0000 7f62c3c59700 1 -- 172.21.15.31:0/1155139716 >> 172.21.15.31:0/1155139716 conn(0x7f62bc068ce0 msgr2=0x7f62bc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:59.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.376+0000 7f62c3c59700 1 -- 172.21.15.31:0/1155139716 shutdown_connections 2023-10-09T06:27:59.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.376+0000 7f62c3c59700 1 -- 172.21.15.31:0/1155139716 wait complete. 2023-10-09T06:27:59.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.377+0000 7f62c3c59700 1 Processor -- start 2023-10-09T06:27:59.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.377+0000 7f62c3c59700 1 -- start start 2023-10-09T06:27:59.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c3c59700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62a4003a60 0x7f62bc1512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:59.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c3c59700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62bc143750 0x7f62bc154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:59.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c3c59700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62bc154cd0 0x7f62bc155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:59.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c3c59700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc154580 con 0x7f62bc154cd0 2023-10-09T06:27:59.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c3c59700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc14e940 con 0x7f62a4003a60 2023-10-09T06:27:59.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c3c59700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc153fc0 con 0x7f62bc143750 2023-10-09T06:27:59.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c21f6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62bc154cd0 0x7f62bc155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:59.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c21f6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62bc154cd0 0x7f62bc155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43856/0 (socket says 172.21.15.31:43856) 2023-10-09T06:27:59.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c21f6700 1 -- 172.21.15.31:0/1524680471 learned_addr learned my addr 172.21.15.31:0/1524680471 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:27:59.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c19f5700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62a4003a60 0x7f62bc1512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:59.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c11f4700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62bc143750 0x7f62bc154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:59.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c21f6700 1 -- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62bc143750 msgr2=0x7f62bc154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:59.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c21f6700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62bc143750 0x7f62bc154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c21f6700 1 -- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62a4003a60 msgr2=0x7f62bc1512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:59.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c21f6700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62a4003a60 0x7f62bc1512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c21f6700 1 -- 172.21.15.31:0/1524680471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc1542a0 con 0x7f62bc154cd0 2023-10-09T06:27:59.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c21f6700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62bc154cd0 0x7f62bc155140 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f62bc1580c0 tx=0x7f62b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:59.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62b9ffb700 1 -- 172.21.15.31:0/1524680471 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4015740 con 0x7f62bc154cd0 2023-10-09T06:27:59.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62b9ffb700 1 -- 172.21.15.31:0/1524680471 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b40158a0 con 0x7f62bc154cd0 2023-10-09T06:27:59.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c3c59700 1 -- 172.21.15.31:0/1524680471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62bc14e5d0 con 0x7f62bc154cd0 2023-10-09T06:27:59.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62b9ffb700 1 -- 172.21.15.31:0/1524680471 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4015ca0 con 0x7f62bc154cd0 2023-10-09T06:27:59.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.378+0000 7f62c3c59700 1 -- 172.21.15.31:0/1524680471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc143d80 con 0x7f62bc154cd0 2023-10-09T06:27:59.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.379+0000 7f62c3c59700 1 -- 172.21.15.31:0/1524680471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62bc04c3c0 con 0x7f62bc154cd0 2023-10-09T06:27:59.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.380+0000 7f62b9ffb700 1 -- 172.21.15.31:0/1524680471 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62b40145f0 con 0x7f62bc154cd0 2023-10-09T06:27:59.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.380+0000 7f62b9ffb700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f62a8066f30 0x7f62a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:27:59.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.380+0000 7f62b9ffb700 1 -- 172.21.15.31:0/1524680471 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f62b40848a0 con 0x7f62bc154cd0 2023-10-09T06:27:59.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.381+0000 7f62c19f5700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f62a8066f30 0x7f62a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:27:59.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.381+0000 7f62c19f5700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f62a8066f30 0x7f62a80693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00e240 tx=0x7f62ac01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:27:59.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.385+0000 7f62b9ffb700 1 -- 172.21.15.31:0/1524680471 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62b4051b10 con 0x7f62bc154cd0 2023-10-09T06:27:59.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.573+0000 7f62c3c59700 1 -- 172.21.15.31:0/1524680471 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62bc14ea80 con 0x7f62a8066f30 2023-10-09T06:27:59.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.582+0000 7f62b9ffb700 1 -- 172.21.15.31:0/1524680471 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285392 (secure 0 0 0) 0x7f62bc14ea80 con 0x7f62a8066f30 2023-10-09T06:27:59.586 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:27:59.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.585+0000 7f62c3c59700 1 -- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f62a8066f30 msgr2=0x7f62a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:59.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.585+0000 7f62c3c59700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f62a8066f30 0x7f62a80693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00e240 tx=0x7f62ac01a000 comp rx=0 tx=0).stop 2023-10-09T06:27:59.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.585+0000 7f62c3c59700 1 -- 172.21.15.31:0/1524680471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62bc154cd0 msgr2=0x7f62bc155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:27:59.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.585+0000 7f62c3c59700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62bc154cd0 0x7f62bc155140 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f62bc1580c0 tx=0x7f62b4008040 comp rx=0 tx=0).stop 2023-10-09T06:27:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.585+0000 7f62c3c59700 1 -- 172.21.15.31:0/1524680471 shutdown_connections 2023-10-09T06:27:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.585+0000 7f62c3c59700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f62a8066f30 0x7f62a80693e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.585+0000 7f62c3c59700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62bc154cd0 0x7f62bc155140 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.585+0000 7f62c3c59700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62a4003a60 0x7f62bc1512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.585+0000 7f62c3c59700 1 --2- 172.21.15.31:0/1524680471 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62bc143750 0x7f62bc154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:27:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.585+0000 7f62c3c59700 1 -- 172.21.15.31:0/1524680471 >> 172.21.15.31:0/1524680471 conn(0x7f62bc068ce0 msgr2=0x7f62bc0b6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:27:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.585+0000 7f62c3c59700 1 -- 172.21.15.31:0/1524680471 shutdown_connections 2023-10-09T06:27:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:27:59.585+0000 7f62c3c59700 1 -- 172.21.15.31:0/1524680471 wait complete. 2023-10-09T06:27:59.589 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:27:59.598 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2023-10-09T06:27:58.619594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7762,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554737,"statfs":{"total":1600000000,"available":1592051348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001167"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931157+0000","last_change":"2023-10-09T06:27:53.931079+0000","last_active":"2023-10-09T06:27:53.931157+0000","last_peered":"2023-10-09T06:27:53.931157+0000","last_clean":"2023-10-09T06:27:53.931157+0000","last_became_active":"2023-10-09T06:27:53.930657+0000","last_became_peered":"2023-10-09T06:27:53.930657+0000","last_unstale":"2023-10-09T06:27:53.931157+0000","last_undegraded":"2023-10-09T06:27:53.931157+0000","last_fullsized":"2023-10-09T06:27:53.931157+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:54:03.907542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.925903+0000","last_change":"2023-10-09T06:27:53.925366+0000","last_active":"2023-10-09T06:27:53.925903+0000","last_peered":"2023-10-09T06:27:53.925903+0000","last_clean":"2023-10-09T06:27:53.925903+0000","last_became_active":"2023-10-09T06:27:53.925120+0000","last_became_peered":"2023-10-09T06:27:53.925120+0000","last_unstale":"2023-10-09T06:27:53.925903+0000","last_undegraded":"2023-10-09T06:27:53.925903+0000","last_fullsized":"2023-10-09T06:27:53.925903+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:32.047523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.930114+0000","last_change":"2023-10-09T06:27:53.929645+0000","last_active":"2023-10-09T06:27:53.930114+0000","last_peered":"2023-10-09T06:27:53.930114+0000","last_clean":"2023-10-09T06:27:53.930114+0000","last_became_active":"2023-10-09T06:27:53.929416+0000","last_became_peered":"2023-10-09T06:27:53.929416+0000","last_unstale":"2023-10-09T06:27:53.930114+0000","last_undegraded":"2023-10-09T06:27:53.930114+0000","last_fullsized":"2023-10-09T06:27:53.930114+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:54.277929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936804+0000","last_change":"2023-10-09T06:27:53.934571+0000","last_active":"2023-10-09T06:27:53.936804+0000","last_peered":"2023-10-09T06:27:53.936804+0000","last_clean":"2023-10-09T06:27:53.936804+0000","last_became_active":"2023-10-09T06:27:53.933993+0000","last_became_peered":"2023-10-09T06:27:53.933993+0000","last_unstale":"2023-10-09T06:27:53.936804+0000","last_undegraded":"2023-10-09T06:27:53.936804+0000","last_fullsized":"2023-10-09T06:27:53.936804+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:59:21.186206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935619+0000","last_change":"2023-10-09T06:27:53.935452+0000","last_active":"2023-10-09T06:27:53.935619+0000","last_peered":"2023-10-09T06:27:53.935619+0000","last_clean":"2023-10-09T06:27:53.935619+0000","last_became_active":"2023-10-09T06:27:53.932073+0000","last_became_peered":"2023-10-09T06:27:53.932073+0000","last_unstale":"2023-10-09T06:27:53.935619+0000","last_undegraded":"2023-10-09T06:27:53.935619+0000","last_fullsized":"2023-10-09T06:27:53.935619+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:53.233334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929855+0000","last_change":"2023-10-09T06:27:53.929750+0000","last_active":"2023-10-09T06:27:53.929855+0000","last_peered":"2023-10-09T06:27:53.929855+0000","last_clean":"2023-10-09T06:27:53.929855+0000","last_became_active":"2023-10-09T06:27:53.929021+0000","last_became_peered":"2023-10-09T06:27:53.929021+0000","last_unstale":"2023-10-09T06:27:53.929855+0000","last_undegraded":"2023-10-09T06:27:53.929855+0000","last_fullsized":"2023-10-09T06:27:53.929855+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:00:58.002430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928014+0000","last_change":"2023-10-09T06:27:53.926233+0000","last_active":"2023-10-09T06:27:53.928014+0000","last_peered":"2023-10-09T06:27:53.928014+0000","last_clean":"2023-10-09T06:27:53.928014+0000","last_became_active":"2023-10-09T06:27:53.925764+0000","last_became_peered":"2023-10-09T06:27:53.925764+0000","last_unstale":"2023-10-09T06:27:53.928014+0000","last_undegraded":"2023-10-09T06:27:53.928014+0000","last_fullsized":"2023-10-09T06:27:53.928014+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:52.041346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934364+0000","last_change":"2023-10-09T06:27:53.934291+0000","last_active":"2023-10-09T06:27:53.934364+0000","last_peered":"2023-10-09T06:27:53.934364+0000","last_clean":"2023-10-09T06:27:53.934364+0000","last_became_active":"2023-10-09T06:27:53.933988+0000","last_became_peered":"2023-10-09T06:27:53.933988+0000","last_unstale":"2023-10-09T06:27:53.934364+0000","last_undegraded":"2023-10-09T06:27:53.934364+0000","last_fullsized":"2023-10-09T06:27:53.934364+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:41.052472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934633+0000","last_change":"2023-10-09T06:27:53.934432+0000","last_active":"2023-10-09T06:27:53.934633+0000","last_peered":"2023-10-09T06:27:53.934633+0000","last_clean":"2023-10-09T06:27:53.934633+0000","last_became_active":"2023-10-09T06:27:53.934138+0000","last_became_peered":"2023-10-09T06:27:53.934138+0000","last_unstale":"2023-10-09T06:27:53.934633+0000","last_undegraded":"2023-10-09T06:27:53.934633+0000","last_fullsized":"2023-10-09T06:27:53.934633+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:32:48.606592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928844+0000","last_change":"2023-10-09T06:27:53.927444+0000","last_active":"2023-10-09T06:27:53.928844+0000","last_peered":"2023-10-09T06:27:53.928844+0000","last_clean":"2023-10-09T06:27:53.928844+0000","last_became_active":"2023-10-09T06:27:53.927183+0000","last_became_peered":"2023-10-09T06:27:53.927183+0000","last_unstale":"2023-10-09T06:27:53.928844+0000","last_undegraded":"2023-10-09T06:27:53.928844+0000","last_fullsized":"2023-10-09T06:27:53.928844+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:57.800112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932719+0000","last_change":"2023-10-09T06:27:53.931130+0000","last_active":"2023-10-09T06:27:53.932719+0000","last_peered":"2023-10-09T06:27:53.932719+0000","last_clean":"2023-10-09T06:27:53.932719+0000","last_became_active":"2023-10-09T06:27:53.930912+0000","last_became_peered":"2023-10-09T06:27:53.930912+0000","last_unstale":"2023-10-09T06:27:53.932719+0000","last_undegraded":"2023-10-09T06:27:53.932719+0000","last_fullsized":"2023-10-09T06:27:53.932719+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:03.328092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931658+0000","last_change":"2023-10-09T06:27:53.931531+0000","last_active":"2023-10-09T06:27:53.931658+0000","last_peered":"2023-10-09T06:27:53.931658+0000","last_clean":"2023-10-09T06:27:53.931658+0000","last_became_active":"2023-10-09T06:27:53.931172+0000","last_became_peered":"2023-10-09T06:27:53.931172+0000","last_unstale":"2023-10-09T06:27:53.931658+0000","last_undegraded":"2023-10-09T06:27:53.931658+0000","last_fullsized":"2023-10-09T06:27:53.931658+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:04.253773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929951+0000","last_change":"2023-10-09T06:27:53.929876+0000","last_active":"2023-10-09T06:27:53.929951+0000","last_peered":"2023-10-09T06:27:53.929951+0000","last_clean":"2023-10-09T06:27:53.929951+0000","last_became_active":"2023-10-09T06:27:53.929662+0000","last_became_peered":"2023-10-09T06:27:53.929662+0000","last_unstale":"2023-10-09T06:27:53.929951+0000","last_undegraded":"2023-10-09T06:27:53.929951+0000","last_fullsized":"2023-10-09T06:27:53.929951+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:47.143291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932605+0000","last_change":"2023-10-09T06:27:53.932111+0000","last_active":"2023-10-09T06:27:53.932605+0000","last_peered":"2023-10-09T06:27:53.932605+0000","last_clean":"2023-10-09T06:27:53.932605+0000","last_became_active":"2023-10-09T06:27:53.931590+0000","last_became_peered":"2023-10-09T06:27:53.931590+0000","last_unstale":"2023-10-09T06:27:53.932605+0000","last_undegraded":"2023-10-09T06:27:53.932605+0000","last_fullsized":"2023-10-09T06:27:53.932605+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:15.353816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936868+0000","last_change":"2023-10-09T06:27:53.935770+0000","last_active":"2023-10-09T06:27:53.936868+0000","last_peered":"2023-10-09T06:27:53.936868+0000","last_clean":"2023-10-09T06:27:53.936868+0000","last_became_active":"2023-10-09T06:27:53.935568+0000","last_became_peered":"2023-10-09T06:27:53.935568+0000","last_unstale":"2023-10-09T06:27:53.936868+0000","last_undegraded":"2023-10-09T06:27:53.936868+0000","last_fullsized":"2023-10-09T06:27:53.936868+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:44.999564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.937757+0000","last_change":"2023-10-09T06:27:53.937694+0000","last_active":"2023-10-09T06:27:53.937757+0000","last_peered":"2023-10-09T06:27:53.937757+0000","last_clean":"2023-10-09T06:27:53.937757+0000","last_became_active":"2023-10-09T06:27:53.937257+0000","last_became_peered":"2023-10-09T06:27:53.937257+0000","last_unstale":"2023-10-09T06:27:53.937757+0000","last_undegraded":"2023-10-09T06:27:53.937757+0000","last_fullsized":"2023-10-09T06:27:53.937757+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:46.105971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934363+0000","last_change":"2023-10-09T06:27:53.933906+0000","last_active":"2023-10-09T06:27:53.934363+0000","last_peered":"2023-10-09T06:27:53.934363+0000","last_clean":"2023-10-09T06:27:53.934363+0000","last_became_active":"2023-10-09T06:27:53.933686+0000","last_became_peered":"2023-10-09T06:27:53.933686+0000","last_unstale":"2023-10-09T06:27:53.934363+0000","last_undegraded":"2023-10-09T06:27:53.934363+0000","last_fullsized":"2023-10-09T06:27:53.934363+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:41.052472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.938142+0000","last_change":"2023-10-09T06:27:53.937954+0000","last_active":"2023-10-09T06:27:53.938142+0000","last_peered":"2023-10-09T06:27:53.938142+0000","last_clean":"2023-10-09T06:27:53.938142+0000","last_became_active":"2023-10-09T06:27:53.937446+0000","last_became_peered":"2023-10-09T06:27:53.937446+0000","last_unstale":"2023-10-09T06:27:53.938142+0000","last_undegraded":"2023-10-09T06:27:53.938142+0000","last_fullsized":"2023-10-09T06:27:53.938142+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:13.422563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932699+0000","last_change":"2023-10-09T06:27:53.930521+0000","last_active":"2023-10-09T06:27:53.932699+0000","last_peered":"2023-10-09T06:27:53.932699+0000","last_clean":"2023-10-09T06:27:53.932699+0000","last_became_active":"2023-10-09T06:27:53.929878+0000","last_became_peered":"2023-10-09T06:27:53.929878+0000","last_unstale":"2023-10-09T06:27:53.932699+0000","last_undegraded":"2023-10-09T06:27:53.932699+0000","last_fullsized":"2023-10-09T06:27:53.932699+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:28.851401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934655+0000","last_change":"2023-10-09T06:27:53.934514+0000","last_active":"2023-10-09T06:27:53.934655+0000","last_peered":"2023-10-09T06:27:53.934655+0000","last_clean":"2023-10-09T06:27:53.934655+0000","last_became_active":"2023-10-09T06:27:53.934162+0000","last_became_peered":"2023-10-09T06:27:53.934162+0000","last_unstale":"2023-10-09T06:27:53.934655+0000","last_undegraded":"2023-10-09T06:27:53.934655+0000","last_fullsized":"2023-10-09T06:27:53.934655+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:53.233334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931910+0000","last_change":"2023-10-09T06:27:53.929981+0000","last_active":"2023-10-09T06:27:53.931910+0000","last_peered":"2023-10-09T06:27:53.931910+0000","last_clean":"2023-10-09T06:27:53.931910+0000","last_became_active":"2023-10-09T06:27:53.929704+0000","last_became_peered":"2023-10-09T06:27:53.929704+0000","last_unstale":"2023-10-09T06:27:53.931910+0000","last_undegraded":"2023-10-09T06:27:53.931910+0000","last_fullsized":"2023-10-09T06:27:53.931910+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:08.541119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933836+0000","last_change":"2023-10-09T06:27:53.933774+0000","last_active":"2023-10-09T06:27:53.933836+0000","last_peered":"2023-10-09T06:27:53.933836+0000","last_clean":"2023-10-09T06:27:53.933836+0000","last_became_active":"2023-10-09T06:27:53.933400+0000","last_became_peered":"2023-10-09T06:27:53.933400+0000","last_unstale":"2023-10-09T06:27:53.933836+0000","last_undegraded":"2023-10-09T06:27:53.933836+0000","last_fullsized":"2023-10-09T06:27:53.933836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:19.247833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932320+0000","last_change":"2023-10-09T06:27:53.932149+0000","last_active":"2023-10-09T06:27:53.932320+0000","last_peered":"2023-10-09T06:27:53.932320+0000","last_clean":"2023-10-09T06:27:53.932320+0000","last_became_active":"2023-10-09T06:27:53.931915+0000","last_became_peered":"2023-10-09T06:27:53.931915+0000","last_unstale":"2023-10-09T06:27:53.932320+0000","last_undegraded":"2023-10-09T06:27:53.932320+0000","last_fullsized":"2023-10-09T06:27:53.932320+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:54.943386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936737+0000","last_change":"2023-10-09T06:27:53.936102+0000","last_active":"2023-10-09T06:27:53.936737+0000","last_peered":"2023-10-09T06:27:53.936737+0000","last_clean":"2023-10-09T06:27:53.936737+0000","last_became_active":"2023-10-09T06:27:53.935870+0000","last_became_peered":"2023-10-09T06:27:53.935870+0000","last_unstale":"2023-10-09T06:27:53.936737+0000","last_undegraded":"2023-10-09T06:27:53.936737+0000","last_fullsized":"2023-10-09T06:27:53.936737+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:10.148649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932675+0000","last_change":"2023-10-09T06:27:53.932545+0000","last_active":"2023-10-09T06:27:53.932675+0000","last_peered":"2023-10-09T06:27:53.932675+0000","last_clean":"2023-10-09T06:27:53.932675+0000","last_became_active":"2023-10-09T06:27:53.932183+0000","last_became_peered":"2023-10-09T06:27:53.932183+0000","last_unstale":"2023-10-09T06:27:53.932675+0000","last_undegraded":"2023-10-09T06:27:53.932675+0000","last_fullsized":"2023-10-09T06:27:53.932675+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:30.199496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933969+0000","last_change":"2023-10-09T06:27:53.933324+0000","last_active":"2023-10-09T06:27:53.933969+0000","last_peered":"2023-10-09T06:27:53.933969+0000","last_clean":"2023-10-09T06:27:53.933969+0000","last_became_active":"2023-10-09T06:27:53.933084+0000","last_became_peered":"2023-10-09T06:27:53.933084+0000","last_unstale":"2023-10-09T06:27:53.933969+0000","last_undegraded":"2023-10-09T06:27:53.933969+0000","last_fullsized":"2023-10-09T06:27:53.933969+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:21:36.823652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931066+0000","last_change":"2023-10-09T06:27:53.931005+0000","last_active":"2023-10-09T06:27:53.931066+0000","last_peered":"2023-10-09T06:27:53.931066+0000","last_clean":"2023-10-09T06:27:53.931066+0000","last_became_active":"2023-10-09T06:27:53.930776+0000","last_became_peered":"2023-10-09T06:27:53.930776+0000","last_unstale":"2023-10-09T06:27:53.931066+0000","last_undegraded":"2023-10-09T06:27:53.931066+0000","last_fullsized":"2023-10-09T06:27:53.931066+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:09.846466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936519+0000","last_change":"2023-10-09T06:27:53.936453+0000","last_active":"2023-10-09T06:27:53.936519+0000","last_peered":"2023-10-09T06:27:53.936519+0000","last_clean":"2023-10-09T06:27:53.936519+0000","last_became_active":"2023-10-09T06:27:53.936204+0000","last_became_peered":"2023-10-09T06:27:53.936204+0000","last_unstale":"2023-10-09T06:27:53.936519+0000","last_undegraded":"2023-10-09T06:27:53.936519+0000","last_fullsized":"2023-10-09T06:27:53.936519+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:16.687263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936785+0000","last_change":"2023-10-09T06:27:53.934421+0000","last_active":"2023-10-09T06:27:53.936785+0000","last_peered":"2023-10-09T06:27:53.936785+0000","last_clean":"2023-10-09T06:27:53.936785+0000","last_became_active":"2023-10-09T06:27:53.933677+0000","last_became_peered":"2023-10-09T06:27:53.933677+0000","last_unstale":"2023-10-09T06:27:53.936785+0000","last_undegraded":"2023-10-09T06:27:53.936785+0000","last_fullsized":"2023-10-09T06:27:53.936785+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:51.778135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936819+0000","last_change":"2023-10-09T06:27:53.934598+0000","last_active":"2023-10-09T06:27:53.936819+0000","last_peered":"2023-10-09T06:27:53.936819+0000","last_clean":"2023-10-09T06:27:53.936819+0000","last_became_active":"2023-10-09T06:27:53.934282+0000","last_became_peered":"2023-10-09T06:27:53.934282+0000","last_unstale":"2023-10-09T06:27:53.936819+0000","last_undegraded":"2023-10-09T06:27:53.936819+0000","last_fullsized":"2023-10-09T06:27:53.936819+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:06.413749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934504+0000","last_change":"2023-10-09T06:27:53.934424+0000","last_active":"2023-10-09T06:27:53.934504+0000","last_peered":"2023-10-09T06:27:53.934504+0000","last_clean":"2023-10-09T06:27:53.934504+0000","last_became_active":"2023-10-09T06:27:53.934180+0000","last_became_peered":"2023-10-09T06:27:53.934180+0000","last_unstale":"2023-10-09T06:27:53.934504+0000","last_undegraded":"2023-10-09T06:27:53.934504+0000","last_fullsized":"2023-10-09T06:27:53.934504+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:21:15.952486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933511+0000","last_change":"2023-10-09T06:27:53.933431+0000","last_active":"2023-10-09T06:27:53.933511+0000","last_peered":"2023-10-09T06:27:53.933511+0000","last_clean":"2023-10-09T06:27:53.933511+0000","last_became_active":"2023-10-09T06:27:53.933020+0000","last_became_peered":"2023-10-09T06:27:53.933020+0000","last_unstale":"2023-10-09T06:27:53.933511+0000","last_undegraded":"2023-10-09T06:27:53.933511+0000","last_fullsized":"2023-10-09T06:27:53.933511+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:43.819504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934638+0000","last_change":"2023-10-09T06:27:53.934244+0000","last_active":"2023-10-09T06:27:53.934638+0000","last_peered":"2023-10-09T06:27:53.934638+0000","last_clean":"2023-10-09T06:27:53.934638+0000","last_became_active":"2023-10-09T06:27:53.933816+0000","last_became_peered":"2023-10-09T06:27:53.933816+0000","last_unstale":"2023-10-09T06:27:53.934638+0000","last_undegraded":"2023-10-09T06:27:53.934638+0000","last_fullsized":"2023-10-09T06:27:53.934638+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:36.790853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"151'4","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945243+0000","last_change":"2023-10-09T06:27:52.935663+0000","last_active":"2023-10-09T06:27:53.945243+0000","last_peered":"2023-10-09T06:27:53.945243+0000","last_clean":"2023-10-09T06:27:53.945243+0000","last_became_active":"2023-10-09T06:27:52.935442+0000","last_became_peered":"2023-10-09T06:27:52.935442+0000","last_unstale":"2023-10-09T06:27:53.945243+0000","last_undegraded":"2023-10-09T06:27:53.945243+0000","last_fullsized":"2023-10-09T06:27:53.945243+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:17.467616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931066+0000","last_change":"2023-10-09T06:27:53.930969+0000","last_active":"2023-10-09T06:27:53.931066+0000","last_peered":"2023-10-09T06:27:53.931066+0000","last_clean":"2023-10-09T06:27:53.931066+0000","last_became_active":"2023-10-09T06:27:53.930634+0000","last_became_peered":"2023-10-09T06:27:53.930634+0000","last_unstale":"2023-10-09T06:27:53.931066+0000","last_undegraded":"2023-10-09T06:27:53.931066+0000","last_fullsized":"2023-10-09T06:27:53.931066+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:18.472028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944722+0000","last_change":"2023-10-09T06:27:52.935490+0000","last_active":"2023-10-09T06:27:53.944722+0000","last_peered":"2023-10-09T06:27:53.944722+0000","last_clean":"2023-10-09T06:27:53.944722+0000","last_became_active":"2023-10-09T06:27:52.935253+0000","last_became_peered":"2023-10-09T06:27:52.935253+0000","last_unstale":"2023-10-09T06:27:53.944722+0000","last_undegraded":"2023-10-09T06:27:53.944722+0000","last_fullsized":"2023-10-09T06:27:53.944722+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:32.422666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931949+0000","last_change":"2023-10-09T06:27:53.931529+0000","last_active":"2023-10-09T06:27:53.931949+0000","last_peered":"2023-10-09T06:27:53.931949+0000","last_clean":"2023-10-09T06:27:53.931949+0000","last_became_active":"2023-10-09T06:27:53.931272+0000","last_became_peered":"2023-10-09T06:27:53.931272+0000","last_unstale":"2023-10-09T06:27:53.931949+0000","last_undegraded":"2023-10-09T06:27:53.931949+0000","last_fullsized":"2023-10-09T06:27:53.931949+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:52.371297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.943796+0000","last_change":"2023-10-09T06:27:52.935839+0000","last_active":"2023-10-09T06:27:53.943796+0000","last_peered":"2023-10-09T06:27:53.943796+0000","last_clean":"2023-10-09T06:27:53.943796+0000","last_became_active":"2023-10-09T06:27:52.935587+0000","last_became_peered":"2023-10-09T06:27:52.935587+0000","last_unstale":"2023-10-09T06:27:53.943796+0000","last_undegraded":"2023-10-09T06:27:53.943796+0000","last_fullsized":"2023-10-09T06:27:53.943796+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:08.477367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936389+0000","last_change":"2023-10-09T06:27:53.936220+0000","last_active":"2023-10-09T06:27:53.936389+0000","last_peered":"2023-10-09T06:27:53.936389+0000","last_clean":"2023-10-09T06:27:53.936389+0000","last_became_active":"2023-10-09T06:27:53.935141+0000","last_became_peered":"2023-10-09T06:27:53.935141+0000","last_unstale":"2023-10-09T06:27:53.936389+0000","last_undegraded":"2023-10-09T06:27:53.936389+0000","last_fullsized":"2023-10-09T06:27:53.936389+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:32.142862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944534+0000","last_change":"2023-10-09T06:27:52.933698+0000","last_active":"2023-10-09T06:27:53.944534+0000","last_peered":"2023-10-09T06:27:53.944534+0000","last_clean":"2023-10-09T06:27:53.944534+0000","last_became_active":"2023-10-09T06:27:52.933257+0000","last_became_peered":"2023-10-09T06:27:52.933257+0000","last_unstale":"2023-10-09T06:27:53.944534+0000","last_undegraded":"2023-10-09T06:27:53.944534+0000","last_fullsized":"2023-10-09T06:27:53.944534+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:38.688820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.938160+0000","last_change":"2023-10-09T06:27:53.938087+0000","last_active":"2023-10-09T06:27:53.938160+0000","last_peered":"2023-10-09T06:27:53.938160+0000","last_clean":"2023-10-09T06:27:53.938160+0000","last_became_active":"2023-10-09T06:27:53.937736+0000","last_became_peered":"2023-10-09T06:27:53.937736+0000","last_unstale":"2023-10-09T06:27:53.938160+0000","last_undegraded":"2023-10-09T06:27:53.938160+0000","last_fullsized":"2023-10-09T06:27:53.938160+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:08.541119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945458+0000","last_change":"2023-10-09T06:27:52.931663+0000","last_active":"2023-10-09T06:27:53.945458+0000","last_peered":"2023-10-09T06:27:53.945458+0000","last_clean":"2023-10-09T06:27:53.945458+0000","last_became_active":"2023-10-09T06:27:52.930668+0000","last_became_peered":"2023-10-09T06:27:52.930668+0000","last_unstale":"2023-10-09T06:27:53.945458+0000","last_undegraded":"2023-10-09T06:27:53.945458+0000","last_fullsized":"2023-10-09T06:27:53.945458+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:46.138879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933381+0000","last_change":"2023-10-09T06:27:53.933267+0000","last_active":"2023-10-09T06:27:53.933381+0000","last_peered":"2023-10-09T06:27:53.933381+0000","last_clean":"2023-10-09T06:27:53.933381+0000","last_became_active":"2023-10-09T06:27:53.932673+0000","last_became_peered":"2023-10-09T06:27:53.932673+0000","last_unstale":"2023-10-09T06:27:53.933381+0000","last_undegraded":"2023-10-09T06:27:53.933381+0000","last_fullsized":"2023-10-09T06:27:53.933381+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:54.943386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945803+0000","last_change":"2023-10-09T06:27:52.927612+0000","last_active":"2023-10-09T06:27:53.945803+0000","last_peered":"2023-10-09T06:27:53.945803+0000","last_clean":"2023-10-09T06:27:53.945803+0000","last_became_active":"2023-10-09T06:27:52.927332+0000","last_became_peered":"2023-10-09T06:27:52.927332+0000","last_unstale":"2023-10-09T06:27:53.945803+0000","last_undegraded":"2023-10-09T06:27:53.945803+0000","last_fullsized":"2023-10-09T06:27:53.945803+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:42.815093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933858+0000","last_change":"2023-10-09T06:27:53.933645+0000","last_active":"2023-10-09T06:27:53.933858+0000","last_peered":"2023-10-09T06:27:53.933858+0000","last_clean":"2023-10-09T06:27:53.933858+0000","last_became_active":"2023-10-09T06:27:53.933048+0000","last_became_peered":"2023-10-09T06:27:53.933048+0000","last_unstale":"2023-10-09T06:27:53.933858+0000","last_undegraded":"2023-10-09T06:27:53.933858+0000","last_fullsized":"2023-10-09T06:27:53.933858+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:35.399846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.923358+0000","last_change":"2023-10-09T06:27:52.936229+0000","last_active":"2023-10-09T06:27:53.923358+0000","last_peered":"2023-10-09T06:27:53.923358+0000","last_clean":"2023-10-09T06:27:53.923358+0000","last_became_active":"2023-10-09T06:27:52.936013+0000","last_became_peered":"2023-10-09T06:27:52.936013+0000","last_unstale":"2023-10-09T06:27:53.923358+0000","last_undegraded":"2023-10-09T06:27:53.923358+0000","last_fullsized":"2023-10-09T06:27:53.923358+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:56.795700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932645+0000","last_change":"2023-10-09T06:27:53.932244+0000","last_active":"2023-10-09T06:27:53.932645+0000","last_peered":"2023-10-09T06:27:53.932645+0000","last_clean":"2023-10-09T06:27:53.932645+0000","last_became_active":"2023-10-09T06:27:53.931886+0000","last_became_peered":"2023-10-09T06:27:53.931886+0000","last_unstale":"2023-10-09T06:27:53.932645+0000","last_undegraded":"2023-10-09T06:27:53.932645+0000","last_fullsized":"2023-10-09T06:27:53.932645+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:39:52.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.923451+0000","last_change":"2023-10-09T06:27:52.933160+0000","last_active":"2023-10-09T06:27:53.923451+0000","last_peered":"2023-10-09T06:27:53.923451+0000","last_clean":"2023-10-09T06:27:53.923451+0000","last_became_active":"2023-10-09T06:27:52.932999+0000","last_became_peered":"2023-10-09T06:27:52.932999+0000","last_unstale":"2023-10-09T06:27:53.923451+0000","last_undegraded":"2023-10-09T06:27:53.923451+0000","last_fullsized":"2023-10-09T06:27:53.923451+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:17.202095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936884+0000","last_change":"2023-10-09T06:27:53.936338+0000","last_active":"2023-10-09T06:27:53.936884+0000","last_peered":"2023-10-09T06:27:53.936884+0000","last_clean":"2023-10-09T06:27:53.936884+0000","last_became_active":"2023-10-09T06:27:53.936068+0000","last_became_peered":"2023-10-09T06:27:53.936068+0000","last_unstale":"2023-10-09T06:27:53.936884+0000","last_undegraded":"2023-10-09T06:27:53.936884+0000","last_fullsized":"2023-10-09T06:27:53.936884+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:07.136944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928236+0000","last_change":"2023-10-09T06:27:52.933145+0000","last_active":"2023-10-09T06:27:53.928236+0000","last_peered":"2023-10-09T06:27:53.928236+0000","last_clean":"2023-10-09T06:27:53.928236+0000","last_became_active":"2023-10-09T06:27:52.932892+0000","last_became_peered":"2023-10-09T06:27:52.932892+0000","last_unstale":"2023-10-09T06:27:53.928236+0000","last_undegraded":"2023-10-09T06:27:53.928236+0000","last_fullsized":"2023-10-09T06:27:53.928236+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:31.043111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935284+0000","last_change":"2023-10-09T06:27:53.935205+0000","last_active":"2023-10-09T06:27:53.935284+0000","last_peered":"2023-10-09T06:27:53.935284+0000","last_clean":"2023-10-09T06:27:53.935284+0000","last_became_active":"2023-10-09T06:27:53.934775+0000","last_became_peered":"2023-10-09T06:27:53.934775+0000","last_unstale":"2023-10-09T06:27:53.935284+0000","last_undegraded":"2023-10-09T06:27:53.935284+0000","last_fullsized":"2023-10-09T06:27:53.935284+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:39:52.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928582+0000","last_change":"2023-10-09T06:27:52.932076+0000","last_active":"2023-10-09T06:27:53.928582+0000","last_peered":"2023-10-09T06:27:53.928582+0000","last_clean":"2023-10-09T06:27:53.928582+0000","last_became_active":"2023-10-09T06:27:52.931652+0000","last_became_peered":"2023-10-09T06:27:52.931652+0000","last_unstale":"2023-10-09T06:27:53.928582+0000","last_undegraded":"2023-10-09T06:27:53.928582+0000","last_fullsized":"2023-10-09T06:27:53.928582+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:53.938974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934487+0000","last_change":"2023-10-09T06:27:53.934378+0000","last_active":"2023-10-09T06:27:53.934487+0000","last_peered":"2023-10-09T06:27:53.934487+0000","last_clean":"2023-10-09T06:27:53.934487+0000","last_became_active":"2023-10-09T06:27:53.934156+0000","last_became_peered":"2023-10-09T06:27:53.934156+0000","last_unstale":"2023-10-09T06:27:53.934487+0000","last_undegraded":"2023-10-09T06:27:53.934487+0000","last_fullsized":"2023-10-09T06:27:53.934487+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:24.340452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"151'3","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945951+0000","last_change":"2023-10-09T06:27:52.931973+0000","last_active":"2023-10-09T06:27:53.945951+0000","last_peered":"2023-10-09T06:27:53.945951+0000","last_clean":"2023-10-09T06:27:53.945951+0000","last_became_active":"2023-10-09T06:27:52.931677+0000","last_became_peered":"2023-10-09T06:27:52.931677+0000","last_unstale":"2023-10-09T06:27:53.945951+0000","last_undegraded":"2023-10-09T06:27:53.945951+0000","last_fullsized":"2023-10-09T06:27:53.945951+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:52:38.654562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935456+0000","last_change":"2023-10-09T06:27:53.935392+0000","last_active":"2023-10-09T06:27:53.935456+0000","last_peered":"2023-10-09T06:27:53.935456+0000","last_clean":"2023-10-09T06:27:53.935456+0000","last_became_active":"2023-10-09T06:27:53.934928+0000","last_became_peered":"2023-10-09T06:27:53.934928+0000","last_unstale":"2023-10-09T06:27:53.935456+0000","last_undegraded":"2023-10-09T06:27:53.935456+0000","last_fullsized":"2023-10-09T06:27:53.935456+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:00.559448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"151'6","reported_seq":16,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.946402+0000","last_change":"2023-10-09T06:27:52.933173+0000","last_active":"2023-10-09T06:27:53.946402+0000","last_peered":"2023-10-09T06:27:53.946402+0000","last_clean":"2023-10-09T06:27:53.946402+0000","last_became_active":"2023-10-09T06:27:52.932948+0000","last_became_peered":"2023-10-09T06:27:52.932948+0000","last_unstale":"2023-10-09T06:27:53.946402+0000","last_undegraded":"2023-10-09T06:27:53.946402+0000","last_fullsized":"2023-10-09T06:27:53.946402+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:01.012691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933660+0000","last_change":"2023-10-09T06:27:53.933596+0000","last_active":"2023-10-09T06:27:53.933660+0000","last_peered":"2023-10-09T06:27:53.933660+0000","last_clean":"2023-10-09T06:27:53.933660+0000","last_became_active":"2023-10-09T06:27:53.933330+0000","last_became_peered":"2023-10-09T06:27:53.933330+0000","last_unstale":"2023-10-09T06:27:53.933660+0000","last_undegraded":"2023-10-09T06:27:53.933660+0000","last_fullsized":"2023-10-09T06:27:53.933660+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:33.967623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.926380+0000","last_change":"2023-10-09T06:27:52.937327+0000","last_active":"2023-10-09T06:27:53.926380+0000","last_peered":"2023-10-09T06:27:53.926380+0000","last_clean":"2023-10-09T06:27:53.926380+0000","last_became_active":"2023-10-09T06:27:52.937095+0000","last_became_peered":"2023-10-09T06:27:52.937095+0000","last_unstale":"2023-10-09T06:27:53.926380+0000","last_undegraded":"2023-10-09T06:27:53.926380+0000","last_fullsized":"2023-10-09T06:27:53.926380+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:44.302806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.926399+0000","last_change":"2023-10-09T06:27:53.926335+0000","last_active":"2023-10-09T06:27:53.926399+0000","last_peered":"2023-10-09T06:27:53.926399+0000","last_clean":"2023-10-09T06:27:53.926399+0000","last_became_active":"2023-10-09T06:27:53.926099+0000","last_became_peered":"2023-10-09T06:27:53.926099+0000","last_unstale":"2023-10-09T06:27:53.926399+0000","last_undegraded":"2023-10-09T06:27:53.926399+0000","last_fullsized":"2023-10-09T06:27:53.926399+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:16.687263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.922841+0000","last_change":"2023-10-09T06:27:52.931810+0000","last_active":"2023-10-09T06:27:53.922841+0000","last_peered":"2023-10-09T06:27:53.922841+0000","last_clean":"2023-10-09T06:27:53.922841+0000","last_became_active":"2023-10-09T06:27:52.931440+0000","last_became_peered":"2023-10-09T06:27:52.931440+0000","last_unstale":"2023-10-09T06:27:53.922841+0000","last_undegraded":"2023-10-09T06:27:53.922841+0000","last_fullsized":"2023-10-09T06:27:53.922841+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:32.963211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931638+0000","last_change":"2023-10-09T06:27:53.931392+0000","last_active":"2023-10-09T06:27:53.931638+0000","last_peered":"2023-10-09T06:27:53.931638+0000","last_clean":"2023-10-09T06:27:53.931638+0000","last_became_active":"2023-10-09T06:27:53.930853+0000","last_became_peered":"2023-10-09T06:27:53.930853+0000","last_unstale":"2023-10-09T06:27:53.931638+0000","last_undegraded":"2023-10-09T06:27:53.931638+0000","last_fullsized":"2023-10-09T06:27:53.931638+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:17:02.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"151'8","reported_seq":18,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.946781+0000","last_change":"2023-10-09T06:27:52.935565+0000","last_active":"2023-10-09T06:27:53.946781+0000","last_peered":"2023-10-09T06:27:53.946781+0000","last_clean":"2023-10-09T06:27:53.946781+0000","last_became_active":"2023-10-09T06:27:52.935254+0000","last_became_peered":"2023-10-09T06:27:52.935254+0000","last_unstale":"2023-10-09T06:27:53.946781+0000","last_undegraded":"2023-10-09T06:27:53.946781+0000","last_fullsized":"2023-10-09T06:27:53.946781+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:32.422666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933875+0000","last_change":"2023-10-09T06:27:53.933786+0000","last_active":"2023-10-09T06:27:53.933875+0000","last_peered":"2023-10-09T06:27:53.933875+0000","last_clean":"2023-10-09T06:27:53.933875+0000","last_became_active":"2023-10-09T06:27:53.933351+0000","last_became_peered":"2023-10-09T06:27:53.933351+0000","last_unstale":"2023-10-09T06:27:53.933875+0000","last_undegraded":"2023-10-09T06:27:53.933875+0000","last_fullsized":"2023-10-09T06:27:53.933875+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:37:13.894431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944881+0000","last_change":"2023-10-09T06:27:52.931092+0000","last_active":"2023-10-09T06:27:53.944881+0000","last_peered":"2023-10-09T06:27:53.944881+0000","last_clean":"2023-10-09T06:27:53.944881+0000","last_became_active":"2023-10-09T06:27:52.930803+0000","last_became_peered":"2023-10-09T06:27:52.930803+0000","last_unstale":"2023-10-09T06:27:53.944881+0000","last_undegraded":"2023-10-09T06:27:53.944881+0000","last_fullsized":"2023-10-09T06:27:53.944881+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:15.437434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.939322+0000","last_change":"2023-10-09T06:27:53.939245+0000","last_active":"2023-10-09T06:27:53.939322+0000","last_peered":"2023-10-09T06:27:53.939322+0000","last_clean":"2023-10-09T06:27:53.939322+0000","last_became_active":"2023-10-09T06:27:53.938801+0000","last_became_peered":"2023-10-09T06:27:53.938801+0000","last_unstale":"2023-10-09T06:27:53.939322+0000","last_undegraded":"2023-10-09T06:27:53.939322+0000","last_fullsized":"2023-10-09T06:27:53.939322+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.029150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945515+0000","last_change":"2023-10-09T06:27:52.932657+0000","last_active":"2023-10-09T06:27:53.945515+0000","last_peered":"2023-10-09T06:27:53.945515+0000","last_clean":"2023-10-09T06:27:53.945515+0000","last_became_active":"2023-10-09T06:27:52.932402+0000","last_became_peered":"2023-10-09T06:27:52.932402+0000","last_unstale":"2023-10-09T06:27:53.945515+0000","last_undegraded":"2023-10-09T06:27:53.945515+0000","last_fullsized":"2023-10-09T06:27:53.945515+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:51.366885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933951+0000","last_change":"2023-10-09T06:27:53.933290+0000","last_active":"2023-10-09T06:27:53.933951+0000","last_peered":"2023-10-09T06:27:53.933951+0000","last_clean":"2023-10-09T06:27:53.933951+0000","last_became_active":"2023-10-09T06:27:53.933030+0000","last_became_peered":"2023-10-09T06:27:53.933030+0000","last_unstale":"2023-10-09T06:27:53.933951+0000","last_undegraded":"2023-10-09T06:27:53.933951+0000","last_fullsized":"2023-10-09T06:27:53.933951+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:21:15.952486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.943364+0000","last_change":"2023-10-09T06:27:52.935532+0000","last_active":"2023-10-09T06:27:53.943364+0000","last_peered":"2023-10-09T06:27:53.943364+0000","last_clean":"2023-10-09T06:27:53.943364+0000","last_became_active":"2023-10-09T06:27:52.935305+0000","last_became_peered":"2023-10-09T06:27:52.935305+0000","last_unstale":"2023-10-09T06:27:53.943364+0000","last_undegraded":"2023-10-09T06:27:53.943364+0000","last_fullsized":"2023-10-09T06:27:53.943364+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:30:56.562227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935623+0000","last_change":"2023-10-09T06:27:53.935424+0000","last_active":"2023-10-09T06:27:53.935623+0000","last_peered":"2023-10-09T06:27:53.935623+0000","last_clean":"2023-10-09T06:27:53.935623+0000","last_became_active":"2023-10-09T06:27:53.934889+0000","last_became_peered":"2023-10-09T06:27:53.934889+0000","last_unstale":"2023-10-09T06:27:53.935623+0000","last_undegraded":"2023-10-09T06:27:53.935623+0000","last_fullsized":"2023-10-09T06:27:53.935623+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:30:57.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929879+0000","last_change":"2023-10-09T06:27:52.932310+0000","last_active":"2023-10-09T06:27:53.929879+0000","last_peered":"2023-10-09T06:27:53.929879+0000","last_clean":"2023-10-09T06:27:53.929879+0000","last_became_active":"2023-10-09T06:27:52.932078+0000","last_became_peered":"2023-10-09T06:27:52.932078+0000","last_unstale":"2023-10-09T06:27:53.929879+0000","last_undegraded":"2023-10-09T06:27:53.929879+0000","last_fullsized":"2023-10-09T06:27:53.929879+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:41.167438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936847+0000","last_change":"2023-10-09T06:27:53.935211+0000","last_active":"2023-10-09T06:27:53.936847+0000","last_peered":"2023-10-09T06:27:53.936847+0000","last_clean":"2023-10-09T06:27:53.936847+0000","last_became_active":"2023-10-09T06:27:53.934962+0000","last_became_peered":"2023-10-09T06:27:53.934962+0000","last_unstale":"2023-10-09T06:27:53.936847+0000","last_undegraded":"2023-10-09T06:27:53.936847+0000","last_fullsized":"2023-10-09T06:27:53.936847+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:09:41.794786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944429+0000","last_change":"2023-10-09T06:27:52.934337+0000","last_active":"2023-10-09T06:27:53.944429+0000","last_peered":"2023-10-09T06:27:53.944429+0000","last_clean":"2023-10-09T06:27:53.944429+0000","last_became_active":"2023-10-09T06:27:52.934093+0000","last_became_peered":"2023-10-09T06:27:52.934093+0000","last_unstale":"2023-10-09T06:27:53.944429+0000","last_undegraded":"2023-10-09T06:27:53.944429+0000","last_fullsized":"2023-10-09T06:27:53.944429+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:01.012691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.927994+0000","last_change":"2023-10-09T06:27:53.926120+0000","last_active":"2023-10-09T06:27:53.927994+0000","last_peered":"2023-10-09T06:27:53.927994+0000","last_clean":"2023-10-09T06:27:53.927994+0000","last_became_active":"2023-10-09T06:27:53.925870+0000","last_became_peered":"2023-10-09T06:27:53.925870+0000","last_unstale":"2023-10-09T06:27:53.927994+0000","last_undegraded":"2023-10-09T06:27:53.927994+0000","last_fullsized":"2023-10-09T06:27:53.927994+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:34.259293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928683+0000","last_change":"2023-10-09T06:27:52.933464+0000","last_active":"2023-10-09T06:27:53.928683+0000","last_peered":"2023-10-09T06:27:53.928683+0000","last_clean":"2023-10-09T06:27:53.928683+0000","last_became_active":"2023-10-09T06:27:52.933028+0000","last_became_peered":"2023-10-09T06:27:52.933028+0000","last_unstale":"2023-10-09T06:27:53.928683+0000","last_undegraded":"2023-10-09T06:27:53.928683+0000","last_fullsized":"2023-10-09T06:27:53.928683+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:17.467616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935640+0000","last_change":"2023-10-09T06:27:53.935550+0000","last_active":"2023-10-09T06:27:53.935640+0000","last_peered":"2023-10-09T06:27:53.935640+0000","last_clean":"2023-10-09T06:27:53.935640+0000","last_became_active":"2023-10-09T06:27:53.935183+0000","last_became_peered":"2023-10-09T06:27:53.935183+0000","last_unstale":"2023-10-09T06:27:53.935640+0000","last_undegraded":"2023-10-09T06:27:53.935640+0000","last_fullsized":"2023-10-09T06:27:53.935640+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:33.427078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929270+0000","last_change":"2023-10-09T06:27:52.928446+0000","last_active":"2023-10-09T06:27:53.929270+0000","last_peered":"2023-10-09T06:27:53.929270+0000","last_clean":"2023-10-09T06:27:53.929270+0000","last_became_active":"2023-10-09T06:27:52.928210+0000","last_became_peered":"2023-10-09T06:27:52.928210+0000","last_unstale":"2023-10-09T06:27:53.929270+0000","last_undegraded":"2023-10-09T06:27:53.929270+0000","last_fullsized":"2023-10-09T06:27:53.929270+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:34.395434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936406+0000","last_change":"2023-10-09T06:27:53.936346+0000","last_active":"2023-10-09T06:27:53.936406+0000","last_peered":"2023-10-09T06:27:53.936406+0000","last_clean":"2023-10-09T06:27:53.936406+0000","last_became_active":"2023-10-09T06:27:53.935987+0000","last_became_peered":"2023-10-09T06:27:53.935987+0000","last_unstale":"2023-10-09T06:27:53.936406+0000","last_undegraded":"2023-10-09T06:27:53.936406+0000","last_fullsized":"2023-10-09T06:27:53.936406+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:36.790853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929540+0000","last_change":"2023-10-09T06:27:52.932636+0000","last_active":"2023-10-09T06:27:53.929540+0000","last_peered":"2023-10-09T06:27:53.929540+0000","last_clean":"2023-10-09T06:27:53.929540+0000","last_became_active":"2023-10-09T06:27:52.932394+0000","last_became_peered":"2023-10-09T06:27:52.932394+0000","last_unstale":"2023-10-09T06:27:53.929540+0000","last_undegraded":"2023-10-09T06:27:53.929540+0000","last_fullsized":"2023-10-09T06:27:53.929540+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:12.418152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933150+0000","last_change":"2023-10-09T06:27:53.933075+0000","last_active":"2023-10-09T06:27:53.933150+0000","last_peered":"2023-10-09T06:27:53.933150+0000","last_clean":"2023-10-09T06:27:53.933150+0000","last_became_active":"2023-10-09T06:27:53.932578+0000","last_became_peered":"2023-10-09T06:27:53.932578+0000","last_unstale":"2023-10-09T06:27:53.933150+0000","last_undegraded":"2023-10-09T06:27:53.933150+0000","last_fullsized":"2023-10-09T06:27:53.933150+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:35.399846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.943627+0000","last_change":"2023-10-09T06:27:52.936108+0000","last_active":"2023-10-09T06:27:53.943627+0000","last_peered":"2023-10-09T06:27:53.943627+0000","last_clean":"2023-10-09T06:27:53.943627+0000","last_became_active":"2023-10-09T06:27:52.933621+0000","last_became_peered":"2023-10-09T06:27:52.933621+0000","last_unstale":"2023-10-09T06:27:53.943627+0000","last_undegraded":"2023-10-09T06:27:53.943627+0000","last_fullsized":"2023-10-09T06:27:53.943627+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:19.208277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932631+0000","last_change":"2023-10-09T06:27:53.932560+0000","last_active":"2023-10-09T06:27:53.932631+0000","last_peered":"2023-10-09T06:27:53.932631+0000","last_clean":"2023-10-09T06:27:53.932631+0000","last_became_active":"2023-10-09T06:27:53.932325+0000","last_became_peered":"2023-10-09T06:27:53.932325+0000","last_unstale":"2023-10-09T06:27:53.932631+0000","last_undegraded":"2023-10-09T06:27:53.932631+0000","last_fullsized":"2023-10-09T06:27:53.932631+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:07.101614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929099+0000","last_change":"2023-10-09T06:27:52.936079+0000","last_active":"2023-10-09T06:27:53.929099+0000","last_peered":"2023-10-09T06:27:53.929099+0000","last_clean":"2023-10-09T06:27:53.929099+0000","last_became_active":"2023-10-09T06:27:52.935872+0000","last_became_peered":"2023-10-09T06:27:52.935872+0000","last_unstale":"2023-10-09T06:27:53.929099+0000","last_undegraded":"2023-10-09T06:27:53.929099+0000","last_fullsized":"2023-10-09T06:27:53.929099+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:53.273517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932660+0000","last_change":"2023-10-09T06:27:53.932416+0000","last_active":"2023-10-09T06:27:53.932660+0000","last_peered":"2023-10-09T06:27:53.932660+0000","last_clean":"2023-10-09T06:27:53.932660+0000","last_became_active":"2023-10-09T06:27:53.931881+0000","last_became_peered":"2023-10-09T06:27:53.931881+0000","last_unstale":"2023-10-09T06:27:53.932660+0000","last_undegraded":"2023-10-09T06:27:53.932660+0000","last_fullsized":"2023-10-09T06:27:53.932660+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:00.721099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.922920+0000","last_change":"2023-10-09T06:27:52.936040+0000","last_active":"2023-10-09T06:27:53.922920+0000","last_peered":"2023-10-09T06:27:53.922920+0000","last_clean":"2023-10-09T06:27:53.922920+0000","last_became_active":"2023-10-09T06:27:52.935583+0000","last_became_peered":"2023-10-09T06:27:52.935583+0000","last_unstale":"2023-10-09T06:27:53.922920+0000","last_undegraded":"2023-10-09T06:27:53.922920+0000","last_fullsized":"2023-10-09T06:27:53.922920+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:11.452245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932055+0000","last_change":"2023-10-09T06:27:53.931942+0000","last_active":"2023-10-09T06:27:53.932055+0000","last_peered":"2023-10-09T06:27:53.932055+0000","last_clean":"2023-10-09T06:27:53.932055+0000","last_became_active":"2023-10-09T06:27:53.931696+0000","last_became_peered":"2023-10-09T06:27:53.931696+0000","last_unstale":"2023-10-09T06:27:53.932055+0000","last_undegraded":"2023-10-09T06:27:53.932055+0000","last_fullsized":"2023-10-09T06:27:53.932055+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:20.308885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928512+0000","last_change":"2023-10-09T06:27:52.934153+0000","last_active":"2023-10-09T06:27:53.928512+0000","last_peered":"2023-10-09T06:27:53.928512+0000","last_clean":"2023-10-09T06:27:53.928512+0000","last_became_active":"2023-10-09T06:27:52.933922+0000","last_became_peered":"2023-10-09T06:27:52.933922+0000","last_unstale":"2023-10-09T06:27:53.928512+0000","last_undegraded":"2023-10-09T06:27:53.928512+0000","last_fullsized":"2023-10-09T06:27:53.928512+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:02.855389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931930+0000","last_change":"2023-10-09T06:27:53.930498+0000","last_active":"2023-10-09T06:27:53.931930+0000","last_peered":"2023-10-09T06:27:53.931930+0000","last_clean":"2023-10-09T06:27:53.931930+0000","last_became_active":"2023-10-09T06:27:53.930280+0000","last_became_peered":"2023-10-09T06:27:53.930280+0000","last_unstale":"2023-10-09T06:27:53.931930+0000","last_undegraded":"2023-10-09T06:27:53.931930+0000","last_fullsized":"2023-10-09T06:27:53.931930+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:13.422563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.923333+0000","last_change":"2023-10-09T06:27:52.933533+0000","last_active":"2023-10-09T06:27:53.923333+0000","last_peered":"2023-10-09T06:27:53.923333+0000","last_clean":"2023-10-09T06:27:53.923333+0000","last_became_active":"2023-10-09T06:27:52.932880+0000","last_became_peered":"2023-10-09T06:27:52.932880+0000","last_unstale":"2023-10-09T06:27:53.923333+0000","last_undegraded":"2023-10-09T06:27:53.923333+0000","last_fullsized":"2023-10-09T06:27:53.923333+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:06.132532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935267+0000","last_change":"2023-10-09T06:27:53.935031+0000","last_active":"2023-10-09T06:27:53.935267+0000","last_peered":"2023-10-09T06:27:53.935267+0000","last_clean":"2023-10-09T06:27:53.935267+0000","last_became_active":"2023-10-09T06:27:53.932569+0000","last_became_peered":"2023-10-09T06:27:53.932569+0000","last_unstale":"2023-10-09T06:27:53.935267+0000","last_undegraded":"2023-10-09T06:27:53.935267+0000","last_fullsized":"2023-10-09T06:27:53.935267+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:43.355926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.926693+0000","last_change":"2023-10-09T06:27:52.933739+0000","last_active":"2023-10-09T06:27:53.926693+0000","last_peered":"2023-10-09T06:27:53.926693+0000","last_clean":"2023-10-09T06:27:53.926693+0000","last_became_active":"2023-10-09T06:27:52.933302+0000","last_became_peered":"2023-10-09T06:27:52.933302+0000","last_unstale":"2023-10-09T06:27:53.926693+0000","last_undegraded":"2023-10-09T06:27:53.926693+0000","last_fullsized":"2023-10-09T06:27:53.926693+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:03.249361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933919+0000","last_change":"2023-10-09T06:27:53.932522+0000","last_active":"2023-10-09T06:27:53.933919+0000","last_peered":"2023-10-09T06:27:53.933919+0000","last_clean":"2023-10-09T06:27:53.933919+0000","last_became_active":"2023-10-09T06:27:53.932210+0000","last_became_peered":"2023-10-09T06:27:53.932210+0000","last_unstale":"2023-10-09T06:27:53.933919+0000","last_undegraded":"2023-10-09T06:27:53.933919+0000","last_fullsized":"2023-10-09T06:27:53.933919+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:32.142862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933393+0000","last_change":"2023-10-09T06:27:52.935717+0000","last_active":"2023-10-09T06:27:53.933393+0000","last_peered":"2023-10-09T06:27:53.933393+0000","last_clean":"2023-10-09T06:27:53.933393+0000","last_became_active":"2023-10-09T06:27:52.935414+0000","last_became_peered":"2023-10-09T06:27:52.935414+0000","last_unstale":"2023-10-09T06:27:53.933393+0000","last_undegraded":"2023-10-09T06:27:53.933393+0000","last_fullsized":"2023-10-09T06:27:53.933393+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:40.048060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932624+0000","last_change":"2023-10-09T06:27:53.932120+0000","last_active":"2023-10-09T06:27:53.932624+0000","last_peered":"2023-10-09T06:27:53.932624+0000","last_clean":"2023-10-09T06:27:53.932624+0000","last_became_active":"2023-10-09T06:27:53.931913+0000","last_became_peered":"2023-10-09T06:27:53.931913+0000","last_unstale":"2023-10-09T06:27:53.932624+0000","last_undegraded":"2023-10-09T06:27:53.932624+0000","last_fullsized":"2023-10-09T06:27:53.932624+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:02.017103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928803+0000","last_change":"2023-10-09T06:27:52.935326+0000","last_active":"2023-10-09T06:27:53.928803+0000","last_peered":"2023-10-09T06:27:53.928803+0000","last_clean":"2023-10-09T06:27:53.928803+0000","last_became_active":"2023-10-09T06:27:52.935101+0000","last_became_peered":"2023-10-09T06:27:52.935101+0000","last_unstale":"2023-10-09T06:27:53.928803+0000","last_undegraded":"2023-10-09T06:27:53.928803+0000","last_fullsized":"2023-10-09T06:27:53.928803+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:59.555036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.937929+0000","last_change":"2023-10-09T06:27:53.937851+0000","last_active":"2023-10-09T06:27:53.937929+0000","last_peered":"2023-10-09T06:27:53.937929+0000","last_clean":"2023-10-09T06:27:53.937929+0000","last_became_active":"2023-10-09T06:27:53.937623+0000","last_became_peered":"2023-10-09T06:27:53.937623+0000","last_unstale":"2023-10-09T06:27:53.937929+0000","last_undegraded":"2023-10-09T06:27:53.937929+0000","last_fullsized":"2023-10-09T06:27:53.937929+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:46.105971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944011+0000","last_change":"2023-10-09T06:27:52.932778+0000","last_active":"2023-10-09T06:27:53.944011+0000","last_peered":"2023-10-09T06:27:53.944011+0000","last_clean":"2023-10-09T06:27:53.944011+0000","last_became_active":"2023-10-09T06:27:52.932545+0000","last_became_peered":"2023-10-09T06:27:52.932545+0000","last_unstale":"2023-10-09T06:27:53.944011+0000","last_undegraded":"2023-10-09T06:27:53.944011+0000","last_fullsized":"2023-10-09T06:27:53.944011+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:53.938974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.926486+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:27:53.926486+0000","last_peered":"2023-10-09T06:27:53.926486+0000","last_clean":"2023-10-09T06:27:53.926486+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:27:53.926486+0000","last_undegraded":"2023-10-09T06:27:53.926486+0000","last_fullsized":"2023-10-09T06:27:53.926486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1404,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193908,"statfs":{"total":200000000,"available":198562073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.64400000000000002,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.58199999999999996,"15min":0.52700000000000002},"min":{"1min":0.378,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.73099999999999998,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.443}]},{"osd":1,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54700000000000004,"15min":0.50900000000000001},"min":{"1min":0.40400000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77600000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.51300000000000001},"min":{"1min":0.42999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71499999999999997,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.71499999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61799999999999999,"15min":0.57899999999999996},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69799999999999995,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.622},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59599999999999997,"15min":0.54400000000000004},"min":{"1min":0.44900000000000001,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.76500000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.64800000000000002,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.318},"max":{"1min":0.73199999999999998,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":0.56999999999999995},"min":{"1min":0.377,"5min":0.374,"15min":0.32400000000000001},"max":{"1min":0.76500000000000001,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.69199999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.30499999999999999,"5min":0.27200000000000002,"15min":0.23799999999999999},"max":{"1min":0.74199999999999999,"5min":0.872,"15min":0.872},"last":0.495},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.34699999999999998,"5min":0.27000000000000002,"15min":0.25600000000000001},"max":{"1min":0.76900000000000002,"5min":0.79800000000000004,"15min":0.86099999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.495,"15min":0.48399999999999999},"min":{"1min":0.375,"5min":0.255,"15min":0.255},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.47699999999999998,"5min":0.33400000000000002,"15min":0.29199999999999998},"max":{"1min":0.79900000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.61199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":827,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194485,"statfs":{"total":200000000,"available":199153051,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53100000000000003,"15min":0.72499999999999998},"min":{"1min":0.41499999999999998,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.746,"5min":0.77100000000000002,"15min":7.0960000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.80900000000000005,"15min":1.133},"last":0.628}]},{"osd":1,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":1.155},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.443,"5min":0.378,"15min":0.317},"max":{"1min":0.748,"5min":0.75600000000000001,"15min":1.1459999999999999},"last":0.64200000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.59099999999999997},"min":{"1min":0.48799999999999999,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.746,"5min":0.82999999999999996,"15min":1.2290000000000001},"last":0.502},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56200000000000006,"15min":0.73999999999999999},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.81200000000000006,"5min":0.89100000000000001,"15min":7.1299999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.59199999999999997},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.80100000000000005,"5min":0.85599999999999998,"15min":1.337},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.755,"5min":0.81299999999999994,"15min":1.206},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.749,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.371},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.505,"15min":0.5},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.40600000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48099999999999998,"15min":0.47499999999999998},"min":{"1min":0.377,"5min":0.312,"15min":0.312},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.80000000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35599999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.315},"max":{"1min":0.81100000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77900000000000003,"5min":0.80100000000000005,"15min":0.82399999999999995},"last":0.46500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154587,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35599999999999998,"15min":0.36599999999999999},"min":{"1min":0.24199999999999999,"5min":0.223,"15min":0.219},"max":{"1min":0.56699999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.378,"15min":0.34000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.54400000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.37}]},{"osd":2,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.34899999999999998,"15min":0.34599999999999997},"min":{"1min":0.251,"5min":0.23599999999999999,"15min":0.222},"max":{"1min":0.503,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41999999999999998,"15min":0.39100000000000001},"min":{"1min":0.28699999999999998,"5min":0.255,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.437}]},{"osd":3,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.41999999999999998},"min":{"1min":0.33400000000000002,"5min":0.30199999999999999,"15min":0.29199999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.443,"15min":0.42799999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58899999999999997,"15min":0.56299999999999994},"min":{"1min":0.35699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.70699999999999996,"5min":1.097,"15min":1.097},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60999999999999999,"15min":0.77200000000000002},"min":{"1min":0.45300000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81299999999999994,"5min":0.90200000000000002,"15min":5.5270000000000001},"last":0.57599999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64000000000000001,"15min":0.626},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.83999999999999997,"5min":1.125,"15min":1.125},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64200000000000002,"15min":0.65800000000000003},"min":{"1min":0.42699999999999999,"5min":0.40400000000000003,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":1.175,"15min":1.4219999999999999},"last":0.64400000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64900000000000002,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94099999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.38500000000000001},"max":{"1min":0.88400000000000001,"5min":1.125,"15min":1.49},"last":0.66900000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.64400000000000002},"min":{"1min":0.44,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93000000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78900000000000003,"5min":1.052,"15min":1.052},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1402,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193910,"statfs":{"total":200000000,"available":198564219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.35599999999999998,"15min":0.40200000000000002},"min":{"1min":0.216,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51600000000000001,"5min":0.65800000000000003,"15min":1.226},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.41599999999999998},"min":{"1min":0.26900000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.64300000000000002,"5min":0.71899999999999997,"15min":1.131},"last":0.32700000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38500000000000001,"15min":0.88200000000000001},"min":{"1min":0.28299999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.44500000000000001,"5min":0.64400000000000002,"15min":12.929},"last":0.312},{"interface":"front","average":{"1min":0.372,"5min":0.41599999999999998,"15min":0.45100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53600000000000003,"5min":0.70899999999999996,"15min":1.1599999999999999},"last":0.26500000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44,"15min":0.46700000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58499999999999996,"5min":0.76100000000000001,"15min":1.1859999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.441,"15min":0.47899999999999998},"min":{"1min":0.36699999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55800000000000005,"5min":0.69199999999999995,"15min":1.3089999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76000000000000001,"5min":0.86299999999999999,"15min":0.93200000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59899999999999998,"15min":0.64300000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41099999999999998},"max":{"1min":0.754,"5min":0.97099999999999997,"15min":1.335},"last":0.68999999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.61399999999999999},"min":{"1min":0.40799999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77800000000000002,"5min":0.90700000000000003,"15min":1.0580000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.66900000000000004,"5min":0.82199999999999995,"15min":0.999},"last":0.622}]},{"osd":6,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59199999999999997,"15min":0.61299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78600000000000003,"5min":0.83099999999999996,"15min":0.998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.82899999999999996,"5min":0.93899999999999995,"15min":1.2849999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40400000000000003},"max":{"1min":0.80100000000000005,"5min":0.92800000000000005,"15min":1.262},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64400000000000002,"15min":0.66100000000000003},"min":{"1min":0.48299999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76100000000000001,"5min":0.95599999999999996,"15min":1.103},"last":0.54900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":826,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199153999,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.35499999999999998,"15min":0.78600000000000003},"min":{"1min":0.24199999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.46700000000000003,"5min":0.79000000000000004,"15min":14.981999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38400000000000001,"15min":0.62},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.59699999999999998,"5min":0.64100000000000001,"15min":9.1600000000000001},"last":0.312}]},{"osd":1,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36899999999999999,"15min":0.58399999999999996},"min":{"1min":0.28199999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.55400000000000005,"5min":0.73099999999999998,"15min":8.4930000000000003},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.42599999999999999,"15min":0.65200000000000002},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":0.53500000000000003,"5min":0.91400000000000003,"15min":9.0239999999999991},"last":0.35599999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44800000000000001,"15min":0.65600000000000003},"min":{"1min":0.33000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61599999999999999,"5min":0.84299999999999997,"15min":8.5190000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.44700000000000001,"15min":0.85099999999999998},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.56100000000000005,"5min":0.87,"15min":15.007999999999999},"last":0.33000000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63700000000000001,"15min":1.052},"min":{"1min":0.41399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93799999999999994,"5min":0.95299999999999996,"15min":14.917999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65400000000000003,"15min":0.879},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90300000000000002,"5min":1.1160000000000001,"15min":8.9930000000000003},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65200000000000002,"15min":0.85799999999999998},"min":{"1min":0.439,"5min":0.432,"15min":0.35899999999999999},"max":{"1min":0.94599999999999995,"5min":0.96299999999999997,"15min":8.9610000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.86299999999999999},"min":{"1min":0.45100000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.03,"5min":1.03,"15min":8.3919999999999995},"last":0.45200000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64900000000000002,"15min":0.84799999999999998},"min":{"1min":0.498,"5min":0.42499999999999999,"15min":0.39900000000000002},"max":{"1min":0.97299999999999998,"5min":1.026,"15min":8.4339999999999993},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66200000000000003,"15min":1.054},"min":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.028,"15min":14.954000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64300000000000002,"15min":0.84399999999999997},"min":{"1min":0.42599999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":8.9160000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65500000000000003,"15min":0.85899999999999999},"min":{"1min":0.46800000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":1.0609999999999999,"15min":8.4640000000000004},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574937,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154427,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58599999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41699999999999998,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35599999999999998,"15min":0.32800000000000001},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.215},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.433},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.40000000000000002,"15min":0.35699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38800000000000001,"15min":0.36499999999999999},"min":{"1min":0.27000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46899999999999997,"15min":0.42499999999999999},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53800000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.375},"max":{"1min":0.77700000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.434,"5min":0.372,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.84799999999999998,"15min":0.91500000000000004},"last":0.68899999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64200000000000002,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.77100000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64000000000000001,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.38800000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63600000000000001,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.91700000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.64000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154517,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52500000000000002,"15min":0.498},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.29299999999999998},"max":{"1min":0.624,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.53300000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.70199999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.254},"max":{"1min":0.68300000000000005,"5min":0.73999999999999999,"15min":0.77000000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.68000000000000005},"min":{"1min":0.433,"5min":0.38500000000000001,"15min":0.34499999999999997},"max":{"1min":0.67400000000000004,"5min":0.83299999999999996,"15min":4.3250000000000002},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54300000000000004,"15min":0.67200000000000004},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.71299999999999997,"5min":0.79900000000000004,"15min":4.7320000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.98099999999999998},"min":{"1min":0.40999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65100000000000002,"5min":0.80200000000000005,"15min":11.715},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56299999999999994,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.35199999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.39000000000000001},"max":{"1min":0.73999999999999999,"5min":0.81299999999999994,"15min":0.85599999999999998},"last":0.63}]},{"osd":5,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.503,"15min":0.51500000000000001},"min":{"1min":0.28799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.77100000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.315,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":0.75700000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.36399999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74299999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64200000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.81599999999999995,"5min":0.879,"15min":0.879},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.38500000000000001,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.83399999999999996,"15min":0.88600000000000001},"last":0.54700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154475,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54600000000000004,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56399999999999995,"15min":0.52700000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.753,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55200000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.52400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82299999999999995,"5min":1.093,"15min":1.093},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57599999999999996,"15min":0.52800000000000002},"min":{"1min":0.46400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.745,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59399999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55100000000000005,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68000000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79800000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45300000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.78300000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61499999999999999,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77700000000000002,"5min":1.071,"15min":1.071},"last":0.58099999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47799999999999998,"15min":0.497},"min":{"1min":0.29199999999999998,"5min":0.28899999999999998,"15min":0.27500000000000002},"max":{"1min":0.65200000000000002,"5min":0.79000000000000004,"15min":0.84399999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.5,"15min":0.503},"min":{"1min":0.32300000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.72599999999999998,"5min":0.76900000000000002,"15min":0.81000000000000005},"last":0.48399999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.52800000000000002},"min":{"1min":0.308,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59999999999999998,"5min":0.85199999999999998,"15min":1.0680000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.31},"max":{"1min":0.74099999999999999,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.60599999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.30399999999999999},"max":{"1min":0.76700000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.626},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.32600000000000001},"max":{"1min":0.75800000000000001,"5min":0.84399999999999997,"15min":1.0269999999999999},"last":0.53800000000000003}]}]}],"pool_statfs":[]}} 2023-10-09T06:28:02.606 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:28:03.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.405+0000 7f87431c6700 1 Processor -- start 2023-10-09T06:28:03.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.405+0000 7f87431c6700 1 -- start start 2023-10-09T06:28:03.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.406+0000 7f87431c6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f873c15b340 0x7f873c070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:03.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.406+0000 7f87431c6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f873c15c4f0 0x7f873c070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:03.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.406+0000 7f87431c6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873c068a90 con 0x7f873c0cb000 2023-10-09T06:28:03.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.406+0000 7f87431c6700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873c0ca330 con 0x7f873c15b340 2023-10-09T06:28:03.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.406+0000 7f87431c6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c15ca70 con 0x7f873c15c4f0 2023-10-09T06:28:03.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.407+0000 7f8741763700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f873c15c4f0 0x7f873c070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:03.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.407+0000 7f8740f62700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f873c15b340 0x7f873c070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:03.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.407+0000 7f8741763700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f873c15c4f0 0x7f873c070c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:42232/0 (socket says 172.21.15.31:42232) 2023-10-09T06:28:03.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.407+0000 7f8740f62700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f873c15b340 0x7f873c070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:55734/0 (socket says 172.21.15.31:55734) 2023-10-09T06:28:03.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.407+0000 7f8741763700 1 -- 172.21.15.31:0/1984483749 learned_addr learned my addr 172.21.15.31:0/1984483749 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:03.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.407+0000 7f873bfff700 1 --1- 172.21.15.31:0/1984483749 >> v1:172.21.15.158:6789/0 conn(0x7f873c0cb000 0x7f873c067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:40618/0 (socket says 172.21.15.31:40618) 2023-10-09T06:28:03.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.407+0000 7f8741763700 1 -- 172.21.15.31:0/1984483749 >> v2:172.21.15.158:3300/0 conn(0x7f873c15b340 msgr2=0x7f873c070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:03.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.407+0000 7f8741763700 1 --2- 172.21.15.31:0/1984483749 >> v2:172.21.15.158:3300/0 conn(0x7f873c15b340 0x7f873c070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:03.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.407+0000 7f8741763700 1 -- 172.21.15.31:0/1984483749 >> v1:172.21.15.158:6789/0 conn(0x7f873c0cb000 legacy=0x7f873c067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:03.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.407+0000 7f8741763700 1 -- 172.21.15.31:0/1984483749 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c068f20 con 0x7f873c15c4f0 2023-10-09T06:28:03.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.407+0000 7f873b7fe700 1 -- 172.21.15.31:0/1984483749 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115076867 0 0) 0x7f873c068a90 con 0x7f873c0cb000 2023-10-09T06:28:03.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.407+0000 7f8740f62700 1 --2- 172.21.15.31:0/1984483749 >> v2:172.21.15.158:3300/0 conn(0x7f873c15b340 0x7f873c070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:28:03.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.407+0000 7f8741763700 1 --2- 172.21.15.31:0/1984483749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f873c15c4f0 0x7f873c070c40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f87240099b0 tx=0x7f8724009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=970dfc2152126cac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:03.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.408+0000 7f873b7fe700 1 -- 172.21.15.31:0/1984483749 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724009ea0 con 0x7f873c15c4f0 2023-10-09T06:28:03.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.408+0000 7f873b7fe700 1 -- 172.21.15.31:0/1984483749 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872400b860 con 0x7f873c15c4f0 2023-10-09T06:28:03.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.408+0000 7f873b7fe700 1 -- 172.21.15.31:0/1984483749 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400bc00 con 0x7f873c15c4f0 2023-10-09T06:28:03.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.408+0000 7f87431c6700 1 -- 172.21.15.31:0/1984483749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f873c15c4f0 msgr2=0x7f873c070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:03.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.408+0000 7f87431c6700 1 --2- 172.21.15.31:0/1984483749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f873c15c4f0 0x7f873c070c40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f87240099b0 tx=0x7f8724009250 comp rx=0 tx=0).stop 2023-10-09T06:28:03.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.408+0000 7f87431c6700 1 -- 172.21.15.31:0/1984483749 shutdown_connections 2023-10-09T06:28:03.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.408+0000 7f87431c6700 1 --2- 172.21.15.31:0/1984483749 >> v2:172.21.15.158:3300/0 conn(0x7f873c15b340 0x7f873c070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:03.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.408+0000 7f87431c6700 1 --2- 172.21.15.31:0/1984483749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f873c15c4f0 0x7f873c070c40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:03.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.408+0000 7f87431c6700 1 -- 172.21.15.31:0/1984483749 >> 172.21.15.31:0/1984483749 conn(0x7f873c0ca4f0 msgr2=0x7f873c0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:03.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.408+0000 7f87431c6700 1 -- 172.21.15.31:0/1984483749 shutdown_connections 2023-10-09T06:28:03.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.408+0000 7f87431c6700 1 -- 172.21.15.31:0/1984483749 wait complete. 2023-10-09T06:28:03.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.409+0000 7f87431c6700 1 Processor -- start 2023-10-09T06:28:03.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.409+0000 7f87431c6700 1 -- start start 2023-10-09T06:28:03.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.410+0000 7f87431c6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f873c0cb000 0x7f873c169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:03.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.410+0000 7f87431c6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f873c15b340 0x7f873c14e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:03.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.410+0000 7f87431c6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f873c15c4f0 0x7f873c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:03.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.410+0000 7f87431c6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c14ebf0 con 0x7f873c15c4f0 2023-10-09T06:28:03.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.410+0000 7f87431c6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c152330 con 0x7f873c15b340 2023-10-09T06:28:03.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.410+0000 7f87431c6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c151a00 con 0x7f873c0cb000 2023-10-09T06:28:03.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.410+0000 7f8741763700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f873c15c4f0 0x7f873c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:03.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.410+0000 7f8741763700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f873c15c4f0 0x7f873c155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52404/0 (socket says 172.21.15.31:52404) 2023-10-09T06:28:03.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.410+0000 7f8741763700 1 -- 172.21.15.31:0/616620900 learned_addr learned my addr 172.21.15.31:0/616620900 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:03.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.410+0000 7f8740f62700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f873c0cb000 0x7f873c169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:03.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.410+0000 7f873bfff700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f873c15b340 0x7f873c14e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:03.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.411+0000 7f8741763700 1 -- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f873c0cb000 msgr2=0x7f873c169db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:03.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.411+0000 7f8741763700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f873c0cb000 0x7f873c169db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:03.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.411+0000 7f8741763700 1 -- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f873c15b340 msgr2=0x7f873c14e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:03.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.411+0000 7f8741763700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f873c15b340 0x7f873c14e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:03.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.411+0000 7f8741763700 1 -- 172.21.15.31:0/616620900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8734009a20 con 0x7f873c15c4f0 2023-10-09T06:28:03.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.411+0000 7f8741763700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f873c15c4f0 0x7f873c155cd0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8724006fd0 tx=0x7f8724017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:03.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.411+0000 7f8738ff9700 1 -- 172.21.15.31:0/616620900 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400baa0 con 0x7f873c15c4f0 2023-10-09T06:28:03.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.411+0000 7f8738ff9700 1 -- 172.21.15.31:0/616620900 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8724025420 con 0x7f873c15c4f0 2023-10-09T06:28:03.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.411+0000 7f87431c6700 1 -- 172.21.15.31:0/616620900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87240094f0 con 0x7f873c15c4f0 2023-10-09T06:28:03.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.411+0000 7f8738ff9700 1 -- 172.21.15.31:0/616620900 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240257e0 con 0x7f873c15c4f0 2023-10-09T06:28:03.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.411+0000 7f87431c6700 1 -- 172.21.15.31:0/616620900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873c151fc0 con 0x7f873c15c4f0 2023-10-09T06:28:03.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.412+0000 7f87431c6700 1 -- 172.21.15.31:0/616620900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873c04c3c0 con 0x7f873c15c4f0 2023-10-09T06:28:03.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.413+0000 7f8738ff9700 1 -- 172.21.15.31:0/616620900 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8724023070 con 0x7f873c15c4f0 2023-10-09T06:28:03.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.413+0000 7f8738ff9700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f871c066f30 0x7f871c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:03.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.413+0000 7f8738ff9700 1 -- 172.21.15.31:0/616620900 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8724085af0 con 0x7f873c15c4f0 2023-10-09T06:28:03.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.413+0000 7f8740f62700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f871c066f30 0x7f871c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:03.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.414+0000 7f8740f62700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f871c066f30 0x7f871c0693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8734009fd0 tx=0x7f873400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:03.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.417+0000 7f8738ff9700 1 -- 172.21.15.31:0/616620900 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8724052d60 con 0x7f873c15c4f0 2023-10-09T06:28:03.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.608+0000 7f87431c6700 1 -- 172.21.15.31:0/616620900 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f873c06b620 con 0x7f871c066f30 2023-10-09T06:28:03.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.618+0000 7f8738ff9700 1 -- 172.21.15.31:0/616620900 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285392 (secure 0 0 0) 0x7f873c06b620 con 0x7f871c066f30 2023-10-09T06:28:03.622 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.621+0000 7f87431c6700 1 -- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f871c066f30 msgr2=0x7f871c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.621+0000 7f87431c6700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f871c066f30 0x7f871c0693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8734009fd0 tx=0x7f873400b040 comp rx=0 tx=0).stop 2023-10-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.621+0000 7f87431c6700 1 -- 172.21.15.31:0/616620900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f873c15c4f0 msgr2=0x7f873c155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.621+0000 7f87431c6700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f873c15c4f0 0x7f873c155cd0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8724006fd0 tx=0x7f8724017000 comp rx=0 tx=0).stop 2023-10-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.621+0000 7f87431c6700 1 -- 172.21.15.31:0/616620900 shutdown_connections 2023-10-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.621+0000 7f87431c6700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f871c066f30 0x7f871c0693e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.621+0000 7f87431c6700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f873c0cb000 0x7f873c169db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.621+0000 7f87431c6700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f873c15c4f0 0x7f873c155cd0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.621+0000 7f87431c6700 1 --2- 172.21.15.31:0/616620900 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f873c15b340 0x7f873c14e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.621+0000 7f87431c6700 1 -- 172.21.15.31:0/616620900 >> 172.21.15.31:0/616620900 conn(0x7f873c0ca4f0 msgr2=0x7f873c0cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.621+0000 7f87431c6700 1 -- 172.21.15.31:0/616620900 shutdown_connections 2023-10-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.621+0000 7f87431c6700 1 -- 172.21.15.31:0/616620900 wait complete. 2023-10-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:28:03.634 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2023-10-09T06:28:02.620676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7762,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554737,"statfs":{"total":1600000000,"available":1592051348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.698338"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931157+0000","last_change":"2023-10-09T06:27:53.931079+0000","last_active":"2023-10-09T06:27:53.931157+0000","last_peered":"2023-10-09T06:27:53.931157+0000","last_clean":"2023-10-09T06:27:53.931157+0000","last_became_active":"2023-10-09T06:27:53.930657+0000","last_became_peered":"2023-10-09T06:27:53.930657+0000","last_unstale":"2023-10-09T06:27:53.931157+0000","last_undegraded":"2023-10-09T06:27:53.931157+0000","last_fullsized":"2023-10-09T06:27:53.931157+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:54:03.907542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.925903+0000","last_change":"2023-10-09T06:27:53.925366+0000","last_active":"2023-10-09T06:27:53.925903+0000","last_peered":"2023-10-09T06:27:53.925903+0000","last_clean":"2023-10-09T06:27:53.925903+0000","last_became_active":"2023-10-09T06:27:53.925120+0000","last_became_peered":"2023-10-09T06:27:53.925120+0000","last_unstale":"2023-10-09T06:27:53.925903+0000","last_undegraded":"2023-10-09T06:27:53.925903+0000","last_fullsized":"2023-10-09T06:27:53.925903+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:32.047523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.930114+0000","last_change":"2023-10-09T06:27:53.929645+0000","last_active":"2023-10-09T06:27:53.930114+0000","last_peered":"2023-10-09T06:27:53.930114+0000","last_clean":"2023-10-09T06:27:53.930114+0000","last_became_active":"2023-10-09T06:27:53.929416+0000","last_became_peered":"2023-10-09T06:27:53.929416+0000","last_unstale":"2023-10-09T06:27:53.930114+0000","last_undegraded":"2023-10-09T06:27:53.930114+0000","last_fullsized":"2023-10-09T06:27:53.930114+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:54.277929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936804+0000","last_change":"2023-10-09T06:27:53.934571+0000","last_active":"2023-10-09T06:27:53.936804+0000","last_peered":"2023-10-09T06:27:53.936804+0000","last_clean":"2023-10-09T06:27:53.936804+0000","last_became_active":"2023-10-09T06:27:53.933993+0000","last_became_peered":"2023-10-09T06:27:53.933993+0000","last_unstale":"2023-10-09T06:27:53.936804+0000","last_undegraded":"2023-10-09T06:27:53.936804+0000","last_fullsized":"2023-10-09T06:27:53.936804+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:59:21.186206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935619+0000","last_change":"2023-10-09T06:27:53.935452+0000","last_active":"2023-10-09T06:27:53.935619+0000","last_peered":"2023-10-09T06:27:53.935619+0000","last_clean":"2023-10-09T06:27:53.935619+0000","last_became_active":"2023-10-09T06:27:53.932073+0000","last_became_peered":"2023-10-09T06:27:53.932073+0000","last_unstale":"2023-10-09T06:27:53.935619+0000","last_undegraded":"2023-10-09T06:27:53.935619+0000","last_fullsized":"2023-10-09T06:27:53.935619+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:53.233334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929855+0000","last_change":"2023-10-09T06:27:53.929750+0000","last_active":"2023-10-09T06:27:53.929855+0000","last_peered":"2023-10-09T06:27:53.929855+0000","last_clean":"2023-10-09T06:27:53.929855+0000","last_became_active":"2023-10-09T06:27:53.929021+0000","last_became_peered":"2023-10-09T06:27:53.929021+0000","last_unstale":"2023-10-09T06:27:53.929855+0000","last_undegraded":"2023-10-09T06:27:53.929855+0000","last_fullsized":"2023-10-09T06:27:53.929855+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:00:58.002430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928014+0000","last_change":"2023-10-09T06:27:53.926233+0000","last_active":"2023-10-09T06:27:53.928014+0000","last_peered":"2023-10-09T06:27:53.928014+0000","last_clean":"2023-10-09T06:27:53.928014+0000","last_became_active":"2023-10-09T06:27:53.925764+0000","last_became_peered":"2023-10-09T06:27:53.925764+0000","last_unstale":"2023-10-09T06:27:53.928014+0000","last_undegraded":"2023-10-09T06:27:53.928014+0000","last_fullsized":"2023-10-09T06:27:53.928014+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:52.041346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934364+0000","last_change":"2023-10-09T06:27:53.934291+0000","last_active":"2023-10-09T06:27:53.934364+0000","last_peered":"2023-10-09T06:27:53.934364+0000","last_clean":"2023-10-09T06:27:53.934364+0000","last_became_active":"2023-10-09T06:27:53.933988+0000","last_became_peered":"2023-10-09T06:27:53.933988+0000","last_unstale":"2023-10-09T06:27:53.934364+0000","last_undegraded":"2023-10-09T06:27:53.934364+0000","last_fullsized":"2023-10-09T06:27:53.934364+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:41.052472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934633+0000","last_change":"2023-10-09T06:27:53.934432+0000","last_active":"2023-10-09T06:27:53.934633+0000","last_peered":"2023-10-09T06:27:53.934633+0000","last_clean":"2023-10-09T06:27:53.934633+0000","last_became_active":"2023-10-09T06:27:53.934138+0000","last_became_peered":"2023-10-09T06:27:53.934138+0000","last_unstale":"2023-10-09T06:27:53.934633+0000","last_undegraded":"2023-10-09T06:27:53.934633+0000","last_fullsized":"2023-10-09T06:27:53.934633+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:32:48.606592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928844+0000","last_change":"2023-10-09T06:27:53.927444+0000","last_active":"2023-10-09T06:27:53.928844+0000","last_peered":"2023-10-09T06:27:53.928844+0000","last_clean":"2023-10-09T06:27:53.928844+0000","last_became_active":"2023-10-09T06:27:53.927183+0000","last_became_peered":"2023-10-09T06:27:53.927183+0000","last_unstale":"2023-10-09T06:27:53.928844+0000","last_undegraded":"2023-10-09T06:27:53.928844+0000","last_fullsized":"2023-10-09T06:27:53.928844+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:57.800112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932719+0000","last_change":"2023-10-09T06:27:53.931130+0000","last_active":"2023-10-09T06:27:53.932719+0000","last_peered":"2023-10-09T06:27:53.932719+0000","last_clean":"2023-10-09T06:27:53.932719+0000","last_became_active":"2023-10-09T06:27:53.930912+0000","last_became_peered":"2023-10-09T06:27:53.930912+0000","last_unstale":"2023-10-09T06:27:53.932719+0000","last_undegraded":"2023-10-09T06:27:53.932719+0000","last_fullsized":"2023-10-09T06:27:53.932719+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:03.328092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931658+0000","last_change":"2023-10-09T06:27:53.931531+0000","last_active":"2023-10-09T06:27:53.931658+0000","last_peered":"2023-10-09T06:27:53.931658+0000","last_clean":"2023-10-09T06:27:53.931658+0000","last_became_active":"2023-10-09T06:27:53.931172+0000","last_became_peered":"2023-10-09T06:27:53.931172+0000","last_unstale":"2023-10-09T06:27:53.931658+0000","last_undegraded":"2023-10-09T06:27:53.931658+0000","last_fullsized":"2023-10-09T06:27:53.931658+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:04.253773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929951+0000","last_change":"2023-10-09T06:27:53.929876+0000","last_active":"2023-10-09T06:27:53.929951+0000","last_peered":"2023-10-09T06:27:53.929951+0000","last_clean":"2023-10-09T06:27:53.929951+0000","last_became_active":"2023-10-09T06:27:53.929662+0000","last_became_peered":"2023-10-09T06:27:53.929662+0000","last_unstale":"2023-10-09T06:27:53.929951+0000","last_undegraded":"2023-10-09T06:27:53.929951+0000","last_fullsized":"2023-10-09T06:27:53.929951+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:47.143291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932605+0000","last_change":"2023-10-09T06:27:53.932111+0000","last_active":"2023-10-09T06:27:53.932605+0000","last_peered":"2023-10-09T06:27:53.932605+0000","last_clean":"2023-10-09T06:27:53.932605+0000","last_became_active":"2023-10-09T06:27:53.931590+0000","last_became_peered":"2023-10-09T06:27:53.931590+0000","last_unstale":"2023-10-09T06:27:53.932605+0000","last_undegraded":"2023-10-09T06:27:53.932605+0000","last_fullsized":"2023-10-09T06:27:53.932605+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:15.353816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936868+0000","last_change":"2023-10-09T06:27:53.935770+0000","last_active":"2023-10-09T06:27:53.936868+0000","last_peered":"2023-10-09T06:27:53.936868+0000","last_clean":"2023-10-09T06:27:53.936868+0000","last_became_active":"2023-10-09T06:27:53.935568+0000","last_became_peered":"2023-10-09T06:27:53.935568+0000","last_unstale":"2023-10-09T06:27:53.936868+0000","last_undegraded":"2023-10-09T06:27:53.936868+0000","last_fullsized":"2023-10-09T06:27:53.936868+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:44.999564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.937757+0000","last_change":"2023-10-09T06:27:53.937694+0000","last_active":"2023-10-09T06:27:53.937757+0000","last_peered":"2023-10-09T06:27:53.937757+0000","last_clean":"2023-10-09T06:27:53.937757+0000","last_became_active":"2023-10-09T06:27:53.937257+0000","last_became_peered":"2023-10-09T06:27:53.937257+0000","last_unstale":"2023-10-09T06:27:53.937757+0000","last_undegraded":"2023-10-09T06:27:53.937757+0000","last_fullsized":"2023-10-09T06:27:53.937757+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:46.105971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934363+0000","last_change":"2023-10-09T06:27:53.933906+0000","last_active":"2023-10-09T06:27:53.934363+0000","last_peered":"2023-10-09T06:27:53.934363+0000","last_clean":"2023-10-09T06:27:53.934363+0000","last_became_active":"2023-10-09T06:27:53.933686+0000","last_became_peered":"2023-10-09T06:27:53.933686+0000","last_unstale":"2023-10-09T06:27:53.934363+0000","last_undegraded":"2023-10-09T06:27:53.934363+0000","last_fullsized":"2023-10-09T06:27:53.934363+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:41.052472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.938142+0000","last_change":"2023-10-09T06:27:53.937954+0000","last_active":"2023-10-09T06:27:53.938142+0000","last_peered":"2023-10-09T06:27:53.938142+0000","last_clean":"2023-10-09T06:27:53.938142+0000","last_became_active":"2023-10-09T06:27:53.937446+0000","last_became_peered":"2023-10-09T06:27:53.937446+0000","last_unstale":"2023-10-09T06:27:53.938142+0000","last_undegraded":"2023-10-09T06:27:53.938142+0000","last_fullsized":"2023-10-09T06:27:53.938142+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:13.422563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932699+0000","last_change":"2023-10-09T06:27:53.930521+0000","last_active":"2023-10-09T06:27:53.932699+0000","last_peered":"2023-10-09T06:27:53.932699+0000","last_clean":"2023-10-09T06:27:53.932699+0000","last_became_active":"2023-10-09T06:27:53.929878+0000","last_became_peered":"2023-10-09T06:27:53.929878+0000","last_unstale":"2023-10-09T06:27:53.932699+0000","last_undegraded":"2023-10-09T06:27:53.932699+0000","last_fullsized":"2023-10-09T06:27:53.932699+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:28.851401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934655+0000","last_change":"2023-10-09T06:27:53.934514+0000","last_active":"2023-10-09T06:27:53.934655+0000","last_peered":"2023-10-09T06:27:53.934655+0000","last_clean":"2023-10-09T06:27:53.934655+0000","last_became_active":"2023-10-09T06:27:53.934162+0000","last_became_peered":"2023-10-09T06:27:53.934162+0000","last_unstale":"2023-10-09T06:27:53.934655+0000","last_undegraded":"2023-10-09T06:27:53.934655+0000","last_fullsized":"2023-10-09T06:27:53.934655+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:53.233334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931910+0000","last_change":"2023-10-09T06:27:53.929981+0000","last_active":"2023-10-09T06:27:53.931910+0000","last_peered":"2023-10-09T06:27:53.931910+0000","last_clean":"2023-10-09T06:27:53.931910+0000","last_became_active":"2023-10-09T06:27:53.929704+0000","last_became_peered":"2023-10-09T06:27:53.929704+0000","last_unstale":"2023-10-09T06:27:53.931910+0000","last_undegraded":"2023-10-09T06:27:53.931910+0000","last_fullsized":"2023-10-09T06:27:53.931910+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:08.541119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933836+0000","last_change":"2023-10-09T06:27:53.933774+0000","last_active":"2023-10-09T06:27:53.933836+0000","last_peered":"2023-10-09T06:27:53.933836+0000","last_clean":"2023-10-09T06:27:53.933836+0000","last_became_active":"2023-10-09T06:27:53.933400+0000","last_became_peered":"2023-10-09T06:27:53.933400+0000","last_unstale":"2023-10-09T06:27:53.933836+0000","last_undegraded":"2023-10-09T06:27:53.933836+0000","last_fullsized":"2023-10-09T06:27:53.933836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:19.247833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932320+0000","last_change":"2023-10-09T06:27:53.932149+0000","last_active":"2023-10-09T06:27:53.932320+0000","last_peered":"2023-10-09T06:27:53.932320+0000","last_clean":"2023-10-09T06:27:53.932320+0000","last_became_active":"2023-10-09T06:27:53.931915+0000","last_became_peered":"2023-10-09T06:27:53.931915+0000","last_unstale":"2023-10-09T06:27:53.932320+0000","last_undegraded":"2023-10-09T06:27:53.932320+0000","last_fullsized":"2023-10-09T06:27:53.932320+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:54.943386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936737+0000","last_change":"2023-10-09T06:27:53.936102+0000","last_active":"2023-10-09T06:27:53.936737+0000","last_peered":"2023-10-09T06:27:53.936737+0000","last_clean":"2023-10-09T06:27:53.936737+0000","last_became_active":"2023-10-09T06:27:53.935870+0000","last_became_peered":"2023-10-09T06:27:53.935870+0000","last_unstale":"2023-10-09T06:27:53.936737+0000","last_undegraded":"2023-10-09T06:27:53.936737+0000","last_fullsized":"2023-10-09T06:27:53.936737+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:10.148649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932675+0000","last_change":"2023-10-09T06:27:53.932545+0000","last_active":"2023-10-09T06:27:53.932675+0000","last_peered":"2023-10-09T06:27:53.932675+0000","last_clean":"2023-10-09T06:27:53.932675+0000","last_became_active":"2023-10-09T06:27:53.932183+0000","last_became_peered":"2023-10-09T06:27:53.932183+0000","last_unstale":"2023-10-09T06:27:53.932675+0000","last_undegraded":"2023-10-09T06:27:53.932675+0000","last_fullsized":"2023-10-09T06:27:53.932675+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:30.199496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933969+0000","last_change":"2023-10-09T06:27:53.933324+0000","last_active":"2023-10-09T06:27:53.933969+0000","last_peered":"2023-10-09T06:27:53.933969+0000","last_clean":"2023-10-09T06:27:53.933969+0000","last_became_active":"2023-10-09T06:27:53.933084+0000","last_became_peered":"2023-10-09T06:27:53.933084+0000","last_unstale":"2023-10-09T06:27:53.933969+0000","last_undegraded":"2023-10-09T06:27:53.933969+0000","last_fullsized":"2023-10-09T06:27:53.933969+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:21:36.823652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931066+0000","last_change":"2023-10-09T06:27:53.931005+0000","last_active":"2023-10-09T06:27:53.931066+0000","last_peered":"2023-10-09T06:27:53.931066+0000","last_clean":"2023-10-09T06:27:53.931066+0000","last_became_active":"2023-10-09T06:27:53.930776+0000","last_became_peered":"2023-10-09T06:27:53.930776+0000","last_unstale":"2023-10-09T06:27:53.931066+0000","last_undegraded":"2023-10-09T06:27:53.931066+0000","last_fullsized":"2023-10-09T06:27:53.931066+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:09.846466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936519+0000","last_change":"2023-10-09T06:27:53.936453+0000","last_active":"2023-10-09T06:27:53.936519+0000","last_peered":"2023-10-09T06:27:53.936519+0000","last_clean":"2023-10-09T06:27:53.936519+0000","last_became_active":"2023-10-09T06:27:53.936204+0000","last_became_peered":"2023-10-09T06:27:53.936204+0000","last_unstale":"2023-10-09T06:27:53.936519+0000","last_undegraded":"2023-10-09T06:27:53.936519+0000","last_fullsized":"2023-10-09T06:27:53.936519+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:16.687263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936785+0000","last_change":"2023-10-09T06:27:53.934421+0000","last_active":"2023-10-09T06:27:53.936785+0000","last_peered":"2023-10-09T06:27:53.936785+0000","last_clean":"2023-10-09T06:27:53.936785+0000","last_became_active":"2023-10-09T06:27:53.933677+0000","last_became_peered":"2023-10-09T06:27:53.933677+0000","last_unstale":"2023-10-09T06:27:53.936785+0000","last_undegraded":"2023-10-09T06:27:53.936785+0000","last_fullsized":"2023-10-09T06:27:53.936785+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:51.778135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936819+0000","last_change":"2023-10-09T06:27:53.934598+0000","last_active":"2023-10-09T06:27:53.936819+0000","last_peered":"2023-10-09T06:27:53.936819+0000","last_clean":"2023-10-09T06:27:53.936819+0000","last_became_active":"2023-10-09T06:27:53.934282+0000","last_became_peered":"2023-10-09T06:27:53.934282+0000","last_unstale":"2023-10-09T06:27:53.936819+0000","last_undegraded":"2023-10-09T06:27:53.936819+0000","last_fullsized":"2023-10-09T06:27:53.936819+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:06.413749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934504+0000","last_change":"2023-10-09T06:27:53.934424+0000","last_active":"2023-10-09T06:27:53.934504+0000","last_peered":"2023-10-09T06:27:53.934504+0000","last_clean":"2023-10-09T06:27:53.934504+0000","last_became_active":"2023-10-09T06:27:53.934180+0000","last_became_peered":"2023-10-09T06:27:53.934180+0000","last_unstale":"2023-10-09T06:27:53.934504+0000","last_undegraded":"2023-10-09T06:27:53.934504+0000","last_fullsized":"2023-10-09T06:27:53.934504+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:21:15.952486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933511+0000","last_change":"2023-10-09T06:27:53.933431+0000","last_active":"2023-10-09T06:27:53.933511+0000","last_peered":"2023-10-09T06:27:53.933511+0000","last_clean":"2023-10-09T06:27:53.933511+0000","last_became_active":"2023-10-09T06:27:53.933020+0000","last_became_peered":"2023-10-09T06:27:53.933020+0000","last_unstale":"2023-10-09T06:27:53.933511+0000","last_undegraded":"2023-10-09T06:27:53.933511+0000","last_fullsized":"2023-10-09T06:27:53.933511+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:43.819504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934638+0000","last_change":"2023-10-09T06:27:53.934244+0000","last_active":"2023-10-09T06:27:53.934638+0000","last_peered":"2023-10-09T06:27:53.934638+0000","last_clean":"2023-10-09T06:27:53.934638+0000","last_became_active":"2023-10-09T06:27:53.933816+0000","last_became_peered":"2023-10-09T06:27:53.933816+0000","last_unstale":"2023-10-09T06:27:53.934638+0000","last_undegraded":"2023-10-09T06:27:53.934638+0000","last_fullsized":"2023-10-09T06:27:53.934638+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:36.790853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"151'4","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945243+0000","last_change":"2023-10-09T06:27:52.935663+0000","last_active":"2023-10-09T06:27:53.945243+0000","last_peered":"2023-10-09T06:27:53.945243+0000","last_clean":"2023-10-09T06:27:53.945243+0000","last_became_active":"2023-10-09T06:27:52.935442+0000","last_became_peered":"2023-10-09T06:27:52.935442+0000","last_unstale":"2023-10-09T06:27:53.945243+0000","last_undegraded":"2023-10-09T06:27:53.945243+0000","last_fullsized":"2023-10-09T06:27:53.945243+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:17.467616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931066+0000","last_change":"2023-10-09T06:27:53.930969+0000","last_active":"2023-10-09T06:27:53.931066+0000","last_peered":"2023-10-09T06:27:53.931066+0000","last_clean":"2023-10-09T06:27:53.931066+0000","last_became_active":"2023-10-09T06:27:53.930634+0000","last_became_peered":"2023-10-09T06:27:53.930634+0000","last_unstale":"2023-10-09T06:27:53.931066+0000","last_undegraded":"2023-10-09T06:27:53.931066+0000","last_fullsized":"2023-10-09T06:27:53.931066+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:18.472028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944722+0000","last_change":"2023-10-09T06:27:52.935490+0000","last_active":"2023-10-09T06:27:53.944722+0000","last_peered":"2023-10-09T06:27:53.944722+0000","last_clean":"2023-10-09T06:27:53.944722+0000","last_became_active":"2023-10-09T06:27:52.935253+0000","last_became_peered":"2023-10-09T06:27:52.935253+0000","last_unstale":"2023-10-09T06:27:53.944722+0000","last_undegraded":"2023-10-09T06:27:53.944722+0000","last_fullsized":"2023-10-09T06:27:53.944722+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:32.422666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931949+0000","last_change":"2023-10-09T06:27:53.931529+0000","last_active":"2023-10-09T06:27:53.931949+0000","last_peered":"2023-10-09T06:27:53.931949+0000","last_clean":"2023-10-09T06:27:53.931949+0000","last_became_active":"2023-10-09T06:27:53.931272+0000","last_became_peered":"2023-10-09T06:27:53.931272+0000","last_unstale":"2023-10-09T06:27:53.931949+0000","last_undegraded":"2023-10-09T06:27:53.931949+0000","last_fullsized":"2023-10-09T06:27:53.931949+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:52.371297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.943796+0000","last_change":"2023-10-09T06:27:52.935839+0000","last_active":"2023-10-09T06:27:53.943796+0000","last_peered":"2023-10-09T06:27:53.943796+0000","last_clean":"2023-10-09T06:27:53.943796+0000","last_became_active":"2023-10-09T06:27:52.935587+0000","last_became_peered":"2023-10-09T06:27:52.935587+0000","last_unstale":"2023-10-09T06:27:53.943796+0000","last_undegraded":"2023-10-09T06:27:53.943796+0000","last_fullsized":"2023-10-09T06:27:53.943796+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:08.477367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936389+0000","last_change":"2023-10-09T06:27:53.936220+0000","last_active":"2023-10-09T06:27:53.936389+0000","last_peered":"2023-10-09T06:27:53.936389+0000","last_clean":"2023-10-09T06:27:53.936389+0000","last_became_active":"2023-10-09T06:27:53.935141+0000","last_became_peered":"2023-10-09T06:27:53.935141+0000","last_unstale":"2023-10-09T06:27:53.936389+0000","last_undegraded":"2023-10-09T06:27:53.936389+0000","last_fullsized":"2023-10-09T06:27:53.936389+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:32.142862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944534+0000","last_change":"2023-10-09T06:27:52.933698+0000","last_active":"2023-10-09T06:27:53.944534+0000","last_peered":"2023-10-09T06:27:53.944534+0000","last_clean":"2023-10-09T06:27:53.944534+0000","last_became_active":"2023-10-09T06:27:52.933257+0000","last_became_peered":"2023-10-09T06:27:52.933257+0000","last_unstale":"2023-10-09T06:27:53.944534+0000","last_undegraded":"2023-10-09T06:27:53.944534+0000","last_fullsized":"2023-10-09T06:27:53.944534+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:38.688820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.938160+0000","last_change":"2023-10-09T06:27:53.938087+0000","last_active":"2023-10-09T06:27:53.938160+0000","last_peered":"2023-10-09T06:27:53.938160+0000","last_clean":"2023-10-09T06:27:53.938160+0000","last_became_active":"2023-10-09T06:27:53.937736+0000","last_became_peered":"2023-10-09T06:27:53.937736+0000","last_unstale":"2023-10-09T06:27:53.938160+0000","last_undegraded":"2023-10-09T06:27:53.938160+0000","last_fullsized":"2023-10-09T06:27:53.938160+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:08.541119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945458+0000","last_change":"2023-10-09T06:27:52.931663+0000","last_active":"2023-10-09T06:27:53.945458+0000","last_peered":"2023-10-09T06:27:53.945458+0000","last_clean":"2023-10-09T06:27:53.945458+0000","last_became_active":"2023-10-09T06:27:52.930668+0000","last_became_peered":"2023-10-09T06:27:52.930668+0000","last_unstale":"2023-10-09T06:27:53.945458+0000","last_undegraded":"2023-10-09T06:27:53.945458+0000","last_fullsized":"2023-10-09T06:27:53.945458+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:46.138879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933381+0000","last_change":"2023-10-09T06:27:53.933267+0000","last_active":"2023-10-09T06:27:53.933381+0000","last_peered":"2023-10-09T06:27:53.933381+0000","last_clean":"2023-10-09T06:27:53.933381+0000","last_became_active":"2023-10-09T06:27:53.932673+0000","last_became_peered":"2023-10-09T06:27:53.932673+0000","last_unstale":"2023-10-09T06:27:53.933381+0000","last_undegraded":"2023-10-09T06:27:53.933381+0000","last_fullsized":"2023-10-09T06:27:53.933381+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:54.943386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945803+0000","last_change":"2023-10-09T06:27:52.927612+0000","last_active":"2023-10-09T06:27:53.945803+0000","last_peered":"2023-10-09T06:27:53.945803+0000","last_clean":"2023-10-09T06:27:53.945803+0000","last_became_active":"2023-10-09T06:27:52.927332+0000","last_became_peered":"2023-10-09T06:27:52.927332+0000","last_unstale":"2023-10-09T06:27:53.945803+0000","last_undegraded":"2023-10-09T06:27:53.945803+0000","last_fullsized":"2023-10-09T06:27:53.945803+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:42.815093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933858+0000","last_change":"2023-10-09T06:27:53.933645+0000","last_active":"2023-10-09T06:27:53.933858+0000","last_peered":"2023-10-09T06:27:53.933858+0000","last_clean":"2023-10-09T06:27:53.933858+0000","last_became_active":"2023-10-09T06:27:53.933048+0000","last_became_peered":"2023-10-09T06:27:53.933048+0000","last_unstale":"2023-10-09T06:27:53.933858+0000","last_undegraded":"2023-10-09T06:27:53.933858+0000","last_fullsized":"2023-10-09T06:27:53.933858+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:35.399846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.923358+0000","last_change":"2023-10-09T06:27:52.936229+0000","last_active":"2023-10-09T06:27:53.923358+0000","last_peered":"2023-10-09T06:27:53.923358+0000","last_clean":"2023-10-09T06:27:53.923358+0000","last_became_active":"2023-10-09T06:27:52.936013+0000","last_became_peered":"2023-10-09T06:27:52.936013+0000","last_unstale":"2023-10-09T06:27:53.923358+0000","last_undegraded":"2023-10-09T06:27:53.923358+0000","last_fullsized":"2023-10-09T06:27:53.923358+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:56.795700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932645+0000","last_change":"2023-10-09T06:27:53.932244+0000","last_active":"2023-10-09T06:27:53.932645+0000","last_peered":"2023-10-09T06:27:53.932645+0000","last_clean":"2023-10-09T06:27:53.932645+0000","last_became_active":"2023-10-09T06:27:53.931886+0000","last_became_peered":"2023-10-09T06:27:53.931886+0000","last_unstale":"2023-10-09T06:27:53.932645+0000","last_undegraded":"2023-10-09T06:27:53.932645+0000","last_fullsized":"2023-10-09T06:27:53.932645+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:39:52.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.923451+0000","last_change":"2023-10-09T06:27:52.933160+0000","last_active":"2023-10-09T06:27:53.923451+0000","last_peered":"2023-10-09T06:27:53.923451+0000","last_clean":"2023-10-09T06:27:53.923451+0000","last_became_active":"2023-10-09T06:27:52.932999+0000","last_became_peered":"2023-10-09T06:27:52.932999+0000","last_unstale":"2023-10-09T06:27:53.923451+0000","last_undegraded":"2023-10-09T06:27:53.923451+0000","last_fullsized":"2023-10-09T06:27:53.923451+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:17.202095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936884+0000","last_change":"2023-10-09T06:27:53.936338+0000","last_active":"2023-10-09T06:27:53.936884+0000","last_peered":"2023-10-09T06:27:53.936884+0000","last_clean":"2023-10-09T06:27:53.936884+0000","last_became_active":"2023-10-09T06:27:53.936068+0000","last_became_peered":"2023-10-09T06:27:53.936068+0000","last_unstale":"2023-10-09T06:27:53.936884+0000","last_undegraded":"2023-10-09T06:27:53.936884+0000","last_fullsized":"2023-10-09T06:27:53.936884+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:07.136944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928236+0000","last_change":"2023-10-09T06:27:52.933145+0000","last_active":"2023-10-09T06:27:53.928236+0000","last_peered":"2023-10-09T06:27:53.928236+0000","last_clean":"2023-10-09T06:27:53.928236+0000","last_became_active":"2023-10-09T06:27:52.932892+0000","last_became_peered":"2023-10-09T06:27:52.932892+0000","last_unstale":"2023-10-09T06:27:53.928236+0000","last_undegraded":"2023-10-09T06:27:53.928236+0000","last_fullsized":"2023-10-09T06:27:53.928236+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:31.043111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935284+0000","last_change":"2023-10-09T06:27:53.935205+0000","last_active":"2023-10-09T06:27:53.935284+0000","last_peered":"2023-10-09T06:27:53.935284+0000","last_clean":"2023-10-09T06:27:53.935284+0000","last_became_active":"2023-10-09T06:27:53.934775+0000","last_became_peered":"2023-10-09T06:27:53.934775+0000","last_unstale":"2023-10-09T06:27:53.935284+0000","last_undegraded":"2023-10-09T06:27:53.935284+0000","last_fullsized":"2023-10-09T06:27:53.935284+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:39:52.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928582+0000","last_change":"2023-10-09T06:27:52.932076+0000","last_active":"2023-10-09T06:27:53.928582+0000","last_peered":"2023-10-09T06:27:53.928582+0000","last_clean":"2023-10-09T06:27:53.928582+0000","last_became_active":"2023-10-09T06:27:52.931652+0000","last_became_peered":"2023-10-09T06:27:52.931652+0000","last_unstale":"2023-10-09T06:27:53.928582+0000","last_undegraded":"2023-10-09T06:27:53.928582+0000","last_fullsized":"2023-10-09T06:27:53.928582+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:53.938974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.934487+0000","last_change":"2023-10-09T06:27:53.934378+0000","last_active":"2023-10-09T06:27:53.934487+0000","last_peered":"2023-10-09T06:27:53.934487+0000","last_clean":"2023-10-09T06:27:53.934487+0000","last_became_active":"2023-10-09T06:27:53.934156+0000","last_became_peered":"2023-10-09T06:27:53.934156+0000","last_unstale":"2023-10-09T06:27:53.934487+0000","last_undegraded":"2023-10-09T06:27:53.934487+0000","last_fullsized":"2023-10-09T06:27:53.934487+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:24.340452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"151'3","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945951+0000","last_change":"2023-10-09T06:27:52.931973+0000","last_active":"2023-10-09T06:27:53.945951+0000","last_peered":"2023-10-09T06:27:53.945951+0000","last_clean":"2023-10-09T06:27:53.945951+0000","last_became_active":"2023-10-09T06:27:52.931677+0000","last_became_peered":"2023-10-09T06:27:52.931677+0000","last_unstale":"2023-10-09T06:27:53.945951+0000","last_undegraded":"2023-10-09T06:27:53.945951+0000","last_fullsized":"2023-10-09T06:27:53.945951+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:52:38.654562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935456+0000","last_change":"2023-10-09T06:27:53.935392+0000","last_active":"2023-10-09T06:27:53.935456+0000","last_peered":"2023-10-09T06:27:53.935456+0000","last_clean":"2023-10-09T06:27:53.935456+0000","last_became_active":"2023-10-09T06:27:53.934928+0000","last_became_peered":"2023-10-09T06:27:53.934928+0000","last_unstale":"2023-10-09T06:27:53.935456+0000","last_undegraded":"2023-10-09T06:27:53.935456+0000","last_fullsized":"2023-10-09T06:27:53.935456+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:00.559448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"151'6","reported_seq":16,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.946402+0000","last_change":"2023-10-09T06:27:52.933173+0000","last_active":"2023-10-09T06:27:53.946402+0000","last_peered":"2023-10-09T06:27:53.946402+0000","last_clean":"2023-10-09T06:27:53.946402+0000","last_became_active":"2023-10-09T06:27:52.932948+0000","last_became_peered":"2023-10-09T06:27:52.932948+0000","last_unstale":"2023-10-09T06:27:53.946402+0000","last_undegraded":"2023-10-09T06:27:53.946402+0000","last_fullsized":"2023-10-09T06:27:53.946402+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:01.012691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933660+0000","last_change":"2023-10-09T06:27:53.933596+0000","last_active":"2023-10-09T06:27:53.933660+0000","last_peered":"2023-10-09T06:27:53.933660+0000","last_clean":"2023-10-09T06:27:53.933660+0000","last_became_active":"2023-10-09T06:27:53.933330+0000","last_became_peered":"2023-10-09T06:27:53.933330+0000","last_unstale":"2023-10-09T06:27:53.933660+0000","last_undegraded":"2023-10-09T06:27:53.933660+0000","last_fullsized":"2023-10-09T06:27:53.933660+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:33.967623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.926380+0000","last_change":"2023-10-09T06:27:52.937327+0000","last_active":"2023-10-09T06:27:53.926380+0000","last_peered":"2023-10-09T06:27:53.926380+0000","last_clean":"2023-10-09T06:27:53.926380+0000","last_became_active":"2023-10-09T06:27:52.937095+0000","last_became_peered":"2023-10-09T06:27:52.937095+0000","last_unstale":"2023-10-09T06:27:53.926380+0000","last_undegraded":"2023-10-09T06:27:53.926380+0000","last_fullsized":"2023-10-09T06:27:53.926380+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:44.302806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.926399+0000","last_change":"2023-10-09T06:27:53.926335+0000","last_active":"2023-10-09T06:27:53.926399+0000","last_peered":"2023-10-09T06:27:53.926399+0000","last_clean":"2023-10-09T06:27:53.926399+0000","last_became_active":"2023-10-09T06:27:53.926099+0000","last_became_peered":"2023-10-09T06:27:53.926099+0000","last_unstale":"2023-10-09T06:27:53.926399+0000","last_undegraded":"2023-10-09T06:27:53.926399+0000","last_fullsized":"2023-10-09T06:27:53.926399+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:16.687263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.922841+0000","last_change":"2023-10-09T06:27:52.931810+0000","last_active":"2023-10-09T06:27:53.922841+0000","last_peered":"2023-10-09T06:27:53.922841+0000","last_clean":"2023-10-09T06:27:53.922841+0000","last_became_active":"2023-10-09T06:27:52.931440+0000","last_became_peered":"2023-10-09T06:27:52.931440+0000","last_unstale":"2023-10-09T06:27:53.922841+0000","last_undegraded":"2023-10-09T06:27:53.922841+0000","last_fullsized":"2023-10-09T06:27:53.922841+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:32.963211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931638+0000","last_change":"2023-10-09T06:27:53.931392+0000","last_active":"2023-10-09T06:27:53.931638+0000","last_peered":"2023-10-09T06:27:53.931638+0000","last_clean":"2023-10-09T06:27:53.931638+0000","last_became_active":"2023-10-09T06:27:53.930853+0000","last_became_peered":"2023-10-09T06:27:53.930853+0000","last_unstale":"2023-10-09T06:27:53.931638+0000","last_undegraded":"2023-10-09T06:27:53.931638+0000","last_fullsized":"2023-10-09T06:27:53.931638+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:17:02.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"151'8","reported_seq":18,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.946781+0000","last_change":"2023-10-09T06:27:52.935565+0000","last_active":"2023-10-09T06:27:53.946781+0000","last_peered":"2023-10-09T06:27:53.946781+0000","last_clean":"2023-10-09T06:27:53.946781+0000","last_became_active":"2023-10-09T06:27:52.935254+0000","last_became_peered":"2023-10-09T06:27:52.935254+0000","last_unstale":"2023-10-09T06:27:53.946781+0000","last_undegraded":"2023-10-09T06:27:53.946781+0000","last_fullsized":"2023-10-09T06:27:53.946781+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:32.422666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933875+0000","last_change":"2023-10-09T06:27:53.933786+0000","last_active":"2023-10-09T06:27:53.933875+0000","last_peered":"2023-10-09T06:27:53.933875+0000","last_clean":"2023-10-09T06:27:53.933875+0000","last_became_active":"2023-10-09T06:27:53.933351+0000","last_became_peered":"2023-10-09T06:27:53.933351+0000","last_unstale":"2023-10-09T06:27:53.933875+0000","last_undegraded":"2023-10-09T06:27:53.933875+0000","last_fullsized":"2023-10-09T06:27:53.933875+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:37:13.894431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944881+0000","last_change":"2023-10-09T06:27:52.931092+0000","last_active":"2023-10-09T06:27:53.944881+0000","last_peered":"2023-10-09T06:27:53.944881+0000","last_clean":"2023-10-09T06:27:53.944881+0000","last_became_active":"2023-10-09T06:27:52.930803+0000","last_became_peered":"2023-10-09T06:27:52.930803+0000","last_unstale":"2023-10-09T06:27:53.944881+0000","last_undegraded":"2023-10-09T06:27:53.944881+0000","last_fullsized":"2023-10-09T06:27:53.944881+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:55:15.437434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.939322+0000","last_change":"2023-10-09T06:27:53.939245+0000","last_active":"2023-10-09T06:27:53.939322+0000","last_peered":"2023-10-09T06:27:53.939322+0000","last_clean":"2023-10-09T06:27:53.939322+0000","last_became_active":"2023-10-09T06:27:53.938801+0000","last_became_peered":"2023-10-09T06:27:53.938801+0000","last_unstale":"2023-10-09T06:27:53.939322+0000","last_undegraded":"2023-10-09T06:27:53.939322+0000","last_fullsized":"2023-10-09T06:27:53.939322+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.029150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.945515+0000","last_change":"2023-10-09T06:27:52.932657+0000","last_active":"2023-10-09T06:27:53.945515+0000","last_peered":"2023-10-09T06:27:53.945515+0000","last_clean":"2023-10-09T06:27:53.945515+0000","last_became_active":"2023-10-09T06:27:52.932402+0000","last_became_peered":"2023-10-09T06:27:52.932402+0000","last_unstale":"2023-10-09T06:27:53.945515+0000","last_undegraded":"2023-10-09T06:27:53.945515+0000","last_fullsized":"2023-10-09T06:27:53.945515+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:51.366885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933951+0000","last_change":"2023-10-09T06:27:53.933290+0000","last_active":"2023-10-09T06:27:53.933951+0000","last_peered":"2023-10-09T06:27:53.933951+0000","last_clean":"2023-10-09T06:27:53.933951+0000","last_became_active":"2023-10-09T06:27:53.933030+0000","last_became_peered":"2023-10-09T06:27:53.933030+0000","last_unstale":"2023-10-09T06:27:53.933951+0000","last_undegraded":"2023-10-09T06:27:53.933951+0000","last_fullsized":"2023-10-09T06:27:53.933951+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:21:15.952486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.943364+0000","last_change":"2023-10-09T06:27:52.935532+0000","last_active":"2023-10-09T06:27:53.943364+0000","last_peered":"2023-10-09T06:27:53.943364+0000","last_clean":"2023-10-09T06:27:53.943364+0000","last_became_active":"2023-10-09T06:27:52.935305+0000","last_became_peered":"2023-10-09T06:27:52.935305+0000","last_unstale":"2023-10-09T06:27:53.943364+0000","last_undegraded":"2023-10-09T06:27:53.943364+0000","last_fullsized":"2023-10-09T06:27:53.943364+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:30:56.562227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935623+0000","last_change":"2023-10-09T06:27:53.935424+0000","last_active":"2023-10-09T06:27:53.935623+0000","last_peered":"2023-10-09T06:27:53.935623+0000","last_clean":"2023-10-09T06:27:53.935623+0000","last_became_active":"2023-10-09T06:27:53.934889+0000","last_became_peered":"2023-10-09T06:27:53.934889+0000","last_unstale":"2023-10-09T06:27:53.935623+0000","last_undegraded":"2023-10-09T06:27:53.935623+0000","last_fullsized":"2023-10-09T06:27:53.935623+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:30:57.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929879+0000","last_change":"2023-10-09T06:27:52.932310+0000","last_active":"2023-10-09T06:27:53.929879+0000","last_peered":"2023-10-09T06:27:53.929879+0000","last_clean":"2023-10-09T06:27:53.929879+0000","last_became_active":"2023-10-09T06:27:52.932078+0000","last_became_peered":"2023-10-09T06:27:52.932078+0000","last_unstale":"2023-10-09T06:27:53.929879+0000","last_undegraded":"2023-10-09T06:27:53.929879+0000","last_fullsized":"2023-10-09T06:27:53.929879+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:41.167438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936847+0000","last_change":"2023-10-09T06:27:53.935211+0000","last_active":"2023-10-09T06:27:53.936847+0000","last_peered":"2023-10-09T06:27:53.936847+0000","last_clean":"2023-10-09T06:27:53.936847+0000","last_became_active":"2023-10-09T06:27:53.934962+0000","last_became_peered":"2023-10-09T06:27:53.934962+0000","last_unstale":"2023-10-09T06:27:53.936847+0000","last_undegraded":"2023-10-09T06:27:53.936847+0000","last_fullsized":"2023-10-09T06:27:53.936847+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:09:41.794786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944429+0000","last_change":"2023-10-09T06:27:52.934337+0000","last_active":"2023-10-09T06:27:53.944429+0000","last_peered":"2023-10-09T06:27:53.944429+0000","last_clean":"2023-10-09T06:27:53.944429+0000","last_became_active":"2023-10-09T06:27:52.934093+0000","last_became_peered":"2023-10-09T06:27:52.934093+0000","last_unstale":"2023-10-09T06:27:53.944429+0000","last_undegraded":"2023-10-09T06:27:53.944429+0000","last_fullsized":"2023-10-09T06:27:53.944429+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:01.012691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.927994+0000","last_change":"2023-10-09T06:27:53.926120+0000","last_active":"2023-10-09T06:27:53.927994+0000","last_peered":"2023-10-09T06:27:53.927994+0000","last_clean":"2023-10-09T06:27:53.927994+0000","last_became_active":"2023-10-09T06:27:53.925870+0000","last_became_peered":"2023-10-09T06:27:53.925870+0000","last_unstale":"2023-10-09T06:27:53.927994+0000","last_undegraded":"2023-10-09T06:27:53.927994+0000","last_fullsized":"2023-10-09T06:27:53.927994+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:34.259293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928683+0000","last_change":"2023-10-09T06:27:52.933464+0000","last_active":"2023-10-09T06:27:53.928683+0000","last_peered":"2023-10-09T06:27:53.928683+0000","last_clean":"2023-10-09T06:27:53.928683+0000","last_became_active":"2023-10-09T06:27:52.933028+0000","last_became_peered":"2023-10-09T06:27:52.933028+0000","last_unstale":"2023-10-09T06:27:53.928683+0000","last_undegraded":"2023-10-09T06:27:53.928683+0000","last_fullsized":"2023-10-09T06:27:53.928683+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:17.467616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935640+0000","last_change":"2023-10-09T06:27:53.935550+0000","last_active":"2023-10-09T06:27:53.935640+0000","last_peered":"2023-10-09T06:27:53.935640+0000","last_clean":"2023-10-09T06:27:53.935640+0000","last_became_active":"2023-10-09T06:27:53.935183+0000","last_became_peered":"2023-10-09T06:27:53.935183+0000","last_unstale":"2023-10-09T06:27:53.935640+0000","last_undegraded":"2023-10-09T06:27:53.935640+0000","last_fullsized":"2023-10-09T06:27:53.935640+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:33.427078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929270+0000","last_change":"2023-10-09T06:27:52.928446+0000","last_active":"2023-10-09T06:27:53.929270+0000","last_peered":"2023-10-09T06:27:53.929270+0000","last_clean":"2023-10-09T06:27:53.929270+0000","last_became_active":"2023-10-09T06:27:52.928210+0000","last_became_peered":"2023-10-09T06:27:52.928210+0000","last_unstale":"2023-10-09T06:27:53.929270+0000","last_undegraded":"2023-10-09T06:27:53.929270+0000","last_fullsized":"2023-10-09T06:27:53.929270+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:34.395434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.936406+0000","last_change":"2023-10-09T06:27:53.936346+0000","last_active":"2023-10-09T06:27:53.936406+0000","last_peered":"2023-10-09T06:27:53.936406+0000","last_clean":"2023-10-09T06:27:53.936406+0000","last_became_active":"2023-10-09T06:27:53.935987+0000","last_became_peered":"2023-10-09T06:27:53.935987+0000","last_unstale":"2023-10-09T06:27:53.936406+0000","last_undegraded":"2023-10-09T06:27:53.936406+0000","last_fullsized":"2023-10-09T06:27:53.936406+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:36.790853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929540+0000","last_change":"2023-10-09T06:27:52.932636+0000","last_active":"2023-10-09T06:27:53.929540+0000","last_peered":"2023-10-09T06:27:53.929540+0000","last_clean":"2023-10-09T06:27:53.929540+0000","last_became_active":"2023-10-09T06:27:52.932394+0000","last_became_peered":"2023-10-09T06:27:52.932394+0000","last_unstale":"2023-10-09T06:27:53.929540+0000","last_undegraded":"2023-10-09T06:27:53.929540+0000","last_fullsized":"2023-10-09T06:27:53.929540+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:12.418152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933150+0000","last_change":"2023-10-09T06:27:53.933075+0000","last_active":"2023-10-09T06:27:53.933150+0000","last_peered":"2023-10-09T06:27:53.933150+0000","last_clean":"2023-10-09T06:27:53.933150+0000","last_became_active":"2023-10-09T06:27:53.932578+0000","last_became_peered":"2023-10-09T06:27:53.932578+0000","last_unstale":"2023-10-09T06:27:53.933150+0000","last_undegraded":"2023-10-09T06:27:53.933150+0000","last_fullsized":"2023-10-09T06:27:53.933150+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:35.399846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.943627+0000","last_change":"2023-10-09T06:27:52.936108+0000","last_active":"2023-10-09T06:27:53.943627+0000","last_peered":"2023-10-09T06:27:53.943627+0000","last_clean":"2023-10-09T06:27:53.943627+0000","last_became_active":"2023-10-09T06:27:52.933621+0000","last_became_peered":"2023-10-09T06:27:52.933621+0000","last_unstale":"2023-10-09T06:27:53.943627+0000","last_undegraded":"2023-10-09T06:27:53.943627+0000","last_fullsized":"2023-10-09T06:27:53.943627+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:19.208277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932631+0000","last_change":"2023-10-09T06:27:53.932560+0000","last_active":"2023-10-09T06:27:53.932631+0000","last_peered":"2023-10-09T06:27:53.932631+0000","last_clean":"2023-10-09T06:27:53.932631+0000","last_became_active":"2023-10-09T06:27:53.932325+0000","last_became_peered":"2023-10-09T06:27:53.932325+0000","last_unstale":"2023-10-09T06:27:53.932631+0000","last_undegraded":"2023-10-09T06:27:53.932631+0000","last_fullsized":"2023-10-09T06:27:53.932631+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:07.101614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.929099+0000","last_change":"2023-10-09T06:27:52.936079+0000","last_active":"2023-10-09T06:27:53.929099+0000","last_peered":"2023-10-09T06:27:53.929099+0000","last_clean":"2023-10-09T06:27:53.929099+0000","last_became_active":"2023-10-09T06:27:52.935872+0000","last_became_peered":"2023-10-09T06:27:52.935872+0000","last_unstale":"2023-10-09T06:27:53.929099+0000","last_undegraded":"2023-10-09T06:27:53.929099+0000","last_fullsized":"2023-10-09T06:27:53.929099+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:53.273517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932660+0000","last_change":"2023-10-09T06:27:53.932416+0000","last_active":"2023-10-09T06:27:53.932660+0000","last_peered":"2023-10-09T06:27:53.932660+0000","last_clean":"2023-10-09T06:27:53.932660+0000","last_became_active":"2023-10-09T06:27:53.931881+0000","last_became_peered":"2023-10-09T06:27:53.931881+0000","last_unstale":"2023-10-09T06:27:53.932660+0000","last_undegraded":"2023-10-09T06:27:53.932660+0000","last_fullsized":"2023-10-09T06:27:53.932660+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:00.721099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.922920+0000","last_change":"2023-10-09T06:27:52.936040+0000","last_active":"2023-10-09T06:27:53.922920+0000","last_peered":"2023-10-09T06:27:53.922920+0000","last_clean":"2023-10-09T06:27:53.922920+0000","last_became_active":"2023-10-09T06:27:52.935583+0000","last_became_peered":"2023-10-09T06:27:52.935583+0000","last_unstale":"2023-10-09T06:27:53.922920+0000","last_undegraded":"2023-10-09T06:27:53.922920+0000","last_fullsized":"2023-10-09T06:27:53.922920+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:11.452245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932055+0000","last_change":"2023-10-09T06:27:53.931942+0000","last_active":"2023-10-09T06:27:53.932055+0000","last_peered":"2023-10-09T06:27:53.932055+0000","last_clean":"2023-10-09T06:27:53.932055+0000","last_became_active":"2023-10-09T06:27:53.931696+0000","last_became_peered":"2023-10-09T06:27:53.931696+0000","last_unstale":"2023-10-09T06:27:53.932055+0000","last_undegraded":"2023-10-09T06:27:53.932055+0000","last_fullsized":"2023-10-09T06:27:53.932055+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:20.308885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928512+0000","last_change":"2023-10-09T06:27:52.934153+0000","last_active":"2023-10-09T06:27:53.928512+0000","last_peered":"2023-10-09T06:27:53.928512+0000","last_clean":"2023-10-09T06:27:53.928512+0000","last_became_active":"2023-10-09T06:27:52.933922+0000","last_became_peered":"2023-10-09T06:27:52.933922+0000","last_unstale":"2023-10-09T06:27:53.928512+0000","last_undegraded":"2023-10-09T06:27:53.928512+0000","last_fullsized":"2023-10-09T06:27:53.928512+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:02.855389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.931930+0000","last_change":"2023-10-09T06:27:53.930498+0000","last_active":"2023-10-09T06:27:53.931930+0000","last_peered":"2023-10-09T06:27:53.931930+0000","last_clean":"2023-10-09T06:27:53.931930+0000","last_became_active":"2023-10-09T06:27:53.930280+0000","last_became_peered":"2023-10-09T06:27:53.930280+0000","last_unstale":"2023-10-09T06:27:53.931930+0000","last_undegraded":"2023-10-09T06:27:53.931930+0000","last_fullsized":"2023-10-09T06:27:53.931930+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:13.422563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.923333+0000","last_change":"2023-10-09T06:27:52.933533+0000","last_active":"2023-10-09T06:27:53.923333+0000","last_peered":"2023-10-09T06:27:53.923333+0000","last_clean":"2023-10-09T06:27:53.923333+0000","last_became_active":"2023-10-09T06:27:52.932880+0000","last_became_peered":"2023-10-09T06:27:52.932880+0000","last_unstale":"2023-10-09T06:27:53.923333+0000","last_undegraded":"2023-10-09T06:27:53.923333+0000","last_fullsized":"2023-10-09T06:27:53.923333+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:06.132532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.935267+0000","last_change":"2023-10-09T06:27:53.935031+0000","last_active":"2023-10-09T06:27:53.935267+0000","last_peered":"2023-10-09T06:27:53.935267+0000","last_clean":"2023-10-09T06:27:53.935267+0000","last_became_active":"2023-10-09T06:27:53.932569+0000","last_became_peered":"2023-10-09T06:27:53.932569+0000","last_unstale":"2023-10-09T06:27:53.935267+0000","last_undegraded":"2023-10-09T06:27:53.935267+0000","last_fullsized":"2023-10-09T06:27:53.935267+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:43.355926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.926693+0000","last_change":"2023-10-09T06:27:52.933739+0000","last_active":"2023-10-09T06:27:53.926693+0000","last_peered":"2023-10-09T06:27:53.926693+0000","last_clean":"2023-10-09T06:27:53.926693+0000","last_became_active":"2023-10-09T06:27:52.933302+0000","last_became_peered":"2023-10-09T06:27:52.933302+0000","last_unstale":"2023-10-09T06:27:53.926693+0000","last_undegraded":"2023-10-09T06:27:53.926693+0000","last_fullsized":"2023-10-09T06:27:53.926693+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:03.249361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933919+0000","last_change":"2023-10-09T06:27:53.932522+0000","last_active":"2023-10-09T06:27:53.933919+0000","last_peered":"2023-10-09T06:27:53.933919+0000","last_clean":"2023-10-09T06:27:53.933919+0000","last_became_active":"2023-10-09T06:27:53.932210+0000","last_became_peered":"2023-10-09T06:27:53.932210+0000","last_unstale":"2023-10-09T06:27:53.933919+0000","last_undegraded":"2023-10-09T06:27:53.933919+0000","last_fullsized":"2023-10-09T06:27:53.933919+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:32.142862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.933393+0000","last_change":"2023-10-09T06:27:52.935717+0000","last_active":"2023-10-09T06:27:53.933393+0000","last_peered":"2023-10-09T06:27:53.933393+0000","last_clean":"2023-10-09T06:27:53.933393+0000","last_became_active":"2023-10-09T06:27:52.935414+0000","last_became_peered":"2023-10-09T06:27:52.935414+0000","last_unstale":"2023-10-09T06:27:53.933393+0000","last_undegraded":"2023-10-09T06:27:53.933393+0000","last_fullsized":"2023-10-09T06:27:53.933393+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:40.048060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.932624+0000","last_change":"2023-10-09T06:27:53.932120+0000","last_active":"2023-10-09T06:27:53.932624+0000","last_peered":"2023-10-09T06:27:53.932624+0000","last_clean":"2023-10-09T06:27:53.932624+0000","last_became_active":"2023-10-09T06:27:53.931913+0000","last_became_peered":"2023-10-09T06:27:53.931913+0000","last_unstale":"2023-10-09T06:27:53.932624+0000","last_undegraded":"2023-10-09T06:27:53.932624+0000","last_fullsized":"2023-10-09T06:27:53.932624+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:02.017103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.928803+0000","last_change":"2023-10-09T06:27:52.935326+0000","last_active":"2023-10-09T06:27:53.928803+0000","last_peered":"2023-10-09T06:27:53.928803+0000","last_clean":"2023-10-09T06:27:53.928803+0000","last_became_active":"2023-10-09T06:27:52.935101+0000","last_became_peered":"2023-10-09T06:27:52.935101+0000","last_unstale":"2023-10-09T06:27:53.928803+0000","last_undegraded":"2023-10-09T06:27:53.928803+0000","last_fullsized":"2023-10-09T06:27:53.928803+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:59.555036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.937929+0000","last_change":"2023-10-09T06:27:53.937851+0000","last_active":"2023-10-09T06:27:53.937929+0000","last_peered":"2023-10-09T06:27:53.937929+0000","last_clean":"2023-10-09T06:27:53.937929+0000","last_became_active":"2023-10-09T06:27:53.937623+0000","last_became_peered":"2023-10-09T06:27:53.937623+0000","last_unstale":"2023-10-09T06:27:53.937929+0000","last_undegraded":"2023-10-09T06:27:53.937929+0000","last_fullsized":"2023-10-09T06:27:53.937929+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:52.918668+0000","last_clean_scrub_stamp":"2023-10-09T06:27:52.918668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:46.105971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"151'2","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.944011+0000","last_change":"2023-10-09T06:27:52.932778+0000","last_active":"2023-10-09T06:27:53.944011+0000","last_peered":"2023-10-09T06:27:53.944011+0000","last_clean":"2023-10-09T06:27:53.944011+0000","last_became_active":"2023-10-09T06:27:52.932545+0000","last_became_peered":"2023-10-09T06:27:52.932545+0000","last_unstale":"2023-10-09T06:27:53.944011+0000","last_undegraded":"2023-10-09T06:27:53.944011+0000","last_fullsized":"2023-10-09T06:27:53.944011+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:27:51.914256+0000","last_clean_scrub_stamp":"2023-10-09T06:27:51.914256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:53.938974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-09T06:27:53.926486+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:27:53.926486+0000","last_peered":"2023-10-09T06:27:53.926486+0000","last_clean":"2023-10-09T06:27:53.926486+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:27:53.926486+0000","last_undegraded":"2023-10-09T06:27:53.926486+0000","last_fullsized":"2023-10-09T06:27:53.926486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1404,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193908,"statfs":{"total":200000000,"available":198562073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.64400000000000002,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.58199999999999996,"15min":0.52700000000000002},"min":{"1min":0.378,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.73099999999999998,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.443}]},{"osd":1,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54700000000000004,"15min":0.50900000000000001},"min":{"1min":0.40400000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77600000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.51300000000000001},"min":{"1min":0.42999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71499999999999997,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.71499999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61799999999999999,"15min":0.57899999999999996},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69799999999999995,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.622},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59599999999999997,"15min":0.54400000000000004},"min":{"1min":0.44900000000000001,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.76500000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.64800000000000002,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.318},"max":{"1min":0.73199999999999998,"5min":7.4729999999999999,"15min":7.4729999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":0.56999999999999995},"min":{"1min":0.377,"5min":0.374,"15min":0.32400000000000001},"max":{"1min":0.76500000000000001,"5min":7.8390000000000004,"15min":7.8390000000000004},"last":0.69199999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.30499999999999999,"5min":0.27200000000000002,"15min":0.23799999999999999},"max":{"1min":0.74199999999999999,"5min":0.872,"15min":0.872},"last":0.495},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.34699999999999998,"5min":0.27000000000000002,"15min":0.25600000000000001},"max":{"1min":0.76900000000000002,"5min":0.79800000000000004,"15min":0.86099999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.495,"15min":0.48399999999999999},"min":{"1min":0.375,"5min":0.255,"15min":0.255},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.47699999999999998,"5min":0.33400000000000002,"15min":0.29199999999999998},"max":{"1min":0.79900000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.61199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":827,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194485,"statfs":{"total":200000000,"available":199153051,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53100000000000003,"15min":0.72499999999999998},"min":{"1min":0.41499999999999998,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.746,"5min":0.77100000000000002,"15min":7.0960000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.80900000000000005,"15min":1.133},"last":0.628}]},{"osd":1,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":1.155},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.443,"5min":0.378,"15min":0.317},"max":{"1min":0.748,"5min":0.75600000000000001,"15min":1.1459999999999999},"last":0.64200000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.59099999999999997},"min":{"1min":0.48799999999999999,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.746,"5min":0.82999999999999996,"15min":1.2290000000000001},"last":0.502},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56200000000000006,"15min":0.73999999999999999},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.81200000000000006,"5min":0.89100000000000001,"15min":7.1299999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.59199999999999997},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.80100000000000005,"5min":0.85599999999999998,"15min":1.337},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.755,"5min":0.81299999999999994,"15min":1.206},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.749,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.371},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.505,"15min":0.5},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.40600000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48099999999999998,"15min":0.47499999999999998},"min":{"1min":0.377,"5min":0.312,"15min":0.312},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.80000000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35599999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.315},"max":{"1min":0.81100000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77900000000000003,"5min":0.80100000000000005,"15min":0.82399999999999995},"last":0.46500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154587,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35599999999999998,"15min":0.36599999999999999},"min":{"1min":0.24199999999999999,"5min":0.223,"15min":0.219},"max":{"1min":0.56699999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.378,"15min":0.34000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.54400000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.37}]},{"osd":2,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.34899999999999998,"15min":0.34599999999999997},"min":{"1min":0.251,"5min":0.23599999999999999,"15min":0.222},"max":{"1min":0.503,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41999999999999998,"15min":0.39100000000000001},"min":{"1min":0.28699999999999998,"5min":0.255,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.437}]},{"osd":3,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.41999999999999998},"min":{"1min":0.33400000000000002,"5min":0.30199999999999999,"15min":0.29199999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.443,"15min":0.42799999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58899999999999997,"15min":0.56299999999999994},"min":{"1min":0.35699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.70699999999999996,"5min":1.097,"15min":1.097},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60999999999999999,"15min":0.77200000000000002},"min":{"1min":0.45300000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81299999999999994,"5min":0.90200000000000002,"15min":5.5270000000000001},"last":0.57599999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64000000000000001,"15min":0.626},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.83999999999999997,"5min":1.125,"15min":1.125},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64200000000000002,"15min":0.65800000000000003},"min":{"1min":0.42699999999999999,"5min":0.40400000000000003,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":1.175,"15min":1.4219999999999999},"last":0.64400000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64900000000000002,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94099999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.38500000000000001},"max":{"1min":0.88400000000000001,"5min":1.125,"15min":1.49},"last":0.66900000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.64400000000000002},"min":{"1min":0.44,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93000000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78900000000000003,"5min":1.052,"15min":1.052},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1402,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193910,"statfs":{"total":200000000,"available":198564219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.35599999999999998,"15min":0.40200000000000002},"min":{"1min":0.216,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51600000000000001,"5min":0.65800000000000003,"15min":1.226},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.41599999999999998},"min":{"1min":0.26900000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.64300000000000002,"5min":0.71899999999999997,"15min":1.131},"last":0.32700000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38500000000000001,"15min":0.88200000000000001},"min":{"1min":0.28299999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.44500000000000001,"5min":0.64400000000000002,"15min":12.929},"last":0.312},{"interface":"front","average":{"1min":0.372,"5min":0.41599999999999998,"15min":0.45100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53600000000000003,"5min":0.70899999999999996,"15min":1.1599999999999999},"last":0.26500000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44,"15min":0.46700000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58499999999999996,"5min":0.76100000000000001,"15min":1.1859999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.441,"15min":0.47899999999999998},"min":{"1min":0.36699999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55800000000000005,"5min":0.69199999999999995,"15min":1.3089999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76000000000000001,"5min":0.86299999999999999,"15min":0.93200000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59899999999999998,"15min":0.64300000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41099999999999998},"max":{"1min":0.754,"5min":0.97099999999999997,"15min":1.335},"last":0.68999999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.61399999999999999},"min":{"1min":0.40799999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77800000000000002,"5min":0.90700000000000003,"15min":1.0580000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.66900000000000004,"5min":0.82199999999999995,"15min":0.999},"last":0.622}]},{"osd":6,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59199999999999997,"15min":0.61299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78600000000000003,"5min":0.83099999999999996,"15min":0.998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.82899999999999996,"5min":0.93899999999999995,"15min":1.2849999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.40400000000000003},"max":{"1min":0.80100000000000005,"5min":0.92800000000000005,"15min":1.262},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64400000000000002,"15min":0.66100000000000003},"min":{"1min":0.48299999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76100000000000001,"5min":0.95599999999999996,"15min":1.103},"last":0.54900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":826,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199153999,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.35499999999999998,"15min":0.78600000000000003},"min":{"1min":0.24199999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.46700000000000003,"5min":0.79000000000000004,"15min":14.981999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38400000000000001,"15min":0.62},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.59699999999999998,"5min":0.64100000000000001,"15min":9.1600000000000001},"last":0.312}]},{"osd":1,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36899999999999999,"15min":0.58399999999999996},"min":{"1min":0.28199999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.55400000000000005,"5min":0.73099999999999998,"15min":8.4930000000000003},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.42599999999999999,"15min":0.65200000000000002},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":0.53500000000000003,"5min":0.91400000000000003,"15min":9.0239999999999991},"last":0.35599999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44800000000000001,"15min":0.65600000000000003},"min":{"1min":0.33000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61599999999999999,"5min":0.84299999999999997,"15min":8.5190000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.44700000000000001,"15min":0.85099999999999998},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.56100000000000005,"5min":0.87,"15min":15.007999999999999},"last":0.33000000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63700000000000001,"15min":1.052},"min":{"1min":0.41399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93799999999999994,"5min":0.95299999999999996,"15min":14.917999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65400000000000003,"15min":0.879},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90300000000000002,"5min":1.1160000000000001,"15min":8.9930000000000003},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65200000000000002,"15min":0.85799999999999998},"min":{"1min":0.439,"5min":0.432,"15min":0.35899999999999999},"max":{"1min":0.94599999999999995,"5min":0.96299999999999997,"15min":8.9610000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.86299999999999999},"min":{"1min":0.45100000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.03,"5min":1.03,"15min":8.3919999999999995},"last":0.45200000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64900000000000002,"15min":0.84799999999999998},"min":{"1min":0.498,"5min":0.42499999999999999,"15min":0.39900000000000002},"max":{"1min":0.97299999999999998,"5min":1.026,"15min":8.4339999999999993},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66200000000000003,"15min":1.054},"min":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.028,"15min":14.954000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64300000000000002,"15min":0.84399999999999997},"min":{"1min":0.42599999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":8.9160000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65500000000000003,"15min":0.85899999999999999},"min":{"1min":0.46800000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":1.0609999999999999,"15min":8.4640000000000004},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574937,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154427,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58599999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41699999999999998,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35599999999999998,"15min":0.32800000000000001},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.215},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.433},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.40000000000000002,"15min":0.35699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38800000000000001,"15min":0.36499999999999999},"min":{"1min":0.27000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46899999999999997,"15min":0.42499999999999999},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53800000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.375},"max":{"1min":0.77700000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.434,"5min":0.372,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.84799999999999998,"15min":0.91500000000000004},"last":0.68899999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64200000000000002,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.77100000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64000000000000001,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.38800000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63600000000000001,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.91700000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.64000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154517,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52500000000000002,"15min":0.498},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.29299999999999998},"max":{"1min":0.624,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.53300000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.70199999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.254},"max":{"1min":0.68300000000000005,"5min":0.73999999999999999,"15min":0.77000000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.68000000000000005},"min":{"1min":0.433,"5min":0.38500000000000001,"15min":0.34499999999999997},"max":{"1min":0.67400000000000004,"5min":0.83299999999999996,"15min":4.3250000000000002},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54300000000000004,"15min":0.67200000000000004},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.71299999999999997,"5min":0.79900000000000004,"15min":4.7320000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.98099999999999998},"min":{"1min":0.40999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65100000000000002,"5min":0.80200000000000005,"15min":11.715},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56299999999999994,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.35199999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.39000000000000001},"max":{"1min":0.73999999999999999,"5min":0.81299999999999994,"15min":0.85599999999999998},"last":0.63}]},{"osd":5,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.503,"15min":0.51500000000000001},"min":{"1min":0.28799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.77100000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.315,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":0.75700000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.36399999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74299999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64200000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.81599999999999995,"5min":0.879,"15min":0.879},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.38500000000000001,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.83399999999999996,"15min":0.88600000000000001},"last":0.54700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154475,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54600000000000004,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56399999999999995,"15min":0.52700000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.753,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55200000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.52400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82299999999999995,"5min":1.093,"15min":1.093},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57599999999999996,"15min":0.52800000000000002},"min":{"1min":0.46400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.745,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59399999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55100000000000005,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68000000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79800000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45300000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.78300000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61499999999999999,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77700000000000002,"5min":1.071,"15min":1.071},"last":0.58099999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47799999999999998,"15min":0.497},"min":{"1min":0.29199999999999998,"5min":0.28899999999999998,"15min":0.27500000000000002},"max":{"1min":0.65200000000000002,"5min":0.79000000000000004,"15min":0.84399999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.5,"15min":0.503},"min":{"1min":0.32300000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.72599999999999998,"5min":0.76900000000000002,"15min":0.81000000000000005},"last":0.48399999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.52800000000000002},"min":{"1min":0.308,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59999999999999998,"5min":0.85199999999999998,"15min":1.0680000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.31},"max":{"1min":0.74099999999999999,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.60599999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.30399999999999999},"max":{"1min":0.76700000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.626},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.32600000000000001},"max":{"1min":0.75800000000000001,"5min":0.84399999999999997,"15min":1.0269999999999999},"last":0.53800000000000003}]}]}],"pool_statfs":[]}} 2023-10-09T06:28:03.641 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:28:03.641 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:28:03.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.799+0000 7f5059d17700 1 Processor -- start 2023-10-09T06:28:03.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.799+0000 7f5059d17700 1 -- start start 2023-10-09T06:28:03.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.800+0000 7f5059d17700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f50541542a0 0x7f50540b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:03.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.800+0000 7f5059d17700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505406b0a0 con 0x7f505406aa00 2023-10-09T06:28:03.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.800+0000 7f5059d17700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505415ad20 con 0x7f50540cd630 2023-10-09T06:28:03.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.800+0000 7f5059d17700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505415b2e0 con 0x7f50541542a0 2023-10-09T06:28:03.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.800+0000 7f5058d15700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f50541542a0 0x7f50540b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:03.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.800+0000 7f5059516700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f505406aa00 0x7f505415c140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51622/0 (socket says 172.21.15.31:51622) 2023-10-09T06:28:03.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.800+0000 7f5058d15700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f50541542a0 0x7f50540b65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52418/0 (socket says 172.21.15.31:52418) 2023-10-09T06:28:03.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.800+0000 7f5059516700 1 -- 172.21.15.31:0/861350213 learned_addr learned my addr 172.21.15.31:0/861350213 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:28:03.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f5058d15700 1 -- 172.21.15.31:0/861350213 >> v1:172.21.15.158:6789/0 conn(0x7f50540cd630 legacy=0x7f505406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:03.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f5058d15700 1 -- 172.21.15.31:0/861350213 >> v1:172.21.15.31:6789/0 conn(0x7f505406aa00 legacy=0x7f505415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:03.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f5058d15700 1 -- 172.21.15.31:0/861350213 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505415b000 con 0x7f50541542a0 2023-10-09T06:28:03.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f50537fe700 1 -- 172.21.15.31:0/861350213 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727834313 0 0) 0x7f505406b0a0 con 0x7f505406aa00 2023-10-09T06:28:03.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f5058d15700 1 --2- 172.21.15.31:0/861350213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50541542a0 0x7f50540b65a0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f504c009eb0 tx=0x7f504c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4e4abb4adff9bf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:03.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f50537fe700 1 -- 172.21.15.31:0/861350213 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c00e070 con 0x7f50541542a0 2023-10-09T06:28:03.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f50537fe700 1 -- 172.21.15.31:0/861350213 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c00bbf0 con 0x7f50541542a0 2023-10-09T06:28:03.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f50537fe700 1 -- 172.21.15.31:0/861350213 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c012430 con 0x7f50541542a0 2023-10-09T06:28:03.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f5059d17700 1 -- 172.21.15.31:0/861350213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50541542a0 msgr2=0x7f50540b65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:03.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f5059d17700 1 --2- 172.21.15.31:0/861350213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50541542a0 0x7f50540b65a0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f504c009eb0 tx=0x7f504c009780 comp rx=0 tx=0).stop 2023-10-09T06:28:03.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f5059d17700 1 -- 172.21.15.31:0/861350213 shutdown_connections 2023-10-09T06:28:03.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f5059d17700 1 --2- 172.21.15.31:0/861350213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50541542a0 0x7f50540b65a0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:03.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f5059d17700 1 -- 172.21.15.31:0/861350213 >> 172.21.15.31:0/861350213 conn(0x7f5054068cb0 msgr2=0x7f50540690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:03.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f5059d17700 1 -- 172.21.15.31:0/861350213 shutdown_connections 2023-10-09T06:28:03.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.801+0000 7f5059d17700 1 -- 172.21.15.31:0/861350213 wait complete. 2023-10-09T06:28:03.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.802+0000 7f5059d17700 1 Processor -- start 2023-10-09T06:28:03.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.803+0000 7f5059d17700 1 -- start start 2023-10-09T06:28:03.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.803+0000 7f5059d17700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505406aa00 0x7f50540c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:03.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.803+0000 7f5059d17700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50540cd630 0x7f5054153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:03.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.803+0000 7f5059d17700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50541542a0 0x7f50540c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:03.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.803+0000 7f5059d17700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50540c68a0 con 0x7f505406aa00 2023-10-09T06:28:03.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.803+0000 7f5059d17700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50540c7be0 con 0x7f50540cd630 2023-10-09T06:28:03.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.803+0000 7f5059d17700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5054157ad0 con 0x7f50541542a0 2023-10-09T06:28:03.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5058d15700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505406aa00 0x7f50540c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:03.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5058d15700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505406aa00 0x7f50540c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52424/0 (socket says 172.21.15.31:52424) 2023-10-09T06:28:03.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5058d15700 1 -- 172.21.15.31:0/3614201160 learned_addr learned my addr 172.21.15.31:0/3614201160 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:03.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5053fff700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50540cd630 0x7f5054153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:03.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5059516700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50541542a0 0x7f50540c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:03.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5058d15700 1 -- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50541542a0 msgr2=0x7f50540c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:03.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5058d15700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50541542a0 0x7f50540c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:03.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5058d15700 1 -- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50540cd630 msgr2=0x7f5054153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:03.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5058d15700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50540cd630 0x7f5054153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:03.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5058d15700 1 -- 172.21.15.31:0/3614201160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c009a20 con 0x7f505406aa00 2023-10-09T06:28:03.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5053fff700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50540cd630 0x7f5054153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:28:03.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5059516700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50541542a0 0x7f50540c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:28:03.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5058d15700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505406aa00 0x7f50540c76a0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f504c00b6c0 tx=0x7f504c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:03.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5050ff9700 1 -- 172.21.15.31:0/3614201160 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c01d640 con 0x7f505406aa00 2023-10-09T06:28:03.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5050ff9700 1 -- 172.21.15.31:0/3614201160 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c01d7c0 con 0x7f505406aa00 2023-10-09T06:28:03.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5050ff9700 1 -- 172.21.15.31:0/3614201160 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c01db80 con 0x7f505406aa00 2023-10-09T06:28:03.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5059d17700 1 -- 172.21.15.31:0/3614201160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50540c7df0 con 0x7f505406aa00 2023-10-09T06:28:03.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.804+0000 7f5059d17700 1 -- 172.21.15.31:0/3614201160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5054153bc0 con 0x7f505406aa00 2023-10-09T06:28:03.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.805+0000 7f5059d17700 1 -- 172.21.15.31:0/3614201160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5054089550 con 0x7f505406aa00 2023-10-09T06:28:03.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.805+0000 7f5050ff9700 1 -- 172.21.15.31:0/3614201160 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f504c024070 con 0x7f505406aa00 2023-10-09T06:28:03.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.806+0000 7f5050ff9700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5040066f30 0x7f50400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:03.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.806+0000 7f5050ff9700 1 -- 172.21.15.31:0/3614201160 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f504c086fd0 con 0x7f505406aa00 2023-10-09T06:28:03.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.806+0000 7f5053fff700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5040066f30 0x7f50400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:03.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.807+0000 7f5053fff700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5040066f30 0x7f50400693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f50540c9690 tx=0x7f5048009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:03.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:03.810+0000 7f5050ff9700 1 -- 172.21.15.31:0/3614201160 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f504c054240 con 0x7f505406aa00 2023-10-09T06:28:04.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.083+0000 7f5059d17700 1 -- 172.21.15.31:0/3614201160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f505415d610 con 0x7f505406aa00 2023-10-09T06:28:04.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.088+0000 7f5050ff9700 1 -- 172.21.15.31:0/3614201160 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f504c057860 con 0x7f505406aa00 2023-10-09T06:28:04.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.091+0000 7f5059d17700 1 -- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5040066f30 msgr2=0x7f50400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.091+0000 7f5059d17700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5040066f30 0x7f50400693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f50540c9690 tx=0x7f5048009040 comp rx=0 tx=0).stop 2023-10-09T06:28:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.091+0000 7f5059d17700 1 -- 172.21.15.31:0/3614201160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505406aa00 msgr2=0x7f50540c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.091+0000 7f5059d17700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505406aa00 0x7f50540c76a0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f504c00b6c0 tx=0x7f504c016000 comp rx=0 tx=0).stop 2023-10-09T06:28:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.091+0000 7f5059d17700 1 -- 172.21.15.31:0/3614201160 shutdown_connections 2023-10-09T06:28:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.091+0000 7f5059d17700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5040066f30 0x7f50400693e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.091+0000 7f5059d17700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50541542a0 0x7f50540c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.091+0000 7f5059d17700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505406aa00 0x7f50540c76a0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.091+0000 7f5059d17700 1 --2- 172.21.15.31:0/3614201160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50540cd630 0x7f5054153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.091+0000 7f5059d17700 1 -- 172.21.15.31:0/3614201160 >> 172.21.15.31:0/3614201160 conn(0x7f5054068cb0 msgr2=0x7f50540cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:04.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.091+0000 7f5059d17700 1 -- 172.21.15.31:0/3614201160 shutdown_connections 2023-10-09T06:28:04.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.091+0000 7f5059d17700 1 -- 172.21.15.31:0/3614201160 wait complete. 2023-10-09T06:28:04.093 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2023-10-09T06:28:04.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:28:04.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.221+0000 7f2160e53700 1 Processor -- start 2023-10-09T06:28:04.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.221+0000 7f2160e53700 1 -- start start 2023-10-09T06:28:04.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.222+0000 7f2160e53700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f215c1568d0 0x7f215c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:04.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.222+0000 7f2160e53700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f215c0ad9b0 0x7f215c06a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:04.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.222+0000 7f2160e53700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f215c067ba0 con 0x7f215c156ca0 2023-10-09T06:28:04.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.222+0000 7f2160e53700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215c15aa90 con 0x7f215c0ad9b0 2023-10-09T06:28:04.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.222+0000 7f2160e53700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c067870 con 0x7f215c1568d0 2023-10-09T06:28:04.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.223+0000 7f2159d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f215c0ad9b0 0x7f215c06a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:04.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.223+0000 7f2159d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f215c0ad9b0 0x7f215c06a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52436/0 (socket says 172.21.15.31:52436) 2023-10-09T06:28:04.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.223+0000 7f2159d9b700 1 -- 172.21.15.31:0/2068972982 learned_addr learned my addr 172.21.15.31:0/2068972982 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:04.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.223+0000 7f215a59c700 1 --2- 172.21.15.31:0/2068972982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f215c1568d0 0x7f215c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:04.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.223+0000 7f2159d9b700 1 -- 172.21.15.31:0/2068972982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f215c1568d0 msgr2=0x7f215c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:04.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.223+0000 7f2159d9b700 1 --2- 172.21.15.31:0/2068972982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f215c1568d0 0x7f215c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:04.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.223+0000 7f2159d9b700 1 -- 172.21.15.31:0/2068972982 >> v1:172.21.15.158:6789/0 conn(0x7f215c156ca0 legacy=0x7f215c0c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:04.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.223+0000 7f2159d9b700 1 -- 172.21.15.31:0/2068972982 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c0c8ca0 con 0x7f215c0ad9b0 2023-10-09T06:28:04.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.223+0000 7f2159d9b700 1 --2- 172.21.15.31:0/2068972982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f215c0ad9b0 0x7f215c06a360 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f21440099b0 tx=0x7f2144009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7259335cb312ebc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:04.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.223+0000 7f215959a700 1 -- 172.21.15.31:0/2068972982 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400b860 con 0x7f215c0ad9b0 2023-10-09T06:28:04.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.223+0000 7f215959a700 1 -- 172.21.15.31:0/2068972982 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214400b9c0 con 0x7f215c0ad9b0 2023-10-09T06:28:04.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.223+0000 7f215959a700 1 -- 172.21.15.31:0/2068972982 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400bd60 con 0x7f215c0ad9b0 2023-10-09T06:28:04.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.224+0000 7f2160e53700 1 -- 172.21.15.31:0/2068972982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f215c0ad9b0 msgr2=0x7f215c06a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:04.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.224+0000 7f2160e53700 1 --2- 172.21.15.31:0/2068972982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f215c0ad9b0 0x7f215c06a360 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f21440099b0 tx=0x7f2144009250 comp rx=0 tx=0).stop 2023-10-09T06:28:04.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.224+0000 7f2160e53700 1 -- 172.21.15.31:0/2068972982 shutdown_connections 2023-10-09T06:28:04.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.224+0000 7f2160e53700 1 --2- 172.21.15.31:0/2068972982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f215c1568d0 0x7f215c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:04.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.224+0000 7f2160e53700 1 --2- 172.21.15.31:0/2068972982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f215c0ad9b0 0x7f215c06a360 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:04.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.224+0000 7f2160e53700 1 -- 172.21.15.31:0/2068972982 >> 172.21.15.31:0/2068972982 conn(0x7f215c0cda50 msgr2=0x7f215c0cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:04.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.224+0000 7f2160e53700 1 -- 172.21.15.31:0/2068972982 shutdown_connections 2023-10-09T06:28:04.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.224+0000 7f2160e53700 1 -- 172.21.15.31:0/2068972982 wait complete. 2023-10-09T06:28:04.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.225+0000 7f2160e53700 1 Processor -- start 2023-10-09T06:28:04.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.225+0000 7f2160e53700 1 -- start start 2023-10-09T06:28:04.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f2160e53700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f215c0ad9b0 0x7f215c16b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:04.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f2160e53700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f215c1568d0 0x7f215c0c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:04.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f2160e53700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f215c156ca0 0x7f215c0c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:04.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f2160e53700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c167f00 con 0x7f215c156ca0 2023-10-09T06:28:04.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f2160e53700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c0c5de0 con 0x7f215c0ad9b0 2023-10-09T06:28:04.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f2160e53700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c16c1e0 con 0x7f215c1568d0 2023-10-09T06:28:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f215ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f215c156ca0 0x7f215c0c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f215ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f215c156ca0 0x7f215c0c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52438/0 (socket says 172.21.15.31:52438) 2023-10-09T06:28:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f215ad9d700 1 -- 172.21.15.31:0/2455211085 learned_addr learned my addr 172.21.15.31:0/2455211085 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f215a59c700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f215c0ad9b0 0x7f215c16b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f2159d9b700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f215c1568d0 0x7f215c0c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f215ad9d700 1 -- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f215c1568d0 msgr2=0x7f215c0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f215ad9d700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f215c1568d0 0x7f215c0c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f215ad9d700 1 -- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f215c0ad9b0 msgr2=0x7f215c16b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f215ad9d700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f215c0ad9b0 0x7f215c16b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f215ad9d700 1 -- 172.21.15.31:0/2455211085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21440094f0 con 0x7f215c156ca0 2023-10-09T06:28:04.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f215a59c700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f215c0ad9b0 0x7f215c16b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:28:04.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.226+0000 7f215ad9d700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f215c156ca0 0x7f215c0c3d70 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f214c00c8e0 tx=0x7f214c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:04.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.227+0000 7f21527fc700 1 -- 172.21.15.31:0/2455211085 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c00ce80 con 0x7f215c156ca0 2023-10-09T06:28:04.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.227+0000 7f21527fc700 1 -- 172.21.15.31:0/2455211085 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c00a7e0 con 0x7f215c156ca0 2023-10-09T06:28:04.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.227+0000 7f2160e53700 1 -- 172.21.15.31:0/2455211085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c16b940 con 0x7f215c156ca0 2023-10-09T06:28:04.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.227+0000 7f21527fc700 1 -- 172.21.15.31:0/2455211085 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c00ab80 con 0x7f215c156ca0 2023-10-09T06:28:04.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.227+0000 7f2160e53700 1 -- 172.21.15.31:0/2455211085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215c16bf00 con 0x7f215c156ca0 2023-10-09T06:28:04.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.227+0000 7f2160e53700 1 -- 172.21.15.31:0/2455211085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215c168070 con 0x7f215c156ca0 2023-10-09T06:28:04.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.228+0000 7f21527fc700 1 -- 172.21.15.31:0/2455211085 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f214c012420 con 0x7f215c156ca0 2023-10-09T06:28:04.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.228+0000 7f21527fc700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f213c066f30 0x7f213c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:04.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.229+0000 7f21527fc700 1 -- 172.21.15.31:0/2455211085 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f214c084820 con 0x7f215c156ca0 2023-10-09T06:28:04.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.229+0000 7f215a59c700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f213c066f30 0x7f213c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:04.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.229+0000 7f215a59c700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f213c066f30 0x7f213c0693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2154006fd0 tx=0x7f2154008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:04.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.233+0000 7f21527fc700 1 -- 172.21.15.31:0/2455211085 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f214c051a90 con 0x7f215c156ca0 2023-10-09T06:28:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.470+0000 7f2160e53700 1 -- 172.21.15.31:0/2455211085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f215c04c3c0 con 0x7f215c156ca0 2023-10-09T06:28:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.471+0000 7f21527fc700 1 -- 172.21.15.31:0/2455211085 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f214c0550b0 con 0x7f215c156ca0 2023-10-09T06:28:04.472 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:28:04.472 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/52086276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":52086276},{"type":"v1","addr":"172.21.15.158:6836","nonce":52086276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3440717183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3440717183},{"type":"v1","addr":"172.21.15.31:6834","nonce":3440717183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1719024262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1719024262},{"type":"v1","addr":"172.21.15.31:6835","nonce":1719024262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:53.330823+0000","modified":"2023-10-09T06:27:56.943663+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7419":{"gid":7419,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1416230741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1416230741},{"type":"v1","addr":"172.21.15.158:6837","nonce":1416230741}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T06:28:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.473+0000 7f2160e53700 1 -- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f213c066f30 msgr2=0x7f213c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.473+0000 7f2160e53700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f213c066f30 0x7f213c0693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2154006fd0 tx=0x7f2154008040 comp rx=0 tx=0).stop 2023-10-09T06:28:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.473+0000 7f2160e53700 1 -- 172.21.15.31:0/2455211085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f215c156ca0 msgr2=0x7f215c0c3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.473+0000 7f2160e53700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f215c156ca0 0x7f215c0c3d70 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f214c00c8e0 tx=0x7f214c001710 comp rx=0 tx=0).stop 2023-10-09T06:28:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.473+0000 7f2160e53700 1 -- 172.21.15.31:0/2455211085 shutdown_connections 2023-10-09T06:28:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.473+0000 7f2160e53700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f213c066f30 0x7f213c0693e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.473+0000 7f2160e53700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f215c156ca0 0x7f215c0c3d70 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.473+0000 7f2160e53700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f215c0ad9b0 0x7f215c16b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.473+0000 7f2160e53700 1 --2- 172.21.15.31:0/2455211085 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f215c1568d0 0x7f215c0c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.473+0000 7f2160e53700 1 -- 172.21.15.31:0/2455211085 >> 172.21.15.31:0/2455211085 conn(0x7f215c0cda50 msgr2=0x7f215c070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.473+0000 7f2160e53700 1 -- 172.21.15.31:0/2455211085 shutdown_connections 2023-10-09T06:28:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:04.473+0000 7f2160e53700 1 -- 172.21.15.31:0/2455211085 wait complete. 2023-10-09T06:28:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 74 2023-10-09T06:28:04.887 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:27:53.330823+0000', 'modified': '2023-10-09T06:27:56.943663+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7419}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7419': {'gid': 7419, 'name': 'd', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.158:6837/1416230741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6835', 'nonce': 1416230741}, {'type': 'v1', 'addr': '172.21.15.158:6837', 'nonce': 1416230741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:28:04.888 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:28:04.888 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T06:28:05.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.011+0000 7f3fdfcda700 1 Processor -- start 2023-10-09T06:28:05.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.011+0000 7f3fdfcda700 1 -- start start 2023-10-09T06:28:05.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.012+0000 7f3fdfcda700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3fd80cf1c0 0x7f3fd815e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.012+0000 7f3fdfcda700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3fd815a0c0 0x7f3fd8068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.012+0000 7f3fdfcda700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd80cca20 con 0x7f3fd8159cf0 2023-10-09T06:28:05.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.012+0000 7f3fdfcda700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd815ea40 con 0x7f3fd80cf1c0 2023-10-09T06:28:05.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.012+0000 7f3fdfcda700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd8067660 con 0x7f3fd815a0c0 2023-10-09T06:28:05.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.012+0000 7f3fdd275700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3fd80cf1c0 0x7f3fd815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.012+0000 7f3fdd275700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3fd80cf1c0 0x7f3fd815e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52446/0 (socket says 172.21.15.31:52446) 2023-10-09T06:28:05.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.012+0000 7f3fdd275700 1 -- 172.21.15.31:0/2569738898 learned_addr learned my addr 172.21.15.31:0/2569738898 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:05.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.012+0000 7f3fde277700 1 --2- 172.21.15.31:0/2569738898 >> v2:172.21.15.158:3300/0 conn(0x7f3fd815a0c0 0x7f3fd8068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdd275700 1 -- 172.21.15.31:0/2569738898 >> v2:172.21.15.158:3300/0 conn(0x7f3fd815a0c0 msgr2=0x7f3fd8068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:05.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdd275700 1 --2- 172.21.15.31:0/2569738898 >> v2:172.21.15.158:3300/0 conn(0x7f3fd815a0c0 0x7f3fd8068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdd275700 1 -- 172.21.15.31:0/2569738898 >> v1:172.21.15.158:6789/0 conn(0x7f3fd8159cf0 legacy=0x7f3fd80ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdd275700 1 -- 172.21.15.31:0/2569738898 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd8067f00 con 0x7f3fd80cf1c0 2023-10-09T06:28:05.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdd275700 1 --2- 172.21.15.31:0/2569738898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80cf1c0 0x7f3fd815e500 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f3fd806f260 tx=0x7f3fcc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0431b0f4a5541f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:05.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdca74700 1 -- 172.21.15.31:0/2569738898 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00b860 con 0x7f3fd80cf1c0 2023-10-09T06:28:05.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdca74700 1 -- 172.21.15.31:0/2569738898 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc00b9c0 con 0x7f3fd80cf1c0 2023-10-09T06:28:05.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdca74700 1 -- 172.21.15.31:0/2569738898 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00bd60 con 0x7f3fd80cf1c0 2023-10-09T06:28:05.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdfcda700 1 -- 172.21.15.31:0/2569738898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80cf1c0 msgr2=0x7f3fd815e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdfcda700 1 --2- 172.21.15.31:0/2569738898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80cf1c0 0x7f3fd815e500 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f3fd806f260 tx=0x7f3fcc009250 comp rx=0 tx=0).stop 2023-10-09T06:28:05.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdfcda700 1 -- 172.21.15.31:0/2569738898 shutdown_connections 2023-10-09T06:28:05.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdfcda700 1 --2- 172.21.15.31:0/2569738898 >> v2:172.21.15.158:3300/0 conn(0x7f3fd815a0c0 0x7f3fd8068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdfcda700 1 --2- 172.21.15.31:0/2569738898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80cf1c0 0x7f3fd815e500 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.013+0000 7f3fdfcda700 1 -- 172.21.15.31:0/2569738898 >> 172.21.15.31:0/2569738898 conn(0x7f3fd806c6e0 msgr2=0x7f3fd8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:05.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.014+0000 7f3fdfcda700 1 -- 172.21.15.31:0/2569738898 shutdown_connections 2023-10-09T06:28:05.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.014+0000 7f3fdfcda700 1 -- 172.21.15.31:0/2569738898 wait complete. 2023-10-09T06:28:05.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.015+0000 7f3fdfcda700 1 Processor -- start 2023-10-09T06:28:05.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.015+0000 7f3fdfcda700 1 -- start start 2023-10-09T06:28:05.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.015+0000 7f3fdfcda700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fd80cf1c0 0x7f3fd816baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.015+0000 7f3fdfcda700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd8159cf0 0x7f3fd8169650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.015+0000 7f3fdfcda700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fd815a0c0 0x7f3fd8169b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.015+0000 7f3fdfcda700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd816cf00 con 0x7f3fd8159cf0 2023-10-09T06:28:05.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.015+0000 7f3fdfcda700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd816c2f0 con 0x7f3fd80cf1c0 2023-10-09T06:28:05.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.015+0000 7f3fdfcda700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd816c5d0 con 0x7f3fd815a0c0 2023-10-09T06:28:05.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fdd275700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd8159cf0 0x7f3fd8169650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fdd275700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd8159cf0 0x7f3fd8169650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52452/0 (socket says 172.21.15.31:52452) 2023-10-09T06:28:05.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fdd275700 1 -- 172.21.15.31:0/1121367153 learned_addr learned my addr 172.21.15.31:0/1121367153 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:05.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fde277700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fd815a0c0 0x7f3fd8169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fdda76700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fd80cf1c0 0x7f3fd816baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fdd275700 1 -- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fd815a0c0 msgr2=0x7f3fd8169b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fdd275700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fd815a0c0 0x7f3fd8169b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fdd275700 1 -- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fd80cf1c0 msgr2=0x7f3fd816baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fdd275700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fd80cf1c0 0x7f3fd816baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fdd275700 1 -- 172.21.15.31:0/1121367153 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0094f0 con 0x7f3fd8159cf0 2023-10-09T06:28:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fdd275700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd8159cf0 0x7f3fd8169650 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f3fd806de20 tx=0x7f3fcc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fd5ffb700 1 -- 172.21.15.31:0/1121367153 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc011e60 con 0x7f3fd8159cf0 2023-10-09T06:28:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fd5ffb700 1 -- 172.21.15.31:0/1121367153 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc01a630 con 0x7f3fd8159cf0 2023-10-09T06:28:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fdfcda700 1 -- 172.21.15.31:0/1121367153 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd816c8b0 con 0x7f3fd8159cf0 2023-10-09T06:28:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fd5ffb700 1 -- 172.21.15.31:0/1121367153 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc01a9f0 con 0x7f3fd8159cf0 2023-10-09T06:28:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.016+0000 7f3fdfcda700 1 -- 172.21.15.31:0/1121367153 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd816bfe0 con 0x7f3fd8159cf0 2023-10-09T06:28:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.018+0000 7f3fd5ffb700 1 -- 172.21.15.31:0/1121367153 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fcc02d440 con 0x7f3fd8159cf0 2023-10-09T06:28:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.018+0000 7f3fd5ffb700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3fc4066f30 0x7f3fc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.018+0000 7f3fd5ffb700 1 -- 172.21.15.31:0/1121367153 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fcc086160 con 0x7f3fd8159cf0 2023-10-09T06:28:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.018+0000 7f3fdda76700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3fc4066f30 0x7f3fc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.019+0000 7f3fdda76700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3fc4066f30 0x7f3fc40693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0003860 tx=0x7f3fd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.020+0000 7f3fe8fd2b80 1 Processor -- start 2023-10-09T06:28:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.020+0000 7f3fe8fd2b80 1 -- start start 2023-10-09T06:28:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fe8fd2b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 0x5568c19c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fe8fd2b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c1a13d00 0x5568c19f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fe8fd2b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c19f2f60 0x5568c19c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fe8fd2b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c1920a70 con 0x5568c19c9a50 2023-10-09T06:28:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fe8fd2b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c191e270 con 0x5568c1a13d00 2023-10-09T06:28:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fe8fd2b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568c191a060 con 0x5568c19f2f60 2023-10-09T06:28:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fdda76700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 0x5568c19c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fdda76700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 0x5568c19c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52454/0 (socket says 172.21.15.31:52454) 2023-10-09T06:28:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fdda76700 1 -- 172.21.15.31:0/2619021800 learned_addr learned my addr 172.21.15.31:0/2619021800 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fde277700 1 --2- 172.21.15.31:0/2619021800 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c19f2f60 0x5568c19c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fdd275700 1 --2- 172.21.15.31:0/2619021800 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c1a13d00 0x5568c19f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fdda76700 1 -- 172.21.15.31:0/2619021800 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c19f2f60 msgr2=0x5568c19c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fdda76700 1 --2- 172.21.15.31:0/2619021800 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c19f2f60 0x5568c19c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fdda76700 1 -- 172.21.15.31:0/2619021800 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c1a13d00 msgr2=0x5568c19f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fdda76700 1 --2- 172.21.15.31:0/2619021800 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c1a13d00 0x5568c19f2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fdda76700 1 -- 172.21.15.31:0/2619021800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c17b4270 con 0x5568c19c9a50 2023-10-09T06:28:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fdd275700 1 --2- 172.21.15.31:0/2619021800 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c1a13d00 0x5568c19f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:28:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fde277700 1 --2- 172.21.15.31:0/2619021800 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c19f2f60 0x5568c19c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:28:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.021+0000 7f3fdda76700 1 --2- 172.21.15.31:0/2619021800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 0x5568c19c9e20 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000e880 tx=0x7f3fd0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c8af1b259e0c8d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.022+0000 7f3fbeffd700 1 -- 172.21.15.31:0/2619021800 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00137b0 con 0x5568c19c9a50 2023-10-09T06:28:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.022+0000 7f3fbeffd700 1 -- 172.21.15.31:0/2619021800 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd0013910 con 0x5568c19c9a50 2023-10-09T06:28:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.022+0000 7f3fbeffd700 1 -- 172.21.15.31:0/2619021800 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0013cb0 con 0x5568c19c9a50 2023-10-09T06:28:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.022+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/2619021800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 msgr2=0x5568c19c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.022+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/2619021800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 0x5568c19c9e20 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000e880 tx=0x7f3fd0014000 comp rx=0 tx=0).stop 2023-10-09T06:28:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.022+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/2619021800 shutdown_connections 2023-10-09T06:28:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.022+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/2619021800 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c19f2f60 0x5568c19c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.022+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/2619021800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 0x5568c19c9e20 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.022+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/2619021800 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c1a13d00 0x5568c19f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.022+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/2619021800 >> 172.21.15.31:0/2619021800 conn(0x5568c19cb370 msgr2=0x5568c19cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.022+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/2619021800 shutdown_connections 2023-10-09T06:28:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.022+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/2619021800 wait complete. 2023-10-09T06:28:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.023+0000 7f3fe8fd2b80 1 -- start start 2023-10-09T06:28:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.023+0000 7f3fe8fd2b80 1 Processor -- start 2023-10-09T06:28:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fe8fd2b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19c9a50 0x5568c19eeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fe8fd2b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c19f2f60 0x5568c1a109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fe8fd2b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c1a13d00 0x5568c1a09e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fe8fd2b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c18c5890 con 0x5568c1a13d00 2023-10-09T06:28:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fe8fd2b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c18e0ea0 con 0x5568c19c9a50 2023-10-09T06:28:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fe8fd2b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568c179ce30 con 0x5568c19f2f60 2023-10-09T06:28:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fe8fd2b80 10 client.0 _ll_register_callbacks cb 0x5568c198d110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:28:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fde277700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c1a13d00 0x5568c1a09e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fde277700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c1a13d00 0x5568c1a09e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52470/0 (socket says 172.21.15.31:52470) 2023-10-09T06:28:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fde277700 1 -- 172.21.15.31:0/2008177937 learned_addr learned my addr 172.21.15.31:0/2008177937 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fdda76700 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19c9a50 0x5568c19eeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fdd275700 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c19f2f60 0x5568c1a109e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fde277700 1 -- 172.21.15.31:0/2008177937 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c19f2f60 msgr2=0x5568c1a109e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fde277700 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c19f2f60 0x5568c1a109e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fde277700 1 -- 172.21.15.31:0/2008177937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19c9a50 msgr2=0x5568c19eeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fde277700 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19c9a50 0x5568c19eeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fde277700 1 -- 172.21.15.31:0/2008177937 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd000f040 con 0x5568c1a13d00 2023-10-09T06:28:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fdd275700 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c19f2f60 0x5568c1a109e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:28:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fde277700 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c1a13d00 0x5568c1a09e70 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8007b90 tx=0x7f3fc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55fa2445db1c321 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.024+0000 7f3fb7fff700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:28:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fb7fff700 1 -- 172.21.15.31:0/2008177937 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8011940 con 0x5568c1a13d00 2023-10-09T06:28:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fb7fff700 1 -- 172.21.15.31:0/2008177937 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fc8011aa0 con 0x5568c1a13d00 2023-10-09T06:28:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/2008177937 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568c19beb70 con 0x5568c1a13d00 2023-10-09T06:28:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fb7fff700 1 -- 172.21.15.31:0/2008177937 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fc8011e70 con 0x5568c1a13d00 2023-10-09T06:28:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fe8fd2b80 10 client.7581 fetch_fsmap learned FSMap version 74 2023-10-09T06:28:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/2008177937 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x5568c1756fe0 con 0x5568c1a13d00 2023-10-09T06:28:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fb7fff700 1 -- 172.21.15.31:0/2008177937 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c19beb70 con 0x5568c1a13d00 2023-10-09T06:28:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fb7fff700 1 -- 172.21.15.31:0/2008177937 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3fc8014070 con 0x5568c1a13d00 2023-10-09T06:28:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fe8fd2b80 10 client.7581 fetch_fsmap finished waiting for FSMap version 74 2023-10-09T06:28:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fe8fd2b80 10 client.7581 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T06:28:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fe8fd2b80 20 client.7581 populate_metadata read hostname 'smithi031' 2023-10-09T06:28:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.158:6835/1416230741,v1:172.21.15.158:6837/1416230741] conn(0x5568c1a239b0 0x5568c1a23d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fe8fd2b80 4 client.7581 mds_command: new command op to 7419 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:28:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/2008177937 --> [v2:172.21.15.158:6835/1416230741,v1:172.21.15.158:6837/1416230741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568c199baa0 con 0x5568c1a239b0 2023-10-09T06:28:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.025+0000 7f3fdda76700 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.158:6835/1416230741,v1:172.21.15.158:6837/1416230741] conn(0x5568c1a239b0 0x5568c1a23d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.026+0000 7f3fb7fff700 10 client.7581 ms_handle_connect on v2:172.21.15.158:6835/1416230741 2023-10-09T06:28:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.026+0000 7f3fdda76700 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.158:6835/1416230741,v1:172.21.15.158:6837/1416230741] conn(0x5568c1a239b0 0x5568c1a23d80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a33eda4e59fe64a server_cookie=b2cbdcab00dc0f05 in_seq=0 out_seq=0 2023-10-09T06:28:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.026+0000 7f3fb7fff700 1 -- 172.21.15.31:0/2008177937 <== mds.0 v2:172.21.15.158:6835/1416230741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5568c199baa0 con 0x5568c1a239b0 2023-10-09T06:28:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.026+0000 7f3fb7fff700 10 client.7581 handle_command_reply: tid=0 2023-10-09T06:28:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.026+0000 7f3fe8fd2b80 1 client.7581 shutdown 2023-10-09T06:28:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.027+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/2008177937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c1a13d00 msgr2=0x5568c1a09e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.027+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c1a13d00 0x5568c1a09e70 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8007b90 tx=0x7f3fc800b040 comp rx=0 tx=0).stop 2023-10-09T06:28:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.027+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/2008177937 shutdown_connections 2023-10-09T06:28:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.027+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.158:6835/1416230741,v1:172.21.15.158:6837/1416230741] conn(0x5568c1a239b0 0x5568c1a23d80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.027+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c1a13d00 0x5568c1a09e70 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.027+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19c9a50 0x5568c19eeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.027+0000 7f3fb7fff700 0 client.7581 ms_handle_reset on v2:172.21.15.158:6835/1416230741 2023-10-09T06:28:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.027+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/2008177937 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c19f2f60 0x5568c1a109e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.027+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/2008177937 >> 172.21.15.31:0/2008177937 conn(0x5568c19cb370 msgr2=0x5568c19c6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.027+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/2008177937 shutdown_connections 2023-10-09T06:28:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.027+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/2008177937 wait complete. 2023-10-09T06:28:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.027+0000 7f3fe8fd2b80 20 client.7581 trim_cache size 0 max 16384 2023-10-09T06:28:05.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.044+0000 7f3fe8fd2b80 1 Processor -- start 2023-10-09T06:28:05.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.044+0000 7f3fe8fd2b80 1 -- start start 2023-10-09T06:28:05.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fe8fd2b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19c9a50 0x5568c1a22f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fe8fd2b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19f2f60 0x5568c19c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fe8fd2b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c1a13d00 0x5568c1a0f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fe8fd2b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c19cab00 con 0x5568c19f2f60 2023-10-09T06:28:05.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fe8fd2b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c1a122e0 con 0x5568c19c9a50 2023-10-09T06:28:05.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fe8fd2b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568c19c7a70 con 0x5568c1a13d00 2023-10-09T06:28:05.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fdd275700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19f2f60 0x5568c19c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fdd275700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19f2f60 0x5568c19c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52476/0 (socket says 172.21.15.31:52476) 2023-10-09T06:28:05.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fdd275700 1 -- 172.21.15.31:0/3865864836 learned_addr learned my addr 172.21.15.31:0/3865864836 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:05.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fde277700 1 --2- 172.21.15.31:0/3865864836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c1a13d00 0x5568c1a0f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fdda76700 1 --2- 172.21.15.31:0/3865864836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19c9a50 0x5568c1a22f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fdd275700 1 -- 172.21.15.31:0/3865864836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c1a13d00 msgr2=0x5568c1a0f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:05.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fdd275700 1 --2- 172.21.15.31:0/3865864836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c1a13d00 0x5568c1a0f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fdd275700 1 -- 172.21.15.31:0/3865864836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19c9a50 msgr2=0x5568c1a22f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:05.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fdd275700 1 --2- 172.21.15.31:0/3865864836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19c9a50 0x5568c1a22f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fdd275700 1 -- 172.21.15.31:0/3865864836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c18e8780 con 0x5568c19f2f60 2023-10-09T06:28:05.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fdda76700 1 --2- 172.21.15.31:0/3865864836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19c9a50 0x5568c1a22f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:28:05.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fdd275700 1 --2- 172.21.15.31:0/3865864836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19f2f60 0x5568c19c50c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc012fd0 tx=0x7f3fcc086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73497684eae40ff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:05.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fbf7fe700 1 -- 172.21.15.31:0/3865864836 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc02b3a0 con 0x5568c19f2f60 2023-10-09T06:28:05.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fbf7fe700 1 -- 172.21.15.31:0/3865864836 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc05a050 con 0x5568c19f2f60 2023-10-09T06:28:05.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.045+0000 7f3fbf7fe700 1 -- 172.21.15.31:0/3865864836 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc057790 con 0x5568c19f2f60 2023-10-09T06:28:05.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.046+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/3865864836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19f2f60 msgr2=0x5568c19c50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.046+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/3865864836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19f2f60 0x5568c19c50c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc012fd0 tx=0x7f3fcc086040 comp rx=0 tx=0).stop 2023-10-09T06:28:05.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.046+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/3865864836 shutdown_connections 2023-10-09T06:28:05.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.046+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/3865864836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c1a13d00 0x5568c1a0f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.046+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/3865864836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19c9a50 0x5568c1a22f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.046+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/3865864836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19f2f60 0x5568c19c50c0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.046+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/3865864836 >> 172.21.15.31:0/3865864836 conn(0x5568c19cb370 msgr2=0x5568c19f9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:05.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.046+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/3865864836 shutdown_connections 2023-10-09T06:28:05.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.046+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/3865864836 wait complete. 2023-10-09T06:28:05.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.046+0000 7f3fe8fd2b80 1 -- start start 2023-10-09T06:28:05.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.046+0000 7f3fe8fd2b80 1 Processor -- start 2023-10-09T06:28:05.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.047+0000 7f3fe8fd2b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 0x5568c1a75ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.047+0000 7f3fe8fd2b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19f2f60 0x5568c1a0f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.047+0000 7f3fe8fd2b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c1a13d00 0x5568c1a0f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.047+0000 7f3fe8fd2b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c1a2e180 con 0x5568c19c9a50 2023-10-09T06:28:05.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.047+0000 7f3fe8fd2b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c1a2ff00 con 0x5568c19f2f60 2023-10-09T06:28:05.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.047+0000 7f3fe8fd2b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568c1a774d0 con 0x5568c1a13d00 2023-10-09T06:28:05.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.047+0000 7f3fe8fd2b80 10 client.0 _ll_register_callbacks cb 0x5568c198d110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:28:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.047+0000 7f3fdda76700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 0x5568c1a75ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fdda76700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 0x5568c1a75ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52478/0 (socket says 172.21.15.31:52478) 2023-10-09T06:28:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fdda76700 1 -- 172.21.15.31:0/1458124297 learned_addr learned my addr 172.21.15.31:0/1458124297 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fdd275700 1 --2- 172.21.15.31:0/1458124297 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19f2f60 0x5568c1a0f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fde277700 1 --2- 172.21.15.31:0/1458124297 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c1a13d00 0x5568c1a0f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fdda76700 1 -- 172.21.15.31:0/1458124297 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c1a13d00 msgr2=0x5568c1a0f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fdda76700 1 --2- 172.21.15.31:0/1458124297 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c1a13d00 0x5568c1a0f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fdda76700 1 -- 172.21.15.31:0/1458124297 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19f2f60 msgr2=0x5568c1a0f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fdda76700 1 --2- 172.21.15.31:0/1458124297 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19f2f60 0x5568c1a0f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fdda76700 1 -- 172.21.15.31:0/1458124297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd816bfe0 con 0x5568c19c9a50 2023-10-09T06:28:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fdda76700 1 --2- 172.21.15.31:0/1458124297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 0x5568c1a75ca0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000e850 tx=0x7f3fd0030250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa1351fc2cc8330 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fb7fff700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:28:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fb7fff700 1 -- 172.21.15.31:0/1458124297 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0006820 con 0x5568c19c9a50 2023-10-09T06:28:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fb7fff700 1 -- 172.21.15.31:0/1458124297 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fd001b040 con 0x5568c19c9a50 2023-10-09T06:28:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/1458124297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3fd0013910 con 0x5568c19c9a50 2023-10-09T06:28:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fb7fff700 1 -- 172.21.15.31:0/1458124297 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fd0033cd0 con 0x5568c19c9a50 2023-10-09T06:28:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fe8fd2b80 10 client.7587 fetch_fsmap learned FSMap version 74 2023-10-09T06:28:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/1458124297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x5568c18cf470 con 0x5568c19c9a50 2023-10-09T06:28:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.048+0000 7f3fb7fff700 1 -- 172.21.15.31:0/1458124297 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd0013910 con 0x5568c19c9a50 2023-10-09T06:28:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.049+0000 7f3fb7fff700 1 -- 172.21.15.31:0/1458124297 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3fd0006980 con 0x5568c19c9a50 2023-10-09T06:28:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.049+0000 7f3fe8fd2b80 10 client.7587 fetch_fsmap finished waiting for FSMap version 74 2023-10-09T06:28:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.049+0000 7f3fe8fd2b80 10 client.7587 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T06:28:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.049+0000 7f3fe8fd2b80 20 client.7587 populate_metadata read hostname 'smithi031' 2023-10-09T06:28:05.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.049+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/1458124297 >> [v2:172.21.15.158:6835/1416230741,v1:172.21.15.158:6837/1416230741] conn(0x5568c19ed840 0x5568c19edc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.049+0000 7f3fe8fd2b80 4 client.7587 mds_command: new command op to 7419 tid=0[{"prefix": "status"}] 2023-10-09T06:28:05.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.049+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/1458124297 --> [v2:172.21.15.158:6835/1416230741,v1:172.21.15.158:6837/1416230741] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5568c18bce00 con 0x5568c19ed840 2023-10-09T06:28:05.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.049+0000 7f3fdd275700 1 --2- 172.21.15.31:0/1458124297 >> [v2:172.21.15.158:6835/1416230741,v1:172.21.15.158:6837/1416230741] conn(0x5568c19ed840 0x5568c19edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.049+0000 7f3fb7fff700 10 client.7587 ms_handle_connect on v2:172.21.15.158:6835/1416230741 2023-10-09T06:28:05.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.049+0000 7f3fdd275700 1 --2- 172.21.15.31:0/1458124297 >> [v2:172.21.15.158:6835/1416230741,v1:172.21.15.158:6837/1416230741] conn(0x5568c19ed840 0x5568c19edc10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1287840233b9833c server_cookie=2f461ac089f4f0ef in_seq=0 out_seq=0 2023-10-09T06:28:05.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.049+0000 7f3fb7fff700 1 -- 172.21.15.31:0/1458124297 <== mds.0 v2:172.21.15.158:6835/1416230741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5568c18bce00 con 0x5568c19ed840 2023-10-09T06:28:05.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.049+0000 7f3fb7fff700 10 client.7587 handle_command_reply: tid=0 2023-10-09T06:28:05.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.049+0000 7f3fe8fd2b80 1 client.7587 shutdown 2023-10-09T06:28:05.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/1458124297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 msgr2=0x5568c1a75ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/1458124297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 0x5568c1a75ca0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000e850 tx=0x7f3fd0030250 comp rx=0 tx=0).stop 2023-10-09T06:28:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/1458124297 shutdown_connections 2023-10-09T06:28:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/1458124297 >> [v2:172.21.15.158:6835/1416230741,v1:172.21.15.158:6837/1416230741] conn(0x5568c19ed840 0x5568c19edc10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/1458124297 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x5568c1a13d00 0x5568c1a0f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/1458124297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568c19c9a50 0x5568c1a75ca0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fe8fd2b80 1 --2- 172.21.15.31:0/1458124297 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5568c19f2f60 0x5568c1a0f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fb7fff700 0 client.7587 ms_handle_reset on v2:172.21.15.158:6835/1416230741 2023-10-09T06:28:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/1458124297 >> 172.21.15.31:0/1458124297 conn(0x5568c19cb370 msgr2=0x5568c19c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/1458124297 shutdown_connections 2023-10-09T06:28:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fe8fd2b80 1 -- 172.21.15.31:0/1458124297 wait complete. 2023-10-09T06:28:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fe8fd2b80 20 client.7587 trim_cache size 0 max 16384 2023-10-09T06:28:05.058 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:28:05.058 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:28:05.058 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-10-09T06:28:05.058 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 7419, 2023-10-09T06:28:05.058 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-10-09T06:28:05.058 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-10-09T06:28:05.058 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-10-09T06:28:05.058 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 11.113840516, 2023-10-09T06:28:05.058 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 74, 2023-10-09T06:28:05.058 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 152, 2023-10-09T06:28:05.058 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 152, 2023-10-09T06:28:05.059 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 16.188305883999998 2023-10-09T06:28:05.059 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:28:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fdfcda700 1 -- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3fc4066f30 msgr2=0x7f3fc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fdfcda700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3fc4066f30 0x7f3fc40693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0003860 tx=0x7f3fd0009040 comp rx=0 tx=0).stop 2023-10-09T06:28:05.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fdfcda700 1 -- 172.21.15.31:0/1121367153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd8159cf0 msgr2=0x7f3fd8169650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fdfcda700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd8159cf0 0x7f3fd8169650 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f3fd806de20 tx=0x7f3fcc017000 comp rx=0 tx=0).stop 2023-10-09T06:28:05.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fdfcda700 1 -- 172.21.15.31:0/1121367153 shutdown_connections 2023-10-09T06:28:05.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fdfcda700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3fc4066f30 0x7f3fc40693e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fdfcda700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3fd815a0c0 0x7f3fd8169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fdfcda700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3fd80cf1c0 0x7f3fd816baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fdfcda700 1 --2- 172.21.15.31:0/1121367153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd8159cf0 0x7f3fd8169650 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fdfcda700 1 -- 172.21.15.31:0/1121367153 >> 172.21.15.31:0/1121367153 conn(0x7f3fd806c6e0 msgr2=0x7f3fd80cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:05.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fdfcda700 1 -- 172.21.15.31:0/1121367153 shutdown_connections 2023-10-09T06:28:05.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.050+0000 7f3fdfcda700 1 -- 172.21.15.31:0/1121367153 wait complete. 2023-10-09T06:28:05.063 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:28:05.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.181+0000 7f21c7840700 1 Processor -- start 2023-10-09T06:28:05.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.181+0000 7f21c7840700 1 -- start start 2023-10-09T06:28:05.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.182+0000 7f21c7840700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f21c015a620 0x7f21c015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.182+0000 7f21c7840700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c015cbb0 con 0x7f21c0157870 2023-10-09T06:28:05.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.182+0000 7f21c7840700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c015bfa0 con 0x7f21c015d580 2023-10-09T06:28:05.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.182+0000 7f21c7840700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c015bdb0 con 0x7f21c015a620 2023-10-09T06:28:05.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.182+0000 7f21c4ddb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f21c015a620 0x7f21c015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.182+0000 7f21c4ddb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f21c015a620 0x7f21c015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52492/0 (socket says 172.21.15.31:52492) 2023-10-09T06:28:05.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.182+0000 7f21c55dc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f21c0157870 0x7f21c015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51636/0 (socket says 172.21.15.31:51636) 2023-10-09T06:28:05.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.182+0000 7f21c4ddb700 1 -- 172.21.15.31:0/1383841387 learned_addr learned my addr 172.21.15.31:0/1383841387 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:05.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.183+0000 7f21c4ddb700 1 -- 172.21.15.31:0/1383841387 >> v1:172.21.15.158:6789/0 conn(0x7f21c015d580 legacy=0x7f21c0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:05.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.183+0000 7f21c4ddb700 1 -- 172.21.15.31:0/1383841387 >> v1:172.21.15.31:6789/0 conn(0x7f21c0157870 legacy=0x7f21c015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.183+0000 7f21c4ddb700 1 -- 172.21.15.31:0/1383841387 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c015c280 con 0x7f21c015a620 2023-10-09T06:28:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.183+0000 7f21bffff700 1 -- 172.21.15.31:0/1383841387 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757793371 0 0) 0x7f21c015cbb0 con 0x7f21c0157870 2023-10-09T06:28:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.183+0000 7f21c4ddb700 1 --2- 172.21.15.31:0/1383841387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21c015a620 0x7f21c015d040 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f21b40099b0 tx=0x7f21b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7c76480a820ee1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.183+0000 7f21bffff700 1 -- 172.21.15.31:0/1383841387 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b400b820 con 0x7f21c015a620 2023-10-09T06:28:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.183+0000 7f21bffff700 1 -- 172.21.15.31:0/1383841387 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b400b980 con 0x7f21c015a620 2023-10-09T06:28:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.183+0000 7f21bffff700 1 -- 172.21.15.31:0/1383841387 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b400bd20 con 0x7f21c015a620 2023-10-09T06:28:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.183+0000 7f21c7840700 1 -- 172.21.15.31:0/1383841387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21c015a620 msgr2=0x7f21c015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.183+0000 7f21c7840700 1 --2- 172.21.15.31:0/1383841387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21c015a620 0x7f21c015d040 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f21b40099b0 tx=0x7f21b4009250 comp rx=0 tx=0).stop 2023-10-09T06:28:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.184+0000 7f21c7840700 1 -- 172.21.15.31:0/1383841387 shutdown_connections 2023-10-09T06:28:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.184+0000 7f21c7840700 1 --2- 172.21.15.31:0/1383841387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21c015a620 0x7f21c015d040 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.184+0000 7f21c7840700 1 -- 172.21.15.31:0/1383841387 >> 172.21.15.31:0/1383841387 conn(0x7f21c0068ce0 msgr2=0x7f21c00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:05.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.184+0000 7f21c7840700 1 -- 172.21.15.31:0/1383841387 shutdown_connections 2023-10-09T06:28:05.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.184+0000 7f21c7840700 1 -- 172.21.15.31:0/1383841387 wait complete. 2023-10-09T06:28:05.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.185+0000 7f21c7840700 1 Processor -- start 2023-10-09T06:28:05.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.185+0000 7f21c7840700 1 -- start start 2023-10-09T06:28:05.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c7840700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21c0157870 0x7f21c0154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c7840700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21c015a620 0x7f21c00b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c7840700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21c015d580 0x7f21c014b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c7840700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00cf2b0 con 0x7f21c015d580 2023-10-09T06:28:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c7840700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00cf590 con 0x7f21c015a620 2023-10-09T06:28:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c7840700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00cf870 con 0x7f21c0157870 2023-10-09T06:28:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c5ddd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21c015d580 0x7f21c014b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c5ddd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21c015d580 0x7f21c014b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52500/0 (socket says 172.21.15.31:52500) 2023-10-09T06:28:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c5ddd700 1 -- 172.21.15.31:0/3772864284 learned_addr learned my addr 172.21.15.31:0/3772864284 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c4ddb700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21c015a620 0x7f21c00b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c55dc700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21c0157870 0x7f21c0154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c5ddd700 1 -- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21c0157870 msgr2=0x7f21c0154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c5ddd700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21c0157870 0x7f21c0154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c5ddd700 1 -- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21c015a620 msgr2=0x7f21c00b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c5ddd700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21c015a620 0x7f21c00b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c5ddd700 1 -- 172.21.15.31:0/3772864284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b40094f0 con 0x7f21c015d580 2023-10-09T06:28:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c55dc700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21c0157870 0x7f21c0154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:28:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c5ddd700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21c015d580 0x7f21c014b750 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f21b800bb60 tx=0x7f21b80097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21bd7fa700 1 -- 172.21.15.31:0/3772864284 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800c8c0 con 0x7f21c015d580 2023-10-09T06:28:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21bd7fa700 1 -- 172.21.15.31:0/3772864284 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800ca60 con 0x7f21c015d580 2023-10-09T06:28:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c7840700 1 -- 172.21.15.31:0/3772864284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c00cfb50 con 0x7f21c015d580 2023-10-09T06:28:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21bd7fa700 1 -- 172.21.15.31:0/3772864284 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800ce20 con 0x7f21c015d580 2023-10-09T06:28:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.186+0000 7f21c7840700 1 -- 172.21.15.31:0/3772864284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c00d0110 con 0x7f21c015d580 2023-10-09T06:28:05.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.187+0000 7f21c7840700 1 -- 172.21.15.31:0/3772864284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c00d0480 con 0x7f21c015d580 2023-10-09T06:28:05.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.188+0000 7f21bd7fa700 1 -- 172.21.15.31:0/3772864284 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21b8014620 con 0x7f21c015d580 2023-10-09T06:28:05.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.188+0000 7f21bd7fa700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21ac066f30 0x7f21ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:05.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.188+0000 7f21bd7fa700 1 -- 172.21.15.31:0/3772864284 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21b80844c0 con 0x7f21c015d580 2023-10-09T06:28:05.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.188+0000 7f21c55dc700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21ac066f30 0x7f21ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:05.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.189+0000 7f21c55dc700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21ac066f30 0x7f21ac0693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f21b00011e0 tx=0x7f21b0007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:05.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.192+0000 7f21bd7fa700 1 -- 172.21.15.31:0/3772864284 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21b8051730 con 0x7f21c015d580 2023-10-09T06:28:05.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.434+0000 7f21c7840700 1 -- 172.21.15.31:0/3772864284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f21c00d02a0 con 0x7f21c015d580 2023-10-09T06:28:05.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.434+0000 7f21bd7fa700 1 -- 172.21.15.31:0/3772864284 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7f21b8054d50 con 0x7f21c015d580 2023-10-09T06:28:05.435 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:28:05.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.436+0000 7f21c7840700 1 -- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21ac066f30 msgr2=0x7f21ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.436+0000 7f21c7840700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21ac066f30 0x7f21ac0693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f21b00011e0 tx=0x7f21b0007c90 comp rx=0 tx=0).stop 2023-10-09T06:28:05.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.436+0000 7f21c7840700 1 -- 172.21.15.31:0/3772864284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21c015d580 msgr2=0x7f21c014b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:05.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.436+0000 7f21c7840700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21c015d580 0x7f21c014b750 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f21b800bb60 tx=0x7f21b80097f0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.436+0000 7f21c7840700 1 -- 172.21.15.31:0/3772864284 shutdown_connections 2023-10-09T06:28:05.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.436+0000 7f21c7840700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f21ac066f30 0x7f21ac0693e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.436+0000 7f21c7840700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f21c0157870 0x7f21c0154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.436+0000 7f21c7840700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21c015d580 0x7f21c014b750 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.436+0000 7f21c7840700 1 --2- 172.21.15.31:0/3772864284 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21c015a620 0x7f21c00b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:05.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.436+0000 7f21c7840700 1 -- 172.21.15.31:0/3772864284 >> 172.21.15.31:0/3772864284 conn(0x7f21c0068ce0 msgr2=0x7f21c0159510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:05.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.436+0000 7f21c7840700 1 -- 172.21.15.31:0/3772864284 shutdown_connections 2023-10-09T06:28:05.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:05.436+0000 7f21c7840700 1 -- 172.21.15.31:0/3772864284 wait complete. 2023-10-09T06:28:05.449 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:28:05.449 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:28:05.449 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-10-09T06:28:05.449 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:28:05.449 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:28:05.449 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:28:05.449 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:28:05.449 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:28:05.449 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:28:05.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:05.450 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-10-09T06:28:05.465 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:28:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:28:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:28:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:28:05.465 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:05.466 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:28:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T06:28:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-10-09T06:28:05.466 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:28:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T06:28:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-10-09T06:28:05.466 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:28:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-10-09T06:28:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-10-09T06:28:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T06:28:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42081sec preferred_lft 42081sec 2023-10-09T06:28:05.466 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-10-09T06:28:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:28:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:28:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-10-09T06:28:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:28:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:28:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:28:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::b4ad:53ff:fed3:a589/64 scope link 2023-10-09T06:28:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:28:05.467 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether f6:bf:b8:0f:49:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:28:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::f4bf:b8ff:fe0f:498b/64 scope link 2023-10-09T06:28:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:05.468 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:28:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:28:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::d8ab:b5ff:fe1d:e066/64 scope link 2023-10-09T06:28:05.468 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:05.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:05.468 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:28:05.529 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-10-09T06:28:05.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:05.530 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-10-09T06:28:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-10-09T06:28:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:28:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T06:28:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T06:28:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:28:05.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:05.587 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:28:05.587 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:28:05.588 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T06:28:05.588 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T06:28:05.588 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T06:28:05.588 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:28:05.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:05.689 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:28:05.703 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:28:05.704 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:28:05.704 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:28:05.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:05.704 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-10-09T06:28:05.768 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:28:05.769 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:28:05.823 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:28:05.823 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:28:05.824 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:28:05.878 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:28:05.878 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:28:05.878 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:28:05.959 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:28:05.960 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:28:05.979 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:28:05.979 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:28:05.979 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:28:05.979 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:28:05.979 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:28:05.979 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:28:05.979 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:28:05.979 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:28:06.001 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:28:06.001 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:28:06.001 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:28:06.001 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:28:06.001 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:28:06.002 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:28:06.002 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:28:06.002 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:28:06.002 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:28:06.002 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:28:06.002 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:28:06.003 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:28:06.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:06.003 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:28:06.069 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:28:06.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.227+0000 7f2f7d8a1700 1 Processor -- start 2023-10-09T06:28:06.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.227+0000 7f2f7d8a1700 1 -- start start 2023-10-09T06:28:06.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.228+0000 7f2f7d8a1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2f78159e10 0x7f2f780b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:06.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.228+0000 7f2f7d8a1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2f7815a1e0 0x7f2f780b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:06.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.228+0000 7f2f7d8a1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f780b1610 0x7f2f780cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:06.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.228+0000 7f2f7d8a1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7815e800 con 0x7f2f78159e10 2023-10-09T06:28:06.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.228+0000 7f2f7d8a1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7815db80 con 0x7f2f7815a1e0 2023-10-09T06:28:06.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.228+0000 7f2f7d8a1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7815de60 con 0x7f2f780b1610 2023-10-09T06:28:06.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.228+0000 7f2f76ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2f78159e10 0x7f2f780b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:06.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.228+0000 7f2f76ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2f78159e10 0x7f2f780b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52504/0 (socket says 172.21.15.31:52504) 2023-10-09T06:28:06.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.228+0000 7f2f76ffd700 1 -- 172.21.15.31:0/2420067500 learned_addr learned my addr 172.21.15.31:0/2420067500 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.228+0000 7f2f767fc700 1 --2- 172.21.15.31:0/2420067500 >> v2:172.21.15.158:3300/0 conn(0x7f2f7815a1e0 0x7f2f780b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.228+0000 7f2f777fe700 1 --2- 172.21.15.31:0/2420067500 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f780b1610 0x7f2f780cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f76ffd700 1 -- 172.21.15.31:0/2420067500 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f780b1610 msgr2=0x7f2f780cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f76ffd700 1 --2- 172.21.15.31:0/2420067500 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f780b1610 0x7f2f780cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f76ffd700 1 -- 172.21.15.31:0/2420067500 >> v2:172.21.15.158:3300/0 conn(0x7f2f7815a1e0 msgr2=0x7f2f780b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f76ffd700 1 --2- 172.21.15.31:0/2420067500 >> v2:172.21.15.158:3300/0 conn(0x7f2f7815a1e0 0x7f2f780b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f76ffd700 1 -- 172.21.15.31:0/2420067500 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7815e140 con 0x7f2f78159e10 2023-10-09T06:28:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f76ffd700 1 --2- 172.21.15.31:0/2420067500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f78159e10 0x7f2f780b2d20 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f2f78068580 tx=0x7f2f68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565c9de3db92af17 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f75ffb700 1 -- 172.21.15.31:0/2420067500 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6800e070 con 0x7f2f78159e10 2023-10-09T06:28:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f75ffb700 1 -- 172.21.15.31:0/2420067500 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6800b970 con 0x7f2f78159e10 2023-10-09T06:28:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f75ffb700 1 -- 172.21.15.31:0/2420067500 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f680092e0 con 0x7f2f78159e10 2023-10-09T06:28:06.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/2420067500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f78159e10 msgr2=0x7f2f780b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:06.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f7d8a1700 1 --2- 172.21.15.31:0/2420067500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f78159e10 0x7f2f780b2d20 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f2f78068580 tx=0x7f2f68009840 comp rx=0 tx=0).stop 2023-10-09T06:28:06.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/2420067500 shutdown_connections 2023-10-09T06:28:06.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f7d8a1700 1 --2- 172.21.15.31:0/2420067500 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f780b1610 0x7f2f780cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:06.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.229+0000 7f2f7d8a1700 1 --2- 172.21.15.31:0/2420067500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f78159e10 0x7f2f780b2d20 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:06.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.230+0000 7f2f7d8a1700 1 --2- 172.21.15.31:0/2420067500 >> v2:172.21.15.158:3300/0 conn(0x7f2f7815a1e0 0x7f2f780b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:06.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.230+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/2420067500 >> 172.21.15.31:0/2420067500 conn(0x7f2f78067660 msgr2=0x7f2f78067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:06.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.230+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/2420067500 shutdown_connections 2023-10-09T06:28:06.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.230+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/2420067500 wait complete. 2023-10-09T06:28:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.231+0000 7f2f7d8a1700 1 Processor -- start 2023-10-09T06:28:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.231+0000 7f2f7d8a1700 1 -- start start 2023-10-09T06:28:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f7d8a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f780b1610 0x7f2f780c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f7d8a1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f78159e10 0x7f2f7814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f7d8a1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f7815a1e0 0x7f2f78150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f7d8a1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f780c9c10 con 0x7f2f780b1610 2023-10-09T06:28:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f7d8a1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f780c9000 con 0x7f2f78159e10 2023-10-09T06:28:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f7d8a1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f780c92e0 con 0x7f2f7815a1e0 2023-10-09T06:28:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f76ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f780b1610 0x7f2f780c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f76ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f780b1610 0x7f2f780c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52520/0 (socket says 172.21.15.31:52520) 2023-10-09T06:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f76ffd700 1 -- 172.21.15.31:0/1583014882 learned_addr learned my addr 172.21.15.31:0/1583014882 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f767fc700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f78159e10 0x7f2f7814fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f777fe700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f7815a1e0 0x7f2f78150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f76ffd700 1 -- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f7815a1e0 msgr2=0x7f2f78150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f76ffd700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f7815a1e0 0x7f2f78150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f76ffd700 1 -- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f78159e10 msgr2=0x7f2f7814fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f76ffd700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f78159e10 0x7f2f7814fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f76ffd700 1 -- 172.21.15.31:0/1583014882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68009ae0 con 0x7f2f780b1610 2023-10-09T06:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f76ffd700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f780b1610 0x7f2f780c6c60 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2f78089c80 tx=0x7f2f68018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f6effd700 1 -- 172.21.15.31:0/1583014882 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f680087f0 con 0x7f2f780b1610 2023-10-09T06:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.232+0000 7f2f6effd700 1 -- 172.21.15.31:0/1583014882 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f68008950 con 0x7f2f780b1610 2023-10-09T06:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.233+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/1583014882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f780c95c0 con 0x7f2f780b1610 2023-10-09T06:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.233+0000 7f2f6effd700 1 -- 172.21.15.31:0/1583014882 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68008d10 con 0x7f2f780b1610 2023-10-09T06:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.233+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/1583014882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f780ce870 con 0x7f2f780b1610 2023-10-09T06:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.233+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/1583014882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7804c3c0 con 0x7f2f780b1610 2023-10-09T06:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.234+0000 7f2f6effd700 1 -- 172.21.15.31:0/1583014882 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f68003040 con 0x7f2f780b1610 2023-10-09T06:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.234+0000 7f2f6effd700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f58066f30 0x7f2f580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.234+0000 7f2f6effd700 1 -- 172.21.15.31:0/1583014882 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f68085ff0 con 0x7f2f780b1610 2023-10-09T06:28:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.234+0000 7f2f767fc700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f58066f30 0x7f2f580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.235+0000 7f2f767fc700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f58066f30 0x7f2f580693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2f7816d980 tx=0x7f2f600091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.238+0000 7f2f6effd700 1 -- 172.21.15.31:0/1583014882 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f680b75a0 con 0x7f2f780b1610 2023-10-09T06:28:06.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.476+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/1583014882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2f7815e420 con 0x7f2f780b1610 2023-10-09T06:28:06.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.477+0000 7f2f6effd700 1 -- 172.21.15.31:0/1583014882 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2f680531e0 con 0x7f2f780b1610 2023-10-09T06:28:06.476 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:28:06.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.478+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f58066f30 msgr2=0x7f2f580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:06.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.478+0000 7f2f7d8a1700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f58066f30 0x7f2f580693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2f7816d980 tx=0x7f2f600091a0 comp rx=0 tx=0).stop 2023-10-09T06:28:06.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.478+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/1583014882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f780b1610 msgr2=0x7f2f780c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:06.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.478+0000 7f2f7d8a1700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f780b1610 0x7f2f780c6c60 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2f78089c80 tx=0x7f2f68018000 comp rx=0 tx=0).stop 2023-10-09T06:28:06.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.478+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/1583014882 shutdown_connections 2023-10-09T06:28:06.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.478+0000 7f2f7d8a1700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f58066f30 0x7f2f580693e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:06.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.478+0000 7f2f7d8a1700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f7815a1e0 0x7f2f78150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:06.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.478+0000 7f2f7d8a1700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f780b1610 0x7f2f780c6c60 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:06.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.478+0000 7f2f7d8a1700 1 --2- 172.21.15.31:0/1583014882 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f78159e10 0x7f2f7814fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:06.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.478+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/1583014882 >> 172.21.15.31:0/1583014882 conn(0x7f2f78067660 msgr2=0x7f2f780c7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:06.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.478+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/1583014882 shutdown_connections 2023-10-09T06:28:06.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:06.478+0000 7f2f7d8a1700 1 -- 172.21.15.31:0/1583014882 wait complete. 2023-10-09T06:28:06.490 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:28:06.490 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:28:06.490 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-09T06:28:06.490 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T06:28:06.490 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T06:28:06.491 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:28:06.491 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:28:06.491 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:28:06.491 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:28:06.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:06.491 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-09T06:28:06.507 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:28:06.507 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:28:06.508 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:28:06.508 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:06.508 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:28:06.508 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:06.508 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:28:06.508 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:28:06.508 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-09T06:28:06.508 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:28:06.508 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:28:06.508 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-09T06:28:06.508 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:28:06.508 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-09T06:28:06.509 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:28:06.509 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:28:06.509 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:28:06.509 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42107sec preferred_lft 42107sec 2023-10-09T06:28:06.509 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-09T06:28:06.509 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:06.509 INFO:teuthology.orchestra.run.smithi158.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:28:06.509 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:28:06.509 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:28:06.509 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:06.509 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::c5:35ff:fec9:1844/64 scope link 2023-10-09T06:28:06.509 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:06.510 INFO:teuthology.orchestra.run.smithi158.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:28:06.510 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether e6:10:14:7c:a4:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:28:06.510 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::e410:14ff:fe7c:a4d7/64 scope link 2023-10-09T06:28:06.510 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:06.510 INFO:teuthology.orchestra.run.smithi158.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:28:06.510 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T06:28:06.510 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::44a9:f1ff:fe2b:babb/64 scope link 2023-10-09T06:28:06.510 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:28:06.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:06.511 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:28:06.573 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-09T06:28:06.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:06.574 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-09T06:28:06.630 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-09T06:28:06.630 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:28:06.630 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:28:06.631 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:28:06.631 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:28:06.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:06.631 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:28:06.631 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:28:06.631 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:28:06.631 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:28:06.631 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:28:06.631 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:28:06.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:06.732 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:28:06.747 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T06:28:06.747 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T06:28:06.747 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:28:06.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:06.747 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-09T06:28:06.811 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:28:06.812 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T06:28:06.866 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:28:06.866 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:28:06.867 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:28:06.921 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T06:28:06.921 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:28:06.921 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:28:07.001 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:28:07.002 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:28:07.020 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:28:07.021 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:28:07.021 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:28:07.021 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:28:07.021 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:28:07.021 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:28:07.021 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:28:07.021 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:28:07.042 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:28:07.042 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:28:07.042 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:28:07.042 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:28:07.042 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:28:07.042 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:28:07.042 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:28:07.042 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:28:07.042 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:28:07.043 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:28:07.043 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:28:07.043 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:28:07.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:28:07.044 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:28:07.108 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:28:07.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.234+0000 7f7dda267700 1 Processor -- start 2023-10-09T06:28:07.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.234+0000 7f7dda267700 1 -- start start 2023-10-09T06:28:07.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.235+0000 7f7dda267700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7dd41577d0 0x7f7dd40cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:07.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.235+0000 7f7dda267700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7dd4157ba0 0x7f7dd406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:07.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.235+0000 7f7dda267700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7dd415b0d0 0x7f7dd406aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:07.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.235+0000 7f7dda267700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd415c360 con 0x7f7dd41577d0 2023-10-09T06:28:07.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.235+0000 7f7dda267700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd415b790 con 0x7f7dd4157ba0 2023-10-09T06:28:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.235+0000 7f7dda267700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd415ba30 con 0x7f7dd415b0d0 2023-10-09T06:28:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.235+0000 7f7dd3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7dd41577d0 0x7f7dd40cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.235+0000 7f7dd3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7dd41577d0 0x7f7dd40cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52534/0 (socket says 172.21.15.31:52534) 2023-10-09T06:28:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.235+0000 7f7dd3fff700 1 -- 172.21.15.31:0/3547572760 learned_addr learned my addr 172.21.15.31:0/3547572760 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.235+0000 7f7dd37fe700 1 --2- 172.21.15.31:0/3547572760 >> v2:172.21.15.158:3300/0 conn(0x7f7dd4157ba0 0x7f7dd406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.235+0000 7f7dd3fff700 1 -- 172.21.15.31:0/3547572760 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7dd415b0d0 msgr2=0x7f7dd406aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.235+0000 7f7dd8804700 1 --2- 172.21.15.31:0/3547572760 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7dd415b0d0 0x7f7dd406aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dd3fff700 1 --2- 172.21.15.31:0/3547572760 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7dd415b0d0 0x7f7dd406aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dd3fff700 1 -- 172.21.15.31:0/3547572760 >> v2:172.21.15.158:3300/0 conn(0x7f7dd4157ba0 msgr2=0x7f7dd406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dd3fff700 1 --2- 172.21.15.31:0/3547572760 >> v2:172.21.15.158:3300/0 conn(0x7f7dd4157ba0 0x7f7dd406a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dd3fff700 1 -- 172.21.15.31:0/3547572760 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd415bd10 con 0x7f7dd41577d0 2023-10-09T06:28:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dd37fe700 1 --2- 172.21.15.31:0/3547572760 >> v2:172.21.15.158:3300/0 conn(0x7f7dd4157ba0 0x7f7dd406a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:28:07.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dd8804700 1 --2- 172.21.15.31:0/3547572760 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7dd415b0d0 0x7f7dd406aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:28:07.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dd3fff700 1 --2- 172.21.15.31:0/3547572760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd41577d0 0x7f7dd40cd770 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40b38b0 tx=0x7f7dc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1395505715211d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:07.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dd2ffd700 1 -- 172.21.15.31:0/3547572760 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc400b860 con 0x7f7dd41577d0 2023-10-09T06:28:07.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dd2ffd700 1 -- 172.21.15.31:0/3547572760 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc400b9c0 con 0x7f7dd41577d0 2023-10-09T06:28:07.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dd2ffd700 1 -- 172.21.15.31:0/3547572760 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc400bd60 con 0x7f7dd41577d0 2023-10-09T06:28:07.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dda267700 1 -- 172.21.15.31:0/3547572760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd41577d0 msgr2=0x7f7dd40cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:07.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dda267700 1 --2- 172.21.15.31:0/3547572760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd41577d0 0x7f7dd40cd770 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40b38b0 tx=0x7f7dc4009250 comp rx=0 tx=0).stop 2023-10-09T06:28:07.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dda267700 1 -- 172.21.15.31:0/3547572760 shutdown_connections 2023-10-09T06:28:07.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dda267700 1 --2- 172.21.15.31:0/3547572760 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7dd415b0d0 0x7f7dd406aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dda267700 1 --2- 172.21.15.31:0/3547572760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd41577d0 0x7f7dd40cd770 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dda267700 1 --2- 172.21.15.31:0/3547572760 >> v2:172.21.15.158:3300/0 conn(0x7f7dd4157ba0 0x7f7dd406a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dda267700 1 -- 172.21.15.31:0/3547572760 >> 172.21.15.31:0/3547572760 conn(0x7f7dd4068ce0 msgr2=0x7f7dd40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:07.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.236+0000 7f7dda267700 1 -- 172.21.15.31:0/3547572760 shutdown_connections 2023-10-09T06:28:07.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.237+0000 7f7dda267700 1 -- 172.21.15.31:0/3547572760 wait complete. 2023-10-09T06:28:07.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.238+0000 7f7dda267700 1 Processor -- start 2023-10-09T06:28:07.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.238+0000 7f7dda267700 1 -- start start 2023-10-09T06:28:07.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.238+0000 7f7dda267700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7dd41577d0 0x7f7dd4169ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:07.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.238+0000 7f7dda267700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7dd4157ba0 0x7f7dd40aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:07.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.238+0000 7f7dda267700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd415b0d0 0x7f7dd40a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:07.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.238+0000 7f7dda267700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40ae410 con 0x7f7dd415b0d0 2023-10-09T06:28:07.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.238+0000 7f7dda267700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40a91a0 con 0x7f7dd4157ba0 2023-10-09T06:28:07.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.238+0000 7f7dda267700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40a9b50 con 0x7f7dd41577d0 2023-10-09T06:28:07.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dd8804700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd415b0d0 0x7f7dd40a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:07.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dd8804700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd415b0d0 0x7f7dd40a8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52542/0 (socket says 172.21.15.31:52542) 2023-10-09T06:28:07.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dd8804700 1 -- 172.21.15.31:0/1710452161 learned_addr learned my addr 172.21.15.31:0/1710452161 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:07.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dd37fe700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7dd4157ba0 0x7f7dd40aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:07.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dd3fff700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7dd41577d0 0x7f7dd4169ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:07.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dd8804700 1 -- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7dd41577d0 msgr2=0x7f7dd4169ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:07.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dd8804700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7dd41577d0 0x7f7dd4169ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dd8804700 1 -- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7dd4157ba0 msgr2=0x7f7dd40aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:07.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dd8804700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7dd4157ba0 0x7f7dd40aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dd8804700 1 -- 172.21.15.31:0/1710452161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc40094f0 con 0x7f7dd415b0d0 2023-10-09T06:28:07.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dd8804700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd415b0d0 0x7f7dd40a8c60 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00a380 tx=0x7f7dcc007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:07.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dbbfff700 1 -- 172.21.15.31:0/1710452161 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc015440 con 0x7f7dd415b0d0 2023-10-09T06:28:07.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dbbfff700 1 -- 172.21.15.31:0/1710452161 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc0155a0 con 0x7f7dd415b0d0 2023-10-09T06:28:07.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dbbfff700 1 -- 172.21.15.31:0/1710452161 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc015960 con 0x7f7dd415b0d0 2023-10-09T06:28:07.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dda267700 1 -- 172.21.15.31:0/1710452161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd40ae6c0 con 0x7f7dd415b0d0 2023-10-09T06:28:07.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.239+0000 7f7dda267700 1 -- 172.21.15.31:0/1710452161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd40aef00 con 0x7f7dd415b0d0 2023-10-09T06:28:07.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.240+0000 7f7dda267700 1 -- 172.21.15.31:0/1710452161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd404c3c0 con 0x7f7dd415b0d0 2023-10-09T06:28:07.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.241+0000 7f7dbbfff700 1 -- 172.21.15.31:0/1710452161 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7dcc00d440 con 0x7f7dd415b0d0 2023-10-09T06:28:07.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.241+0000 7f7dbbfff700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7dc0066f30 0x7f7dc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:07.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.241+0000 7f7dbbfff700 1 -- 172.21.15.31:0/1710452161 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7dcc084fd0 con 0x7f7dd415b0d0 2023-10-09T06:28:07.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.241+0000 7f7dd3fff700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7dc0066f30 0x7f7dc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:07.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.242+0000 7f7dd3fff700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7dc0066f30 0x7f7dc00693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40b38b0 tx=0x7f7dc4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:07.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.246+0000 7f7dbbfff700 1 -- 172.21.15.31:0/1710452161 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7dcc052240 con 0x7f7dd415b0d0 2023-10-09T06:28:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.481+0000 7f7dda267700 1 -- 172.21.15.31:0/1710452161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dd415bff0 con 0x7f7dd415b0d0 2023-10-09T06:28:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.482+0000 7f7dbbfff700 1 -- 172.21.15.31:0/1710452161 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f7dcc055860 con 0x7f7dd415b0d0 2023-10-09T06:28:07.482 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:28:07.482 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/52086276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":52086276},{"type":"v1","addr":"172.21.15.158:6836","nonce":52086276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3440717183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3440717183},{"type":"v1","addr":"172.21.15.31:6834","nonce":3440717183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1719024262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1719024262},{"type":"v1","addr":"172.21.15.31:6835","nonce":1719024262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:53.330823+0000","modified":"2023-10-09T06:27:56.943663+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7419":{"gid":7419,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1416230741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1416230741},{"type":"v1","addr":"172.21.15.158:6837","nonce":1416230741}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T06:28:07.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.484+0000 7f7dda267700 1 -- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7dc0066f30 msgr2=0x7f7dc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:07.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.484+0000 7f7dda267700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7dc0066f30 0x7f7dc00693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40b38b0 tx=0x7f7dc4017000 comp rx=0 tx=0).stop 2023-10-09T06:28:07.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.484+0000 7f7dda267700 1 -- 172.21.15.31:0/1710452161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd415b0d0 msgr2=0x7f7dd40a8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:07.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.484+0000 7f7dda267700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd415b0d0 0x7f7dd40a8c60 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00a380 tx=0x7f7dcc007900 comp rx=0 tx=0).stop 2023-10-09T06:28:07.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.484+0000 7f7dda267700 1 -- 172.21.15.31:0/1710452161 shutdown_connections 2023-10-09T06:28:07.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.484+0000 7f7dda267700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7dc0066f30 0x7f7dc00693e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.484+0000 7f7dda267700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7dd41577d0 0x7f7dd4169ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.484+0000 7f7dda267700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd415b0d0 0x7f7dd40a8c60 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.484+0000 7f7dda267700 1 --2- 172.21.15.31:0/1710452161 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7dd4157ba0 0x7f7dd40aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.484+0000 7f7dda267700 1 -- 172.21.15.31:0/1710452161 >> 172.21.15.31:0/1710452161 conn(0x7f7dd4068ce0 msgr2=0x7f7dd40b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:07.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.484+0000 7f7dda267700 1 -- 172.21.15.31:0/1710452161 shutdown_connections 2023-10-09T06:28:07.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.484+0000 7f7dda267700 1 -- 172.21.15.31:0/1710452161 wait complete. 2023-10-09T06:28:07.485 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 74 2023-10-09T06:28:07.496 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-09T06:28:07.628 INFO:teuthology.orchestra.run.smithi158.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":7419,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.682657824,"mdsmap_epoch":74,"osdmap_epoch":152,"osdmap_epoch_barrier":152,"uptime":18.757122876} 2023-10-09T06:28:07.629 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 7419, "mdsmap_epoch": 74, "osdmap_epoch": 152, "osdmap_epoch_barrier": 152, "rank_uptime": 13.682657824, "state": "up:active", "uptime": 18.757122876, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:28:07.629 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-09T06:28:07.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.753+0000 7f61ddbfc700 1 Processor -- start 2023-10-09T06:28:07.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.753+0000 7f61ddbfc700 1 -- start start 2023-10-09T06:28:07.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.754+0000 7f61ddbfc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f61d806f2c0 0x7f61d8070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:07.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.754+0000 7f61ddbfc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f61d8068250 0x7f61d8070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:07.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.754+0000 7f61ddbfc700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d8067dc0 con 0x7f61d8159e50 2023-10-09T06:28:07.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.754+0000 7f61ddbfc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d80cb9e0 con 0x7f61d806f2c0 2023-10-09T06:28:07.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.754+0000 7f61ddbfc700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d806fa70 con 0x7f61d8068250 2023-10-09T06:28:07.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.754+0000 7f61d6ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f61d806f2c0 0x7f61d8070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:07.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.754+0000 7f61d6ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f61d806f2c0 0x7f61d8070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52558/0 (socket says 172.21.15.31:52558) 2023-10-09T06:28:07.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.754+0000 7f61d6ffd700 1 -- 172.21.15.31:0/2138428156 learned_addr learned my addr 172.21.15.31:0/2138428156 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.754+0000 7f61d7fff700 1 --2- 172.21.15.31:0/2138428156 >> v2:172.21.15.158:3300/0 conn(0x7f61d8068250 0x7f61d8070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61d6ffd700 1 -- 172.21.15.31:0/2138428156 >> v2:172.21.15.158:3300/0 conn(0x7f61d8068250 msgr2=0x7f61d8070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:28:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61d6ffd700 1 --2- 172.21.15.31:0/2138428156 >> v2:172.21.15.158:3300/0 conn(0x7f61d8068250 0x7f61d8070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61d6ffd700 1 -- 172.21.15.31:0/2138428156 >> v1:172.21.15.158:6789/0 conn(0x7f61d8159e50 legacy=0x7f61d806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61d6ffd700 1 -- 172.21.15.31:0/2138428156 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d806f790 con 0x7f61d806f2c0 2023-10-09T06:28:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61d6ffd700 1 --2- 172.21.15.31:0/2138428156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d806f2c0 0x7f61d8070700 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f61d806e120 tx=0x7f61c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1180b46fecf9ca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61d67fc700 1 -- 172.21.15.31:0/2138428156 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0009e70 con 0x7f61d806f2c0 2023-10-09T06:28:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61d67fc700 1 -- 172.21.15.31:0/2138428156 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c000b860 con 0x7f61d806f2c0 2023-10-09T06:28:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61d67fc700 1 -- 172.21.15.31:0/2138428156 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c000bc00 con 0x7f61d806f2c0 2023-10-09T06:28:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2138428156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d806f2c0 msgr2=0x7f61d8070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61ddbfc700 1 --2- 172.21.15.31:0/2138428156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d806f2c0 0x7f61d8070700 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f61d806e120 tx=0x7f61c0009250 comp rx=0 tx=0).stop 2023-10-09T06:28:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2138428156 shutdown_connections 2023-10-09T06:28:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61ddbfc700 1 --2- 172.21.15.31:0/2138428156 >> v2:172.21.15.158:3300/0 conn(0x7f61d8068250 0x7f61d8070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61ddbfc700 1 --2- 172.21.15.31:0/2138428156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d806f2c0 0x7f61d8070700 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.755+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2138428156 >> 172.21.15.31:0/2138428156 conn(0x7f61d80cdae0 msgr2=0x7f61d80cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.756+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2138428156 shutdown_connections 2023-10-09T06:28:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.756+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2138428156 wait complete. 2023-10-09T06:28:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.757+0000 7f61ddbfc700 1 Processor -- start 2023-10-09T06:28:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.757+0000 7f61ddbfc700 1 -- start start 2023-10-09T06:28:07.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.757+0000 7f61ddbfc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d8068250 0x7f61d8142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:07.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.757+0000 7f61ddbfc700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61d806f2c0 0x7f61d80b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:07.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.757+0000 7f61ddbfc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61d8159e50 0x7f61d81435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:07.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61ddbfc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d8156ae0 con 0x7f61d8068250 2023-10-09T06:28:07.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61ddbfc700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80b2080 con 0x7f61d8159e50 2023-10-09T06:28:07.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61ddbfc700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80b1470 con 0x7f61d806f2c0 2023-10-09T06:28:07.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61d77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d8068250 0x7f61d8142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:07.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61d77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d8068250 0x7f61d8142c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52574/0 (socket says 172.21.15.31:52574) 2023-10-09T06:28:07.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61d77fe700 1 -- 172.21.15.31:0/2171073261 learned_addr learned my addr 172.21.15.31:0/2171073261 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:28:07.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61d7fff700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61d8159e50 0x7f61d81435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:07.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61d6ffd700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61d806f2c0 0x7f61d80b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:07.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61d77fe700 1 -- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61d806f2c0 msgr2=0x7f61d80b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:07.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61d77fe700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61d806f2c0 0x7f61d80b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61d77fe700 1 -- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61d8159e50 msgr2=0x7f61d81435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:07.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61d77fe700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61d8159e50 0x7f61d81435e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61d77fe700 1 -- 172.21.15.31:0/2171073261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c00094f0 con 0x7f61d8068250 2023-10-09T06:28:07.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61d6ffd700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61d806f2c0 0x7f61d80b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:28:07.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61d77fe700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d8068250 0x7f61d8142c80 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f61c800c8e0 tx=0x7f61c8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:07.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61cf7fe700 1 -- 172.21.15.31:0/2171073261 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c800ce80 con 0x7f61d8068250 2023-10-09T06:28:07.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61cf7fe700 1 -- 172.21.15.31:0/2171073261 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c800a7e0 con 0x7f61d8068250 2023-10-09T06:28:07.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2171073261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d80b1750 con 0x7f61d8068250 2023-10-09T06:28:07.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61cf7fe700 1 -- 172.21.15.31:0/2171073261 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c800aba0 con 0x7f61d8068250 2023-10-09T06:28:07.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.758+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2171073261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d80b1d10 con 0x7f61d8068250 2023-10-09T06:28:07.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.759+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2171073261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d80cc7a0 con 0x7f61d8068250 2023-10-09T06:28:07.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.760+0000 7f61cf7fe700 1 -- 172.21.15.31:0/2171073261 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61c8003030 con 0x7f61d8068250 2023-10-09T06:28:07.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.760+0000 7f61cf7fe700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f61b8066f30 0x7f61b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:28:07.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.760+0000 7f61cf7fe700 1 -- 172.21.15.31:0/2171073261 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f61c8084530 con 0x7f61d8068250 2023-10-09T06:28:07.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.760+0000 7f61d6ffd700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f61b8066f30 0x7f61b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:28:07.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.761+0000 7f61d6ffd700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f61b8066f30 0x7f61b80693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f61d806e120 tx=0x7f61c0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:28:07.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.765+0000 7f61cf7fe700 1 -- 172.21.15.31:0/2171073261 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61c80517a0 con 0x7f61d8068250 2023-10-09T06:28:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.958+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2171073261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f61d804c3c0 con 0x7f61d8068250 2023-10-09T06:28:07.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.978+0000 7f61cf7fe700 1 -- 172.21.15.31:0/2171073261 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v153) v1 ==== 181+0+0 (secure 0 0 0) 0x7f61c8054dc0 con 0x7f61d8068250 2023-10-09T06:28:07.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.980+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f61b8066f30 msgr2=0x7f61b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:07.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.980+0000 7f61ddbfc700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f61b8066f30 0x7f61b80693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f61d806e120 tx=0x7f61c0017000 comp rx=0 tx=0).stop 2023-10-09T06:28:07.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.980+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2171073261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d8068250 msgr2=0x7f61d8142c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:28:07.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.981+0000 7f61ddbfc700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d8068250 0x7f61d8142c80 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f61c800c8e0 tx=0x7f61c8001710 comp rx=0 tx=0).stop 2023-10-09T06:28:07.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.981+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2171073261 shutdown_connections 2023-10-09T06:28:07.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.981+0000 7f61ddbfc700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f61b8066f30 0x7f61b80693e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.981+0000 7f61ddbfc700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61d8159e50 0x7f61d81435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.981+0000 7f61ddbfc700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d8068250 0x7f61d8142c80 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.981+0000 7f61ddbfc700 1 --2- 172.21.15.31:0/2171073261 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f61d806f2c0 0x7f61d80b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:28:07.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.981+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2171073261 >> 172.21.15.31:0/2171073261 conn(0x7f61d80cdae0 msgr2=0x7f61d80ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:28:07.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.981+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2171073261 shutdown_connections 2023-10-09T06:28:07.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:28:07.981+0000 7f61ddbfc700 1 -- 172.21.15.31:0/2171073261 wait complete. 2023-10-09T06:28:07.983 INFO:teuthology.orchestra.run.smithi031.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-09T06:28:07.993 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T06:28:08.129 INFO:teuthology.orchestra.run.smithi031.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T06:28:08.129 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T06:28:08.129 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-09T06:28:08.257 INFO:teuthology.orchestra.run.smithi031.stdout:{"mon_tick_interval":"5"} 2023-10-09T06:28:08.257 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-09T06:28:08.258 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-09T06:28:08.258 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T06:28:08.258 DEBUG:teuthology.orchestra.run.smithi031:> import time 2023-10-09T06:28:08.258 DEBUG:teuthology.orchestra.run.smithi031:> import datetime 2023-10-09T06:28:08.258 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2023-10-09T06:28:08.258 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-10-09T06:28:08.258 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:28:08.258 DEBUG:teuthology.orchestra.run.smithi031:> # Write some buffered data through before going full, all should be well 2023-10-09T06:28:08.258 DEBUG:teuthology.orchestra.run.smithi031:> print("writing some data through which we expect to succeed") 2023-10-09T06:28:08.258 DEBUG:teuthology.orchestra.run.smithi031:> bytes = 0 2023-10-09T06:28:08.259 DEBUG:teuthology.orchestra.run.smithi031:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-09T06:28:08.259 DEBUG:teuthology.orchestra.run.smithi031:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-09T06:28:08.259 DEBUG:teuthology.orchestra.run.smithi031:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-09T06:28:08.259 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(f) 2023-10-09T06:28:08.259 DEBUG:teuthology.orchestra.run.smithi031:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-09T06:28:08.259 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:28:08.259 DEBUG:teuthology.orchestra.run.smithi031:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-09T06:28:08.259 DEBUG:teuthology.orchestra.run.smithi031:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-09T06:28:08.259 DEBUG:teuthology.orchestra.run.smithi031:> # buffered IO, the error should always only appear from fsync and not 2023-10-09T06:28:08.259 DEBUG:teuthology.orchestra.run.smithi031:> # from write 2023-10-09T06:28:08.259 DEBUG:teuthology.orchestra.run.smithi031:> full = False 2023-10-09T06:28:08.259 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:28:08.259 DEBUG:teuthology.orchestra.run.smithi031:> for n in range(0, int(32 * 0.9)): 2023-10-09T06:28:08.260 DEBUG:teuthology.orchestra.run.smithi031:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-09T06:28:08.260 DEBUG:teuthology.orchestra.run.smithi031:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-09T06:28:08.260 DEBUG:teuthology.orchestra.run.smithi031:> print("done writing {0} bytes".format(bytes)) 2023-10-09T06:28:08.260 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:28:08.260 DEBUG:teuthology.orchestra.run.smithi031:> # OK, now we should sneak in under the full condition 2023-10-09T06:28:08.260 DEBUG:teuthology.orchestra.run.smithi031:> # due to the time it takes the OSDs to report to the 2023-10-09T06:28:08.260 DEBUG:teuthology.orchestra.run.smithi031:> # mons, and get a successful fsync on our full-making data 2023-10-09T06:28:08.260 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(f) 2023-10-09T06:28:08.260 DEBUG:teuthology.orchestra.run.smithi031:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-09T06:28:08.260 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:28:08.260 DEBUG:teuthology.orchestra.run.smithi031:> # buffered write, add more dirty data to the buffer 2023-10-09T06:28:08.260 DEBUG:teuthology.orchestra.run.smithi031:> print("starting buffered write") 2023-10-09T06:28:08.260 DEBUG:teuthology.orchestra.run.smithi031:> try: 2023-10-09T06:28:08.261 DEBUG:teuthology.orchestra.run.smithi031:> for n in range(0, int(32 * 0.2)): 2023-10-09T06:28:08.261 DEBUG:teuthology.orchestra.run.smithi031:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-09T06:28:08.261 DEBUG:teuthology.orchestra.run.smithi031:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-09T06:28:08.261 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(15.0) 2023-10-09T06:28:08.261 DEBUG:teuthology.orchestra.run.smithi031:> except OSError: 2023-10-09T06:28:08.261 DEBUG:teuthology.orchestra.run.smithi031:> pass; 2023-10-09T06:28:08.261 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:28:08.261 DEBUG:teuthology.orchestra.run.smithi031:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-09T06:28:08.261 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:28:08.261 DEBUG:teuthology.orchestra.run.smithi031:> # Wait long enough for a background flush that should fail 2023-10-09T06:28:08.261 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(30) 2023-10-09T06:28:08.261 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:28:08.261 DEBUG:teuthology.orchestra.run.smithi031:> if False: 2023-10-09T06:28:08.262 DEBUG:teuthology.orchestra.run.smithi031:> # ...and check that the failed background flush is reflected in fclose 2023-10-09T06:28:08.262 DEBUG:teuthology.orchestra.run.smithi031:> try: 2023-10-09T06:28:08.262 DEBUG:teuthology.orchestra.run.smithi031:> os.close(f) 2023-10-09T06:28:08.262 DEBUG:teuthology.orchestra.run.smithi031:> except OSError: 2023-10-09T06:28:08.262 DEBUG:teuthology.orchestra.run.smithi031:> print("close() returned an error as expected") 2023-10-09T06:28:08.262 DEBUG:teuthology.orchestra.run.smithi031:> else: 2023-10-09T06:28:08.262 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("close() failed to raise error") 2023-10-09T06:28:08.262 DEBUG:teuthology.orchestra.run.smithi031:> else: 2023-10-09T06:28:08.262 DEBUG:teuthology.orchestra.run.smithi031:> # The kernel cephfs client does not raise errors on fclose 2023-10-09T06:28:08.262 DEBUG:teuthology.orchestra.run.smithi031:> os.close(f) 2023-10-09T06:28:08.262 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:28:08.262 DEBUG:teuthology.orchestra.run.smithi031:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-09T06:28:08.262 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-10-09T06:28:26.693 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:28:26.700 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:28:56.757 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:28:56.760 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:29:26.844 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:29:26.847 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:29:56.917 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:29:56.920 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:30:09.017 INFO:teuthology.orchestra.run.smithi031.stdout:writing some data through which we expect to succeed 2023-10-09T06:30:09.018 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-09T06:30:09.018 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-09T06:30:09.018 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-09T06:30:09.018 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-09T06:30:09.018 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-09T06:30:09.018 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-09T06:30:09.019 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-09T06:30:09.019 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-09T06:30:09.019 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-09T06:30:09.019 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-09T06:30:09.019 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-09T06:30:09.019 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-09T06:30:09.019 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-09T06:30:09.020 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-09T06:30:09.020 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-09T06:30:09.020 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-09T06:30:09.020 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-09T06:30:09.020 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-09T06:30:09.020 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-09T06:30:09.020 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-09T06:30:09.020 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-09T06:30:09.021 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-09T06:30:09.021 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-09T06:30:09.021 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-09T06:30:09.021 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-09T06:30:09.021 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-09T06:30:09.021 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-09T06:30:09.022 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-09T06:30:09.022 INFO:teuthology.orchestra.run.smithi031.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-09T06:30:09.023 INFO:teuthology.orchestra.run.smithi031.stdout:done writing 29884416 bytes 2023-10-09T06:30:09.023 INFO:teuthology.orchestra.run.smithi031.stdout:successfully fsync'ed prior to getting full state reported 2023-10-09T06:30:09.023 INFO:teuthology.orchestra.run.smithi031.stdout:starting buffered write 2023-10-09T06:30:09.023 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:30:09.023 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:30:09.023 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:30:09.024 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:30:09.024 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:30:09.024 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:30:09.024 INFO:teuthology.orchestra.run.smithi031.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-09T06:30:09.093 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:30:09.093 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:30:09.143 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:30:09.191 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:30:09.191 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:30:09.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:30:09.192 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:30:09.239 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:30:09.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:09.239 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:30:09.255 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T06:30:09.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:30:09.256 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T06:30:09.297 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:30:09.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:09.297 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T06:30:09.353 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:30:09.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.479+0000 7f8d29127700 1 Processor -- start 2023-10-09T06:30:09.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.479+0000 7f8d29127700 1 -- start start 2023-10-09T06:30:09.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d29127700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8d24159db0 0x7f8d240d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:09.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d29127700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8d24068240 0x7f8d240b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:09.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d29127700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d240b5790 con 0x7f8d240b1d30 2023-10-09T06:30:09.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d29127700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d240ae9b0 con 0x7f8d24068240 2023-10-09T06:30:09.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d29127700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d240b59e0 con 0x7f8d24159db0 2023-10-09T06:30:09.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d237fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8d24068240 0x7f8d240b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:09.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d237fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8d24068240 0x7f8d240b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44880/0 (socket says 172.21.15.31:44880) 2023-10-09T06:30:09.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d237fe700 1 -- 172.21.15.31:0/1250401423 learned_addr learned my addr 172.21.15.31:0/1250401423 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:09.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d23fff700 1 --2- 172.21.15.31:0/1250401423 >> v2:172.21.15.158:3300/0 conn(0x7f8d24159db0 0x7f8d240d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d237fe700 1 -- 172.21.15.31:0/1250401423 >> v2:172.21.15.158:3300/0 conn(0x7f8d24159db0 msgr2=0x7f8d240d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d237fe700 1 --2- 172.21.15.31:0/1250401423 >> v2:172.21.15.158:3300/0 conn(0x7f8d24159db0 0x7f8d240d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d237fe700 1 -- 172.21.15.31:0/1250401423 >> v1:172.21.15.158:6789/0 conn(0x7f8d240b1d30 legacy=0x7f8d240b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d237fe700 1 -- 172.21.15.31:0/1250401423 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d240b5cc0 con 0x7f8d24068240 2023-10-09T06:30:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.480+0000 7f8d23fff700 1 --2- 172.21.15.31:0/1250401423 >> v2:172.21.15.158:3300/0 conn(0x7f8d24159db0 0x7f8d240d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.481+0000 7f8d237fe700 1 --2- 172.21.15.31:0/1250401423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d24068240 0x7f8d240b17f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f8d240899b0 tx=0x7f8d0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6e34b908d6453d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.481+0000 7f8d22ffd700 1 -- 172.21.15.31:0/1250401423 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00b8f0 con 0x7f8d24068240 2023-10-09T06:30:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.481+0000 7f8d22ffd700 1 -- 172.21.15.31:0/1250401423 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c00ba50 con 0x7f8d24068240 2023-10-09T06:30:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.481+0000 7f8d22ffd700 1 -- 172.21.15.31:0/1250401423 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00bdf0 con 0x7f8d24068240 2023-10-09T06:30:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.481+0000 7f8d29127700 1 -- 172.21.15.31:0/1250401423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d24068240 msgr2=0x7f8d240b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.481+0000 7f8d29127700 1 --2- 172.21.15.31:0/1250401423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d24068240 0x7f8d240b17f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f8d240899b0 tx=0x7f8d0c009250 comp rx=0 tx=0).stop 2023-10-09T06:30:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.481+0000 7f8d29127700 1 -- 172.21.15.31:0/1250401423 shutdown_connections 2023-10-09T06:30:09.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.481+0000 7f8d29127700 1 --2- 172.21.15.31:0/1250401423 >> v2:172.21.15.158:3300/0 conn(0x7f8d24159db0 0x7f8d240d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:09.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.481+0000 7f8d29127700 1 --2- 172.21.15.31:0/1250401423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d24068240 0x7f8d240b17f0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:09.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.481+0000 7f8d29127700 1 -- 172.21.15.31:0/1250401423 >> 172.21.15.31:0/1250401423 conn(0x7f8d24067e40 msgr2=0x7f8d240d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:09.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.481+0000 7f8d29127700 1 -- 172.21.15.31:0/1250401423 shutdown_connections 2023-10-09T06:30:09.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.481+0000 7f8d29127700 1 -- 172.21.15.31:0/1250401423 wait complete. 2023-10-09T06:30:09.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.482+0000 7f8d29127700 1 Processor -- start 2023-10-09T06:30:09.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.483+0000 7f8d29127700 1 -- start start 2023-10-09T06:30:09.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.483+0000 7f8d29127700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d24068240 0x7f8d2409cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:09.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.483+0000 7f8d29127700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8d240b1d30 0x7f8d2409a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:09.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.483+0000 7f8d29127700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d24159db0 0x7f8d2409af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:09.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.483+0000 7f8d29127700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2409dea0 con 0x7f8d24159db0 2023-10-09T06:30:09.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.483+0000 7f8d29127700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d24154d30 con 0x7f8d24068240 2023-10-09T06:30:09.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.483+0000 7f8d29127700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2409d290 con 0x7f8d240b1d30 2023-10-09T06:30:09.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.483+0000 7f8d28926700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d24159db0 0x7f8d2409af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:09.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d23fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d24068240 0x7f8d2409cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:09.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d28926700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d24159db0 0x7f8d2409af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44890/0 (socket says 172.21.15.31:44890) 2023-10-09T06:30:09.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d28926700 1 -- 172.21.15.31:0/3265396038 learned_addr learned my addr 172.21.15.31:0/3265396038 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:09.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d237fe700 1 --2- 172.21.15.31:0/3265396038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8d240b1d30 0x7f8d2409a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:09.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d28926700 1 -- 172.21.15.31:0/3265396038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8d240b1d30 msgr2=0x7f8d2409a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:09.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d28926700 1 --2- 172.21.15.31:0/3265396038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8d240b1d30 0x7f8d2409a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:09.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d28926700 1 -- 172.21.15.31:0/3265396038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d24068240 msgr2=0x7f8d2409cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:09.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d28926700 1 --2- 172.21.15.31:0/3265396038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d24068240 0x7f8d2409cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:09.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d28926700 1 -- 172.21.15.31:0/3265396038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0094f0 con 0x7f8d24159db0 2023-10-09T06:30:09.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d28926700 1 --2- 172.21.15.31:0/3265396038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d24159db0 0x7f8d2409af20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00c8e0 tx=0x7f8d1c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:09.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d1bfff700 1 -- 172.21.15.31:0/3265396038 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c012630 con 0x7f8d24159db0 2023-10-09T06:30:09.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d1bfff700 1 -- 172.21.15.31:0/3265396038 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c012790 con 0x7f8d24159db0 2023-10-09T06:30:09.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d29127700 1 -- 172.21.15.31:0/3265396038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2409d570 con 0x7f8d24159db0 2023-10-09T06:30:09.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d1bfff700 1 -- 172.21.15.31:0/3265396038 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c012b50 con 0x7f8d24159db0 2023-10-09T06:30:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.484+0000 7f8d29127700 1 -- 172.21.15.31:0/3265396038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2409db30 con 0x7f8d24159db0 2023-10-09T06:30:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.485+0000 7f8d29127700 1 -- 172.21.15.31:0/3265396038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2409e050 con 0x7f8d24159db0 2023-10-09T06:30:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.485+0000 7f8d1bfff700 1 -- 172.21.15.31:0/3265396038 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d1c01a3a0 con 0x7f8d24159db0 2023-10-09T06:30:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.486+0000 7f8d1bfff700 1 --2- 172.21.15.31:0/3265396038 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8d04066f60 0x7f8d04069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.486+0000 7f8d1bfff700 1 -- 172.21.15.31:0/3265396038 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f8d1c0846b0 con 0x7f8d24159db0 2023-10-09T06:30:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.486+0000 7f8d1bfff700 1 -- 172.21.15.31:0/3265396038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f8d0406eb40 con 0x7f8d24159db0 2023-10-09T06:30:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.486+0000 7f8d23fff700 1 --2- 172.21.15.31:0/3265396038 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8d04066f60 0x7f8d04069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.487+0000 7f8d23fff700 1 --2- 172.21.15.31:0/3265396038 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8d04066f60 0x7f8d04069410 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8d240b17e0 tx=0x7f8d14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.490+0000 7f8d1bfff700 1 -- 172.21.15.31:0/3265396038 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d2409e050 con 0x7f8d24159db0 2023-10-09T06:30:09.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.726+0000 7f8d29127700 1 -- 172.21.15.31:0/3265396038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d2406ace0 con 0x7f8d24159db0 2023-10-09T06:30:09.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.726+0000 7f8d1bfff700 1 -- 172.21.15.31:0/3265396038 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f8d1c0518e0 con 0x7f8d24159db0 2023-10-09T06:30:09.726 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:09.726 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/52086276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":52086276},{"type":"v1","addr":"172.21.15.158:6836","nonce":52086276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3440717183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3440717183},{"type":"v1","addr":"172.21.15.31:6834","nonce":3440717183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1719024262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1719024262},{"type":"v1","addr":"172.21.15.31:6835","nonce":1719024262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:53.330823+0000","modified":"2023-10-09T06:27:56.943663+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7419":{"gid":7419,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1416230741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1416230741},{"type":"v1","addr":"172.21.15.158:6837","nonce":1416230741}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T06:30:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.728+0000 7f8d29127700 1 -- 172.21.15.31:0/3265396038 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8d04066f60 msgr2=0x7f8d04069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.728+0000 7f8d29127700 1 --2- 172.21.15.31:0/3265396038 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8d04066f60 0x7f8d04069410 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8d240b17e0 tx=0x7f8d14008040 comp rx=0 tx=0).stop 2023-10-09T06:30:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.728+0000 7f8d29127700 1 -- 172.21.15.31:0/3265396038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d24159db0 msgr2=0x7f8d2409af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.728+0000 7f8d29127700 1 --2- 172.21.15.31:0/3265396038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d24159db0 0x7f8d2409af20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00c8e0 tx=0x7f8d1c001710 comp rx=0 tx=0).stop 2023-10-09T06:30:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.728+0000 7f8d29127700 1 -- 172.21.15.31:0/3265396038 shutdown_connections 2023-10-09T06:30:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.728+0000 7f8d29127700 1 --2- 172.21.15.31:0/3265396038 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8d04066f60 0x7f8d04069410 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.728+0000 7f8d29127700 1 --2- 172.21.15.31:0/3265396038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d24159db0 0x7f8d2409af20 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.728+0000 7f8d29127700 1 --2- 172.21.15.31:0/3265396038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d24068240 0x7f8d2409cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:09.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.728+0000 7f8d29127700 1 --2- 172.21.15.31:0/3265396038 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8d240b1d30 0x7f8d2409a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:09.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.728+0000 7f8d29127700 1 -- 172.21.15.31:0/3265396038 >> 172.21.15.31:0/3265396038 conn(0x7f8d24067e40 msgr2=0x7f8d24155320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:09.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.728+0000 7f8d29127700 1 -- 172.21.15.31:0/3265396038 shutdown_connections 2023-10-09T06:30:09.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.728+0000 7f8d29127700 1 -- 172.21.15.31:0/3265396038 wait complete. 2023-10-09T06:30:09.729 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 74 2023-10-09T06:30:09.740 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:30:09.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.859+0000 7f2c4a39a700 1 Processor -- start 2023-10-09T06:30:09.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.859+0000 7f2c4a39a700 1 -- start start 2023-10-09T06:30:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.860+0000 7f2c4a39a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c4415a620 0x7f2c4415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.860+0000 7f2c4a39a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4415cbb0 con 0x7f2c4415d580 2023-10-09T06:30:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.860+0000 7f2c4a39a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4415bfa0 con 0x7f2c44157870 2023-10-09T06:30:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.860+0000 7f2c4a39a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4415bdb0 con 0x7f2c4415a620 2023-10-09T06:30:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.860+0000 7f2c48937700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2c4415d580 0x7f2c44158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46290/0 (socket says 172.21.15.31:46290) 2023-10-09T06:30:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.861+0000 7f2c48937700 1 -- 172.21.15.31:0/755832380 learned_addr learned my addr 172.21.15.31:0/755832380 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.861+0000 7f2c437fe700 1 --2- 172.21.15.31:0/755832380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c4415a620 0x7f2c4415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.861+0000 7f2c42ffd700 1 -- 172.21.15.31:0/755832380 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357087568 0 0) 0x7f2c4415cbb0 con 0x7f2c4415d580 2023-10-09T06:30:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.861+0000 7f2c42ffd700 1 -- 172.21.15.31:0/755832380 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c2c003570 con 0x7f2c4415d580 2023-10-09T06:30:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.861+0000 7f2c42ffd700 1 -- 172.21.15.31:0/755832380 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131937212 0 0) 0x7f2c4415bfa0 con 0x7f2c44157870 2023-10-09T06:30:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.861+0000 7f2c42ffd700 1 -- 172.21.15.31:0/755832380 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c4415cbb0 con 0x7f2c44157870 2023-10-09T06:30:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.861+0000 7f2c437fe700 1 -- 172.21.15.31:0/755832380 >> v1:172.21.15.158:6789/0 conn(0x7f2c44157870 legacy=0x7f2c4415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.861+0000 7f2c437fe700 1 -- 172.21.15.31:0/755832380 >> v1:172.21.15.31:6789/0 conn(0x7f2c4415d580 legacy=0x7f2c44158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.861+0000 7f2c42ffd700 1 -- 172.21.15.31:0/755832380 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 874606651 0 0) 0x7f2c2c003570 con 0x7f2c4415d580 2023-10-09T06:30:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.861+0000 7f2c437fe700 1 -- 172.21.15.31:0/755832380 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4415c280 con 0x7f2c4415a620 2023-10-09T06:30:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.861+0000 7f2c437fe700 1 --2- 172.21.15.31:0/755832380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c4415a620 0x7f2c4415d040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009910 tx=0x7f2c380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=403f5cbefec79310 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.861+0000 7f2c42ffd700 1 -- 172.21.15.31:0/755832380 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0017f0 con 0x7f2c4415a620 2023-10-09T06:30:09.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.861+0000 7f2c42ffd700 1 -- 172.21.15.31:0/755832380 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c38011420 con 0x7f2c4415a620 2023-10-09T06:30:09.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.862+0000 7f2c42ffd700 1 -- 172.21.15.31:0/755832380 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c380117a0 con 0x7f2c4415a620 2023-10-09T06:30:09.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.862+0000 7f2c4a39a700 1 -- 172.21.15.31:0/755832380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c4415a620 msgr2=0x7f2c4415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:09.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.862+0000 7f2c4a39a700 1 --2- 172.21.15.31:0/755832380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c4415a620 0x7f2c4415d040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009910 tx=0x7f2c380091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:09.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.862+0000 7f2c4a39a700 1 -- 172.21.15.31:0/755832380 shutdown_connections 2023-10-09T06:30:09.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.862+0000 7f2c4a39a700 1 --2- 172.21.15.31:0/755832380 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c4415a620 0x7f2c4415d040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:09.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.862+0000 7f2c4a39a700 1 -- 172.21.15.31:0/755832380 >> 172.21.15.31:0/755832380 conn(0x7f2c44068ce0 msgr2=0x7f2c440690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:09.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.862+0000 7f2c4a39a700 1 -- 172.21.15.31:0/755832380 shutdown_connections 2023-10-09T06:30:09.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.862+0000 7f2c4a39a700 1 -- 172.21.15.31:0/755832380 wait complete. 2023-10-09T06:30:09.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.863+0000 7f2c4a39a700 1 Processor -- start 2023-10-09T06:30:09.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.863+0000 7f2c4a39a700 1 -- start start 2023-10-09T06:30:09.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c4a39a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c44157870 0x7f2c440b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:09.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c4a39a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2c4415a620 0x7f2c440b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:09.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c4a39a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c4415d580 0x7f2c44152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:09.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c4a39a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440cf980 con 0x7f2c44157870 2023-10-09T06:30:09.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c4a39a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44151230 con 0x7f2c4415a620 2023-10-09T06:30:09.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c4a39a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44151510 con 0x7f2c4415d580 2023-10-09T06:30:09.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c43fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c44157870 0x7f2c440b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:09.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c43fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c44157870 0x7f2c440b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50986/0 (socket says 172.21.15.31:50986) 2023-10-09T06:30:09.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c43fff700 1 -- 172.21.15.31:0/413325323 learned_addr learned my addr 172.21.15.31:0/413325323 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:09.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c43fff700 1 -- 172.21.15.31:0/413325323 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c4415d580 msgr2=0x7f2c44152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:09.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c43fff700 1 --2- 172.21.15.31:0/413325323 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c4415d580 0x7f2c44152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:09.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c43fff700 1 -- 172.21.15.31:0/413325323 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2c4415a620 msgr2=0x7f2c440b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:09.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c43fff700 1 --2- 172.21.15.31:0/413325323 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2c4415a620 0x7f2c440b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:09.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.864+0000 7f2c43fff700 1 -- 172.21.15.31:0/413325323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c38009420 con 0x7f2c44157870 2023-10-09T06:30:09.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.865+0000 7f2c43fff700 1 --2- 172.21.15.31:0/413325323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c44157870 0x7f2c440b31b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400c790 tx=0x7f2c34007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:09.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.865+0000 7f2c2bfff700 1 -- 172.21.15.31:0/413325323 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34010510 con 0x7f2c44157870 2023-10-09T06:30:09.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.865+0000 7f2c2bfff700 1 -- 172.21.15.31:0/413325323 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c34010670 con 0x7f2c44157870 2023-10-09T06:30:09.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.865+0000 7f2c2bfff700 1 -- 172.21.15.31:0/413325323 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34010a10 con 0x7f2c44157870 2023-10-09T06:30:09.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.865+0000 7f2c4a39a700 1 -- 172.21.15.31:0/413325323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c440cf610 con 0x7f2c44157870 2023-10-09T06:30:09.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.865+0000 7f2c4a39a700 1 -- 172.21.15.31:0/413325323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c44153920 con 0x7f2c44157870 2023-10-09T06:30:09.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.866+0000 7f2c4a39a700 1 -- 172.21.15.31:0/413325323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4404c3c0 con 0x7f2c44157870 2023-10-09T06:30:09.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.866+0000 7f2c2bfff700 1 -- 172.21.15.31:0/413325323 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c3401b400 con 0x7f2c44157870 2023-10-09T06:30:09.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.867+0000 7f2c2bfff700 1 --2- 172.21.15.31:0/413325323 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2c30066f60 0x7f2c30069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:09.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.867+0000 7f2c2bfff700 1 -- 172.21.15.31:0/413325323 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f2c340843d0 con 0x7f2c44157870 2023-10-09T06:30:09.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.867+0000 7f2c2bfff700 1 -- 172.21.15.31:0/413325323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f2c3006eb40 con 0x7f2c44157870 2023-10-09T06:30:09.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.867+0000 7f2c437fe700 1 --2- 172.21.15.31:0/413325323 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2c30066f60 0x7f2c30069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:09.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.867+0000 7f2c437fe700 1 --2- 172.21.15.31:0/413325323 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2c30066f60 0x7f2c30069410 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2c4415aa20 tx=0x7f2c38016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:09.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:09.871+0000 7f2c2bfff700 1 -- 172.21.15.31:0/413325323 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c34054ff0 con 0x7f2c44157870 2023-10-09T06:30:10.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.074+0000 7f2c4a39a700 1 -- 172.21.15.31:0/413325323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c4415c560 con 0x7f2c44157870 2023-10-09T06:30:10.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.075+0000 7f2c2bfff700 1 -- 172.21.15.31:0/413325323 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+15488 (secure 0 0 0) 0x7f2c34054b80 con 0x7f2c44157870 2023-10-09T06:30:10.075 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:10.075 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":156,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:29:31.773183+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:27:51.726909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T06:27:52.302903+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.9","mappings":[{"from":2,"to":0}]},{"pgid":"19.12","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:30:10.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.077+0000 7f2c4a39a700 1 -- 172.21.15.31:0/413325323 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2c30066f60 msgr2=0x7f2c30069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.077+0000 7f2c4a39a700 1 --2- 172.21.15.31:0/413325323 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2c30066f60 0x7f2c30069410 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2c4415aa20 tx=0x7f2c38016000 comp rx=0 tx=0).stop 2023-10-09T06:30:10.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.077+0000 7f2c4a39a700 1 -- 172.21.15.31:0/413325323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c44157870 msgr2=0x7f2c440b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.077+0000 7f2c4a39a700 1 --2- 172.21.15.31:0/413325323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c44157870 0x7f2c440b31b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400c790 tx=0x7f2c34007e10 comp rx=0 tx=0).stop 2023-10-09T06:30:10.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.077+0000 7f2c4a39a700 1 -- 172.21.15.31:0/413325323 shutdown_connections 2023-10-09T06:30:10.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.077+0000 7f2c4a39a700 1 --2- 172.21.15.31:0/413325323 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2c30066f60 0x7f2c30069410 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.077+0000 7f2c4a39a700 1 --2- 172.21.15.31:0/413325323 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c4415d580 0x7f2c44152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.077+0000 7f2c4a39a700 1 --2- 172.21.15.31:0/413325323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c44157870 0x7f2c440b31b0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.077+0000 7f2c4a39a700 1 --2- 172.21.15.31:0/413325323 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2c4415a620 0x7f2c440b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.077+0000 7f2c4a39a700 1 -- 172.21.15.31:0/413325323 >> 172.21.15.31:0/413325323 conn(0x7f2c44068ce0 msgr2=0x7f2c4415e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:10.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.077+0000 7f2c4a39a700 1 -- 172.21.15.31:0/413325323 shutdown_connections 2023-10-09T06:30:10.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.077+0000 7f2c4a39a700 1 -- 172.21.15.31:0/413325323 wait complete. 2023-10-09T06:30:10.089 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:27:51.726909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '151', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:27:52.302903+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:30:10.090 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:30:10.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.212+0000 7f79ac94d700 1 Processor -- start 2023-10-09T06:30:10.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.212+0000 7f79ac94d700 1 -- start start 2023-10-09T06:30:10.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79ac94d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f79a80b4860 0x7f79a80b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79ac94d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79a80b4c30 0x7f79a8159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79ac94d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a80b14f0 con 0x7f79a8159fd0 2023-10-09T06:30:10.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79ac94d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a80b17d0 con 0x7f79a80b4860 2023-10-09T06:30:10.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79ac94d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80b1ab0 con 0x7f79a80b4c30 2023-10-09T06:30:10.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79a659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f79a80b4860 0x7f79a80b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79a659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f79a80b4860 0x7f79a80b6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50990/0 (socket says 172.21.15.31:50990) 2023-10-09T06:30:10.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79a659c700 1 -- 172.21.15.31:0/3278993046 learned_addr learned my addr 172.21.15.31:0/3278993046 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:10.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79a5d9b700 1 --2- 172.21.15.31:0/3278993046 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79a80b4c30 0x7f79a8159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79a659c700 1 -- 172.21.15.31:0/3278993046 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79a80b4c30 msgr2=0x7f79a8159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:10.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79a659c700 1 --2- 172.21.15.31:0/3278993046 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79a80b4c30 0x7f79a8159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79a659c700 1 -- 172.21.15.31:0/3278993046 >> v1:172.21.15.158:6789/0 conn(0x7f79a8159fd0 legacy=0x7f79a80cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79a659c700 1 -- 172.21.15.31:0/3278993046 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80b1d90 con 0x7f79a80b4860 2023-10-09T06:30:10.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.213+0000 7f79a5d9b700 1 --2- 172.21.15.31:0/3278993046 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79a80b4c30 0x7f79a8159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:10.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.214+0000 7f79a659c700 1 --2- 172.21.15.31:0/3278993046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a80b4860 0x7f79a80b6700 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f7998009990 tx=0x7f7998009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8cd8beffa22a29 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:10.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.214+0000 7f79a559a700 1 -- 172.21.15.31:0/3278993046 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998005c10 con 0x7f79a80b4860 2023-10-09T06:30:10.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.214+0000 7f79a559a700 1 -- 172.21.15.31:0/3278993046 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7998005d70 con 0x7f79a80b4860 2023-10-09T06:30:10.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.214+0000 7f79a559a700 1 -- 172.21.15.31:0/3278993046 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800b910 con 0x7f79a80b4860 2023-10-09T06:30:10.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.214+0000 7f79ac94d700 1 -- 172.21.15.31:0/3278993046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a80b4860 msgr2=0x7f79a80b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.214+0000 7f79ac94d700 1 --2- 172.21.15.31:0/3278993046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a80b4860 0x7f79a80b6700 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f7998009990 tx=0x7f7998009220 comp rx=0 tx=0).stop 2023-10-09T06:30:10.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.214+0000 7f79ac94d700 1 -- 172.21.15.31:0/3278993046 shutdown_connections 2023-10-09T06:30:10.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.214+0000 7f79ac94d700 1 --2- 172.21.15.31:0/3278993046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a80b4860 0x7f79a80b6700 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.214+0000 7f79ac94d700 1 --2- 172.21.15.31:0/3278993046 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79a80b4c30 0x7f79a8159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.214+0000 7f79ac94d700 1 -- 172.21.15.31:0/3278993046 >> 172.21.15.31:0/3278993046 conn(0x7f79a809a0f0 msgr2=0x7f79a8067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:10.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.214+0000 7f79ac94d700 1 -- 172.21.15.31:0/3278993046 shutdown_connections 2023-10-09T06:30:10.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.214+0000 7f79ac94d700 1 -- 172.21.15.31:0/3278993046 wait complete. 2023-10-09T06:30:10.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.215+0000 7f79ac94d700 1 Processor -- start 2023-10-09T06:30:10.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.216+0000 7f79ac94d700 1 -- start start 2023-10-09T06:30:10.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.216+0000 7f79ac94d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79a80b4860 0x7f79a816d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.216+0000 7f79ac94d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a80b4c30 0x7f79a816d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.216+0000 7f79ac94d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79a8159fd0 0x7f79a814b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.216+0000 7f79ac94d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a8149010 con 0x7f79a80b4c30 2023-10-09T06:30:10.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.216+0000 7f79ac94d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a816afd0 con 0x7f79a8159fd0 2023-10-09T06:30:10.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.216+0000 7f79ac94d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a816b2b0 con 0x7f79a80b4860 2023-10-09T06:30:10.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.216+0000 7f79a5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a80b4c30 0x7f79a816d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.216+0000 7f79a5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a80b4c30 0x7f79a816d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50996/0 (socket says 172.21.15.31:50996) 2023-10-09T06:30:10.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.216+0000 7f79a5d9b700 1 -- 172.21.15.31:0/1570427831 learned_addr learned my addr 172.21.15.31:0/1570427831 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:10.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.216+0000 7f79a659c700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79a80b4860 0x7f79a816d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.216+0000 7f79a6d9d700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79a8159fd0 0x7f79a814b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.217+0000 7f79a5d9b700 1 -- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79a80b4860 msgr2=0x7f79a816d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.217+0000 7f79a5d9b700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79a80b4860 0x7f79a816d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.217+0000 7f79a5d9b700 1 -- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79a8159fd0 msgr2=0x7f79a814b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.217+0000 7f79a5d9b700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79a8159fd0 0x7f79a814b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.217+0000 7f79a5d9b700 1 -- 172.21.15.31:0/1570427831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7998009480 con 0x7f79a80b4c30 2023-10-09T06:30:10.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.217+0000 7f79a5d9b700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a80b4c30 0x7f79a816d940 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f799c00e8d0 tx=0x7f799c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:10.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.217+0000 7f79967fc700 1 -- 172.21.15.31:0/1570427831 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c013410 con 0x7f79a80b4c30 2023-10-09T06:30:10.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.217+0000 7f79967fc700 1 -- 172.21.15.31:0/1570427831 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c013570 con 0x7f79a80b4c30 2023-10-09T06:30:10.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.217+0000 7f79ac94d700 1 -- 172.21.15.31:0/1570427831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a816b590 con 0x7f79a80b4c30 2023-10-09T06:30:10.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.217+0000 7f79967fc700 1 -- 172.21.15.31:0/1570427831 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c013910 con 0x7f79a80b4c30 2023-10-09T06:30:10.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.217+0000 7f79ac94d700 1 -- 172.21.15.31:0/1570427831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a816bb50 con 0x7f79a80b4c30 2023-10-09T06:30:10.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.218+0000 7f79ac94d700 1 -- 172.21.15.31:0/1570427831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a804c3c0 con 0x7f79a80b4c30 2023-10-09T06:30:10.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.218+0000 7f79967fc700 1 -- 172.21.15.31:0/1570427831 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f799c013d40 con 0x7f79a80b4c30 2023-10-09T06:30:10.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.219+0000 7f79967fc700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7988066f30 0x7f79880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.219+0000 7f79967fc700 1 -- 172.21.15.31:0/1570427831 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f799c084270 con 0x7f79a80b4c30 2023-10-09T06:30:10.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.219+0000 7f79967fc700 1 -- 172.21.15.31:0/1570427831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f798806eb10 con 0x7f79a80b4c30 2023-10-09T06:30:10.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.219+0000 7f79a659c700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7988066f30 0x7f79880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.220+0000 7f79a659c700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7988066f30 0x7f79880693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7998009260 tx=0x7f7998016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:10.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.223+0000 7f79967fc700 1 -- 172.21.15.31:0/1570427831 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f799c0514a0 con 0x7f79a80b4c30 2023-10-09T06:30:10.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.414+0000 7f79ac94d700 1 -- 172.21.15.31:0/1570427831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79a80b2070 con 0x7f79a80b4c30 2023-10-09T06:30:10.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.415+0000 7f79967fc700 1 -- 172.21.15.31:0/1570427831 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v156) v1 ==== 93+0+10 (secure 0 0 0) 0x7f799c020020 con 0x7f79a80b4c30 2023-10-09T06:30:10.415 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:30:10.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.417+0000 7f79ac94d700 1 -- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7988066f30 msgr2=0x7f79880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.417+0000 7f79ac94d700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7988066f30 0x7f79880693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7998009260 tx=0x7f7998016000 comp rx=0 tx=0).stop 2023-10-09T06:30:10.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.417+0000 7f79ac94d700 1 -- 172.21.15.31:0/1570427831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a80b4c30 msgr2=0x7f79a816d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.417+0000 7f79ac94d700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a80b4c30 0x7f79a816d940 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f799c00e8d0 tx=0x7f799c008040 comp rx=0 tx=0).stop 2023-10-09T06:30:10.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.417+0000 7f79ac94d700 1 -- 172.21.15.31:0/1570427831 shutdown_connections 2023-10-09T06:30:10.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.417+0000 7f79ac94d700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7988066f30 0x7f79880693e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.417+0000 7f79ac94d700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f79a80b4860 0x7f79a816d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.417+0000 7f79ac94d700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79a8159fd0 0x7f79a814b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.417+0000 7f79ac94d700 1 --2- 172.21.15.31:0/1570427831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a80b4c30 0x7f79a816d940 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.417+0000 7f79ac94d700 1 -- 172.21.15.31:0/1570427831 >> 172.21.15.31:0/1570427831 conn(0x7f79a809a0f0 msgr2=0x7f79a815c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:10.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.417+0000 7f79ac94d700 1 -- 172.21.15.31:0/1570427831 shutdown_connections 2023-10-09T06:30:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.417+0000 7f79ac94d700 1 -- 172.21.15.31:0/1570427831 wait complete. 2023-10-09T06:30:10.428 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:30:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.551+0000 7f3104d07700 1 Processor -- start 2023-10-09T06:30:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.551+0000 7f3104d07700 1 -- start start 2023-10-09T06:30:10.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.551+0000 7f3104d07700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31000697c0 0x7f310015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f3104d07700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310015ea90 con 0x7f3100159e60 2023-10-09T06:30:10.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f3104d07700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31000b3100 con 0x7f310015a230 2023-10-09T06:30:10.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f3104d07700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31000d1cf0 con 0x7f31000697c0 2023-10-09T06:30:10.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fe59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3100159e60 0x7f31000690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46306/0 (socket says 172.21.15.31:46306) 2023-10-09T06:30:10.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fe59c700 1 -- 172.21.15.31:0/3597352693 learned_addr learned my addr 172.21.15.31:0/3597352693 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:10.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fdd9b700 1 --2- 172.21.15.31:0/3597352693 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31000697c0 0x7f310015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423161343 0 0) 0x7f310015ea90 con 0x7f3100159e60 2023-10-09T06:30:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ec003570 con 0x7f3100159e60 2023-10-09T06:30:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3720505965 0 0) 0x7f30ec003570 con 0x7f3100159e60 2023-10-09T06:30:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31000697c0 msgr2=0x7f310015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 --2- 172.21.15.31:0/3597352693 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31000697c0 0x7f310015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 >> v1:172.21.15.158:6789/0 conn(0x7f310015a230 legacy=0x7f31000af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000d10e0 con 0x7f3100159e60 2023-10-09T06:30:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f30f8001470 con 0x7f3100159e60 2023-10-09T06:30:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 >> v1:172.21.15.31:6789/0 conn(0x7f3100159e60 legacy=0x7f31000690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 --2- 172.21.15.31:0/3597352693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30ec003a90 0x7f30ec003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 --2- 172.21.15.31:0/3597352693 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31000697c0 0x7f30ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 --2- 172.21.15.31:0/3597352693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30ec004d50 0x7f30ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31000d1cf0 con 0x7f30ec004d50 2023-10-09T06:30:10.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec00bb10 con 0x7f30ec003a90 2023-10-09T06:30:10.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.552+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec00bcd0 con 0x7f31000697c0 2023-10-09T06:30:10.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.553+0000 7f30fed9d700 1 --2- 172.21.15.31:0/3597352693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30ec004d50 0x7f30ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.553+0000 7f30fdd9b700 1 --2- 172.21.15.31:0/3597352693 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31000697c0 0x7f30ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.553+0000 7f30fe59c700 1 --2- 172.21.15.31:0/3597352693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30ec003a90 0x7f30ec003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.553+0000 7f30fed9d700 1 -- 172.21.15.31:0/3597352693 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31000697c0 msgr2=0x7f30ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:10.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.553+0000 7f30fed9d700 1 --2- 172.21.15.31:0/3597352693 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31000697c0 0x7f30ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.553+0000 7f30fed9d700 1 -- 172.21.15.31:0/3597352693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30ec003a90 msgr2=0x7f30ec003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:10.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.553+0000 7f30fed9d700 1 --2- 172.21.15.31:0/3597352693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30ec003a90 0x7f30ec003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.553+0000 7f30fed9d700 1 -- 172.21.15.31:0/3597352693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec003570 con 0x7f30ec004d50 2023-10-09T06:30:10.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.553+0000 7f30fed9d700 1 --2- 172.21.15.31:0/3597352693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30ec004d50 0x7f30ec0051c0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f30f00020a0 tx=0x7f30f00016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f3c406ddca0123 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:10.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.553+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f00019e0 con 0x7f30ec004d50 2023-10-09T06:30:10.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.553+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f000c8b0 con 0x7f30ec004d50 2023-10-09T06:30:10.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.553+0000 7f30fd59a700 1 -- 172.21.15.31:0/3597352693 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000cc50 con 0x7f30ec004d50 2023-10-09T06:30:10.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.554+0000 7f3104d07700 1 -- 172.21.15.31:0/3597352693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30ec004d50 msgr2=0x7f30ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.554+0000 7f3104d07700 1 --2- 172.21.15.31:0/3597352693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30ec004d50 0x7f30ec0051c0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f30f00020a0 tx=0x7f30f00016d0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.554+0000 7f30fed9d700 1 -- 172.21.15.31:0/3597352693 reap_dead start 2023-10-09T06:30:10.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.554+0000 7f3104d07700 1 -- 172.21.15.31:0/3597352693 shutdown_connections 2023-10-09T06:30:10.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.554+0000 7f3104d07700 1 -- 172.21.15.31:0/3597352693 >> 172.21.15.31:0/3597352693 conn(0x7f3100070700 msgr2=0x7f3100070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:10.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.554+0000 7f3104d07700 1 -- 172.21.15.31:0/3597352693 shutdown_connections 2023-10-09T06:30:10.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.554+0000 7f3104d07700 1 -- 172.21.15.31:0/3597352693 wait complete. 2023-10-09T06:30:10.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.555+0000 7f3104d07700 1 Processor -- start 2023-10-09T06:30:10.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.555+0000 7f3104d07700 1 -- start start 2023-10-09T06:30:10.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f3104d07700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30ec004d50 0x7f31000c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f3104d07700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31001595e0 0x7f310016b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f3104d07700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31000c4bc0 0x7f31000c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f3104d07700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31000c6620 con 0x7f31001595e0 2023-10-09T06:30:10.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f3104d07700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31000c97d0 con 0x7f30ec004d50 2023-10-09T06:30:10.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f3104d07700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31000c63a0 con 0x7f31000c4bc0 2023-10-09T06:30:10.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f30fdd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31001595e0 0x7f310016b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f30fdd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31001595e0 0x7f310016b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51000/0 (socket says 172.21.15.31:51000) 2023-10-09T06:30:10.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f30fdd9b700 1 -- 172.21.15.31:0/664336133 learned_addr learned my addr 172.21.15.31:0/664336133 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:10.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f30fe59c700 1 --2- 172.21.15.31:0/664336133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30ec004d50 0x7f31000c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f30fdd9b700 1 -- 172.21.15.31:0/664336133 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31000c4bc0 msgr2=0x7f31000c7030 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T06:30:10.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f30fdd9b700 1 --2- 172.21.15.31:0/664336133 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31000c4bc0 0x7f31000c7030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f30fdd9b700 1 -- 172.21.15.31:0/664336133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30ec004d50 msgr2=0x7f31000c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f30fdd9b700 1 --2- 172.21.15.31:0/664336133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30ec004d50 0x7f31000c5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f30fdd9b700 1 -- 172.21.15.31:0/664336133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000c8ea0 con 0x7f31001595e0 2023-10-09T06:30:10.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f30fdd9b700 1 --2- 172.21.15.31:0/664336133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31001595e0 0x7f310016b460 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f30e8011b40 tx=0x7f30e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:10.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f30f67fc700 1 -- 172.21.15.31:0/664336133 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800fa10 con 0x7f31001595e0 2023-10-09T06:30:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f30f67fc700 1 -- 172.21.15.31:0/664336133 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e800fb70 con 0x7f31001595e0 2023-10-09T06:30:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f3104d07700 1 -- 172.21.15.31:0/664336133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31000c9180 con 0x7f31001595e0 2023-10-09T06:30:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.556+0000 7f30f67fc700 1 -- 172.21.15.31:0/664336133 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8014440 con 0x7f31001595e0 2023-10-09T06:30:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.557+0000 7f3104d07700 1 -- 172.21.15.31:0/664336133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310016b9a0 con 0x7f31001595e0 2023-10-09T06:30:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.557+0000 7f3104d07700 1 -- 172.21.15.31:0/664336133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31000c9620 con 0x7f31001595e0 2023-10-09T06:30:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.558+0000 7f30f67fc700 1 -- 172.21.15.31:0/664336133 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30e8014870 con 0x7f31001595e0 2023-10-09T06:30:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.558+0000 7f30f67fc700 1 --2- 172.21.15.31:0/664336133 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f30e0066f30 0x7f30e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.558+0000 7f30f67fc700 1 -- 172.21.15.31:0/664336133 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f30e8018030 con 0x7f31001595e0 2023-10-09T06:30:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.559+0000 7f30f67fc700 1 -- 172.21.15.31:0/664336133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f30e006eb10 con 0x7f31001595e0 2023-10-09T06:30:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.559+0000 7f30fe59c700 1 --2- 172.21.15.31:0/664336133 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f30e0066f30 0x7f30e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.559+0000 7f30fe59c700 1 --2- 172.21.15.31:0/664336133 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f30e0066f30 0x7f30e00693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f30f8007f30 tx=0x7f30f8001e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:10.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.563+0000 7f30f67fc700 1 -- 172.21.15.31:0/664336133 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30e8022060 con 0x7f31001595e0 2023-10-09T06:30:10.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.756+0000 7f3104d07700 1 -- 172.21.15.31:0/664336133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f310004c3c0 con 0x7f31001595e0 2023-10-09T06:30:10.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.757+0000 7f30f67fc700 1 -- 172.21.15.31:0/664336133 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v156) v1 ==== 104+0+11 (secure 0 0 0) 0x7f30e80521f0 con 0x7f31001595e0 2023-10-09T06:30:10.756 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:30:10.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.758+0000 7f3104d07700 1 -- 172.21.15.31:0/664336133 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f30e0066f30 msgr2=0x7f30e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.758+0000 7f3104d07700 1 --2- 172.21.15.31:0/664336133 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f30e0066f30 0x7f30e00693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f30f8007f30 tx=0x7f30f8001e70 comp rx=0 tx=0).stop 2023-10-09T06:30:10.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.758+0000 7f3104d07700 1 -- 172.21.15.31:0/664336133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31001595e0 msgr2=0x7f310016b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.758+0000 7f3104d07700 1 --2- 172.21.15.31:0/664336133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31001595e0 0x7f310016b460 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f30e8011b40 tx=0x7f30e80091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.759+0000 7f3104d07700 1 -- 172.21.15.31:0/664336133 shutdown_connections 2023-10-09T06:30:10.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.759+0000 7f3104d07700 1 --2- 172.21.15.31:0/664336133 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f30e0066f30 0x7f30e00693e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.759+0000 7f3104d07700 1 --2- 172.21.15.31:0/664336133 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31000c4bc0 0x7f31000c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.759+0000 7f3104d07700 1 --2- 172.21.15.31:0/664336133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30ec004d50 0x7f31000c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.759+0000 7f3104d07700 1 --2- 172.21.15.31:0/664336133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31001595e0 0x7f310016b460 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.759+0000 7f3104d07700 1 -- 172.21.15.31:0/664336133 >> 172.21.15.31:0/664336133 conn(0x7f3100070700 msgr2=0x7f31000b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:10.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.759+0000 7f3104d07700 1 -- 172.21.15.31:0/664336133 shutdown_connections 2023-10-09T06:30:10.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.759+0000 7f3104d07700 1 -- 172.21.15.31:0/664336133 wait complete. 2023-10-09T06:30:10.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:30:10.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.893+0000 7f9f43fff700 1 Processor -- start 2023-10-09T06:30:10.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.893+0000 7f9f43fff700 1 -- start start 2023-10-09T06:30:10.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f43fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f4415cec0 0x7f9f440cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f43fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f4415ade0 0x7f9f440cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f43fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f440cc760 con 0x7f9f4415a300 2023-10-09T06:30:10.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f43fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4415b460 con 0x7f9f4415cec0 2023-10-09T06:30:10.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f43fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4415ba20 con 0x7f9f4415ade0 2023-10-09T06:30:10.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f427fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f4415cec0 0x7f9f440cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f42ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9f4415a300 0x7f9f4415a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46308/0 (socket says 172.21.15.31:46308) 2023-10-09T06:30:10.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f427fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f4415cec0 0x7f9f440cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51008/0 (socket says 172.21.15.31:51008) 2023-10-09T06:30:10.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f42ffd700 1 -- 172.21.15.31:0/564961015 learned_addr learned my addr 172.21.15.31:0/564961015 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:10.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f437fe700 1 --2- 172.21.15.31:0/564961015 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f4415ade0 0x7f9f440cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f427fc700 1 -- 172.21.15.31:0/564961015 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f4415ade0 msgr2=0x7f9f440cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:10.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f427fc700 1 --2- 172.21.15.31:0/564961015 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f4415ade0 0x7f9f440cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f427fc700 1 -- 172.21.15.31:0/564961015 >> v1:172.21.15.31:6789/0 conn(0x7f9f4415a300 legacy=0x7f9f4415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f41ffb700 1 -- 172.21.15.31:0/564961015 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230024169 0 0) 0x7f9f440cc760 con 0x7f9f4415a300 2023-10-09T06:30:10.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f427fc700 1 -- 172.21.15.31:0/564961015 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f440cc1a0 con 0x7f9f4415cec0 2023-10-09T06:30:10.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.894+0000 7f9f437fe700 1 --2- 172.21.15.31:0/564961015 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f4415ade0 0x7f9f440cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:10.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.895+0000 7f9f427fc700 1 --2- 172.21.15.31:0/564961015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4415cec0 0x7f9f440cb430 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0098e0 tx=0x7f9f2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf0469907961821 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:10.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.895+0000 7f9f41ffb700 1 -- 172.21.15.31:0/564961015 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c009e80 con 0x7f9f4415cec0 2023-10-09T06:30:10.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.895+0000 7f9f41ffb700 1 -- 172.21.15.31:0/564961015 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c00b860 con 0x7f9f4415cec0 2023-10-09T06:30:10.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.895+0000 7f9f41ffb700 1 -- 172.21.15.31:0/564961015 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c00bbe0 con 0x7f9f4415cec0 2023-10-09T06:30:10.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.895+0000 7f9f43fff700 1 -- 172.21.15.31:0/564961015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4415cec0 msgr2=0x7f9f440cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.895+0000 7f9f43fff700 1 --2- 172.21.15.31:0/564961015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4415cec0 0x7f9f440cb430 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0098e0 tx=0x7f9f2c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.895+0000 7f9f43fff700 1 -- 172.21.15.31:0/564961015 shutdown_connections 2023-10-09T06:30:10.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.895+0000 7f9f43fff700 1 --2- 172.21.15.31:0/564961015 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f4415ade0 0x7f9f440cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.895+0000 7f9f43fff700 1 --2- 172.21.15.31:0/564961015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4415cec0 0x7f9f440cb430 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.895+0000 7f9f43fff700 1 -- 172.21.15.31:0/564961015 >> 172.21.15.31:0/564961015 conn(0x7f9f44099f50 msgr2=0x7f9f44067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:10.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.895+0000 7f9f43fff700 1 -- 172.21.15.31:0/564961015 shutdown_connections 2023-10-09T06:30:10.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.895+0000 7f9f43fff700 1 -- 172.21.15.31:0/564961015 wait complete. 2023-10-09T06:30:10.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.896+0000 7f9f43fff700 1 Processor -- start 2023-10-09T06:30:10.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.897+0000 7f9f43fff700 1 -- start start 2023-10-09T06:30:10.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.897+0000 7f9f43fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f4415a300 0x7f9f440c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.897+0000 7f9f43fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f4415ade0 0x7f9f440c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.897+0000 7f9f43fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4415cec0 0x7f9f440c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.897+0000 7f9f43fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440c78c0 con 0x7f9f4415cec0 2023-10-09T06:30:10.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.897+0000 7f9f43fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440b56f0 con 0x7f9f4415a300 2023-10-09T06:30:10.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.897+0000 7f9f43fff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440b59d0 con 0x7f9f4415ade0 2023-10-09T06:30:10.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.897+0000 7f9f437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4415cec0 0x7f9f440c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.897+0000 7f9f437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4415cec0 0x7f9f440c4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51010/0 (socket says 172.21.15.31:51010) 2023-10-09T06:30:10.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.897+0000 7f9f437fe700 1 -- 172.21.15.31:0/2075027774 learned_addr learned my addr 172.21.15.31:0/2075027774 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f427fc700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f4415ade0 0x7f9f440c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f42ffd700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f4415a300 0x7f9f440c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f437fe700 1 -- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f4415ade0 msgr2=0x7f9f440c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f437fe700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f4415ade0 0x7f9f440c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f437fe700 1 -- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f4415a300 msgr2=0x7f9f440c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f437fe700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f4415a300 0x7f9f440c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f437fe700 1 -- 172.21.15.31:0/2075027774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c009420 con 0x7f9f4415cec0 2023-10-09T06:30:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f427fc700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f4415ade0 0x7f9f440c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:10.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f437fe700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4415cec0 0x7f9f440c4be0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400c880 tx=0x7f9f34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:10.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f3affd700 1 -- 172.21.15.31:0/2075027774 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34011600 con 0x7f9f4415cec0 2023-10-09T06:30:10.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f3affd700 1 -- 172.21.15.31:0/2075027774 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f34011760 con 0x7f9f4415cec0 2023-10-09T06:30:10.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f43fff700 1 -- 172.21.15.31:0/2075027774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f440b5cb0 con 0x7f9f4415cec0 2023-10-09T06:30:10.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f3affd700 1 -- 172.21.15.31:0/2075027774 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34011b20 con 0x7f9f4415cec0 2023-10-09T06:30:10.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.898+0000 7f9f43fff700 1 -- 172.21.15.31:0/2075027774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f440b6270 con 0x7f9f4415cec0 2023-10-09T06:30:10.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.899+0000 7f9f43fff700 1 -- 172.21.15.31:0/2075027774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f440c8500 con 0x7f9f4415cec0 2023-10-09T06:30:10.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.899+0000 7f9f3affd700 1 -- 172.21.15.31:0/2075027774 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f340193b0 con 0x7f9f4415cec0 2023-10-09T06:30:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.900+0000 7f9f3affd700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f24066f30 0x7f9f240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.900+0000 7f9f3affd700 1 -- 172.21.15.31:0/2075027774 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f9f340845f0 con 0x7f9f4415cec0 2023-10-09T06:30:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.900+0000 7f9f3affd700 1 -- 172.21.15.31:0/2075027774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f9f2406eb10 con 0x7f9f4415cec0 2023-10-09T06:30:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.900+0000 7f9f42ffd700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f24066f30 0x7f9f240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.901+0000 7f9f42ffd700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f24066f30 0x7f9f240693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c002ef0 tx=0x7f9f3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:10.904+0000 7f9f3affd700 1 -- 172.21.15.31:0/2075027774 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f440c8500 con 0x7f9f4415cec0 2023-10-09T06:30:11.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.097+0000 7f9f43fff700 1 -- 172.21.15.31:0/2075027774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f440c8500 con 0x7f9f4415cec0 2023-10-09T06:30:11.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.097+0000 7f9f3affd700 1 -- 172.21.15.31:0/2075027774 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v156) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9f3401f020 con 0x7f9f4415cec0 2023-10-09T06:30:11.097 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:30:11.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.099+0000 7f9f43fff700 1 -- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f24066f30 msgr2=0x7f9f240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.099+0000 7f9f43fff700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f24066f30 0x7f9f240693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c002ef0 tx=0x7f9f3c009040 comp rx=0 tx=0).stop 2023-10-09T06:30:11.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.099+0000 7f9f43fff700 1 -- 172.21.15.31:0/2075027774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4415cec0 msgr2=0x7f9f440c4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.099+0000 7f9f43fff700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4415cec0 0x7f9f440c4be0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400c880 tx=0x7f9f34008040 comp rx=0 tx=0).stop 2023-10-09T06:30:11.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.099+0000 7f9f43fff700 1 -- 172.21.15.31:0/2075027774 shutdown_connections 2023-10-09T06:30:11.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.099+0000 7f9f43fff700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9f24066f30 0x7f9f240693e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.099+0000 7f9f43fff700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4415cec0 0x7f9f440c4be0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.099+0000 7f9f43fff700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f4415a300 0x7f9f440c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.099+0000 7f9f43fff700 1 --2- 172.21.15.31:0/2075027774 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9f4415ade0 0x7f9f440c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.099+0000 7f9f43fff700 1 -- 172.21.15.31:0/2075027774 >> 172.21.15.31:0/2075027774 conn(0x7f9f44099f50 msgr2=0x7f9f4406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:11.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.099+0000 7f9f43fff700 1 -- 172.21.15.31:0/2075027774 shutdown_connections 2023-10-09T06:30:11.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.099+0000 7f9f43fff700 1 -- 172.21.15.31:0/2075027774 wait complete. 2023-10-09T06:30:11.111 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:30:11.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.232+0000 7f23a614e700 1 Processor -- start 2023-10-09T06:30:11.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.232+0000 7f23a614e700 1 -- start start 2023-10-09T06:30:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.232+0000 7f23a614e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23a00d1c30 0x7f23a00ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f23a614e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23a015a680 0x7f23a00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f23a614e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a00c5d80 con 0x7f23a015a2b0 2023-10-09T06:30:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f23a614e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a0068470 con 0x7f23a015a680 2023-10-09T06:30:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f23a614e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00c6060 con 0x7f23a00d1c30 2023-10-09T06:30:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f239ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23a015a680 0x7f23a00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f239f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f23a015a2b0 0x7f23a00b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46312/0 (socket says 172.21.15.31:46312) 2023-10-09T06:30:11.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f239f7fe700 1 -- 172.21.15.31:0/1885739902 learned_addr learned my addr 172.21.15.31:0/1885739902 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:11.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f239effd700 1 --2- 172.21.15.31:0/1885739902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23a00d1c30 0x7f23a00ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f239ffff700 1 -- 172.21.15.31:0/1885739902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23a00d1c30 msgr2=0x7f23a00ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:11.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f239ffff700 1 --2- 172.21.15.31:0/1885739902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23a00d1c30 0x7f23a00ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f239ffff700 1 -- 172.21.15.31:0/1885739902 >> v1:172.21.15.31:6789/0 conn(0x7f23a015a2b0 legacy=0x7f23a00b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f239e7fc700 1 -- 172.21.15.31:0/1885739902 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616269625 0 0) 0x7f23a00c5d80 con 0x7f23a015a2b0 2023-10-09T06:30:11.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f239ffff700 1 -- 172.21.15.31:0/1885739902 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a00c6340 con 0x7f23a015a680 2023-10-09T06:30:11.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f239ffff700 1 --2- 172.21.15.31:0/1885739902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a015a680 0x7f23a00cf710 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f23980098e0 tx=0x7f23980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d5f11f583b2487 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:11.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f239e7fc700 1 -- 172.21.15.31:0/1885739902 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239800b640 con 0x7f23a015a680 2023-10-09T06:30:11.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f239e7fc700 1 -- 172.21.15.31:0/1885739902 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239800b7a0 con 0x7f23a015a680 2023-10-09T06:30:11.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.233+0000 7f239e7fc700 1 -- 172.21.15.31:0/1885739902 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239800bb40 con 0x7f23a015a680 2023-10-09T06:30:11.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.234+0000 7f23a614e700 1 -- 172.21.15.31:0/1885739902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a015a680 msgr2=0x7f23a00cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.234+0000 7f23a614e700 1 --2- 172.21.15.31:0/1885739902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a015a680 0x7f23a00cf710 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f23980098e0 tx=0x7f23980091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.234+0000 7f23a614e700 1 -- 172.21.15.31:0/1885739902 shutdown_connections 2023-10-09T06:30:11.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.234+0000 7f23a614e700 1 --2- 172.21.15.31:0/1885739902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a015a680 0x7f23a00cf710 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.234+0000 7f23a614e700 1 --2- 172.21.15.31:0/1885739902 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23a00d1c30 0x7f23a00ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.234+0000 7f23a614e700 1 -- 172.21.15.31:0/1885739902 >> 172.21.15.31:0/1885739902 conn(0x7f23a0067e40 msgr2=0x7f23a00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:11.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.234+0000 7f23a614e700 1 -- 172.21.15.31:0/1885739902 shutdown_connections 2023-10-09T06:30:11.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.234+0000 7f23a614e700 1 -- 172.21.15.31:0/1885739902 wait complete. 2023-10-09T06:30:11.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.235+0000 7f23a614e700 1 Processor -- start 2023-10-09T06:30:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.235+0000 7f23a614e700 1 -- start start 2023-10-09T06:30:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f23a614e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23a00d1c30 0x7f23a0157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f23a614e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a015a2b0 0x7f23a015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f23a614e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23a015a680 0x7f23a009c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f23a614e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00c8090 con 0x7f23a015a2b0 2023-10-09T06:30:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f23a614e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a0158140 con 0x7f23a00d1c30 2023-10-09T06:30:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f23a614e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00c82e0 con 0x7f23a015a680 2023-10-09T06:30:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f239effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a015a2b0 0x7f23a015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f239effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a015a2b0 0x7f23a015ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51028/0 (socket says 172.21.15.31:51028) 2023-10-09T06:30:11.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f239effd700 1 -- 172.21.15.31:0/3539624018 learned_addr learned my addr 172.21.15.31:0/3539624018 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f239effd700 1 -- 172.21.15.31:0/3539624018 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23a015a680 msgr2=0x7f23a009c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f239effd700 1 --2- 172.21.15.31:0/3539624018 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23a015a680 0x7f23a009c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f239effd700 1 -- 172.21.15.31:0/3539624018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23a00d1c30 msgr2=0x7f23a0157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f239effd700 1 --2- 172.21.15.31:0/3539624018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23a00d1c30 0x7f23a0157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.236+0000 7f239effd700 1 -- 172.21.15.31:0/3539624018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2398009420 con 0x7f23a015a2b0 2023-10-09T06:30:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.237+0000 7f239effd700 1 --2- 172.21.15.31:0/3539624018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a015a2b0 0x7f23a015ba80 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f238800e900 tx=0x7f23880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.237+0000 7f23977fe700 1 -- 172.21.15.31:0/3539624018 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800eea0 con 0x7f23a015a2b0 2023-10-09T06:30:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.237+0000 7f23977fe700 1 -- 172.21.15.31:0/3539624018 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238800c850 con 0x7f23a015a2b0 2023-10-09T06:30:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.237+0000 7f23a614e700 1 -- 172.21.15.31:0/3539624018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a00c85c0 con 0x7f23a015a2b0 2023-10-09T06:30:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.237+0000 7f23977fe700 1 -- 172.21.15.31:0/3539624018 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800cc10 con 0x7f23a015a2b0 2023-10-09T06:30:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.237+0000 7f23a614e700 1 -- 172.21.15.31:0/3539624018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a00c8b80 con 0x7f23a015a2b0 2023-10-09T06:30:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.238+0000 7f23a614e700 1 -- 172.21.15.31:0/3539624018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a004c3c0 con 0x7f23a015a2b0 2023-10-09T06:30:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.238+0000 7f23977fe700 1 -- 172.21.15.31:0/3539624018 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2388013470 con 0x7f23a015a2b0 2023-10-09T06:30:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.238+0000 7f23977fe700 1 --2- 172.21.15.31:0/3539624018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2380066f30 0x7f23800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.239+0000 7f23977fe700 1 -- 172.21.15.31:0/3539624018 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f23880846e0 con 0x7f23a015a2b0 2023-10-09T06:30:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.239+0000 7f23977fe700 1 -- 172.21.15.31:0/3539624018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f238006eb10 con 0x7f23a015a2b0 2023-10-09T06:30:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.239+0000 7f239f7fe700 1 --2- 172.21.15.31:0/3539624018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2380066f30 0x7f23800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.239+0000 7f239f7fe700 1 --2- 172.21.15.31:0/3539624018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2380066f30 0x7f23800693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2390001cf0 tx=0x7f2390007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.243+0000 7f23977fe700 1 -- 172.21.15.31:0/3539624018 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2388051910 con 0x7f23a015a2b0 2023-10-09T06:30:11.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.483+0000 7f23a614e700 1 -- 172.21.15.31:0/3539624018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23a00b6840 con 0x7f23a015a2b0 2023-10-09T06:30:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.483+0000 7f23977fe700 1 -- 172.21.15.31:0/3539624018 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f2388054f30 con 0x7f23a015a2b0 2023-10-09T06:30:11.483 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:11.483 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/52086276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":52086276},{"type":"v1","addr":"172.21.15.158:6836","nonce":52086276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3440717183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3440717183},{"type":"v1","addr":"172.21.15.31:6834","nonce":3440717183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1719024262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1719024262},{"type":"v1","addr":"172.21.15.31:6835","nonce":1719024262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:53.330823+0000","modified":"2023-10-09T06:27:56.943663+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7419":{"gid":7419,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1416230741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1416230741},{"type":"v1","addr":"172.21.15.158:6837","nonce":1416230741}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T06:30:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.485+0000 7f23a614e700 1 -- 172.21.15.31:0/3539624018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2380066f30 msgr2=0x7f23800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.485+0000 7f23a614e700 1 --2- 172.21.15.31:0/3539624018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2380066f30 0x7f23800693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2390001cf0 tx=0x7f2390007dc0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.485+0000 7f23a614e700 1 -- 172.21.15.31:0/3539624018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a015a2b0 msgr2=0x7f23a015ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.485+0000 7f23a614e700 1 --2- 172.21.15.31:0/3539624018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a015a2b0 0x7f23a015ba80 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f238800e900 tx=0x7f23880091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.485+0000 7f23a614e700 1 -- 172.21.15.31:0/3539624018 shutdown_connections 2023-10-09T06:30:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.485+0000 7f23a614e700 1 --2- 172.21.15.31:0/3539624018 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2380066f30 0x7f23800693e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.485+0000 7f23a614e700 1 --2- 172.21.15.31:0/3539624018 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f23a015a680 0x7f23a009c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.485+0000 7f23a614e700 1 --2- 172.21.15.31:0/3539624018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23a00d1c30 0x7f23a0157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.485+0000 7f23a614e700 1 --2- 172.21.15.31:0/3539624018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a015a2b0 0x7f23a015ba80 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.485+0000 7f23a614e700 1 -- 172.21.15.31:0/3539624018 >> 172.21.15.31:0/3539624018 conn(0x7f23a0067e40 msgr2=0x7f23a00b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.485+0000 7f23a614e700 1 -- 172.21.15.31:0/3539624018 shutdown_connections 2023-10-09T06:30:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.485+0000 7f23a614e700 1 -- 172.21.15.31:0/3539624018 wait complete. 2023-10-09T06:30:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 74 2023-10-09T06:30:11.498 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:30:11.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.618+0000 7f42b16d1700 1 Processor -- start 2023-10-09T06:30:11.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.618+0000 7f42b16d1700 1 -- start start 2023-10-09T06:30:11.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42b16d1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f42ac0c9310 0x7f42ac158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42b16d1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f42ac069f80 0x7f42ac1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42b16d1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f42ac0c96e0 0x7f42ac157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42b16d1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ac158420 con 0x7f42ac0c9310 2023-10-09T06:30:11.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42b16d1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ac1594f0 con 0x7f42ac0c96e0 2023-10-09T06:30:11.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42b16d1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac06be10 con 0x7f42ac069f80 2023-10-09T06:30:11.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42aaffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f42ac0c9310 0x7f42ac158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42aaffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f42ac0c9310 0x7f42ac158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51042/0 (socket says 172.21.15.31:51042) 2023-10-09T06:30:11.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42aaffd700 1 -- 172.21.15.31:0/4054627645 learned_addr learned my addr 172.21.15.31:0/4054627645 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:11.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42ab7fe700 1 --2- 172.21.15.31:0/4054627645 >> v2:172.21.15.158:3300/0 conn(0x7f42ac0c96e0 0x7f42ac157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42aa7fc700 1 --2- 172.21.15.31:0/4054627645 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f42ac069f80 0x7f42ac1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42aaffd700 1 -- 172.21.15.31:0/4054627645 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f42ac069f80 msgr2=0x7f42ac1579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:11.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42aaffd700 1 --2- 172.21.15.31:0/4054627645 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f42ac069f80 0x7f42ac1579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42aaffd700 1 -- 172.21.15.31:0/4054627645 >> v2:172.21.15.158:3300/0 conn(0x7f42ac0c96e0 msgr2=0x7f42ac157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:11.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42aaffd700 1 --2- 172.21.15.31:0/4054627645 >> v2:172.21.15.158:3300/0 conn(0x7f42ac0c96e0 0x7f42ac157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42aaffd700 1 -- 172.21.15.31:0/4054627645 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac06c0f0 con 0x7f42ac0c9310 2023-10-09T06:30:11.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42ab7fe700 1 --2- 172.21.15.31:0/4054627645 >> v2:172.21.15.158:3300/0 conn(0x7f42ac0c96e0 0x7f42ac157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:11.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42aa7fc700 1 --2- 172.21.15.31:0/4054627645 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f42ac069f80 0x7f42ac1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:11.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42aaffd700 1 --2- 172.21.15.31:0/4054627645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42ac0c9310 0x7f42ac158fb0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0c5ac0 tx=0x7f429c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f2eebaa0631788 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:11.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42a9ffb700 1 -- 172.21.15.31:0/4054627645 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c00b860 con 0x7f42ac0c9310 2023-10-09T06:30:11.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42a9ffb700 1 -- 172.21.15.31:0/4054627645 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c00b9c0 con 0x7f42ac0c9310 2023-10-09T06:30:11.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.619+0000 7f42a9ffb700 1 -- 172.21.15.31:0/4054627645 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c00bd60 con 0x7f42ac0c9310 2023-10-09T06:30:11.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.620+0000 7f42b16d1700 1 -- 172.21.15.31:0/4054627645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42ac0c9310 msgr2=0x7f42ac158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.620+0000 7f42b16d1700 1 --2- 172.21.15.31:0/4054627645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42ac0c9310 0x7f42ac158fb0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0c5ac0 tx=0x7f429c009250 comp rx=0 tx=0).stop 2023-10-09T06:30:11.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.620+0000 7f42b16d1700 1 -- 172.21.15.31:0/4054627645 shutdown_connections 2023-10-09T06:30:11.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.620+0000 7f42b16d1700 1 --2- 172.21.15.31:0/4054627645 >> v2:172.21.15.158:3300/0 conn(0x7f42ac0c96e0 0x7f42ac157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.620+0000 7f42b16d1700 1 --2- 172.21.15.31:0/4054627645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42ac0c9310 0x7f42ac158fb0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.620+0000 7f42b16d1700 1 --2- 172.21.15.31:0/4054627645 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f42ac069f80 0x7f42ac1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.620+0000 7f42b16d1700 1 -- 172.21.15.31:0/4054627645 >> 172.21.15.31:0/4054627645 conn(0x7f42ac06fe50 msgr2=0x7f42ac069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:11.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.620+0000 7f42b16d1700 1 -- 172.21.15.31:0/4054627645 shutdown_connections 2023-10-09T06:30:11.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.620+0000 7f42b16d1700 1 -- 172.21.15.31:0/4054627645 wait complete. 2023-10-09T06:30:11.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.621+0000 7f42b16d1700 1 Processor -- start 2023-10-09T06:30:11.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.621+0000 7f42b16d1700 1 -- start start 2023-10-09T06:30:11.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.622+0000 7f42b16d1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42ac069f80 0x7f42ac1563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.622+0000 7f42b16d1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f42ac0c9310 0x7f42ac159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.622+0000 7f42b16d1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42ac0c96e0 0x7f42ac150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.622+0000 7f42b16d1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac0c6990 con 0x7f42ac069f80 2023-10-09T06:30:11.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.622+0000 7f42b16d1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac15a930 con 0x7f42ac0c96e0 2023-10-09T06:30:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.622+0000 7f42b16d1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac15a090 con 0x7f42ac0c9310 2023-10-09T06:30:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.622+0000 7f42aaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42ac069f80 0x7f42ac1563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.622+0000 7f42aaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42ac069f80 0x7f42ac1563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51046/0 (socket says 172.21.15.31:51046) 2023-10-09T06:30:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.622+0000 7f42aaffd700 1 -- 172.21.15.31:0/77891876 learned_addr learned my addr 172.21.15.31:0/77891876 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.622+0000 7f42aa7fc700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f42ac0c9310 0x7f42ac159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.622+0000 7f42ab7fe700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42ac0c96e0 0x7f42ac150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.622+0000 7f42aaffd700 1 -- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f42ac0c9310 msgr2=0x7f42ac159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.623+0000 7f42aaffd700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f42ac0c9310 0x7f42ac159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.623+0000 7f42aaffd700 1 -- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42ac0c96e0 msgr2=0x7f42ac150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.623+0000 7f42aaffd700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42ac0c96e0 0x7f42ac150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.623+0000 7f42aaffd700 1 -- 172.21.15.31:0/77891876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c0094f0 con 0x7f42ac069f80 2023-10-09T06:30:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.623+0000 7f42ab7fe700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42ac0c96e0 0x7f42ac150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.623+0000 7f42aaffd700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42ac069f80 0x7f42ac1563d0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f42ac06ab60 tx=0x7f429c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.623+0000 7f4292ffd700 1 -- 172.21.15.31:0/77891876 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c011e70 con 0x7f42ac069f80 2023-10-09T06:30:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.623+0000 7f4292ffd700 1 -- 172.21.15.31:0/77891876 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c024440 con 0x7f42ac069f80 2023-10-09T06:30:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.623+0000 7f4292ffd700 1 -- 172.21.15.31:0/77891876 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c024800 con 0x7f42ac069f80 2023-10-09T06:30:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.623+0000 7f42b16d1700 1 -- 172.21.15.31:0/77891876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ac15a370 con 0x7f42ac069f80 2023-10-09T06:30:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.623+0000 7f42b16d1700 1 -- 172.21.15.31:0/77891876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ac0b4410 con 0x7f42ac069f80 2023-10-09T06:30:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.624+0000 7f42b16d1700 1 -- 172.21.15.31:0/77891876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ac0c6760 con 0x7f42ac069f80 2023-10-09T06:30:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.624+0000 7f4292ffd700 1 -- 172.21.15.31:0/77891876 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f429c01a420 con 0x7f42ac069f80 2023-10-09T06:30:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.625+0000 7f4292ffd700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4298066f30 0x7f42980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.625+0000 7f4292ffd700 1 -- 172.21.15.31:0/77891876 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f429c0865e0 con 0x7f42ac069f80 2023-10-09T06:30:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.625+0000 7f4292ffd700 1 -- 172.21.15.31:0/77891876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f429806eb10 con 0x7f42ac069f80 2023-10-09T06:30:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.625+0000 7f42aa7fc700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4298066f30 0x7f42980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.625+0000 7f42aa7fc700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4298066f30 0x7f42980693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0b48f0 tx=0x7f42a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.629+0000 7f4292ffd700 1 -- 172.21.15.31:0/77891876 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42ac0c6760 con 0x7f42ac069f80 2023-10-09T06:30:11.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.823+0000 7f42b16d1700 1 -- 172.21.15.31:0/77891876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42ac0c6760 con 0x7f42ac069f80 2023-10-09T06:30:11.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.824+0000 7f4292ffd700 1 -- 172.21.15.31:0/77891876 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+15488 (secure 0 0 0) 0x7f42ac0c6760 con 0x7f42ac069f80 2023-10-09T06:30:11.823 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:11.823 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":156,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:29:31.773183+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:27:51.726909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T06:27:52.302903+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.9","mappings":[{"from":2,"to":0}]},{"pgid":"19.12","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:30:11.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.825+0000 7f42b16d1700 1 -- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4298066f30 msgr2=0x7f42980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.825+0000 7f42b16d1700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4298066f30 0x7f42980693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0b48f0 tx=0x7f42a0008040 comp rx=0 tx=0).stop 2023-10-09T06:30:11.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.825+0000 7f42b16d1700 1 -- 172.21.15.31:0/77891876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42ac069f80 msgr2=0x7f42ac1563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.825+0000 7f42b16d1700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42ac069f80 0x7f42ac1563d0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f42ac06ab60 tx=0x7f429c017000 comp rx=0 tx=0).stop 2023-10-09T06:30:11.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.826+0000 7f42b16d1700 1 -- 172.21.15.31:0/77891876 shutdown_connections 2023-10-09T06:30:11.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.826+0000 7f42b16d1700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4298066f30 0x7f42980693e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.826+0000 7f42b16d1700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42ac0c96e0 0x7f42ac150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.826+0000 7f42b16d1700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42ac069f80 0x7f42ac1563d0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.826+0000 7f42b16d1700 1 --2- 172.21.15.31:0/77891876 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f42ac0c9310 0x7f42ac159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.826+0000 7f42b16d1700 1 -- 172.21.15.31:0/77891876 >> 172.21.15.31:0/77891876 conn(0x7f42ac06fe50 msgr2=0x7f42ac0cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:11.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.826+0000 7f42b16d1700 1 -- 172.21.15.31:0/77891876 shutdown_connections 2023-10-09T06:30:11.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.826+0000 7f42b16d1700 1 -- 172.21.15.31:0/77891876 wait complete. 2023-10-09T06:30:11.838 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:30:11.838 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:30:11.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.958+0000 7ff6857d9700 1 Processor -- start 2023-10-09T06:30:11.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.958+0000 7ff6857d9700 1 -- start start 2023-10-09T06:30:11.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.959+0000 7ff6857d9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff68015a2b0 0x7ff6800b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.959+0000 7ff6857d9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6800d1c30 0x7ff6800cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.959+0000 7ff6857d9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff68015a680 0x7ff6800cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.959+0000 7ff6857d9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff680068470 con 0x7ff68015a680 2023-10-09T06:30:11.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.959+0000 7ff6857d9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6800c5d80 con 0x7ff68015a2b0 2023-10-09T06:30:11.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.959+0000 7ff6857d9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800c6060 con 0x7ff6800d1c30 2023-10-09T06:30:11.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.959+0000 7ff67f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff68015a680 0x7ff6800cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.959+0000 7ff67f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff68015a680 0x7ff6800cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51056/0 (socket says 172.21.15.31:51056) 2023-10-09T06:30:11.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.960+0000 7ff67f7fe700 1 -- 172.21.15.31:0/2893690767 learned_addr learned my addr 172.21.15.31:0/2893690767 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:11.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.960+0000 7ff67effd700 1 --2- 172.21.15.31:0/2893690767 >> v2:172.21.15.158:3300/0 conn(0x7ff68015a2b0 0x7ff6800b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.960+0000 7ff67f7fe700 1 -- 172.21.15.31:0/2893690767 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6800d1c30 msgr2=0x7ff6800cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:11.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.960+0000 7ff67f7fe700 1 --2- 172.21.15.31:0/2893690767 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6800d1c30 0x7ff6800cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.960+0000 7ff67f7fe700 1 -- 172.21.15.31:0/2893690767 >> v2:172.21.15.158:3300/0 conn(0x7ff68015a2b0 msgr2=0x7ff6800b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:11.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.960+0000 7ff67f7fe700 1 --2- 172.21.15.31:0/2893690767 >> v2:172.21.15.158:3300/0 conn(0x7ff68015a2b0 0x7ff6800b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.960+0000 7ff67f7fe700 1 -- 172.21.15.31:0/2893690767 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6800c6340 con 0x7ff68015a680 2023-10-09T06:30:11.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.960+0000 7ff67effd700 1 --2- 172.21.15.31:0/2893690767 >> v2:172.21.15.158:3300/0 conn(0x7ff68015a2b0 0x7ff6800b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:11.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.960+0000 7ff67f7fe700 1 --2- 172.21.15.31:0/2893690767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff68015a680 0x7ff6800cfc50 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff680089220 tx=0x7ff670009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54d8d9437e103a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:11.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.960+0000 7ff67dffb700 1 -- 172.21.15.31:0/2893690767 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67000e070 con 0x7ff68015a680 2023-10-09T06:30:11.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.960+0000 7ff67dffb700 1 -- 172.21.15.31:0/2893690767 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67000ba50 con 0x7ff68015a680 2023-10-09T06:30:11.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.960+0000 7ff67dffb700 1 -- 172.21.15.31:0/2893690767 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6700092e0 con 0x7ff68015a680 2023-10-09T06:30:11.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.961+0000 7ff6857d9700 1 -- 172.21.15.31:0/2893690767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff68015a680 msgr2=0x7ff6800cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.961+0000 7ff6857d9700 1 --2- 172.21.15.31:0/2893690767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff68015a680 0x7ff6800cfc50 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff680089220 tx=0x7ff670009840 comp rx=0 tx=0).stop 2023-10-09T06:30:11.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.961+0000 7ff6857d9700 1 -- 172.21.15.31:0/2893690767 shutdown_connections 2023-10-09T06:30:11.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.961+0000 7ff6857d9700 1 --2- 172.21.15.31:0/2893690767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff68015a680 0x7ff6800cfc50 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.961+0000 7ff6857d9700 1 --2- 172.21.15.31:0/2893690767 >> v2:172.21.15.158:3300/0 conn(0x7ff68015a2b0 0x7ff6800b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.961+0000 7ff6857d9700 1 --2- 172.21.15.31:0/2893690767 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff6800d1c30 0x7ff6800cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.961+0000 7ff6857d9700 1 -- 172.21.15.31:0/2893690767 >> 172.21.15.31:0/2893690767 conn(0x7ff680067e40 msgr2=0x7ff6800d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:11.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.961+0000 7ff6857d9700 1 -- 172.21.15.31:0/2893690767 shutdown_connections 2023-10-09T06:30:11.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.961+0000 7ff6857d9700 1 -- 172.21.15.31:0/2893690767 wait complete. 2023-10-09T06:30:11.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.962+0000 7ff6857d9700 1 Processor -- start 2023-10-09T06:30:11.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.962+0000 7ff6857d9700 1 -- start start 2023-10-09T06:30:11.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff6857d9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6800d1c30 0x7ff6800c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff6857d9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff68015a2b0 0x7ff68015c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff6857d9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff68015a680 0x7ff680156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff6857d9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800b3d80 con 0x7ff6800d1c30 2023-10-09T06:30:11.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff6857d9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800b4060 con 0x7ff68015a680 2023-10-09T06:30:11.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff6857d9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800b4340 con 0x7ff68015a2b0 2023-10-09T06:30:11.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff67effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6800d1c30 0x7ff6800c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff67effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6800d1c30 0x7ff6800c71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51062/0 (socket says 172.21.15.31:51062) 2023-10-09T06:30:11.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff67effd700 1 -- 172.21.15.31:0/3765297573 learned_addr learned my addr 172.21.15.31:0/3765297573 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:11.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff67f7fe700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff68015a680 0x7ff680156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff67e7fc700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff68015a2b0 0x7ff68015c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff67effd700 1 -- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff68015a2b0 msgr2=0x7ff68015c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff67effd700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff68015a2b0 0x7ff68015c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff67effd700 1 -- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff68015a680 msgr2=0x7ff680156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:11.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff67effd700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff68015a680 0x7ff680156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:11.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff67effd700 1 -- 172.21.15.31:0/3765297573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff670009ae0 con 0x7ff6800d1c30 2023-10-09T06:30:11.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.963+0000 7ff67effd700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6800d1c30 0x7ff6800c71a0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ff67800d810 tx=0x7ff678008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:11.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.964+0000 7ff676ffd700 1 -- 172.21.15.31:0/3765297573 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678005a60 con 0x7ff6800d1c30 2023-10-09T06:30:11.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.964+0000 7ff676ffd700 1 -- 172.21.15.31:0/3765297573 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff678005bc0 con 0x7ff6800d1c30 2023-10-09T06:30:11.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.964+0000 7ff6857d9700 1 -- 172.21.15.31:0/3765297573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6800b4620 con 0x7ff6800d1c30 2023-10-09T06:30:11.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.964+0000 7ff676ffd700 1 -- 172.21.15.31:0/3765297573 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678009610 con 0x7ff6800d1c30 2023-10-09T06:30:11.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.964+0000 7ff6857d9700 1 -- 172.21.15.31:0/3765297573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6800b4be0 con 0x7ff6800d1c30 2023-10-09T06:30:11.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.965+0000 7ff6857d9700 1 -- 172.21.15.31:0/3765297573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6800b4e00 con 0x7ff6800d1c30 2023-10-09T06:30:11.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.965+0000 7ff676ffd700 1 -- 172.21.15.31:0/3765297573 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff678009a00 con 0x7ff6800d1c30 2023-10-09T06:30:11.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.965+0000 7ff676ffd700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff660066f30 0x7ff6600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:11.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.966+0000 7ff676ffd700 1 -- 172.21.15.31:0/3765297573 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ff678084830 con 0x7ff6800d1c30 2023-10-09T06:30:11.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.966+0000 7ff676ffd700 1 -- 172.21.15.31:0/3765297573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7ff66006eb10 con 0x7ff6800d1c30 2023-10-09T06:30:11.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.966+0000 7ff67e7fc700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff660066f30 0x7ff6600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:11.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.966+0000 7ff67e7fc700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff660066f30 0x7ff6600693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff668006fd0 tx=0x7ff668008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:11.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:11.970+0000 7ff676ffd700 1 -- 172.21.15.31:0/3765297573 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6780554f0 con 0x7ff6800d1c30 2023-10-09T06:30:12.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.208+0000 7ff6857d9700 1 -- 172.21.15.31:0/3765297573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff68004c3c0 con 0x7ff6800d1c30 2023-10-09T06:30:12.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.208+0000 7ff676ffd700 1 -- 172.21.15.31:0/3765297573 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4599 (secure 0 0 0) 0x7ff678009cb0 con 0x7ff6800d1c30 2023-10-09T06:30:12.208 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:12.208 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/52086276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":52086276},{"type":"v1","addr":"172.21.15.158:6836","nonce":52086276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3440717183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3440717183},{"type":"v1","addr":"172.21.15.31:6834","nonce":3440717183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1719024262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1719024262},{"type":"v1","addr":"172.21.15.31:6835","nonce":1719024262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:53.330823+0000","modified":"2023-10-09T06:27:56.943663+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7419":{"gid":7419,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1416230741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1416230741},{"type":"v1","addr":"172.21.15.158:6837","nonce":1416230741}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T06:30:12.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.210+0000 7ff6857d9700 1 -- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff660066f30 msgr2=0x7ff6600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:12.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.210+0000 7ff6857d9700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff660066f30 0x7ff6600693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff668006fd0 tx=0x7ff668008040 comp rx=0 tx=0).stop 2023-10-09T06:30:12.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.210+0000 7ff6857d9700 1 -- 172.21.15.31:0/3765297573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6800d1c30 msgr2=0x7ff6800c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:12.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.210+0000 7ff6857d9700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6800d1c30 0x7ff6800c71a0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ff67800d810 tx=0x7ff678008040 comp rx=0 tx=0).stop 2023-10-09T06:30:12.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.210+0000 7ff6857d9700 1 -- 172.21.15.31:0/3765297573 shutdown_connections 2023-10-09T06:30:12.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.210+0000 7ff6857d9700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff660066f30 0x7ff6600693e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.210+0000 7ff6857d9700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff68015a680 0x7ff680156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.210+0000 7ff6857d9700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6800d1c30 0x7ff6800c71a0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.210+0000 7ff6857d9700 1 --2- 172.21.15.31:0/3765297573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff68015a2b0 0x7ff68015c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.210+0000 7ff6857d9700 1 -- 172.21.15.31:0/3765297573 >> 172.21.15.31:0/3765297573 conn(0x7ff680067e40 msgr2=0x7ff6800ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:12.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.210+0000 7ff6857d9700 1 -- 172.21.15.31:0/3765297573 shutdown_connections 2023-10-09T06:30:12.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.210+0000 7ff6857d9700 1 -- 172.21.15.31:0/3765297573 wait complete. 2023-10-09T06:30:12.212 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 74 2023-10-09T06:30:12.222 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:30:12.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.342+0000 7ffbde458700 1 Processor -- start 2023-10-09T06:30:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.342+0000 7ffbde458700 1 -- start start 2023-10-09T06:30:12.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbde458700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ffbd80d1c30 0x7ffbd80ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:12.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbde458700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbd815a680 0x7ffbd80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:12.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbde458700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd80c5d80 con 0x7ffbd815a2b0 2023-10-09T06:30:12.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbde458700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd8068470 con 0x7ffbd80d1c30 2023-10-09T06:30:12.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbde458700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80c6060 con 0x7ffbd815a680 2023-10-09T06:30:12.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbd7fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ffbd815a2b0 0x7ffbd80b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46326/0 (socket says 172.21.15.31:46326) 2023-10-09T06:30:12.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbd7fff700 1 -- 172.21.15.31:0/2588699985 learned_addr learned my addr 172.21.15.31:0/2588699985 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbd77fe700 1 --2- 172.21.15.31:0/2588699985 >> v2:172.21.15.158:3300/0 conn(0x7ffbd80d1c30 0x7ffbd80ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbdc9f5700 1 --2- 172.21.15.31:0/2588699985 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbd815a680 0x7ffbd80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbd6ffd700 1 -- 172.21.15.31:0/2588699985 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779668815 0 0) 0x7ffbd80c5d80 con 0x7ffbd815a2b0 2023-10-09T06:30:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbd6ffd700 1 -- 172.21.15.31:0/2588699985 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbc0003570 con 0x7ffbd815a2b0 2023-10-09T06:30:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbdc9f5700 1 -- 172.21.15.31:0/2588699985 >> v2:172.21.15.158:3300/0 conn(0x7ffbd80d1c30 msgr2=0x7ffbd80ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbdc9f5700 1 --2- 172.21.15.31:0/2588699985 >> v2:172.21.15.158:3300/0 conn(0x7ffbd80d1c30 0x7ffbd80ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbdc9f5700 1 -- 172.21.15.31:0/2588699985 >> v1:172.21.15.31:6789/0 conn(0x7ffbd815a2b0 legacy=0x7ffbd80b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbd6ffd700 1 -- 172.21.15.31:0/2588699985 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825464026 0 0) 0x7ffbc0003570 con 0x7ffbd815a2b0 2023-10-09T06:30:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbdc9f5700 1 -- 172.21.15.31:0/2588699985 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd80c6340 con 0x7ffbd815a680 2023-10-09T06:30:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.343+0000 7ffbd77fe700 1 --2- 172.21.15.31:0/2588699985 >> v2:172.21.15.158:3300/0 conn(0x7ffbd80d1c30 0x7ffbd80ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:30:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.344+0000 7ffbdc9f5700 1 --2- 172.21.15.31:0/2588699985 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbd815a680 0x7ffbd80cf710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009e60 tx=0x7ffbd0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce6c038a710c49c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:12.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.344+0000 7ffbd6ffd700 1 -- 172.21.15.31:0/2588699985 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000e070 con 0x7ffbd815a680 2023-10-09T06:30:12.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.344+0000 7ffbd6ffd700 1 -- 172.21.15.31:0/2588699985 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd000b7a0 con 0x7ffbd815a680 2023-10-09T06:30:12.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.344+0000 7ffbd6ffd700 1 -- 172.21.15.31:0/2588699985 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc0015f0 con 0x7ffbd815a680 2023-10-09T06:30:12.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.344+0000 7ffbde458700 1 -- 172.21.15.31:0/2588699985 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbd815a680 msgr2=0x7ffbd80cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:12.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.344+0000 7ffbde458700 1 --2- 172.21.15.31:0/2588699985 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbd815a680 0x7ffbd80cf710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009e60 tx=0x7ffbd0009780 comp rx=0 tx=0).stop 2023-10-09T06:30:12.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.344+0000 7ffbde458700 1 -- 172.21.15.31:0/2588699985 shutdown_connections 2023-10-09T06:30:12.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.344+0000 7ffbde458700 1 --2- 172.21.15.31:0/2588699985 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbd815a680 0x7ffbd80cf710 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.344+0000 7ffbde458700 1 --2- 172.21.15.31:0/2588699985 >> v2:172.21.15.158:3300/0 conn(0x7ffbd80d1c30 0x7ffbd80ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.344+0000 7ffbde458700 1 -- 172.21.15.31:0/2588699985 >> 172.21.15.31:0/2588699985 conn(0x7ffbd8067e40 msgr2=0x7ffbd80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:12.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.344+0000 7ffbde458700 1 -- 172.21.15.31:0/2588699985 shutdown_connections 2023-10-09T06:30:12.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.344+0000 7ffbde458700 1 -- 172.21.15.31:0/2588699985 wait complete. 2023-10-09T06:30:12.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.346+0000 7ffbde458700 1 Processor -- start 2023-10-09T06:30:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.346+0000 7ffbde458700 1 -- start start 2023-10-09T06:30:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.346+0000 7ffbde458700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbd80d1c30 0x7ffbd815d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.346+0000 7ffbde458700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd815a2b0 0x7ffbd8157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.346+0000 7ffbde458700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbd815a680 0x7ffbd815ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.346+0000 7ffbde458700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd815c4c0 con 0x7ffbd815a2b0 2023-10-09T06:30:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.346+0000 7ffbde458700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd815c7a0 con 0x7ffbd815a680 2023-10-09T06:30:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.346+0000 7ffbde458700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd815ca80 con 0x7ffbd80d1c30 2023-10-09T06:30:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbd77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd815a2b0 0x7ffbd8157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbd77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd815a2b0 0x7ffbd8157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51076/0 (socket says 172.21.15.31:51076) 2023-10-09T06:30:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbd77fe700 1 -- 172.21.15.31:0/3695802265 learned_addr learned my addr 172.21.15.31:0/3695802265 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbdc9f5700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbd815a680 0x7ffbd815ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:12.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbd7fff700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbd80d1c30 0x7ffbd815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:12.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbd77fe700 1 -- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbd80d1c30 msgr2=0x7ffbd815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:12.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbd77fe700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbd80d1c30 0x7ffbd815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbd77fe700 1 -- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbd815a680 msgr2=0x7ffbd815ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:12.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbd77fe700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbd815a680 0x7ffbd815ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbd77fe700 1 -- 172.21.15.31:0/3695802265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc8009420 con 0x7ffbd815a2b0 2023-10-09T06:30:12.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbd7fff700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbd80d1c30 0x7ffbd815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:12.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbd77fe700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd815a2b0 0x7ffbd8157a50 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800ec80 tx=0x7ffbc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:12.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbbffff700 1 -- 172.21.15.31:0/3695802265 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800c9d0 con 0x7ffbd815a2b0 2023-10-09T06:30:12.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbbffff700 1 -- 172.21.15.31:0/3695802265 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc800cb30 con 0x7ffbd815a2b0 2023-10-09T06:30:12.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbde458700 1 -- 172.21.15.31:0/3695802265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd0009a20 con 0x7ffbd815a2b0 2023-10-09T06:30:12.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbbffff700 1 -- 172.21.15.31:0/3695802265 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8013470 con 0x7ffbd815a2b0 2023-10-09T06:30:12.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.347+0000 7ffbde458700 1 -- 172.21.15.31:0/3695802265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd815ce10 con 0x7ffbd815a2b0 2023-10-09T06:30:12.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.348+0000 7ffbde458700 1 -- 172.21.15.31:0/3695802265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd815db60 con 0x7ffbd815a2b0 2023-10-09T06:30:12.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.349+0000 7ffbbffff700 1 -- 172.21.15.31:0/3695802265 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffbc8013820 con 0x7ffbd815a2b0 2023-10-09T06:30:12.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.350+0000 7ffbbffff700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffbc4066f30 0x7ffbc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:12.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.350+0000 7ffbbffff700 1 -- 172.21.15.31:0/3695802265 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ffbc8084b40 con 0x7ffbd815a2b0 2023-10-09T06:30:12.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.350+0000 7ffbd7fff700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffbc4066f30 0x7ffbc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:12.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.350+0000 7ffbbffff700 1 -- 172.21.15.31:0/3695802265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7ffbc406eb10 con 0x7ffbd815a2b0 2023-10-09T06:30:12.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.350+0000 7ffbd7fff700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffbc4066f30 0x7ffbc40693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc002ee0 tx=0x7ffbcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.354+0000 7ffbbffff700 1 -- 172.21.15.31:0/3695802265 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbc8017060 con 0x7ffbd815a2b0 2023-10-09T06:30:12.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.594+0000 7ffbde458700 1 -- 172.21.15.31:0/3695802265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbd815db60 con 0x7ffbd815a2b0 2023-10-09T06:30:12.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.594+0000 7ffbbffff700 1 -- 172.21.15.31:0/3695802265 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4599 (secure 0 0 0) 0x7ffbd815db60 con 0x7ffbd815a2b0 2023-10-09T06:30:12.594 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:12.594 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/52086276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":52086276},{"type":"v1","addr":"172.21.15.158:6836","nonce":52086276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3440717183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3440717183},{"type":"v1","addr":"172.21.15.31:6834","nonce":3440717183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1719024262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1719024262},{"type":"v1","addr":"172.21.15.31:6835","nonce":1719024262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:27:53.330823+0000","modified":"2023-10-09T06:27:56.943663+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7419":{"gid":7419,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6837/1416230741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1416230741},{"type":"v1","addr":"172.21.15.158:6837","nonce":1416230741}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T06:30:12.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.596+0000 7ffbde458700 1 -- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffbc4066f30 msgr2=0x7ffbc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:12.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.596+0000 7ffbde458700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffbc4066f30 0x7ffbc40693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc002ee0 tx=0x7ffbcc009040 comp rx=0 tx=0).stop 2023-10-09T06:30:12.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.596+0000 7ffbde458700 1 -- 172.21.15.31:0/3695802265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd815a2b0 msgr2=0x7ffbd8157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:12.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.596+0000 7ffbde458700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd815a2b0 0x7ffbd8157a50 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800ec80 tx=0x7ffbc80091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.596+0000 7ffbde458700 1 -- 172.21.15.31:0/3695802265 shutdown_connections 2023-10-09T06:30:12.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.596+0000 7ffbde458700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffbc4066f30 0x7ffbc40693e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.596+0000 7ffbde458700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffbd80d1c30 0x7ffbd815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.596+0000 7ffbde458700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffbd815a680 0x7ffbd815ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.596+0000 7ffbde458700 1 --2- 172.21.15.31:0/3695802265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbd815a2b0 0x7ffbd8157a50 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.596+0000 7ffbde458700 1 -- 172.21.15.31:0/3695802265 >> 172.21.15.31:0/3695802265 conn(0x7ffbd8067e40 msgr2=0x7ffbd80cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:12.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.596+0000 7ffbde458700 1 -- 172.21.15.31:0/3695802265 shutdown_connections 2023-10-09T06:30:12.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.596+0000 7ffbde458700 1 -- 172.21.15.31:0/3695802265 wait complete. 2023-10-09T06:30:12.599 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 74 2023-10-09T06:30:12.608 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:30:12.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.728+0000 7f93c6132700 1 Processor -- start 2023-10-09T06:30:12.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.728+0000 7f93c6132700 1 -- start start 2023-10-09T06:30:12.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93c6132700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93c015a2b0 0x7f93c00b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:12.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93c6132700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93c00d1c30 0x7f93c00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:12.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93c6132700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f93c015a680 0x7f93c00cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:12.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93c6132700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c0068470 con 0x7f93c015a2b0 2023-10-09T06:30:12.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93c6132700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c00c5d80 con 0x7f93c015a680 2023-10-09T06:30:12.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93c6132700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00c6060 con 0x7f93c00d1c30 2023-10-09T06:30:12.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93bf7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93c015a2b0 0x7f93c00b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:12.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93bf7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93c015a2b0 0x7f93c00b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51086/0 (socket says 172.21.15.31:51086) 2023-10-09T06:30:12.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93bf7fe700 1 -- 172.21.15.31:0/2753899386 learned_addr learned my addr 172.21.15.31:0/2753899386 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:12.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93beffd700 1 --2- 172.21.15.31:0/2753899386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93c00d1c30 0x7f93c00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:12.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93bffff700 1 --2- 172.21.15.31:0/2753899386 >> v2:172.21.15.158:3300/0 conn(0x7f93c015a680 0x7f93c00cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:12.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93bf7fe700 1 -- 172.21.15.31:0/2753899386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93c00d1c30 msgr2=0x7f93c00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:12.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93bf7fe700 1 --2- 172.21.15.31:0/2753899386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93c00d1c30 0x7f93c00cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93bf7fe700 1 -- 172.21.15.31:0/2753899386 >> v2:172.21.15.158:3300/0 conn(0x7f93c015a680 msgr2=0x7f93c00cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:12.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93bf7fe700 1 --2- 172.21.15.31:0/2753899386 >> v2:172.21.15.158:3300/0 conn(0x7f93c015a680 0x7f93c00cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93bf7fe700 1 -- 172.21.15.31:0/2753899386 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c00c6340 con 0x7f93c015a2b0 2023-10-09T06:30:12.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93beffd700 1 --2- 172.21.15.31:0/2753899386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93c00d1c30 0x7f93c00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:12.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93bffff700 1 --2- 172.21.15.31:0/2753899386 >> v2:172.21.15.158:3300/0 conn(0x7f93c015a680 0x7f93c00cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:12.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93bf7fe700 1 --2- 172.21.15.31:0/2753899386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c015a2b0 0x7f93c00b3da0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f93c008a810 tx=0x7f93b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ae403c7d3fe6f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:12.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93be7fc700 1 -- 172.21.15.31:0/2753899386 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000e070 con 0x7f93c015a2b0 2023-10-09T06:30:12.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93be7fc700 1 -- 172.21.15.31:0/2753899386 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b000bad0 con 0x7f93c015a2b0 2023-10-09T06:30:12.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.729+0000 7f93be7fc700 1 -- 172.21.15.31:0/2753899386 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b00092e0 con 0x7f93c015a2b0 2023-10-09T06:30:12.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.730+0000 7f93c6132700 1 -- 172.21.15.31:0/2753899386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c015a2b0 msgr2=0x7f93c00b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:12.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.730+0000 7f93c6132700 1 --2- 172.21.15.31:0/2753899386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c015a2b0 0x7f93c00b3da0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f93c008a810 tx=0x7f93b0009840 comp rx=0 tx=0).stop 2023-10-09T06:30:12.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.730+0000 7f93c6132700 1 -- 172.21.15.31:0/2753899386 shutdown_connections 2023-10-09T06:30:12.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.730+0000 7f93c6132700 1 --2- 172.21.15.31:0/2753899386 >> v2:172.21.15.158:3300/0 conn(0x7f93c015a680 0x7f93c00cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.730+0000 7f93c6132700 1 --2- 172.21.15.31:0/2753899386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c015a2b0 0x7f93c00b3da0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.730+0000 7f93c6132700 1 --2- 172.21.15.31:0/2753899386 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93c00d1c30 0x7f93c00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.730+0000 7f93c6132700 1 -- 172.21.15.31:0/2753899386 >> 172.21.15.31:0/2753899386 conn(0x7f93c0067e40 msgr2=0x7f93c00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:12.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.730+0000 7f93c6132700 1 -- 172.21.15.31:0/2753899386 shutdown_connections 2023-10-09T06:30:12.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.730+0000 7f93c6132700 1 -- 172.21.15.31:0/2753899386 wait complete. 2023-10-09T06:30:12.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.731+0000 7f93c6132700 1 Processor -- start 2023-10-09T06:30:12.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.731+0000 7f93c6132700 1 -- start start 2023-10-09T06:30:12.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93c6132700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93c00d1c30 0x7f93c009e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:12.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93c6132700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c015a2b0 0x7f93c0157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:12.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93c6132700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93c015a680 0x7f93c009b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:12.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93c6132700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c009e6b0 con 0x7f93c015a2b0 2023-10-09T06:30:12.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93c6132700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c009d0d0 con 0x7f93c00d1c30 2023-10-09T06:30:12.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93c6132700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c009d3b0 con 0x7f93c015a680 2023-10-09T06:30:12.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93beffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c015a2b0 0x7f93c0157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:12.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93beffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c015a2b0 0x7f93c0157d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51088/0 (socket says 172.21.15.31:51088) 2023-10-09T06:30:12.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93beffd700 1 -- 172.21.15.31:0/1635414076 learned_addr learned my addr 172.21.15.31:0/1635414076 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:12.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93bf7fe700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93c00d1c30 0x7f93c009e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:12.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93bffff700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93c015a680 0x7f93c009b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:12.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93beffd700 1 -- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93c015a680 msgr2=0x7f93c009b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:12.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93beffd700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93c015a680 0x7f93c009b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93beffd700 1 -- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93c00d1c30 msgr2=0x7f93c009e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:12.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93beffd700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93c00d1c30 0x7f93c009e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93beffd700 1 -- 172.21.15.31:0/1635414076 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b0009ae0 con 0x7f93c015a2b0 2023-10-09T06:30:12.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.732+0000 7f93bf7fe700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93c00d1c30 0x7f93c009e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:12.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.733+0000 7f93beffd700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c015a2b0 0x7f93c0157d00 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f93a800d890 tx=0x7f93a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:12.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.733+0000 7f93b77fe700 1 -- 172.21.15.31:0/1635414076 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a80125f0 con 0x7f93c015a2b0 2023-10-09T06:30:12.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.733+0000 7f93b77fe700 1 -- 172.21.15.31:0/1635414076 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a8012750 con 0x7f93c015a2b0 2023-10-09T06:30:12.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.733+0000 7f93c6132700 1 -- 172.21.15.31:0/1635414076 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c009d690 con 0x7f93c015a2b0 2023-10-09T06:30:12.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.733+0000 7f93b77fe700 1 -- 172.21.15.31:0/1635414076 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8012af0 con 0x7f93c015a2b0 2023-10-09T06:30:12.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.733+0000 7f93c6132700 1 -- 172.21.15.31:0/1635414076 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c009dc50 con 0x7f93c015a2b0 2023-10-09T06:30:12.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.734+0000 7f93c6132700 1 -- 172.21.15.31:0/1635414076 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c004c3c0 con 0x7f93c015a2b0 2023-10-09T06:30:12.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.734+0000 7f93b77fe700 1 -- 172.21.15.31:0/1635414076 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93a8014430 con 0x7f93c015a2b0 2023-10-09T06:30:12.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.734+0000 7f93b77fe700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f93a0066f30 0x7f93a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:12.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.735+0000 7f93b77fe700 1 -- 172.21.15.31:0/1635414076 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f93a8084980 con 0x7f93c015a2b0 2023-10-09T06:30:12.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.735+0000 7f93b77fe700 1 -- 172.21.15.31:0/1635414076 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f93a006eb10 con 0x7f93c015a2b0 2023-10-09T06:30:12.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.735+0000 7f93bf7fe700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f93a0066f30 0x7f93a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:12.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.735+0000 7f93bf7fe700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f93a0066f30 0x7f93a00693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f93b0009fd0 tx=0x7f93b0018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:12.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.739+0000 7f93b77fe700 1 -- 172.21.15.31:0/1635414076 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93a8051bb0 con 0x7f93c015a2b0 2023-10-09T06:30:12.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.933+0000 7f93c6132700 1 -- 172.21.15.31:0/1635414076 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93c00696d0 con 0x7f93c015a2b0 2023-10-09T06:30:12.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.934+0000 7f93b77fe700 1 -- 172.21.15.31:0/1635414076 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+15488 (secure 0 0 0) 0x7f93a80551d0 con 0x7f93c015a2b0 2023-10-09T06:30:12.934 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:12.934 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":156,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:29:31.773183+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:27:51.726909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T06:27:52.302903+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.9","mappings":[{"from":2,"to":0}]},{"pgid":"19.12","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:30:12.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.936+0000 7f93c6132700 1 -- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f93a0066f30 msgr2=0x7f93a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:12.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.936+0000 7f93c6132700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f93a0066f30 0x7f93a00693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f93b0009fd0 tx=0x7f93b0018000 comp rx=0 tx=0).stop 2023-10-09T06:30:12.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.936+0000 7f93c6132700 1 -- 172.21.15.31:0/1635414076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c015a2b0 msgr2=0x7f93c0157d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:12.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.936+0000 7f93c6132700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c015a2b0 0x7f93c0157d00 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f93a800d890 tx=0x7f93a8008040 comp rx=0 tx=0).stop 2023-10-09T06:30:12.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.936+0000 7f93c6132700 1 -- 172.21.15.31:0/1635414076 shutdown_connections 2023-10-09T06:30:12.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.936+0000 7f93c6132700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f93a0066f30 0x7f93a00693e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.936+0000 7f93c6132700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f93c015a680 0x7f93c009b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.936+0000 7f93c6132700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93c00d1c30 0x7f93c009e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.936+0000 7f93c6132700 1 --2- 172.21.15.31:0/1635414076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c015a2b0 0x7f93c0157d00 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:12.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.936+0000 7f93c6132700 1 -- 172.21.15.31:0/1635414076 >> 172.21.15.31:0/1635414076 conn(0x7f93c0067e40 msgr2=0x7f93c00d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:12.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.936+0000 7f93c6132700 1 -- 172.21.15.31:0/1635414076 shutdown_connections 2023-10-09T06:30:12.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:12.936+0000 7f93c6132700 1 -- 172.21.15.31:0/1635414076 wait complete. 2023-10-09T06:30:12.948 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:30:13.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.068+0000 7f5a245e0700 1 Processor -- start 2023-10-09T06:30:13.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.068+0000 7f5a245e0700 1 -- start start 2023-10-09T06:30:13.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.069+0000 7f5a245e0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5a1c15a2b0 0x7f5a1c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:13.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.069+0000 7f5a245e0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a1c0d1c30 0x7f5a1c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:13.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.069+0000 7f5a245e0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a1c0c5d80 con 0x7f5a1c15a680 2023-10-09T06:30:13.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.069+0000 7f5a245e0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a1c068470 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.069+0000 7f5a245e0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c0c6060 con 0x7f5a1c0d1c30 2023-10-09T06:30:13.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.070+0000 7f5a2237c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5a1c15a2b0 0x7f5a1c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:13.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.070+0000 7f5a22b7d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5a1c15a680 0x7f5a1c0c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46330/0 (socket says 172.21.15.31:46330) 2023-10-09T06:30:13.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.070+0000 7f5a22b7d700 1 -- 172.21.15.31:0/4074394974 learned_addr learned my addr 172.21.15.31:0/4074394974 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:13.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.070+0000 7f5a21b7b700 1 --2- 172.21.15.31:0/4074394974 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a1c0d1c30 0x7f5a1c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:13.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.070+0000 7f5a2237c700 1 -- 172.21.15.31:0/4074394974 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a1c0d1c30 msgr2=0x7f5a1c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:13.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.070+0000 7f5a2237c700 1 --2- 172.21.15.31:0/4074394974 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a1c0d1c30 0x7f5a1c0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.070+0000 7f5a2237c700 1 -- 172.21.15.31:0/4074394974 >> v1:172.21.15.31:6789/0 conn(0x7f5a1c15a680 legacy=0x7f5a1c0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:13.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.070+0000 7f5a2137a700 1 -- 172.21.15.31:0/4074394974 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650265206 0 0) 0x7f5a1c0c5d80 con 0x7f5a1c15a680 2023-10-09T06:30:13.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.070+0000 7f5a2237c700 1 -- 172.21.15.31:0/4074394974 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c0c6340 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.070+0000 7f5a2237c700 1 --2- 172.21.15.31:0/4074394974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1c15a2b0 0x7f5a1c0b3da0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5a140098d0 tx=0x7f5a14009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db450619b432b84 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:13.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.070+0000 7f5a2137a700 1 -- 172.21.15.31:0/4074394974 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14005c10 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.070+0000 7f5a2137a700 1 -- 172.21.15.31:0/4074394974 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a14005d70 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.070+0000 7f5a2137a700 1 -- 172.21.15.31:0/4074394974 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14006280 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.071+0000 7f5a245e0700 1 -- 172.21.15.31:0/4074394974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1c15a2b0 msgr2=0x7f5a1c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:13.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.071+0000 7f5a245e0700 1 --2- 172.21.15.31:0/4074394974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1c15a2b0 0x7f5a1c0b3da0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5a140098d0 tx=0x7f5a14009120 comp rx=0 tx=0).stop 2023-10-09T06:30:13.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.071+0000 7f5a245e0700 1 -- 172.21.15.31:0/4074394974 shutdown_connections 2023-10-09T06:30:13.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.071+0000 7f5a245e0700 1 --2- 172.21.15.31:0/4074394974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1c15a2b0 0x7f5a1c0b3da0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.071+0000 7f5a245e0700 1 --2- 172.21.15.31:0/4074394974 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a1c0d1c30 0x7f5a1c0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.071+0000 7f5a245e0700 1 -- 172.21.15.31:0/4074394974 >> 172.21.15.31:0/4074394974 conn(0x7f5a1c067e40 msgr2=0x7f5a1c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:13.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.071+0000 7f5a245e0700 1 -- 172.21.15.31:0/4074394974 shutdown_connections 2023-10-09T06:30:13.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.071+0000 7f5a245e0700 1 -- 172.21.15.31:0/4074394974 wait complete. 2023-10-09T06:30:13.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.072+0000 7f5a245e0700 1 Processor -- start 2023-10-09T06:30:13.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.072+0000 7f5a245e0700 1 -- start start 2023-10-09T06:30:13.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a245e0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a1c0d1c30 0x7f5a1c15d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:13.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a245e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1c15a2b0 0x7f5a1c169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:13.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a245e0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a1c15a680 0x7f5a1c16a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:13.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a245e0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c15b240 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a245e0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c0c9340 con 0x7f5a1c0d1c30 2023-10-09T06:30:13.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a245e0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c15be40 con 0x7f5a1c15a680 2023-10-09T06:30:13.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a21b7b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1c15a2b0 0x7f5a1c169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:13.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a21b7b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1c15a2b0 0x7f5a1c169cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51120/0 (socket says 172.21.15.31:51120) 2023-10-09T06:30:13.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a21b7b700 1 -- 172.21.15.31:0/3795538808 learned_addr learned my addr 172.21.15.31:0/3795538808 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:13.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a2237c700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a1c0d1c30 0x7f5a1c15d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:13.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a22b7d700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a1c15a680 0x7f5a1c16a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:13.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a21b7b700 1 -- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a1c15a680 msgr2=0x7f5a1c16a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:13.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a21b7b700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a1c15a680 0x7f5a1c16a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a21b7b700 1 -- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a1c0d1c30 msgr2=0x7f5a1c15d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:13.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a21b7b700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a1c0d1c30 0x7f5a1c15d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a21b7b700 1 -- 172.21.15.31:0/3795538808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a140093c0 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a2237c700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a1c0d1c30 0x7f5a1c15d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:13.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a21b7b700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1c15a2b0 0x7f5a1c169cc0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000e900 tx=0x7f5a100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:13.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a1a7fc700 1 -- 172.21.15.31:0/3795538808 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1000eea0 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a1a7fc700 1 -- 172.21.15.31:0/3795538808 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1000c850 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a1a7fc700 1 -- 172.21.15.31:0/3795538808 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1000cc10 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.073+0000 7f5a245e0700 1 -- 172.21.15.31:0/3795538808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1c15c960 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.074+0000 7f5a245e0700 1 -- 172.21.15.31:0/3795538808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1c15c3a0 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.074+0000 7f5a245e0700 1 -- 172.21.15.31:0/3795538808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1c0c94b0 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.075+0000 7f5a1a7fc700 1 -- 172.21.15.31:0/3795538808 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a10013470 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.075+0000 7f5a1a7fc700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a08066f30 0x7f5a080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:13.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.075+0000 7f5a1a7fc700 1 -- 172.21.15.31:0/3795538808 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f5a10084730 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.075+0000 7f5a1a7fc700 1 -- 172.21.15.31:0/3795538808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f5a0806eb10 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.075+0000 7f5a2237c700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a08066f30 0x7f5a080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:13.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.076+0000 7f5a2237c700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a08066f30 0x7f5a080693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009160 tx=0x7f5a14016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:13.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.079+0000 7f5a1a7fc700 1 -- 172.21.15.31:0/3795538808 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a10017060 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.315+0000 7f5a245e0700 1 -- 172.21.15.31:0/3795538808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5a1c04c3c0 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.315 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:30:13.316+0000 7fc5e82b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:30:13.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.322+0000 7f5a1a7fc700 1 -- 172.21.15.31:0/3795538808 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(157..157 src has 1..157) v4 ==== 366+0+0 (secure 0 0 0) 0x7f5a10055620 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.322+0000 7f5a1a7fc700 1 -- 172.21.15.31:0/3795538808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f5a0806f460 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.324+0000 7f5a1a7fc700 1 -- 172.21.15.31:0/3795538808 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5a10021030 con 0x7f5a1c15a2b0 2023-10-09T06:30:13.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.326+0000 7f5a245e0700 1 -- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a08066f30 msgr2=0x7f5a080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:13.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.326+0000 7f5a245e0700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a08066f30 0x7f5a080693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009160 tx=0x7f5a14016000 comp rx=0 tx=0).stop 2023-10-09T06:30:13.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.326+0000 7f5a245e0700 1 -- 172.21.15.31:0/3795538808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1c15a2b0 msgr2=0x7f5a1c169cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:13.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.326+0000 7f5a245e0700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1c15a2b0 0x7f5a1c169cc0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000e900 tx=0x7f5a100091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.326+0000 7f5a245e0700 1 -- 172.21.15.31:0/3795538808 shutdown_connections 2023-10-09T06:30:13.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.326+0000 7f5a245e0700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5a08066f30 0x7f5a080693e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.326+0000 7f5a245e0700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5a1c15a680 0x7f5a1c16a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.326+0000 7f5a245e0700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a1c0d1c30 0x7f5a1c15d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.326+0000 7f5a245e0700 1 --2- 172.21.15.31:0/3795538808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1c15a2b0 0x7f5a1c169cc0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.326+0000 7f5a245e0700 1 -- 172.21.15.31:0/3795538808 >> 172.21.15.31:0/3795538808 conn(0x7f5a1c067e40 msgr2=0x7f5a1c06a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:13.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.326+0000 7f5a245e0700 1 -- 172.21.15.31:0/3795538808 shutdown_connections 2023-10-09T06:30:13.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.326+0000 7f5a245e0700 1 -- 172.21.15.31:0/3795538808 wait complete. 2023-10-09T06:30:13.327 INFO:tasks.ceph.mds.d.smithi158.stderr: -8921> 2023-10-09T06:27:59.259+0000 7f118b0e5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:30:13.327 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:30:13.338 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:30:13.357 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-09T06:30:13.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.460+0000 7f2ba780b700 1 Processor -- start 2023-10-09T06:30:13.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.460+0000 7f2ba780b700 1 -- start start 2023-10-09T06:30:13.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.461+0000 7f2ba780b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2ba00cd300 0x7f2ba015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:13.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.461+0000 7f2ba780b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba01513f0 con 0x7f2ba00d1470 2023-10-09T06:30:13.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.461+0000 7f2ba780b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba015db20 con 0x7f2ba00b6760 2023-10-09T06:30:13.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.461+0000 7f2ba780b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba015e7a0 con 0x7f2ba00cd300 2023-10-09T06:30:13.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.461+0000 7f2ba55a7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2ba00cd300 0x7f2ba015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:13.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.461+0000 7f2ba5da8700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2ba00d1470 0x7f2ba00cf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46336/0 (socket says 172.21.15.31:46336) 2023-10-09T06:30:13.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.461+0000 7f2ba5da8700 1 -- 172.21.15.31:0/4098116011 learned_addr learned my addr 172.21.15.31:0/4098116011 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:13.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.462+0000 7f2ba55a7700 1 -- 172.21.15.31:0/4098116011 >> v1:172.21.15.158:6789/0 conn(0x7f2ba00b6760 legacy=0x7f2ba00d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:13.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.462+0000 7f2ba55a7700 1 -- 172.21.15.31:0/4098116011 >> v1:172.21.15.31:6789/0 conn(0x7f2ba00d1470 legacy=0x7f2ba00cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:13.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.462+0000 7f2b97fff700 1 -- 172.21.15.31:0/4098116011 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173067447 0 0) 0x7f2ba01513f0 con 0x7f2ba00d1470 2023-10-09T06:30:13.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.462+0000 7f2ba55a7700 1 -- 172.21.15.31:0/4098116011 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba015de00 con 0x7f2ba00cd300 2023-10-09T06:30:13.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.462+0000 7f2ba55a7700 1 --2- 172.21.15.31:0/4098116011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba00cd300 0x7f2ba015afb0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0098e0 tx=0x7f2b9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01965aec662615a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:13.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.462+0000 7f2b97fff700 1 -- 172.21.15.31:0/4098116011 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c009e80 con 0x7f2ba00cd300 2023-10-09T06:30:13.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.462+0000 7f2b97fff700 1 -- 172.21.15.31:0/4098116011 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c00b860 con 0x7f2ba00cd300 2023-10-09T06:30:13.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.462+0000 7f2b97fff700 1 -- 172.21.15.31:0/4098116011 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c00bbe0 con 0x7f2ba00cd300 2023-10-09T06:30:13.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.463+0000 7f2ba780b700 1 -- 172.21.15.31:0/4098116011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba00cd300 msgr2=0x7f2ba015afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:13.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.463+0000 7f2ba780b700 1 --2- 172.21.15.31:0/4098116011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba00cd300 0x7f2ba015afb0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0098e0 tx=0x7f2b9c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.463+0000 7f2ba780b700 1 -- 172.21.15.31:0/4098116011 shutdown_connections 2023-10-09T06:30:13.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.463+0000 7f2ba780b700 1 --2- 172.21.15.31:0/4098116011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba00cd300 0x7f2ba015afb0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.463+0000 7f2ba780b700 1 -- 172.21.15.31:0/4098116011 >> 172.21.15.31:0/4098116011 conn(0x7f2ba0068d90 msgr2=0x7f2ba0069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:13.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.463+0000 7f2ba780b700 1 -- 172.21.15.31:0/4098116011 shutdown_connections 2023-10-09T06:30:13.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.463+0000 7f2ba780b700 1 -- 172.21.15.31:0/4098116011 wait complete. 2023-10-09T06:30:13.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.464+0000 7f2ba780b700 1 Processor -- start 2023-10-09T06:30:13.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.464+0000 7f2ba780b700 1 -- start start 2023-10-09T06:30:13.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba780b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba00b6760 0x7f2ba00b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:13.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba780b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ba00cd300 0x7f2ba0147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:13.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba780b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ba00d1470 0x7f2ba014b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:13.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba780b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba016a670 con 0x7f2ba00b6760 2023-10-09T06:30:13.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba780b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba014b710 con 0x7f2ba00d1470 2023-10-09T06:30:13.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba780b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba016a320 con 0x7f2ba00cd300 2023-10-09T06:30:13.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba55a7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba00b6760 0x7f2ba00b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:13.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba55a7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba00b6760 0x7f2ba00b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51138/0 (socket says 172.21.15.31:51138) 2023-10-09T06:30:13.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba55a7700 1 -- 172.21.15.31:0/1311303961 learned_addr learned my addr 172.21.15.31:0/1311303961 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:13.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba5da8700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ba00d1470 0x7f2ba014b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:13.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba4da6700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ba00cd300 0x7f2ba0147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:13.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba55a7700 1 -- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ba00cd300 msgr2=0x7f2ba0147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:13.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba55a7700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ba00cd300 0x7f2ba0147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba55a7700 1 -- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ba00d1470 msgr2=0x7f2ba014b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:13.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba55a7700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ba00d1470 0x7f2ba014b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:13.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba55a7700 1 -- 172.21.15.31:0/1311303961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c009420 con 0x7f2ba00b6760 2023-10-09T06:30:13.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba5da8700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ba00d1470 0x7f2ba014b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:13.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba55a7700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba00b6760 0x7f2ba00b0670 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0069e00 tx=0x7f2b9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:13.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2b957fa700 1 -- 172.21.15.31:0/1311303961 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c011420 con 0x7f2ba00b6760 2023-10-09T06:30:13.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2b957fa700 1 -- 172.21.15.31:0/1311303961 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c011580 con 0x7f2ba00b6760 2023-10-09T06:30:13.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.465+0000 7f2ba780b700 1 -- 172.21.15.31:0/1311303961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba00b0cc0 con 0x7f2ba00b6760 2023-10-09T06:30:13.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.466+0000 7f2b957fa700 1 -- 172.21.15.31:0/1311303961 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c011920 con 0x7f2ba00b6760 2023-10-09T06:30:13.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.466+0000 7f2ba780b700 1 -- 172.21.15.31:0/1311303961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba00b1280 con 0x7f2ba00b6760 2023-10-09T06:30:13.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.467+0000 7f2ba780b700 1 -- 172.21.15.31:0/1311303961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba004c3c0 con 0x7f2ba00b6760 2023-10-09T06:30:13.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.467+0000 7f2b957fa700 1 -- 172.21.15.31:0/1311303961 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b9c011c90 con 0x7f2ba00b6760 2023-10-09T06:30:13.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.467+0000 7f2b957fa700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2b84066f30 0x7f2b840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:13.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.468+0000 7f2b957fa700 1 -- 172.21.15.31:0/1311303961 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f2b9c086210 con 0x7f2ba00b6760 2023-10-09T06:30:13.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.468+0000 7f2ba4da6700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2b84066f30 0x7f2b840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:13.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.468+0000 7f2b957fa700 1 -- 172.21.15.31:0/1311303961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f2b8406ebb0 con 0x7f2ba00b6760 2023-10-09T06:30:13.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.468+0000 7f2ba4da6700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2b84066f30 0x7f2b840693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2ba014aba0 tx=0x7f2b90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:13.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.472+0000 7f2b957fa700 1 -- 172.21.15.31:0/1311303961 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b9c015060 con 0x7f2ba00b6760 2023-10-09T06:30:13.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:13.710+0000 7f2ba780b700 1 -- 172.21.15.31:0/1311303961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2ba00b4010 con 0x7f2ba00b6760 2023-10-09T06:30:14.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.322+0000 7f2b957fa700 1 -- 172.21.15.31:0/1311303961 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2b9c0533f0 con 0x7f2ba00b6760 2023-10-09T06:30:14.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.324+0000 7f2ba780b700 1 -- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2b84066f30 msgr2=0x7f2b840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:14.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.324+0000 7f2ba780b700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2b84066f30 0x7f2b840693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2ba014aba0 tx=0x7f2b90009040 comp rx=0 tx=0).stop 2023-10-09T06:30:14.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.324+0000 7f2ba780b700 1 -- 172.21.15.31:0/1311303961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba00b6760 msgr2=0x7f2ba00b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:14.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.324+0000 7f2ba780b700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba00b6760 0x7f2ba00b0670 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0069e00 tx=0x7f2b9c017000 comp rx=0 tx=0).stop 2023-10-09T06:30:14.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.325+0000 7f2ba780b700 1 -- 172.21.15.31:0/1311303961 shutdown_connections 2023-10-09T06:30:14.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.325+0000 7f2ba780b700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2b84066f30 0x7f2b840693e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:14.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.325+0000 7f2ba780b700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ba00d1470 0x7f2ba014b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:14.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.325+0000 7f2ba780b700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ba00b6760 0x7f2ba00b0670 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:14.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.325+0000 7f2ba780b700 1 --2- 172.21.15.31:0/1311303961 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2ba00cd300 0x7f2ba0147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:14.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.325+0000 7f2ba780b700 1 -- 172.21.15.31:0/1311303961 >> 172.21.15.31:0/1311303961 conn(0x7f2ba0068d90 msgr2=0x7f2ba014e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:14.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.325+0000 7f2ba780b700 1 -- 172.21.15.31:0/1311303961 shutdown_connections 2023-10-09T06:30:14.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.325+0000 7f2ba780b700 1 -- 172.21.15.31:0/1311303961 wait complete. 2023-10-09T06:30:14.338 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:30:14.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.461+0000 7fbb8a0b0700 1 Processor -- start 2023-10-09T06:30:14.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.461+0000 7fbb8a0b0700 1 -- start start 2023-10-09T06:30:14.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.461+0000 7fbb8a0b0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb84159ef0 0x7fbb8415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:14.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.461+0000 7fbb8a0b0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbb840b6a10 0x7fbb840b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:14.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.461+0000 7fbb8a0b0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb840b1a60 con 0x7fbb840b15e0 2023-10-09T06:30:14.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.461+0000 7fbb8a0b0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb840b1d40 con 0x7fbb84159ef0 2023-10-09T06:30:14.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.461+0000 7fbb8a0b0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb840b2020 con 0x7fbb840b6a10 2023-10-09T06:30:14.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb837fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb84159ef0 0x7fbb8415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:14.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb83fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbb840b15e0 0x7fbb840b46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46338/0 (socket says 172.21.15.31:46338) 2023-10-09T06:30:14.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb83fff700 1 -- 172.21.15.31:0/379680565 learned_addr learned my addr 172.21.15.31:0/379680565 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:14.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb82ffd700 1 --2- 172.21.15.31:0/379680565 >> v2:172.21.15.158:3300/0 conn(0x7fbb840b6a10 0x7fbb840b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:14.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb837fe700 1 -- 172.21.15.31:0/379680565 >> v2:172.21.15.158:3300/0 conn(0x7fbb840b6a10 msgr2=0x7fbb840b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:14.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb837fe700 1 --2- 172.21.15.31:0/379680565 >> v2:172.21.15.158:3300/0 conn(0x7fbb840b6a10 0x7fbb840b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:14.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb837fe700 1 -- 172.21.15.31:0/379680565 >> v1:172.21.15.31:6789/0 conn(0x7fbb840b15e0 legacy=0x7fbb840b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:14.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb837fe700 1 -- 172.21.15.31:0/379680565 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb840b2300 con 0x7fbb84159ef0 2023-10-09T06:30:14.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb827fc700 1 -- 172.21.15.31:0/379680565 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884021607 0 0) 0x7fbb840b1a60 con 0x7fbb840b15e0 2023-10-09T06:30:14.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb82ffd700 1 --2- 172.21.15.31:0/379680565 >> v2:172.21.15.158:3300/0 conn(0x7fbb840b6a10 0x7fbb840b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:14.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb837fe700 1 --2- 172.21.15.31:0/379680565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb84159ef0 0x7fbb8415a2c0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fbb84089550 tx=0x7fbb74009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca89037528633f0f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:14.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb827fc700 1 -- 172.21.15.31:0/379680565 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74005c10 con 0x7fbb84159ef0 2023-10-09T06:30:14.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb827fc700 1 -- 172.21.15.31:0/379680565 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb74005d70 con 0x7fbb84159ef0 2023-10-09T06:30:14.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.462+0000 7fbb827fc700 1 -- 172.21.15.31:0/379680565 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74006260 con 0x7fbb84159ef0 2023-10-09T06:30:14.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.463+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/379680565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb84159ef0 msgr2=0x7fbb8415a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:14.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.463+0000 7fbb8a0b0700 1 --2- 172.21.15.31:0/379680565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb84159ef0 0x7fbb8415a2c0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fbb84089550 tx=0x7fbb74009120 comp rx=0 tx=0).stop 2023-10-09T06:30:14.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.463+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/379680565 shutdown_connections 2023-10-09T06:30:14.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.463+0000 7fbb8a0b0700 1 --2- 172.21.15.31:0/379680565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb84159ef0 0x7fbb8415a2c0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:14.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.463+0000 7fbb8a0b0700 1 --2- 172.21.15.31:0/379680565 >> v2:172.21.15.158:3300/0 conn(0x7fbb840b6a10 0x7fbb840b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:14.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.463+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/379680565 >> 172.21.15.31:0/379680565 conn(0x7fbb8409a0a0 msgr2=0x7fbb84067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:14.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.463+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/379680565 shutdown_connections 2023-10-09T06:30:14.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.463+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/379680565 wait complete. 2023-10-09T06:30:14.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.464+0000 7fbb8a0b0700 1 Processor -- start 2023-10-09T06:30:14.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.464+0000 7fbb8a0b0700 1 -- start start 2023-10-09T06:30:14.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb8a0b0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb840b6a10 0x7fbb84158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:14.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb8a0b0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb84159ef0 0x7fbb84169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:14.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb8a0b0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb8416a480 0x7fbb8409ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:14.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb8a0b0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8416b100 con 0x7fbb840b6a10 2023-10-09T06:30:14.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb8a0b0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8416b9a0 con 0x7fbb8416a480 2023-10-09T06:30:14.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb8a0b0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8416a900 con 0x7fbb84159ef0 2023-10-09T06:30:14.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb837fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb840b6a10 0x7fbb84158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:14.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb837fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb840b6a10 0x7fbb84158b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51154/0 (socket says 172.21.15.31:51154) 2023-10-09T06:30:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb837fe700 1 -- 172.21.15.31:0/245640620 learned_addr learned my addr 172.21.15.31:0/245640620 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb83fff700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb8416a480 0x7fbb8409ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb837fe700 1 -- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb84159ef0 msgr2=0x7fbb84169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb82ffd700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb84159ef0 0x7fbb84169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb837fe700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb84159ef0 0x7fbb84169f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb837fe700 1 -- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb8416a480 msgr2=0x7fbb8409ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb837fe700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb8416a480 0x7fbb8409ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb837fe700 1 -- 172.21.15.31:0/245640620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb740093c0 con 0x7fbb840b6a10 2023-10-09T06:30:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb83fff700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb8416a480 0x7fbb8409ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:14.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb82ffd700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb84159ef0 0x7fbb84169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.465+0000 7fbb837fe700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb840b6a10 0x7fbb84158b80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fbb84071f80 tx=0x7fbb74016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.466+0000 7fbb6b7fe700 1 -- 172.21.15.31:0/245640620 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400bb50 con 0x7fbb840b6a10 2023-10-09T06:30:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.466+0000 7fbb6b7fe700 1 -- 172.21.15.31:0/245640620 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7400bcb0 con 0x7fbb840b6a10 2023-10-09T06:30:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.466+0000 7fbb6b7fe700 1 -- 172.21.15.31:0/245640620 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7401b480 con 0x7fbb840b6a10 2023-10-09T06:30:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.466+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/245640620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8409d7e0 con 0x7fbb840b6a10 2023-10-09T06:30:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.466+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/245640620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8416b630 con 0x7fbb840b6a10 2023-10-09T06:30:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.467+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/245640620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb840b5910 con 0x7fbb840b6a10 2023-10-09T06:30:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.467+0000 7fbb6b7fe700 1 -- 172.21.15.31:0/245640620 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb7401b890 con 0x7fbb840b6a10 2023-10-09T06:30:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.467+0000 7fbb6b7fe700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb70066f30 0x7fbb700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.468+0000 7fbb6b7fe700 1 -- 172.21.15.31:0/245640620 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fbb74086960 con 0x7fbb840b6a10 2023-10-09T06:30:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.468+0000 7fbb82ffd700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb70066f30 0x7fbb700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.468+0000 7fbb6b7fe700 1 -- 172.21.15.31:0/245640620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7fbb7006ebb0 con 0x7fbb840b6a10 2023-10-09T06:30:14.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.468+0000 7fbb82ffd700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb70066f30 0x7fbb700693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb78006f00 tx=0x7fbb78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:14.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.472+0000 7fbb6b7fe700 1 -- 172.21.15.31:0/245640620 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb74053b40 con 0x7fbb840b6a10 2023-10-09T06:30:14.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:14.666+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/245640620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbb8404c3c0 con 0x7fbb840b6a10 2023-10-09T06:30:15.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.332+0000 7fbb6b7fe700 1 -- 172.21.15.31:0/245640620 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(158..158 src has 1..158) v4 ==== 288+0+0 (secure 0 0 0) 0x7fbb74057f00 con 0x7fbb840b6a10 2023-10-09T06:30:15.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.332+0000 7fbb6b7fe700 1 -- 172.21.15.31:0/245640620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7fbb7006cfe0 con 0x7fbb840b6a10 2023-10-09T06:30:15.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.334+0000 7fbb6b7fe700 1 -- 172.21.15.31:0/245640620 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v158) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbb74057160 con 0x7fbb840b6a10 2023-10-09T06:30:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.340+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb70066f30 msgr2=0x7fbb700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.340+0000 7fbb8a0b0700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb70066f30 0x7fbb700693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb78006f00 tx=0x7fbb78008040 comp rx=0 tx=0).stop 2023-10-09T06:30:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.340+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/245640620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb840b6a10 msgr2=0x7fbb84158b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.340+0000 7fbb8a0b0700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb840b6a10 0x7fbb84158b80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fbb84071f80 tx=0x7fbb74016000 comp rx=0 tx=0).stop 2023-10-09T06:30:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.340+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/245640620 shutdown_connections 2023-10-09T06:30:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.340+0000 7fbb8a0b0700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbb70066f30 0x7fbb700693e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:15.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.340+0000 7fbb8a0b0700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb8416a480 0x7fbb8409ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.340+0000 7fbb8a0b0700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb840b6a10 0x7fbb84158b80 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.340+0000 7fbb8a0b0700 1 --2- 172.21.15.31:0/245640620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbb84159ef0 0x7fbb84169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.340+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/245640620 >> 172.21.15.31:0/245640620 conn(0x7fbb8409a0a0 msgr2=0x7fbb840b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.340+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/245640620 shutdown_connections 2023-10-09T06:30:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.340+0000 7fbb8a0b0700 1 -- 172.21.15.31:0/245640620 wait complete. 2023-10-09T06:30:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:30:15.355 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:30:15.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.484+0000 7fd1b99be700 1 Processor -- start 2023-10-09T06:30:15.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.484+0000 7fd1b99be700 1 -- start start 2023-10-09T06:30:15.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.484+0000 7fd1b99be700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1b40b1950 0x7fd1b4158e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:15.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.484+0000 7fd1b99be700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd1b4152520 0x7fd1b40ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:15.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.484+0000 7fd1b99be700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b4159350 con 0x7fd1b40b36c0 2023-10-09T06:30:15.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.484+0000 7fd1b99be700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b40b1110 con 0x7fd1b40b1950 2023-10-09T06:30:15.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.484+0000 7fd1b99be700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b40ae4e0 con 0x7fd1b4152520 2023-10-09T06:30:15.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.485+0000 7fd1aa7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1b40b1950 0x7fd1b4158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:15.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.485+0000 7fd1aa7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1b40b1950 0x7fd1b4158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51162/0 (socket says 172.21.15.31:51162) 2023-10-09T06:30:15.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.485+0000 7fd1aa7fc700 1 -- 172.21.15.31:0/2386534826 learned_addr learned my addr 172.21.15.31:0/2386534826 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:15.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.485+0000 7fd1b37fe700 1 --2- 172.21.15.31:0/2386534826 >> v2:172.21.15.158:3300/0 conn(0x7fd1b4152520 0x7fd1b40ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:15.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.485+0000 7fd1aa7fc700 1 -- 172.21.15.31:0/2386534826 >> v2:172.21.15.158:3300/0 conn(0x7fd1b4152520 msgr2=0x7fd1b40ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:15.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.485+0000 7fd1aa7fc700 1 --2- 172.21.15.31:0/2386534826 >> v2:172.21.15.158:3300/0 conn(0x7fd1b4152520 0x7fd1b40ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:15.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.485+0000 7fd1aa7fc700 1 -- 172.21.15.31:0/2386534826 >> v1:172.21.15.158:6789/0 conn(0x7fd1b40b36c0 legacy=0x7fd1b4151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:15.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.485+0000 7fd1aa7fc700 1 -- 172.21.15.31:0/2386534826 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b40b1ea0 con 0x7fd1b40b1950 2023-10-09T06:30:15.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.485+0000 7fd1aa7fc700 1 --2- 172.21.15.31:0/2386534826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b40b1950 0x7fd1b4158e10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4155f10 tx=0x7fd19c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b165c6df5c329e43 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:15.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.485+0000 7fd1b27fc700 1 -- 172.21.15.31:0/2386534826 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c00b820 con 0x7fd1b40b1950 2023-10-09T06:30:15.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.485+0000 7fd1b27fc700 1 -- 172.21.15.31:0/2386534826 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c00b980 con 0x7fd1b40b1950 2023-10-09T06:30:15.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.485+0000 7fd1b27fc700 1 -- 172.21.15.31:0/2386534826 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c00bd20 con 0x7fd1b40b1950 2023-10-09T06:30:15.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.486+0000 7fd1b99be700 1 -- 172.21.15.31:0/2386534826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b40b1950 msgr2=0x7fd1b4158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:15.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.486+0000 7fd1b99be700 1 --2- 172.21.15.31:0/2386534826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b40b1950 0x7fd1b4158e10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4155f10 tx=0x7fd19c009250 comp rx=0 tx=0).stop 2023-10-09T06:30:15.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.486+0000 7fd1b99be700 1 -- 172.21.15.31:0/2386534826 shutdown_connections 2023-10-09T06:30:15.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.486+0000 7fd1b99be700 1 --2- 172.21.15.31:0/2386534826 >> v2:172.21.15.158:3300/0 conn(0x7fd1b4152520 0x7fd1b40ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:15.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.486+0000 7fd1b99be700 1 --2- 172.21.15.31:0/2386534826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b40b1950 0x7fd1b4158e10 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:15.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.486+0000 7fd1b99be700 1 -- 172.21.15.31:0/2386534826 >> 172.21.15.31:0/2386534826 conn(0x7fd1b4069870 msgr2=0x7fd1b4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:15.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.486+0000 7fd1b99be700 1 -- 172.21.15.31:0/2386534826 shutdown_connections 2023-10-09T06:30:15.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.486+0000 7fd1b99be700 1 -- 172.21.15.31:0/2386534826 wait complete. 2023-10-09T06:30:15.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.487+0000 7fd1b99be700 1 Processor -- start 2023-10-09T06:30:15.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.487+0000 7fd1b99be700 1 -- start start 2023-10-09T06:30:15.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b99be700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b40b1950 0x7fd1b4150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:15.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b99be700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1b40b36c0 0x7fd1b4157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:15.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b99be700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1b4152520 0x7fd1b41579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:15.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b99be700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4067800 con 0x7fd1b40b1950 2023-10-09T06:30:15.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b99be700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4067ae0 con 0x7fd1b40b36c0 2023-10-09T06:30:15.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b99be700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4067dc0 con 0x7fd1b4152520 2023-10-09T06:30:15.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b40b1950 0x7fd1b4150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:15.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b40b1950 0x7fd1b4150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51164/0 (socket says 172.21.15.31:51164) 2023-10-09T06:30:15.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b2ffd700 1 -- 172.21.15.31:0/3999863525 learned_addr learned my addr 172.21.15.31:0/3999863525 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:15.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1aa7fc700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1b40b36c0 0x7fd1b4157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:15.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b37fe700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1b4152520 0x7fd1b41579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:15.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b2ffd700 1 -- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1b4152520 msgr2=0x7fd1b41579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:15.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b2ffd700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1b4152520 0x7fd1b41579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:15.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b2ffd700 1 -- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1b40b36c0 msgr2=0x7fd1b4157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:15.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b2ffd700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1b40b36c0 0x7fd1b4157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:15.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b2ffd700 1 -- 172.21.15.31:0/3999863525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0094f0 con 0x7fd1b40b1950 2023-10-09T06:30:15.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.488+0000 7fd1b2ffd700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b40b1950 0x7fd1b4150990 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400c5d0 tx=0x7fd1a4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:15.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.489+0000 7fd1ab7fe700 1 -- 172.21.15.31:0/3999863525 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4011590 con 0x7fd1b40b1950 2023-10-09T06:30:15.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.489+0000 7fd1ab7fe700 1 -- 172.21.15.31:0/3999863525 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a4011710 con 0x7fd1b40b1950 2023-10-09T06:30:15.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.489+0000 7fd1b99be700 1 -- 172.21.15.31:0/3999863525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b40680a0 con 0x7fd1b40b1950 2023-10-09T06:30:15.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.489+0000 7fd1ab7fe700 1 -- 172.21.15.31:0/3999863525 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4011ad0 con 0x7fd1b40b1950 2023-10-09T06:30:15.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.489+0000 7fd1b99be700 1 -- 172.21.15.31:0/3999863525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b4150ed0 con 0x7fd1b40b1950 2023-10-09T06:30:15.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.490+0000 7fd1b99be700 1 -- 172.21.15.31:0/3999863525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b40685c0 con 0x7fd1b40b1950 2023-10-09T06:30:15.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.490+0000 7fd1ab7fe700 1 -- 172.21.15.31:0/3999863525 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1a401c460 con 0x7fd1b40b1950 2023-10-09T06:30:15.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.491+0000 7fd1ab7fe700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd194066f30 0x7fd1940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:15.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.491+0000 7fd1ab7fe700 1 -- 172.21.15.31:0/3999863525 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5411+0+0 (secure 0 0 0) 0x7fd1a4084210 con 0x7fd1b40b1950 2023-10-09T06:30:15.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.491+0000 7fd1aa7fc700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd194066f30 0x7fd1940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:15.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.491+0000 7fd1ab7fe700 1 -- 172.21.15.31:0/3999863525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7fd19406ddb0 con 0x7fd1b40b1950 2023-10-09T06:30:15.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.492+0000 7fd1aa7fc700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd194066f30 0x7fd1940693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40b1dd0 tx=0x7fd19c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:15.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.495+0000 7fd1ab7fe700 1 -- 172.21.15.31:0/3999863525 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1b40685c0 con 0x7fd1b40b1950 2023-10-09T06:30:15.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:15.692+0000 7fd1b99be700 1 -- 172.21.15.31:0/3999863525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd1b406b900 con 0x7fd1b40b1950 2023-10-09T06:30:16.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.338+0000 7fd1ab7fe700 1 -- 172.21.15.31:0/3999863525 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(159..159 src has 1..159) v4 ==== 322+0+0 (secure 0 0 0) 0x7fd1a4055260 con 0x7fd1b40b1950 2023-10-09T06:30:16.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.338+0000 7fd1ab7fe700 1 -- 172.21.15.31:0/3999863525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7fd19406cb40 con 0x7fd1b40b1950 2023-10-09T06:30:16.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.338+0000 7fd1ab7fe700 1 -- 172.21.15.31:0/3999863525 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v159) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd1a40515a0 con 0x7fd1b40b1950 2023-10-09T06:30:16.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.344+0000 7fd1b99be700 1 -- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd194066f30 msgr2=0x7fd1940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:16.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.344+0000 7fd1b99be700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd194066f30 0x7fd1940693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40b1dd0 tx=0x7fd19c016000 comp rx=0 tx=0).stop 2023-10-09T06:30:16.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.344+0000 7fd1b99be700 1 -- 172.21.15.31:0/3999863525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b40b1950 msgr2=0x7fd1b4150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:16.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.344+0000 7fd1b99be700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b40b1950 0x7fd1b4150990 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400c5d0 tx=0x7fd1a4007f60 comp rx=0 tx=0).stop 2023-10-09T06:30:16.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.345+0000 7fd1b99be700 1 -- 172.21.15.31:0/3999863525 shutdown_connections 2023-10-09T06:30:16.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.345+0000 7fd1b99be700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd194066f30 0x7fd1940693e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.345+0000 7fd1b99be700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd1b4152520 0x7fd1b41579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.345+0000 7fd1b99be700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b40b1950 0x7fd1b4150990 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.345+0000 7fd1b99be700 1 --2- 172.21.15.31:0/3999863525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1b40b36c0 0x7fd1b4157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.345+0000 7fd1b99be700 1 -- 172.21.15.31:0/3999863525 >> 172.21.15.31:0/3999863525 conn(0x7fd1b4069870 msgr2=0x7fd1b406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:16.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.346+0000 7fd1b99be700 1 -- 172.21.15.31:0/3999863525 shutdown_connections 2023-10-09T06:30:16.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.346+0000 7fd1b99be700 1 -- 172.21.15.31:0/3999863525 wait complete. 2023-10-09T06:30:16.348 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2023-10-09T06:30:16.362 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:30:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.486+0000 7f598359e700 1 Processor -- start 2023-10-09T06:30:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.486+0000 7f598359e700 1 -- start start 2023-10-09T06:30:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.487+0000 7f598359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f598406e3d0 0x7f598406c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.487+0000 7f598359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f598406c8c0 0x7f5984067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.487+0000 7f598359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598406f4c0 con 0x7f5984156ad0 2023-10-09T06:30:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.487+0000 7f598359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59840cc4d0 con 0x7f598406c8c0 2023-10-09T06:30:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.487+0000 7f598359e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598406cd10 con 0x7f598406e3d0 2023-10-09T06:30:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.487+0000 7f5982d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f598406c8c0 0x7f5984067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.487+0000 7f598259c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5984156ad0 0x7f5984157bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46352/0 (socket says 172.21.15.31:46352) 2023-10-09T06:30:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.487+0000 7f598259c700 1 -- 172.21.15.31:0/2831713348 learned_addr learned my addr 172.21.15.31:0/2831713348 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.487+0000 7f5981d9b700 1 --2- 172.21.15.31:0/2831713348 >> v2:172.21.15.158:3300/0 conn(0x7f598406e3d0 0x7f598406c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.487+0000 7f5982d9d700 1 -- 172.21.15.31:0/2831713348 >> v2:172.21.15.158:3300/0 conn(0x7f598406e3d0 msgr2=0x7f598406c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.487+0000 7f5982d9d700 1 --2- 172.21.15.31:0/2831713348 >> v2:172.21.15.158:3300/0 conn(0x7f598406e3d0 0x7f598406c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.487+0000 7f5982d9d700 1 -- 172.21.15.31:0/2831713348 >> v1:172.21.15.31:6789/0 conn(0x7f5984156ad0 legacy=0x7f5984157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.488+0000 7f5982d9d700 1 -- 172.21.15.31:0/2831713348 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598406e8b0 con 0x7f598406c8c0 2023-10-09T06:30:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.487+0000 7f598159a700 1 -- 172.21.15.31:0/2831713348 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050638331 0 0) 0x7f598406f4c0 con 0x7f5984156ad0 2023-10-09T06:30:16.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.488+0000 7f5981d9b700 1 --2- 172.21.15.31:0/2831713348 >> v2:172.21.15.158:3300/0 conn(0x7f598406e3d0 0x7f598406c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:16.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.488+0000 7f5982d9d700 1 --2- 172.21.15.31:0/2831713348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f598406c8c0 0x7f5984067a90 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f5984158580 tx=0x7f59740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e304b4090780609a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:16.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.488+0000 7f598159a700 1 -- 172.21.15.31:0/2831713348 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400b6b0 con 0x7f598406c8c0 2023-10-09T06:30:16.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.488+0000 7f598159a700 1 -- 172.21.15.31:0/2831713348 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597400b810 con 0x7f598406c8c0 2023-10-09T06:30:16.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.488+0000 7f598159a700 1 -- 172.21.15.31:0/2831713348 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400bbb0 con 0x7f598406c8c0 2023-10-09T06:30:16.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.488+0000 7f598359e700 1 -- 172.21.15.31:0/2831713348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f598406c8c0 msgr2=0x7f5984067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:16.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.488+0000 7f598359e700 1 --2- 172.21.15.31:0/2831713348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f598406c8c0 0x7f5984067a90 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f5984158580 tx=0x7f59740091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.488+0000 7f598359e700 1 -- 172.21.15.31:0/2831713348 shutdown_connections 2023-10-09T06:30:16.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.488+0000 7f598359e700 1 --2- 172.21.15.31:0/2831713348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f598406c8c0 0x7f5984067a90 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.488+0000 7f598359e700 1 --2- 172.21.15.31:0/2831713348 >> v2:172.21.15.158:3300/0 conn(0x7f598406e3d0 0x7f598406c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.488+0000 7f598359e700 1 -- 172.21.15.31:0/2831713348 >> 172.21.15.31:0/2831713348 conn(0x7f59840cb0a0 msgr2=0x7f598406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:16.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.489+0000 7f598359e700 1 -- 172.21.15.31:0/2831713348 shutdown_connections 2023-10-09T06:30:16.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.489+0000 7f598359e700 1 -- 172.21.15.31:0/2831713348 wait complete. 2023-10-09T06:30:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.490+0000 7f598359e700 1 Processor -- start 2023-10-09T06:30:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.490+0000 7f598359e700 1 -- start start 2023-10-09T06:30:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.490+0000 7f598359e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598406c8c0 0x7f59841481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.490+0000 7f598359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f598406e3d0 0x7f59840c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.490+0000 7f598359e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5984156ad0 0x7f5984070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.490+0000 7f598359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59840c6710 con 0x7f598406e3d0 2023-10-09T06:30:16.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.490+0000 7f598359e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59840b0900 con 0x7f5984156ad0 2023-10-09T06:30:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.490+0000 7f598359e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59840b0be0 con 0x7f598406c8c0 2023-10-09T06:30:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f5981d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f598406e3d0 0x7f59840c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f5981d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f598406e3d0 0x7f59840c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51174/0 (socket says 172.21.15.31:51174) 2023-10-09T06:30:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f5981d9b700 1 -- 172.21.15.31:0/886267121 learned_addr learned my addr 172.21.15.31:0/886267121 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f598259c700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598406c8c0 0x7f59841481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f5982d9d700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5984156ad0 0x7f5984070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f5981d9b700 1 -- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598406c8c0 msgr2=0x7f59841481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:16.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f5981d9b700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598406c8c0 0x7f59841481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f5981d9b700 1 -- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5984156ad0 msgr2=0x7f5984070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f5981d9b700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5984156ad0 0x7f5984070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f5981d9b700 1 -- 172.21.15.31:0/886267121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974009420 con 0x7f598406e3d0 2023-10-09T06:30:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f5981d9b700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f598406e3d0 0x7f59840c42c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f596c00c8b0 tx=0x7f596c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f597a7fc700 1 -- 172.21.15.31:0/886267121 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c011600 con 0x7f598406e3d0 2023-10-09T06:30:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f597a7fc700 1 -- 172.21.15.31:0/886267121 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c011760 con 0x7f598406e3d0 2023-10-09T06:30:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f598359e700 1 -- 172.21.15.31:0/886267121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59840c6900 con 0x7f598406e3d0 2023-10-09T06:30:16.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f597a7fc700 1 -- 172.21.15.31:0/886267121 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c011b00 con 0x7f598406e3d0 2023-10-09T06:30:16.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.491+0000 7f598359e700 1 -- 172.21.15.31:0/886267121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59840c6e80 con 0x7f598406e3d0 2023-10-09T06:30:16.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.492+0000 7f598359e700 1 -- 172.21.15.31:0/886267121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598406d8f0 con 0x7f598406e3d0 2023-10-09T06:30:16.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.493+0000 7f597a7fc700 1 -- 172.21.15.31:0/886267121 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f596c0193b0 con 0x7f598406e3d0 2023-10-09T06:30:16.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.493+0000 7f597a7fc700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5964066f30 0x7f59640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.493+0000 7f597a7fc700 1 -- 172.21.15.31:0/886267121 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f596c084120 con 0x7f598406e3d0 2023-10-09T06:30:16.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.493+0000 7f598259c700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5964066f30 0x7f59640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.494+0000 7f598259c700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5964066f30 0x7f59640693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f597c002230 tx=0x7f597c001a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:16.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.497+0000 7f597a7fc700 1 -- 172.21.15.31:0/886267121 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f596c051690 con 0x7f598406e3d0 2023-10-09T06:30:16.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.693+0000 7f598359e700 1 -- 172.21.15.31:0/886267121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f59840b0d20 con 0x7f598406e3d0 2023-10-09T06:30:16.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.697+0000 7f597a7fc700 1 -- 172.21.15.31:0/886267121 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f596c054cb0 con 0x7f598406e3d0 2023-10-09T06:30:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.699+0000 7f598359e700 1 -- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5964066f30 msgr2=0x7f59640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.699+0000 7f598359e700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5964066f30 0x7f59640693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f597c002230 tx=0x7f597c001a20 comp rx=0 tx=0).stop 2023-10-09T06:30:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.699+0000 7f598359e700 1 -- 172.21.15.31:0/886267121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f598406e3d0 msgr2=0x7f59840c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.699+0000 7f598359e700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f598406e3d0 0x7f59840c42c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f596c00c8b0 tx=0x7f596c008040 comp rx=0 tx=0).stop 2023-10-09T06:30:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.699+0000 7f598359e700 1 -- 172.21.15.31:0/886267121 shutdown_connections 2023-10-09T06:30:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.699+0000 7f598359e700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5964066f30 0x7f59640693e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.699+0000 7f598359e700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f598406c8c0 0x7f59841481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.699+0000 7f598359e700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5984156ad0 0x7f5984070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.699+0000 7f598359e700 1 --2- 172.21.15.31:0/886267121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f598406e3d0 0x7f59840c42c0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.699+0000 7f598359e700 1 -- 172.21.15.31:0/886267121 >> 172.21.15.31:0/886267121 conn(0x7f59840cb0a0 msgr2=0x7f59840c89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:16.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.699+0000 7f598359e700 1 -- 172.21.15.31:0/886267121 shutdown_connections 2023-10-09T06:30:16.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.699+0000 7f598359e700 1 -- 172.21.15.31:0/886267121 wait complete. 2023-10-09T06:30:16.712 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-09T06:30:16.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.831+0000 7f0422ef6700 1 Processor -- start 2023-10-09T06:30:16.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.831+0000 7f0422ef6700 1 -- start start 2023-10-09T06:30:16.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.831+0000 7f0422ef6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f041c157c40 0x7f041c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.831+0000 7f0422ef6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c15cbb0 con 0x7f041c15a620 2023-10-09T06:30:16.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.831+0000 7f0422ef6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c15bfa0 con 0x7f041c157870 2023-10-09T06:30:16.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.831+0000 7f0422ef6700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c15bdb0 con 0x7f041c157c40 2023-10-09T06:30:16.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041bfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f041c15a620 0x7f041c15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46364/0 (socket says 172.21.15.31:46364) 2023-10-09T06:30:16.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041bfff700 1 -- 172.21.15.31:0/773861001 learned_addr learned my addr 172.21.15.31:0/773861001 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:16.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f0421493700 1 --2- 172.21.15.31:0/773861001 >> v2:172.21.15.158:3300/0 conn(0x7f041c157c40 0x7f041c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841945285 0 0) 0x7f041c15cbb0 con 0x7f041c15a620 2023-10-09T06:30:16.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0404003570 con 0x7f041c15a620 2023-10-09T06:30:16.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3563063835 0 0) 0x7f0404003570 con 0x7f041c15a620 2023-10-09T06:30:16.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 >> v2:172.21.15.158:3300/0 conn(0x7f041c157c40 msgr2=0x7f041c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:16.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 --2- 172.21.15.31:0/773861001 >> v2:172.21.15.158:3300/0 conn(0x7f041c157c40 0x7f041c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 >> v1:172.21.15.158:6789/0 conn(0x7f041c157870 legacy=0x7f041c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:16.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c15c280 con 0x7f041c15a620 2023-10-09T06:30:16.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f0410001470 con 0x7f041c15a620 2023-10-09T06:30:16.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 >> v1:172.21.15.31:6789/0 conn(0x7f041c15a620 legacy=0x7f041c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:16.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 --2- 172.21.15.31:0/773861001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0404003a60 0x7f0404003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 --2- 172.21.15.31:0/773861001 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0404004810 0x7f0404004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 --2- 172.21.15.31:0/773861001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040051c0 0x7f040400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040400c130 con 0x7f04040051c0 2023-10-09T06:30:16.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040400c2a0 con 0x7f0404003a60 2023-10-09T06:30:16.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040400c460 con 0x7f0404004810 2023-10-09T06:30:16.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.832+0000 7f0421493700 1 --2- 172.21.15.31:0/773861001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040051c0 0x7f040400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f0420c92700 1 --2- 172.21.15.31:0/773861001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0404003a60 0x7f0404003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f041bfff700 1 --2- 172.21.15.31:0/773861001 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0404004810 0x7f0404004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f0421493700 1 -- 172.21.15.31:0/773861001 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0404004810 msgr2=0x7f0404004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:16.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f0421493700 1 --2- 172.21.15.31:0/773861001 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0404004810 0x7f0404004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f0421493700 1 -- 172.21.15.31:0/773861001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0404003a60 msgr2=0x7f0404003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:16.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f0421493700 1 --2- 172.21.15.31:0/773861001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0404003a60 0x7f0404003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f0421493700 1 -- 172.21.15.31:0/773861001 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0404003570 con 0x7f04040051c0 2023-10-09T06:30:16.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f041bfff700 1 --2- 172.21.15.31:0/773861001 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0404004810 0x7f0404004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:16.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f0421493700 1 -- 172.21.15.31:0/773861001 reap_dead start 2023-10-09T06:30:16.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f0421493700 1 --2- 172.21.15.31:0/773861001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040051c0 0x7f040400ba60 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f041c1580c0 tx=0x7f041400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d247c9c105017cf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:16.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400ea90 con 0x7f04040051c0 2023-10-09T06:30:16.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041400f040 con 0x7f04040051c0 2023-10-09T06:30:16.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f041b7fe700 1 -- 172.21.15.31:0/773861001 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400ee60 con 0x7f04040051c0 2023-10-09T06:30:16.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f0422ef6700 1 -- 172.21.15.31:0/773861001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040051c0 msgr2=0x7f040400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:16.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.833+0000 7f0422ef6700 1 --2- 172.21.15.31:0/773861001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040051c0 0x7f040400ba60 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f041c1580c0 tx=0x7f041400b040 comp rx=0 tx=0).stop 2023-10-09T06:30:16.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.834+0000 7f0422ef6700 1 -- 172.21.15.31:0/773861001 shutdown_connections 2023-10-09T06:30:16.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.834+0000 7f0422ef6700 1 --2- 172.21.15.31:0/773861001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040051c0 0x7f040400ba60 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.834+0000 7f0422ef6700 1 -- 172.21.15.31:0/773861001 >> 172.21.15.31:0/773861001 conn(0x7f041c068ce0 msgr2=0x7f041c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:16.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.834+0000 7f0422ef6700 1 -- 172.21.15.31:0/773861001 shutdown_connections 2023-10-09T06:30:16.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.834+0000 7f0422ef6700 1 -- 172.21.15.31:0/773861001 wait complete. 2023-10-09T06:30:16.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.835+0000 7f0422ef6700 1 Processor -- start 2023-10-09T06:30:16.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.835+0000 7f0422ef6700 1 -- start start 2023-10-09T06:30:16.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0422ef6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04040051c0 0x7f041c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0422ef6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f041c0b0610 0x7f041c0b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0422ef6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f041c150e10 0x7f041c151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0422ef6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0b0fc0 con 0x7f041c150e10 2023-10-09T06:30:16.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0422ef6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0b1290 con 0x7f041c0b0610 2023-10-09T06:30:16.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0422ef6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0b1570 con 0x7f04040051c0 2023-10-09T06:30:16.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0421493700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f041c150e10 0x7f041c151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0421493700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f041c150e10 0x7f041c151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51198/0 (socket says 172.21.15.31:51198) 2023-10-09T06:30:16.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0421493700 1 -- 172.21.15.31:0/1038448551 learned_addr learned my addr 172.21.15.31:0/1038448551 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:16.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f041bfff700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f041c0b0610 0x7f041c0b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0420c92700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04040051c0 0x7f041c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0421493700 1 -- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04040051c0 msgr2=0x7f041c0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:16.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0421493700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04040051c0 0x7f041c0b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0421493700 1 -- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f041c0b0610 msgr2=0x7f041c0b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:16.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0421493700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f041c0b0610 0x7f041c0b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:16.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0421493700 1 -- 172.21.15.31:0/1038448551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0b1850 con 0x7f041c150e10 2023-10-09T06:30:16.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f041bfff700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f041c0b0610 0x7f041c0b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:16.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0421493700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f041c150e10 0x7f041c151290 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f041400afd0 tx=0x7f041401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:16.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0418ff9700 1 -- 172.21.15.31:0/1038448551 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400ee90 con 0x7f041c150e10 2023-10-09T06:30:16.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0418ff9700 1 -- 172.21.15.31:0/1038448551 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041401d630 con 0x7f041c150e10 2023-10-09T06:30:16.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0418ff9700 1 -- 172.21.15.31:0/1038448551 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041401d9f0 con 0x7f041c150e10 2023-10-09T06:30:16.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0422ef6700 1 -- 172.21.15.31:0/1038448551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c0b1b30 con 0x7f041c150e10 2023-10-09T06:30:16.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.836+0000 7f0422ef6700 1 -- 172.21.15.31:0/1038448551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c0b3230 con 0x7f041c150e10 2023-10-09T06:30:16.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.837+0000 7f0422ef6700 1 -- 172.21.15.31:0/1038448551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c0b2050 con 0x7f041c150e10 2023-10-09T06:30:16.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.838+0000 7f0418ff9700 1 -- 172.21.15.31:0/1038448551 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04140133e0 con 0x7f041c150e10 2023-10-09T06:30:16.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.838+0000 7f0418ff9700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0408066f30 0x7f04080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:16.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.838+0000 7f0418ff9700 1 -- 172.21.15.31:0/1038448551 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0414086050 con 0x7f041c150e10 2023-10-09T06:30:16.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.838+0000 7f0420c92700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0408066f30 0x7f04080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:16.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.839+0000 7f0420c92700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0408066f30 0x7f04080693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f040c0039c0 tx=0x7f040c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:16.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:16.842+0000 7f0418ff9700 1 -- 172.21.15.31:0/1038448551 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f041c0b2050 con 0x7f041c150e10 2023-10-09T06:30:17.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.112+0000 7f0422ef6700 1 -- 172.21.15.31:0/1038448551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f041c0b2050 con 0x7f041c150e10 2023-10-09T06:30:17.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.937+0000 7f0418ff9700 1 -- 172.21.15.31:0/1038448551 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v449) v1 ==== 132+0+0 (secure 0 0 0) 0x7f041c0b2050 con 0x7f041c150e10 2023-10-09T06:30:17.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.940+0000 7f0422ef6700 1 -- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0408066f30 msgr2=0x7f04080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.940+0000 7f0422ef6700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0408066f30 0x7f04080693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f040c0039c0 tx=0x7f040c009040 comp rx=0 tx=0).stop 2023-10-09T06:30:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.940+0000 7f0422ef6700 1 -- 172.21.15.31:0/1038448551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f041c150e10 msgr2=0x7f041c151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.940+0000 7f0422ef6700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f041c150e10 0x7f041c151290 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f041400afd0 tx=0x7f041401a000 comp rx=0 tx=0).stop 2023-10-09T06:30:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.940+0000 7f0422ef6700 1 -- 172.21.15.31:0/1038448551 shutdown_connections 2023-10-09T06:30:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.940+0000 7f0422ef6700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0408066f30 0x7f04080693e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.940+0000 7f0422ef6700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04040051c0 0x7f041c0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.940+0000 7f0422ef6700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f041c150e10 0x7f041c151290 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.940+0000 7f0422ef6700 1 --2- 172.21.15.31:0/1038448551 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f041c0b0610 0x7f041c0b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.940+0000 7f0422ef6700 1 -- 172.21.15.31:0/1038448551 >> 172.21.15.31:0/1038448551 conn(0x7f041c068ce0 msgr2=0x7f041c0b47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.940+0000 7f0422ef6700 1 -- 172.21.15.31:0/1038448551 shutdown_connections 2023-10-09T06:30:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:17.940+0000 7f0422ef6700 1 -- 172.21.15.31:0/1038448551 wait complete. 2023-10-09T06:30:17.954 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-09T06:30:17.954 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-10-09T06:30:17.954 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-10-09T06:30:17.954 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-09T06:30:18.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.075+0000 7fb64c350700 1 Processor -- start 2023-10-09T06:30:18.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.075+0000 7fb64c350700 1 -- start start 2023-10-09T06:30:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.076+0000 7fb64c350700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb644157870 0x7fb64415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.076+0000 7fb64c350700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb644157c40 0x7fb644158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.076+0000 7fb64c350700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64415cbb0 con 0x7fb64415a620 2023-10-09T06:30:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.076+0000 7fb64c350700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64415bfa0 con 0x7fb644157870 2023-10-09T06:30:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.076+0000 7fb64c350700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64415c280 con 0x7fb644157c40 2023-10-09T06:30:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.076+0000 7fb64a8ed700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb644157c40 0x7fb644158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.076+0000 7fb64a0ec700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb644157870 0x7fb64415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.076+0000 7fb6498eb700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fb64415a620 0x7fb64415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:44836/0 (socket says 172.21.15.31:44836) 2023-10-09T06:30:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.076+0000 7fb6498eb700 1 -- 172.21.15.31:0/2723561810 learned_addr learned my addr 172.21.15.31:0/2723561810 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.076+0000 7fb64a0ec700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb644157870 0x7fb64415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:59510/0 (socket says 172.21.15.31:59510) 2023-10-09T06:30:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.077+0000 7fb64a0ec700 1 -- 172.21.15.31:0/2723561810 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb644157c40 msgr2=0x7fb644158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.077+0000 7fb64a0ec700 1 --2- 172.21.15.31:0/2723561810 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb644157c40 0x7fb644158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.077+0000 7fb64a0ec700 1 -- 172.21.15.31:0/2723561810 >> v1:172.21.15.158:6789/0 conn(0x7fb64415a620 legacy=0x7fb64415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.077+0000 7fb64a0ec700 1 -- 172.21.15.31:0/2723561810 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64415c560 con 0x7fb644157870 2023-10-09T06:30:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.077+0000 7fb64a8ed700 1 --2- 172.21.15.31:0/2723561810 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb644157c40 0x7fb644158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:30:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.077+0000 7fb6490ea700 1 -- 172.21.15.31:0/2723561810 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203099877 0 0) 0x7fb64415cbb0 con 0x7fb64415a620 2023-10-09T06:30:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.077+0000 7fb64a0ec700 1 --2- 172.21.15.31:0/2723561810 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb644157870 0x7fb64415b6a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0098e0 tx=0x7fb63c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdb9c199e5c79ae9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.077+0000 7fb6490ea700 1 -- 172.21.15.31:0/2723561810 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00b640 con 0x7fb644157870 2023-10-09T06:30:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.077+0000 7fb6490ea700 1 -- 172.21.15.31:0/2723561810 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c00b7a0 con 0x7fb644157870 2023-10-09T06:30:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.077+0000 7fb6490ea700 1 -- 172.21.15.31:0/2723561810 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00bb40 con 0x7fb644157870 2023-10-09T06:30:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.078+0000 7fb64c350700 1 -- 172.21.15.31:0/2723561810 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb644157870 msgr2=0x7fb64415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:18.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.078+0000 7fb64c350700 1 --2- 172.21.15.31:0/2723561810 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb644157870 0x7fb64415b6a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0098e0 tx=0x7fb63c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:18.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.078+0000 7fb64c350700 1 -- 172.21.15.31:0/2723561810 shutdown_connections 2023-10-09T06:30:18.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.078+0000 7fb64c350700 1 --2- 172.21.15.31:0/2723561810 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb644157870 0x7fb64415b6a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:18.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.078+0000 7fb64c350700 1 --2- 172.21.15.31:0/2723561810 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb644157c40 0x7fb644158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:18.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.078+0000 7fb64c350700 1 -- 172.21.15.31:0/2723561810 >> 172.21.15.31:0/2723561810 conn(0x7fb644068ce0 msgr2=0x7fb6440690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:18.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.078+0000 7fb64c350700 1 -- 172.21.15.31:0/2723561810 shutdown_connections 2023-10-09T06:30:18.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.078+0000 7fb64c350700 1 -- 172.21.15.31:0/2723561810 wait complete. 2023-10-09T06:30:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.079+0000 7fb64c350700 1 Processor -- start 2023-10-09T06:30:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.079+0000 7fb64c350700 1 -- start start 2023-10-09T06:30:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb64c350700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb644157870 0x7fb644151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb64c350700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb644157c40 0x7fb644153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb64c350700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb64415a620 0x7fb644140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb64c350700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb644153c80 con 0x7fb644157c40 2023-10-09T06:30:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb64c350700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb644154a80 con 0x7fb64415a620 2023-10-09T06:30:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb64c350700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64414ff70 con 0x7fb644157870 2023-10-09T06:30:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb6498eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb644157c40 0x7fb644153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb6498eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb644157c40 0x7fb644153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51212/0 (socket says 172.21.15.31:51212) 2023-10-09T06:30:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb6498eb700 1 -- 172.21.15.31:0/1350891853 learned_addr learned my addr 172.21.15.31:0/1350891853 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb64a0ec700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb644157870 0x7fb644151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb64a8ed700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb64415a620 0x7fb644140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb6498eb700 1 -- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb644157870 msgr2=0x7fb644151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb6498eb700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb644157870 0x7fb644151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb6498eb700 1 -- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb64415a620 msgr2=0x7fb644140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb6498eb700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb64415a620 0x7fb644140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb6498eb700 1 -- 172.21.15.31:0/1350891853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb634009a20 con 0x7fb644157c40 2023-10-09T06:30:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb6498eb700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb644157c40 0x7fb644153740 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fb63800c610 tx=0x7fb638000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb6427fc700 1 -- 172.21.15.31:0/1350891853 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638005b30 con 0x7fb644157c40 2023-10-09T06:30:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb6427fc700 1 -- 172.21.15.31:0/1350891853 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb638005c90 con 0x7fb644157c40 2023-10-09T06:30:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb6427fc700 1 -- 172.21.15.31:0/1350891853 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638007300 con 0x7fb644157c40 2023-10-09T06:30:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb64c350700 1 -- 172.21.15.31:0/1350891853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c009420 con 0x7fb644157c40 2023-10-09T06:30:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.080+0000 7fb64c350700 1 -- 172.21.15.31:0/1350891853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb644154430 con 0x7fb644157c40 2023-10-09T06:30:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.081+0000 7fb64c350700 1 -- 172.21.15.31:0/1350891853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb644154c10 con 0x7fb644157c40 2023-10-09T06:30:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.082+0000 7fb6427fc700 1 -- 172.21.15.31:0/1350891853 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb63801b3b0 con 0x7fb644157c40 2023-10-09T06:30:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.082+0000 7fb6427fc700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb630066f30 0x7fb6300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.082+0000 7fb6427fc700 1 -- 172.21.15.31:0/1350891853 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb638083600 con 0x7fb644157c40 2023-10-09T06:30:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.082+0000 7fb64a0ec700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb630066f30 0x7fb6300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.083+0000 7fb64a0ec700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb630066f30 0x7fb6300693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0093f0 tx=0x7fb63c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.086+0000 7fb6427fc700 1 -- 172.21.15.31:0/1350891853 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb638050c30 con 0x7fb644157c40 2023-10-09T06:30:18.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.356+0000 7fb64c350700 1 -- 172.21.15.31:0/1350891853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7fb64415c840 con 0x7fb644157c40 2023-10-09T06:30:18.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.944+0000 7fb6427fc700 1 -- 172.21.15.31:0/1350891853 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v450) v1 ==== 134+0+0 (secure 0 0 0) 0x7fb638054250 con 0x7fb644157c40 2023-10-09T06:30:18.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.946+0000 7fb64c350700 1 -- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb630066f30 msgr2=0x7fb6300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:18.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.946+0000 7fb64c350700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb630066f30 0x7fb6300693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0093f0 tx=0x7fb63c017000 comp rx=0 tx=0).stop 2023-10-09T06:30:18.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.946+0000 7fb64c350700 1 -- 172.21.15.31:0/1350891853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb644157c40 msgr2=0x7fb644153740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:18.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.946+0000 7fb64c350700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb644157c40 0x7fb644153740 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fb63800c610 tx=0x7fb638000fe0 comp rx=0 tx=0).stop 2023-10-09T06:30:18.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.946+0000 7fb64c350700 1 -- 172.21.15.31:0/1350891853 shutdown_connections 2023-10-09T06:30:18.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.946+0000 7fb64c350700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb630066f30 0x7fb6300693e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:18.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.946+0000 7fb64c350700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb644157870 0x7fb644151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:18.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.946+0000 7fb64c350700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb64415a620 0x7fb644140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:18.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.946+0000 7fb64c350700 1 --2- 172.21.15.31:0/1350891853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb644157c40 0x7fb644153740 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:18.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.946+0000 7fb64c350700 1 -- 172.21.15.31:0/1350891853 >> 172.21.15.31:0/1350891853 conn(0x7fb644068ce0 msgr2=0x7fb6440d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:18.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.946+0000 7fb64c350700 1 -- 172.21.15.31:0/1350891853 shutdown_connections 2023-10-09T06:30:18.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:18.946+0000 7fb64c350700 1 -- 172.21.15.31:0/1350891853 wait complete. 2023-10-09T06:30:18.960 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:30:19.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.083+0000 7f6811c5c700 1 Processor -- start 2023-10-09T06:30:19.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.083+0000 7f6811c5c700 1 -- start start 2023-10-09T06:30:19.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.084+0000 7f6811c5c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c06aa00 0x7f680c164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.084+0000 7f6811c5c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c0b4d70 con 0x7f680c0b6580 2023-10-09T06:30:19.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.084+0000 7f6811c5c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c15b3b0 con 0x7f680c0cce30 2023-10-09T06:30:19.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.084+0000 7f6811c5c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0cd8d0 con 0x7f680c06aa00 2023-10-09T06:30:19.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.084+0000 7f680bfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f680c0b6580 0x7f680c06a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46368/0 (socket says 172.21.15.31:46368) 2023-10-09T06:30:19.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.084+0000 7f680bfff700 1 -- 172.21.15.31:0/1252180371 learned_addr learned my addr 172.21.15.31:0/1252180371 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:19.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f681145b700 1 --2- 172.21.15.31:0/1252180371 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c06aa00 0x7f680c164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112364662 0 0) 0x7f680c0b4d70 con 0x7f680c0b6580 2023-10-09T06:30:19.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f4003570 con 0x7f680c0b6580 2023-10-09T06:30:19.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2298115177 0 0) 0x7f67f4003570 con 0x7f680c0b6580 2023-10-09T06:30:19.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c06aa00 msgr2=0x7f680c164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:19.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 --2- 172.21.15.31:0/1252180371 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c06aa00 0x7f680c164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 >> v1:172.21.15.158:6789/0 conn(0x7f680c0cce30 legacy=0x7f680c15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0b4440 con 0x7f680c0b6580 2023-10-09T06:30:19.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f6800001470 con 0x7f680c0b6580 2023-10-09T06:30:19.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 >> v1:172.21.15.31:6789/0 conn(0x7f680c0b6580 legacy=0x7f680c06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 --2- 172.21.15.31:0/1252180371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f4003a90 0x7f67f4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 --2- 172.21.15.31:0/1252180371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f67f4004810 0x7f67f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 --2- 172.21.15.31:0/1252180371 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c06aa00 0x7f67f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0cd8d0 con 0x7f67f4003a90 2023-10-09T06:30:19.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f400bb10 con 0x7f67f4004810 2023-10-09T06:30:19.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f400bcd0 con 0x7f680c06aa00 2023-10-09T06:30:19.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f6810c5a700 1 --2- 172.21.15.31:0/1252180371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f4003a90 0x7f67f4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f680bfff700 1 --2- 172.21.15.31:0/1252180371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f67f4004810 0x7f67f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f681145b700 1 --2- 172.21.15.31:0/1252180371 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c06aa00 0x7f67f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f6810c5a700 1 -- 172.21.15.31:0/1252180371 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c06aa00 msgr2=0x7f67f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:19.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f6810c5a700 1 --2- 172.21.15.31:0/1252180371 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c06aa00 0x7f67f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f6810c5a700 1 -- 172.21.15.31:0/1252180371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f67f4004810 msgr2=0x7f67f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:19.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f6810c5a700 1 --2- 172.21.15.31:0/1252180371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f67f4004810 0x7f67f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f6810c5a700 1 -- 172.21.15.31:0/1252180371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f4003570 con 0x7f67f4003a90 2023-10-09T06:30:19.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.085+0000 7f681145b700 1 --2- 172.21.15.31:0/1252180371 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c06aa00 0x7f67f40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:19.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.086+0000 7f6810c5a700 1 --2- 172.21.15.31:0/1252180371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f4003a90 0x7f67f4003e60 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f67fc001960 tx=0x7f67fc007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5764721b296e6eb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:19.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.086+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00c5d0 con 0x7f67f4003a90 2023-10-09T06:30:19.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.086+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc00c730 con 0x7f67f4003a90 2023-10-09T06:30:19.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.086+0000 7f680b7fe700 1 -- 172.21.15.31:0/1252180371 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00cad0 con 0x7f67f4003a90 2023-10-09T06:30:19.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.086+0000 7f6811c5c700 1 -- 172.21.15.31:0/1252180371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f4003a90 msgr2=0x7f67f4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.086+0000 7f6811c5c700 1 --2- 172.21.15.31:0/1252180371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f4003a90 0x7f67f4003e60 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f67fc001960 tx=0x7f67fc007d10 comp rx=0 tx=0).stop 2023-10-09T06:30:19.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.086+0000 7f681145b700 1 -- 172.21.15.31:0/1252180371 reap_dead start 2023-10-09T06:30:19.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.086+0000 7f6811c5c700 1 -- 172.21.15.31:0/1252180371 shutdown_connections 2023-10-09T06:30:19.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.086+0000 7f6811c5c700 1 -- 172.21.15.31:0/1252180371 >> 172.21.15.31:0/1252180371 conn(0x7f680c068cb0 msgr2=0x7f680c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:19.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.086+0000 7f6811c5c700 1 -- 172.21.15.31:0/1252180371 shutdown_connections 2023-10-09T06:30:19.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.086+0000 7f6811c5c700 1 -- 172.21.15.31:0/1252180371 wait complete. 2023-10-09T06:30:19.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.087+0000 7f6811c5c700 1 Processor -- start 2023-10-09T06:30:19.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.088+0000 7f6811c5c700 1 -- start start 2023-10-09T06:30:19.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.088+0000 7f6811c5c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f4003a90 0x7f680c0b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.088+0000 7f6811c5c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c145670 0x7f680c145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.088+0000 7f6811c5c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c0b11b0 0x7f680c14da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.088+0000 7f6811c5c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0b0480 con 0x7f67f4003a90 2023-10-09T06:30:19.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.088+0000 7f6811c5c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0b0d20 con 0x7f680c145670 2023-10-09T06:30:19.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.088+0000 7f6811c5c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c16aeb0 con 0x7f680c0b11b0 2023-10-09T06:30:19.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.088+0000 7f6810c5a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f4003a90 0x7f680c0b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.088+0000 7f6810c5a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f4003a90 0x7f680c0b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51234/0 (socket says 172.21.15.31:51234) 2023-10-09T06:30:19.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f6810c5a700 1 -- 172.21.15.31:0/1879699621 learned_addr learned my addr 172.21.15.31:0/1879699621 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:19.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f680bfff700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c145670 0x7f680c145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f681145b700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c0b11b0 0x7f680c14da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f6810c5a700 1 -- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c0b11b0 msgr2=0x7f680c14da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f6810c5a700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c0b11b0 0x7f680c14da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f6810c5a700 1 -- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c145670 msgr2=0x7f680c145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f6810c5a700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c145670 0x7f680c145010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f6810c5a700 1 -- 172.21.15.31:0/1879699621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0b06d0 con 0x7f67f4003a90 2023-10-09T06:30:19.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f681145b700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c0b11b0 0x7f680c14da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:19.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f680bfff700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c145670 0x7f680c145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:19.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f6810c5a700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f4003a90 0x7f680c0b2dd0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f67f4004770 tx=0x7f67fc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:19.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f6808ff9700 1 -- 172.21.15.31:0/1879699621 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00ce40 con 0x7f67f4003a90 2023-10-09T06:30:19.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f6808ff9700 1 -- 172.21.15.31:0/1879699621 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc00c8a0 con 0x7f67f4003a90 2023-10-09T06:30:19.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f6808ff9700 1 -- 172.21.15.31:0/1879699621 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc026400 con 0x7f67f4003a90 2023-10-09T06:30:19.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f6811c5c700 1 -- 172.21.15.31:0/1879699621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c0b09b0 con 0x7f67f4003a90 2023-10-09T06:30:19.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.089+0000 7f6811c5c700 1 -- 172.21.15.31:0/1879699621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c16ac60 con 0x7f67f4003a90 2023-10-09T06:30:19.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.090+0000 7f6811c5c700 1 -- 172.21.15.31:0/1879699621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680c089550 con 0x7f67f4003a90 2023-10-09T06:30:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.090+0000 7f6808ff9700 1 -- 172.21.15.31:0/1879699621 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67fc019030 con 0x7f67f4003a90 2023-10-09T06:30:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.091+0000 7f6808ff9700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f67f8066f30 0x7f67f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.091+0000 7f6808ff9700 1 -- 172.21.15.31:0/1879699621 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f67fc0859b0 con 0x7f67f4003a90 2023-10-09T06:30:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.091+0000 7f680bfff700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f67f8066f30 0x7f67f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.092+0000 7f680bfff700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f67f8066f30 0x7f67f80693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6800000e10 tx=0x7f6800009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.095+0000 7f6808ff9700 1 -- 172.21.15.31:0/1879699621 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67fc052f20 con 0x7f67f4003a90 2023-10-09T06:30:19.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.287+0000 7f6811c5c700 1 -- 172.21.15.31:0/1879699621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f680c0b4720 con 0x7f67f4003a90 2023-10-09T06:30:19.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.293+0000 7f6808ff9700 1 -- 172.21.15.31:0/1879699621 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f67fc0170c0 con 0x7f67f4003a90 2023-10-09T06:30:19.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.295+0000 7f6811c5c700 1 -- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f67f8066f30 msgr2=0x7f67f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.295+0000 7f6811c5c700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f67f8066f30 0x7f67f80693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6800000e10 tx=0x7f6800009040 comp rx=0 tx=0).stop 2023-10-09T06:30:19.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.295+0000 7f6811c5c700 1 -- 172.21.15.31:0/1879699621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f4003a90 msgr2=0x7f680c0b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.295+0000 7f6811c5c700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f4003a90 0x7f680c0b2dd0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f67f4004770 tx=0x7f67fc015000 comp rx=0 tx=0).stop 2023-10-09T06:30:19.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.295+0000 7f6811c5c700 1 -- 172.21.15.31:0/1879699621 shutdown_connections 2023-10-09T06:30:19.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.295+0000 7f6811c5c700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f67f8066f30 0x7f67f80693e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.295+0000 7f6811c5c700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f680c0b11b0 0x7f680c14da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.295+0000 7f6811c5c700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f4003a90 0x7f680c0b2dd0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.295+0000 7f6811c5c700 1 --2- 172.21.15.31:0/1879699621 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f680c145670 0x7f680c145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.295+0000 7f6811c5c700 1 -- 172.21.15.31:0/1879699621 >> 172.21.15.31:0/1879699621 conn(0x7f680c068cb0 msgr2=0x7f680c150580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:19.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.295+0000 7f6811c5c700 1 -- 172.21.15.31:0/1879699621 shutdown_connections 2023-10-09T06:30:19.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.295+0000 7f6811c5c700 1 -- 172.21.15.31:0/1879699621 wait complete. 2023-10-09T06:30:19.308 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:30:19.308 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:30:19.346 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:30:19.390 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:30:19.390 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:30:19.390 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:30:19.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.508+0000 7ff5747e1700 1 Processor -- start 2023-10-09T06:30:19.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.508+0000 7ff5747e1700 1 -- start start 2023-10-09T06:30:19.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.509+0000 7ff5747e1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff56c159e10 0x7ff56c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.509+0000 7ff5747e1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c15db80 con 0x7ff56c15a1e0 2023-10-09T06:30:19.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.509+0000 7ff5747e1700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c15de60 con 0x7ff56c0cde50 2023-10-09T06:30:19.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.509+0000 7ff5747e1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c15e800 con 0x7ff56c159e10 2023-10-09T06:30:19.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.509+0000 7ff57257d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff56c159e10 0x7ff56c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.509+0000 7ff571d7c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff56c15a1e0 0x7ff56c0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46384/0 (socket says 172.21.15.31:46384) 2023-10-09T06:30:19.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.509+0000 7ff571d7c700 1 -- 172.21.15.31:0/2388078627 learned_addr learned my addr 172.21.15.31:0/2388078627 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:19.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.509+0000 7ff57157b700 1 -- 172.21.15.31:0/2388078627 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941988843 0 0) 0x7ff56c15db80 con 0x7ff56c15a1e0 2023-10-09T06:30:19.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.509+0000 7ff57157b700 1 -- 172.21.15.31:0/2388078627 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff554003570 con 0x7ff56c15a1e0 2023-10-09T06:30:19.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.509+0000 7ff57257d700 1 -- 172.21.15.31:0/2388078627 >> v1:172.21.15.158:6789/0 conn(0x7ff56c0cde50 legacy=0x7ff56c0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:19.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.509+0000 7ff57257d700 1 -- 172.21.15.31:0/2388078627 >> v1:172.21.15.31:6789/0 conn(0x7ff56c15a1e0 legacy=0x7ff56c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.509+0000 7ff57257d700 1 -- 172.21.15.31:0/2388078627 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c15e140 con 0x7ff56c159e10 2023-10-09T06:30:19.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.509+0000 7ff57257d700 1 --2- 172.21.15.31:0/2388078627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff56c159e10 0x7ff56c0b2d20 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7ff564009e60 tx=0x7ff564009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12197e844755a20 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:19.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.510+0000 7ff57157b700 1 -- 172.21.15.31:0/2388078627 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400e070 con 0x7ff56c159e10 2023-10-09T06:30:19.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.510+0000 7ff57157b700 1 -- 172.21.15.31:0/2388078627 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56400bb20 con 0x7ff56c159e10 2023-10-09T06:30:19.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.510+0000 7ff57157b700 1 -- 172.21.15.31:0/2388078627 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564012430 con 0x7ff56c159e10 2023-10-09T06:30:19.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.510+0000 7ff5747e1700 1 -- 172.21.15.31:0/2388078627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff56c159e10 msgr2=0x7ff56c0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.510+0000 7ff5747e1700 1 --2- 172.21.15.31:0/2388078627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff56c159e10 0x7ff56c0b2d20 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7ff564009e60 tx=0x7ff564009780 comp rx=0 tx=0).stop 2023-10-09T06:30:19.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.510+0000 7ff5747e1700 1 -- 172.21.15.31:0/2388078627 shutdown_connections 2023-10-09T06:30:19.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.510+0000 7ff5747e1700 1 --2- 172.21.15.31:0/2388078627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff56c159e10 0x7ff56c0b2d20 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.510+0000 7ff5747e1700 1 -- 172.21.15.31:0/2388078627 >> 172.21.15.31:0/2388078627 conn(0x7ff56c067660 msgr2=0x7ff56c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:19.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.510+0000 7ff5747e1700 1 -- 172.21.15.31:0/2388078627 shutdown_connections 2023-10-09T06:30:19.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.510+0000 7ff5747e1700 1 -- 172.21.15.31:0/2388078627 wait complete. 2023-10-09T06:30:19.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.511+0000 7ff5747e1700 1 Processor -- start 2023-10-09T06:30:19.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.511+0000 7ff5747e1700 1 -- start start 2023-10-09T06:30:19.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff5747e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff56c0cde50 0x7ff56c14d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff5747e1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff56c159e10 0x7ff56c16b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff5747e1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff56c15a1e0 0x7ff56c15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff5747e1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0cea10 con 0x7ff56c0cde50 2023-10-09T06:30:19.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff5747e1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0cecf0 con 0x7ff56c159e10 2023-10-09T06:30:19.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff5747e1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0cefd0 con 0x7ff56c15a1e0 2023-10-09T06:30:19.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff57257d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff56c0cde50 0x7ff56c14d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff57257d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff56c0cde50 0x7ff56c14d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51242/0 (socket says 172.21.15.31:51242) 2023-10-09T06:30:19.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff57257d700 1 -- 172.21.15.31:0/4229246776 learned_addr learned my addr 172.21.15.31:0/4229246776 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:19.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff571d7c700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff56c159e10 0x7ff56c16b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff57257d700 1 -- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff56c15a1e0 msgr2=0x7ff56c15c450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T06:30:19.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff57257d700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff56c15a1e0 0x7ff56c15c450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff57257d700 1 -- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff56c159e10 msgr2=0x7ff56c16b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff57257d700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff56c159e10 0x7ff56c16b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff57257d700 1 -- 172.21.15.31:0/4229246776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009a20 con 0x7ff56c0cde50 2023-10-09T06:30:19.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.512+0000 7ff571d7c700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff56c159e10 0x7ff56c16b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:19.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.513+0000 7ff57257d700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff56c0cde50 0x7ff56c14d110 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7ff56c089c80 tx=0x7ff564018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:19.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.513+0000 7ff56a7fc700 1 -- 172.21.15.31:0/4229246776 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564012de0 con 0x7ff56c0cde50 2023-10-09T06:30:19.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.513+0000 7ff56a7fc700 1 -- 172.21.15.31:0/4229246776 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff564027470 con 0x7ff56c0cde50 2023-10-09T06:30:19.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.513+0000 7ff5747e1700 1 -- 172.21.15.31:0/4229246776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c0cf2b0 con 0x7ff56c0cde50 2023-10-09T06:30:19.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.513+0000 7ff56a7fc700 1 -- 172.21.15.31:0/4229246776 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564027830 con 0x7ff56c0cde50 2023-10-09T06:30:19.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.513+0000 7ff5747e1700 1 -- 172.21.15.31:0/4229246776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c14d650 con 0x7ff56c0cde50 2023-10-09T06:30:19.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.514+0000 7ff5747e1700 1 -- 172.21.15.31:0/4229246776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c04c3c0 con 0x7ff56c0cde50 2023-10-09T06:30:19.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.514+0000 7ff56a7fc700 1 -- 172.21.15.31:0/4229246776 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff564024070 con 0x7ff56c0cde50 2023-10-09T06:30:19.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.514+0000 7ff56a7fc700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff558066f30 0x7ff5580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.515+0000 7ff56a7fc700 1 -- 172.21.15.31:0/4229246776 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff564086aa0 con 0x7ff56c0cde50 2023-10-09T06:30:19.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.515+0000 7ff571d7c700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff558066f30 0x7ff5580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.516+0000 7ff571d7c700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff558066f30 0x7ff5580693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff560007fd0 tx=0x7ff560009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:19.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.519+0000 7ff56a7fc700 1 -- 172.21.15.31:0/4229246776 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff564054010 con 0x7ff56c0cde50 2023-10-09T06:30:19.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.762+0000 7ff5747e1700 1 -- 172.21.15.31:0/4229246776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff56c15e420 con 0x7ff56c0cde50 2023-10-09T06:30:19.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.763+0000 7ff56a7fc700 1 -- 172.21.15.31:0/4229246776 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+3526 (secure 0 0 0) 0x7ff564057630 con 0x7ff56c0cde50 2023-10-09T06:30:19.764 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:19.764 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/997660448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":997660448},{"type":"v1","addr":"172.21.15.158:6837","nonce":997660448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":6823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/52086276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":52086276},{"type":"v1","addr":"172.21.15.158:6836","nonce":52086276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3440717183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3440717183},{"type":"v1","addr":"172.21.15.31:6834","nonce":3440717183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1719024262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1719024262},{"type":"v1","addr":"172.21.15.31:6835","nonce":1719024262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[]} 2023-10-09T06:30:19.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.765+0000 7ff5747e1700 1 -- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff558066f30 msgr2=0x7ff5580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.765+0000 7ff5747e1700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff558066f30 0x7ff5580693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff560007fd0 tx=0x7ff560009040 comp rx=0 tx=0).stop 2023-10-09T06:30:19.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.765+0000 7ff5747e1700 1 -- 172.21.15.31:0/4229246776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff56c0cde50 msgr2=0x7ff56c14d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.765+0000 7ff5747e1700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff56c0cde50 0x7ff56c14d110 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7ff56c089c80 tx=0x7ff564018000 comp rx=0 tx=0).stop 2023-10-09T06:30:19.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.765+0000 7ff5747e1700 1 -- 172.21.15.31:0/4229246776 shutdown_connections 2023-10-09T06:30:19.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.765+0000 7ff5747e1700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff558066f30 0x7ff5580693e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.765+0000 7ff5747e1700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff56c15a1e0 0x7ff56c15c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.765+0000 7ff5747e1700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff56c0cde50 0x7ff56c14d110 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.765+0000 7ff5747e1700 1 --2- 172.21.15.31:0/4229246776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff56c159e10 0x7ff56c16b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.765+0000 7ff5747e1700 1 -- 172.21.15.31:0/4229246776 >> 172.21.15.31:0/4229246776 conn(0x7ff56c067660 msgr2=0x7ff56c159210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:19.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.765+0000 7ff5747e1700 1 -- 172.21.15.31:0/4229246776 shutdown_connections 2023-10-09T06:30:19.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.765+0000 7ff5747e1700 1 -- 172.21.15.31:0/4229246776 wait complete. 2023-10-09T06:30:19.768 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 76 2023-10-09T06:30:19.778 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:30:19.778 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:30:19.778 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:30:19.778 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:30:19.778 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:30:19.778 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:30:19.779 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:30:19.779 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:30:19.779 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:30:19.779 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:30:19.779 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:30:19.779 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:30:19.779 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:30:19.779 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:30:19.780 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:30:19.780 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:30:19.789 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:30:19.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:30:19.790 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:30:19.790 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:30:19.792 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:30:19.792 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:30:19.792 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:30:19.793 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:30:19.832 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:30:19.832 DEBUG:teuthology.parallel:result is None 2023-10-09T06:30:19.833 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:30:19.833 DEBUG:teuthology.parallel:result is None 2023-10-09T06:30:19.835 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:30:19.835 DEBUG:teuthology.parallel:result is None 2023-10-09T06:30:19.835 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:30:19.835 DEBUG:teuthology.parallel:result is None 2023-10-09T06:30:19.836 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:30:19.907 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-10-09T06:30:19.907 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:30:19.917 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:30:19.917 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-09T06:30:19.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.961+0000 7f3eaa2d4700 1 Processor -- start 2023-10-09T06:30:19.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.961+0000 7f3eaa2d4700 1 -- start start 2023-10-09T06:30:19.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.962+0000 7f3eaa2d4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ea41575f0 0x7f3ea40cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.962+0000 7f3eaa2d4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3ea41579c0 0x7f3ea415ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.962+0000 7f3eaa2d4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3ea40d0a50 0x7f3ea40d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.962+0000 7f3eaa2d4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea40697b0 con 0x7f3ea41579c0 2023-10-09T06:30:19.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.962+0000 7f3eaa2d4700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea415b240 con 0x7f3ea40d0a50 2023-10-09T06:30:19.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.962+0000 7f3eaa2d4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea40d0540 con 0x7f3ea41575f0 2023-10-09T06:30:19.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.962+0000 7f3ea8ad1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3ea41579c0 0x7f3ea415ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.962+0000 7f3ea8ad1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3ea41579c0 0x7f3ea415ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50540/0 (socket says 172.21.15.31:50540) 2023-10-09T06:30:19.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.962+0000 7f3ea8ad1700 1 -- 172.21.15.31:0/1754925753 learned_addr learned my addr 172.21.15.31:0/1754925753 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:19.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.962+0000 7f3ea9ad3700 1 --2- 172.21.15.31:0/1754925753 >> v2:172.21.15.158:3300/0 conn(0x7f3ea40d0a50 0x7f3ea40d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.962+0000 7f3ea92d2700 1 --2- 172.21.15.31:0/1754925753 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ea41575f0 0x7f3ea40cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.963+0000 7f3ea8ad1700 1 -- 172.21.15.31:0/1754925753 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ea41575f0 msgr2=0x7f3ea40cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:19.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.963+0000 7f3ea8ad1700 1 --2- 172.21.15.31:0/1754925753 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ea41575f0 0x7f3ea40cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.963+0000 7f3ea8ad1700 1 -- 172.21.15.31:0/1754925753 >> v2:172.21.15.158:3300/0 conn(0x7f3ea40d0a50 msgr2=0x7f3ea40d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:19.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.963+0000 7f3ea8ad1700 1 --2- 172.21.15.31:0/1754925753 >> v2:172.21.15.158:3300/0 conn(0x7f3ea40d0a50 0x7f3ea40d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.963+0000 7f3ea8ad1700 1 -- 172.21.15.31:0/1754925753 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea40d13d0 con 0x7f3ea41579c0 2023-10-09T06:30:19.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.963+0000 7f3ea8ad1700 1 --2- 172.21.15.31:0/1754925753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea41579c0 0x7f3ea415ad00 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40b5ef0 tx=0x7f3ea0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda2921c81c5a172 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:19.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.967+0000 7f3e9bfff700 1 -- 172.21.15.31:0/1754925753 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea000b640 con 0x7f3ea41579c0 2023-10-09T06:30:19.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.967+0000 7f3e9bfff700 1 -- 172.21.15.31:0/1754925753 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea000b7a0 con 0x7f3ea41579c0 2023-10-09T06:30:19.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.967+0000 7f3e9bfff700 1 -- 172.21.15.31:0/1754925753 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea000bb60 con 0x7f3ea41579c0 2023-10-09T06:30:19.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.968+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/1754925753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea41579c0 msgr2=0x7f3ea415ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.968+0000 7f3eaa2d4700 1 --2- 172.21.15.31:0/1754925753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea41579c0 0x7f3ea415ad00 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40b5ef0 tx=0x7f3ea0009250 comp rx=0 tx=0).stop 2023-10-09T06:30:19.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.968+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/1754925753 shutdown_connections 2023-10-09T06:30:19.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.968+0000 7f3eaa2d4700 1 --2- 172.21.15.31:0/1754925753 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ea41575f0 0x7f3ea40cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.968+0000 7f3eaa2d4700 1 --2- 172.21.15.31:0/1754925753 >> v2:172.21.15.158:3300/0 conn(0x7f3ea40d0a50 0x7f3ea40d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.968+0000 7f3eaa2d4700 1 --2- 172.21.15.31:0/1754925753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea41579c0 0x7f3ea415ad00 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.968+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/1754925753 >> 172.21.15.31:0/1754925753 conn(0x7f3ea4068130 msgr2=0x7f3ea4068ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:19.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.968+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/1754925753 shutdown_connections 2023-10-09T06:30:19.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.968+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/1754925753 wait complete. 2023-10-09T06:30:19.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.969+0000 7f3eaa2d4700 1 Processor -- start 2023-10-09T06:30:19.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.969+0000 7f3eaa2d4700 1 -- start start 2023-10-09T06:30:19.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3eaa2d4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ea40d0a50 0x7f3ea4152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3eaa2d4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea41575f0 0x7f3ea41528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3eaa2d4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ea41579c0 0x7f3ea41550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3eaa2d4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4153c10 con 0x7f3ea41575f0 2023-10-09T06:30:19.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3eaa2d4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4153ef0 con 0x7f3ea40d0a50 2023-10-09T06:30:19.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3eaa2d4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea41541d0 con 0x7f3ea41579c0 2023-10-09T06:30:19.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3ea8ad1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea41575f0 0x7f3ea41528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3ea8ad1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea41575f0 0x7f3ea41528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50544/0 (socket says 172.21.15.31:50544) 2023-10-09T06:30:19.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3ea8ad1700 1 -- 172.21.15.31:0/4212522116 learned_addr learned my addr 172.21.15.31:0/4212522116 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:19.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3ea92d2700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ea40d0a50 0x7f3ea4152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3ea9ad3700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ea41579c0 0x7f3ea41550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3ea8ad1700 1 -- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ea41579c0 msgr2=0x7f3ea41550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3ea8ad1700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ea41579c0 0x7f3ea41550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3ea8ad1700 1 -- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ea40d0a50 msgr2=0x7f3ea4152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:19.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3ea8ad1700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ea40d0a50 0x7f3ea4152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:19.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3ea8ad1700 1 -- 172.21.15.31:0/4212522116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea00094f0 con 0x7f3ea41575f0 2023-10-09T06:30:19.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.970+0000 7f3ea8ad1700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea41575f0 0x7f3ea41528c0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0006fd0 tx=0x7f3ea0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:19.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.973+0000 7f3e997fa700 1 -- 172.21.15.31:0/4212522116 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea000bb20 con 0x7f3ea41575f0 2023-10-09T06:30:19.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.973+0000 7f3e997fa700 1 -- 172.21.15.31:0/4212522116 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea0000c90 con 0x7f3ea41575f0 2023-10-09T06:30:19.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.973+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/4212522116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea41544b0 con 0x7f3ea41575f0 2023-10-09T06:30:19.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.973+0000 7f3e997fa700 1 -- 172.21.15.31:0/4212522116 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0025690 con 0x7f3ea41575f0 2023-10-09T06:30:19.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.974+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/4212522116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea413e7c0 con 0x7f3ea41575f0 2023-10-09T06:30:19.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.974+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/4212522116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea41503a0 con 0x7f3ea41575f0 2023-10-09T06:30:19.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.975+0000 7f3e997fa700 1 -- 172.21.15.31:0/4212522116 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ea002e440 con 0x7f3ea41575f0 2023-10-09T06:30:19.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.975+0000 7f3e997fa700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e88066f30 0x7f3e880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:19.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.976+0000 7f3e997fa700 1 -- 172.21.15.31:0/4212522116 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3ea0085cf0 con 0x7f3ea41575f0 2023-10-09T06:30:19.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.976+0000 7f3ea92d2700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e88066f30 0x7f3e880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:19.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.976+0000 7f3ea92d2700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e88066f30 0x7f3e880693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009db0 tx=0x7f3e940091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:19.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:19.980+0000 7f3e997fa700 1 -- 172.21.15.31:0/4212522116 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ea41503a0 con 0x7f3ea41575f0 2023-10-09T06:30:20.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.187+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/4212522116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3ea41503a0 con 0x7f3ea41575f0 2023-10-09T06:30:20.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.972+0000 7f3e997fa700 1 -- 172.21.15.31:0/4212522116 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v164) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3ea41503a0 con 0x7f3ea41575f0 2023-10-09T06:30:20.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.975+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e88066f30 msgr2=0x7f3e880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:20.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.975+0000 7f3eaa2d4700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e88066f30 0x7f3e880693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009db0 tx=0x7f3e940091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:20.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.975+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/4212522116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea41575f0 msgr2=0x7f3ea41528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:20.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.975+0000 7f3eaa2d4700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea41575f0 0x7f3ea41528c0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0006fd0 tx=0x7f3ea0017000 comp rx=0 tx=0).stop 2023-10-09T06:30:20.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.975+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/4212522116 shutdown_connections 2023-10-09T06:30:20.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.975+0000 7f3eaa2d4700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3e88066f30 0x7f3e880693e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:20.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.975+0000 7f3eaa2d4700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3ea41579c0 0x7f3ea41550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:20.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.975+0000 7f3eaa2d4700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ea40d0a50 0x7f3ea4152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:20.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.975+0000 7f3eaa2d4700 1 --2- 172.21.15.31:0/4212522116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea41575f0 0x7f3ea41528c0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:20.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.975+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/4212522116 >> 172.21.15.31:0/4212522116 conn(0x7f3ea4068130 msgr2=0x7f3ea415b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:20.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.975+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/4212522116 shutdown_connections 2023-10-09T06:30:20.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:20.975+0000 7f3eaa2d4700 1 -- 172.21.15.31:0/4212522116 wait complete. 2023-10-09T06:30:20.977 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2023-10-09T06:30:20.989 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:30:21.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.112+0000 7f317e229700 1 Processor -- start 2023-10-09T06:30:21.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.112+0000 7f317e229700 1 -- start start 2023-10-09T06:30:21.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f317e229700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780d1c30 0x7f31780ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f317e229700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31780c5d80 con 0x7f317815a2b0 2023-10-09T06:30:21.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f317e229700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31780c6060 con 0x7f317815a680 2023-10-09T06:30:21.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f317e229700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3178068470 con 0x7f31780d1c30 2023-10-09T06:30:21.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f31777fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f317815a2b0 0x7f31780b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43162/0 (socket says 172.21.15.31:43162) 2023-10-09T06:30:21.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f31777fe700 1 -- 172.21.15.31:0/414067192 learned_addr learned my addr 172.21.15.31:0/414067192 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:21.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980442736 0 0) 0x7f31780c5d80 con 0x7f317815a2b0 2023-10-09T06:30:21.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3160003570 con 0x7f317815a2b0 2023-10-09T06:30:21.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f3176ffd700 1 --2- 172.21.15.31:0/414067192 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780d1c30 0x7f31780ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4237249132 0 0) 0x7f3160003570 con 0x7f317815a2b0 2023-10-09T06:30:21.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780d1c30 msgr2=0x7f31780ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:21.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f31767fc700 1 --2- 172.21.15.31:0/414067192 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780d1c30 0x7f31780ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 >> v1:172.21.15.158:6789/0 conn(0x7f317815a680 legacy=0x7f31780cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31780c6340 con 0x7f317815a2b0 2023-10-09T06:30:21.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.113+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f31680015f0 con 0x7f317815a2b0 2023-10-09T06:30:21.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 >> v1:172.21.15.31:6789/0 conn(0x7f317815a2b0 legacy=0x7f31780b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f31767fc700 1 --2- 172.21.15.31:0/414067192 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3160003a90 0x7f3160003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f31767fc700 1 --2- 172.21.15.31:0/414067192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3160004810 0x7f3160004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f31767fc700 1 --2- 172.21.15.31:0/414067192 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780d1c30 0x7f3160005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3178068470 con 0x7f3160004810 2023-10-09T06:30:21.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316000bc20 con 0x7f3160003a90 2023-10-09T06:30:21.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316000bde0 con 0x7f31780d1c30 2023-10-09T06:30:21.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f3176ffd700 1 --2- 172.21.15.31:0/414067192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3160004810 0x7f3160004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f31777fe700 1 --2- 172.21.15.31:0/414067192 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3160003a90 0x7f3160003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f3177fff700 1 --2- 172.21.15.31:0/414067192 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780d1c30 0x7f3160005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f3176ffd700 1 -- 172.21.15.31:0/414067192 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780d1c30 msgr2=0x7f3160005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:21.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f3176ffd700 1 --2- 172.21.15.31:0/414067192 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780d1c30 0x7f3160005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f3176ffd700 1 -- 172.21.15.31:0/414067192 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3160003a90 msgr2=0x7f3160003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:21.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f3176ffd700 1 --2- 172.21.15.31:0/414067192 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3160003a90 0x7f3160003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f3176ffd700 1 -- 172.21.15.31:0/414067192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3160003570 con 0x7f3160004810 2023-10-09T06:30:21.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f3177fff700 1 --2- 172.21.15.31:0/414067192 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780d1c30 0x7f3160005290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:21.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f3176ffd700 1 --2- 172.21.15.31:0/414067192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3160004810 0x7f3160004c80 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f31780d2000 tx=0x7f316c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb65c2003db429a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:21.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c00d5d0 con 0x7f3160004810 2023-10-09T06:30:21.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c00d730 con 0x7f3160004810 2023-10-09T06:30:21.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.114+0000 7f31767fc700 1 -- 172.21.15.31:0/414067192 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c00daf0 con 0x7f3160004810 2023-10-09T06:30:21.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.115+0000 7f317e229700 1 -- 172.21.15.31:0/414067192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3160004810 msgr2=0x7f3160004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.115+0000 7f317e229700 1 --2- 172.21.15.31:0/414067192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3160004810 0x7f3160004c80 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f31780d2000 tx=0x7f316c008040 comp rx=0 tx=0).stop 2023-10-09T06:30:21.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.115+0000 7f3177fff700 1 -- 172.21.15.31:0/414067192 reap_dead start 2023-10-09T06:30:21.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.115+0000 7f317e229700 1 -- 172.21.15.31:0/414067192 shutdown_connections 2023-10-09T06:30:21.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.115+0000 7f317e229700 1 -- 172.21.15.31:0/414067192 >> 172.21.15.31:0/414067192 conn(0x7f3178067e40 msgr2=0x7f31780d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:21.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.115+0000 7f317e229700 1 -- 172.21.15.31:0/414067192 shutdown_connections 2023-10-09T06:30:21.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.115+0000 7f317e229700 1 -- 172.21.15.31:0/414067192 wait complete. 2023-10-09T06:30:21.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.116+0000 7f317e229700 1 Processor -- start 2023-10-09T06:30:21.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.116+0000 7f317e229700 1 -- start start 2023-10-09T06:30:21.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f317e229700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3160004810 0x7f31780cf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f317e229700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f317814ddd0 0x7f317814e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f317e229700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780c9cc0 0x7f31780ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f317e229700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317815b5e0 con 0x7f3160004810 2023-10-09T06:30:21.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f317e229700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3178172cc0 con 0x7f317814ddd0 2023-10-09T06:30:21.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f317e229700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31781720b0 con 0x7f31780c9cc0 2023-10-09T06:30:21.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f31777fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3160004810 0x7f31780cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f31777fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3160004810 0x7f31780cf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50562/0 (socket says 172.21.15.31:50562) 2023-10-09T06:30:21.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f31777fe700 1 -- 172.21.15.31:0/1095951201 learned_addr learned my addr 172.21.15.31:0/1095951201 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:21.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f3177fff700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780c9cc0 0x7f31780ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f3176ffd700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f317814ddd0 0x7f317814e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f31777fe700 1 -- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780c9cc0 msgr2=0x7f31780ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f31777fe700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780c9cc0 0x7f31780ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f31777fe700 1 -- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f317814ddd0 msgr2=0x7f317814e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f31777fe700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f317814ddd0 0x7f317814e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f31777fe700 1 -- 172.21.15.31:0/1095951201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3178172390 con 0x7f3160004810 2023-10-09T06:30:21.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f3176ffd700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f317814ddd0 0x7f317814e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:21.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.117+0000 7f31777fe700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3160004810 0x7f31780cf960 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f316800fc00 tx=0x7f3168009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:21.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.118+0000 7f315f7fe700 1 -- 172.21.15.31:0/1095951201 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31680072e0 con 0x7f3160004810 2023-10-09T06:30:21.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.118+0000 7f315f7fe700 1 -- 172.21.15.31:0/1095951201 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3168007440 con 0x7f3160004810 2023-10-09T06:30:21.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.118+0000 7f317e229700 1 -- 172.21.15.31:0/1095951201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3178172670 con 0x7f3160004810 2023-10-09T06:30:21.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.118+0000 7f315f7fe700 1 -- 172.21.15.31:0/1095951201 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31680057f0 con 0x7f3160004810 2023-10-09T06:30:21.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.118+0000 7f317e229700 1 -- 172.21.15.31:0/1095951201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317814e780 con 0x7f3160004810 2023-10-09T06:30:21.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.119+0000 7f317e229700 1 -- 172.21.15.31:0/1095951201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317804c3c0 con 0x7f3160004810 2023-10-09T06:30:21.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.119+0000 7f315f7fe700 1 -- 172.21.15.31:0/1095951201 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3168005b80 con 0x7f3160004810 2023-10-09T06:30:21.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.119+0000 7f315f7fe700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3164066f30 0x7f31640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.119+0000 7f315f7fe700 1 -- 172.21.15.31:0/1095951201 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f31680845d0 con 0x7f3160004810 2023-10-09T06:30:21.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.119+0000 7f3176ffd700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3164066f30 0x7f31640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.120+0000 7f3176ffd700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3164066f30 0x7f31640693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f31780d2000 tx=0x7f316c01b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:21.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.124+0000 7f315f7fe700 1 -- 172.21.15.31:0/1095951201 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3168051b90 con 0x7f3160004810 2023-10-09T06:30:21.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.394+0000 7f317e229700 1 -- 172.21.15.31:0/1095951201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3178064a00 con 0x7f3160004810 2023-10-09T06:30:21.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.394+0000 7f315f7fe700 1 -- 172.21.15.31:0/1095951201 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f31680551b0 con 0x7f3160004810 2023-10-09T06:30:21.395 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:21.395 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:30:21.395 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2023-10-09T06:30:21.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.395 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2023-10-09T06:30:21.396 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl/nWKAxAA1kcqjt4lPGPkmDivDpIVjQ==", 2023-10-09T06:30:21.396 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.396 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:30:21.396 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:30:21.396 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:30:21.396 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.396 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.396 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2023-10-09T06:30:21.397 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl9xYEDxAAQJeaqz7lkrArv45vLGb34g==", 2023-10-09T06:30:21.397 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.397 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:30:21.397 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:30:21.397 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:30:21.397 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.397 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.397 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2023-10-09T06:30:21.397 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlJOp0ChAADGiI4SX7ZLvDrtjDtU905A==", 2023-10-09T06:30:21.398 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.398 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:30:21.398 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:30:21.398 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:30:21.398 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.398 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.398 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2023-10-09T06:30:21.398 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlbnnJFRAAO+XoxRQDaHv0ZicyggniLQ==", 2023-10-09T06:30:21.398 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.398 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:30:21.399 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:30:21.399 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:30:21.399 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.399 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.399 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2023-10-09T06:30:21.399 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNloyZ+LxAApAHpPxV7R1OVE2wlIaU+PA==", 2023-10-09T06:30:21.399 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.399 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:30:21.399 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:30:21.400 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.400 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.400 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2023-10-09T06:30:21.400 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNlvHeUNhAAXblIEmmsc5eTo5VcZVirfA==", 2023-10-09T06:30:21.400 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.400 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:30:21.400 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:30:21.400 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.400 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.401 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2023-10-09T06:30:21.401 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlxfIaBBAAE8WbXh4Q4SxaW2k7MkSTHg==", 2023-10-09T06:30:21.401 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.401 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:30:21.401 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:30:21.401 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.401 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.401 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2023-10-09T06:30:21.402 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlUtX3DRAA5NEq+lFMzqhu1GF1ZWT2ag==", 2023-10-09T06:30:21.402 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.402 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:30:21.402 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:30:21.402 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.402 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.402 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2023-10-09T06:30:21.402 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlcWc5IBAA5e62AwhIuHdw4dTjnNS8hQ==", 2023-10-09T06:30:21.402 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.402 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:30:21.403 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:30:21.403 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.403 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.403 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2023-10-09T06:30:21.403 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlX5S6JhAAzvzO2YEqEtq2fJ3FW9Fddg==", 2023-10-09T06:30:21.403 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.403 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:30:21.403 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:30:21.403 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.404 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.404 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2023-10-09T06:30:21.404 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl9jy5LxAAxgMslSN6ayxB2MFRf2dwNQ==", 2023-10-09T06:30:21.404 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.404 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:30:21.404 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:30:21.404 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.404 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.405 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2023-10-09T06:30:21.405 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl8M+TOBAARhk2wEaXO9Pi4TP9d+L5Gg==", 2023-10-09T06:30:21.405 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.405 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:30:21.405 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:30:21.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.405 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.405 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2023-10-09T06:30:21.405 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlfsC2GRAAlm37QI8DkNclcBpD5ZBR7A==", 2023-10-09T06:30:21.405 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.406 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:30:21.406 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2023-10-09T06:30:21.406 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T06:30:21.406 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.406 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2023-10-09T06:30:21.406 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlapIxIhAAiBZUkpnf6tyFHwySGKhRpQ==", 2023-10-09T06:30:21.406 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.406 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:30:21.406 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:30:21.407 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:30:21.407 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:30:21.407 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.407 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2023-10-09T06:30:21.407 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEZYuHxAA7WEH0vXmAEH5Wki8ESrDBg==", 2023-10-09T06:30:21.407 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.407 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:30:21.407 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:30:21.407 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:30:21.407 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:30:21.408 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.408 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2023-10-09T06:30:21.408 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlFvuIJxAAGuTp4gsXrvUzDd1B7d5vcg==", 2023-10-09T06:30:21.408 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.408 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:30:21.408 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:30:21.408 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:30:21.408 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:30:21.408 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.409 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2023-10-09T06:30:21.409 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlS8AlJBAAg8lLRVasKHyhbFlOTfgt9g==", 2023-10-09T06:30:21.409 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.409 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:30:21.409 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:30:21.409 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:30:21.409 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.409 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.409 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2023-10-09T06:30:21.410 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEE9eABAAHbJ1yvlmOUNo6n2uAhPrnw==", 2023-10-09T06:30:21.410 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.410 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:30:21.410 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:30:21.410 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.410 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:30:21.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:21.410 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2023-10-09T06:30:21.410 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlhol5OBAAZSZ+PbojVwsOJtLlTl6wAA==", 2023-10-09T06:30:21.410 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:30:21.411 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:30:21.411 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:30:21.411 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:30:21.411 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.411 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:21.411 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:30:21.411 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:30:21.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.396+0000 7f317e229700 1 -- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3164066f30 msgr2=0x7f31640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.396+0000 7f317e229700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3164066f30 0x7f31640693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f31780d2000 tx=0x7f316c01b000 comp rx=0 tx=0).stop 2023-10-09T06:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.396+0000 7f317e229700 1 -- 172.21.15.31:0/1095951201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3160004810 msgr2=0x7f31780cf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.396+0000 7f317e229700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3160004810 0x7f31780cf960 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f316800fc00 tx=0x7f3168009040 comp rx=0 tx=0).stop 2023-10-09T06:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.396+0000 7f317e229700 1 -- 172.21.15.31:0/1095951201 shutdown_connections 2023-10-09T06:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.396+0000 7f317e229700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3164066f30 0x7f31640693e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.396+0000 7f317e229700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31780c9cc0 0x7f31780ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.396+0000 7f317e229700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3160004810 0x7f31780cf960 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.396+0000 7f317e229700 1 --2- 172.21.15.31:0/1095951201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f317814ddd0 0x7f317814e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.396+0000 7f317e229700 1 -- 172.21.15.31:0/1095951201 >> 172.21.15.31:0/1095951201 conn(0x7f3178067e40 msgr2=0x7f3178158210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.396+0000 7f317e229700 1 -- 172.21.15.31:0/1095951201 shutdown_connections 2023-10-09T06:30:21.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.396+0000 7f317e229700 1 -- 172.21.15.31:0/1095951201 wait complete. 2023-10-09T06:30:21.414 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:30:21.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.533+0000 7f047616e700 1 Processor -- start 2023-10-09T06:30:21.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.533+0000 7f047616e700 1 -- start start 2023-10-09T06:30:21.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.533+0000 7f047616e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04700b0890 0x7f04700cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.533+0000 7f047616e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f04700cbd40 0x7f0470067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.533+0000 7f047616e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04700cb370 con 0x7f047006c630 2023-10-09T06:30:21.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f047616e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04700b0c60 con 0x7f04700b0890 2023-10-09T06:30:21.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f047616e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047006a1e0 con 0x7f04700cbd40 2023-10-09T06:30:21.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f046f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04700b0890 0x7f04700cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f046f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04700b0890 0x7f04700cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50572/0 (socket says 172.21.15.31:50572) 2023-10-09T06:30:21.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f046f7fe700 1 -- 172.21.15.31:0/373480006 learned_addr learned my addr 172.21.15.31:0/373480006 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:21.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f046effd700 1 --2- 172.21.15.31:0/373480006 >> v2:172.21.15.158:3300/0 conn(0x7f04700cbd40 0x7f0470067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f046f7fe700 1 -- 172.21.15.31:0/373480006 >> v2:172.21.15.158:3300/0 conn(0x7f04700cbd40 msgr2=0x7f0470067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:21.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f046f7fe700 1 --2- 172.21.15.31:0/373480006 >> v2:172.21.15.158:3300/0 conn(0x7f04700cbd40 0x7f0470067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f046f7fe700 1 -- 172.21.15.31:0/373480006 >> v1:172.21.15.158:6789/0 conn(0x7f047006c630 legacy=0x7f047015dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:21.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f046f7fe700 1 -- 172.21.15.31:0/373480006 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047006cb80 con 0x7f04700b0890 2023-10-09T06:30:21.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f046effd700 1 --2- 172.21.15.31:0/373480006 >> v2:172.21.15.158:3300/0 conn(0x7f04700cbd40 0x7f0470067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:21.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f046f7fe700 1 --2- 172.21.15.31:0/373480006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04700b0890 0x7f04700cb800 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0470064ae0 tx=0x7f0458009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75867d9ccb29672e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:21.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f046e7fc700 1 -- 172.21.15.31:0/373480006 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045800b820 con 0x7f04700b0890 2023-10-09T06:30:21.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f046e7fc700 1 -- 172.21.15.31:0/373480006 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045800b980 con 0x7f04700b0890 2023-10-09T06:30:21.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.534+0000 7f046e7fc700 1 -- 172.21.15.31:0/373480006 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045800bd20 con 0x7f04700b0890 2023-10-09T06:30:21.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.535+0000 7f047616e700 1 -- 172.21.15.31:0/373480006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04700b0890 msgr2=0x7f04700cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.535+0000 7f047616e700 1 --2- 172.21.15.31:0/373480006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04700b0890 0x7f04700cb800 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0470064ae0 tx=0x7f0458009250 comp rx=0 tx=0).stop 2023-10-09T06:30:21.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.535+0000 7f047616e700 1 -- 172.21.15.31:0/373480006 shutdown_connections 2023-10-09T06:30:21.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.535+0000 7f047616e700 1 --2- 172.21.15.31:0/373480006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04700b0890 0x7f04700cb800 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.535+0000 7f047616e700 1 --2- 172.21.15.31:0/373480006 >> v2:172.21.15.158:3300/0 conn(0x7f04700cbd40 0x7f0470067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.535+0000 7f047616e700 1 -- 172.21.15.31:0/373480006 >> 172.21.15.31:0/373480006 conn(0x7f047006fe50 msgr2=0x7f0470069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:21.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.535+0000 7f047616e700 1 -- 172.21.15.31:0/373480006 shutdown_connections 2023-10-09T06:30:21.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.535+0000 7f047616e700 1 -- 172.21.15.31:0/373480006 wait complete. 2023-10-09T06:30:21.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.536+0000 7f047616e700 1 Processor -- start 2023-10-09T06:30:21.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.536+0000 7f047616e700 1 -- start start 2023-10-09T06:30:21.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f047616e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f047006c630 0x7f047015c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f047616e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04700b0890 0x7f04700c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f047616e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04700cbd40 0x7f04700abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f047616e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04700c4290 con 0x7f04700cbd40 2023-10-09T06:30:21.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f047616e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04700c3680 con 0x7f047006c630 2023-10-09T06:30:21.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f047616e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04700c3960 con 0x7f04700b0890 2023-10-09T06:30:21.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f046ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04700cbd40 0x7f04700abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f046ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04700cbd40 0x7f04700abcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50582/0 (socket says 172.21.15.31:50582) 2023-10-09T06:30:21.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f046ffff700 1 -- 172.21.15.31:0/3245766113 learned_addr learned my addr 172.21.15.31:0/3245766113 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:21.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f046effd700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04700b0890 0x7f04700c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f046f7fe700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f047006c630 0x7f047015c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f046ffff700 1 -- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04700b0890 msgr2=0x7f04700c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f046ffff700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04700b0890 0x7f04700c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f046ffff700 1 -- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f047006c630 msgr2=0x7f047015c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f046ffff700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f047006c630 0x7f047015c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.537+0000 7f046ffff700 1 -- 172.21.15.31:0/3245766113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04580094f0 con 0x7f04700cbd40 2023-10-09T06:30:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.538+0000 7f046ffff700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04700cbd40 0x7f04700abcc0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f046800bc30 tx=0x7f0468009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.538+0000 7f04677fe700 1 -- 172.21.15.31:0/3245766113 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046800c9b0 con 0x7f04700cbd40 2023-10-09T06:30:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.538+0000 7f04677fe700 1 -- 172.21.15.31:0/3245766113 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046800cb30 con 0x7f04700cbd40 2023-10-09T06:30:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.538+0000 7f04677fe700 1 -- 172.21.15.31:0/3245766113 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468014410 con 0x7f04700cbd40 2023-10-09T06:30:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.538+0000 7f047616e700 1 -- 172.21.15.31:0/3245766113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04700c3c40 con 0x7f04700cbd40 2023-10-09T06:30:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.538+0000 7f047616e700 1 -- 172.21.15.31:0/3245766113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04700aad20 con 0x7f04700cbd40 2023-10-09T06:30:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.539+0000 7f047616e700 1 -- 172.21.15.31:0/3245766113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047004c3c0 con 0x7f04700cbd40 2023-10-09T06:30:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.539+0000 7f04677fe700 1 -- 172.21.15.31:0/3245766113 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0468014840 con 0x7f04700cbd40 2023-10-09T06:30:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.540+0000 7f04677fe700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0450066f30 0x7f04500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.540+0000 7f04677fe700 1 -- 172.21.15.31:0/3245766113 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0468084200 con 0x7f04700cbd40 2023-10-09T06:30:21.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.540+0000 7f046f7fe700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0450066f30 0x7f04500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.540+0000 7f046f7fe700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0450066f30 0x7f04500693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0470064ae0 tx=0x7f0458016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:21.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.544+0000 7f04677fe700 1 -- 172.21.15.31:0/3245766113 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f046804c5a0 con 0x7f04700cbd40 2023-10-09T06:30:21.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.737+0000 7f047616e700 1 -- 172.21.15.31:0/3245766113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04700c9360 con 0x7f04700cbd40 2023-10-09T06:30:21.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.737+0000 7f04677fe700 1 -- 172.21.15.31:0/3245766113 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+12145 (secure 0 0 0) 0x7f04680517c0 con 0x7f04700cbd40 2023-10-09T06:30:21.738 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:21.738 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":164,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:30:20.971116+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:30:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.739+0000 7f047616e700 1 -- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0450066f30 msgr2=0x7f04500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.739+0000 7f047616e700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0450066f30 0x7f04500693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0470064ae0 tx=0x7f0458016000 comp rx=0 tx=0).stop 2023-10-09T06:30:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.739+0000 7f047616e700 1 -- 172.21.15.31:0/3245766113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04700cbd40 msgr2=0x7f04700abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.739+0000 7f047616e700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04700cbd40 0x7f04700abcc0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f046800bc30 tx=0x7f0468009820 comp rx=0 tx=0).stop 2023-10-09T06:30:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.739+0000 7f047616e700 1 -- 172.21.15.31:0/3245766113 shutdown_connections 2023-10-09T06:30:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.739+0000 7f047616e700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0450066f30 0x7f04500693e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.739+0000 7f047616e700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04700cbd40 0x7f04700abcc0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.739+0000 7f047616e700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f047006c630 0x7f047015c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.739+0000 7f047616e700 1 --2- 172.21.15.31:0/3245766113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f04700b0890 0x7f04700c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.739+0000 7f047616e700 1 -- 172.21.15.31:0/3245766113 >> 172.21.15.31:0/3245766113 conn(0x7f047006fe50 msgr2=0x7f04700ae6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.740+0000 7f047616e700 1 -- 172.21.15.31:0/3245766113 shutdown_connections 2023-10-09T06:30:21.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.740+0000 7f047616e700 1 -- 172.21.15.31:0/3245766113 wait complete. 2023-10-09T06:30:21.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:30:21.753 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:30:21.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.874+0000 7fae0404a700 1 Processor -- start 2023-10-09T06:30:21.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.874+0000 7fae0404a700 1 -- start start 2023-10-09T06:30:21.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae0404a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadfc0678b0 0x7fadfc15db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae0404a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadfc0cae70 con 0x7fadfc0cbf10 2023-10-09T06:30:21.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae0404a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadfc0cb150 con 0x7fadfc0c9390 2023-10-09T06:30:21.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae0404a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0cb430 con 0x7fadfc0678b0 2023-10-09T06:30:21.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae015e5700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fadfc0cbf10 0x7fadfc15e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43170/0 (socket says 172.21.15.31:43170) 2023-10-09T06:30:21.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae015e5700 1 -- 172.21.15.31:0/2319474002 learned_addr learned my addr 172.21.15.31:0/2319474002 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:21.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae01de6700 1 --2- 172.21.15.31:0/2319474002 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadfc0678b0 0x7fadfc15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae00de4700 1 -- 172.21.15.31:0/2319474002 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848268125 0 0) 0x7fadfc0cae70 con 0x7fadfc0cbf10 2023-10-09T06:30:21.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae00de4700 1 -- 172.21.15.31:0/2319474002 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fade8003570 con 0x7fadfc0cbf10 2023-10-09T06:30:21.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae00de4700 1 -- 172.21.15.31:0/2319474002 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399117475 0 0) 0x7fadfc0cb150 con 0x7fadfc0c9390 2023-10-09T06:30:21.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae00de4700 1 -- 172.21.15.31:0/2319474002 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadfc0cae70 con 0x7fadfc0c9390 2023-10-09T06:30:21.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae01de6700 1 -- 172.21.15.31:0/2319474002 >> v1:172.21.15.158:6789/0 conn(0x7fadfc0c9390 legacy=0x7fadfc15a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae01de6700 1 -- 172.21.15.31:0/2319474002 >> v1:172.21.15.31:6789/0 conn(0x7fadfc0cbf10 legacy=0x7fadfc15e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae00de4700 1 -- 172.21.15.31:0/2319474002 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1769192101 0 0) 0x7fade8003570 con 0x7fadfc0cbf10 2023-10-09T06:30:21.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.875+0000 7fae01de6700 1 -- 172.21.15.31:0/2319474002 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc0cb710 con 0x7fadfc0678b0 2023-10-09T06:30:21.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.876+0000 7fae01de6700 1 --2- 172.21.15.31:0/2319474002 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadfc0678b0 0x7fadfc15db80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009910 tx=0x7fadf80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5266c3ba681166a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:21.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.876+0000 7fae00de4700 1 -- 172.21.15.31:0/2319474002 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec001470 con 0x7fadfc0678b0 2023-10-09T06:30:21.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.876+0000 7fae00de4700 1 -- 172.21.15.31:0/2319474002 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8011420 con 0x7fadfc0678b0 2023-10-09T06:30:21.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.876+0000 7fae00de4700 1 -- 172.21.15.31:0/2319474002 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf80117c0 con 0x7fadfc0678b0 2023-10-09T06:30:21.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.876+0000 7fae0404a700 1 -- 172.21.15.31:0/2319474002 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadfc0678b0 msgr2=0x7fadfc15db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.876+0000 7fae0404a700 1 --2- 172.21.15.31:0/2319474002 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadfc0678b0 0x7fadfc15db80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009910 tx=0x7fadf80091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.876+0000 7fae0404a700 1 -- 172.21.15.31:0/2319474002 shutdown_connections 2023-10-09T06:30:21.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.876+0000 7fae0404a700 1 --2- 172.21.15.31:0/2319474002 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadfc0678b0 0x7fadfc15db80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.876+0000 7fae0404a700 1 -- 172.21.15.31:0/2319474002 >> 172.21.15.31:0/2319474002 conn(0x7fadfc069870 msgr2=0x7fadfc069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:21.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.877+0000 7fae0404a700 1 -- 172.21.15.31:0/2319474002 shutdown_connections 2023-10-09T06:30:21.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.877+0000 7fae0404a700 1 -- 172.21.15.31:0/2319474002 wait complete. 2023-10-09T06:30:21.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.878+0000 7fae0404a700 1 Processor -- start 2023-10-09T06:30:21.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.878+0000 7fae0404a700 1 -- start start 2023-10-09T06:30:21.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.878+0000 7fae0404a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadfc0678b0 0x7fadfc0ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.878+0000 7fae0404a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fadfc0c9390 0x7fadfc0ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.878+0000 7fae0404a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadfc0cbf10 0x7fadfc169e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.878+0000 7fae0404a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc16ae00 con 0x7fadfc0678b0 2023-10-09T06:30:21.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.878+0000 7fae0404a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0aad10 con 0x7fadfc0c9390 2023-10-09T06:30:21.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.878+0000 7fae0404a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc16a840 con 0x7fadfc0cbf10 2023-10-09T06:30:21.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.878+0000 7fae01de6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadfc0678b0 0x7fadfc0ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.878+0000 7fae01de6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadfc0678b0 0x7fadfc0ac0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50592/0 (socket says 172.21.15.31:50592) 2023-10-09T06:30:21.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.878+0000 7fae01de6700 1 -- 172.21.15.31:0/724554936 learned_addr learned my addr 172.21.15.31:0/724554936 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:21.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.879+0000 7fae015e5700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fadfc0c9390 0x7fadfc0ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.879+0000 7fae025e7700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadfc0cbf10 0x7fadfc169e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.879+0000 7fae01de6700 1 -- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadfc0cbf10 msgr2=0x7fadfc169e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.879+0000 7fae01de6700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadfc0cbf10 0x7fadfc169e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.879+0000 7fae01de6700 1 -- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fadfc0c9390 msgr2=0x7fadfc0ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:21.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.879+0000 7fae01de6700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fadfc0c9390 0x7fadfc0ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:21.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.879+0000 7fae01de6700 1 -- 172.21.15.31:0/724554936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf8009420 con 0x7fadfc0678b0 2023-10-09T06:30:21.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.879+0000 7fae01de6700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadfc0678b0 0x7fadfc0ac0f0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fadf80091e0 tx=0x7fadf8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:21.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.879+0000 7fadf1ffb700 1 -- 172.21.15.31:0/724554936 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf801cc90 con 0x7fadfc0678b0 2023-10-09T06:30:21.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.879+0000 7fadf1ffb700 1 -- 172.21.15.31:0/724554936 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf801cdf0 con 0x7fadfc0678b0 2023-10-09T06:30:21.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.879+0000 7fae0404a700 1 -- 172.21.15.31:0/724554936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc16ab20 con 0x7fadfc0678b0 2023-10-09T06:30:21.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.879+0000 7fadf1ffb700 1 -- 172.21.15.31:0/724554936 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf801a6a0 con 0x7fadfc0678b0 2023-10-09T06:30:21.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.879+0000 7fae0404a700 1 -- 172.21.15.31:0/724554936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc0aebe0 con 0x7fadfc0678b0 2023-10-09T06:30:21.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.880+0000 7fae0404a700 1 -- 172.21.15.31:0/724554936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc04c3c0 con 0x7fadfc0678b0 2023-10-09T06:30:21.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.880+0000 7fadf1ffb700 1 -- 172.21.15.31:0/724554936 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadf801aad0 con 0x7fadfc0678b0 2023-10-09T06:30:21.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.881+0000 7fadf1ffb700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fade0066f30 0x7fade00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:21.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.881+0000 7fadf1ffb700 1 -- 172.21.15.31:0/724554936 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fadf8085f50 con 0x7fadfc0678b0 2023-10-09T06:30:21.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.881+0000 7fae015e5700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fade0066f30 0x7fade00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:21.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.882+0000 7fae015e5700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fade0066f30 0x7fade00693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fadec0015a0 tx=0x7fadec000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:21.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:21.885+0000 7fadf1ffb700 1 -- 172.21.15.31:0/724554936 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadf8053510 con 0x7fadfc0678b0 2023-10-09T06:30:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.077+0000 7fae0404a700 1 -- 172.21.15.31:0/724554936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fadfc068da0 con 0x7fadfc0678b0 2023-10-09T06:30:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.077+0000 7fadf1ffb700 1 -- 172.21.15.31:0/724554936 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v164) v1 ==== 93+0+10 (secure 0 0 0) 0x7fadf8056b30 con 0x7fadfc0678b0 2023-10-09T06:30:22.078 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:30:22.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.079+0000 7fae0404a700 1 -- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fade0066f30 msgr2=0x7fade00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:22.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.079+0000 7fae0404a700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fade0066f30 0x7fade00693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fadec0015a0 tx=0x7fadec000bc0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.079+0000 7fae0404a700 1 -- 172.21.15.31:0/724554936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadfc0678b0 msgr2=0x7fadfc0ac0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.079+0000 7fae0404a700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadfc0678b0 0x7fadfc0ac0f0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fadf80091e0 tx=0x7fadf8016000 comp rx=0 tx=0).stop 2023-10-09T06:30:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.079+0000 7fae0404a700 1 -- 172.21.15.31:0/724554936 shutdown_connections 2023-10-09T06:30:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.079+0000 7fae0404a700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fade0066f30 0x7fade00693e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.079+0000 7fae0404a700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fadfc0cbf10 0x7fadfc169e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.079+0000 7fae0404a700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadfc0678b0 0x7fadfc0ac0f0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.079+0000 7fae0404a700 1 --2- 172.21.15.31:0/724554936 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fadfc0c9390 0x7fadfc0ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.079+0000 7fae0404a700 1 -- 172.21.15.31:0/724554936 >> 172.21.15.31:0/724554936 conn(0x7fadfc069870 msgr2=0x7fadfc0b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.080+0000 7fae0404a700 1 -- 172.21.15.31:0/724554936 shutdown_connections 2023-10-09T06:30:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.080+0000 7fae0404a700 1 -- 172.21.15.31:0/724554936 wait complete. 2023-10-09T06:30:22.092 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:30:22.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.210+0000 7fc446fe7700 1 Processor -- start 2023-10-09T06:30:22.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.210+0000 7fc446fe7700 1 -- start start 2023-10-09T06:30:22.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.211+0000 7fc446fe7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc44015a2b0 0x7fc4400b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:22.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.211+0000 7fc446fe7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc4400d1c30 0x7fc4400cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:22.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.211+0000 7fc446fe7700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4400c5d80 con 0x7fc44015a680 2023-10-09T06:30:22.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.211+0000 7fc446fe7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc440068470 con 0x7fc44015a2b0 2023-10-09T06:30:22.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.211+0000 7fc446fe7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4400c6060 con 0x7fc4400d1c30 2023-10-09T06:30:22.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.211+0000 7fc444d83700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc44015a2b0 0x7fc4400b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:22.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.211+0000 7fc444d83700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc44015a2b0 0x7fc4400b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50602/0 (socket says 172.21.15.31:50602) 2023-10-09T06:30:22.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.211+0000 7fc444d83700 1 -- 172.21.15.31:0/2111312102 learned_addr learned my addr 172.21.15.31:0/2111312102 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:22.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.211+0000 7fc43ffff700 1 --2- 172.21.15.31:0/2111312102 >> v2:172.21.15.158:3300/0 conn(0x7fc4400d1c30 0x7fc4400cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:22.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.211+0000 7fc444d83700 1 -- 172.21.15.31:0/2111312102 >> v2:172.21.15.158:3300/0 conn(0x7fc4400d1c30 msgr2=0x7fc4400cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:22.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc444d83700 1 --2- 172.21.15.31:0/2111312102 >> v2:172.21.15.158:3300/0 conn(0x7fc4400d1c30 0x7fc4400cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc444d83700 1 -- 172.21.15.31:0/2111312102 >> v1:172.21.15.158:6789/0 conn(0x7fc44015a680 legacy=0x7fc4400c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:22.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc444d83700 1 -- 172.21.15.31:0/2111312102 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4400c6340 con 0x7fc44015a2b0 2023-10-09T06:30:22.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc43ffff700 1 --2- 172.21.15.31:0/2111312102 >> v2:172.21.15.158:3300/0 conn(0x7fc4400d1c30 0x7fc4400cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:22.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc444d83700 1 --2- 172.21.15.31:0/2111312102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44015a2b0 0x7fc4400b3da0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc440089190 tx=0x7fc438009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb51b09172fa4be4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:22.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc43f7fe700 1 -- 172.21.15.31:0/2111312102 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43800e070 con 0x7fc44015a2b0 2023-10-09T06:30:22.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc43f7fe700 1 -- 172.21.15.31:0/2111312102 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43800bad0 con 0x7fc44015a2b0 2023-10-09T06:30:22.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc43f7fe700 1 -- 172.21.15.31:0/2111312102 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380092e0 con 0x7fc44015a2b0 2023-10-09T06:30:22.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc446fe7700 1 -- 172.21.15.31:0/2111312102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44015a2b0 msgr2=0x7fc4400b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:22.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc446fe7700 1 --2- 172.21.15.31:0/2111312102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44015a2b0 0x7fc4400b3da0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc440089190 tx=0x7fc438009840 comp rx=0 tx=0).stop 2023-10-09T06:30:22.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc446fe7700 1 -- 172.21.15.31:0/2111312102 shutdown_connections 2023-10-09T06:30:22.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc446fe7700 1 --2- 172.21.15.31:0/2111312102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44015a2b0 0x7fc4400b3da0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc446fe7700 1 --2- 172.21.15.31:0/2111312102 >> v2:172.21.15.158:3300/0 conn(0x7fc4400d1c30 0x7fc4400cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc446fe7700 1 -- 172.21.15.31:0/2111312102 >> 172.21.15.31:0/2111312102 conn(0x7fc440067e40 msgr2=0x7fc4400d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:22.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.212+0000 7fc446fe7700 1 -- 172.21.15.31:0/2111312102 shutdown_connections 2023-10-09T06:30:22.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.213+0000 7fc446fe7700 1 -- 172.21.15.31:0/2111312102 wait complete. 2023-10-09T06:30:22.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.214+0000 7fc446fe7700 1 Processor -- start 2023-10-09T06:30:22.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.214+0000 7fc446fe7700 1 -- start start 2023-10-09T06:30:22.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.214+0000 7fc446fe7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4400d1c30 0x7fc440155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:22.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.214+0000 7fc446fe7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc44015a2b0 0x7fc44015b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:22.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.214+0000 7fc446fe7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44015a680 0x7fc4400b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:22.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.214+0000 7fc446fe7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4400c8880 con 0x7fc44015a680 2023-10-09T06:30:22.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.214+0000 7fc446fe7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44015c150 con 0x7fc44015a2b0 2023-10-09T06:30:22.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.214+0000 7fc446fe7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4400c8230 con 0x7fc4400d1c30 2023-10-09T06:30:22.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc445584700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44015a680 0x7fc4400b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:22.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc445584700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44015a680 0x7fc4400b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50608/0 (socket says 172.21.15.31:50608) 2023-10-09T06:30:22.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc445584700 1 -- 172.21.15.31:0/1710998152 learned_addr learned my addr 172.21.15.31:0/1710998152 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:22.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc43ffff700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc44015a2b0 0x7fc44015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:22.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc444d83700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4400d1c30 0x7fc440155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:22.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc445584700 1 -- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4400d1c30 msgr2=0x7fc440155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:22.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc445584700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4400d1c30 0x7fc440155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc445584700 1 -- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc44015a2b0 msgr2=0x7fc44015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:22.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc445584700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc44015a2b0 0x7fc44015b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc445584700 1 -- 172.21.15.31:0/1710998152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc438009ae0 con 0x7fc44015a680 2023-10-09T06:30:22.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc445584700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44015a680 0x7fc4400b4d50 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fc43000c4c0 tx=0x7fc430007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:22.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc43cff9700 1 -- 172.21.15.31:0/1710998152 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43000ce70 con 0x7fc44015a680 2023-10-09T06:30:22.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc43cff9700 1 -- 172.21.15.31:0/1710998152 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc430011590 con 0x7fc44015a680 2023-10-09T06:30:22.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc446fe7700 1 -- 172.21.15.31:0/1710998152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4400c8510 con 0x7fc44015a680 2023-10-09T06:30:22.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc43cff9700 1 -- 172.21.15.31:0/1710998152 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430011970 con 0x7fc44015a680 2023-10-09T06:30:22.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.215+0000 7fc446fe7700 1 -- 172.21.15.31:0/1710998152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc440155f50 con 0x7fc44015a680 2023-10-09T06:30:22.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.216+0000 7fc446fe7700 1 -- 172.21.15.31:0/1710998152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4400c8090 con 0x7fc44015a680 2023-10-09T06:30:22.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.217+0000 7fc43cff9700 1 -- 172.21.15.31:0/1710998152 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc430011ce0 con 0x7fc44015a680 2023-10-09T06:30:22.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.217+0000 7fc43cff9700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc42c066f30 0x7fc42c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:22.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.217+0000 7fc43cff9700 1 -- 172.21.15.31:0/1710998152 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc4300834c0 con 0x7fc44015a680 2023-10-09T06:30:22.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.217+0000 7fc444d83700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc42c066f30 0x7fc42c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:22.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.218+0000 7fc444d83700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc42c066f30 0x7fc42c0693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc438009fd0 tx=0x7fc438018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:22.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.221+0000 7fc43cff9700 1 -- 172.21.15.31:0/1710998152 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4400c8090 con 0x7fc44015a680 2023-10-09T06:30:22.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.416+0000 7fc446fe7700 1 -- 172.21.15.31:0/1710998152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc4400c8090 con 0x7fc44015a680 2023-10-09T06:30:22.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.416+0000 7fc43cff9700 1 -- 172.21.15.31:0/1710998152 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v164) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc4400c8090 con 0x7fc44015a680 2023-10-09T06:30:22.417 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:22.417 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-10-09T06:30:22.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:30:22.418 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-10-09T06:30:22.418 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-10-09T06:30:22.418 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:30:22.418 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-10-09T06:30:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.418+0000 7fc446fe7700 1 -- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc42c066f30 msgr2=0x7fc42c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.418+0000 7fc446fe7700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc42c066f30 0x7fc42c0693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc438009fd0 tx=0x7fc438018000 comp rx=0 tx=0).stop 2023-10-09T06:30:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.418+0000 7fc446fe7700 1 -- 172.21.15.31:0/1710998152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44015a680 msgr2=0x7fc4400b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.418+0000 7fc446fe7700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44015a680 0x7fc4400b4d50 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fc43000c4c0 tx=0x7fc430007f50 comp rx=0 tx=0).stop 2023-10-09T06:30:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.418+0000 7fc446fe7700 1 -- 172.21.15.31:0/1710998152 shutdown_connections 2023-10-09T06:30:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.418+0000 7fc446fe7700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc42c066f30 0x7fc42c0693e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.418+0000 7fc446fe7700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4400d1c30 0x7fc440155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.418+0000 7fc446fe7700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44015a680 0x7fc4400b4d50 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.418+0000 7fc446fe7700 1 --2- 172.21.15.31:0/1710998152 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc44015a2b0 0x7fc44015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.418+0000 7fc446fe7700 1 -- 172.21.15.31:0/1710998152 >> 172.21.15.31:0/1710998152 conn(0x7fc440067e40 msgr2=0x7fc4400d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.418+0000 7fc446fe7700 1 -- 172.21.15.31:0/1710998152 shutdown_connections 2023-10-09T06:30:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.418+0000 7fc446fe7700 1 -- 172.21.15.31:0/1710998152 wait complete. 2023-10-09T06:30:22.431 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:30:22.432 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:30:22.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.554+0000 7f627ef95700 1 Processor -- start 2023-10-09T06:30:22.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.554+0000 7f627ef95700 1 -- start start 2023-10-09T06:30:22.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.555+0000 7f627ef95700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62780678b0 0x7f62780cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:22.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.555+0000 7f627ef95700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f62780cc1e0 0x7f62781573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:22.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.555+0000 7f627ef95700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627815e720 con 0x7f6278067c80 2023-10-09T06:30:22.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.555+0000 7f627ef95700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627815b2f0 con 0x7f62780cc1e0 2023-10-09T06:30:22.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.555+0000 7f627ef95700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627815db10 con 0x7f62780678b0 2023-10-09T06:30:22.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.555+0000 7f6277fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f62780cc1e0 0x7f62781573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:22.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.555+0000 7f6277fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f62780cc1e0 0x7f62781573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50612/0 (socket says 172.21.15.31:50612) 2023-10-09T06:30:22.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.555+0000 7f6277fff700 1 -- 172.21.15.31:0/2917975034 learned_addr learned my addr 172.21.15.31:0/2917975034 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:22.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.555+0000 7f627cd31700 1 --2- 172.21.15.31:0/2917975034 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62780678b0 0x7f62780cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:22.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f6277fff700 1 -- 172.21.15.31:0/2917975034 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62780678b0 msgr2=0x7f62780cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:22.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f6277fff700 1 --2- 172.21.15.31:0/2917975034 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62780678b0 0x7f62780cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f6277fff700 1 -- 172.21.15.31:0/2917975034 >> v1:172.21.15.158:6789/0 conn(0x7f6278067c80 legacy=0x7f62780af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:22.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f6277fff700 1 -- 172.21.15.31:0/2917975034 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627815ddf0 con 0x7f62780cc1e0 2023-10-09T06:30:22.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f6277fff700 1 --2- 172.21.15.31:0/2917975034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780cc1e0 0x7f62781573b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f626c0099b0 tx=0x7f626c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c50ea31973ba727 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:22.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f62777fe700 1 -- 172.21.15.31:0/2917975034 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c009ea0 con 0x7f62780cc1e0 2023-10-09T06:30:22.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f62777fe700 1 -- 172.21.15.31:0/2917975034 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c00b860 con 0x7f62780cc1e0 2023-10-09T06:30:22.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f62777fe700 1 -- 172.21.15.31:0/2917975034 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00bc00 con 0x7f62780cc1e0 2023-10-09T06:30:22.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f627ef95700 1 -- 172.21.15.31:0/2917975034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780cc1e0 msgr2=0x7f62781573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:22.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f627ef95700 1 --2- 172.21.15.31:0/2917975034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780cc1e0 0x7f62781573b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f626c0099b0 tx=0x7f626c009250 comp rx=0 tx=0).stop 2023-10-09T06:30:22.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f627ef95700 1 -- 172.21.15.31:0/2917975034 shutdown_connections 2023-10-09T06:30:22.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f627ef95700 1 --2- 172.21.15.31:0/2917975034 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f62780678b0 0x7f62780cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f627ef95700 1 --2- 172.21.15.31:0/2917975034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780cc1e0 0x7f62781573b0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f627ef95700 1 -- 172.21.15.31:0/2917975034 >> 172.21.15.31:0/2917975034 conn(0x7f62780d0dc0 msgr2=0x7f62780d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:22.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.556+0000 7f627ef95700 1 -- 172.21.15.31:0/2917975034 shutdown_connections 2023-10-09T06:30:22.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.557+0000 7f627ef95700 1 -- 172.21.15.31:0/2917975034 wait complete. 2023-10-09T06:30:22.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.558+0000 7f627ef95700 1 Processor -- start 2023-10-09T06:30:22.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.558+0000 7f627ef95700 1 -- start start 2023-10-09T06:30:22.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.558+0000 7f627ef95700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62780678b0 0x7f62780c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:22.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.558+0000 7f627ef95700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6278067c80 0x7f62780b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:22.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.558+0000 7f627ef95700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780cc1e0 0x7f6278148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:22.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.558+0000 7f627ef95700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62780b51f0 con 0x7f62780cc1e0 2023-10-09T06:30:22.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.558+0000 7f627ef95700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62780b54d0 con 0x7f62780678b0 2023-10-09T06:30:22.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.558+0000 7f627ef95700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62780b57b0 con 0x7f6278067c80 2023-10-09T06:30:22.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f627d532700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780cc1e0 0x7f6278148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:22.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f627d532700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780cc1e0 0x7f6278148450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50626/0 (socket says 172.21.15.31:50626) 2023-10-09T06:30:22.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f627d532700 1 -- 172.21.15.31:0/3078194000 learned_addr learned my addr 172.21.15.31:0/3078194000 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:22.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f627cd31700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62780678b0 0x7f62780c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:22.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f6277fff700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6278067c80 0x7f62780b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:22.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f627d532700 1 -- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6278067c80 msgr2=0x7f62780b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:22.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f627d532700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6278067c80 0x7f62780b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f627d532700 1 -- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62780678b0 msgr2=0x7f62780c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:22.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f627d532700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62780678b0 0x7f62780c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f627d532700 1 -- 172.21.15.31:0/3078194000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c0094f0 con 0x7f62780cc1e0 2023-10-09T06:30:22.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f627d532700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780cc1e0 0x7f6278148450 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f627000c8e0 tx=0x7f6270001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:22.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f6274ff9700 1 -- 172.21.15.31:0/3078194000 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270012630 con 0x7f62780cc1e0 2023-10-09T06:30:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f6274ff9700 1 -- 172.21.15.31:0/3078194000 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6270012790 con 0x7f62780cc1e0 2023-10-09T06:30:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f627ef95700 1 -- 172.21.15.31:0/3078194000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62780b5a90 con 0x7f62780cc1e0 2023-10-09T06:30:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f6274ff9700 1 -- 172.21.15.31:0/3078194000 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270012b50 con 0x7f62780cc1e0 2023-10-09T06:30:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.559+0000 7f627ef95700 1 -- 172.21.15.31:0/3078194000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62781571f0 con 0x7f62780cc1e0 2023-10-09T06:30:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.560+0000 7f627ef95700 1 -- 172.21.15.31:0/3078194000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627804c3c0 con 0x7f62780cc1e0 2023-10-09T06:30:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.561+0000 7f6274ff9700 1 -- 172.21.15.31:0/3078194000 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f627001a3a0 con 0x7f62780cc1e0 2023-10-09T06:30:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.561+0000 7f6274ff9700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6264066f30 0x7f62640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.561+0000 7f6274ff9700 1 -- 172.21.15.31:0/3078194000 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6270084350 con 0x7f62780cc1e0 2023-10-09T06:30:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.561+0000 7f627cd31700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6264066f30 0x7f62640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.562+0000 7f627cd31700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6264066f30 0x7f62640693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6268009db0 tx=0x7f62680091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.565+0000 7f6274ff9700 1 -- 172.21.15.31:0/3078194000 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62700553a0 con 0x7f62780cc1e0 2023-10-09T06:30:22.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.757+0000 7f627ef95700 1 -- 172.21.15.31:0/3078194000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f627815e0d0 con 0x7f62780cc1e0 2023-10-09T06:30:22.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.978+0000 7f6274ff9700 1 -- 172.21.15.31:0/3078194000 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v165) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6270054f30 con 0x7f62780cc1e0 2023-10-09T06:30:22.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.981+0000 7f627ef95700 1 -- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6264066f30 msgr2=0x7f62640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:22.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.981+0000 7f627ef95700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6264066f30 0x7f62640693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6268009db0 tx=0x7f62680091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.981+0000 7f627ef95700 1 -- 172.21.15.31:0/3078194000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780cc1e0 msgr2=0x7f6278148450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:22.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.981+0000 7f627ef95700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780cc1e0 0x7f6278148450 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f627000c8e0 tx=0x7f6270001710 comp rx=0 tx=0).stop 2023-10-09T06:30:22.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.981+0000 7f627ef95700 1 -- 172.21.15.31:0/3078194000 shutdown_connections 2023-10-09T06:30:22.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.981+0000 7f627ef95700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6264066f30 0x7f62640693e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.981+0000 7f627ef95700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62780cc1e0 0x7f6278148450 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.981+0000 7f627ef95700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f62780678b0 0x7f62780c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.981+0000 7f627ef95700 1 --2- 172.21.15.31:0/3078194000 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6278067c80 0x7f62780b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:22.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.982+0000 7f627ef95700 1 -- 172.21.15.31:0/3078194000 >> 172.21.15.31:0/3078194000 conn(0x7f62780d0dc0 msgr2=0x7f62780b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:22.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.982+0000 7f627ef95700 1 -- 172.21.15.31:0/3078194000 shutdown_connections 2023-10-09T06:30:22.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:22.982+0000 7f627ef95700 1 -- 172.21.15.31:0/3078194000 wait complete. 2023-10-09T06:30:22.986 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-10-09T06:30:22.996 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:30:23.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.122+0000 7fd0ad366700 1 Processor -- start 2023-10-09T06:30:23.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.122+0000 7fd0ad366700 1 -- start start 2023-10-09T06:30:23.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.123+0000 7fd0ad366700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd0a8159860 0x7fd0a8159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:23.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.123+0000 7fd0ad366700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a80b12a0 0x7fd0a80b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:23.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.123+0000 7fd0ad366700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a815a170 con 0x7fd0a80b2f70 2023-10-09T06:30:23.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.123+0000 7fd0ad366700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a815e710 con 0x7fd0a8159860 2023-10-09T06:30:23.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.123+0000 7fd0ad366700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80b04e0 con 0x7fd0a80b12a0 2023-10-09T06:30:23.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.123+0000 7fd0a77fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd0a80b2f70 0x7fd0a815d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43184/0 (socket says 172.21.15.31:43184) 2023-10-09T06:30:23.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.123+0000 7fd0a77fe700 1 -- 172.21.15.31:0/2019485885 learned_addr learned my addr 172.21.15.31:0/2019485885 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:23.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.123+0000 7fd0a67fc700 1 --2- 172.21.15.31:0/2019485885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a80b12a0 0x7fd0a80b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:23.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.123+0000 7fd0a6ffd700 1 --2- 172.21.15.31:0/2019485885 >> v2:172.21.15.158:3300/0 conn(0x7fd0a8159860 0x7fd0a8159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:23.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.123+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971871730 0 0) 0x7fd0a815a170 con 0x7fd0a80b2f70 2023-10-09T06:30:23.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.123+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd094003570 con 0x7fd0a80b2f70 2023-10-09T06:30:23.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1164243447 0 0) 0x7fd094003570 con 0x7fd0a80b2f70 2023-10-09T06:30:23.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a80b12a0 msgr2=0x7fd0a80b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:23.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 --2- 172.21.15.31:0/2019485885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a80b12a0 0x7fd0a80b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:23.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 >> v2:172.21.15.158:3300/0 conn(0x7fd0a8159860 msgr2=0x7fd0a8159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:23.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 --2- 172.21.15.31:0/2019485885 >> v2:172.21.15.158:3300/0 conn(0x7fd0a8159860 0x7fd0a8159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:23.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a80b07c0 con 0x7fd0a80b2f70 2023-10-09T06:30:23.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fd0980017f0 con 0x7fd0a80b2f70 2023-10-09T06:30:23.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 >> v1:172.21.15.31:6789/0 conn(0x7fd0a80b2f70 legacy=0x7fd0a815d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:23.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 --2- 172.21.15.31:0/2019485885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd094003a60 0x7fd094003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:23.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 --2- 172.21.15.31:0/2019485885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a80b12a0 0x7fd094004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:23.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 --2- 172.21.15.31:0/2019485885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd094004d50 0x7fd0940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:23.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a815e710 con 0x7fd094004d50 2023-10-09T06:30:23.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80b04e0 con 0x7fd094003a60 2023-10-09T06:30:23.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09400ba90 con 0x7fd0a80b12a0 2023-10-09T06:30:23.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a6ffd700 1 --2- 172.21.15.31:0/2019485885 >> v2:172.21.15.158:3300/0 conn(0x7fd0a8159860 0x7fd0a8159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:30:23.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a77fe700 1 --2- 172.21.15.31:0/2019485885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd094004d50 0x7fd0940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:23.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a67fc700 1 --2- 172.21.15.31:0/2019485885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a80b12a0 0x7fd094004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:23.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a6ffd700 1 --2- 172.21.15.31:0/2019485885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd094003a60 0x7fd094003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:23.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a77fe700 1 -- 172.21.15.31:0/2019485885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a80b12a0 msgr2=0x7fd094004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:23.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a77fe700 1 --2- 172.21.15.31:0/2019485885 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a80b12a0 0x7fd094004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:23.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a77fe700 1 -- 172.21.15.31:0/2019485885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd094003a60 msgr2=0x7fd094003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:23.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a77fe700 1 --2- 172.21.15.31:0/2019485885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd094003a60 0x7fd094003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:23.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a77fe700 1 -- 172.21.15.31:0/2019485885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094003570 con 0x7fd094004d50 2023-10-09T06:30:23.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.124+0000 7fd0a77fe700 1 --2- 172.21.15.31:0/2019485885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd094004d50 0x7fd0940051c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fd09800a970 tx=0x7fd0a80b22c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10ec912df2ded5d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:23.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.125+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0980070d0 con 0x7fd094004d50 2023-10-09T06:30:23.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.125+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd098007230 con 0x7fd094004d50 2023-10-09T06:30:23.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.125+0000 7fd0a5ffb700 1 -- 172.21.15.31:0/2019485885 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0980075f0 con 0x7fd094004d50 2023-10-09T06:30:23.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.125+0000 7fd0ad366700 1 -- 172.21.15.31:0/2019485885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd094004d50 msgr2=0x7fd0940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:23.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.125+0000 7fd0ad366700 1 --2- 172.21.15.31:0/2019485885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd094004d50 0x7fd0940051c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fd09800a970 tx=0x7fd0a80b22c0 comp rx=0 tx=0).stop 2023-10-09T06:30:23.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.125+0000 7fd0a77fe700 1 -- 172.21.15.31:0/2019485885 reap_dead start 2023-10-09T06:30:23.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.125+0000 7fd0ad366700 1 -- 172.21.15.31:0/2019485885 shutdown_connections 2023-10-09T06:30:23.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.125+0000 7fd0ad366700 1 -- 172.21.15.31:0/2019485885 >> 172.21.15.31:0/2019485885 conn(0x7fd0a8068c80 msgr2=0x7fd0a8069080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:23.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.125+0000 7fd0ad366700 1 -- 172.21.15.31:0/2019485885 shutdown_connections 2023-10-09T06:30:23.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.125+0000 7fd0ad366700 1 -- 172.21.15.31:0/2019485885 wait complete. 2023-10-09T06:30:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.126+0000 7fd0ad366700 1 Processor -- start 2023-10-09T06:30:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.126+0000 7fd0ad366700 1 -- start start 2023-10-09T06:30:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.127+0000 7fd0ad366700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a8158200 0x7fd0a80c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.127+0000 7fd0ad366700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0a80ca420 0x7fd0a80ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.127+0000 7fd0ad366700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0a80b59d0 0x7fd0a80b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.127+0000 7fd0ad366700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80b63b0 con 0x7fd0a80ca420 2023-10-09T06:30:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.127+0000 7fd0ad366700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80c5460 con 0x7fd0a80b59d0 2023-10-09T06:30:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.127+0000 7fd0ad366700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80c79f0 con 0x7fd0a8158200 2023-10-09T06:30:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.127+0000 7fd0a67fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0a80ca420 0x7fd0a80ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.127+0000 7fd0a67fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0a80ca420 0x7fd0a80ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50646/0 (socket says 172.21.15.31:50646) 2023-10-09T06:30:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.127+0000 7fd0a67fc700 1 -- 172.21.15.31:0/580067303 learned_addr learned my addr 172.21.15.31:0/580067303 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.127+0000 7fd0a6ffd700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a8158200 0x7fd0a80c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.127+0000 7fd0a77fe700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0a80b59d0 0x7fd0a80b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.128+0000 7fd0a67fc700 1 -- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a8158200 msgr2=0x7fd0a80c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.128+0000 7fd0a67fc700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a8158200 0x7fd0a80c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.128+0000 7fd0a67fc700 1 -- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0a80b59d0 msgr2=0x7fd0a80b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.128+0000 7fd0a67fc700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0a80b59d0 0x7fd0a80b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.128+0000 7fd0a67fc700 1 -- 172.21.15.31:0/580067303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a80c7150 con 0x7fd0a80ca420 2023-10-09T06:30:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.128+0000 7fd0a6ffd700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a8158200 0x7fd0a80c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.128+0000 7fd0a77fe700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0a80b59d0 0x7fd0a80b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.128+0000 7fd0a67fc700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0a80ca420 0x7fd0a80ce740 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fd090006ac0 tx=0x7fd0900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.128+0000 7fd09effd700 1 -- 172.21.15.31:0/580067303 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09000fa10 con 0x7fd0a80ca420 2023-10-09T06:30:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.128+0000 7fd09effd700 1 -- 172.21.15.31:0/580067303 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09000fb70 con 0x7fd0a80ca420 2023-10-09T06:30:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.128+0000 7fd0ad366700 1 -- 172.21.15.31:0/580067303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a80c7430 con 0x7fd0a80ca420 2023-10-09T06:30:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.128+0000 7fd09effd700 1 -- 172.21.15.31:0/580067303 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090014440 con 0x7fd0a80ca420 2023-10-09T06:30:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.128+0000 7fd0ad366700 1 -- 172.21.15.31:0/580067303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a80cfd50 con 0x7fd0a80ca420 2023-10-09T06:30:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.129+0000 7fd09effd700 1 -- 172.21.15.31:0/580067303 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd090014870 con 0x7fd0a80ca420 2023-10-09T06:30:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.129+0000 7fd0ad366700 1 -- 172.21.15.31:0/580067303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a8089870 con 0x7fd0a80ca420 2023-10-09T06:30:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.130+0000 7fd09effd700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd088066f30 0x7fd0880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.130+0000 7fd09effd700 1 -- 172.21.15.31:0/580067303 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fd090018030 con 0x7fd0a80ca420 2023-10-09T06:30:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.130+0000 7fd0a6ffd700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd088066f30 0x7fd0880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.130+0000 7fd0a6ffd700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd088066f30 0x7fd0880693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00093f0 tx=0x7fd0a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.134+0000 7fd09effd700 1 -- 172.21.15.31:0/580067303 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0900522b0 con 0x7fd0a80ca420 2023-10-09T06:30:23.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.327+0000 7fd0ad366700 1 -- 172.21.15.31:0/580067303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd0a804bb80 con 0x7fd0a80ca420 2023-10-09T06:30:23.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.981+0000 7fd09effd700 1 -- 172.21.15.31:0/580067303 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v166) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd0900220d0 con 0x7fd0a80ca420 2023-10-09T06:30:23.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.989+0000 7fd0ad366700 1 -- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd088066f30 msgr2=0x7fd0880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:23.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.989+0000 7fd0ad366700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd088066f30 0x7fd0880693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00093f0 tx=0x7fd0a0008040 comp rx=0 tx=0).stop 2023-10-09T06:30:23.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.989+0000 7fd0ad366700 1 -- 172.21.15.31:0/580067303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0a80ca420 msgr2=0x7fd0a80ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:23.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.989+0000 7fd0ad366700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0a80ca420 0x7fd0a80ce740 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fd090006ac0 tx=0x7fd0900091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:23.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.990+0000 7fd0ad366700 1 -- 172.21.15.31:0/580067303 shutdown_connections 2023-10-09T06:30:23.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.990+0000 7fd0ad366700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd088066f30 0x7fd0880693e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:23.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.990+0000 7fd0ad366700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0a8158200 0x7fd0a80c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:23.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.990+0000 7fd0ad366700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0a80b59d0 0x7fd0a80b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:23.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.990+0000 7fd0ad366700 1 --2- 172.21.15.31:0/580067303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0a80ca420 0x7fd0a80ce740 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:23.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.990+0000 7fd0ad366700 1 -- 172.21.15.31:0/580067303 >> 172.21.15.31:0/580067303 conn(0x7fd0a8068c80 msgr2=0x7fd0a8158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:23.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.990+0000 7fd0ad366700 1 -- 172.21.15.31:0/580067303 shutdown_connections 2023-10-09T06:30:23.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:23.990+0000 7fd0ad366700 1 -- 172.21.15.31:0/580067303 wait complete. 2023-10-09T06:30:23.996 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-10-09T06:30:24.008 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:30:24.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.132+0000 7f882f0d0700 1 Processor -- start 2023-10-09T06:30:24.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.132+0000 7f882f0d0700 1 -- start start 2023-10-09T06:30:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f882f0d0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8828159ec0 0x7f88280af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f882f0d0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f882815a290 0x7f88280afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f882f0d0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88280b0790 con 0x7f882806a5a0 2023-10-09T06:30:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f882f0d0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88280ce1f0 con 0x7f8828159ec0 2023-10-09T06:30:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f882f0d0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88280b0b20 con 0x7f882815a290 2023-10-09T06:30:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f882ce6c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8828159ec0 0x7f88280af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f882d66d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f882806a5a0 0x7f882815db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43196/0 (socket says 172.21.15.31:43196) 2023-10-09T06:30:24.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f882d66d700 1 -- 172.21.15.31:0/2818200624 learned_addr learned my addr 172.21.15.31:0/2818200624 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:24.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f8827fff700 1 --2- 172.21.15.31:0/2818200624 >> v2:172.21.15.158:3300/0 conn(0x7f882815a290 0x7f88280afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:24.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f882ce6c700 1 -- 172.21.15.31:0/2818200624 >> v2:172.21.15.158:3300/0 conn(0x7f882815a290 msgr2=0x7f88280afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:24.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f882ce6c700 1 --2- 172.21.15.31:0/2818200624 >> v2:172.21.15.158:3300/0 conn(0x7f882815a290 0x7f88280afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:24.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f882ce6c700 1 -- 172.21.15.31:0/2818200624 >> v1:172.21.15.31:6789/0 conn(0x7f882806a5a0 legacy=0x7f882815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:24.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f882ce6c700 1 -- 172.21.15.31:0/2818200624 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88280b04b0 con 0x7f8828159ec0 2023-10-09T06:30:24.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f88277fe700 1 -- 172.21.15.31:0/2818200624 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448642551 0 0) 0x7f88280b0790 con 0x7f882806a5a0 2023-10-09T06:30:24.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f8827fff700 1 --2- 172.21.15.31:0/2818200624 >> v2:172.21.15.158:3300/0 conn(0x7f882815a290 0x7f88280afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:24.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.133+0000 7f882ce6c700 1 --2- 172.21.15.31:0/2818200624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8828159ec0 0x7f88280af940 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f8828089910 tx=0x7f881c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d3cb88706276a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:24.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.134+0000 7f88277fe700 1 -- 172.21.15.31:0/2818200624 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00b6b0 con 0x7f8828159ec0 2023-10-09T06:30:24.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.134+0000 7f88277fe700 1 -- 172.21.15.31:0/2818200624 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c00b810 con 0x7f8828159ec0 2023-10-09T06:30:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.134+0000 7f88277fe700 1 -- 172.21.15.31:0/2818200624 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00bbb0 con 0x7f8828159ec0 2023-10-09T06:30:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.134+0000 7f882f0d0700 1 -- 172.21.15.31:0/2818200624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8828159ec0 msgr2=0x7f88280af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.134+0000 7f882f0d0700 1 --2- 172.21.15.31:0/2818200624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8828159ec0 0x7f88280af940 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f8828089910 tx=0x7f881c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.134+0000 7f882f0d0700 1 -- 172.21.15.31:0/2818200624 shutdown_connections 2023-10-09T06:30:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.134+0000 7f882f0d0700 1 --2- 172.21.15.31:0/2818200624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8828159ec0 0x7f88280af940 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.134+0000 7f882f0d0700 1 --2- 172.21.15.31:0/2818200624 >> v2:172.21.15.158:3300/0 conn(0x7f882815a290 0x7f88280afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.134+0000 7f882f0d0700 1 -- 172.21.15.31:0/2818200624 >> 172.21.15.31:0/2818200624 conn(0x7f88280d1880 msgr2=0x7f88280cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.134+0000 7f882f0d0700 1 -- 172.21.15.31:0/2818200624 shutdown_connections 2023-10-09T06:30:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.134+0000 7f882f0d0700 1 -- 172.21.15.31:0/2818200624 wait complete. 2023-10-09T06:30:24.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.135+0000 7f882f0d0700 1 Processor -- start 2023-10-09T06:30:24.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.136+0000 7f882f0d0700 1 -- start start 2023-10-09T06:30:24.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.136+0000 7f882f0d0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882806a5a0 0x7f88281531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:24.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.136+0000 7f882f0d0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8828159ec0 0x7f8828152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:24.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.136+0000 7f882f0d0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f882815a290 0x7f882816a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:24.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.136+0000 7f882f0d0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88280c97f0 con 0x7f882806a5a0 2023-10-09T06:30:24.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.136+0000 7f882f0d0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8828152fd0 con 0x7f8828159ec0 2023-10-09T06:30:24.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.136+0000 7f882f0d0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882816aa80 con 0x7f882815a290 2023-10-09T06:30:24.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.136+0000 7f882ce6c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882806a5a0 0x7f88281531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:24.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.136+0000 7f882ce6c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882806a5a0 0x7f88281531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50660/0 (socket says 172.21.15.31:50660) 2023-10-09T06:30:24.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.136+0000 7f882ce6c700 1 -- 172.21.15.31:0/2616765597 learned_addr learned my addr 172.21.15.31:0/2616765597 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:24.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.136+0000 7f8827fff700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8828159ec0 0x7f8828152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:24.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.137+0000 7f882d66d700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f882815a290 0x7f882816a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:24.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.137+0000 7f882ce6c700 1 -- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f882815a290 msgr2=0x7f882816a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:24.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.137+0000 7f882ce6c700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f882815a290 0x7f882816a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:24.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.137+0000 7f882ce6c700 1 -- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8828159ec0 msgr2=0x7f8828152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:24.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.137+0000 7f882ce6c700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8828159ec0 0x7f8828152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:24.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.137+0000 7f882ce6c700 1 -- 172.21.15.31:0/2616765597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c009420 con 0x7f882806a5a0 2023-10-09T06:30:24.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.137+0000 7f882ce6c700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882806a5a0 0x7f88281531c0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f881c00b0e0 tx=0x7f881c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:24.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.137+0000 7f8824ff9700 1 -- 172.21.15.31:0/2616765597 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00bb90 con 0x7f882806a5a0 2023-10-09T06:30:24.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.137+0000 7f8824ff9700 1 -- 172.21.15.31:0/2616765597 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c011420 con 0x7f882806a5a0 2023-10-09T06:30:24.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.137+0000 7f882f0d0700 1 -- 172.21.15.31:0/2616765597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882816ad40 con 0x7f882806a5a0 2023-10-09T06:30:24.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.137+0000 7f8824ff9700 1 -- 172.21.15.31:0/2616765597 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0117a0 con 0x7f882806a5a0 2023-10-09T06:30:24.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.137+0000 7f882f0d0700 1 -- 172.21.15.31:0/2616765597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88280c9a00 con 0x7f882806a5a0 2023-10-09T06:30:24.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.138+0000 7f882f0d0700 1 -- 172.21.15.31:0/2616765597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882804c3c0 con 0x7f882806a5a0 2023-10-09T06:30:24.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.139+0000 7f8824ff9700 1 -- 172.21.15.31:0/2616765597 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f881c011b90 con 0x7f882806a5a0 2023-10-09T06:30:24.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.139+0000 7f8824ff9700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f880c066f30 0x7f880c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:24.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.139+0000 7f8824ff9700 1 -- 172.21.15.31:0/2616765597 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f881c0860a0 con 0x7f882806a5a0 2023-10-09T06:30:24.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.139+0000 7f8827fff700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f880c066f30 0x7f880c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:24.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.140+0000 7f8827fff700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f880c066f30 0x7f880c0693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f88280c9460 tx=0x7f8814008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:24.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.144+0000 7f8824ff9700 1 -- 172.21.15.31:0/2616765597 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f881c053370 con 0x7f882806a5a0 2023-10-09T06:30:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:24.380+0000 7f882f0d0700 1 -- 172.21.15.31:0/2616765597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f88280ceab0 con 0x7f882806a5a0 2023-10-09T06:30:25.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.009+0000 7f8824ff9700 1 -- 172.21.15.31:0/2616765597 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v78) v1 ==== 174+0+0 (secure 0 0 0) 0x7f881c056990 con 0x7f882806a5a0 2023-10-09T06:30:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.012+0000 7f882f0d0700 1 -- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f880c066f30 msgr2=0x7f880c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.012+0000 7f882f0d0700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f880c066f30 0x7f880c0693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f88280c9460 tx=0x7f8814008040 comp rx=0 tx=0).stop 2023-10-09T06:30:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.012+0000 7f882f0d0700 1 -- 172.21.15.31:0/2616765597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882806a5a0 msgr2=0x7f88281531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.012+0000 7f882f0d0700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882806a5a0 0x7f88281531c0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f881c00b0e0 tx=0x7f881c017000 comp rx=0 tx=0).stop 2023-10-09T06:30:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.012+0000 7f882f0d0700 1 -- 172.21.15.31:0/2616765597 shutdown_connections 2023-10-09T06:30:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.012+0000 7f882f0d0700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f880c066f30 0x7f880c0693e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.012+0000 7f882f0d0700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f882815a290 0x7f882816a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.012+0000 7f882f0d0700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882806a5a0 0x7f88281531c0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.012+0000 7f882f0d0700 1 --2- 172.21.15.31:0/2616765597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8828159ec0 0x7f8828152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.012+0000 7f882f0d0700 1 -- 172.21.15.31:0/2616765597 >> 172.21.15.31:0/2616765597 conn(0x7f88280d1880 msgr2=0x7f88280d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.012+0000 7f882f0d0700 1 -- 172.21.15.31:0/2616765597 shutdown_connections 2023-10-09T06:30:25.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.012+0000 7f882f0d0700 1 -- 172.21.15.31:0/2616765597 wait complete. 2023-10-09T06:30:25.017 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 20 and data pool 21 2023-10-09T06:30:25.028 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:30:25.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.193+0000 7fedc583b700 1 Processor -- start 2023-10-09T06:30:25.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.193+0000 7fedc583b700 1 -- start start 2023-10-09T06:30:25.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.194+0000 7fedc583b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fedc015d5d0 0x7fedc00b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.194+0000 7fedc583b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fedc00b2190 0x7fedc009b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.194+0000 7fedc583b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc009acf0 con 0x7fedc00b1610 2023-10-09T06:30:25.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.194+0000 7fedc583b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc015d9a0 con 0x7fedc00b2190 2023-10-09T06:30:25.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.194+0000 7fedc583b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc00b4b20 con 0x7fedc015d5d0 2023-10-09T06:30:25.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.194+0000 7fedbf7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fedc00b2190 0x7fedc009b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.194+0000 7fedbf7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fedc00b2190 0x7fedc009b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50670/0 (socket says 172.21.15.31:50670) 2023-10-09T06:30:25.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.194+0000 7fedbf7fe700 1 -- 172.21.15.31:0/2853640182 learned_addr learned my addr 172.21.15.31:0/2853640182 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:25.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.194+0000 7fedbeffd700 1 --2- 172.21.15.31:0/2853640182 >> v2:172.21.15.158:3300/0 conn(0x7fedc015d5d0 0x7fedc00b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.194+0000 7fedbf7fe700 1 -- 172.21.15.31:0/2853640182 >> v2:172.21.15.158:3300/0 conn(0x7fedc015d5d0 msgr2=0x7fedc00b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:25.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.194+0000 7fedbf7fe700 1 --2- 172.21.15.31:0/2853640182 >> v2:172.21.15.158:3300/0 conn(0x7fedc015d5d0 0x7fedc00b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.194+0000 7fedbf7fe700 1 -- 172.21.15.31:0/2853640182 >> v1:172.21.15.158:6789/0 conn(0x7fedc00b1610 legacy=0x7fedc00b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:25.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.194+0000 7fedbf7fe700 1 -- 172.21.15.31:0/2853640182 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc00b4e00 con 0x7fedc00b2190 2023-10-09T06:30:25.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.195+0000 7fedbf7fe700 1 --2- 172.21.15.31:0/2853640182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedc00b2190 0x7fedc009b180 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fedc00b6d10 tx=0x7fedb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd47794a49ce2ce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:25.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.195+0000 7fedbdffb700 1 -- 172.21.15.31:0/2853640182 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800b8b0 con 0x7fedc00b2190 2023-10-09T06:30:25.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.195+0000 7fedbdffb700 1 -- 172.21.15.31:0/2853640182 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb800ba10 con 0x7fedc00b2190 2023-10-09T06:30:25.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.195+0000 7fedbdffb700 1 -- 172.21.15.31:0/2853640182 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800bdb0 con 0x7fedc00b2190 2023-10-09T06:30:25.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.195+0000 7fedc583b700 1 -- 172.21.15.31:0/2853640182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedc00b2190 msgr2=0x7fedc009b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.195+0000 7fedc583b700 1 --2- 172.21.15.31:0/2853640182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedc00b2190 0x7fedc009b180 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fedc00b6d10 tx=0x7fedb8009250 comp rx=0 tx=0).stop 2023-10-09T06:30:25.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.195+0000 7fedc583b700 1 -- 172.21.15.31:0/2853640182 shutdown_connections 2023-10-09T06:30:25.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.195+0000 7fedc583b700 1 --2- 172.21.15.31:0/2853640182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedc00b2190 0x7fedc009b180 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.195+0000 7fedc583b700 1 --2- 172.21.15.31:0/2853640182 >> v2:172.21.15.158:3300/0 conn(0x7fedc015d5d0 0x7fedc00b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.195+0000 7fedc583b700 1 -- 172.21.15.31:0/2853640182 >> 172.21.15.31:0/2853640182 conn(0x7fedc0067e40 msgr2=0x7fedc00d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:25.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.195+0000 7fedc583b700 1 -- 172.21.15.31:0/2853640182 shutdown_connections 2023-10-09T06:30:25.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.195+0000 7fedc583b700 1 -- 172.21.15.31:0/2853640182 wait complete. 2023-10-09T06:30:25.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.197+0000 7fedc583b700 1 Processor -- start 2023-10-09T06:30:25.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.197+0000 7fedc583b700 1 -- start start 2023-10-09T06:30:25.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.197+0000 7fedc583b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fedc00b1610 0x7fedc0154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedc583b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedc00b2190 0x7fedc014f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedc583b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedc015d5d0 0x7fedc0152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedc583b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc009b800 con 0x7fedc00b2190 2023-10-09T06:30:25.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedc583b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc01533d0 con 0x7fedc015d5d0 2023-10-09T06:30:25.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedc583b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc009b1b0 con 0x7fedc00b1610 2023-10-09T06:30:25.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedbe7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedc00b2190 0x7fedc014f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedbe7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedc00b2190 0x7fedc014f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50678/0 (socket says 172.21.15.31:50678) 2023-10-09T06:30:25.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedbe7fc700 1 -- 172.21.15.31:0/2322588159 learned_addr learned my addr 172.21.15.31:0/2322588159 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:25.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedbf7fe700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedc015d5d0 0x7fedc0152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedbeffd700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fedc00b1610 0x7fedc0154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedbe7fc700 1 -- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fedc00b1610 msgr2=0x7fedc0154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedbe7fc700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fedc00b1610 0x7fedc0154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedbe7fc700 1 -- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedc015d5d0 msgr2=0x7fedc0152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedbe7fc700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedc015d5d0 0x7fedc0152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedbe7fc700 1 -- 172.21.15.31:0/2322588159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80094f0 con 0x7fedc00b2190 2023-10-09T06:30:25.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedbe7fc700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedc00b2190 0x7fedc014f150 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7feda800c5d0 tx=0x7feda8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:25.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedb6ffd700 1 -- 172.21.15.31:0/2322588159 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8011590 con 0x7fedc00b2190 2023-10-09T06:30:25.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedb6ffd700 1 -- 172.21.15.31:0/2322588159 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda8011710 con 0x7fedc00b2190 2023-10-09T06:30:25.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedb6ffd700 1 -- 172.21.15.31:0/2322588159 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8011ad0 con 0x7fedc00b2190 2023-10-09T06:30:25.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedc583b700 1 -- 172.21.15.31:0/2322588159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc009b490 con 0x7fedc00b2190 2023-10-09T06:30:25.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.198+0000 7fedc583b700 1 -- 172.21.15.31:0/2322588159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc014f690 con 0x7fedc00b2190 2023-10-09T06:30:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.199+0000 7fedc583b700 1 -- 172.21.15.31:0/2322588159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc009b970 con 0x7fedc00b2190 2023-10-09T06:30:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.200+0000 7fedb6ffd700 1 -- 172.21.15.31:0/2322588159 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feda801c460 con 0x7fedc00b2190 2023-10-09T06:30:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.200+0000 7fedb6ffd700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7feda0066f30 0x7feda00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.200+0000 7fedb6ffd700 1 -- 172.21.15.31:0/2322588159 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feda8084290 con 0x7fedc00b2190 2023-10-09T06:30:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.200+0000 7fedbeffd700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7feda0066f30 0x7feda00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.201+0000 7fedbeffd700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7feda0066f30 0x7feda00693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fedb0007460 tx=0x7fedb000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.205+0000 7fedb6ffd700 1 -- 172.21.15.31:0/2322588159 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feda8051500 con 0x7fedc00b2190 2023-10-09T06:30:25.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.398+0000 7fedc583b700 1 -- 172.21.15.31:0/2322588159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedc009a980 con 0x7fedc00b2190 2023-10-09T06:30:25.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.399+0000 7fedb6ffd700 1 -- 172.21.15.31:0/2322588159 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+15378 (secure 0 0 0) 0x7feda8054b20 con 0x7fedc00b2190 2023-10-09T06:30:25.400 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:25.400 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":167,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:30:24.381933+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:30:22.788833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T06:30:23.358451+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:30:25.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.401+0000 7fedc583b700 1 -- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7feda0066f30 msgr2=0x7feda00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.401+0000 7fedc583b700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7feda0066f30 0x7feda00693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fedb0007460 tx=0x7fedb000b040 comp rx=0 tx=0).stop 2023-10-09T06:30:25.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.401+0000 7fedc583b700 1 -- 172.21.15.31:0/2322588159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedc00b2190 msgr2=0x7fedc014f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.401+0000 7fedc583b700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedc00b2190 0x7fedc014f150 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7feda800c5d0 tx=0x7feda8007f60 comp rx=0 tx=0).stop 2023-10-09T06:30:25.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.401+0000 7fedc583b700 1 -- 172.21.15.31:0/2322588159 shutdown_connections 2023-10-09T06:30:25.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.401+0000 7fedc583b700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7feda0066f30 0x7feda00693e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.401+0000 7fedc583b700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fedc00b1610 0x7fedc0154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.401+0000 7fedc583b700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedc015d5d0 0x7fedc0152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.401+0000 7fedc583b700 1 --2- 172.21.15.31:0/2322588159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedc00b2190 0x7fedc014f150 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.401+0000 7fedc583b700 1 -- 172.21.15.31:0/2322588159 >> 172.21.15.31:0/2322588159 conn(0x7fedc0067e40 msgr2=0x7fedc015bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:25.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.401+0000 7fedc583b700 1 -- 172.21.15.31:0/2322588159 shutdown_connections 2023-10-09T06:30:25.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.401+0000 7fedc583b700 1 -- 172.21.15.31:0/2322588159 wait complete. 2023-10-09T06:30:25.415 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:30:25.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.534+0000 7f4fcf461700 1 Processor -- start 2023-10-09T06:30:25.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.534+0000 7f4fcf461700 1 -- start start 2023-10-09T06:30:25.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcf461700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4fc8156570 0x7f4fc806d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcf461700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fc815a330 0x7f4fc806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcf461700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4fc8156940 0x7f4fc8156da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcf461700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc8157c30 con 0x7f4fc8156940 2023-10-09T06:30:25.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcf461700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc81584f0 con 0x7f4fc8156570 2023-10-09T06:30:25.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcf461700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8157670 con 0x7f4fc815a330 2023-10-09T06:30:25.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcd9fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4fc8156940 0x7f4fc8156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcd9fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4fc8156940 0x7f4fc8156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50688/0 (socket says 172.21.15.31:50688) 2023-10-09T06:30:25.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcd9fe700 1 -- 172.21.15.31:0/4054763674 learned_addr learned my addr 172.21.15.31:0/4054763674 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:25.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcc9fc700 1 --2- 172.21.15.31:0/4054763674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fc815a330 0x7f4fc806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcd1fd700 1 --2- 172.21.15.31:0/4054763674 >> v2:172.21.15.158:3300/0 conn(0x7f4fc8156570 0x7f4fc806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcd9fe700 1 -- 172.21.15.31:0/4054763674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fc815a330 msgr2=0x7f4fc806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:25.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcd9fe700 1 --2- 172.21.15.31:0/4054763674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fc815a330 0x7f4fc806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcd9fe700 1 -- 172.21.15.31:0/4054763674 >> v2:172.21.15.158:3300/0 conn(0x7f4fc8156570 msgr2=0x7f4fc806d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:25.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcd9fe700 1 --2- 172.21.15.31:0/4054763674 >> v2:172.21.15.158:3300/0 conn(0x7f4fc8156570 0x7f4fc806d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcd9fe700 1 -- 172.21.15.31:0/4054763674 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8157950 con 0x7f4fc8156940 2023-10-09T06:30:25.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcc9fc700 1 --2- 172.21.15.31:0/4054763674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fc815a330 0x7f4fc806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:25.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.535+0000 7f4fcd9fe700 1 --2- 172.21.15.31:0/4054763674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc8156940 0x7f4fc8156da0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80c9e60 tx=0x7f4fc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591ea564f17fe035 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:25.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.536+0000 7f4fc7fff700 1 -- 172.21.15.31:0/4054763674 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000e070 con 0x7f4fc8156940 2023-10-09T06:30:25.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.536+0000 7f4fc7fff700 1 -- 172.21.15.31:0/4054763674 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc000ba50 con 0x7f4fc8156940 2023-10-09T06:30:25.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.536+0000 7f4fc7fff700 1 -- 172.21.15.31:0/4054763674 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00092e0 con 0x7f4fc8156940 2023-10-09T06:30:25.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.536+0000 7f4fcf461700 1 -- 172.21.15.31:0/4054763674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc8156940 msgr2=0x7f4fc8156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.536+0000 7f4fcf461700 1 --2- 172.21.15.31:0/4054763674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc8156940 0x7f4fc8156da0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80c9e60 tx=0x7f4fc0009840 comp rx=0 tx=0).stop 2023-10-09T06:30:25.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.536+0000 7f4fcf461700 1 -- 172.21.15.31:0/4054763674 shutdown_connections 2023-10-09T06:30:25.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.536+0000 7f4fcf461700 1 --2- 172.21.15.31:0/4054763674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc8156940 0x7f4fc8156da0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.536+0000 7f4fcf461700 1 --2- 172.21.15.31:0/4054763674 >> v2:172.21.15.158:3300/0 conn(0x7f4fc8156570 0x7f4fc806d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.536+0000 7f4fcf461700 1 --2- 172.21.15.31:0/4054763674 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fc815a330 0x7f4fc806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.536+0000 7f4fcf461700 1 -- 172.21.15.31:0/4054763674 >> 172.21.15.31:0/4054763674 conn(0x7f4fc8067660 msgr2=0x7f4fc8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:25.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.536+0000 7f4fcf461700 1 -- 172.21.15.31:0/4054763674 shutdown_connections 2023-10-09T06:30:25.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.536+0000 7f4fcf461700 1 -- 172.21.15.31:0/4054763674 wait complete. 2023-10-09T06:30:25.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.537+0000 7f4fcf461700 1 Processor -- start 2023-10-09T06:30:25.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.537+0000 7f4fcf461700 1 -- start start 2023-10-09T06:30:25.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.538+0000 7f4fcf461700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fc8156570 0x7f4fc80c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.538+0000 7f4fcf461700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc8156940 0x7f4fc80c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.538+0000 7f4fcf461700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fc815a330 0x7f4fc80c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.538+0000 7f4fcf461700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80c21f0 con 0x7f4fc8156940 2023-10-09T06:30:25.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.538+0000 7f4fcf461700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80c1620 con 0x7f4fc815a330 2023-10-09T06:30:25.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.538+0000 7f4fcf461700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80c18c0 con 0x7f4fc8156570 2023-10-09T06:30:25.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.538+0000 7f4fcc9fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc8156940 0x7f4fc80c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.538+0000 7f4fcc9fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc8156940 0x7f4fc80c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50690/0 (socket says 172.21.15.31:50690) 2023-10-09T06:30:25.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.538+0000 7f4fcc9fc700 1 -- 172.21.15.31:0/2256298166 learned_addr learned my addr 172.21.15.31:0/2256298166 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:25.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.538+0000 7f4fcd1fd700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fc8156570 0x7f4fc80c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.539+0000 7f4fcd9fe700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fc815a330 0x7f4fc80c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.539+0000 7f4fcc9fc700 1 -- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fc8156570 msgr2=0x7f4fc80c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.539+0000 7f4fcc9fc700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fc8156570 0x7f4fc80c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.539+0000 7f4fcc9fc700 1 -- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fc815a330 msgr2=0x7f4fc80c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.539+0000 7f4fcc9fc700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fc815a330 0x7f4fc80c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.539+0000 7f4fcc9fc700 1 -- 172.21.15.31:0/2256298166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0009ae0 con 0x7f4fc8156940 2023-10-09T06:30:25.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.539+0000 7f4fcc9fc700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc8156940 0x7f4fc80c7bc0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00e8a0 tx=0x7f4fbc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:25.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.539+0000 7f4fc57fa700 1 -- 172.21.15.31:0/2256298166 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc013410 con 0x7f4fc8156940 2023-10-09T06:30:25.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.539+0000 7f4fc57fa700 1 -- 172.21.15.31:0/2256298166 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc013570 con 0x7f4fc8156940 2023-10-09T06:30:25.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.539+0000 7f4fcf461700 1 -- 172.21.15.31:0/2256298166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc80c1ba0 con 0x7f4fc8156940 2023-10-09T06:30:25.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.539+0000 7f4fc57fa700 1 -- 172.21.15.31:0/2256298166 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc013930 con 0x7f4fc8156940 2023-10-09T06:30:25.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.539+0000 7f4fcf461700 1 -- 172.21.15.31:0/2256298166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc80c67b0 con 0x7f4fc8156940 2023-10-09T06:30:25.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.540+0000 7f4fcf461700 1 -- 172.21.15.31:0/2256298166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc80c2360 con 0x7f4fc8156940 2023-10-09T06:30:25.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.540+0000 7f4fc57fa700 1 -- 172.21.15.31:0/2256298166 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fbc013ca0 con 0x7f4fc8156940 2023-10-09T06:30:25.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.541+0000 7f4fc57fa700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4fb4066f30 0x7f4fb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.541+0000 7f4fc57fa700 1 -- 172.21.15.31:0/2256298166 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4fbc0841c0 con 0x7f4fc8156940 2023-10-09T06:30:25.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.541+0000 7f4fcd1fd700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4fb4066f30 0x7f4fb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.542+0000 7f4fcd1fd700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4fb4066f30 0x7f4fb40693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80b2620 tx=0x7f4fb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:25.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.545+0000 7f4fc57fa700 1 -- 172.21.15.31:0/2256298166 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fbc054ec0 con 0x7f4fc8156940 2023-10-09T06:30:25.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.738+0000 7f4fcf461700 1 -- 172.21.15.31:0/2256298166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fc804c3c0 con 0x7f4fc8156940 2023-10-09T06:30:25.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.739+0000 7f4fc57fa700 1 -- 172.21.15.31:0/2256298166 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f4fbc054a50 con 0x7f4fc8156940 2023-10-09T06:30:25.740 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:25.740 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":167,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:30:24.381933+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:30:22.788833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T06:30:23.358451+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:30:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.741+0000 7f4fcf461700 1 -- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4fb4066f30 msgr2=0x7f4fb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.741+0000 7f4fcf461700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4fb4066f30 0x7f4fb40693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80b2620 tx=0x7f4fb8008040 comp rx=0 tx=0).stop 2023-10-09T06:30:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.741+0000 7f4fcf461700 1 -- 172.21.15.31:0/2256298166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc8156940 msgr2=0x7f4fc80c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.741+0000 7f4fcf461700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc8156940 0x7f4fc80c7bc0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00e8a0 tx=0x7f4fbc008040 comp rx=0 tx=0).stop 2023-10-09T06:30:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.741+0000 7f4fcf461700 1 -- 172.21.15.31:0/2256298166 shutdown_connections 2023-10-09T06:30:25.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.741+0000 7f4fcf461700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4fb4066f30 0x7f4fb40693e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.741+0000 7f4fcf461700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4fc8156570 0x7f4fc80c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.741+0000 7f4fcf461700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4fc815a330 0x7f4fc80c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.741+0000 7f4fcf461700 1 --2- 172.21.15.31:0/2256298166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc8156940 0x7f4fc80c7bc0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.741+0000 7f4fcf461700 1 -- 172.21.15.31:0/2256298166 >> 172.21.15.31:0/2256298166 conn(0x7f4fc8067660 msgr2=0x7f4fc8155930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:25.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.741+0000 7f4fcf461700 1 -- 172.21.15.31:0/2256298166 shutdown_connections 2023-10-09T06:30:25.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.741+0000 7f4fcf461700 1 -- 172.21.15.31:0/2256298166 wait complete. 2023-10-09T06:30:25.755 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:30:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.876+0000 7f318f891700 1 Processor -- start 2023-10-09T06:30:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.876+0000 7f318f891700 1 -- start start 2023-10-09T06:30:25.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.877+0000 7f318f891700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31880c89d0 0x7f318806f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.877+0000 7f318f891700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3188067de0 con 0x7f31880af790 2023-10-09T06:30:25.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.877+0000 7f318f891700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31880c9090 con 0x7f318806e910 2023-10-09T06:30:25.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.877+0000 7f318f891700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31880c9370 con 0x7f31880c89d0 2023-10-09T06:30:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.877+0000 7f318d62d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f31880af790 0x7f318806e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43200/0 (socket says 172.21.15.31:43200) 2023-10-09T06:30:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.877+0000 7f318d62d700 1 -- 172.21.15.31:0/3468710526 learned_addr learned my addr 172.21.15.31:0/3468710526 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f318de2e700 1 --2- 172.21.15.31:0/3468710526 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31880c89d0 0x7f318806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049373400 0 0) 0x7f3188067de0 con 0x7f31880af790 2023-10-09T06:30:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3170003570 con 0x7f31880af790 2023-10-09T06:30:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1112320014 0 0) 0x7f3170003570 con 0x7f31880af790 2023-10-09T06:30:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31880c89d0 msgr2=0x7f318806f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 --2- 172.21.15.31:0/3468710526 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31880c89d0 0x7f318806f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 >> v1:172.21.15.158:6789/0 conn(0x7f318806e910 legacy=0x7f3188068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3188067790 con 0x7f31880af790 2023-10-09T06:30:25.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f31800017f0 con 0x7f31880af790 2023-10-09T06:30:25.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 >> v1:172.21.15.31:6789/0 conn(0x7f31880af790 legacy=0x7f318806e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 --2- 172.21.15.31:0/3468710526 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31880c89d0 0x7f3170003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 --2- 172.21.15.31:0/3468710526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170004010 0x7f3170004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 --2- 172.21.15.31:0/3468710526 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3170004d50 0x7f31700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31880c9370 con 0x7f3170004010 2023-10-09T06:30:25.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317000bbf0 con 0x7f3170004d50 2023-10-09T06:30:25.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317000dfc0 con 0x7f31880c89d0 2023-10-09T06:30:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f318ce2c700 1 --2- 172.21.15.31:0/3468710526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170004010 0x7f3170004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f318d62d700 1 --2- 172.21.15.31:0/3468710526 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31880c89d0 0x7f3170003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f318de2e700 1 --2- 172.21.15.31:0/3468710526 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3170004d50 0x7f31700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f318ce2c700 1 -- 172.21.15.31:0/3468710526 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31880c89d0 msgr2=0x7f3170003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f318ce2c700 1 --2- 172.21.15.31:0/3468710526 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f31880c89d0 0x7f3170003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f318ce2c700 1 -- 172.21.15.31:0/3468710526 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3170004d50 msgr2=0x7f31700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f318ce2c700 1 --2- 172.21.15.31:0/3468710526 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3170004d50 0x7f31700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.878+0000 7f318ce2c700 1 -- 172.21.15.31:0/3468710526 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3170003570 con 0x7f3170004010 2023-10-09T06:30:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.879+0000 7f318ce2c700 1 --2- 172.21.15.31:0/3468710526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170004010 0x7f3170004810 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f318806dd10 tx=0x7f317c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea80fb6f49f63dc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:25.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.879+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c012420 con 0x7f3170004010 2023-10-09T06:30:25.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.879+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c012580 con 0x7f3170004010 2023-10-09T06:30:25.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.879+0000 7f3187fff700 1 -- 172.21.15.31:0/3468710526 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c012920 con 0x7f3170004010 2023-10-09T06:30:25.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.879+0000 7f318f891700 1 -- 172.21.15.31:0/3468710526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170004010 msgr2=0x7f3170004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.879+0000 7f318f891700 1 --2- 172.21.15.31:0/3468710526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170004010 0x7f3170004810 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f318806dd10 tx=0x7f317c007d30 comp rx=0 tx=0).stop 2023-10-09T06:30:25.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.879+0000 7f318de2e700 1 -- 172.21.15.31:0/3468710526 reap_dead start 2023-10-09T06:30:25.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.879+0000 7f318f891700 1 -- 172.21.15.31:0/3468710526 shutdown_connections 2023-10-09T06:30:25.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.879+0000 7f318f891700 1 -- 172.21.15.31:0/3468710526 >> 172.21.15.31:0/3468710526 conn(0x7f31880ce4d0 msgr2=0x7f31880ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:25.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.879+0000 7f318f891700 1 -- 172.21.15.31:0/3468710526 shutdown_connections 2023-10-09T06:30:25.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.879+0000 7f318f891700 1 -- 172.21.15.31:0/3468710526 wait complete. 2023-10-09T06:30:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.880+0000 7f318f891700 1 Processor -- start 2023-10-09T06:30:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.881+0000 7f318f891700 1 -- start start 2023-10-09T06:30:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.881+0000 7f318f891700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170004010 0x7f31880b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.881+0000 7f318f891700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f318816a5c0 0x7f3188147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.881+0000 7f318f891700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31881699a0 0x7f3188169e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.881+0000 7f318f891700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318816a380 con 0x7f3170004010 2023-10-09T06:30:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.881+0000 7f318f891700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31880b1350 con 0x7f31881699a0 2023-10-09T06:30:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.881+0000 7f318f891700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31880b1630 con 0x7f318816a5c0 2023-10-09T06:30:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.881+0000 7f318d62d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170004010 0x7f31880b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.881+0000 7f318d62d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170004010 0x7f31880b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50708/0 (socket says 172.21.15.31:50708) 2023-10-09T06:30:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.881+0000 7f318d62d700 1 -- 172.21.15.31:0/141521864 learned_addr learned my addr 172.21.15.31:0/141521864 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.882+0000 7f318ce2c700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f318816a5c0 0x7f3188147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.882+0000 7f318de2e700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31881699a0 0x7f3188169e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.882+0000 7f318d62d700 1 -- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f318816a5c0 msgr2=0x7f3188147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.882+0000 7f318d62d700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f318816a5c0 0x7f3188147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.882+0000 7f318d62d700 1 -- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31881699a0 msgr2=0x7f3188169e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.882+0000 7f318d62d700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31881699a0 0x7f3188169e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.882+0000 7f318d62d700 1 -- 172.21.15.31:0/141521864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31880b1910 con 0x7f3170004010 2023-10-09T06:30:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.882+0000 7f318d62d700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170004010 0x7f31880b0b00 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f3180007a90 tx=0x7f31800021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.882+0000 7f31857fa700 1 -- 172.21.15.31:0/141521864 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180007ac0 con 0x7f3170004010 2023-10-09T06:30:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.882+0000 7f31857fa700 1 -- 172.21.15.31:0/141521864 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318000acc0 con 0x7f3170004010 2023-10-09T06:30:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.882+0000 7f318f891700 1 -- 172.21.15.31:0/141521864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31880b1bf0 con 0x7f3170004010 2023-10-09T06:30:25.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.882+0000 7f31857fa700 1 -- 172.21.15.31:0/141521864 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180013600 con 0x7f3170004010 2023-10-09T06:30:25.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.882+0000 7f318f891700 1 -- 172.21.15.31:0/141521864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31880b1040 con 0x7f3170004010 2023-10-09T06:30:25.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.883+0000 7f318f891700 1 -- 172.21.15.31:0/141521864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318804c3c0 con 0x7f3170004010 2023-10-09T06:30:25.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.883+0000 7f31857fa700 1 -- 172.21.15.31:0/141521864 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31800139b0 con 0x7f3170004010 2023-10-09T06:30:25.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.884+0000 7f31857fa700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3174066f30 0x7f31740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:25.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.884+0000 7f31857fa700 1 -- 172.21.15.31:0/141521864 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31800850d0 con 0x7f3170004010 2023-10-09T06:30:25.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.884+0000 7f318ce2c700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3174066f30 0x7f31740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:25.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.884+0000 7f318ce2c700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3174066f30 0x7f31740693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3188163f90 tx=0x7f317c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:25.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:25.888+0000 7f31857fa700 1 -- 172.21.15.31:0/141521864 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3180052340 con 0x7f3170004010 2023-10-09T06:30:26.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:26.127+0000 7f318f891700 1 -- 172.21.15.31:0/141521864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f31880c8330 con 0x7f3170004010 2023-10-09T06:30:26.979 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:30:26.982 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:30:27.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.020+0000 7f31857fa700 1 -- 172.21.15.31:0/141521864 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v81) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3180055960 con 0x7f3170004010 2023-10-09T06:30:27.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.023+0000 7f318f891700 1 -- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3174066f30 msgr2=0x7f31740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:27.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.023+0000 7f318f891700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3174066f30 0x7f31740693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3188163f90 tx=0x7f317c015000 comp rx=0 tx=0).stop 2023-10-09T06:30:27.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.023+0000 7f318f891700 1 -- 172.21.15.31:0/141521864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170004010 msgr2=0x7f31880b0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:27.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.023+0000 7f318f891700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170004010 0x7f31880b0b00 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f3180007a90 tx=0x7f31800021d0 comp rx=0 tx=0).stop 2023-10-09T06:30:27.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.023+0000 7f318f891700 1 -- 172.21.15.31:0/141521864 shutdown_connections 2023-10-09T06:30:27.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.023+0000 7f318f891700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3174066f30 0x7f31740693e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:27.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.023+0000 7f318f891700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31881699a0 0x7f3188169e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:27.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.023+0000 7f318f891700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170004010 0x7f31880b0b00 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:27.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.023+0000 7f318f891700 1 --2- 172.21.15.31:0/141521864 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f318816a5c0 0x7f3188147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:27.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.023+0000 7f318f891700 1 -- 172.21.15.31:0/141521864 >> 172.21.15.31:0/141521864 conn(0x7f31880ce4d0 msgr2=0x7f3188159010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:27.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.023+0000 7f318f891700 1 -- 172.21.15.31:0/141521864 shutdown_connections 2023-10-09T06:30:27.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.023+0000 7f318f891700 1 -- 172.21.15.31:0/141521864 wait complete. 2023-10-09T06:30:27.037 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:30:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.217+0000 7fc968b00700 1 Processor -- start 2023-10-09T06:30:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.217+0000 7fc968b00700 1 -- start start 2023-10-09T06:30:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.218+0000 7fc968b00700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc96415afe0 0x7fc9640afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.218+0000 7fc968b00700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc9640c9830 0x7fc96415c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.218+0000 7fc968b00700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9640b0e30 con 0x7fc9640b12c0 2023-10-09T06:30:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.218+0000 7fc968b00700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9640af670 con 0x7fc96415afe0 2023-10-09T06:30:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.218+0000 7fc968b00700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96415c870 con 0x7fc9640c9830 2023-10-09T06:30:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.218+0000 7fc96259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc96415afe0 0x7fc9640afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.218+0000 7fc96259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc96415afe0 0x7fc9640afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50718/0 (socket says 172.21.15.31:50718) 2023-10-09T06:30:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.219+0000 7fc96259c700 1 -- 172.21.15.31:0/2507821540 learned_addr learned my addr 172.21.15.31:0/2507821540 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.219+0000 7fc962d9d700 1 --2- 172.21.15.31:0/2507821540 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc9640c9830 0x7fc96415c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.219+0000 7fc96259c700 1 -- 172.21.15.31:0/2507821540 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc9640c9830 msgr2=0x7fc96415c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.219+0000 7fc96259c700 1 --2- 172.21.15.31:0/2507821540 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc9640c9830 0x7fc96415c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.219+0000 7fc96259c700 1 -- 172.21.15.31:0/2507821540 >> v1:172.21.15.158:6789/0 conn(0x7fc9640b12c0 legacy=0x7fc9640c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.219+0000 7fc96159a700 1 -- 172.21.15.31:0/2507821540 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337014446 0 0) 0x7fc9640b0e30 con 0x7fc9640b12c0 2023-10-09T06:30:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.219+0000 7fc96259c700 1 -- 172.21.15.31:0/2507821540 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9640b0220 con 0x7fc96415afe0 2023-10-09T06:30:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.219+0000 7fc96259c700 1 --2- 172.21.15.31:0/2507821540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415afe0 0x7fc9640afb60 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0099b0 tx=0x7fc95c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82d7a3ce2b54655 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.219+0000 7fc96159a700 1 -- 172.21.15.31:0/2507821540 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c009ea0 con 0x7fc96415afe0 2023-10-09T06:30:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.219+0000 7fc96159a700 1 -- 172.21.15.31:0/2507821540 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c00b860 con 0x7fc96415afe0 2023-10-09T06:30:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.219+0000 7fc96159a700 1 -- 172.21.15.31:0/2507821540 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00bc00 con 0x7fc96415afe0 2023-10-09T06:30:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.220+0000 7fc968b00700 1 -- 172.21.15.31:0/2507821540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415afe0 msgr2=0x7fc9640afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.220+0000 7fc968b00700 1 --2- 172.21.15.31:0/2507821540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415afe0 0x7fc9640afb60 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0099b0 tx=0x7fc95c009250 comp rx=0 tx=0).stop 2023-10-09T06:30:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.220+0000 7fc968b00700 1 -- 172.21.15.31:0/2507821540 shutdown_connections 2023-10-09T06:30:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.220+0000 7fc968b00700 1 --2- 172.21.15.31:0/2507821540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415afe0 0x7fc9640afb60 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.220+0000 7fc968b00700 1 --2- 172.21.15.31:0/2507821540 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc9640c9830 0x7fc96415c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.220+0000 7fc968b00700 1 -- 172.21.15.31:0/2507821540 >> 172.21.15.31:0/2507821540 conn(0x7fc96406f3e0 msgr2=0x7fc96406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.220+0000 7fc968b00700 1 -- 172.21.15.31:0/2507821540 shutdown_connections 2023-10-09T06:30:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.220+0000 7fc968b00700 1 -- 172.21.15.31:0/2507821540 wait complete. 2023-10-09T06:30:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.221+0000 7fc968b00700 1 Processor -- start 2023-10-09T06:30:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.221+0000 7fc968b00700 1 -- start start 2023-10-09T06:30:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc968b00700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9640b12c0 0x7fc964158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc968b00700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc9640c9830 0x7fc9640adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc968b00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415afe0 0x7fc9640ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc968b00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640695d0 con 0x7fc96415afe0 2023-10-09T06:30:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc968b00700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640c2ab0 con 0x7fc9640b12c0 2023-10-09T06:30:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc968b00700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640c3910 con 0x7fc9640c9830 2023-10-09T06:30:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc962d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415afe0 0x7fc9640ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc962d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415afe0 0x7fc9640ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50720/0 (socket says 172.21.15.31:50720) 2023-10-09T06:30:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc962d9d700 1 -- 172.21.15.31:0/441764186 learned_addr learned my addr 172.21.15.31:0/441764186 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc961d9b700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc9640c9830 0x7fc9640adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc96259c700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9640b12c0 0x7fc964158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc962d9d700 1 -- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc9640c9830 msgr2=0x7fc9640adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc962d9d700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc9640c9830 0x7fc9640adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc962d9d700 1 -- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9640b12c0 msgr2=0x7fc964158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc962d9d700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9640b12c0 0x7fc964158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc962d9d700 1 -- 172.21.15.31:0/441764186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c0094f0 con 0x7fc96415afe0 2023-10-09T06:30:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc961d9b700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc9640c9830 0x7fc9640adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc962d9d700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415afe0 0x7fc9640ca9d0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fc954009ef0 tx=0x7fc95400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc95a7fc700 1 -- 172.21.15.31:0/441764186 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95400cc50 con 0x7fc96415afe0 2023-10-09T06:30:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc95a7fc700 1 -- 172.21.15.31:0/441764186 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95400f040 con 0x7fc96415afe0 2023-10-09T06:30:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc95a7fc700 1 -- 172.21.15.31:0/441764186 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954014480 con 0x7fc96415afe0 2023-10-09T06:30:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc968b00700 1 -- 172.21.15.31:0/441764186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9640c2d00 con 0x7fc96415afe0 2023-10-09T06:30:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.222+0000 7fc968b00700 1 -- 172.21.15.31:0/441764186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9640c32c0 con 0x7fc96415afe0 2023-10-09T06:30:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.223+0000 7fc968b00700 1 -- 172.21.15.31:0/441764186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9640c3ac0 con 0x7fc96415afe0 2023-10-09T06:30:27.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.224+0000 7fc95a7fc700 1 -- 172.21.15.31:0/441764186 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc954014830 con 0x7fc96415afe0 2023-10-09T06:30:27.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.224+0000 7fc95a7fc700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc944066f30 0x7fc9440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:27.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.224+0000 7fc95a7fc700 1 -- 172.21.15.31:0/441764186 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9540852d0 con 0x7fc96415afe0 2023-10-09T06:30:27.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.225+0000 7fc96259c700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc944066f30 0x7fc9440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:27.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.225+0000 7fc96259c700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc944066f30 0x7fc9440693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0099b0 tx=0x7fc95c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.228+0000 7fc95a7fc700 1 -- 172.21.15.31:0/441764186 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc954052540 con 0x7fc96415afe0 2023-10-09T06:30:27.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:27.463+0000 7fc968b00700 1 -- 172.21.15.31:0/441764186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc96404c3c0 con 0x7fc96415afe0 2023-10-09T06:30:28.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.021+0000 7fc95a7fc700 1 -- 172.21.15.31:0/441764186 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v82) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc954055b60 con 0x7fc96415afe0 2023-10-09T06:30:28.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.023+0000 7fc968b00700 1 -- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc944066f30 msgr2=0x7fc9440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.023+0000 7fc968b00700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc944066f30 0x7fc9440693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0099b0 tx=0x7fc95c017000 comp rx=0 tx=0).stop 2023-10-09T06:30:28.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.023+0000 7fc968b00700 1 -- 172.21.15.31:0/441764186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415afe0 msgr2=0x7fc9640ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.023+0000 7fc968b00700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415afe0 0x7fc9640ca9d0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fc954009ef0 tx=0x7fc95400b040 comp rx=0 tx=0).stop 2023-10-09T06:30:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.023+0000 7fc968b00700 1 -- 172.21.15.31:0/441764186 shutdown_connections 2023-10-09T06:30:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.023+0000 7fc968b00700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc944066f30 0x7fc9440693e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.023+0000 7fc968b00700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415afe0 0x7fc9640ca9d0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.023+0000 7fc968b00700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9640b12c0 0x7fc964158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.023+0000 7fc968b00700 1 --2- 172.21.15.31:0/441764186 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc9640c9830 0x7fc9640adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.023+0000 7fc968b00700 1 -- 172.21.15.31:0/441764186 >> 172.21.15.31:0/441764186 conn(0x7fc96406f3e0 msgr2=0x7fc9640b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.023+0000 7fc968b00700 1 -- 172.21.15.31:0/441764186 shutdown_connections 2023-10-09T06:30:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.023+0000 7fc968b00700 1 -- 172.21.15.31:0/441764186 wait complete. 2023-10-09T06:30:28.037 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:30:28.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.156+0000 7f029f59e700 1 Processor -- start 2023-10-09T06:30:28.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.156+0000 7f029f59e700 1 -- start start 2023-10-09T06:30:28.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.157+0000 7f029f59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02a00cd6e0 0x7f02a00cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.157+0000 7f029f59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a00cdab0 0x7f02a015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.157+0000 7f029f59e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a00cb7c0 con 0x7f02a015dda0 2023-10-09T06:30:28.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.157+0000 7f029f59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a015e850 con 0x7f02a00cd6e0 2023-10-09T06:30:28.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.157+0000 7f029f59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00cd030 con 0x7f02a00cdab0 2023-10-09T06:30:28.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.157+0000 7f029e59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02a00cd6e0 0x7f02a00cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.157+0000 7f029e59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02a00cd6e0 0x7f02a00cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50736/0 (socket says 172.21.15.31:50736) 2023-10-09T06:30:28.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.157+0000 7f029e59c700 1 -- 172.21.15.31:0/709471946 learned_addr learned my addr 172.21.15.31:0/709471946 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:28.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.157+0000 7f029e59c700 1 -- 172.21.15.31:0/709471946 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a00cdab0 msgr2=0x7f02a015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:28.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.157+0000 7f029e59c700 1 --2- 172.21.15.31:0/709471946 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a00cdab0 0x7f02a015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.157+0000 7f029e59c700 1 -- 172.21.15.31:0/709471946 >> v1:172.21.15.158:6789/0 conn(0x7f02a015dda0 legacy=0x7f02a015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:28.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.157+0000 7f029e59c700 1 -- 172.21.15.31:0/709471946 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a015e290 con 0x7f02a00cd6e0 2023-10-09T06:30:28.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.158+0000 7f029e59c700 1 --2- 172.21.15.31:0/709471946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a00cd6e0 0x7f02a00cbc50 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f0290009f20 tx=0x7f0290009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f63e0c9af0581 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:28.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.158+0000 7f029d59a700 1 -- 172.21.15.31:0/709471946 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029000e070 con 0x7f02a00cd6e0 2023-10-09T06:30:28.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.158+0000 7f029d59a700 1 -- 172.21.15.31:0/709471946 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029000ba40 con 0x7f02a00cd6e0 2023-10-09T06:30:28.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.158+0000 7f029d59a700 1 -- 172.21.15.31:0/709471946 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900092e0 con 0x7f02a00cd6e0 2023-10-09T06:30:28.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.158+0000 7f029f59e700 1 -- 172.21.15.31:0/709471946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a00cd6e0 msgr2=0x7f02a00cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.158+0000 7f029f59e700 1 --2- 172.21.15.31:0/709471946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a00cd6e0 0x7f02a00cbc50 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f0290009f20 tx=0x7f0290009840 comp rx=0 tx=0).stop 2023-10-09T06:30:28.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.158+0000 7f029f59e700 1 -- 172.21.15.31:0/709471946 shutdown_connections 2023-10-09T06:30:28.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.158+0000 7f029f59e700 1 --2- 172.21.15.31:0/709471946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a00cd6e0 0x7f02a00cbc50 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.158+0000 7f029f59e700 1 --2- 172.21.15.31:0/709471946 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a00cdab0 0x7f02a015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.158+0000 7f029f59e700 1 -- 172.21.15.31:0/709471946 >> 172.21.15.31:0/709471946 conn(0x7f02a0067660 msgr2=0x7f02a0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:28.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.158+0000 7f029f59e700 1 -- 172.21.15.31:0/709471946 shutdown_connections 2023-10-09T06:30:28.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.158+0000 7f029f59e700 1 -- 172.21.15.31:0/709471946 wait complete. 2023-10-09T06:30:28.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.160+0000 7f029f59e700 1 Processor -- start 2023-10-09T06:30:28.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.160+0000 7f029f59e700 1 -- start start 2023-10-09T06:30:28.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.160+0000 7f029f59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02a00cd6e0 0x7f02a0155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.160+0000 7f029f59e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a00cdab0 0x7f02a0158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.160+0000 7f029f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015dda0 0x7f02a00c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.160+0000 7f029f59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00b0180 con 0x7f02a015dda0 2023-10-09T06:30:28.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.160+0000 7f029f59e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a015c370 con 0x7f02a00cd6e0 2023-10-09T06:30:28.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.160+0000 7f029f59e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0156150 con 0x7f02a00cdab0 2023-10-09T06:30:28.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.160+0000 7f029ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015dda0 0x7f02a00c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f029ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015dda0 0x7f02a00c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50746/0 (socket says 172.21.15.31:50746) 2023-10-09T06:30:28.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f029ed9d700 1 -- 172.21.15.31:0/3939465495 learned_addr learned my addr 172.21.15.31:0/3939465495 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:28.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f029e59c700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02a00cd6e0 0x7f02a0155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f029dd9b700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a00cdab0 0x7f02a0158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f029ed9d700 1 -- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a00cdab0 msgr2=0x7f02a0158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f029ed9d700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a00cdab0 0x7f02a0158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f029ed9d700 1 -- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02a00cd6e0 msgr2=0x7f02a0155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f029ed9d700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02a00cd6e0 0x7f02a0155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f029ed9d700 1 -- 172.21.15.31:0/3939465495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0290009ae0 con 0x7f02a015dda0 2023-10-09T06:30:28.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f029ed9d700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015dda0 0x7f02a00c60f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f029800b5e0 tx=0x7f0298009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:28.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f02967fc700 1 -- 172.21.15.31:0/3939465495 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029800f510 con 0x7f02a015dda0 2023-10-09T06:30:28.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f02967fc700 1 -- 172.21.15.31:0/3939465495 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029800f690 con 0x7f02a015dda0 2023-10-09T06:30:28.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f029f59e700 1 -- 172.21.15.31:0/3939465495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a015b760 con 0x7f02a015dda0 2023-10-09T06:30:28.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f02967fc700 1 -- 172.21.15.31:0/3939465495 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029800fa50 con 0x7f02a015dda0 2023-10-09T06:30:28.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.161+0000 7f029f59e700 1 -- 172.21.15.31:0/3939465495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a015bd20 con 0x7f02a015dda0 2023-10-09T06:30:28.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.162+0000 7f029f59e700 1 -- 172.21.15.31:0/3939465495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a015c4e0 con 0x7f02a015dda0 2023-10-09T06:30:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.163+0000 7f02967fc700 1 -- 172.21.15.31:0/3939465495 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f029801a400 con 0x7f02a015dda0 2023-10-09T06:30:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.163+0000 7f02967fc700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0280066f30 0x7f02800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.163+0000 7f02967fc700 1 -- 172.21.15.31:0/3939465495 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0298083da0 con 0x7f02a015dda0 2023-10-09T06:30:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.163+0000 7f029e59c700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0280066f30 0x7f02800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.164+0000 7f029e59c700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0280066f30 0x7f02800693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0290009880 tx=0x7f0290017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:28.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.167+0000 7f02967fc700 1 -- 172.21.15.31:0/3939465495 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0298051090 con 0x7f02a015dda0 2023-10-09T06:30:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.402+0000 7f029f59e700 1 -- 172.21.15.31:0/3939465495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02a015e570 con 0x7f02a015dda0 2023-10-09T06:30:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.403+0000 7f02967fc700 1 -- 172.21.15.31:0/3939465495 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f02980546b0 con 0x7f02a015dda0 2023-10-09T06:30:28.404 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:28.404 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1455840229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1455840229},{"type":"v1","addr":"172.21.15.158:6837","nonce":1455840229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7770,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3156917195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3156917195},{"type":"v1","addr":"172.21.15.31:6834","nonce":3156917195}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1537057825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1537057825},{"type":"v1","addr":"172.21.15.31:6835","nonce":1537057825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:30:24.382245+0000","modified":"2023-10-09T06:30:28.019930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7782":{"gid":7782,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/3592438876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3592438876},{"type":"v1","addr":"172.21.15.158:6836","nonce":3592438876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T06:30:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.405+0000 7f029f59e700 1 -- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0280066f30 msgr2=0x7f02800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.405+0000 7f029f59e700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0280066f30 0x7f02800693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0290009880 tx=0x7f0290017000 comp rx=0 tx=0).stop 2023-10-09T06:30:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.405+0000 7f029f59e700 1 -- 172.21.15.31:0/3939465495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015dda0 msgr2=0x7f02a00c60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.405+0000 7f029f59e700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015dda0 0x7f02a00c60f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f029800b5e0 tx=0x7f0298009120 comp rx=0 tx=0).stop 2023-10-09T06:30:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.405+0000 7f029f59e700 1 -- 172.21.15.31:0/3939465495 shutdown_connections 2023-10-09T06:30:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.405+0000 7f029f59e700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0280066f30 0x7f02800693e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.405+0000 7f029f59e700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02a015dda0 0x7f02a00c60f0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.405+0000 7f029f59e700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02a00cd6e0 0x7f02a0155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.405+0000 7f029f59e700 1 --2- 172.21.15.31:0/3939465495 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f02a00cdab0 0x7f02a0158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.405+0000 7f029f59e700 1 -- 172.21.15.31:0/3939465495 >> 172.21.15.31:0/3939465495 conn(0x7f02a0067660 msgr2=0x7f02a00c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.405+0000 7f029f59e700 1 -- 172.21.15.31:0/3939465495 shutdown_connections 2023-10-09T06:30:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.405+0000 7f029f59e700 1 -- 172.21.15.31:0/3939465495 wait complete. 2023-10-09T06:30:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 82 2023-10-09T06:30:28.418 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:30:28.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.535+0000 7f70a8de3700 1 Processor -- start 2023-10-09T06:30:28.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.535+0000 7f70a8de3700 1 -- start start 2023-10-09T06:30:28.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.536+0000 7f70a8de3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f70a40cfe20 0x7f70a40ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.536+0000 7f70a8de3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a40c5d80 con 0x7f70a415a2b0 2023-10-09T06:30:28.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.536+0000 7f70a8de3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a40c6060 con 0x7f70a40d1c30 2023-10-09T06:30:28.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.536+0000 7f70a8de3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a4068470 con 0x7f70a40cfe20 2023-10-09T06:30:28.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.536+0000 7f70a2d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f70a40cfe20 0x7f70a40ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.537+0000 7f70a259c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f70a415a2b0 0x7f70a40b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43206/0 (socket says 172.21.15.31:43206) 2023-10-09T06:30:28.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.537+0000 7f70a259c700 1 -- 172.21.15.31:0/462573803 learned_addr learned my addr 172.21.15.31:0/462573803 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:28.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.537+0000 7f70a2d9d700 1 -- 172.21.15.31:0/462573803 >> v1:172.21.15.158:6789/0 conn(0x7f70a40d1c30 legacy=0x7f70a40cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:28.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.537+0000 7f70a2d9d700 1 -- 172.21.15.31:0/462573803 >> v1:172.21.15.31:6789/0 conn(0x7f70a415a2b0 legacy=0x7f70a40b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.537+0000 7f70a2d9d700 1 -- 172.21.15.31:0/462573803 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a40c6340 con 0x7f70a40cfe20 2023-10-09T06:30:28.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.537+0000 7f70a159a700 1 -- 172.21.15.31:0/462573803 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220416568 0 0) 0x7f70a40c5d80 con 0x7f70a415a2b0 2023-10-09T06:30:28.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.537+0000 7f70a2d9d700 1 --2- 172.21.15.31:0/462573803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a40cfe20 0x7f70a40ccdd0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7094009e60 tx=0x7f7094009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bb42af73426faa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:28.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.537+0000 7f70a159a700 1 -- 172.21.15.31:0/462573803 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709400e070 con 0x7f70a40cfe20 2023-10-09T06:30:28.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.537+0000 7f70a159a700 1 -- 172.21.15.31:0/462573803 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709400bbf0 con 0x7f70a40cfe20 2023-10-09T06:30:28.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.537+0000 7f70a159a700 1 -- 172.21.15.31:0/462573803 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094012430 con 0x7f70a40cfe20 2023-10-09T06:30:28.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.538+0000 7f70a8de3700 1 -- 172.21.15.31:0/462573803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a40cfe20 msgr2=0x7f70a40ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.538+0000 7f70a8de3700 1 --2- 172.21.15.31:0/462573803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a40cfe20 0x7f70a40ccdd0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7094009e60 tx=0x7f7094009780 comp rx=0 tx=0).stop 2023-10-09T06:30:28.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.538+0000 7f70a8de3700 1 -- 172.21.15.31:0/462573803 shutdown_connections 2023-10-09T06:30:28.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.538+0000 7f70a8de3700 1 --2- 172.21.15.31:0/462573803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a40cfe20 0x7f70a40ccdd0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.538+0000 7f70a8de3700 1 -- 172.21.15.31:0/462573803 >> 172.21.15.31:0/462573803 conn(0x7f70a4067e40 msgr2=0x7f70a40d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:28.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.538+0000 7f70a8de3700 1 -- 172.21.15.31:0/462573803 shutdown_connections 2023-10-09T06:30:28.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.538+0000 7f70a8de3700 1 -- 172.21.15.31:0/462573803 wait complete. 2023-10-09T06:30:28.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.539+0000 7f70a8de3700 1 Processor -- start 2023-10-09T06:30:28.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.539+0000 7f70a8de3700 1 -- start start 2023-10-09T06:30:28.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a8de3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70a40cfe20 0x7f70a4157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a8de3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70a40d1c30 0x7f70a409bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a8de3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a415a2b0 0x7f70a416d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a8de3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a415a890 con 0x7f70a415a2b0 2023-10-09T06:30:28.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a8de3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a415b3a0 con 0x7f70a40d1c30 2023-10-09T06:30:28.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a8de3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a415aa70 con 0x7f70a40cfe20 2023-10-09T06:30:28.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a2d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a415a2b0 0x7f70a416d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a2d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a415a2b0 0x7f70a416d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50760/0 (socket says 172.21.15.31:50760) 2023-10-09T06:30:28.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a2d9d700 1 -- 172.21.15.31:0/4077520850 learned_addr learned my addr 172.21.15.31:0/4077520850 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:28.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a259c700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70a40cfe20 0x7f70a4157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a2d9d700 1 -- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70a40cfe20 msgr2=0x7f70a4157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a1d9b700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70a40d1c30 0x7f70a409bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a2d9d700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70a40cfe20 0x7f70a4157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a2d9d700 1 -- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70a40d1c30 msgr2=0x7f70a409bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a2d9d700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70a40d1c30 0x7f70a409bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a2d9d700 1 -- 172.21.15.31:0/4077520850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7094009a20 con 0x7f70a415a2b0 2023-10-09T06:30:28.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a259c700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70a40cfe20 0x7f70a4157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:28.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a1d9b700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70a40d1c30 0x7f70a409bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:28.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a2d9d700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a415a2b0 0x7f70a416d5b0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f70a40cb5d0 tx=0x7f7094018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:28.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f709a7fc700 1 -- 172.21.15.31:0/4077520850 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709401e710 con 0x7f70a415a2b0 2023-10-09T06:30:28.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f709a7fc700 1 -- 172.21.15.31:0/4077520850 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709401e890 con 0x7f70a415a2b0 2023-10-09T06:30:28.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a8de3700 1 -- 172.21.15.31:0/4077520850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a415ad50 con 0x7f70a415a2b0 2023-10-09T06:30:28.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f709a7fc700 1 -- 172.21.15.31:0/4077520850 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709401ec50 con 0x7f70a415a2b0 2023-10-09T06:30:28.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.540+0000 7f70a8de3700 1 -- 172.21.15.31:0/4077520850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a41581a0 con 0x7f70a415a2b0 2023-10-09T06:30:28.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.541+0000 7f70a8de3700 1 -- 172.21.15.31:0/4077520850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a404c3c0 con 0x7f70a415a2b0 2023-10-09T06:30:28.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.542+0000 7f709a7fc700 1 -- 172.21.15.31:0/4077520850 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7094024070 con 0x7f70a415a2b0 2023-10-09T06:30:28.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.542+0000 7f709a7fc700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7084066f30 0x7f70840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.542+0000 7f709a7fc700 1 -- 172.21.15.31:0/4077520850 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70940870b0 con 0x7f70a415a2b0 2023-10-09T06:30:28.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.542+0000 7f70a259c700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7084066f30 0x7f70840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.543+0000 7f70a259c700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7084066f30 0x7f70840693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f709c001810 tx=0x7f709c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:28.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.546+0000 7f709a7fc700 1 -- 172.21.15.31:0/4077520850 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70940543d0 con 0x7f70a415a2b0 2023-10-09T06:30:28.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.741+0000 7f70a8de3700 1 -- 172.21.15.31:0/4077520850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70a415b4e0 con 0x7f70a415a2b0 2023-10-09T06:30:28.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.741+0000 7f709a7fc700 1 -- 172.21.15.31:0/4077520850 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+15365 (secure 0 0 0) 0x7f709401edb0 con 0x7f70a415a2b0 2023-10-09T06:30:28.742 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:28.742 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":168,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:30:25.994489+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:30:22.788833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T06:30:23.358451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:30:28.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.744+0000 7f70a8de3700 1 -- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7084066f30 msgr2=0x7f70840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.744+0000 7f70a8de3700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7084066f30 0x7f70840693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f709c001810 tx=0x7f709c009040 comp rx=0 tx=0).stop 2023-10-09T06:30:28.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.744+0000 7f70a8de3700 1 -- 172.21.15.31:0/4077520850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a415a2b0 msgr2=0x7f70a416d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.744+0000 7f70a8de3700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a415a2b0 0x7f70a416d5b0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f70a40cb5d0 tx=0x7f7094018000 comp rx=0 tx=0).stop 2023-10-09T06:30:28.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.744+0000 7f70a8de3700 1 -- 172.21.15.31:0/4077520850 shutdown_connections 2023-10-09T06:30:28.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.744+0000 7f70a8de3700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7084066f30 0x7f70840693e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.744+0000 7f70a8de3700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f70a40cfe20 0x7f70a4157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.744+0000 7f70a8de3700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a415a2b0 0x7f70a416d5b0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.744+0000 7f70a8de3700 1 --2- 172.21.15.31:0/4077520850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70a40d1c30 0x7f70a409bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.744+0000 7f70a8de3700 1 -- 172.21.15.31:0/4077520850 >> 172.21.15.31:0/4077520850 conn(0x7f70a4067e40 msgr2=0x7f70a4069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:28.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.744+0000 7f70a8de3700 1 -- 172.21.15.31:0/4077520850 shutdown_connections 2023-10-09T06:30:28.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.744+0000 7f70a8de3700 1 -- 172.21.15.31:0/4077520850 wait complete. 2023-10-09T06:30:28.758 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:30:28.759 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:30:28.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.877+0000 7f4659712700 1 Processor -- start 2023-10-09T06:30:28.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.877+0000 7f4659712700 1 -- start start 2023-10-09T06:30:28.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.878+0000 7f4659712700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f465415a2b0 0x7f46540b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.878+0000 7f4659712700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f46540cfe20 0x7f46540ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.878+0000 7f4659712700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46540c5d80 con 0x7f46540d1c30 2023-10-09T06:30:28.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.878+0000 7f4659712700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4654068470 con 0x7f46540cfe20 2023-10-09T06:30:28.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.878+0000 7f4659712700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46540c6060 con 0x7f465415a2b0 2023-10-09T06:30:28.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.878+0000 7f46527fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f46540d1c30 0x7f46540cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43208/0 (socket says 172.21.15.31:43208) 2023-10-09T06:30:28.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.878+0000 7f46527fc700 1 -- 172.21.15.31:0/89272771 learned_addr learned my addr 172.21.15.31:0/89272771 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:28.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.878+0000 7f4652ffd700 1 --2- 172.21.15.31:0/89272771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f465415a2b0 0x7f46540b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.878+0000 7f46537fe700 1 --2- 172.21.15.31:0/89272771 >> v2:172.21.15.158:3300/0 conn(0x7f46540cfe20 0x7f46540ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.879+0000 7f4651ffb700 1 -- 172.21.15.31:0/89272771 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621570097 0 0) 0x7f46540c5d80 con 0x7f46540d1c30 2023-10-09T06:30:28.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.879+0000 7f4651ffb700 1 -- 172.21.15.31:0/89272771 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4640003570 con 0x7f46540d1c30 2023-10-09T06:30:28.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.879+0000 7f4652ffd700 1 -- 172.21.15.31:0/89272771 >> v2:172.21.15.158:3300/0 conn(0x7f46540cfe20 msgr2=0x7f46540ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:28.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.879+0000 7f4652ffd700 1 --2- 172.21.15.31:0/89272771 >> v2:172.21.15.158:3300/0 conn(0x7f46540cfe20 0x7f46540ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.879+0000 7f4652ffd700 1 -- 172.21.15.31:0/89272771 >> v1:172.21.15.31:6789/0 conn(0x7f46540d1c30 legacy=0x7f46540cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.879+0000 7f4652ffd700 1 -- 172.21.15.31:0/89272771 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540c6340 con 0x7f465415a2b0 2023-10-09T06:30:28.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.879+0000 7f46537fe700 1 --2- 172.21.15.31:0/89272771 >> v2:172.21.15.158:3300/0 conn(0x7f46540cfe20 0x7f46540ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:30:28.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.879+0000 7f4652ffd700 1 --2- 172.21.15.31:0/89272771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f465415a2b0 0x7f46540b3da0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f464c0098d0 tx=0x7f464c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=257c10f9528cfcb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:28.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.879+0000 7f4651ffb700 1 -- 172.21.15.31:0/89272771 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c005c10 con 0x7f465415a2b0 2023-10-09T06:30:28.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.879+0000 7f4651ffb700 1 -- 172.21.15.31:0/89272771 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c005d70 con 0x7f465415a2b0 2023-10-09T06:30:28.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.879+0000 7f4651ffb700 1 -- 172.21.15.31:0/89272771 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c006260 con 0x7f465415a2b0 2023-10-09T06:30:28.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.880+0000 7f4659712700 1 -- 172.21.15.31:0/89272771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f465415a2b0 msgr2=0x7f46540b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.880+0000 7f4659712700 1 --2- 172.21.15.31:0/89272771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f465415a2b0 0x7f46540b3da0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f464c0098d0 tx=0x7f464c009120 comp rx=0 tx=0).stop 2023-10-09T06:30:28.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.880+0000 7f4659712700 1 -- 172.21.15.31:0/89272771 shutdown_connections 2023-10-09T06:30:28.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.880+0000 7f4659712700 1 --2- 172.21.15.31:0/89272771 >> v2:172.21.15.158:3300/0 conn(0x7f46540cfe20 0x7f46540ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.880+0000 7f4659712700 1 --2- 172.21.15.31:0/89272771 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f465415a2b0 0x7f46540b3da0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.880+0000 7f4659712700 1 -- 172.21.15.31:0/89272771 >> 172.21.15.31:0/89272771 conn(0x7f4654067e40 msgr2=0x7f46540d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:28.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.880+0000 7f4659712700 1 -- 172.21.15.31:0/89272771 shutdown_connections 2023-10-09T06:30:28.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.880+0000 7f4659712700 1 -- 172.21.15.31:0/89272771 wait complete. 2023-10-09T06:30:28.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.881+0000 7f4659712700 1 Processor -- start 2023-10-09T06:30:28.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.881+0000 7f4659712700 1 -- start start 2023-10-09T06:30:28.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f4659712700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46540cfe20 0x7f465416a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f4659712700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46540d1c30 0x7f4654167490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f4659712700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465415a2b0 0x7f46540d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f4659712700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46541679d0 con 0x7f465415a2b0 2023-10-09T06:30:28.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f4659712700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465409b410 con 0x7f46540d1c30 2023-10-09T06:30:28.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f4659712700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4654167b50 con 0x7f46540cfe20 2023-10-09T06:30:28.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f46537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465415a2b0 0x7f46540d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f46537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465415a2b0 0x7f46540d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50774/0 (socket says 172.21.15.31:50774) 2023-10-09T06:30:28.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f46537fe700 1 -- 172.21.15.31:0/154252098 learned_addr learned my addr 172.21.15.31:0/154252098 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:28.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f4652ffd700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46540cfe20 0x7f465416a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f46527fc700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46540d1c30 0x7f4654167490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f46537fe700 1 -- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46540cfe20 msgr2=0x7f465416a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f46537fe700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46540cfe20 0x7f465416a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f46537fe700 1 -- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46540d1c30 msgr2=0x7f4654167490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:28.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f46537fe700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46540d1c30 0x7f4654167490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:28.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f46537fe700 1 -- 172.21.15.31:0/154252098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644009a20 con 0x7f465415a2b0 2023-10-09T06:30:28.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f46527fc700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46540d1c30 0x7f4654167490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:28.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f46537fe700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465415a2b0 0x7f46540d0f70 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f4644009e90 tx=0x7f464400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:28.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.882+0000 7f464affd700 1 -- 172.21.15.31:0/154252098 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464400cc20 con 0x7f465415a2b0 2023-10-09T06:30:28.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.883+0000 7f464affd700 1 -- 172.21.15.31:0/154252098 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464400f040 con 0x7f465415a2b0 2023-10-09T06:30:28.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.883+0000 7f4659712700 1 -- 172.21.15.31:0/154252098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c0093c0 con 0x7f465415a2b0 2023-10-09T06:30:28.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.883+0000 7f464affd700 1 -- 172.21.15.31:0/154252098 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644014480 con 0x7f465415a2b0 2023-10-09T06:30:28.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.883+0000 7f4659712700 1 -- 172.21.15.31:0/154252098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4654167d60 con 0x7f465415a2b0 2023-10-09T06:30:28.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.884+0000 7f4659712700 1 -- 172.21.15.31:0/154252098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465404c3c0 con 0x7f465415a2b0 2023-10-09T06:30:28.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.884+0000 7f464affd700 1 -- 172.21.15.31:0/154252098 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4644014810 con 0x7f465415a2b0 2023-10-09T06:30:28.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.884+0000 7f464affd700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4634066f30 0x7f46340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:28.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.884+0000 7f464affd700 1 -- 172.21.15.31:0/154252098 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4644084fe0 con 0x7f465415a2b0 2023-10-09T06:30:28.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.885+0000 7f4652ffd700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4634066f30 0x7f46340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:28.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.885+0000 7f4652ffd700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4634066f30 0x7f46340693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f464c009160 tx=0x7f464c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:28.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:28.889+0000 7f464affd700 1 -- 172.21.15.31:0/154252098 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4644052250 con 0x7f465415a2b0 2023-10-09T06:30:29.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.080+0000 7f4659712700 1 -- 172.21.15.31:0/154252098 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f465415d7b0 con 0x7f4634066f30 2023-10-09T06:30:29.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.089+0000 7f464affd700 1 -- 172.21.15.31:0/154252098 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285233 (secure 0 0 0) 0x7f465415d7b0 con 0x7f4634066f30 2023-10-09T06:30:29.094 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:29.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.092+0000 7f4659712700 1 -- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4634066f30 msgr2=0x7f46340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.092+0000 7f4659712700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4634066f30 0x7f46340693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f464c009160 tx=0x7f464c016000 comp rx=0 tx=0).stop 2023-10-09T06:30:29.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.092+0000 7f4659712700 1 -- 172.21.15.31:0/154252098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465415a2b0 msgr2=0x7f46540d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.092+0000 7f4659712700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465415a2b0 0x7f46540d0f70 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f4644009e90 tx=0x7f464400b040 comp rx=0 tx=0).stop 2023-10-09T06:30:29.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.092+0000 7f4659712700 1 -- 172.21.15.31:0/154252098 shutdown_connections 2023-10-09T06:30:29.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.092+0000 7f4659712700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4634066f30 0x7f46340693e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.092+0000 7f4659712700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46540cfe20 0x7f465416a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.092+0000 7f4659712700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f465415a2b0 0x7f46540d0f70 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.092+0000 7f4659712700 1 --2- 172.21.15.31:0/154252098 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f46540d1c30 0x7f4654167490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.092+0000 7f4659712700 1 -- 172.21.15.31:0/154252098 >> 172.21.15.31:0/154252098 conn(0x7f4654067e40 msgr2=0x7f46540ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:29.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.093+0000 7f4659712700 1 -- 172.21.15.31:0/154252098 shutdown_connections 2023-10-09T06:30:29.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.093+0000 7f4659712700 1 -- 172.21.15.31:0/154252098 wait complete. 2023-10-09T06:30:29.097 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:30:29.105 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2023-10-09T06:30:28.656104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8477,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554022,"statfs":{"total":1600000000,"available":1591318876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.677629"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.002236+0000","last_change":"2023-10-09T06:30:25.002171+0000","last_active":"2023-10-09T06:30:25.002236+0000","last_peered":"2023-10-09T06:30:25.002236+0000","last_clean":"2023-10-09T06:30:25.002236+0000","last_became_active":"2023-10-09T06:30:25.001953+0000","last_became_peered":"2023-10-09T06:30:25.001953+0000","last_unstale":"2023-10-09T06:30:25.002236+0000","last_undegraded":"2023-10-09T06:30:25.002236+0000","last_fullsized":"2023-10-09T06:30:25.002236+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:30.947032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008415+0000","last_change":"2023-10-09T06:30:25.008415+0000","last_active":"2023-10-09T06:30:25.008415+0000","last_peered":"2023-10-09T06:30:25.008415+0000","last_clean":"2023-10-09T06:30:25.008415+0000","last_became_active":"2023-10-09T06:30:25.008057+0000","last_became_peered":"2023-10-09T06:30:25.008057+0000","last_unstale":"2023-10-09T06:30:25.008415+0000","last_undegraded":"2023-10-09T06:30:25.008415+0000","last_fullsized":"2023-10-09T06:30:25.008415+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:16.528015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005849+0000","last_change":"2023-10-09T06:30:25.005786+0000","last_active":"2023-10-09T06:30:25.005849+0000","last_peered":"2023-10-09T06:30:25.005849+0000","last_clean":"2023-10-09T06:30:25.005849+0000","last_became_active":"2023-10-09T06:30:25.005314+0000","last_became_peered":"2023-10-09T06:30:25.005314+0000","last_unstale":"2023-10-09T06:30:25.005849+0000","last_undegraded":"2023-10-09T06:30:25.005849+0000","last_fullsized":"2023-10-09T06:30:25.005849+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:05:44.334580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.001263+0000","last_change":"2023-10-09T06:30:25.001180+0000","last_active":"2023-10-09T06:30:25.001263+0000","last_peered":"2023-10-09T06:30:25.001263+0000","last_clean":"2023-10-09T06:30:25.001263+0000","last_became_active":"2023-10-09T06:30:25.000506+0000","last_became_peered":"2023-10-09T06:30:25.000506+0000","last_unstale":"2023-10-09T06:30:25.001263+0000","last_undegraded":"2023-10-09T06:30:25.001263+0000","last_fullsized":"2023-10-09T06:30:25.001263+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:35.313823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008187+0000","last_change":"2023-10-09T06:30:25.008062+0000","last_active":"2023-10-09T06:30:25.008187+0000","last_peered":"2023-10-09T06:30:25.008187+0000","last_clean":"2023-10-09T06:30:25.008187+0000","last_became_active":"2023-10-09T06:30:25.007731+0000","last_became_peered":"2023-10-09T06:30:25.007731+0000","last_unstale":"2023-10-09T06:30:25.008187+0000","last_undegraded":"2023-10-09T06:30:25.008187+0000","last_fullsized":"2023-10-09T06:30:25.008187+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:22.042293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004159+0000","last_change":"2023-10-09T06:30:25.003903+0000","last_active":"2023-10-09T06:30:25.004159+0000","last_peered":"2023-10-09T06:30:25.004159+0000","last_clean":"2023-10-09T06:30:25.004159+0000","last_became_active":"2023-10-09T06:30:25.002961+0000","last_became_peered":"2023-10-09T06:30:25.002961+0000","last_unstale":"2023-10-09T06:30:25.004159+0000","last_undegraded":"2023-10-09T06:30:25.004159+0000","last_fullsized":"2023-10-09T06:30:25.004159+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:31:00.237471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.010697+0000","last_change":"2023-10-09T06:30:25.010697+0000","last_active":"2023-10-09T06:30:25.010697+0000","last_peered":"2023-10-09T06:30:25.010697+0000","last_clean":"2023-10-09T06:30:25.010697+0000","last_became_active":"2023-10-09T06:30:25.010469+0000","last_became_peered":"2023-10-09T06:30:25.010469+0000","last_unstale":"2023-10-09T06:30:25.010697+0000","last_undegraded":"2023-10-09T06:30:25.010697+0000","last_fullsized":"2023-10-09T06:30:25.010697+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:51.080595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.010150+0000","last_change":"2023-10-09T06:30:25.010085+0000","last_active":"2023-10-09T06:30:25.010150+0000","last_peered":"2023-10-09T06:30:25.010150+0000","last_clean":"2023-10-09T06:30:25.010150+0000","last_became_active":"2023-10-09T06:30:25.009855+0000","last_became_peered":"2023-10-09T06:30:25.009855+0000","last_unstale":"2023-10-09T06:30:25.010150+0000","last_undegraded":"2023-10-09T06:30:25.010150+0000","last_fullsized":"2023-10-09T06:30:25.010150+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:38.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.002317+0000","last_change":"2023-10-09T06:30:25.002317+0000","last_active":"2023-10-09T06:30:25.002317+0000","last_peered":"2023-10-09T06:30:25.002317+0000","last_clean":"2023-10-09T06:30:25.002317+0000","last_became_active":"2023-10-09T06:30:25.002095+0000","last_became_peered":"2023-10-09T06:30:25.002095+0000","last_unstale":"2023-10-09T06:30:25.002317+0000","last_undegraded":"2023-10-09T06:30:25.002317+0000","last_fullsized":"2023-10-09T06:30:25.002317+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:41.330399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.002547+0000","last_change":"2023-10-09T06:30:25.002486+0000","last_active":"2023-10-09T06:30:25.002547+0000","last_peered":"2023-10-09T06:30:25.002547+0000","last_clean":"2023-10-09T06:30:25.002547+0000","last_became_active":"2023-10-09T06:30:25.002262+0000","last_became_peered":"2023-10-09T06:30:25.002262+0000","last_unstale":"2023-10-09T06:30:25.002547+0000","last_undegraded":"2023-10-09T06:30:25.002547+0000","last_fullsized":"2023-10-09T06:30:25.002547+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:36:56.464910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.010747+0000","last_change":"2023-10-09T06:30:25.010682+0000","last_active":"2023-10-09T06:30:25.010747+0000","last_peered":"2023-10-09T06:30:25.010747+0000","last_clean":"2023-10-09T06:30:25.010747+0000","last_became_active":"2023-10-09T06:30:25.010420+0000","last_became_peered":"2023-10-09T06:30:25.010420+0000","last_unstale":"2023-10-09T06:30:25.010747+0000","last_undegraded":"2023-10-09T06:30:25.010747+0000","last_fullsized":"2023-10-09T06:30:25.010747+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:22.042293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.013340+0000","last_change":"2023-10-09T06:30:25.012961+0000","last_active":"2023-10-09T06:30:25.013340+0000","last_peered":"2023-10-09T06:30:25.013340+0000","last_clean":"2023-10-09T06:30:25.013340+0000","last_became_active":"2023-10-09T06:30:25.012604+0000","last_became_peered":"2023-10-09T06:30:25.012604+0000","last_unstale":"2023-10-09T06:30:25.013340+0000","last_undegraded":"2023-10-09T06:30:25.013340+0000","last_fullsized":"2023-10-09T06:30:25.013340+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:45.751574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.013687+0000","last_change":"2023-10-09T06:30:25.013630+0000","last_active":"2023-10-09T06:30:25.013687+0000","last_peered":"2023-10-09T06:30:25.013687+0000","last_clean":"2023-10-09T06:30:25.013687+0000","last_became_active":"2023-10-09T06:30:25.013178+0000","last_became_peered":"2023-10-09T06:30:25.013178+0000","last_unstale":"2023-10-09T06:30:25.013687+0000","last_undegraded":"2023-10-09T06:30:25.013687+0000","last_fullsized":"2023-10-09T06:30:25.013687+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:04.243187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003477+0000","last_change":"2023-10-09T06:30:25.003327+0000","last_active":"2023-10-09T06:30:25.003477+0000","last_peered":"2023-10-09T06:30:25.003477+0000","last_clean":"2023-10-09T06:30:25.003477+0000","last_became_active":"2023-10-09T06:30:25.002879+0000","last_became_peered":"2023-10-09T06:30:25.002879+0000","last_unstale":"2023-10-09T06:30:25.003477+0000","last_undegraded":"2023-10-09T06:30:25.003477+0000","last_fullsized":"2023-10-09T06:30:25.003477+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:05:44.334580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003543+0000","last_change":"2023-10-09T06:30:25.003466+0000","last_active":"2023-10-09T06:30:25.003543+0000","last_peered":"2023-10-09T06:30:25.003543+0000","last_clean":"2023-10-09T06:30:25.003543+0000","last_became_active":"2023-10-09T06:30:25.003232+0000","last_became_peered":"2023-10-09T06:30:25.003232+0000","last_unstale":"2023-10-09T06:30:25.003543+0000","last_undegraded":"2023-10-09T06:30:25.003543+0000","last_fullsized":"2023-10-09T06:30:25.003543+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:28.978001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005878+0000","last_change":"2023-10-09T06:30:25.005778+0000","last_active":"2023-10-09T06:30:25.005878+0000","last_peered":"2023-10-09T06:30:25.005878+0000","last_clean":"2023-10-09T06:30:25.005878+0000","last_became_active":"2023-10-09T06:30:25.005554+0000","last_became_peered":"2023-10-09T06:30:25.005554+0000","last_unstale":"2023-10-09T06:30:25.005878+0000","last_undegraded":"2023-10-09T06:30:25.005878+0000","last_fullsized":"2023-10-09T06:30:25.005878+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:11:15.192154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.013322+0000","last_change":"2023-10-09T06:30:25.012809+0000","last_active":"2023-10-09T06:30:25.013322+0000","last_peered":"2023-10-09T06:30:25.013322+0000","last_clean":"2023-10-09T06:30:25.013322+0000","last_became_active":"2023-10-09T06:30:25.012306+0000","last_became_peered":"2023-10-09T06:30:25.012306+0000","last_unstale":"2023-10-09T06:30:25.013322+0000","last_undegraded":"2023-10-09T06:30:25.013322+0000","last_fullsized":"2023-10-09T06:30:25.013322+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:02.061891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.006223+0000","last_change":"2023-10-09T06:30:25.005955+0000","last_active":"2023-10-09T06:30:25.006223+0000","last_peered":"2023-10-09T06:30:25.006223+0000","last_clean":"2023-10-09T06:30:25.006223+0000","last_became_active":"2023-10-09T06:30:25.005558+0000","last_became_peered":"2023-10-09T06:30:25.005558+0000","last_unstale":"2023-10-09T06:30:25.006223+0000","last_undegraded":"2023-10-09T06:30:25.006223+0000","last_fullsized":"2023-10-09T06:30:25.006223+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:16.501201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004141+0000","last_change":"2023-10-09T06:30:25.003568+0000","last_active":"2023-10-09T06:30:25.004141+0000","last_peered":"2023-10-09T06:30:25.004141+0000","last_clean":"2023-10-09T06:30:25.004141+0000","last_became_active":"2023-10-09T06:30:25.003200+0000","last_became_peered":"2023-10-09T06:30:25.003200+0000","last_unstale":"2023-10-09T06:30:25.004141+0000","last_undegraded":"2023-10-09T06:30:25.004141+0000","last_fullsized":"2023-10-09T06:30:25.004141+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:40:06.561425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004126+0000","last_change":"2023-10-09T06:30:25.003392+0000","last_active":"2023-10-09T06:30:25.004126+0000","last_peered":"2023-10-09T06:30:25.004126+0000","last_clean":"2023-10-09T06:30:25.004126+0000","last_became_active":"2023-10-09T06:30:25.003025+0000","last_became_peered":"2023-10-09T06:30:25.003025+0000","last_unstale":"2023-10-09T06:30:25.004126+0000","last_undegraded":"2023-10-09T06:30:25.004126+0000","last_fullsized":"2023-10-09T06:30:25.004126+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:35:45.471474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004998+0000","last_change":"2023-10-09T06:30:25.004936+0000","last_active":"2023-10-09T06:30:25.004998+0000","last_peered":"2023-10-09T06:30:25.004998+0000","last_clean":"2023-10-09T06:30:25.004998+0000","last_became_active":"2023-10-09T06:30:25.004718+0000","last_became_peered":"2023-10-09T06:30:25.004718+0000","last_unstale":"2023-10-09T06:30:25.004998+0000","last_undegraded":"2023-10-09T06:30:25.004998+0000","last_fullsized":"2023-10-09T06:30:25.004998+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:28.624141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003406+0000","last_change":"2023-10-09T06:30:25.002932+0000","last_active":"2023-10-09T06:30:25.003406+0000","last_peered":"2023-10-09T06:30:25.003406+0000","last_clean":"2023-10-09T06:30:25.003406+0000","last_became_active":"2023-10-09T06:30:25.001913+0000","last_became_peered":"2023-10-09T06:30:25.001913+0000","last_unstale":"2023-10-09T06:30:25.003406+0000","last_undegraded":"2023-10-09T06:30:25.003406+0000","last_fullsized":"2023-10-09T06:30:25.003406+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:53.286248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.009603+0000","last_change":"2023-10-09T06:30:25.009251+0000","last_active":"2023-10-09T06:30:25.009603+0000","last_peered":"2023-10-09T06:30:25.009603+0000","last_clean":"2023-10-09T06:30:25.009603+0000","last_became_active":"2023-10-09T06:30:25.008975+0000","last_became_peered":"2023-10-09T06:30:25.008975+0000","last_unstale":"2023-10-09T06:30:25.009603+0000","last_undegraded":"2023-10-09T06:30:25.009603+0000","last_fullsized":"2023-10-09T06:30:25.009603+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:16:10.411380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003526+0000","last_change":"2023-10-09T06:30:25.003412+0000","last_active":"2023-10-09T06:30:25.003526+0000","last_peered":"2023-10-09T06:30:25.003526+0000","last_clean":"2023-10-09T06:30:25.003526+0000","last_became_active":"2023-10-09T06:30:25.003188+0000","last_became_peered":"2023-10-09T06:30:25.003188+0000","last_unstale":"2023-10-09T06:30:25.003526+0000","last_undegraded":"2023-10-09T06:30:25.003526+0000","last_fullsized":"2023-10-09T06:30:25.003526+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:56.924537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004108+0000","last_change":"2023-10-09T06:30:25.003248+0000","last_active":"2023-10-09T06:30:25.004108+0000","last_peered":"2023-10-09T06:30:25.004108+0000","last_clean":"2023-10-09T06:30:25.004108+0000","last_became_active":"2023-10-09T06:30:25.002714+0000","last_became_peered":"2023-10-09T06:30:25.002714+0000","last_unstale":"2023-10-09T06:30:25.004108+0000","last_undegraded":"2023-10-09T06:30:25.004108+0000","last_fullsized":"2023-10-09T06:30:25.004108+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:55:32.998556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004174+0000","last_change":"2023-10-09T06:30:25.004067+0000","last_active":"2023-10-09T06:30:25.004174+0000","last_peered":"2023-10-09T06:30:25.004174+0000","last_clean":"2023-10-09T06:30:25.004174+0000","last_became_active":"2023-10-09T06:30:25.003690+0000","last_became_peered":"2023-10-09T06:30:25.003690+0000","last_unstale":"2023-10-09T06:30:25.004174+0000","last_undegraded":"2023-10-09T06:30:25.004174+0000","last_fullsized":"2023-10-09T06:30:25.004174+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:50.817916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004143+0000","last_change":"2023-10-09T06:30:25.004017+0000","last_active":"2023-10-09T06:30:25.004143+0000","last_peered":"2023-10-09T06:30:25.004143+0000","last_clean":"2023-10-09T06:30:25.004143+0000","last_became_active":"2023-10-09T06:30:25.003801+0000","last_became_peered":"2023-10-09T06:30:25.003801+0000","last_unstale":"2023-10-09T06:30:25.004143+0000","last_undegraded":"2023-10-09T06:30:25.004143+0000","last_fullsized":"2023-10-09T06:30:25.004143+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:41.102911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008856+0000","last_change":"2023-10-09T06:30:25.008856+0000","last_active":"2023-10-09T06:30:25.008856+0000","last_peered":"2023-10-09T06:30:25.008856+0000","last_clean":"2023-10-09T06:30:25.008856+0000","last_became_active":"2023-10-09T06:30:25.008486+0000","last_became_peered":"2023-10-09T06:30:25.008486+0000","last_unstale":"2023-10-09T06:30:25.008856+0000","last_undegraded":"2023-10-09T06:30:25.008856+0000","last_fullsized":"2023-10-09T06:30:25.008856+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:55:27.261832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004728+0000","last_change":"2023-10-09T06:30:25.004638+0000","last_active":"2023-10-09T06:30:25.004728+0000","last_peered":"2023-10-09T06:30:25.004728+0000","last_clean":"2023-10-09T06:30:25.004728+0000","last_became_active":"2023-10-09T06:30:25.004086+0000","last_became_peered":"2023-10-09T06:30:25.004086+0000","last_unstale":"2023-10-09T06:30:25.004728+0000","last_undegraded":"2023-10-09T06:30:25.004728+0000","last_fullsized":"2023-10-09T06:30:25.004728+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:51:15.693796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003460+0000","last_change":"2023-10-09T06:30:25.003176+0000","last_active":"2023-10-09T06:30:25.003460+0000","last_peered":"2023-10-09T06:30:25.003460+0000","last_clean":"2023-10-09T06:30:25.003460+0000","last_became_active":"2023-10-09T06:30:25.002811+0000","last_became_peered":"2023-10-09T06:30:25.002811+0000","last_unstale":"2023-10-09T06:30:25.003460+0000","last_undegraded":"2023-10-09T06:30:25.003460+0000","last_fullsized":"2023-10-09T06:30:25.003460+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:22.744819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.000535+0000","last_change":"2023-10-09T06:30:25.000535+0000","last_active":"2023-10-09T06:30:25.000535+0000","last_peered":"2023-10-09T06:30:25.000535+0000","last_clean":"2023-10-09T06:30:25.000535+0000","last_became_active":"2023-10-09T06:30:25.000297+0000","last_became_peered":"2023-10-09T06:30:25.000297+0000","last_unstale":"2023-10-09T06:30:25.000535+0000","last_undegraded":"2023-10-09T06:30:25.000535+0000","last_fullsized":"2023-10-09T06:30:25.000535+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:30.467994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.009125+0000","last_change":"2023-10-09T06:30:25.009073+0000","last_active":"2023-10-09T06:30:25.009125+0000","last_peered":"2023-10-09T06:30:25.009125+0000","last_clean":"2023-10-09T06:30:25.009125+0000","last_became_active":"2023-10-09T06:30:25.008800+0000","last_became_peered":"2023-10-09T06:30:25.008800+0000","last_unstale":"2023-10-09T06:30:25.009125+0000","last_undegraded":"2023-10-09T06:30:25.009125+0000","last_fullsized":"2023-10-09T06:30:25.009125+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:56:17.105011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.011774+0000","last_change":"2023-10-09T06:30:25.010918+0000","last_active":"2023-10-09T06:30:25.011774+0000","last_peered":"2023-10-09T06:30:25.011774+0000","last_clean":"2023-10-09T06:30:25.011774+0000","last_became_active":"2023-10-09T06:30:25.010696+0000","last_became_peered":"2023-10-09T06:30:25.010696+0000","last_unstale":"2023-10-09T06:30:25.011774+0000","last_undegraded":"2023-10-09T06:30:25.011774+0000","last_fullsized":"2023-10-09T06:30:25.011774+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:52.720292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"167'4","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017788+0000","last_change":"2023-10-09T06:30:23.985929+0000","last_active":"2023-10-09T06:30:25.017788+0000","last_peered":"2023-10-09T06:30:25.017788+0000","last_clean":"2023-10-09T06:30:25.017788+0000","last_became_active":"2023-10-09T06:30:23.985651+0000","last_became_peered":"2023-10-09T06:30:23.985651+0000","last_unstale":"2023-10-09T06:30:25.017788+0000","last_undegraded":"2023-10-09T06:30:25.017788+0000","last_fullsized":"2023-10-09T06:30:25.017788+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:37:46.880510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.009033+0000","last_change":"2023-10-09T06:30:25.009033+0000","last_active":"2023-10-09T06:30:25.009033+0000","last_peered":"2023-10-09T06:30:25.009033+0000","last_clean":"2023-10-09T06:30:25.009033+0000","last_became_active":"2023-10-09T06:30:25.008876+0000","last_became_peered":"2023-10-09T06:30:25.008876+0000","last_unstale":"2023-10-09T06:30:25.009033+0000","last_undegraded":"2023-10-09T06:30:25.009033+0000","last_fullsized":"2023-10-09T06:30:25.009033+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:29:45.086531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.999200+0000","last_change":"2023-10-09T06:30:23.991298+0000","last_active":"2023-10-09T06:30:24.999200+0000","last_peered":"2023-10-09T06:30:24.999200+0000","last_clean":"2023-10-09T06:30:24.999200+0000","last_became_active":"2023-10-09T06:30:23.990688+0000","last_became_peered":"2023-10-09T06:30:23.990688+0000","last_unstale":"2023-10-09T06:30:24.999200+0000","last_undegraded":"2023-10-09T06:30:24.999200+0000","last_fullsized":"2023-10-09T06:30:24.999200+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:06:05.629590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005929+0000","last_change":"2023-10-09T06:30:25.005220+0000","last_active":"2023-10-09T06:30:25.005929+0000","last_peered":"2023-10-09T06:30:25.005929+0000","last_clean":"2023-10-09T06:30:25.005929+0000","last_became_active":"2023-10-09T06:30:25.004962+0000","last_became_peered":"2023-10-09T06:30:25.004962+0000","last_unstale":"2023-10-09T06:30:25.005929+0000","last_undegraded":"2023-10-09T06:30:25.005929+0000","last_fullsized":"2023-10-09T06:30:25.005929+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:07.714322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.018655+0000","last_change":"2023-10-09T06:30:23.993048+0000","last_active":"2023-10-09T06:30:25.018655+0000","last_peered":"2023-10-09T06:30:25.018655+0000","last_clean":"2023-10-09T06:30:25.018655+0000","last_became_active":"2023-10-09T06:30:23.992790+0000","last_became_peered":"2023-10-09T06:30:23.992790+0000","last_unstale":"2023-10-09T06:30:25.018655+0000","last_undegraded":"2023-10-09T06:30:25.018655+0000","last_fullsized":"2023-10-09T06:30:25.018655+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:37.182380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.011797+0000","last_change":"2023-10-09T06:30:25.011364+0000","last_active":"2023-10-09T06:30:25.011797+0000","last_peered":"2023-10-09T06:30:25.011797+0000","last_clean":"2023-10-09T06:30:25.011797+0000","last_became_active":"2023-10-09T06:30:25.011036+0000","last_became_peered":"2023-10-09T06:30:25.011036+0000","last_unstale":"2023-10-09T06:30:25.011797+0000","last_undegraded":"2023-10-09T06:30:25.011797+0000","last_fullsized":"2023-10-09T06:30:25.011797+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:55.725345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017960+0000","last_change":"2023-10-09T06:30:23.985173+0000","last_active":"2023-10-09T06:30:25.017960+0000","last_peered":"2023-10-09T06:30:25.017960+0000","last_clean":"2023-10-09T06:30:25.017960+0000","last_became_active":"2023-10-09T06:30:23.984873+0000","last_became_peered":"2023-10-09T06:30:23.984873+0000","last_unstale":"2023-10-09T06:30:25.017960+0000","last_undegraded":"2023-10-09T06:30:25.017960+0000","last_fullsized":"2023-10-09T06:30:25.017960+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:06.710483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005143+0000","last_change":"2023-10-09T06:30:25.005143+0000","last_active":"2023-10-09T06:30:25.005143+0000","last_peered":"2023-10-09T06:30:25.005143+0000","last_clean":"2023-10-09T06:30:25.005143+0000","last_became_active":"2023-10-09T06:30:25.004914+0000","last_became_peered":"2023-10-09T06:30:25.004914+0000","last_unstale":"2023-10-09T06:30:25.005143+0000","last_undegraded":"2023-10-09T06:30:25.005143+0000","last_fullsized":"2023-10-09T06:30:25.005143+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:37:47.884349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.018567+0000","last_change":"2023-10-09T06:30:23.994348+0000","last_active":"2023-10-09T06:30:25.018567+0000","last_peered":"2023-10-09T06:30:25.018567+0000","last_clean":"2023-10-09T06:30:25.018567+0000","last_became_active":"2023-10-09T06:30:23.993763+0000","last_became_peered":"2023-10-09T06:30:23.993763+0000","last_unstale":"2023-10-09T06:30:25.018567+0000","last_undegraded":"2023-10-09T06:30:25.018567+0000","last_fullsized":"2023-10-09T06:30:25.018567+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:15.497090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003426+0000","last_change":"2023-10-09T06:30:25.003090+0000","last_active":"2023-10-09T06:30:25.003426+0000","last_peered":"2023-10-09T06:30:25.003426+0000","last_clean":"2023-10-09T06:30:25.003426+0000","last_became_active":"2023-10-09T06:30:25.002318+0000","last_became_peered":"2023-10-09T06:30:25.002318+0000","last_unstale":"2023-10-09T06:30:25.003426+0000","last_undegraded":"2023-10-09T06:30:25.003426+0000","last_fullsized":"2023-10-09T06:30:25.003426+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:16.501201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017274+0000","last_change":"2023-10-09T06:30:23.992003+0000","last_active":"2023-10-09T06:30:25.017274+0000","last_peered":"2023-10-09T06:30:25.017274+0000","last_clean":"2023-10-09T06:30:25.017274+0000","last_became_active":"2023-10-09T06:30:23.991746+0000","last_became_peered":"2023-10-09T06:30:23.991746+0000","last_unstale":"2023-10-09T06:30:25.017274+0000","last_undegraded":"2023-10-09T06:30:25.017274+0000","last_fullsized":"2023-10-09T06:30:25.017274+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:53:13.106188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.009895+0000","last_change":"2023-10-09T06:30:25.009895+0000","last_active":"2023-10-09T06:30:25.009895+0000","last_peered":"2023-10-09T06:30:25.009895+0000","last_clean":"2023-10-09T06:30:25.009895+0000","last_became_active":"2023-10-09T06:30:25.009680+0000","last_became_peered":"2023-10-09T06:30:25.009680+0000","last_unstale":"2023-10-09T06:30:25.009895+0000","last_undegraded":"2023-10-09T06:30:25.009895+0000","last_fullsized":"2023-10-09T06:30:25.009895+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:01.065011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.998801+0000","last_change":"2023-10-09T06:30:23.989940+0000","last_active":"2023-10-09T06:30:24.998801+0000","last_peered":"2023-10-09T06:30:24.998801+0000","last_clean":"2023-10-09T06:30:24.998801+0000","last_became_active":"2023-10-09T06:30:23.989695+0000","last_became_peered":"2023-10-09T06:30:23.989695+0000","last_unstale":"2023-10-09T06:30:24.998801+0000","last_undegraded":"2023-10-09T06:30:24.998801+0000","last_fullsized":"2023-10-09T06:30:24.998801+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:45.608000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.010259+0000","last_change":"2023-10-09T06:30:25.010165+0000","last_active":"2023-10-09T06:30:25.010259+0000","last_peered":"2023-10-09T06:30:25.010259+0000","last_clean":"2023-10-09T06:30:25.010259+0000","last_became_active":"2023-10-09T06:30:25.009949+0000","last_became_peered":"2023-10-09T06:30:25.009949+0000","last_unstale":"2023-10-09T06:30:25.010259+0000","last_undegraded":"2023-10-09T06:30:25.010259+0000","last_fullsized":"2023-10-09T06:30:25.010259+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:38.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.997568+0000","last_change":"2023-10-09T06:30:23.990154+0000","last_active":"2023-10-09T06:30:24.997568+0000","last_peered":"2023-10-09T06:30:24.997568+0000","last_clean":"2023-10-09T06:30:24.997568+0000","last_became_active":"2023-10-09T06:30:23.989924+0000","last_became_peered":"2023-10-09T06:30:23.989924+0000","last_unstale":"2023-10-09T06:30:24.997568+0000","last_undegraded":"2023-10-09T06:30:24.997568+0000","last_fullsized":"2023-10-09T06:30:24.997568+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:21.038454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008742+0000","last_change":"2023-10-09T06:30:25.008365+0000","last_active":"2023-10-09T06:30:25.008742+0000","last_peered":"2023-10-09T06:30:25.008742+0000","last_clean":"2023-10-09T06:30:25.008742+0000","last_became_active":"2023-10-09T06:30:25.008125+0000","last_became_peered":"2023-10-09T06:30:25.008125+0000","last_unstale":"2023-10-09T06:30:25.008742+0000","last_undegraded":"2023-10-09T06:30:25.008742+0000","last_fullsized":"2023-10-09T06:30:25.008742+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:30.947032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T06:30:23.989254+0000","last_change":"2023-10-09T06:30:23.989052+0000","last_active":"2023-10-09T06:30:23.989254+0000","last_peered":"2023-10-09T06:30:23.989254+0000","last_clean":"2023-10-09T06:30:23.989254+0000","last_became_active":"2023-10-09T06:30:23.988821+0000","last_became_peered":"2023-10-09T06:30:23.988821+0000","last_unstale":"2023-10-09T06:30:23.989254+0000","last_undegraded":"2023-10-09T06:30:23.989254+0000","last_fullsized":"2023-10-09T06:30:23.989254+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:34.545116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.010679+0000","last_change":"2023-10-09T06:30:25.010615+0000","last_active":"2023-10-09T06:30:25.010679+0000","last_peered":"2023-10-09T06:30:25.010679+0000","last_clean":"2023-10-09T06:30:25.010679+0000","last_became_active":"2023-10-09T06:30:25.010374+0000","last_became_peered":"2023-10-09T06:30:25.010374+0000","last_unstale":"2023-10-09T06:30:25.010679+0000","last_undegraded":"2023-10-09T06:30:25.010679+0000","last_fullsized":"2023-10-09T06:30:25.010679+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:18:50.201556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.998649+0000","last_change":"2023-10-09T06:30:23.991566+0000","last_active":"2023-10-09T06:30:24.998649+0000","last_peered":"2023-10-09T06:30:24.998649+0000","last_clean":"2023-10-09T06:30:24.998649+0000","last_became_active":"2023-10-09T06:30:23.990842+0000","last_became_peered":"2023-10-09T06:30:23.990842+0000","last_unstale":"2023-10-09T06:30:24.998649+0000","last_undegraded":"2023-10-09T06:30:24.998649+0000","last_fullsized":"2023-10-09T06:30:24.998649+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:00.061172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.010183+0000","last_change":"2023-10-09T06:30:25.009600+0000","last_active":"2023-10-09T06:30:25.010183+0000","last_peered":"2023-10-09T06:30:25.010183+0000","last_clean":"2023-10-09T06:30:25.010183+0000","last_became_active":"2023-10-09T06:30:25.009277+0000","last_became_peered":"2023-10-09T06:30:25.009277+0000","last_unstale":"2023-10-09T06:30:25.010183+0000","last_undegraded":"2023-10-09T06:30:25.010183+0000","last_fullsized":"2023-10-09T06:30:25.010183+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:23.164478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"167'6","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.018398+0000","last_change":"2023-10-09T06:30:23.994875+0000","last_active":"2023-10-09T06:30:25.018398+0000","last_peered":"2023-10-09T06:30:25.018398+0000","last_clean":"2023-10-09T06:30:25.018398+0000","last_became_active":"2023-10-09T06:30:23.994638+0000","last_became_peered":"2023-10-09T06:30:23.994638+0000","last_unstale":"2023-10-09T06:30:25.018398+0000","last_undegraded":"2023-10-09T06:30:25.018398+0000","last_fullsized":"2023-10-09T06:30:25.018398+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:26.884295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005150+0000","last_change":"2023-10-09T06:30:25.005021+0000","last_active":"2023-10-09T06:30:25.005150+0000","last_peered":"2023-10-09T06:30:25.005150+0000","last_clean":"2023-10-09T06:30:25.005150+0000","last_became_active":"2023-10-09T06:30:25.004670+0000","last_became_peered":"2023-10-09T06:30:25.004670+0000","last_unstale":"2023-10-09T06:30:25.005150+0000","last_undegraded":"2023-10-09T06:30:25.005150+0000","last_fullsized":"2023-10-09T06:30:25.005150+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:22.744819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017357+0000","last_change":"2023-10-09T06:30:23.992397+0000","last_active":"2023-10-09T06:30:25.017357+0000","last_peered":"2023-10-09T06:30:25.017357+0000","last_clean":"2023-10-09T06:30:25.017357+0000","last_became_active":"2023-10-09T06:30:23.992172+0000","last_became_peered":"2023-10-09T06:30:23.992172+0000","last_unstale":"2023-10-09T06:30:25.017357+0000","last_undegraded":"2023-10-09T06:30:25.017357+0000","last_fullsized":"2023-10-09T06:30:25.017357+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:59.816440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008372+0000","last_change":"2023-10-09T06:30:25.008372+0000","last_active":"2023-10-09T06:30:25.008372+0000","last_peered":"2023-10-09T06:30:25.008372+0000","last_clean":"2023-10-09T06:30:25.008372+0000","last_became_active":"2023-10-09T06:30:25.008181+0000","last_became_peered":"2023-10-09T06:30:25.008181+0000","last_unstale":"2023-10-09T06:30:25.008372+0000","last_undegraded":"2023-10-09T06:30:25.008372+0000","last_fullsized":"2023-10-09T06:30:25.008372+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:08:53.370514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.996470+0000","last_change":"2023-10-09T06:30:23.989327+0000","last_active":"2023-10-09T06:30:24.996470+0000","last_peered":"2023-10-09T06:30:24.996470+0000","last_clean":"2023-10-09T06:30:24.996470+0000","last_became_active":"2023-10-09T06:30:23.988942+0000","last_became_peered":"2023-10-09T06:30:23.988942+0000","last_unstale":"2023-10-09T06:30:24.996470+0000","last_undegraded":"2023-10-09T06:30:24.996470+0000","last_fullsized":"2023-10-09T06:30:24.996470+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:37.182380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.013568+0000","last_change":"2023-10-09T06:30:25.013506+0000","last_active":"2023-10-09T06:30:25.013568+0000","last_peered":"2023-10-09T06:30:25.013568+0000","last_clean":"2023-10-09T06:30:25.013568+0000","last_became_active":"2023-10-09T06:30:25.012879+0000","last_became_peered":"2023-10-09T06:30:25.012879+0000","last_unstale":"2023-10-09T06:30:25.013568+0000","last_undegraded":"2023-10-09T06:30:25.013568+0000","last_fullsized":"2023-10-09T06:30:25.013568+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:31:00.237471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.998403+0000","last_change":"2023-10-09T06:30:23.992624+0000","last_active":"2023-10-09T06:30:24.998403+0000","last_peered":"2023-10-09T06:30:24.998403+0000","last_clean":"2023-10-09T06:30:24.998403+0000","last_became_active":"2023-10-09T06:30:23.992453+0000","last_became_peered":"2023-10-09T06:30:23.992453+0000","last_unstale":"2023-10-09T06:30:24.998403+0000","last_undegraded":"2023-10-09T06:30:24.998403+0000","last_fullsized":"2023-10-09T06:30:24.998403+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:40.099072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003043+0000","last_change":"2023-10-09T06:30:25.002795+0000","last_active":"2023-10-09T06:30:25.003043+0000","last_peered":"2023-10-09T06:30:25.003043+0000","last_clean":"2023-10-09T06:30:25.003043+0000","last_became_active":"2023-10-09T06:30:25.002533+0000","last_became_peered":"2023-10-09T06:30:25.002533+0000","last_unstale":"2023-10-09T06:30:25.003043+0000","last_undegraded":"2023-10-09T06:30:25.003043+0000","last_fullsized":"2023-10-09T06:30:25.003043+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:35.313823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"167'8","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.019761+0000","last_change":"2023-10-09T06:30:23.992980+0000","last_active":"2023-10-09T06:30:25.019761+0000","last_peered":"2023-10-09T06:30:25.019761+0000","last_clean":"2023-10-09T06:30:25.019761+0000","last_became_active":"2023-10-09T06:30:23.992663+0000","last_became_peered":"2023-10-09T06:30:23.992663+0000","last_unstale":"2023-10-09T06:30:25.019761+0000","last_undegraded":"2023-10-09T06:30:25.019761+0000","last_fullsized":"2023-10-09T06:30:25.019761+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:37:59.055511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.001173+0000","last_change":"2023-10-09T06:30:25.001090+0000","last_active":"2023-10-09T06:30:25.001173+0000","last_peered":"2023-10-09T06:30:25.001173+0000","last_clean":"2023-10-09T06:30:25.001173+0000","last_became_active":"2023-10-09T06:30:25.000860+0000","last_became_peered":"2023-10-09T06:30:25.000860+0000","last_unstale":"2023-10-09T06:30:25.001173+0000","last_undegraded":"2023-10-09T06:30:25.001173+0000","last_fullsized":"2023-10-09T06:30:25.001173+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:13.069696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017558+0000","last_change":"2023-10-09T06:30:23.989109+0000","last_active":"2023-10-09T06:30:25.017558+0000","last_peered":"2023-10-09T06:30:25.017558+0000","last_clean":"2023-10-09T06:30:25.017558+0000","last_became_active":"2023-10-09T06:30:23.988477+0000","last_became_peered":"2023-10-09T06:30:23.988477+0000","last_unstale":"2023-10-09T06:30:25.017558+0000","last_undegraded":"2023-10-09T06:30:25.017558+0000","last_fullsized":"2023-10-09T06:30:25.017558+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:11:14.188315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003172+0000","last_change":"2023-10-09T06:30:25.003108+0000","last_active":"2023-10-09T06:30:25.003172+0000","last_peered":"2023-10-09T06:30:25.003172+0000","last_clean":"2023-10-09T06:30:25.003172+0000","last_became_active":"2023-10-09T06:30:25.002687+0000","last_became_peered":"2023-10-09T06:30:25.002687+0000","last_unstale":"2023-10-09T06:30:25.003172+0000","last_undegraded":"2023-10-09T06:30:25.003172+0000","last_fullsized":"2023-10-09T06:30:25.003172+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:53:14.110027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017043+0000","last_change":"2023-10-09T06:30:23.988960+0000","last_active":"2023-10-09T06:30:25.017043+0000","last_peered":"2023-10-09T06:30:25.017043+0000","last_clean":"2023-10-09T06:30:25.017043+0000","last_became_active":"2023-10-09T06:30:23.988721+0000","last_became_peered":"2023-10-09T06:30:23.988721+0000","last_unstale":"2023-10-09T06:30:25.017043+0000","last_undegraded":"2023-10-09T06:30:25.017043+0000","last_fullsized":"2023-10-09T06:30:25.017043+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:15.497362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.001483+0000","last_change":"2023-10-09T06:30:25.001422+0000","last_active":"2023-10-09T06:30:25.001483+0000","last_peered":"2023-10-09T06:30:25.001483+0000","last_clean":"2023-10-09T06:30:25.001483+0000","last_became_active":"2023-10-09T06:30:25.001187+0000","last_became_peered":"2023-10-09T06:30:25.001187+0000","last_unstale":"2023-10-09T06:30:25.001483+0000","last_undegraded":"2023-10-09T06:30:25.001483+0000","last_fullsized":"2023-10-09T06:30:25.001483+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:16:10.411380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017176+0000","last_change":"2023-10-09T06:30:23.986859+0000","last_active":"2023-10-09T06:30:25.017176+0000","last_peered":"2023-10-09T06:30:25.017176+0000","last_clean":"2023-10-09T06:30:25.017176+0000","last_became_active":"2023-10-09T06:30:23.986291+0000","last_became_peered":"2023-10-09T06:30:23.986291+0000","last_unstale":"2023-10-09T06:30:25.017176+0000","last_undegraded":"2023-10-09T06:30:25.017176+0000","last_fullsized":"2023-10-09T06:30:25.017176+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:31.878680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005945+0000","last_change":"2023-10-09T06:30:25.005700+0000","last_active":"2023-10-09T06:30:25.005945+0000","last_peered":"2023-10-09T06:30:25.005945+0000","last_clean":"2023-10-09T06:30:25.005945+0000","last_became_active":"2023-10-09T06:30:25.005442+0000","last_became_peered":"2023-10-09T06:30:25.005442+0000","last_unstale":"2023-10-09T06:30:25.005945+0000","last_undegraded":"2023-10-09T06:30:25.005945+0000","last_fullsized":"2023-10-09T06:30:25.005945+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:00.820279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T06:30:23.990740+0000","last_change":"2023-10-09T06:30:23.990676+0000","last_active":"2023-10-09T06:30:23.990740+0000","last_peered":"2023-10-09T06:30:23.990740+0000","last_clean":"2023-10-09T06:30:23.990740+0000","last_became_active":"2023-10-09T06:30:23.990485+0000","last_became_peered":"2023-10-09T06:30:23.990485+0000","last_unstale":"2023-10-09T06:30:23.990740+0000","last_undegraded":"2023-10-09T06:30:23.990740+0000","last_fullsized":"2023-10-09T06:30:23.990740+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:16:09.407541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003442+0000","last_change":"2023-10-09T06:30:25.003153+0000","last_active":"2023-10-09T06:30:25.003442+0000","last_peered":"2023-10-09T06:30:25.003442+0000","last_clean":"2023-10-09T06:30:25.003442+0000","last_became_active":"2023-10-09T06:30:25.002555+0000","last_became_peered":"2023-10-09T06:30:25.002555+0000","last_unstale":"2023-10-09T06:30:25.003442+0000","last_undegraded":"2023-10-09T06:30:25.003442+0000","last_fullsized":"2023-10-09T06:30:25.003442+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:06:06.633428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.018300+0000","last_change":"2023-10-09T06:30:23.994935+0000","last_active":"2023-10-09T06:30:25.018300+0000","last_peered":"2023-10-09T06:30:25.018300+0000","last_clean":"2023-10-09T06:30:25.018300+0000","last_became_active":"2023-10-09T06:30:23.994684+0000","last_became_peered":"2023-10-09T06:30:23.994684+0000","last_unstale":"2023-10-09T06:30:25.018300+0000","last_undegraded":"2023-10-09T06:30:25.018300+0000","last_fullsized":"2023-10-09T06:30:25.018300+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:53.091899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008717+0000","last_change":"2023-10-09T06:30:25.008717+0000","last_active":"2023-10-09T06:30:25.008717+0000","last_peered":"2023-10-09T06:30:25.008717+0000","last_clean":"2023-10-09T06:30:25.008717+0000","last_became_active":"2023-10-09T06:30:25.008016+0000","last_became_peered":"2023-10-09T06:30:25.008016+0000","last_unstale":"2023-10-09T06:30:25.008717+0000","last_undegraded":"2023-10-09T06:30:25.008717+0000","last_fullsized":"2023-10-09T06:30:25.008717+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:49.516567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.999760+0000","last_change":"2023-10-09T06:30:23.993977+0000","last_active":"2023-10-09T06:30:24.999760+0000","last_peered":"2023-10-09T06:30:24.999760+0000","last_clean":"2023-10-09T06:30:24.999760+0000","last_became_active":"2023-10-09T06:30:23.993683+0000","last_became_peered":"2023-10-09T06:30:23.993683+0000","last_unstale":"2023-10-09T06:30:24.999760+0000","last_undegraded":"2023-10-09T06:30:24.999760+0000","last_fullsized":"2023-10-09T06:30:24.999760+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:40.326560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.009581+0000","last_change":"2023-10-09T06:30:25.008769+0000","last_active":"2023-10-09T06:30:25.009581+0000","last_peered":"2023-10-09T06:30:25.009581+0000","last_clean":"2023-10-09T06:30:25.009581+0000","last_became_active":"2023-10-09T06:30:25.008510+0000","last_became_peered":"2023-10-09T06:30:25.008510+0000","last_unstale":"2023-10-09T06:30:25.009581+0000","last_undegraded":"2023-10-09T06:30:25.009581+0000","last_fullsized":"2023-10-09T06:30:25.009581+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:55.007506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.999186+0000","last_change":"2023-10-09T06:30:23.993097+0000","last_active":"2023-10-09T06:30:24.999186+0000","last_peered":"2023-10-09T06:30:24.999186+0000","last_clean":"2023-10-09T06:30:24.999186+0000","last_became_active":"2023-10-09T06:30:23.992462+0000","last_became_peered":"2023-10-09T06:30:23.992462+0000","last_unstale":"2023-10-09T06:30:24.999186+0000","last_undegraded":"2023-10-09T06:30:24.999186+0000","last_fullsized":"2023-10-09T06:30:24.999186+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:08:52.366676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.012635+0000","last_change":"2023-10-09T06:30:25.012635+0000","last_active":"2023-10-09T06:30:25.012635+0000","last_peered":"2023-10-09T06:30:25.012635+0000","last_clean":"2023-10-09T06:30:25.012635+0000","last_became_active":"2023-10-09T06:30:25.012398+0000","last_became_peered":"2023-10-09T06:30:25.012398+0000","last_unstale":"2023-10-09T06:30:25.012635+0000","last_undegraded":"2023-10-09T06:30:25.012635+0000","last_fullsized":"2023-10-09T06:30:25.012635+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:06.937555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.996565+0000","last_change":"2023-10-09T06:30:23.989165+0000","last_active":"2023-10-09T06:30:24.996565+0000","last_peered":"2023-10-09T06:30:24.996565+0000","last_clean":"2023-10-09T06:30:24.996565+0000","last_became_active":"2023-10-09T06:30:23.988575+0000","last_became_peered":"2023-10-09T06:30:23.988575+0000","last_unstale":"2023-10-09T06:30:24.996565+0000","last_undegraded":"2023-10-09T06:30:24.996565+0000","last_fullsized":"2023-10-09T06:30:24.996565+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:29.943194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.013433+0000","last_change":"2023-10-09T06:30:25.013365+0000","last_active":"2023-10-09T06:30:25.013433+0000","last_peered":"2023-10-09T06:30:25.013433+0000","last_clean":"2023-10-09T06:30:25.013433+0000","last_became_active":"2023-10-09T06:30:25.012548+0000","last_became_peered":"2023-10-09T06:30:25.012548+0000","last_unstale":"2023-10-09T06:30:25.013433+0000","last_undegraded":"2023-10-09T06:30:25.013433+0000","last_fullsized":"2023-10-09T06:30:25.013433+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:07.714322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.018365+0000","last_change":"2023-10-09T06:30:23.993528+0000","last_active":"2023-10-09T06:30:25.018365+0000","last_peered":"2023-10-09T06:30:25.018365+0000","last_clean":"2023-10-09T06:30:25.018365+0000","last_became_active":"2023-10-09T06:30:23.992339+0000","last_became_peered":"2023-10-09T06:30:23.992339+0000","last_unstale":"2023-10-09T06:30:25.018365+0000","last_undegraded":"2023-10-09T06:30:25.018365+0000","last_fullsized":"2023-10-09T06:30:25.018365+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:10.620838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.000689+0000","last_change":"2023-10-09T06:30:25.000621+0000","last_active":"2023-10-09T06:30:25.000689+0000","last_peered":"2023-10-09T06:30:25.000689+0000","last_clean":"2023-10-09T06:30:25.000689+0000","last_became_active":"2023-10-09T06:30:25.000358+0000","last_became_peered":"2023-10-09T06:30:25.000358+0000","last_unstale":"2023-10-09T06:30:25.000689+0000","last_undegraded":"2023-10-09T06:30:25.000689+0000","last_fullsized":"2023-10-09T06:30:25.000689+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:53.286248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.998666+0000","last_change":"2023-10-09T06:30:23.990183+0000","last_active":"2023-10-09T06:30:24.998666+0000","last_peered":"2023-10-09T06:30:24.998666+0000","last_clean":"2023-10-09T06:30:24.998666+0000","last_became_active":"2023-10-09T06:30:23.989939+0000","last_became_peered":"2023-10-09T06:30:23.989939+0000","last_unstale":"2023-10-09T06:30:24.998666+0000","last_undegraded":"2023-10-09T06:30:24.998666+0000","last_fullsized":"2023-10-09T06:30:24.998666+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:56:16.101172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003697+0000","last_change":"2023-10-09T06:30:25.003697+0000","last_active":"2023-10-09T06:30:25.003697+0000","last_peered":"2023-10-09T06:30:25.003697+0000","last_clean":"2023-10-09T06:30:25.003697+0000","last_became_active":"2023-10-09T06:30:25.003326+0000","last_became_peered":"2023-10-09T06:30:25.003326+0000","last_unstale":"2023-10-09T06:30:25.003697+0000","last_undegraded":"2023-10-09T06:30:25.003697+0000","last_fullsized":"2023-10-09T06:30:25.003697+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:54.095738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.999683+0000","last_change":"2023-10-09T06:30:23.993784+0000","last_active":"2023-10-09T06:30:24.999683+0000","last_peered":"2023-10-09T06:30:24.999683+0000","last_clean":"2023-10-09T06:30:24.999683+0000","last_became_active":"2023-10-09T06:30:23.993567+0000","last_became_peered":"2023-10-09T06:30:23.993567+0000","last_unstale":"2023-10-09T06:30:24.999683+0000","last_undegraded":"2023-10-09T06:30:24.999683+0000","last_fullsized":"2023-10-09T06:30:24.999683+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:35:44.467635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005912+0000","last_change":"2023-10-09T06:30:25.004790+0000","last_active":"2023-10-09T06:30:25.005912+0000","last_peered":"2023-10-09T06:30:25.005912+0000","last_clean":"2023-10-09T06:30:25.005912+0000","last_became_active":"2023-10-09T06:30:25.004424+0000","last_became_peered":"2023-10-09T06:30:25.004424+0000","last_unstale":"2023-10-09T06:30:25.005912+0000","last_undegraded":"2023-10-09T06:30:25.005912+0000","last_fullsized":"2023-10-09T06:30:25.005912+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:04.243187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.998012+0000","last_change":"2023-10-09T06:30:23.995383+0000","last_active":"2023-10-09T06:30:24.998012+0000","last_peered":"2023-10-09T06:30:24.998012+0000","last_clean":"2023-10-09T06:30:24.998012+0000","last_became_active":"2023-10-09T06:30:23.995142+0000","last_became_peered":"2023-10-09T06:30:23.995142+0000","last_unstale":"2023-10-09T06:30:24.998012+0000","last_undegraded":"2023-10-09T06:30:24.998012+0000","last_fullsized":"2023-10-09T06:30:24.998012+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:55:31.994717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005281+0000","last_change":"2023-10-09T06:30:25.005217+0000","last_active":"2023-10-09T06:30:25.005281+0000","last_peered":"2023-10-09T06:30:25.005281+0000","last_clean":"2023-10-09T06:30:25.005281+0000","last_became_active":"2023-10-09T06:30:25.004959+0000","last_became_peered":"2023-10-09T06:30:25.004959+0000","last_unstale":"2023-10-09T06:30:25.005281+0000","last_undegraded":"2023-10-09T06:30:25.005281+0000","last_fullsized":"2023-10-09T06:30:25.005281+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:36.546784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T06:30:23.992074+0000","last_change":"2023-10-09T06:30:23.992004+0000","last_active":"2023-10-09T06:30:23.992074+0000","last_peered":"2023-10-09T06:30:23.992074+0000","last_clean":"2023-10-09T06:30:23.992074+0000","last_became_active":"2023-10-09T06:30:23.991792+0000","last_became_peered":"2023-10-09T06:30:23.991792+0000","last_unstale":"2023-10-09T06:30:23.992074+0000","last_undegraded":"2023-10-09T06:30:23.992074+0000","last_fullsized":"2023-10-09T06:30:23.992074+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:15.524176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008777+0000","last_change":"2023-10-09T06:30:25.008425+0000","last_active":"2023-10-09T06:30:25.008777+0000","last_peered":"2023-10-09T06:30:25.008777+0000","last_clean":"2023-10-09T06:30:25.008777+0000","last_became_active":"2023-10-09T06:30:25.007999+0000","last_became_peered":"2023-10-09T06:30:25.007999+0000","last_unstale":"2023-10-09T06:30:25.008777+0000","last_undegraded":"2023-10-09T06:30:25.008777+0000","last_fullsized":"2023-10-09T06:30:25.008777+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:00.820279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.998836+0000","last_change":"2023-10-09T06:30:23.993701+0000","last_active":"2023-10-09T06:30:24.998836+0000","last_peered":"2023-10-09T06:30:24.998836+0000","last_clean":"2023-10-09T06:30:24.998836+0000","last_became_active":"2023-10-09T06:30:23.993315+0000","last_became_peered":"2023-10-09T06:30:23.993315+0000","last_unstale":"2023-10-09T06:30:24.998836+0000","last_undegraded":"2023-10-09T06:30:24.998836+0000","last_fullsized":"2023-10-09T06:30:24.998836+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:15.524176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.001784+0000","last_change":"2023-10-09T06:30:25.001722+0000","last_active":"2023-10-09T06:30:25.001784+0000","last_peered":"2023-10-09T06:30:25.001784+0000","last_clean":"2023-10-09T06:30:25.001784+0000","last_became_active":"2023-10-09T06:30:25.001492+0000","last_became_peered":"2023-10-09T06:30:25.001492+0000","last_unstale":"2023-10-09T06:30:25.001784+0000","last_undegraded":"2023-10-09T06:30:25.001784+0000","last_fullsized":"2023-10-09T06:30:25.001784+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:40.403667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.999749+0000","last_change":"2023-10-09T06:30:23.992533+0000","last_active":"2023-10-09T06:30:24.999749+0000","last_peered":"2023-10-09T06:30:24.999749+0000","last_clean":"2023-10-09T06:30:24.999749+0000","last_became_active":"2023-10-09T06:30:23.992270+0000","last_became_peered":"2023-10-09T06:30:23.992270+0000","last_unstale":"2023-10-09T06:30:24.999749+0000","last_undegraded":"2023-10-09T06:30:24.999749+0000","last_fullsized":"2023-10-09T06:30:24.999749+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:59.233633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.009576+0000","last_change":"2023-10-09T06:30:25.009515+0000","last_active":"2023-10-09T06:30:25.009576+0000","last_peered":"2023-10-09T06:30:25.009576+0000","last_clean":"2023-10-09T06:30:25.009576+0000","last_became_active":"2023-10-09T06:30:25.009183+0000","last_became_peered":"2023-10-09T06:30:25.009183+0000","last_unstale":"2023-10-09T06:30:25.009576+0000","last_undegraded":"2023-10-09T06:30:25.009576+0000","last_fullsized":"2023-10-09T06:30:25.009576+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:51:15.693796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T06:30:23.991547+0000","last_change":"2023-10-09T06:30:23.991475+0000","last_active":"2023-10-09T06:30:23.991547+0000","last_peered":"2023-10-09T06:30:23.991547+0000","last_clean":"2023-10-09T06:30:23.991547+0000","last_became_active":"2023-10-09T06:30:23.991035+0000","last_became_peered":"2023-10-09T06:30:23.991035+0000","last_unstale":"2023-10-09T06:30:23.991547+0000","last_undegraded":"2023-10-09T06:30:23.991547+0000","last_fullsized":"2023-10-09T06:30:23.991547+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:05:43.330742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008421+0000","last_change":"2023-10-09T06:30:25.008421+0000","last_active":"2023-10-09T06:30:25.008421+0000","last_peered":"2023-10-09T06:30:25.008421+0000","last_clean":"2023-10-09T06:30:25.008421+0000","last_became_active":"2023-10-09T06:30:25.007993+0000","last_became_peered":"2023-10-09T06:30:25.007993+0000","last_unstale":"2023-10-09T06:30:25.008421+0000","last_undegraded":"2023-10-09T06:30:25.008421+0000","last_fullsized":"2023-10-09T06:30:25.008421+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:38:08.170516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"167'3","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.018540+0000","last_change":"2023-10-09T06:30:23.988091+0000","last_active":"2023-10-09T06:30:25.018540+0000","last_peered":"2023-10-09T06:30:25.018540+0000","last_clean":"2023-10-09T06:30:25.018540+0000","last_became_active":"2023-10-09T06:30:23.987327+0000","last_became_peered":"2023-10-09T06:30:23.987327+0000","last_unstale":"2023-10-09T06:30:25.018540+0000","last_undegraded":"2023-10-09T06:30:25.018540+0000","last_fullsized":"2023-10-09T06:30:25.018540+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:06.710483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":291,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.999843+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:30:24.999843+0000","last_peered":"2023-10-09T06:30:24.999843+0000","last_clean":"2023-10-09T06:30:24.999843+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:30:24.999843+0000","last_undegraded":"2023-10-09T06:30:24.999843+0000","last_fullsized":"2023-10-09T06:30:24.999843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1493,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193818,"statfs":{"total":200000000,"available":198470464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.52100000000000002},"min":{"1min":0.38500000000000001,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":0.79600000000000004,"15min":1.5469999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54700000000000004,"15min":0.53700000000000003},"min":{"1min":0.41799999999999998,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.75600000000000001,"5min":0.81100000000000005,"15min":3.6970000000000001},"last":0.46300000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.52100000000000002},"min":{"1min":0.311,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70199999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.54800000000000004,"15min":0.52400000000000002},"min":{"1min":0.45800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":1.4870000000000001},"last":0.44800000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.51500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.81899999999999995,"15min":2.6139999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":2.6019999999999999},"last":0.41399999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56699999999999995,"15min":0.58599999999999997},"min":{"1min":0.45200000000000001,"5min":0.33600000000000002,"15min":0.318},"max":{"1min":0.751,"5min":0.84399999999999997,"15min":7.4729999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.374,"15min":0.32400000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":7.8390000000000004},"last":0.40100000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.23799999999999999},"max":{"1min":0.76400000000000001,"5min":0.83099999999999996,"15min":0.872},"last":0.378},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50600000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.27000000000000002,"15min":0.25600000000000001},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.86099999999999999},"last":0.52700000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.36099999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.73299999999999998,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.38,"5min":0.32600000000000001,"15min":0.30599999999999999},"max":{"1min":0.73699999999999999,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.503}]},{"osd":6,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80700000000000005,"5min":0.88400000000000001,"15min":0.93999999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.438,"5min":0.34799999999999998,"15min":0.29199999999999998},"max":{"1min":0.79400000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":916,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194395,"statfs":{"total":200000000,"available":199061310,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54800000000000004,"15min":0.68799999999999994},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":7.0960000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.41999999999999998,"5min":0.35199999999999998,"15min":0.31},"max":{"1min":0.69999999999999996,"5min":0.80900000000000005,"15min":1.133},"last":0.64900000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.84399999999999997,"15min":1.155},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.52800000000000002,"5min":0.378,"15min":0.317},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.1459999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56299999999999994,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.69199999999999995,"5min":0.82999999999999996,"15min":1.2290000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.70399999999999996},"min":{"1min":0.379,"5min":0.36299999999999999,"15min":0.308},"max":{"1min":0.80100000000000005,"5min":0.89100000000000001,"15min":7.1299999999999999},"last":0.62}]},{"osd":3,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.85599999999999998,"15min":1.337},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55500000000000005,"15min":0.57499999999999996},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.206},"last":0.52000000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.315,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53700000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.443},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.34499999999999997,"15min":0.312},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46100000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47799999999999998,"15min":0.47599999999999998},"min":{"1min":0.35499999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.70499999999999996,"5min":0.71999999999999997,"15min":0.80000000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.65800000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.501}]},{"osd":7,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.68700000000000006,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63400000000000001,"5min":0.77900000000000003,"15min":0.82399999999999995},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":917,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194395,"statfs":{"total":200000000,"available":199060902,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.254,"5min":0.223,"15min":0.219},"max":{"1min":0.495,"5min":0.58999999999999997,"15min":0.64000000000000001},"last":0.313},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.379,"15min":0.35299999999999998},"min":{"1min":0.26900000000000002,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.93300000000000005},"last":0.29499999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.59699999999999998,"5min":0.71399999999999997,"15min":0.82299999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.42799999999999999,"15min":0.40100000000000002},"min":{"1min":0.33100000000000002,"5min":0.255,"15min":0.247},"max":{"1min":0.63700000000000001,"5min":0.65500000000000003,"15min":0.70899999999999996},"last":0.435}]},{"osd":3,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46700000000000003,"15min":0.434},"min":{"1min":0.38500000000000001,"5min":0.32300000000000001,"15min":0.29199999999999998},"max":{"1min":0.67900000000000005,"5min":0.751,"15min":0.751},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.442,"15min":0.435},"min":{"1min":0.33000000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.90500000000000003},"last":0.34300000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58799999999999997,"15min":0.57399999999999995},"min":{"1min":0.48199999999999998,"5min":0.35699999999999998,"15min":0.315},"max":{"1min":0.91200000000000003,"5min":0.95699999999999996,"15min":1.097},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61699999999999999,"15min":0.74099999999999999},"min":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":5.5270000000000001},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64700000000000002,"15min":0.63600000000000001},"min":{"1min":0.47299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.125},"last":0.629},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.995,"5min":1,"15min":1.4219999999999999},"last":0.53500000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65400000000000003,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0629999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.38500000000000001},"max":{"1min":0.873,"5min":0.93600000000000005,"15min":1.49},"last":0.48999999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.52900000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":1.016,"15min":1.016},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.504,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0409999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1488,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193824,"statfs":{"total":200000000,"available":198475806,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.36299999999999999,"15min":0.39600000000000002},"min":{"1min":0.26200000000000001,"5min":0.216,"15min":0.20599999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":1.226},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40300000000000002,"15min":0.41699999999999998},"min":{"1min":0.30199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.78200000000000003,"5min":0.82999999999999996,"15min":1.131},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40100000000000002,"15min":0.77800000000000002},"min":{"1min":0.34699999999999998,"5min":0.28199999999999997,"15min":0.25800000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":12.929},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.30499999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.751,"5min":0.751,"15min":1.1599999999999999},"last":0.40500000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.46999999999999997},"min":{"1min":0.38400000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.69699999999999995,"5min":0.78100000000000003,"15min":1.1859999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.45500000000000002,"15min":0.47599999999999998},"min":{"1min":0.39700000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":1.3089999999999999},"last":0.41599999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.58099999999999996,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.93200000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.56200000000000006,"5min":0.41999999999999998,"15min":0.41099999999999998},"max":{"1min":0.90100000000000002,"5min":0.97099999999999997,"15min":1.335},"last":0.72799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.56499999999999995,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.0580000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.51700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.999},"last":0.61399999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.52600000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.56499999999999995,"5min":0.374,"15min":0.374},"max":{"1min":1.032,"5min":1.032,"15min":1.2849999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.67000000000000004,"15min":0.67500000000000004},"min":{"1min":0.54900000000000004,"5min":0.40500000000000003,"15min":0.40400000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.262},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.61699999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.103},"last":0.65700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":918,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194394,"statfs":{"total":200000000,"available":199059850,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.69099999999999995},"min":{"1min":0.21099999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.49099999999999999,"5min":0.65000000000000002,"15min":14.981999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.56899999999999995},"min":{"1min":0.29499999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":9.1600000000000001},"last":0.25700000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.35999999999999999,"15min":0.53500000000000003},"min":{"1min":0.25900000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.50700000000000001,"5min":0.68000000000000005,"15min":8.4930000000000003},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.60399999999999998},"min":{"1min":0.30099999999999999,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":0.57199999999999995,"5min":0.91400000000000003,"15min":9.0239999999999991},"last":0.29799999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.61299999999999999},"min":{"1min":0.375,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61699999999999999,"5min":0.70299999999999996,"15min":8.5190000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44800000000000001,"15min":0.76400000000000001},"min":{"1min":0.34399999999999997,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.64500000000000002,"5min":0.748,"15min":15.007999999999999},"last":0.378}]},{"osd":4,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63800000000000001,"15min":0.96099999999999997},"min":{"1min":0.42599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91900000000000004,"5min":0.95299999999999996,"15min":14.917999999999999},"last":0.872},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65800000000000003,"15min":0.82899999999999996},"min":{"1min":0.46400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90400000000000003,"5min":1.1160000000000001,"15min":8.9930000000000003},"last":0.88}]},{"osd":5,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.81000000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.84399999999999997,"5min":0.94599999999999995,"15min":8.9610000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66700000000000004,"15min":0.81999999999999995},"min":{"1min":0.47499999999999998,"5min":0.35999999999999999,"15min":0.35099999999999998},"max":{"1min":0.96499999999999997,"5min":1.03,"15min":8.3919999999999995},"last":0.71199999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65200000000000002,"15min":0.80700000000000005},"min":{"1min":0.502,"5min":0.42499999999999999,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.97299999999999998,"15min":8.4339999999999993},"last":0.754},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67500000000000004,"15min":0.96999999999999997},"min":{"1min":0.52100000000000002,"5min":0.44400000000000001,"15min":0.374},"max":{"1min":0.98699999999999999,"5min":1.028,"15min":14.954000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64700000000000002,"15min":0.80000000000000004},"min":{"1min":0.44600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":8.9160000000000004},"last":0.625},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66100000000000003,"15min":0.81599999999999995},"min":{"1min":0.45600000000000002,"5min":0.42399999999999999,"15min":0.39200000000000002},"max":{"1min":0.88800000000000001,"5min":1.0609999999999999,"15min":8.4640000000000004},"last":0.77700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574967,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":910,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194402,"statfs":{"total":200000000,"available":199067654,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.34899999999999998},"min":{"1min":0.27700000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53200000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.442,"15min":0.40100000000000002},"min":{"1min":0.35399999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.61399999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.34499999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.34499999999999997},"min":{"1min":0.28999999999999998,"5min":0.24299999999999999,"15min":0.215},"max":{"1min":0.54100000000000004,"5min":0.623,"15min":0.623},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.437,"15min":0.38100000000000001},"min":{"1min":0.32900000000000001,"5min":0.25700000000000001,"15min":0.23699999999999999},"max":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40400000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.38},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.56699999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.498,"15min":0.44700000000000001},"min":{"1min":0.36599999999999999,"5min":0.32600000000000001,"15min":0.28399999999999997},"max":{"1min":0.64500000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.44500000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.375},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64700000000000002,"15min":0.59299999999999997},"min":{"1min":0.51800000000000002,"5min":0.38800000000000001,"15min":0.33400000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.73999999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66900000000000004,"15min":0.63600000000000001},"min":{"1min":0.56699999999999995,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.93899999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.68799999999999994,"15min":0.63800000000000001},"min":{"1min":0.49299999999999999,"5min":0.43099999999999999,"15min":0.38500000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.84999999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.60799999999999998},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.92400000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.69699999999999995,"15min":0.63700000000000001},"min":{"1min":0.628,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.68400000000000005,"15min":0.62},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.38800000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.69399999999999995,"15min":0.63600000000000001},"min":{"1min":0.60399999999999998,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.629}]}]},{"osd":4,"up_from":13,"seq":55834574967,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":916,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194395,"statfs":{"total":200000000,"available":199061456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.41299999999999998,"5min":0.36099999999999999,"15min":0.29299999999999998},"max":{"1min":0.68500000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.45200000000000001,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.66500000000000004,"5min":0.76800000000000002,"15min":0.78600000000000003},"last":0.47699999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.52400000000000002},"min":{"1min":0.48499999999999999,"5min":0.33000000000000002,"15min":0.254},"max":{"1min":0.747,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.5},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54800000000000004,"15min":0.65300000000000002},"min":{"1min":0.46700000000000003,"5min":0.38500000000000001,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":4.3250000000000002},"last":0.45900000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54800000000000004,"15min":0.64700000000000002},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.313},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":4.7320000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56499999999999995,"15min":0.89200000000000002},"min":{"1min":0.42499999999999999,"5min":0.36399999999999999,"15min":0.32600000000000001},"max":{"1min":0.70399999999999996,"5min":0.78200000000000003,"15min":11.715},"last":0.53800000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.55500000000000005,"15min":0.54000000000000004},"min":{"1min":0.49299999999999999,"5min":0.35199999999999998,"15min":0.34899999999999998},"max":{"1min":0.72899999999999998,"5min":0.754,"15min":0.79100000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.53300000000000003,"5min":0.438,"15min":0.39000000000000001},"max":{"1min":0.77300000000000002,"5min":0.79700000000000004,"15min":0.85599999999999998},"last":0.60799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46800000000000003,"15min":0.48399999999999999},"min":{"1min":0.28499999999999998,"5min":0.27200000000000002,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47299999999999998,"15min":0.505},"min":{"1min":0.317,"5min":0.253,"15min":0.253},"max":{"1min":0.66500000000000004,"5min":0.77300000000000002,"15min":0.82799999999999996},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.86699999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.34499999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67800000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63}]},{"osd":7,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52000000000000002,"15min":0.52800000000000002},"min":{"1min":0.38200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68400000000000005,"5min":0.81599999999999995,"15min":0.879},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.75900000000000001,"5min":0.83399999999999996,"15min":0.88600000000000001},"last":0.64500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":916,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194395,"statfs":{"total":200000000,"available":199061434,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.35599999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.79200000000000004,"5min":0.85399999999999998,"15min":1.0289999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.81899999999999995},"last":0.72899999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.53000000000000003},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.82399999999999995,"15min":1.093},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.53600000000000003},"min":{"1min":0.40500000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82199999999999995,"5min":0.83399999999999996,"15min":0.85499999999999998},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54600000000000004,"15min":0.52400000000000002},"min":{"1min":0.436,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.68799999999999994,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.47799999999999998,"5min":0.376,"15min":0.36299999999999999},"max":{"1min":0.749,"5min":0.84199999999999997,"15min":0.89300000000000002},"last":0.71399999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.56599999999999995},"min":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.35299999999999998},"max":{"1min":0.78200000000000003,"5min":0.83699999999999997,"15min":0.98699999999999999},"last":0.624},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60799999999999998,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76300000000000001,"5min":0.81299999999999994,"15min":1.071},"last":0.69799999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47499999999999998,"15min":0.48799999999999999},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":0.73899999999999999,"15min":0.84399999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.71699999999999997,"5min":0.78000000000000003,"15min":0.81000000000000005},"last":0.65400000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.497,"15min":0.51900000000000002},"min":{"1min":0.33400000000000002,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.58899999999999997,"5min":0.73999999999999999,"15min":1.0680000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.82799999999999996,"15min":1.0920000000000001},"last":0.754}]},{"osd":7,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.54200000000000004},"min":{"1min":0.36199999999999999,"5min":0.317,"15min":0.30399999999999999},"max":{"1min":0.67200000000000004,"5min":0.81000000000000005,"15min":0.91900000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.32600000000000001},"max":{"1min":0.61599999999999999,"5min":0.84399999999999997,"15min":1.0269999999999999},"last":0.74099999999999999}]}]}],"pool_statfs":[]}} 2023-10-09T06:30:29.117 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:30:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.264+0000 7febf17a6700 1 Processor -- start 2023-10-09T06:30:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.264+0000 7febf17a6700 1 -- start start 2023-10-09T06:30:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.265+0000 7febf17a6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7febec1523e0 0x7febec06c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.265+0000 7febf17a6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec158e50 0x7febec0cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.265+0000 7febf17a6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec06c010 con 0x7febec152010 2023-10-09T06:30:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.265+0000 7febf17a6700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec06bd10 con 0x7febec1523e0 2023-10-09T06:30:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.265+0000 7febf17a6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec15c060 con 0x7febec158e50 2023-10-09T06:30:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.265+0000 7febeaffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7febec152010 0x7febec15b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43220/0 (socket says 172.21.15.31:43220) 2023-10-09T06:30:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.265+0000 7febeaffd700 1 -- 172.21.15.31:0/966880990 learned_addr learned my addr 172.21.15.31:0/966880990 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.265+0000 7febeb7fe700 1 --2- 172.21.15.31:0/966880990 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec158e50 0x7febec0cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.265+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737359543 0 0) 0x7febec06c010 con 0x7febec152010 2023-10-09T06:30:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.265+0000 7febea7fc700 1 --2- 172.21.15.31:0/966880990 >> v2:172.21.15.158:3300/0 conn(0x7febec1523e0 0x7febec06c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.265+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd8003570 con 0x7febec152010 2023-10-09T06:30:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3289287091 0 0) 0x7febd8003570 con 0x7febec152010 2023-10-09T06:30:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec158e50 msgr2=0x7febec0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 --2- 172.21.15.31:0/966880990 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec158e50 0x7febec0cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 >> v2:172.21.15.158:3300/0 conn(0x7febec1523e0 msgr2=0x7febec06c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 --2- 172.21.15.31:0/966880990 >> v2:172.21.15.158:3300/0 conn(0x7febec1523e0 0x7febec06c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec15c340 con 0x7febec152010 2023-10-09T06:30:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7febe4001470 con 0x7febec152010 2023-10-09T06:30:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 >> v1:172.21.15.31:6789/0 conn(0x7febec152010 legacy=0x7febec15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 --2- 172.21.15.31:0/966880990 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febd8003a60 0x7febd8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 --2- 172.21.15.31:0/966880990 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec158e50 0x7febd8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 --2- 172.21.15.31:0/966880990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd8004d50 0x7febd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec06bd10 con 0x7febd8004d50 2023-10-09T06:30:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec15c060 con 0x7febd8003a60 2023-10-09T06:30:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd800ba60 con 0x7febec158e50 2023-10-09T06:30:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febeb7fe700 1 --2- 172.21.15.31:0/966880990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd8004d50 0x7febd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febeaffd700 1 --2- 172.21.15.31:0/966880990 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febd8003a60 0x7febd8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febea7fc700 1 --2- 172.21.15.31:0/966880990 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec158e50 0x7febd8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febeb7fe700 1 -- 172.21.15.31:0/966880990 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec158e50 msgr2=0x7febd8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:29.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febeb7fe700 1 --2- 172.21.15.31:0/966880990 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec158e50 0x7febd8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febeb7fe700 1 -- 172.21.15.31:0/966880990 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febd8003a60 msgr2=0x7febd8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:29.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febeb7fe700 1 --2- 172.21.15.31:0/966880990 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febd8003a60 0x7febd8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.266+0000 7febeb7fe700 1 -- 172.21.15.31:0/966880990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8003570 con 0x7febd8004d50 2023-10-09T06:30:29.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.267+0000 7febeb7fe700 1 --2- 172.21.15.31:0/966880990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd8004d50 0x7febd80051c0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7febdc00e210 tx=0x7febdc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff01b333956bdfe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:29.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.267+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc00ea60 con 0x7febd8004d50 2023-10-09T06:30:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.267+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc00f040 con 0x7febd8004d50 2023-10-09T06:30:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.267+0000 7febe9ffb700 1 -- 172.21.15.31:0/966880990 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc00ee10 con 0x7febd8004d50 2023-10-09T06:30:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.267+0000 7febf17a6700 1 -- 172.21.15.31:0/966880990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd8004d50 msgr2=0x7febd80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.267+0000 7febf17a6700 1 --2- 172.21.15.31:0/966880990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd8004d50 0x7febd80051c0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7febdc00e210 tx=0x7febdc00b040 comp rx=0 tx=0).stop 2023-10-09T06:30:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.267+0000 7febeb7fe700 1 -- 172.21.15.31:0/966880990 reap_dead start 2023-10-09T06:30:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.267+0000 7febf17a6700 1 -- 172.21.15.31:0/966880990 shutdown_connections 2023-10-09T06:30:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.267+0000 7febf17a6700 1 -- 172.21.15.31:0/966880990 >> 172.21.15.31:0/966880990 conn(0x7febec069870 msgr2=0x7febec069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.267+0000 7febf17a6700 1 -- 172.21.15.31:0/966880990 shutdown_connections 2023-10-09T06:30:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.267+0000 7febf17a6700 1 -- 172.21.15.31:0/966880990 wait complete. 2023-10-09T06:30:29.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.268+0000 7febf17a6700 1 Processor -- start 2023-10-09T06:30:29.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.269+0000 7febf17a6700 1 -- start start 2023-10-09T06:30:29.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.269+0000 7febf17a6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febec13d320 0x7febec13d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.269+0000 7febf17a6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febec0c7f40 0x7febec0c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.269+0000 7febf17a6700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec0c6990 0x7febec167a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.269+0000 7febf17a6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec0c83b0 con 0x7febec0c7f40 2023-10-09T06:30:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.269+0000 7febf17a6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec0c6ea0 con 0x7febec13d320 2023-10-09T06:30:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.269+0000 7febf17a6700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec0c7180 con 0x7febec0c6990 2023-10-09T06:30:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.269+0000 7febea7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febec0c7f40 0x7febec0c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.269+0000 7febea7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febec0c7f40 0x7febec0c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50796/0 (socket says 172.21.15.31:50796) 2023-10-09T06:30:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.269+0000 7febea7fc700 1 -- 172.21.15.31:0/847672345 learned_addr learned my addr 172.21.15.31:0/847672345 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.269+0000 7febeaffd700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febec13d320 0x7febec13d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febeb7fe700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec0c6990 0x7febec167a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febea7fc700 1 -- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec0c6990 msgr2=0x7febec167a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febea7fc700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec0c6990 0x7febec167a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febea7fc700 1 -- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febec13d320 msgr2=0x7febec13d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febea7fc700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febec13d320 0x7febec13d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febea7fc700 1 -- 172.21.15.31:0/847672345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec0c7460 con 0x7febec0c7f40 2023-10-09T06:30:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febeb7fe700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec0c6990 0x7febec167a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febeaffd700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febec13d320 0x7febec13d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febea7fc700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febec0c7f40 0x7febec0c6450 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7febd4006ac0 tx=0x7febd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febe2ffd700 1 -- 172.21.15.31:0/847672345 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd400fa10 con 0x7febec0c7f40 2023-10-09T06:30:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febe2ffd700 1 -- 172.21.15.31:0/847672345 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd400fb70 con 0x7febec0c7f40 2023-10-09T06:30:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febf17a6700 1 -- 172.21.15.31:0/847672345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec0c7740 con 0x7febec0c7f40 2023-10-09T06:30:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febe2ffd700 1 -- 172.21.15.31:0/847672345 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4014440 con 0x7febec0c7f40 2023-10-09T06:30:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.270+0000 7febf17a6700 1 -- 172.21.15.31:0/847672345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec0c5e60 con 0x7febec0c7f40 2023-10-09T06:30:29.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.271+0000 7febf17a6700 1 -- 172.21.15.31:0/847672345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec04c3c0 con 0x7febec0c7f40 2023-10-09T06:30:29.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.271+0000 7febe2ffd700 1 -- 172.21.15.31:0/847672345 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febd4014830 con 0x7febec0c7f40 2023-10-09T06:30:29.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.272+0000 7febe2ffd700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7febcc066f30 0x7febcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.272+0000 7febe2ffd700 1 -- 172.21.15.31:0/847672345 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7febd4018030 con 0x7febec0c7f40 2023-10-09T06:30:29.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.272+0000 7febeaffd700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7febcc066f30 0x7febcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.272+0000 7febeaffd700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7febcc066f30 0x7febcc0693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7febe4001c40 tx=0x7febe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:29.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.276+0000 7febe2ffd700 1 -- 172.21.15.31:0/847672345 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febd40521d0 con 0x7febec0c7f40 2023-10-09T06:30:29.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.467+0000 7febf17a6700 1 -- 172.21.15.31:0/847672345 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7febec06d1b0 con 0x7febcc066f30 2023-10-09T06:30:29.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.476+0000 7febe2ffd700 1 -- 172.21.15.31:0/847672345 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285233 (secure 0 0 0) 0x7febec06d1b0 con 0x7febcc066f30 2023-10-09T06:30:29.481 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:29.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.480+0000 7febf17a6700 1 -- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7febcc066f30 msgr2=0x7febcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.480+0000 7febf17a6700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7febcc066f30 0x7febcc0693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7febe4001c40 tx=0x7febe4009040 comp rx=0 tx=0).stop 2023-10-09T06:30:29.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.480+0000 7febf17a6700 1 -- 172.21.15.31:0/847672345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febec0c7f40 msgr2=0x7febec0c6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.480+0000 7febf17a6700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febec0c7f40 0x7febec0c6450 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7febd4006ac0 tx=0x7febd40091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.480+0000 7febf17a6700 1 -- 172.21.15.31:0/847672345 shutdown_connections 2023-10-09T06:30:29.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.480+0000 7febf17a6700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7febcc066f30 0x7febcc0693e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.480+0000 7febf17a6700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7febec0c6990 0x7febec167a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.480+0000 7febf17a6700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febec13d320 0x7febec13d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.480+0000 7febf17a6700 1 --2- 172.21.15.31:0/847672345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febec0c7f40 0x7febec0c6450 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.480+0000 7febf17a6700 1 -- 172.21.15.31:0/847672345 >> 172.21.15.31:0/847672345 conn(0x7febec069870 msgr2=0x7febec0ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:29.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.480+0000 7febf17a6700 1 -- 172.21.15.31:0/847672345 shutdown_connections 2023-10-09T06:30:29.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.480+0000 7febf17a6700 1 -- 172.21.15.31:0/847672345 wait complete. 2023-10-09T06:30:29.485 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:30:29.493 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2023-10-09T06:30:28.656104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8477,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554022,"statfs":{"total":1600000000,"available":1591318876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.677629"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.002236+0000","last_change":"2023-10-09T06:30:25.002171+0000","last_active":"2023-10-09T06:30:25.002236+0000","last_peered":"2023-10-09T06:30:25.002236+0000","last_clean":"2023-10-09T06:30:25.002236+0000","last_became_active":"2023-10-09T06:30:25.001953+0000","last_became_peered":"2023-10-09T06:30:25.001953+0000","last_unstale":"2023-10-09T06:30:25.002236+0000","last_undegraded":"2023-10-09T06:30:25.002236+0000","last_fullsized":"2023-10-09T06:30:25.002236+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:30.947032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008415+0000","last_change":"2023-10-09T06:30:25.008415+0000","last_active":"2023-10-09T06:30:25.008415+0000","last_peered":"2023-10-09T06:30:25.008415+0000","last_clean":"2023-10-09T06:30:25.008415+0000","last_became_active":"2023-10-09T06:30:25.008057+0000","last_became_peered":"2023-10-09T06:30:25.008057+0000","last_unstale":"2023-10-09T06:30:25.008415+0000","last_undegraded":"2023-10-09T06:30:25.008415+0000","last_fullsized":"2023-10-09T06:30:25.008415+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:16.528015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005849+0000","last_change":"2023-10-09T06:30:25.005786+0000","last_active":"2023-10-09T06:30:25.005849+0000","last_peered":"2023-10-09T06:30:25.005849+0000","last_clean":"2023-10-09T06:30:25.005849+0000","last_became_active":"2023-10-09T06:30:25.005314+0000","last_became_peered":"2023-10-09T06:30:25.005314+0000","last_unstale":"2023-10-09T06:30:25.005849+0000","last_undegraded":"2023-10-09T06:30:25.005849+0000","last_fullsized":"2023-10-09T06:30:25.005849+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:05:44.334580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.001263+0000","last_change":"2023-10-09T06:30:25.001180+0000","last_active":"2023-10-09T06:30:25.001263+0000","last_peered":"2023-10-09T06:30:25.001263+0000","last_clean":"2023-10-09T06:30:25.001263+0000","last_became_active":"2023-10-09T06:30:25.000506+0000","last_became_peered":"2023-10-09T06:30:25.000506+0000","last_unstale":"2023-10-09T06:30:25.001263+0000","last_undegraded":"2023-10-09T06:30:25.001263+0000","last_fullsized":"2023-10-09T06:30:25.001263+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:35.313823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008187+0000","last_change":"2023-10-09T06:30:25.008062+0000","last_active":"2023-10-09T06:30:25.008187+0000","last_peered":"2023-10-09T06:30:25.008187+0000","last_clean":"2023-10-09T06:30:25.008187+0000","last_became_active":"2023-10-09T06:30:25.007731+0000","last_became_peered":"2023-10-09T06:30:25.007731+0000","last_unstale":"2023-10-09T06:30:25.008187+0000","last_undegraded":"2023-10-09T06:30:25.008187+0000","last_fullsized":"2023-10-09T06:30:25.008187+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:22.042293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004159+0000","last_change":"2023-10-09T06:30:25.003903+0000","last_active":"2023-10-09T06:30:25.004159+0000","last_peered":"2023-10-09T06:30:25.004159+0000","last_clean":"2023-10-09T06:30:25.004159+0000","last_became_active":"2023-10-09T06:30:25.002961+0000","last_became_peered":"2023-10-09T06:30:25.002961+0000","last_unstale":"2023-10-09T06:30:25.004159+0000","last_undegraded":"2023-10-09T06:30:25.004159+0000","last_fullsized":"2023-10-09T06:30:25.004159+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:31:00.237471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.010697+0000","last_change":"2023-10-09T06:30:25.010697+0000","last_active":"2023-10-09T06:30:25.010697+0000","last_peered":"2023-10-09T06:30:25.010697+0000","last_clean":"2023-10-09T06:30:25.010697+0000","last_became_active":"2023-10-09T06:30:25.010469+0000","last_became_peered":"2023-10-09T06:30:25.010469+0000","last_unstale":"2023-10-09T06:30:25.010697+0000","last_undegraded":"2023-10-09T06:30:25.010697+0000","last_fullsized":"2023-10-09T06:30:25.010697+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:51.080595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.010150+0000","last_change":"2023-10-09T06:30:25.010085+0000","last_active":"2023-10-09T06:30:25.010150+0000","last_peered":"2023-10-09T06:30:25.010150+0000","last_clean":"2023-10-09T06:30:25.010150+0000","last_became_active":"2023-10-09T06:30:25.009855+0000","last_became_peered":"2023-10-09T06:30:25.009855+0000","last_unstale":"2023-10-09T06:30:25.010150+0000","last_undegraded":"2023-10-09T06:30:25.010150+0000","last_fullsized":"2023-10-09T06:30:25.010150+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:38.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.002317+0000","last_change":"2023-10-09T06:30:25.002317+0000","last_active":"2023-10-09T06:30:25.002317+0000","last_peered":"2023-10-09T06:30:25.002317+0000","last_clean":"2023-10-09T06:30:25.002317+0000","last_became_active":"2023-10-09T06:30:25.002095+0000","last_became_peered":"2023-10-09T06:30:25.002095+0000","last_unstale":"2023-10-09T06:30:25.002317+0000","last_undegraded":"2023-10-09T06:30:25.002317+0000","last_fullsized":"2023-10-09T06:30:25.002317+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:41.330399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.002547+0000","last_change":"2023-10-09T06:30:25.002486+0000","last_active":"2023-10-09T06:30:25.002547+0000","last_peered":"2023-10-09T06:30:25.002547+0000","last_clean":"2023-10-09T06:30:25.002547+0000","last_became_active":"2023-10-09T06:30:25.002262+0000","last_became_peered":"2023-10-09T06:30:25.002262+0000","last_unstale":"2023-10-09T06:30:25.002547+0000","last_undegraded":"2023-10-09T06:30:25.002547+0000","last_fullsized":"2023-10-09T06:30:25.002547+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:36:56.464910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.010747+0000","last_change":"2023-10-09T06:30:25.010682+0000","last_active":"2023-10-09T06:30:25.010747+0000","last_peered":"2023-10-09T06:30:25.010747+0000","last_clean":"2023-10-09T06:30:25.010747+0000","last_became_active":"2023-10-09T06:30:25.010420+0000","last_became_peered":"2023-10-09T06:30:25.010420+0000","last_unstale":"2023-10-09T06:30:25.010747+0000","last_undegraded":"2023-10-09T06:30:25.010747+0000","last_fullsized":"2023-10-09T06:30:25.010747+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:22.042293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.013340+0000","last_change":"2023-10-09T06:30:25.012961+0000","last_active":"2023-10-09T06:30:25.013340+0000","last_peered":"2023-10-09T06:30:25.013340+0000","last_clean":"2023-10-09T06:30:25.013340+0000","last_became_active":"2023-10-09T06:30:25.012604+0000","last_became_peered":"2023-10-09T06:30:25.012604+0000","last_unstale":"2023-10-09T06:30:25.013340+0000","last_undegraded":"2023-10-09T06:30:25.013340+0000","last_fullsized":"2023-10-09T06:30:25.013340+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:45.751574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.013687+0000","last_change":"2023-10-09T06:30:25.013630+0000","last_active":"2023-10-09T06:30:25.013687+0000","last_peered":"2023-10-09T06:30:25.013687+0000","last_clean":"2023-10-09T06:30:25.013687+0000","last_became_active":"2023-10-09T06:30:25.013178+0000","last_became_peered":"2023-10-09T06:30:25.013178+0000","last_unstale":"2023-10-09T06:30:25.013687+0000","last_undegraded":"2023-10-09T06:30:25.013687+0000","last_fullsized":"2023-10-09T06:30:25.013687+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:04.243187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003477+0000","last_change":"2023-10-09T06:30:25.003327+0000","last_active":"2023-10-09T06:30:25.003477+0000","last_peered":"2023-10-09T06:30:25.003477+0000","last_clean":"2023-10-09T06:30:25.003477+0000","last_became_active":"2023-10-09T06:30:25.002879+0000","last_became_peered":"2023-10-09T06:30:25.002879+0000","last_unstale":"2023-10-09T06:30:25.003477+0000","last_undegraded":"2023-10-09T06:30:25.003477+0000","last_fullsized":"2023-10-09T06:30:25.003477+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:05:44.334580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003543+0000","last_change":"2023-10-09T06:30:25.003466+0000","last_active":"2023-10-09T06:30:25.003543+0000","last_peered":"2023-10-09T06:30:25.003543+0000","last_clean":"2023-10-09T06:30:25.003543+0000","last_became_active":"2023-10-09T06:30:25.003232+0000","last_became_peered":"2023-10-09T06:30:25.003232+0000","last_unstale":"2023-10-09T06:30:25.003543+0000","last_undegraded":"2023-10-09T06:30:25.003543+0000","last_fullsized":"2023-10-09T06:30:25.003543+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:28.978001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005878+0000","last_change":"2023-10-09T06:30:25.005778+0000","last_active":"2023-10-09T06:30:25.005878+0000","last_peered":"2023-10-09T06:30:25.005878+0000","last_clean":"2023-10-09T06:30:25.005878+0000","last_became_active":"2023-10-09T06:30:25.005554+0000","last_became_peered":"2023-10-09T06:30:25.005554+0000","last_unstale":"2023-10-09T06:30:25.005878+0000","last_undegraded":"2023-10-09T06:30:25.005878+0000","last_fullsized":"2023-10-09T06:30:25.005878+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:11:15.192154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.013322+0000","last_change":"2023-10-09T06:30:25.012809+0000","last_active":"2023-10-09T06:30:25.013322+0000","last_peered":"2023-10-09T06:30:25.013322+0000","last_clean":"2023-10-09T06:30:25.013322+0000","last_became_active":"2023-10-09T06:30:25.012306+0000","last_became_peered":"2023-10-09T06:30:25.012306+0000","last_unstale":"2023-10-09T06:30:25.013322+0000","last_undegraded":"2023-10-09T06:30:25.013322+0000","last_fullsized":"2023-10-09T06:30:25.013322+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:02.061891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.006223+0000","last_change":"2023-10-09T06:30:25.005955+0000","last_active":"2023-10-09T06:30:25.006223+0000","last_peered":"2023-10-09T06:30:25.006223+0000","last_clean":"2023-10-09T06:30:25.006223+0000","last_became_active":"2023-10-09T06:30:25.005558+0000","last_became_peered":"2023-10-09T06:30:25.005558+0000","last_unstale":"2023-10-09T06:30:25.006223+0000","last_undegraded":"2023-10-09T06:30:25.006223+0000","last_fullsized":"2023-10-09T06:30:25.006223+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:16.501201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004141+0000","last_change":"2023-10-09T06:30:25.003568+0000","last_active":"2023-10-09T06:30:25.004141+0000","last_peered":"2023-10-09T06:30:25.004141+0000","last_clean":"2023-10-09T06:30:25.004141+0000","last_became_active":"2023-10-09T06:30:25.003200+0000","last_became_peered":"2023-10-09T06:30:25.003200+0000","last_unstale":"2023-10-09T06:30:25.004141+0000","last_undegraded":"2023-10-09T06:30:25.004141+0000","last_fullsized":"2023-10-09T06:30:25.004141+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:40:06.561425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004126+0000","last_change":"2023-10-09T06:30:25.003392+0000","last_active":"2023-10-09T06:30:25.004126+0000","last_peered":"2023-10-09T06:30:25.004126+0000","last_clean":"2023-10-09T06:30:25.004126+0000","last_became_active":"2023-10-09T06:30:25.003025+0000","last_became_peered":"2023-10-09T06:30:25.003025+0000","last_unstale":"2023-10-09T06:30:25.004126+0000","last_undegraded":"2023-10-09T06:30:25.004126+0000","last_fullsized":"2023-10-09T06:30:25.004126+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:35:45.471474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004998+0000","last_change":"2023-10-09T06:30:25.004936+0000","last_active":"2023-10-09T06:30:25.004998+0000","last_peered":"2023-10-09T06:30:25.004998+0000","last_clean":"2023-10-09T06:30:25.004998+0000","last_became_active":"2023-10-09T06:30:25.004718+0000","last_became_peered":"2023-10-09T06:30:25.004718+0000","last_unstale":"2023-10-09T06:30:25.004998+0000","last_undegraded":"2023-10-09T06:30:25.004998+0000","last_fullsized":"2023-10-09T06:30:25.004998+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:28.624141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003406+0000","last_change":"2023-10-09T06:30:25.002932+0000","last_active":"2023-10-09T06:30:25.003406+0000","last_peered":"2023-10-09T06:30:25.003406+0000","last_clean":"2023-10-09T06:30:25.003406+0000","last_became_active":"2023-10-09T06:30:25.001913+0000","last_became_peered":"2023-10-09T06:30:25.001913+0000","last_unstale":"2023-10-09T06:30:25.003406+0000","last_undegraded":"2023-10-09T06:30:25.003406+0000","last_fullsized":"2023-10-09T06:30:25.003406+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:53.286248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.009603+0000","last_change":"2023-10-09T06:30:25.009251+0000","last_active":"2023-10-09T06:30:25.009603+0000","last_peered":"2023-10-09T06:30:25.009603+0000","last_clean":"2023-10-09T06:30:25.009603+0000","last_became_active":"2023-10-09T06:30:25.008975+0000","last_became_peered":"2023-10-09T06:30:25.008975+0000","last_unstale":"2023-10-09T06:30:25.009603+0000","last_undegraded":"2023-10-09T06:30:25.009603+0000","last_fullsized":"2023-10-09T06:30:25.009603+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:16:10.411380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003526+0000","last_change":"2023-10-09T06:30:25.003412+0000","last_active":"2023-10-09T06:30:25.003526+0000","last_peered":"2023-10-09T06:30:25.003526+0000","last_clean":"2023-10-09T06:30:25.003526+0000","last_became_active":"2023-10-09T06:30:25.003188+0000","last_became_peered":"2023-10-09T06:30:25.003188+0000","last_unstale":"2023-10-09T06:30:25.003526+0000","last_undegraded":"2023-10-09T06:30:25.003526+0000","last_fullsized":"2023-10-09T06:30:25.003526+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:56.924537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004108+0000","last_change":"2023-10-09T06:30:25.003248+0000","last_active":"2023-10-09T06:30:25.004108+0000","last_peered":"2023-10-09T06:30:25.004108+0000","last_clean":"2023-10-09T06:30:25.004108+0000","last_became_active":"2023-10-09T06:30:25.002714+0000","last_became_peered":"2023-10-09T06:30:25.002714+0000","last_unstale":"2023-10-09T06:30:25.004108+0000","last_undegraded":"2023-10-09T06:30:25.004108+0000","last_fullsized":"2023-10-09T06:30:25.004108+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:55:32.998556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004174+0000","last_change":"2023-10-09T06:30:25.004067+0000","last_active":"2023-10-09T06:30:25.004174+0000","last_peered":"2023-10-09T06:30:25.004174+0000","last_clean":"2023-10-09T06:30:25.004174+0000","last_became_active":"2023-10-09T06:30:25.003690+0000","last_became_peered":"2023-10-09T06:30:25.003690+0000","last_unstale":"2023-10-09T06:30:25.004174+0000","last_undegraded":"2023-10-09T06:30:25.004174+0000","last_fullsized":"2023-10-09T06:30:25.004174+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:50.817916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004143+0000","last_change":"2023-10-09T06:30:25.004017+0000","last_active":"2023-10-09T06:30:25.004143+0000","last_peered":"2023-10-09T06:30:25.004143+0000","last_clean":"2023-10-09T06:30:25.004143+0000","last_became_active":"2023-10-09T06:30:25.003801+0000","last_became_peered":"2023-10-09T06:30:25.003801+0000","last_unstale":"2023-10-09T06:30:25.004143+0000","last_undegraded":"2023-10-09T06:30:25.004143+0000","last_fullsized":"2023-10-09T06:30:25.004143+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:41.102911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008856+0000","last_change":"2023-10-09T06:30:25.008856+0000","last_active":"2023-10-09T06:30:25.008856+0000","last_peered":"2023-10-09T06:30:25.008856+0000","last_clean":"2023-10-09T06:30:25.008856+0000","last_became_active":"2023-10-09T06:30:25.008486+0000","last_became_peered":"2023-10-09T06:30:25.008486+0000","last_unstale":"2023-10-09T06:30:25.008856+0000","last_undegraded":"2023-10-09T06:30:25.008856+0000","last_fullsized":"2023-10-09T06:30:25.008856+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:55:27.261832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.004728+0000","last_change":"2023-10-09T06:30:25.004638+0000","last_active":"2023-10-09T06:30:25.004728+0000","last_peered":"2023-10-09T06:30:25.004728+0000","last_clean":"2023-10-09T06:30:25.004728+0000","last_became_active":"2023-10-09T06:30:25.004086+0000","last_became_peered":"2023-10-09T06:30:25.004086+0000","last_unstale":"2023-10-09T06:30:25.004728+0000","last_undegraded":"2023-10-09T06:30:25.004728+0000","last_fullsized":"2023-10-09T06:30:25.004728+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:51:15.693796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003460+0000","last_change":"2023-10-09T06:30:25.003176+0000","last_active":"2023-10-09T06:30:25.003460+0000","last_peered":"2023-10-09T06:30:25.003460+0000","last_clean":"2023-10-09T06:30:25.003460+0000","last_became_active":"2023-10-09T06:30:25.002811+0000","last_became_peered":"2023-10-09T06:30:25.002811+0000","last_unstale":"2023-10-09T06:30:25.003460+0000","last_undegraded":"2023-10-09T06:30:25.003460+0000","last_fullsized":"2023-10-09T06:30:25.003460+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:22.744819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.000535+0000","last_change":"2023-10-09T06:30:25.000535+0000","last_active":"2023-10-09T06:30:25.000535+0000","last_peered":"2023-10-09T06:30:25.000535+0000","last_clean":"2023-10-09T06:30:25.000535+0000","last_became_active":"2023-10-09T06:30:25.000297+0000","last_became_peered":"2023-10-09T06:30:25.000297+0000","last_unstale":"2023-10-09T06:30:25.000535+0000","last_undegraded":"2023-10-09T06:30:25.000535+0000","last_fullsized":"2023-10-09T06:30:25.000535+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:30.467994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.009125+0000","last_change":"2023-10-09T06:30:25.009073+0000","last_active":"2023-10-09T06:30:25.009125+0000","last_peered":"2023-10-09T06:30:25.009125+0000","last_clean":"2023-10-09T06:30:25.009125+0000","last_became_active":"2023-10-09T06:30:25.008800+0000","last_became_peered":"2023-10-09T06:30:25.008800+0000","last_unstale":"2023-10-09T06:30:25.009125+0000","last_undegraded":"2023-10-09T06:30:25.009125+0000","last_fullsized":"2023-10-09T06:30:25.009125+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:56:17.105011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.011774+0000","last_change":"2023-10-09T06:30:25.010918+0000","last_active":"2023-10-09T06:30:25.011774+0000","last_peered":"2023-10-09T06:30:25.011774+0000","last_clean":"2023-10-09T06:30:25.011774+0000","last_became_active":"2023-10-09T06:30:25.010696+0000","last_became_peered":"2023-10-09T06:30:25.010696+0000","last_unstale":"2023-10-09T06:30:25.011774+0000","last_undegraded":"2023-10-09T06:30:25.011774+0000","last_fullsized":"2023-10-09T06:30:25.011774+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:52.720292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"167'4","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017788+0000","last_change":"2023-10-09T06:30:23.985929+0000","last_active":"2023-10-09T06:30:25.017788+0000","last_peered":"2023-10-09T06:30:25.017788+0000","last_clean":"2023-10-09T06:30:25.017788+0000","last_became_active":"2023-10-09T06:30:23.985651+0000","last_became_peered":"2023-10-09T06:30:23.985651+0000","last_unstale":"2023-10-09T06:30:25.017788+0000","last_undegraded":"2023-10-09T06:30:25.017788+0000","last_fullsized":"2023-10-09T06:30:25.017788+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:37:46.880510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.009033+0000","last_change":"2023-10-09T06:30:25.009033+0000","last_active":"2023-10-09T06:30:25.009033+0000","last_peered":"2023-10-09T06:30:25.009033+0000","last_clean":"2023-10-09T06:30:25.009033+0000","last_became_active":"2023-10-09T06:30:25.008876+0000","last_became_peered":"2023-10-09T06:30:25.008876+0000","last_unstale":"2023-10-09T06:30:25.009033+0000","last_undegraded":"2023-10-09T06:30:25.009033+0000","last_fullsized":"2023-10-09T06:30:25.009033+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:29:45.086531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.999200+0000","last_change":"2023-10-09T06:30:23.991298+0000","last_active":"2023-10-09T06:30:24.999200+0000","last_peered":"2023-10-09T06:30:24.999200+0000","last_clean":"2023-10-09T06:30:24.999200+0000","last_became_active":"2023-10-09T06:30:23.990688+0000","last_became_peered":"2023-10-09T06:30:23.990688+0000","last_unstale":"2023-10-09T06:30:24.999200+0000","last_undegraded":"2023-10-09T06:30:24.999200+0000","last_fullsized":"2023-10-09T06:30:24.999200+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:06:05.629590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005929+0000","last_change":"2023-10-09T06:30:25.005220+0000","last_active":"2023-10-09T06:30:25.005929+0000","last_peered":"2023-10-09T06:30:25.005929+0000","last_clean":"2023-10-09T06:30:25.005929+0000","last_became_active":"2023-10-09T06:30:25.004962+0000","last_became_peered":"2023-10-09T06:30:25.004962+0000","last_unstale":"2023-10-09T06:30:25.005929+0000","last_undegraded":"2023-10-09T06:30:25.005929+0000","last_fullsized":"2023-10-09T06:30:25.005929+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:07.714322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.018655+0000","last_change":"2023-10-09T06:30:23.993048+0000","last_active":"2023-10-09T06:30:25.018655+0000","last_peered":"2023-10-09T06:30:25.018655+0000","last_clean":"2023-10-09T06:30:25.018655+0000","last_became_active":"2023-10-09T06:30:23.992790+0000","last_became_peered":"2023-10-09T06:30:23.992790+0000","last_unstale":"2023-10-09T06:30:25.018655+0000","last_undegraded":"2023-10-09T06:30:25.018655+0000","last_fullsized":"2023-10-09T06:30:25.018655+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:37.182380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.011797+0000","last_change":"2023-10-09T06:30:25.011364+0000","last_active":"2023-10-09T06:30:25.011797+0000","last_peered":"2023-10-09T06:30:25.011797+0000","last_clean":"2023-10-09T06:30:25.011797+0000","last_became_active":"2023-10-09T06:30:25.011036+0000","last_became_peered":"2023-10-09T06:30:25.011036+0000","last_unstale":"2023-10-09T06:30:25.011797+0000","last_undegraded":"2023-10-09T06:30:25.011797+0000","last_fullsized":"2023-10-09T06:30:25.011797+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:55.725345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017960+0000","last_change":"2023-10-09T06:30:23.985173+0000","last_active":"2023-10-09T06:30:25.017960+0000","last_peered":"2023-10-09T06:30:25.017960+0000","last_clean":"2023-10-09T06:30:25.017960+0000","last_became_active":"2023-10-09T06:30:23.984873+0000","last_became_peered":"2023-10-09T06:30:23.984873+0000","last_unstale":"2023-10-09T06:30:25.017960+0000","last_undegraded":"2023-10-09T06:30:25.017960+0000","last_fullsized":"2023-10-09T06:30:25.017960+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:06.710483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005143+0000","last_change":"2023-10-09T06:30:25.005143+0000","last_active":"2023-10-09T06:30:25.005143+0000","last_peered":"2023-10-09T06:30:25.005143+0000","last_clean":"2023-10-09T06:30:25.005143+0000","last_became_active":"2023-10-09T06:30:25.004914+0000","last_became_peered":"2023-10-09T06:30:25.004914+0000","last_unstale":"2023-10-09T06:30:25.005143+0000","last_undegraded":"2023-10-09T06:30:25.005143+0000","last_fullsized":"2023-10-09T06:30:25.005143+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:37:47.884349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.018567+0000","last_change":"2023-10-09T06:30:23.994348+0000","last_active":"2023-10-09T06:30:25.018567+0000","last_peered":"2023-10-09T06:30:25.018567+0000","last_clean":"2023-10-09T06:30:25.018567+0000","last_became_active":"2023-10-09T06:30:23.993763+0000","last_became_peered":"2023-10-09T06:30:23.993763+0000","last_unstale":"2023-10-09T06:30:25.018567+0000","last_undegraded":"2023-10-09T06:30:25.018567+0000","last_fullsized":"2023-10-09T06:30:25.018567+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:15.497090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003426+0000","last_change":"2023-10-09T06:30:25.003090+0000","last_active":"2023-10-09T06:30:25.003426+0000","last_peered":"2023-10-09T06:30:25.003426+0000","last_clean":"2023-10-09T06:30:25.003426+0000","last_became_active":"2023-10-09T06:30:25.002318+0000","last_became_peered":"2023-10-09T06:30:25.002318+0000","last_unstale":"2023-10-09T06:30:25.003426+0000","last_undegraded":"2023-10-09T06:30:25.003426+0000","last_fullsized":"2023-10-09T06:30:25.003426+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:16.501201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017274+0000","last_change":"2023-10-09T06:30:23.992003+0000","last_active":"2023-10-09T06:30:25.017274+0000","last_peered":"2023-10-09T06:30:25.017274+0000","last_clean":"2023-10-09T06:30:25.017274+0000","last_became_active":"2023-10-09T06:30:23.991746+0000","last_became_peered":"2023-10-09T06:30:23.991746+0000","last_unstale":"2023-10-09T06:30:25.017274+0000","last_undegraded":"2023-10-09T06:30:25.017274+0000","last_fullsized":"2023-10-09T06:30:25.017274+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:53:13.106188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.009895+0000","last_change":"2023-10-09T06:30:25.009895+0000","last_active":"2023-10-09T06:30:25.009895+0000","last_peered":"2023-10-09T06:30:25.009895+0000","last_clean":"2023-10-09T06:30:25.009895+0000","last_became_active":"2023-10-09T06:30:25.009680+0000","last_became_peered":"2023-10-09T06:30:25.009680+0000","last_unstale":"2023-10-09T06:30:25.009895+0000","last_undegraded":"2023-10-09T06:30:25.009895+0000","last_fullsized":"2023-10-09T06:30:25.009895+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:01.065011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.998801+0000","last_change":"2023-10-09T06:30:23.989940+0000","last_active":"2023-10-09T06:30:24.998801+0000","last_peered":"2023-10-09T06:30:24.998801+0000","last_clean":"2023-10-09T06:30:24.998801+0000","last_became_active":"2023-10-09T06:30:23.989695+0000","last_became_peered":"2023-10-09T06:30:23.989695+0000","last_unstale":"2023-10-09T06:30:24.998801+0000","last_undegraded":"2023-10-09T06:30:24.998801+0000","last_fullsized":"2023-10-09T06:30:24.998801+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:45.608000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.010259+0000","last_change":"2023-10-09T06:30:25.010165+0000","last_active":"2023-10-09T06:30:25.010259+0000","last_peered":"2023-10-09T06:30:25.010259+0000","last_clean":"2023-10-09T06:30:25.010259+0000","last_became_active":"2023-10-09T06:30:25.009949+0000","last_became_peered":"2023-10-09T06:30:25.009949+0000","last_unstale":"2023-10-09T06:30:25.010259+0000","last_undegraded":"2023-10-09T06:30:25.010259+0000","last_fullsized":"2023-10-09T06:30:25.010259+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:38.186219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.997568+0000","last_change":"2023-10-09T06:30:23.990154+0000","last_active":"2023-10-09T06:30:24.997568+0000","last_peered":"2023-10-09T06:30:24.997568+0000","last_clean":"2023-10-09T06:30:24.997568+0000","last_became_active":"2023-10-09T06:30:23.989924+0000","last_became_peered":"2023-10-09T06:30:23.989924+0000","last_unstale":"2023-10-09T06:30:24.997568+0000","last_undegraded":"2023-10-09T06:30:24.997568+0000","last_fullsized":"2023-10-09T06:30:24.997568+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:21.038454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008742+0000","last_change":"2023-10-09T06:30:25.008365+0000","last_active":"2023-10-09T06:30:25.008742+0000","last_peered":"2023-10-09T06:30:25.008742+0000","last_clean":"2023-10-09T06:30:25.008742+0000","last_became_active":"2023-10-09T06:30:25.008125+0000","last_became_peered":"2023-10-09T06:30:25.008125+0000","last_unstale":"2023-10-09T06:30:25.008742+0000","last_undegraded":"2023-10-09T06:30:25.008742+0000","last_fullsized":"2023-10-09T06:30:25.008742+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:30.947032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T06:30:23.989254+0000","last_change":"2023-10-09T06:30:23.989052+0000","last_active":"2023-10-09T06:30:23.989254+0000","last_peered":"2023-10-09T06:30:23.989254+0000","last_clean":"2023-10-09T06:30:23.989254+0000","last_became_active":"2023-10-09T06:30:23.988821+0000","last_became_peered":"2023-10-09T06:30:23.988821+0000","last_unstale":"2023-10-09T06:30:23.989254+0000","last_undegraded":"2023-10-09T06:30:23.989254+0000","last_fullsized":"2023-10-09T06:30:23.989254+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:34.545116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.010679+0000","last_change":"2023-10-09T06:30:25.010615+0000","last_active":"2023-10-09T06:30:25.010679+0000","last_peered":"2023-10-09T06:30:25.010679+0000","last_clean":"2023-10-09T06:30:25.010679+0000","last_became_active":"2023-10-09T06:30:25.010374+0000","last_became_peered":"2023-10-09T06:30:25.010374+0000","last_unstale":"2023-10-09T06:30:25.010679+0000","last_undegraded":"2023-10-09T06:30:25.010679+0000","last_fullsized":"2023-10-09T06:30:25.010679+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:18:50.201556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.998649+0000","last_change":"2023-10-09T06:30:23.991566+0000","last_active":"2023-10-09T06:30:24.998649+0000","last_peered":"2023-10-09T06:30:24.998649+0000","last_clean":"2023-10-09T06:30:24.998649+0000","last_became_active":"2023-10-09T06:30:23.990842+0000","last_became_peered":"2023-10-09T06:30:23.990842+0000","last_unstale":"2023-10-09T06:30:24.998649+0000","last_undegraded":"2023-10-09T06:30:24.998649+0000","last_fullsized":"2023-10-09T06:30:24.998649+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:00.061172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.010183+0000","last_change":"2023-10-09T06:30:25.009600+0000","last_active":"2023-10-09T06:30:25.010183+0000","last_peered":"2023-10-09T06:30:25.010183+0000","last_clean":"2023-10-09T06:30:25.010183+0000","last_became_active":"2023-10-09T06:30:25.009277+0000","last_became_peered":"2023-10-09T06:30:25.009277+0000","last_unstale":"2023-10-09T06:30:25.010183+0000","last_undegraded":"2023-10-09T06:30:25.010183+0000","last_fullsized":"2023-10-09T06:30:25.010183+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:23.164478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"167'6","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.018398+0000","last_change":"2023-10-09T06:30:23.994875+0000","last_active":"2023-10-09T06:30:25.018398+0000","last_peered":"2023-10-09T06:30:25.018398+0000","last_clean":"2023-10-09T06:30:25.018398+0000","last_became_active":"2023-10-09T06:30:23.994638+0000","last_became_peered":"2023-10-09T06:30:23.994638+0000","last_unstale":"2023-10-09T06:30:25.018398+0000","last_undegraded":"2023-10-09T06:30:25.018398+0000","last_fullsized":"2023-10-09T06:30:25.018398+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:26.884295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005150+0000","last_change":"2023-10-09T06:30:25.005021+0000","last_active":"2023-10-09T06:30:25.005150+0000","last_peered":"2023-10-09T06:30:25.005150+0000","last_clean":"2023-10-09T06:30:25.005150+0000","last_became_active":"2023-10-09T06:30:25.004670+0000","last_became_peered":"2023-10-09T06:30:25.004670+0000","last_unstale":"2023-10-09T06:30:25.005150+0000","last_undegraded":"2023-10-09T06:30:25.005150+0000","last_fullsized":"2023-10-09T06:30:25.005150+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:22.744819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017357+0000","last_change":"2023-10-09T06:30:23.992397+0000","last_active":"2023-10-09T06:30:25.017357+0000","last_peered":"2023-10-09T06:30:25.017357+0000","last_clean":"2023-10-09T06:30:25.017357+0000","last_became_active":"2023-10-09T06:30:23.992172+0000","last_became_peered":"2023-10-09T06:30:23.992172+0000","last_unstale":"2023-10-09T06:30:25.017357+0000","last_undegraded":"2023-10-09T06:30:25.017357+0000","last_fullsized":"2023-10-09T06:30:25.017357+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:59.816440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008372+0000","last_change":"2023-10-09T06:30:25.008372+0000","last_active":"2023-10-09T06:30:25.008372+0000","last_peered":"2023-10-09T06:30:25.008372+0000","last_clean":"2023-10-09T06:30:25.008372+0000","last_became_active":"2023-10-09T06:30:25.008181+0000","last_became_peered":"2023-10-09T06:30:25.008181+0000","last_unstale":"2023-10-09T06:30:25.008372+0000","last_undegraded":"2023-10-09T06:30:25.008372+0000","last_fullsized":"2023-10-09T06:30:25.008372+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:08:53.370514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.996470+0000","last_change":"2023-10-09T06:30:23.989327+0000","last_active":"2023-10-09T06:30:24.996470+0000","last_peered":"2023-10-09T06:30:24.996470+0000","last_clean":"2023-10-09T06:30:24.996470+0000","last_became_active":"2023-10-09T06:30:23.988942+0000","last_became_peered":"2023-10-09T06:30:23.988942+0000","last_unstale":"2023-10-09T06:30:24.996470+0000","last_undegraded":"2023-10-09T06:30:24.996470+0000","last_fullsized":"2023-10-09T06:30:24.996470+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:37.182380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.013568+0000","last_change":"2023-10-09T06:30:25.013506+0000","last_active":"2023-10-09T06:30:25.013568+0000","last_peered":"2023-10-09T06:30:25.013568+0000","last_clean":"2023-10-09T06:30:25.013568+0000","last_became_active":"2023-10-09T06:30:25.012879+0000","last_became_peered":"2023-10-09T06:30:25.012879+0000","last_unstale":"2023-10-09T06:30:25.013568+0000","last_undegraded":"2023-10-09T06:30:25.013568+0000","last_fullsized":"2023-10-09T06:30:25.013568+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:31:00.237471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.998403+0000","last_change":"2023-10-09T06:30:23.992624+0000","last_active":"2023-10-09T06:30:24.998403+0000","last_peered":"2023-10-09T06:30:24.998403+0000","last_clean":"2023-10-09T06:30:24.998403+0000","last_became_active":"2023-10-09T06:30:23.992453+0000","last_became_peered":"2023-10-09T06:30:23.992453+0000","last_unstale":"2023-10-09T06:30:24.998403+0000","last_undegraded":"2023-10-09T06:30:24.998403+0000","last_fullsized":"2023-10-09T06:30:24.998403+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:40.099072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003043+0000","last_change":"2023-10-09T06:30:25.002795+0000","last_active":"2023-10-09T06:30:25.003043+0000","last_peered":"2023-10-09T06:30:25.003043+0000","last_clean":"2023-10-09T06:30:25.003043+0000","last_became_active":"2023-10-09T06:30:25.002533+0000","last_became_peered":"2023-10-09T06:30:25.002533+0000","last_unstale":"2023-10-09T06:30:25.003043+0000","last_undegraded":"2023-10-09T06:30:25.003043+0000","last_fullsized":"2023-10-09T06:30:25.003043+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:35.313823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"167'8","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.019761+0000","last_change":"2023-10-09T06:30:23.992980+0000","last_active":"2023-10-09T06:30:25.019761+0000","last_peered":"2023-10-09T06:30:25.019761+0000","last_clean":"2023-10-09T06:30:25.019761+0000","last_became_active":"2023-10-09T06:30:23.992663+0000","last_became_peered":"2023-10-09T06:30:23.992663+0000","last_unstale":"2023-10-09T06:30:25.019761+0000","last_undegraded":"2023-10-09T06:30:25.019761+0000","last_fullsized":"2023-10-09T06:30:25.019761+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:37:59.055511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.001173+0000","last_change":"2023-10-09T06:30:25.001090+0000","last_active":"2023-10-09T06:30:25.001173+0000","last_peered":"2023-10-09T06:30:25.001173+0000","last_clean":"2023-10-09T06:30:25.001173+0000","last_became_active":"2023-10-09T06:30:25.000860+0000","last_became_peered":"2023-10-09T06:30:25.000860+0000","last_unstale":"2023-10-09T06:30:25.001173+0000","last_undegraded":"2023-10-09T06:30:25.001173+0000","last_fullsized":"2023-10-09T06:30:25.001173+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:13.069696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017558+0000","last_change":"2023-10-09T06:30:23.989109+0000","last_active":"2023-10-09T06:30:25.017558+0000","last_peered":"2023-10-09T06:30:25.017558+0000","last_clean":"2023-10-09T06:30:25.017558+0000","last_became_active":"2023-10-09T06:30:23.988477+0000","last_became_peered":"2023-10-09T06:30:23.988477+0000","last_unstale":"2023-10-09T06:30:25.017558+0000","last_undegraded":"2023-10-09T06:30:25.017558+0000","last_fullsized":"2023-10-09T06:30:25.017558+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:11:14.188315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003172+0000","last_change":"2023-10-09T06:30:25.003108+0000","last_active":"2023-10-09T06:30:25.003172+0000","last_peered":"2023-10-09T06:30:25.003172+0000","last_clean":"2023-10-09T06:30:25.003172+0000","last_became_active":"2023-10-09T06:30:25.002687+0000","last_became_peered":"2023-10-09T06:30:25.002687+0000","last_unstale":"2023-10-09T06:30:25.003172+0000","last_undegraded":"2023-10-09T06:30:25.003172+0000","last_fullsized":"2023-10-09T06:30:25.003172+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:53:14.110027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017043+0000","last_change":"2023-10-09T06:30:23.988960+0000","last_active":"2023-10-09T06:30:25.017043+0000","last_peered":"2023-10-09T06:30:25.017043+0000","last_clean":"2023-10-09T06:30:25.017043+0000","last_became_active":"2023-10-09T06:30:23.988721+0000","last_became_peered":"2023-10-09T06:30:23.988721+0000","last_unstale":"2023-10-09T06:30:25.017043+0000","last_undegraded":"2023-10-09T06:30:25.017043+0000","last_fullsized":"2023-10-09T06:30:25.017043+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:15.497362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.001483+0000","last_change":"2023-10-09T06:30:25.001422+0000","last_active":"2023-10-09T06:30:25.001483+0000","last_peered":"2023-10-09T06:30:25.001483+0000","last_clean":"2023-10-09T06:30:25.001483+0000","last_became_active":"2023-10-09T06:30:25.001187+0000","last_became_peered":"2023-10-09T06:30:25.001187+0000","last_unstale":"2023-10-09T06:30:25.001483+0000","last_undegraded":"2023-10-09T06:30:25.001483+0000","last_fullsized":"2023-10-09T06:30:25.001483+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:16:10.411380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.017176+0000","last_change":"2023-10-09T06:30:23.986859+0000","last_active":"2023-10-09T06:30:25.017176+0000","last_peered":"2023-10-09T06:30:25.017176+0000","last_clean":"2023-10-09T06:30:25.017176+0000","last_became_active":"2023-10-09T06:30:23.986291+0000","last_became_peered":"2023-10-09T06:30:23.986291+0000","last_unstale":"2023-10-09T06:30:25.017176+0000","last_undegraded":"2023-10-09T06:30:25.017176+0000","last_fullsized":"2023-10-09T06:30:25.017176+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:21:31.878680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005945+0000","last_change":"2023-10-09T06:30:25.005700+0000","last_active":"2023-10-09T06:30:25.005945+0000","last_peered":"2023-10-09T06:30:25.005945+0000","last_clean":"2023-10-09T06:30:25.005945+0000","last_became_active":"2023-10-09T06:30:25.005442+0000","last_became_peered":"2023-10-09T06:30:25.005442+0000","last_unstale":"2023-10-09T06:30:25.005945+0000","last_undegraded":"2023-10-09T06:30:25.005945+0000","last_fullsized":"2023-10-09T06:30:25.005945+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:00.820279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T06:30:23.990740+0000","last_change":"2023-10-09T06:30:23.990676+0000","last_active":"2023-10-09T06:30:23.990740+0000","last_peered":"2023-10-09T06:30:23.990740+0000","last_clean":"2023-10-09T06:30:23.990740+0000","last_became_active":"2023-10-09T06:30:23.990485+0000","last_became_peered":"2023-10-09T06:30:23.990485+0000","last_unstale":"2023-10-09T06:30:23.990740+0000","last_undegraded":"2023-10-09T06:30:23.990740+0000","last_fullsized":"2023-10-09T06:30:23.990740+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:16:09.407541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003442+0000","last_change":"2023-10-09T06:30:25.003153+0000","last_active":"2023-10-09T06:30:25.003442+0000","last_peered":"2023-10-09T06:30:25.003442+0000","last_clean":"2023-10-09T06:30:25.003442+0000","last_became_active":"2023-10-09T06:30:25.002555+0000","last_became_peered":"2023-10-09T06:30:25.002555+0000","last_unstale":"2023-10-09T06:30:25.003442+0000","last_undegraded":"2023-10-09T06:30:25.003442+0000","last_fullsized":"2023-10-09T06:30:25.003442+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:06:06.633428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.018300+0000","last_change":"2023-10-09T06:30:23.994935+0000","last_active":"2023-10-09T06:30:25.018300+0000","last_peered":"2023-10-09T06:30:25.018300+0000","last_clean":"2023-10-09T06:30:25.018300+0000","last_became_active":"2023-10-09T06:30:23.994684+0000","last_became_peered":"2023-10-09T06:30:23.994684+0000","last_unstale":"2023-10-09T06:30:25.018300+0000","last_undegraded":"2023-10-09T06:30:25.018300+0000","last_fullsized":"2023-10-09T06:30:25.018300+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:53.091899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008717+0000","last_change":"2023-10-09T06:30:25.008717+0000","last_active":"2023-10-09T06:30:25.008717+0000","last_peered":"2023-10-09T06:30:25.008717+0000","last_clean":"2023-10-09T06:30:25.008717+0000","last_became_active":"2023-10-09T06:30:25.008016+0000","last_became_peered":"2023-10-09T06:30:25.008016+0000","last_unstale":"2023-10-09T06:30:25.008717+0000","last_undegraded":"2023-10-09T06:30:25.008717+0000","last_fullsized":"2023-10-09T06:30:25.008717+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:49.516567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.999760+0000","last_change":"2023-10-09T06:30:23.993977+0000","last_active":"2023-10-09T06:30:24.999760+0000","last_peered":"2023-10-09T06:30:24.999760+0000","last_clean":"2023-10-09T06:30:24.999760+0000","last_became_active":"2023-10-09T06:30:23.993683+0000","last_became_peered":"2023-10-09T06:30:23.993683+0000","last_unstale":"2023-10-09T06:30:24.999760+0000","last_undegraded":"2023-10-09T06:30:24.999760+0000","last_fullsized":"2023-10-09T06:30:24.999760+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:40.326560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.009581+0000","last_change":"2023-10-09T06:30:25.008769+0000","last_active":"2023-10-09T06:30:25.009581+0000","last_peered":"2023-10-09T06:30:25.009581+0000","last_clean":"2023-10-09T06:30:25.009581+0000","last_became_active":"2023-10-09T06:30:25.008510+0000","last_became_peered":"2023-10-09T06:30:25.008510+0000","last_unstale":"2023-10-09T06:30:25.009581+0000","last_undegraded":"2023-10-09T06:30:25.009581+0000","last_fullsized":"2023-10-09T06:30:25.009581+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:55.007506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.999186+0000","last_change":"2023-10-09T06:30:23.993097+0000","last_active":"2023-10-09T06:30:24.999186+0000","last_peered":"2023-10-09T06:30:24.999186+0000","last_clean":"2023-10-09T06:30:24.999186+0000","last_became_active":"2023-10-09T06:30:23.992462+0000","last_became_peered":"2023-10-09T06:30:23.992462+0000","last_unstale":"2023-10-09T06:30:24.999186+0000","last_undegraded":"2023-10-09T06:30:24.999186+0000","last_fullsized":"2023-10-09T06:30:24.999186+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:08:52.366676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.012635+0000","last_change":"2023-10-09T06:30:25.012635+0000","last_active":"2023-10-09T06:30:25.012635+0000","last_peered":"2023-10-09T06:30:25.012635+0000","last_clean":"2023-10-09T06:30:25.012635+0000","last_became_active":"2023-10-09T06:30:25.012398+0000","last_became_peered":"2023-10-09T06:30:25.012398+0000","last_unstale":"2023-10-09T06:30:25.012635+0000","last_undegraded":"2023-10-09T06:30:25.012635+0000","last_fullsized":"2023-10-09T06:30:25.012635+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:06.937555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.996565+0000","last_change":"2023-10-09T06:30:23.989165+0000","last_active":"2023-10-09T06:30:24.996565+0000","last_peered":"2023-10-09T06:30:24.996565+0000","last_clean":"2023-10-09T06:30:24.996565+0000","last_became_active":"2023-10-09T06:30:23.988575+0000","last_became_peered":"2023-10-09T06:30:23.988575+0000","last_unstale":"2023-10-09T06:30:24.996565+0000","last_undegraded":"2023-10-09T06:30:24.996565+0000","last_fullsized":"2023-10-09T06:30:24.996565+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:29.943194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.013433+0000","last_change":"2023-10-09T06:30:25.013365+0000","last_active":"2023-10-09T06:30:25.013433+0000","last_peered":"2023-10-09T06:30:25.013433+0000","last_clean":"2023-10-09T06:30:25.013433+0000","last_became_active":"2023-10-09T06:30:25.012548+0000","last_became_peered":"2023-10-09T06:30:25.012548+0000","last_unstale":"2023-10-09T06:30:25.013433+0000","last_undegraded":"2023-10-09T06:30:25.013433+0000","last_fullsized":"2023-10-09T06:30:25.013433+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:07.714322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.018365+0000","last_change":"2023-10-09T06:30:23.993528+0000","last_active":"2023-10-09T06:30:25.018365+0000","last_peered":"2023-10-09T06:30:25.018365+0000","last_clean":"2023-10-09T06:30:25.018365+0000","last_became_active":"2023-10-09T06:30:23.992339+0000","last_became_peered":"2023-10-09T06:30:23.992339+0000","last_unstale":"2023-10-09T06:30:25.018365+0000","last_undegraded":"2023-10-09T06:30:25.018365+0000","last_fullsized":"2023-10-09T06:30:25.018365+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:10.620838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.000689+0000","last_change":"2023-10-09T06:30:25.000621+0000","last_active":"2023-10-09T06:30:25.000689+0000","last_peered":"2023-10-09T06:30:25.000689+0000","last_clean":"2023-10-09T06:30:25.000689+0000","last_became_active":"2023-10-09T06:30:25.000358+0000","last_became_peered":"2023-10-09T06:30:25.000358+0000","last_unstale":"2023-10-09T06:30:25.000689+0000","last_undegraded":"2023-10-09T06:30:25.000689+0000","last_fullsized":"2023-10-09T06:30:25.000689+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:53.286248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.998666+0000","last_change":"2023-10-09T06:30:23.990183+0000","last_active":"2023-10-09T06:30:24.998666+0000","last_peered":"2023-10-09T06:30:24.998666+0000","last_clean":"2023-10-09T06:30:24.998666+0000","last_became_active":"2023-10-09T06:30:23.989939+0000","last_became_peered":"2023-10-09T06:30:23.989939+0000","last_unstale":"2023-10-09T06:30:24.998666+0000","last_undegraded":"2023-10-09T06:30:24.998666+0000","last_fullsized":"2023-10-09T06:30:24.998666+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:56:16.101172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.003697+0000","last_change":"2023-10-09T06:30:25.003697+0000","last_active":"2023-10-09T06:30:25.003697+0000","last_peered":"2023-10-09T06:30:25.003697+0000","last_clean":"2023-10-09T06:30:25.003697+0000","last_became_active":"2023-10-09T06:30:25.003326+0000","last_became_peered":"2023-10-09T06:30:25.003326+0000","last_unstale":"2023-10-09T06:30:25.003697+0000","last_undegraded":"2023-10-09T06:30:25.003697+0000","last_fullsized":"2023-10-09T06:30:25.003697+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:54.095738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.999683+0000","last_change":"2023-10-09T06:30:23.993784+0000","last_active":"2023-10-09T06:30:24.999683+0000","last_peered":"2023-10-09T06:30:24.999683+0000","last_clean":"2023-10-09T06:30:24.999683+0000","last_became_active":"2023-10-09T06:30:23.993567+0000","last_became_peered":"2023-10-09T06:30:23.993567+0000","last_unstale":"2023-10-09T06:30:24.999683+0000","last_undegraded":"2023-10-09T06:30:24.999683+0000","last_fullsized":"2023-10-09T06:30:24.999683+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:35:44.467635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005912+0000","last_change":"2023-10-09T06:30:25.004790+0000","last_active":"2023-10-09T06:30:25.005912+0000","last_peered":"2023-10-09T06:30:25.005912+0000","last_clean":"2023-10-09T06:30:25.005912+0000","last_became_active":"2023-10-09T06:30:25.004424+0000","last_became_peered":"2023-10-09T06:30:25.004424+0000","last_unstale":"2023-10-09T06:30:25.005912+0000","last_undegraded":"2023-10-09T06:30:25.005912+0000","last_fullsized":"2023-10-09T06:30:25.005912+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:04.243187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.998012+0000","last_change":"2023-10-09T06:30:23.995383+0000","last_active":"2023-10-09T06:30:24.998012+0000","last_peered":"2023-10-09T06:30:24.998012+0000","last_clean":"2023-10-09T06:30:24.998012+0000","last_became_active":"2023-10-09T06:30:23.995142+0000","last_became_peered":"2023-10-09T06:30:23.995142+0000","last_unstale":"2023-10-09T06:30:24.998012+0000","last_undegraded":"2023-10-09T06:30:24.998012+0000","last_fullsized":"2023-10-09T06:30:24.998012+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:55:31.994717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.005281+0000","last_change":"2023-10-09T06:30:25.005217+0000","last_active":"2023-10-09T06:30:25.005281+0000","last_peered":"2023-10-09T06:30:25.005281+0000","last_clean":"2023-10-09T06:30:25.005281+0000","last_became_active":"2023-10-09T06:30:25.004959+0000","last_became_peered":"2023-10-09T06:30:25.004959+0000","last_unstale":"2023-10-09T06:30:25.005281+0000","last_undegraded":"2023-10-09T06:30:25.005281+0000","last_fullsized":"2023-10-09T06:30:25.005281+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:36.546784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T06:30:23.992074+0000","last_change":"2023-10-09T06:30:23.992004+0000","last_active":"2023-10-09T06:30:23.992074+0000","last_peered":"2023-10-09T06:30:23.992074+0000","last_clean":"2023-10-09T06:30:23.992074+0000","last_became_active":"2023-10-09T06:30:23.991792+0000","last_became_peered":"2023-10-09T06:30:23.991792+0000","last_unstale":"2023-10-09T06:30:23.992074+0000","last_undegraded":"2023-10-09T06:30:23.992074+0000","last_fullsized":"2023-10-09T06:30:23.992074+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:15.524176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008777+0000","last_change":"2023-10-09T06:30:25.008425+0000","last_active":"2023-10-09T06:30:25.008777+0000","last_peered":"2023-10-09T06:30:25.008777+0000","last_clean":"2023-10-09T06:30:25.008777+0000","last_became_active":"2023-10-09T06:30:25.007999+0000","last_became_peered":"2023-10-09T06:30:25.007999+0000","last_unstale":"2023-10-09T06:30:25.008777+0000","last_undegraded":"2023-10-09T06:30:25.008777+0000","last_fullsized":"2023-10-09T06:30:25.008777+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:00.820279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.998836+0000","last_change":"2023-10-09T06:30:23.993701+0000","last_active":"2023-10-09T06:30:24.998836+0000","last_peered":"2023-10-09T06:30:24.998836+0000","last_clean":"2023-10-09T06:30:24.998836+0000","last_became_active":"2023-10-09T06:30:23.993315+0000","last_became_peered":"2023-10-09T06:30:23.993315+0000","last_unstale":"2023-10-09T06:30:24.998836+0000","last_undegraded":"2023-10-09T06:30:24.998836+0000","last_fullsized":"2023-10-09T06:30:24.998836+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:15.524176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.001784+0000","last_change":"2023-10-09T06:30:25.001722+0000","last_active":"2023-10-09T06:30:25.001784+0000","last_peered":"2023-10-09T06:30:25.001784+0000","last_clean":"2023-10-09T06:30:25.001784+0000","last_became_active":"2023-10-09T06:30:25.001492+0000","last_became_peered":"2023-10-09T06:30:25.001492+0000","last_unstale":"2023-10-09T06:30:25.001784+0000","last_undegraded":"2023-10-09T06:30:25.001784+0000","last_fullsized":"2023-10-09T06:30:25.001784+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:40.403667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.999749+0000","last_change":"2023-10-09T06:30:23.992533+0000","last_active":"2023-10-09T06:30:24.999749+0000","last_peered":"2023-10-09T06:30:24.999749+0000","last_clean":"2023-10-09T06:30:24.999749+0000","last_became_active":"2023-10-09T06:30:23.992270+0000","last_became_peered":"2023-10-09T06:30:23.992270+0000","last_unstale":"2023-10-09T06:30:24.999749+0000","last_undegraded":"2023-10-09T06:30:24.999749+0000","last_fullsized":"2023-10-09T06:30:24.999749+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:59.233633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.009576+0000","last_change":"2023-10-09T06:30:25.009515+0000","last_active":"2023-10-09T06:30:25.009576+0000","last_peered":"2023-10-09T06:30:25.009576+0000","last_clean":"2023-10-09T06:30:25.009576+0000","last_became_active":"2023-10-09T06:30:25.009183+0000","last_became_peered":"2023-10-09T06:30:25.009183+0000","last_unstale":"2023-10-09T06:30:25.009576+0000","last_undegraded":"2023-10-09T06:30:25.009576+0000","last_fullsized":"2023-10-09T06:30:25.009576+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:51:15.693796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T06:30:23.991547+0000","last_change":"2023-10-09T06:30:23.991475+0000","last_active":"2023-10-09T06:30:23.991547+0000","last_peered":"2023-10-09T06:30:23.991547+0000","last_clean":"2023-10-09T06:30:23.991547+0000","last_became_active":"2023-10-09T06:30:23.991035+0000","last_became_peered":"2023-10-09T06:30:23.991035+0000","last_unstale":"2023-10-09T06:30:23.991547+0000","last_undegraded":"2023-10-09T06:30:23.991547+0000","last_fullsized":"2023-10-09T06:30:23.991547+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:05:43.330742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.008421+0000","last_change":"2023-10-09T06:30:25.008421+0000","last_active":"2023-10-09T06:30:25.008421+0000","last_peered":"2023-10-09T06:30:25.008421+0000","last_clean":"2023-10-09T06:30:25.008421+0000","last_became_active":"2023-10-09T06:30:25.007993+0000","last_became_peered":"2023-10-09T06:30:25.007993+0000","last_unstale":"2023-10-09T06:30:25.008421+0000","last_undegraded":"2023-10-09T06:30:25.008421+0000","last_fullsized":"2023-10-09T06:30:25.008421+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:23.977779+0000","last_clean_scrub_stamp":"2023-10-09T06:30:23.977779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:38:08.170516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"167'3","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:25.018540+0000","last_change":"2023-10-09T06:30:23.988091+0000","last_active":"2023-10-09T06:30:25.018540+0000","last_peered":"2023-10-09T06:30:25.018540+0000","last_clean":"2023-10-09T06:30:25.018540+0000","last_became_active":"2023-10-09T06:30:23.987327+0000","last_became_peered":"2023-10-09T06:30:23.987327+0000","last_unstale":"2023-10-09T06:30:25.018540+0000","last_undegraded":"2023-10-09T06:30:25.018540+0000","last_fullsized":"2023-10-09T06:30:25.018540+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:30:22.973940+0000","last_clean_scrub_stamp":"2023-10-09T06:30:22.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:06.710483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":291,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T06:30:24.999843+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:30:24.999843+0000","last_peered":"2023-10-09T06:30:24.999843+0000","last_clean":"2023-10-09T06:30:24.999843+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:30:24.999843+0000","last_undegraded":"2023-10-09T06:30:24.999843+0000","last_fullsized":"2023-10-09T06:30:24.999843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1493,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193818,"statfs":{"total":200000000,"available":198470464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.52100000000000002},"min":{"1min":0.38500000000000001,"5min":0.311,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":0.79600000000000004,"15min":1.5469999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54700000000000004,"15min":0.53700000000000003},"min":{"1min":0.41799999999999998,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.75600000000000001,"5min":0.81100000000000005,"15min":3.6970000000000001},"last":0.46300000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.52100000000000002},"min":{"1min":0.311,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70199999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.54800000000000004,"15min":0.52400000000000002},"min":{"1min":0.45800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":1.4870000000000001},"last":0.44800000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.51500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.81899999999999995,"15min":2.6139999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":2.6019999999999999},"last":0.41399999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56699999999999995,"15min":0.58599999999999997},"min":{"1min":0.45200000000000001,"5min":0.33600000000000002,"15min":0.318},"max":{"1min":0.751,"5min":0.84399999999999997,"15min":7.4729999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.374,"15min":0.32400000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":7.8390000000000004},"last":0.40100000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.23799999999999999},"max":{"1min":0.76400000000000001,"5min":0.83099999999999996,"15min":0.872},"last":0.378},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50600000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.27000000000000002,"15min":0.25600000000000001},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.86099999999999999},"last":0.52700000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.36099999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.73299999999999998,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.38,"5min":0.32600000000000001,"15min":0.30599999999999999},"max":{"1min":0.73699999999999999,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.503}]},{"osd":6,"last update":"Mon Oct 9 06:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80700000000000005,"5min":0.88400000000000001,"15min":0.93999999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.438,"5min":0.34799999999999998,"15min":0.29199999999999998},"max":{"1min":0.79400000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":916,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194395,"statfs":{"total":200000000,"available":199061310,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54800000000000004,"15min":0.68799999999999994},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":7.0960000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.41999999999999998,"5min":0.35199999999999998,"15min":0.31},"max":{"1min":0.69999999999999996,"5min":0.80900000000000005,"15min":1.133},"last":0.64900000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.84399999999999997,"15min":1.155},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.52800000000000002,"5min":0.378,"15min":0.317},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.1459999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56299999999999994,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":0.69199999999999995,"5min":0.82999999999999996,"15min":1.2290000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.70399999999999996},"min":{"1min":0.379,"5min":0.36299999999999999,"15min":0.308},"max":{"1min":0.80100000000000005,"5min":0.89100000000000001,"15min":7.1299999999999999},"last":0.62}]},{"osd":3,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.85599999999999998,"15min":1.337},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55500000000000005,"15min":0.57499999999999996},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.206},"last":0.52000000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.315,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53700000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.443},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.34499999999999997,"15min":0.312},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46100000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47799999999999998,"15min":0.47599999999999998},"min":{"1min":0.35499999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.70499999999999996,"5min":0.71999999999999997,"15min":0.80000000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.65800000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.501}]},{"osd":7,"last update":"Mon Oct 9 06:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.68700000000000006,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63400000000000001,"5min":0.77900000000000003,"15min":0.82399999999999995},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":917,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194395,"statfs":{"total":200000000,"available":199060902,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.254,"5min":0.223,"15min":0.219},"max":{"1min":0.495,"5min":0.58999999999999997,"15min":0.64000000000000001},"last":0.313},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.379,"15min":0.35299999999999998},"min":{"1min":0.26900000000000002,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.93300000000000005},"last":0.29499999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.59699999999999998,"5min":0.71399999999999997,"15min":0.82299999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.42799999999999999,"15min":0.40100000000000002},"min":{"1min":0.33100000000000002,"5min":0.255,"15min":0.247},"max":{"1min":0.63700000000000001,"5min":0.65500000000000003,"15min":0.70899999999999996},"last":0.435}]},{"osd":3,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46700000000000003,"15min":0.434},"min":{"1min":0.38500000000000001,"5min":0.32300000000000001,"15min":0.29199999999999998},"max":{"1min":0.67900000000000005,"5min":0.751,"15min":0.751},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.442,"15min":0.435},"min":{"1min":0.33000000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.90500000000000003},"last":0.34300000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58799999999999997,"15min":0.57399999999999995},"min":{"1min":0.48199999999999998,"5min":0.35699999999999998,"15min":0.315},"max":{"1min":0.91200000000000003,"5min":0.95699999999999996,"15min":1.097},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61699999999999999,"15min":0.74099999999999999},"min":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":5.5270000000000001},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64700000000000002,"15min":0.63600000000000001},"min":{"1min":0.47299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.125},"last":0.629},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.995,"5min":1,"15min":1.4219999999999999},"last":0.53500000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65400000000000003,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0629999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.38500000000000001},"max":{"1min":0.873,"5min":0.93600000000000005,"15min":1.49},"last":0.48999999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.52900000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":1.016,"15min":1.016},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.504,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0409999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1488,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193824,"statfs":{"total":200000000,"available":198475806,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.36299999999999999,"15min":0.39600000000000002},"min":{"1min":0.26200000000000001,"5min":0.216,"15min":0.20599999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":1.226},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40300000000000002,"15min":0.41699999999999998},"min":{"1min":0.30199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.78200000000000003,"5min":0.82999999999999996,"15min":1.131},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40100000000000002,"15min":0.77800000000000002},"min":{"1min":0.34699999999999998,"5min":0.28199999999999997,"15min":0.25800000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":12.929},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.30499999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.751,"5min":0.751,"15min":1.1599999999999999},"last":0.40500000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.46999999999999997},"min":{"1min":0.38400000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.69699999999999995,"5min":0.78100000000000003,"15min":1.1859999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.45500000000000002,"15min":0.47599999999999998},"min":{"1min":0.39700000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":1.3089999999999999},"last":0.41599999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.58099999999999996,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.93200000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.56200000000000006,"5min":0.41999999999999998,"15min":0.41099999999999998},"max":{"1min":0.90100000000000002,"5min":0.97099999999999997,"15min":1.335},"last":0.72799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.56499999999999995,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.0580000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.51700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.999},"last":0.61399999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.52600000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.56499999999999995,"5min":0.374,"15min":0.374},"max":{"1min":1.032,"5min":1.032,"15min":1.2849999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.67000000000000004,"15min":0.67500000000000004},"min":{"1min":0.54900000000000004,"5min":0.40500000000000003,"15min":0.40400000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.262},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.61699999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.103},"last":0.65700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":918,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194394,"statfs":{"total":200000000,"available":199059850,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.69099999999999995},"min":{"1min":0.21099999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.49099999999999999,"5min":0.65000000000000002,"15min":14.981999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.56899999999999995},"min":{"1min":0.29499999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":9.1600000000000001},"last":0.25700000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.35999999999999999,"15min":0.53500000000000003},"min":{"1min":0.25900000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.50700000000000001,"5min":0.68000000000000005,"15min":8.4930000000000003},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.60399999999999998},"min":{"1min":0.30099999999999999,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":0.57199999999999995,"5min":0.91400000000000003,"15min":9.0239999999999991},"last":0.29799999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.61299999999999999},"min":{"1min":0.375,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61699999999999999,"5min":0.70299999999999996,"15min":8.5190000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44800000000000001,"15min":0.76400000000000001},"min":{"1min":0.34399999999999997,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.64500000000000002,"5min":0.748,"15min":15.007999999999999},"last":0.378}]},{"osd":4,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63800000000000001,"15min":0.96099999999999997},"min":{"1min":0.42599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91900000000000004,"5min":0.95299999999999996,"15min":14.917999999999999},"last":0.872},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65800000000000003,"15min":0.82899999999999996},"min":{"1min":0.46400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90400000000000003,"5min":1.1160000000000001,"15min":8.9930000000000003},"last":0.88}]},{"osd":5,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.81000000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.84399999999999997,"5min":0.94599999999999995,"15min":8.9610000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66700000000000004,"15min":0.81999999999999995},"min":{"1min":0.47499999999999998,"5min":0.35999999999999999,"15min":0.35099999999999998},"max":{"1min":0.96499999999999997,"5min":1.03,"15min":8.3919999999999995},"last":0.71199999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65200000000000002,"15min":0.80700000000000005},"min":{"1min":0.502,"5min":0.42499999999999999,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.97299999999999998,"15min":8.4339999999999993},"last":0.754},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67500000000000004,"15min":0.96999999999999997},"min":{"1min":0.52100000000000002,"5min":0.44400000000000001,"15min":0.374},"max":{"1min":0.98699999999999999,"5min":1.028,"15min":14.954000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64700000000000002,"15min":0.80000000000000004},"min":{"1min":0.44600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":8.9160000000000004},"last":0.625},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66100000000000003,"15min":0.81599999999999995},"min":{"1min":0.45600000000000002,"5min":0.42399999999999999,"15min":0.39200000000000002},"max":{"1min":0.88800000000000001,"5min":1.0609999999999999,"15min":8.4640000000000004},"last":0.77700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574967,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":910,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194402,"statfs":{"total":200000000,"available":199067654,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.34899999999999998},"min":{"1min":0.27700000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53200000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.442,"15min":0.40100000000000002},"min":{"1min":0.35399999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.61399999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.34499999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.34499999999999997},"min":{"1min":0.28999999999999998,"5min":0.24299999999999999,"15min":0.215},"max":{"1min":0.54100000000000004,"5min":0.623,"15min":0.623},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.437,"15min":0.38100000000000001},"min":{"1min":0.32900000000000001,"5min":0.25700000000000001,"15min":0.23699999999999999},"max":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40400000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.38},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.56699999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.498,"15min":0.44700000000000001},"min":{"1min":0.36599999999999999,"5min":0.32600000000000001,"15min":0.28399999999999997},"max":{"1min":0.64500000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.44500000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.375},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64700000000000002,"15min":0.59299999999999997},"min":{"1min":0.51800000000000002,"5min":0.38800000000000001,"15min":0.33400000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.73999999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66900000000000004,"15min":0.63600000000000001},"min":{"1min":0.56699999999999995,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.93899999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.68799999999999994,"15min":0.63800000000000001},"min":{"1min":0.49299999999999999,"5min":0.43099999999999999,"15min":0.38500000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.84999999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.60799999999999998},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.92400000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.69699999999999995,"15min":0.63700000000000001},"min":{"1min":0.628,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.68400000000000005,"15min":0.62},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.38800000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.69399999999999995,"15min":0.63600000000000001},"min":{"1min":0.60399999999999998,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.629}]}]},{"osd":4,"up_from":13,"seq":55834574967,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":916,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194395,"statfs":{"total":200000000,"available":199061456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.41299999999999998,"5min":0.36099999999999999,"15min":0.29299999999999998},"max":{"1min":0.68500000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.45200000000000001,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.66500000000000004,"5min":0.76800000000000002,"15min":0.78600000000000003},"last":0.47699999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.52400000000000002},"min":{"1min":0.48499999999999999,"5min":0.33000000000000002,"15min":0.254},"max":{"1min":0.747,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.5},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54800000000000004,"15min":0.65300000000000002},"min":{"1min":0.46700000000000003,"5min":0.38500000000000001,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":4.3250000000000002},"last":0.45900000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54800000000000004,"15min":0.64700000000000002},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.313},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":4.7320000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56499999999999995,"15min":0.89200000000000002},"min":{"1min":0.42499999999999999,"5min":0.36399999999999999,"15min":0.32600000000000001},"max":{"1min":0.70399999999999996,"5min":0.78200000000000003,"15min":11.715},"last":0.53800000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.55500000000000005,"15min":0.54000000000000004},"min":{"1min":0.49299999999999999,"5min":0.35199999999999998,"15min":0.34899999999999998},"max":{"1min":0.72899999999999998,"5min":0.754,"15min":0.79100000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.53300000000000003,"5min":0.438,"15min":0.39000000000000001},"max":{"1min":0.77300000000000002,"5min":0.79700000000000004,"15min":0.85599999999999998},"last":0.60799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46800000000000003,"15min":0.48399999999999999},"min":{"1min":0.28499999999999998,"5min":0.27200000000000002,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47299999999999998,"15min":0.505},"min":{"1min":0.317,"5min":0.253,"15min":0.253},"max":{"1min":0.66500000000000004,"5min":0.77300000000000002,"15min":0.82799999999999996},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.86699999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52800000000000002,"15min":0.54100000000000004},"min":{"1min":0.34499999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67800000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63}]},{"osd":7,"last update":"Mon Oct 9 06:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52000000000000002,"15min":0.52800000000000002},"min":{"1min":0.38200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68400000000000005,"5min":0.81599999999999995,"15min":0.879},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.75900000000000001,"5min":0.83399999999999996,"15min":0.88600000000000001},"last":0.64500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":916,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194395,"statfs":{"total":200000000,"available":199061434,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.35599999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.79200000000000004,"5min":0.85399999999999998,"15min":1.0289999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.81899999999999995},"last":0.72899999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.53000000000000003},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.82399999999999995,"15min":1.093},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.53600000000000003},"min":{"1min":0.40500000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82199999999999995,"5min":0.83399999999999996,"15min":0.85499999999999998},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54600000000000004,"15min":0.52400000000000002},"min":{"1min":0.436,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.68799999999999994,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.47799999999999998,"5min":0.376,"15min":0.36299999999999999},"max":{"1min":0.749,"5min":0.84199999999999997,"15min":0.89300000000000002},"last":0.71399999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.56599999999999995},"min":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.35299999999999998},"max":{"1min":0.78200000000000003,"5min":0.83699999999999997,"15min":0.98699999999999999},"last":0.624},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60799999999999998,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76300000000000001,"5min":0.81299999999999994,"15min":1.071},"last":0.69799999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47499999999999998,"15min":0.48799999999999999},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":0.73899999999999999,"15min":0.84399999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.71699999999999997,"5min":0.78000000000000003,"15min":0.81000000000000005},"last":0.65400000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.497,"15min":0.51900000000000002},"min":{"1min":0.33400000000000002,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.58899999999999997,"5min":0.73999999999999999,"15min":1.0680000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.82799999999999996,"15min":1.0920000000000001},"last":0.754}]},{"osd":7,"last update":"Mon Oct 9 06:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.54200000000000004},"min":{"1min":0.36199999999999999,"5min":0.317,"15min":0.30399999999999999},"max":{"1min":0.67200000000000004,"5min":0.81000000000000005,"15min":0.91900000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.32600000000000001},"max":{"1min":0.61599999999999999,"5min":0.84399999999999997,"15min":1.0269999999999999},"last":0.74099999999999999}]}]}],"pool_statfs":[]}} 2023-10-09T06:30:29.503 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:30:29.504 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:30:29.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.659+0000 7f207bd3a700 1 Processor -- start 2023-10-09T06:30:29.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.659+0000 7f207bd3a700 1 -- start start 2023-10-09T06:30:29.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.660+0000 7f207bd3a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2074159e60 0x7f207415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.660+0000 7f207bd3a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f207415a230 0x7f20740690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.660+0000 7f207bd3a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207415ea90 con 0x7f20740695f0 2023-10-09T06:30:29.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.660+0000 7f207bd3a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20740d1cf0 con 0x7f207415a230 2023-10-09T06:30:29.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.660+0000 7f207bd3a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2074069a90 con 0x7f2074159e60 2023-10-09T06:30:29.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.660+0000 7f207a2d7700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f20740695f0 0x7f20740af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40494/0 (socket says 172.21.15.31:40494) 2023-10-09T06:30:29.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.660+0000 7f207a2d7700 1 -- 172.21.15.31:0/2269811839 learned_addr learned my addr 172.21.15.31:0/2269811839 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:29.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.660+0000 7f2079ad6700 1 --2- 172.21.15.31:0/2269811839 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2074159e60 0x7f207415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.660+0000 7f20792d5700 1 --2- 172.21.15.31:0/2269811839 >> v2:172.21.15.158:3300/0 conn(0x7f207415a230 0x7f20740690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.660+0000 7f2078ad4700 1 -- 172.21.15.31:0/2269811839 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997310708 0 0) 0x7f207415ea90 con 0x7f20740695f0 2023-10-09T06:30:29.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.660+0000 7f2078ad4700 1 -- 172.21.15.31:0/2269811839 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f205c003570 con 0x7f20740695f0 2023-10-09T06:30:29.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.661+0000 7f20792d5700 1 -- 172.21.15.31:0/2269811839 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2074159e60 msgr2=0x7f207415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:29.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.661+0000 7f20792d5700 1 --2- 172.21.15.31:0/2269811839 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2074159e60 0x7f207415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.661+0000 7f20792d5700 1 -- 172.21.15.31:0/2269811839 >> v1:172.21.15.31:6789/0 conn(0x7f20740695f0 legacy=0x7f20740af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.661+0000 7f2078ad4700 1 -- 172.21.15.31:0/2269811839 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1380236985 0 0) 0x7f205c003570 con 0x7f20740695f0 2023-10-09T06:30:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.661+0000 7f20792d5700 1 -- 172.21.15.31:0/2269811839 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20740b3100 con 0x7f207415a230 2023-10-09T06:30:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.661+0000 7f20792d5700 1 --2- 172.21.15.31:0/2269811839 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f207415a230 0x7f20740690b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f20680098e0 tx=0x7f20680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79b4b7aa283b1bdf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.661+0000 7f2078ad4700 1 -- 172.21.15.31:0/2269811839 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20640017f0 con 0x7f207415a230 2023-10-09T06:30:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.661+0000 7f2078ad4700 1 -- 172.21.15.31:0/2269811839 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2068011420 con 0x7f207415a230 2023-10-09T06:30:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.661+0000 7f2078ad4700 1 -- 172.21.15.31:0/2269811839 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20680117c0 con 0x7f207415a230 2023-10-09T06:30:29.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.662+0000 7f207bd3a700 1 -- 172.21.15.31:0/2269811839 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f207415a230 msgr2=0x7f20740690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.662+0000 7f207bd3a700 1 --2- 172.21.15.31:0/2269811839 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f207415a230 0x7f20740690b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f20680098e0 tx=0x7f20680091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.662+0000 7f207bd3a700 1 -- 172.21.15.31:0/2269811839 shutdown_connections 2023-10-09T06:30:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.662+0000 7f207bd3a700 1 --2- 172.21.15.31:0/2269811839 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2074159e60 0x7f207415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.662+0000 7f207bd3a700 1 --2- 172.21.15.31:0/2269811839 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f207415a230 0x7f20740690b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.662+0000 7f207bd3a700 1 -- 172.21.15.31:0/2269811839 >> 172.21.15.31:0/2269811839 conn(0x7f2074070700 msgr2=0x7f2074070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.662+0000 7f207bd3a700 1 -- 172.21.15.31:0/2269811839 shutdown_connections 2023-10-09T06:30:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.662+0000 7f207bd3a700 1 -- 172.21.15.31:0/2269811839 wait complete. 2023-10-09T06:30:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.663+0000 7f207bd3a700 1 Processor -- start 2023-10-09T06:30:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.663+0000 7f207bd3a700 1 -- start start 2023-10-09T06:30:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f207bd3a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20740695f0 0x7f2074159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f207bd3a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2074159e60 0x7f20740c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f207bd3a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f207415a230 0x7f20740c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f207bd3a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20740ca760 con 0x7f2074159e60 2023-10-09T06:30:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f207bd3a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20740c7da0 con 0x7f20740695f0 2023-10-09T06:30:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f207bd3a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20740c8c00 con 0x7f207415a230 2023-10-09T06:30:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f20792d5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2074159e60 0x7f20740c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f20792d5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2074159e60 0x7f20740c51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44092/0 (socket says 172.21.15.31:44092) 2023-10-09T06:30:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f20792d5700 1 -- 172.21.15.31:0/802391513 learned_addr learned my addr 172.21.15.31:0/802391513 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f207a2d7700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f207415a230 0x7f20740c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f2079ad6700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20740695f0 0x7f2074159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f20792d5700 1 -- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f207415a230 msgr2=0x7f20740c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f20792d5700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f207415a230 0x7f20740c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f20792d5700 1 -- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20740695f0 msgr2=0x7f2074159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f20792d5700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20740695f0 0x7f2074159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f20792d5700 1 -- 172.21.15.31:0/802391513 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2068009420 con 0x7f2074159e60 2023-10-09T06:30:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f2079ad6700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20740695f0 0x7f2074159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f20792d5700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2074159e60 0x7f20740c51d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f20680030c0 tx=0x7f2068016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f2071ffb700 1 -- 172.21.15.31:0/802391513 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206801cd60 con 0x7f2074159e60 2023-10-09T06:30:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f2071ffb700 1 -- 172.21.15.31:0/802391513 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206801a450 con 0x7f2074159e60 2023-10-09T06:30:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f207bd3a700 1 -- 172.21.15.31:0/802391513 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20740c7ff0 con 0x7f2074159e60 2023-10-09T06:30:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.664+0000 7f2071ffb700 1 -- 172.21.15.31:0/802391513 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206801a810 con 0x7f2074159e60 2023-10-09T06:30:29.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.665+0000 7f207bd3a700 1 -- 172.21.15.31:0/802391513 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20740c85b0 con 0x7f2074159e60 2023-10-09T06:30:29.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.665+0000 7f207bd3a700 1 -- 172.21.15.31:0/802391513 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207404c3c0 con 0x7f2074159e60 2023-10-09T06:30:29.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.666+0000 7f2071ffb700 1 -- 172.21.15.31:0/802391513 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f206801ac40 con 0x7f2074159e60 2023-10-09T06:30:29.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.666+0000 7f2071ffb700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2060066f30 0x7f20600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:29.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.666+0000 7f2071ffb700 1 -- 172.21.15.31:0/802391513 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2068085ee0 con 0x7f2074159e60 2023-10-09T06:30:29.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.666+0000 7f2079ad6700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2060066f30 0x7f20600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:29.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.667+0000 7f2079ad6700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2060066f30 0x7f20600693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f206c006f00 tx=0x7f206c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:29.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.671+0000 7f2071ffb700 1 -- 172.21.15.31:0/802391513 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2068053150 con 0x7f2074159e60 2023-10-09T06:30:29.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.942+0000 7f207bd3a700 1 -- 172.21.15.31:0/802391513 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f20740cb590 con 0x7f2074159e60 2023-10-09T06:30:29.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.945+0000 7f2071ffb700 1 -- 172.21.15.31:0/802391513 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f2068056770 con 0x7f2074159e60 2023-10-09T06:30:29.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.948+0000 7f207bd3a700 1 -- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2060066f30 msgr2=0x7f20600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.948+0000 7f207bd3a700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2060066f30 0x7f20600693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f206c006f00 tx=0x7f206c008040 comp rx=0 tx=0).stop 2023-10-09T06:30:29.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.948+0000 7f207bd3a700 1 -- 172.21.15.31:0/802391513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2074159e60 msgr2=0x7f20740c51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:29.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.948+0000 7f207bd3a700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2074159e60 0x7f20740c51d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f20680030c0 tx=0x7f2068016000 comp rx=0 tx=0).stop 2023-10-09T06:30:29.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.948+0000 7f207bd3a700 1 -- 172.21.15.31:0/802391513 shutdown_connections 2023-10-09T06:30:29.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.948+0000 7f207bd3a700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2060066f30 0x7f20600693e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.948+0000 7f207bd3a700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f207415a230 0x7f20740c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.948+0000 7f207bd3a700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20740695f0 0x7f2074159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.948+0000 7f207bd3a700 1 --2- 172.21.15.31:0/802391513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2074159e60 0x7f20740c51d0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:29.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.948+0000 7f207bd3a700 1 -- 172.21.15.31:0/802391513 >> 172.21.15.31:0/802391513 conn(0x7f2074070700 msgr2=0x7f20740d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:29.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.948+0000 7f207bd3a700 1 -- 172.21.15.31:0/802391513 shutdown_connections 2023-10-09T06:30:29.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:29.948+0000 7f207bd3a700 1 -- 172.21.15.31:0/802391513 wait complete. 2023-10-09T06:30:29.950 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2023-10-09T06:30:29.960 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:30:30.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.079+0000 7fc3c0eed700 1 Processor -- start 2023-10-09T06:30:30.080 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.079+0000 7fc3c0eed700 1 -- start start 2023-10-09T06:30:30.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.080+0000 7fc3c0eed700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc3bc0cd6e0 0x7fc3bc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.080+0000 7fc3c0eed700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3bc0cdab0 0x7fc3bc15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.080+0000 7fc3c0eed700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3bc0cb7c0 con 0x7fc3bc15dda0 2023-10-09T06:30:30.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.080+0000 7fc3c0eed700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3bc15e850 con 0x7fc3bc0cd6e0 2023-10-09T06:30:30.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.080+0000 7fc3c0eed700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0cd030 con 0x7fc3bc0cdab0 2023-10-09T06:30:30.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.080+0000 7fc3bbfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc3bc15dda0 0x7fc3bc15cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40504/0 (socket says 172.21.15.31:40504) 2023-10-09T06:30:30.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.080+0000 7fc3bbfff700 1 -- 172.21.15.31:0/284145860 learned_addr learned my addr 172.21.15.31:0/284145860 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:30.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.080+0000 7fc3baffd700 1 --2- 172.21.15.31:0/284145860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3bc0cdab0 0x7fc3bc15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.080+0000 7fc3bb7fe700 1 --2- 172.21.15.31:0/284145860 >> v2:172.21.15.158:3300/0 conn(0x7fc3bc0cd6e0 0x7fc3bc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.080+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753161934 0 0) 0x7fc3bc0cb7c0 con 0x7fc3bc15dda0 2023-10-09T06:30:30.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.080+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a4003570 con 0x7fc3bc15dda0 2023-10-09T06:30:30.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 484675609 0 0) 0x7fc3a4003570 con 0x7fc3bc15dda0 2023-10-09T06:30:30.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3bc0cdab0 msgr2=0x7fc3bc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:30.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 --2- 172.21.15.31:0/284145860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3bc0cdab0 0x7fc3bc15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 >> v2:172.21.15.158:3300/0 conn(0x7fc3bc0cd6e0 msgr2=0x7fc3bc0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 --2- 172.21.15.31:0/284145860 >> v2:172.21.15.158:3300/0 conn(0x7fc3bc0cd6e0 0x7fc3bc0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc15e290 con 0x7fc3bc15dda0 2023-10-09T06:30:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fc3b40017f0 con 0x7fc3bc15dda0 2023-10-09T06:30:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 >> v1:172.21.15.31:6789/0 conn(0x7fc3bc15dda0 legacy=0x7fc3bc15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 --2- 172.21.15.31:0/284145860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3bc0cdab0 0x7fc3a4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 --2- 172.21.15.31:0/284145860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3a4003fe0 0x7fc3a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 --2- 172.21.15.31:0/284145860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a4004d50 0x7fc3a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc15e850 con 0x7fc3a4004d50 2023-10-09T06:30:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0cd030 con 0x7fc3a4003fe0 2023-10-09T06:30:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a400ba90 con 0x7fc3bc0cdab0 2023-10-09T06:30:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3bb7fe700 1 --2- 172.21.15.31:0/284145860 >> v2:172.21.15.158:3300/0 conn(0x7fc3bc0cd6e0 0x7fc3bc0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:30:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3bbfff700 1 --2- 172.21.15.31:0/284145860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a4004d50 0x7fc3a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3baffd700 1 --2- 172.21.15.31:0/284145860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3a4003fe0 0x7fc3a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3bb7fe700 1 --2- 172.21.15.31:0/284145860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3bc0cdab0 0x7fc3a4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3bbfff700 1 -- 172.21.15.31:0/284145860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3bc0cdab0 msgr2=0x7fc3a4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3bbfff700 1 --2- 172.21.15.31:0/284145860 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3bc0cdab0 0x7fc3a4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3bbfff700 1 -- 172.21.15.31:0/284145860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3a4003fe0 msgr2=0x7fc3a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3bbfff700 1 --2- 172.21.15.31:0/284145860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3a4003fe0 0x7fc3a4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3bbfff700 1 -- 172.21.15.31:0/284145860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a4003570 con 0x7fc3a4004d50 2023-10-09T06:30:30.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3bbfff700 1 --2- 172.21.15.31:0/284145860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a4004d50 0x7fc3a40051c0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400a970 tx=0x7fc3bc0ccaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eebd307fd296fdd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:30.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40070d0 con 0x7fc3a4004d50 2023-10-09T06:30:30.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b4007230 con 0x7fc3a4004d50 2023-10-09T06:30:30.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.081+0000 7fc3ba7fc700 1 -- 172.21.15.31:0/284145860 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40075f0 con 0x7fc3a4004d50 2023-10-09T06:30:30.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.082+0000 7fc3c0eed700 1 -- 172.21.15.31:0/284145860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a4004d50 msgr2=0x7fc3a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.082+0000 7fc3c0eed700 1 --2- 172.21.15.31:0/284145860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a4004d50 0x7fc3a40051c0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400a970 tx=0x7fc3bc0ccaf0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.082+0000 7fc3bbfff700 1 -- 172.21.15.31:0/284145860 reap_dead start 2023-10-09T06:30:30.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.082+0000 7fc3c0eed700 1 -- 172.21.15.31:0/284145860 shutdown_connections 2023-10-09T06:30:30.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.082+0000 7fc3c0eed700 1 -- 172.21.15.31:0/284145860 >> 172.21.15.31:0/284145860 conn(0x7fc3bc067660 msgr2=0x7fc3bc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.082+0000 7fc3c0eed700 1 -- 172.21.15.31:0/284145860 shutdown_connections 2023-10-09T06:30:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.082+0000 7fc3c0eed700 1 -- 172.21.15.31:0/284145860 wait complete. 2023-10-09T06:30:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.083+0000 7fc3c0eed700 1 Processor -- start 2023-10-09T06:30:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.083+0000 7fc3c0eed700 1 -- start start 2023-10-09T06:30:30.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3c0eed700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3bc14c9f0 0x7fc3bc16a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3c0eed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3bc16a710 0x7fc3bc0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3c0eed700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3bc0b63a0 0x7fc3bc0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3c0eed700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0b6810 con 0x7fc3bc16a710 2023-10-09T06:30:30.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3c0eed700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0c7d20 con 0x7fc3bc14c9f0 2023-10-09T06:30:30.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3c0eed700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc16ad20 con 0x7fc3bc0b63a0 2023-10-09T06:30:30.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3baffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3bc16a710 0x7fc3bc0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3baffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3bc16a710 0x7fc3bc0b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44110/0 (socket says 172.21.15.31:44110) 2023-10-09T06:30:30.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3baffd700 1 -- 172.21.15.31:0/3354482999 learned_addr learned my addr 172.21.15.31:0/3354482999 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:30.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3bb7fe700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3bc14c9f0 0x7fc3bc16a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3bbfff700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3bc0b63a0 0x7fc3bc0b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3baffd700 1 -- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3bc0b63a0 msgr2=0x7fc3bc0b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3baffd700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3bc0b63a0 0x7fc3bc0b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3baffd700 1 -- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3bc14c9f0 msgr2=0x7fc3bc16a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3baffd700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3bc14c9f0 0x7fc3bc16a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.084+0000 7fc3baffd700 1 -- 172.21.15.31:0/3354482999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc16b000 con 0x7fc3bc16a710 2023-10-09T06:30:30.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.085+0000 7fc3baffd700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3bc16a710 0x7fc3bc0b5e60 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0006ac0 tx=0x7fc3b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:30.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.085+0000 7fc3a37fe700 1 -- 172.21.15.31:0/3354482999 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000f940 con 0x7fc3bc16a710 2023-10-09T06:30:30.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.085+0000 7fc3a37fe700 1 -- 172.21.15.31:0/3354482999 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b000faa0 con 0x7fc3bc16a710 2023-10-09T06:30:30.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.085+0000 7fc3c0eed700 1 -- 172.21.15.31:0/3354482999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc0c7f70 con 0x7fc3bc16a710 2023-10-09T06:30:30.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.085+0000 7fc3a37fe700 1 -- 172.21.15.31:0/3354482999 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000fe20 con 0x7fc3bc16a710 2023-10-09T06:30:30.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.085+0000 7fc3c0eed700 1 -- 172.21.15.31:0/3354482999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc14cdc0 con 0x7fc3bc16a710 2023-10-09T06:30:30.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.086+0000 7fc3c0eed700 1 -- 172.21.15.31:0/3354482999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc089280 con 0x7fc3bc16a710 2023-10-09T06:30:30.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.086+0000 7fc3a37fe700 1 -- 172.21.15.31:0/3354482999 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3b0014650 con 0x7fc3bc16a710 2023-10-09T06:30:30.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.086+0000 7fc3a37fe700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc3a8066f30 0x7fc3a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.087+0000 7fc3a37fe700 1 -- 172.21.15.31:0/3354482999 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc3b0018030 con 0x7fc3bc16a710 2023-10-09T06:30:30.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.087+0000 7fc3bb7fe700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc3a8066f30 0x7fc3a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.087+0000 7fc3bb7fe700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc3a8066f30 0x7fc3a80693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0093f0 tx=0x7fc3ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:30.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.091+0000 7fc3a37fe700 1 -- 172.21.15.31:0/3354482999 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3b0052120 con 0x7fc3bc16a710 2023-10-09T06:30:30.301 INFO:tasks.ceph.mds.b.smithi158.stderr:2023-10-09T06:30:30.301+0000 7f52679c5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:30:30.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.332+0000 7fc3c0eed700 1 -- 172.21.15.31:0/3354482999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3bc15e570 con 0x7fc3bc16a710 2023-10-09T06:30:30.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.332+0000 7fc3a37fe700 1 -- 172.21.15.31:0/3354482999 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fc3b0055740 con 0x7fc3bc16a710 2023-10-09T06:30:30.333 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:30.333 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1455840229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1455840229},{"type":"v1","addr":"172.21.15.158:6837","nonce":1455840229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7770,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3156917195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3156917195},{"type":"v1","addr":"172.21.15.31:6834","nonce":3156917195}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1537057825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1537057825},{"type":"v1","addr":"172.21.15.31:6835","nonce":1537057825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:30:24.382245+0000","modified":"2023-10-09T06:30:28.019930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7782":{"gid":7782,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/3592438876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3592438876},{"type":"v1","addr":"172.21.15.158:6836","nonce":3592438876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T06:30:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.334+0000 7fc3c0eed700 1 -- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc3a8066f30 msgr2=0x7fc3a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.334+0000 7fc3c0eed700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc3a8066f30 0x7fc3a80693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0093f0 tx=0x7fc3ac008040 comp rx=0 tx=0).stop 2023-10-09T06:30:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.334+0000 7fc3c0eed700 1 -- 172.21.15.31:0/3354482999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3bc16a710 msgr2=0x7fc3bc0b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.334+0000 7fc3c0eed700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3bc16a710 0x7fc3bc0b5e60 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0006ac0 tx=0x7fc3b00091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.335+0000 7fc3c0eed700 1 -- 172.21.15.31:0/3354482999 shutdown_connections 2023-10-09T06:30:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.335+0000 7fc3c0eed700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc3a8066f30 0x7fc3a80693e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.335+0000 7fc3c0eed700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc3bc0b63a0 0x7fc3bc0b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.335+0000 7fc3c0eed700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3bc14c9f0 0x7fc3bc16a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.335+0000 7fc3c0eed700 1 --2- 172.21.15.31:0/3354482999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3bc16a710 0x7fc3bc0b5e60 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.335+0000 7fc3c0eed700 1 -- 172.21.15.31:0/3354482999 >> 172.21.15.31:0/3354482999 conn(0x7fc3bc067660 msgr2=0x7fc3bc14d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.335+0000 7fc3c0eed700 1 -- 172.21.15.31:0/3354482999 shutdown_connections 2023-10-09T06:30:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.335+0000 7fc3c0eed700 1 -- 172.21.15.31:0/3354482999 wait complete. 2023-10-09T06:30:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 82 2023-10-09T06:30:30.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 82, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:30:24.382245+0000', 'modified': '2023-10-09T06:30:28.019930+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7782}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7782': {'gid': 7782, 'name': 'b', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.158:6836/3592438876', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6834', 'nonce': 3592438876}, {'type': 'v1', 'addr': '172.21.15.158:6836', 'nonce': 3592438876}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:30:30.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:30:30.751 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-09T06:30:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.873+0000 7f2f9527e700 1 Processor -- start 2023-10-09T06:30:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.873+0000 7f2f9527e700 1 -- start start 2023-10-09T06:30:30.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.874+0000 7f2f9527e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2f90159da0 0x7f2f900b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.874+0000 7f2f9527e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9015ea70 con 0x7f2f90069210 2023-10-09T06:30:30.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.874+0000 7f2f9527e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f900b3990 con 0x7f2f9015a170 2023-10-09T06:30:30.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.874+0000 7f2f9527e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f900b0b70 con 0x7f2f90159da0 2023-10-09T06:30:30.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.874+0000 7f2f94a7d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2f90069210 0x7f2f900af4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40512/0 (socket says 172.21.15.31:40512) 2023-10-09T06:30:30.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.874+0000 7f2f94a7d700 1 -- 172.21.15.31:0/2188123110 learned_addr learned my addr 172.21.15.31:0/2188123110 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:30.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.874+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/2188123110 >> v2:172.21.15.158:3300/0 conn(0x7f2f90159da0 0x7f2f900b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.874+0000 7f2f8effd700 1 -- 172.21.15.31:0/2188123110 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694547797 0 0) 0x7f2f9015ea70 con 0x7f2f90069210 2023-10-09T06:30:30.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.874+0000 7f2f8effd700 1 -- 172.21.15.31:0/2188123110 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f78003570 con 0x7f2f90069210 2023-10-09T06:30:30.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.874+0000 7f2f8effd700 1 -- 172.21.15.31:0/2188123110 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273572052 0 0) 0x7f2f900b3990 con 0x7f2f9015a170 2023-10-09T06:30:30.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.875+0000 7f2f8effd700 1 -- 172.21.15.31:0/2188123110 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f9015ea70 con 0x7f2f9015a170 2023-10-09T06:30:30.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.875+0000 7f2f8effd700 1 -- 172.21.15.31:0/2188123110 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2817183532 0 0) 0x7f2f78003570 con 0x7f2f90069210 2023-10-09T06:30:30.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.875+0000 7f2f8ffff700 1 -- 172.21.15.31:0/2188123110 >> v1:172.21.15.158:6789/0 conn(0x7f2f9015a170 legacy=0x7f2f90068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.875+0000 7f2f8ffff700 1 -- 172.21.15.31:0/2188123110 >> v1:172.21.15.31:6789/0 conn(0x7f2f90069210 legacy=0x7f2f900af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.875+0000 7f2f8ffff700 1 -- 172.21.15.31:0/2188123110 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9015def0 con 0x7f2f90159da0 2023-10-09T06:30:30.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.875+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/2188123110 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f90159da0 0x7f2f900b2da0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2f840098e0 tx=0x7f2f840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52efa91a9cd0ccd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:30.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.875+0000 7f2f8effd700 1 -- 172.21.15.31:0/2188123110 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880017f0 con 0x7f2f90159da0 2023-10-09T06:30:30.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.875+0000 7f2f8effd700 1 -- 172.21.15.31:0/2188123110 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f84011420 con 0x7f2f90159da0 2023-10-09T06:30:30.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.875+0000 7f2f8effd700 1 -- 172.21.15.31:0/2188123110 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f840117c0 con 0x7f2f90159da0 2023-10-09T06:30:30.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.875+0000 7f2f9527e700 1 -- 172.21.15.31:0/2188123110 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f90159da0 msgr2=0x7f2f900b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.875+0000 7f2f9527e700 1 --2- 172.21.15.31:0/2188123110 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f90159da0 0x7f2f900b2da0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2f840098e0 tx=0x7f2f840091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.875+0000 7f2f9527e700 1 -- 172.21.15.31:0/2188123110 shutdown_connections 2023-10-09T06:30:30.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.875+0000 7f2f9527e700 1 --2- 172.21.15.31:0/2188123110 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f90159da0 0x7f2f900b2da0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.876+0000 7f2f9527e700 1 -- 172.21.15.31:0/2188123110 >> 172.21.15.31:0/2188123110 conn(0x7f2f900d0bc0 msgr2=0x7f2f900d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:30.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.876+0000 7f2f9527e700 1 -- 172.21.15.31:0/2188123110 shutdown_connections 2023-10-09T06:30:30.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.876+0000 7f2f9527e700 1 -- 172.21.15.31:0/2188123110 wait complete. 2023-10-09T06:30:30.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.877+0000 7f2f9527e700 1 Processor -- start 2023-10-09T06:30:30.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.877+0000 7f2f9527e700 1 -- start start 2023-10-09T06:30:30.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.877+0000 7f2f9527e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f90069210 0x7f2f900c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f9527e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f90159da0 0x7f2f90154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f9527e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f9015a170 0x7f2f90155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f9527e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900ccb70 con 0x7f2f90069210 2023-10-09T06:30:30.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f9527e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9016ab50 con 0x7f2f9015a170 2023-10-09T06:30:30.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f9527e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9016b3b0 con 0x7f2f90159da0 2023-10-09T06:30:30.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f8ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f90069210 0x7f2f900c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f8ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f90069210 0x7f2f900c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44118/0 (socket says 172.21.15.31:44118) 2023-10-09T06:30:30.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f8ffff700 1 -- 172.21.15.31:0/4247496981 learned_addr learned my addr 172.21.15.31:0/4247496981 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:30.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f8f7fe700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f90159da0 0x7f2f90154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f94a7d700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f9015a170 0x7f2f90155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f8ffff700 1 -- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f90159da0 msgr2=0x7f2f90154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f90159da0 0x7f2f90154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f8ffff700 1 -- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f9015a170 msgr2=0x7f2f90155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f9015a170 0x7f2f90155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f8ffff700 1 -- 172.21.15.31:0/4247496981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84009420 con 0x7f2f90069210 2023-10-09T06:30:30.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f90069210 0x7f2f900c7f00 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2f9006b5c0 tx=0x7f2f84016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:30.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f77fff700 1 -- 172.21.15.31:0/4247496981 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84000cf0 con 0x7f2f90069210 2023-10-09T06:30:30.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f77fff700 1 -- 172.21.15.31:0/4247496981 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8401cb30 con 0x7f2f90069210 2023-10-09T06:30:30.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f9527e700 1 -- 172.21.15.31:0/4247496981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f900cc890 con 0x7f2f90069210 2023-10-09T06:30:30.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.878+0000 7f2f77fff700 1 -- 172.21.15.31:0/4247496981 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8401a450 con 0x7f2f90069210 2023-10-09T06:30:30.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.879+0000 7f2f9527e700 1 -- 172.21.15.31:0/4247496981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9016b040 con 0x7f2f90069210 2023-10-09T06:30:30.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.880+0000 7f2f77fff700 1 -- 172.21.15.31:0/4247496981 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f8401a800 con 0x7f2f90069210 2023-10-09T06:30:30.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.881+0000 7f2f77fff700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f7c066f30 0x7f2f7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.881+0000 7f2f77fff700 1 -- 172.21.15.31:0/4247496981 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f84085da0 con 0x7f2f90069210 2023-10-09T06:30:30.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.881+0000 7f2f8f7fe700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f7c066f30 0x7f2f7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.881+0000 7f2f8f7fe700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f7c066f30 0x7f2f7c0693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2f80007fd0 tx=0x7f2f80007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:30.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.882+0000 7f2f9f7d8b80 1 Processor -- start 2023-10-09T06:30:30.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.882+0000 7f2f9f7d8b80 1 -- start start 2023-10-09T06:30:30.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.883+0000 7f2f9f7d8b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d035c480 0x55b2d033b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.883+0000 7f2f9f7d8b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d030f5f0 0x55b2d035c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.883+0000 7f2f9f7d8b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d0311b80 0x55b2d0311ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.883+0000 7f2f9f7d8b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d0268a70 con 0x55b2d030f5f0 2023-10-09T06:30:30.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.883+0000 7f2f9f7d8b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d0266270 con 0x55b2d0311b80 2023-10-09T06:30:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.883+0000 7f2f9f7d8b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2d0262060 con 0x55b2d035c480 2023-10-09T06:30:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.883+0000 7f2f8f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d030f5f0 0x55b2d035c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.883+0000 7f2f8f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d030f5f0 0x55b2d035c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44128/0 (socket says 172.21.15.31:44128) 2023-10-09T06:30:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.883+0000 7f2f8f7fe700 1 -- 172.21.15.31:0/2573939851 learned_addr learned my addr 172.21.15.31:0/2573939851 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:30.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.883+0000 7f2f94a7d700 1 --2- 172.21.15.31:0/2573939851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d0311b80 0x55b2d0311ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.883+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/2573939851 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d035c480 0x55b2d033b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.884+0000 7f2f8f7fe700 1 -- 172.21.15.31:0/2573939851 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d035c480 msgr2=0x55b2d033b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:30.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.884+0000 7f2f8f7fe700 1 --2- 172.21.15.31:0/2573939851 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d035c480 0x55b2d033b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.884+0000 7f2f8f7fe700 1 -- 172.21.15.31:0/2573939851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d0311b80 msgr2=0x55b2d0311ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:30.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.884+0000 7f2f8f7fe700 1 --2- 172.21.15.31:0/2573939851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d0311b80 0x55b2d0311ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.884+0000 7f2f8f7fe700 1 -- 172.21.15.31:0/2573939851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2d00fc270 con 0x55b2d030f5f0 2023-10-09T06:30:30.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.884+0000 7f2f8f7fe700 1 --2- 172.21.15.31:0/2573939851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d030f5f0 0x55b2d035c850 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f2f800028e0 tx=0x7f2f80015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe18cf562562ae2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:30.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.884+0000 7f2f757fa700 1 -- 172.21.15.31:0/2573939851 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80014450 con 0x55b2d030f5f0 2023-10-09T06:30:30.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.884+0000 7f2f757fa700 1 -- 172.21.15.31:0/2573939851 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f800145b0 con 0x55b2d030f5f0 2023-10-09T06:30:30.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.884+0000 7f2f757fa700 1 -- 172.21.15.31:0/2573939851 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80014930 con 0x55b2d030f5f0 2023-10-09T06:30:30.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.885+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/2573939851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d030f5f0 msgr2=0x55b2d035c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.885+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/2573939851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d030f5f0 0x55b2d035c850 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f2f800028e0 tx=0x7f2f80015000 comp rx=0 tx=0).stop 2023-10-09T06:30:30.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.885+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/2573939851 shutdown_connections 2023-10-09T06:30:30.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.885+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/2573939851 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d035c480 0x55b2d033b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.885+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/2573939851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d0311b80 0x55b2d0311ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.885+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/2573939851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d030f5f0 0x55b2d035c850 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.885+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/2573939851 >> 172.21.15.31:0/2573939851 conn(0x55b2d03130c0 msgr2=0x55b2d03138f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.885+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/2573939851 shutdown_connections 2023-10-09T06:30:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.885+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/2573939851 wait complete. 2023-10-09T06:30:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.885+0000 7f2f9f7d8b80 1 -- start start 2023-10-09T06:30:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.885+0000 7f2f9f7d8b80 1 Processor -- start 2023-10-09T06:30:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.886+0000 7f2f9f7d8b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d030f5f0 0x55b2d03594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.886+0000 7f2f9f7d8b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d0311b80 0x55b2d03682a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.886+0000 7f2f9f7d8b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 0x55b2d03687e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.886+0000 7f2f9f7d8b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d020d890 con 0x55b2d035c480 2023-10-09T06:30:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.886+0000 7f2f9f7d8b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d0228ea0 con 0x55b2d0311b80 2023-10-09T06:30:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.886+0000 7f2f9f7d8b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2d00e4e30 con 0x55b2d030f5f0 2023-10-09T06:30:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.886+0000 7f2f9f7d8b80 10 client.0 _ll_register_callbacks cb 0x55b2d02d52c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:30:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.886+0000 7f2f94a7d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 0x55b2d03687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.886+0000 7f2f94a7d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 0x55b2d03687e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44144/0 (socket says 172.21.15.31:44144) 2023-10-09T06:30:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.886+0000 7f2f94a7d700 1 -- 172.21.15.31:0/340751653 learned_addr learned my addr 172.21.15.31:0/340751653 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.886+0000 7f2f8f7fe700 1 --2- 172.21.15.31:0/340751653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d0311b80 0x55b2d03682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.886+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/340751653 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d030f5f0 0x55b2d03594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f94a7d700 1 -- 172.21.15.31:0/340751653 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d030f5f0 msgr2=0x55b2d03594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f94a7d700 1 --2- 172.21.15.31:0/340751653 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d030f5f0 0x55b2d03594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f94a7d700 1 -- 172.21.15.31:0/340751653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d0311b80 msgr2=0x55b2d03682a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:30.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f94a7d700 1 --2- 172.21.15.31:0/340751653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d0311b80 0x55b2d03682a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f94a7d700 1 -- 172.21.15.31:0/340751653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9015ea70 con 0x55b2d035c480 2023-10-09T06:30:30.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f94a7d700 1 --2- 172.21.15.31:0/340751653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 0x55b2d03687e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f2f880076c0 tx=0x7f2f88000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfbdb3bb7fdd42c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:30.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f6e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:30:30.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f6e7fc700 1 -- 172.21.15.31:0/340751653 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88012750 con 0x55b2d035c480 2023-10-09T06:30:30.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f6e7fc700 1 -- 172.21.15.31:0/340751653 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f88016b00 con 0x55b2d035c480 2023-10-09T06:30:30.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/340751653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2d0306cd0 con 0x55b2d035c480 2023-10-09T06:30:30.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f6e7fc700 1 -- 172.21.15.31:0/340751653 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f880128b0 con 0x55b2d035c480 2023-10-09T06:30:30.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f9f7d8b80 10 client.7911 fetch_fsmap learned FSMap version 82 2023-10-09T06:30:30.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/340751653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x55b2d009efe0 con 0x55b2d035c480 2023-10-09T06:30:30.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f6e7fc700 1 -- 172.21.15.31:0/340751653 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b2d0306cd0 con 0x55b2d035c480 2023-10-09T06:30:30.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f6e7fc700 1 -- 172.21.15.31:0/340751653 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 82) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2f88012a10 con 0x55b2d035c480 2023-10-09T06:30:30.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f9f7d8b80 10 client.7911 fetch_fsmap finished waiting for FSMap version 82 2023-10-09T06:30:30.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f9f7d8b80 10 client.7911 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T06:30:30.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f9f7d8b80 20 client.7911 populate_metadata read hostname 'smithi031' 2023-10-09T06:30:30.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/340751653 >> [v2:172.21.15.158:6834/3592438876,v1:172.21.15.158:6836/3592438876] conn(0x55b2d0341390 0x55b2d0341760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f9f7d8b80 4 client.7911 mds_command: new command op to 7782 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:30:30.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.887+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/340751653 --> [v2:172.21.15.158:6834/3592438876,v1:172.21.15.158:6836/3592438876] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2d02e3aa0 con 0x55b2d0341390 2023-10-09T06:30:30.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.888+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/340751653 >> [v2:172.21.15.158:6834/3592438876,v1:172.21.15.158:6836/3592438876] conn(0x55b2d0341390 0x55b2d0341760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.888+0000 7f2f6e7fc700 10 client.7911 ms_handle_connect on v2:172.21.15.158:6834/3592438876 2023-10-09T06:30:30.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.888+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/340751653 >> [v2:172.21.15.158:6834/3592438876,v1:172.21.15.158:6836/3592438876] conn(0x55b2d0341390 0x55b2d0341760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e317e6e5e013e9ea server_cookie=7f1e3d3eb816bbd9 in_seq=0 out_seq=0 2023-10-09T06:30:30.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f6e7fc700 1 -- 172.21.15.31:0/340751653 <== mds.0 v2:172.21.15.158:6834/3592438876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b2d02e3aa0 con 0x55b2d0341390 2023-10-09T06:30:30.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f6e7fc700 10 client.7911 handle_command_reply: tid=0 2023-10-09T06:30:30.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f9f7d8b80 1 client.7911 shutdown 2023-10-09T06:30:30.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/340751653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 msgr2=0x55b2d03687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/340751653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 0x55b2d03687e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f2f880076c0 tx=0x7f2f88000f40 comp rx=0 tx=0).stop 2023-10-09T06:30:30.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/340751653 shutdown_connections 2023-10-09T06:30:30.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/340751653 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d030f5f0 0x55b2d03594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/340751653 >> [v2:172.21.15.158:6834/3592438876,v1:172.21.15.158:6836/3592438876] conn(0x55b2d0341390 0x55b2d0341760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/340751653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 0x55b2d03687e0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/340751653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d0311b80 0x55b2d03682a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f6e7fc700 0 client.7911 ms_handle_reset on v2:172.21.15.158:6834/3592438876 2023-10-09T06:30:30.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/340751653 >> 172.21.15.31:0/340751653 conn(0x55b2d03130c0 msgr2=0x55b2d030de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:30.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/340751653 shutdown_connections 2023-10-09T06:30:30.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/340751653 wait complete. 2023-10-09T06:30:30.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.889+0000 7f2f9f7d8b80 20 client.7911 trim_cache size 0 max 16384 2023-10-09T06:30:30.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.906+0000 7f2f9f7d8b80 1 Processor -- start 2023-10-09T06:30:30.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.906+0000 7f2f9f7d8b80 1 -- start start 2023-10-09T06:30:30.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f9f7d8b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d030f5f0 0x55b2d03682a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f9f7d8b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d0311b80 0x55b2d035b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f9f7d8b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 0x55b2d0314e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f9f7d8b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d0310010 con 0x55b2d035c480 2023-10-09T06:30:30.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f9f7d8b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d030f4a0 con 0x55b2d030f5f0 2023-10-09T06:30:30.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f9f7d8b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2d030a9e0 con 0x55b2d0311b80 2023-10-09T06:30:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f94a7d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 0x55b2d0314e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f94a7d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 0x55b2d0314e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44156/0 (socket says 172.21.15.31:44156) 2023-10-09T06:30:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f94a7d700 1 -- 172.21.15.31:0/3812918537 learned_addr learned my addr 172.21.15.31:0/3812918537 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/3812918537 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d030f5f0 0x55b2d03682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f8f7fe700 1 --2- 172.21.15.31:0/3812918537 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d0311b80 0x55b2d035b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f94a7d700 1 -- 172.21.15.31:0/3812918537 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d0311b80 msgr2=0x55b2d035b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f94a7d700 1 --2- 172.21.15.31:0/3812918537 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d0311b80 0x55b2d035b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f94a7d700 1 -- 172.21.15.31:0/3812918537 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d030f5f0 msgr2=0x55b2d03682a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f94a7d700 1 --2- 172.21.15.31:0/3812918537 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d030f5f0 0x55b2d03682a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f94a7d700 1 -- 172.21.15.31:0/3812918537 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2d0230780 con 0x55b2d035c480 2023-10-09T06:30:30.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.907+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/3812918537 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d030f5f0 0x55b2d03682a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:30.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.908+0000 7f2f94a7d700 1 --2- 172.21.15.31:0/3812918537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 0x55b2d0314e20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2f88004d70 tx=0x7f2f8800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320587f0ca2a5546 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:30.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.908+0000 7f2f75ffb700 1 -- 172.21.15.31:0/3812918537 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88001ad0 con 0x55b2d035c480 2023-10-09T06:30:30.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.908+0000 7f2f75ffb700 1 -- 172.21.15.31:0/3812918537 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f880125a0 con 0x55b2d035c480 2023-10-09T06:30:30.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.908+0000 7f2f75ffb700 1 -- 172.21.15.31:0/3812918537 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88012920 con 0x55b2d035c480 2023-10-09T06:30:30.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.908+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/3812918537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 msgr2=0x55b2d0314e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.908+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/3812918537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 0x55b2d0314e20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2f88004d70 tx=0x7f2f8800a000 comp rx=0 tx=0).stop 2023-10-09T06:30:30.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.908+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/3812918537 shutdown_connections 2023-10-09T06:30:30.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.908+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/3812918537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d035c480 0x55b2d0314e20 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.908+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/3812918537 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d030f5f0 0x55b2d03682a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.908+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/3812918537 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d0311b80 0x55b2d035b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.908+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/3812918537 >> 172.21.15.31:0/3812918537 conn(0x55b2d03130c0 msgr2=0x55b2d030de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:30.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.908+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/3812918537 shutdown_connections 2023-10-09T06:30:30.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.908+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/3812918537 wait complete. 2023-10-09T06:30:30.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.909+0000 7f2f9f7d8b80 1 -- start start 2023-10-09T06:30:30.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.909+0000 7f2f9f7d8b80 1 Processor -- start 2023-10-09T06:30:30.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f9f7d8b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d030f5f0 0x55b2d03b8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f9f7d8b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d0311b80 0x55b2d0314e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f9f7d8b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d035c480 0x55b2d0315360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f9f7d8b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d030e1c0 con 0x55b2d0311b80 2023-10-09T06:30:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f9f7d8b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d0332e70 con 0x55b2d030f5f0 2023-10-09T06:30:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f9f7d8b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2d0309310 con 0x55b2d035c480 2023-10-09T06:30:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f9f7d8b80 10 client.0 _ll_register_callbacks cb 0x55b2d02d52c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:30:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f8f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d0311b80 0x55b2d0314e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f8f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d0311b80 0x55b2d0314e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44164/0 (socket says 172.21.15.31:44164) 2023-10-09T06:30:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f8f7fe700 1 -- 172.21.15.31:0/3405986073 learned_addr learned my addr 172.21.15.31:0/3405986073 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d030f5f0 0x55b2d03b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f94a7d700 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d035c480 0x55b2d0315360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f8f7fe700 1 -- 172.21.15.31:0/3405986073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d035c480 msgr2=0x55b2d0315360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:30.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f8f7fe700 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d035c480 0x55b2d0315360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f8f7fe700 1 -- 172.21.15.31:0/3405986073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d030f5f0 msgr2=0x55b2d03b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:30.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f8f7fe700 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d030f5f0 0x55b2d03b8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f8f7fe700 1 -- 172.21.15.31:0/3405986073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b2d009efe0 con 0x55b2d0311b80 2023-10-09T06:30:30.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f94a7d700 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d035c480 0x55b2d0315360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:30.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f8f7fe700 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d0311b80 0x55b2d0314e20 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f2f80023040 tx=0x7f2f8001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572fed05ba25f5c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:30.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f6e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:30:30.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.910+0000 7f2f6e7fc700 1 -- 172.21.15.31:0/3405986073 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800207f0 con 0x55b2d0311b80 2023-10-09T06:30:30.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f6e7fc700 1 -- 172.21.15.31:0/3405986073 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f8001c040 con 0x55b2d0311b80 2023-10-09T06:30:30.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/3405986073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f800145b0 con 0x55b2d0311b80 2023-10-09T06:30:30.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f6e7fc700 1 -- 172.21.15.31:0/3405986073 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f80037ce0 con 0x55b2d0311b80 2023-10-09T06:30:30.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f9f7d8b80 10 client.7917 fetch_fsmap learned FSMap version 82 2023-10-09T06:30:30.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/3405986073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x55b2d0217470 con 0x55b2d0311b80 2023-10-09T06:30:30.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f6e7fc700 1 -- 172.21.15.31:0/3405986073 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f800145b0 con 0x55b2d0311b80 2023-10-09T06:30:30.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f6e7fc700 1 -- 172.21.15.31:0/3405986073 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 82) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2f80012070 con 0x55b2d0311b80 2023-10-09T06:30:30.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f9f7d8b80 10 client.7917 fetch_fsmap finished waiting for FSMap version 82 2023-10-09T06:30:30.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f9f7d8b80 10 client.7917 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T06:30:30.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f9f7d8b80 20 client.7917 populate_metadata read hostname 'smithi031' 2023-10-09T06:30:30.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.158:6834/3592438876,v1:172.21.15.158:6836/3592438876] conn(0x55b2d033e0c0 0x55b2d033e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:30.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f9f7d8b80 4 client.7917 mds_command: new command op to 7782 tid=0[{"prefix": "status"}] 2023-10-09T06:30:30.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/3405986073 --> [v2:172.21.15.158:6834/3592438876,v1:172.21.15.158:6836/3592438876] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b2d0204e00 con 0x55b2d033e0c0 2023-10-09T06:30:30.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.911+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.158:6834/3592438876,v1:172.21.15.158:6836/3592438876] conn(0x55b2d033e0c0 0x55b2d033e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:30.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f6e7fc700 10 client.7917 ms_handle_connect on v2:172.21.15.158:6834/3592438876 2023-10-09T06:30:30.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f8ffff700 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.158:6834/3592438876,v1:172.21.15.158:6836/3592438876] conn(0x55b2d033e0c0 0x55b2d033e490 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=148be96188deb169 server_cookie=8ba985569e3e294e in_seq=0 out_seq=0 2023-10-09T06:30:30.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f6e7fc700 1 -- 172.21.15.31:0/3405986073 <== mds.0 v2:172.21.15.158:6834/3592438876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b2d0204e00 con 0x55b2d033e0c0 2023-10-09T06:30:30.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f6e7fc700 10 client.7917 handle_command_reply: tid=0 2023-10-09T06:30:30.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f9f7d8b80 1 client.7917 shutdown 2023-10-09T06:30:30.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/3405986073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d0311b80 msgr2=0x55b2d0314e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d0311b80 0x55b2d0314e20 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f2f80023040 tx=0x7f2f8001f000 comp rx=0 tx=0).stop 2023-10-09T06:30:30.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/3405986073 shutdown_connections 2023-10-09T06:30:30.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55b2d035c480 0x55b2d0315360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.158:6834/3592438876,v1:172.21.15.158:6836/3592438876] conn(0x55b2d033e0c0 0x55b2d033e490 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b2d030f5f0 0x55b2d03b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f6e7fc700 0 client.7917 ms_handle_reset on v2:172.21.15.158:6834/3592438876 2023-10-09T06:30:30.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f9f7d8b80 1 --2- 172.21.15.31:0/3405986073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b2d0311b80 0x55b2d0314e20 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/3405986073 >> 172.21.15.31:0/3405986073 conn(0x55b2d03130c0 msgr2=0x55b2d035b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:30.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/3405986073 shutdown_connections 2023-10-09T06:30:30.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f9f7d8b80 1 -- 172.21.15.31:0/3405986073 wait complete. 2023-10-09T06:30:30.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.912+0000 7f2f9f7d8b80 20 client.7917 trim_cache size 0 max 16384 2023-10-09T06:30:30.936 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:30:30.936 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:30:30.936 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-10-09T06:30:30.936 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 7782, 2023-10-09T06:30:30.936 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-10-09T06:30:30.936 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-10-09T06:30:30.936 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-10-09T06:30:30.937 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 5.9054290229999999, 2023-10-09T06:30:30.937 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 82, 2023-10-09T06:30:30.937 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 168, 2023-10-09T06:30:30.937 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 168, 2023-10-09T06:30:30.937 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 10.993868245 2023-10-09T06:30:30.937 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:30:30.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.913+0000 7f2f9527e700 1 -- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f7c066f30 msgr2=0x7f2f7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.913+0000 7f2f9527e700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f7c066f30 0x7f2f7c0693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2f80007fd0 tx=0x7f2f80007d10 comp rx=0 tx=0).stop 2023-10-09T06:30:30.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.913+0000 7f2f9527e700 1 -- 172.21.15.31:0/4247496981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f90069210 msgr2=0x7f2f900c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:30.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.913+0000 7f2f9527e700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f90069210 0x7f2f900c7f00 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2f9006b5c0 tx=0x7f2f84016000 comp rx=0 tx=0).stop 2023-10-09T06:30:30.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.913+0000 7f2f9527e700 1 -- 172.21.15.31:0/4247496981 shutdown_connections 2023-10-09T06:30:30.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.913+0000 7f2f9527e700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2f7c066f30 0x7f2f7c0693e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.913+0000 7f2f9527e700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2f9015a170 0x7f2f90155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.913+0000 7f2f9527e700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f90069210 0x7f2f900c7f00 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.913+0000 7f2f9527e700 1 --2- 172.21.15.31:0/4247496981 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2f90159da0 0x7f2f90154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:30.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.913+0000 7f2f9527e700 1 -- 172.21.15.31:0/4247496981 >> 172.21.15.31:0/4247496981 conn(0x7f2f900d0bc0 msgr2=0x7f2f900b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:30.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.913+0000 7f2f9527e700 1 -- 172.21.15.31:0/4247496981 shutdown_connections 2023-10-09T06:30:30.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:30.913+0000 7f2f9527e700 1 -- 172.21.15.31:0/4247496981 wait complete. 2023-10-09T06:30:30.940 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:30:31.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.060+0000 7ffa28adf700 1 Processor -- start 2023-10-09T06:30:31.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.060+0000 7ffa28adf700 1 -- start start 2023-10-09T06:30:31.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa28adf700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ffa2415a0c0 0x7ffa2415e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:31.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa28adf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa240cca20 con 0x7ffa24159cf0 2023-10-09T06:30:31.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa28adf700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2415ea40 con 0x7ffa240cf1c0 2023-10-09T06:30:31.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa28adf700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa24067660 con 0x7ffa2415a0c0 2023-10-09T06:30:31.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2259c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ffa24159cf0 0x7ffa240ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40518/0 (socket says 172.21.15.31:40518) 2023-10-09T06:30:31.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2259c700 1 -- 172.21.15.31:0/2402432228 learned_addr learned my addr 172.21.15.31:0/2402432228 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:31.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292563758 0 0) 0x7ffa240cca20 con 0x7ffa24159cf0 2023-10-09T06:30:31.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa22d9d700 1 --2- 172.21.15.31:0/2402432228 >> v2:172.21.15.158:3300/0 conn(0x7ffa2415a0c0 0x7ffa2415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:31.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa10003570 con 0x7ffa24159cf0 2023-10-09T06:30:31.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2047808434 0 0) 0x7ffa10003570 con 0x7ffa24159cf0 2023-10-09T06:30:31.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 >> v2:172.21.15.158:3300/0 conn(0x7ffa2415a0c0 msgr2=0x7ffa2415e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:31.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 --2- 172.21.15.31:0/2402432228 >> v2:172.21.15.158:3300/0 conn(0x7ffa2415a0c0 0x7ffa2415e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:31.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 >> v1:172.21.15.158:6789/0 conn(0x7ffa240cf1c0 legacy=0x7ffa24068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:31.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa24067f00 con 0x7ffa24159cf0 2023-10-09T06:30:31.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7ffa140017f0 con 0x7ffa24159cf0 2023-10-09T06:30:31.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 >> v1:172.21.15.31:6789/0 conn(0x7ffa24159cf0 legacy=0x7ffa240ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:31.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 --2- 172.21.15.31:0/2402432228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa10003a60 0x7ffa10003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:31.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 --2- 172.21.15.31:0/2402432228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa10004810 0x7ffa10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:31.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 --2- 172.21.15.31:0/2402432228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa100052e0 0x7ffa1000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:31.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa24067660 con 0x7ffa100052e0 2023-10-09T06:30:31.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.061+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1000c190 con 0x7ffa10003a60 2023-10-09T06:30:31.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1000c350 con 0x7ffa10004810 2023-10-09T06:30:31.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa22d9d700 1 --2- 172.21.15.31:0/2402432228 >> v2:172.21.15.158:3300/0 conn(0x7ffa2415a0c0 0x7ffa2415e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:30:31.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa22d9d700 1 --2- 172.21.15.31:0/2402432228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa100052e0 0x7ffa1000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:31.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa2259c700 1 --2- 172.21.15.31:0/2402432228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa10003a60 0x7ffa10003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:31.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa21d9b700 1 --2- 172.21.15.31:0/2402432228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa10004810 0x7ffa10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:31.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa22d9d700 1 -- 172.21.15.31:0/2402432228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa10004810 msgr2=0x7ffa10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:31.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa22d9d700 1 --2- 172.21.15.31:0/2402432228 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa10004810 0x7ffa10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:31.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa22d9d700 1 -- 172.21.15.31:0/2402432228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa10003a60 msgr2=0x7ffa10003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:31.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa22d9d700 1 --2- 172.21.15.31:0/2402432228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa10003a60 0x7ffa10003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:31.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa22d9d700 1 -- 172.21.15.31:0/2402432228 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa10003570 con 0x7ffa100052e0 2023-10-09T06:30:31.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa22d9d700 1 -- 172.21.15.31:0/2402432228 reap_dead start 2023-10-09T06:30:31.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa22d9d700 1 --2- 172.21.15.31:0/2402432228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa100052e0 0x7ffa1000ba60 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c009ba0 tx=0x7ffa1c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18c294bcba93b67 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:31.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c009510 con 0x7ffa100052e0 2023-10-09T06:30:31.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c00e5e0 con 0x7ffa100052e0 2023-10-09T06:30:31.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.062+0000 7ffa2159a700 1 -- 172.21.15.31:0/2402432228 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00e790 con 0x7ffa100052e0 2023-10-09T06:30:31.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.063+0000 7ffa28adf700 1 -- 172.21.15.31:0/2402432228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa100052e0 msgr2=0x7ffa1000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:31.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.063+0000 7ffa28adf700 1 --2- 172.21.15.31:0/2402432228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa100052e0 0x7ffa1000ba60 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c009ba0 tx=0x7ffa1c008040 comp rx=0 tx=0).stop 2023-10-09T06:30:31.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.063+0000 7ffa28adf700 1 -- 172.21.15.31:0/2402432228 shutdown_connections 2023-10-09T06:30:31.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.063+0000 7ffa28adf700 1 --2- 172.21.15.31:0/2402432228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa100052e0 0x7ffa1000ba60 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:31.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.063+0000 7ffa28adf700 1 -- 172.21.15.31:0/2402432228 >> 172.21.15.31:0/2402432228 conn(0x7ffa2406c6e0 msgr2=0x7ffa24069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:31.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.063+0000 7ffa28adf700 1 -- 172.21.15.31:0/2402432228 shutdown_connections 2023-10-09T06:30:31.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.063+0000 7ffa28adf700 1 -- 172.21.15.31:0/2402432228 wait complete. 2023-10-09T06:30:31.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.064+0000 7ffa28adf700 1 Processor -- start 2023-10-09T06:30:31.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.064+0000 7ffa28adf700 1 -- start start 2023-10-09T06:30:31.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa28adf700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa100052e0 0x7ffa24154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:31.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa28adf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa24158d40 0x7ffa240c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:31.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa28adf700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa24157320 0x7ffa240b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:31.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa28adf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa24156e90 con 0x7ffa24158d40 2023-10-09T06:30:31.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa28adf700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa24154e50 con 0x7ffa100052e0 2023-10-09T06:30:31.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa28adf700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa241591e0 con 0x7ffa24157320 2023-10-09T06:30:31.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa21d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa24158d40 0x7ffa240c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:31.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa21d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa24158d40 0x7ffa240c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44180/0 (socket says 172.21.15.31:44180) 2023-10-09T06:30:31.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa21d9b700 1 -- 172.21.15.31:0/335092477 learned_addr learned my addr 172.21.15.31:0/335092477 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:31.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa22d9d700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa24157320 0x7ffa240b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:31.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa2259c700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa100052e0 0x7ffa24154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:31.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa21d9b700 1 -- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa24157320 msgr2=0x7ffa240b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:31.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa21d9b700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa24157320 0x7ffa240b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:31.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa21d9b700 1 -- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa100052e0 msgr2=0x7ffa24154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:31.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa21d9b700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa100052e0 0x7ffa24154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:31.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa21d9b700 1 -- 172.21.15.31:0/335092477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa241594c0 con 0x7ffa24158d40 2023-10-09T06:30:31.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa2259c700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa100052e0 0x7ffa24154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:31.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa21d9b700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa24158d40 0x7ffa240c65b0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c002980 tx=0x7ffa0c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:31.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa1a7fc700 1 -- 172.21.15.31:0/335092477 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c00f8d0 con 0x7ffa24158d40 2023-10-09T06:30:31.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa1a7fc700 1 -- 172.21.15.31:0/335092477 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c00fa30 con 0x7ffa24158d40 2023-10-09T06:30:31.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa1a7fc700 1 -- 172.21.15.31:0/335092477 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c00fdd0 con 0x7ffa24158d40 2023-10-09T06:30:31.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.065+0000 7ffa28adf700 1 -- 172.21.15.31:0/335092477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa24156840 con 0x7ffa24158d40 2023-10-09T06:30:31.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.066+0000 7ffa28adf700 1 -- 172.21.15.31:0/335092477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa240c6af0 con 0x7ffa24158d40 2023-10-09T06:30:31.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.067+0000 7ffa28adf700 1 -- 172.21.15.31:0/335092477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa24157040 con 0x7ffa24158d40 2023-10-09T06:30:31.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.067+0000 7ffa1a7fc700 1 -- 172.21.15.31:0/335092477 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa0c013600 con 0x7ffa24158d40 2023-10-09T06:30:31.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.067+0000 7ffa1a7fc700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffa04066f30 0x7ffa040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:31.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.067+0000 7ffa1a7fc700 1 -- 172.21.15.31:0/335092477 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa0c084770 con 0x7ffa24158d40 2023-10-09T06:30:31.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.068+0000 7ffa2259c700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffa04066f30 0x7ffa040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:31.074 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.068+0000 7ffa2259c700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffa04066f30 0x7ffa040693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffa14001190 tx=0x7ffa14006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:31.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.072+0000 7ffa1a7fc700 1 -- 172.21.15.31:0/335092477 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa24157040 con 0x7ffa24158d40 2023-10-09T06:30:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.308+0000 7ffa28adf700 1 -- 172.21.15.31:0/335092477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffa2415ea40 con 0x7ffa24158d40 2023-10-09T06:30:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.309+0000 7ffa1a7fc700 1 -- 172.21.15.31:0/335092477 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v82) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffa2415ea40 con 0x7ffa24158d40 2023-10-09T06:30:31.310 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:30:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.310+0000 7ffa28adf700 1 -- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffa04066f30 msgr2=0x7ffa040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.310+0000 7ffa28adf700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffa04066f30 0x7ffa040693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffa14001190 tx=0x7ffa14006040 comp rx=0 tx=0).stop 2023-10-09T06:30:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.310+0000 7ffa28adf700 1 -- 172.21.15.31:0/335092477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa24158d40 msgr2=0x7ffa240c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.310+0000 7ffa28adf700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa24158d40 0x7ffa240c65b0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c002980 tx=0x7ffa0c007d30 comp rx=0 tx=0).stop 2023-10-09T06:30:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.311+0000 7ffa28adf700 1 -- 172.21.15.31:0/335092477 shutdown_connections 2023-10-09T06:30:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.311+0000 7ffa28adf700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffa04066f30 0x7ffa040693e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.311+0000 7ffa28adf700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa24157320 0x7ffa240b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.311+0000 7ffa28adf700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa100052e0 0x7ffa24154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.311+0000 7ffa28adf700 1 --2- 172.21.15.31:0/335092477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa24158d40 0x7ffa240c65b0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.311+0000 7ffa28adf700 1 -- 172.21.15.31:0/335092477 >> 172.21.15.31:0/335092477 conn(0x7ffa2406c6e0 msgr2=0x7ffa240c39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.311+0000 7ffa28adf700 1 -- 172.21.15.31:0/335092477 shutdown_connections 2023-10-09T06:30:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:31.311+0000 7ffa28adf700 1 -- 172.21.15.31:0/335092477 wait complete. 2023-10-09T06:30:31.323 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:30:31.323 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:30:31.323 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-10-09T06:30:31.323 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:30:31.323 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:30:31.324 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:30:31.324 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:30:31.324 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:30:31.324 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:30:31.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:31.324 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-10-09T06:30:31.339 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:30:31.339 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:30:31.340 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:30:31.340 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:31.340 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:30:31.340 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:31.341 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:30:31.341 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T06:30:31.341 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-10-09T06:30:31.341 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:30:31.341 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T06:30:31.341 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-10-09T06:30:31.341 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:30:31.342 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-10-09T06:30:31.342 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-10-09T06:30:31.342 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T06:30:31.342 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 41935sec preferred_lft 41935sec 2023-10-09T06:30:31.342 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-10-09T06:30:31.342 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:31.342 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:30:31.343 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:30:31.343 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-10-09T06:30:31.343 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:30:31.343 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:30:31.343 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:30:31.343 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:31.343 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::b4ad:53ff:fed3:a589/64 scope link 2023-10-09T06:30:31.343 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:31.343 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:30:31.343 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether f6:bf:b8:0f:49:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:30:31.344 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::f4bf:b8ff:fe0f:498b/64 scope link 2023-10-09T06:30:31.344 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:31.344 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:30:31.344 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:30:31.344 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::d8ab:b5ff:fe1d:e066/64 scope link 2023-10-09T06:30:31.344 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:31.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:31.345 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:30:31.403 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-10-09T06:30:31.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:31.405 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-10-09T06:30:31.461 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-10-09T06:30:31.462 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:30:31.462 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T06:30:31.462 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T06:30:31.462 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:30:31.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:31.463 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:30:31.463 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:30:31.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T06:30:31.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T06:30:31.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T06:30:31.464 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:30:31.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:31.565 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:30:31.580 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:30:31.580 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:30:31.581 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:30:31.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:31.581 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-10-09T06:30:31.645 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:30:31.646 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:30:31.700 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:30:31.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:30:31.701 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:30:31.755 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:30:31.755 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:30:31.755 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:30:31.837 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:30:31.837 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:30:31.856 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:30:31.856 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:30:31.856 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:30:31.857 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:30:31.857 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:30:31.857 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:30:31.857 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:30:31.857 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:30:31.878 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:30:31.879 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:30:31.879 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:30:31.879 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:30:31.879 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:30:31.879 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:30:31.879 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:30:31.880 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:30:31.880 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:30:31.880 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:30:31.880 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:30:31.881 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:30:31.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:31.882 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:30:31.947 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:30:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.106+0000 7f4ca7a1f700 1 Processor -- start 2023-10-09T06:30:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.106+0000 7f4ca7a1f700 1 -- start start 2023-10-09T06:30:32.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.107+0000 7f4ca7a1f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ca015a1e0 0x7f4ca00cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:32.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.107+0000 7f4ca7a1f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca015db80 con 0x7f4ca0159e10 2023-10-09T06:30:32.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.107+0000 7f4ca7a1f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca015de60 con 0x7f4ca00b3430 2023-10-09T06:30:32.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.107+0000 7f4ca7a1f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca015e800 con 0x7f4ca015a1e0 2023-10-09T06:30:32.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.107+0000 7f4ca57bb700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4ca0159e10 0x7f4ca00b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40526/0 (socket says 172.21.15.31:40526) 2023-10-09T06:30:32.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.107+0000 7f4ca57bb700 1 -- 172.21.15.31:0/1791202823 learned_addr learned my addr 172.21.15.31:0/1791202823 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:32.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.107+0000 7f4ca4fba700 1 --2- 172.21.15.31:0/1791202823 >> v2:172.21.15.158:3300/0 conn(0x7f4ca015a1e0 0x7f4ca00cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:32.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.107+0000 7f4c9ffff700 1 -- 172.21.15.31:0/1791202823 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654188676 0 0) 0x7f4ca015db80 con 0x7f4ca0159e10 2023-10-09T06:30:32.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.108+0000 7f4c9ffff700 1 -- 172.21.15.31:0/1791202823 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c88003570 con 0x7f4ca0159e10 2023-10-09T06:30:32.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.108+0000 7f4c9ffff700 1 -- 172.21.15.31:0/1791202823 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188627251 0 0) 0x7f4ca015de60 con 0x7f4ca00b3430 2023-10-09T06:30:32.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.108+0000 7f4c9ffff700 1 -- 172.21.15.31:0/1791202823 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ca015db80 con 0x7f4ca00b3430 2023-10-09T06:30:32.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.108+0000 7f4ca4fba700 1 -- 172.21.15.31:0/1791202823 >> v1:172.21.15.158:6789/0 conn(0x7f4ca00b3430 legacy=0x7f4ca00cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:32.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.108+0000 7f4ca4fba700 1 -- 172.21.15.31:0/1791202823 >> v1:172.21.15.31:6789/0 conn(0x7f4ca0159e10 legacy=0x7f4ca00b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.108+0000 7f4c9ffff700 1 -- 172.21.15.31:0/1791202823 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3441708013 0 0) 0x7f4c88003570 con 0x7f4ca0159e10 2023-10-09T06:30:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.108+0000 7f4ca4fba700 1 -- 172.21.15.31:0/1791202823 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca015e140 con 0x7f4ca015a1e0 2023-10-09T06:30:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.108+0000 7f4ca4fba700 1 --2- 172.21.15.31:0/1791202823 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ca015a1e0 0x7f4ca00cd740 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4c940098e0 tx=0x7f4c940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ce27d997fc16ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.108+0000 7f4c9ffff700 1 -- 172.21.15.31:0/1791202823 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c900017f0 con 0x7f4ca015a1e0 2023-10-09T06:30:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.108+0000 7f4c9ffff700 1 -- 172.21.15.31:0/1791202823 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c94011420 con 0x7f4ca015a1e0 2023-10-09T06:30:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.108+0000 7f4c9ffff700 1 -- 172.21.15.31:0/1791202823 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c940117c0 con 0x7f4ca015a1e0 2023-10-09T06:30:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.109+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/1791202823 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ca015a1e0 msgr2=0x7f4ca00cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.109+0000 7f4ca7a1f700 1 --2- 172.21.15.31:0/1791202823 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ca015a1e0 0x7f4ca00cd740 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4c940098e0 tx=0x7f4c940091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.109+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/1791202823 shutdown_connections 2023-10-09T06:30:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.109+0000 7f4ca7a1f700 1 --2- 172.21.15.31:0/1791202823 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ca015a1e0 0x7f4ca00cd740 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.109+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/1791202823 >> 172.21.15.31:0/1791202823 conn(0x7f4ca0067660 msgr2=0x7f4ca0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.109+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/1791202823 shutdown_connections 2023-10-09T06:30:32.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.109+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/1791202823 wait complete. 2023-10-09T06:30:32.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.110+0000 7f4ca7a1f700 1 Processor -- start 2023-10-09T06:30:32.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.110+0000 7f4ca7a1f700 1 -- start start 2023-10-09T06:30:32.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca7a1f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ca00b3430 0x7f4ca00c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:32.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca7a1f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca0159e10 0x7f4ca00b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:32.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca7a1f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ca015a1e0 0x7f4ca00b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:32.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca7a1f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00ca3e0 con 0x7f4ca0159e10 2023-10-09T06:30:32.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca7a1f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00c4d60 con 0x7f4ca00b3430 2023-10-09T06:30:32.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca7a1f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00c5040 con 0x7f4ca015a1e0 2023-10-09T06:30:32.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca4fba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca0159e10 0x7f4ca00b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:32.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca4fba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca0159e10 0x7f4ca00b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44184/0 (socket says 172.21.15.31:44184) 2023-10-09T06:30:32.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca4fba700 1 -- 172.21.15.31:0/2568062748 learned_addr learned my addr 172.21.15.31:0/2568062748 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:32.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca57bb700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ca00b3430 0x7f4ca00c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:32.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca5fbc700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ca015a1e0 0x7f4ca00b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:32.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca4fba700 1 -- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ca015a1e0 msgr2=0x7f4ca00b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:32.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca4fba700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ca015a1e0 0x7f4ca00b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:32.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca4fba700 1 -- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ca00b3430 msgr2=0x7f4ca00c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:32.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca4fba700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ca00b3430 0x7f4ca00c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:32.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca4fba700 1 -- 172.21.15.31:0/2568062748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c94009420 con 0x7f4ca0159e10 2023-10-09T06:30:32.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca5fbc700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ca015a1e0 0x7f4ca00b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:32.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca57bb700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ca00b3430 0x7f4ca00c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:30:32.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4ca4fba700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca0159e10 0x7f4ca00b4c70 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f4c94002000 tx=0x7f4c94016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:32.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4c9d7fa700 1 -- 172.21.15.31:0/2568062748 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9401cc90 con 0x7f4ca0159e10 2023-10-09T06:30:32.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.111+0000 7f4c9d7fa700 1 -- 172.21.15.31:0/2568062748 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9401cdf0 con 0x7f4ca0159e10 2023-10-09T06:30:32.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.112+0000 7f4c9d7fa700 1 -- 172.21.15.31:0/2568062748 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c94025680 con 0x7f4ca0159e10 2023-10-09T06:30:32.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.112+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/2568062748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca00c5320 con 0x7f4ca0159e10 2023-10-09T06:30:32.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.112+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/2568062748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca00ca020 con 0x7f4ca0159e10 2023-10-09T06:30:32.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.112+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/2568062748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca004c3c0 con 0x7f4ca0159e10 2023-10-09T06:30:32.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.113+0000 7f4c9d7fa700 1 -- 172.21.15.31:0/2568062748 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c940193f0 con 0x7f4ca0159e10 2023-10-09T06:30:32.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.113+0000 7f4c9d7fa700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c8c066f30 0x7f4c8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:32.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.113+0000 7f4c9d7fa700 1 -- 172.21.15.31:0/2568062748 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c94085770 con 0x7f4ca0159e10 2023-10-09T06:30:32.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.114+0000 7f4ca57bb700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c8c066f30 0x7f4c8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:32.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.114+0000 7f4ca57bb700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c8c066f30 0x7f4c8c0693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4c90001920 tx=0x7f4c90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:32.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.118+0000 7f4c9d7fa700 1 -- 172.21.15.31:0/2568062748 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c94052a60 con 0x7f4ca0159e10 2023-10-09T06:30:32.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.355+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/2568062748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4ca015e420 con 0x7f4ca0159e10 2023-10-09T06:30:32.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.356+0000 7f4c9d7fa700 1 -- 172.21.15.31:0/2568062748 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v82) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4c94056080 con 0x7f4ca0159e10 2023-10-09T06:30:32.357 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:30:32.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.358+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c8c066f30 msgr2=0x7f4c8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:32.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.358+0000 7f4ca7a1f700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c8c066f30 0x7f4c8c0693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4c90001920 tx=0x7f4c90009040 comp rx=0 tx=0).stop 2023-10-09T06:30:32.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.358+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/2568062748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca0159e10 msgr2=0x7f4ca00b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:32.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.358+0000 7f4ca7a1f700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca0159e10 0x7f4ca00b4c70 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f4c94002000 tx=0x7f4c94016000 comp rx=0 tx=0).stop 2023-10-09T06:30:32.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.358+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/2568062748 shutdown_connections 2023-10-09T06:30:32.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.358+0000 7f4ca7a1f700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c8c066f30 0x7f4c8c0693e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:32.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.358+0000 7f4ca7a1f700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ca015a1e0 0x7f4ca00b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:32.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.358+0000 7f4ca7a1f700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ca00b3430 0x7f4ca00c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:32.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.358+0000 7f4ca7a1f700 1 --2- 172.21.15.31:0/2568062748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca0159e10 0x7f4ca00b4c70 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:32.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.358+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/2568062748 >> 172.21.15.31:0/2568062748 conn(0x7f4ca0067660 msgr2=0x7f4ca0156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:32.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.358+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/2568062748 shutdown_connections 2023-10-09T06:30:32.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:32.358+0000 7f4ca7a1f700 1 -- 172.21.15.31:0/2568062748 wait complete. 2023-10-09T06:30:32.370 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:30:32.370 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:30:32.371 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-09T06:30:32.371 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T06:30:32.371 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T06:30:32.371 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:30:32.371 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:30:32.371 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:30:32.371 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:30:32.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:32.371 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-09T06:30:32.390 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:30:32.390 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:30:32.390 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:30:32.391 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:32.391 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:30:32.391 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:32.391 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:30:32.391 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:30:32.391 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-09T06:30:32.391 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:30:32.392 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:30:32.392 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-09T06:30:32.392 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:30:32.392 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-09T06:30:32.392 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:30:32.392 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:30:32.392 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:30:32.392 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 41961sec preferred_lft 41961sec 2023-10-09T06:30:32.392 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-09T06:30:32.392 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:32.392 INFO:teuthology.orchestra.run.smithi158.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:30:32.393 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:30:32.393 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:30:32.393 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:32.393 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::c5:35ff:fec9:1844/64 scope link 2023-10-09T06:30:32.393 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:32.393 INFO:teuthology.orchestra.run.smithi158.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:30:32.393 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether e6:10:14:7c:a4:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:30:32.393 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::e410:14ff:fe7c:a4d7/64 scope link 2023-10-09T06:30:32.393 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:32.393 INFO:teuthology.orchestra.run.smithi158.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:30:32.393 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T06:30:32.393 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::44a9:f1ff:fe2b:babb/64 scope link 2023-10-09T06:30:32.394 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:30:32.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:32.394 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:30:32.458 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-09T06:30:32.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:32.460 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-09T06:30:32.519 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-09T06:30:32.519 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:30:32.520 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:30:32.520 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:30:32.520 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:30:32.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:32.521 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:30:32.521 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:30:32.521 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:30:32.521 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:30:32.521 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:30:32.521 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:30:32.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:32.625 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:30:32.640 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T06:30:32.640 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T06:30:32.641 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:30:32.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:32.641 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-09T06:30:32.705 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:30:32.706 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T06:30:32.760 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:30:32.760 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:30:32.761 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:30:32.814 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T06:30:32.815 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:30:32.815 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:30:32.895 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:30:32.895 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:30:32.913 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:30:32.914 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:30:32.914 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:30:32.914 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:30:32.914 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:30:32.914 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:30:32.914 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:30:32.914 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:30:32.935 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:30:32.935 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:30:32.935 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:30:32.936 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:30:32.936 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:30:32.936 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:30:32.936 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:30:32.936 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:30:32.936 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:30:32.936 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:30:32.936 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:30:32.937 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:30:32.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:30:32.937 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:30:33.003 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:30:33.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.132+0000 7f94aad84700 1 Processor -- start 2023-10-09T06:30:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.132+0000 7f94aad84700 1 -- start start 2023-10-09T06:30:33.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94aad84700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f94a415a2b0 0x7f94a40b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:33.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94aad84700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f94a40cfe20 0x7f94a40ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:33.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94aad84700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a40c5d80 con 0x7f94a40d1c30 2023-10-09T06:30:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94aad84700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a4068470 con 0x7f94a415a2b0 2023-10-09T06:30:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94aad84700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a40c6060 con 0x7f94a40cfe20 2023-10-09T06:30:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94a8b20700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f94a415a2b0 0x7f94a40b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94a8b20700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f94a415a2b0 0x7f94a40b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44198/0 (socket says 172.21.15.31:44198) 2023-10-09T06:30:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94a8b20700 1 -- 172.21.15.31:0/3683535449 learned_addr learned my addr 172.21.15.31:0/3683535449 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94a9321700 1 --2- 172.21.15.31:0/3683535449 >> v2:172.21.15.158:3300/0 conn(0x7f94a40cfe20 0x7f94a40ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94a8b20700 1 -- 172.21.15.31:0/3683535449 >> v2:172.21.15.158:3300/0 conn(0x7f94a40cfe20 msgr2=0x7f94a40ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:30:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94a8b20700 1 --2- 172.21.15.31:0/3683535449 >> v2:172.21.15.158:3300/0 conn(0x7f94a40cfe20 0x7f94a40ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94a8b20700 1 -- 172.21.15.31:0/3683535449 >> v1:172.21.15.158:6789/0 conn(0x7f94a40d1c30 legacy=0x7f94a40cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94a8b20700 1 -- 172.21.15.31:0/3683535449 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a40c6340 con 0x7f94a415a2b0 2023-10-09T06:30:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94a8b20700 1 --2- 172.21.15.31:0/3683535449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a415a2b0 0x7f94a40b3da0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f94a4064970 tx=0x7f949c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5904e76dbdd991b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94a37fe700 1 -- 172.21.15.31:0/3683535449 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c00e070 con 0x7f94a415a2b0 2023-10-09T06:30:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94a37fe700 1 -- 172.21.15.31:0/3683535449 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c00ba20 con 0x7f94a415a2b0 2023-10-09T06:30:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.133+0000 7f94a37fe700 1 -- 172.21.15.31:0/3683535449 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0092e0 con 0x7f94a415a2b0 2023-10-09T06:30:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.134+0000 7f94aad84700 1 -- 172.21.15.31:0/3683535449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a415a2b0 msgr2=0x7f94a40b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.134+0000 7f94aad84700 1 --2- 172.21.15.31:0/3683535449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a415a2b0 0x7f94a40b3da0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f94a4064970 tx=0x7f949c009840 comp rx=0 tx=0).stop 2023-10-09T06:30:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.134+0000 7f94aad84700 1 -- 172.21.15.31:0/3683535449 shutdown_connections 2023-10-09T06:30:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.134+0000 7f94aad84700 1 --2- 172.21.15.31:0/3683535449 >> v2:172.21.15.158:3300/0 conn(0x7f94a40cfe20 0x7f94a40ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.134+0000 7f94aad84700 1 --2- 172.21.15.31:0/3683535449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a415a2b0 0x7f94a40b3da0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.134+0000 7f94aad84700 1 -- 172.21.15.31:0/3683535449 >> 172.21.15.31:0/3683535449 conn(0x7f94a4067e40 msgr2=0x7f94a40d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.134+0000 7f94aad84700 1 -- 172.21.15.31:0/3683535449 shutdown_connections 2023-10-09T06:30:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.134+0000 7f94aad84700 1 -- 172.21.15.31:0/3683535449 wait complete. 2023-10-09T06:30:33.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.135+0000 7f94aad84700 1 Processor -- start 2023-10-09T06:30:33.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.135+0000 7f94aad84700 1 -- start start 2023-10-09T06:30:33.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94aad84700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94a40cfe20 0x7f94a415a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:33.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94aad84700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a40d1c30 0x7f94a415fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:33.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94aad84700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a415a2b0 0x7f94a414b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:33.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94aad84700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a415de70 con 0x7f94a415a2b0 2023-10-09T06:30:33.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94aad84700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a415abc0 con 0x7f94a40cfe20 2023-10-09T06:30:33.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94aad84700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a416e540 con 0x7f94a40d1c30 2023-10-09T06:30:33.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94a9321700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a415a2b0 0x7f94a414b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:33.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94a9321700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a415a2b0 0x7f94a414b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44202/0 (socket says 172.21.15.31:44202) 2023-10-09T06:30:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94a9321700 1 -- 172.21.15.31:0/1055821976 learned_addr learned my addr 172.21.15.31:0/1055821976 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94a8b20700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94a40cfe20 0x7f94a415a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94a3fff700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a40d1c30 0x7f94a415fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94a9321700 1 -- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a40d1c30 msgr2=0x7f94a415fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94a9321700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a40d1c30 0x7f94a415fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94a9321700 1 -- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94a40cfe20 msgr2=0x7f94a415a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94a9321700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94a40cfe20 0x7f94a415a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.136+0000 7f94a9321700 1 -- 172.21.15.31:0/1055821976 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c009ae0 con 0x7f94a415a2b0 2023-10-09T06:30:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.137+0000 7f94a9321700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a415a2b0 0x7f94a414b690 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f948c00e900 tx=0x7f948c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.137+0000 7f94a0ff9700 1 -- 172.21.15.31:0/1055821976 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c013680 con 0x7f94a415a2b0 2023-10-09T06:30:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.137+0000 7f94a0ff9700 1 -- 172.21.15.31:0/1055821976 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c0137e0 con 0x7f94a415a2b0 2023-10-09T06:30:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.137+0000 7f94aad84700 1 -- 172.21.15.31:0/1055821976 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a4158e50 con 0x7f94a415a2b0 2023-10-09T06:30:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.137+0000 7f94a0ff9700 1 -- 172.21.15.31:0/1055821976 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c013ba0 con 0x7f94a415a2b0 2023-10-09T06:30:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.137+0000 7f94aad84700 1 -- 172.21.15.31:0/1055821976 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a416def0 con 0x7f94a415a2b0 2023-10-09T06:30:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.138+0000 7f94aad84700 1 -- 172.21.15.31:0/1055821976 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a404c3c0 con 0x7f94a415a2b0 2023-10-09T06:30:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.138+0000 7f94a0ff9700 1 -- 172.21.15.31:0/1055821976 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f948c0123d0 con 0x7f94a415a2b0 2023-10-09T06:30:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.139+0000 7f94a0ff9700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9484066f30 0x7f94840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.139+0000 7f94a0ff9700 1 -- 172.21.15.31:0/1055821976 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f948c084560 con 0x7f94a415a2b0 2023-10-09T06:30:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.139+0000 7f94a8b20700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9484066f30 0x7f94840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.139+0000 7f94a8b20700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9484066f30 0x7f94840693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f949c009fd0 tx=0x7f949c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.143+0000 7f94a0ff9700 1 -- 172.21.15.31:0/1055821976 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f948c0517d0 con 0x7f94a415a2b0 2023-10-09T06:30:33.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.380+0000 7f94aad84700 1 -- 172.21.15.31:0/1055821976 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94a4089fa0 con 0x7f94a415a2b0 2023-10-09T06:30:33.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.380+0000 7f94a0ff9700 1 -- 172.21.15.31:0/1055821976 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f948c054df0 con 0x7f94a415a2b0 2023-10-09T06:30:33.381 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:30:33.381 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1455840229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1455840229},{"type":"v1","addr":"172.21.15.158:6837","nonce":1455840229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7770,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3156917195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3156917195},{"type":"v1","addr":"172.21.15.31:6834","nonce":3156917195}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1537057825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1537057825},{"type":"v1","addr":"172.21.15.31:6835","nonce":1537057825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:30:24.382245+0000","modified":"2023-10-09T06:30:28.019930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7782":{"gid":7782,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/3592438876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3592438876},{"type":"v1","addr":"172.21.15.158:6836","nonce":3592438876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T06:30:33.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.383+0000 7f94aad84700 1 -- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9484066f30 msgr2=0x7f94840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:33.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.383+0000 7f94aad84700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9484066f30 0x7f94840693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f949c009fd0 tx=0x7f949c018000 comp rx=0 tx=0).stop 2023-10-09T06:30:33.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.383+0000 7f94aad84700 1 -- 172.21.15.31:0/1055821976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a415a2b0 msgr2=0x7f94a414b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:33.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.383+0000 7f94aad84700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a415a2b0 0x7f94a414b690 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f948c00e900 tx=0x7f948c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:30:33.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.383+0000 7f94aad84700 1 -- 172.21.15.31:0/1055821976 shutdown_connections 2023-10-09T06:30:33.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.383+0000 7f94aad84700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9484066f30 0x7f94840693e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:33.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.383+0000 7f94aad84700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a415a2b0 0x7f94a414b690 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:33.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.383+0000 7f94aad84700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f94a40cfe20 0x7f94a415a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:33.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.383+0000 7f94aad84700 1 --2- 172.21.15.31:0/1055821976 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f94a40d1c30 0x7f94a415fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:33.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.383+0000 7f94aad84700 1 -- 172.21.15.31:0/1055821976 >> 172.21.15.31:0/1055821976 conn(0x7f94a4067e40 msgr2=0x7f94a406a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:33.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.383+0000 7f94aad84700 1 -- 172.21.15.31:0/1055821976 shutdown_connections 2023-10-09T06:30:33.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.383+0000 7f94aad84700 1 -- 172.21.15.31:0/1055821976 wait complete. 2023-10-09T06:30:33.385 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 82 2023-10-09T06:30:33.396 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-09T06:30:33.528 INFO:teuthology.orchestra.run.smithi158.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":7782,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5115755499999999,"mdsmap_epoch":82,"osdmap_epoch":168,"osdmap_epoch_barrier":168,"uptime":13.600015625999999} 2023-10-09T06:30:33.529 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 7782, "mdsmap_epoch": 82, "osdmap_epoch": 168, "osdmap_epoch_barrier": 168, "rank_uptime": 8.51157555, "state": "up:active", "uptime": 13.600015626, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:30:33.530 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-09T06:30:33.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.653+0000 7f10e20d2700 1 Processor -- start 2023-10-09T06:30:33.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.653+0000 7f10e20d2700 1 -- start start 2023-10-09T06:30:33.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.654+0000 7f10e20d2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f10dc068af0 0x7f10dc0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:33.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.654+0000 7f10e20d2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc0aff80 con 0x7f10dc068ec0 2023-10-09T06:30:33.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.654+0000 7f10e20d2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc0b0350 con 0x7f10dc0b1950 2023-10-09T06:30:33.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.654+0000 7f10e20d2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc0b15c0 con 0x7f10dc068af0 2023-10-09T06:30:33.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.654+0000 7f10daffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f10dc068ec0 0x7f10dc15aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40540/0 (socket says 172.21.15.31:40540) 2023-10-09T06:30:33.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.654+0000 7f10daffd700 1 -- 172.21.15.31:0/3611117191 learned_addr learned my addr 172.21.15.31:0/3611117191 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:30:33.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.654+0000 7f10db7fe700 1 --2- 172.21.15.31:0/3611117191 >> v2:172.21.15.158:3300/0 conn(0x7f10dc068af0 0x7f10dc0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:33.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.654+0000 7f10da7fc700 1 -- 172.21.15.31:0/3611117191 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648783066 0 0) 0x7f10dc0aff80 con 0x7f10dc068ec0 2023-10-09T06:30:33.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.654+0000 7f10da7fc700 1 -- 172.21.15.31:0/3611117191 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c8003570 con 0x7f10dc068ec0 2023-10-09T06:30:33.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.654+0000 7f10db7fe700 1 -- 172.21.15.31:0/3611117191 >> v1:172.21.15.158:6789/0 conn(0x7f10dc0b1950 legacy=0x7f10dc0af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:33.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.654+0000 7f10da7fc700 1 -- 172.21.15.31:0/3611117191 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338027428 0 0) 0x7f10dc0b0350 con 0x7f10dc0b1950 2023-10-09T06:30:33.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.654+0000 7f10db7fe700 1 -- 172.21.15.31:0/3611117191 >> v1:172.21.15.31:6789/0 conn(0x7f10dc068ec0 legacy=0x7f10dc15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:33.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.654+0000 7f10db7fe700 1 -- 172.21.15.31:0/3611117191 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc0b0bf0 con 0x7f10dc068af0 2023-10-09T06:30:33.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.655+0000 7f10db7fe700 1 --2- 172.21.15.31:0/3611117191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10dc068af0 0x7f10dc0b1080 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009e60 tx=0x7f10cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=774ac31ebd770692 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:33.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.655+0000 7f10da7fc700 1 -- 172.21.15.31:0/3611117191 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc00e070 con 0x7f10dc068af0 2023-10-09T06:30:33.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.655+0000 7f10da7fc700 1 -- 172.21.15.31:0/3611117191 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc00bb60 con 0x7f10dc068af0 2023-10-09T06:30:33.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.655+0000 7f10da7fc700 1 -- 172.21.15.31:0/3611117191 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc012430 con 0x7f10dc068af0 2023-10-09T06:30:33.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.655+0000 7f10e20d2700 1 -- 172.21.15.31:0/3611117191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10dc068af0 msgr2=0x7f10dc0b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:33.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.655+0000 7f10e20d2700 1 --2- 172.21.15.31:0/3611117191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10dc068af0 0x7f10dc0b1080 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009e60 tx=0x7f10cc009780 comp rx=0 tx=0).stop 2023-10-09T06:30:33.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.655+0000 7f10e20d2700 1 -- 172.21.15.31:0/3611117191 shutdown_connections 2023-10-09T06:30:33.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.655+0000 7f10e20d2700 1 --2- 172.21.15.31:0/3611117191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10dc068af0 0x7f10dc0b1080 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:33.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.655+0000 7f10e20d2700 1 -- 172.21.15.31:0/3611117191 >> 172.21.15.31:0/3611117191 conn(0x7f10dc069870 msgr2=0x7f10dc069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:33.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.655+0000 7f10e20d2700 1 -- 172.21.15.31:0/3611117191 shutdown_connections 2023-10-09T06:30:33.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.655+0000 7f10e20d2700 1 -- 172.21.15.31:0/3611117191 wait complete. 2023-10-09T06:30:33.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.657+0000 7f10e20d2700 1 Processor -- start 2023-10-09T06:30:33.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.657+0000 7f10e20d2700 1 -- start start 2023-10-09T06:30:33.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.657+0000 7f10e20d2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10dc068af0 0x7f10dc14a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:33.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.657+0000 7f10e20d2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10dc068ec0 0x7f10dc0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:33.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.657+0000 7f10e20d2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10dc0b1950 0x7f10dc0b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:33.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.657+0000 7f10e20d2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0c9a00 con 0x7f10dc068ec0 2023-10-09T06:30:33.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.657+0000 7f10e20d2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc14ac40 con 0x7f10dc0b1950 2023-10-09T06:30:33.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.657+0000 7f10e20d2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0cabf0 con 0x7f10dc068af0 2023-10-09T06:30:33.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.657+0000 7f10daffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10dc068ec0 0x7f10dc0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:33.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.657+0000 7f10daffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10dc068ec0 0x7f10dc0b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44212/0 (socket says 172.21.15.31:44212) 2023-10-09T06:30:33.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.657+0000 7f10daffd700 1 -- 172.21.15.31:0/71994652 learned_addr learned my addr 172.21.15.31:0/71994652 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:30:33.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.657+0000 7f10dbfff700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10dc0b1950 0x7f10dc0b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:33.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.658+0000 7f10db7fe700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10dc068af0 0x7f10dc14a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:33.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.658+0000 7f10daffd700 1 -- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10dc068af0 msgr2=0x7f10dc14a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:33.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.658+0000 7f10daffd700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10dc068af0 0x7f10dc14a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:33.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.658+0000 7f10daffd700 1 -- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10dc0b1950 msgr2=0x7f10dc0b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:33.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.658+0000 7f10daffd700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10dc0b1950 0x7f10dc0b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:33.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.658+0000 7f10daffd700 1 -- 172.21.15.31:0/71994652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc009a20 con 0x7f10dc068ec0 2023-10-09T06:30:33.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.658+0000 7f10daffd700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10dc068ec0 0x7f10dc0b3490 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c790 tx=0x7f10c4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:33.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.658+0000 7f10d37fe700 1 -- 172.21.15.31:0/71994652 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4005b30 con 0x7f10dc068ec0 2023-10-09T06:30:33.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.658+0000 7f10d37fe700 1 -- 172.21.15.31:0/71994652 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4005c90 con 0x7f10dc068ec0 2023-10-09T06:30:33.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.658+0000 7f10e20d2700 1 -- 172.21.15.31:0/71994652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc0ca2c0 con 0x7f10dc068ec0 2023-10-09T06:30:33.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.658+0000 7f10d37fe700 1 -- 172.21.15.31:0/71994652 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4007320 con 0x7f10dc068ec0 2023-10-09T06:30:33.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.658+0000 7f10e20d2700 1 -- 172.21.15.31:0/71994652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc0ca880 con 0x7f10dc068ec0 2023-10-09T06:30:33.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.659+0000 7f10e20d2700 1 -- 172.21.15.31:0/71994652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc06b900 con 0x7f10dc068ec0 2023-10-09T06:30:33.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.660+0000 7f10d37fe700 1 -- 172.21.15.31:0/71994652 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10c4007690 con 0x7f10dc068ec0 2023-10-09T06:30:33.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.660+0000 7f10d37fe700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f10bc066f30 0x7f10bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:30:33.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.660+0000 7f10d37fe700 1 -- 172.21.15.31:0/71994652 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10c4083950 con 0x7f10dc068ec0 2023-10-09T06:30:33.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.660+0000 7f10db7fe700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f10bc066f30 0x7f10bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:30:33.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.661+0000 7f10db7fe700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f10bc066f30 0x7f10bc0693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0099f0 tx=0x7f10cc019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:30:33.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.664+0000 7f10d37fe700 1 -- 172.21.15.31:0/71994652 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10c4050bc0 con 0x7f10dc068ec0 2023-10-09T06:30:33.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:33.859+0000 7f10e20d2700 1 -- 172.21.15.31:0/71994652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f10dc04c3c0 con 0x7f10dc068ec0 2023-10-09T06:30:34.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:34.045+0000 7f10d37fe700 1 -- 172.21.15.31:0/71994652 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v169) v1 ==== 181+0+0 (secure 0 0 0) 0x7f10c4017020 con 0x7f10dc068ec0 2023-10-09T06:30:34.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:34.047+0000 7f10e20d2700 1 -- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f10bc066f30 msgr2=0x7f10bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:34.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:34.047+0000 7f10e20d2700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f10bc066f30 0x7f10bc0693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0099f0 tx=0x7f10cc019000 comp rx=0 tx=0).stop 2023-10-09T06:30:34.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:34.047+0000 7f10e20d2700 1 -- 172.21.15.31:0/71994652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10dc068ec0 msgr2=0x7f10dc0b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:30:34.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:34.047+0000 7f10e20d2700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10dc068ec0 0x7f10dc0b3490 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c790 tx=0x7f10c4007df0 comp rx=0 tx=0).stop 2023-10-09T06:30:34.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:34.047+0000 7f10e20d2700 1 -- 172.21.15.31:0/71994652 shutdown_connections 2023-10-09T06:30:34.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:34.047+0000 7f10e20d2700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f10bc066f30 0x7f10bc0693e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:34.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:34.047+0000 7f10e20d2700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f10dc068af0 0x7f10dc14a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:34.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:34.047+0000 7f10e20d2700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f10dc0b1950 0x7f10dc0b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:34.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:34.047+0000 7f10e20d2700 1 --2- 172.21.15.31:0/71994652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10dc068ec0 0x7f10dc0b3490 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:30:34.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:34.047+0000 7f10e20d2700 1 -- 172.21.15.31:0/71994652 >> 172.21.15.31:0/71994652 conn(0x7f10dc069870 msgr2=0x7f10dc0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:30:34.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:34.047+0000 7f10e20d2700 1 -- 172.21.15.31:0/71994652 shutdown_connections 2023-10-09T06:30:34.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:30:34.047+0000 7f10e20d2700 1 -- 172.21.15.31:0/71994652 wait complete. 2023-10-09T06:30:34.049 INFO:teuthology.orchestra.run.smithi031.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-09T06:30:34.061 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T06:30:34.195 INFO:teuthology.orchestra.run.smithi031.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T06:30:34.196 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T06:30:34.196 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-09T06:30:34.325 INFO:teuthology.orchestra.run.smithi031.stdout:{"mon_tick_interval":"5"} 2023-10-09T06:30:34.325 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-09T06:30:34.326 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-09T06:30:34.326 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T06:30:34.326 DEBUG:teuthology.orchestra.run.smithi031:> import time 2023-10-09T06:30:34.326 DEBUG:teuthology.orchestra.run.smithi031:> import datetime 2023-10-09T06:30:34.326 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2023-10-09T06:30:34.327 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-10-09T06:30:34.327 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:30:34.327 DEBUG:teuthology.orchestra.run.smithi031:> # Write some buffered data through before going full, all should be well 2023-10-09T06:30:34.327 DEBUG:teuthology.orchestra.run.smithi031:> print("writing some data through which we expect to succeed") 2023-10-09T06:30:34.327 DEBUG:teuthology.orchestra.run.smithi031:> bytes = 0 2023-10-09T06:30:34.328 DEBUG:teuthology.orchestra.run.smithi031:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-09T06:30:34.328 DEBUG:teuthology.orchestra.run.smithi031:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-09T06:30:34.328 DEBUG:teuthology.orchestra.run.smithi031:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-09T06:30:34.328 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(f) 2023-10-09T06:30:34.328 DEBUG:teuthology.orchestra.run.smithi031:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-09T06:30:34.328 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:30:34.329 DEBUG:teuthology.orchestra.run.smithi031:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-09T06:30:34.329 DEBUG:teuthology.orchestra.run.smithi031:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-09T06:30:34.329 DEBUG:teuthology.orchestra.run.smithi031:> # buffered IO, the error should always only appear from fsync and not 2023-10-09T06:30:34.329 DEBUG:teuthology.orchestra.run.smithi031:> # from write 2023-10-09T06:30:34.329 DEBUG:teuthology.orchestra.run.smithi031:> full = False 2023-10-09T06:30:34.329 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:30:34.330 DEBUG:teuthology.orchestra.run.smithi031:> for n in range(0, int(32 * 1.1)): 2023-10-09T06:30:34.330 DEBUG:teuthology.orchestra.run.smithi031:> try: 2023-10-09T06:30:34.330 DEBUG:teuthology.orchestra.run.smithi031:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-09T06:30:34.330 DEBUG:teuthology.orchestra.run.smithi031:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-09T06:30:34.330 DEBUG:teuthology.orchestra.run.smithi031:> except OSError as e: 2023-10-09T06:30:34.330 DEBUG:teuthology.orchestra.run.smithi031:> if False: 2023-10-09T06:30:34.331 DEBUG:teuthology.orchestra.run.smithi031:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-09T06:30:34.331 DEBUG:teuthology.orchestra.run.smithi031:> raise 2023-10-09T06:30:34.331 DEBUG:teuthology.orchestra.run.smithi031:> else: 2023-10-09T06:30:34.331 DEBUG:teuthology.orchestra.run.smithi031:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-09T06:30:34.331 DEBUG:teuthology.orchestra.run.smithi031:> full = True 2023-10-09T06:30:34.331 DEBUG:teuthology.orchestra.run.smithi031:> break 2023-10-09T06:30:34.332 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:30:34.332 DEBUG:teuthology.orchestra.run.smithi031:> try: 2023-10-09T06:30:34.332 DEBUG:teuthology.orchestra.run.smithi031:> os.fsync(f) 2023-10-09T06:30:34.332 DEBUG:teuthology.orchestra.run.smithi031:> print("fsync'"'"'ed successfully") 2023-10-09T06:30:34.333 DEBUG:teuthology.orchestra.run.smithi031:> except OSError as e: 2023-10-09T06:30:34.333 DEBUG:teuthology.orchestra.run.smithi031:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-09T06:30:34.333 DEBUG:teuthology.orchestra.run.smithi031:> full = True 2023-10-09T06:30:34.333 DEBUG:teuthology.orchestra.run.smithi031:> break 2023-10-09T06:30:34.334 DEBUG:teuthology.orchestra.run.smithi031:> else: 2023-10-09T06:30:34.334 DEBUG:teuthology.orchestra.run.smithi031:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-09T06:30:34.334 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:30:34.334 DEBUG:teuthology.orchestra.run.smithi031:> if n > 32 * 0.9: 2023-10-09T06:30:34.334 DEBUG:teuthology.orchestra.run.smithi031:> # Be cautious in the last region where we expect to hit 2023-10-09T06:30:34.335 DEBUG:teuthology.orchestra.run.smithi031:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-09T06:30:34.335 DEBUG:teuthology.orchestra.run.smithi031:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-09T06:30:34.335 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(15.0) 2023-10-09T06:30:34.335 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:30:34.335 DEBUG:teuthology.orchestra.run.smithi031:> if not full: 2023-10-09T06:30:34.335 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-09T06:30:34.336 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:30:34.336 DEBUG:teuthology.orchestra.run.smithi031:> # close() should not raise an error because we already caught it in 2023-10-09T06:30:34.336 DEBUG:teuthology.orchestra.run.smithi031:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-09T06:30:34.337 DEBUG:teuthology.orchestra.run.smithi031:> # since then because all IOs got cancelled on the full flag. 2023-10-09T06:30:34.337 DEBUG:teuthology.orchestra.run.smithi031:> print("calling close") 2023-10-09T06:30:34.337 DEBUG:teuthology.orchestra.run.smithi031:> os.close(f) 2023-10-09T06:30:34.338 DEBUG:teuthology.orchestra.run.smithi031:> print("close() did not raise error") 2023-10-09T06:30:34.338 DEBUG:teuthology.orchestra.run.smithi031:> 2023-10-09T06:30:34.338 DEBUG:teuthology.orchestra.run.smithi031:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-09T06:30:34.338 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-10-09T06:30:57.054 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:30:57.057 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:31:27.124 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:31:27.129 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:31:35.078 INFO:teuthology.orchestra.run.smithi031.stdout:writing some data through which we expect to succeed 2023-10-09T06:31:35.078 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-09T06:31:35.078 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 1.00 MB 2023-10-09T06:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 2.00 MB 2023-10-09T06:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 3.00 MB 2023-10-09T06:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 4.00 MB 2023-10-09T06:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 5.00 MB 2023-10-09T06:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 6.00 MB 2023-10-09T06:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 7.00 MB 2023-10-09T06:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 8.00 MB 2023-10-09T06:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 9.00 MB 2023-10-09T06:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 10.00 MB 2023-10-09T06:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 11.00 MB 2023-10-09T06:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 12.00 MB 2023-10-09T06:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 13.00 MB 2023-10-09T06:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 14.00 MB 2023-10-09T06:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 15.00 MB 2023-10-09T06:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 16.00 MB 2023-10-09T06:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 17.00 MB 2023-10-09T06:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 18.00 MB 2023-10-09T06:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 19.00 MB 2023-10-09T06:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 20.00 MB 2023-10-09T06:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 21.00 MB 2023-10-09T06:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 22.00 MB 2023-10-09T06:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 23.00 MB 2023-10-09T06:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 24.00 MB 2023-10-09T06:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 25.00 MB 2023-10-09T06:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 26.00 MB 2023-10-09T06:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 27.00 MB 2023-10-09T06:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 28.00 MB 2023-10-09T06:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 29.00 MB 2023-10-09T06:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 30.00 MB 2023-10-09T06:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 31.00 MB 2023-10-09T06:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 32.00 MB 2023-10-09T06:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T06:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout:fsync'ed successfully 2023-10-09T06:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout:Not full yet after 33.00 MB 2023-10-09T06:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T06:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout:Reached fullness after 33.00 MB 2023-10-09T06:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout:calling close 2023-10-09T06:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout:close() did not raise error 2023-10-09T06:31:35.282 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:31:35.282 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:31:35.339 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:31:35.380 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:31:35.380 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:31:35.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:31:35.380 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:31:35.425 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:31:35.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:35.425 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:31:35.482 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T06:31:35.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:31:35.483 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T06:31:35.527 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:31:35.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:35.527 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T06:31:35.544 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:31:35.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.668+0000 7fad0b78f700 1 Processor -- start 2023-10-09T06:31:35.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.669+0000 7fad0b78f700 1 -- start start 2023-10-09T06:31:35.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.669+0000 7fad0b78f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fad040ade00 0x7fad04161b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:35.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.669+0000 7fad0b78f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad040c9cb0 con 0x7fad040c75c0 2023-10-09T06:31:35.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.669+0000 7fad0b78f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad040c90a0 con 0x7fad040abae0 2023-10-09T06:31:35.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.669+0000 7fad0b78f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad040c9380 con 0x7fad040ade00 2023-10-09T06:31:35.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad08d2a700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fad040c75c0 0x7fad040c8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48184/0 (socket says 172.21.15.31:48184) 2023-10-09T06:31:35.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad08d2a700 1 -- 172.21.15.31:0/2310468163 learned_addr learned my addr 172.21.15.31:0/2310468163 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:35.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad09d2c700 1 --2- 172.21.15.31:0/2310468163 >> v2:172.21.15.158:3300/0 conn(0x7fad040ade00 0x7fad04161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:35.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad03fff700 1 -- 172.21.15.31:0/2310468163 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793697269 0 0) 0x7fad040c9cb0 con 0x7fad040c75c0 2023-10-09T06:31:35.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad03fff700 1 -- 172.21.15.31:0/2310468163 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facec003570 con 0x7fad040c75c0 2023-10-09T06:31:35.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad03fff700 1 -- 172.21.15.31:0/2310468163 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461333624 0 0) 0x7fad040c90a0 con 0x7fad040abae0 2023-10-09T06:31:35.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad03fff700 1 -- 172.21.15.31:0/2310468163 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad040c9cb0 con 0x7fad040abae0 2023-10-09T06:31:35.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad09d2c700 1 -- 172.21.15.31:0/2310468163 >> v1:172.21.15.158:6789/0 conn(0x7fad040abae0 legacy=0x7fad040c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:35.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad09d2c700 1 -- 172.21.15.31:0/2310468163 >> v1:172.21.15.31:6789/0 conn(0x7fad040c75c0 legacy=0x7fad040c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:35.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad09d2c700 1 -- 172.21.15.31:0/2310468163 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040c9660 con 0x7fad040ade00 2023-10-09T06:31:35.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad09d2c700 1 --2- 172.21.15.31:0/2310468163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad040ade00 0x7fad04161b40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7facfc009e60 tx=0x7facfc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=353a6bc0c807a2b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:35.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad03fff700 1 -- 172.21.15.31:0/2310468163 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00e070 con 0x7fad040ade00 2023-10-09T06:31:35.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad03fff700 1 -- 172.21.15.31:0/2310468163 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc00bab0 con 0x7fad040ade00 2023-10-09T06:31:35.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.670+0000 7fad03fff700 1 -- 172.21.15.31:0/2310468163 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00be70 con 0x7fad040ade00 2023-10-09T06:31:35.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.671+0000 7fad0b78f700 1 -- 172.21.15.31:0/2310468163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad040ade00 msgr2=0x7fad04161b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:35.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.671+0000 7fad0b78f700 1 --2- 172.21.15.31:0/2310468163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad040ade00 0x7fad04161b40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7facfc009e60 tx=0x7facfc009780 comp rx=0 tx=0).stop 2023-10-09T06:31:35.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.671+0000 7fad0b78f700 1 -- 172.21.15.31:0/2310468163 shutdown_connections 2023-10-09T06:31:35.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.671+0000 7fad0b78f700 1 --2- 172.21.15.31:0/2310468163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad040ade00 0x7fad04161b40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:35.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.671+0000 7fad0b78f700 1 -- 172.21.15.31:0/2310468163 >> 172.21.15.31:0/2310468163 conn(0x7fad04067660 msgr2=0x7fad04067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:35.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.671+0000 7fad0b78f700 1 -- 172.21.15.31:0/2310468163 shutdown_connections 2023-10-09T06:31:35.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.671+0000 7fad0b78f700 1 -- 172.21.15.31:0/2310468163 wait complete. 2023-10-09T06:31:35.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.672+0000 7fad0b78f700 1 Processor -- start 2023-10-09T06:31:35.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.672+0000 7fad0b78f700 1 -- start start 2023-10-09T06:31:35.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.673+0000 7fad0b78f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad040abae0 0x7fad04158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:35.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.673+0000 7fad0b78f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad040ade00 0x7fad040cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:35.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.673+0000 7fad0b78f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad040c75c0 0x7fad040c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:35.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.673+0000 7fad0b78f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad040cc830 con 0x7fad040ade00 2023-10-09T06:31:35.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.673+0000 7fad0b78f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad040cbc20 con 0x7fad040abae0 2023-10-09T06:31:35.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.673+0000 7fad0b78f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad040cbf00 con 0x7fad040c75c0 2023-10-09T06:31:35.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.673+0000 7fad08d2a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad040ade00 0x7fad040cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:35.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.673+0000 7fad08d2a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad040ade00 0x7fad040cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43488/0 (socket says 172.21.15.31:43488) 2023-10-09T06:31:35.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.673+0000 7fad08d2a700 1 -- 172.21.15.31:0/3083237397 learned_addr learned my addr 172.21.15.31:0/3083237397 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:35.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.673+0000 7fad0952b700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad040abae0 0x7fad04158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:35.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.673+0000 7fad09d2c700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad040c75c0 0x7fad040c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:35.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.674+0000 7fad08d2a700 1 -- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad040c75c0 msgr2=0x7fad040c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:35.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.674+0000 7fad08d2a700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad040c75c0 0x7fad040c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:35.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.674+0000 7fad08d2a700 1 -- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad040abae0 msgr2=0x7fad04158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:35.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.674+0000 7fad08d2a700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad040abae0 0x7fad04158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:35.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.674+0000 7fad08d2a700 1 -- 172.21.15.31:0/3083237397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc009a20 con 0x7fad040ade00 2023-10-09T06:31:35.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.674+0000 7fad08d2a700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad040ade00 0x7fad040cb2d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7facf800e9a0 tx=0x7facf8007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:35.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.674+0000 7fad017fa700 1 -- 172.21.15.31:0/3083237397 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf800ee30 con 0x7fad040ade00 2023-10-09T06:31:35.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.674+0000 7fad017fa700 1 -- 172.21.15.31:0/3083237397 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf8005b30 con 0x7fad040ade00 2023-10-09T06:31:35.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.674+0000 7fad0b78f700 1 -- 172.21.15.31:0/3083237397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad040cc1e0 con 0x7fad040ade00 2023-10-09T06:31:35.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.674+0000 7fad017fa700 1 -- 172.21.15.31:0/3083237397 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf800c7e0 con 0x7fad040ade00 2023-10-09T06:31:35.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.674+0000 7fad0b78f700 1 -- 172.21.15.31:0/3083237397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad040cb810 con 0x7fad040ade00 2023-10-09T06:31:35.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.675+0000 7fad0b78f700 1 -- 172.21.15.31:0/3083237397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0404c3c0 con 0x7fad040ade00 2023-10-09T06:31:35.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.676+0000 7fad017fa700 1 -- 172.21.15.31:0/3083237397 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7facf800cbd0 con 0x7fad040ade00 2023-10-09T06:31:35.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.676+0000 7fad017fa700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7facf0066f30 0x7facf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:35.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.676+0000 7fad017fa700 1 -- 172.21.15.31:0/3083237397 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7facf8086920 con 0x7fad040ade00 2023-10-09T06:31:35.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.676+0000 7fad0952b700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7facf0066f30 0x7facf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:35.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.676+0000 7fad017fa700 1 -- 172.21.15.31:0/3083237397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7facf006eab0 con 0x7fad040ade00 2023-10-09T06:31:35.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.677+0000 7fad0952b700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7facf0066f30 0x7facf00693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7facf4007fd0 tx=0x7facf4007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:35.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.680+0000 7fad017fa700 1 -- 172.21.15.31:0/3083237397 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facf801f060 con 0x7fad040ade00 2023-10-09T06:31:35.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.917+0000 7fad0b78f700 1 -- 172.21.15.31:0/3083237397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad040cc970 con 0x7fad040ade00 2023-10-09T06:31:35.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.918+0000 7fad017fa700 1 -- 172.21.15.31:0/3083237397 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4607 (secure 0 0 0) 0x7facf801f030 con 0x7fad040ade00 2023-10-09T06:31:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:35.919 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1455840229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1455840229},{"type":"v1","addr":"172.21.15.158:6837","nonce":1455840229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7770,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3156917195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3156917195},{"type":"v1","addr":"172.21.15.31:6834","nonce":3156917195}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1537057825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1537057825},{"type":"v1","addr":"172.21.15.31:6835","nonce":1537057825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:30:24.382245+0000","modified":"2023-10-09T06:30:28.019930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7782":{"gid":7782,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/3592438876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3592438876},{"type":"v1","addr":"172.21.15.158:6836","nonce":3592438876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T06:31:35.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.920+0000 7fad0b78f700 1 -- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7facf0066f30 msgr2=0x7facf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:35.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.920+0000 7fad0b78f700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7facf0066f30 0x7facf00693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7facf4007fd0 tx=0x7facf4007d50 comp rx=0 tx=0).stop 2023-10-09T06:31:35.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.920+0000 7fad0b78f700 1 -- 172.21.15.31:0/3083237397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad040ade00 msgr2=0x7fad040cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:35.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.920+0000 7fad0b78f700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad040ade00 0x7fad040cb2d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7facf800e9a0 tx=0x7facf8007ed0 comp rx=0 tx=0).stop 2023-10-09T06:31:35.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.920+0000 7fad0b78f700 1 -- 172.21.15.31:0/3083237397 shutdown_connections 2023-10-09T06:31:35.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.920+0000 7fad0b78f700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7facf0066f30 0x7facf00693e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:35.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.920+0000 7fad0b78f700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fad040c75c0 0x7fad040c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:35.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.920+0000 7fad0b78f700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fad040abae0 0x7fad04158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:35.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.920+0000 7fad0b78f700 1 --2- 172.21.15.31:0/3083237397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad040ade00 0x7fad040cb2d0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:35.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.920+0000 7fad0b78f700 1 -- 172.21.15.31:0/3083237397 >> 172.21.15.31:0/3083237397 conn(0x7fad04067660 msgr2=0x7fad040c46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:35.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.920+0000 7fad0b78f700 1 -- 172.21.15.31:0/3083237397 shutdown_connections 2023-10-09T06:31:35.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:35.920+0000 7fad0b78f700 1 -- 172.21.15.31:0/3083237397 wait complete. 2023-10-09T06:31:35.922 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 82 2023-10-09T06:31:35.933 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:31:36.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.055+0000 7f259dae8700 1 Processor -- start 2023-10-09T06:31:36.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.055+0000 7f259dae8700 1 -- start start 2023-10-09T06:31:36.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.056+0000 7f259dae8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2598159f10 0x7f25980c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.056+0000 7f259dae8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259815a730 con 0x7f259815a2e0 2023-10-09T06:31:36.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.056+0000 7f259dae8700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25980ae320 con 0x7f25980cc410 2023-10-09T06:31:36.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.056+0000 7f259dae8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25980ad710 con 0x7f2598159f10 2023-10-09T06:31:36.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.056+0000 7f2597fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f259815a2e0 0x7f25980cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48194/0 (socket says 172.21.15.31:48194) 2023-10-09T06:31:36.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.056+0000 7f2597fff700 1 -- 172.21.15.31:0/2462749789 learned_addr learned my addr 172.21.15.31:0/2462749789 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:36.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.056+0000 7f259cae6700 1 --2- 172.21.15.31:0/2462749789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2598159f10 0x7f25980c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.056+0000 7f25977fe700 1 -- 172.21.15.31:0/2462749789 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192729059 0 0) 0x7f258c001110 con 0x7f259815a2e0 2023-10-09T06:31:36.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.056+0000 7f25977fe700 1 -- 172.21.15.31:0/2462749789 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2580003570 con 0x7f259815a2e0 2023-10-09T06:31:36.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.057+0000 7f25977fe700 1 -- 172.21.15.31:0/2462749789 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893764084 0 0) 0x7f25980ae320 con 0x7f25980cc410 2023-10-09T06:31:36.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.057+0000 7f25977fe700 1 -- 172.21.15.31:0/2462749789 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f258c001110 con 0x7f25980cc410 2023-10-09T06:31:36.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.057+0000 7f25977fe700 1 -- 172.21.15.31:0/2462749789 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1107646665 0 0) 0x7f2580003570 con 0x7f259815a2e0 2023-10-09T06:31:36.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.057+0000 7f259cae6700 1 -- 172.21.15.31:0/2462749789 >> v1:172.21.15.158:6789/0 conn(0x7f25980cc410 legacy=0x7f25980cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.057+0000 7f259cae6700 1 -- 172.21.15.31:0/2462749789 >> v1:172.21.15.31:6789/0 conn(0x7f259815a2e0 legacy=0x7f25980cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.057+0000 7f259cae6700 1 -- 172.21.15.31:0/2462749789 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25980ad9f0 con 0x7f2598159f10 2023-10-09T06:31:36.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.057+0000 7f259cae6700 1 --2- 172.21.15.31:0/2462749789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2598159f10 0x7f25980c59e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2588009910 tx=0x7f25880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=288e2dfafaa16874 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:36.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.057+0000 7f25977fe700 1 -- 172.21.15.31:0/2462749789 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c001600 con 0x7f2598159f10 2023-10-09T06:31:36.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.057+0000 7f25977fe700 1 -- 172.21.15.31:0/2462749789 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2588011420 con 0x7f2598159f10 2023-10-09T06:31:36.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.057+0000 7f25977fe700 1 -- 172.21.15.31:0/2462749789 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25880117c0 con 0x7f2598159f10 2023-10-09T06:31:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.058+0000 7f259dae8700 1 -- 172.21.15.31:0/2462749789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2598159f10 msgr2=0x7f25980c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.058+0000 7f259dae8700 1 --2- 172.21.15.31:0/2462749789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2598159f10 0x7f25980c59e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2588009910 tx=0x7f25880091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.058+0000 7f259dae8700 1 -- 172.21.15.31:0/2462749789 shutdown_connections 2023-10-09T06:31:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.058+0000 7f259dae8700 1 --2- 172.21.15.31:0/2462749789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2598159f10 0x7f25980c59e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.058+0000 7f259dae8700 1 -- 172.21.15.31:0/2462749789 >> 172.21.15.31:0/2462749789 conn(0x7f2598067e40 msgr2=0x7f25980d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.058+0000 7f259dae8700 1 -- 172.21.15.31:0/2462749789 shutdown_connections 2023-10-09T06:31:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.058+0000 7f259dae8700 1 -- 172.21.15.31:0/2462749789 wait complete. 2023-10-09T06:31:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.059+0000 7f259dae8700 1 Processor -- start 2023-10-09T06:31:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.059+0000 7f259dae8700 1 -- start start 2023-10-09T06:31:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f259dae8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f25980cc410 0x7f2598154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f259dae8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2598159f10 0x7f25980c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f259dae8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f259815a2e0 0x7f259815b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f259dae8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2598155090 con 0x7f2598159f10 2023-10-09T06:31:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f259dae8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25980b4fc0 con 0x7f259815a2e0 2023-10-09T06:31:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f259dae8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25980b5ae0 con 0x7f25980cc410 2023-10-09T06:31:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f2597fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2598159f10 0x7f25980c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f2597fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2598159f10 0x7f25980c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43496/0 (socket says 172.21.15.31:43496) 2023-10-09T06:31:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f2597fff700 1 -- 172.21.15.31:0/2678002037 learned_addr learned my addr 172.21.15.31:0/2678002037 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f259d2e7700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f259815a2e0 0x7f259815b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f259cae6700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f25980cc410 0x7f2598154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f2597fff700 1 -- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f25980cc410 msgr2=0x7f2598154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f2597fff700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f25980cc410 0x7f2598154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f2597fff700 1 -- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f259815a2e0 msgr2=0x7f259815b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f2597fff700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f259815a2e0 0x7f259815b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f2597fff700 1 -- 172.21.15.31:0/2678002037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2588009420 con 0x7f2598159f10 2023-10-09T06:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f2597fff700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2598159f10 0x7f25980c8cc0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f258c00cb60 tx=0x7f258c001c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:36.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f2594ff9700 1 -- 172.21.15.31:0/2678002037 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c007360 con 0x7f2598159f10 2023-10-09T06:31:36.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f2594ff9700 1 -- 172.21.15.31:0/2678002037 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c0074e0 con 0x7f2598159f10 2023-10-09T06:31:36.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f259dae8700 1 -- 172.21.15.31:0/2678002037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259815c0f0 con 0x7f2598159f10 2023-10-09T06:31:36.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.060+0000 7f2594ff9700 1 -- 172.21.15.31:0/2678002037 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c004830 con 0x7f2598159f10 2023-10-09T06:31:36.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.061+0000 7f259dae8700 1 -- 172.21.15.31:0/2678002037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25980b5770 con 0x7f2598159f10 2023-10-09T06:31:36.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.061+0000 7f259dae8700 1 -- 172.21.15.31:0/2678002037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25980caf30 con 0x7f2598159f10 2023-10-09T06:31:36.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.062+0000 7f2594ff9700 1 -- 172.21.15.31:0/2678002037 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f258c004c40 con 0x7f2598159f10 2023-10-09T06:31:36.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.062+0000 7f2594ff9700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2584066f30 0x7f25840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.062+0000 7f2594ff9700 1 -- 172.21.15.31:0/2678002037 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f258c083d10 con 0x7f2598159f10 2023-10-09T06:31:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.062+0000 7f2594ff9700 1 -- 172.21.15.31:0/2678002037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f258406eab0 con 0x7f2598159f10 2023-10-09T06:31:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.062+0000 7f259cae6700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2584066f30 0x7f25840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.063+0000 7f259cae6700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2584066f30 0x7f25840693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f25880030c0 tx=0x7f2588016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.066+0000 7f2594ff9700 1 -- 172.21.15.31:0/2678002037 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f258c018060 con 0x7f2598159f10 2023-10-09T06:31:36.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.259+0000 7f259dae8700 1 -- 172.21.15.31:0/2678002037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f259815a730 con 0x7f2598159f10 2023-10-09T06:31:36.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.260+0000 7f2594ff9700 1 -- 172.21.15.31:0/2678002037 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+15440 (secure 0 0 0) 0x7f259815a730 con 0x7f2598159f10 2023-10-09T06:31:36.261 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:36.261 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":172,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:31:11.792110+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:30:22.788833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T06:30:23.358451+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.7","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:31:36.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.262+0000 7f259dae8700 1 -- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2584066f30 msgr2=0x7f25840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.262+0000 7f259dae8700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2584066f30 0x7f25840693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f25880030c0 tx=0x7f2588016000 comp rx=0 tx=0).stop 2023-10-09T06:31:36.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.262+0000 7f259dae8700 1 -- 172.21.15.31:0/2678002037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2598159f10 msgr2=0x7f25980c8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.262+0000 7f259dae8700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2598159f10 0x7f25980c8cc0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f258c00cb60 tx=0x7f258c001c40 comp rx=0 tx=0).stop 2023-10-09T06:31:36.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.262+0000 7f259dae8700 1 -- 172.21.15.31:0/2678002037 shutdown_connections 2023-10-09T06:31:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.262+0000 7f259dae8700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2584066f30 0x7f25840693e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.262+0000 7f259dae8700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f25980cc410 0x7f2598154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.262+0000 7f259dae8700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f259815a2e0 0x7f259815b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.262+0000 7f259dae8700 1 --2- 172.21.15.31:0/2678002037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2598159f10 0x7f25980c8cc0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.262+0000 7f259dae8700 1 -- 172.21.15.31:0/2678002037 >> 172.21.15.31:0/2678002037 conn(0x7f2598067e40 msgr2=0x7f2598155b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.262+0000 7f259dae8700 1 -- 172.21.15.31:0/2678002037 shutdown_connections 2023-10-09T06:31:36.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.263+0000 7f259dae8700 1 -- 172.21.15.31:0/2678002037 wait complete. 2023-10-09T06:31:36.275 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:30:22.788833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:30:23.358451+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:31:36.276 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:31:36.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.398+0000 7f8617a3d700 1 Processor -- start 2023-10-09T06:31:36.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.398+0000 7f8617a3d700 1 -- start start 2023-10-09T06:31:36.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f8617a3d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f861015b990 0x7f861015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f8617a3d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86100b14f0 con 0x7f86100b3570 2023-10-09T06:31:36.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f8617a3d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86100b17d0 con 0x7f86100b4860 2023-10-09T06:31:36.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f8617a3d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86100b1ab0 con 0x7f861015b990 2023-10-09T06:31:36.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f8614fd8700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f86100b3570 0x7f86100cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48200/0 (socket says 172.21.15.31:48200) 2023-10-09T06:31:36.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f8614fd8700 1 -- 172.21.15.31:0/458995063 learned_addr learned my addr 172.21.15.31:0/458995063 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:36.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f8615fda700 1 --2- 172.21.15.31:0/458995063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f861015b990 0x7f861015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f860ffff700 1 -- 172.21.15.31:0/458995063 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313229195 0 0) 0x7f86100b14f0 con 0x7f86100b3570 2023-10-09T06:31:36.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f860ffff700 1 -- 172.21.15.31:0/458995063 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f8003570 con 0x7f86100b3570 2023-10-09T06:31:36.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f860ffff700 1 -- 172.21.15.31:0/458995063 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378746429 0 0) 0x7f86100b17d0 con 0x7f86100b4860 2023-10-09T06:31:36.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f860ffff700 1 -- 172.21.15.31:0/458995063 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86100b14f0 con 0x7f86100b4860 2023-10-09T06:31:36.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f8615fda700 1 -- 172.21.15.31:0/458995063 >> v1:172.21.15.158:6789/0 conn(0x7f86100b4860 legacy=0x7f8610159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f8615fda700 1 -- 172.21.15.31:0/458995063 >> v1:172.21.15.31:6789/0 conn(0x7f86100b3570 legacy=0x7f86100cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f8615fda700 1 -- 172.21.15.31:0/458995063 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86100b1d90 con 0x7f861015b990 2023-10-09T06:31:36.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.399+0000 7f8615fda700 1 --2- 172.21.15.31:0/458995063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f861015b990 0x7f861015a1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8608009910 tx=0x7f86080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee2bd5ad473b202 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:36.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.400+0000 7f860ffff700 1 -- 172.21.15.31:0/458995063 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860800b690 con 0x7f861015b990 2023-10-09T06:31:36.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.400+0000 7f860ffff700 1 -- 172.21.15.31:0/458995063 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860800b7f0 con 0x7f861015b990 2023-10-09T06:31:36.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.400+0000 7f860ffff700 1 -- 172.21.15.31:0/458995063 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860800bb90 con 0x7f861015b990 2023-10-09T06:31:36.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.400+0000 7f8617a3d700 1 -- 172.21.15.31:0/458995063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f861015b990 msgr2=0x7f861015a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.400+0000 7f8617a3d700 1 --2- 172.21.15.31:0/458995063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f861015b990 0x7f861015a1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8608009910 tx=0x7f86080091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.400+0000 7f8617a3d700 1 -- 172.21.15.31:0/458995063 shutdown_connections 2023-10-09T06:31:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.400+0000 7f8617a3d700 1 --2- 172.21.15.31:0/458995063 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f861015b990 0x7f861015a1a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.400+0000 7f8617a3d700 1 -- 172.21.15.31:0/458995063 >> 172.21.15.31:0/458995063 conn(0x7f861009a0f0 msgr2=0x7f8610067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.401+0000 7f8617a3d700 1 -- 172.21.15.31:0/458995063 shutdown_connections 2023-10-09T06:31:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.401+0000 7f8617a3d700 1 -- 172.21.15.31:0/458995063 wait complete. 2023-10-09T06:31:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.402+0000 7f8617a3d700 1 Processor -- start 2023-10-09T06:31:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.402+0000 7f8617a3d700 1 -- start start 2023-10-09T06:31:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8617a3d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86100b3570 0x7f861016a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8617a3d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86100b4860 0x7f86101691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8617a3d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f861015b990 0x7f86100aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8617a3d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861009bbc0 con 0x7f861015b990 2023-10-09T06:31:36.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8617a3d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861009f260 con 0x7f86100b3570 2023-10-09T06:31:36.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8617a3d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861009b040 con 0x7f86100b4860 2023-10-09T06:31:36.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8615fda700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f861015b990 0x7f86100aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8615fda700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f861015b990 0x7f86100aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43500/0 (socket says 172.21.15.31:43500) 2023-10-09T06:31:36.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8615fda700 1 -- 172.21.15.31:0/1998045935 learned_addr learned my addr 172.21.15.31:0/1998045935 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:36.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8614fd8700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86100b4860 0x7f86101691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f86157d9700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86100b3570 0x7f861016a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8615fda700 1 -- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86100b4860 msgr2=0x7f86101691b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8615fda700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86100b4860 0x7f86101691b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8615fda700 1 -- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86100b3570 msgr2=0x7f861016a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8615fda700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86100b3570 0x7f861016a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8615fda700 1 -- 172.21.15.31:0/1998045935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8608009420 con 0x7f861015b990 2023-10-09T06:31:36.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8615fda700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f861015b990 0x7f86100aee60 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f8610068cd0 tx=0x7f8608017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:36.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f860d7fa700 1 -- 172.21.15.31:0/1998045935 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860801f070 con 0x7f861015b990 2023-10-09T06:31:36.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f860d7fa700 1 -- 172.21.15.31:0/1998045935 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8608002f70 con 0x7f861015b990 2023-10-09T06:31:36.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8617a3d700 1 -- 172.21.15.31:0/1998045935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861009b320 con 0x7f861015b990 2023-10-09T06:31:36.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f860d7fa700 1 -- 172.21.15.31:0/1998045935 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608011670 con 0x7f861015b990 2023-10-09T06:31:36.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.403+0000 7f8617a3d700 1 -- 172.21.15.31:0/1998045935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861009b8e0 con 0x7f861015b990 2023-10-09T06:31:36.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.404+0000 7f8617a3d700 1 -- 172.21.15.31:0/1998045935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861004c3c0 con 0x7f861015b990 2023-10-09T06:31:36.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.405+0000 7f860d7fa700 1 -- 172.21.15.31:0/1998045935 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8608011a60 con 0x7f861015b990 2023-10-09T06:31:36.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.405+0000 7f860d7fa700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f85fc066f30 0x7f85fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.405+0000 7f860d7fa700 1 -- 172.21.15.31:0/1998045935 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f8608085b70 con 0x7f861015b990 2023-10-09T06:31:36.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.405+0000 7f86157d9700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f85fc066f30 0x7f85fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.406+0000 7f860d7fa700 1 -- 172.21.15.31:0/1998045935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f85fc06eab0 con 0x7f861015b990 2023-10-09T06:31:36.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.406+0000 7f86157d9700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f85fc066f30 0x7f85fc0693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f86000042e0 tx=0x7f8600009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:36.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.410+0000 7f860d7fa700 1 -- 172.21.15.31:0/1998045935 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8608052da0 con 0x7f861015b990 2023-10-09T06:31:36.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.602+0000 7f8617a3d700 1 -- 172.21.15.31:0/1998045935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86100b2070 con 0x7f861015b990 2023-10-09T06:31:36.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.603+0000 7f860d7fa700 1 -- 172.21.15.31:0/1998045935 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v172) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8608028070 con 0x7f861015b990 2023-10-09T06:31:36.603 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:31:36.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.605+0000 7f8617a3d700 1 -- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f85fc066f30 msgr2=0x7f85fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.605+0000 7f8617a3d700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f85fc066f30 0x7f85fc0693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f86000042e0 tx=0x7f8600009040 comp rx=0 tx=0).stop 2023-10-09T06:31:36.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.605+0000 7f8617a3d700 1 -- 172.21.15.31:0/1998045935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f861015b990 msgr2=0x7f86100aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.605+0000 7f8617a3d700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f861015b990 0x7f86100aee60 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f8610068cd0 tx=0x7f8608017000 comp rx=0 tx=0).stop 2023-10-09T06:31:36.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.605+0000 7f8617a3d700 1 -- 172.21.15.31:0/1998045935 shutdown_connections 2023-10-09T06:31:36.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.605+0000 7f8617a3d700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f85fc066f30 0x7f85fc0693e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.605+0000 7f8617a3d700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f861015b990 0x7f86100aee60 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.605+0000 7f8617a3d700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86100b3570 0x7f861016a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.605+0000 7f8617a3d700 1 --2- 172.21.15.31:0/1998045935 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f86100b4860 0x7f86101691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.605+0000 7f8617a3d700 1 -- 172.21.15.31:0/1998045935 >> 172.21.15.31:0/1998045935 conn(0x7f861009a0f0 msgr2=0x7f8610069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:36.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.605+0000 7f8617a3d700 1 -- 172.21.15.31:0/1998045935 shutdown_connections 2023-10-09T06:31:36.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.605+0000 7f8617a3d700 1 -- 172.21.15.31:0/1998045935 wait complete. 2023-10-09T06:31:36.617 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:31:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.739+0000 7fda22e97700 1 Processor -- start 2023-10-09T06:31:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.740+0000 7fda22e97700 1 -- start start 2023-10-09T06:31:36.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.740+0000 7fda22e97700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda1c0b4860 0x7fda1c0b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.740+0000 7fda22e97700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda1c0b3570 0x7fda1c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.740+0000 7fda22e97700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1c0b14f0 con 0x7fda1c0b4c30 2023-10-09T06:31:36.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.740+0000 7fda22e97700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c0b17d0 con 0x7fda1c0b4860 2023-10-09T06:31:36.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.740+0000 7fda22e97700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0b1ab0 con 0x7fda1c0b3570 2023-10-09T06:31:36.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.741+0000 7fda20c33700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda1c0b4860 0x7fda1c0b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.741+0000 7fda21434700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda1c0b3570 0x7fda1c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.741+0000 7fda20c33700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda1c0b4860 0x7fda1c0b6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:33466/0 (socket says 172.21.15.31:33466) 2023-10-09T06:31:36.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.741+0000 7fda20c33700 1 -- 172.21.15.31:0/18944582 learned_addr learned my addr 172.21.15.31:0/18944582 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:36.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.741+0000 7fda20c33700 1 -- 172.21.15.31:0/18944582 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda1c0b3570 msgr2=0x7fda1c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:36.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.741+0000 7fda20c33700 1 --2- 172.21.15.31:0/18944582 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda1c0b3570 0x7fda1c15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.741+0000 7fda20c33700 1 -- 172.21.15.31:0/18944582 >> v1:172.21.15.158:6789/0 conn(0x7fda1c0b4c30 legacy=0x7fda1c159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:36.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.741+0000 7fda20c33700 1 -- 172.21.15.31:0/18944582 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c0b1d90 con 0x7fda1c0b4860 2023-10-09T06:31:36.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.741+0000 7fda21434700 1 --2- 172.21.15.31:0/18944582 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda1c0b3570 0x7fda1c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:31:36.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.741+0000 7fda20c33700 1 --2- 172.21.15.31:0/18944582 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda1c0b4860 0x7fda1c0b6700 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009990 tx=0x7fda0c009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4835564faa96f225 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:36.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.741+0000 7fda1b7fe700 1 -- 172.21.15.31:0/18944582 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c009e80 con 0x7fda1c0b4860 2023-10-09T06:31:36.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.742+0000 7fda1b7fe700 1 -- 172.21.15.31:0/18944582 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c005c10 con 0x7fda1c0b4860 2023-10-09T06:31:36.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.742+0000 7fda1b7fe700 1 -- 172.21.15.31:0/18944582 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c00b6a0 con 0x7fda1c0b4860 2023-10-09T06:31:36.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.742+0000 7fda22e97700 1 -- 172.21.15.31:0/18944582 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda1c0b4860 msgr2=0x7fda1c0b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.742+0000 7fda22e97700 1 --2- 172.21.15.31:0/18944582 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda1c0b4860 0x7fda1c0b6700 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009990 tx=0x7fda0c009220 comp rx=0 tx=0).stop 2023-10-09T06:31:36.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.742+0000 7fda22e97700 1 -- 172.21.15.31:0/18944582 shutdown_connections 2023-10-09T06:31:36.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.742+0000 7fda22e97700 1 --2- 172.21.15.31:0/18944582 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda1c0b4860 0x7fda1c0b6700 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.742+0000 7fda22e97700 1 --2- 172.21.15.31:0/18944582 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda1c0b3570 0x7fda1c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.742+0000 7fda22e97700 1 -- 172.21.15.31:0/18944582 >> 172.21.15.31:0/18944582 conn(0x7fda1c09a0f0 msgr2=0x7fda1c067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:36.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.742+0000 7fda22e97700 1 -- 172.21.15.31:0/18944582 shutdown_connections 2023-10-09T06:31:36.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.742+0000 7fda22e97700 1 -- 172.21.15.31:0/18944582 wait complete. 2023-10-09T06:31:36.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.743+0000 7fda22e97700 1 Processor -- start 2023-10-09T06:31:36.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.743+0000 7fda22e97700 1 -- start start 2023-10-09T06:31:36.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.744+0000 7fda22e97700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda1c0b3570 0x7fda1c0aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.744+0000 7fda22e97700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda1c0b4860 0x7fda1c09f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.744+0000 7fda22e97700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda1c0b4c30 0x7fda1c09e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.744+0000 7fda22e97700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c157ed0 con 0x7fda1c0b4860 2023-10-09T06:31:36.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.744+0000 7fda22e97700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c16a8b0 con 0x7fda1c0b4c30 2023-10-09T06:31:36.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.744+0000 7fda22e97700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0aeb80 con 0x7fda1c0b3570 2023-10-09T06:31:36.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.744+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda1c0b4860 0x7fda1c09f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.744+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda1c0b4860 0x7fda1c09f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43508/0 (socket says 172.21.15.31:43508) 2023-10-09T06:31:36.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.744+0000 7fda1bfff700 1 -- 172.21.15.31:0/923218277 learned_addr learned my addr 172.21.15.31:0/923218277 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:36.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.744+0000 7fda21434700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda1c0b4c30 0x7fda1c09e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.744+0000 7fda20c33700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda1c0b3570 0x7fda1c0aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.745+0000 7fda1bfff700 1 -- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda1c0b3570 msgr2=0x7fda1c0aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.745+0000 7fda1bfff700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda1c0b3570 0x7fda1c0aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.745+0000 7fda1bfff700 1 -- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda1c0b4c30 msgr2=0x7fda1c09e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.745+0000 7fda1bfff700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda1c0b4c30 0x7fda1c09e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.745+0000 7fda1bfff700 1 -- 172.21.15.31:0/923218277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda14009a20 con 0x7fda1c0b4860 2023-10-09T06:31:36.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.745+0000 7fda1bfff700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda1c0b4860 0x7fda1c09f660 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fda1000b5e0 tx=0x7fda10009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:36.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.745+0000 7fda18ff9700 1 -- 172.21.15.31:0/923218277 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1000f510 con 0x7fda1c0b4860 2023-10-09T06:31:36.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.745+0000 7fda18ff9700 1 -- 172.21.15.31:0/923218277 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1000f670 con 0x7fda1c0b4860 2023-10-09T06:31:36.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.745+0000 7fda22e97700 1 -- 172.21.15.31:0/923218277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c009480 con 0x7fda1c0b4860 2023-10-09T06:31:36.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.745+0000 7fda18ff9700 1 -- 172.21.15.31:0/923218277 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1000fa30 con 0x7fda1c0b4860 2023-10-09T06:31:36.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.745+0000 7fda22e97700 1 -- 172.21.15.31:0/923218277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c0af140 con 0x7fda1c0b4860 2023-10-09T06:31:36.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.746+0000 7fda22e97700 1 -- 172.21.15.31:0/923218277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c16aa20 con 0x7fda1c0b4860 2023-10-09T06:31:36.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.746+0000 7fda18ff9700 1 -- 172.21.15.31:0/923218277 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda1001a400 con 0x7fda1c0b4860 2023-10-09T06:31:36.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.747+0000 7fda18ff9700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda08066f30 0x7fda080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:36.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.747+0000 7fda18ff9700 1 -- 172.21.15.31:0/923218277 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fda10083e60 con 0x7fda1c0b4860 2023-10-09T06:31:36.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.747+0000 7fda18ff9700 1 -- 172.21.15.31:0/923218277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7fda0806eab0 con 0x7fda1c0b4860 2023-10-09T06:31:36.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.747+0000 7fda20c33700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda08066f30 0x7fda080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:36.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.747+0000 7fda20c33700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda08066f30 0x7fda080693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0030c0 tx=0x7fda0c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:36.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.751+0000 7fda18ff9700 1 -- 172.21.15.31:0/923218277 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda100511f0 con 0x7fda1c0b4860 2023-10-09T06:31:36.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.943+0000 7fda22e97700 1 -- 172.21.15.31:0/923218277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda1c04c3c0 con 0x7fda1c0b4860 2023-10-09T06:31:36.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.944+0000 7fda18ff9700 1 -- 172.21.15.31:0/923218277 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v172) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda10054810 con 0x7fda1c0b4860 2023-10-09T06:31:36.944 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:31:36.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.946+0000 7fda22e97700 1 -- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda08066f30 msgr2=0x7fda080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.946+0000 7fda22e97700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda08066f30 0x7fda080693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0030c0 tx=0x7fda0c015000 comp rx=0 tx=0).stop 2023-10-09T06:31:36.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.946+0000 7fda22e97700 1 -- 172.21.15.31:0/923218277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda1c0b4860 msgr2=0x7fda1c09f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:36.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.946+0000 7fda22e97700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda1c0b4860 0x7fda1c09f660 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fda1000b5e0 tx=0x7fda10009120 comp rx=0 tx=0).stop 2023-10-09T06:31:36.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.946+0000 7fda22e97700 1 -- 172.21.15.31:0/923218277 shutdown_connections 2023-10-09T06:31:36.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.946+0000 7fda22e97700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fda08066f30 0x7fda080693e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.946+0000 7fda22e97700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fda1c0b3570 0x7fda1c0aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.946+0000 7fda22e97700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda1c0b4c30 0x7fda1c09e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.946+0000 7fda22e97700 1 --2- 172.21.15.31:0/923218277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda1c0b4860 0x7fda1c09f660 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:36.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.946+0000 7fda22e97700 1 -- 172.21.15.31:0/923218277 >> 172.21.15.31:0/923218277 conn(0x7fda1c09a0f0 msgr2=0x7fda1c158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:36.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.946+0000 7fda22e97700 1 -- 172.21.15.31:0/923218277 shutdown_connections 2023-10-09T06:31:36.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:36.946+0000 7fda22e97700 1 -- 172.21.15.31:0/923218277 wait complete. 2023-10-09T06:31:36.959 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:31:37.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.081+0000 7f4f21007700 1 Processor -- start 2023-10-09T06:31:37.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.081+0000 7f4f21007700 1 -- start start 2023-10-09T06:31:37.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.082+0000 7f4f21007700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f1c159ec0 0x7f4f1c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.082+0000 7f4f21007700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4f1c06acb0 0x7f4f1c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.082+0000 7f4f21007700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1c0b0790 con 0x7f4f1c15a290 2023-10-09T06:31:37.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.082+0000 7f4f21007700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1c0ce1f0 con 0x7f4f1c06acb0 2023-10-09T06:31:37.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.082+0000 7f4f21007700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0b0b20 con 0x7f4f1c159ec0 2023-10-09T06:31:37.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.082+0000 7f4f1b59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4f1c06acb0 0x7f4f1c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.082+0000 7f4f1ad9d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f1c159ec0 0x7f4f1c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.082+0000 7f4f1a59c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f4f1c15a290 0x7f4f1c06a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:50834/0 (socket says 172.21.15.31:50834) 2023-10-09T06:31:37.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.082+0000 7f4f1a59c700 1 -- 172.21.15.31:0/1346112481 learned_addr learned my addr 172.21.15.31:0/1346112481 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:37.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.083+0000 7f4f1ad9d700 1 -- 172.21.15.31:0/1346112481 >> v2:172.21.15.158:3300/0 conn(0x7f4f1c06acb0 msgr2=0x7f4f1c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:37.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.083+0000 7f4f1ad9d700 1 --2- 172.21.15.31:0/1346112481 >> v2:172.21.15.158:3300/0 conn(0x7f4f1c06acb0 0x7f4f1c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.083+0000 7f4f1ad9d700 1 -- 172.21.15.31:0/1346112481 >> v1:172.21.15.158:6789/0 conn(0x7f4f1c15a290 legacy=0x7f4f1c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.083+0000 7f4f19d9b700 1 -- 172.21.15.31:0/1346112481 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272520036 0 0) 0x7f4f1c0b0790 con 0x7f4f1c15a290 2023-10-09T06:31:37.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.083+0000 7f4f1ad9d700 1 -- 172.21.15.31:0/1346112481 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c0b04b0 con 0x7f4f1c159ec0 2023-10-09T06:31:37.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.083+0000 7f4f1b59e700 1 --2- 172.21.15.31:0/1346112481 >> v2:172.21.15.158:3300/0 conn(0x7f4f1c06acb0 0x7f4f1c0afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:31:37.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.083+0000 7f4f1ad9d700 1 --2- 172.21.15.31:0/1346112481 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f1c159ec0 0x7f4f1c0af940 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0098e0 tx=0x7f4f0c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b22320e0f7fd67f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:37.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.083+0000 7f4f19d9b700 1 -- 172.21.15.31:0/1346112481 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c00b640 con 0x7f4f1c159ec0 2023-10-09T06:31:37.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.083+0000 7f4f19d9b700 1 -- 172.21.15.31:0/1346112481 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c00b7a0 con 0x7f4f1c159ec0 2023-10-09T06:31:37.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.083+0000 7f4f19d9b700 1 -- 172.21.15.31:0/1346112481 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c00bb40 con 0x7f4f1c159ec0 2023-10-09T06:31:37.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.084+0000 7f4f21007700 1 -- 172.21.15.31:0/1346112481 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f1c159ec0 msgr2=0x7f4f1c0af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.084+0000 7f4f21007700 1 --2- 172.21.15.31:0/1346112481 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f1c159ec0 0x7f4f1c0af940 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0098e0 tx=0x7f4f0c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.084+0000 7f4f21007700 1 -- 172.21.15.31:0/1346112481 shutdown_connections 2023-10-09T06:31:37.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.084+0000 7f4f21007700 1 --2- 172.21.15.31:0/1346112481 >> v2:172.21.15.158:3300/0 conn(0x7f4f1c06acb0 0x7f4f1c0afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.084+0000 7f4f21007700 1 --2- 172.21.15.31:0/1346112481 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f1c159ec0 0x7f4f1c0af940 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.084+0000 7f4f21007700 1 -- 172.21.15.31:0/1346112481 >> 172.21.15.31:0/1346112481 conn(0x7f4f1c0d1880 msgr2=0x7f4f1c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:37.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.084+0000 7f4f21007700 1 -- 172.21.15.31:0/1346112481 shutdown_connections 2023-10-09T06:31:37.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.084+0000 7f4f21007700 1 -- 172.21.15.31:0/1346112481 wait complete. 2023-10-09T06:31:37.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.085+0000 7f4f21007700 1 Processor -- start 2023-10-09T06:31:37.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.085+0000 7f4f21007700 1 -- start start 2023-10-09T06:31:37.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f21007700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f1c06acb0 0x7f4f1c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f21007700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f1c159ec0 0x7f4f1c0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f21007700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1c15a290 0x7f4f1c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f21007700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c15aa40 con 0x7f4f1c15a290 2023-10-09T06:31:37.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f21007700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c16b530 con 0x7f4f1c159ec0 2023-10-09T06:31:37.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f21007700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c16a920 con 0x7f4f1c06acb0 2023-10-09T06:31:37.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f1b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1c15a290 0x7f4f1c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f1b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1c15a290 0x7f4f1c0cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43510/0 (socket says 172.21.15.31:43510) 2023-10-09T06:31:37.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f1b59e700 1 -- 172.21.15.31:0/3398780955 learned_addr learned my addr 172.21.15.31:0/3398780955 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:37.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f1ad9d700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f1c06acb0 0x7f4f1c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f1a59c700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f1c159ec0 0x7f4f1c0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f1b59e700 1 -- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f1c06acb0 msgr2=0x7f4f1c0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f1b59e700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f1c06acb0 0x7f4f1c0b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f1b59e700 1 -- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f1c159ec0 msgr2=0x7f4f1c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f1b59e700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f1c159ec0 0x7f4f1c0caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f1b59e700 1 -- 172.21.15.31:0/3398780955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f14009a20 con 0x7f4f1c15a290 2023-10-09T06:31:37.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f1b59e700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1c15a290 0x7f4f1c0cf590 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009f90 tx=0x7f4f1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:37.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.086+0000 7f4f02ffd700 1 -- 172.21.15.31:0/3398780955 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1400cbd0 con 0x7f4f1c15a290 2023-10-09T06:31:37.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.087+0000 7f4f02ffd700 1 -- 172.21.15.31:0/3398780955 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1400f040 con 0x7f4f1c15a290 2023-10-09T06:31:37.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.087+0000 7f4f21007700 1 -- 172.21.15.31:0/3398780955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c009420 con 0x7f4f1c15a290 2023-10-09T06:31:37.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.087+0000 7f4f02ffd700 1 -- 172.21.15.31:0/3398780955 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14014480 con 0x7f4f1c15a290 2023-10-09T06:31:37.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.087+0000 7f4f21007700 1 -- 172.21.15.31:0/3398780955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1c16aee0 con 0x7f4f1c15a290 2023-10-09T06:31:37.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.087+0000 7f4f21007700 1 -- 172.21.15.31:0/3398780955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1c16b700 con 0x7f4f1c15a290 2023-10-09T06:31:37.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.088+0000 7f4f02ffd700 1 -- 172.21.15.31:0/3398780955 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f140147f0 con 0x7f4f1c15a290 2023-10-09T06:31:37.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.088+0000 7f4f02ffd700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4f08066f30 0x7f4f080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.088+0000 7f4f02ffd700 1 -- 172.21.15.31:0/3398780955 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f4f140852c0 con 0x7f4f1c15a290 2023-10-09T06:31:37.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.088+0000 7f4f02ffd700 1 -- 172.21.15.31:0/3398780955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f4f0806eab0 con 0x7f4f1c15a290 2023-10-09T06:31:37.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.089+0000 7f4f1ad9d700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4f08066f30 0x7f4f080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.089+0000 7f4f1ad9d700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4f08066f30 0x7f4f080693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0091e0 tx=0x7f4f0c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:37.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.093+0000 7f4f02ffd700 1 -- 172.21.15.31:0/3398780955 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f14018060 con 0x7f4f1c15a290 2023-10-09T06:31:37.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.284+0000 7f4f21007700 1 -- 172.21.15.31:0/3398780955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f1c04c3c0 con 0x7f4f1c15a290 2023-10-09T06:31:37.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.285+0000 7f4f02ffd700 1 -- 172.21.15.31:0/3398780955 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v172) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f1c16b700 con 0x7f4f1c15a290 2023-10-09T06:31:37.285 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:31:37.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.287+0000 7f4f21007700 1 -- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4f08066f30 msgr2=0x7f4f080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.287+0000 7f4f21007700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4f08066f30 0x7f4f080693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0091e0 tx=0x7f4f0c017000 comp rx=0 tx=0).stop 2023-10-09T06:31:37.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.287+0000 7f4f21007700 1 -- 172.21.15.31:0/3398780955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1c15a290 msgr2=0x7f4f1c0cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.287+0000 7f4f21007700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1c15a290 0x7f4f1c0cf590 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009f90 tx=0x7f4f1400b040 comp rx=0 tx=0).stop 2023-10-09T06:31:37.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.287+0000 7f4f21007700 1 -- 172.21.15.31:0/3398780955 shutdown_connections 2023-10-09T06:31:37.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.287+0000 7f4f21007700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4f08066f30 0x7f4f080693e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.287+0000 7f4f21007700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f1c06acb0 0x7f4f1c0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.287+0000 7f4f21007700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1c15a290 0x7f4f1c0cf590 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.287+0000 7f4f21007700 1 --2- 172.21.15.31:0/3398780955 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f1c159ec0 0x7f4f1c0caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.287+0000 7f4f21007700 1 -- 172.21.15.31:0/3398780955 >> 172.21.15.31:0/3398780955 conn(0x7f4f1c0d1880 msgr2=0x7f4f1c0b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:37.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.287+0000 7f4f21007700 1 -- 172.21.15.31:0/3398780955 shutdown_connections 2023-10-09T06:31:37.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.287+0000 7f4f21007700 1 -- 172.21.15.31:0/3398780955 wait complete. 2023-10-09T06:31:37.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:31:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.419+0000 7fdba2171700 1 Processor -- start 2023-10-09T06:31:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.419+0000 7fdba2171700 1 -- start start 2023-10-09T06:31:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdba2171700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdb9c15a2b0 0x7fdb9c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdba2171700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb9c0cfe20 0x7fdb9c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdba2171700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c0c5d80 con 0x7fdb9c0d1c30 2023-10-09T06:31:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdba2171700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9c068470 con 0x7fdb9c15a2b0 2023-10-09T06:31:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdba2171700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0c6060 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdb9b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdb9c15a2b0 0x7fdb9c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdb9affd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdb9c0d1c30 0x7fdb9c0cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48204/0 (socket says 172.21.15.31:48204) 2023-10-09T06:31:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdb9affd700 1 -- 172.21.15.31:0/4239140057 learned_addr learned my addr 172.21.15.31:0/4239140057 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdb9bfff700 1 --2- 172.21.15.31:0/4239140057 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb9c0cfe20 0x7fdb9c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdb9b7fe700 1 -- 172.21.15.31:0/4239140057 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb9c0cfe20 msgr2=0x7fdb9c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdb9b7fe700 1 --2- 172.21.15.31:0/4239140057 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb9c0cfe20 0x7fdb9c0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdb9b7fe700 1 -- 172.21.15.31:0/4239140057 >> v1:172.21.15.31:6789/0 conn(0x7fdb9c0d1c30 legacy=0x7fdb9c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdb9b7fe700 1 -- 172.21.15.31:0/4239140057 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0c6340 con 0x7fdb9c15a2b0 2023-10-09T06:31:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdb9a7fc700 1 -- 172.21.15.31:0/4239140057 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748589356 0 0) 0x7fdb9c0c5d80 con 0x7fdb9c0d1c30 2023-10-09T06:31:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.420+0000 7fdb9b7fe700 1 --2- 172.21.15.31:0/4239140057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c15a2b0 0x7fdb9c0b3da0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0098d0 tx=0x7fdb8c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c6cad2134276c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.421+0000 7fdb9a7fc700 1 -- 172.21.15.31:0/4239140057 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c009e70 con 0x7fdb9c15a2b0 2023-10-09T06:31:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.421+0000 7fdb9a7fc700 1 -- 172.21.15.31:0/4239140057 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c005c10 con 0x7fdb9c15a2b0 2023-10-09T06:31:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.421+0000 7fdb9a7fc700 1 -- 172.21.15.31:0/4239140057 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c00b650 con 0x7fdb9c15a2b0 2023-10-09T06:31:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.421+0000 7fdba2171700 1 -- 172.21.15.31:0/4239140057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c15a2b0 msgr2=0x7fdb9c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.421+0000 7fdba2171700 1 --2- 172.21.15.31:0/4239140057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c15a2b0 0x7fdb9c0b3da0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0098d0 tx=0x7fdb8c009120 comp rx=0 tx=0).stop 2023-10-09T06:31:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.421+0000 7fdba2171700 1 -- 172.21.15.31:0/4239140057 shutdown_connections 2023-10-09T06:31:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.421+0000 7fdba2171700 1 --2- 172.21.15.31:0/4239140057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c15a2b0 0x7fdb9c0b3da0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.421+0000 7fdba2171700 1 --2- 172.21.15.31:0/4239140057 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb9c0cfe20 0x7fdb9c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.421+0000 7fdba2171700 1 -- 172.21.15.31:0/4239140057 >> 172.21.15.31:0/4239140057 conn(0x7fdb9c067e40 msgr2=0x7fdb9c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.421+0000 7fdba2171700 1 -- 172.21.15.31:0/4239140057 shutdown_connections 2023-10-09T06:31:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.421+0000 7fdba2171700 1 -- 172.21.15.31:0/4239140057 wait complete. 2023-10-09T06:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.423+0000 7fdba2171700 1 Processor -- start 2023-10-09T06:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.423+0000 7fdba2171700 1 -- start start 2023-10-09T06:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.423+0000 7fdba2171700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c0cfe20 0x7fdb9c0c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.423+0000 7fdba2171700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb9c0d1c30 0x7fdb9c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.423+0000 7fdba2171700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb9c15a2b0 0x7fdb9c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.423+0000 7fdba2171700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c09ae30 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.423+0000 7fdba2171700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0c96f0 con 0x7fdb9c0d1c30 2023-10-09T06:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.423+0000 7fdba2171700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0c99d0 con 0x7fdb9c15a2b0 2023-10-09T06:31:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.423+0000 7fdb9b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c0cfe20 0x7fdb9c0c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.423+0000 7fdb9b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c0cfe20 0x7fdb9c0c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43528/0 (socket says 172.21.15.31:43528) 2023-10-09T06:31:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.423+0000 7fdb9b7fe700 1 -- 172.21.15.31:0/385789007 learned_addr learned my addr 172.21.15.31:0/385789007 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.424+0000 7fdb9bfff700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb9c15a2b0 0x7fdb9c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.424+0000 7fdb9affd700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb9c0d1c30 0x7fdb9c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.424+0000 7fdb9b7fe700 1 -- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb9c15a2b0 msgr2=0x7fdb9c15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.424+0000 7fdb9b7fe700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb9c15a2b0 0x7fdb9c15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.424+0000 7fdb9b7fe700 1 -- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb9c0d1c30 msgr2=0x7fdb9c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.424+0000 7fdb9b7fe700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb9c0d1c30 0x7fdb9c15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.424+0000 7fdb9b7fe700 1 -- 172.21.15.31:0/385789007 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c0093c0 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.424+0000 7fdb9b7fe700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c0cfe20 0x7fdb9c0c9060 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00b3c0 tx=0x7fdb8c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.424+0000 7fdb837fe700 1 -- 172.21.15.31:0/385789007 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c006460 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.424+0000 7fdb837fe700 1 -- 172.21.15.31:0/385789007 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c0065c0 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.424+0000 7fdba2171700 1 -- 172.21.15.31:0/385789007 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c0c9cb0 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.424+0000 7fdb837fe700 1 -- 172.21.15.31:0/385789007 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c006940 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.424+0000 7fdba2171700 1 -- 172.21.15.31:0/385789007 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c0ca270 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.425+0000 7fdba2171700 1 -- 172.21.15.31:0/385789007 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9c0ca490 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.425+0000 7fdb837fe700 1 -- 172.21.15.31:0/385789007 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb8c01b690 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.426+0000 7fdb837fe700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdb88066f30 0x7fdb880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.426+0000 7fdb837fe700 1 -- 172.21.15.31:0/385789007 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fdb8c086700 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.426+0000 7fdb837fe700 1 -- 172.21.15.31:0/385789007 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7fdb8806eab0 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.426+0000 7fdb9affd700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdb88066f30 0x7fdb880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.427+0000 7fdb9affd700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdb88066f30 0x7fdb880693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0d2000 tx=0x7fdb90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:37.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.430+0000 7fdb837fe700 1 -- 172.21.15.31:0/385789007 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb8c053950 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.665+0000 7fdba2171700 1 -- 172.21.15.31:0/385789007 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb9c04c3c0 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.666+0000 7fdb837fe700 1 -- 172.21.15.31:0/385789007 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fdb8c069e60 con 0x7fdb9c0cfe20 2023-10-09T06:31:37.667 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:37.667 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1455840229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1455840229},{"type":"v1","addr":"172.21.15.158:6837","nonce":1455840229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7770,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3156917195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3156917195},{"type":"v1","addr":"172.21.15.31:6834","nonce":3156917195}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1537057825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1537057825},{"type":"v1","addr":"172.21.15.31:6835","nonce":1537057825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:30:24.382245+0000","modified":"2023-10-09T06:30:28.019930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7782":{"gid":7782,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/3592438876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3592438876},{"type":"v1","addr":"172.21.15.158:6836","nonce":3592438876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T06:31:37.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.668+0000 7fdba2171700 1 -- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdb88066f30 msgr2=0x7fdb880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.668+0000 7fdba2171700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdb88066f30 0x7fdb880693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0d2000 tx=0x7fdb90009040 comp rx=0 tx=0).stop 2023-10-09T06:31:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.668+0000 7fdba2171700 1 -- 172.21.15.31:0/385789007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c0cfe20 msgr2=0x7fdb9c0c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.668+0000 7fdba2171700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c0cfe20 0x7fdb9c0c9060 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00b3c0 tx=0x7fdb8c016000 comp rx=0 tx=0).stop 2023-10-09T06:31:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.668+0000 7fdba2171700 1 -- 172.21.15.31:0/385789007 shutdown_connections 2023-10-09T06:31:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.668+0000 7fdba2171700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdb88066f30 0x7fdb880693e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.668+0000 7fdba2171700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdb9c15a2b0 0x7fdb9c15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.668+0000 7fdba2171700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c0cfe20 0x7fdb9c0c9060 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.668+0000 7fdba2171700 1 --2- 172.21.15.31:0/385789007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb9c0d1c30 0x7fdb9c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.668+0000 7fdba2171700 1 -- 172.21.15.31:0/385789007 >> 172.21.15.31:0/385789007 conn(0x7fdb9c067e40 msgr2=0x7fdb9c0d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.668+0000 7fdba2171700 1 -- 172.21.15.31:0/385789007 shutdown_connections 2023-10-09T06:31:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.668+0000 7fdba2171700 1 -- 172.21.15.31:0/385789007 wait complete. 2023-10-09T06:31:37.670 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 82 2023-10-09T06:31:37.681 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:31:37.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.799+0000 7f6f7e5d9700 1 Processor -- start 2023-10-09T06:31:37.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.799+0000 7f6f7e5d9700 1 -- start start 2023-10-09T06:31:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.799+0000 7f6f7e5d9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f780d1c30 0x7f6f780ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f7e5d9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f780c5d80 con 0x7f6f7815a680 2023-10-09T06:31:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f7e5d9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f780c6060 con 0x7f6f7815a2b0 2023-10-09T06:31:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f7e5d9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78068470 con 0x7f6f780d1c30 2023-10-09T06:31:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f7cb76700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6f7815a680 0x7f6f780cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48210/0 (socket says 172.21.15.31:48210) 2023-10-09T06:31:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f7cb76700 1 -- 172.21.15.31:0/2947045445 learned_addr learned my addr 172.21.15.31:0/2947045445 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f777fe700 1 --2- 172.21.15.31:0/2947045445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f780d1c30 0x7f6f780ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f76ffd700 1 -- 172.21.15.31:0/2947045445 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587640461 0 0) 0x7f6f780c5d80 con 0x7f6f7815a680 2023-10-09T06:31:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f76ffd700 1 -- 172.21.15.31:0/2947045445 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f64003570 con 0x7f6f7815a680 2023-10-09T06:31:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f76ffd700 1 -- 172.21.15.31:0/2947045445 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337378072 0 0) 0x7f6f780c6060 con 0x7f6f7815a2b0 2023-10-09T06:31:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f76ffd700 1 -- 172.21.15.31:0/2947045445 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f780c5d80 con 0x7f6f7815a2b0 2023-10-09T06:31:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f777fe700 1 -- 172.21.15.31:0/2947045445 >> v1:172.21.15.158:6789/0 conn(0x7f6f7815a2b0 legacy=0x7f6f780b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f777fe700 1 -- 172.21.15.31:0/2947045445 >> v1:172.21.15.31:6789/0 conn(0x7f6f7815a680 legacy=0x7f6f780cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f777fe700 1 -- 172.21.15.31:0/2947045445 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f780c6340 con 0x7f6f780d1c30 2023-10-09T06:31:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.800+0000 7f6f777fe700 1 --2- 172.21.15.31:0/2947045445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f780d1c30 0x7f6f780ccdd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009910 tx=0x7f6f600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e3076c1a6c911b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.801+0000 7f6f76ffd700 1 -- 172.21.15.31:0/2947045445 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f60011630 con 0x7f6f780d1c30 2023-10-09T06:31:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.801+0000 7f6f76ffd700 1 -- 172.21.15.31:0/2947045445 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f60011790 con 0x7f6f780d1c30 2023-10-09T06:31:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.801+0000 7f6f76ffd700 1 -- 172.21.15.31:0/2947045445 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f60011b30 con 0x7f6f780d1c30 2023-10-09T06:31:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.801+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/2947045445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f780d1c30 msgr2=0x7f6f780ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.801+0000 7f6f7e5d9700 1 --2- 172.21.15.31:0/2947045445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f780d1c30 0x7f6f780ccdd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009910 tx=0x7f6f600091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.801+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/2947045445 shutdown_connections 2023-10-09T06:31:37.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.801+0000 7f6f7e5d9700 1 --2- 172.21.15.31:0/2947045445 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f780d1c30 0x7f6f780ccdd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.801+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/2947045445 >> 172.21.15.31:0/2947045445 conn(0x7f6f78067e40 msgr2=0x7f6f780d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:37.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.801+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/2947045445 shutdown_connections 2023-10-09T06:31:37.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.801+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/2947045445 wait complete. 2023-10-09T06:31:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.802+0000 7f6f7e5d9700 1 Processor -- start 2023-10-09T06:31:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.802+0000 7f6f7e5d9700 1 -- start start 2023-10-09T06:31:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.803+0000 7f6f7e5d9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f780d1c30 0x7f6f780b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.803+0000 7f6f7e5d9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f7815a2b0 0x7f6f780b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.803+0000 7f6f7e5d9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f7815a680 0x7f6f7815c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.803+0000 7f6f7e5d9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780c86b0 con 0x7f6f780d1c30 2023-10-09T06:31:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.803+0000 7f6f7e5d9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780b5d60 con 0x7f6f7815a680 2023-10-09T06:31:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.803+0000 7f6f7e5d9700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780b6040 con 0x7f6f7815a2b0 2023-10-09T06:31:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.803+0000 7f6f77fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f780d1c30 0x7f6f780b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.803+0000 7f6f77fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f780d1c30 0x7f6f780b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43540/0 (socket says 172.21.15.31:43540) 2023-10-09T06:31:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.803+0000 7f6f77fff700 1 -- 172.21.15.31:0/3609858886 learned_addr learned my addr 172.21.15.31:0/3609858886 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.803+0000 7f6f777fe700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f7815a2b0 0x7f6f780b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.803+0000 7f6f7cb76700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f7815a680 0x7f6f7815c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.804+0000 7f6f77fff700 1 -- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f7815a2b0 msgr2=0x7f6f780b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.804+0000 7f6f77fff700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f7815a2b0 0x7f6f780b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.804+0000 7f6f77fff700 1 -- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f7815a680 msgr2=0x7f6f7815c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.804+0000 7f6f77fff700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f7815a680 0x7f6f7815c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.804+0000 7f6f77fff700 1 -- 172.21.15.31:0/3609858886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f60009420 con 0x7f6f780d1c30 2023-10-09T06:31:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.804+0000 7f6f77fff700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f780d1c30 0x7f6f780b4fa0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800c560 tx=0x7f6f68007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.804+0000 7f6f6ffff700 1 -- 172.21.15.31:0/3609858886 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68010510 con 0x7f6f780d1c30 2023-10-09T06:31:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.804+0000 7f6f6ffff700 1 -- 172.21.15.31:0/3609858886 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f68010670 con 0x7f6f780d1c30 2023-10-09T06:31:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.804+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/3609858886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f780b6320 con 0x7f6f780d1c30 2023-10-09T06:31:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.804+0000 7f6f6ffff700 1 -- 172.21.15.31:0/3609858886 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68010a30 con 0x7f6f780d1c30 2023-10-09T06:31:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.804+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/3609858886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f780b5a20 con 0x7f6f780d1c30 2023-10-09T06:31:37.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.805+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/3609858886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7804c3c0 con 0x7f6f780d1c30 2023-10-09T06:31:37.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.805+0000 7f6f6ffff700 1 -- 172.21.15.31:0/3609858886 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f68002050 con 0x7f6f780d1c30 2023-10-09T06:31:37.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.806+0000 7f6f6ffff700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f58066f30 0x7f6f580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:37.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.806+0000 7f6f6ffff700 1 -- 172.21.15.31:0/3609858886 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f6f68083e20 con 0x7f6f780d1c30 2023-10-09T06:31:37.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.806+0000 7f6f777fe700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f58066f30 0x7f6f580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:37.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.806+0000 7f6f6ffff700 1 -- 172.21.15.31:0/3609858886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f6f5806eab0 con 0x7f6f780d1c30 2023-10-09T06:31:37.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.806+0000 7f6f777fe700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f58066f30 0x7f6f580693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6f780d2000 tx=0x7f6f60017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:37.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:37.810+0000 7f6f6ffff700 1 -- 172.21.15.31:0/3609858886 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f68051070 con 0x7f6f780d1c30 2023-10-09T06:31:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.005+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/3609858886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f78064a00 con 0x7f6f780d1c30 2023-10-09T06:31:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.006+0000 7f6f6ffff700 1 -- 172.21.15.31:0/3609858886 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+15440 (secure 0 0 0) 0x7f6f68054690 con 0x7f6f780d1c30 2023-10-09T06:31:38.006 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:38.007 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":172,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:31:11.792110+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:30:22.788833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T06:30:23.358451+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.7","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:31:38.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.008+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f58066f30 msgr2=0x7f6f580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.008+0000 7f6f7e5d9700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f58066f30 0x7f6f580693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6f780d2000 tx=0x7f6f60017000 comp rx=0 tx=0).stop 2023-10-09T06:31:38.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.008+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/3609858886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f780d1c30 msgr2=0x7f6f780b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.008+0000 7f6f7e5d9700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f780d1c30 0x7f6f780b4fa0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800c560 tx=0x7f6f68007e00 comp rx=0 tx=0).stop 2023-10-09T06:31:38.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.008+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/3609858886 shutdown_connections 2023-10-09T06:31:38.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.008+0000 7f6f7e5d9700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6f58066f30 0x7f6f580693e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.008+0000 7f6f7e5d9700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f7815a680 0x7f6f7815c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.008+0000 7f6f7e5d9700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f780d1c30 0x7f6f780b4fa0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.008+0000 7f6f7e5d9700 1 --2- 172.21.15.31:0/3609858886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6f7815a2b0 0x7f6f780b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.008+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/3609858886 >> 172.21.15.31:0/3609858886 conn(0x7f6f78067e40 msgr2=0x7f6f780695b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:38.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.008+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/3609858886 shutdown_connections 2023-10-09T06:31:38.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.008+0000 7f6f7e5d9700 1 -- 172.21.15.31:0/3609858886 wait complete. 2023-10-09T06:31:38.021 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:31:38.021 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:31:38.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.140+0000 7f786efc4700 1 Processor -- start 2023-10-09T06:31:38.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.140+0000 7f786efc4700 1 -- start start 2023-10-09T06:31:38.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f786efc4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7868159dd0 0x7f786815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f786efc4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f786815db70 0x7f78680c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f786efc4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78680cc590 con 0x7f78680cbfd0 2023-10-09T06:31:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f786efc4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78680cc870 con 0x7f786815db70 2023-10-09T06:31:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f786efc4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78680ccb50 con 0x7f7868159dd0 2023-10-09T06:31:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f786d561700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f78680cbfd0 0x7f78680c9000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48214/0 (socket says 172.21.15.31:48214) 2023-10-09T06:31:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f7867fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f786815db70 0x7f78680c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f786d561700 1 -- 172.21.15.31:0/1139540144 learned_addr learned my addr 172.21.15.31:0/1139540144 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f786cd60700 1 --2- 172.21.15.31:0/1139540144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7868159dd0 0x7f786815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f78677fe700 1 -- 172.21.15.31:0/1139540144 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445673833 0 0) 0x7f78680cc590 con 0x7f78680cbfd0 2023-10-09T06:31:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f78677fe700 1 -- 172.21.15.31:0/1139540144 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7854003570 con 0x7f78680cbfd0 2023-10-09T06:31:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f7867fff700 1 -- 172.21.15.31:0/1139540144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7868159dd0 msgr2=0x7f786815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f7867fff700 1 --2- 172.21.15.31:0/1139540144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7868159dd0 0x7f786815a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f7867fff700 1 -- 172.21.15.31:0/1139540144 >> v1:172.21.15.31:6789/0 conn(0x7f78680cbfd0 legacy=0x7f78680c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f7867fff700 1 -- 172.21.15.31:0/1139540144 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78680cce30 con 0x7f786815db70 2023-10-09T06:31:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f786cd60700 1 --2- 172.21.15.31:0/1139540144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7868159dd0 0x7f786815a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.141+0000 7f7867fff700 1 --2- 172.21.15.31:0/1139540144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786815db70 0x7f78680c1f80 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f78500098e0 tx=0x7f78500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755a9d01ca8b2933 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.142+0000 7f78677fe700 1 -- 172.21.15.31:0/1139540144 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785000b640 con 0x7f786815db70 2023-10-09T06:31:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.142+0000 7f78677fe700 1 -- 172.21.15.31:0/1139540144 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785000b7a0 con 0x7f786815db70 2023-10-09T06:31:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.142+0000 7f78677fe700 1 -- 172.21.15.31:0/1139540144 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785000bb40 con 0x7f786815db70 2023-10-09T06:31:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.142+0000 7f786efc4700 1 -- 172.21.15.31:0/1139540144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786815db70 msgr2=0x7f78680c1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.142+0000 7f786efc4700 1 --2- 172.21.15.31:0/1139540144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786815db70 0x7f78680c1f80 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f78500098e0 tx=0x7f78500091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.142+0000 7f786efc4700 1 -- 172.21.15.31:0/1139540144 shutdown_connections 2023-10-09T06:31:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.142+0000 7f786efc4700 1 --2- 172.21.15.31:0/1139540144 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7868159dd0 0x7f786815a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.142+0000 7f786efc4700 1 --2- 172.21.15.31:0/1139540144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786815db70 0x7f78680c1f80 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.142+0000 7f786efc4700 1 -- 172.21.15.31:0/1139540144 >> 172.21.15.31:0/1139540144 conn(0x7f78680cd1e0 msgr2=0x7f78680cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.142+0000 7f786efc4700 1 -- 172.21.15.31:0/1139540144 shutdown_connections 2023-10-09T06:31:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.142+0000 7f786efc4700 1 -- 172.21.15.31:0/1139540144 wait complete. 2023-10-09T06:31:38.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.143+0000 7f786efc4700 1 Processor -- start 2023-10-09T06:31:38.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.143+0000 7f786efc4700 1 -- start start 2023-10-09T06:31:38.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.144+0000 7f786efc4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78680cbfd0 0x7f7868151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.144+0000 7f786efc4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7868159dd0 0x7f78680b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.144+0000 7f786efc4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786815db70 0x7f78680c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.144+0000 7f786efc4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786815f5c0 con 0x7f786815db70 2023-10-09T06:31:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.144+0000 7f786efc4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786815c540 con 0x7f78680cbfd0 2023-10-09T06:31:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.144+0000 7f786efc4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78681521f0 con 0x7f7868159dd0 2023-10-09T06:31:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.144+0000 7f786d561700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786815db70 0x7f78680c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.144+0000 7f786d561700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786815db70 0x7f78680c4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43562/0 (socket says 172.21.15.31:43562) 2023-10-09T06:31:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.144+0000 7f786d561700 1 -- 172.21.15.31:0/750837639 learned_addr learned my addr 172.21.15.31:0/750837639 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f7867fff700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7868159dd0 0x7f78680b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f786cd60700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78680cbfd0 0x7f7868151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f786d561700 1 -- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7868159dd0 msgr2=0x7f78680b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f786d561700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7868159dd0 0x7f78680b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f786d561700 1 -- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78680cbfd0 msgr2=0x7f7868151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f786d561700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78680cbfd0 0x7f7868151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f786d561700 1 -- 172.21.15.31:0/750837639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7850009420 con 0x7f786815db70 2023-10-09T06:31:38.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f7867fff700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7868159dd0 0x7f78680b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:31:38.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f786cd60700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78680cbfd0 0x7f7868151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:31:38.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f786d561700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786815db70 0x7f78680c4290 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f78600010e0 tx=0x7f7860007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:38.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f7864ff9700 1 -- 172.21.15.31:0/750837639 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860005c00 con 0x7f786815db70 2023-10-09T06:31:38.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f7864ff9700 1 -- 172.21.15.31:0/750837639 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7860005d60 con 0x7f786815db70 2023-10-09T06:31:38.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f7864ff9700 1 -- 172.21.15.31:0/750837639 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600072e0 con 0x7f786815db70 2023-10-09T06:31:38.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f786efc4700 1 -- 172.21.15.31:0/750837639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786815bc10 con 0x7f786815db70 2023-10-09T06:31:38.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.145+0000 7f786efc4700 1 -- 172.21.15.31:0/750837639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786815c1d0 con 0x7f786815db70 2023-10-09T06:31:38.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.146+0000 7f786efc4700 1 -- 172.21.15.31:0/750837639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786804c3c0 con 0x7f786815db70 2023-10-09T06:31:38.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.146+0000 7f7864ff9700 1 -- 172.21.15.31:0/750837639 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7860007690 con 0x7f786815db70 2023-10-09T06:31:38.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.147+0000 7f7864ff9700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7848066f30 0x7f78480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.147+0000 7f7864ff9700 1 -- 172.21.15.31:0/750837639 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f7860083a30 con 0x7f786815db70 2023-10-09T06:31:38.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.147+0000 7f786cd60700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7848066f30 0x7f78480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.147+0000 7f7864ff9700 1 -- 172.21.15.31:0/750837639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f784806eab0 con 0x7f786815db70 2023-10-09T06:31:38.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.148+0000 7f786cd60700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7848066f30 0x7f78480693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f78580094d0 tx=0x7f785800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:38.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.151+0000 7f7864ff9700 1 -- 172.21.15.31:0/750837639 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f786004b5a0 con 0x7f786815db70 2023-10-09T06:31:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.389+0000 7f786efc4700 1 -- 172.21.15.31:0/750837639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f786815c680 con 0x7f786815db70 2023-10-09T06:31:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.389+0000 7f7864ff9700 1 -- 172.21.15.31:0/750837639 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f7860017020 con 0x7f786815db70 2023-10-09T06:31:38.390 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:38.390 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1455840229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1455840229},{"type":"v1","addr":"172.21.15.158:6837","nonce":1455840229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7770,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3156917195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3156917195},{"type":"v1","addr":"172.21.15.31:6834","nonce":3156917195}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1537057825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1537057825},{"type":"v1","addr":"172.21.15.31:6835","nonce":1537057825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:30:24.382245+0000","modified":"2023-10-09T06:30:28.019930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7782":{"gid":7782,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/3592438876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3592438876},{"type":"v1","addr":"172.21.15.158:6836","nonce":3592438876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T06:31:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.391+0000 7f786efc4700 1 -- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7848066f30 msgr2=0x7f78480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.391+0000 7f786efc4700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7848066f30 0x7f78480693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f78580094d0 tx=0x7f785800b040 comp rx=0 tx=0).stop 2023-10-09T06:31:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.391+0000 7f786efc4700 1 -- 172.21.15.31:0/750837639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786815db70 msgr2=0x7f78680c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.391+0000 7f786efc4700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786815db70 0x7f78680c4290 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f78600010e0 tx=0x7f7860007dd0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.391+0000 7f786efc4700 1 -- 172.21.15.31:0/750837639 shutdown_connections 2023-10-09T06:31:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.391+0000 7f786efc4700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7848066f30 0x7f78480693e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.391+0000 7f786efc4700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786815db70 0x7f78680c4290 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.391+0000 7f786efc4700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78680cbfd0 0x7f7868151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.391+0000 7f786efc4700 1 --2- 172.21.15.31:0/750837639 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7868159dd0 0x7f78680b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.391+0000 7f786efc4700 1 -- 172.21.15.31:0/750837639 >> 172.21.15.31:0/750837639 conn(0x7f78680cd1e0 msgr2=0x7f78680cb620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:38.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.391+0000 7f786efc4700 1 -- 172.21.15.31:0/750837639 shutdown_connections 2023-10-09T06:31:38.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.391+0000 7f786efc4700 1 -- 172.21.15.31:0/750837639 wait complete. 2023-10-09T06:31:38.393 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 82 2023-10-09T06:31:38.404 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:31:38.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.523+0000 7f87af47e700 1 Processor -- start 2023-10-09T06:31:38.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.523+0000 7f87af47e700 1 -- start start 2023-10-09T06:31:38.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87af47e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f87a815a030 0x7f87a815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87af47e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87a80cf100 0x7f87a80cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87af47e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87a80b40b0 0x7f87a80b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87af47e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a80d1960 con 0x7f87a80cf100 2023-10-09T06:31:38.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87af47e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a80d0610 con 0x7f87a815a030 2023-10-09T06:31:38.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87af47e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a815a940 con 0x7f87a80b40b0 2023-10-09T06:31:38.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87adc7b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87a80cf100 0x7f87a80cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87adc7b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87a80cf100 0x7f87a80cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43576/0 (socket says 172.21.15.31:43576) 2023-10-09T06:31:38.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87adc7b700 1 -- 172.21.15.31:0/4042833280 learned_addr learned my addr 172.21.15.31:0/4042833280 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:38.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87ae47c700 1 --2- 172.21.15.31:0/4042833280 >> v2:172.21.15.158:3300/0 conn(0x7f87a815a030 0x7f87a815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87aec7d700 1 --2- 172.21.15.31:0/4042833280 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87a80b40b0 0x7f87a80b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87adc7b700 1 -- 172.21.15.31:0/4042833280 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87a80b40b0 msgr2=0x7f87a80b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:38.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87adc7b700 1 --2- 172.21.15.31:0/4042833280 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87a80b40b0 0x7f87a80b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87adc7b700 1 -- 172.21.15.31:0/4042833280 >> v2:172.21.15.158:3300/0 conn(0x7f87a815a030 msgr2=0x7f87a815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:38.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87adc7b700 1 --2- 172.21.15.31:0/4042833280 >> v2:172.21.15.158:3300/0 conn(0x7f87a815a030 0x7f87a815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87adc7b700 1 -- 172.21.15.31:0/4042833280 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a80cfab0 con 0x7f87a80cf100 2023-10-09T06:31:38.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.524+0000 7f87ae47c700 1 --2- 172.21.15.31:0/4042833280 >> v2:172.21.15.158:3300/0 conn(0x7f87a815a030 0x7f87a815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:38.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.525+0000 7f87adc7b700 1 --2- 172.21.15.31:0/4042833280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87a80cf100 0x7f87a80cf570 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f87a806b8e0 tx=0x7f879c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1519c7f44c945c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.525+0000 7f87ad47a700 1 -- 172.21.15.31:0/4042833280 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c00b860 con 0x7f87a80cf100 2023-10-09T06:31:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.525+0000 7f87ad47a700 1 -- 172.21.15.31:0/4042833280 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c00b9c0 con 0x7f87a80cf100 2023-10-09T06:31:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.525+0000 7f87ad47a700 1 -- 172.21.15.31:0/4042833280 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c00bd60 con 0x7f87a80cf100 2023-10-09T06:31:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.525+0000 7f87af47e700 1 -- 172.21.15.31:0/4042833280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87a80cf100 msgr2=0x7f87a80cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.525+0000 7f87af47e700 1 --2- 172.21.15.31:0/4042833280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87a80cf100 0x7f87a80cf570 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f87a806b8e0 tx=0x7f879c009250 comp rx=0 tx=0).stop 2023-10-09T06:31:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.525+0000 7f87af47e700 1 -- 172.21.15.31:0/4042833280 shutdown_connections 2023-10-09T06:31:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.525+0000 7f87af47e700 1 --2- 172.21.15.31:0/4042833280 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87a80b40b0 0x7f87a80b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.525+0000 7f87af47e700 1 --2- 172.21.15.31:0/4042833280 >> v2:172.21.15.158:3300/0 conn(0x7f87a815a030 0x7f87a815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.525+0000 7f87af47e700 1 --2- 172.21.15.31:0/4042833280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87a80cf100 0x7f87a80cf570 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.525+0000 7f87af47e700 1 -- 172.21.15.31:0/4042833280 >> 172.21.15.31:0/4042833280 conn(0x7f87a8067e40 msgr2=0x7f87a80d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.526+0000 7f87af47e700 1 -- 172.21.15.31:0/4042833280 shutdown_connections 2023-10-09T06:31:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.526+0000 7f87af47e700 1 -- 172.21.15.31:0/4042833280 wait complete. 2023-10-09T06:31:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.527+0000 7f87af47e700 1 Processor -- start 2023-10-09T06:31:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.527+0000 7f87af47e700 1 -- start start 2023-10-09T06:31:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.527+0000 7f87af47e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f87a80b40b0 0x7f87a814b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.527+0000 7f87af47e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87a80cf100 0x7f87a815fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.527+0000 7f87af47e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87a815a030 0x7f87a81600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.527+0000 7f87af47e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a809ac70 con 0x7f87a80cf100 2023-10-09T06:31:38.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.527+0000 7f87af47e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a815ed30 con 0x7f87a80b40b0 2023-10-09T06:31:38.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.527+0000 7f87af47e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a815e120 con 0x7f87a815a030 2023-10-09T06:31:38.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.527+0000 7f87adc7b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87a80cf100 0x7f87a815fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.527+0000 7f87adc7b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87a80cf100 0x7f87a815fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43584/0 (socket says 172.21.15.31:43584) 2023-10-09T06:31:38.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.527+0000 7f87adc7b700 1 -- 172.21.15.31:0/92640712 learned_addr learned my addr 172.21.15.31:0/92640712 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:38.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87ae47c700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f87a80b40b0 0x7f87a814b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87aec7d700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87a815a030 0x7f87a81600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87adc7b700 1 -- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87a815a030 msgr2=0x7f87a81600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87adc7b700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87a815a030 0x7f87a81600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87adc7b700 1 -- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f87a80b40b0 msgr2=0x7f87a814b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87adc7b700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f87a80b40b0 0x7f87a814b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87adc7b700 1 -- 172.21.15.31:0/92640712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c0094f0 con 0x7f87a80cf100 2023-10-09T06:31:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87aec7d700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87a815a030 0x7f87a81600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87ae47c700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f87a80b40b0 0x7f87a814b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87adc7b700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87a80cf100 0x7f87a815fb70 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f879c009290 tx=0x7f879c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87a67fc700 1 -- 172.21.15.31:0/92640712 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c026480 con 0x7f87a80cf100 2023-10-09T06:31:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87a67fc700 1 -- 172.21.15.31:0/92640712 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c01f070 con 0x7f87a80cf100 2023-10-09T06:31:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87af47e700 1 -- 172.21.15.31:0/92640712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a815e400 con 0x7f87a80cf100 2023-10-09T06:31:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87a67fc700 1 -- 172.21.15.31:0/92640712 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c026830 con 0x7f87a80cf100 2023-10-09T06:31:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.528+0000 7f87af47e700 1 -- 172.21.15.31:0/92640712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a815e9c0 con 0x7f87a80cf100 2023-10-09T06:31:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.529+0000 7f87af47e700 1 -- 172.21.15.31:0/92640712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a8089300 con 0x7f87a80cf100 2023-10-09T06:31:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.529+0000 7f87a67fc700 1 -- 172.21.15.31:0/92640712 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f879c026ba0 con 0x7f87a80cf100 2023-10-09T06:31:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.530+0000 7f87a67fc700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8794066f30 0x7f87940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.530+0000 7f87a67fc700 1 -- 172.21.15.31:0/92640712 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f879c021070 con 0x7f87a80cf100 2023-10-09T06:31:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.530+0000 7f87a67fc700 1 -- 172.21.15.31:0/92640712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f879406eab0 con 0x7f87a80cf100 2023-10-09T06:31:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.530+0000 7f87ae47c700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8794066f30 0x7f87940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.530+0000 7f87ae47c700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8794066f30 0x7f87940693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f87a0006ea0 tx=0x7f87a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.534+0000 7f87a67fc700 1 -- 172.21.15.31:0/92640712 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f879c015060 con 0x7f87a80cf100 2023-10-09T06:31:38.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.772+0000 7f87af47e700 1 -- 172.21.15.31:0/92640712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87a815eea0 con 0x7f87a80cf100 2023-10-09T06:31:38.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.772+0000 7f87a67fc700 1 -- 172.21.15.31:0/92640712 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f879c053780 con 0x7f87a80cf100 2023-10-09T06:31:38.773 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:38.773 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1455840229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1455840229},{"type":"v1","addr":"172.21.15.158:6837","nonce":1455840229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7770,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3156917195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3156917195},{"type":"v1","addr":"172.21.15.31:6834","nonce":3156917195}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1537057825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1537057825},{"type":"v1","addr":"172.21.15.31:6835","nonce":1537057825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:30:24.382245+0000","modified":"2023-10-09T06:30:28.019930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7782":{"gid":7782,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.158:6836/3592438876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":3592438876},{"type":"v1","addr":"172.21.15.158:6836","nonce":3592438876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T06:31:38.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.775+0000 7f87af47e700 1 -- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8794066f30 msgr2=0x7f87940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.775+0000 7f87af47e700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8794066f30 0x7f87940693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f87a0006ea0 tx=0x7f87a0008040 comp rx=0 tx=0).stop 2023-10-09T06:31:38.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.775+0000 7f87af47e700 1 -- 172.21.15.31:0/92640712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87a80cf100 msgr2=0x7f87a815fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.775+0000 7f87af47e700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87a80cf100 0x7f87a815fb70 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f879c009290 tx=0x7f879c017000 comp rx=0 tx=0).stop 2023-10-09T06:31:38.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.775+0000 7f87af47e700 1 -- 172.21.15.31:0/92640712 shutdown_connections 2023-10-09T06:31:38.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.775+0000 7f87af47e700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8794066f30 0x7f87940693e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.775+0000 7f87af47e700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f87a815a030 0x7f87a81600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.775+0000 7f87af47e700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f87a80b40b0 0x7f87a814b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.775+0000 7f87af47e700 1 --2- 172.21.15.31:0/92640712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87a80cf100 0x7f87a815fb70 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.775+0000 7f87af47e700 1 -- 172.21.15.31:0/92640712 >> 172.21.15.31:0/92640712 conn(0x7f87a8067e40 msgr2=0x7f87a806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:38.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.775+0000 7f87af47e700 1 -- 172.21.15.31:0/92640712 shutdown_connections 2023-10-09T06:31:38.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.775+0000 7f87af47e700 1 -- 172.21.15.31:0/92640712 wait complete. 2023-10-09T06:31:38.777 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 82 2023-10-09T06:31:38.787 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:31:38.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.906+0000 7f5d2c89c700 1 Processor -- start 2023-10-09T06:31:38.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.906+0000 7f5d2c89c700 1 -- start start 2023-10-09T06:31:38.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.907+0000 7f5d2c89c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d2815a2b0 0x7f5d280b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.907+0000 7f5d2c89c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5d280d1c30 0x7f5d280cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.907+0000 7f5d2c89c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d280c5d80 con 0x7f5d2815a680 2023-10-09T06:31:38.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.907+0000 7f5d2c89c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d28068470 con 0x7f5d280d1c30 2023-10-09T06:31:38.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.907+0000 7f5d2c89c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280c6060 con 0x7f5d2815a2b0 2023-10-09T06:31:38.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.907+0000 7f5d26d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5d2815a680 0x7f5d280c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48226/0 (socket says 172.21.15.31:48226) 2023-10-09T06:31:38.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.907+0000 7f5d26d9d700 1 -- 172.21.15.31:0/482039113 learned_addr learned my addr 172.21.15.31:0/482039113 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:38.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.907+0000 7f5d2659c700 1 --2- 172.21.15.31:0/482039113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d2815a2b0 0x7f5d280b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.907+0000 7f5d25d9b700 1 --2- 172.21.15.31:0/482039113 >> v2:172.21.15.158:3300/0 conn(0x7f5d280d1c30 0x7f5d280cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.908+0000 7f5d2559a700 1 -- 172.21.15.31:0/482039113 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9497117 0 0) 0x7f5d280c5d80 con 0x7f5d2815a680 2023-10-09T06:31:38.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.908+0000 7f5d2559a700 1 -- 172.21.15.31:0/482039113 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d10003570 con 0x7f5d2815a680 2023-10-09T06:31:38.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.908+0000 7f5d2659c700 1 -- 172.21.15.31:0/482039113 >> v2:172.21.15.158:3300/0 conn(0x7f5d280d1c30 msgr2=0x7f5d280cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:38.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.908+0000 7f5d2659c700 1 --2- 172.21.15.31:0/482039113 >> v2:172.21.15.158:3300/0 conn(0x7f5d280d1c30 0x7f5d280cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.908+0000 7f5d2659c700 1 -- 172.21.15.31:0/482039113 >> v1:172.21.15.31:6789/0 conn(0x7f5d2815a680 legacy=0x7f5d280c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.908+0000 7f5d2559a700 1 -- 172.21.15.31:0/482039113 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3834465213 0 0) 0x7f5d10003570 con 0x7f5d2815a680 2023-10-09T06:31:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.908+0000 7f5d2659c700 1 -- 172.21.15.31:0/482039113 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d280c6340 con 0x7f5d2815a2b0 2023-10-09T06:31:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.908+0000 7f5d25d9b700 1 --2- 172.21.15.31:0/482039113 >> v2:172.21.15.158:3300/0 conn(0x7f5d280d1c30 0x7f5d280cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:31:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.908+0000 7f5d2659c700 1 --2- 172.21.15.31:0/482039113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d2815a2b0 0x7f5d280b3da0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5d180098d0 tx=0x7f5d18009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46a226e664c83f88 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.908+0000 7f5d2559a700 1 -- 172.21.15.31:0/482039113 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d200017f0 con 0x7f5d2815a2b0 2023-10-09T06:31:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.908+0000 7f5d2559a700 1 -- 172.21.15.31:0/482039113 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d18011420 con 0x7f5d2815a2b0 2023-10-09T06:31:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.908+0000 7f5d2559a700 1 -- 172.21.15.31:0/482039113 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d180117c0 con 0x7f5d2815a2b0 2023-10-09T06:31:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.909+0000 7f5d2c89c700 1 -- 172.21.15.31:0/482039113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d2815a2b0 msgr2=0x7f5d280b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.909+0000 7f5d2c89c700 1 --2- 172.21.15.31:0/482039113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d2815a2b0 0x7f5d280b3da0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5d180098d0 tx=0x7f5d18009120 comp rx=0 tx=0).stop 2023-10-09T06:31:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.909+0000 7f5d2c89c700 1 -- 172.21.15.31:0/482039113 shutdown_connections 2023-10-09T06:31:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.909+0000 7f5d2c89c700 1 --2- 172.21.15.31:0/482039113 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d2815a2b0 0x7f5d280b3da0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.909+0000 7f5d2c89c700 1 --2- 172.21.15.31:0/482039113 >> v2:172.21.15.158:3300/0 conn(0x7f5d280d1c30 0x7f5d280cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.909+0000 7f5d2c89c700 1 -- 172.21.15.31:0/482039113 >> 172.21.15.31:0/482039113 conn(0x7f5d28067e40 msgr2=0x7f5d280d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.909+0000 7f5d2c89c700 1 -- 172.21.15.31:0/482039113 shutdown_connections 2023-10-09T06:31:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.909+0000 7f5d2c89c700 1 -- 172.21.15.31:0/482039113 wait complete. 2023-10-09T06:31:38.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.910+0000 7f5d2c89c700 1 Processor -- start 2023-10-09T06:31:38.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.910+0000 7f5d2c89c700 1 -- start start 2023-10-09T06:31:38.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2c89c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d280d1c30 0x7f5d28157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2c89c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d2815a2b0 0x7f5d2815bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2c89c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d2815a680 0x7f5d2815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2c89c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d28157d50 con 0x7f5d280d1c30 2023-10-09T06:31:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2c89c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d281445b0 con 0x7f5d2815a680 2023-10-09T06:31:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2c89c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2815e9f0 con 0x7f5d2815a2b0 2023-10-09T06:31:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d280d1c30 0x7f5d28157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d280d1c30 0x7f5d28157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43598/0 (socket says 172.21.15.31:43598) 2023-10-09T06:31:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2659c700 1 -- 172.21.15.31:0/1049099738 learned_addr learned my addr 172.21.15.31:0/1049099738 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d25d9b700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d2815a2b0 0x7f5d2815bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d26d9d700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d2815a680 0x7f5d2815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2659c700 1 -- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d2815a2b0 msgr2=0x7f5d2815bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2659c700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d2815a2b0 0x7f5d2815bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2659c700 1 -- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d2815a680 msgr2=0x7f5d2815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2659c700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d2815a680 0x7f5d2815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2659c700 1 -- 172.21.15.31:0/1049099738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c009420 con 0x7f5d280d1c30 2023-10-09T06:31:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d26d9d700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d2815a680 0x7f5d2815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2659c700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d280d1c30 0x7f5d28157810 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f5d18009160 tx=0x7f5d18016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d167fc700 1 -- 172.21.15.31:0/1049099738 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1801cd20 con 0x7f5d280d1c30 2023-10-09T06:31:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d167fc700 1 -- 172.21.15.31:0/1049099738 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1801ce80 con 0x7f5d280d1c30 2023-10-09T06:31:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d2c89c700 1 -- 172.21.15.31:0/1049099738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d180093c0 con 0x7f5d280d1c30 2023-10-09T06:31:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.911+0000 7f5d167fc700 1 -- 172.21.15.31:0/1049099738 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1801a6a0 con 0x7f5d280d1c30 2023-10-09T06:31:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.912+0000 7f5d2c89c700 1 -- 172.21.15.31:0/1049099738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2815e3a0 con 0x7f5d280d1c30 2023-10-09T06:31:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.912+0000 7f5d2c89c700 1 -- 172.21.15.31:0/1049099738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2804c3c0 con 0x7f5d280d1c30 2023-10-09T06:31:38.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.913+0000 7f5d167fc700 1 -- 172.21.15.31:0/1049099738 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d1801aa50 con 0x7f5d280d1c30 2023-10-09T06:31:38.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.913+0000 7f5d167fc700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5d08066f30 0x7f5d080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:38.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.913+0000 7f5d167fc700 1 -- 172.21.15.31:0/1049099738 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f5d18085ec0 con 0x7f5d280d1c30 2023-10-09T06:31:38.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.913+0000 7f5d167fc700 1 -- 172.21.15.31:0/1049099738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f5d0806eab0 con 0x7f5d280d1c30 2023-10-09T06:31:38.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.913+0000 7f5d25d9b700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5d08066f30 0x7f5d080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:38.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.914+0000 7f5d25d9b700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5d08066f30 0x7f5d080693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0093f0 tx=0x7f5d1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:38.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:38.917+0000 7f5d167fc700 1 -- 172.21.15.31:0/1049099738 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d18029060 con 0x7f5d280d1c30 2023-10-09T06:31:39.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.110+0000 7f5d2c89c700 1 -- 172.21.15.31:0/1049099738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d28064a00 con 0x7f5d280d1c30 2023-10-09T06:31:39.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.110+0000 7f5d167fc700 1 -- 172.21.15.31:0/1049099738 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+15440 (secure 0 0 0) 0x7f5d18053110 con 0x7f5d280d1c30 2023-10-09T06:31:39.112 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:39.112 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":172,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:31:11.792110+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:30:22.788833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T06:30:23.358451+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.7","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:31:39.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.113+0000 7f5d2c89c700 1 -- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5d08066f30 msgr2=0x7f5d080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:39.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.113+0000 7f5d2c89c700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5d08066f30 0x7f5d080693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0093f0 tx=0x7f5d1c008040 comp rx=0 tx=0).stop 2023-10-09T06:31:39.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.113+0000 7f5d2c89c700 1 -- 172.21.15.31:0/1049099738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d280d1c30 msgr2=0x7f5d28157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:39.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.113+0000 7f5d2c89c700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d280d1c30 0x7f5d28157810 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f5d18009160 tx=0x7f5d18016000 comp rx=0 tx=0).stop 2023-10-09T06:31:39.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.113+0000 7f5d2c89c700 1 -- 172.21.15.31:0/1049099738 shutdown_connections 2023-10-09T06:31:39.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.113+0000 7f5d2c89c700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5d08066f30 0x7f5d080693e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.113+0000 7f5d2c89c700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d2815a680 0x7f5d2815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.113+0000 7f5d2c89c700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d280d1c30 0x7f5d28157810 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.113+0000 7f5d2c89c700 1 --2- 172.21.15.31:0/1049099738 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5d2815a2b0 0x7f5d2815bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.113+0000 7f5d2c89c700 1 -- 172.21.15.31:0/1049099738 >> 172.21.15.31:0/1049099738 conn(0x7f5d28067e40 msgr2=0x7f5d280d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:39.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.113+0000 7f5d2c89c700 1 -- 172.21.15.31:0/1049099738 shutdown_connections 2023-10-09T06:31:39.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.113+0000 7f5d2c89c700 1 -- 172.21.15.31:0/1049099738 wait complete. 2023-10-09T06:31:39.126 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:31:39.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.246+0000 7f1366961700 1 Processor -- start 2023-10-09T06:31:39.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.246+0000 7f1366961700 1 -- start start 2023-10-09T06:31:39.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.247+0000 7f1366961700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f13600abae0 0x7f13600c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:39.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.247+0000 7f1366961700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13600c8b10 0x7f13600c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:39.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.247+0000 7f1366961700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13600c9cb0 con 0x7f13600abeb0 2023-10-09T06:31:39.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.247+0000 7f1366961700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13600c90a0 con 0x7f13600abae0 2023-10-09T06:31:39.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.247+0000 7f1366961700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13600c9380 con 0x7f13600c8b10 2023-10-09T06:31:39.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.247+0000 7f135ffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f13600abae0 0x7f13600c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:39.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.247+0000 7f1364efe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13600c8b10 0x7f13600c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:39.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.247+0000 7f135f7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f13600abeb0 0x7f13600c8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:50844/0 (socket says 172.21.15.31:50844) 2023-10-09T06:31:39.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.247+0000 7f135f7fe700 1 -- 172.21.15.31:0/1188736813 learned_addr learned my addr 172.21.15.31:0/1188736813 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:39.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.248+0000 7f1364efe700 1 -- 172.21.15.31:0/1188736813 >> v2:172.21.15.158:3300/0 conn(0x7f13600abae0 msgr2=0x7f13600c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:39.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.248+0000 7f1364efe700 1 --2- 172.21.15.31:0/1188736813 >> v2:172.21.15.158:3300/0 conn(0x7f13600abae0 0x7f13600c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.248+0000 7f1364efe700 1 -- 172.21.15.31:0/1188736813 >> v1:172.21.15.158:6789/0 conn(0x7f13600abeb0 legacy=0x7f13600c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:39.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.248+0000 7f135effd700 1 -- 172.21.15.31:0/1188736813 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047705602 0 0) 0x7f13600c9cb0 con 0x7f13600abeb0 2023-10-09T06:31:39.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.248+0000 7f1364efe700 1 -- 172.21.15.31:0/1188736813 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600c9660 con 0x7f13600c8b10 2023-10-09T06:31:39.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.249+0000 7f1364efe700 1 --2- 172.21.15.31:0/1188736813 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13600c8b10 0x7f13600c73f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1358009e60 tx=0x7f1358009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35863af028f69393 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.249+0000 7f135effd700 1 -- 172.21.15.31:0/1188736813 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135800e070 con 0x7f13600c8b10 2023-10-09T06:31:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.249+0000 7f135effd700 1 -- 172.21.15.31:0/1188736813 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135800bb60 con 0x7f13600c8b10 2023-10-09T06:31:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.249+0000 7f135effd700 1 -- 172.21.15.31:0/1188736813 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358012430 con 0x7f13600c8b10 2023-10-09T06:31:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.250+0000 7f1366961700 1 -- 172.21.15.31:0/1188736813 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13600c8b10 msgr2=0x7f13600c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.250+0000 7f1366961700 1 --2- 172.21.15.31:0/1188736813 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13600c8b10 0x7f13600c73f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1358009e60 tx=0x7f1358009780 comp rx=0 tx=0).stop 2023-10-09T06:31:39.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.250+0000 7f1366961700 1 -- 172.21.15.31:0/1188736813 shutdown_connections 2023-10-09T06:31:39.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.250+0000 7f1366961700 1 --2- 172.21.15.31:0/1188736813 >> v2:172.21.15.158:3300/0 conn(0x7f13600abae0 0x7f13600c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.250+0000 7f1366961700 1 --2- 172.21.15.31:0/1188736813 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13600c8b10 0x7f13600c73f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.250+0000 7f1366961700 1 -- 172.21.15.31:0/1188736813 >> 172.21.15.31:0/1188736813 conn(0x7f1360067660 msgr2=0x7f1360067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:39.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.250+0000 7f1366961700 1 -- 172.21.15.31:0/1188736813 shutdown_connections 2023-10-09T06:31:39.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.250+0000 7f1366961700 1 -- 172.21.15.31:0/1188736813 wait complete. 2023-10-09T06:31:39.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.251+0000 7f1366961700 1 Processor -- start 2023-10-09T06:31:39.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.251+0000 7f1366961700 1 -- start start 2023-10-09T06:31:39.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.252+0000 7f1366961700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13600abae0 0x7f1360157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:39.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.252+0000 7f1366961700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13600abeb0 0x7f13600af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:39.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.252+0000 7f1366961700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13600c8b10 0x7f13600b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:39.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.252+0000 7f1366961700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136016ad30 con 0x7f13600c8b10 2023-10-09T06:31:39.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.252+0000 7f1366961700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13600cbe10 con 0x7f13600abeb0 2023-10-09T06:31:39.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.252+0000 7f1366961700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13600cc0f0 con 0x7f13600abae0 2023-10-09T06:31:39.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.252+0000 7f1364efe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13600c8b10 0x7f13600b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.252+0000 7f1364efe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13600c8b10 0x7f13600b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43606/0 (socket says 172.21.15.31:43606) 2023-10-09T06:31:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.252+0000 7f1364efe700 1 -- 172.21.15.31:0/2701281314 learned_addr learned my addr 172.21.15.31:0/2701281314 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.252+0000 7f135f7fe700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13600abeb0 0x7f13600af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.252+0000 7f135ffff700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13600abae0 0x7f1360157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.253+0000 7f1364efe700 1 -- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13600abae0 msgr2=0x7f1360157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.253+0000 7f1364efe700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13600abae0 0x7f1360157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.253+0000 7f1364efe700 1 -- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13600abeb0 msgr2=0x7f13600af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.253+0000 7f1364efe700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13600abeb0 0x7f13600af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.253+0000 7f1364efe700 1 -- 172.21.15.31:0/2701281314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1358009a20 con 0x7f13600c8b10 2023-10-09T06:31:39.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.253+0000 7f135f7fe700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13600abeb0 0x7f13600af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:39.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.253+0000 7f1364efe700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13600c8b10 0x7f13600b1bd0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f13600c94c0 tx=0x7f1358019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:39.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.253+0000 7f1347fff700 1 -- 172.21.15.31:0/2701281314 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358027470 con 0x7f13600c8b10 2023-10-09T06:31:39.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.253+0000 7f1347fff700 1 -- 172.21.15.31:0/2701281314 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1358027610 con 0x7f13600c8b10 2023-10-09T06:31:39.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.253+0000 7f1366961700 1 -- 172.21.15.31:0/2701281314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13600cc3d0 con 0x7f13600c8b10 2023-10-09T06:31:39.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.253+0000 7f1347fff700 1 -- 172.21.15.31:0/2701281314 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13580279d0 con 0x7f13600c8b10 2023-10-09T06:31:39.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.253+0000 7f1366961700 1 -- 172.21.15.31:0/2701281314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1360158310 con 0x7f13600c8b10 2023-10-09T06:31:39.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.254+0000 7f1366961700 1 -- 172.21.15.31:0/2701281314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136004c3c0 con 0x7f13600c8b10 2023-10-09T06:31:39.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.254+0000 7f1347fff700 1 -- 172.21.15.31:0/2701281314 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1358024070 con 0x7f13600c8b10 2023-10-09T06:31:39.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.255+0000 7f1347fff700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f134c066f30 0x7f134c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:39.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.255+0000 7f1347fff700 1 -- 172.21.15.31:0/2701281314 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f1358087030 con 0x7f13600c8b10 2023-10-09T06:31:39.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.255+0000 7f1347fff700 1 -- 172.21.15.31:0/2701281314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f134c06eab0 con 0x7f13600c8b10 2023-10-09T06:31:39.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.255+0000 7f135ffff700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f134c066f30 0x7f134c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:39.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.256+0000 7f135ffff700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f134c066f30 0x7f134c0693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1350009d40 tx=0x7f1350008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:39.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.259+0000 7f1347fff700 1 -- 172.21.15.31:0/2701281314 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1358054280 con 0x7f13600c8b10 2023-10-09T06:31:39.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.496+0000 7f1366961700 1 -- 172.21.15.31:0/2701281314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f136006aeb0 con 0x7f13600c8b10 2023-10-09T06:31:39.497 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:31:39.497+0000 7fc5e82b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:31:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.499+0000 7f1347fff700 1 -- 172.21.15.31:0/2701281314 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(173..173 src has 1..173) v4 ==== 366+0+0 (secure 0 0 0) 0x7f1358057f40 con 0x7f13600c8b10 2023-10-09T06:31:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.499+0000 7f1347fff700 1 -- 172.21.15.31:0/2701281314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f134c06f450 con 0x7f13600c8b10 2023-10-09T06:31:39.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.501+0000 7f1347fff700 1 -- 172.21.15.31:0/2701281314 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v83) v1 ==== 161+0+0 (secure 0 0 0) 0x7f135802c030 con 0x7f13600c8b10 2023-10-09T06:31:39.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.503+0000 7f1366961700 1 -- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f134c066f30 msgr2=0x7f134c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:39.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.503+0000 7f1366961700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f134c066f30 0x7f134c0693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1350009d40 tx=0x7f1350008040 comp rx=0 tx=0).stop 2023-10-09T06:31:39.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.503+0000 7f1366961700 1 -- 172.21.15.31:0/2701281314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13600c8b10 msgr2=0x7f13600b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:39.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.503+0000 7f1366961700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13600c8b10 0x7f13600b1bd0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f13600c94c0 tx=0x7f1358019000 comp rx=0 tx=0).stop 2023-10-09T06:31:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.503+0000 7f1366961700 1 -- 172.21.15.31:0/2701281314 shutdown_connections 2023-10-09T06:31:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.503+0000 7f1366961700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f134c066f30 0x7f134c0693e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.503+0000 7f1366961700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f13600abae0 0x7f1360157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.503+0000 7f1366961700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13600c8b10 0x7f13600b1bd0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.503+0000 7f1366961700 1 --2- 172.21.15.31:0/2701281314 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13600abeb0 0x7f13600af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.503+0000 7f1366961700 1 -- 172.21.15.31:0/2701281314 >> 172.21.15.31:0/2701281314 conn(0x7f1360067660 msgr2=0x7f13600c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.504+0000 7f1366961700 1 -- 172.21.15.31:0/2701281314 shutdown_connections 2023-10-09T06:31:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.504+0000 7f1366961700 1 -- 172.21.15.31:0/2701281314 wait complete. 2023-10-09T06:31:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:31:39.507 INFO:tasks.ceph.mds.b.smithi158.stderr: -8350> 2023-10-09T06:30:30.301+0000 7f52679c5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:31:39.516 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:31:39.537 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:31:39.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.636+0000 7f4c34bf7700 1 Processor -- start 2023-10-09T06:31:39.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.636+0000 7f4c34bf7700 1 -- start start 2023-10-09T06:31:39.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c34bf7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4c3006d370 0x7f4c3006d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c34bf7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3015c8d0 con 0x7f4c30152300 2023-10-09T06:31:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c34bf7700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c300c9370 con 0x7f4c3015b9a0 2023-10-09T06:31:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c34bf7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c300b1400 con 0x7f4c3006d370 2023-10-09T06:31:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c2ed9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4c3006d370 0x7f4c3006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c2e59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4c30152300 0x7f4c30158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34348/0 (socket says 172.21.15.31:34348) 2023-10-09T06:31:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c2e59c700 1 -- 172.21.15.31:0/2484516447 learned_addr learned my addr 172.21.15.31:0/2484516447 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c2ed9d700 1 -- 172.21.15.31:0/2484516447 >> v1:172.21.15.158:6789/0 conn(0x7f4c3015b9a0 legacy=0x7f4c300caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c2ed9d700 1 -- 172.21.15.31:0/2484516447 >> v1:172.21.15.31:6789/0 conn(0x7f4c30152300 legacy=0x7f4c30158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c2d59a700 1 -- 172.21.15.31:0/2484516447 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952345392 0 0) 0x7f4c300c9370 con 0x7f4c3015b9a0 2023-10-09T06:31:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c2ed9d700 1 -- 172.21.15.31:0/2484516447 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3015c030 con 0x7f4c3006d370 2023-10-09T06:31:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c2ed9d700 1 --2- 172.21.15.31:0/2484516447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c3006d370 0x7f4c3006d790 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009e60 tx=0x7f4c20009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd446ae358b8f6b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c2d59a700 1 -- 172.21.15.31:0/2484516447 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2000e070 con 0x7f4c3006d370 2023-10-09T06:31:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c2d59a700 1 -- 172.21.15.31:0/2484516447 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2000bb30 con 0x7f4c3006d370 2023-10-09T06:31:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.638+0000 7f4c2d59a700 1 -- 172.21.15.31:0/2484516447 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20012430 con 0x7f4c3006d370 2023-10-09T06:31:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.639+0000 7f4c34bf7700 1 -- 172.21.15.31:0/2484516447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c3006d370 msgr2=0x7f4c3006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.639+0000 7f4c34bf7700 1 --2- 172.21.15.31:0/2484516447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c3006d370 0x7f4c3006d790 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009e60 tx=0x7f4c20009780 comp rx=0 tx=0).stop 2023-10-09T06:31:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.639+0000 7f4c34bf7700 1 -- 172.21.15.31:0/2484516447 shutdown_connections 2023-10-09T06:31:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.639+0000 7f4c34bf7700 1 --2- 172.21.15.31:0/2484516447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c3006d370 0x7f4c3006d790 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.639+0000 7f4c34bf7700 1 -- 172.21.15.31:0/2484516447 >> 172.21.15.31:0/2484516447 conn(0x7f4c30069870 msgr2=0x7f4c30069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.639+0000 7f4c34bf7700 1 -- 172.21.15.31:0/2484516447 shutdown_connections 2023-10-09T06:31:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.639+0000 7f4c34bf7700 1 -- 172.21.15.31:0/2484516447 wait complete. 2023-10-09T06:31:39.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.640+0000 7f4c34bf7700 1 Processor -- start 2023-10-09T06:31:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.640+0000 7f4c34bf7700 1 -- start start 2023-10-09T06:31:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c34bf7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c3006d370 0x7f4c300c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c34bf7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4c30152300 0x7f4c30168aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c34bf7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c3015b9a0 0x7f4c3016aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c34bf7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3015cba0 con 0x7f4c3006d370 2023-10-09T06:31:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c34bf7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300c7ef0 con 0x7f4c3015b9a0 2023-10-09T06:31:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c34bf7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3015ce10 con 0x7f4c30152300 2023-10-09T06:31:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c2e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c3006d370 0x7f4c300c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c2e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c3006d370 0x7f4c300c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51524/0 (socket says 172.21.15.31:51524) 2023-10-09T06:31:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c2e59c700 1 -- 172.21.15.31:0/1982306840 learned_addr learned my addr 172.21.15.31:0/1982306840 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c2e59c700 1 -- 172.21.15.31:0/1982306840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4c30152300 msgr2=0x7f4c30168aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:39.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c2e59c700 1 --2- 172.21.15.31:0/1982306840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4c30152300 0x7f4c30168aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c2e59c700 1 -- 172.21.15.31:0/1982306840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c3015b9a0 msgr2=0x7f4c3016aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:39.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c2e59c700 1 --2- 172.21.15.31:0/1982306840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c3015b9a0 0x7f4c3016aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:39.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c2e59c700 1 -- 172.21.15.31:0/1982306840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c20009a20 con 0x7f4c3006d370 2023-10-09T06:31:39.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.641+0000 7f4c2e59c700 1 --2- 172.21.15.31:0/1982306840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c3006d370 0x7f4c300c79b0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800c760 tx=0x7f4c28007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:39.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.642+0000 7f4c267fc700 1 -- 172.21.15.31:0/1982306840 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28005b30 con 0x7f4c3006d370 2023-10-09T06:31:39.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.642+0000 7f4c267fc700 1 -- 172.21.15.31:0/1982306840 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c28005cb0 con 0x7f4c3006d370 2023-10-09T06:31:39.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.642+0000 7f4c34bf7700 1 -- 172.21.15.31:0/1982306840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3015d0f0 con 0x7f4c3006d370 2023-10-09T06:31:39.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.642+0000 7f4c267fc700 1 -- 172.21.15.31:0/1982306840 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28007340 con 0x7f4c3006d370 2023-10-09T06:31:39.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.642+0000 7f4c34bf7700 1 -- 172.21.15.31:0/1982306840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c30168fe0 con 0x7f4c3006d370 2023-10-09T06:31:39.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.643+0000 7f4c34bf7700 1 -- 172.21.15.31:0/1982306840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3015d610 con 0x7f4c3006d370 2023-10-09T06:31:39.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.643+0000 7f4c267fc700 1 -- 172.21.15.31:0/1982306840 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c2801b400 con 0x7f4c3006d370 2023-10-09T06:31:39.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.644+0000 7f4c267fc700 1 --2- 172.21.15.31:0/1982306840 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c10066f30 0x7f4c100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:39.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.644+0000 7f4c267fc700 1 -- 172.21.15.31:0/1982306840 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5820+0+0 (secure 0 0 0) 0x7f4c28084150 con 0x7f4c3006d370 2023-10-09T06:31:39.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.644+0000 7f4c2dd9b700 1 --2- 172.21.15.31:0/1982306840 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c10066f30 0x7f4c100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:39.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.644+0000 7f4c267fc700 1 -- 172.21.15.31:0/1982306840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f4c1006eb50 con 0x7f4c3006d370 2023-10-09T06:31:39.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.644+0000 7f4c2dd9b700 1 --2- 172.21.15.31:0/1982306840 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c10066f30 0x7f4c100693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4c180016d0 tx=0x7f4c18007b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:39.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.648+0000 7f4c267fc700 1 -- 172.21.15.31:0/1982306840 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c280513d0 con 0x7f4c3006d370 2023-10-09T06:31:39.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:39.887+0000 7f4c34bf7700 1 -- 172.21.15.31:0/1982306840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4c3004c3c0 con 0x7f4c3006d370 2023-10-09T06:31:40.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.501+0000 7f4c267fc700 1 -- 172.21.15.31:0/1982306840 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v84) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4c280549f0 con 0x7f4c3006d370 2023-10-09T06:31:40.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.504+0000 7f4c34bf7700 1 -- 172.21.15.31:0/1982306840 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c10066f30 msgr2=0x7f4c100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:40.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.504+0000 7f4c34bf7700 1 --2- 172.21.15.31:0/1982306840 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c10066f30 0x7f4c100693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4c180016d0 tx=0x7f4c18007b40 comp rx=0 tx=0).stop 2023-10-09T06:31:40.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.504+0000 7f4c34bf7700 1 -- 172.21.15.31:0/1982306840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c3006d370 msgr2=0x7f4c300c79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:40.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.504+0000 7f4c34bf7700 1 --2- 172.21.15.31:0/1982306840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c3006d370 0x7f4c300c79b0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800c760 tx=0x7f4c28007ef0 comp rx=0 tx=0).stop 2023-10-09T06:31:40.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.504+0000 7f4c34bf7700 1 -- 172.21.15.31:0/1982306840 shutdown_connections 2023-10-09T06:31:40.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.504+0000 7f4c34bf7700 1 --2- 172.21.15.31:0/1982306840 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4c10066f30 0x7f4c100693e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:40.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.504+0000 7f4c34bf7700 1 --2- 172.21.15.31:0/1982306840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c3015b9a0 0x7f4c3016aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:40.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.504+0000 7f4c34bf7700 1 --2- 172.21.15.31:0/1982306840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c3006d370 0x7f4c300c79b0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:40.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.504+0000 7f4c34bf7700 1 --2- 172.21.15.31:0/1982306840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4c30152300 0x7f4c30168aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:40.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.504+0000 7f4c34bf7700 1 -- 172.21.15.31:0/1982306840 >> 172.21.15.31:0/1982306840 conn(0x7f4c30069870 msgr2=0x7f4c300c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:40.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.504+0000 7f4c34bf7700 1 -- 172.21.15.31:0/1982306840 shutdown_connections 2023-10-09T06:31:40.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.504+0000 7f4c34bf7700 1 -- 172.21.15.31:0/1982306840 wait complete. 2023-10-09T06:31:40.522 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:31:40.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.650+0000 7f9e9ede8700 1 Processor -- start 2023-10-09T06:31:40.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.650+0000 7f9e9ede8700 1 -- start start 2023-10-09T06:31:40.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9ede8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9e98157b10 0x7f9e9815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:40.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9ede8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9e9815aee0 0x7f9e98067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:40.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9ede8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e98067ba0 0x7f9e9806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:40.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9ede8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9815e9e0 con 0x7f9e98157b10 2023-10-09T06:31:40.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9ede8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e98157ee0 con 0x7f9e9815aee0 2023-10-09T06:31:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9ede8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980cf350 con 0x7f9e98067ba0 2023-10-09T06:31:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9cb84700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9e98157b10 0x7f9e9815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9cb84700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9e98157b10 0x7f9e9815dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51526/0 (socket says 172.21.15.31:51526) 2023-10-09T06:31:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9cb84700 1 -- 172.21.15.31:0/940893321 learned_addr learned my addr 172.21.15.31:0/940893321 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9d385700 1 --2- 172.21.15.31:0/940893321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e98067ba0 0x7f9e9806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e97fff700 1 --2- 172.21.15.31:0/940893321 >> v2:172.21.15.158:3300/0 conn(0x7f9e9815aee0 0x7f9e98067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9cb84700 1 -- 172.21.15.31:0/940893321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e98067ba0 msgr2=0x7f9e9806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9cb84700 1 --2- 172.21.15.31:0/940893321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e98067ba0 0x7f9e9806a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9cb84700 1 -- 172.21.15.31:0/940893321 >> v2:172.21.15.158:3300/0 conn(0x7f9e9815aee0 msgr2=0x7f9e98067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9cb84700 1 --2- 172.21.15.31:0/940893321 >> v2:172.21.15.158:3300/0 conn(0x7f9e9815aee0 0x7f9e98067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9cb84700 1 -- 172.21.15.31:0/940893321 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98067fe0 con 0x7f9e98157b10 2023-10-09T06:31:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e9d385700 1 --2- 172.21.15.31:0/940893321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e98067ba0 0x7f9e9806a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.651+0000 7f9e97fff700 1 --2- 172.21.15.31:0/940893321 >> v2:172.21.15.158:3300/0 conn(0x7f9e9815aee0 0x7f9e98067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.652+0000 7f9e9cb84700 1 --2- 172.21.15.31:0/940893321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e98157b10 0x7f9e9815dab0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f9e98068b40 tx=0x7f9e90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7781dcefffc5438 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.652+0000 7f9e977fe700 1 -- 172.21.15.31:0/940893321 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000b860 con 0x7f9e98157b10 2023-10-09T06:31:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.652+0000 7f9e977fe700 1 -- 172.21.15.31:0/940893321 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9000b9c0 con 0x7f9e98157b10 2023-10-09T06:31:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.652+0000 7f9e977fe700 1 -- 172.21.15.31:0/940893321 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000bd60 con 0x7f9e98157b10 2023-10-09T06:31:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.652+0000 7f9e9ede8700 1 -- 172.21.15.31:0/940893321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e98157b10 msgr2=0x7f9e9815dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.652+0000 7f9e9ede8700 1 --2- 172.21.15.31:0/940893321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e98157b10 0x7f9e9815dab0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f9e98068b40 tx=0x7f9e90009250 comp rx=0 tx=0).stop 2023-10-09T06:31:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.652+0000 7f9e9ede8700 1 -- 172.21.15.31:0/940893321 shutdown_connections 2023-10-09T06:31:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.652+0000 7f9e9ede8700 1 --2- 172.21.15.31:0/940893321 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e98067ba0 0x7f9e9806a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:40.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.652+0000 7f9e9ede8700 1 --2- 172.21.15.31:0/940893321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e98157b10 0x7f9e9815dab0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:40.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.652+0000 7f9e9ede8700 1 --2- 172.21.15.31:0/940893321 >> v2:172.21.15.158:3300/0 conn(0x7f9e9815aee0 0x7f9e98067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:40.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.652+0000 7f9e9ede8700 1 -- 172.21.15.31:0/940893321 >> 172.21.15.31:0/940893321 conn(0x7f9e980d0de0 msgr2=0x7f9e980d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:40.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.652+0000 7f9e9ede8700 1 -- 172.21.15.31:0/940893321 shutdown_connections 2023-10-09T06:31:40.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.652+0000 7f9e9ede8700 1 -- 172.21.15.31:0/940893321 wait complete. 2023-10-09T06:31:40.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.653+0000 7f9e9ede8700 1 Processor -- start 2023-10-09T06:31:40.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.653+0000 7f9e9ede8700 1 -- start start 2023-10-09T06:31:40.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.654+0000 7f9e9ede8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e98067ba0 0x7f9e981549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.654+0000 7f9e9ede8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e98157b10 0x7f9e980c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.654+0000 7f9e9ede8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e9815aee0 0x7f9e98159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.654+0000 7f9e9ede8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980b1660 con 0x7f9e98157b10 2023-10-09T06:31:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.654+0000 7f9e9ede8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e98154f10 con 0x7f9e98067ba0 2023-10-09T06:31:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.654+0000 7f9e9ede8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980b0d30 con 0x7f9e9815aee0 2023-10-09T06:31:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.654+0000 7f9e97fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e98157b10 0x7f9e980c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.654+0000 7f9e97fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e98157b10 0x7f9e980c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51540/0 (socket says 172.21.15.31:51540) 2023-10-09T06:31:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.654+0000 7f9e97fff700 1 -- 172.21.15.31:0/1451962160 learned_addr learned my addr 172.21.15.31:0/1451962160 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.654+0000 7f9e9cb84700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e98067ba0 0x7f9e981549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.655+0000 7f9e9d385700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e9815aee0 0x7f9e98159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:40.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.655+0000 7f9e97fff700 1 -- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e9815aee0 msgr2=0x7f9e98159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:40.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.655+0000 7f9e97fff700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e9815aee0 0x7f9e98159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:40.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.655+0000 7f9e97fff700 1 -- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e98067ba0 msgr2=0x7f9e981549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:40.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.655+0000 7f9e97fff700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e98067ba0 0x7f9e981549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:40.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.655+0000 7f9e97fff700 1 -- 172.21.15.31:0/1451962160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e900094f0 con 0x7f9e98157b10 2023-10-09T06:31:40.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.655+0000 7f9e97fff700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e98157b10 0x7f9e980c8d60 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800d0d0 tx=0x7f9e88009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:40.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.655+0000 7f9e94ff9700 1 -- 172.21.15.31:0/1451962160 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8800dd70 con 0x7f9e98157b10 2023-10-09T06:31:40.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.655+0000 7f9e94ff9700 1 -- 172.21.15.31:0/1451962160 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8800f040 con 0x7f9e98157b10 2023-10-09T06:31:40.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.655+0000 7f9e94ff9700 1 -- 172.21.15.31:0/1451962160 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88015650 con 0x7f9e98157b10 2023-10-09T06:31:40.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.655+0000 7f9e9ede8700 1 -- 172.21.15.31:0/1451962160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e980b1010 con 0x7f9e98157b10 2023-10-09T06:31:40.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.655+0000 7f9e9ede8700 1 -- 172.21.15.31:0/1451962160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e980c92a0 con 0x7f9e98157b10 2023-10-09T06:31:40.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.656+0000 7f9e9ede8700 1 -- 172.21.15.31:0/1451962160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9804c3c0 con 0x7f9e98157b10 2023-10-09T06:31:40.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.656+0000 7f9e94ff9700 1 -- 172.21.15.31:0/1451962160 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e88015a40 con 0x7f9e98157b10 2023-10-09T06:31:40.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.657+0000 7f9e94ff9700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9e78066f30 0x7f9e780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:40.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.657+0000 7f9e94ff9700 1 -- 172.21.15.31:0/1451962160 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5820+0+0 (secure 0 0 0) 0x7f9e88084960 con 0x7f9e98157b10 2023-10-09T06:31:40.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.657+0000 7f9e9cb84700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9e78066f30 0x7f9e780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:40.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.657+0000 7f9e94ff9700 1 -- 172.21.15.31:0/1451962160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f9e7806eb50 con 0x7f9e98157b10 2023-10-09T06:31:40.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.658+0000 7f9e9cb84700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9e78066f30 0x7f9e780693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9e98068b40 tx=0x7f9e90017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:40.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.661+0000 7f9e94ff9700 1 -- 172.21.15.31:0/1451962160 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e8804e5a0 con 0x7f9e98157b10 2023-10-09T06:31:40.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:40.855+0000 7f9e9ede8700 1 -- 172.21.15.31:0/1451962160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9e980b17a0 con 0x7f9e98157b10 2023-10-09T06:31:41.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.504+0000 7f9e94ff9700 1 -- 172.21.15.31:0/1451962160 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(174..174 src has 1..174) v4 ==== 288+0+0 (secure 0 0 0) 0x7f9e880558d0 con 0x7f9e98157b10 2023-10-09T06:31:41.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.504+0000 7f9e94ff9700 1 -- 172.21.15.31:0/1451962160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7f9e7806cf80 con 0x7f9e98157b10 2023-10-09T06:31:41.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.508+0000 7f9e94ff9700 1 -- 172.21.15.31:0/1451962160 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v174) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9e8801a060 con 0x7f9e98157b10 2023-10-09T06:31:41.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.512+0000 7f9e9ede8700 1 -- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9e78066f30 msgr2=0x7f9e780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:41.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.512+0000 7f9e9ede8700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9e78066f30 0x7f9e780693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9e98068b40 tx=0x7f9e90017000 comp rx=0 tx=0).stop 2023-10-09T06:31:41.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.512+0000 7f9e9ede8700 1 -- 172.21.15.31:0/1451962160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e98157b10 msgr2=0x7f9e980c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:41.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.512+0000 7f9e9ede8700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e98157b10 0x7f9e980c8d60 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800d0d0 tx=0x7f9e88009970 comp rx=0 tx=0).stop 2023-10-09T06:31:41.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.512+0000 7f9e9ede8700 1 -- 172.21.15.31:0/1451962160 shutdown_connections 2023-10-09T06:31:41.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.512+0000 7f9e9ede8700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9e78066f30 0x7f9e780693e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:41.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.512+0000 7f9e9ede8700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9e9815aee0 0x7f9e98159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:41.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.512+0000 7f9e9ede8700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e98067ba0 0x7f9e981549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:41.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.512+0000 7f9e9ede8700 1 --2- 172.21.15.31:0/1451962160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e98157b10 0x7f9e980c8d60 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:41.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.512+0000 7f9e9ede8700 1 -- 172.21.15.31:0/1451962160 >> 172.21.15.31:0/1451962160 conn(0x7f9e980d0de0 msgr2=0x7f9e981551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:41.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.513+0000 7f9e9ede8700 1 -- 172.21.15.31:0/1451962160 shutdown_connections 2023-10-09T06:31:41.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.513+0000 7f9e9ede8700 1 -- 172.21.15.31:0/1451962160 wait complete. 2023-10-09T06:31:41.514 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:31:41.527 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:31:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.654+0000 7fbc267b1700 1 Processor -- start 2023-10-09T06:31:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.654+0000 7fbc267b1700 1 -- start start 2023-10-09T06:31:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc267b1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbc20068af0 0x7fbc200b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc267b1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbc200b1950 0x7fbc200af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc267b1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc200aff80 con 0x7fbc20068ec0 2023-10-09T06:31:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc267b1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc200b15c0 con 0x7fbc200b1950 2023-10-09T06:31:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc267b1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2015b5f0 con 0x7fbc20068af0 2023-10-09T06:31:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc24d4e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbc200b1950 0x7fbc200af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc1f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbc20068ec0 0x7fbc2015aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34354/0 (socket says 172.21.15.31:34354) 2023-10-09T06:31:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc24d4e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbc200b1950 0x7fbc200af0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51552/0 (socket says 172.21.15.31:51552) 2023-10-09T06:31:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc1f7fe700 1 -- 172.21.15.31:0/4117021304 learned_addr learned my addr 172.21.15.31:0/4117021304 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc24d4e700 1 -- 172.21.15.31:0/4117021304 >> v2:172.21.15.158:3300/0 conn(0x7fbc20068af0 msgr2=0x7fbc200b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc1ffff700 1 --2- 172.21.15.31:0/4117021304 >> v2:172.21.15.158:3300/0 conn(0x7fbc20068af0 0x7fbc200b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc24d4e700 1 --2- 172.21.15.31:0/4117021304 >> v2:172.21.15.158:3300/0 conn(0x7fbc20068af0 0x7fbc200b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc24d4e700 1 -- 172.21.15.31:0/4117021304 >> v1:172.21.15.31:6789/0 conn(0x7fbc20068ec0 legacy=0x7fbc2015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc1effd700 1 -- 172.21.15.31:0/4117021304 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274466939 0 0) 0x7fbc200aff80 con 0x7fbc20068ec0 2023-10-09T06:31:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc24d4e700 1 -- 172.21.15.31:0/4117021304 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200b0350 con 0x7fbc200b1950 2023-10-09T06:31:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.655+0000 7fbc1ffff700 1 --2- 172.21.15.31:0/4117021304 >> v2:172.21.15.158:3300/0 conn(0x7fbc20068af0 0x7fbc200b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:31:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.656+0000 7fbc24d4e700 1 --2- 172.21.15.31:0/4117021304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc200b1950 0x7fbc200af0f0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fbc20069340 tx=0x7fbc18009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c40eb53636a972 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.656+0000 7fbc1effd700 1 -- 172.21.15.31:0/4117021304 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1800e070 con 0x7fbc200b1950 2023-10-09T06:31:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.656+0000 7fbc1effd700 1 -- 172.21.15.31:0/4117021304 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1800bc30 con 0x7fbc200b1950 2023-10-09T06:31:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.656+0000 7fbc1effd700 1 -- 172.21.15.31:0/4117021304 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18012430 con 0x7fbc200b1950 2023-10-09T06:31:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.656+0000 7fbc267b1700 1 -- 172.21.15.31:0/4117021304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc200b1950 msgr2=0x7fbc200af0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.656+0000 7fbc267b1700 1 --2- 172.21.15.31:0/4117021304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc200b1950 0x7fbc200af0f0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fbc20069340 tx=0x7fbc18009780 comp rx=0 tx=0).stop 2023-10-09T06:31:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.656+0000 7fbc267b1700 1 -- 172.21.15.31:0/4117021304 shutdown_connections 2023-10-09T06:31:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.656+0000 7fbc267b1700 1 --2- 172.21.15.31:0/4117021304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc200b1950 0x7fbc200af0f0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.656+0000 7fbc267b1700 1 --2- 172.21.15.31:0/4117021304 >> v2:172.21.15.158:3300/0 conn(0x7fbc20068af0 0x7fbc200b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.656+0000 7fbc267b1700 1 -- 172.21.15.31:0/4117021304 >> 172.21.15.31:0/4117021304 conn(0x7fbc20069870 msgr2=0x7fbc20069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.656+0000 7fbc267b1700 1 -- 172.21.15.31:0/4117021304 shutdown_connections 2023-10-09T06:31:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.656+0000 7fbc267b1700 1 -- 172.21.15.31:0/4117021304 wait complete. 2023-10-09T06:31:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.657+0000 7fbc267b1700 1 Processor -- start 2023-10-09T06:31:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.658+0000 7fbc267b1700 1 -- start start 2023-10-09T06:31:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.658+0000 7fbc267b1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc20068af0 0x7fbc20144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.658+0000 7fbc267b1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc20068ec0 0x7fbc200caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.658+0000 7fbc267b1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc200b1950 0x7fbc20069c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.658+0000 7fbc267b1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200c89e0 con 0x7fbc20068af0 2023-10-09T06:31:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.658+0000 7fbc267b1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200cd690 con 0x7fbc20068ec0 2023-10-09T06:31:41.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.658+0000 7fbc267b1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200cd970 con 0x7fbc200b1950 2023-10-09T06:31:41.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.658+0000 7fbc1ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc20068af0 0x7fbc20144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:41.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.658+0000 7fbc1ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc20068af0 0x7fbc20144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51556/0 (socket says 172.21.15.31:51556) 2023-10-09T06:31:41.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.658+0000 7fbc1ffff700 1 -- 172.21.15.31:0/1199704639 learned_addr learned my addr 172.21.15.31:0/1199704639 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:41.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.659+0000 7fbc1ffff700 1 -- 172.21.15.31:0/1199704639 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc200b1950 msgr2=0x7fbc20069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:41.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.659+0000 7fbc1ffff700 1 --2- 172.21.15.31:0/1199704639 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc200b1950 0x7fbc20069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:41.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.659+0000 7fbc1ffff700 1 -- 172.21.15.31:0/1199704639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc20068ec0 msgr2=0x7fbc200caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.659+0000 7fbc1ffff700 1 --2- 172.21.15.31:0/1199704639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc20068ec0 0x7fbc200caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.659+0000 7fbc1ffff700 1 -- 172.21.15.31:0/1199704639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc18009a20 con 0x7fbc20068af0 2023-10-09T06:31:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.659+0000 7fbc1ffff700 1 --2- 172.21.15.31:0/1199704639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc20068af0 0x7fbc20144250 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800c830 tx=0x7fbc08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.659+0000 7fbc17fff700 1 -- 172.21.15.31:0/1199704639 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc08011600 con 0x7fbc20068af0 2023-10-09T06:31:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.659+0000 7fbc17fff700 1 -- 172.21.15.31:0/1199704639 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc08011760 con 0x7fbc20068af0 2023-10-09T06:31:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.659+0000 7fbc267b1700 1 -- 172.21.15.31:0/1199704639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc200cdc50 con 0x7fbc20068af0 2023-10-09T06:31:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.659+0000 7fbc17fff700 1 -- 172.21.15.31:0/1199704639 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc08011b20 con 0x7fbc20068af0 2023-10-09T06:31:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.659+0000 7fbc267b1700 1 -- 172.21.15.31:0/1199704639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc200cb020 con 0x7fbc20068af0 2023-10-09T06:31:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.660+0000 7fbc267b1700 1 -- 172.21.15.31:0/1199704639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc200684f0 con 0x7fbc20068af0 2023-10-09T06:31:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.660+0000 7fbc17fff700 1 -- 172.21.15.31:0/1199704639 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc0800a3e0 con 0x7fbc20068af0 2023-10-09T06:31:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.661+0000 7fbc17fff700 1 --2- 172.21.15.31:0/1199704639 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbc00066f30 0x7fbc000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.661+0000 7fbc17fff700 1 -- 172.21.15.31:0/1199704639 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fbc08084880 con 0x7fbc20068af0 2023-10-09T06:31:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.661+0000 7fbc17fff700 1 -- 172.21.15.31:0/1199704639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7fbc0006dd50 con 0x7fbc20068af0 2023-10-09T06:31:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.661+0000 7fbc1f7fe700 1 --2- 172.21.15.31:0/1199704639 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbc00066f30 0x7fbc000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.661+0000 7fbc1f7fe700 1 --2- 172.21.15.31:0/1199704639 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbc00066f30 0x7fbc000693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fbc100011e0 tx=0x7fbc100079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.665+0000 7fbc17fff700 1 -- 172.21.15.31:0/1199704639 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc08015060 con 0x7fbc20068af0 2023-10-09T06:31:41.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.798+0000 7fbc17fff700 1 -- 172.21.15.31:0/1199704639 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(175..175 src has 1..175) v4 ==== 671+0+0 (secure 0 0 0) 0x7fbc08055ff0 con 0x7fbc20068af0 2023-10-09T06:31:41.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.798+0000 7fbc17fff700 1 -- 172.21.15.31:0/1199704639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7fbc0006e910 con 0x7fbc20068af0 2023-10-09T06:31:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:41.860+0000 7fbc267b1700 1 -- 172.21.15.31:0/1199704639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbc2006b900 con 0x7fbc20068af0 2023-10-09T06:31:42.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.804+0000 7fbc17fff700 1 -- 172.21.15.31:0/1199704639 <== mon.0 v2:172.21.15.31:3300/0 8 ==== osd_map(176..176 src has 1..176) v4 ==== 305+0+0 (secure 0 0 0) 0x7fbc08058b40 con 0x7fbc20068af0 2023-10-09T06:31:42.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.807+0000 7fbc17fff700 1 -- 172.21.15.31:0/1199704639 <== mon.0 v2:172.21.15.31:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v176) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbc0801f070 con 0x7fbc20068af0 2023-10-09T06:31:42.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.811+0000 7fbc267b1700 1 -- 172.21.15.31:0/1199704639 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbc00066f30 msgr2=0x7fbc000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:42.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.811+0000 7fbc267b1700 1 --2- 172.21.15.31:0/1199704639 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbc00066f30 0x7fbc000693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fbc100011e0 tx=0x7fbc100079d0 comp rx=0 tx=0).stop 2023-10-09T06:31:42.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.811+0000 7fbc267b1700 1 -- 172.21.15.31:0/1199704639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc20068af0 msgr2=0x7fbc20144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:42.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.811+0000 7fbc267b1700 1 --2- 172.21.15.31:0/1199704639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc20068af0 0x7fbc20144250 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800c830 tx=0x7fbc08008040 comp rx=0 tx=0).stop 2023-10-09T06:31:42.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.811+0000 7fbc267b1700 1 -- 172.21.15.31:0/1199704639 shutdown_connections 2023-10-09T06:31:42.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.811+0000 7fbc267b1700 1 --2- 172.21.15.31:0/1199704639 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbc00066f30 0x7fbc000693e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:42.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.811+0000 7fbc267b1700 1 --2- 172.21.15.31:0/1199704639 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbc200b1950 0x7fbc20069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:42.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.811+0000 7fbc267b1700 1 --2- 172.21.15.31:0/1199704639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc20068af0 0x7fbc20144250 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:42.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.811+0000 7fbc267b1700 1 --2- 172.21.15.31:0/1199704639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc20068ec0 0x7fbc200caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:42.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.811+0000 7fbc267b1700 1 -- 172.21.15.31:0/1199704639 >> 172.21.15.31:0/1199704639 conn(0x7fbc20069870 msgr2=0x7fbc2015b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:42.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.812+0000 7fbc267b1700 1 -- 172.21.15.31:0/1199704639 shutdown_connections 2023-10-09T06:31:42.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.812+0000 7fbc267b1700 1 -- 172.21.15.31:0/1199704639 wait complete. 2023-10-09T06:31:42.814 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2023-10-09T06:31:42.830 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:31:42.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.957+0000 7f28196eb700 1 Processor -- start 2023-10-09T06:31:42.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.957+0000 7f28196eb700 1 -- start start 2023-10-09T06:31:42.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f28196eb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28140678b0 0x7f281415db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:42.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f28196eb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28140cae70 con 0x7f28140cbf10 2023-10-09T06:31:42.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f28196eb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28140cb150 con 0x7f28140c9390 2023-10-09T06:31:42.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f28196eb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28140cb430 con 0x7f28140678b0 2023-10-09T06:31:42.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f2812ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28140678b0 0x7f281415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:42.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f28127fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f28140cbf10 0x7f281415e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34360/0 (socket says 172.21.15.31:34360) 2023-10-09T06:31:42.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f28127fc700 1 -- 172.21.15.31:0/2072685528 learned_addr learned my addr 172.21.15.31:0/2072685528 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:42.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f2812ffd700 1 -- 172.21.15.31:0/2072685528 >> v1:172.21.15.158:6789/0 conn(0x7f28140c9390 legacy=0x7f281415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:42.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f2812ffd700 1 -- 172.21.15.31:0/2072685528 >> v1:172.21.15.31:6789/0 conn(0x7f28140cbf10 legacy=0x7f281415e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:42.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f2812ffd700 1 -- 172.21.15.31:0/2072685528 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28140cb710 con 0x7f28140678b0 2023-10-09T06:31:42.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f2811ffb700 1 -- 172.21.15.31:0/2072685528 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730505170 0 0) 0x7f28140cae70 con 0x7f28140cbf10 2023-10-09T06:31:42.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f2812ffd700 1 --2- 172.21.15.31:0/2072685528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140678b0 0x7f281415db80 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f2804009e60 tx=0x7f2804009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91668d3f81eeb38b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:42.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f2811ffb700 1 -- 172.21.15.31:0/2072685528 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280400e070 con 0x7f28140678b0 2023-10-09T06:31:42.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f2811ffb700 1 -- 172.21.15.31:0/2072685528 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280400bbf0 con 0x7f28140678b0 2023-10-09T06:31:42.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.958+0000 7f2811ffb700 1 -- 172.21.15.31:0/2072685528 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804012430 con 0x7f28140678b0 2023-10-09T06:31:42.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.959+0000 7f28196eb700 1 -- 172.21.15.31:0/2072685528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140678b0 msgr2=0x7f281415db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:42.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.959+0000 7f28196eb700 1 --2- 172.21.15.31:0/2072685528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140678b0 0x7f281415db80 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f2804009e60 tx=0x7f2804009780 comp rx=0 tx=0).stop 2023-10-09T06:31:42.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.959+0000 7f28196eb700 1 -- 172.21.15.31:0/2072685528 shutdown_connections 2023-10-09T06:31:42.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.959+0000 7f28196eb700 1 --2- 172.21.15.31:0/2072685528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140678b0 0x7f281415db80 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:42.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.959+0000 7f28196eb700 1 -- 172.21.15.31:0/2072685528 >> 172.21.15.31:0/2072685528 conn(0x7f2814069870 msgr2=0x7f2814069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:42.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.959+0000 7f28196eb700 1 -- 172.21.15.31:0/2072685528 shutdown_connections 2023-10-09T06:31:42.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.959+0000 7f28196eb700 1 -- 172.21.15.31:0/2072685528 wait complete. 2023-10-09T06:31:42.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.960+0000 7f28196eb700 1 Processor -- start 2023-10-09T06:31:42.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.960+0000 7f28196eb700 1 -- start start 2023-10-09T06:31:42.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28196eb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28140678b0 0x7f28140ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:42.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28196eb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28140c9390 0x7f28140ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:42.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28196eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140cbf10 0x7f28140ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:42.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28196eb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28140abc00 con 0x7f28140cbf10 2023-10-09T06:31:42.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28196eb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28140abee0 con 0x7f28140678b0 2023-10-09T06:31:42.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28196eb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28140ae950 con 0x7f28140c9390 2023-10-09T06:31:42.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28137fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140cbf10 0x7f28140ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:42.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28137fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140cbf10 0x7f28140ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51572/0 (socket says 172.21.15.31:51572) 2023-10-09T06:31:42.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28137fe700 1 -- 172.21.15.31:0/3516223892 learned_addr learned my addr 172.21.15.31:0/3516223892 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:42.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f2812ffd700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28140678b0 0x7f28140ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:42.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28137fe700 1 -- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28140c9390 msgr2=0x7f28140ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:42.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28127fc700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28140c9390 0x7f28140ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:42.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28137fe700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28140c9390 0x7f28140ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:42.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28137fe700 1 -- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28140678b0 msgr2=0x7f28140ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:42.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28137fe700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28140678b0 0x7f28140ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:42.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f28137fe700 1 -- 172.21.15.31:0/3516223892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2804009a20 con 0x7f28140cbf10 2023-10-09T06:31:42.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.961+0000 7f2812ffd700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28140678b0 0x7f28140ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:31:42.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.962+0000 7f28137fe700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140cbf10 0x7f28140ce3b0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f280c00b510 tx=0x7f280c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:42.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.962+0000 7f280affd700 1 -- 172.21.15.31:0/3516223892 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c00f510 con 0x7f28140cbf10 2023-10-09T06:31:42.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.962+0000 7f280affd700 1 -- 172.21.15.31:0/3516223892 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c00f670 con 0x7f28140cbf10 2023-10-09T06:31:42.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.962+0000 7f28196eb700 1 -- 172.21.15.31:0/3516223892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28140aec30 con 0x7f28140cbf10 2023-10-09T06:31:42.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.962+0000 7f280affd700 1 -- 172.21.15.31:0/3516223892 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c00fa30 con 0x7f28140cbf10 2023-10-09T06:31:42.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.962+0000 7f28196eb700 1 -- 172.21.15.31:0/3516223892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28140ae5f0 con 0x7f28140cbf10 2023-10-09T06:31:42.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.963+0000 7f28196eb700 1 -- 172.21.15.31:0/3516223892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281404c3c0 con 0x7f28140cbf10 2023-10-09T06:31:42.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.963+0000 7f280affd700 1 -- 172.21.15.31:0/3516223892 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f280c01a400 con 0x7f28140cbf10 2023-10-09T06:31:42.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.964+0000 7f280affd700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f27f4066f30 0x7f27f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:42.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.964+0000 7f280affd700 1 -- 172.21.15.31:0/3516223892 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f280c083c70 con 0x7f28140cbf10 2023-10-09T06:31:42.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.964+0000 7f2812ffd700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f27f4066f30 0x7f27f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:42.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.964+0000 7f2812ffd700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f27f4066f30 0x7f27f40693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f28040099f0 tx=0x7f2804018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:42.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:42.968+0000 7f280affd700 1 -- 172.21.15.31:0/3516223892 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f280c051260 con 0x7f28140cbf10 2023-10-09T06:31:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.160+0000 7f28196eb700 1 -- 172.21.15.31:0/3516223892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f28140c5630 con 0x7f28140cbf10 2023-10-09T06:31:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.164+0000 7f280affd700 1 -- 172.21.15.31:0/3516223892 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f280c054880 con 0x7f28140cbf10 2023-10-09T06:31:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.166+0000 7f28196eb700 1 -- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f27f4066f30 msgr2=0x7f27f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.166+0000 7f28196eb700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f27f4066f30 0x7f27f40693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f28040099f0 tx=0x7f2804018000 comp rx=0 tx=0).stop 2023-10-09T06:31:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.166+0000 7f28196eb700 1 -- 172.21.15.31:0/3516223892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140cbf10 msgr2=0x7f28140ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.166+0000 7f28196eb700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140cbf10 0x7f28140ce3b0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f280c00b510 tx=0x7f280c009060 comp rx=0 tx=0).stop 2023-10-09T06:31:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.166+0000 7f28196eb700 1 -- 172.21.15.31:0/3516223892 shutdown_connections 2023-10-09T06:31:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.166+0000 7f28196eb700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f27f4066f30 0x7f27f40693e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.166+0000 7f28196eb700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140cbf10 0x7f28140ce3b0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.166+0000 7f28196eb700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28140678b0 0x7f28140ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.166+0000 7f28196eb700 1 --2- 172.21.15.31:0/3516223892 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f28140c9390 0x7f28140ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.166+0000 7f28196eb700 1 -- 172.21.15.31:0/3516223892 >> 172.21.15.31:0/3516223892 conn(0x7f2814069870 msgr2=0x7f28140c39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.166+0000 7f28196eb700 1 -- 172.21.15.31:0/3516223892 shutdown_connections 2023-10-09T06:31:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.166+0000 7f28196eb700 1 -- 172.21.15.31:0/3516223892 wait complete. 2023-10-09T06:31:43.179 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-09T06:31:43.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.297+0000 7f845759e700 1 Processor -- start 2023-10-09T06:31:43.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.297+0000 7f845759e700 1 -- start start 2023-10-09T06:31:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.298+0000 7f845759e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8458159db0 0x7f84580d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.298+0000 7f845759e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84580b1f00 0x7f84580aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.298+0000 7f845759e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84580b4bf0 con 0x7f8458068240 2023-10-09T06:31:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.298+0000 7f845759e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84580b5790 con 0x7f8458159db0 2023-10-09T06:31:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.298+0000 7f845759e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84580ae9b0 con 0x7f84580b1f00 2023-10-09T06:31:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.298+0000 7f8456d9d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84580b1f00 0x7f84580aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.298+0000 7f845659c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8458159db0 0x7f84580d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.298+0000 7f8455d9b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f8458068240 0x7f84580b17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:37396/0 (socket says 172.21.15.31:37396) 2023-10-09T06:31:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.298+0000 7f8455d9b700 1 -- 172.21.15.31:0/85249403 learned_addr learned my addr 172.21.15.31:0/85249403 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.299+0000 7f845659c700 1 -- 172.21.15.31:0/85249403 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84580b1f00 msgr2=0x7f84580aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.299+0000 7f845659c700 1 --2- 172.21.15.31:0/85249403 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84580b1f00 0x7f84580aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.299+0000 7f845659c700 1 -- 172.21.15.31:0/85249403 >> v1:172.21.15.158:6789/0 conn(0x7f8458068240 legacy=0x7f84580b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.299+0000 7f845559a700 1 -- 172.21.15.31:0/85249403 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32569091 0 0) 0x7f84580b4bf0 con 0x7f8458068240 2023-10-09T06:31:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.299+0000 7f845659c700 1 -- 172.21.15.31:0/85249403 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84580b59e0 con 0x7f8458159db0 2023-10-09T06:31:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.299+0000 7f8456d9d700 1 --2- 172.21.15.31:0/85249403 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84580b1f00 0x7f84580aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:31:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.299+0000 7f845659c700 1 --2- 172.21.15.31:0/85249403 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8458159db0 0x7f84580d13c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8450009e60 tx=0x7f8450009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bd967e54d02d70f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.299+0000 7f845559a700 1 -- 172.21.15.31:0/85249403 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845000e070 con 0x7f8458159db0 2023-10-09T06:31:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.299+0000 7f845559a700 1 -- 172.21.15.31:0/85249403 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845000bbf0 con 0x7f8458159db0 2023-10-09T06:31:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.299+0000 7f845559a700 1 -- 172.21.15.31:0/85249403 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450012430 con 0x7f8458159db0 2023-10-09T06:31:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.300+0000 7f845759e700 1 -- 172.21.15.31:0/85249403 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8458159db0 msgr2=0x7f84580d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.300+0000 7f845759e700 1 --2- 172.21.15.31:0/85249403 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8458159db0 0x7f84580d13c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8450009e60 tx=0x7f8450009780 comp rx=0 tx=0).stop 2023-10-09T06:31:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.300+0000 7f845759e700 1 -- 172.21.15.31:0/85249403 shutdown_connections 2023-10-09T06:31:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.300+0000 7f845759e700 1 --2- 172.21.15.31:0/85249403 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8458159db0 0x7f84580d13c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.300+0000 7f845759e700 1 --2- 172.21.15.31:0/85249403 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84580b1f00 0x7f84580aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.300+0000 7f845759e700 1 -- 172.21.15.31:0/85249403 >> 172.21.15.31:0/85249403 conn(0x7f8458067e40 msgr2=0x7f84580d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.300+0000 7f845759e700 1 -- 172.21.15.31:0/85249403 shutdown_connections 2023-10-09T06:31:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.300+0000 7f845759e700 1 -- 172.21.15.31:0/85249403 wait complete. 2023-10-09T06:31:43.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.301+0000 7f845759e700 1 Processor -- start 2023-10-09T06:31:43.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.301+0000 7f845759e700 1 -- start start 2023-10-09T06:31:43.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8458068240 0x7f845816ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845759e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84580b1f00 0x7f8458169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845759e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8458159db0 0x7f8458150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84580b0e90 con 0x7f8458068240 2023-10-09T06:31:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845759e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845816d200 con 0x7f8458159db0 2023-10-09T06:31:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845759e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84580b0280 con 0x7f84580b1f00 2023-10-09T06:31:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8458068240 0x7f845816ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8458068240 0x7f845816ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51582/0 (socket says 172.21.15.31:51582) 2023-10-09T06:31:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845659c700 1 -- 172.21.15.31:0/1857882402 learned_addr learned my addr 172.21.15.31:0/1857882402 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f8456d9d700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8458159db0 0x7f8458150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f8455d9b700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84580b1f00 0x7f8458169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845659c700 1 -- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84580b1f00 msgr2=0x7f8458169e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845659c700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84580b1f00 0x7f8458169e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845659c700 1 -- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8458159db0 msgr2=0x7f8458150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845659c700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8458159db0 0x7f8458150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845659c700 1 -- 172.21.15.31:0/1857882402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448009420 con 0x7f8458068240 2023-10-09T06:31:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f8456d9d700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8458159db0 0x7f8458150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:31:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f8455d9b700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84580b1f00 0x7f8458169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:31:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f845659c700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8458068240 0x7f845816ccc0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f845000b6c0 tx=0x7f8450019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.302+0000 7f844e7fc700 1 -- 172.21.15.31:0/1857882402 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450027470 con 0x7f8458068240 2023-10-09T06:31:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.303+0000 7f844e7fc700 1 -- 172.21.15.31:0/1857882402 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84500275d0 con 0x7f8458068240 2023-10-09T06:31:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.303+0000 7f845759e700 1 -- 172.21.15.31:0/1857882402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8450009a20 con 0x7f8458068240 2023-10-09T06:31:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.303+0000 7f844e7fc700 1 -- 172.21.15.31:0/1857882402 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450027990 con 0x7f8458068240 2023-10-09T06:31:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.303+0000 7f845759e700 1 -- 172.21.15.31:0/1857882402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84580b0840 con 0x7f8458068240 2023-10-09T06:31:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.303+0000 7f845759e700 1 -- 172.21.15.31:0/1857882402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845806ace0 con 0x7f8458068240 2023-10-09T06:31:43.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.304+0000 7f844e7fc700 1 -- 172.21.15.31:0/1857882402 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8450024070 con 0x7f8458068240 2023-10-09T06:31:43.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.304+0000 7f844e7fc700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8438066f30 0x7f84380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.304+0000 7f844e7fc700 1 -- 172.21.15.31:0/1857882402 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8450086c90 con 0x7f8458068240 2023-10-09T06:31:43.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.304+0000 7f8455d9b700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8438066f30 0x7f84380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:43.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.305+0000 7f8455d9b700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8438066f30 0x7f84380693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f845815eaf0 tx=0x7f8440009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.309+0000 7f844e7fc700 1 -- 172.21.15.31:0/1857882402 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8450054200 con 0x7f8458068240 2023-10-09T06:31:43.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.582+0000 7f845759e700 1 -- 172.21.15.31:0/1857882402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f84580b5d30 con 0x7f8458068240 2023-10-09T06:31:43.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.809+0000 7f844e7fc700 1 -- 172.21.15.31:0/1857882402 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v504) v1 ==== 131+0+0 (secure 0 0 0) 0x7f8450057820 con 0x7f8458068240 2023-10-09T06:31:43.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.811+0000 7f845759e700 1 -- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8438066f30 msgr2=0x7f84380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:43.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.811+0000 7f845759e700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8438066f30 0x7f84380693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f845815eaf0 tx=0x7f8440009040 comp rx=0 tx=0).stop 2023-10-09T06:31:43.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.811+0000 7f845759e700 1 -- 172.21.15.31:0/1857882402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8458068240 msgr2=0x7f845816ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:43.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.811+0000 7f845759e700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8458068240 0x7f845816ccc0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f845000b6c0 tx=0x7f8450019000 comp rx=0 tx=0).stop 2023-10-09T06:31:43.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.811+0000 7f845759e700 1 -- 172.21.15.31:0/1857882402 shutdown_connections 2023-10-09T06:31:43.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.811+0000 7f845759e700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8438066f30 0x7f84380693e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.811+0000 7f845759e700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8458159db0 0x7f8458150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.811+0000 7f845759e700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8458068240 0x7f845816ccc0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.811+0000 7f845759e700 1 --2- 172.21.15.31:0/1857882402 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f84580b1f00 0x7f8458169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.811+0000 7f845759e700 1 -- 172.21.15.31:0/1857882402 >> 172.21.15.31:0/1857882402 conn(0x7f8458067e40 msgr2=0x7f8458157890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:43.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.811+0000 7f845759e700 1 -- 172.21.15.31:0/1857882402 shutdown_connections 2023-10-09T06:31:43.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.811+0000 7f845759e700 1 -- 172.21.15.31:0/1857882402 wait complete. 2023-10-09T06:31:43.824 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-09T06:31:43.825 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-09T06:31:43.825 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-09T06:31:43.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.944+0000 7fe99db1d700 1 Processor -- start 2023-10-09T06:31:43.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.944+0000 7fe99db1d700 1 -- start start 2023-10-09T06:31:43.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe99db1d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9980abae0 0x7fe9980c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe99db1d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9980c9cb0 con 0x7fe9980abeb0 2023-10-09T06:31:43.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe99db1d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9980c90a0 con 0x7fe9980c8b10 2023-10-09T06:31:43.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe99db1d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980c9380 con 0x7fe9980abae0 2023-10-09T06:31:43.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe996ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe9980abeb0 0x7fe9980c8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34370/0 (socket says 172.21.15.31:34370) 2023-10-09T06:31:43.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe996ffd700 1 -- 172.21.15.31:0/1779679573 learned_addr learned my addr 172.21.15.31:0/1779679573 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:43.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971543610 0 0) 0x7fe9980c9cb0 con 0x7fe9980abeb0 2023-10-09T06:31:43.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9977fe700 1 --2- 172.21.15.31:0/1779679573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9980abae0 0x7fe9980c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:43.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe980003570 con 0x7fe9980abeb0 2023-10-09T06:31:43.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 610470002 0 0) 0x7fe980003570 con 0x7fe9980abeb0 2023-10-09T06:31:43.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9980abae0 msgr2=0x7fe9980c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:43.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 --2- 172.21.15.31:0/1779679573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9980abae0 0x7fe9980c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 >> v1:172.21.15.158:6789/0 conn(0x7fe9980c8b10 legacy=0x7fe9980acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:43.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9980c9660 con 0x7fe9980abeb0 2023-10-09T06:31:43.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fe98c001470 con 0x7fe9980abeb0 2023-10-09T06:31:43.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 >> v1:172.21.15.31:6789/0 conn(0x7fe9980abeb0 legacy=0x7fe9980c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:43.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 --2- 172.21.15.31:0/1779679573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9980abae0 0x7fe980003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 --2- 172.21.15.31:0/1779679573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe980004010 0x7fe980004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 --2- 172.21.15.31:0/1779679573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe980004d50 0x7fe9800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980c9380 con 0x7fe980004d50 2023-10-09T06:31:43.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98000de00 con 0x7fe980004010 2023-10-09T06:31:43.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.945+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98000dfc0 con 0x7fe9980abae0 2023-10-09T06:31:43.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.946+0000 7fe997fff700 1 --2- 172.21.15.31:0/1779679573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe980004d50 0x7fe9800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:43.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.946+0000 7fe996ffd700 1 --2- 172.21.15.31:0/1779679573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe980004010 0x7fe980004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:43.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.946+0000 7fe9977fe700 1 --2- 172.21.15.31:0/1779679573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9980abae0 0x7fe980003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:43.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.946+0000 7fe997fff700 1 -- 172.21.15.31:0/1779679573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9980abae0 msgr2=0x7fe980003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:43.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.946+0000 7fe997fff700 1 --2- 172.21.15.31:0/1779679573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe9980abae0 0x7fe980003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.946+0000 7fe997fff700 1 -- 172.21.15.31:0/1779679573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe980004010 msgr2=0x7fe980004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:43.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.946+0000 7fe997fff700 1 --2- 172.21.15.31:0/1779679573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe980004010 0x7fe980004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.946+0000 7fe997fff700 1 -- 172.21.15.31:0/1779679573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe980003570 con 0x7fe980004d50 2023-10-09T06:31:43.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.946+0000 7fe997fff700 1 --2- 172.21.15.31:0/1779679573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe980004d50 0x7fe9800051c0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fe990001f90 tx=0x7fe990001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865987b026529e3a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:43.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.946+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990001950 con 0x7fe980004d50 2023-10-09T06:31:43.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.946+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99000c8b0 con 0x7fe980004d50 2023-10-09T06:31:43.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.946+0000 7fe9967fc700 1 -- 172.21.15.31:0/1779679573 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99000cc70 con 0x7fe980004d50 2023-10-09T06:31:43.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.947+0000 7fe99db1d700 1 -- 172.21.15.31:0/1779679573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe980004d50 msgr2=0x7fe9800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:43.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.947+0000 7fe99db1d700 1 --2- 172.21.15.31:0/1779679573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe980004d50 0x7fe9800051c0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fe990001f90 tx=0x7fe990001640 comp rx=0 tx=0).stop 2023-10-09T06:31:43.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.947+0000 7fe997fff700 1 -- 172.21.15.31:0/1779679573 reap_dead start 2023-10-09T06:31:43.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.947+0000 7fe99db1d700 1 -- 172.21.15.31:0/1779679573 shutdown_connections 2023-10-09T06:31:43.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.947+0000 7fe99db1d700 1 -- 172.21.15.31:0/1779679573 >> 172.21.15.31:0/1779679573 conn(0x7fe998067660 msgr2=0x7fe998067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:43.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.947+0000 7fe99db1d700 1 -- 172.21.15.31:0/1779679573 shutdown_connections 2023-10-09T06:31:43.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.947+0000 7fe99db1d700 1 -- 172.21.15.31:0/1779679573 wait complete. 2023-10-09T06:31:43.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.948+0000 7fe99db1d700 1 Processor -- start 2023-10-09T06:31:43.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.948+0000 7fe99db1d700 1 -- start start 2023-10-09T06:31:43.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe99db1d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe998143c00 0x7fe9980aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe99db1d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe998143fd0 0x7fe9980aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe99db1d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9980b0a20 0x7fe9980b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe99db1d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe998155d20 con 0x7fe9980b0a20 2023-10-09T06:31:43.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe99db1d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980b1790 con 0x7fe998143fd0 2023-10-09T06:31:43.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe99db1d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980b1a70 con 0x7fe998143c00 2023-10-09T06:31:43.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe997fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9980b0a20 0x7fe9980b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:43.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe997fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9980b0a20 0x7fe9980b0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51594/0 (socket says 172.21.15.31:51594) 2023-10-09T06:31:43.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe997fff700 1 -- 172.21.15.31:0/3987250687 learned_addr learned my addr 172.21.15.31:0/3987250687 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:43.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe997fff700 1 -- 172.21.15.31:0/3987250687 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe998143c00 msgr2=0x7fe9980aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:43.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe997fff700 1 --2- 172.21.15.31:0/3987250687 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe998143c00 0x7fe9980aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe997fff700 1 -- 172.21.15.31:0/3987250687 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe998143fd0 msgr2=0x7fe9980aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:43.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe996ffd700 1 --2- 172.21.15.31:0/3987250687 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe998143fd0 0x7fe9980aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:43.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe997fff700 1 --2- 172.21.15.31:0/3987250687 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe998143fd0 0x7fe9980aadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:43.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe997fff700 1 -- 172.21.15.31:0/3987250687 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9981559b0 con 0x7fe9980b0a20 2023-10-09T06:31:43.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe997fff700 1 --2- 172.21.15.31:0/3987250687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9980b0a20 0x7fe9980b0e90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fe990004000 tx=0x7fe990015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:43.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe97f7fe700 1 -- 172.21.15.31:0/3987250687 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99000c6d0 con 0x7fe9980b0a20 2023-10-09T06:31:43.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.949+0000 7fe97f7fe700 1 -- 172.21.15.31:0/3987250687 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99000cc30 con 0x7fe9980b0a20 2023-10-09T06:31:43.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.950+0000 7fe99db1d700 1 -- 172.21.15.31:0/3987250687 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9980b13d0 con 0x7fe9980b0a20 2023-10-09T06:31:43.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.950+0000 7fe97f7fe700 1 -- 172.21.15.31:0/3987250687 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99001e630 con 0x7fe9980b0a20 2023-10-09T06:31:43.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.950+0000 7fe99db1d700 1 -- 172.21.15.31:0/3987250687 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe998069180 con 0x7fe9980b0a20 2023-10-09T06:31:43.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.950+0000 7fe99db1d700 1 -- 172.21.15.31:0/3987250687 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9980ab6d0 con 0x7fe9980b0a20 2023-10-09T06:31:43.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.951+0000 7fe97f7fe700 1 -- 172.21.15.31:0/3987250687 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe990019030 con 0x7fe9980b0a20 2023-10-09T06:31:43.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.951+0000 7fe97f7fe700 1 --2- 172.21.15.31:0/3987250687 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe984066f30 0x7fe9840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:43.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.951+0000 7fe97f7fe700 1 -- 172.21.15.31:0/3987250687 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe990085950 con 0x7fe9980b0a20 2023-10-09T06:31:43.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.952+0000 7fe9977fe700 1 --2- 172.21.15.31:0/3987250687 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe984066f30 0x7fe9840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:43.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.952+0000 7fe9977fe700 1 --2- 172.21.15.31:0/3987250687 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe984066f30 0x7fe9840693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe988006eb0 tx=0x7fe9880091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:43.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:43.956+0000 7fe97f7fe700 1 -- 172.21.15.31:0/3987250687 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe990052e20 con 0x7fe9980b0a20 2023-10-09T06:31:44.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.229+0000 7fe99db1d700 1 -- 172.21.15.31:0/3987250687 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7fe998155b40 con 0x7fe9980b0a20 2023-10-09T06:31:44.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.816+0000 7fe97f7fe700 1 -- 172.21.15.31:0/3987250687 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v505) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe990017070 con 0x7fe9980b0a20 2023-10-09T06:31:44.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.818+0000 7fe99db1d700 1 -- 172.21.15.31:0/3987250687 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe984066f30 msgr2=0x7fe9840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:44.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.818+0000 7fe99db1d700 1 --2- 172.21.15.31:0/3987250687 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe984066f30 0x7fe9840693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe988006eb0 tx=0x7fe9880091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:44.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.818+0000 7fe99db1d700 1 -- 172.21.15.31:0/3987250687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9980b0a20 msgr2=0x7fe9980b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:44.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.818+0000 7fe99db1d700 1 --2- 172.21.15.31:0/3987250687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9980b0a20 0x7fe9980b0e90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fe990004000 tx=0x7fe990015000 comp rx=0 tx=0).stop 2023-10-09T06:31:44.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.818+0000 7fe99db1d700 1 -- 172.21.15.31:0/3987250687 shutdown_connections 2023-10-09T06:31:44.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.818+0000 7fe99db1d700 1 --2- 172.21.15.31:0/3987250687 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe984066f30 0x7fe9840693e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:44.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.818+0000 7fe99db1d700 1 --2- 172.21.15.31:0/3987250687 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe998143c00 0x7fe9980aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:44.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.818+0000 7fe99db1d700 1 --2- 172.21.15.31:0/3987250687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9980b0a20 0x7fe9980b0e90 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:44.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.818+0000 7fe99db1d700 1 --2- 172.21.15.31:0/3987250687 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe998143fd0 0x7fe9980aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:44.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.818+0000 7fe99db1d700 1 -- 172.21.15.31:0/3987250687 >> 172.21.15.31:0/3987250687 conn(0x7fe998067660 msgr2=0x7fe998159530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:44.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.818+0000 7fe99db1d700 1 -- 172.21.15.31:0/3987250687 shutdown_connections 2023-10-09T06:31:44.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.818+0000 7fe99db1d700 1 -- 172.21.15.31:0/3987250687 wait complete. 2023-10-09T06:31:44.832 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:31:44.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.956+0000 7f8836ed2700 1 Processor -- start 2023-10-09T06:31:44.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.956+0000 7f8836ed2700 1 -- start start 2023-10-09T06:31:44.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.957+0000 7f8836ed2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8830159ec0 0x7f88300af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:44.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.957+0000 7f8836ed2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f883006acb0 0x7f88300afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:44.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.957+0000 7f8836ed2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88300b0790 con 0x7f883015a290 2023-10-09T06:31:44.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.957+0000 7f8836ed2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88300ce1f0 con 0x7f883006acb0 2023-10-09T06:31:44.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.957+0000 7f8836ed2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88300b0b20 con 0x7f8830159ec0 2023-10-09T06:31:44.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.957+0000 7f883546f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f883006acb0 0x7f88300afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:44.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.957+0000 7f883546f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f883006acb0 0x7f88300afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51604/0 (socket says 172.21.15.31:51604) 2023-10-09T06:31:44.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.957+0000 7f883546f700 1 -- 172.21.15.31:0/1255307031 learned_addr learned my addr 172.21.15.31:0/1255307031 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:44.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.958+0000 7f8834c6e700 1 --2- 172.21.15.31:0/1255307031 >> v2:172.21.15.158:3300/0 conn(0x7f8830159ec0 0x7f88300af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:44.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.958+0000 7f883546f700 1 -- 172.21.15.31:0/1255307031 >> v2:172.21.15.158:3300/0 conn(0x7f8830159ec0 msgr2=0x7f88300af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:44.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.958+0000 7f883546f700 1 --2- 172.21.15.31:0/1255307031 >> v2:172.21.15.158:3300/0 conn(0x7f8830159ec0 0x7f88300af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:44.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.958+0000 7f883546f700 1 -- 172.21.15.31:0/1255307031 >> v1:172.21.15.158:6789/0 conn(0x7f883015a290 legacy=0x7f883006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:44.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.958+0000 7f883546f700 1 -- 172.21.15.31:0/1255307031 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88300b04b0 con 0x7f883006acb0 2023-10-09T06:31:44.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.958+0000 7f8834c6e700 1 --2- 172.21.15.31:0/1255307031 >> v2:172.21.15.158:3300/0 conn(0x7f8830159ec0 0x7f88300af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:31:44.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.958+0000 7f883546f700 1 --2- 172.21.15.31:0/1255307031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f883006acb0 0x7f88300afe80 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f88300898e0 tx=0x7f8818009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b941a5e5a4e171b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:44.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.958+0000 7f882f7fe700 1 -- 172.21.15.31:0/1255307031 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881800b820 con 0x7f883006acb0 2023-10-09T06:31:44.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.958+0000 7f882f7fe700 1 -- 172.21.15.31:0/1255307031 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881800b980 con 0x7f883006acb0 2023-10-09T06:31:44.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.958+0000 7f882f7fe700 1 -- 172.21.15.31:0/1255307031 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881800bd20 con 0x7f883006acb0 2023-10-09T06:31:44.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.959+0000 7f8836ed2700 1 -- 172.21.15.31:0/1255307031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f883006acb0 msgr2=0x7f88300afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:44.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.959+0000 7f8836ed2700 1 --2- 172.21.15.31:0/1255307031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f883006acb0 0x7f88300afe80 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f88300898e0 tx=0x7f8818009250 comp rx=0 tx=0).stop 2023-10-09T06:31:44.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.959+0000 7f8836ed2700 1 -- 172.21.15.31:0/1255307031 shutdown_connections 2023-10-09T06:31:44.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.959+0000 7f8836ed2700 1 --2- 172.21.15.31:0/1255307031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f883006acb0 0x7f88300afe80 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:44.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.959+0000 7f8836ed2700 1 --2- 172.21.15.31:0/1255307031 >> v2:172.21.15.158:3300/0 conn(0x7f8830159ec0 0x7f88300af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:44.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.959+0000 7f8836ed2700 1 -- 172.21.15.31:0/1255307031 >> 172.21.15.31:0/1255307031 conn(0x7f88300d1880 msgr2=0x7f88300cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:44.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.959+0000 7f8836ed2700 1 -- 172.21.15.31:0/1255307031 shutdown_connections 2023-10-09T06:31:44.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.959+0000 7f8836ed2700 1 -- 172.21.15.31:0/1255307031 wait complete. 2023-10-09T06:31:44.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.960+0000 7f8836ed2700 1 Processor -- start 2023-10-09T06:31:44.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.960+0000 7f8836ed2700 1 -- start start 2023-10-09T06:31:44.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f8836ed2700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f883006acb0 0x7f88300b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:44.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f8836ed2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8830159ec0 0x7f88300c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:44.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f8836ed2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f883015a290 0x7f88301555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:44.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f8836ed2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88300b4ab0 con 0x7f8830159ec0 2023-10-09T06:31:44.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f8836ed2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88300b3ea0 con 0x7f883015a290 2023-10-09T06:31:44.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f8836ed2700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88300b4180 con 0x7f883006acb0 2023-10-09T06:31:44.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f882ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8830159ec0 0x7f88300c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:44.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f882ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8830159ec0 0x7f88300c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51614/0 (socket says 172.21.15.31:51614) 2023-10-09T06:31:44.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f882ffff700 1 -- 172.21.15.31:0/743257159 learned_addr learned my addr 172.21.15.31:0/743257159 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:44.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f883546f700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f883015a290 0x7f88301555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:44.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f8834c6e700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f883006acb0 0x7f88300b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:44.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f882ffff700 1 -- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f883006acb0 msgr2=0x7f88300b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:44.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f882ffff700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f883006acb0 0x7f88300b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:44.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f882ffff700 1 -- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f883015a290 msgr2=0x7f88301555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:44.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f882ffff700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f883015a290 0x7f88301555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:44.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f882ffff700 1 -- 172.21.15.31:0/743257159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88180094f0 con 0x7f8830159ec0 2023-10-09T06:31:44.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f882ffff700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8830159ec0 0x7f88300c9ce0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f882000bc30 tx=0x7f8820009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:44.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.961+0000 7f882cff9700 1 -- 172.21.15.31:0/743257159 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882000c9b0 con 0x7f8830159ec0 2023-10-09T06:31:44.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.962+0000 7f882cff9700 1 -- 172.21.15.31:0/743257159 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882000cb50 con 0x7f8830159ec0 2023-10-09T06:31:44.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.962+0000 7f8836ed2700 1 -- 172.21.15.31:0/743257159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88300b4460 con 0x7f8830159ec0 2023-10-09T06:31:44.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.962+0000 7f882cff9700 1 -- 172.21.15.31:0/743257159 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820014410 con 0x7f8830159ec0 2023-10-09T06:31:44.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.962+0000 7f8836ed2700 1 -- 172.21.15.31:0/743257159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88300b5480 con 0x7f8830159ec0 2023-10-09T06:31:44.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.962+0000 7f8836ed2700 1 -- 172.21.15.31:0/743257159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883004c3c0 con 0x7f8830159ec0 2023-10-09T06:31:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.963+0000 7f882cff9700 1 -- 172.21.15.31:0/743257159 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8820014800 con 0x7f8830159ec0 2023-10-09T06:31:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.963+0000 7f882cff9700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8810066f30 0x7f88100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.963+0000 7f882cff9700 1 -- 172.21.15.31:0/743257159 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8820084470 con 0x7f8830159ec0 2023-10-09T06:31:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.964+0000 7f8834c6e700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8810066f30 0x7f88100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.964+0000 7f8834c6e700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8810066f30 0x7f88100693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f882800abe0 tx=0x7f8828006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:44.968+0000 7f882cff9700 1 -- 172.21.15.31:0/743257159 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8820051940 con 0x7f8830159ec0 2023-10-09T06:31:45.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.161+0000 7f8836ed2700 1 -- 172.21.15.31:0/743257159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f88300ceab0 con 0x7f8830159ec0 2023-10-09T06:31:45.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.167+0000 7f882cff9700 1 -- 172.21.15.31:0/743257159 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8820054f60 con 0x7f8830159ec0 2023-10-09T06:31:45.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.169+0000 7f8836ed2700 1 -- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8810066f30 msgr2=0x7f88100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:45.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.169+0000 7f8836ed2700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8810066f30 0x7f88100693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f882800abe0 tx=0x7f8828006f90 comp rx=0 tx=0).stop 2023-10-09T06:31:45.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.169+0000 7f8836ed2700 1 -- 172.21.15.31:0/743257159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8830159ec0 msgr2=0x7f88300c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:45.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.169+0000 7f8836ed2700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8830159ec0 0x7f88300c9ce0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f882000bc30 tx=0x7f8820009820 comp rx=0 tx=0).stop 2023-10-09T06:31:45.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.169+0000 7f8836ed2700 1 -- 172.21.15.31:0/743257159 shutdown_connections 2023-10-09T06:31:45.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.169+0000 7f8836ed2700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8810066f30 0x7f88100693e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.169+0000 7f8836ed2700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f883006acb0 0x7f88300b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.169+0000 7f8836ed2700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f883015a290 0x7f88301555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.169+0000 7f8836ed2700 1 --2- 172.21.15.31:0/743257159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8830159ec0 0x7f88300c9ce0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.169+0000 7f8836ed2700 1 -- 172.21.15.31:0/743257159 >> 172.21.15.31:0/743257159 conn(0x7f88300d1880 msgr2=0x7f88300c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:45.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.169+0000 7f8836ed2700 1 -- 172.21.15.31:0/743257159 shutdown_connections 2023-10-09T06:31:45.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.169+0000 7f8836ed2700 1 -- 172.21.15.31:0/743257159 wait complete. 2023-10-09T06:31:45.182 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:31:45.182 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:31:45.220 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:31:45.263 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:31:45.263 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:31:45.263 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:31:45.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.381+0000 7f8fd8409700 1 Processor -- start 2023-10-09T06:31:45.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.382+0000 7f8fd8409700 1 -- start start 2023-10-09T06:31:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.382+0000 7f8fd8409700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8fd00d1c30 0x7f8fd00ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.382+0000 7f8fd8409700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fd015a680 0x7f8fd00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.382+0000 7f8fd8409700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd00c5d80 con 0x7f8fd015a2b0 2023-10-09T06:31:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.382+0000 7f8fd8409700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd0068470 con 0x7f8fd00d1c30 2023-10-09T06:31:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.382+0000 7f8fd8409700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd00c6060 con 0x7f8fd015a680 2023-10-09T06:31:45.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.383+0000 7f8fd59a4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8fd00d1c30 0x7f8fd00ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.383+0000 7f8fd59a4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8fd00d1c30 0x7f8fd00ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51622/0 (socket says 172.21.15.31:51622) 2023-10-09T06:31:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.383+0000 7f8fd59a4700 1 -- 172.21.15.31:0/3828459762 learned_addr learned my addr 172.21.15.31:0/3828459762 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.383+0000 7f8fd59a4700 1 -- 172.21.15.31:0/3828459762 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fd015a680 msgr2=0x7f8fd00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.383+0000 7f8fd59a4700 1 --2- 172.21.15.31:0/3828459762 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fd015a680 0x7f8fd00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.383+0000 7f8fd59a4700 1 -- 172.21.15.31:0/3828459762 >> v1:172.21.15.158:6789/0 conn(0x7f8fd015a2b0 legacy=0x7f8fd00b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.383+0000 7f8fd59a4700 1 -- 172.21.15.31:0/3828459762 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd00c6340 con 0x7f8fd00d1c30 2023-10-09T06:31:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.383+0000 7f8fd59a4700 1 --2- 172.21.15.31:0/3828459762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fd00d1c30 0x7f8fd00ccdd0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40099b0 tx=0x7f8fc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45b2da4caba6d7b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.383+0000 7f8fd51a3700 1 -- 172.21.15.31:0/3828459762 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc400b820 con 0x7f8fd00d1c30 2023-10-09T06:31:45.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.383+0000 7f8fd51a3700 1 -- 172.21.15.31:0/3828459762 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc400b980 con 0x7f8fd00d1c30 2023-10-09T06:31:45.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.383+0000 7f8fd51a3700 1 -- 172.21.15.31:0/3828459762 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc400bd20 con 0x7f8fd00d1c30 2023-10-09T06:31:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.384+0000 7f8fd8409700 1 -- 172.21.15.31:0/3828459762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fd00d1c30 msgr2=0x7f8fd00ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.384+0000 7f8fd8409700 1 --2- 172.21.15.31:0/3828459762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fd00d1c30 0x7f8fd00ccdd0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40099b0 tx=0x7f8fc4009250 comp rx=0 tx=0).stop 2023-10-09T06:31:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.384+0000 7f8fd8409700 1 -- 172.21.15.31:0/3828459762 shutdown_connections 2023-10-09T06:31:45.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.384+0000 7f8fd8409700 1 --2- 172.21.15.31:0/3828459762 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fd015a680 0x7f8fd00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.384+0000 7f8fd8409700 1 --2- 172.21.15.31:0/3828459762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fd00d1c30 0x7f8fd00ccdd0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.384+0000 7f8fd8409700 1 -- 172.21.15.31:0/3828459762 >> 172.21.15.31:0/3828459762 conn(0x7f8fd0067e40 msgr2=0x7f8fd00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:45.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.384+0000 7f8fd8409700 1 -- 172.21.15.31:0/3828459762 shutdown_connections 2023-10-09T06:31:45.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.384+0000 7f8fd8409700 1 -- 172.21.15.31:0/3828459762 wait complete. 2023-10-09T06:31:45.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.385+0000 7f8fd8409700 1 Processor -- start 2023-10-09T06:31:45.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.385+0000 7f8fd8409700 1 -- start start 2023-10-09T06:31:45.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd8409700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fd00d1c30 0x7f8fd0158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:45.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd8409700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fd015a2b0 0x7f8fd015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:45.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd8409700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fd015a680 0x7f8fd015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:45.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd8409700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd00b5250 con 0x7f8fd015a2b0 2023-10-09T06:31:45.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd8409700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd0158670 con 0x7f8fd015a680 2023-10-09T06:31:45.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd8409700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd00b5440 con 0x7f8fd00d1c30 2023-10-09T06:31:45.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd59a4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fd015a2b0 0x7f8fd015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:45.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd59a4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fd015a2b0 0x7f8fd015b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51628/0 (socket says 172.21.15.31:51628) 2023-10-09T06:31:45.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd59a4700 1 -- 172.21.15.31:0/3575714216 learned_addr learned my addr 172.21.15.31:0/3575714216 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:45.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd59a4700 1 -- 172.21.15.31:0/3575714216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fd00d1c30 msgr2=0x7f8fd0158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:45.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd59a4700 1 --2- 172.21.15.31:0/3575714216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fd00d1c30 0x7f8fd0158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd59a4700 1 -- 172.21.15.31:0/3575714216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fd015a680 msgr2=0x7f8fd015cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:45.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd59a4700 1 --2- 172.21.15.31:0/3575714216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fd015a680 0x7f8fd015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd59a4700 1 -- 172.21.15.31:0/3575714216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc40094f0 con 0x7f8fd015a2b0 2023-10-09T06:31:45.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd59a4700 1 --2- 172.21.15.31:0/3575714216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fd015a2b0 0x7f8fd015b4b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4009290 tx=0x7f8fc4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:45.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fce7fc700 1 -- 172.21.15.31:0/3575714216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4026480 con 0x7f8fd015a2b0 2023-10-09T06:31:45.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fce7fc700 1 -- 172.21.15.31:0/3575714216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc401f070 con 0x7f8fd015a2b0 2023-10-09T06:31:45.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd8409700 1 -- 172.21.15.31:0/3575714216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd00b5720 con 0x7f8fd015a2b0 2023-10-09T06:31:45.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fce7fc700 1 -- 172.21.15.31:0/3575714216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4026850 con 0x7f8fd015a2b0 2023-10-09T06:31:45.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.386+0000 7f8fd8409700 1 -- 172.21.15.31:0/3575714216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd00b5ce0 con 0x7f8fd015a2b0 2023-10-09T06:31:45.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.387+0000 7f8fd8409700 1 -- 172.21.15.31:0/3575714216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd00b6030 con 0x7f8fd015a2b0 2023-10-09T06:31:45.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.388+0000 7f8fce7fc700 1 -- 172.21.15.31:0/3575714216 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8fc401a440 con 0x7f8fd015a2b0 2023-10-09T06:31:45.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.388+0000 7f8fce7fc700 1 --2- 172.21.15.31:0/3575714216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8fbc066f30 0x7f8fbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:45.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.388+0000 7f8fce7fc700 1 -- 172.21.15.31:0/3575714216 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8fc4021070 con 0x7f8fd015a2b0 2023-10-09T06:31:45.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.388+0000 7f8fd61a5700 1 --2- 172.21.15.31:0/3575714216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8fbc066f30 0x7f8fbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:45.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.389+0000 7f8fd61a5700 1 --2- 172.21.15.31:0/3575714216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8fbc066f30 0x7f8fbc0693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000acf0 tx=0x7f8fc0009350 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:45.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.392+0000 7f8fce7fc700 1 -- 172.21.15.31:0/3575714216 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fc4053910 con 0x7f8fd015a2b0 2023-10-09T06:31:45.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.630+0000 7f8fd8409700 1 -- 172.21.15.31:0/3575714216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fd004c3c0 con 0x7f8fd015a2b0 2023-10-09T06:31:45.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.631+0000 7f8fce7fc700 1 -- 172.21.15.31:0/3575714216 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f8fc4056f30 con 0x7f8fd015a2b0 2023-10-09T06:31:45.631 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:45.632 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":84,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/1867744244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":1867744244},{"type":"v1","addr":"172.21.15.158:6836","nonce":1867744244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":7078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1455840229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":1455840229},{"type":"v1","addr":"172.21.15.158:6837","nonce":1455840229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7770,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3156917195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3156917195},{"type":"v1","addr":"172.21.15.31:6834","nonce":3156917195}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1537057825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1537057825},{"type":"v1","addr":"172.21.15.31:6835","nonce":1537057825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[]} 2023-10-09T06:31:45.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.632+0000 7f8fd8409700 1 -- 172.21.15.31:0/3575714216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8fbc066f30 msgr2=0x7f8fbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:45.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.633+0000 7f8fd8409700 1 --2- 172.21.15.31:0/3575714216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8fbc066f30 0x7f8fbc0693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000acf0 tx=0x7f8fc0009350 comp rx=0 tx=0).stop 2023-10-09T06:31:45.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.633+0000 7f8fd8409700 1 -- 172.21.15.31:0/3575714216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fd015a2b0 msgr2=0x7f8fd015b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:45.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.633+0000 7f8fd8409700 1 --2- 172.21.15.31:0/3575714216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fd015a2b0 0x7f8fd015b4b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4009290 tx=0x7f8fc4016000 comp rx=0 tx=0).stop 2023-10-09T06:31:45.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.633+0000 7f8fd8409700 1 -- 172.21.15.31:0/3575714216 shutdown_connections 2023-10-09T06:31:45.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.633+0000 7f8fd8409700 1 --2- 172.21.15.31:0/3575714216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8fbc066f30 0x7f8fbc0693e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.633+0000 7f8fd8409700 1 --2- 172.21.15.31:0/3575714216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8fd00d1c30 0x7f8fd0158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.633+0000 7f8fd8409700 1 --2- 172.21.15.31:0/3575714216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8fd015a680 0x7f8fd015cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.633+0000 7f8fd8409700 1 --2- 172.21.15.31:0/3575714216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fd015a2b0 0x7f8fd015b4b0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.633+0000 7f8fd8409700 1 -- 172.21.15.31:0/3575714216 >> 172.21.15.31:0/3575714216 conn(0x7f8fd0067e40 msgr2=0x7f8fd0069170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:45.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.633+0000 7f8fd8409700 1 -- 172.21.15.31:0/3575714216 shutdown_connections 2023-10-09T06:31:45.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.633+0000 7f8fd8409700 1 -- 172.21.15.31:0/3575714216 wait complete. 2023-10-09T06:31:45.635 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 84 2023-10-09T06:31:45.646 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:31:45.646 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:31:45.646 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:31:45.646 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:31:45.646 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:31:45.647 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:31:45.647 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:31:45.647 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:31:45.647 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:31:45.647 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:31:45.648 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:31:45.648 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:31:45.648 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:31:45.648 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:31:45.648 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:31:45.649 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:31:45.655 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:31:45.655 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:31:45.656 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:31:45.656 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:31:45.659 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:31:45.659 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:31:45.660 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:31:45.660 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:31:45.698 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:31:45.698 DEBUG:teuthology.parallel:result is None 2023-10-09T06:31:45.699 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:31:45.699 DEBUG:teuthology.parallel:result is None 2023-10-09T06:31:45.701 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:31:45.701 DEBUG:teuthology.parallel:result is None 2023-10-09T06:31:45.702 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:31:45.702 DEBUG:teuthology.parallel:result is None 2023-10-09T06:31:45.702 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:31:45.774 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:31:45.774 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-10-09T06:31:45.785 INFO:tasks.ceph.mds.d.smithi158.stdout:starting mds.d at 2023-10-09T06:31:45.785 INFO:tasks.ceph.mds.b.smithi158.stdout:starting mds.b at 2023-10-09T06:31:45.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.829+0000 7f661b39d700 1 Processor -- start 2023-10-09T06:31:45.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.829+0000 7f661b39d700 1 -- start start 2023-10-09T06:31:45.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.830+0000 7f661b39d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6614152010 0x7f661415b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:45.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.830+0000 7f661b39d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f66141523e0 0x7f661406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.830+0000 7f661b39d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661406c010 con 0x7f6614158e50 2023-10-09T06:31:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.830+0000 7f661b39d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661406bd10 con 0x7f66141523e0 2023-10-09T06:31:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.830+0000 7f661b39d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661415c060 con 0x7f6614152010 2023-10-09T06:31:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.830+0000 7f6619139700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6614152010 0x7f661415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.830+0000 7f6618938700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f66141523e0 0x7f661406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.830+0000 7f6619139700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6614152010 0x7f661415b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:50470/0 (socket says 172.21.15.31:50470) 2023-10-09T06:31:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.830+0000 7f6619139700 1 -- 172.21.15.31:0/3388763724 learned_addr learned my addr 172.21.15.31:0/3388763724 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.830+0000 7f6619139700 1 -- 172.21.15.31:0/3388763724 >> v2:172.21.15.158:3300/0 conn(0x7f66141523e0 msgr2=0x7f661406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.830+0000 7f6619139700 1 --2- 172.21.15.31:0/3388763724 >> v2:172.21.15.158:3300/0 conn(0x7f66141523e0 0x7f661406c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.830+0000 7f6619139700 1 -- 172.21.15.31:0/3388763724 >> v1:172.21.15.158:6789/0 conn(0x7f6614158e50 legacy=0x7f66140cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.830+0000 7f6619139700 1 -- 172.21.15.31:0/3388763724 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661415c340 con 0x7f6614152010 2023-10-09T06:31:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.831+0000 7f6619139700 1 --2- 172.21.15.31:0/3388763724 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6614152010 0x7f661415b810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f66100099b0 tx=0x7f6610009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c743e8fed9def1f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.831+0000 7f660bfff700 1 -- 172.21.15.31:0/3388763724 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610009ea0 con 0x7f6614152010 2023-10-09T06:31:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.831+0000 7f660bfff700 1 -- 172.21.15.31:0/3388763724 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661000b860 con 0x7f6614152010 2023-10-09T06:31:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.831+0000 7f660bfff700 1 -- 172.21.15.31:0/3388763724 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661000bc00 con 0x7f6614152010 2023-10-09T06:31:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.831+0000 7f661b39d700 1 -- 172.21.15.31:0/3388763724 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6614152010 msgr2=0x7f661415b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.831+0000 7f661b39d700 1 --2- 172.21.15.31:0/3388763724 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6614152010 0x7f661415b810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f66100099b0 tx=0x7f6610009250 comp rx=0 tx=0).stop 2023-10-09T06:31:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.831+0000 7f661b39d700 1 -- 172.21.15.31:0/3388763724 shutdown_connections 2023-10-09T06:31:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.831+0000 7f661b39d700 1 --2- 172.21.15.31:0/3388763724 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6614152010 0x7f661415b810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.831+0000 7f661b39d700 1 --2- 172.21.15.31:0/3388763724 >> v2:172.21.15.158:3300/0 conn(0x7f66141523e0 0x7f661406c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.831+0000 7f661b39d700 1 -- 172.21.15.31:0/3388763724 >> 172.21.15.31:0/3388763724 conn(0x7f6614069870 msgr2=0x7f6614069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:45.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.832+0000 7f661b39d700 1 -- 172.21.15.31:0/3388763724 shutdown_connections 2023-10-09T06:31:45.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.832+0000 7f661b39d700 1 -- 172.21.15.31:0/3388763724 wait complete. 2023-10-09T06:31:45.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.833+0000 7f661b39d700 1 Processor -- start 2023-10-09T06:31:45.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.833+0000 7f661b39d700 1 -- start start 2023-10-09T06:31:45.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.833+0000 7f661b39d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6614152010 0x7f661416bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:45.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.833+0000 7f661b39d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66141523e0 0x7f66140b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:45.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.833+0000 7f661b39d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6614158e50 0x7f661415a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.833+0000 7f661b39d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66140b4930 con 0x7f66141523e0 2023-10-09T06:31:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f661b39d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661416bab0 con 0x7f6614152010 2023-10-09T06:31:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f661b39d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66140b4370 con 0x7f6614158e50 2023-10-09T06:31:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f6618938700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66141523e0 0x7f66140b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f6618938700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66141523e0 0x7f66140b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51678/0 (socket says 172.21.15.31:51678) 2023-10-09T06:31:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f6618938700 1 -- 172.21.15.31:0/2634153702 learned_addr learned my addr 172.21.15.31:0/2634153702 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f6619139700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6614152010 0x7f661416bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f661993a700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6614158e50 0x7f661415a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f6618938700 1 -- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6614158e50 msgr2=0x7f661415a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f6618938700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6614158e50 0x7f661415a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f6618938700 1 -- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6614152010 msgr2=0x7f661416bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:45.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f6618938700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6614152010 0x7f661416bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:45.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f6618938700 1 -- 172.21.15.31:0/2634153702 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66100094f0 con 0x7f66141523e0 2023-10-09T06:31:45.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f6618938700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66141523e0 0x7f66140b3a20 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f660400ec50 tx=0x7f66040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:45.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f66097fa700 1 -- 172.21.15.31:0/2634153702 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660400c850 con 0x7f66141523e0 2023-10-09T06:31:45.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f66097fa700 1 -- 172.21.15.31:0/2634153702 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660400c9b0 con 0x7f66141523e0 2023-10-09T06:31:45.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f661b39d700 1 -- 172.21.15.31:0/2634153702 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66140b4650 con 0x7f66141523e0 2023-10-09T06:31:45.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f66097fa700 1 -- 172.21.15.31:0/2634153702 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660400cd70 con 0x7f66141523e0 2023-10-09T06:31:45.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.834+0000 7f661b39d700 1 -- 172.21.15.31:0/2634153702 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661416c480 con 0x7f66141523e0 2023-10-09T06:31:45.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.835+0000 7f661b39d700 1 -- 172.21.15.31:0/2634153702 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661416b5a0 con 0x7f66141523e0 2023-10-09T06:31:45.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.836+0000 7f66097fa700 1 -- 172.21.15.31:0/2634153702 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6604013680 con 0x7f66141523e0 2023-10-09T06:31:45.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.836+0000 7f66097fa700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f65f8066f30 0x7f65f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:45.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.836+0000 7f66097fa700 1 -- 172.21.15.31:0/2634153702 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6604084420 con 0x7f66141523e0 2023-10-09T06:31:45.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.836+0000 7f6619139700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f65f8066f30 0x7f65f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:45.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.837+0000 7f6619139700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f65f8066f30 0x7f65f80693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f66100099b0 tx=0x7f6610017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:45.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:45.840+0000 7f66097fa700 1 -- 172.21.15.31:0/2634153702 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f661416b5a0 con 0x7f66141523e0 2023-10-09T06:31:46.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.056+0000 7f661b39d700 1 -- 172.21.15.31:0/2634153702 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f661416b5a0 con 0x7f66141523e0 2023-10-09T06:31:46.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.828+0000 7f66097fa700 1 -- 172.21.15.31:0/2634153702 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v181) v1 ==== 97+0+0 (secure 0 0 0) 0x7f661416b5a0 con 0x7f66141523e0 2023-10-09T06:31:46.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.831+0000 7f661b39d700 1 -- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f65f8066f30 msgr2=0x7f65f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:46.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.831+0000 7f661b39d700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f65f8066f30 0x7f65f80693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f66100099b0 tx=0x7f6610017000 comp rx=0 tx=0).stop 2023-10-09T06:31:46.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.831+0000 7f661b39d700 1 -- 172.21.15.31:0/2634153702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66141523e0 msgr2=0x7f66140b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:46.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.831+0000 7f661b39d700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66141523e0 0x7f66140b3a20 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f660400ec50 tx=0x7f66040091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:46.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.831+0000 7f661b39d700 1 -- 172.21.15.31:0/2634153702 shutdown_connections 2023-10-09T06:31:46.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.831+0000 7f661b39d700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f65f8066f30 0x7f65f80693e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:46.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.831+0000 7f661b39d700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6614158e50 0x7f661415a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:46.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.831+0000 7f661b39d700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6614152010 0x7f661416bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:46.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.831+0000 7f661b39d700 1 --2- 172.21.15.31:0/2634153702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66141523e0 0x7f66140b3a20 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:46.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.831+0000 7f661b39d700 1 -- 172.21.15.31:0/2634153702 >> 172.21.15.31:0/2634153702 conn(0x7f6614069870 msgr2=0x7f6614158250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:46.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.831+0000 7f661b39d700 1 -- 172.21.15.31:0/2634153702 shutdown_connections 2023-10-09T06:31:46.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.831+0000 7f661b39d700 1 -- 172.21.15.31:0/2634153702 wait complete. 2023-10-09T06:31:46.834 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2023-10-09T06:31:46.848 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:31:46.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.972+0000 7f4f1d126700 1 Processor -- start 2023-10-09T06:31:46.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.972+0000 7f4f1d126700 1 -- start start 2023-10-09T06:31:46.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.973+0000 7f4f1d126700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f18157870 0x7f4f1815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:46.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.973+0000 7f4f1d126700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f18157c40 0x7f4f18158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.973+0000 7f4f1d126700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1815cbb0 con 0x7f4f1815a620 2023-10-09T06:31:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.973+0000 7f4f1d126700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1815bfa0 con 0x7f4f18157c40 2023-10-09T06:31:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.973+0000 7f4f1d126700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815c280 con 0x7f4f18157870 2023-10-09T06:31:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.973+0000 7f4f1759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f18157c40 0x7f4f18158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.973+0000 7f4f1659c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4f1815a620 0x7f4f1815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34384/0 (socket says 172.21.15.31:34384) 2023-10-09T06:31:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.973+0000 7f4f1659c700 1 -- 172.21.15.31:0/3632233501 learned_addr learned my addr 172.21.15.31:0/3632233501 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.974+0000 7f4f16d9d700 1 --2- 172.21.15.31:0/3632233501 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f18157870 0x7f4f1815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.974+0000 7f4f1759e700 1 -- 172.21.15.31:0/3632233501 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f18157870 msgr2=0x7f4f1815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.974+0000 7f4f1759e700 1 --2- 172.21.15.31:0/3632233501 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f18157870 0x7f4f1815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.974+0000 7f4f1759e700 1 -- 172.21.15.31:0/3632233501 >> v1:172.21.15.31:6789/0 conn(0x7f4f1815a620 legacy=0x7f4f1815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.974+0000 7f4f15d9b700 1 -- 172.21.15.31:0/3632233501 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975049089 0 0) 0x7f4f1815cbb0 con 0x7f4f1815a620 2023-10-09T06:31:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.974+0000 7f4f1759e700 1 -- 172.21.15.31:0/3632233501 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1815c560 con 0x7f4f18157c40 2023-10-09T06:31:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.974+0000 7f4f1759e700 1 --2- 172.21.15.31:0/3632233501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f18157c40 0x7f4f18158110 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f4f100098e0 tx=0x7f4f100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179ae2d314da32c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.974+0000 7f4f15d9b700 1 -- 172.21.15.31:0/3632233501 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10009e80 con 0x7f4f18157c40 2023-10-09T06:31:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.974+0000 7f4f15d9b700 1 -- 172.21.15.31:0/3632233501 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1000b860 con 0x7f4f18157c40 2023-10-09T06:31:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.974+0000 7f4f15d9b700 1 -- 172.21.15.31:0/3632233501 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000bbe0 con 0x7f4f18157c40 2023-10-09T06:31:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.974+0000 7f4f1d126700 1 -- 172.21.15.31:0/3632233501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f18157c40 msgr2=0x7f4f18158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.974+0000 7f4f1d126700 1 --2- 172.21.15.31:0/3632233501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f18157c40 0x7f4f18158110 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f4f100098e0 tx=0x7f4f100091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.975+0000 7f4f1d126700 1 -- 172.21.15.31:0/3632233501 shutdown_connections 2023-10-09T06:31:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.975+0000 7f4f1d126700 1 --2- 172.21.15.31:0/3632233501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f18157c40 0x7f4f18158110 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.975+0000 7f4f1d126700 1 --2- 172.21.15.31:0/3632233501 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f18157870 0x7f4f1815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.975+0000 7f4f1d126700 1 -- 172.21.15.31:0/3632233501 >> 172.21.15.31:0/3632233501 conn(0x7f4f18068ce0 msgr2=0x7f4f180690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.975+0000 7f4f1d126700 1 -- 172.21.15.31:0/3632233501 shutdown_connections 2023-10-09T06:31:46.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.975+0000 7f4f1d126700 1 -- 172.21.15.31:0/3632233501 wait complete. 2023-10-09T06:31:46.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.976+0000 7f4f1d126700 1 Processor -- start 2023-10-09T06:31:46.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.976+0000 7f4f1d126700 1 -- start start 2023-10-09T06:31:46.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.976+0000 7f4f1d126700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f18157870 0x7f4f1813f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:46.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.976+0000 7f4f1d126700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f18157c40 0x7f4f180b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:46.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1d126700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1815a620 0x7f4f1815f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:46.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1d126700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1813f860 con 0x7f4f1815a620 2023-10-09T06:31:46.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1d126700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815e210 con 0x7f4f18157870 2023-10-09T06:31:46.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1d126700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815d600 con 0x7f4f18157c40 2023-10-09T06:31:46.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1815a620 0x7f4f1815f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:46.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1815a620 0x7f4f1815f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51684/0 (socket says 172.21.15.31:51684) 2023-10-09T06:31:46.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1759e700 1 -- 172.21.15.31:0/1167978942 learned_addr learned my addr 172.21.15.31:0/1167978942 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:46.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1659c700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f18157c40 0x7f4f180b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:46.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f16d9d700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f18157870 0x7f4f1813f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:46.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1759e700 1 -- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f18157c40 msgr2=0x7f4f180b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:46.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1759e700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f18157c40 0x7f4f180b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:46.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1759e700 1 -- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f18157870 msgr2=0x7f4f1813f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:46.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1759e700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f18157870 0x7f4f1813f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:46.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1759e700 1 -- 172.21.15.31:0/1167978942 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f10009420 con 0x7f4f1815a620 2023-10-09T06:31:46.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1759e700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1815a620 0x7f4f1815f8a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000b3c0 tx=0x7f4f10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:46.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f0effd700 1 -- 172.21.15.31:0/1167978942 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10011630 con 0x7f4f1815a620 2023-10-09T06:31:46.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f0effd700 1 -- 172.21.15.31:0/1167978942 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f100117b0 con 0x7f4f1815a620 2023-10-09T06:31:46.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1d126700 1 -- 172.21.15.31:0/1167978942 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1815d8e0 con 0x7f4f1815a620 2023-10-09T06:31:46.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f0effd700 1 -- 172.21.15.31:0/1167978942 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10011b70 con 0x7f4f1815a620 2023-10-09T06:31:46.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.977+0000 7f4f1d126700 1 -- 172.21.15.31:0/1167978942 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1815dea0 con 0x7f4f1815a620 2023-10-09T06:31:46.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.978+0000 7f4f1d126700 1 -- 172.21.15.31:0/1167978942 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1815e3a0 con 0x7f4f1815a620 2023-10-09T06:31:46.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.979+0000 7f4f0effd700 1 -- 172.21.15.31:0/1167978942 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f100253f0 con 0x7f4f1815a620 2023-10-09T06:31:46.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.979+0000 7f4f0effd700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ef8066f30 0x7f4ef80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:46.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.979+0000 7f4f0effd700 1 -- 172.21.15.31:0/1167978942 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4f10085e10 con 0x7f4f1815a620 2023-10-09T06:31:46.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.979+0000 7f4f16d9d700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ef8066f30 0x7f4ef80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:46.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.980+0000 7f4f16d9d700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ef8066f30 0x7f4ef80693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4f08007540 tx=0x7f4f0800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:46.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:46.983+0000 7f4f0effd700 1 -- 172.21.15.31:0/1167978942 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f100533d0 con 0x7f4f1815a620 2023-10-09T06:31:47.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.258+0000 7f4f1d126700 1 -- 172.21.15.31:0/1167978942 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4f1804c3c0 con 0x7f4f1815a620 2023-10-09T06:31:47.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.258+0000 7f4f0effd700 1 -- 172.21.15.31:0/1167978942 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4f10015090 con 0x7f4f1815a620 2023-10-09T06:31:47.259 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:47.259 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:31:47.259 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2023-10-09T06:31:47.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.259 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2023-10-09T06:31:47.260 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl/nWKAxAA1kcqjt4lPGPkmDivDpIVjQ==", 2023-10-09T06:31:47.260 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.260 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:31:47.260 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:31:47.260 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:31:47.260 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.260 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.261 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2023-10-09T06:31:47.261 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNl9xYEDxAAQJeaqz7lkrArv45vLGb34g==", 2023-10-09T06:31:47.261 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.261 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:31:47.261 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:31:47.261 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:31:47.261 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.261 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.262 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2023-10-09T06:31:47.262 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlJOp0ChAADGiI4SX7ZLvDrtjDtU905A==", 2023-10-09T06:31:47.262 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.262 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:31:47.262 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:31:47.262 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:31:47.263 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.263 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.263 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2023-10-09T06:31:47.263 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlbnnJFRAAO+XoxRQDaHv0ZicyggniLQ==", 2023-10-09T06:31:47.263 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.263 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:31:47.263 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:31:47.264 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:31:47.264 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.264 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.264 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2023-10-09T06:31:47.264 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNloyZ+LxAApAHpPxV7R1OVE2wlIaU+PA==", 2023-10-09T06:31:47.264 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.264 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:31:47.265 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:31:47.265 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.265 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.265 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2023-10-09T06:31:47.265 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCvmyNlvHeUNhAAXblIEmmsc5eTo5VcZVirfA==", 2023-10-09T06:31:47.265 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.266 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:31:47.266 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:31:47.266 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.266 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.266 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2023-10-09T06:31:47.266 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlxfIaBBAAE8WbXh4Q4SxaW2k7MkSTHg==", 2023-10-09T06:31:47.266 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.267 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:31:47.267 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:31:47.267 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.267 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.267 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2023-10-09T06:31:47.267 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwmyNlUtX3DRAA5NEq+lFMzqhu1GF1ZWT2ag==", 2023-10-09T06:31:47.267 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.269 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:31:47.269 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:31:47.270 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.270 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.270 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2023-10-09T06:31:47.270 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlcWc5IBAA5e62AwhIuHdw4dTjnNS8hQ==", 2023-10-09T06:31:47.270 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.270 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:31:47.270 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:31:47.270 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.270 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.271 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2023-10-09T06:31:47.271 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNlX5S6JhAAzvzO2YEqEtq2fJ3FW9Fddg==", 2023-10-09T06:31:47.271 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.271 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:31:47.271 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:31:47.271 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.271 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.272 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2023-10-09T06:31:47.272 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl9jy5LxAAxgMslSN6ayxB2MFRf2dwNQ==", 2023-10-09T06:31:47.272 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.272 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:31:47.272 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:31:47.272 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.272 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.272 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2023-10-09T06:31:47.272 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCxmyNl8M+TOBAARhk2wEaXO9Pi4TP9d+L5Gg==", 2023-10-09T06:31:47.272 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.273 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-10-09T06:31:47.273 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-10-09T06:31:47.273 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.273 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.273 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2023-10-09T06:31:47.273 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlfsC2GRAAlm37QI8DkNclcBpD5ZBR7A==", 2023-10-09T06:31:47.273 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.273 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:31:47.273 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2023-10-09T06:31:47.273 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T06:31:47.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.274 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2023-10-09T06:31:47.274 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlapIxIhAAiBZUkpnf6tyFHwySGKhRpQ==", 2023-10-09T06:31:47.274 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.274 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:31:47.274 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:31:47.274 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:31:47.274 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:31:47.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.275 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2023-10-09T06:31:47.275 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEZYuHxAA7WEH0vXmAEH5Wki8ESrDBg==", 2023-10-09T06:31:47.275 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.275 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:31:47.275 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:31:47.275 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:31:47.275 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:31:47.275 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.275 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2023-10-09T06:31:47.276 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlFvuIJxAAGuTp4gsXrvUzDd1B7d5vcg==", 2023-10-09T06:31:47.276 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.276 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-10-09T06:31:47.276 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-10-09T06:31:47.276 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-10-09T06:31:47.276 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-10-09T06:31:47.276 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.276 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2023-10-09T06:31:47.276 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlS8AlJBAAg8lLRVasKHyhbFlOTfgt9g==", 2023-10-09T06:31:47.276 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.277 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:31:47.277 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-10-09T06:31:47.277 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-10-09T06:31:47.277 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.277 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.277 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2023-10-09T06:31:47.277 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCsmyNlEE9eABAAHbJ1yvlmOUNo6n2uAhPrnw==", 2023-10-09T06:31:47.277 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.277 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:31:47.277 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:31:47.277 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.278 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:31:47.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:47.278 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2023-10-09T06:31:47.278 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCrmyNlhol5OBAAZSZ+PbojVwsOJtLlTl6wAA==", 2023-10-09T06:31:47.278 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-10-09T06:31:47.278 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-10-09T06:31:47.278 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-10-09T06:31:47.278 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-10-09T06:31:47.278 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.278 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:47.279 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:31:47.279 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:31:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.260+0000 7f4f1d126700 1 -- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ef8066f30 msgr2=0x7f4ef80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.260+0000 7f4f1d126700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ef8066f30 0x7f4ef80693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4f08007540 tx=0x7f4f0800b040 comp rx=0 tx=0).stop 2023-10-09T06:31:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.260+0000 7f4f1d126700 1 -- 172.21.15.31:0/1167978942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1815a620 msgr2=0x7f4f1815f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.260+0000 7f4f1d126700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1815a620 0x7f4f1815f8a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000b3c0 tx=0x7f4f10017000 comp rx=0 tx=0).stop 2023-10-09T06:31:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.260+0000 7f4f1d126700 1 -- 172.21.15.31:0/1167978942 shutdown_connections 2023-10-09T06:31:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.260+0000 7f4f1d126700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ef8066f30 0x7f4ef80693e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.260+0000 7f4f1d126700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f1815a620 0x7f4f1815f8a0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.260+0000 7f4f1d126700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f18157870 0x7f4f1813f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.260+0000 7f4f1d126700 1 --2- 172.21.15.31:0/1167978942 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4f18157c40 0x7f4f180b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.260+0000 7f4f1d126700 1 -- 172.21.15.31:0/1167978942 >> 172.21.15.31:0/1167978942 conn(0x7f4f18068ce0 msgr2=0x7f4f180cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:47.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.261+0000 7f4f1d126700 1 -- 172.21.15.31:0/1167978942 shutdown_connections 2023-10-09T06:31:47.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.261+0000 7f4f1d126700 1 -- 172.21.15.31:0/1167978942 wait complete. 2023-10-09T06:31:47.281 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:31:47.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.400+0000 7f5f38aac700 1 Processor -- start 2023-10-09T06:31:47.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.400+0000 7f5f38aac700 1 -- start start 2023-10-09T06:31:47.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.401+0000 7f5f38aac700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5f3406a060 0x7f5f340ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:47.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.401+0000 7f5f38aac700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f34068de0 con 0x7f5f34159c60 2023-10-09T06:31:47.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.401+0000 7f5f38aac700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f340affc0 con 0x7f5f3415a030 2023-10-09T06:31:47.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.401+0000 7f5f38aac700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f340695f0 con 0x7f5f3406a060 2023-10-09T06:31:47.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.401+0000 7f5f32ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5f3406a060 0x7f5f340ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:47.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.401+0000 7f5f337fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5f34159c60 0x7f5f3415ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34400/0 (socket says 172.21.15.31:34400) 2023-10-09T06:31:47.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.401+0000 7f5f337fe700 1 -- 172.21.15.31:0/1658894481 learned_addr learned my addr 172.21.15.31:0/1658894481 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:47.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.401+0000 7f5f32ffd700 1 -- 172.21.15.31:0/1658894481 >> v1:172.21.15.158:6789/0 conn(0x7f5f3415a030 legacy=0x7f5f340b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:47.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.401+0000 7f5f32ffd700 1 -- 172.21.15.31:0/1658894481 >> v1:172.21.15.31:6789/0 conn(0x7f5f34159c60 legacy=0x7f5f3415ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:47.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.401+0000 7f5f32ffd700 1 -- 172.21.15.31:0/1658894481 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f34069030 con 0x7f5f3406a060 2023-10-09T06:31:47.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.401+0000 7f5f327fc700 1 -- 172.21.15.31:0/1658894481 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521300754 0 0) 0x7f5f34068de0 con 0x7f5f34159c60 2023-10-09T06:31:47.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.402+0000 7f5f32ffd700 1 --2- 172.21.15.31:0/1658894481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3406a060 0x7f5f340ce990 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f5f280098e0 tx=0x7f5f280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266b3991f97504e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:47.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.402+0000 7f5f327fc700 1 -- 172.21.15.31:0/1658894481 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28009e80 con 0x7f5f3406a060 2023-10-09T06:31:47.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.402+0000 7f5f327fc700 1 -- 172.21.15.31:0/1658894481 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2800b820 con 0x7f5f3406a060 2023-10-09T06:31:47.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.402+0000 7f5f327fc700 1 -- 172.21.15.31:0/1658894481 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800bba0 con 0x7f5f3406a060 2023-10-09T06:31:47.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.402+0000 7f5f38aac700 1 -- 172.21.15.31:0/1658894481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3406a060 msgr2=0x7f5f340ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:47.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.402+0000 7f5f38aac700 1 --2- 172.21.15.31:0/1658894481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3406a060 0x7f5f340ce990 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f5f280098e0 tx=0x7f5f280091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.402+0000 7f5f38aac700 1 -- 172.21.15.31:0/1658894481 shutdown_connections 2023-10-09T06:31:47.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.402+0000 7f5f38aac700 1 --2- 172.21.15.31:0/1658894481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3406a060 0x7f5f340ce990 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.402+0000 7f5f38aac700 1 -- 172.21.15.31:0/1658894481 >> 172.21.15.31:0/1658894481 conn(0x7f5f3406c740 msgr2=0x7f5f34069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:47.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.402+0000 7f5f38aac700 1 -- 172.21.15.31:0/1658894481 shutdown_connections 2023-10-09T06:31:47.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.402+0000 7f5f38aac700 1 -- 172.21.15.31:0/1658894481 wait complete. 2023-10-09T06:31:47.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.404+0000 7f5f38aac700 1 Processor -- start 2023-10-09T06:31:47.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.404+0000 7f5f38aac700 1 -- start start 2023-10-09T06:31:47.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.404+0000 7f5f38aac700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f3406a060 0x7f5f34067c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:47.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.404+0000 7f5f38aac700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5f34159c60 0x7f5f340cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:47.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.404+0000 7f5f38aac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3415a030 0x7f5f3414e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:47.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.404+0000 7f5f38aac700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340abf40 con 0x7f5f3415a030 2023-10-09T06:31:47.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.404+0000 7f5f38aac700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340b17d0 con 0x7f5f3406a060 2023-10-09T06:31:47.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.404+0000 7f5f38aac700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340b2630 con 0x7f5f34159c60 2023-10-09T06:31:47.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f33fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3415a030 0x7f5f3414e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:47.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f33fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3415a030 0x7f5f3414e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51698/0 (socket says 172.21.15.31:51698) 2023-10-09T06:31:47.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f33fff700 1 -- 172.21.15.31:0/102997836 learned_addr learned my addr 172.21.15.31:0/102997836 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:47.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f337fe700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f3406a060 0x7f5f34067c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:47.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f32ffd700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5f34159c60 0x7f5f340cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:47.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f33fff700 1 -- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5f34159c60 msgr2=0x7f5f340cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:47.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f33fff700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5f34159c60 0x7f5f340cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f33fff700 1 -- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f3406a060 msgr2=0x7f5f34067c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:47.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f33fff700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f3406a060 0x7f5f34067c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f33fff700 1 -- 172.21.15.31:0/102997836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28009420 con 0x7f5f3415a030 2023-10-09T06:31:47.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f32ffd700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5f34159c60 0x7f5f340cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:47.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f33fff700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3415a030 0x7f5f3414e370 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00c8c0 tx=0x7f5f2c0026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:47.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f1b7fe700 1 -- 172.21.15.31:0/102997836 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c012630 con 0x7f5f3415a030 2023-10-09T06:31:47.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f1b7fe700 1 -- 172.21.15.31:0/102997836 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c0127b0 con 0x7f5f3415a030 2023-10-09T06:31:47.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f38aac700 1 -- 172.21.15.31:0/102997836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f340b1a20 con 0x7f5f3415a030 2023-10-09T06:31:47.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f1b7fe700 1 -- 172.21.15.31:0/102997836 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c012b70 con 0x7f5f3415a030 2023-10-09T06:31:47.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.405+0000 7f5f38aac700 1 -- 172.21.15.31:0/102997836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f340b1fe0 con 0x7f5f3415a030 2023-10-09T06:31:47.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.406+0000 7f5f38aac700 1 -- 172.21.15.31:0/102997836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f340b2770 con 0x7f5f3415a030 2023-10-09T06:31:47.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.406+0000 7f5f1b7fe700 1 -- 172.21.15.31:0/102997836 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f2c01b400 con 0x7f5f3415a030 2023-10-09T06:31:47.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.407+0000 7f5f1b7fe700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5f20066f30 0x7f5f200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:47.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.407+0000 7f5f1b7fe700 1 -- 172.21.15.31:0/102997836 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5f2c084530 con 0x7f5f3415a030 2023-10-09T06:31:47.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.407+0000 7f5f337fe700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5f20066f30 0x7f5f200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:47.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.408+0000 7f5f337fe700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5f20066f30 0x7f5f200693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5f24007fd0 tx=0x7f5f24007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:47.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.411+0000 7f5f1b7fe700 1 -- 172.21.15.31:0/102997836 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f2c051af0 con 0x7f5f3415a030 2023-10-09T06:31:47.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.606+0000 7f5f38aac700 1 -- 172.21.15.31:0/102997836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f3404bb80 con 0x7f5f3415a030 2023-10-09T06:31:47.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.607+0000 7f5f1b7fe700 1 -- 172.21.15.31:0/102997836 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+12145 (secure 0 0 0) 0x7f5f2c055110 con 0x7f5f3415a030 2023-10-09T06:31:47.608 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:47.608 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":181,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:31:46.827128+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:31:47.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.609+0000 7f5f38aac700 1 -- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5f20066f30 msgr2=0x7f5f200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:47.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.609+0000 7f5f38aac700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5f20066f30 0x7f5f200693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5f24007fd0 tx=0x7f5f24007d30 comp rx=0 tx=0).stop 2023-10-09T06:31:47.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.609+0000 7f5f38aac700 1 -- 172.21.15.31:0/102997836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3415a030 msgr2=0x7f5f3414e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:47.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.609+0000 7f5f38aac700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3415a030 0x7f5f3414e370 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00c8c0 tx=0x7f5f2c0026a0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.609+0000 7f5f38aac700 1 -- 172.21.15.31:0/102997836 shutdown_connections 2023-10-09T06:31:47.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.609+0000 7f5f38aac700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5f20066f30 0x7f5f200693e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.609+0000 7f5f38aac700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3415a030 0x7f5f3414e370 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.609+0000 7f5f38aac700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f3406a060 0x7f5f34067c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.609+0000 7f5f38aac700 1 --2- 172.21.15.31:0/102997836 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5f34159c60 0x7f5f340cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.609+0000 7f5f38aac700 1 -- 172.21.15.31:0/102997836 >> 172.21.15.31:0/102997836 conn(0x7f5f3406c740 msgr2=0x7f5f341563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:47.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.609+0000 7f5f38aac700 1 -- 172.21.15.31:0/102997836 shutdown_connections 2023-10-09T06:31:47.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.609+0000 7f5f38aac700 1 -- 172.21.15.31:0/102997836 wait complete. 2023-10-09T06:31:47.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:31:47.622 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:31:47.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.743+0000 7f57d9a71700 1 Processor -- start 2023-10-09T06:31:47.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.743+0000 7f57d9a71700 1 -- start start 2023-10-09T06:31:47.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d9a71700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57d40cce30 0x7f57d415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:47.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d9a71700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57d40b6580 0x7f57d406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:47.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d9a71700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f57d406a830 0x7f57d415d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:47.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d9a71700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d40b4d70 con 0x7f57d40b6580 2023-10-09T06:31:47.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d9a71700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d406ac70 con 0x7f57d406a830 2023-10-09T06:31:47.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d9a71700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40cd8d0 con 0x7f57d40cce30 2023-10-09T06:31:47.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57d40b6580 0x7f57d406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:47.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57d40b6580 0x7f57d406a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51710/0 (socket says 172.21.15.31:51710) 2023-10-09T06:31:47.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d3fff700 1 -- 172.21.15.31:0/482689738 learned_addr learned my addr 172.21.15.31:0/482689738 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:47.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d3fff700 1 -- 172.21.15.31:0/482689738 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57d40cce30 msgr2=0x7f57d415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:47.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d3fff700 1 --2- 172.21.15.31:0/482689738 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57d40cce30 0x7f57d415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d3fff700 1 -- 172.21.15.31:0/482689738 >> v2:172.21.15.158:3300/0 conn(0x7f57d406a830 msgr2=0x7f57d415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:47.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d3fff700 1 --2- 172.21.15.31:0/482689738 >> v2:172.21.15.158:3300/0 conn(0x7f57d406a830 0x7f57d415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.744+0000 7f57d3fff700 1 -- 172.21.15.31:0/482689738 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d40b4440 con 0x7f57d40b6580 2023-10-09T06:31:47.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.745+0000 7f57d3fff700 1 --2- 172.21.15.31:0/482689738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d40b6580 0x7f57d406a2f0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f57d415a280 tx=0x7f57c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1886e3f11da29179 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:47.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.745+0000 7f57d37fe700 1 -- 172.21.15.31:0/482689738 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c800b860 con 0x7f57d40b6580 2023-10-09T06:31:47.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.745+0000 7f57d37fe700 1 -- 172.21.15.31:0/482689738 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c800b9c0 con 0x7f57d40b6580 2023-10-09T06:31:47.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.745+0000 7f57d37fe700 1 -- 172.21.15.31:0/482689738 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c800bd60 con 0x7f57d40b6580 2023-10-09T06:31:47.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.745+0000 7f57d9a71700 1 -- 172.21.15.31:0/482689738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d40b6580 msgr2=0x7f57d406a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:47.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.745+0000 7f57d9a71700 1 --2- 172.21.15.31:0/482689738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d40b6580 0x7f57d406a2f0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f57d415a280 tx=0x7f57c8009250 comp rx=0 tx=0).stop 2023-10-09T06:31:47.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.745+0000 7f57d9a71700 1 -- 172.21.15.31:0/482689738 shutdown_connections 2023-10-09T06:31:47.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.745+0000 7f57d9a71700 1 --2- 172.21.15.31:0/482689738 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57d40cce30 0x7f57d415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.745+0000 7f57d9a71700 1 --2- 172.21.15.31:0/482689738 >> v2:172.21.15.158:3300/0 conn(0x7f57d406a830 0x7f57d415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.745+0000 7f57d9a71700 1 --2- 172.21.15.31:0/482689738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d40b6580 0x7f57d406a2f0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.745+0000 7f57d9a71700 1 -- 172.21.15.31:0/482689738 >> 172.21.15.31:0/482689738 conn(0x7f57d4068cb0 msgr2=0x7f57d40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:47.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.745+0000 7f57d9a71700 1 -- 172.21.15.31:0/482689738 shutdown_connections 2023-10-09T06:31:47.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.745+0000 7f57d9a71700 1 -- 172.21.15.31:0/482689738 wait complete. 2023-10-09T06:31:47.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.746+0000 7f57d9a71700 1 Processor -- start 2023-10-09T06:31:47.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.747+0000 7f57d9a71700 1 -- start start 2023-10-09T06:31:47.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.747+0000 7f57d9a71700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57d406a830 0x7f57d4154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:47.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.747+0000 7f57d9a71700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57d40b6580 0x7f57d4155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:47.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.747+0000 7f57d9a71700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d40cce30 0x7f57d4155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:47.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.747+0000 7f57d9a71700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40b2da0 con 0x7f57d40cce30 2023-10-09T06:31:47.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.747+0000 7f57d9a71700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40b2220 con 0x7f57d40b6580 2023-10-09T06:31:47.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.747+0000 7f57d9a71700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40b2500 con 0x7f57d406a830 2023-10-09T06:31:47.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.747+0000 7f57d9270700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d40cce30 0x7f57d4155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:47.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.747+0000 7f57d9270700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d40cce30 0x7f57d4155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51720/0 (socket says 172.21.15.31:51720) 2023-10-09T06:31:47.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.747+0000 7f57d9270700 1 -- 172.21.15.31:0/3528663636 learned_addr learned my addr 172.21.15.31:0/3528663636 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:47.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.747+0000 7f57d8a6f700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57d406a830 0x7f57d4154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:47.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.747+0000 7f57d3fff700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57d40b6580 0x7f57d4155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:47.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.748+0000 7f57d9270700 1 -- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57d406a830 msgr2=0x7f57d4154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:47.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.748+0000 7f57d9270700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57d406a830 0x7f57d4154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.748+0000 7f57d9270700 1 -- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57d40b6580 msgr2=0x7f57d4155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:47.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.748+0000 7f57d9270700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57d40b6580 0x7f57d4155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.748+0000 7f57d9270700 1 -- 172.21.15.31:0/3528663636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c80094f0 con 0x7f57d40cce30 2023-10-09T06:31:47.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.748+0000 7f57d9270700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d40cce30 0x7f57d4155990 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f57c400b810 tx=0x7f57c40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:47.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.748+0000 7f57d0ff9700 1 -- 172.21.15.31:0/3528663636 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c400f510 con 0x7f57d40cce30 2023-10-09T06:31:47.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.748+0000 7f57d0ff9700 1 -- 172.21.15.31:0/3528663636 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c400f670 con 0x7f57d40cce30 2023-10-09T06:31:47.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.748+0000 7f57d9a71700 1 -- 172.21.15.31:0/3528663636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d40b27e0 con 0x7f57d40cce30 2023-10-09T06:31:47.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.748+0000 7f57d0ff9700 1 -- 172.21.15.31:0/3528663636 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c400fa30 con 0x7f57d40cce30 2023-10-09T06:31:47.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.748+0000 7f57d9a71700 1 -- 172.21.15.31:0/3528663636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d414fdb0 con 0x7f57d40cce30 2023-10-09T06:31:47.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.749+0000 7f57d9a71700 1 -- 172.21.15.31:0/3528663636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d4089550 con 0x7f57d40cce30 2023-10-09T06:31:47.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.749+0000 7f57d0ff9700 1 -- 172.21.15.31:0/3528663636 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57c401a400 con 0x7f57d40cce30 2023-10-09T06:31:47.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.750+0000 7f57d0ff9700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57c0066f30 0x7f57c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:47.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.750+0000 7f57d0ff9700 1 -- 172.21.15.31:0/3528663636 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f57c4083c30 con 0x7f57d40cce30 2023-10-09T06:31:47.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.750+0000 7f57d8a6f700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57c0066f30 0x7f57c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:47.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.751+0000 7f57d8a6f700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57c0066f30 0x7f57c00693e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f57cc007580 tx=0x7f57cc009780 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:47.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.754+0000 7f57d0ff9700 1 -- 172.21.15.31:0/3528663636 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57c4051270 con 0x7f57d40cce30 2023-10-09T06:31:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.948+0000 7f57d9a71700 1 -- 172.21.15.31:0/3528663636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57d40b4720 con 0x7f57d40cce30 2023-10-09T06:31:47.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.949+0000 7f57d0ff9700 1 -- 172.21.15.31:0/3528663636 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v181) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57c4054890 con 0x7f57d40cce30 2023-10-09T06:31:47.949 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:31:47.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.951+0000 7f57d9a71700 1 -- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57c0066f30 msgr2=0x7f57c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:47.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.951+0000 7f57d9a71700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57c0066f30 0x7f57c00693e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f57cc007580 tx=0x7f57cc009780 comp rx=0 tx=0).stop 2023-10-09T06:31:47.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.951+0000 7f57d9a71700 1 -- 172.21.15.31:0/3528663636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d40cce30 msgr2=0x7f57d4155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:47.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.951+0000 7f57d9a71700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d40cce30 0x7f57d4155990 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f57c400b810 tx=0x7f57c40091d0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.951+0000 7f57d9a71700 1 -- 172.21.15.31:0/3528663636 shutdown_connections 2023-10-09T06:31:47.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.951+0000 7f57d9a71700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f57c0066f30 0x7f57c00693e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.951+0000 7f57d9a71700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f57d406a830 0x7f57d4154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.951+0000 7f57d9a71700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d40cce30 0x7f57d4155990 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.951+0000 7f57d9a71700 1 --2- 172.21.15.31:0/3528663636 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f57d40b6580 0x7f57d4155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.951+0000 7f57d9a71700 1 -- 172.21.15.31:0/3528663636 >> 172.21.15.31:0/3528663636 conn(0x7f57d4068cb0 msgr2=0x7f57d40d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.951+0000 7f57d9a71700 1 -- 172.21.15.31:0/3528663636 shutdown_connections 2023-10-09T06:31:47.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:47.951+0000 7f57d9a71700 1 -- 172.21.15.31:0/3528663636 wait complete. 2023-10-09T06:31:47.964 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:31:48.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.083+0000 7faef6431700 1 Processor -- start 2023-10-09T06:31:48.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.083+0000 7faef6431700 1 -- start start 2023-10-09T06:31:48.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faef6431700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faef006c630 0x7faef0067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faef6431700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faef0067ba0 0x7faef0159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faef6431700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef00cb370 con 0x7faef00b0890 2023-10-09T06:31:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faef6431700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef0067fe0 con 0x7faef006c630 2023-10-09T06:31:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faef6431700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef00b0c60 con 0x7faef0067ba0 2023-10-09T06:31:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faeef7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faef006c630 0x7faef0067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faef49ce700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faef0067ba0 0x7faef0159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faeef7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faef006c630 0x7faef0067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:34478/0 (socket says 172.21.15.31:34478) 2023-10-09T06:31:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faeeffff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7faef00b0890 0x7faef00cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:37458/0 (socket says 172.21.15.31:37458) 2023-10-09T06:31:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faeef7fe700 1 -- 172.21.15.31:0/2347320229 learned_addr learned my addr 172.21.15.31:0/2347320229 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:48.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faef49ce700 1 -- 172.21.15.31:0/2347320229 >> v2:172.21.15.158:3300/0 conn(0x7faef006c630 msgr2=0x7faef0067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:48.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faef49ce700 1 --2- 172.21.15.31:0/2347320229 >> v2:172.21.15.158:3300/0 conn(0x7faef006c630 0x7faef0067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faef49ce700 1 -- 172.21.15.31:0/2347320229 >> v1:172.21.15.158:6789/0 conn(0x7faef00b0890 legacy=0x7faef00cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faef49ce700 1 -- 172.21.15.31:0/2347320229 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef006a1e0 con 0x7faef0067ba0 2023-10-09T06:31:48.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faeeeffd700 1 -- 172.21.15.31:0/2347320229 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291800581 0 0) 0x7faef00cb370 con 0x7faef00b0890 2023-10-09T06:31:48.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.084+0000 7faeef7fe700 1 --2- 172.21.15.31:0/2347320229 >> v2:172.21.15.158:3300/0 conn(0x7faef006c630 0x7faef0067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:31:48.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.085+0000 7faef49ce700 1 --2- 172.21.15.31:0/2347320229 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faef0067ba0 0x7faef0159790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faee8009e60 tx=0x7faee8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efafa8c82c28e9ce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:48.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.085+0000 7faeeeffd700 1 -- 172.21.15.31:0/2347320229 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee800e070 con 0x7faef0067ba0 2023-10-09T06:31:48.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.085+0000 7faeeeffd700 1 -- 172.21.15.31:0/2347320229 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee800bb60 con 0x7faef0067ba0 2023-10-09T06:31:48.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.085+0000 7faeeeffd700 1 -- 172.21.15.31:0/2347320229 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8012430 con 0x7faef0067ba0 2023-10-09T06:31:48.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.085+0000 7faef6431700 1 -- 172.21.15.31:0/2347320229 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faef0067ba0 msgr2=0x7faef0159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.085+0000 7faef6431700 1 --2- 172.21.15.31:0/2347320229 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faef0067ba0 0x7faef0159790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faee8009e60 tx=0x7faee8009780 comp rx=0 tx=0).stop 2023-10-09T06:31:48.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.085+0000 7faef6431700 1 -- 172.21.15.31:0/2347320229 shutdown_connections 2023-10-09T06:31:48.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.085+0000 7faef6431700 1 --2- 172.21.15.31:0/2347320229 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faef0067ba0 0x7faef0159790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.085+0000 7faef6431700 1 --2- 172.21.15.31:0/2347320229 >> v2:172.21.15.158:3300/0 conn(0x7faef006c630 0x7faef0067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.085+0000 7faef6431700 1 -- 172.21.15.31:0/2347320229 >> 172.21.15.31:0/2347320229 conn(0x7faef006fe50 msgr2=0x7faef0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:48.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.085+0000 7faef6431700 1 -- 172.21.15.31:0/2347320229 shutdown_connections 2023-10-09T06:31:48.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.085+0000 7faef6431700 1 -- 172.21.15.31:0/2347320229 wait complete. 2023-10-09T06:31:48.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.086+0000 7faef6431700 1 Processor -- start 2023-10-09T06:31:48.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.087+0000 7faef6431700 1 -- start start 2023-10-09T06:31:48.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.087+0000 7faef6431700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faef0067ba0 0x7faef00c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.087+0000 7faef6431700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faef006c630 0x7faef00aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.087+0000 7faef6431700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faef00b0890 0x7faef0150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.087+0000 7faef6431700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef00ab970 con 0x7faef006c630 2023-10-09T06:31:48.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.087+0000 7faef6431700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef00ab0d0 con 0x7faef00b0890 2023-10-09T06:31:48.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.087+0000 7faef6431700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef00ab3b0 con 0x7faef0067ba0 2023-10-09T06:31:48.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.087+0000 7faeef7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faef006c630 0x7faef00aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faeef7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faef006c630 0x7faef00aa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51722/0 (socket says 172.21.15.31:51722) 2023-10-09T06:31:48.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faeef7fe700 1 -- 172.21.15.31:0/3423914310 learned_addr learned my addr 172.21.15.31:0/3423914310 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:48.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faeeffff700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faef0067ba0 0x7faef00c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faef49ce700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faef00b0890 0x7faef0150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faeef7fe700 1 -- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faef0067ba0 msgr2=0x7faef00c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faeef7fe700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faef0067ba0 0x7faef00c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faeef7fe700 1 -- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faef00b0890 msgr2=0x7faef0150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faeef7fe700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faef00b0890 0x7faef0150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faeef7fe700 1 -- 172.21.15.31:0/3423914310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee00094f0 con 0x7faef006c630 2023-10-09T06:31:48.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faeef7fe700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faef006c630 0x7faef00aa880 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7faee000ec80 tx=0x7faee0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:48.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faee7fff700 1 -- 172.21.15.31:0/3423914310 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee000c850 con 0x7faef006c630 2023-10-09T06:31:48.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faee7fff700 1 -- 172.21.15.31:0/3423914310 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee000c9b0 con 0x7faef006c630 2023-10-09T06:31:48.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faef6431700 1 -- 172.21.15.31:0/3423914310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee8009a20 con 0x7faef006c630 2023-10-09T06:31:48.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faee7fff700 1 -- 172.21.15.31:0/3423914310 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee000cd30 con 0x7faef006c630 2023-10-09T06:31:48.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.088+0000 7faef6431700 1 -- 172.21.15.31:0/3423914310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef00abc90 con 0x7faef006c630 2023-10-09T06:31:48.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.089+0000 7faef6431700 1 -- 172.21.15.31:0/3423914310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef00aae20 con 0x7faef006c630 2023-10-09T06:31:48.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.090+0000 7faee7fff700 1 -- 172.21.15.31:0/3423914310 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faee0013680 con 0x7faef006c630 2023-10-09T06:31:48.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.090+0000 7faee7fff700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faed0066f30 0x7faed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.090+0000 7faee7fff700 1 -- 172.21.15.31:0/3423914310 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4853+0+0 (secure 0 0 0) 0x7faee0084880 con 0x7faef006c630 2023-10-09T06:31:48.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.090+0000 7faeeffff700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faed0066f30 0x7faed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.091+0000 7faeeffff700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faed0066f30 0x7faed00693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7faed8007180 tx=0x7faed8007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:48.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.094+0000 7faee7fff700 1 -- 172.21.15.31:0/3423914310 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faee0051da0 con 0x7faef006c630 2023-10-09T06:31:48.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.289+0000 7faef6431700 1 -- 172.21.15.31:0/3423914310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7faef004c3c0 con 0x7faef006c630 2023-10-09T06:31:48.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.289+0000 7faee7fff700 1 -- 172.21.15.31:0/3423914310 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v181) v1 ==== 84+0+65 (secure 0 0 0) 0x7faee0017060 con 0x7faef006c630 2023-10-09T06:31:48.290 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:48.290 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-10-09T06:31:48.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:31:48.290 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-10-09T06:31:48.290 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-10-09T06:31:48.290 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:31:48.290 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-10-09T06:31:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.291+0000 7faef6431700 1 -- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faed0066f30 msgr2=0x7faed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.291+0000 7faef6431700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faed0066f30 0x7faed00693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7faed8007180 tx=0x7faed8007ef0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.291+0000 7faef6431700 1 -- 172.21.15.31:0/3423914310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faef006c630 msgr2=0x7faef00aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.291+0000 7faef6431700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faef006c630 0x7faef00aa880 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7faee000ec80 tx=0x7faee0009250 comp rx=0 tx=0).stop 2023-10-09T06:31:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.291+0000 7faef6431700 1 -- 172.21.15.31:0/3423914310 shutdown_connections 2023-10-09T06:31:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.291+0000 7faef6431700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7faed0066f30 0x7faed00693e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.291+0000 7faef6431700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7faef0067ba0 0x7faef00c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.291+0000 7faef6431700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faef00b0890 0x7faef0150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.291+0000 7faef6431700 1 --2- 172.21.15.31:0/3423914310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faef006c630 0x7faef00aa880 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.291+0000 7faef6431700 1 -- 172.21.15.31:0/3423914310 >> 172.21.15.31:0/3423914310 conn(0x7faef006fe50 msgr2=0x7faef00cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.291+0000 7faef6431700 1 -- 172.21.15.31:0/3423914310 shutdown_connections 2023-10-09T06:31:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.291+0000 7faef6431700 1 -- 172.21.15.31:0/3423914310 wait complete. 2023-10-09T06:31:48.304 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:31:48.304 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:31:48.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.426+0000 7f66f5c64700 1 Processor -- start 2023-10-09T06:31:48.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.426+0000 7f66f5c64700 1 -- start start 2023-10-09T06:31:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.427+0000 7f66f5c64700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f0159e50 0x7f66f00b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.427+0000 7f66f5c64700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f00b0d60 con 0x7f66f00b3370 2023-10-09T06:31:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.427+0000 7f66f5c64700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f00d15b0 con 0x7f66f0068cb0 2023-10-09T06:31:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.427+0000 7f66f5c64700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f00d1890 con 0x7f66f0159e50 2023-10-09T06:31:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.427+0000 7f66eeffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f66f00b3370 0x7f66f00b11f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34404/0 (socket says 172.21.15.31:34404) 2023-10-09T06:31:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.427+0000 7f66eeffd700 1 -- 172.21.15.31:0/3765281789 learned_addr learned my addr 172.21.15.31:0/3765281789 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.427+0000 7f66ef7fe700 1 --2- 172.21.15.31:0/3765281789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f0159e50 0x7f66f00b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.428+0000 7f66ee7fc700 1 -- 172.21.15.31:0/3765281789 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651650522 0 0) 0x7f66f00b0d60 con 0x7f66f00b3370 2023-10-09T06:31:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.428+0000 7f66ee7fc700 1 -- 172.21.15.31:0/3765281789 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d8003570 con 0x7f66f00b3370 2023-10-09T06:31:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.428+0000 7f66ee7fc700 1 -- 172.21.15.31:0/3765281789 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210545103 0 0) 0x7f66f00d15b0 con 0x7f66f0068cb0 2023-10-09T06:31:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.428+0000 7f66ee7fc700 1 -- 172.21.15.31:0/3765281789 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f00b0d60 con 0x7f66f0068cb0 2023-10-09T06:31:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.428+0000 7f66ef7fe700 1 -- 172.21.15.31:0/3765281789 >> v1:172.21.15.158:6789/0 conn(0x7f66f0068cb0 legacy=0x7f66f00cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.428+0000 7f66ef7fe700 1 -- 172.21.15.31:0/3765281789 >> v1:172.21.15.31:6789/0 conn(0x7f66f00b3370 legacy=0x7f66f00b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.428+0000 7f66ef7fe700 1 -- 172.21.15.31:0/3765281789 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f00b09f0 con 0x7f66f0159e50 2023-10-09T06:31:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.428+0000 7f66ef7fe700 1 --2- 172.21.15.31:0/3765281789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f0159e50 0x7f66f00b2e30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009910 tx=0x7f66e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcd65fdcc909a25e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.428+0000 7f66ee7fc700 1 -- 172.21.15.31:0/3765281789 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e0011630 con 0x7f66f0159e50 2023-10-09T06:31:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.428+0000 7f66ee7fc700 1 -- 172.21.15.31:0/3765281789 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e0011790 con 0x7f66f0159e50 2023-10-09T06:31:48.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.428+0000 7f66ee7fc700 1 -- 172.21.15.31:0/3765281789 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e0011b30 con 0x7f66f0159e50 2023-10-09T06:31:48.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.429+0000 7f66f5c64700 1 -- 172.21.15.31:0/3765281789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f0159e50 msgr2=0x7f66f00b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.429+0000 7f66f5c64700 1 --2- 172.21.15.31:0/3765281789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f0159e50 0x7f66f00b2e30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009910 tx=0x7f66e00091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.429+0000 7f66f5c64700 1 -- 172.21.15.31:0/3765281789 shutdown_connections 2023-10-09T06:31:48.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.429+0000 7f66f5c64700 1 --2- 172.21.15.31:0/3765281789 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f0159e50 0x7f66f00b2e30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.429+0000 7f66f5c64700 1 -- 172.21.15.31:0/3765281789 >> 172.21.15.31:0/3765281789 conn(0x7f66f0068130 msgr2=0x7f66f00d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:48.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.429+0000 7f66f5c64700 1 -- 172.21.15.31:0/3765281789 shutdown_connections 2023-10-09T06:31:48.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.429+0000 7f66f5c64700 1 -- 172.21.15.31:0/3765281789 wait complete. 2023-10-09T06:31:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.430+0000 7f66f5c64700 1 Processor -- start 2023-10-09T06:31:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.430+0000 7f66f5c64700 1 -- start start 2023-10-09T06:31:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66f5c64700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66f0068cb0 0x7f66f00c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66f5c64700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66f00b3370 0x7f66f016b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66f5c64700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f0159e50 0x7f66f0169e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66f5c64700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f016b590 con 0x7f66f00b3370 2023-10-09T06:31:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66f5c64700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f00ca9c0 con 0x7f66f0068cb0 2023-10-09T06:31:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66f5c64700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f00c8f70 con 0x7f66f0159e50 2023-10-09T06:31:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66eeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66f00b3370 0x7f66f016b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66eeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66f00b3370 0x7f66f016b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51736/0 (socket says 172.21.15.31:51736) 2023-10-09T06:31:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66eeffd700 1 -- 172.21.15.31:0/2288401852 learned_addr learned my addr 172.21.15.31:0/2288401852 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66ef7fe700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66f0068cb0 0x7f66f00c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66effff700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f0159e50 0x7f66f0169e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66eeffd700 1 -- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f0159e50 msgr2=0x7f66f0169e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66eeffd700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f0159e50 0x7f66f0169e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66eeffd700 1 -- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66f0068cb0 msgr2=0x7f66f00c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66eeffd700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66f0068cb0 0x7f66f00c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66eeffd700 1 -- 172.21.15.31:0/2288401852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e0009420 con 0x7f66f00b3370 2023-10-09T06:31:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66ef7fe700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66f0068cb0 0x7f66f00c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66effff700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f0159e50 0x7f66f0169e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.431+0000 7f66eeffd700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66f00b3370 0x7f66f016b050 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c790 tx=0x7f66e4007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:48.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.432+0000 7f66d77fe700 1 -- 172.21.15.31:0/2288401852 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4005b30 con 0x7f66f00b3370 2023-10-09T06:31:48.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.432+0000 7f66d77fe700 1 -- 172.21.15.31:0/2288401852 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e4005c90 con 0x7f66f00b3370 2023-10-09T06:31:48.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.432+0000 7f66f5c64700 1 -- 172.21.15.31:0/2288401852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f00c8360 con 0x7f66f00b3370 2023-10-09T06:31:48.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.432+0000 7f66d77fe700 1 -- 172.21.15.31:0/2288401852 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4007300 con 0x7f66f00b3370 2023-10-09T06:31:48.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.432+0000 7f66f5c64700 1 -- 172.21.15.31:0/2288401852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f00c8920 con 0x7f66f00b3370 2023-10-09T06:31:48.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.433+0000 7f66f5c64700 1 -- 172.21.15.31:0/2288401852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f00c9120 con 0x7f66f00b3370 2023-10-09T06:31:48.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.433+0000 7f66d77fe700 1 -- 172.21.15.31:0/2288401852 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66e401b3b0 con 0x7f66f00b3370 2023-10-09T06:31:48.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.433+0000 7f66d77fe700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f66dc066f30 0x7f66dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.434+0000 7f66d77fe700 1 -- 172.21.15.31:0/2288401852 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f66e4083780 con 0x7f66f00b3370 2023-10-09T06:31:48.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.434+0000 7f66ef7fe700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f66dc066f30 0x7f66dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.434+0000 7f66ef7fe700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f66dc066f30 0x7f66dc0693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009860 tx=0x7f66e0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:48.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.438+0000 7f66d77fe700 1 -- 172.21.15.31:0/2288401852 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66f00c9120 con 0x7f66f00b3370 2023-10-09T06:31:48.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.632+0000 7f66f5c64700 1 -- 172.21.15.31:0/2288401852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f66f00c90e0 con 0x7f66f00b3370 2023-10-09T06:31:48.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.835+0000 7f66d77fe700 1 -- 172.21.15.31:0/2288401852 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v182) v1 ==== 138+0+0 (secure 0 0 0) 0x7f66e40170b0 con 0x7f66f00b3370 2023-10-09T06:31:48.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.838+0000 7f66f5c64700 1 -- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f66dc066f30 msgr2=0x7f66dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.838+0000 7f66f5c64700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f66dc066f30 0x7f66dc0693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009860 tx=0x7f66e0017000 comp rx=0 tx=0).stop 2023-10-09T06:31:48.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.838+0000 7f66f5c64700 1 -- 172.21.15.31:0/2288401852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66f00b3370 msgr2=0x7f66f016b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.838+0000 7f66f5c64700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66f00b3370 0x7f66f016b050 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c790 tx=0x7f66e4007e40 comp rx=0 tx=0).stop 2023-10-09T06:31:48.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.838+0000 7f66f5c64700 1 -- 172.21.15.31:0/2288401852 shutdown_connections 2023-10-09T06:31:48.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.838+0000 7f66f5c64700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f66dc066f30 0x7f66dc0693e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.838+0000 7f66f5c64700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f66f0159e50 0x7f66f0169e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.838+0000 7f66f5c64700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66f0068cb0 0x7f66f00c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.838+0000 7f66f5c64700 1 --2- 172.21.15.31:0/2288401852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66f00b3370 0x7f66f016b050 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.838+0000 7f66f5c64700 1 -- 172.21.15.31:0/2288401852 >> 172.21.15.31:0/2288401852 conn(0x7f66f0068130 msgr2=0x7f66f00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.838+0000 7f66f5c64700 1 -- 172.21.15.31:0/2288401852 shutdown_connections 2023-10-09T06:31:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.838+0000 7f66f5c64700 1 -- 172.21.15.31:0/2288401852 wait complete. 2023-10-09T06:31:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-10-09T06:31:48.851 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:31:48.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.977+0000 7f98e8e64700 1 Processor -- start 2023-10-09T06:31:48.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.977+0000 7f98e8e64700 1 -- start start 2023-10-09T06:31:48.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e8e64700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b4860 0x7f98e40b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e8e64700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e40b14f0 con 0x7f98e40b3570 2023-10-09T06:31:48.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e8e64700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e40b17d0 con 0x7f98e40b4c30 2023-10-09T06:31:48.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e8e64700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e40b1ab0 con 0x7f98e40b4860 2023-10-09T06:31:48.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e2d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f98e40b3570 0x7f98e40cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34420/0 (socket says 172.21.15.31:34420) 2023-10-09T06:31:48.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e2d9d700 1 -- 172.21.15.31:0/3351724937 learned_addr learned my addr 172.21.15.31:0/3351724937 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:48.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e259c700 1 --2- 172.21.15.31:0/3351724937 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b4860 0x7f98e40b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e159a700 1 -- 172.21.15.31:0/3351724937 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938320939 0 0) 0x7f98e40b14f0 con 0x7f98e40b3570 2023-10-09T06:31:48.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e159a700 1 -- 172.21.15.31:0/3351724937 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98cc003570 con 0x7f98e40b3570 2023-10-09T06:31:48.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e159a700 1 -- 172.21.15.31:0/3351724937 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812349611 0 0) 0x7f98e40b17d0 con 0x7f98e40b4c30 2023-10-09T06:31:48.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e159a700 1 -- 172.21.15.31:0/3351724937 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98e40b14f0 con 0x7f98e40b4c30 2023-10-09T06:31:48.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e159a700 1 -- 172.21.15.31:0/3351724937 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3659794256 0 0) 0x7f98cc003570 con 0x7f98e40b3570 2023-10-09T06:31:48.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e259c700 1 -- 172.21.15.31:0/3351724937 >> v1:172.21.15.158:6789/0 conn(0x7f98e40b4c30 legacy=0x7f98e4159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e259c700 1 -- 172.21.15.31:0/3351724937 >> v1:172.21.15.31:6789/0 conn(0x7f98e40b3570 legacy=0x7f98e40cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.978+0000 7f98e259c700 1 -- 172.21.15.31:0/3351724937 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e40b1d90 con 0x7f98e40b4860 2023-10-09T06:31:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.979+0000 7f98e259c700 1 --2- 172.21.15.31:0/3351724937 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b4860 0x7f98e40b6700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009900 tx=0x7f98d4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ba7cfdd9de170aa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.979+0000 7f98e159a700 1 -- 172.21.15.31:0/3351724937 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc0017f0 con 0x7f98e40b4860 2023-10-09T06:31:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.979+0000 7f98e159a700 1 -- 172.21.15.31:0/3351724937 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d4011420 con 0x7f98e40b4860 2023-10-09T06:31:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.979+0000 7f98e159a700 1 -- 172.21.15.31:0/3351724937 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40117a0 con 0x7f98e40b4860 2023-10-09T06:31:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.979+0000 7f98e8e64700 1 -- 172.21.15.31:0/3351724937 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b4860 msgr2=0x7f98e40b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.979+0000 7f98e8e64700 1 --2- 172.21.15.31:0/3351724937 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b4860 0x7f98e40b6700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009900 tx=0x7f98d4009120 comp rx=0 tx=0).stop 2023-10-09T06:31:48.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.979+0000 7f98e8e64700 1 -- 172.21.15.31:0/3351724937 shutdown_connections 2023-10-09T06:31:48.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.979+0000 7f98e8e64700 1 --2- 172.21.15.31:0/3351724937 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b4860 0x7f98e40b6700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.979+0000 7f98e8e64700 1 -- 172.21.15.31:0/3351724937 >> 172.21.15.31:0/3351724937 conn(0x7f98e409a0f0 msgr2=0x7f98e4067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:48.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.979+0000 7f98e8e64700 1 -- 172.21.15.31:0/3351724937 shutdown_connections 2023-10-09T06:31:48.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.979+0000 7f98e8e64700 1 -- 172.21.15.31:0/3351724937 wait complete. 2023-10-09T06:31:48.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.980+0000 7f98e8e64700 1 Processor -- start 2023-10-09T06:31:48.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.981+0000 7f98e8e64700 1 -- start start 2023-10-09T06:31:48.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.981+0000 7f98e8e64700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b3570 0x7f98e4158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.981+0000 7f98e8e64700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e40b4860 0x7f98e40ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.981+0000 7f98e8e64700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98e40b4c30 0x7f98e409dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.981+0000 7f98e8e64700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e409d840 con 0x7f98e40b4860 2023-10-09T06:31:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.981+0000 7f98e8e64700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e409cc30 con 0x7f98e40b4c30 2023-10-09T06:31:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.981+0000 7f98e8e64700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e409cf10 con 0x7f98e40b3570 2023-10-09T06:31:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.981+0000 7f98e1d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e40b4860 0x7f98e40ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.981+0000 7f98e259c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b3570 0x7f98e4158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.981+0000 7f98e1d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e40b4860 0x7f98e40ad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51742/0 (socket says 172.21.15.31:51742) 2023-10-09T06:31:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.981+0000 7f98e1d9b700 1 -- 172.21.15.31:0/853368165 learned_addr learned my addr 172.21.15.31:0/853368165 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.982+0000 7f98e2d9d700 1 --2- 172.21.15.31:0/853368165 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98e40b4c30 0x7f98e409dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.982+0000 7f98e1d9b700 1 -- 172.21.15.31:0/853368165 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b3570 msgr2=0x7f98e4158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.982+0000 7f98e1d9b700 1 --2- 172.21.15.31:0/853368165 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b3570 0x7f98e4158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.982+0000 7f98e1d9b700 1 -- 172.21.15.31:0/853368165 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98e40b4c30 msgr2=0x7f98e409dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:48.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.982+0000 7f98e1d9b700 1 --2- 172.21.15.31:0/853368165 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98e40b4c30 0x7f98e409dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:48.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.982+0000 7f98e1d9b700 1 -- 172.21.15.31:0/853368165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d40093c0 con 0x7f98e40b4860 2023-10-09T06:31:48.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.982+0000 7f98e1d9b700 1 --2- 172.21.15.31:0/853368165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e40b4860 0x7f98e40ad2a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f98d800c580 tx=0x7f98d8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:48.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.982+0000 7f98d27fc700 1 -- 172.21.15.31:0/853368165 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8010510 con 0x7f98e40b4860 2023-10-09T06:31:48.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.982+0000 7f98d27fc700 1 -- 172.21.15.31:0/853368165 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d8010670 con 0x7f98e40b4860 2023-10-09T06:31:48.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.982+0000 7f98e8e64700 1 -- 172.21.15.31:0/853368165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e409d1f0 con 0x7f98e40b4860 2023-10-09T06:31:48.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.982+0000 7f98d27fc700 1 -- 172.21.15.31:0/853368165 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8010a30 con 0x7f98e40b4860 2023-10-09T06:31:48.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.982+0000 7f98e8e64700 1 -- 172.21.15.31:0/853368165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e4158d80 con 0x7f98e40b4860 2023-10-09T06:31:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.983+0000 7f98e8e64700 1 -- 172.21.15.31:0/853368165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e409d9f0 con 0x7f98e40b4860 2023-10-09T06:31:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.983+0000 7f98d27fc700 1 -- 172.21.15.31:0/853368165 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98d801b400 con 0x7f98e40b4860 2023-10-09T06:31:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.984+0000 7f98d27fc700 1 --2- 172.21.15.31:0/853368165 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98c4066f30 0x7f98c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.984+0000 7f98d27fc700 1 -- 172.21.15.31:0/853368165 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f98d8083e40 con 0x7f98e40b4860 2023-10-09T06:31:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.984+0000 7f98e259c700 1 --2- 172.21.15.31:0/853368165 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98c4066f30 0x7f98c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.985+0000 7f98e259c700 1 --2- 172.21.15.31:0/853368165 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98c4066f30 0x7f98c40693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009850 tx=0x7f98d4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:48.988+0000 7f98d27fc700 1 -- 172.21.15.31:0/853368165 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98e409d9f0 con 0x7f98e40b4860 2023-10-09T06:31:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.181+0000 7f98e8e64700 1 -- 172.21.15.31:0/853368165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f98e404c3c0 con 0x7f98e40b4860 2023-10-09T06:31:49.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.843+0000 7f98d27fc700 1 -- 172.21.15.31:0/853368165 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v183) v1 ==== 170+0+0 (secure 0 0 0) 0x7f98d8051290 con 0x7f98e40b4860 2023-10-09T06:31:49.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.850+0000 7f98e8e64700 1 -- 172.21.15.31:0/853368165 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98c4066f30 msgr2=0x7f98c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:49.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.850+0000 7f98e8e64700 1 --2- 172.21.15.31:0/853368165 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98c4066f30 0x7f98c40693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009850 tx=0x7f98d4016000 comp rx=0 tx=0).stop 2023-10-09T06:31:49.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.850+0000 7f98e8e64700 1 -- 172.21.15.31:0/853368165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e40b4860 msgr2=0x7f98e40ad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:49.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.850+0000 7f98e8e64700 1 --2- 172.21.15.31:0/853368165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e40b4860 0x7f98e40ad2a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f98d800c580 tx=0x7f98d8007e10 comp rx=0 tx=0).stop 2023-10-09T06:31:49.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.851+0000 7f98e8e64700 1 -- 172.21.15.31:0/853368165 shutdown_connections 2023-10-09T06:31:49.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.851+0000 7f98e8e64700 1 --2- 172.21.15.31:0/853368165 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f98c4066f30 0x7f98c40693e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:49.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.851+0000 7f98e8e64700 1 --2- 172.21.15.31:0/853368165 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98e40b3570 0x7f98e4158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:49.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.851+0000 7f98e8e64700 1 --2- 172.21.15.31:0/853368165 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98e40b4c30 0x7f98e409dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:49.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.851+0000 7f98e8e64700 1 --2- 172.21.15.31:0/853368165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98e40b4860 0x7f98e40ad2a0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:49.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.851+0000 7f98e8e64700 1 -- 172.21.15.31:0/853368165 >> 172.21.15.31:0/853368165 conn(0x7f98e409a0f0 msgr2=0x7f98e415afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:49.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.851+0000 7f98e8e64700 1 -- 172.21.15.31:0/853368165 shutdown_connections 2023-10-09T06:31:49.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.851+0000 7f98e8e64700 1 -- 172.21.15.31:0/853368165 wait complete. 2023-10-09T06:31:49.853 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-10-09T06:31:49.866 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:31:49.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.992+0000 7f8dc660b700 1 Processor -- start 2023-10-09T06:31:49.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.992+0000 7f8dc660b700 1 -- start start 2023-10-09T06:31:49.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dc660b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8dc01435a0 0x7f8dc0070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:49.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dc660b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc006a550 0x7f8dc0070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:49.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dc660b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc015e380 con 0x7f8dc0143970 2023-10-09T06:31:49.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dc660b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc006fb70 con 0x7f8dc01435a0 2023-10-09T06:31:49.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dc660b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc006ab70 con 0x7f8dc006a550 2023-10-09T06:31:49.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dbf7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8dc0143970 0x7f8dc0069e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37852/0 (socket says 172.21.15.31:37852) 2023-10-09T06:31:49.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dbf7fe700 1 -- 172.21.15.31:0/1899614539 learned_addr learned my addr 172.21.15.31:0/1899614539 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:49.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dbffff700 1 --2- 172.21.15.31:0/1899614539 >> v2:172.21.15.158:3300/0 conn(0x7f8dc01435a0 0x7f8dc0070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:49.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580890319 0 0) 0x7f8dc015e380 con 0x7f8dc0143970 2023-10-09T06:31:49.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dc4ba8700 1 --2- 172.21.15.31:0/1899614539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc006a550 0x7f8dc0070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:49.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dac003570 con 0x7f8dc0143970 2023-10-09T06:31:49.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 172120019 0 0) 0x7f8dac003570 con 0x7f8dc0143970 2023-10-09T06:31:49.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc006a550 msgr2=0x7f8dc0070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:49.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dbeffd700 1 --2- 172.21.15.31:0/1899614539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc006a550 0x7f8dc0070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:49.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 >> v2:172.21.15.158:3300/0 conn(0x7f8dc01435a0 msgr2=0x7f8dc0070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:49.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dbeffd700 1 --2- 172.21.15.31:0/1899614539 >> v2:172.21.15.158:3300/0 conn(0x7f8dc01435a0 0x7f8dc0070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:49.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc015da50 con 0x7f8dc0143970 2023-10-09T06:31:49.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f8da8001470 con 0x7f8dc0143970 2023-10-09T06:31:49.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.993+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 >> v1:172.21.15.31:6789/0 conn(0x7f8dc0143970 legacy=0x7f8dc0069e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:49.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbeffd700 1 --2- 172.21.15.31:0/1899614539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dac003a60 0x7f8dac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:49.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbeffd700 1 --2- 172.21.15.31:0/1899614539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dac004810 0x7f8dac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:49.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbeffd700 1 --2- 172.21.15.31:0/1899614539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc006a550 0x7f8dac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:49.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc006fb70 con 0x7f8dac003a60 2023-10-09T06:31:49.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc006ab70 con 0x7f8dac004810 2023-10-09T06:31:49.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac00ba60 con 0x7f8dc006a550 2023-10-09T06:31:49.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbffff700 1 --2- 172.21.15.31:0/1899614539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dac003a60 0x7f8dac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:49.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbf7fe700 1 --2- 172.21.15.31:0/1899614539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dac004810 0x7f8dac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:50.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dc4ba8700 1 --2- 172.21.15.31:0/1899614539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc006a550 0x7f8dac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:50.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbffff700 1 -- 172.21.15.31:0/1899614539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc006a550 msgr2=0x7f8dac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:50.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbffff700 1 --2- 172.21.15.31:0/1899614539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc006a550 0x7f8dac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:50.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbffff700 1 -- 172.21.15.31:0/1899614539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dac004810 msgr2=0x7f8dac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:50.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbffff700 1 --2- 172.21.15.31:0/1899614539 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dac004810 0x7f8dac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:50.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbffff700 1 -- 172.21.15.31:0/1899614539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac003570 con 0x7f8dac003a60 2023-10-09T06:31:50.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dc4ba8700 1 --2- 172.21.15.31:0/1899614539 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc006a550 0x7f8dac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:50.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbffff700 1 --2- 172.21.15.31:0/1899614539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dac003a60 0x7f8dac003e70 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009c30 tx=0x7f8db00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757dc5e2d2a01d61 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:50.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000e710 con 0x7f8dac003a60 2023-10-09T06:31:50.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db000e870 con 0x7f8dac003a60 2023-10-09T06:31:50.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.994+0000 7f8dbeffd700 1 -- 172.21.15.31:0/1899614539 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000ec30 con 0x7f8dac003a60 2023-10-09T06:31:50.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.995+0000 7f8dc660b700 1 -- 172.21.15.31:0/1899614539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dac003a60 msgr2=0x7f8dac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:50.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.995+0000 7f8dc660b700 1 --2- 172.21.15.31:0/1899614539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dac003a60 0x7f8dac003e70 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009c30 tx=0x7f8db00091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:50.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.995+0000 7f8dc4ba8700 1 -- 172.21.15.31:0/1899614539 reap_dead start 2023-10-09T06:31:50.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.995+0000 7f8dc660b700 1 -- 172.21.15.31:0/1899614539 shutdown_connections 2023-10-09T06:31:50.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.995+0000 7f8dc660b700 1 -- 172.21.15.31:0/1899614539 >> 172.21.15.31:0/1899614539 conn(0x7f8dc00ca520 msgr2=0x7f8dc00ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:50.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.995+0000 7f8dc660b700 1 -- 172.21.15.31:0/1899614539 shutdown_connections 2023-10-09T06:31:50.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.995+0000 7f8dc660b700 1 -- 172.21.15.31:0/1899614539 wait complete. 2023-10-09T06:31:50.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.996+0000 7f8dc660b700 1 Processor -- start 2023-10-09T06:31:50.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.996+0000 7f8dc660b700 1 -- start start 2023-10-09T06:31:50.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc660b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dac003a60 0x7f8dc00aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:50.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc660b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc00b31d0 0x7f8dc0169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:50.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc660b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc016a0f0 0x7f8dc00c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:50.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc660b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc0141d10 con 0x7f8dc016a0f0 2023-10-09T06:31:50.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc660b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc0141100 con 0x7f8dac003a60 2023-10-09T06:31:50.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc660b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc01413e0 con 0x7f8dc00b31d0 2023-10-09T06:31:50.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc4ba8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc016a0f0 0x7f8dc00c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc4ba8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc016a0f0 0x7f8dc00c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42636/0 (socket says 172.21.15.31:42636) 2023-10-09T06:31:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc4ba8700 1 -- 172.21.15.31:0/496951966 learned_addr learned my addr 172.21.15.31:0/496951966 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dbf7fe700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc00b31d0 0x7f8dc0169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dbffff700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dac003a60 0x7f8dc00aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc4ba8700 1 -- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc00b31d0 msgr2=0x7f8dc0169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc4ba8700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc00b31d0 0x7f8dc0169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc4ba8700 1 -- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dac003a60 msgr2=0x7f8dc00aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc4ba8700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dac003a60 0x7f8dc00aaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:50.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc4ba8700 1 -- 172.21.15.31:0/496951966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc01416c0 con 0x7f8dc016a0f0 2023-10-09T06:31:50.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dbffff700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dac003a60 0x7f8dc00aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:50.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dbf7fe700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc00b31d0 0x7f8dc0169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:50.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.997+0000 7f8dc4ba8700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc016a0f0 0x7f8dc00c9230 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00acf30 tx=0x7f8db800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:50.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.998+0000 7f8db7fff700 1 -- 172.21.15.31:0/496951966 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db800e050 con 0x7f8dc016a0f0 2023-10-09T06:31:50.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.998+0000 7f8db7fff700 1 -- 172.21.15.31:0/496951966 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db800f040 con 0x7f8dc016a0f0 2023-10-09T06:31:50.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.998+0000 7f8dc660b700 1 -- 172.21.15.31:0/496951966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc01419a0 con 0x7f8dc016a0f0 2023-10-09T06:31:50.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.998+0000 7f8db7fff700 1 -- 172.21.15.31:0/496951966 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db8010ec0 con 0x7f8dc016a0f0 2023-10-09T06:31:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.998+0000 7f8dc660b700 1 -- 172.21.15.31:0/496951966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc00b3640 con 0x7f8dc016a0f0 2023-10-09T06:31:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.999+0000 7f8dc660b700 1 -- 172.21.15.31:0/496951966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc0141e50 con 0x7f8dc016a0f0 2023-10-09T06:31:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:49.999+0000 7f8db7fff700 1 -- 172.21.15.31:0/496951966 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8db8003020 con 0x7f8dc016a0f0 2023-10-09T06:31:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.000+0000 7f8db7fff700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8da0066f30 0x7f8da00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.000+0000 7f8db7fff700 1 -- 172.21.15.31:0/496951966 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f8db80848a0 con 0x7f8dc016a0f0 2023-10-09T06:31:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.000+0000 7f8dbffff700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8da0066f30 0x7f8da00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.001+0000 7f8dbffff700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8da0066f30 0x7f8da00693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8db00091e0 tx=0x7f8db001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.005+0000 7f8db7fff700 1 -- 172.21.15.31:0/496951966 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8dc0141e50 con 0x7f8dc016a0f0 2023-10-09T06:31:50.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.240+0000 7f8dc660b700 1 -- 172.21.15.31:0/496951966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8dc0141e50 con 0x7f8dc016a0f0 2023-10-09T06:31:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.872+0000 7f8db7fff700 1 -- 172.21.15.31:0/496951966 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v86) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8dc0141e50 con 0x7f8dc016a0f0 2023-10-09T06:31:50.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.878+0000 7f8dc660b700 1 -- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8da0066f30 msgr2=0x7f8da00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:50.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.878+0000 7f8dc660b700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8da0066f30 0x7f8da00693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8db00091e0 tx=0x7f8db001a000 comp rx=0 tx=0).stop 2023-10-09T06:31:50.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.878+0000 7f8dc660b700 1 -- 172.21.15.31:0/496951966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc016a0f0 msgr2=0x7f8dc00c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:50.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.878+0000 7f8dc660b700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc016a0f0 0x7f8dc00c9230 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00acf30 tx=0x7f8db800b040 comp rx=0 tx=0).stop 2023-10-09T06:31:50.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.878+0000 7f8dc660b700 1 -- 172.21.15.31:0/496951966 shutdown_connections 2023-10-09T06:31:50.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.878+0000 7f8dc660b700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8da0066f30 0x7f8da00693e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:50.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.878+0000 7f8dc660b700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc016a0f0 0x7f8dc00c9230 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:50.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.878+0000 7f8dc660b700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8dac003a60 0x7f8dc00aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:50.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.878+0000 7f8dc660b700 1 --2- 172.21.15.31:0/496951966 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8dc00b31d0 0x7f8dc0169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:50.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.878+0000 7f8dc660b700 1 -- 172.21.15.31:0/496951966 >> 172.21.15.31:0/496951966 conn(0x7f8dc00ca520 msgr2=0x7f8dc00c2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:50.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.878+0000 7f8dc660b700 1 -- 172.21.15.31:0/496951966 shutdown_connections 2023-10-09T06:31:50.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:50.879+0000 7f8dc660b700 1 -- 172.21.15.31:0/496951966 wait complete. 2023-10-09T06:31:50.880 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 22 and data pool 23 2023-10-09T06:31:50.893 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:31:51.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.014+0000 7f2c30c38700 1 Processor -- start 2023-10-09T06:31:51.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.014+0000 7f2c30c38700 1 -- start start 2023-10-09T06:31:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.015+0000 7f2c30c38700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c2c15a620 0x7f2c2c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.015+0000 7f2c30c38700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2c2c15d580 0x7f2c2c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.015+0000 7f2c30c38700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2c15cbb0 con 0x7f2c2c157870 2023-10-09T06:31:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.015+0000 7f2c30c38700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2c15bdb0 con 0x7f2c2c15d580 2023-10-09T06:31:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.015+0000 7f2c30c38700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c15bfa0 con 0x7f2c2c15a620 2023-10-09T06:31:51.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.016+0000 7f2c29d9b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c2c15a620 0x7f2c2c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.016+0000 7f2c2ad9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2c2c15d580 0x7f2c2c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.016+0000 7f2c2a59c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f2c2c157870 0x7f2c2c15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:44436/0 (socket says 172.21.15.31:44436) 2023-10-09T06:31:51.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.016+0000 7f2c2a59c700 1 -- 172.21.15.31:0/2144097890 learned_addr learned my addr 172.21.15.31:0/2144097890 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:51.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.016+0000 7f2c2959a700 1 -- 172.21.15.31:0/2144097890 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116520641 0 0) 0x7f2c2c15cbb0 con 0x7f2c2c157870 2023-10-09T06:31:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.016+0000 7f2c29d9b700 1 -- 172.21.15.31:0/2144097890 >> v2:172.21.15.158:3300/0 conn(0x7f2c2c15d580 msgr2=0x7f2c2c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.016+0000 7f2c29d9b700 1 --2- 172.21.15.31:0/2144097890 >> v2:172.21.15.158:3300/0 conn(0x7f2c2c15d580 0x7f2c2c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.016+0000 7f2c29d9b700 1 -- 172.21.15.31:0/2144097890 >> v1:172.21.15.158:6789/0 conn(0x7f2c2c157870 legacy=0x7f2c2c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.016+0000 7f2c29d9b700 1 -- 172.21.15.31:0/2144097890 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c15c280 con 0x7f2c2c15a620 2023-10-09T06:31:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.016+0000 7f2c29d9b700 1 --2- 172.21.15.31:0/2144097890 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c2c15a620 0x7f2c2c15d040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2c200098e0 tx=0x7f2c200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf7a9fd899411154 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.016+0000 7f2c2959a700 1 -- 172.21.15.31:0/2144097890 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000b640 con 0x7f2c2c15a620 2023-10-09T06:31:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.016+0000 7f2c2959a700 1 -- 172.21.15.31:0/2144097890 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2000b7a0 con 0x7f2c2c15a620 2023-10-09T06:31:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.016+0000 7f2c2959a700 1 -- 172.21.15.31:0/2144097890 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000bb40 con 0x7f2c2c15a620 2023-10-09T06:31:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.017+0000 7f2c30c38700 1 -- 172.21.15.31:0/2144097890 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c2c15a620 msgr2=0x7f2c2c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.017+0000 7f2c30c38700 1 --2- 172.21.15.31:0/2144097890 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c2c15a620 0x7f2c2c15d040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2c200098e0 tx=0x7f2c200091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.017+0000 7f2c30c38700 1 -- 172.21.15.31:0/2144097890 shutdown_connections 2023-10-09T06:31:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.017+0000 7f2c30c38700 1 --2- 172.21.15.31:0/2144097890 >> v2:172.21.15.158:3300/0 conn(0x7f2c2c15d580 0x7f2c2c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.017+0000 7f2c30c38700 1 --2- 172.21.15.31:0/2144097890 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c2c15a620 0x7f2c2c15d040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.017+0000 7f2c30c38700 1 -- 172.21.15.31:0/2144097890 >> 172.21.15.31:0/2144097890 conn(0x7f2c2c068ce0 msgr2=0x7f2c2c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.017+0000 7f2c30c38700 1 -- 172.21.15.31:0/2144097890 shutdown_connections 2023-10-09T06:31:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.017+0000 7f2c30c38700 1 -- 172.21.15.31:0/2144097890 wait complete. 2023-10-09T06:31:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.018+0000 7f2c30c38700 1 Processor -- start 2023-10-09T06:31:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.018+0000 7f2c30c38700 1 -- start start 2023-10-09T06:31:51.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c30c38700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c2c157870 0x7f2c2c0b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c30c38700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c2c15a620 0x7f2c2c154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c30c38700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2c2c15d580 0x7f2c2c14bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c30c38700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c1554f0 con 0x7f2c2c157870 2023-10-09T06:31:51.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c30c38700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c16b170 con 0x7f2c2c15d580 2023-10-09T06:31:51.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c30c38700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c16a880 con 0x7f2c2c15a620 2023-10-09T06:31:51.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c2a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c2c157870 0x7f2c2c0b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c2a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c2c157870 0x7f2c2c0b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42652/0 (socket says 172.21.15.31:42652) 2023-10-09T06:31:51.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c2a59c700 1 -- 172.21.15.31:0/295965696 learned_addr learned my addr 172.21.15.31:0/295965696 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:51.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c2ad9d700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2c2c15d580 0x7f2c2c14bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c29d9b700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c2c15a620 0x7f2c2c154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c2a59c700 1 -- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c2c15a620 msgr2=0x7f2c2c154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c2a59c700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c2c15a620 0x7f2c2c154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c2a59c700 1 -- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2c2c15d580 msgr2=0x7f2c2c14bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c2a59c700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2c2c15d580 0x7f2c2c14bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c2a59c700 1 -- 172.21.15.31:0/295965696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20009420 con 0x7f2c2c157870 2023-10-09T06:31:51.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.019+0000 7f2c2a59c700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c2c157870 0x7f2c2c0b29e0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00c5b0 tx=0x7f2c1c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:51.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.020+0000 7f2c1a7fc700 1 -- 172.21.15.31:0/295965696 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c005b30 con 0x7f2c2c157870 2023-10-09T06:31:51.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.020+0000 7f2c1a7fc700 1 -- 172.21.15.31:0/295965696 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c005c90 con 0x7f2c2c157870 2023-10-09T06:31:51.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.020+0000 7f2c30c38700 1 -- 172.21.15.31:0/295965696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c16ab20 con 0x7f2c2c157870 2023-10-09T06:31:51.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.020+0000 7f2c1a7fc700 1 -- 172.21.15.31:0/295965696 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c007300 con 0x7f2c2c157870 2023-10-09T06:31:51.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.020+0000 7f2c30c38700 1 -- 172.21.15.31:0/295965696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2c155720 con 0x7f2c2c157870 2023-10-09T06:31:51.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.021+0000 7f2c30c38700 1 -- 172.21.15.31:0/295965696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2c04c3c0 con 0x7f2c2c157870 2023-10-09T06:31:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.021+0000 7f2c1a7fc700 1 -- 172.21.15.31:0/295965696 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c1c01b3b0 con 0x7f2c2c157870 2023-10-09T06:31:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.021+0000 7f2c1a7fc700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2c0c066f30 0x7f2c0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.021+0000 7f2c1a7fc700 1 -- 172.21.15.31:0/295965696 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2c1c083960 con 0x7f2c2c157870 2023-10-09T06:31:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.022+0000 7f2c29d9b700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2c0c066f30 0x7f2c0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.022+0000 7f2c29d9b700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2c0c066f30 0x7f2c0c0693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c15aa20 tx=0x7f2c20017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.026+0000 7f2c1a7fc700 1 -- 172.21.15.31:0/295965696 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c1c050bd0 con 0x7f2c2c157870 2023-10-09T06:31:51.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.220+0000 7f2c30c38700 1 -- 172.21.15.31:0/295965696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c2c15c560 con 0x7f2c2c157870 2023-10-09T06:31:51.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.221+0000 7f2c1a7fc700 1 -- 172.21.15.31:0/295965696 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f2c1c017090 con 0x7f2c2c157870 2023-10-09T06:31:51.221 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:51.221 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":184,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:31:50.242150+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:31:48.664093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T06:31:49.212701+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:31:51.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.222+0000 7f2c30c38700 1 -- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2c0c066f30 msgr2=0x7f2c0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.222+0000 7f2c30c38700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2c0c066f30 0x7f2c0c0693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c15aa20 tx=0x7f2c20017000 comp rx=0 tx=0).stop 2023-10-09T06:31:51.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.222+0000 7f2c30c38700 1 -- 172.21.15.31:0/295965696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c2c157870 msgr2=0x7f2c2c0b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.222+0000 7f2c30c38700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c2c157870 0x7f2c2c0b29e0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00c5b0 tx=0x7f2c1c001070 comp rx=0 tx=0).stop 2023-10-09T06:31:51.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.223+0000 7f2c30c38700 1 -- 172.21.15.31:0/295965696 shutdown_connections 2023-10-09T06:31:51.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.223+0000 7f2c30c38700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2c0c066f30 0x7f2c0c0693e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.223+0000 7f2c30c38700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2c2c15d580 0x7f2c2c14bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.223+0000 7f2c30c38700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c2c157870 0x7f2c2c0b29e0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.223+0000 7f2c30c38700 1 --2- 172.21.15.31:0/295965696 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2c2c15a620 0x7f2c2c154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.223+0000 7f2c30c38700 1 -- 172.21.15.31:0/295965696 >> 172.21.15.31:0/295965696 conn(0x7f2c2c068ce0 msgr2=0x7f2c2c14c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:51.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.223+0000 7f2c30c38700 1 -- 172.21.15.31:0/295965696 shutdown_connections 2023-10-09T06:31:51.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.223+0000 7f2c30c38700 1 -- 172.21.15.31:0/295965696 wait complete. 2023-10-09T06:31:51.236 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:31:51.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.354+0000 7f2e09258700 1 Processor -- start 2023-10-09T06:31:51.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.354+0000 7f2e09258700 1 -- start start 2023-10-09T06:31:51.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.355+0000 7f2e09258700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e04159cf0 0x7f2e0415e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.355+0000 7f2e09258700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e040cca20 con 0x7f2e040cf1c0 2023-10-09T06:31:51.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.355+0000 7f2e09258700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0415ea40 con 0x7f2e0415a0c0 2023-10-09T06:31:51.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.355+0000 7f2e09258700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04067660 con 0x7f2e04159cf0 2023-10-09T06:31:51.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.355+0000 7f2e0359e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2e040cf1c0 0x7f2e04068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37866/0 (socket says 172.21.15.31:37866) 2023-10-09T06:31:51.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.355+0000 7f2e0359e700 1 -- 172.21.15.31:0/3363988238 learned_addr learned my addr 172.21.15.31:0/3363988238 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:51.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.355+0000 7f2e02d9d700 1 --2- 172.21.15.31:0/3363988238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e04159cf0 0x7f2e0415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.355+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765958365 0 0) 0x7f2e040cca20 con 0x7f2e040cf1c0 2023-10-09T06:31:51.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.355+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2df0003570 con 0x7f2e040cf1c0 2023-10-09T06:31:51.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2245686099 0 0) 0x7f2df0003570 con 0x7f2e040cf1c0 2023-10-09T06:31:51.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e04159cf0 msgr2=0x7f2e0415e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:51.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e01d9b700 1 --2- 172.21.15.31:0/3363988238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e04159cf0 0x7f2e0415e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 >> v1:172.21.15.158:6789/0 conn(0x7f2e0415a0c0 legacy=0x7f2e040ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e04067f00 con 0x7f2e040cf1c0 2023-10-09T06:31:51.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f2df4001470 con 0x7f2e040cf1c0 2023-10-09T06:31:51.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 >> v1:172.21.15.31:6789/0 conn(0x7f2e040cf1c0 legacy=0x7f2e04068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e01d9b700 1 --2- 172.21.15.31:0/3363988238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2df0003a90 0x7f2df0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e01d9b700 1 --2- 172.21.15.31:0/3363988238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e04159cf0 0x7f2df0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e01d9b700 1 --2- 172.21.15.31:0/3363988238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df0004d50 0x7f2df00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04067660 con 0x7f2df0004d50 2023-10-09T06:31:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df000bb40 con 0x7f2df0003a90 2023-10-09T06:31:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df000bd00 con 0x7f2e04159cf0 2023-10-09T06:31:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e0359e700 1 --2- 172.21.15.31:0/3363988238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df0004d50 0x7f2df00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e02d9d700 1 --2- 172.21.15.31:0/3363988238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2df0003a90 0x7f2df0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e0259c700 1 --2- 172.21.15.31:0/3363988238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e04159cf0 0x7f2df0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e0359e700 1 -- 172.21.15.31:0/3363988238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e04159cf0 msgr2=0x7f2df0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:51.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e0359e700 1 --2- 172.21.15.31:0/3363988238 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e04159cf0 0x7f2df0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e0359e700 1 -- 172.21.15.31:0/3363988238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2df0003a90 msgr2=0x7f2df0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:51.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e0359e700 1 --2- 172.21.15.31:0/3363988238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2df0003a90 0x7f2df0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e0359e700 1 -- 172.21.15.31:0/3363988238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df0003570 con 0x7f2df0004d50 2023-10-09T06:31:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.356+0000 7f2e0359e700 1 --2- 172.21.15.31:0/3363988238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df0004d50 0x7f2df00051c0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f2df400c2d0 tx=0x7f2df4001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae96e3aa2e208d6a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.357+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df400cba0 con 0x7f2df0004d50 2023-10-09T06:31:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.357+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df400cd40 con 0x7f2df0004d50 2023-10-09T06:31:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.357+0000 7f2e01d9b700 1 -- 172.21.15.31:0/3363988238 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4005b70 con 0x7f2df0004d50 2023-10-09T06:31:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.357+0000 7f2e09258700 1 -- 172.21.15.31:0/3363988238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df0004d50 msgr2=0x7f2df00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.357+0000 7f2e09258700 1 --2- 172.21.15.31:0/3363988238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df0004d50 0x7f2df00051c0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f2df400c2d0 tx=0x7f2df4001da0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.357+0000 7f2e0359e700 1 -- 172.21.15.31:0/3363988238 reap_dead start 2023-10-09T06:31:51.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.357+0000 7f2e09258700 1 -- 172.21.15.31:0/3363988238 shutdown_connections 2023-10-09T06:31:51.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.357+0000 7f2e09258700 1 -- 172.21.15.31:0/3363988238 >> 172.21.15.31:0/3363988238 conn(0x7f2e0406c6e0 msgr2=0x7f2e04069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:51.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.357+0000 7f2e09258700 1 -- 172.21.15.31:0/3363988238 shutdown_connections 2023-10-09T06:31:51.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.357+0000 7f2e09258700 1 -- 172.21.15.31:0/3363988238 wait complete. 2023-10-09T06:31:51.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.358+0000 7f2e09258700 1 Processor -- start 2023-10-09T06:31:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.358+0000 7f2e09258700 1 -- start start 2023-10-09T06:31:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.359+0000 7f2e09258700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2df0004d50 0x7f2e04156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.359+0000 7f2e09258700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0416aa40 0x7f2e04154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.359+0000 7f2e09258700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e040b18f0 0x7f2e040b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.359+0000 7f2e09258700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040b2290 con 0x7f2e040b18f0 2023-10-09T06:31:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.359+0000 7f2e09258700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e041583c0 con 0x7f2e0416aa40 2023-10-09T06:31:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.359+0000 7f2e09258700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e041574e0 con 0x7f2df0004d50 2023-10-09T06:31:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.359+0000 7f2e0359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e040b18f0 0x7f2e040b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.359+0000 7f2e02d9d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2df0004d50 0x7f2e04156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.359+0000 7f2e0359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e040b18f0 0x7f2e040b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42672/0 (socket says 172.21.15.31:42672) 2023-10-09T06:31:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.359+0000 7f2e02d9d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2df0004d50 0x7f2e04156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:51886/0 (socket says 172.21.15.31:51886) 2023-10-09T06:31:51.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.359+0000 7f2e0359e700 1 -- 172.21.15.31:0/3985337972 learned_addr learned my addr 172.21.15.31:0/3985337972 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.359+0000 7f2e0259c700 1 --2- 172.21.15.31:0/3985337972 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0416aa40 0x7f2e04154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.359+0000 7f2e0359e700 1 -- 172.21.15.31:0/3985337972 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2df0004d50 msgr2=0x7f2e04156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.360+0000 7f2e0359e700 1 --2- 172.21.15.31:0/3985337972 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2df0004d50 0x7f2e04156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.360+0000 7f2e0359e700 1 -- 172.21.15.31:0/3985337972 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0416aa40 msgr2=0x7f2e04154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.360+0000 7f2e0359e700 1 --2- 172.21.15.31:0/3985337972 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0416aa40 0x7f2e04154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.360+0000 7f2e0359e700 1 -- 172.21.15.31:0/3985337972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e041577b0 con 0x7f2e040b18f0 2023-10-09T06:31:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.360+0000 7f2e0359e700 1 --2- 172.21.15.31:0/3985337972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e040b18f0 0x7f2e040b1d50 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f2df4000c00 tx=0x7f2df4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.360+0000 7f2dfaffd700 1 -- 172.21.15.31:0/3985337972 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4022070 con 0x7f2e040b18f0 2023-10-09T06:31:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.360+0000 7f2dfaffd700 1 -- 172.21.15.31:0/3985337972 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df400ceb0 con 0x7f2e040b18f0 2023-10-09T06:31:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.360+0000 7f2dfaffd700 1 -- 172.21.15.31:0/3985337972 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4001da0 con 0x7f2e040b18f0 2023-10-09T06:31:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.360+0000 7f2e09258700 1 -- 172.21.15.31:0/3985337972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e04157a90 con 0x7f2e040b18f0 2023-10-09T06:31:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.360+0000 7f2e09258700 1 -- 172.21.15.31:0/3985337972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e04158050 con 0x7f2e040b18f0 2023-10-09T06:31:51.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.361+0000 7f2e09258700 1 -- 172.21.15.31:0/3985337972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0404c3c0 con 0x7f2e040b18f0 2023-10-09T06:31:51.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.361+0000 7f2dfaffd700 1 -- 172.21.15.31:0/3985337972 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2df401e430 con 0x7f2e040b18f0 2023-10-09T06:31:51.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.362+0000 7f2dfaffd700 1 --2- 172.21.15.31:0/3985337972 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2de4066f30 0x7f2de40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.362+0000 7f2dfaffd700 1 -- 172.21.15.31:0/3985337972 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2df40853f0 con 0x7f2e040b18f0 2023-10-09T06:31:51.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.362+0000 7f2e02d9d700 1 --2- 172.21.15.31:0/3985337972 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2de4066f30 0x7f2de40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.362+0000 7f2e02d9d700 1 --2- 172.21.15.31:0/3985337972 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2de4066f30 0x7f2de40693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2e04158bd0 tx=0x7f2dfc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.366+0000 7f2dfaffd700 1 -- 172.21.15.31:0/3985337972 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2df4052660 con 0x7f2e040b18f0 2023-10-09T06:31:51.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.561+0000 7f2e09258700 1 -- 172.21.15.31:0/3985337972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e040ce730 con 0x7f2e040b18f0 2023-10-09T06:31:51.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.561+0000 7f2dfaffd700 1 -- 172.21.15.31:0/3985337972 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f2df4055c80 con 0x7f2e040b18f0 2023-10-09T06:31:51.562 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:51.562 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":184,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:31:50.242150+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:31:48.664093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T06:31:49.212701+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:31:51.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.564+0000 7f2e09258700 1 -- 172.21.15.31:0/3985337972 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2de4066f30 msgr2=0x7f2de40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.564+0000 7f2e09258700 1 --2- 172.21.15.31:0/3985337972 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2de4066f30 0x7f2de40693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2e04158bd0 tx=0x7f2dfc00b040 comp rx=0 tx=0).stop 2023-10-09T06:31:51.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.564+0000 7f2e09258700 1 -- 172.21.15.31:0/3985337972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e040b18f0 msgr2=0x7f2e040b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.564+0000 7f2e09258700 1 --2- 172.21.15.31:0/3985337972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e040b18f0 0x7f2e040b1d50 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f2df4000c00 tx=0x7f2df4015000 comp rx=0 tx=0).stop 2023-10-09T06:31:51.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.564+0000 7f2e09258700 1 -- 172.21.15.31:0/3985337972 shutdown_connections 2023-10-09T06:31:51.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.564+0000 7f2e09258700 1 --2- 172.21.15.31:0/3985337972 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2de4066f30 0x7f2de40693e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.564+0000 7f2e09258700 1 --2- 172.21.15.31:0/3985337972 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2df0004d50 0x7f2e04156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.564+0000 7f2e09258700 1 --2- 172.21.15.31:0/3985337972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e040b18f0 0x7f2e040b1d50 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.564+0000 7f2e09258700 1 --2- 172.21.15.31:0/3985337972 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e0416aa40 0x7f2e04154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.564+0000 7f2e09258700 1 -- 172.21.15.31:0/3985337972 >> 172.21.15.31:0/3985337972 conn(0x7f2e0406c6e0 msgr2=0x7f2e040c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:51.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.564+0000 7f2e09258700 1 -- 172.21.15.31:0/3985337972 shutdown_connections 2023-10-09T06:31:51.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.564+0000 7f2e09258700 1 -- 172.21.15.31:0/3985337972 wait complete. 2023-10-09T06:31:51.579 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:31:51.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.699+0000 7efd375c5700 1 Processor -- start 2023-10-09T06:31:51.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.699+0000 7efd375c5700 1 -- start start 2023-10-09T06:31:51.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.700+0000 7efd375c5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd3015afe0 0x7efd300afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.700+0000 7efd375c5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efd300c9830 0x7efd3015c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.700+0000 7efd375c5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd300b0e30 con 0x7efd300b12c0 2023-10-09T06:31:51.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.700+0000 7efd375c5700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd300af670 con 0x7efd300c9830 2023-10-09T06:31:51.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.700+0000 7efd375c5700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3015c870 con 0x7efd3015afe0 2023-10-09T06:31:51.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.700+0000 7efd34b60700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efd300b12c0 0x7efd300c9120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37878/0 (socket says 172.21.15.31:37878) 2023-10-09T06:31:51.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.700+0000 7efd34b60700 1 -- 172.21.15.31:0/883531037 learned_addr learned my addr 172.21.15.31:0/883531037 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:51.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.701+0000 7efd35361700 1 --2- 172.21.15.31:0/883531037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd3015afe0 0x7efd300afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.701+0000 7efd35b62700 1 --2- 172.21.15.31:0/883531037 >> v2:172.21.15.158:3300/0 conn(0x7efd300c9830 0x7efd3015c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.701+0000 7efd2ffff700 1 -- 172.21.15.31:0/883531037 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437977953 0 0) 0x7efd300b0e30 con 0x7efd300b12c0 2023-10-09T06:31:51.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.701+0000 7efd2ffff700 1 -- 172.21.15.31:0/883531037 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd18003570 con 0x7efd300b12c0 2023-10-09T06:31:51.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.701+0000 7efd35361700 1 -- 172.21.15.31:0/883531037 >> v2:172.21.15.158:3300/0 conn(0x7efd300c9830 msgr2=0x7efd3015c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:51.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.701+0000 7efd35361700 1 --2- 172.21.15.31:0/883531037 >> v2:172.21.15.158:3300/0 conn(0x7efd300c9830 0x7efd3015c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.701+0000 7efd35361700 1 -- 172.21.15.31:0/883531037 >> v1:172.21.15.31:6789/0 conn(0x7efd300b12c0 legacy=0x7efd300c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.701+0000 7efd35361700 1 -- 172.21.15.31:0/883531037 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300b0220 con 0x7efd3015afe0 2023-10-09T06:31:51.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.701+0000 7efd35361700 1 --2- 172.21.15.31:0/883531037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd3015afe0 0x7efd300afb60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efd280098e0 tx=0x7efd280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df62c8c81f51616 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:51.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.701+0000 7efd2ffff700 1 -- 172.21.15.31:0/883531037 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28011630 con 0x7efd3015afe0 2023-10-09T06:31:51.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.701+0000 7efd2ffff700 1 -- 172.21.15.31:0/883531037 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd28011790 con 0x7efd3015afe0 2023-10-09T06:31:51.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.701+0000 7efd2ffff700 1 -- 172.21.15.31:0/883531037 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28011b10 con 0x7efd3015afe0 2023-10-09T06:31:51.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.702+0000 7efd375c5700 1 -- 172.21.15.31:0/883531037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd3015afe0 msgr2=0x7efd300afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.702+0000 7efd375c5700 1 --2- 172.21.15.31:0/883531037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd3015afe0 0x7efd300afb60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efd280098e0 tx=0x7efd280091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.702+0000 7efd375c5700 1 -- 172.21.15.31:0/883531037 shutdown_connections 2023-10-09T06:31:51.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.702+0000 7efd375c5700 1 --2- 172.21.15.31:0/883531037 >> v2:172.21.15.158:3300/0 conn(0x7efd300c9830 0x7efd3015c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.702+0000 7efd375c5700 1 --2- 172.21.15.31:0/883531037 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd3015afe0 0x7efd300afb60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.702+0000 7efd375c5700 1 -- 172.21.15.31:0/883531037 >> 172.21.15.31:0/883531037 conn(0x7efd3006f3e0 msgr2=0x7efd3006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:51.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.702+0000 7efd375c5700 1 -- 172.21.15.31:0/883531037 shutdown_connections 2023-10-09T06:31:51.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.702+0000 7efd375c5700 1 -- 172.21.15.31:0/883531037 wait complete. 2023-10-09T06:31:51.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.703+0000 7efd375c5700 1 Processor -- start 2023-10-09T06:31:51.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.703+0000 7efd375c5700 1 -- start start 2023-10-09T06:31:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd375c5700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd300b12c0 0x7efd300adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd375c5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd300c9830 0x7efd300cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd375c5700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd3015afe0 0x7efd300ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd375c5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300b2120 con 0x7efd300c9830 2023-10-09T06:31:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd375c5700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300ae530 con 0x7efd300b12c0 2023-10-09T06:31:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd375c5700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd300c88c0 con 0x7efd3015afe0 2023-10-09T06:31:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd34b60700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd300c9830 0x7efd300cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd34b60700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd300c9830 0x7efd300cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42686/0 (socket says 172.21.15.31:42686) 2023-10-09T06:31:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd34b60700 1 -- 172.21.15.31:0/2418263099 learned_addr learned my addr 172.21.15.31:0/2418263099 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd35361700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd300b12c0 0x7efd300adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd35b62700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd3015afe0 0x7efd300ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd34b60700 1 -- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd3015afe0 msgr2=0x7efd300ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd34b60700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd3015afe0 0x7efd300ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd34b60700 1 -- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd300b12c0 msgr2=0x7efd300adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd34b60700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd300b12c0 0x7efd300adff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd34b60700 1 -- 172.21.15.31:0/2418263099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd28009420 con 0x7efd300c9830 2023-10-09T06:31:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.704+0000 7efd34b60700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd300c9830 0x7efd300cdb60 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7efd2400c7f0 tx=0x7efd24007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.705+0000 7efd2d7fa700 1 -- 172.21.15.31:0/2418263099 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24005c00 con 0x7efd300c9830 2023-10-09T06:31:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.705+0000 7efd2d7fa700 1 -- 172.21.15.31:0/2418263099 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd24005d60 con 0x7efd300c9830 2023-10-09T06:31:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.705+0000 7efd375c5700 1 -- 172.21.15.31:0/2418263099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd300b1ad0 con 0x7efd300c9830 2023-10-09T06:31:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.705+0000 7efd2d7fa700 1 -- 172.21.15.31:0/2418263099 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24007300 con 0x7efd300c9830 2023-10-09T06:31:51.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.705+0000 7efd375c5700 1 -- 172.21.15.31:0/2418263099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd300c7b20 con 0x7efd300c9830 2023-10-09T06:31:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.706+0000 7efd375c5700 1 -- 172.21.15.31:0/2418263099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd300b1930 con 0x7efd300c9830 2023-10-09T06:31:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.706+0000 7efd2d7fa700 1 -- 172.21.15.31:0/2418263099 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd2401b3b0 con 0x7efd300c9830 2023-10-09T06:31:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.706+0000 7efd2d7fa700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efd1c066f30 0x7efd1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.706+0000 7efd2d7fa700 1 -- 172.21.15.31:0/2418263099 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd24083910 con 0x7efd300c9830 2023-10-09T06:31:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.707+0000 7efd35361700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efd1c066f30 0x7efd1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:51.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.707+0000 7efd35361700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efd1c066f30 0x7efd1c0693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efd280091e0 tx=0x7efd28017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:51.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.711+0000 7efd2d7fa700 1 -- 172.21.15.31:0/2418263099 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd300b1930 con 0x7efd300c9830 2023-10-09T06:31:51.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:51.948+0000 7efd375c5700 1 -- 172.21.15.31:0/2418263099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efd300b1930 con 0x7efd300c9830 2023-10-09T06:31:52.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:52.876+0000 7efd2d7fa700 1 -- 172.21.15.31:0/2418263099 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v88) v1 ==== 118+0+0 (secure 0 0 0) 0x7efd300b1930 con 0x7efd300c9830 2023-10-09T06:31:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:52.879+0000 7efd375c5700 1 -- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efd1c066f30 msgr2=0x7efd1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:52.879+0000 7efd375c5700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efd1c066f30 0x7efd1c0693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efd280091e0 tx=0x7efd28017000 comp rx=0 tx=0).stop 2023-10-09T06:31:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:52.879+0000 7efd375c5700 1 -- 172.21.15.31:0/2418263099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd300c9830 msgr2=0x7efd300cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:52.879+0000 7efd375c5700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd300c9830 0x7efd300cdb60 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7efd2400c7f0 tx=0x7efd24007d90 comp rx=0 tx=0).stop 2023-10-09T06:31:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:52.879+0000 7efd375c5700 1 -- 172.21.15.31:0/2418263099 shutdown_connections 2023-10-09T06:31:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:52.879+0000 7efd375c5700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efd1c066f30 0x7efd1c0693e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:52.879+0000 7efd375c5700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efd3015afe0 0x7efd300ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:52.879+0000 7efd375c5700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd300b12c0 0x7efd300adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:52.879+0000 7efd375c5700 1 --2- 172.21.15.31:0/2418263099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd300c9830 0x7efd300cdb60 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:52.879+0000 7efd375c5700 1 -- 172.21.15.31:0/2418263099 >> 172.21.15.31:0/2418263099 conn(0x7efd3006f3e0 msgr2=0x7efd300b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:52.880+0000 7efd375c5700 1 -- 172.21.15.31:0/2418263099 shutdown_connections 2023-10-09T06:31:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:52.880+0000 7efd375c5700 1 -- 172.21.15.31:0/2418263099 wait complete. 2023-10-09T06:31:52.895 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:31:53.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.023+0000 7fdf93275700 1 Processor -- start 2023-10-09T06:31:53.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.023+0000 7fdf93275700 1 -- start start 2023-10-09T06:31:53.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.024+0000 7fdf93275700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf8c0b3570 0x7fdf8c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:53.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.024+0000 7fdf93275700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdf8c0b4c30 0x7fdf8c0b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:53.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.024+0000 7fdf93275700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c0b14f0 con 0x7fdf8c0b4860 2023-10-09T06:31:53.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.024+0000 7fdf93275700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c0b17d0 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.024+0000 7fdf93275700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0b1ab0 con 0x7fdf8c0b3570 2023-10-09T06:31:53.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.024+0000 7fdf91812700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdf8c0b4c30 0x7fdf8c0b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:53.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.024+0000 7fdf91011700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fdf8c0b4860 0x7fdf8c159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:44448/0 (socket says 172.21.15.31:44448) 2023-10-09T06:31:53.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.025+0000 7fdf91011700 1 -- 172.21.15.31:0/1418403081 learned_addr learned my addr 172.21.15.31:0/1418403081 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:53.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.025+0000 7fdf90810700 1 --2- 172.21.15.31:0/1418403081 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf8c0b3570 0x7fdf8c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:53.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.025+0000 7fdf91812700 1 -- 172.21.15.31:0/1418403081 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf8c0b3570 msgr2=0x7fdf8c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:53.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.025+0000 7fdf91812700 1 --2- 172.21.15.31:0/1418403081 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf8c0b3570 0x7fdf8c15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:53.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.025+0000 7fdf91812700 1 -- 172.21.15.31:0/1418403081 >> v1:172.21.15.158:6789/0 conn(0x7fdf8c0b4860 legacy=0x7fdf8c159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:53.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.025+0000 7fdf8bfff700 1 -- 172.21.15.31:0/1418403081 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650602381 0 0) 0x7fdf8c0b14f0 con 0x7fdf8c0b4860 2023-10-09T06:31:53.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.025+0000 7fdf91812700 1 -- 172.21.15.31:0/1418403081 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c0b1d90 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.026+0000 7fdf91812700 1 --2- 172.21.15.31:0/1418403081 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf8c0b4c30 0x7fdf8c0b6700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0098e0 tx=0x7fdf7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d616b0c97f2619d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:53.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.026+0000 7fdf8bfff700 1 -- 172.21.15.31:0/1418403081 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00b6d0 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.026+0000 7fdf8bfff700 1 -- 172.21.15.31:0/1418403081 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c00b830 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.026+0000 7fdf8bfff700 1 -- 172.21.15.31:0/1418403081 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00bbd0 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.026+0000 7fdf93275700 1 -- 172.21.15.31:0/1418403081 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf8c0b4c30 msgr2=0x7fdf8c0b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:53.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.026+0000 7fdf93275700 1 --2- 172.21.15.31:0/1418403081 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf8c0b4c30 0x7fdf8c0b6700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0098e0 tx=0x7fdf7c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:53.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.026+0000 7fdf93275700 1 -- 172.21.15.31:0/1418403081 shutdown_connections 2023-10-09T06:31:53.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.026+0000 7fdf93275700 1 --2- 172.21.15.31:0/1418403081 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf8c0b4c30 0x7fdf8c0b6700 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:53.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.026+0000 7fdf93275700 1 --2- 172.21.15.31:0/1418403081 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf8c0b3570 0x7fdf8c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:53.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.026+0000 7fdf93275700 1 -- 172.21.15.31:0/1418403081 >> 172.21.15.31:0/1418403081 conn(0x7fdf8c09a0f0 msgr2=0x7fdf8c067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:53.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.027+0000 7fdf93275700 1 -- 172.21.15.31:0/1418403081 shutdown_connections 2023-10-09T06:31:53.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.027+0000 7fdf93275700 1 -- 172.21.15.31:0/1418403081 wait complete. 2023-10-09T06:31:53.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.028+0000 7fdf93275700 1 Processor -- start 2023-10-09T06:31:53.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.028+0000 7fdf93275700 1 -- start start 2023-10-09T06:31:53.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.028+0000 7fdf93275700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf8c0b3570 0x7fdf8c16a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:53.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf93275700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf8c0b4860 0x7fdf8c09e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:53.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf93275700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf8c0b4c30 0x7fdf8c147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:53.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf93275700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c09ab60 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf93275700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c09e620 con 0x7fdf8c0b4860 2023-10-09T06:31:53.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf93275700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c09b3c0 con 0x7fdf8c0b3570 2023-10-09T06:31:53.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf91812700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf8c0b4c30 0x7fdf8c147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:53.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf91812700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf8c0b4c30 0x7fdf8c147240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42690/0 (socket says 172.21.15.31:42690) 2023-10-09T06:31:53.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf91812700 1 -- 172.21.15.31:0/1476079292 learned_addr learned my addr 172.21.15.31:0/1476079292 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:53.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf91011700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf8c0b3570 0x7fdf8c16a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:53.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf90810700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf8c0b4860 0x7fdf8c09e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:53.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf91812700 1 -- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf8c0b3570 msgr2=0x7fdf8c16a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:53.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf91812700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf8c0b3570 0x7fdf8c16a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:53.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf91812700 1 -- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf8c0b4860 msgr2=0x7fdf8c09e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:53.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf91812700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf8c0b4860 0x7fdf8c09e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:53.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf91812700 1 -- 172.21.15.31:0/1476079292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c009420 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf91812700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf8c0b4c30 0x7fdf8c147240 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c068cd0 tx=0x7fdf7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:53.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf897fa700 1 -- 172.21.15.31:0/1476079292 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c011630 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf897fa700 1 -- 172.21.15.31:0/1476079292 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c011790 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf93275700 1 -- 172.21.15.31:0/1476079292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c147780 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf897fa700 1 -- 172.21.15.31:0/1476079292 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c011b30 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.029+0000 7fdf93275700 1 -- 172.21.15.31:0/1476079292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c09ad70 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.030+0000 7fdf93275700 1 -- 172.21.15.31:0/1476079292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c09b570 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.031+0000 7fdf897fa700 1 -- 172.21.15.31:0/1476079292 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf7c0193b0 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.031+0000 7fdf897fa700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdf78066f30 0x7fdf780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:53.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.031+0000 7fdf897fa700 1 -- 172.21.15.31:0/1476079292 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf7c085bc0 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.031+0000 7fdf91011700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdf78066f30 0x7fdf780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:53.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.032+0000 7fdf91011700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdf78066f30 0x7fdf780693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c158830 tx=0x7fdf84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:53.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.035+0000 7fdf897fa700 1 -- 172.21.15.31:0/1476079292 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf8c09b570 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.273+0000 7fdf93275700 1 -- 172.21.15.31:0/1476079292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdf8c09b530 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.879+0000 7fdf897fa700 1 -- 172.21.15.31:0/1476079292 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v89) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdf7c052e30 con 0x7fdf8c0b4c30 2023-10-09T06:31:53.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.881+0000 7fdf93275700 1 -- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdf78066f30 msgr2=0x7fdf780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:53.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.881+0000 7fdf93275700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdf78066f30 0x7fdf780693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c158830 tx=0x7fdf84009040 comp rx=0 tx=0).stop 2023-10-09T06:31:53.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.881+0000 7fdf93275700 1 -- 172.21.15.31:0/1476079292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf8c0b4c30 msgr2=0x7fdf8c147240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:53.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.881+0000 7fdf93275700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf8c0b4c30 0x7fdf8c147240 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c068cd0 tx=0x7fdf7c017000 comp rx=0 tx=0).stop 2023-10-09T06:31:53.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.881+0000 7fdf93275700 1 -- 172.21.15.31:0/1476079292 shutdown_connections 2023-10-09T06:31:53.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.881+0000 7fdf93275700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fdf78066f30 0x7fdf780693e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:53.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.881+0000 7fdf93275700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fdf8c0b3570 0x7fdf8c16a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:53.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.881+0000 7fdf93275700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf8c0b4c30 0x7fdf8c147240 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:53.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.881+0000 7fdf93275700 1 --2- 172.21.15.31:0/1476079292 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdf8c0b4860 0x7fdf8c09e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:53.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.881+0000 7fdf93275700 1 -- 172.21.15.31:0/1476079292 >> 172.21.15.31:0/1476079292 conn(0x7fdf8c09a0f0 msgr2=0x7fdf8c15b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:53.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.882+0000 7fdf93275700 1 -- 172.21.15.31:0/1476079292 shutdown_connections 2023-10-09T06:31:53.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:53.882+0000 7fdf93275700 1 -- 172.21.15.31:0/1476079292 wait complete. 2023-10-09T06:31:53.895 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:31:54.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.014+0000 7f3949a6c700 1 Processor -- start 2023-10-09T06:31:54.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.014+0000 7f3949a6c700 1 -- start start 2023-10-09T06:31:54.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.015+0000 7f3949a6c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3944159f10 0x7f39440c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.015+0000 7f3949a6c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39440ae320 con 0x7f394415a2e0 2023-10-09T06:31:54.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.015+0000 7f3949a6c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39440ad710 con 0x7f39440cc410 2023-10-09T06:31:54.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.015+0000 7f3949a6c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394415a760 con 0x7f3944159f10 2023-10-09T06:31:54.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.015+0000 7f3943fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f394415a2e0 0x7f39440cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37884/0 (socket says 172.21.15.31:37884) 2023-10-09T06:31:54.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.015+0000 7f3943fff700 1 -- 172.21.15.31:0/4226331167 learned_addr learned my addr 172.21.15.31:0/4226331167 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:54.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.015+0000 7f3948a6a700 1 --2- 172.21.15.31:0/4226331167 >> v2:172.21.15.158:3300/0 conn(0x7f3944159f10 0x7f39440c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.015+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097031875 0 0) 0x7f39440ae320 con 0x7f394415a2e0 2023-10-09T06:31:54.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.015+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3930003570 con 0x7f394415a2e0 2023-10-09T06:31:54.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3100986833 0 0) 0x7f3930003570 con 0x7f394415a2e0 2023-10-09T06:31:54.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 >> v2:172.21.15.158:3300/0 conn(0x7f3944159f10 msgr2=0x7f39440c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:54.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 --2- 172.21.15.31:0/4226331167 >> v2:172.21.15.158:3300/0 conn(0x7f3944159f10 0x7f39440c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 >> v1:172.21.15.158:6789/0 conn(0x7f39440cc410 legacy=0x7f39440cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39440ad9f0 con 0x7f394415a2e0 2023-10-09T06:31:54.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f39340017f0 con 0x7f394415a2e0 2023-10-09T06:31:54.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 >> v1:172.21.15.31:6789/0 conn(0x7f394415a2e0 legacy=0x7f39440cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 --2- 172.21.15.31:0/4226331167 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3930003a60 0x7f3930003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 --2- 172.21.15.31:0/4226331167 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3930004810 0x7f3930004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 --2- 172.21.15.31:0/4226331167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39300051c0 0x7f393000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394415a760 con 0x7f39300051c0 2023-10-09T06:31:54.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393000c0d0 con 0x7f3930003a60 2023-10-09T06:31:54.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393000c290 con 0x7f3930004810 2023-10-09T06:31:54.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f394926b700 1 --2- 172.21.15.31:0/4226331167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39300051c0 0x7f393000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f3948a6a700 1 --2- 172.21.15.31:0/4226331167 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3930003a60 0x7f3930003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f394926b700 1 -- 172.21.15.31:0/4226331167 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3930004810 msgr2=0x7f3930004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:54.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f394926b700 1 --2- 172.21.15.31:0/4226331167 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3930004810 0x7f3930004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f394926b700 1 -- 172.21.15.31:0/4226331167 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3930003a60 msgr2=0x7f3930003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:54.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f394926b700 1 --2- 172.21.15.31:0/4226331167 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3930003a60 0x7f3930003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f394926b700 1 -- 172.21.15.31:0/4226331167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3930003570 con 0x7f39300051c0 2023-10-09T06:31:54.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f394926b700 1 -- 172.21.15.31:0/4226331167 reap_dead start 2023-10-09T06:31:54.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f394926b700 1 --2- 172.21.15.31:0/4226331167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39300051c0 0x7f393000ba60 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f392c0018b0 tx=0x7f392c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c227f65c12a1a23d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:54.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.016+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c012420 con 0x7f39300051c0 2023-10-09T06:31:54.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.017+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c0125a0 con 0x7f39300051c0 2023-10-09T06:31:54.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.017+0000 7f39437fe700 1 -- 172.21.15.31:0/4226331167 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c012960 con 0x7f39300051c0 2023-10-09T06:31:54.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.017+0000 7f3949a6c700 1 -- 172.21.15.31:0/4226331167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39300051c0 msgr2=0x7f393000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.017+0000 7f3949a6c700 1 --2- 172.21.15.31:0/4226331167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39300051c0 0x7f393000ba60 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f392c0018b0 tx=0x7f392c007d30 comp rx=0 tx=0).stop 2023-10-09T06:31:54.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.017+0000 7f3949a6c700 1 -- 172.21.15.31:0/4226331167 shutdown_connections 2023-10-09T06:31:54.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.017+0000 7f3949a6c700 1 --2- 172.21.15.31:0/4226331167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39300051c0 0x7f393000ba60 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.017+0000 7f3949a6c700 1 -- 172.21.15.31:0/4226331167 >> 172.21.15.31:0/4226331167 conn(0x7f3944067e40 msgr2=0x7f39440d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:54.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.017+0000 7f3949a6c700 1 -- 172.21.15.31:0/4226331167 shutdown_connections 2023-10-09T06:31:54.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.017+0000 7f3949a6c700 1 -- 172.21.15.31:0/4226331167 wait complete. 2023-10-09T06:31:54.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.018+0000 7f3949a6c700 1 Processor -- start 2023-10-09T06:31:54.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.018+0000 7f3949a6c700 1 -- start start 2023-10-09T06:31:54.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3949a6c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39300051c0 0x7f39440ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3949a6c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39440cf7b0 0x7f3944155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3949a6c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39440c7cf0 0x7f39440b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3949a6c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3944157400 con 0x7f39440cf7b0 2023-10-09T06:31:54.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3949a6c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39440c9f70 con 0x7f39440c7cf0 2023-10-09T06:31:54.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3949a6c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39440ca250 con 0x7f39300051c0 2023-10-09T06:31:54.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3943fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39440cf7b0 0x7f3944155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3943fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39440cf7b0 0x7f3944155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42712/0 (socket says 172.21.15.31:42712) 2023-10-09T06:31:54.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3943fff700 1 -- 172.21.15.31:0/3666320248 learned_addr learned my addr 172.21.15.31:0/3666320248 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:54.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3948a6a700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39300051c0 0x7f39440ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f394926b700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39440c7cf0 0x7f39440b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3943fff700 1 -- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39300051c0 msgr2=0x7f39440ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3943fff700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39300051c0 0x7f39440ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3943fff700 1 -- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39440c7cf0 msgr2=0x7f39440b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3943fff700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39440c7cf0 0x7f39440b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f3943fff700 1 -- 172.21.15.31:0/3666320248 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3944155f90 con 0x7f39440cf7b0 2023-10-09T06:31:54.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.019+0000 7f394926b700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39440c7cf0 0x7f39440b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:54.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.020+0000 7f3943fff700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39440cf7b0 0x7f3944155a50 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f393400cb90 tx=0x7f3934007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:54.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.020+0000 7f3940ff9700 1 -- 172.21.15.31:0/3666320248 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934004dc0 con 0x7f39440cf7b0 2023-10-09T06:31:54.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.020+0000 7f3940ff9700 1 -- 172.21.15.31:0/3666320248 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393400a660 con 0x7f39440cf7b0 2023-10-09T06:31:54.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.020+0000 7f3940ff9700 1 -- 172.21.15.31:0/3666320248 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400aa20 con 0x7f39440cf7b0 2023-10-09T06:31:54.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.020+0000 7f3949a6c700 1 -- 172.21.15.31:0/3666320248 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3944157650 con 0x7f39440cf7b0 2023-10-09T06:31:54.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.020+0000 7f3949a6c700 1 -- 172.21.15.31:0/3666320248 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3944157c10 con 0x7f39440cf7b0 2023-10-09T06:31:54.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.021+0000 7f3949a6c700 1 -- 172.21.15.31:0/3666320248 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3944089300 con 0x7f39440cf7b0 2023-10-09T06:31:54.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.021+0000 7f3940ff9700 1 -- 172.21.15.31:0/3666320248 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3934007150 con 0x7f39440cf7b0 2023-10-09T06:31:54.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.022+0000 7f3940ff9700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3924066f30 0x7f39240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.022+0000 7f3940ff9700 1 -- 172.21.15.31:0/3666320248 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3934084020 con 0x7f39440cf7b0 2023-10-09T06:31:54.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.022+0000 7f3948a6a700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3924066f30 0x7f39240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.022+0000 7f3948a6a700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3924066f30 0x7f39240693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f39440c6b80 tx=0x7f393c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:54.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.026+0000 7f3940ff9700 1 -- 172.21.15.31:0/3666320248 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3934051310 con 0x7f39440cf7b0 2023-10-09T06:31:54.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.262+0000 7f3949a6c700 1 -- 172.21.15.31:0/3666320248 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39440890a0 con 0x7f39440cf7b0 2023-10-09T06:31:54.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.262+0000 7f3940ff9700 1 -- 172.21.15.31:0/3666320248 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f3934018020 con 0x7f39440cf7b0 2023-10-09T06:31:54.264 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:54.265 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/3503727793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3503727793},{"type":"v1","addr":"172.21.15.158:6837","nonce":3503727793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2366061673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2366061673},{"type":"v1","addr":"172.21.15.158:6836","nonce":2366061673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3405107978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3405107978},{"type":"v1","addr":"172.21.15.31:6834","nonce":3405107978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:31:50.242464+0000","modified":"2023-10-09T06:31:53.876299+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8079":{"gid":8079,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4124393323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4124393323},{"type":"v1","addr":"172.21.15.31:6835","nonce":4124393323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T06:31:54.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.264+0000 7f3949a6c700 1 -- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3924066f30 msgr2=0x7f39240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.264+0000 7f3949a6c700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3924066f30 0x7f39240693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f39440c6b80 tx=0x7f393c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.264+0000 7f3949a6c700 1 -- 172.21.15.31:0/3666320248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39440cf7b0 msgr2=0x7f3944155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.264+0000 7f3949a6c700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39440cf7b0 0x7f3944155a50 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f393400cb90 tx=0x7f3934007c70 comp rx=0 tx=0).stop 2023-10-09T06:31:54.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.264+0000 7f3949a6c700 1 -- 172.21.15.31:0/3666320248 shutdown_connections 2023-10-09T06:31:54.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.264+0000 7f3949a6c700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3924066f30 0x7f39240693e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.264+0000 7f3949a6c700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f39300051c0 0x7f39440ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.264+0000 7f3949a6c700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39440c7cf0 0x7f39440b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.264+0000 7f3949a6c700 1 --2- 172.21.15.31:0/3666320248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39440cf7b0 0x7f3944155a50 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.264+0000 7f3949a6c700 1 -- 172.21.15.31:0/3666320248 >> 172.21.15.31:0/3666320248 conn(0x7f3944067e40 msgr2=0x7f39440c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:54.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.265+0000 7f3949a6c700 1 -- 172.21.15.31:0/3666320248 shutdown_connections 2023-10-09T06:31:54.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.265+0000 7f3949a6c700 1 -- 172.21.15.31:0/3666320248 wait complete. 2023-10-09T06:31:54.268 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 89 2023-10-09T06:31:54.278 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:31:54.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.397+0000 7fd07ae34700 1 Processor -- start 2023-10-09T06:31:54.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.397+0000 7fd07ae34700 1 -- start start 2023-10-09T06:31:54.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd07ae34700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd074157a90 0x7fd0740b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd07ae34700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0740cb0b0 con 0x7fd07406fef0 2023-10-09T06:31:54.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd07ae34700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0740b0830 con 0x7fd074157e60 2023-10-09T06:31:54.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd07ae34700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0740b0ad0 con 0x7fd074157a90 2023-10-09T06:31:54.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd07a633700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd07406fef0 0x7fd0740ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37894/0 (socket says 172.21.15.31:37894) 2023-10-09T06:31:54.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd07a633700 1 -- 172.21.15.31:0/1401281982 learned_addr learned my addr 172.21.15.31:0/1401281982 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:54.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd079e32700 1 --2- 172.21.15.31:0/1401281982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd074157a90 0x7fd0740b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136959380 0 0) 0x7fd0740cb0b0 con 0x7fd07406fef0 2023-10-09T06:31:54.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd060003570 con 0x7fd07406fef0 2023-10-09T06:31:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 393961188 0 0) 0x7fd060003570 con 0x7fd07406fef0 2023-10-09T06:31:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd074157a90 msgr2=0x7fd0740b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd078e30700 1 --2- 172.21.15.31:0/1401281982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd074157a90 0x7fd0740b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 >> v1:172.21.15.158:6789/0 conn(0x7fd074157e60 legacy=0x7fd0740b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0740ca780 con 0x7fd07406fef0 2023-10-09T06:31:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.398+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fd06c0017f0 con 0x7fd07406fef0 2023-10-09T06:31:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 >> v1:172.21.15.31:6789/0 conn(0x7fd07406fef0 legacy=0x7fd0740ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd078e30700 1 --2- 172.21.15.31:0/1401281982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd060003a90 0x7fd060003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd078e30700 1 --2- 172.21.15.31:0/1401281982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd074157a90 0x7fd060004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd078e30700 1 --2- 172.21.15.31:0/1401281982 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd060004d50 0x7fd0600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0740b0ad0 con 0x7fd060003a90 2023-10-09T06:31:54.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06000bb70 con 0x7fd060004d50 2023-10-09T06:31:54.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06000bd30 con 0x7fd074157a90 2023-10-09T06:31:54.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd079e32700 1 --2- 172.21.15.31:0/1401281982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd060003a90 0x7fd060003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd079631700 1 --2- 172.21.15.31:0/1401281982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd074157a90 0x7fd060004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd07a633700 1 --2- 172.21.15.31:0/1401281982 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd060004d50 0x7fd0600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd079e32700 1 -- 172.21.15.31:0/1401281982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd074157a90 msgr2=0x7fd060004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:54.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd079e32700 1 --2- 172.21.15.31:0/1401281982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd074157a90 0x7fd060004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd079e32700 1 -- 172.21.15.31:0/1401281982 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd060004d50 msgr2=0x7fd0600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:54.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd079e32700 1 --2- 172.21.15.31:0/1401281982 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd060004d50 0x7fd0600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd079e32700 1 -- 172.21.15.31:0/1401281982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd060003570 con 0x7fd060003a90 2023-10-09T06:31:54.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd079631700 1 --2- 172.21.15.31:0/1401281982 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd074157a90 0x7fd060004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:54.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd079e32700 1 --2- 172.21.15.31:0/1401281982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd060003a90 0x7fd060003ea0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fd070009c00 tx=0x7fd0700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30229c3fa02b72d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:54.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07000e710 con 0x7fd060003a90 2023-10-09T06:31:54.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07000e870 con 0x7fd060003a90 2023-10-09T06:31:54.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.399+0000 7fd078e30700 1 -- 172.21.15.31:0/1401281982 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07000ec30 con 0x7fd060003a90 2023-10-09T06:31:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.400+0000 7fd07ae34700 1 -- 172.21.15.31:0/1401281982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd060003a90 msgr2=0x7fd060003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.400+0000 7fd07ae34700 1 --2- 172.21.15.31:0/1401281982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd060003a90 0x7fd060003ea0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fd070009c00 tx=0x7fd0700091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.400+0000 7fd07a633700 1 -- 172.21.15.31:0/1401281982 reap_dead start 2023-10-09T06:31:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.400+0000 7fd07ae34700 1 -- 172.21.15.31:0/1401281982 shutdown_connections 2023-10-09T06:31:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.400+0000 7fd07ae34700 1 -- 172.21.15.31:0/1401281982 >> 172.21.15.31:0/1401281982 conn(0x7fd07406bc70 msgr2=0x7fd07406c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.400+0000 7fd07ae34700 1 -- 172.21.15.31:0/1401281982 shutdown_connections 2023-10-09T06:31:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.400+0000 7fd07ae34700 1 -- 172.21.15.31:0/1401281982 wait complete. 2023-10-09T06:31:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.401+0000 7fd07ae34700 1 Processor -- start 2023-10-09T06:31:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.401+0000 7fd07ae34700 1 -- start start 2023-10-09T06:31:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd07ae34700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0740c1ad0 0x7fd0740c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd07ae34700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0740c1ea0 0x7fd0740c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd07ae34700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0740c6540 0x7fd0740c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd07ae34700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0740c8b40 con 0x7fd0740c1ad0 2023-10-09T06:31:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd07ae34700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0740cca00 con 0x7fd0740c1ea0 2023-10-09T06:31:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd07ae34700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0740c8580 con 0x7fd0740c6540 2023-10-09T06:31:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd079e32700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0740c1ad0 0x7fd0740c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd079e32700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0740c1ad0 0x7fd0740c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42732/0 (socket says 172.21.15.31:42732) 2023-10-09T06:31:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd079e32700 1 -- 172.21.15.31:0/4164296201 learned_addr learned my addr 172.21.15.31:0/4164296201 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd07a633700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0740c6540 0x7fd0740c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd079631700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0740c1ea0 0x7fd0740c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd079e32700 1 -- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0740c6540 msgr2=0x7fd0740c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd079e32700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0740c6540 0x7fd0740c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd079e32700 1 -- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0740c1ea0 msgr2=0x7fd0740c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd079e32700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0740c1ea0 0x7fd0740c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd079e32700 1 -- 172.21.15.31:0/4164296201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0740c8860 con 0x7fd0740c1ad0 2023-10-09T06:31:54.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd079631700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0740c1ea0 0x7fd0740c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:31:54.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd079e32700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0740c1ad0 0x7fd0740c7d00 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd06000bb40 tx=0x7fd07001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:54.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd069ffb700 1 -- 172.21.15.31:0/4164296201 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070022070 con 0x7fd0740c1ad0 2023-10-09T06:31:54.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd069ffb700 1 -- 172.21.15.31:0/4164296201 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07000e9e0 con 0x7fd0740c1ad0 2023-10-09T06:31:54.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd07ae34700 1 -- 172.21.15.31:0/4164296201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0740cc690 con 0x7fd0740c1ad0 2023-10-09T06:31:54.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.402+0000 7fd069ffb700 1 -- 172.21.15.31:0/4164296201 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07001c450 con 0x7fd0740c1ad0 2023-10-09T06:31:54.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.403+0000 7fd07ae34700 1 -- 172.21.15.31:0/4164296201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd074148300 con 0x7fd0740c1ad0 2023-10-09T06:31:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.404+0000 7fd07ae34700 1 -- 172.21.15.31:0/4164296201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0740cc4d0 con 0x7fd0740c1ad0 2023-10-09T06:31:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.404+0000 7fd069ffb700 1 -- 172.21.15.31:0/4164296201 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd07001c860 con 0x7fd0740c1ad0 2023-10-09T06:31:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.404+0000 7fd069ffb700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd058066f30 0x7fd0580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.404+0000 7fd069ffb700 1 -- 172.21.15.31:0/4164296201 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd070085d50 con 0x7fd0740c1ad0 2023-10-09T06:31:54.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.405+0000 7fd079631700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd058066f30 0x7fd0580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.405+0000 7fd079631700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd058066f30 0x7fd0580693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd064000f60 tx=0x7fd064009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:54.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.409+0000 7fd069ffb700 1 -- 172.21.15.31:0/4164296201 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0700b75a0 con 0x7fd0740c1ad0 2023-10-09T06:31:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.601+0000 7fd07ae34700 1 -- 172.21.15.31:0/4164296201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0740c8a80 con 0x7fd0740c1ad0 2023-10-09T06:31:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.602+0000 7fd069ffb700 1 -- 172.21.15.31:0/4164296201 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+15365 (secure 0 0 0) 0x7fd070052f20 con 0x7fd0740c1ad0 2023-10-09T06:31:54.603 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:54.603 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":185,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:31:51.851774+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:31:48.664093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T06:31:49.212701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:31:54.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.604+0000 7fd07ae34700 1 -- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd058066f30 msgr2=0x7fd0580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.604+0000 7fd07ae34700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd058066f30 0x7fd0580693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd064000f60 tx=0x7fd064009040 comp rx=0 tx=0).stop 2023-10-09T06:31:54.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.604+0000 7fd07ae34700 1 -- 172.21.15.31:0/4164296201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0740c1ad0 msgr2=0x7fd0740c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.604+0000 7fd07ae34700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0740c1ad0 0x7fd0740c7d00 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd06000bb40 tx=0x7fd07001a000 comp rx=0 tx=0).stop 2023-10-09T06:31:54.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.604+0000 7fd07ae34700 1 -- 172.21.15.31:0/4164296201 shutdown_connections 2023-10-09T06:31:54.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.604+0000 7fd07ae34700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd058066f30 0x7fd0580693e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.604+0000 7fd07ae34700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0740c6540 0x7fd0740c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.604+0000 7fd07ae34700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0740c1ad0 0x7fd0740c7d00 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.604+0000 7fd07ae34700 1 --2- 172.21.15.31:0/4164296201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0740c1ea0 0x7fd0740c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.604+0000 7fd07ae34700 1 -- 172.21.15.31:0/4164296201 >> 172.21.15.31:0/4164296201 conn(0x7fd07406bc70 msgr2=0x7fd0740b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:54.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.604+0000 7fd07ae34700 1 -- 172.21.15.31:0/4164296201 shutdown_connections 2023-10-09T06:31:54.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.604+0000 7fd07ae34700 1 -- 172.21.15.31:0/4164296201 wait complete. 2023-10-09T06:31:54.617 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:31:54.617 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:31:54.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.736+0000 7f1b7083b700 1 Processor -- start 2023-10-09T06:31:54.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.736+0000 7f1b7083b700 1 -- start start 2023-10-09T06:31:54.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.737+0000 7f1b7083b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b6c159db0 0x7f1b6c0d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.737+0000 7f1b7083b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1b6c0b1f00 0x7f1b6c0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.737+0000 7f1b7083b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6c0b4bf0 con 0x7f1b6c068240 2023-10-09T06:31:54.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.737+0000 7f1b7083b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6c0b5790 con 0x7f1b6c0b1f00 2023-10-09T06:31:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.737+0000 7f1b7083b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c0ae9b0 con 0x7f1b6c159db0 2023-10-09T06:31:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.737+0000 7f1b6b59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1b6c0b1f00 0x7f1b6c0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.737+0000 7f1b6b59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1b6c0b1f00 0x7f1b6c0aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42744/0 (socket says 172.21.15.31:42744) 2023-10-09T06:31:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.737+0000 7f1b6b59e700 1 -- 172.21.15.31:0/2889614301 learned_addr learned my addr 172.21.15.31:0/2889614301 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.737+0000 7f1b6ad9d700 1 --2- 172.21.15.31:0/2889614301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b6c159db0 0x7f1b6c0d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.737+0000 7f1b6b59e700 1 -- 172.21.15.31:0/2889614301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b6c159db0 msgr2=0x7f1b6c0d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.737+0000 7f1b6b59e700 1 --2- 172.21.15.31:0/2889614301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b6c159db0 0x7f1b6c0d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.737+0000 7f1b6b59e700 1 -- 172.21.15.31:0/2889614301 >> v1:172.21.15.158:6789/0 conn(0x7f1b6c068240 legacy=0x7f1b6c0b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.737+0000 7f1b6b59e700 1 -- 172.21.15.31:0/2889614301 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c0b59e0 con 0x7f1b6c0b1f00 2023-10-09T06:31:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.738+0000 7f1b6b59e700 1 --2- 172.21.15.31:0/2889614301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b6c0b1f00 0x7f1b6c0aee40 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009f20 tx=0x7f1b64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17831c5f636b6be0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.738+0000 7f1b69d9b700 1 -- 172.21.15.31:0/2889614301 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6400e070 con 0x7f1b6c0b1f00 2023-10-09T06:31:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.738+0000 7f1b69d9b700 1 -- 172.21.15.31:0/2889614301 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6400ba60 con 0x7f1b6c0b1f00 2023-10-09T06:31:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.738+0000 7f1b69d9b700 1 -- 172.21.15.31:0/2889614301 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b640092e0 con 0x7f1b6c0b1f00 2023-10-09T06:31:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.738+0000 7f1b7083b700 1 -- 172.21.15.31:0/2889614301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b6c0b1f00 msgr2=0x7f1b6c0aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.738+0000 7f1b7083b700 1 --2- 172.21.15.31:0/2889614301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b6c0b1f00 0x7f1b6c0aee40 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009f20 tx=0x7f1b64009840 comp rx=0 tx=0).stop 2023-10-09T06:31:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.738+0000 7f1b7083b700 1 -- 172.21.15.31:0/2889614301 shutdown_connections 2023-10-09T06:31:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.738+0000 7f1b7083b700 1 --2- 172.21.15.31:0/2889614301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b6c0b1f00 0x7f1b6c0aee40 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.738+0000 7f1b7083b700 1 --2- 172.21.15.31:0/2889614301 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b6c159db0 0x7f1b6c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.738+0000 7f1b7083b700 1 -- 172.21.15.31:0/2889614301 >> 172.21.15.31:0/2889614301 conn(0x7f1b6c067e40 msgr2=0x7f1b6c0d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.738+0000 7f1b7083b700 1 -- 172.21.15.31:0/2889614301 shutdown_connections 2023-10-09T06:31:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.738+0000 7f1b7083b700 1 -- 172.21.15.31:0/2889614301 wait complete. 2023-10-09T06:31:54.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.739+0000 7f1b7083b700 1 Processor -- start 2023-10-09T06:31:54.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.740+0000 7f1b7083b700 1 -- start start 2023-10-09T06:31:54.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.740+0000 7f1b7083b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b6c068240 0x7f1b6c14a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.740+0000 7f1b7083b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b6c0b1f00 0x7f1b6c15b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.740+0000 7f1b7083b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b6c159db0 0x7f1b6c154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.740+0000 7f1b7083b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c15c0d0 con 0x7f1b6c068240 2023-10-09T06:31:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.740+0000 7f1b7083b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c15bb10 con 0x7f1b6c0b1f00 2023-10-09T06:31:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.740+0000 7f1b7083b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c15bdf0 con 0x7f1b6c159db0 2023-10-09T06:31:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.740+0000 7f1b6ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b6c068240 0x7f1b6c14a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.740+0000 7f1b6ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b6c068240 0x7f1b6c14a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42746/0 (socket says 172.21.15.31:42746) 2023-10-09T06:31:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.740+0000 7f1b6ad9d700 1 -- 172.21.15.31:0/3564102933 learned_addr learned my addr 172.21.15.31:0/3564102933 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.740+0000 7f1b6b59e700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b6c159db0 0x7f1b6c154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.740+0000 7f1b6a59c700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b6c0b1f00 0x7f1b6c15b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.741+0000 7f1b6ad9d700 1 -- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b6c159db0 msgr2=0x7f1b6c154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.741+0000 7f1b6ad9d700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b6c159db0 0x7f1b6c154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.741+0000 7f1b6ad9d700 1 -- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b6c0b1f00 msgr2=0x7f1b6c15b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.741+0000 7f1b6ad9d700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b6c0b1f00 0x7f1b6c15b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.741+0000 7f1b6ad9d700 1 -- 172.21.15.31:0/3564102933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b64009ae0 con 0x7f1b6c068240 2023-10-09T06:31:54.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.741+0000 7f1b6a59c700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b6c0b1f00 0x7f1b6c15b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:54.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.741+0000 7f1b6ad9d700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b6c068240 0x7f1b6c14a600 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000e930 tx=0x7f1b600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:54.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.741+0000 7f1b52ffd700 1 -- 172.21.15.31:0/3564102933 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6000c700 con 0x7f1b6c068240 2023-10-09T06:31:54.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.741+0000 7f1b52ffd700 1 -- 172.21.15.31:0/3564102933 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6000c860 con 0x7f1b6c068240 2023-10-09T06:31:54.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.741+0000 7f1b7083b700 1 -- 172.21.15.31:0/3564102933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6c09aa80 con 0x7f1b6c068240 2023-10-09T06:31:54.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.741+0000 7f1b52ffd700 1 -- 172.21.15.31:0/3564102933 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6000cc00 con 0x7f1b6c068240 2023-10-09T06:31:54.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.741+0000 7f1b7083b700 1 -- 172.21.15.31:0/3564102933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6c14ab40 con 0x7f1b6c068240 2023-10-09T06:31:54.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.742+0000 7f1b7083b700 1 -- 172.21.15.31:0/3564102933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6c09b0d0 con 0x7f1b6c068240 2023-10-09T06:31:54.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.742+0000 7f1b52ffd700 1 -- 172.21.15.31:0/3564102933 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b60013470 con 0x7f1b6c068240 2023-10-09T06:31:54.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.743+0000 7f1b52ffd700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1b58066f30 0x7f1b580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:54.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.743+0000 7f1b52ffd700 1 -- 172.21.15.31:0/3564102933 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b60084740 con 0x7f1b6c068240 2023-10-09T06:31:54.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.743+0000 7f1b6a59c700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1b58066f30 0x7f1b580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:54.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.743+0000 7f1b6a59c700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1b58066f30 0x7f1b580693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c007fd0 tx=0x7f1b5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:54.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.747+0000 7f1b52ffd700 1 -- 172.21.15.31:0/3564102933 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b600519b0 con 0x7f1b6c068240 2023-10-09T06:31:54.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.937+0000 7f1b7083b700 1 -- 172.21.15.31:0/3564102933 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b6c08abf0 con 0x7f1b58066f30 2023-10-09T06:31:54.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.946+0000 7f1b52ffd700 1 -- 172.21.15.31:0/3564102933 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285209 (secure 0 0 0) 0x7f1b6c08abf0 con 0x7f1b58066f30 2023-10-09T06:31:54.951 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:54.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.949+0000 7f1b7083b700 1 -- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1b58066f30 msgr2=0x7f1b580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.949+0000 7f1b7083b700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1b58066f30 0x7f1b580693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c007fd0 tx=0x7f1b5c009040 comp rx=0 tx=0).stop 2023-10-09T06:31:54.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.949+0000 7f1b7083b700 1 -- 172.21.15.31:0/3564102933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b6c068240 msgr2=0x7f1b6c14a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:54.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.949+0000 7f1b7083b700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b6c068240 0x7f1b6c14a600 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000e930 tx=0x7f1b600091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.949+0000 7f1b7083b700 1 -- 172.21.15.31:0/3564102933 shutdown_connections 2023-10-09T06:31:54.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.949+0000 7f1b7083b700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1b58066f30 0x7f1b580693e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.949+0000 7f1b7083b700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b6c159db0 0x7f1b6c154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.949+0000 7f1b7083b700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b6c068240 0x7f1b6c14a600 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.949+0000 7f1b7083b700 1 --2- 172.21.15.31:0/3564102933 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b6c0b1f00 0x7f1b6c15b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:54.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.949+0000 7f1b7083b700 1 -- 172.21.15.31:0/3564102933 >> 172.21.15.31:0/3564102933 conn(0x7f1b6c067e40 msgr2=0x7f1b6c155bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:54.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.949+0000 7f1b7083b700 1 -- 172.21.15.31:0/3564102933 shutdown_connections 2023-10-09T06:31:54.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:54.949+0000 7f1b7083b700 1 -- 172.21.15.31:0/3564102933 wait complete. 2023-10-09T06:31:54.957 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:31:54.962 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":511,"stamp":"2023-10-09T06:31:54.676423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553237,"statfs":{"total":1600000000,"available":1590515060,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.841836"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.862365+0000","last_change":"2023-10-09T06:31:50.862229+0000","last_active":"2023-10-09T06:31:50.862365+0000","last_peered":"2023-10-09T06:31:50.862365+0000","last_clean":"2023-10-09T06:31:50.862365+0000","last_became_active":"2023-10-09T06:31:50.860945+0000","last_became_peered":"2023-10-09T06:31:50.860945+0000","last_unstale":"2023-10-09T06:31:50.862365+0000","last_undegraded":"2023-10-09T06:31:50.862365+0000","last_fullsized":"2023-10-09T06:31:50.862365+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:35:24.031139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863204+0000","last_change":"2023-10-09T06:31:50.862860+0000","last_active":"2023-10-09T06:31:50.863204+0000","last_peered":"2023-10-09T06:31:50.863204+0000","last_clean":"2023-10-09T06:31:50.863204+0000","last_became_active":"2023-10-09T06:31:50.862112+0000","last_became_peered":"2023-10-09T06:31:50.862112+0000","last_unstale":"2023-10-09T06:31:50.863204+0000","last_undegraded":"2023-10-09T06:31:50.863204+0000","last_fullsized":"2023-10-09T06:31:50.863204+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:20:54.089203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868667+0000","last_change":"2023-10-09T06:31:50.868529+0000","last_active":"2023-10-09T06:31:50.868667+0000","last_peered":"2023-10-09T06:31:50.868667+0000","last_clean":"2023-10-09T06:31:50.868667+0000","last_became_active":"2023-10-09T06:31:50.868241+0000","last_became_peered":"2023-10-09T06:31:50.868241+0000","last_unstale":"2023-10-09T06:31:50.868667+0000","last_undegraded":"2023-10-09T06:31:50.868667+0000","last_fullsized":"2023-10-09T06:31:50.868667+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:04.440015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.869977+0000","last_change":"2023-10-09T06:31:50.869697+0000","last_active":"2023-10-09T06:31:50.869977+0000","last_peered":"2023-10-09T06:31:50.869977+0000","last_clean":"2023-10-09T06:31:50.869977+0000","last_became_active":"2023-10-09T06:31:50.869450+0000","last_became_peered":"2023-10-09T06:31:50.869450+0000","last_unstale":"2023-10-09T06:31:50.869977+0000","last_undegraded":"2023-10-09T06:31:50.869977+0000","last_fullsized":"2023-10-09T06:31:50.869977+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:46.192949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.866726+0000","last_change":"2023-10-09T06:31:50.866656+0000","last_active":"2023-10-09T06:31:50.866726+0000","last_peered":"2023-10-09T06:31:50.866726+0000","last_clean":"2023-10-09T06:31:50.866726+0000","last_became_active":"2023-10-09T06:31:50.866118+0000","last_became_peered":"2023-10-09T06:31:50.866118+0000","last_unstale":"2023-10-09T06:31:50.866726+0000","last_undegraded":"2023-10-09T06:31:50.866726+0000","last_fullsized":"2023-10-09T06:31:50.866726+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:48:58.120745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865522+0000","last_change":"2023-10-09T06:31:50.865422+0000","last_active":"2023-10-09T06:31:50.865522+0000","last_peered":"2023-10-09T06:31:50.865522+0000","last_clean":"2023-10-09T06:31:50.865522+0000","last_became_active":"2023-10-09T06:31:50.864436+0000","last_became_peered":"2023-10-09T06:31:50.864436+0000","last_unstale":"2023-10-09T06:31:50.865522+0000","last_undegraded":"2023-10-09T06:31:50.865522+0000","last_fullsized":"2023-10-09T06:31:50.865522+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:27.283114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.869265+0000","last_change":"2023-10-09T06:31:50.868663+0000","last_active":"2023-10-09T06:31:50.869265+0000","last_peered":"2023-10-09T06:31:50.869265+0000","last_clean":"2023-10-09T06:31:50.869265+0000","last_became_active":"2023-10-09T06:31:50.868015+0000","last_became_peered":"2023-10-09T06:31:50.868015+0000","last_unstale":"2023-10-09T06:31:50.869265+0000","last_undegraded":"2023-10-09T06:31:50.869265+0000","last_fullsized":"2023-10-09T06:31:50.869265+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:05:12.363084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867707+0000","last_change":"2023-10-09T06:31:50.867643+0000","last_active":"2023-10-09T06:31:50.867707+0000","last_peered":"2023-10-09T06:31:50.867707+0000","last_clean":"2023-10-09T06:31:50.867707+0000","last_became_active":"2023-10-09T06:31:50.867405+0000","last_became_peered":"2023-10-09T06:31:50.867405+0000","last_unstale":"2023-10-09T06:31:50.867707+0000","last_undegraded":"2023-10-09T06:31:50.867707+0000","last_fullsized":"2023-10-09T06:31:50.867707+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:52:29.407202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861426+0000","last_change":"2023-10-09T06:31:50.861001+0000","last_active":"2023-10-09T06:31:50.861426+0000","last_peered":"2023-10-09T06:31:50.861426+0000","last_clean":"2023-10-09T06:31:50.861426+0000","last_became_active":"2023-10-09T06:31:50.860765+0000","last_became_peered":"2023-10-09T06:31:50.860765+0000","last_unstale":"2023-10-09T06:31:50.861426+0000","last_undegraded":"2023-10-09T06:31:50.861426+0000","last_fullsized":"2023-10-09T06:31:50.861426+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:51.099722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.866866+0000","last_change":"2023-10-09T06:31:50.866800+0000","last_active":"2023-10-09T06:31:50.866866+0000","last_peered":"2023-10-09T06:31:50.866866+0000","last_clean":"2023-10-09T06:31:50.866866+0000","last_became_active":"2023-10-09T06:31:50.866421+0000","last_became_peered":"2023-10-09T06:31:50.866421+0000","last_unstale":"2023-10-09T06:31:50.866866+0000","last_undegraded":"2023-10-09T06:31:50.866866+0000","last_fullsized":"2023-10-09T06:31:50.866866+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:58.686562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868029+0000","last_change":"2023-10-09T06:31:50.867779+0000","last_active":"2023-10-09T06:31:50.868029+0000","last_peered":"2023-10-09T06:31:50.868029+0000","last_clean":"2023-10-09T06:31:50.868029+0000","last_became_active":"2023-10-09T06:31:50.867507+0000","last_became_peered":"2023-10-09T06:31:50.867507+0000","last_unstale":"2023-10-09T06:31:50.868029+0000","last_undegraded":"2023-10-09T06:31:50.868029+0000","last_fullsized":"2023-10-09T06:31:50.868029+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:12:38.686373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863186+0000","last_change":"2023-10-09T06:31:50.862730+0000","last_active":"2023-10-09T06:31:50.863186+0000","last_peered":"2023-10-09T06:31:50.863186+0000","last_clean":"2023-10-09T06:31:50.863186+0000","last_became_active":"2023-10-09T06:31:50.861824+0000","last_became_peered":"2023-10-09T06:31:50.861824+0000","last_unstale":"2023-10-09T06:31:50.863186+0000","last_undegraded":"2023-10-09T06:31:50.863186+0000","last_fullsized":"2023-10-09T06:31:50.863186+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:48.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.857356+0000","last_change":"2023-10-09T06:31:50.857256+0000","last_active":"2023-10-09T06:31:50.857356+0000","last_peered":"2023-10-09T06:31:50.857356+0000","last_clean":"2023-10-09T06:31:50.857356+0000","last_became_active":"2023-10-09T06:31:50.857022+0000","last_became_peered":"2023-10-09T06:31:50.857022+0000","last_unstale":"2023-10-09T06:31:50.857356+0000","last_undegraded":"2023-10-09T06:31:50.857356+0000","last_fullsized":"2023-10-09T06:31:50.857356+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:04.407035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861311+0000","last_change":"2023-10-09T06:31:50.860592+0000","last_active":"2023-10-09T06:31:50.861311+0000","last_peered":"2023-10-09T06:31:50.861311+0000","last_clean":"2023-10-09T06:31:50.861311+0000","last_became_active":"2023-10-09T06:31:50.860350+0000","last_became_peered":"2023-10-09T06:31:50.860350+0000","last_unstale":"2023-10-09T06:31:50.861311+0000","last_undegraded":"2023-10-09T06:31:50.861311+0000","last_fullsized":"2023-10-09T06:31:50.861311+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:14:08.743829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867456+0000","last_change":"2023-10-09T06:31:50.867365+0000","last_active":"2023-10-09T06:31:50.867456+0000","last_peered":"2023-10-09T06:31:50.867456+0000","last_clean":"2023-10-09T06:31:50.867456+0000","last_became_active":"2023-10-09T06:31:50.867088+0000","last_became_peered":"2023-10-09T06:31:50.867088+0000","last_unstale":"2023-10-09T06:31:50.867456+0000","last_undegraded":"2023-10-09T06:31:50.867456+0000","last_fullsized":"2023-10-09T06:31:50.867456+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:56:50.863439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865548+0000","last_change":"2023-10-09T06:31:50.865482+0000","last_active":"2023-10-09T06:31:50.865548+0000","last_peered":"2023-10-09T06:31:50.865548+0000","last_clean":"2023-10-09T06:31:50.865548+0000","last_became_active":"2023-10-09T06:31:50.864963+0000","last_became_peered":"2023-10-09T06:31:50.864963+0000","last_unstale":"2023-10-09T06:31:50.865548+0000","last_undegraded":"2023-10-09T06:31:50.865548+0000","last_fullsized":"2023-10-09T06:31:50.865548+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:29.009492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.864156+0000","last_change":"2023-10-09T06:31:50.864071+0000","last_active":"2023-10-09T06:31:50.864156+0000","last_peered":"2023-10-09T06:31:50.864156+0000","last_clean":"2023-10-09T06:31:50.864156+0000","last_became_active":"2023-10-09T06:31:50.863845+0000","last_became_peered":"2023-10-09T06:31:50.863845+0000","last_unstale":"2023-10-09T06:31:50.864156+0000","last_undegraded":"2023-10-09T06:31:50.864156+0000","last_fullsized":"2023-10-09T06:31:50.864156+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:35:55.444592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863306+0000","last_change":"2023-10-09T06:31:50.863219+0000","last_active":"2023-10-09T06:31:50.863306+0000","last_peered":"2023-10-09T06:31:50.863306+0000","last_clean":"2023-10-09T06:31:50.863306+0000","last_became_active":"2023-10-09T06:31:50.862978+0000","last_became_peered":"2023-10-09T06:31:50.862978+0000","last_unstale":"2023-10-09T06:31:50.863306+0000","last_undegraded":"2023-10-09T06:31:50.863306+0000","last_fullsized":"2023-10-09T06:31:50.863306+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:06.602929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.869233+0000","last_change":"2023-10-09T06:31:50.869157+0000","last_active":"2023-10-09T06:31:50.869233+0000","last_peered":"2023-10-09T06:31:50.869233+0000","last_clean":"2023-10-09T06:31:50.869233+0000","last_became_active":"2023-10-09T06:31:50.868903+0000","last_became_peered":"2023-10-09T06:31:50.868903+0000","last_unstale":"2023-10-09T06:31:50.869233+0000","last_undegraded":"2023-10-09T06:31:50.869233+0000","last_fullsized":"2023-10-09T06:31:50.869233+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:33.048267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861292+0000","last_change":"2023-10-09T06:31:50.860561+0000","last_active":"2023-10-09T06:31:50.861292+0000","last_peered":"2023-10-09T06:31:50.861292+0000","last_clean":"2023-10-09T06:31:50.861292+0000","last_became_active":"2023-10-09T06:31:50.860297+0000","last_became_peered":"2023-10-09T06:31:50.860297+0000","last_unstale":"2023-10-09T06:31:50.861292+0000","last_undegraded":"2023-10-09T06:31:50.861292+0000","last_fullsized":"2023-10-09T06:31:50.861292+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:28:36.355659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861491+0000","last_change":"2023-10-09T06:31:50.861409+0000","last_active":"2023-10-09T06:31:50.861491+0000","last_peered":"2023-10-09T06:31:50.861491+0000","last_clean":"2023-10-09T06:31:50.861491+0000","last_became_active":"2023-10-09T06:31:50.861161+0000","last_became_peered":"2023-10-09T06:31:50.861161+0000","last_unstale":"2023-10-09T06:31:50.861491+0000","last_undegraded":"2023-10-09T06:31:50.861491+0000","last_fullsized":"2023-10-09T06:31:50.861491+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:06:13.127841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867424+0000","last_change":"2023-10-09T06:31:50.867365+0000","last_active":"2023-10-09T06:31:50.867424+0000","last_peered":"2023-10-09T06:31:50.867424+0000","last_clean":"2023-10-09T06:31:50.867424+0000","last_became_active":"2023-10-09T06:31:50.867167+0000","last_became_peered":"2023-10-09T06:31:50.867167+0000","last_unstale":"2023-10-09T06:31:50.867424+0000","last_undegraded":"2023-10-09T06:31:50.867424+0000","last_fullsized":"2023-10-09T06:31:50.867424+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:14:34.826898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863115+0000","last_change":"2023-10-09T06:31:50.863049+0000","last_active":"2023-10-09T06:31:50.863115+0000","last_peered":"2023-10-09T06:31:50.863115+0000","last_clean":"2023-10-09T06:31:50.863115+0000","last_became_active":"2023-10-09T06:31:50.862818+0000","last_became_peered":"2023-10-09T06:31:50.862818+0000","last_unstale":"2023-10-09T06:31:50.863115+0000","last_undegraded":"2023-10-09T06:31:50.863115+0000","last_fullsized":"2023-10-09T06:31:50.863115+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:24.297743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.857202+0000","last_change":"2023-10-09T06:31:50.857069+0000","last_active":"2023-10-09T06:31:50.857202+0000","last_peered":"2023-10-09T06:31:50.857202+0000","last_clean":"2023-10-09T06:31:50.857202+0000","last_became_active":"2023-10-09T06:31:50.856839+0000","last_became_peered":"2023-10-09T06:31:50.856839+0000","last_unstale":"2023-10-09T06:31:50.857202+0000","last_undegraded":"2023-10-09T06:31:50.857202+0000","last_fullsized":"2023-10-09T06:31:50.857202+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:58.236733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868381+0000","last_change":"2023-10-09T06:31:50.868310+0000","last_active":"2023-10-09T06:31:50.868381+0000","last_peered":"2023-10-09T06:31:50.868381+0000","last_clean":"2023-10-09T06:31:50.868381+0000","last_became_active":"2023-10-09T06:31:50.867981+0000","last_became_peered":"2023-10-09T06:31:50.867981+0000","last_unstale":"2023-10-09T06:31:50.868381+0000","last_undegraded":"2023-10-09T06:31:50.868381+0000","last_fullsized":"2023-10-09T06:31:50.868381+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:03.673645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863865+0000","last_change":"2023-10-09T06:31:50.863740+0000","last_active":"2023-10-09T06:31:50.863865+0000","last_peered":"2023-10-09T06:31:50.863865+0000","last_clean":"2023-10-09T06:31:50.863865+0000","last_became_active":"2023-10-09T06:31:50.863493+0000","last_became_peered":"2023-10-09T06:31:50.863493+0000","last_unstale":"2023-10-09T06:31:50.863865+0000","last_undegraded":"2023-10-09T06:31:50.863865+0000","last_fullsized":"2023-10-09T06:31:50.863865+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:41.542127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867273+0000","last_change":"2023-10-09T06:31:50.867207+0000","last_active":"2023-10-09T06:31:50.867273+0000","last_peered":"2023-10-09T06:31:50.867273+0000","last_clean":"2023-10-09T06:31:50.867273+0000","last_became_active":"2023-10-09T06:31:50.866965+0000","last_became_peered":"2023-10-09T06:31:50.866965+0000","last_unstale":"2023-10-09T06:31:50.867273+0000","last_undegraded":"2023-10-09T06:31:50.867273+0000","last_fullsized":"2023-10-09T06:31:50.867273+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:22.062533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867240+0000","last_change":"2023-10-09T06:31:50.867076+0000","last_active":"2023-10-09T06:31:50.867240+0000","last_peered":"2023-10-09T06:31:50.867240+0000","last_clean":"2023-10-09T06:31:50.867240+0000","last_became_active":"2023-10-09T06:31:50.866900+0000","last_became_peered":"2023-10-09T06:31:50.866900+0000","last_unstale":"2023-10-09T06:31:50.867240+0000","last_undegraded":"2023-10-09T06:31:50.867240+0000","last_fullsized":"2023-10-09T06:31:50.867240+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:14:08.743829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868911+0000","last_change":"2023-10-09T06:31:50.868862+0000","last_active":"2023-10-09T06:31:50.868911+0000","last_peered":"2023-10-09T06:31:50.868911+0000","last_clean":"2023-10-09T06:31:50.868911+0000","last_became_active":"2023-10-09T06:31:50.868642+0000","last_became_peered":"2023-10-09T06:31:50.868642+0000","last_unstale":"2023-10-09T06:31:50.868911+0000","last_undegraded":"2023-10-09T06:31:50.868911+0000","last_fullsized":"2023-10-09T06:31:50.868911+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:46.192949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.866027+0000","last_change":"2023-10-09T06:31:50.865911+0000","last_active":"2023-10-09T06:31:50.866027+0000","last_peered":"2023-10-09T06:31:50.866027+0000","last_clean":"2023-10-09T06:31:50.866027+0000","last_became_active":"2023-10-09T06:31:50.865553+0000","last_became_peered":"2023-10-09T06:31:50.865553+0000","last_unstale":"2023-10-09T06:31:50.866027+0000","last_undegraded":"2023-10-09T06:31:50.866027+0000","last_fullsized":"2023-10-09T06:31:50.866027+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:35.972452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867538+0000","last_change":"2023-10-09T06:31:50.866764+0000","last_active":"2023-10-09T06:31:50.867538+0000","last_peered":"2023-10-09T06:31:50.867538+0000","last_clean":"2023-10-09T06:31:50.867538+0000","last_became_active":"2023-10-09T06:31:50.865729+0000","last_became_peered":"2023-10-09T06:31:50.865729+0000","last_unstale":"2023-10-09T06:31:50.867538+0000","last_undegraded":"2023-10-09T06:31:50.867538+0000","last_fullsized":"2023-10-09T06:31:50.867538+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:52:29.407202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.862096+0000","last_change":"2023-10-09T06:31:50.860663+0000","last_active":"2023-10-09T06:31:50.862096+0000","last_peered":"2023-10-09T06:31:50.862096+0000","last_clean":"2023-10-09T06:31:50.862096+0000","last_became_active":"2023-10-09T06:31:50.860281+0000","last_became_peered":"2023-10-09T06:31:50.860281+0000","last_unstale":"2023-10-09T06:31:50.862096+0000","last_undegraded":"2023-10-09T06:31:50.862096+0000","last_fullsized":"2023-10-09T06:31:50.862096+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:06:15.147931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865539+0000","last_change":"2023-10-09T06:31:50.865440+0000","last_active":"2023-10-09T06:31:50.865539+0000","last_peered":"2023-10-09T06:31:50.865539+0000","last_clean":"2023-10-09T06:31:50.865539+0000","last_became_active":"2023-10-09T06:31:50.864838+0000","last_became_peered":"2023-10-09T06:31:50.864838+0000","last_unstale":"2023-10-09T06:31:50.865539+0000","last_undegraded":"2023-10-09T06:31:50.865539+0000","last_fullsized":"2023-10-09T06:31:50.865539+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:43.833704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"184'4","reported_seq":14,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.878366+0000","last_change":"2023-10-09T06:31:49.851032+0000","last_active":"2023-10-09T06:31:50.878366+0000","last_peered":"2023-10-09T06:31:50.878366+0000","last_clean":"2023-10-09T06:31:50.878366+0000","last_became_active":"2023-10-09T06:31:49.850763+0000","last_became_peered":"2023-10-09T06:31:49.850763+0000","last_unstale":"2023-10-09T06:31:50.878366+0000","last_undegraded":"2023-10-09T06:31:50.878366+0000","last_fullsized":"2023-10-09T06:31:50.878366+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:32:51.881707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867520+0000","last_change":"2023-10-09T06:31:50.866563+0000","last_active":"2023-10-09T06:31:50.867520+0000","last_peered":"2023-10-09T06:31:50.867520+0000","last_clean":"2023-10-09T06:31:50.867520+0000","last_became_active":"2023-10-09T06:31:50.866051+0000","last_became_peered":"2023-10-09T06:31:50.866051+0000","last_unstale":"2023-10-09T06:31:50.867520+0000","last_undegraded":"2023-10-09T06:31:50.867520+0000","last_fullsized":"2023-10-09T06:31:50.867520+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:20:54.089203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.881653+0000","last_change":"2023-10-09T06:31:49.846376+0000","last_active":"2023-10-09T06:31:50.881653+0000","last_peered":"2023-10-09T06:31:50.881653+0000","last_clean":"2023-10-09T06:31:50.881653+0000","last_became_active":"2023-10-09T06:31:49.845509+0000","last_became_peered":"2023-10-09T06:31:49.845509+0000","last_unstale":"2023-10-09T06:31:50.881653+0000","last_undegraded":"2023-10-09T06:31:50.881653+0000","last_fullsized":"2023-10-09T06:31:50.881653+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:03.435952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.864721+0000","last_change":"2023-10-09T06:31:50.864664+0000","last_active":"2023-10-09T06:31:50.864721+0000","last_peered":"2023-10-09T06:31:50.864721+0000","last_clean":"2023-10-09T06:31:50.864721+0000","last_became_active":"2023-10-09T06:31:50.864101+0000","last_became_peered":"2023-10-09T06:31:50.864101+0000","last_unstale":"2023-10-09T06:31:50.864721+0000","last_undegraded":"2023-10-09T06:31:50.864721+0000","last_fullsized":"2023-10-09T06:31:50.864721+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:16.250085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.878824+0000","last_change":"2023-10-09T06:31:49.850145+0000","last_active":"2023-10-09T06:31:50.878824+0000","last_peered":"2023-10-09T06:31:50.878824+0000","last_clean":"2023-10-09T06:31:50.878824+0000","last_became_active":"2023-10-09T06:31:49.848039+0000","last_became_peered":"2023-10-09T06:31:49.848039+0000","last_unstale":"2023-10-09T06:31:50.878824+0000","last_undegraded":"2023-10-09T06:31:50.878824+0000","last_fullsized":"2023-10-09T06:31:50.878824+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:12.926146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863311+0000","last_change":"2023-10-09T06:31:50.863261+0000","last_active":"2023-10-09T06:31:50.863311+0000","last_peered":"2023-10-09T06:31:50.863311+0000","last_clean":"2023-10-09T06:31:50.863311+0000","last_became_active":"2023-10-09T06:31:50.863002+0000","last_became_peered":"2023-10-09T06:31:50.863002+0000","last_unstale":"2023-10-09T06:31:50.863311+0000","last_undegraded":"2023-10-09T06:31:50.863311+0000","last_fullsized":"2023-10-09T06:31:50.863311+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:35.972452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.880460+0000","last_change":"2023-10-09T06:31:49.848937+0000","last_active":"2023-10-09T06:31:50.880460+0000","last_peered":"2023-10-09T06:31:50.880460+0000","last_clean":"2023-10-09T06:31:50.880460+0000","last_became_active":"2023-10-09T06:31:49.848682+0000","last_became_peered":"2023-10-09T06:31:49.848682+0000","last_unstale":"2023-10-09T06:31:50.880460+0000","last_undegraded":"2023-10-09T06:31:50.880460+0000","last_fullsized":"2023-10-09T06:31:50.880460+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:26.550942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863847+0000","last_change":"2023-10-09T06:31:50.863604+0000","last_active":"2023-10-09T06:31:50.863847+0000","last_peered":"2023-10-09T06:31:50.863847+0000","last_clean":"2023-10-09T06:31:50.863847+0000","last_became_active":"2023-10-09T06:31:50.863405+0000","last_became_peered":"2023-10-09T06:31:50.863405+0000","last_unstale":"2023-10-09T06:31:50.863847+0000","last_undegraded":"2023-10-09T06:31:50.863847+0000","last_fullsized":"2023-10-09T06:31:50.863847+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:26.969106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.876666+0000","last_change":"2023-10-09T06:31:49.850430+0000","last_active":"2023-10-09T06:31:50.876666+0000","last_peered":"2023-10-09T06:31:50.876666+0000","last_clean":"2023-10-09T06:31:50.876666+0000","last_became_active":"2023-10-09T06:31:49.850080+0000","last_became_peered":"2023-10-09T06:31:49.850080+0000","last_unstale":"2023-10-09T06:31:50.876666+0000","last_undegraded":"2023-10-09T06:31:50.876666+0000","last_fullsized":"2023-10-09T06:31:50.876666+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:40:45.840449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.870838+0000","last_change":"2023-10-09T06:31:50.870730+0000","last_active":"2023-10-09T06:31:50.870838+0000","last_peered":"2023-10-09T06:31:50.870838+0000","last_clean":"2023-10-09T06:31:50.870838+0000","last_became_active":"2023-10-09T06:31:50.870256+0000","last_became_peered":"2023-10-09T06:31:50.870256+0000","last_unstale":"2023-10-09T06:31:50.870838+0000","last_undegraded":"2023-10-09T06:31:50.870838+0000","last_fullsized":"2023-10-09T06:31:50.870838+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:10.436182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.880207+0000","last_change":"2023-10-09T06:31:49.848370+0000","last_active":"2023-10-09T06:31:50.880207+0000","last_peered":"2023-10-09T06:31:50.880207+0000","last_clean":"2023-10-09T06:31:50.880207+0000","last_became_active":"2023-10-09T06:31:49.847908+0000","last_became_peered":"2023-10-09T06:31:49.847908+0000","last_unstale":"2023-10-09T06:31:50.880207+0000","last_undegraded":"2023-10-09T06:31:50.880207+0000","last_fullsized":"2023-10-09T06:31:50.880207+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:09.347969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868954+0000","last_change":"2023-10-09T06:31:50.868859+0000","last_active":"2023-10-09T06:31:50.868954+0000","last_peered":"2023-10-09T06:31:50.868954+0000","last_clean":"2023-10-09T06:31:50.868954+0000","last_became_active":"2023-10-09T06:31:50.868082+0000","last_became_peered":"2023-10-09T06:31:50.868082+0000","last_unstale":"2023-10-09T06:31:50.868954+0000","last_undegraded":"2023-10-09T06:31:50.868954+0000","last_fullsized":"2023-10-09T06:31:50.868954+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:59.722788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.855767+0000","last_change":"2023-10-09T06:31:49.845656+0000","last_active":"2023-10-09T06:31:50.855767+0000","last_peered":"2023-10-09T06:31:50.855767+0000","last_clean":"2023-10-09T06:31:50.855767+0000","last_became_active":"2023-10-09T06:31:49.844972+0000","last_became_peered":"2023-10-09T06:31:49.844972+0000","last_unstale":"2023-10-09T06:31:50.855767+0000","last_undegraded":"2023-10-09T06:31:50.855767+0000","last_fullsized":"2023-10-09T06:31:50.855767+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:28.460116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865850+0000","last_change":"2023-10-09T06:31:50.865786+0000","last_active":"2023-10-09T06:31:50.865850+0000","last_peered":"2023-10-09T06:31:50.865850+0000","last_clean":"2023-10-09T06:31:50.865850+0000","last_became_active":"2023-10-09T06:31:50.865558+0000","last_became_peered":"2023-10-09T06:31:50.865558+0000","last_unstale":"2023-10-09T06:31:50.865850+0000","last_undegraded":"2023-10-09T06:31:50.865850+0000","last_fullsized":"2023-10-09T06:31:50.865850+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:29:54.170807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861009+0000","last_change":"2023-10-09T06:31:49.841777+0000","last_active":"2023-10-09T06:31:50.861009+0000","last_peered":"2023-10-09T06:31:50.861009+0000","last_clean":"2023-10-09T06:31:50.861009+0000","last_became_active":"2023-10-09T06:31:49.841552+0000","last_became_peered":"2023-10-09T06:31:49.841552+0000","last_unstale":"2023-10-09T06:31:50.861009+0000","last_undegraded":"2023-10-09T06:31:50.861009+0000","last_fullsized":"2023-10-09T06:31:50.861009+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:12:37.682310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.866493+0000","last_change":"2023-10-09T06:31:50.866428+0000","last_active":"2023-10-09T06:31:50.866493+0000","last_peered":"2023-10-09T06:31:50.866493+0000","last_clean":"2023-10-09T06:31:50.866493+0000","last_became_active":"2023-10-09T06:31:50.866193+0000","last_became_peered":"2023-10-09T06:31:50.866193+0000","last_unstale":"2023-10-09T06:31:50.866493+0000","last_undegraded":"2023-10-09T06:31:50.866493+0000","last_fullsized":"2023-10-09T06:31:50.866493+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:16.491703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.859387+0000","last_change":"2023-10-09T06:31:49.851388+0000","last_active":"2023-10-09T06:31:50.859387+0000","last_peered":"2023-10-09T06:31:50.859387+0000","last_clean":"2023-10-09T06:31:50.859387+0000","last_became_active":"2023-10-09T06:31:49.851147+0000","last_became_peered":"2023-10-09T06:31:49.851147+0000","last_unstale":"2023-10-09T06:31:50.859387+0000","last_undegraded":"2023-10-09T06:31:50.859387+0000","last_fullsized":"2023-10-09T06:31:50.859387+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:46:22.024278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867321+0000","last_change":"2023-10-09T06:31:50.867247+0000","last_active":"2023-10-09T06:31:50.867321+0000","last_peered":"2023-10-09T06:31:50.867321+0000","last_clean":"2023-10-09T06:31:50.867321+0000","last_became_active":"2023-10-09T06:31:50.866975+0000","last_became_peered":"2023-10-09T06:31:50.866975+0000","last_unstale":"2023-10-09T06:31:50.867321+0000","last_undegraded":"2023-10-09T06:31:50.867321+0000","last_fullsized":"2023-10-09T06:31:50.867321+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:56.810898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"184'3","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.880739+0000","last_change":"2023-10-09T06:31:49.844783+0000","last_active":"2023-10-09T06:31:50.880739+0000","last_peered":"2023-10-09T06:31:50.880739+0000","last_clean":"2023-10-09T06:31:50.880739+0000","last_became_active":"2023-10-09T06:31:49.844547+0000","last_became_peered":"2023-10-09T06:31:49.844547+0000","last_unstale":"2023-10-09T06:31:50.880739+0000","last_undegraded":"2023-10-09T06:31:50.880739+0000","last_fullsized":"2023-10-09T06:31:50.880739+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:20.249095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.866488+0000","last_change":"2023-10-09T06:31:50.866406+0000","last_active":"2023-10-09T06:31:50.866488+0000","last_peered":"2023-10-09T06:31:50.866488+0000","last_clean":"2023-10-09T06:31:50.866488+0000","last_became_active":"2023-10-09T06:31:50.865609+0000","last_became_peered":"2023-10-09T06:31:50.865609+0000","last_unstale":"2023-10-09T06:31:50.866488+0000","last_undegraded":"2023-10-09T06:31:50.866488+0000","last_fullsized":"2023-10-09T06:31:50.866488+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:14:34.826898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"184'6","reported_seq":16,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.882102+0000","last_change":"2023-10-09T06:31:49.846525+0000","last_active":"2023-10-09T06:31:50.882102+0000","last_peered":"2023-10-09T06:31:50.882102+0000","last_clean":"2023-10-09T06:31:50.882102+0000","last_became_active":"2023-10-09T06:31:49.845845+0000","last_became_peered":"2023-10-09T06:31:49.845845+0000","last_unstale":"2023-10-09T06:31:50.882102+0000","last_undegraded":"2023-10-09T06:31:50.882102+0000","last_fullsized":"2023-10-09T06:31:50.882102+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:34.005739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.857361+0000","last_change":"2023-10-09T06:31:50.857159+0000","last_active":"2023-10-09T06:31:50.857361+0000","last_peered":"2023-10-09T06:31:50.857361+0000","last_clean":"2023-10-09T06:31:50.857361+0000","last_became_active":"2023-10-09T06:31:50.856959+0000","last_became_peered":"2023-10-09T06:31:50.856959+0000","last_unstale":"2023-10-09T06:31:50.857361+0000","last_undegraded":"2023-10-09T06:31:50.857361+0000","last_fullsized":"2023-10-09T06:31:50.857361+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:00:48.720222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.878906+0000","last_change":"2023-10-09T06:31:49.850315+0000","last_active":"2023-10-09T06:31:50.878906+0000","last_peered":"2023-10-09T06:31:50.878906+0000","last_clean":"2023-10-09T06:31:50.878906+0000","last_became_active":"2023-10-09T06:31:49.848368+0000","last_became_peered":"2023-10-09T06:31:49.848368+0000","last_unstale":"2023-10-09T06:31:50.878906+0000","last_undegraded":"2023-10-09T06:31:50.878906+0000","last_fullsized":"2023-10-09T06:31:50.878906+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:29.475235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.864089+0000","last_change":"2023-10-09T06:31:50.864024+0000","last_active":"2023-10-09T06:31:50.864089+0000","last_peered":"2023-10-09T06:31:50.864089+0000","last_clean":"2023-10-09T06:31:50.864089+0000","last_became_active":"2023-10-09T06:31:50.863791+0000","last_became_peered":"2023-10-09T06:31:50.863791+0000","last_unstale":"2023-10-09T06:31:50.864089+0000","last_undegraded":"2023-10-09T06:31:50.864089+0000","last_fullsized":"2023-10-09T06:31:50.864089+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:06:15.147931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.856250+0000","last_change":"2023-10-09T06:31:49.849455+0000","last_active":"2023-10-09T06:31:50.856250+0000","last_peered":"2023-10-09T06:31:50.856250+0000","last_clean":"2023-10-09T06:31:50.856250+0000","last_became_active":"2023-10-09T06:31:49.848961+0000","last_became_peered":"2023-10-09T06:31:49.848961+0000","last_unstale":"2023-10-09T06:31:50.856250+0000","last_undegraded":"2023-10-09T06:31:50.856250+0000","last_fullsized":"2023-10-09T06:31:50.856250+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:57.232670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867222+0000","last_change":"2023-10-09T06:31:50.866306+0000","last_active":"2023-10-09T06:31:50.867222+0000","last_peered":"2023-10-09T06:31:50.867222+0000","last_clean":"2023-10-09T06:31:50.867222+0000","last_became_active":"2023-10-09T06:31:50.866066+0000","last_became_peered":"2023-10-09T06:31:50.866066+0000","last_unstale":"2023-10-09T06:31:50.867222+0000","last_undegraded":"2023-10-09T06:31:50.867222+0000","last_fullsized":"2023-10-09T06:31:50.867222+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:48.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861811+0000","last_change":"2023-10-09T06:31:49.851292+0000","last_active":"2023-10-09T06:31:50.861811+0000","last_peered":"2023-10-09T06:31:50.861811+0000","last_clean":"2023-10-09T06:31:50.861811+0000","last_became_active":"2023-10-09T06:31:49.851095+0000","last_became_peered":"2023-10-09T06:31:49.851095+0000","last_unstale":"2023-10-09T06:31:50.861811+0000","last_undegraded":"2023-10-09T06:31:50.861811+0000","last_fullsized":"2023-10-09T06:31:50.861811+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:26.145307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.869008+0000","last_change":"2023-10-09T06:31:50.868948+0000","last_active":"2023-10-09T06:31:50.869008+0000","last_peered":"2023-10-09T06:31:50.869008+0000","last_clean":"2023-10-09T06:31:50.869008+0000","last_became_active":"2023-10-09T06:31:50.868720+0000","last_became_peered":"2023-10-09T06:31:50.868720+0000","last_unstale":"2023-10-09T06:31:50.869008+0000","last_undegraded":"2023-10-09T06:31:50.869008+0000","last_fullsized":"2023-10-09T06:31:50.869008+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:59.722788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"184'8","reported_seq":18,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.882233+0000","last_change":"2023-10-09T06:31:49.844219+0000","last_active":"2023-10-09T06:31:50.882233+0000","last_peered":"2023-10-09T06:31:50.882233+0000","last_clean":"2023-10-09T06:31:50.882233+0000","last_became_active":"2023-10-09T06:31:49.843877+0000","last_became_peered":"2023-10-09T06:31:49.843877+0000","last_unstale":"2023-10-09T06:31:50.882233+0000","last_undegraded":"2023-10-09T06:31:50.882233+0000","last_fullsized":"2023-10-09T06:31:50.882233+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:17:35.455105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.869058+0000","last_change":"2023-10-09T06:31:50.869014+0000","last_active":"2023-10-09T06:31:50.869058+0000","last_peered":"2023-10-09T06:31:50.869058+0000","last_clean":"2023-10-09T06:31:50.869058+0000","last_became_active":"2023-10-09T06:31:50.868560+0000","last_became_peered":"2023-10-09T06:31:50.868560+0000","last_unstale":"2023-10-09T06:31:50.869058+0000","last_undegraded":"2023-10-09T06:31:50.869058+0000","last_fullsized":"2023-10-09T06:31:50.869058+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:35.972452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.876916+0000","last_change":"2023-10-09T06:31:49.850373+0000","last_active":"2023-10-09T06:31:50.876916+0000","last_peered":"2023-10-09T06:31:50.876916+0000","last_clean":"2023-10-09T06:31:50.876916+0000","last_became_active":"2023-10-09T06:31:49.850141+0000","last_became_peered":"2023-10-09T06:31:49.850141+0000","last_unstale":"2023-10-09T06:31:50.876916+0000","last_undegraded":"2023-10-09T06:31:50.876916+0000","last_fullsized":"2023-10-09T06:31:50.876916+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:35:54.440529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.870126+0000","last_change":"2023-10-09T06:31:50.869799+0000","last_active":"2023-10-09T06:31:50.870126+0000","last_peered":"2023-10-09T06:31:50.870126+0000","last_clean":"2023-10-09T06:31:50.870126+0000","last_became_active":"2023-10-09T06:31:50.869549+0000","last_became_peered":"2023-10-09T06:31:50.869549+0000","last_unstale":"2023-10-09T06:31:50.870126+0000","last_undegraded":"2023-10-09T06:31:50.870126+0000","last_fullsized":"2023-10-09T06:31:50.870126+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:40:35.750099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.877197+0000","last_change":"2023-10-09T06:31:49.850480+0000","last_active":"2023-10-09T06:31:50.877197+0000","last_peered":"2023-10-09T06:31:50.877197+0000","last_clean":"2023-10-09T06:31:50.877197+0000","last_became_active":"2023-10-09T06:31:49.849821+0000","last_became_peered":"2023-10-09T06:31:49.849821+0000","last_unstale":"2023-10-09T06:31:50.877197+0000","last_undegraded":"2023-10-09T06:31:50.877197+0000","last_fullsized":"2023-10-09T06:31:50.877197+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:58.109101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.870641+0000","last_change":"2023-10-09T06:31:50.870572+0000","last_active":"2023-10-09T06:31:50.870641+0000","last_peered":"2023-10-09T06:31:50.870641+0000","last_clean":"2023-10-09T06:31:50.870641+0000","last_became_active":"2023-10-09T06:31:50.869992+0000","last_became_peered":"2023-10-09T06:31:50.869992+0000","last_unstale":"2023-10-09T06:31:50.870641+0000","last_undegraded":"2023-10-09T06:31:50.870641+0000","last_fullsized":"2023-10-09T06:31:50.870641+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:22.062533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.877434+0000","last_change":"2023-10-09T06:31:49.847099+0000","last_active":"2023-10-09T06:31:50.877434+0000","last_peered":"2023-10-09T06:31:50.877434+0000","last_clean":"2023-10-09T06:31:50.877434+0000","last_became_active":"2023-10-09T06:31:49.846455+0000","last_became_peered":"2023-10-09T06:31:49.846455+0000","last_unstale":"2023-10-09T06:31:50.877434+0000","last_undegraded":"2023-10-09T06:31:50.877434+0000","last_fullsized":"2023-10-09T06:31:50.877434+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:28.025693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868008+0000","last_change":"2023-10-09T06:31:50.867945+0000","last_active":"2023-10-09T06:31:50.868008+0000","last_peered":"2023-10-09T06:31:50.868008+0000","last_clean":"2023-10-09T06:31:50.868008+0000","last_became_active":"2023-10-09T06:31:50.867641+0000","last_became_peered":"2023-10-09T06:31:50.867641+0000","last_unstale":"2023-10-09T06:31:50.868008+0000","last_undegraded":"2023-10-09T06:31:50.868008+0000","last_fullsized":"2023-10-09T06:31:50.868008+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:16.491703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.858705+0000","last_change":"2023-10-09T06:31:49.846216+0000","last_active":"2023-10-09T06:31:50.858705+0000","last_peered":"2023-10-09T06:31:50.858705+0000","last_clean":"2023-10-09T06:31:50.858705+0000","last_became_active":"2023-10-09T06:31:49.845969+0000","last_became_peered":"2023-10-09T06:31:49.845969+0000","last_unstale":"2023-10-09T06:31:50.858705+0000","last_undegraded":"2023-10-09T06:31:50.858705+0000","last_fullsized":"2023-10-09T06:31:50.858705+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:02:35.380044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.857625+0000","last_change":"2023-10-09T06:31:50.857564+0000","last_active":"2023-10-09T06:31:50.857625+0000","last_peered":"2023-10-09T06:31:50.857625+0000","last_clean":"2023-10-09T06:31:50.857625+0000","last_became_active":"2023-10-09T06:31:50.857246+0000","last_became_peered":"2023-10-09T06:31:50.857246+0000","last_unstale":"2023-10-09T06:31:50.857625+0000","last_undegraded":"2023-10-09T06:31:50.857625+0000","last_fullsized":"2023-10-09T06:31:50.857625+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:10.436182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.879928+0000","last_change":"2023-10-09T06:31:49.848167+0000","last_active":"2023-10-09T06:31:50.879928+0000","last_peered":"2023-10-09T06:31:50.879928+0000","last_clean":"2023-10-09T06:31:50.879928+0000","last_became_active":"2023-10-09T06:31:49.847500+0000","last_became_peered":"2023-10-09T06:31:49.847500+0000","last_unstale":"2023-10-09T06:31:50.879928+0000","last_undegraded":"2023-10-09T06:31:50.879928+0000","last_fullsized":"2023-10-09T06:31:50.879928+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:40:45.840449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865303+0000","last_change":"2023-10-09T06:31:50.865236+0000","last_active":"2023-10-09T06:31:50.865303+0000","last_peered":"2023-10-09T06:31:50.865303+0000","last_clean":"2023-10-09T06:31:50.865303+0000","last_became_active":"2023-10-09T06:31:50.864992+0000","last_became_peered":"2023-10-09T06:31:50.864992+0000","last_unstale":"2023-10-09T06:31:50.865303+0000","last_undegraded":"2023-10-09T06:31:50.865303+0000","last_fullsized":"2023-10-09T06:31:50.865303+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:08:19.977754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.859140+0000","last_change":"2023-10-09T06:31:49.844218+0000","last_active":"2023-10-09T06:31:50.859140+0000","last_peered":"2023-10-09T06:31:50.859140+0000","last_clean":"2023-10-09T06:31:50.859140+0000","last_became_active":"2023-10-09T06:31:49.843964+0000","last_became_peered":"2023-10-09T06:31:49.843964+0000","last_unstale":"2023-10-09T06:31:50.859140+0000","last_undegraded":"2023-10-09T06:31:50.859140+0000","last_fullsized":"2023-10-09T06:31:50.859140+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:24.232424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.862339+0000","last_change":"2023-10-09T06:31:50.861724+0000","last_active":"2023-10-09T06:31:50.862339+0000","last_peered":"2023-10-09T06:31:50.862339+0000","last_clean":"2023-10-09T06:31:50.862339+0000","last_became_active":"2023-10-09T06:31:50.860573+0000","last_became_peered":"2023-10-09T06:31:50.860573+0000","last_unstale":"2023-10-09T06:31:50.862339+0000","last_undegraded":"2023-10-09T06:31:50.862339+0000","last_fullsized":"2023-10-09T06:31:50.862339+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:02.559983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865561+0000","last_change":"2023-10-09T06:31:49.850835+0000","last_active":"2023-10-09T06:31:50.865561+0000","last_peered":"2023-10-09T06:31:50.865561+0000","last_clean":"2023-10-09T06:31:50.865561+0000","last_became_active":"2023-10-09T06:31:49.850601+0000","last_became_peered":"2023-10-09T06:31:49.850601+0000","last_unstale":"2023-10-09T06:31:50.865561+0000","last_undegraded":"2023-10-09T06:31:50.865561+0000","last_fullsized":"2023-10-09T06:31:50.865561+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:02.669582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.862311+0000","last_change":"2023-10-09T06:31:50.862248+0000","last_active":"2023-10-09T06:31:50.862311+0000","last_peered":"2023-10-09T06:31:50.862311+0000","last_clean":"2023-10-09T06:31:50.862311+0000","last_became_active":"2023-10-09T06:31:50.862018+0000","last_became_peered":"2023-10-09T06:31:50.862018+0000","last_unstale":"2023-10-09T06:31:50.862311+0000","last_undegraded":"2023-10-09T06:31:50.862311+0000","last_fullsized":"2023-10-09T06:31:50.862311+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:12.173738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.859134+0000","last_change":"2023-10-09T06:31:49.847265+0000","last_active":"2023-10-09T06:31:50.859134+0000","last_peered":"2023-10-09T06:31:50.859134+0000","last_clean":"2023-10-09T06:31:50.859134+0000","last_became_active":"2023-10-09T06:31:49.846780+0000","last_became_peered":"2023-10-09T06:31:49.846780+0000","last_unstale":"2023-10-09T06:31:50.859134+0000","last_undegraded":"2023-10-09T06:31:50.859134+0000","last_fullsized":"2023-10-09T06:31:50.859134+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:50.615999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867272+0000","last_change":"2023-10-09T06:31:50.866593+0000","last_active":"2023-10-09T06:31:50.867272+0000","last_peered":"2023-10-09T06:31:50.867272+0000","last_clean":"2023-10-09T06:31:50.867272+0000","last_became_active":"2023-10-09T06:31:50.866331+0000","last_became_peered":"2023-10-09T06:31:50.866331+0000","last_unstale":"2023-10-09T06:31:50.867272+0000","last_undegraded":"2023-10-09T06:31:50.867272+0000","last_fullsized":"2023-10-09T06:31:50.867272+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:08:19.977754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.877823+0000","last_change":"2023-10-09T06:31:49.850048+0000","last_active":"2023-10-09T06:31:50.877823+0000","last_peered":"2023-10-09T06:31:50.877823+0000","last_clean":"2023-10-09T06:31:50.877823+0000","last_became_active":"2023-10-09T06:31:49.849817+0000","last_became_peered":"2023-10-09T06:31:49.849817+0000","last_unstale":"2023-10-09T06:31:50.877823+0000","last_undegraded":"2023-10-09T06:31:50.877823+0000","last_fullsized":"2023-10-09T06:31:50.877823+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:57.682499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868688+0000","last_change":"2023-10-09T06:31:50.868514+0000","last_active":"2023-10-09T06:31:50.868688+0000","last_peered":"2023-10-09T06:31:50.868688+0000","last_clean":"2023-10-09T06:31:50.868688+0000","last_became_active":"2023-10-09T06:31:50.867822+0000","last_became_peered":"2023-10-09T06:31:50.867822+0000","last_unstale":"2023-10-09T06:31:50.868688+0000","last_undegraded":"2023-10-09T06:31:50.868688+0000","last_fullsized":"2023-10-09T06:31:50.868688+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:30.486854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.855765+0000","last_change":"2023-10-09T06:31:49.846759+0000","last_active":"2023-10-09T06:31:50.855765+0000","last_peered":"2023-10-09T06:31:50.855765+0000","last_clean":"2023-10-09T06:31:50.855765+0000","last_became_active":"2023-10-09T06:31:49.846532+0000","last_became_peered":"2023-10-09T06:31:49.846532+0000","last_unstale":"2023-10-09T06:31:50.855765+0000","last_undegraded":"2023-10-09T06:31:50.855765+0000","last_fullsized":"2023-10-09T06:31:50.855765+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:49.395747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867570+0000","last_change":"2023-10-09T06:31:50.867498+0000","last_active":"2023-10-09T06:31:50.867570+0000","last_peered":"2023-10-09T06:31:50.867570+0000","last_clean":"2023-10-09T06:31:50.867570+0000","last_became_active":"2023-10-09T06:31:50.867260+0000","last_became_peered":"2023-10-09T06:31:50.867260+0000","last_unstale":"2023-10-09T06:31:50.867570+0000","last_undegraded":"2023-10-09T06:31:50.867570+0000","last_fullsized":"2023-10-09T06:31:50.867570+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:14.224730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.855857+0000","last_change":"2023-10-09T06:31:49.844089+0000","last_active":"2023-10-09T06:31:50.855857+0000","last_peered":"2023-10-09T06:31:50.855857+0000","last_clean":"2023-10-09T06:31:50.855857+0000","last_became_active":"2023-10-09T06:31:49.843845+0000","last_became_peered":"2023-10-09T06:31:49.843845+0000","last_unstale":"2023-10-09T06:31:50.855857+0000","last_undegraded":"2023-10-09T06:31:50.855857+0000","last_fullsized":"2023-10-09T06:31:50.855857+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:28:35.351596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863123+0000","last_change":"2023-10-09T06:31:50.863037+0000","last_active":"2023-10-09T06:31:50.863123+0000","last_peered":"2023-10-09T06:31:50.863123+0000","last_clean":"2023-10-09T06:31:50.863123+0000","last_became_active":"2023-10-09T06:31:50.862802+0000","last_became_peered":"2023-10-09T06:31:50.862802+0000","last_unstale":"2023-10-09T06:31:50.863123+0000","last_undegraded":"2023-10-09T06:31:50.863123+0000","last_fullsized":"2023-10-09T06:31:50.863123+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:29.009492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.856835+0000","last_change":"2023-10-09T06:31:49.852424+0000","last_active":"2023-10-09T06:31:50.856835+0000","last_peered":"2023-10-09T06:31:50.856835+0000","last_clean":"2023-10-09T06:31:50.856835+0000","last_became_active":"2023-10-09T06:31:49.852213+0000","last_became_peered":"2023-10-09T06:31:49.852213+0000","last_unstale":"2023-10-09T06:31:50.856835+0000","last_undegraded":"2023-10-09T06:31:50.856835+0000","last_fullsized":"2023-10-09T06:31:50.856835+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:08.064089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.862075+0000","last_change":"2023-10-09T06:31:50.860509+0000","last_active":"2023-10-09T06:31:50.862075+0000","last_peered":"2023-10-09T06:31:50.862075+0000","last_clean":"2023-10-09T06:31:50.862075+0000","last_became_active":"2023-10-09T06:31:50.859983+0000","last_became_peered":"2023-10-09T06:31:50.859983+0000","last_unstale":"2023-10-09T06:31:50.862075+0000","last_undegraded":"2023-10-09T06:31:50.862075+0000","last_fullsized":"2023-10-09T06:31:50.862075+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:41.542127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865453+0000","last_change":"2023-10-09T06:31:49.844513+0000","last_active":"2023-10-09T06:31:50.865453+0000","last_peered":"2023-10-09T06:31:50.865453+0000","last_clean":"2023-10-09T06:31:50.865453+0000","last_became_active":"2023-10-09T06:31:49.844291+0000","last_became_peered":"2023-10-09T06:31:49.844291+0000","last_unstale":"2023-10-09T06:31:50.865453+0000","last_undegraded":"2023-10-09T06:31:50.865453+0000","last_fullsized":"2023-10-09T06:31:50.865453+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:28:35.351596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867566+0000","last_change":"2023-10-09T06:31:50.866882+0000","last_active":"2023-10-09T06:31:50.867566+0000","last_peered":"2023-10-09T06:31:50.867566+0000","last_clean":"2023-10-09T06:31:50.867566+0000","last_became_active":"2023-10-09T06:31:50.866465+0000","last_became_peered":"2023-10-09T06:31:50.866465+0000","last_unstale":"2023-10-09T06:31:50.867566+0000","last_undegraded":"2023-10-09T06:31:50.867566+0000","last_fullsized":"2023-10-09T06:31:50.867566+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:48.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861907+0000","last_change":"2023-10-09T06:31:49.846601+0000","last_active":"2023-10-09T06:31:50.861907+0000","last_peered":"2023-10-09T06:31:50.861907+0000","last_clean":"2023-10-09T06:31:50.861907+0000","last_became_active":"2023-10-09T06:31:49.846364+0000","last_became_peered":"2023-10-09T06:31:49.846364+0000","last_unstale":"2023-10-09T06:31:50.861907+0000","last_undegraded":"2023-10-09T06:31:50.861907+0000","last_fullsized":"2023-10-09T06:31:50.861907+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:41.507001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865641+0000","last_change":"2023-10-09T06:31:50.865581+0000","last_active":"2023-10-09T06:31:50.865641+0000","last_peered":"2023-10-09T06:31:50.865641+0000","last_clean":"2023-10-09T06:31:50.865641+0000","last_became_active":"2023-10-09T06:31:50.865200+0000","last_became_peered":"2023-10-09T06:31:50.865200+0000","last_unstale":"2023-10-09T06:31:50.865641+0000","last_undegraded":"2023-10-09T06:31:50.865641+0000","last_fullsized":"2023-10-09T06:31:50.865641+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:06.602929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.854375+0000","last_change":"2023-10-09T06:31:49.844813+0000","last_active":"2023-10-09T06:31:50.854375+0000","last_peered":"2023-10-09T06:31:50.854375+0000","last_clean":"2023-10-09T06:31:50.854375+0000","last_became_active":"2023-10-09T06:31:49.844539+0000","last_became_peered":"2023-10-09T06:31:49.844539+0000","last_unstale":"2023-10-09T06:31:50.854375+0000","last_undegraded":"2023-10-09T06:31:50.854375+0000","last_fullsized":"2023-10-09T06:31:50.854375+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:38.320831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.864347+0000","last_change":"2023-10-09T06:31:50.864276+0000","last_active":"2023-10-09T06:31:50.864347+0000","last_peered":"2023-10-09T06:31:50.864347+0000","last_clean":"2023-10-09T06:31:50.864347+0000","last_became_active":"2023-10-09T06:31:50.863585+0000","last_became_peered":"2023-10-09T06:31:50.863585+0000","last_unstale":"2023-10-09T06:31:50.864347+0000","last_undegraded":"2023-10-09T06:31:50.864347+0000","last_fullsized":"2023-10-09T06:31:50.864347+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:29.464179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867568+0000","last_change":"2023-10-09T06:31:49.846676+0000","last_active":"2023-10-09T06:31:50.867568+0000","last_peered":"2023-10-09T06:31:50.867568+0000","last_clean":"2023-10-09T06:31:50.867568+0000","last_became_active":"2023-10-09T06:31:49.846148+0000","last_became_peered":"2023-10-09T06:31:49.846148+0000","last_unstale":"2023-10-09T06:31:50.867568+0000","last_undegraded":"2023-10-09T06:31:50.867568+0000","last_fullsized":"2023-10-09T06:31:50.867568+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:38.320831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.869121+0000","last_change":"2023-10-09T06:31:50.868648+0000","last_active":"2023-10-09T06:31:50.869121+0000","last_peered":"2023-10-09T06:31:50.869121+0000","last_clean":"2023-10-09T06:31:50.869121+0000","last_became_active":"2023-10-09T06:31:50.868413+0000","last_became_peered":"2023-10-09T06:31:50.868413+0000","last_unstale":"2023-10-09T06:31:50.869121+0000","last_undegraded":"2023-10-09T06:31:50.869121+0000","last_fullsized":"2023-10-09T06:31:50.869121+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:00.451963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865546+0000","last_change":"2023-10-09T06:31:49.849208+0000","last_active":"2023-10-09T06:31:50.865546+0000","last_peered":"2023-10-09T06:31:50.865546+0000","last_clean":"2023-10-09T06:31:50.865546+0000","last_became_active":"2023-10-09T06:31:49.848577+0000","last_became_peered":"2023-10-09T06:31:49.848577+0000","last_unstale":"2023-10-09T06:31:50.865546+0000","last_undegraded":"2023-10-09T06:31:50.865546+0000","last_fullsized":"2023-10-09T06:31:50.865546+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:28.460116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":306,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.859264+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:31:50.859264+0000","last_peered":"2023-10-09T06:31:50.859264+0000","last_clean":"2023-10-09T06:31:50.859264+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:31:50.859264+0000","last_undegraded":"2023-10-09T06:31:50.859264+0000","last_fullsized":"2023-10-09T06:31:50.859264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574984,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1591,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193720,"statfs":{"total":200000000,"available":198369933,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.5469999999999999},"last":0.498},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.28100000000000003},"max":{"1min":0.77300000000000002,"5min":0.81100000000000005,"15min":3.6970000000000001},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.52400000000000002},"min":{"1min":0.36599999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74299999999999999,"5min":0.80400000000000005,"15min":0.88100000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54800000000000004,"15min":0.52600000000000002},"min":{"1min":0.376,"5min":0.36399999999999999,"15min":0.26800000000000002},"max":{"1min":0.69599999999999995,"5min":0.80500000000000005,"15min":1.4870000000000001},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.45500000000000002,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":2.6139999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":2.6019999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55500000000000005,"15min":0.58499999999999996},"min":{"1min":0.40400000000000003,"5min":0.35799999999999998,"15min":0.318},"max":{"1min":0.78600000000000003,"5min":0.80900000000000005,"15min":7.4729999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":0.58299999999999996},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.76500000000000001,"5min":0.80500000000000005,"15min":7.8390000000000004},"last":0.55300000000000005}]},{"osd":4,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46100000000000002,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.23799999999999999},"max":{"1min":0.65300000000000002,"5min":0.76400000000000001,"15min":0.872},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.307,"5min":0.30599999999999999,"15min":0.25600000000000001},"max":{"1min":0.73999999999999999,"5min":0.77800000000000002,"15min":0.86099999999999999},"last":0.35599999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32200000000000001,"5min":0.316,"15min":0.255},"max":{"1min":0.71599999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.371},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.30599999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.98699999999999999},"last":0.39400000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.35499999999999998},"max":{"1min":0.77000000000000002,"5min":0.83599999999999997,"15min":0.93999999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.91400000000000003},"last":0.41899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574984,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.66600000000000004},"min":{"1min":0.39500000000000002,"5min":0.35299999999999998,"15min":0.26900000000000002},"max":{"1min":0.66800000000000004,"5min":0.76700000000000002,"15min":7.0960000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.434,"5min":0.35199999999999998,"15min":0.31},"max":{"1min":0.69999999999999996,"5min":0.80900000000000005,"15min":1.133},"last":0.61399999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.438,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":0.84399999999999997,"15min":1.155},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.40000000000000002,"15min":0.317},"max":{"1min":0.71199999999999997,"5min":0.82099999999999995,"15min":1.1459999999999999},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.433,"5min":0.39500000000000002,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":0.82999999999999996,"15min":1.2290000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57399999999999995,"15min":0.68300000000000005},"min":{"1min":0.375,"5min":0.36299999999999999,"15min":0.308},"max":{"1min":0.66100000000000003,"5min":0.89100000000000001,"15min":7.1299999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.41899999999999998,"5min":0.39700000000000002,"15min":0.34499999999999997},"max":{"1min":0.68799999999999994,"5min":0.85599999999999998,"15min":1.337},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.57299999999999995},"min":{"1min":0.44700000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.67300000000000004,"5min":0.80100000000000005,"15min":1.206},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47799999999999998,"15min":0.46500000000000002},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.28000000000000003},"max":{"1min":0.69399999999999995,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.312},"max":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.47799999999999998},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.312},"max":{"1min":0.64300000000000002,"5min":0.71999999999999997,"15min":0.80000000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.75,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38900000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.71199999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.44500000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.77900000000000003,"15min":0.82399999999999995},"last":0.40799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962517,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35499999999999998,"15min":0.36199999999999999},"min":{"1min":0.251,"5min":0.223,"15min":0.219},"max":{"1min":0.51500000000000001,"5min":0.58999999999999997,"15min":0.64000000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.373,"15min":0.35399999999999998},"min":{"1min":0.23899999999999999,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.40600000000000003,"5min":0.61499999999999999,"15min":0.93300000000000005},"last":0.35799999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35499999999999998,"15min":0.35299999999999998},"min":{"1min":0.25700000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.44,"5min":0.71399999999999997,"15min":0.82299999999999995},"last":0.376},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42199999999999999,"15min":0.40200000000000002},"min":{"1min":0.28799999999999998,"5min":0.27600000000000002,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.65500000000000003,"15min":0.70899999999999996},"last":0.442}]},{"osd":3,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.438},"min":{"1min":0.34000000000000002,"5min":0.32700000000000001,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":0.751,"15min":0.751},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.313,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.626,"5min":0.64900000000000002,"15min":0.90500000000000003},"last":0.50800000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58799999999999997,"15min":0.57399999999999995},"min":{"1min":0.44400000000000001,"5min":0.35699999999999998,"15min":0.315},"max":{"1min":0.72799999999999998,"5min":0.95699999999999996,"15min":1.097},"last":0.751},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61399999999999999,"15min":0.72199999999999998},"min":{"1min":0.497,"5min":0.42699999999999999,"15min":0.39200000000000002},"max":{"1min":0.88400000000000001,"5min":0.97699999999999998,"15min":5.5270000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.42699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.81499999999999995,"5min":1.0669999999999999,"15min":1.125},"last":0.88},{"interface":"front","average":{"1min":0.621,"5min":0.64600000000000002,"15min":0.65700000000000003},"min":{"1min":0.49299999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":1,"15min":1.4219999999999999},"last":0.80000000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64300000000000002,"15min":0.63400000000000001},"min":{"1min":0.46500000000000002,"5min":0.45500000000000002,"15min":0.39300000000000002},"max":{"1min":0.91500000000000004,"5min":1.0029999999999999,"15min":1.0629999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.38500000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.49},"last":0.70699999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66300000000000003,"15min":0.65200000000000002},"min":{"1min":0.503,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.77100000000000002,"5min":1.016,"15min":1.016},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.91500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193722,"statfs":{"total":200000000,"available":198372183,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.37,"15min":0.39300000000000002},"min":{"1min":0.255,"5min":0.216,"15min":0.20599999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":1.226},"last":0.373},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.28699999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.59299999999999997,"5min":0.82999999999999996,"15min":1.131},"last":0.28100000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.72599999999999998},"min":{"1min":0.29899999999999999,"5min":0.28299999999999997,"15min":0.25800000000000001},"max":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":12.929},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41999999999999998,"15min":0.44400000000000001},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.71499999999999997,"5min":0.751,"15min":1.1599999999999999},"last":0.34300000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46300000000000002,"15min":0.46899999999999997},"min":{"1min":0.30499999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.63700000000000001,"5min":0.78100000000000003,"15min":1.1859999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.47399999999999998},"min":{"1min":0.34399999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67800000000000005,"5min":0.70899999999999996,"15min":1.3089999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89200000000000002,"5min":0.90300000000000002,"15min":0.93200000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82799999999999996,"5min":0.90100000000000002,"15min":1.335},"last":0.63200000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84199999999999997,"5min":1.016,"15min":1.0580000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.61599999999999999,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.83599999999999997,"5min":0.98599999999999999,"15min":0.999},"last":0.66800000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76500000000000001,"5min":1.05,"15min":1.05},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41499999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.93700000000000006,"5min":1.032,"15min":1.2849999999999999},"last":0.50800000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68500000000000005,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.40500000000000003,"15min":0.40400000000000003},"max":{"1min":0.96599999999999997,"5min":0.97899999999999998,"15min":1.262},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.497,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89900000000000002,"5min":1.0660000000000001,"15min":1.103},"last":0.77900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.64400000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.19800000000000001},"max":{"1min":0.52300000000000002,"5min":0.65000000000000002,"15min":14.981999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.38400000000000001,"15min":0.54200000000000004},"min":{"1min":0.252,"5min":0.22,"15min":0.22},"max":{"1min":0.56499999999999995,"5min":0.64100000000000001,"15min":9.1600000000000001},"last":0.30299999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36599999999999999,"15min":0.51200000000000001},"min":{"1min":0.28299999999999997,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":8.4930000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41099999999999998,"15min":0.57799999999999996},"min":{"1min":0.27400000000000002,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":0.52600000000000002,"5min":0.67800000000000005,"15min":9.0239999999999991},"last":0.25900000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.58899999999999997},"min":{"1min":0.33000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60299999999999998,"5min":0.69399999999999995,"15min":8.5190000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.433,"5min":0.44400000000000001,"15min":0.71799999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.61799999999999999,"5min":0.748,"15min":15.007999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.91500000000000004},"min":{"1min":0.439,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.872,"5min":0.93799999999999994,"15min":14.917999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.80300000000000005},"min":{"1min":0.501,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88,"5min":0.92300000000000004,"15min":8.9930000000000003},"last":0.45700000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.78600000000000003},"min":{"1min":0.42799999999999999,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.80500000000000005,"5min":0.94599999999999995,"15min":8.9610000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.79700000000000004},"min":{"1min":0.45600000000000002,"5min":0.433,"15min":0.35099999999999998},"max":{"1min":0.85299999999999998,"5min":1.03,"15min":8.3919999999999995},"last":0.48499999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65400000000000003,"15min":0.78400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":0.97299999999999998,"15min":8.4339999999999993},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67300000000000004,"15min":0.92700000000000005},"min":{"1min":0.48799999999999999,"5min":0.44600000000000001,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":0.99099999999999999,"15min":14.954000000000001},"last":0.44500000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.77600000000000002},"min":{"1min":0.46100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76500000000000001,"5min":0.90600000000000003,"15min":8.9160000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.65300000000000002,"15min":0.79200000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":0.80400000000000005,"5min":0.91700000000000004,"15min":8.4640000000000004},"last":0.435}]}]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962517,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38400000000000001,"15min":0.35099999999999998},"min":{"1min":0.248,"5min":0.23000000000000001,"15min":0.19900000000000001},"max":{"1min":0.56000000000000005,"5min":0.58599999999999997,"15min":0.66800000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.442,"15min":0.40500000000000003},"min":{"1min":0.32800000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59799999999999998,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.23499999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38700000000000001,"15min":0.34899999999999998},"min":{"1min":0.28199999999999997,"5min":0.26500000000000001,"15min":0.215},"max":{"1min":0.58199999999999996,"5min":0.623,"15min":0.623},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.38600000000000001},"min":{"1min":0.29799999999999999,"5min":0.25700000000000001,"15min":0.23699999999999999},"max":{"1min":0.66600000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.28399999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41899999999999998,"15min":0.38400000000000001},"min":{"1min":0.309,"5min":0.27000000000000002,"15min":0.252},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.498,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32600000000000001,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.379,"15min":0.375},"max":{"1min":0.94499999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.59799999999999998},"min":{"1min":0.44,"5min":0.41799999999999998,"15min":0.33400000000000002},"max":{"1min":0.997,"5min":1.073,"15min":1.073},"last":0.41299999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.63900000000000001},"min":{"1min":0.47799999999999998,"5min":0.40500000000000003,"15min":0.33600000000000002},"max":{"1min":0.96899999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.64300000000000002},"min":{"1min":0.505,"5min":0.45200000000000001,"15min":0.38500000000000001},"max":{"1min":0.90800000000000003,"5min":1.097,"15min":1.097},"last":0.39600000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66800000000000004,"15min":0.61399999999999999},"min":{"1min":0.46100000000000002,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.372},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96499999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.44400000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68500000000000005,"15min":0.627},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.38800000000000001},"max":{"1min":0.98499999999999999,"5min":1.139,"15min":1.139},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.64100000000000001},"min":{"1min":0.49099999999999999,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.999,"5min":1.026,"15min":1.026},"last":0.40600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1014,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194297,"statfs":{"total":200000000,"available":198960945,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65400000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.44400000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.52600000000000002},"min":{"1min":0.42699999999999999,"5min":0.34300000000000003,"15min":0.254},"max":{"1min":0.72499999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54000000000000004,"15min":0.63800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.754,"5min":0.754,"15min":4.3250000000000002},"last":0.68100000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.63500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":4.7320000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56100000000000005,"15min":0.84399999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.32600000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":11.715},"last":0.58099999999999996}]},{"osd":3,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56799999999999995,"15min":0.54600000000000004},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.79100000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.46300000000000002,"5min":0.438,"15min":0.39000000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.85599999999999998},"last":0.498}]},{"osd":5,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.38300000000000001,"5min":0.27200000000000002,"15min":0.26800000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47799999999999998,"15min":0.504},"min":{"1min":0.375,"5min":0.253,"15min":0.253},"max":{"1min":0.70299999999999996,"5min":0.77100000000000002,"15min":0.82799999999999996},"last":0.39700000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.498,"15min":0.503},"min":{"1min":0.376,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.74399999999999999,"5min":0.80400000000000005,"15min":0.86699999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.46200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69399999999999995,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.626}]},{"osd":7,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.44500000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.747,"5min":0.81599999999999995,"15min":0.879},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.435,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.88600000000000001},"last":0.53500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198961975,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.42399999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":1.0289999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72899999999999998,"5min":0.78500000000000003,"15min":0.81899999999999995},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78600000000000003,"5min":0.82299999999999995,"15min":1.093},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56999999999999995,"15min":0.54200000000000004},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.82199999999999995,"15min":0.85499999999999998},"last":0.57299999999999995}]},{"osd":2,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54600000000000004,"15min":0.52900000000000003},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":0.79800000000000004,"15min":0.89300000000000002},"last":0.68899999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78300000000000003,"15min":0.98699999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.59499999999999997},"min":{"1min":0.499,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":1.071},"last":0.67400000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.48499999999999999},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.84399999999999997},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.503,"15min":0.501},"min":{"1min":0.34300000000000003,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.81000000000000005},"last":0.86599999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.745,"5min":0.745,"15min":1.0680000000000001},"last":0.746},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.442,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.754,"5min":0.78900000000000003,"15min":1.0920000000000001},"last":0.88}]},{"osd":7,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.373,"5min":0.317,"15min":0.30399999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.91900000000000004},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":1.0269999999999999},"last":0.77400000000000002}]}]}],"pool_statfs":[]}} 2023-10-09T06:31:54.969 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:31:55.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.123+0000 7fe8ee05f700 1 Processor -- start 2023-10-09T06:31:55.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.123+0000 7fe8ee05f700 1 -- start start 2023-10-09T06:31:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.124+0000 7fe8ee05f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe8e81577d0 0x7fe8e80cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.124+0000 7fe8ee05f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e806ac30 0x7fe8e815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.124+0000 7fe8ee05f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e815c360 con 0x7fe8e8157ba0 2023-10-09T06:31:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.124+0000 7fe8ee05f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e815b790 con 0x7fe8e81577d0 2023-10-09T06:31:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.124+0000 7fe8ee05f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e815ba30 con 0x7fe8e806ac30 2023-10-09T06:31:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.124+0000 7fe8e77fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe8e81577d0 0x7fe8e80cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.124+0000 7fe8e6ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe8e8157ba0 0x7fe8e806a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37902/0 (socket says 172.21.15.31:37902) 2023-10-09T06:31:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.124+0000 7fe8e6ffd700 1 -- 172.21.15.31:0/3197042722 learned_addr learned my addr 172.21.15.31:0/3197042722 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.125+0000 7fe8e7fff700 1 --2- 172.21.15.31:0/3197042722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e806ac30 0x7fe8e815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.125+0000 7fe8e77fe700 1 -- 172.21.15.31:0/3197042722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e806ac30 msgr2=0x7fe8e815c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.125+0000 7fe8e77fe700 1 --2- 172.21.15.31:0/3197042722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e806ac30 0x7fe8e815c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.125+0000 7fe8e77fe700 1 -- 172.21.15.31:0/3197042722 >> v1:172.21.15.31:6789/0 conn(0x7fe8e8157ba0 legacy=0x7fe8e806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.125+0000 7fe8e77fe700 1 -- 172.21.15.31:0/3197042722 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e815bd10 con 0x7fe8e81577d0 2023-10-09T06:31:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.125+0000 7fe8e67fc700 1 -- 172.21.15.31:0/3197042722 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246948980 0 0) 0x7fe8e815c360 con 0x7fe8e8157ba0 2023-10-09T06:31:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.125+0000 7fe8e7fff700 1 --2- 172.21.15.31:0/3197042722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e806ac30 0x7fe8e815c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:31:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.125+0000 7fe8e77fe700 1 --2- 172.21.15.31:0/3197042722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e81577d0 0x7fe8e80cd770 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80098e0 tx=0x7fe8d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60cdf0995de135b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.125+0000 7fe8e67fc700 1 -- 172.21.15.31:0/3197042722 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8009e80 con 0x7fe8e81577d0 2023-10-09T06:31:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.125+0000 7fe8e67fc700 1 -- 172.21.15.31:0/3197042722 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d800b860 con 0x7fe8e81577d0 2023-10-09T06:31:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.125+0000 7fe8e67fc700 1 -- 172.21.15.31:0/3197042722 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d800bbe0 con 0x7fe8e81577d0 2023-10-09T06:31:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.126+0000 7fe8ee05f700 1 -- 172.21.15.31:0/3197042722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e81577d0 msgr2=0x7fe8e80cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.126+0000 7fe8ee05f700 1 --2- 172.21.15.31:0/3197042722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e81577d0 0x7fe8e80cd770 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80098e0 tx=0x7fe8d80091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.126+0000 7fe8ee05f700 1 -- 172.21.15.31:0/3197042722 shutdown_connections 2023-10-09T06:31:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.126+0000 7fe8ee05f700 1 --2- 172.21.15.31:0/3197042722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e81577d0 0x7fe8e80cd770 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.126+0000 7fe8ee05f700 1 --2- 172.21.15.31:0/3197042722 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e806ac30 0x7fe8e815c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.126+0000 7fe8ee05f700 1 -- 172.21.15.31:0/3197042722 >> 172.21.15.31:0/3197042722 conn(0x7fe8e8068ce0 msgr2=0x7fe8e80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.126+0000 7fe8ee05f700 1 -- 172.21.15.31:0/3197042722 shutdown_connections 2023-10-09T06:31:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.126+0000 7fe8ee05f700 1 -- 172.21.15.31:0/3197042722 wait complete. 2023-10-09T06:31:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.127+0000 7fe8ee05f700 1 Processor -- start 2023-10-09T06:31:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.127+0000 7fe8ee05f700 1 -- start start 2023-10-09T06:31:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8ee05f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e806ac30 0x7fe8e813a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8ee05f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e81577d0 0x7fe8e81517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8ee05f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e8157ba0 0x7fe8e8151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8ee05f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e814cc90 con 0x7fe8e8157ba0 2023-10-09T06:31:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8ee05f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e8156300 con 0x7fe8e81577d0 2023-10-09T06:31:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8ee05f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e81565e0 con 0x7fe8e806ac30 2023-10-09T06:31:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8e7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e8157ba0 0x7fe8e8151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8e7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e8157ba0 0x7fe8e8151d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42774/0 (socket says 172.21.15.31:42774) 2023-10-09T06:31:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8e7fff700 1 -- 172.21.15.31:0/1538537820 learned_addr learned my addr 172.21.15.31:0/1538537820 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8e6ffd700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e81577d0 0x7fe8e81517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8e77fe700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e806ac30 0x7fe8e813a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8e7fff700 1 -- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e806ac30 msgr2=0x7fe8e813a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8e7fff700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e806ac30 0x7fe8e813a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8e7fff700 1 -- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e81577d0 msgr2=0x7fe8e81517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8e7fff700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e81577d0 0x7fe8e81517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8e7fff700 1 -- 172.21.15.31:0/1538537820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8009420 con 0x7fe8e8157ba0 2023-10-09T06:31:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8e7fff700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e8157ba0 0x7fe8e8151d00 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000cfc0 tx=0x7fe8e00078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8cf7fe700 1 -- 172.21.15.31:0/1538537820 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0015440 con 0x7fe8e8157ba0 2023-10-09T06:31:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8cf7fe700 1 -- 172.21.15.31:0/1538537820 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e00155a0 con 0x7fe8e8157ba0 2023-10-09T06:31:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8ee05f700 1 -- 172.21.15.31:0/1538537820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e80b0de0 con 0x7fe8e8157ba0 2023-10-09T06:31:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8cf7fe700 1 -- 172.21.15.31:0/1538537820 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0015960 con 0x7fe8e8157ba0 2023-10-09T06:31:55.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.128+0000 7fe8ee05f700 1 -- 172.21.15.31:0/1538537820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e80b13a0 con 0x7fe8e8157ba0 2023-10-09T06:31:55.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.129+0000 7fe8ee05f700 1 -- 172.21.15.31:0/1538537820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e80b15c0 con 0x7fe8e8157ba0 2023-10-09T06:31:55.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.130+0000 7fe8cf7fe700 1 -- 172.21.15.31:0/1538537820 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8e000d440 con 0x7fe8e8157ba0 2023-10-09T06:31:55.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.130+0000 7fe8cf7fe700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8d4066f30 0x7fe8d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.130+0000 7fe8cf7fe700 1 -- 172.21.15.31:0/1538537820 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe8e00851e0 con 0x7fe8e8157ba0 2023-10-09T06:31:55.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.130+0000 7fe8e77fe700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8d4066f30 0x7fe8d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.131+0000 7fe8e77fe700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8d4066f30 0x7fe8d40693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80091e0 tx=0x7fe8d8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:55.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.134+0000 7fe8cf7fe700 1 -- 172.21.15.31:0/1538537820 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8e0052450 con 0x7fe8e8157ba0 2023-10-09T06:31:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.321+0000 7fe8ee05f700 1 -- 172.21.15.31:0/1538537820 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8e804c3c0 con 0x7fe8d4066f30 2023-10-09T06:31:55.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.330+0000 7fe8cf7fe700 1 -- 172.21.15.31:0/1538537820 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285209 (secure 0 0 0) 0x7fe8e804c3c0 con 0x7fe8d4066f30 2023-10-09T06:31:55.334 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:55.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.333+0000 7fe8ee05f700 1 -- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8d4066f30 msgr2=0x7fe8d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.333+0000 7fe8ee05f700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8d4066f30 0x7fe8d40693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80091e0 tx=0x7fe8d8017000 comp rx=0 tx=0).stop 2023-10-09T06:31:55.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.333+0000 7fe8ee05f700 1 -- 172.21.15.31:0/1538537820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e8157ba0 msgr2=0x7fe8e8151d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.333+0000 7fe8ee05f700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e8157ba0 0x7fe8e8151d00 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000cfc0 tx=0x7fe8e00078d0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.333+0000 7fe8ee05f700 1 -- 172.21.15.31:0/1538537820 shutdown_connections 2023-10-09T06:31:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.333+0000 7fe8ee05f700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe8d4066f30 0x7fe8d40693e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.333+0000 7fe8ee05f700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe8e806ac30 0x7fe8e813a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.333+0000 7fe8ee05f700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e8157ba0 0x7fe8e8151d00 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.333+0000 7fe8ee05f700 1 --2- 172.21.15.31:0/1538537820 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8e81577d0 0x7fe8e81517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.333+0000 7fe8ee05f700 1 -- 172.21.15.31:0/1538537820 >> 172.21.15.31:0/1538537820 conn(0x7fe8e8068ce0 msgr2=0x7fe8e814d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.333+0000 7fe8ee05f700 1 -- 172.21.15.31:0/1538537820 shutdown_connections 2023-10-09T06:31:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.333+0000 7fe8ee05f700 1 -- 172.21.15.31:0/1538537820 wait complete. 2023-10-09T06:31:55.337 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:31:55.346 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":511,"stamp":"2023-10-09T06:31:54.676423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553237,"statfs":{"total":1600000000,"available":1590515060,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.841836"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.862365+0000","last_change":"2023-10-09T06:31:50.862229+0000","last_active":"2023-10-09T06:31:50.862365+0000","last_peered":"2023-10-09T06:31:50.862365+0000","last_clean":"2023-10-09T06:31:50.862365+0000","last_became_active":"2023-10-09T06:31:50.860945+0000","last_became_peered":"2023-10-09T06:31:50.860945+0000","last_unstale":"2023-10-09T06:31:50.862365+0000","last_undegraded":"2023-10-09T06:31:50.862365+0000","last_fullsized":"2023-10-09T06:31:50.862365+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:35:24.031139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863204+0000","last_change":"2023-10-09T06:31:50.862860+0000","last_active":"2023-10-09T06:31:50.863204+0000","last_peered":"2023-10-09T06:31:50.863204+0000","last_clean":"2023-10-09T06:31:50.863204+0000","last_became_active":"2023-10-09T06:31:50.862112+0000","last_became_peered":"2023-10-09T06:31:50.862112+0000","last_unstale":"2023-10-09T06:31:50.863204+0000","last_undegraded":"2023-10-09T06:31:50.863204+0000","last_fullsized":"2023-10-09T06:31:50.863204+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:20:54.089203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868667+0000","last_change":"2023-10-09T06:31:50.868529+0000","last_active":"2023-10-09T06:31:50.868667+0000","last_peered":"2023-10-09T06:31:50.868667+0000","last_clean":"2023-10-09T06:31:50.868667+0000","last_became_active":"2023-10-09T06:31:50.868241+0000","last_became_peered":"2023-10-09T06:31:50.868241+0000","last_unstale":"2023-10-09T06:31:50.868667+0000","last_undegraded":"2023-10-09T06:31:50.868667+0000","last_fullsized":"2023-10-09T06:31:50.868667+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:04.440015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.869977+0000","last_change":"2023-10-09T06:31:50.869697+0000","last_active":"2023-10-09T06:31:50.869977+0000","last_peered":"2023-10-09T06:31:50.869977+0000","last_clean":"2023-10-09T06:31:50.869977+0000","last_became_active":"2023-10-09T06:31:50.869450+0000","last_became_peered":"2023-10-09T06:31:50.869450+0000","last_unstale":"2023-10-09T06:31:50.869977+0000","last_undegraded":"2023-10-09T06:31:50.869977+0000","last_fullsized":"2023-10-09T06:31:50.869977+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:46.192949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.866726+0000","last_change":"2023-10-09T06:31:50.866656+0000","last_active":"2023-10-09T06:31:50.866726+0000","last_peered":"2023-10-09T06:31:50.866726+0000","last_clean":"2023-10-09T06:31:50.866726+0000","last_became_active":"2023-10-09T06:31:50.866118+0000","last_became_peered":"2023-10-09T06:31:50.866118+0000","last_unstale":"2023-10-09T06:31:50.866726+0000","last_undegraded":"2023-10-09T06:31:50.866726+0000","last_fullsized":"2023-10-09T06:31:50.866726+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:48:58.120745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865522+0000","last_change":"2023-10-09T06:31:50.865422+0000","last_active":"2023-10-09T06:31:50.865522+0000","last_peered":"2023-10-09T06:31:50.865522+0000","last_clean":"2023-10-09T06:31:50.865522+0000","last_became_active":"2023-10-09T06:31:50.864436+0000","last_became_peered":"2023-10-09T06:31:50.864436+0000","last_unstale":"2023-10-09T06:31:50.865522+0000","last_undegraded":"2023-10-09T06:31:50.865522+0000","last_fullsized":"2023-10-09T06:31:50.865522+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:27.283114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.869265+0000","last_change":"2023-10-09T06:31:50.868663+0000","last_active":"2023-10-09T06:31:50.869265+0000","last_peered":"2023-10-09T06:31:50.869265+0000","last_clean":"2023-10-09T06:31:50.869265+0000","last_became_active":"2023-10-09T06:31:50.868015+0000","last_became_peered":"2023-10-09T06:31:50.868015+0000","last_unstale":"2023-10-09T06:31:50.869265+0000","last_undegraded":"2023-10-09T06:31:50.869265+0000","last_fullsized":"2023-10-09T06:31:50.869265+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:05:12.363084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867707+0000","last_change":"2023-10-09T06:31:50.867643+0000","last_active":"2023-10-09T06:31:50.867707+0000","last_peered":"2023-10-09T06:31:50.867707+0000","last_clean":"2023-10-09T06:31:50.867707+0000","last_became_active":"2023-10-09T06:31:50.867405+0000","last_became_peered":"2023-10-09T06:31:50.867405+0000","last_unstale":"2023-10-09T06:31:50.867707+0000","last_undegraded":"2023-10-09T06:31:50.867707+0000","last_fullsized":"2023-10-09T06:31:50.867707+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:52:29.407202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861426+0000","last_change":"2023-10-09T06:31:50.861001+0000","last_active":"2023-10-09T06:31:50.861426+0000","last_peered":"2023-10-09T06:31:50.861426+0000","last_clean":"2023-10-09T06:31:50.861426+0000","last_became_active":"2023-10-09T06:31:50.860765+0000","last_became_peered":"2023-10-09T06:31:50.860765+0000","last_unstale":"2023-10-09T06:31:50.861426+0000","last_undegraded":"2023-10-09T06:31:50.861426+0000","last_fullsized":"2023-10-09T06:31:50.861426+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:51.099722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.866866+0000","last_change":"2023-10-09T06:31:50.866800+0000","last_active":"2023-10-09T06:31:50.866866+0000","last_peered":"2023-10-09T06:31:50.866866+0000","last_clean":"2023-10-09T06:31:50.866866+0000","last_became_active":"2023-10-09T06:31:50.866421+0000","last_became_peered":"2023-10-09T06:31:50.866421+0000","last_unstale":"2023-10-09T06:31:50.866866+0000","last_undegraded":"2023-10-09T06:31:50.866866+0000","last_fullsized":"2023-10-09T06:31:50.866866+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:58.686562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868029+0000","last_change":"2023-10-09T06:31:50.867779+0000","last_active":"2023-10-09T06:31:50.868029+0000","last_peered":"2023-10-09T06:31:50.868029+0000","last_clean":"2023-10-09T06:31:50.868029+0000","last_became_active":"2023-10-09T06:31:50.867507+0000","last_became_peered":"2023-10-09T06:31:50.867507+0000","last_unstale":"2023-10-09T06:31:50.868029+0000","last_undegraded":"2023-10-09T06:31:50.868029+0000","last_fullsized":"2023-10-09T06:31:50.868029+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:12:38.686373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863186+0000","last_change":"2023-10-09T06:31:50.862730+0000","last_active":"2023-10-09T06:31:50.863186+0000","last_peered":"2023-10-09T06:31:50.863186+0000","last_clean":"2023-10-09T06:31:50.863186+0000","last_became_active":"2023-10-09T06:31:50.861824+0000","last_became_peered":"2023-10-09T06:31:50.861824+0000","last_unstale":"2023-10-09T06:31:50.863186+0000","last_undegraded":"2023-10-09T06:31:50.863186+0000","last_fullsized":"2023-10-09T06:31:50.863186+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:48.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.857356+0000","last_change":"2023-10-09T06:31:50.857256+0000","last_active":"2023-10-09T06:31:50.857356+0000","last_peered":"2023-10-09T06:31:50.857356+0000","last_clean":"2023-10-09T06:31:50.857356+0000","last_became_active":"2023-10-09T06:31:50.857022+0000","last_became_peered":"2023-10-09T06:31:50.857022+0000","last_unstale":"2023-10-09T06:31:50.857356+0000","last_undegraded":"2023-10-09T06:31:50.857356+0000","last_fullsized":"2023-10-09T06:31:50.857356+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:04.407035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861311+0000","last_change":"2023-10-09T06:31:50.860592+0000","last_active":"2023-10-09T06:31:50.861311+0000","last_peered":"2023-10-09T06:31:50.861311+0000","last_clean":"2023-10-09T06:31:50.861311+0000","last_became_active":"2023-10-09T06:31:50.860350+0000","last_became_peered":"2023-10-09T06:31:50.860350+0000","last_unstale":"2023-10-09T06:31:50.861311+0000","last_undegraded":"2023-10-09T06:31:50.861311+0000","last_fullsized":"2023-10-09T06:31:50.861311+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:14:08.743829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867456+0000","last_change":"2023-10-09T06:31:50.867365+0000","last_active":"2023-10-09T06:31:50.867456+0000","last_peered":"2023-10-09T06:31:50.867456+0000","last_clean":"2023-10-09T06:31:50.867456+0000","last_became_active":"2023-10-09T06:31:50.867088+0000","last_became_peered":"2023-10-09T06:31:50.867088+0000","last_unstale":"2023-10-09T06:31:50.867456+0000","last_undegraded":"2023-10-09T06:31:50.867456+0000","last_fullsized":"2023-10-09T06:31:50.867456+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:56:50.863439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865548+0000","last_change":"2023-10-09T06:31:50.865482+0000","last_active":"2023-10-09T06:31:50.865548+0000","last_peered":"2023-10-09T06:31:50.865548+0000","last_clean":"2023-10-09T06:31:50.865548+0000","last_became_active":"2023-10-09T06:31:50.864963+0000","last_became_peered":"2023-10-09T06:31:50.864963+0000","last_unstale":"2023-10-09T06:31:50.865548+0000","last_undegraded":"2023-10-09T06:31:50.865548+0000","last_fullsized":"2023-10-09T06:31:50.865548+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:29.009492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.864156+0000","last_change":"2023-10-09T06:31:50.864071+0000","last_active":"2023-10-09T06:31:50.864156+0000","last_peered":"2023-10-09T06:31:50.864156+0000","last_clean":"2023-10-09T06:31:50.864156+0000","last_became_active":"2023-10-09T06:31:50.863845+0000","last_became_peered":"2023-10-09T06:31:50.863845+0000","last_unstale":"2023-10-09T06:31:50.864156+0000","last_undegraded":"2023-10-09T06:31:50.864156+0000","last_fullsized":"2023-10-09T06:31:50.864156+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:35:55.444592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863306+0000","last_change":"2023-10-09T06:31:50.863219+0000","last_active":"2023-10-09T06:31:50.863306+0000","last_peered":"2023-10-09T06:31:50.863306+0000","last_clean":"2023-10-09T06:31:50.863306+0000","last_became_active":"2023-10-09T06:31:50.862978+0000","last_became_peered":"2023-10-09T06:31:50.862978+0000","last_unstale":"2023-10-09T06:31:50.863306+0000","last_undegraded":"2023-10-09T06:31:50.863306+0000","last_fullsized":"2023-10-09T06:31:50.863306+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:06.602929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.869233+0000","last_change":"2023-10-09T06:31:50.869157+0000","last_active":"2023-10-09T06:31:50.869233+0000","last_peered":"2023-10-09T06:31:50.869233+0000","last_clean":"2023-10-09T06:31:50.869233+0000","last_became_active":"2023-10-09T06:31:50.868903+0000","last_became_peered":"2023-10-09T06:31:50.868903+0000","last_unstale":"2023-10-09T06:31:50.869233+0000","last_undegraded":"2023-10-09T06:31:50.869233+0000","last_fullsized":"2023-10-09T06:31:50.869233+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:33.048267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861292+0000","last_change":"2023-10-09T06:31:50.860561+0000","last_active":"2023-10-09T06:31:50.861292+0000","last_peered":"2023-10-09T06:31:50.861292+0000","last_clean":"2023-10-09T06:31:50.861292+0000","last_became_active":"2023-10-09T06:31:50.860297+0000","last_became_peered":"2023-10-09T06:31:50.860297+0000","last_unstale":"2023-10-09T06:31:50.861292+0000","last_undegraded":"2023-10-09T06:31:50.861292+0000","last_fullsized":"2023-10-09T06:31:50.861292+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:28:36.355659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861491+0000","last_change":"2023-10-09T06:31:50.861409+0000","last_active":"2023-10-09T06:31:50.861491+0000","last_peered":"2023-10-09T06:31:50.861491+0000","last_clean":"2023-10-09T06:31:50.861491+0000","last_became_active":"2023-10-09T06:31:50.861161+0000","last_became_peered":"2023-10-09T06:31:50.861161+0000","last_unstale":"2023-10-09T06:31:50.861491+0000","last_undegraded":"2023-10-09T06:31:50.861491+0000","last_fullsized":"2023-10-09T06:31:50.861491+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:06:13.127841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867424+0000","last_change":"2023-10-09T06:31:50.867365+0000","last_active":"2023-10-09T06:31:50.867424+0000","last_peered":"2023-10-09T06:31:50.867424+0000","last_clean":"2023-10-09T06:31:50.867424+0000","last_became_active":"2023-10-09T06:31:50.867167+0000","last_became_peered":"2023-10-09T06:31:50.867167+0000","last_unstale":"2023-10-09T06:31:50.867424+0000","last_undegraded":"2023-10-09T06:31:50.867424+0000","last_fullsized":"2023-10-09T06:31:50.867424+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:14:34.826898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863115+0000","last_change":"2023-10-09T06:31:50.863049+0000","last_active":"2023-10-09T06:31:50.863115+0000","last_peered":"2023-10-09T06:31:50.863115+0000","last_clean":"2023-10-09T06:31:50.863115+0000","last_became_active":"2023-10-09T06:31:50.862818+0000","last_became_peered":"2023-10-09T06:31:50.862818+0000","last_unstale":"2023-10-09T06:31:50.863115+0000","last_undegraded":"2023-10-09T06:31:50.863115+0000","last_fullsized":"2023-10-09T06:31:50.863115+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:24.297743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.857202+0000","last_change":"2023-10-09T06:31:50.857069+0000","last_active":"2023-10-09T06:31:50.857202+0000","last_peered":"2023-10-09T06:31:50.857202+0000","last_clean":"2023-10-09T06:31:50.857202+0000","last_became_active":"2023-10-09T06:31:50.856839+0000","last_became_peered":"2023-10-09T06:31:50.856839+0000","last_unstale":"2023-10-09T06:31:50.857202+0000","last_undegraded":"2023-10-09T06:31:50.857202+0000","last_fullsized":"2023-10-09T06:31:50.857202+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:58.236733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868381+0000","last_change":"2023-10-09T06:31:50.868310+0000","last_active":"2023-10-09T06:31:50.868381+0000","last_peered":"2023-10-09T06:31:50.868381+0000","last_clean":"2023-10-09T06:31:50.868381+0000","last_became_active":"2023-10-09T06:31:50.867981+0000","last_became_peered":"2023-10-09T06:31:50.867981+0000","last_unstale":"2023-10-09T06:31:50.868381+0000","last_undegraded":"2023-10-09T06:31:50.868381+0000","last_fullsized":"2023-10-09T06:31:50.868381+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:03.673645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863865+0000","last_change":"2023-10-09T06:31:50.863740+0000","last_active":"2023-10-09T06:31:50.863865+0000","last_peered":"2023-10-09T06:31:50.863865+0000","last_clean":"2023-10-09T06:31:50.863865+0000","last_became_active":"2023-10-09T06:31:50.863493+0000","last_became_peered":"2023-10-09T06:31:50.863493+0000","last_unstale":"2023-10-09T06:31:50.863865+0000","last_undegraded":"2023-10-09T06:31:50.863865+0000","last_fullsized":"2023-10-09T06:31:50.863865+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:41.542127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867273+0000","last_change":"2023-10-09T06:31:50.867207+0000","last_active":"2023-10-09T06:31:50.867273+0000","last_peered":"2023-10-09T06:31:50.867273+0000","last_clean":"2023-10-09T06:31:50.867273+0000","last_became_active":"2023-10-09T06:31:50.866965+0000","last_became_peered":"2023-10-09T06:31:50.866965+0000","last_unstale":"2023-10-09T06:31:50.867273+0000","last_undegraded":"2023-10-09T06:31:50.867273+0000","last_fullsized":"2023-10-09T06:31:50.867273+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:22.062533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867240+0000","last_change":"2023-10-09T06:31:50.867076+0000","last_active":"2023-10-09T06:31:50.867240+0000","last_peered":"2023-10-09T06:31:50.867240+0000","last_clean":"2023-10-09T06:31:50.867240+0000","last_became_active":"2023-10-09T06:31:50.866900+0000","last_became_peered":"2023-10-09T06:31:50.866900+0000","last_unstale":"2023-10-09T06:31:50.867240+0000","last_undegraded":"2023-10-09T06:31:50.867240+0000","last_fullsized":"2023-10-09T06:31:50.867240+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:14:08.743829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868911+0000","last_change":"2023-10-09T06:31:50.868862+0000","last_active":"2023-10-09T06:31:50.868911+0000","last_peered":"2023-10-09T06:31:50.868911+0000","last_clean":"2023-10-09T06:31:50.868911+0000","last_became_active":"2023-10-09T06:31:50.868642+0000","last_became_peered":"2023-10-09T06:31:50.868642+0000","last_unstale":"2023-10-09T06:31:50.868911+0000","last_undegraded":"2023-10-09T06:31:50.868911+0000","last_fullsized":"2023-10-09T06:31:50.868911+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:46.192949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.866027+0000","last_change":"2023-10-09T06:31:50.865911+0000","last_active":"2023-10-09T06:31:50.866027+0000","last_peered":"2023-10-09T06:31:50.866027+0000","last_clean":"2023-10-09T06:31:50.866027+0000","last_became_active":"2023-10-09T06:31:50.865553+0000","last_became_peered":"2023-10-09T06:31:50.865553+0000","last_unstale":"2023-10-09T06:31:50.866027+0000","last_undegraded":"2023-10-09T06:31:50.866027+0000","last_fullsized":"2023-10-09T06:31:50.866027+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:35.972452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867538+0000","last_change":"2023-10-09T06:31:50.866764+0000","last_active":"2023-10-09T06:31:50.867538+0000","last_peered":"2023-10-09T06:31:50.867538+0000","last_clean":"2023-10-09T06:31:50.867538+0000","last_became_active":"2023-10-09T06:31:50.865729+0000","last_became_peered":"2023-10-09T06:31:50.865729+0000","last_unstale":"2023-10-09T06:31:50.867538+0000","last_undegraded":"2023-10-09T06:31:50.867538+0000","last_fullsized":"2023-10-09T06:31:50.867538+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:52:29.407202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.862096+0000","last_change":"2023-10-09T06:31:50.860663+0000","last_active":"2023-10-09T06:31:50.862096+0000","last_peered":"2023-10-09T06:31:50.862096+0000","last_clean":"2023-10-09T06:31:50.862096+0000","last_became_active":"2023-10-09T06:31:50.860281+0000","last_became_peered":"2023-10-09T06:31:50.860281+0000","last_unstale":"2023-10-09T06:31:50.862096+0000","last_undegraded":"2023-10-09T06:31:50.862096+0000","last_fullsized":"2023-10-09T06:31:50.862096+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:06:15.147931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865539+0000","last_change":"2023-10-09T06:31:50.865440+0000","last_active":"2023-10-09T06:31:50.865539+0000","last_peered":"2023-10-09T06:31:50.865539+0000","last_clean":"2023-10-09T06:31:50.865539+0000","last_became_active":"2023-10-09T06:31:50.864838+0000","last_became_peered":"2023-10-09T06:31:50.864838+0000","last_unstale":"2023-10-09T06:31:50.865539+0000","last_undegraded":"2023-10-09T06:31:50.865539+0000","last_fullsized":"2023-10-09T06:31:50.865539+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:43.833704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"184'4","reported_seq":14,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.878366+0000","last_change":"2023-10-09T06:31:49.851032+0000","last_active":"2023-10-09T06:31:50.878366+0000","last_peered":"2023-10-09T06:31:50.878366+0000","last_clean":"2023-10-09T06:31:50.878366+0000","last_became_active":"2023-10-09T06:31:49.850763+0000","last_became_peered":"2023-10-09T06:31:49.850763+0000","last_unstale":"2023-10-09T06:31:50.878366+0000","last_undegraded":"2023-10-09T06:31:50.878366+0000","last_fullsized":"2023-10-09T06:31:50.878366+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:32:51.881707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867520+0000","last_change":"2023-10-09T06:31:50.866563+0000","last_active":"2023-10-09T06:31:50.867520+0000","last_peered":"2023-10-09T06:31:50.867520+0000","last_clean":"2023-10-09T06:31:50.867520+0000","last_became_active":"2023-10-09T06:31:50.866051+0000","last_became_peered":"2023-10-09T06:31:50.866051+0000","last_unstale":"2023-10-09T06:31:50.867520+0000","last_undegraded":"2023-10-09T06:31:50.867520+0000","last_fullsized":"2023-10-09T06:31:50.867520+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:20:54.089203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.881653+0000","last_change":"2023-10-09T06:31:49.846376+0000","last_active":"2023-10-09T06:31:50.881653+0000","last_peered":"2023-10-09T06:31:50.881653+0000","last_clean":"2023-10-09T06:31:50.881653+0000","last_became_active":"2023-10-09T06:31:49.845509+0000","last_became_peered":"2023-10-09T06:31:49.845509+0000","last_unstale":"2023-10-09T06:31:50.881653+0000","last_undegraded":"2023-10-09T06:31:50.881653+0000","last_fullsized":"2023-10-09T06:31:50.881653+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:03.435952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.864721+0000","last_change":"2023-10-09T06:31:50.864664+0000","last_active":"2023-10-09T06:31:50.864721+0000","last_peered":"2023-10-09T06:31:50.864721+0000","last_clean":"2023-10-09T06:31:50.864721+0000","last_became_active":"2023-10-09T06:31:50.864101+0000","last_became_peered":"2023-10-09T06:31:50.864101+0000","last_unstale":"2023-10-09T06:31:50.864721+0000","last_undegraded":"2023-10-09T06:31:50.864721+0000","last_fullsized":"2023-10-09T06:31:50.864721+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:16.250085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.878824+0000","last_change":"2023-10-09T06:31:49.850145+0000","last_active":"2023-10-09T06:31:50.878824+0000","last_peered":"2023-10-09T06:31:50.878824+0000","last_clean":"2023-10-09T06:31:50.878824+0000","last_became_active":"2023-10-09T06:31:49.848039+0000","last_became_peered":"2023-10-09T06:31:49.848039+0000","last_unstale":"2023-10-09T06:31:50.878824+0000","last_undegraded":"2023-10-09T06:31:50.878824+0000","last_fullsized":"2023-10-09T06:31:50.878824+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:12.926146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863311+0000","last_change":"2023-10-09T06:31:50.863261+0000","last_active":"2023-10-09T06:31:50.863311+0000","last_peered":"2023-10-09T06:31:50.863311+0000","last_clean":"2023-10-09T06:31:50.863311+0000","last_became_active":"2023-10-09T06:31:50.863002+0000","last_became_peered":"2023-10-09T06:31:50.863002+0000","last_unstale":"2023-10-09T06:31:50.863311+0000","last_undegraded":"2023-10-09T06:31:50.863311+0000","last_fullsized":"2023-10-09T06:31:50.863311+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:35.972452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.880460+0000","last_change":"2023-10-09T06:31:49.848937+0000","last_active":"2023-10-09T06:31:50.880460+0000","last_peered":"2023-10-09T06:31:50.880460+0000","last_clean":"2023-10-09T06:31:50.880460+0000","last_became_active":"2023-10-09T06:31:49.848682+0000","last_became_peered":"2023-10-09T06:31:49.848682+0000","last_unstale":"2023-10-09T06:31:50.880460+0000","last_undegraded":"2023-10-09T06:31:50.880460+0000","last_fullsized":"2023-10-09T06:31:50.880460+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:26.550942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863847+0000","last_change":"2023-10-09T06:31:50.863604+0000","last_active":"2023-10-09T06:31:50.863847+0000","last_peered":"2023-10-09T06:31:50.863847+0000","last_clean":"2023-10-09T06:31:50.863847+0000","last_became_active":"2023-10-09T06:31:50.863405+0000","last_became_peered":"2023-10-09T06:31:50.863405+0000","last_unstale":"2023-10-09T06:31:50.863847+0000","last_undegraded":"2023-10-09T06:31:50.863847+0000","last_fullsized":"2023-10-09T06:31:50.863847+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:26.969106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.876666+0000","last_change":"2023-10-09T06:31:49.850430+0000","last_active":"2023-10-09T06:31:50.876666+0000","last_peered":"2023-10-09T06:31:50.876666+0000","last_clean":"2023-10-09T06:31:50.876666+0000","last_became_active":"2023-10-09T06:31:49.850080+0000","last_became_peered":"2023-10-09T06:31:49.850080+0000","last_unstale":"2023-10-09T06:31:50.876666+0000","last_undegraded":"2023-10-09T06:31:50.876666+0000","last_fullsized":"2023-10-09T06:31:50.876666+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:40:45.840449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.870838+0000","last_change":"2023-10-09T06:31:50.870730+0000","last_active":"2023-10-09T06:31:50.870838+0000","last_peered":"2023-10-09T06:31:50.870838+0000","last_clean":"2023-10-09T06:31:50.870838+0000","last_became_active":"2023-10-09T06:31:50.870256+0000","last_became_peered":"2023-10-09T06:31:50.870256+0000","last_unstale":"2023-10-09T06:31:50.870838+0000","last_undegraded":"2023-10-09T06:31:50.870838+0000","last_fullsized":"2023-10-09T06:31:50.870838+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:10.436182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.880207+0000","last_change":"2023-10-09T06:31:49.848370+0000","last_active":"2023-10-09T06:31:50.880207+0000","last_peered":"2023-10-09T06:31:50.880207+0000","last_clean":"2023-10-09T06:31:50.880207+0000","last_became_active":"2023-10-09T06:31:49.847908+0000","last_became_peered":"2023-10-09T06:31:49.847908+0000","last_unstale":"2023-10-09T06:31:50.880207+0000","last_undegraded":"2023-10-09T06:31:50.880207+0000","last_fullsized":"2023-10-09T06:31:50.880207+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:09.347969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868954+0000","last_change":"2023-10-09T06:31:50.868859+0000","last_active":"2023-10-09T06:31:50.868954+0000","last_peered":"2023-10-09T06:31:50.868954+0000","last_clean":"2023-10-09T06:31:50.868954+0000","last_became_active":"2023-10-09T06:31:50.868082+0000","last_became_peered":"2023-10-09T06:31:50.868082+0000","last_unstale":"2023-10-09T06:31:50.868954+0000","last_undegraded":"2023-10-09T06:31:50.868954+0000","last_fullsized":"2023-10-09T06:31:50.868954+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:59.722788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.855767+0000","last_change":"2023-10-09T06:31:49.845656+0000","last_active":"2023-10-09T06:31:50.855767+0000","last_peered":"2023-10-09T06:31:50.855767+0000","last_clean":"2023-10-09T06:31:50.855767+0000","last_became_active":"2023-10-09T06:31:49.844972+0000","last_became_peered":"2023-10-09T06:31:49.844972+0000","last_unstale":"2023-10-09T06:31:50.855767+0000","last_undegraded":"2023-10-09T06:31:50.855767+0000","last_fullsized":"2023-10-09T06:31:50.855767+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:28.460116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865850+0000","last_change":"2023-10-09T06:31:50.865786+0000","last_active":"2023-10-09T06:31:50.865850+0000","last_peered":"2023-10-09T06:31:50.865850+0000","last_clean":"2023-10-09T06:31:50.865850+0000","last_became_active":"2023-10-09T06:31:50.865558+0000","last_became_peered":"2023-10-09T06:31:50.865558+0000","last_unstale":"2023-10-09T06:31:50.865850+0000","last_undegraded":"2023-10-09T06:31:50.865850+0000","last_fullsized":"2023-10-09T06:31:50.865850+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:29:54.170807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861009+0000","last_change":"2023-10-09T06:31:49.841777+0000","last_active":"2023-10-09T06:31:50.861009+0000","last_peered":"2023-10-09T06:31:50.861009+0000","last_clean":"2023-10-09T06:31:50.861009+0000","last_became_active":"2023-10-09T06:31:49.841552+0000","last_became_peered":"2023-10-09T06:31:49.841552+0000","last_unstale":"2023-10-09T06:31:50.861009+0000","last_undegraded":"2023-10-09T06:31:50.861009+0000","last_fullsized":"2023-10-09T06:31:50.861009+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:12:37.682310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.866493+0000","last_change":"2023-10-09T06:31:50.866428+0000","last_active":"2023-10-09T06:31:50.866493+0000","last_peered":"2023-10-09T06:31:50.866493+0000","last_clean":"2023-10-09T06:31:50.866493+0000","last_became_active":"2023-10-09T06:31:50.866193+0000","last_became_peered":"2023-10-09T06:31:50.866193+0000","last_unstale":"2023-10-09T06:31:50.866493+0000","last_undegraded":"2023-10-09T06:31:50.866493+0000","last_fullsized":"2023-10-09T06:31:50.866493+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:16.491703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.859387+0000","last_change":"2023-10-09T06:31:49.851388+0000","last_active":"2023-10-09T06:31:50.859387+0000","last_peered":"2023-10-09T06:31:50.859387+0000","last_clean":"2023-10-09T06:31:50.859387+0000","last_became_active":"2023-10-09T06:31:49.851147+0000","last_became_peered":"2023-10-09T06:31:49.851147+0000","last_unstale":"2023-10-09T06:31:50.859387+0000","last_undegraded":"2023-10-09T06:31:50.859387+0000","last_fullsized":"2023-10-09T06:31:50.859387+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:46:22.024278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867321+0000","last_change":"2023-10-09T06:31:50.867247+0000","last_active":"2023-10-09T06:31:50.867321+0000","last_peered":"2023-10-09T06:31:50.867321+0000","last_clean":"2023-10-09T06:31:50.867321+0000","last_became_active":"2023-10-09T06:31:50.866975+0000","last_became_peered":"2023-10-09T06:31:50.866975+0000","last_unstale":"2023-10-09T06:31:50.867321+0000","last_undegraded":"2023-10-09T06:31:50.867321+0000","last_fullsized":"2023-10-09T06:31:50.867321+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:56.810898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"184'3","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.880739+0000","last_change":"2023-10-09T06:31:49.844783+0000","last_active":"2023-10-09T06:31:50.880739+0000","last_peered":"2023-10-09T06:31:50.880739+0000","last_clean":"2023-10-09T06:31:50.880739+0000","last_became_active":"2023-10-09T06:31:49.844547+0000","last_became_peered":"2023-10-09T06:31:49.844547+0000","last_unstale":"2023-10-09T06:31:50.880739+0000","last_undegraded":"2023-10-09T06:31:50.880739+0000","last_fullsized":"2023-10-09T06:31:50.880739+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:20.249095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.866488+0000","last_change":"2023-10-09T06:31:50.866406+0000","last_active":"2023-10-09T06:31:50.866488+0000","last_peered":"2023-10-09T06:31:50.866488+0000","last_clean":"2023-10-09T06:31:50.866488+0000","last_became_active":"2023-10-09T06:31:50.865609+0000","last_became_peered":"2023-10-09T06:31:50.865609+0000","last_unstale":"2023-10-09T06:31:50.866488+0000","last_undegraded":"2023-10-09T06:31:50.866488+0000","last_fullsized":"2023-10-09T06:31:50.866488+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:14:34.826898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"184'6","reported_seq":16,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.882102+0000","last_change":"2023-10-09T06:31:49.846525+0000","last_active":"2023-10-09T06:31:50.882102+0000","last_peered":"2023-10-09T06:31:50.882102+0000","last_clean":"2023-10-09T06:31:50.882102+0000","last_became_active":"2023-10-09T06:31:49.845845+0000","last_became_peered":"2023-10-09T06:31:49.845845+0000","last_unstale":"2023-10-09T06:31:50.882102+0000","last_undegraded":"2023-10-09T06:31:50.882102+0000","last_fullsized":"2023-10-09T06:31:50.882102+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:34.005739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.857361+0000","last_change":"2023-10-09T06:31:50.857159+0000","last_active":"2023-10-09T06:31:50.857361+0000","last_peered":"2023-10-09T06:31:50.857361+0000","last_clean":"2023-10-09T06:31:50.857361+0000","last_became_active":"2023-10-09T06:31:50.856959+0000","last_became_peered":"2023-10-09T06:31:50.856959+0000","last_unstale":"2023-10-09T06:31:50.857361+0000","last_undegraded":"2023-10-09T06:31:50.857361+0000","last_fullsized":"2023-10-09T06:31:50.857361+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:00:48.720222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.878906+0000","last_change":"2023-10-09T06:31:49.850315+0000","last_active":"2023-10-09T06:31:50.878906+0000","last_peered":"2023-10-09T06:31:50.878906+0000","last_clean":"2023-10-09T06:31:50.878906+0000","last_became_active":"2023-10-09T06:31:49.848368+0000","last_became_peered":"2023-10-09T06:31:49.848368+0000","last_unstale":"2023-10-09T06:31:50.878906+0000","last_undegraded":"2023-10-09T06:31:50.878906+0000","last_fullsized":"2023-10-09T06:31:50.878906+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:29.475235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.864089+0000","last_change":"2023-10-09T06:31:50.864024+0000","last_active":"2023-10-09T06:31:50.864089+0000","last_peered":"2023-10-09T06:31:50.864089+0000","last_clean":"2023-10-09T06:31:50.864089+0000","last_became_active":"2023-10-09T06:31:50.863791+0000","last_became_peered":"2023-10-09T06:31:50.863791+0000","last_unstale":"2023-10-09T06:31:50.864089+0000","last_undegraded":"2023-10-09T06:31:50.864089+0000","last_fullsized":"2023-10-09T06:31:50.864089+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:06:15.147931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.856250+0000","last_change":"2023-10-09T06:31:49.849455+0000","last_active":"2023-10-09T06:31:50.856250+0000","last_peered":"2023-10-09T06:31:50.856250+0000","last_clean":"2023-10-09T06:31:50.856250+0000","last_became_active":"2023-10-09T06:31:49.848961+0000","last_became_peered":"2023-10-09T06:31:49.848961+0000","last_unstale":"2023-10-09T06:31:50.856250+0000","last_undegraded":"2023-10-09T06:31:50.856250+0000","last_fullsized":"2023-10-09T06:31:50.856250+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:57.232670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867222+0000","last_change":"2023-10-09T06:31:50.866306+0000","last_active":"2023-10-09T06:31:50.867222+0000","last_peered":"2023-10-09T06:31:50.867222+0000","last_clean":"2023-10-09T06:31:50.867222+0000","last_became_active":"2023-10-09T06:31:50.866066+0000","last_became_peered":"2023-10-09T06:31:50.866066+0000","last_unstale":"2023-10-09T06:31:50.867222+0000","last_undegraded":"2023-10-09T06:31:50.867222+0000","last_fullsized":"2023-10-09T06:31:50.867222+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:48.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861811+0000","last_change":"2023-10-09T06:31:49.851292+0000","last_active":"2023-10-09T06:31:50.861811+0000","last_peered":"2023-10-09T06:31:50.861811+0000","last_clean":"2023-10-09T06:31:50.861811+0000","last_became_active":"2023-10-09T06:31:49.851095+0000","last_became_peered":"2023-10-09T06:31:49.851095+0000","last_unstale":"2023-10-09T06:31:50.861811+0000","last_undegraded":"2023-10-09T06:31:50.861811+0000","last_fullsized":"2023-10-09T06:31:50.861811+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:26.145307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.869008+0000","last_change":"2023-10-09T06:31:50.868948+0000","last_active":"2023-10-09T06:31:50.869008+0000","last_peered":"2023-10-09T06:31:50.869008+0000","last_clean":"2023-10-09T06:31:50.869008+0000","last_became_active":"2023-10-09T06:31:50.868720+0000","last_became_peered":"2023-10-09T06:31:50.868720+0000","last_unstale":"2023-10-09T06:31:50.869008+0000","last_undegraded":"2023-10-09T06:31:50.869008+0000","last_fullsized":"2023-10-09T06:31:50.869008+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:59.722788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"184'8","reported_seq":18,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.882233+0000","last_change":"2023-10-09T06:31:49.844219+0000","last_active":"2023-10-09T06:31:50.882233+0000","last_peered":"2023-10-09T06:31:50.882233+0000","last_clean":"2023-10-09T06:31:50.882233+0000","last_became_active":"2023-10-09T06:31:49.843877+0000","last_became_peered":"2023-10-09T06:31:49.843877+0000","last_unstale":"2023-10-09T06:31:50.882233+0000","last_undegraded":"2023-10-09T06:31:50.882233+0000","last_fullsized":"2023-10-09T06:31:50.882233+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:17:35.455105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.869058+0000","last_change":"2023-10-09T06:31:50.869014+0000","last_active":"2023-10-09T06:31:50.869058+0000","last_peered":"2023-10-09T06:31:50.869058+0000","last_clean":"2023-10-09T06:31:50.869058+0000","last_became_active":"2023-10-09T06:31:50.868560+0000","last_became_peered":"2023-10-09T06:31:50.868560+0000","last_unstale":"2023-10-09T06:31:50.869058+0000","last_undegraded":"2023-10-09T06:31:50.869058+0000","last_fullsized":"2023-10-09T06:31:50.869058+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:35.972452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.876916+0000","last_change":"2023-10-09T06:31:49.850373+0000","last_active":"2023-10-09T06:31:50.876916+0000","last_peered":"2023-10-09T06:31:50.876916+0000","last_clean":"2023-10-09T06:31:50.876916+0000","last_became_active":"2023-10-09T06:31:49.850141+0000","last_became_peered":"2023-10-09T06:31:49.850141+0000","last_unstale":"2023-10-09T06:31:50.876916+0000","last_undegraded":"2023-10-09T06:31:50.876916+0000","last_fullsized":"2023-10-09T06:31:50.876916+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:35:54.440529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.870126+0000","last_change":"2023-10-09T06:31:50.869799+0000","last_active":"2023-10-09T06:31:50.870126+0000","last_peered":"2023-10-09T06:31:50.870126+0000","last_clean":"2023-10-09T06:31:50.870126+0000","last_became_active":"2023-10-09T06:31:50.869549+0000","last_became_peered":"2023-10-09T06:31:50.869549+0000","last_unstale":"2023-10-09T06:31:50.870126+0000","last_undegraded":"2023-10-09T06:31:50.870126+0000","last_fullsized":"2023-10-09T06:31:50.870126+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:40:35.750099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.877197+0000","last_change":"2023-10-09T06:31:49.850480+0000","last_active":"2023-10-09T06:31:50.877197+0000","last_peered":"2023-10-09T06:31:50.877197+0000","last_clean":"2023-10-09T06:31:50.877197+0000","last_became_active":"2023-10-09T06:31:49.849821+0000","last_became_peered":"2023-10-09T06:31:49.849821+0000","last_unstale":"2023-10-09T06:31:50.877197+0000","last_undegraded":"2023-10-09T06:31:50.877197+0000","last_fullsized":"2023-10-09T06:31:50.877197+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:58.109101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.870641+0000","last_change":"2023-10-09T06:31:50.870572+0000","last_active":"2023-10-09T06:31:50.870641+0000","last_peered":"2023-10-09T06:31:50.870641+0000","last_clean":"2023-10-09T06:31:50.870641+0000","last_became_active":"2023-10-09T06:31:50.869992+0000","last_became_peered":"2023-10-09T06:31:50.869992+0000","last_unstale":"2023-10-09T06:31:50.870641+0000","last_undegraded":"2023-10-09T06:31:50.870641+0000","last_fullsized":"2023-10-09T06:31:50.870641+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:22.062533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.877434+0000","last_change":"2023-10-09T06:31:49.847099+0000","last_active":"2023-10-09T06:31:50.877434+0000","last_peered":"2023-10-09T06:31:50.877434+0000","last_clean":"2023-10-09T06:31:50.877434+0000","last_became_active":"2023-10-09T06:31:49.846455+0000","last_became_peered":"2023-10-09T06:31:49.846455+0000","last_unstale":"2023-10-09T06:31:50.877434+0000","last_undegraded":"2023-10-09T06:31:50.877434+0000","last_fullsized":"2023-10-09T06:31:50.877434+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:28.025693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868008+0000","last_change":"2023-10-09T06:31:50.867945+0000","last_active":"2023-10-09T06:31:50.868008+0000","last_peered":"2023-10-09T06:31:50.868008+0000","last_clean":"2023-10-09T06:31:50.868008+0000","last_became_active":"2023-10-09T06:31:50.867641+0000","last_became_peered":"2023-10-09T06:31:50.867641+0000","last_unstale":"2023-10-09T06:31:50.868008+0000","last_undegraded":"2023-10-09T06:31:50.868008+0000","last_fullsized":"2023-10-09T06:31:50.868008+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:16.491703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.858705+0000","last_change":"2023-10-09T06:31:49.846216+0000","last_active":"2023-10-09T06:31:50.858705+0000","last_peered":"2023-10-09T06:31:50.858705+0000","last_clean":"2023-10-09T06:31:50.858705+0000","last_became_active":"2023-10-09T06:31:49.845969+0000","last_became_peered":"2023-10-09T06:31:49.845969+0000","last_unstale":"2023-10-09T06:31:50.858705+0000","last_undegraded":"2023-10-09T06:31:50.858705+0000","last_fullsized":"2023-10-09T06:31:50.858705+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:02:35.380044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.857625+0000","last_change":"2023-10-09T06:31:50.857564+0000","last_active":"2023-10-09T06:31:50.857625+0000","last_peered":"2023-10-09T06:31:50.857625+0000","last_clean":"2023-10-09T06:31:50.857625+0000","last_became_active":"2023-10-09T06:31:50.857246+0000","last_became_peered":"2023-10-09T06:31:50.857246+0000","last_unstale":"2023-10-09T06:31:50.857625+0000","last_undegraded":"2023-10-09T06:31:50.857625+0000","last_fullsized":"2023-10-09T06:31:50.857625+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:10.436182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.879928+0000","last_change":"2023-10-09T06:31:49.848167+0000","last_active":"2023-10-09T06:31:50.879928+0000","last_peered":"2023-10-09T06:31:50.879928+0000","last_clean":"2023-10-09T06:31:50.879928+0000","last_became_active":"2023-10-09T06:31:49.847500+0000","last_became_peered":"2023-10-09T06:31:49.847500+0000","last_unstale":"2023-10-09T06:31:50.879928+0000","last_undegraded":"2023-10-09T06:31:50.879928+0000","last_fullsized":"2023-10-09T06:31:50.879928+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:40:45.840449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865303+0000","last_change":"2023-10-09T06:31:50.865236+0000","last_active":"2023-10-09T06:31:50.865303+0000","last_peered":"2023-10-09T06:31:50.865303+0000","last_clean":"2023-10-09T06:31:50.865303+0000","last_became_active":"2023-10-09T06:31:50.864992+0000","last_became_peered":"2023-10-09T06:31:50.864992+0000","last_unstale":"2023-10-09T06:31:50.865303+0000","last_undegraded":"2023-10-09T06:31:50.865303+0000","last_fullsized":"2023-10-09T06:31:50.865303+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:08:19.977754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.859140+0000","last_change":"2023-10-09T06:31:49.844218+0000","last_active":"2023-10-09T06:31:50.859140+0000","last_peered":"2023-10-09T06:31:50.859140+0000","last_clean":"2023-10-09T06:31:50.859140+0000","last_became_active":"2023-10-09T06:31:49.843964+0000","last_became_peered":"2023-10-09T06:31:49.843964+0000","last_unstale":"2023-10-09T06:31:50.859140+0000","last_undegraded":"2023-10-09T06:31:50.859140+0000","last_fullsized":"2023-10-09T06:31:50.859140+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:24.232424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.862339+0000","last_change":"2023-10-09T06:31:50.861724+0000","last_active":"2023-10-09T06:31:50.862339+0000","last_peered":"2023-10-09T06:31:50.862339+0000","last_clean":"2023-10-09T06:31:50.862339+0000","last_became_active":"2023-10-09T06:31:50.860573+0000","last_became_peered":"2023-10-09T06:31:50.860573+0000","last_unstale":"2023-10-09T06:31:50.862339+0000","last_undegraded":"2023-10-09T06:31:50.862339+0000","last_fullsized":"2023-10-09T06:31:50.862339+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:02.559983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865561+0000","last_change":"2023-10-09T06:31:49.850835+0000","last_active":"2023-10-09T06:31:50.865561+0000","last_peered":"2023-10-09T06:31:50.865561+0000","last_clean":"2023-10-09T06:31:50.865561+0000","last_became_active":"2023-10-09T06:31:49.850601+0000","last_became_peered":"2023-10-09T06:31:49.850601+0000","last_unstale":"2023-10-09T06:31:50.865561+0000","last_undegraded":"2023-10-09T06:31:50.865561+0000","last_fullsized":"2023-10-09T06:31:50.865561+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:02.669582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.862311+0000","last_change":"2023-10-09T06:31:50.862248+0000","last_active":"2023-10-09T06:31:50.862311+0000","last_peered":"2023-10-09T06:31:50.862311+0000","last_clean":"2023-10-09T06:31:50.862311+0000","last_became_active":"2023-10-09T06:31:50.862018+0000","last_became_peered":"2023-10-09T06:31:50.862018+0000","last_unstale":"2023-10-09T06:31:50.862311+0000","last_undegraded":"2023-10-09T06:31:50.862311+0000","last_fullsized":"2023-10-09T06:31:50.862311+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:12.173738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.859134+0000","last_change":"2023-10-09T06:31:49.847265+0000","last_active":"2023-10-09T06:31:50.859134+0000","last_peered":"2023-10-09T06:31:50.859134+0000","last_clean":"2023-10-09T06:31:50.859134+0000","last_became_active":"2023-10-09T06:31:49.846780+0000","last_became_peered":"2023-10-09T06:31:49.846780+0000","last_unstale":"2023-10-09T06:31:50.859134+0000","last_undegraded":"2023-10-09T06:31:50.859134+0000","last_fullsized":"2023-10-09T06:31:50.859134+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:50.615999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867272+0000","last_change":"2023-10-09T06:31:50.866593+0000","last_active":"2023-10-09T06:31:50.867272+0000","last_peered":"2023-10-09T06:31:50.867272+0000","last_clean":"2023-10-09T06:31:50.867272+0000","last_became_active":"2023-10-09T06:31:50.866331+0000","last_became_peered":"2023-10-09T06:31:50.866331+0000","last_unstale":"2023-10-09T06:31:50.867272+0000","last_undegraded":"2023-10-09T06:31:50.867272+0000","last_fullsized":"2023-10-09T06:31:50.867272+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:08:19.977754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.877823+0000","last_change":"2023-10-09T06:31:49.850048+0000","last_active":"2023-10-09T06:31:50.877823+0000","last_peered":"2023-10-09T06:31:50.877823+0000","last_clean":"2023-10-09T06:31:50.877823+0000","last_became_active":"2023-10-09T06:31:49.849817+0000","last_became_peered":"2023-10-09T06:31:49.849817+0000","last_unstale":"2023-10-09T06:31:50.877823+0000","last_undegraded":"2023-10-09T06:31:50.877823+0000","last_fullsized":"2023-10-09T06:31:50.877823+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:57.682499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.868688+0000","last_change":"2023-10-09T06:31:50.868514+0000","last_active":"2023-10-09T06:31:50.868688+0000","last_peered":"2023-10-09T06:31:50.868688+0000","last_clean":"2023-10-09T06:31:50.868688+0000","last_became_active":"2023-10-09T06:31:50.867822+0000","last_became_peered":"2023-10-09T06:31:50.867822+0000","last_unstale":"2023-10-09T06:31:50.868688+0000","last_undegraded":"2023-10-09T06:31:50.868688+0000","last_fullsized":"2023-10-09T06:31:50.868688+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:07:30.486854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.855765+0000","last_change":"2023-10-09T06:31:49.846759+0000","last_active":"2023-10-09T06:31:50.855765+0000","last_peered":"2023-10-09T06:31:50.855765+0000","last_clean":"2023-10-09T06:31:50.855765+0000","last_became_active":"2023-10-09T06:31:49.846532+0000","last_became_peered":"2023-10-09T06:31:49.846532+0000","last_unstale":"2023-10-09T06:31:50.855765+0000","last_undegraded":"2023-10-09T06:31:50.855765+0000","last_fullsized":"2023-10-09T06:31:50.855765+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:59:49.395747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867570+0000","last_change":"2023-10-09T06:31:50.867498+0000","last_active":"2023-10-09T06:31:50.867570+0000","last_peered":"2023-10-09T06:31:50.867570+0000","last_clean":"2023-10-09T06:31:50.867570+0000","last_became_active":"2023-10-09T06:31:50.867260+0000","last_became_peered":"2023-10-09T06:31:50.867260+0000","last_unstale":"2023-10-09T06:31:50.867570+0000","last_undegraded":"2023-10-09T06:31:50.867570+0000","last_fullsized":"2023-10-09T06:31:50.867570+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:14.224730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.855857+0000","last_change":"2023-10-09T06:31:49.844089+0000","last_active":"2023-10-09T06:31:50.855857+0000","last_peered":"2023-10-09T06:31:50.855857+0000","last_clean":"2023-10-09T06:31:50.855857+0000","last_became_active":"2023-10-09T06:31:49.843845+0000","last_became_peered":"2023-10-09T06:31:49.843845+0000","last_unstale":"2023-10-09T06:31:50.855857+0000","last_undegraded":"2023-10-09T06:31:50.855857+0000","last_fullsized":"2023-10-09T06:31:50.855857+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:28:35.351596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.863123+0000","last_change":"2023-10-09T06:31:50.863037+0000","last_active":"2023-10-09T06:31:50.863123+0000","last_peered":"2023-10-09T06:31:50.863123+0000","last_clean":"2023-10-09T06:31:50.863123+0000","last_became_active":"2023-10-09T06:31:50.862802+0000","last_became_peered":"2023-10-09T06:31:50.862802+0000","last_unstale":"2023-10-09T06:31:50.863123+0000","last_undegraded":"2023-10-09T06:31:50.863123+0000","last_fullsized":"2023-10-09T06:31:50.863123+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:29.009492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.856835+0000","last_change":"2023-10-09T06:31:49.852424+0000","last_active":"2023-10-09T06:31:50.856835+0000","last_peered":"2023-10-09T06:31:50.856835+0000","last_clean":"2023-10-09T06:31:50.856835+0000","last_became_active":"2023-10-09T06:31:49.852213+0000","last_became_peered":"2023-10-09T06:31:49.852213+0000","last_unstale":"2023-10-09T06:31:50.856835+0000","last_undegraded":"2023-10-09T06:31:50.856835+0000","last_fullsized":"2023-10-09T06:31:50.856835+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:08.064089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.862075+0000","last_change":"2023-10-09T06:31:50.860509+0000","last_active":"2023-10-09T06:31:50.862075+0000","last_peered":"2023-10-09T06:31:50.862075+0000","last_clean":"2023-10-09T06:31:50.862075+0000","last_became_active":"2023-10-09T06:31:50.859983+0000","last_became_peered":"2023-10-09T06:31:50.859983+0000","last_unstale":"2023-10-09T06:31:50.862075+0000","last_undegraded":"2023-10-09T06:31:50.862075+0000","last_fullsized":"2023-10-09T06:31:50.862075+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:41.542127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865453+0000","last_change":"2023-10-09T06:31:49.844513+0000","last_active":"2023-10-09T06:31:50.865453+0000","last_peered":"2023-10-09T06:31:50.865453+0000","last_clean":"2023-10-09T06:31:50.865453+0000","last_became_active":"2023-10-09T06:31:49.844291+0000","last_became_peered":"2023-10-09T06:31:49.844291+0000","last_unstale":"2023-10-09T06:31:50.865453+0000","last_undegraded":"2023-10-09T06:31:50.865453+0000","last_fullsized":"2023-10-09T06:31:50.865453+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:28:35.351596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867566+0000","last_change":"2023-10-09T06:31:50.866882+0000","last_active":"2023-10-09T06:31:50.867566+0000","last_peered":"2023-10-09T06:31:50.867566+0000","last_clean":"2023-10-09T06:31:50.867566+0000","last_became_active":"2023-10-09T06:31:50.866465+0000","last_became_peered":"2023-10-09T06:31:50.866465+0000","last_unstale":"2023-10-09T06:31:50.867566+0000","last_undegraded":"2023-10-09T06:31:50.867566+0000","last_fullsized":"2023-10-09T06:31:50.867566+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:48.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.861907+0000","last_change":"2023-10-09T06:31:49.846601+0000","last_active":"2023-10-09T06:31:50.861907+0000","last_peered":"2023-10-09T06:31:50.861907+0000","last_clean":"2023-10-09T06:31:50.861907+0000","last_became_active":"2023-10-09T06:31:49.846364+0000","last_became_peered":"2023-10-09T06:31:49.846364+0000","last_unstale":"2023-10-09T06:31:50.861907+0000","last_undegraded":"2023-10-09T06:31:50.861907+0000","last_fullsized":"2023-10-09T06:31:50.861907+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:41.507001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865641+0000","last_change":"2023-10-09T06:31:50.865581+0000","last_active":"2023-10-09T06:31:50.865641+0000","last_peered":"2023-10-09T06:31:50.865641+0000","last_clean":"2023-10-09T06:31:50.865641+0000","last_became_active":"2023-10-09T06:31:50.865200+0000","last_became_peered":"2023-10-09T06:31:50.865200+0000","last_unstale":"2023-10-09T06:31:50.865641+0000","last_undegraded":"2023-10-09T06:31:50.865641+0000","last_fullsized":"2023-10-09T06:31:50.865641+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:06.602929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.854375+0000","last_change":"2023-10-09T06:31:49.844813+0000","last_active":"2023-10-09T06:31:50.854375+0000","last_peered":"2023-10-09T06:31:50.854375+0000","last_clean":"2023-10-09T06:31:50.854375+0000","last_became_active":"2023-10-09T06:31:49.844539+0000","last_became_peered":"2023-10-09T06:31:49.844539+0000","last_unstale":"2023-10-09T06:31:50.854375+0000","last_undegraded":"2023-10-09T06:31:50.854375+0000","last_fullsized":"2023-10-09T06:31:50.854375+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:38.320831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.864347+0000","last_change":"2023-10-09T06:31:50.864276+0000","last_active":"2023-10-09T06:31:50.864347+0000","last_peered":"2023-10-09T06:31:50.864347+0000","last_clean":"2023-10-09T06:31:50.864347+0000","last_became_active":"2023-10-09T06:31:50.863585+0000","last_became_peered":"2023-10-09T06:31:50.863585+0000","last_unstale":"2023-10-09T06:31:50.864347+0000","last_undegraded":"2023-10-09T06:31:50.864347+0000","last_fullsized":"2023-10-09T06:31:50.864347+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:29.464179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.867568+0000","last_change":"2023-10-09T06:31:49.846676+0000","last_active":"2023-10-09T06:31:50.867568+0000","last_peered":"2023-10-09T06:31:50.867568+0000","last_clean":"2023-10-09T06:31:50.867568+0000","last_became_active":"2023-10-09T06:31:49.846148+0000","last_became_peered":"2023-10-09T06:31:49.846148+0000","last_unstale":"2023-10-09T06:31:50.867568+0000","last_undegraded":"2023-10-09T06:31:50.867568+0000","last_fullsized":"2023-10-09T06:31:50.867568+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:32:38.320831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.869121+0000","last_change":"2023-10-09T06:31:50.868648+0000","last_active":"2023-10-09T06:31:50.869121+0000","last_peered":"2023-10-09T06:31:50.869121+0000","last_clean":"2023-10-09T06:31:50.869121+0000","last_became_active":"2023-10-09T06:31:50.868413+0000","last_became_peered":"2023-10-09T06:31:50.868413+0000","last_unstale":"2023-10-09T06:31:50.869121+0000","last_undegraded":"2023-10-09T06:31:50.869121+0000","last_fullsized":"2023-10-09T06:31:50.869121+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:49.833993+0000","last_clean_scrub_stamp":"2023-10-09T06:31:49.833993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:00.451963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.865546+0000","last_change":"2023-10-09T06:31:49.849208+0000","last_active":"2023-10-09T06:31:50.865546+0000","last_peered":"2023-10-09T06:31:50.865546+0000","last_clean":"2023-10-09T06:31:50.865546+0000","last_became_active":"2023-10-09T06:31:49.848577+0000","last_became_peered":"2023-10-09T06:31:49.848577+0000","last_unstale":"2023-10-09T06:31:50.865546+0000","last_undegraded":"2023-10-09T06:31:50.865546+0000","last_fullsized":"2023-10-09T06:31:50.865546+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:31:48.829930+0000","last_clean_scrub_stamp":"2023-10-09T06:31:48.829930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:28.460116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":306,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T06:31:50.859264+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:31:50.859264+0000","last_peered":"2023-10-09T06:31:50.859264+0000","last_clean":"2023-10-09T06:31:50.859264+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:31:50.859264+0000","last_undegraded":"2023-10-09T06:31:50.859264+0000","last_fullsized":"2023-10-09T06:31:50.859264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574984,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1591,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193720,"statfs":{"total":200000000,"available":198369933,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.5469999999999999},"last":0.498},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.28100000000000003},"max":{"1min":0.77300000000000002,"5min":0.81100000000000005,"15min":3.6970000000000001},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.52400000000000002},"min":{"1min":0.36599999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74299999999999999,"5min":0.80400000000000005,"15min":0.88100000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54800000000000004,"15min":0.52600000000000002},"min":{"1min":0.376,"5min":0.36399999999999999,"15min":0.26800000000000002},"max":{"1min":0.69599999999999995,"5min":0.80500000000000005,"15min":1.4870000000000001},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.45500000000000002,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":2.6139999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":2.6019999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55500000000000005,"15min":0.58499999999999996},"min":{"1min":0.40400000000000003,"5min":0.35799999999999998,"15min":0.318},"max":{"1min":0.78600000000000003,"5min":0.80900000000000005,"15min":7.4729999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":0.58299999999999996},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.76500000000000001,"5min":0.80500000000000005,"15min":7.8390000000000004},"last":0.55300000000000005}]},{"osd":4,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46100000000000002,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.23799999999999999},"max":{"1min":0.65300000000000002,"5min":0.76400000000000001,"15min":0.872},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.307,"5min":0.30599999999999999,"15min":0.25600000000000001},"max":{"1min":0.73999999999999999,"5min":0.77800000000000002,"15min":0.86099999999999999},"last":0.35599999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32200000000000001,"5min":0.316,"15min":0.255},"max":{"1min":0.71599999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.371},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.30599999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.98699999999999999},"last":0.39400000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.35499999999999998},"max":{"1min":0.77000000000000002,"5min":0.83599999999999997,"15min":0.93999999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.91400000000000003},"last":0.41899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574984,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.66600000000000004},"min":{"1min":0.39500000000000002,"5min":0.35299999999999998,"15min":0.26900000000000002},"max":{"1min":0.66800000000000004,"5min":0.76700000000000002,"15min":7.0960000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.434,"5min":0.35199999999999998,"15min":0.31},"max":{"1min":0.69999999999999996,"5min":0.80900000000000005,"15min":1.133},"last":0.61399999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.438,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":0.84399999999999997,"15min":1.155},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.40000000000000002,"15min":0.317},"max":{"1min":0.71199999999999997,"5min":0.82099999999999995,"15min":1.1459999999999999},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.433,"5min":0.39500000000000002,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":0.82999999999999996,"15min":1.2290000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57399999999999995,"15min":0.68300000000000005},"min":{"1min":0.375,"5min":0.36299999999999999,"15min":0.308},"max":{"1min":0.66100000000000003,"5min":0.89100000000000001,"15min":7.1299999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.41899999999999998,"5min":0.39700000000000002,"15min":0.34499999999999997},"max":{"1min":0.68799999999999994,"5min":0.85599999999999998,"15min":1.337},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.57299999999999995},"min":{"1min":0.44700000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.67300000000000004,"5min":0.80100000000000005,"15min":1.206},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47799999999999998,"15min":0.46500000000000002},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.28000000000000003},"max":{"1min":0.69399999999999995,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.312},"max":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.47799999999999998},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.312},"max":{"1min":0.64300000000000002,"5min":0.71999999999999997,"15min":0.80000000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.75,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38900000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.71199999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.44500000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.77900000000000003,"15min":0.82399999999999995},"last":0.40799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962517,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35499999999999998,"15min":0.36199999999999999},"min":{"1min":0.251,"5min":0.223,"15min":0.219},"max":{"1min":0.51500000000000001,"5min":0.58999999999999997,"15min":0.64000000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.373,"15min":0.35399999999999998},"min":{"1min":0.23899999999999999,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.40600000000000003,"5min":0.61499999999999999,"15min":0.93300000000000005},"last":0.35799999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35499999999999998,"15min":0.35299999999999998},"min":{"1min":0.25700000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.44,"5min":0.71399999999999997,"15min":0.82299999999999995},"last":0.376},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42199999999999999,"15min":0.40200000000000002},"min":{"1min":0.28799999999999998,"5min":0.27600000000000002,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.65500000000000003,"15min":0.70899999999999996},"last":0.442}]},{"osd":3,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.438},"min":{"1min":0.34000000000000002,"5min":0.32700000000000001,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":0.751,"15min":0.751},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.313,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.626,"5min":0.64900000000000002,"15min":0.90500000000000003},"last":0.50800000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58799999999999997,"15min":0.57399999999999995},"min":{"1min":0.44400000000000001,"5min":0.35699999999999998,"15min":0.315},"max":{"1min":0.72799999999999998,"5min":0.95699999999999996,"15min":1.097},"last":0.751},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61399999999999999,"15min":0.72199999999999998},"min":{"1min":0.497,"5min":0.42699999999999999,"15min":0.39200000000000002},"max":{"1min":0.88400000000000001,"5min":0.97699999999999998,"15min":5.5270000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.42699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.81499999999999995,"5min":1.0669999999999999,"15min":1.125},"last":0.88},{"interface":"front","average":{"1min":0.621,"5min":0.64600000000000002,"15min":0.65700000000000003},"min":{"1min":0.49299999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":1,"15min":1.4219999999999999},"last":0.80000000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64300000000000002,"15min":0.63400000000000001},"min":{"1min":0.46500000000000002,"5min":0.45500000000000002,"15min":0.39300000000000002},"max":{"1min":0.91500000000000004,"5min":1.0029999999999999,"15min":1.0629999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.38500000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.49},"last":0.70699999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66300000000000003,"15min":0.65200000000000002},"min":{"1min":0.503,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.77100000000000002,"5min":1.016,"15min":1.016},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.91500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193722,"statfs":{"total":200000000,"available":198372183,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.37,"15min":0.39300000000000002},"min":{"1min":0.255,"5min":0.216,"15min":0.20599999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":1.226},"last":0.373},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.28699999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.59299999999999997,"5min":0.82999999999999996,"15min":1.131},"last":0.28100000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.72599999999999998},"min":{"1min":0.29899999999999999,"5min":0.28299999999999997,"15min":0.25800000000000001},"max":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":12.929},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41999999999999998,"15min":0.44400000000000001},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.71499999999999997,"5min":0.751,"15min":1.1599999999999999},"last":0.34300000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46300000000000002,"15min":0.46899999999999997},"min":{"1min":0.30499999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.63700000000000001,"5min":0.78100000000000003,"15min":1.1859999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.47399999999999998},"min":{"1min":0.34399999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67800000000000005,"5min":0.70899999999999996,"15min":1.3089999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89200000000000002,"5min":0.90300000000000002,"15min":0.93200000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82799999999999996,"5min":0.90100000000000002,"15min":1.335},"last":0.63200000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84199999999999997,"5min":1.016,"15min":1.0580000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.61599999999999999,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.83599999999999997,"5min":0.98599999999999999,"15min":0.999},"last":0.66800000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76500000000000001,"5min":1.05,"15min":1.05},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41499999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.93700000000000006,"5min":1.032,"15min":1.2849999999999999},"last":0.50800000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68500000000000005,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.40500000000000003,"15min":0.40400000000000003},"max":{"1min":0.96599999999999997,"5min":0.97899999999999998,"15min":1.262},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.497,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89900000000000002,"5min":1.0660000000000001,"15min":1.103},"last":0.77900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.64400000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.19800000000000001},"max":{"1min":0.52300000000000002,"5min":0.65000000000000002,"15min":14.981999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.38400000000000001,"15min":0.54200000000000004},"min":{"1min":0.252,"5min":0.22,"15min":0.22},"max":{"1min":0.56499999999999995,"5min":0.64100000000000001,"15min":9.1600000000000001},"last":0.30299999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36599999999999999,"15min":0.51200000000000001},"min":{"1min":0.28299999999999997,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":8.4930000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41099999999999998,"15min":0.57799999999999996},"min":{"1min":0.27400000000000002,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":0.52600000000000002,"5min":0.67800000000000005,"15min":9.0239999999999991},"last":0.25900000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.58899999999999997},"min":{"1min":0.33000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60299999999999998,"5min":0.69399999999999995,"15min":8.5190000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.433,"5min":0.44400000000000001,"15min":0.71799999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.61799999999999999,"5min":0.748,"15min":15.007999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.91500000000000004},"min":{"1min":0.439,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.872,"5min":0.93799999999999994,"15min":14.917999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.80300000000000005},"min":{"1min":0.501,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88,"5min":0.92300000000000004,"15min":8.9930000000000003},"last":0.45700000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.78600000000000003},"min":{"1min":0.42799999999999999,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.80500000000000005,"5min":0.94599999999999995,"15min":8.9610000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.79700000000000004},"min":{"1min":0.45600000000000002,"5min":0.433,"15min":0.35099999999999998},"max":{"1min":0.85299999999999998,"5min":1.03,"15min":8.3919999999999995},"last":0.48499999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65400000000000003,"15min":0.78400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":0.97299999999999998,"15min":8.4339999999999993},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67300000000000004,"15min":0.92700000000000005},"min":{"1min":0.48799999999999999,"5min":0.44600000000000001,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":0.99099999999999999,"15min":14.954000000000001},"last":0.44500000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.77600000000000002},"min":{"1min":0.46100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76500000000000001,"5min":0.90600000000000003,"15min":8.9160000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.65300000000000002,"15min":0.79200000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":0.80400000000000005,"5min":0.91700000000000004,"15min":8.4640000000000004},"last":0.435}]}]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962517,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38400000000000001,"15min":0.35099999999999998},"min":{"1min":0.248,"5min":0.23000000000000001,"15min":0.19900000000000001},"max":{"1min":0.56000000000000005,"5min":0.58599999999999997,"15min":0.66800000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.442,"15min":0.40500000000000003},"min":{"1min":0.32800000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59799999999999998,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.23499999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38700000000000001,"15min":0.34899999999999998},"min":{"1min":0.28199999999999997,"5min":0.26500000000000001,"15min":0.215},"max":{"1min":0.58199999999999996,"5min":0.623,"15min":0.623},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.38600000000000001},"min":{"1min":0.29799999999999999,"5min":0.25700000000000001,"15min":0.23699999999999999},"max":{"1min":0.66600000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.28399999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41899999999999998,"15min":0.38400000000000001},"min":{"1min":0.309,"5min":0.27000000000000002,"15min":0.252},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.498,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32600000000000001,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.379,"15min":0.375},"max":{"1min":0.94499999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.59799999999999998},"min":{"1min":0.44,"5min":0.41799999999999998,"15min":0.33400000000000002},"max":{"1min":0.997,"5min":1.073,"15min":1.073},"last":0.41299999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.63900000000000001},"min":{"1min":0.47799999999999998,"5min":0.40500000000000003,"15min":0.33600000000000002},"max":{"1min":0.96899999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.64300000000000002},"min":{"1min":0.505,"5min":0.45200000000000001,"15min":0.38500000000000001},"max":{"1min":0.90800000000000003,"5min":1.097,"15min":1.097},"last":0.39600000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66800000000000004,"15min":0.61399999999999999},"min":{"1min":0.46100000000000002,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.372},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96499999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.44400000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68500000000000005,"15min":0.627},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.38800000000000001},"max":{"1min":0.98499999999999999,"5min":1.139,"15min":1.139},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.64100000000000001},"min":{"1min":0.49099999999999999,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.999,"5min":1.026,"15min":1.026},"last":0.40600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1014,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194297,"statfs":{"total":200000000,"available":198960945,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65400000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.44400000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.52600000000000002},"min":{"1min":0.42699999999999999,"5min":0.34300000000000003,"15min":0.254},"max":{"1min":0.72499999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54000000000000004,"15min":0.63800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.754,"5min":0.754,"15min":4.3250000000000002},"last":0.68100000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.63500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":4.7320000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56100000000000005,"15min":0.84399999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.32600000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":11.715},"last":0.58099999999999996}]},{"osd":3,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56799999999999995,"15min":0.54600000000000004},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.79100000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.46300000000000002,"5min":0.438,"15min":0.39000000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.85599999999999998},"last":0.498}]},{"osd":5,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.38300000000000001,"5min":0.27200000000000002,"15min":0.26800000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47799999999999998,"15min":0.504},"min":{"1min":0.375,"5min":0.253,"15min":0.253},"max":{"1min":0.70299999999999996,"5min":0.77100000000000002,"15min":0.82799999999999996},"last":0.39700000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.498,"15min":0.503},"min":{"1min":0.376,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.74399999999999999,"5min":0.80400000000000005,"15min":0.86699999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.46200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69399999999999995,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.626}]},{"osd":7,"last update":"Mon Oct 9 06:30:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.44500000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.747,"5min":0.81599999999999995,"15min":0.879},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.435,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.88600000000000001},"last":0.53500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198961975,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.42399999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":1.0289999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72899999999999998,"5min":0.78500000000000003,"15min":0.81899999999999995},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78600000000000003,"5min":0.82299999999999995,"15min":1.093},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56999999999999995,"15min":0.54200000000000004},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.82199999999999995,"15min":0.85499999999999998},"last":0.57299999999999995}]},{"osd":2,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54600000000000004,"15min":0.52900000000000003},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":0.79800000000000004,"15min":0.89300000000000002},"last":0.68899999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78300000000000003,"15min":0.98699999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.59499999999999997},"min":{"1min":0.499,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":1.071},"last":0.67400000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.48499999999999999},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.84399999999999997},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.503,"15min":0.501},"min":{"1min":0.34300000000000003,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.81000000000000005},"last":0.86599999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.745,"5min":0.745,"15min":1.0680000000000001},"last":0.746},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.442,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.754,"5min":0.78900000000000003,"15min":1.0920000000000001},"last":0.88}]},{"osd":7,"last update":"Mon Oct 9 06:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.373,"5min":0.317,"15min":0.30399999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.91900000000000004},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":1.0269999999999999},"last":0.77400000000000002}]}]}],"pool_statfs":[]}} 2023-10-09T06:31:55.352 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:31:55.352 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:31:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.512+0000 7f3560d07700 1 Processor -- start 2023-10-09T06:31:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.512+0000 7f3560d07700 1 -- start start 2023-10-09T06:31:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f3560d07700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f355c1542a0 0x7f355c0b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f3560d07700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f355c0cd630 0x7f355c06a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f3560d07700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f355c06a830 0x7f355c15d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f3560d07700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355c15b2e0 con 0x7f355c0cd630 2023-10-09T06:31:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f3560d07700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355c06ac90 con 0x7f355c06a830 2023-10-09T06:31:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f3560d07700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c06b0a0 con 0x7f355c1542a0 2023-10-09T06:31:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f355affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f355c0cd630 0x7f355c06a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f355affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f355c0cd630 0x7f355c06a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42790/0 (socket says 172.21.15.31:42790) 2023-10-09T06:31:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f355affd700 1 -- 172.21.15.31:0/2152858005 learned_addr learned my addr 172.21.15.31:0/2152858005 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f355b7fe700 1 --2- 172.21.15.31:0/2152858005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f355c1542a0 0x7f355c0b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f355bfff700 1 --2- 172.21.15.31:0/2152858005 >> v2:172.21.15.158:3300/0 conn(0x7f355c06a830 0x7f355c15d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f355affd700 1 -- 172.21.15.31:0/2152858005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f355c1542a0 msgr2=0x7f355c0b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f355affd700 1 --2- 172.21.15.31:0/2152858005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f355c1542a0 0x7f355c0b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f355affd700 1 -- 172.21.15.31:0/2152858005 >> v2:172.21.15.158:3300/0 conn(0x7f355c06a830 msgr2=0x7f355c15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f355affd700 1 --2- 172.21.15.31:0/2152858005 >> v2:172.21.15.158:3300/0 conn(0x7f355c06a830 0x7f355c15d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f355affd700 1 -- 172.21.15.31:0/2152858005 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c15ad20 con 0x7f355c0cd630 2023-10-09T06:31:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.513+0000 7f355bfff700 1 --2- 172.21.15.31:0/2152858005 >> v2:172.21.15.158:3300/0 conn(0x7f355c06a830 0x7f355c15d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:31:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.514+0000 7f355affd700 1 --2- 172.21.15.31:0/2152858005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f355c0cd630 0x7f355c06a2f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f355c0afdc0 tx=0x7f3550009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43723bcff3a205e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.514+0000 7f355a7fc700 1 -- 172.21.15.31:0/2152858005 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000b860 con 0x7f355c0cd630 2023-10-09T06:31:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.514+0000 7f355a7fc700 1 -- 172.21.15.31:0/2152858005 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355000b9c0 con 0x7f355c0cd630 2023-10-09T06:31:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.514+0000 7f355a7fc700 1 -- 172.21.15.31:0/2152858005 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000bd60 con 0x7f355c0cd630 2023-10-09T06:31:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.514+0000 7f3560d07700 1 -- 172.21.15.31:0/2152858005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f355c0cd630 msgr2=0x7f355c06a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.514+0000 7f3560d07700 1 --2- 172.21.15.31:0/2152858005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f355c0cd630 0x7f355c06a2f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f355c0afdc0 tx=0x7f3550009250 comp rx=0 tx=0).stop 2023-10-09T06:31:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.514+0000 7f3560d07700 1 -- 172.21.15.31:0/2152858005 shutdown_connections 2023-10-09T06:31:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.514+0000 7f3560d07700 1 --2- 172.21.15.31:0/2152858005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f355c1542a0 0x7f355c0b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.514+0000 7f3560d07700 1 --2- 172.21.15.31:0/2152858005 >> v2:172.21.15.158:3300/0 conn(0x7f355c06a830 0x7f355c15d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.514+0000 7f3560d07700 1 --2- 172.21.15.31:0/2152858005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f355c0cd630 0x7f355c06a2f0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.514+0000 7f3560d07700 1 -- 172.21.15.31:0/2152858005 >> 172.21.15.31:0/2152858005 conn(0x7f355c068cb0 msgr2=0x7f355c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.514+0000 7f3560d07700 1 -- 172.21.15.31:0/2152858005 shutdown_connections 2023-10-09T06:31:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.514+0000 7f3560d07700 1 -- 172.21.15.31:0/2152858005 wait complete. 2023-10-09T06:31:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.516+0000 7f3560d07700 1 Processor -- start 2023-10-09T06:31:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.516+0000 7f3560d07700 1 -- start start 2023-10-09T06:31:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.516+0000 7f3560d07700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f355c06a830 0x7f355c16a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.516+0000 7f3560d07700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f355c0cd630 0x7f355c16d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.516+0000 7f3560d07700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f355c1542a0 0x7f355c0c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.516+0000 7f3560d07700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c153040 con 0x7f355c1542a0 2023-10-09T06:31:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.516+0000 7f3560d07700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c1592e0 con 0x7f355c06a830 2023-10-09T06:31:55.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.516+0000 7f3560d07700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c16d760 con 0x7f355c0cd630 2023-10-09T06:31:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f355bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f355c1542a0 0x7f355c0c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f355bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f355c1542a0 0x7f355c0c6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42800/0 (socket says 172.21.15.31:42800) 2023-10-09T06:31:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f355bfff700 1 -- 172.21.15.31:0/518328451 learned_addr learned my addr 172.21.15.31:0/518328451 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f355b7fe700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f355c06a830 0x7f355c16a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f355affd700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f355c0cd630 0x7f355c16d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f355bfff700 1 -- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f355c0cd630 msgr2=0x7f355c16d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f355bfff700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f355c0cd630 0x7f355c16d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f355bfff700 1 -- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f355c06a830 msgr2=0x7f355c16a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f355bfff700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f355c06a830 0x7f355c16a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f355bfff700 1 -- 172.21.15.31:0/518328451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35500094f0 con 0x7f355c1542a0 2023-10-09T06:31:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f355bfff700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f355c1542a0 0x7f355c0c6400 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f355400a3b0 tx=0x7f3554007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f35437fe700 1 -- 172.21.15.31:0/518328451 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554015440 con 0x7f355c1542a0 2023-10-09T06:31:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f35437fe700 1 -- 172.21.15.31:0/518328451 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35540155a0 con 0x7f355c1542a0 2023-10-09T06:31:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f3560d07700 1 -- 172.21.15.31:0/518328451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355c156f70 con 0x7f355c1542a0 2023-10-09T06:31:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f35437fe700 1 -- 172.21.15.31:0/518328451 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554015960 con 0x7f355c1542a0 2023-10-09T06:31:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.517+0000 7f3560d07700 1 -- 172.21.15.31:0/518328451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355c159000 con 0x7f355c1542a0 2023-10-09T06:31:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.518+0000 7f3560d07700 1 -- 172.21.15.31:0/518328451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355c157100 con 0x7f355c1542a0 2023-10-09T06:31:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.519+0000 7f35437fe700 1 -- 172.21.15.31:0/518328451 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3554015d50 con 0x7f355c1542a0 2023-10-09T06:31:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.519+0000 7f35437fe700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3548066f30 0x7f35480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.519+0000 7f35437fe700 1 -- 172.21.15.31:0/518328451 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3554084dc0 con 0x7f355c1542a0 2023-10-09T06:31:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.519+0000 7f355b7fe700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3548066f30 0x7f35480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.520+0000 7f355b7fe700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3548066f30 0x7f35480693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f355c0cca70 tx=0x7f354c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.523+0000 7f35437fe700 1 -- 172.21.15.31:0/518328451 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3554052030 con 0x7f355c1542a0 2023-10-09T06:31:55.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.793+0000 7f3560d07700 1 -- 172.21.15.31:0/518328451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f355c15d610 con 0x7f355c1542a0 2023-10-09T06:31:55.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.796+0000 7f35437fe700 1 -- 172.21.15.31:0/518328451 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3554055650 con 0x7f355c1542a0 2023-10-09T06:31:55.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.798+0000 7f3560d07700 1 -- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3548066f30 msgr2=0x7f35480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.798+0000 7f3560d07700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3548066f30 0x7f35480693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f355c0cca70 tx=0x7f354c008040 comp rx=0 tx=0).stop 2023-10-09T06:31:55.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.798+0000 7f3560d07700 1 -- 172.21.15.31:0/518328451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f355c1542a0 msgr2=0x7f355c0c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.798+0000 7f3560d07700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f355c1542a0 0x7f355c0c6400 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f355400a3b0 tx=0x7f3554007900 comp rx=0 tx=0).stop 2023-10-09T06:31:55.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.798+0000 7f3560d07700 1 -- 172.21.15.31:0/518328451 shutdown_connections 2023-10-09T06:31:55.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.798+0000 7f3560d07700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3548066f30 0x7f35480693e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.798+0000 7f3560d07700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f355c1542a0 0x7f355c0c6400 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.798+0000 7f3560d07700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f355c06a830 0x7f355c16a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.798+0000 7f3560d07700 1 --2- 172.21.15.31:0/518328451 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f355c0cd630 0x7f355c16d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.798+0000 7f3560d07700 1 -- 172.21.15.31:0/518328451 >> 172.21.15.31:0/518328451 conn(0x7f355c068cb0 msgr2=0x7f355c0b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:55.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.798+0000 7f3560d07700 1 -- 172.21.15.31:0/518328451 shutdown_connections 2023-10-09T06:31:55.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.798+0000 7f3560d07700 1 -- 172.21.15.31:0/518328451 wait complete. 2023-10-09T06:31:55.800 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2023-10-09T06:31:55.811 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:31:55.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.930+0000 7f9537180700 1 Processor -- start 2023-10-09T06:31:55.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.930+0000 7f9537180700 1 -- start start 2023-10-09T06:31:55.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.930+0000 7f9537180700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95300b0e50 0x7f95300c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.930+0000 7f9537180700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f95300b1220 0x7f953006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.930+0000 7f9537180700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f953006dad0 0x7f95300cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.930+0000 7f9537180700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f953015de60 con 0x7f95300b0e50 2023-10-09T06:31:55.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.930+0000 7f9537180700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f953015e140 con 0x7f95300b1220 2023-10-09T06:31:55.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.930+0000 7f9537180700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953015e420 con 0x7f953006dad0 2023-10-09T06:31:55.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f9534f1c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95300b0e50 0x7f95300c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f9534f1c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95300b0e50 0x7f95300c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42802/0 (socket says 172.21.15.31:42802) 2023-10-09T06:31:55.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f9534f1c700 1 -- 172.21.15.31:0/3029562766 learned_addr learned my addr 172.21.15.31:0/3029562766 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:55.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f953571d700 1 --2- 172.21.15.31:0/3029562766 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f953006dad0 0x7f95300cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f952ffff700 1 --2- 172.21.15.31:0/3029562766 >> v2:172.21.15.158:3300/0 conn(0x7f95300b1220 0x7f953006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f9534f1c700 1 -- 172.21.15.31:0/3029562766 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f953006dad0 msgr2=0x7f95300cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:55.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f9534f1c700 1 --2- 172.21.15.31:0/3029562766 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f953006dad0 0x7f95300cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f9534f1c700 1 -- 172.21.15.31:0/3029562766 >> v2:172.21.15.158:3300/0 conn(0x7f95300b1220 msgr2=0x7f953006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:55.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f9534f1c700 1 --2- 172.21.15.31:0/3029562766 >> v2:172.21.15.158:3300/0 conn(0x7f95300b1220 0x7f953006d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f9534f1c700 1 -- 172.21.15.31:0/3029562766 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953015e700 con 0x7f95300b0e50 2023-10-09T06:31:55.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f953571d700 1 --2- 172.21.15.31:0/3029562766 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f953006dad0 0x7f95300cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:55.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f9534f1c700 1 --2- 172.21.15.31:0/3029562766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300b0e50 0x7f95300c9180 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f953006cd30 tx=0x7f9528009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d4635eac3eb9ca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:55.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f952f7fe700 1 -- 172.21.15.31:0/3029562766 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528009e70 con 0x7f95300b0e50 2023-10-09T06:31:55.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f952f7fe700 1 -- 172.21.15.31:0/3029562766 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952800b860 con 0x7f95300b0e50 2023-10-09T06:31:55.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.931+0000 7f952f7fe700 1 -- 172.21.15.31:0/3029562766 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952800bc20 con 0x7f95300b0e50 2023-10-09T06:31:55.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.932+0000 7f9537180700 1 -- 172.21.15.31:0/3029562766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300b0e50 msgr2=0x7f95300c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.932+0000 7f9537180700 1 --2- 172.21.15.31:0/3029562766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300b0e50 0x7f95300c9180 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f953006cd30 tx=0x7f9528009250 comp rx=0 tx=0).stop 2023-10-09T06:31:55.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.932+0000 7f9537180700 1 -- 172.21.15.31:0/3029562766 shutdown_connections 2023-10-09T06:31:55.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.932+0000 7f9537180700 1 --2- 172.21.15.31:0/3029562766 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f953006dad0 0x7f95300cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.932+0000 7f9537180700 1 --2- 172.21.15.31:0/3029562766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300b0e50 0x7f95300c9180 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.932+0000 7f9537180700 1 --2- 172.21.15.31:0/3029562766 >> v2:172.21.15.158:3300/0 conn(0x7f95300b1220 0x7f953006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.932+0000 7f9537180700 1 -- 172.21.15.31:0/3029562766 >> 172.21.15.31:0/3029562766 conn(0x7f9530069870 msgr2=0x7f9530069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.932+0000 7f9537180700 1 -- 172.21.15.31:0/3029562766 shutdown_connections 2023-10-09T06:31:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.932+0000 7f9537180700 1 -- 172.21.15.31:0/3029562766 wait complete. 2023-10-09T06:31:55.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.933+0000 7f9537180700 1 Processor -- start 2023-10-09T06:31:55.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.933+0000 7f9537180700 1 -- start start 2023-10-09T06:31:55.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f9537180700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f953006dad0 0x7f9530145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f9537180700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300b0e50 0x7f95300cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f9537180700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95300b1220 0x7f9530156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f9537180700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95300c75c0 con 0x7f95300b0e50 2023-10-09T06:31:55.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f9537180700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9530153af0 con 0x7f95300b1220 2023-10-09T06:31:55.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f9537180700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953016e0b0 con 0x7f953006dad0 2023-10-09T06:31:55.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f952ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300b0e50 0x7f95300cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f952ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300b0e50 0x7f95300cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42818/0 (socket says 172.21.15.31:42818) 2023-10-09T06:31:55.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f952ffff700 1 -- 172.21.15.31:0/1244308339 learned_addr learned my addr 172.21.15.31:0/1244308339 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:55.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f9534f1c700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f953006dad0 0x7f9530145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f953571d700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95300b1220 0x7f9530156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f952ffff700 1 -- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f953006dad0 msgr2=0x7f9530145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f952ffff700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f953006dad0 0x7f9530145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f952ffff700 1 -- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95300b1220 msgr2=0x7f9530156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:55.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f952ffff700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95300b1220 0x7f9530156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:55.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f952ffff700 1 -- 172.21.15.31:0/1244308339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95280094f0 con 0x7f95300b0e50 2023-10-09T06:31:55.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f9534f1c700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f953006dad0 0x7f9530145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:55.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f952ffff700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300b0e50 0x7f95300cb7e0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f9520009e10 tx=0x7f952000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:55.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f952cff9700 1 -- 172.21.15.31:0/1244308339 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000cc20 con 0x7f95300b0e50 2023-10-09T06:31:55.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f952cff9700 1 -- 172.21.15.31:0/1244308339 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952000f040 con 0x7f95300b0e50 2023-10-09T06:31:55.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f9537180700 1 -- 172.21.15.31:0/1244308339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953016e390 con 0x7f95300b0e50 2023-10-09T06:31:55.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.934+0000 7f952cff9700 1 -- 172.21.15.31:0/1244308339 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520014480 con 0x7f95300b0e50 2023-10-09T06:31:55.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.935+0000 7f9537180700 1 -- 172.21.15.31:0/1244308339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953016e950 con 0x7f95300b0e50 2023-10-09T06:31:55.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.935+0000 7f9537180700 1 -- 172.21.15.31:0/1244308339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95300c7750 con 0x7f95300b0e50 2023-10-09T06:31:55.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.936+0000 7f952cff9700 1 -- 172.21.15.31:0/1244308339 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95200147f0 con 0x7f95300b0e50 2023-10-09T06:31:55.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.936+0000 7f952cff9700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9510066f30 0x7f95100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:55.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.936+0000 7f952cff9700 1 -- 172.21.15.31:0/1244308339 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9520085210 con 0x7f95300b0e50 2023-10-09T06:31:55.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.937+0000 7f9534f1c700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9510066f30 0x7f95100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:55.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.937+0000 7f9534f1c700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9510066f30 0x7f95100693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f953006cd30 tx=0x7f9528017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:55.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:55.941+0000 7f952cff9700 1 -- 172.21.15.31:0/1244308339 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95300c7750 con 0x7f95300b0e50 2023-10-09T06:31:56.173 INFO:tasks.ceph.mds.a.smithi031.stderr:2023-10-09T06:31:56.172+0000 7f9ecc506700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:31:56.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.176+0000 7f9537180700 1 -- 172.21.15.31:0/1244308339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95300c7700 con 0x7f95300b0e50 2023-10-09T06:31:56.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.177+0000 7f952cff9700 1 -- 172.21.15.31:0/1244308339 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f9520052480 con 0x7f95300b0e50 2023-10-09T06:31:56.177 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:56.177 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/3503727793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3503727793},{"type":"v1","addr":"172.21.15.158:6837","nonce":3503727793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2366061673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2366061673},{"type":"v1","addr":"172.21.15.158:6836","nonce":2366061673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3405107978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3405107978},{"type":"v1","addr":"172.21.15.31:6834","nonce":3405107978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:31:50.242464+0000","modified":"2023-10-09T06:31:53.876299+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8079":{"gid":8079,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4124393323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4124393323},{"type":"v1","addr":"172.21.15.31:6835","nonce":4124393323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T06:31:56.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.178+0000 7f9537180700 1 -- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9510066f30 msgr2=0x7f95100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.178+0000 7f9537180700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9510066f30 0x7f95100693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f953006cd30 tx=0x7f9528017000 comp rx=0 tx=0).stop 2023-10-09T06:31:56.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.179+0000 7f9537180700 1 -- 172.21.15.31:0/1244308339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300b0e50 msgr2=0x7f95300cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.179+0000 7f9537180700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300b0e50 0x7f95300cb7e0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f9520009e10 tx=0x7f952000b040 comp rx=0 tx=0).stop 2023-10-09T06:31:56.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.179+0000 7f9537180700 1 -- 172.21.15.31:0/1244308339 shutdown_connections 2023-10-09T06:31:56.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.179+0000 7f9537180700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9510066f30 0x7f95100693e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.179+0000 7f9537180700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f953006dad0 0x7f9530145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.179+0000 7f9537180700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95300b1220 0x7f9530156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.179+0000 7f9537180700 1 --2- 172.21.15.31:0/1244308339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300b0e50 0x7f95300cb7e0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.179+0000 7f9537180700 1 -- 172.21.15.31:0/1244308339 >> 172.21.15.31:0/1244308339 conn(0x7f9530069870 msgr2=0x7f95300c4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:56.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.179+0000 7f9537180700 1 -- 172.21.15.31:0/1244308339 shutdown_connections 2023-10-09T06:31:56.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.179+0000 7f9537180700 1 -- 172.21.15.31:0/1244308339 wait complete. 2023-10-09T06:31:56.181 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 89 2023-10-09T06:31:56.594 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:31:50.242464+0000', 'modified': '2023-10-09T06:31:53.876299+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8079}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8079': {'gid': 8079, 'name': 'a', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/4124393323', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 4124393323}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 4124393323}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:31:56.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:31:56.595 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T06:31:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.716+0000 7fd20610d700 1 Processor -- start 2023-10-09T06:31:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.716+0000 7fd20610d700 1 -- start start 2023-10-09T06:31:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.717+0000 7fd20610d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2000c9af0 0x7fd20006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.717+0000 7fd20610d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2000ca0b0 con 0x7fd200070700 2023-10-09T06:31:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.717+0000 7fd20610d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd200068a10 con 0x7fd2001510f0 2023-10-09T06:31:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.717+0000 7fd20610d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd200068cf0 con 0x7fd2000c9af0 2023-10-09T06:31:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.717+0000 7fd1feffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2000c9af0 0x7fd20006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.717+0000 7fd1fffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd200070700 0x7fd200070b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37916/0 (socket says 172.21.15.31:37916) 2023-10-09T06:31:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.717+0000 7fd1fffff700 1 -- 172.21.15.31:0/4232712756 learned_addr learned my addr 172.21.15.31:0/4232712756 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.717+0000 7fd1feffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2000c9af0 0x7fd20006ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42830/0 (socket says 172.21.15.31:42830) 2023-10-09T06:31:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.718+0000 7fd1feffd700 1 -- 172.21.15.31:0/4232712756 >> v1:172.21.15.158:6789/0 conn(0x7fd2001510f0 legacy=0x7fd20015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.718+0000 7fd1feffd700 1 -- 172.21.15.31:0/4232712756 >> v1:172.21.15.31:6789/0 conn(0x7fd200070700 legacy=0x7fd200070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.718+0000 7fd1feffd700 1 -- 172.21.15.31:0/4232712756 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000cb230 con 0x7fd2000c9af0 2023-10-09T06:31:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.718+0000 7fd1fe7fc700 1 -- 172.21.15.31:0/4232712756 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315003941 0 0) 0x7fd2000ca0b0 con 0x7fd200070700 2023-10-09T06:31:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.718+0000 7fd1feffd700 1 --2- 172.21.15.31:0/4232712756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2000c9af0 0x7fd20006ecc0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40098e0 tx=0x7fd1f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773d0c6bb5029dc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.718+0000 7fd1fe7fc700 1 -- 172.21.15.31:0/4232712756 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4009e80 con 0x7fd2000c9af0 2023-10-09T06:31:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.718+0000 7fd1fe7fc700 1 -- 172.21.15.31:0/4232712756 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f400b860 con 0x7fd2000c9af0 2023-10-09T06:31:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.718+0000 7fd1fe7fc700 1 -- 172.21.15.31:0/4232712756 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f400bbe0 con 0x7fd2000c9af0 2023-10-09T06:31:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.718+0000 7fd20610d700 1 -- 172.21.15.31:0/4232712756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2000c9af0 msgr2=0x7fd20006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.718+0000 7fd20610d700 1 --2- 172.21.15.31:0/4232712756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2000c9af0 0x7fd20006ecc0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40098e0 tx=0x7fd1f40091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.718+0000 7fd20610d700 1 -- 172.21.15.31:0/4232712756 shutdown_connections 2023-10-09T06:31:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.718+0000 7fd20610d700 1 --2- 172.21.15.31:0/4232712756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2000c9af0 0x7fd20006ecc0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.718+0000 7fd20610d700 1 -- 172.21.15.31:0/4232712756 >> 172.21.15.31:0/4232712756 conn(0x7fd2000ca4f0 msgr2=0x7fd2000ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.719+0000 7fd20610d700 1 -- 172.21.15.31:0/4232712756 shutdown_connections 2023-10-09T06:31:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.719+0000 7fd20610d700 1 -- 172.21.15.31:0/4232712756 wait complete. 2023-10-09T06:31:56.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.720+0000 7fd20610d700 1 Processor -- start 2023-10-09T06:31:56.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.720+0000 7fd20610d700 1 -- start start 2023-10-09T06:31:56.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.720+0000 7fd20610d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd200070700 0x7fd2000c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.720+0000 7fd20610d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2000c9af0 0x7fd20016b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.720+0000 7fd20610d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd2001510f0 0x7fd20016a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.720+0000 7fd20610d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20016b4b0 con 0x7fd2000c9af0 2023-10-09T06:31:56.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.720+0000 7fd20610d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000c57b0 con 0x7fd200070700 2023-10-09T06:31:56.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.720+0000 7fd20610d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20016bbb0 con 0x7fd2001510f0 2023-10-09T06:31:56.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd1feffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2000c9af0 0x7fd20016b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd1feffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2000c9af0 0x7fd20016b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42842/0 (socket says 172.21.15.31:42842) 2023-10-09T06:31:56.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd1feffd700 1 -- 172.21.15.31:0/1479923749 learned_addr learned my addr 172.21.15.31:0/1479923749 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:56.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd1feffd700 1 -- 172.21.15.31:0/1479923749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd2001510f0 msgr2=0x7fd20016a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd1feffd700 1 --2- 172.21.15.31:0/1479923749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd2001510f0 0x7fd20016a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd1feffd700 1 -- 172.21.15.31:0/1479923749 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd200070700 msgr2=0x7fd2000c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd1ff7fe700 1 --2- 172.21.15.31:0/1479923749 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd200070700 0x7fd2000c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd1feffd700 1 --2- 172.21.15.31:0/1479923749 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd200070700 0x7fd2000c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd1feffd700 1 -- 172.21.15.31:0/1479923749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f4009420 con 0x7fd2000c9af0 2023-10-09T06:31:56.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd1feffd700 1 --2- 172.21.15.31:0/1479923749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2000c9af0 0x7fd20016b670 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009f00 tx=0x7fd1f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:56.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd1e77fe700 1 -- 172.21.15.31:0/1479923749 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4011420 con 0x7fd2000c9af0 2023-10-09T06:31:56.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd1e77fe700 1 -- 172.21.15.31:0/1479923749 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4011580 con 0x7fd2000c9af0 2023-10-09T06:31:56.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd20610d700 1 -- 172.21.15.31:0/1479923749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20016aef0 con 0x7fd2000c9af0 2023-10-09T06:31:56.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd1e77fe700 1 -- 172.21.15.31:0/1479923749 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4011940 con 0x7fd2000c9af0 2023-10-09T06:31:56.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.721+0000 7fd20610d700 1 -- 172.21.15.31:0/1479923749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2000c5440 con 0x7fd2000c9af0 2023-10-09T06:31:56.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.723+0000 7fd1e77fe700 1 -- 172.21.15.31:0/1479923749 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1f4011cf0 con 0x7fd2000c9af0 2023-10-09T06:31:56.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.723+0000 7fd1e77fe700 1 --2- 172.21.15.31:0/1479923749 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1ec066f30 0x7fd1ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.723+0000 7fd1e77fe700 1 -- 172.21.15.31:0/1479923749 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1f4086000 con 0x7fd2000c9af0 2023-10-09T06:31:56.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.723+0000 7fd1ff7fe700 1 --2- 172.21.15.31:0/1479923749 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1ec066f30 0x7fd1ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.724+0000 7fd1ff7fe700 1 --2- 172.21.15.31:0/1479923749 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1ec066f30 0x7fd1ec0693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00016c0 tx=0x7fd1f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:56.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.725+0000 7fd20f405b80 1 Processor -- start 2023-10-09T06:31:56.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.725+0000 7fd20f405b80 1 -- start start 2023-10-09T06:31:56.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd20f405b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fc9da50 0x55967fc9de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd20f405b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fce7d00 0x55967fcc6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd20f405b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 0x55967fc99cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd20f405b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fbf4a70 con 0x55967fcc6f60 2023-10-09T06:31:56.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd20f405b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fbf2270 con 0x55967fc9da50 2023-10-09T06:31:56.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd20f405b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55967fbee060 con 0x55967fce7d00 2023-10-09T06:31:56.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd1fffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 0x55967fc99cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd1fffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 0x55967fc99cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42858/0 (socket says 172.21.15.31:42858) 2023-10-09T06:31:56.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd1fffff700 1 -- 172.21.15.31:0/2248635746 learned_addr learned my addr 172.21.15.31:0/2248635746 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:56.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd1feffd700 1 --2- 172.21.15.31:0/2248635746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fce7d00 0x55967fcc6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd1ff7fe700 1 --2- 172.21.15.31:0/2248635746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fc9da50 0x55967fc9de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd1fffff700 1 -- 172.21.15.31:0/2248635746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fce7d00 msgr2=0x55967fcc6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:56.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd1fffff700 1 --2- 172.21.15.31:0/2248635746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fce7d00 0x55967fcc6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd1fffff700 1 -- 172.21.15.31:0/2248635746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fc9da50 msgr2=0x55967fc9de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:56.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd1fffff700 1 --2- 172.21.15.31:0/2248635746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fc9da50 0x55967fc9de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.726+0000 7fd1fffff700 1 -- 172.21.15.31:0/2248635746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55967fa88270 con 0x55967fcc6f60 2023-10-09T06:31:56.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.727+0000 7fd1fffff700 1 --2- 172.21.15.31:0/2248635746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 0x55967fc99cf0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8002170 tx=0x7fd1f80019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87dd53c188117f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:56.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.727+0000 7fd1e4ff9700 1 -- 172.21.15.31:0/2248635746 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800cca0 con 0x55967fcc6f60 2023-10-09T06:31:56.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.727+0000 7fd1e4ff9700 1 -- 172.21.15.31:0/2248635746 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f800ce00 con 0x55967fcc6f60 2023-10-09T06:31:56.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.727+0000 7fd1e4ff9700 1 -- 172.21.15.31:0/2248635746 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8007320 con 0x55967fcc6f60 2023-10-09T06:31:56.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.727+0000 7fd20f405b80 1 -- 172.21.15.31:0/2248635746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 msgr2=0x55967fc99cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.727+0000 7fd20f405b80 1 --2- 172.21.15.31:0/2248635746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 0x55967fc99cf0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8002170 tx=0x7fd1f80019e0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.727+0000 7fd20f405b80 1 -- 172.21.15.31:0/2248635746 shutdown_connections 2023-10-09T06:31:56.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.727+0000 7fd20f405b80 1 --2- 172.21.15.31:0/2248635746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 0x55967fc99cf0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.727+0000 7fd20f405b80 1 --2- 172.21.15.31:0/2248635746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fc9da50 0x55967fc9de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.727+0000 7fd20f405b80 1 --2- 172.21.15.31:0/2248635746 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fce7d00 0x55967fcc6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.727+0000 7fd20f405b80 1 -- 172.21.15.31:0/2248635746 >> 172.21.15.31:0/2248635746 conn(0x55967fc9f370 msgr2=0x55967fc9f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.728+0000 7fd20f405b80 1 -- 172.21.15.31:0/2248635746 shutdown_connections 2023-10-09T06:31:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.728+0000 7fd20f405b80 1 -- 172.21.15.31:0/2248635746 wait complete. 2023-10-09T06:31:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.728+0000 7fd20f405b80 1 -- start start 2023-10-09T06:31:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.728+0000 7fd20f405b80 1 Processor -- start 2023-10-09T06:31:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd20f405b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fc9da50 0x55967fce7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd20f405b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fcc6f60 0x55967fcde840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd20f405b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fce7d00 0x55967fcdfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd20f405b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fb99890 con 0x55967fc9da50 2023-10-09T06:31:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd20f405b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fbb4ea0 con 0x55967fcc6f60 2023-10-09T06:31:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd20f405b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55967fa70e30 con 0x55967fce7d00 2023-10-09T06:31:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd1ff7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fc9da50 0x55967fce7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd20f405b80 10 client.0 _ll_register_callbacks cb 0x55967fc61110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:31:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd1ff7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fc9da50 0x55967fce7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42864/0 (socket says 172.21.15.31:42864) 2023-10-09T06:31:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd1ff7fe700 1 -- 172.21.15.31:0/754118273 learned_addr learned my addr 172.21.15.31:0/754118273 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd1feffd700 1 --2- 172.21.15.31:0/754118273 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fcc6f60 0x55967fcde840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd1fffff700 1 --2- 172.21.15.31:0/754118273 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fce7d00 0x55967fcdfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd1ff7fe700 1 -- 172.21.15.31:0/754118273 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fce7d00 msgr2=0x55967fcdfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:56.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd1ff7fe700 1 --2- 172.21.15.31:0/754118273 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fce7d00 0x55967fcdfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd1ff7fe700 1 -- 172.21.15.31:0/754118273 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fcc6f60 msgr2=0x55967fcde840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:56.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd1ff7fe700 1 --2- 172.21.15.31:0/754118273 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fcc6f60 0x55967fcde840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.729+0000 7fd1ff7fe700 1 -- 172.21.15.31:0/754118273 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f8001cc0 con 0x55967fc9da50 2023-10-09T06:31:56.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd1ff7fe700 1 --2- 172.21.15.31:0/754118273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fc9da50 0x55967fce7730 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0014fc0 tx=0x7fd1f0016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c996a8f2de048e83 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:56.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd1ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:31:56.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd1ddffb700 1 -- 172.21.15.31:0/754118273 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f00145c0 con 0x55967fc9da50 2023-10-09T06:31:56.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd1ddffb700 1 -- 172.21.15.31:0/754118273 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1f0012d50 con 0x55967fc9da50 2023-10-09T06:31:56.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd20f405b80 1 -- 172.21.15.31:0/754118273 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55967fc92b70 con 0x55967fc9da50 2023-10-09T06:31:56.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd1ddffb700 1 -- 172.21.15.31:0/754118273 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1f0021cb0 con 0x55967fc9da50 2023-10-09T06:31:56.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd20f405b80 10 client.8208 fetch_fsmap learned FSMap version 89 2023-10-09T06:31:56.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd20f405b80 1 -- 172.21.15.31:0/754118273 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x55967fa2afe0 con 0x55967fc9da50 2023-10-09T06:31:56.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd1ddffb700 1 -- 172.21.15.31:0/754118273 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55967fc92b70 con 0x55967fc9da50 2023-10-09T06:31:56.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd1ddffb700 1 -- 172.21.15.31:0/754118273 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 89) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd1f002b3b0 con 0x55967fc9da50 2023-10-09T06:31:56.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd20f405b80 10 client.8208 fetch_fsmap finished waiting for FSMap version 89 2023-10-09T06:31:56.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd20f405b80 10 client.8208 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T06:31:56.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd20f405b80 20 client.8208 populate_metadata read hostname 'smithi031' 2023-10-09T06:31:56.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd20f405b80 1 --2- 172.21.15.31:0/754118273 >> [v2:172.21.15.31:6833/4124393323,v1:172.21.15.31:6835/4124393323] conn(0x55967fccce80 0x55967fccd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd20f405b80 4 client.8208 mds_command: new command op to 8079 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:31:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd20f405b80 1 -- 172.21.15.31:0/754118273 --> [v2:172.21.15.31:6833/4124393323,v1:172.21.15.31:6835/4124393323] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55967fc6faa0 con 0x55967fccce80 2023-10-09T06:31:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.730+0000 7fd1feffd700 1 --2- 172.21.15.31:0/754118273 >> [v2:172.21.15.31:6833/4124393323,v1:172.21.15.31:6835/4124393323] conn(0x55967fccce80 0x55967fccd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd1ddffb700 10 client.8208 ms_handle_connect on v2:172.21.15.31:6833/4124393323 2023-10-09T06:31:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd1feffd700 1 --2- 172.21.15.31:0/754118273 >> [v2:172.21.15.31:6833/4124393323,v1:172.21.15.31:6835/4124393323] conn(0x55967fccce80 0x55967fccd250 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=272598b18e01a343 server_cookie=9ebf448ec3616cb7 in_seq=0 out_seq=0 2023-10-09T06:31:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd1ddffb700 1 -- 172.21.15.31:0/754118273 <== mds.0 v2:172.21.15.31:6833/4124393323 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55967fc6faa0 con 0x55967fccce80 2023-10-09T06:31:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd1ddffb700 10 client.8208 handle_command_reply: tid=0 2023-10-09T06:31:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd20f405b80 1 client.8208 shutdown 2023-10-09T06:31:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd20f405b80 1 -- 172.21.15.31:0/754118273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fc9da50 msgr2=0x55967fce7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd20f405b80 1 --2- 172.21.15.31:0/754118273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fc9da50 0x55967fce7730 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0014fc0 tx=0x7fd1f0016040 comp rx=0 tx=0).stop 2023-10-09T06:31:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd20f405b80 1 -- 172.21.15.31:0/754118273 shutdown_connections 2023-10-09T06:31:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd20f405b80 1 --2- 172.21.15.31:0/754118273 >> [v2:172.21.15.31:6833/4124393323,v1:172.21.15.31:6835/4124393323] conn(0x55967fccce80 0x55967fccd250 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd20f405b80 1 --2- 172.21.15.31:0/754118273 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fce7d00 0x55967fcdfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd20f405b80 1 --2- 172.21.15.31:0/754118273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fc9da50 0x55967fce7730 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd1ddffb700 0 client.8208 ms_handle_reset on v2:172.21.15.31:6833/4124393323 2023-10-09T06:31:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd20f405b80 1 --2- 172.21.15.31:0/754118273 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fcc6f60 0x55967fcde840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd20f405b80 1 -- 172.21.15.31:0/754118273 >> 172.21.15.31:0/754118273 conn(0x55967fc9f370 msgr2=0x55967fc9a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd20f405b80 1 -- 172.21.15.31:0/754118273 shutdown_connections 2023-10-09T06:31:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.731+0000 7fd20f405b80 1 -- 172.21.15.31:0/754118273 wait complete. 2023-10-09T06:31:56.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.732+0000 7fd20f405b80 20 client.8208 trim_cache size 0 max 16384 2023-10-09T06:31:56.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.748+0000 7fd20f405b80 1 Processor -- start 2023-10-09T06:31:56.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.748+0000 7fd20f405b80 1 -- start start 2023-10-09T06:31:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.749+0000 7fd20f405b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fc9da50 0x55967fccd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.749+0000 7fd20f405b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fcc6f60 0x55967fc98cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.749+0000 7fd20f405b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fce7d00 0x55967fce0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.749+0000 7fd20f405b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fcdd7a0 con 0x55967fce7d00 2023-10-09T06:31:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.749+0000 7fd20f405b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fcca9d0 con 0x55967fc9da50 2023-10-09T06:31:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.749+0000 7fd20f405b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55967fce1ac0 con 0x55967fcc6f60 2023-10-09T06:31:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.749+0000 7fd1fffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fce7d00 0x55967fce0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.749+0000 7fd1fffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fce7d00 0x55967fce0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42880/0 (socket says 172.21.15.31:42880) 2023-10-09T06:31:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.749+0000 7fd1fffff700 1 -- 172.21.15.31:0/1858218503 learned_addr learned my addr 172.21.15.31:0/1858218503 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.749+0000 7fd1ff7fe700 1 --2- 172.21.15.31:0/1858218503 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fc9da50 0x55967fccd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.749+0000 7fd1feffd700 1 --2- 172.21.15.31:0/1858218503 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fcc6f60 0x55967fc98cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd1fffff700 1 -- 172.21.15.31:0/1858218503 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fcc6f60 msgr2=0x55967fc98cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd1fffff700 1 --2- 172.21.15.31:0/1858218503 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fcc6f60 0x55967fc98cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd1fffff700 1 -- 172.21.15.31:0/1858218503 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fc9da50 msgr2=0x55967fccd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd1fffff700 1 --2- 172.21.15.31:0/1858218503 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fc9da50 0x55967fccd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd1fffff700 1 -- 172.21.15.31:0/1858218503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55967fbbc780 con 0x55967fce7d00 2023-10-09T06:31:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd1fffff700 1 --2- 172.21.15.31:0/1858218503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fce7d00 0x55967fce0ab0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8011000 tx=0x7fd1f8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6af19bf08cd8a80 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd1e57fa700 1 -- 172.21.15.31:0/1858218503 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8001b20 con 0x55967fce7d00 2023-10-09T06:31:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd1e57fa700 1 -- 172.21.15.31:0/1858218503 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f8024070 con 0x55967fce7d00 2023-10-09T06:31:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd1e57fa700 1 -- 172.21.15.31:0/1858218503 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8000f40 con 0x55967fce7d00 2023-10-09T06:31:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd20f405b80 1 -- 172.21.15.31:0/1858218503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fce7d00 msgr2=0x55967fce0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd20f405b80 1 --2- 172.21.15.31:0/1858218503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fce7d00 0x55967fce0ab0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8011000 tx=0x7fd1f8015000 comp rx=0 tx=0).stop 2023-10-09T06:31:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd20f405b80 1 -- 172.21.15.31:0/1858218503 shutdown_connections 2023-10-09T06:31:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd20f405b80 1 --2- 172.21.15.31:0/1858218503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fce7d00 0x55967fce0ab0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd20f405b80 1 --2- 172.21.15.31:0/1858218503 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fc9da50 0x55967fccd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd20f405b80 1 --2- 172.21.15.31:0/1858218503 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fcc6f60 0x55967fc98cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.750+0000 7fd20f405b80 1 -- 172.21.15.31:0/1858218503 >> 172.21.15.31:0/1858218503 conn(0x55967fc9f370 msgr2=0x55967fcc5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:56.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.751+0000 7fd20f405b80 1 -- 172.21.15.31:0/1858218503 shutdown_connections 2023-10-09T06:31:56.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.751+0000 7fd20f405b80 1 -- 172.21.15.31:0/1858218503 wait complete. 2023-10-09T06:31:56.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.751+0000 7fd20f405b80 1 -- start start 2023-10-09T06:31:56.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.751+0000 7fd20f405b80 1 Processor -- start 2023-10-09T06:31:56.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd20f405b80 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fc9da50 0x55967fcdaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd20f405b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 0x55967fd2f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd20f405b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fce7d00 0x55967fcf3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd20f405b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fccd590 con 0x55967fcc6f60 2023-10-09T06:31:56.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd20f405b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fce7170 con 0x55967fce7d00 2023-10-09T06:31:56.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd20f405b80 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x55967fcfcd40 con 0x55967fc9da50 2023-10-09T06:31:56.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd20f405b80 10 client.0 _ll_register_callbacks cb 0x55967fc61110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:31:56.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1feffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 0x55967fd2f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1feffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 0x55967fd2f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42886/0 (socket says 172.21.15.31:42886) 2023-10-09T06:31:56.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1feffd700 1 -- 172.21.15.31:0/2912908620 learned_addr learned my addr 172.21.15.31:0/2912908620 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:56.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1ff7fe700 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fc9da50 0x55967fcdaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1fffff700 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fce7d00 0x55967fcf3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1feffd700 1 -- 172.21.15.31:0/2912908620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fc9da50 msgr2=0x55967fcdaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:56.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1feffd700 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fc9da50 0x55967fcdaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1feffd700 1 -- 172.21.15.31:0/2912908620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fce7d00 msgr2=0x55967fcf3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:56.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1feffd700 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fce7d00 0x55967fcf3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1feffd700 1 -- 172.21.15.31:0/2912908620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55967fa88270 con 0x55967fcc6f60 2023-10-09T06:31:56.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1fffff700 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fce7d00 0x55967fcf3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:56.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1feffd700 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 0x55967fd2f920 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4056ec0 tx=0x7fd1f406b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52eb9682061f633b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:56.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-10-09T06:31:56.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1ddffb700 1 -- 172.21.15.31:0/2912908620 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40552d0 con 0x55967fcc6f60 2023-10-09T06:31:56.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.752+0000 7fd1ddffb700 1 -- 172.21.15.31:0/2912908620 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1f406d1c0 con 0x55967fcc6f60 2023-10-09T06:31:56.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd20f405b80 1 -- 172.21.15.31:0/2912908620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1f800ce00 con 0x55967fcc6f60 2023-10-09T06:31:56.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd1ddffb700 1 -- 172.21.15.31:0/2912908620 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1f406d380 con 0x55967fcc6f60 2023-10-09T06:31:56.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd20f405b80 10 client.8214 fetch_fsmap learned FSMap version 89 2023-10-09T06:31:56.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd20f405b80 1 -- 172.21.15.31:0/2912908620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x55967fba3470 con 0x55967fcc6f60 2023-10-09T06:31:56.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd1ddffb700 1 -- 172.21.15.31:0/2912908620 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4082020 con 0x55967fcc6f60 2023-10-09T06:31:56.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd1ddffb700 1 -- 172.21.15.31:0/2912908620 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 89) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd1f4057190 con 0x55967fcc6f60 2023-10-09T06:31:56.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd20f405b80 10 client.8214 fetch_fsmap finished waiting for FSMap version 89 2023-10-09T06:31:56.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd20f405b80 10 client.8214 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T06:31:56.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd20f405b80 20 client.8214 populate_metadata read hostname 'smithi031' 2023-10-09T06:31:56.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd20f405b80 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.31:6833/4124393323,v1:172.21.15.31:6835/4124393323] conn(0x55967fce6390 0x55967fce6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd20f405b80 4 client.8214 mds_command: new command op to 8079 tid=0[{"prefix": "status"}] 2023-10-09T06:31:56.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd20f405b80 1 -- 172.21.15.31:0/2912908620 --> [v2:172.21.15.31:6833/4124393323,v1:172.21.15.31:6835/4124393323] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55967fb90e00 con 0x55967fce6390 2023-10-09T06:31:56.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd1ff7fe700 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.31:6833/4124393323,v1:172.21.15.31:6835/4124393323] conn(0x55967fce6390 0x55967fce6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd1ff7fe700 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.31:6833/4124393323,v1:172.21.15.31:6835/4124393323] conn(0x55967fce6390 0x55967fce6760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e1e4edc171eb652 server_cookie=7ee04d6bf4766f9b in_seq=0 out_seq=0 2023-10-09T06:31:56.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd1ddffb700 10 client.8214 ms_handle_connect on v2:172.21.15.31:6833/4124393323 2023-10-09T06:31:56.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd1ddffb700 1 -- 172.21.15.31:0/2912908620 <== mds.0 v2:172.21.15.31:6833/4124393323 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55967fb90e00 con 0x55967fce6390 2023-10-09T06:31:56.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd1ddffb700 10 client.8214 handle_command_reply: tid=0 2023-10-09T06:31:56.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.753+0000 7fd20f405b80 1 client.8214 shutdown 2023-10-09T06:31:56.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20f405b80 1 -- 172.21.15.31:0/2912908620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 msgr2=0x55967fd2f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20f405b80 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 0x55967fd2f920 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4056ec0 tx=0x7fd1f406b040 comp rx=0 tx=0).stop 2023-10-09T06:31:56.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20f405b80 1 -- 172.21.15.31:0/2912908620 shutdown_connections 2023-10-09T06:31:56.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20f405b80 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.31:6833/4124393323,v1:172.21.15.31:6835/4124393323] conn(0x55967fce6390 0x55967fce6760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20f405b80 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x55967fc9da50 0x55967fcdaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20f405b80 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55967fce7d00 0x55967fcf3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd1ddffb700 0 client.8214 ms_handle_reset on v2:172.21.15.31:6833/4124393323 2023-10-09T06:31:56.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20f405b80 1 --2- 172.21.15.31:0/2912908620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55967fcc6f60 0x55967fd2f920 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20f405b80 1 -- 172.21.15.31:0/2912908620 >> 172.21.15.31:0/2912908620 conn(0x55967fc9f370 msgr2=0x55967fce0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:56.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20f405b80 1 -- 172.21.15.31:0/2912908620 shutdown_connections 2023-10-09T06:31:56.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20f405b80 1 -- 172.21.15.31:0/2912908620 wait complete. 2023-10-09T06:31:56.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20f405b80 20 client.8214 trim_cache size 0 max 16384 2023-10-09T06:31:56.764 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:31:56.765 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:31:56.765 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-10-09T06:31:56.765 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 8079, 2023-10-09T06:31:56.765 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-10-09T06:31:56.765 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-10-09T06:31:56.765 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-10-09T06:31:56.765 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 5.8839140629999998, 2023-10-09T06:31:56.765 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 89, 2023-10-09T06:31:56.765 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 185, 2023-10-09T06:31:56.766 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 185, 2023-10-09T06:31:56.766 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 10.977932997 2023-10-09T06:31:56.766 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:31:56.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20610d700 1 -- 172.21.15.31:0/1479923749 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1ec066f30 msgr2=0x7fd1ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20610d700 1 --2- 172.21.15.31:0/1479923749 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1ec066f30 0x7fd1ec0693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00016c0 tx=0x7fd1f0009040 comp rx=0 tx=0).stop 2023-10-09T06:31:56.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20610d700 1 -- 172.21.15.31:0/1479923749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2000c9af0 msgr2=0x7fd20016b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20610d700 1 --2- 172.21.15.31:0/1479923749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2000c9af0 0x7fd20016b670 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009f00 tx=0x7fd1f4017000 comp rx=0 tx=0).stop 2023-10-09T06:31:56.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20610d700 1 -- 172.21.15.31:0/1479923749 shutdown_connections 2023-10-09T06:31:56.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20610d700 1 --2- 172.21.15.31:0/1479923749 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd1ec066f30 0x7fd1ec0693e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20610d700 1 --2- 172.21.15.31:0/1479923749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd2001510f0 0x7fd20016a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20610d700 1 --2- 172.21.15.31:0/1479923749 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd200070700 0x7fd2000c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20610d700 1 --2- 172.21.15.31:0/1479923749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2000c9af0 0x7fd20016b670 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20610d700 1 -- 172.21.15.31:0/1479923749 >> 172.21.15.31:0/1479923749 conn(0x7fd2000ca4f0 msgr2=0x7fd2000ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:56.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20610d700 1 -- 172.21.15.31:0/1479923749 shutdown_connections 2023-10-09T06:31:56.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.754+0000 7fd20610d700 1 -- 172.21.15.31:0/1479923749 wait complete. 2023-10-09T06:31:56.769 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:31:56.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.889+0000 7f0ac70f7700 1 Processor -- start 2023-10-09T06:31:56.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.889+0000 7f0ac70f7700 1 -- start start 2023-10-09T06:31:56.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.890+0000 7f0ac70f7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ac01523e0 0x7f0ac006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.890+0000 7f0ac70f7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ac0158e50 0x7f0ac00cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.890+0000 7f0ac70f7700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac006c010 con 0x7f0ac0152010 2023-10-09T06:31:56.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.890+0000 7f0ac70f7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac006bd10 con 0x7f0ac01523e0 2023-10-09T06:31:56.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.890+0000 7f0ac70f7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac015c060 con 0x7f0ac0158e50 2023-10-09T06:31:56.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.890+0000 7f0abffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ac01523e0 0x7f0ac006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.890+0000 7f0abffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ac01523e0 0x7f0ac006c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42892/0 (socket says 172.21.15.31:42892) 2023-10-09T06:31:56.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.890+0000 7f0abffff700 1 -- 172.21.15.31:0/1321924344 learned_addr learned my addr 172.21.15.31:0/1321924344 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:56.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.890+0000 7f0ac5694700 1 --2- 172.21.15.31:0/1321924344 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ac0158e50 0x7f0ac00cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.891+0000 7f0abffff700 1 -- 172.21.15.31:0/1321924344 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ac0158e50 msgr2=0x7f0ac00cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:56.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.891+0000 7f0abffff700 1 --2- 172.21.15.31:0/1321924344 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ac0158e50 0x7f0ac00cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.891+0000 7f0abffff700 1 -- 172.21.15.31:0/1321924344 >> v1:172.21.15.158:6789/0 conn(0x7f0ac0152010 legacy=0x7f0ac015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.891+0000 7f0abffff700 1 -- 172.21.15.31:0/1321924344 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac015c340 con 0x7f0ac01523e0 2023-10-09T06:31:56.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.891+0000 7f0abffff700 1 --2- 172.21.15.31:0/1321924344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac01523e0 0x7f0ac006c4a0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009f20 tx=0x7f0ab0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3745e6dabf8bd8a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:56.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.893+0000 7f0abf7fe700 1 -- 172.21.15.31:0/1321924344 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab000e070 con 0x7f0ac01523e0 2023-10-09T06:31:56.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.893+0000 7f0abf7fe700 1 -- 172.21.15.31:0/1321924344 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab000b9d0 con 0x7f0ac01523e0 2023-10-09T06:31:56.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.893+0000 7f0abf7fe700 1 -- 172.21.15.31:0/1321924344 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab00092e0 con 0x7f0ac01523e0 2023-10-09T06:31:56.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.893+0000 7f0ac70f7700 1 -- 172.21.15.31:0/1321924344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac01523e0 msgr2=0x7f0ac006c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.893+0000 7f0ac70f7700 1 --2- 172.21.15.31:0/1321924344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac01523e0 0x7f0ac006c4a0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009f20 tx=0x7f0ab0009840 comp rx=0 tx=0).stop 2023-10-09T06:31:56.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.893+0000 7f0ac70f7700 1 -- 172.21.15.31:0/1321924344 shutdown_connections 2023-10-09T06:31:56.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.893+0000 7f0ac70f7700 1 --2- 172.21.15.31:0/1321924344 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ac0158e50 0x7f0ac00cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.893+0000 7f0ac70f7700 1 --2- 172.21.15.31:0/1321924344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac01523e0 0x7f0ac006c4a0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.893+0000 7f0ac70f7700 1 -- 172.21.15.31:0/1321924344 >> 172.21.15.31:0/1321924344 conn(0x7f0ac0069870 msgr2=0x7f0ac0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:56.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.893+0000 7f0ac70f7700 1 -- 172.21.15.31:0/1321924344 shutdown_connections 2023-10-09T06:31:56.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.894+0000 7f0ac70f7700 1 -- 172.21.15.31:0/1321924344 wait complete. 2023-10-09T06:31:56.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.895+0000 7f0ac70f7700 1 Processor -- start 2023-10-09T06:31:56.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.895+0000 7f0ac70f7700 1 -- start start 2023-10-09T06:31:56.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0ac70f7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ac0152010 0x7f0ac0156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0ac70f7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac01523e0 0x7f0ac0067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0ac70f7700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ac0158e50 0x7f0ac0067ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0ac70f7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac0068de0 con 0x7f0ac01523e0 2023-10-09T06:31:56.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0ac70f7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00b1da0 con 0x7f0ac0152010 2023-10-09T06:31:56.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0ac70f7700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00c6ea0 con 0x7f0ac0158e50 2023-10-09T06:31:56.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0abffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac01523e0 0x7f0ac0067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0abffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac01523e0 0x7f0ac0067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42906/0 (socket says 172.21.15.31:42906) 2023-10-09T06:31:56.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0abffff700 1 -- 172.21.15.31:0/2764033572 learned_addr learned my addr 172.21.15.31:0/2764033572 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:56.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0ac4e93700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ac0152010 0x7f0ac0156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0ac5694700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ac0158e50 0x7f0ac0067ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0abffff700 1 -- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ac0158e50 msgr2=0x7f0ac0067ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0abffff700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ac0158e50 0x7f0ac0067ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0abffff700 1 -- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ac0152010 msgr2=0x7f0ac0156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:56.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0abffff700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ac0152010 0x7f0ac0156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:56.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0abffff700 1 -- 172.21.15.31:0/2764033572 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab0009ae0 con 0x7f0ac01523e0 2023-10-09T06:31:56.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.896+0000 7f0abffff700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac01523e0 0x7f0ac0067660 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000b610 tx=0x7f0ab0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:56.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.899+0000 7f0abcff9700 1 -- 172.21.15.31:0/2764033572 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab00088f0 con 0x7f0ac01523e0 2023-10-09T06:31:56.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.899+0000 7f0abcff9700 1 -- 172.21.15.31:0/2764033572 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab0008a50 con 0x7f0ac01523e0 2023-10-09T06:31:56.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.899+0000 7f0ac70f7700 1 -- 172.21.15.31:0/2764033572 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac00681d0 con 0x7f0ac01523e0 2023-10-09T06:31:56.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.899+0000 7f0abcff9700 1 -- 172.21.15.31:0/2764033572 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0008df0 con 0x7f0ac01523e0 2023-10-09T06:31:56.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.900+0000 7f0ac70f7700 1 -- 172.21.15.31:0/2764033572 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac0068560 con 0x7f0ac01523e0 2023-10-09T06:31:56.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.900+0000 7f0ac70f7700 1 -- 172.21.15.31:0/2764033572 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac004c3c0 con 0x7f0ac01523e0 2023-10-09T06:31:56.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.901+0000 7f0abcff9700 1 -- 172.21.15.31:0/2764033572 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ab0003040 con 0x7f0ac01523e0 2023-10-09T06:31:56.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.901+0000 7f0abcff9700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0aa0066f30 0x7f0aa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:56.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.901+0000 7f0abcff9700 1 -- 172.21.15.31:0/2764033572 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ab00862e0 con 0x7f0ac01523e0 2023-10-09T06:31:56.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.902+0000 7f0ac4e93700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0aa0066f30 0x7f0aa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:56.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.902+0000 7f0ac4e93700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0aa0066f30 0x7f0aa00693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80039e0 tx=0x7f0ab8007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:56.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:56.906+0000 7f0abcff9700 1 -- 172.21.15.31:0/2764033572 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ab0053550 con 0x7f0ac01523e0 2023-10-09T06:31:57.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.141+0000 7f0ac70f7700 1 -- 172.21.15.31:0/2764033572 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0ac0158540 con 0x7f0ac01523e0 2023-10-09T06:31:57.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.142+0000 7f0abcff9700 1 -- 172.21.15.31:0/2764033572 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0ab0056b70 con 0x7f0ac01523e0 2023-10-09T06:31:57.142 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:31:57.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.143+0000 7f0ac70f7700 1 -- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0aa0066f30 msgr2=0x7f0aa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:57.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.143+0000 7f0ac70f7700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0aa0066f30 0x7f0aa00693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80039e0 tx=0x7f0ab8007ec0 comp rx=0 tx=0).stop 2023-10-09T06:31:57.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.143+0000 7f0ac70f7700 1 -- 172.21.15.31:0/2764033572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac01523e0 msgr2=0x7f0ac0067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:57.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.143+0000 7f0ac70f7700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac01523e0 0x7f0ac0067660 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000b610 tx=0x7f0ab0018000 comp rx=0 tx=0).stop 2023-10-09T06:31:57.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.143+0000 7f0ac70f7700 1 -- 172.21.15.31:0/2764033572 shutdown_connections 2023-10-09T06:31:57.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.143+0000 7f0ac70f7700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0aa0066f30 0x7f0aa00693e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:57.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.143+0000 7f0ac70f7700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ac0158e50 0x7f0ac0067ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:57.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.143+0000 7f0ac70f7700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ac0152010 0x7f0ac0156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:57.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.143+0000 7f0ac70f7700 1 --2- 172.21.15.31:0/2764033572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac01523e0 0x7f0ac0067660 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:57.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.143+0000 7f0ac70f7700 1 -- 172.21.15.31:0/2764033572 >> 172.21.15.31:0/2764033572 conn(0x7f0ac0069870 msgr2=0x7f0ac00cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:57.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.144+0000 7f0ac70f7700 1 -- 172.21.15.31:0/2764033572 shutdown_connections 2023-10-09T06:31:57.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.144+0000 7f0ac70f7700 1 -- 172.21.15.31:0/2764033572 wait complete. 2023-10-09T06:31:57.156 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:31:57.156 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:31:57.156 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-10-09T06:31:57.156 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:31:57.157 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:31:57.157 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:31:57.157 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:31:57.157 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:31:57.157 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:31:57.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:57.157 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-10-09T06:31:57.172 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:31:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:31:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:31:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-10-09T06:31:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:57.173 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:31:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T06:31:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-10-09T06:31:57.173 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:31:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T06:31:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-10-09T06:31:57.174 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:31:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-10-09T06:31:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-10-09T06:31:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T06:31:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 41850sec preferred_lft 41850sec 2023-10-09T06:31:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-10-09T06:31:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:57.174 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:31:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:31:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-10-09T06:31:57.175 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:31:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:31:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:31:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::b4ad:53ff:fed3:a589/64 scope link 2023-10-09T06:31:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:57.175 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:31:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether f6:bf:b8:0f:49:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:31:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::f4bf:b8ff:fe0f:498b/64 scope link 2023-10-09T06:31:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:57.175 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:31:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether da:ab:b5:1d:e0:66 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:31:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::d8ab:b5ff:fe1d:e066/64 scope link 2023-10-09T06:31:57.176 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:57.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:57.176 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:31:57.196 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:31:57.215 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:31:57.237 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-10-09T06:31:57.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:57.238 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-10-09T06:31:57.320 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-10-09T06:31:57.320 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:31:57.320 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T06:31:57.320 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T06:31:57.320 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:31:57.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:57.321 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-10-09T06:31:57.321 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-10-09T06:31:57.321 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T06:31:57.321 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T06:31:57.321 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T06:31:57.321 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-10-09T06:31:57.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:57.422 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:31:57.437 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:31:57.437 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:31:57.437 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:31:57.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:57.438 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-10-09T06:31:57.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:31:57.503 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:31:57.558 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:31:57.559 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:31:57.559 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:31:57.613 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:31:57.613 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:31:57.613 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:31:57.695 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:31:57.695 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:31:57.713 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:31:57.714 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:31:57.714 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:31:57.714 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:31:57.714 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:31:57.714 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:31:57.714 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:31:57.714 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:31:57.734 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:31:57.734 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:31:57.735 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:31:57.735 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:31:57.735 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:31:57.735 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:31:57.735 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:31:57.735 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:31:57.735 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:31:57.735 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:31:57.735 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:31:57.736 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:31:57.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:57.737 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:31:57.802 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:31:57.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.961+0000 7fa0a568e700 1 Processor -- start 2023-10-09T06:31:57.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.961+0000 7fa0a568e700 1 -- start start 2023-10-09T06:31:57.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.962+0000 7fa0a568e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a01523e0 0x7fa0a006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:57.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.962+0000 7fa0a568e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa0a0158e50 0x7fa0a00cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:57.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.962+0000 7fa0a568e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a006c010 con 0x7fa0a0152010 2023-10-09T06:31:57.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.962+0000 7fa0a568e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a006bd10 con 0x7fa0a0158e50 2023-10-09T06:31:57.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.962+0000 7fa0a568e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a015c060 con 0x7fa0a01523e0 2023-10-09T06:31:57.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.962+0000 7fa09effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa0a0152010 0x7fa0a015b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37922/0 (socket says 172.21.15.31:37922) 2023-10-09T06:31:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.962+0000 7fa09effd700 1 -- 172.21.15.31:0/2094072824 learned_addr learned my addr 172.21.15.31:0/2094072824 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.962+0000 7fa09e7fc700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a01523e0 0x7fa0a006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.962+0000 7fa09f7fe700 1 --2- 172.21.15.31:0/2094072824 >> v2:172.21.15.158:3300/0 conn(0x7fa0a0158e50 0x7fa0a00cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.962+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121380478 0 0) 0x7fa0a006c010 con 0x7fa0a0152010 2023-10-09T06:31:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.962+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa08c003570 con 0x7fa0a0152010 2023-10-09T06:31:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1721932246 0 0) 0x7fa08c003570 con 0x7fa0a0152010 2023-10-09T06:31:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a01523e0 msgr2=0x7fa0a006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a01523e0 0x7fa0a006c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 >> v2:172.21.15.158:3300/0 conn(0x7fa0a0158e50 msgr2=0x7fa0a00cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 --2- 172.21.15.31:0/2094072824 >> v2:172.21.15.158:3300/0 conn(0x7fa0a0158e50 0x7fa0a00cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a015c340 con 0x7fa0a0152010 2023-10-09T06:31:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fa098001470 con 0x7fa0a0152010 2023-10-09T06:31:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 >> v1:172.21.15.31:6789/0 conn(0x7fa0a0152010 legacy=0x7fa0a015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa08c003a60 0x7fa08c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa08c004810 0x7fa08c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a01523e0 0x7fa08c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a006bd10 con 0x7fa08c003a60 2023-10-09T06:31:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a015c060 con 0x7fa08c004810 2023-10-09T06:31:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c00ba60 con 0x7fa0a01523e0 2023-10-09T06:31:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09effd700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa08c003a60 0x7fa08c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09e7fc700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa08c004810 0x7fa08c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09f7fe700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a01523e0 0x7fa08c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09effd700 1 -- 172.21.15.31:0/2094072824 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a01523e0 msgr2=0x7fa08c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09effd700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a01523e0 0x7fa08c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09effd700 1 -- 172.21.15.31:0/2094072824 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa08c004810 msgr2=0x7fa08c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09effd700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa08c004810 0x7fa08c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09effd700 1 -- 172.21.15.31:0/2094072824 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c003570 con 0x7fa08c003a60 2023-10-09T06:31:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09e7fc700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa08c004810 0x7fa08c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09f7fe700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a01523e0 0x7fa08c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:31:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.963+0000 7fa09effd700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa08c003a60 0x7fa08c003e70 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fa09800c3f0 tx=0x7fa098001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10ec60a7da00577 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.964+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09800cc80 con 0x7fa08c003a60 2023-10-09T06:31:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.964+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09800ce00 con 0x7fa08c003a60 2023-10-09T06:31:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.964+0000 7fa09dffb700 1 -- 172.21.15.31:0/2094072824 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098005b70 con 0x7fa08c003a60 2023-10-09T06:31:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.964+0000 7fa0a568e700 1 -- 172.21.15.31:0/2094072824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa08c003a60 msgr2=0x7fa08c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.964+0000 7fa0a568e700 1 --2- 172.21.15.31:0/2094072824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa08c003a60 0x7fa08c003e70 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fa09800c3f0 tx=0x7fa098001e90 comp rx=0 tx=0).stop 2023-10-09T06:31:57.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.964+0000 7fa09f7fe700 1 -- 172.21.15.31:0/2094072824 reap_dead start 2023-10-09T06:31:57.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.964+0000 7fa0a568e700 1 -- 172.21.15.31:0/2094072824 shutdown_connections 2023-10-09T06:31:57.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.964+0000 7fa0a568e700 1 -- 172.21.15.31:0/2094072824 >> 172.21.15.31:0/2094072824 conn(0x7fa0a0069870 msgr2=0x7fa0a0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:57.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.964+0000 7fa0a568e700 1 -- 172.21.15.31:0/2094072824 shutdown_connections 2023-10-09T06:31:57.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.964+0000 7fa0a568e700 1 -- 172.21.15.31:0/2094072824 wait complete. 2023-10-09T06:31:57.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.965+0000 7fa0a568e700 1 Processor -- start 2023-10-09T06:31:57.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.965+0000 7fa0a568e700 1 -- start start 2023-10-09T06:31:57.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa0a568e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa08c003a60 0x7fa0a00cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:57.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa0a568e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a00b3f50 0x7fa0a00b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:57.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa0a568e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0a013ff90 0x7fa0a0140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa0a568e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a0141920 con 0x7fa0a013ff90 2023-10-09T06:31:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa0a568e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00b4900 con 0x7fa08c003a60 2023-10-09T06:31:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa0a568e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a0140d10 con 0x7fa0a00b3f50 2023-10-09T06:31:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa09f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0a013ff90 0x7fa0a0140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa09f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0a013ff90 0x7fa0a0140410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42926/0 (socket says 172.21.15.31:42926) 2023-10-09T06:31:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa09f7fe700 1 -- 172.21.15.31:0/2935980513 learned_addr learned my addr 172.21.15.31:0/2935980513 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa09effd700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa08c003a60 0x7fa0a00cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa09e7fc700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a00b3f50 0x7fa0a00b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa09f7fe700 1 -- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a00b3f50 msgr2=0x7fa0a00b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa09f7fe700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a00b3f50 0x7fa0a00b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa09f7fe700 1 -- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa08c003a60 msgr2=0x7fa0a00cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:57.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa09f7fe700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa08c003a60 0x7fa0a00cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:57.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.966+0000 7fa09f7fe700 1 -- 172.21.15.31:0/2935980513 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a0140ff0 con 0x7fa0a013ff90 2023-10-09T06:31:57.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.967+0000 7fa09f7fe700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0a013ff90 0x7fa0a0140410 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00ceb10 tx=0x7fa09000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:57.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.967+0000 7fa096ffd700 1 -- 172.21.15.31:0/2935980513 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09001b070 con 0x7fa0a013ff90 2023-10-09T06:31:57.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.967+0000 7fa096ffd700 1 -- 172.21.15.31:0/2935980513 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09000f040 con 0x7fa0a013ff90 2023-10-09T06:31:57.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.967+0000 7fa0a568e700 1 -- 172.21.15.31:0/2935980513 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a01412d0 con 0x7fa0a013ff90 2023-10-09T06:31:57.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.967+0000 7fa096ffd700 1 -- 172.21.15.31:0/2935980513 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09000e050 con 0x7fa0a013ff90 2023-10-09T06:31:57.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.967+0000 7fa0a568e700 1 -- 172.21.15.31:0/2935980513 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a0140950 con 0x7fa0a013ff90 2023-10-09T06:31:57.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.968+0000 7fa0a568e700 1 -- 172.21.15.31:0/2935980513 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a0141cb0 con 0x7fa0a013ff90 2023-10-09T06:31:57.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.968+0000 7fa096ffd700 1 -- 172.21.15.31:0/2935980513 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa090003020 con 0x7fa0a013ff90 2023-10-09T06:31:57.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.969+0000 7fa096ffd700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa080066f30 0x7fa0800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:57.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.969+0000 7fa096ffd700 1 -- 172.21.15.31:0/2935980513 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa0900849f0 con 0x7fa0a013ff90 2023-10-09T06:31:57.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.969+0000 7fa09effd700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa080066f30 0x7fa0800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:57.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.969+0000 7fa09effd700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa080066f30 0x7fa0800693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa09800c390 tx=0x7fa098015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:57.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:57.973+0000 7fa096ffd700 1 -- 172.21.15.31:0/2935980513 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0a0141cb0 con 0x7fa0a013ff90 2023-10-09T06:31:58.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.211+0000 7fa0a568e700 1 -- 172.21.15.31:0/2935980513 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa0a004c3c0 con 0x7fa0a013ff90 2023-10-09T06:31:58.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.211+0000 7fa096ffd700 1 -- 172.21.15.31:0/2935980513 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa090051c60 con 0x7fa0a013ff90 2023-10-09T06:31:58.212 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:31:58.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.213+0000 7fa0a568e700 1 -- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa080066f30 msgr2=0x7fa0800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:58.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.213+0000 7fa0a568e700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa080066f30 0x7fa0800693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa09800c390 tx=0x7fa098015000 comp rx=0 tx=0).stop 2023-10-09T06:31:58.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.213+0000 7fa0a568e700 1 -- 172.21.15.31:0/2935980513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0a013ff90 msgr2=0x7fa0a0140410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:58.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.213+0000 7fa0a568e700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0a013ff90 0x7fa0a0140410 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00ceb10 tx=0x7fa09000b040 comp rx=0 tx=0).stop 2023-10-09T06:31:58.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.213+0000 7fa0a568e700 1 -- 172.21.15.31:0/2935980513 shutdown_connections 2023-10-09T06:31:58.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.213+0000 7fa0a568e700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa080066f30 0x7fa0800693e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:58.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.213+0000 7fa0a568e700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0a013ff90 0x7fa0a0140410 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:58.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.213+0000 7fa0a568e700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa08c003a60 0x7fa0a00cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:58.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.213+0000 7fa0a568e700 1 --2- 172.21.15.31:0/2935980513 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa0a00b3f50 0x7fa0a00b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:58.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.213+0000 7fa0a568e700 1 -- 172.21.15.31:0/2935980513 >> 172.21.15.31:0/2935980513 conn(0x7fa0a0069870 msgr2=0x7fa0a006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:58.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.213+0000 7fa0a568e700 1 -- 172.21.15.31:0/2935980513 shutdown_connections 2023-10-09T06:31:58.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.213+0000 7fa0a568e700 1 -- 172.21.15.31:0/2935980513 wait complete. 2023-10-09T06:31:58.225 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:31:58.226 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:31:58.226 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-09T06:31:58.226 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T06:31:58.226 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T06:31:58.226 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:31:58.226 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:31:58.226 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:31:58.226 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:31:58.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:58.227 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-09T06:31:58.244 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:31:58.244 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:31:58.244 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:31:58.244 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:58.244 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-09T06:31:58.245 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:58.245 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:31:58.245 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:31:58.245 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-09T06:31:58.245 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:31:58.245 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:31:58.245 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-09T06:31:58.245 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:31:58.245 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-09T06:31:58.245 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:31:58.245 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:31:58.246 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:31:58.246 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 41875sec preferred_lft 41875sec 2023-10-09T06:31:58.246 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-09T06:31:58.246 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:58.246 INFO:teuthology.orchestra.run.smithi158.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:31:58.246 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff 2023-10-09T06:31:58.246 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:31:58.246 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:58.246 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::c5:35ff:fec9:1844/64 scope link 2023-10-09T06:31:58.247 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:58.247 INFO:teuthology.orchestra.run.smithi158.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:31:58.247 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether e6:10:14:7c:a4:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:31:58.247 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::e410:14ff:fe7c:a4d7/64 scope link 2023-10-09T06:31:58.247 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:58.247 INFO:teuthology.orchestra.run.smithi158.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:31:58.247 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 46:a9:f1:2b:ba:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T06:31:58.247 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::44a9:f1ff:fe2b:babb/64 scope link 2023-10-09T06:31:58.247 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:31:58.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:58.248 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:31:58.310 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-09T06:31:58.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:58.312 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-09T06:31:58.369 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-09T06:31:58.370 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:31:58.370 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:31:58.370 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:31:58.370 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:31:58.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:58.370 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-09T06:31:58.370 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-09T06:31:58.370 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:31:58.371 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:31:58.371 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:31:58.371 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-09T06:31:58.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:58.473 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:31:58.487 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T06:31:58.488 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T06:31:58.488 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:31:58.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:58.488 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-09T06:31:58.553 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:31:58.553 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T06:31:58.607 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:31:58.608 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:31:58.608 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:31:58.663 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T06:31:58.663 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:31:58.663 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:31:58.744 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:31:58.744 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:31:58.785 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:31:58.785 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:31:58.785 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.158:3300,172.21.15.158:3301" 2023-10-09T06:31:58.785 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 1@e30ef3ca-dd5e-445c-bd11-d2bec76d42c9.cephfs=/ 2023-10-09T06:31:58.785 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.158:3300/172.21.15.158:3301" will pass to kernel 2023-10-09T06:31:58.785 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T06:31:58.785 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T06:31:58.785 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T06:31:58.786 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790" 2023-10-09T06:31:58.786 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.158:6789,172.21.15.158:6790:/ 2023-10-09T06:31:58.786 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=e30ef3ca-dd5e-445c-bd11-d2bec76d42c9" will pass to kernel 2023-10-09T06:31:58.787 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:31:58.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:31:58.787 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:31:58.852 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:31:58.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.977+0000 7f5e37bd8700 1 Processor -- start 2023-10-09T06:31:58.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.977+0000 7f5e37bd8700 1 -- start start 2023-10-09T06:31:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.978+0000 7f5e37bd8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5e301510f0 0x7f5e3006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.978+0000 7f5e37bd8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e300ca0b0 con 0x7f5e30070700 2023-10-09T06:31:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.978+0000 7f5e37bd8700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e30068a10 con 0x7f5e300c9af0 2023-10-09T06:31:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.978+0000 7f5e37bd8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e30068cf0 con 0x7f5e301510f0 2023-10-09T06:31:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.978+0000 7f5e36175700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5e30070700 0x7f5e30070b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37932/0 (socket says 172.21.15.31:37932) 2023-10-09T06:31:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.978+0000 7f5e36175700 1 -- 172.21.15.31:0/2928494929 learned_addr learned my addr 172.21.15.31:0/2928494929 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.978+0000 7f5e35974700 1 --2- 172.21.15.31:0/2928494929 >> v2:172.21.15.158:3300/0 conn(0x7f5e301510f0 0x7f5e3006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.978+0000 7f5e34972700 1 -- 172.21.15.31:0/2928494929 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131180166 0 0) 0x7f5e300ca0b0 con 0x7f5e30070700 2023-10-09T06:31:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.978+0000 7f5e34972700 1 -- 172.21.15.31:0/2928494929 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e18003570 con 0x7f5e30070700 2023-10-09T06:31:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.979+0000 7f5e34972700 1 -- 172.21.15.31:0/2928494929 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087754488 0 0) 0x7f5e30068a10 con 0x7f5e300c9af0 2023-10-09T06:31:58.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.979+0000 7f5e34972700 1 -- 172.21.15.31:0/2928494929 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e300ca0b0 con 0x7f5e300c9af0 2023-10-09T06:31:58.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.979+0000 7f5e35974700 1 -- 172.21.15.31:0/2928494929 >> v1:172.21.15.158:6789/0 conn(0x7f5e300c9af0 legacy=0x7f5e3015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:58.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.979+0000 7f5e34972700 1 -- 172.21.15.31:0/2928494929 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 980915376 0 0) 0x7f5e18003570 con 0x7f5e30070700 2023-10-09T06:31:58.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.979+0000 7f5e35974700 1 -- 172.21.15.31:0/2928494929 >> v1:172.21.15.31:6789/0 conn(0x7f5e30070700 legacy=0x7f5e30070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:58.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.979+0000 7f5e35974700 1 -- 172.21.15.31:0/2928494929 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e300cb230 con 0x7f5e301510f0 2023-10-09T06:31:58.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.979+0000 7f5e35974700 1 --2- 172.21.15.31:0/2928494929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e301510f0 0x7f5e3006ecc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5e280098e0 tx=0x7f5e280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=904d1923aa28ce52 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:58.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.979+0000 7f5e34972700 1 -- 172.21.15.31:0/2928494929 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e200017f0 con 0x7f5e301510f0 2023-10-09T06:31:58.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.979+0000 7f5e34972700 1 -- 172.21.15.31:0/2928494929 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e28011420 con 0x7f5e301510f0 2023-10-09T06:31:58.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.979+0000 7f5e34972700 1 -- 172.21.15.31:0/2928494929 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e280117c0 con 0x7f5e301510f0 2023-10-09T06:31:58.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.980+0000 7f5e37bd8700 1 -- 172.21.15.31:0/2928494929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e301510f0 msgr2=0x7f5e3006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:58.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.980+0000 7f5e37bd8700 1 --2- 172.21.15.31:0/2928494929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e301510f0 0x7f5e3006ecc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5e280098e0 tx=0x7f5e280091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:58.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.980+0000 7f5e37bd8700 1 -- 172.21.15.31:0/2928494929 shutdown_connections 2023-10-09T06:31:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.980+0000 7f5e37bd8700 1 --2- 172.21.15.31:0/2928494929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e301510f0 0x7f5e3006ecc0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.980+0000 7f5e37bd8700 1 -- 172.21.15.31:0/2928494929 >> 172.21.15.31:0/2928494929 conn(0x7f5e300ca4f0 msgr2=0x7f5e300ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.980+0000 7f5e37bd8700 1 -- 172.21.15.31:0/2928494929 shutdown_connections 2023-10-09T06:31:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.980+0000 7f5e37bd8700 1 -- 172.21.15.31:0/2928494929 wait complete. 2023-10-09T06:31:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.981+0000 7f5e37bd8700 1 Processor -- start 2023-10-09T06:31:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.981+0000 7f5e37bd8700 1 -- start start 2023-10-09T06:31:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.981+0000 7f5e37bd8700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e30070700 0x7f5e30150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.981+0000 7f5e37bd8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e300c9af0 0x7f5e300b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.981+0000 7f5e37bd8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e301510f0 0x7f5e301560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.981+0000 7f5e37bd8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e30154df0 con 0x7f5e301510f0 2023-10-09T06:31:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.981+0000 7f5e37bd8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e30155c50 con 0x7f5e300c9af0 2023-10-09T06:31:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.981+0000 7f5e37bd8700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e30150b80 con 0x7f5e30070700 2023-10-09T06:31:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e36175700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e301510f0 0x7f5e301560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e36175700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e301510f0 0x7f5e301560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42930/0 (socket says 172.21.15.31:42930) 2023-10-09T06:31:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e36175700 1 -- 172.21.15.31:0/1755595232 learned_addr learned my addr 172.21.15.31:0/1755595232 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e35974700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e30070700 0x7f5e30150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e35173700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e300c9af0 0x7f5e300b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e36175700 1 -- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e30070700 msgr2=0x7f5e30150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e36175700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e30070700 0x7f5e30150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e36175700 1 -- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e300c9af0 msgr2=0x7f5e300b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e36175700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e300c9af0 0x7f5e300b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e36175700 1 -- 172.21.15.31:0/1755595232 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e28009420 con 0x7f5e301510f0 2023-10-09T06:31:58.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e36175700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e301510f0 0x7f5e301560e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000cc90 tx=0x7f5e20007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:58.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e2dffb700 1 -- 172.21.15.31:0/1755595232 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20004dc0 con 0x7f5e301510f0 2023-10-09T06:31:58.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e2dffb700 1 -- 172.21.15.31:0/1755595232 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2000a5c0 con 0x7f5e301510f0 2023-10-09T06:31:58.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e37bd8700 1 -- 172.21.15.31:0/1755595232 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e30155040 con 0x7f5e301510f0 2023-10-09T06:31:58.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e2dffb700 1 -- 172.21.15.31:0/1755595232 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000a980 con 0x7f5e301510f0 2023-10-09T06:31:58.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.982+0000 7f5e37bd8700 1 -- 172.21.15.31:0/1755595232 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e30155600 con 0x7f5e301510f0 2023-10-09T06:31:58.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.983+0000 7f5e37bd8700 1 -- 172.21.15.31:0/1755595232 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e30155dc0 con 0x7f5e301510f0 2023-10-09T06:31:58.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.984+0000 7f5e2dffb700 1 -- 172.21.15.31:0/1755595232 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e2000acf0 con 0x7f5e301510f0 2023-10-09T06:31:58.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.984+0000 7f5e2dffb700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5e1c066f30 0x7f5e1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:58.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.984+0000 7f5e2dffb700 1 -- 172.21.15.31:0/1755595232 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5e20083b50 con 0x7f5e301510f0 2023-10-09T06:31:58.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.984+0000 7f5e35974700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5e1c066f30 0x7f5e1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:58.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.985+0000 7f5e35974700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5e1c066f30 0x7f5e1c0693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5e280093f0 tx=0x7f5e28016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:58.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:58.990+0000 7f5e2dffb700 1 -- 172.21.15.31:0/1755595232 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e20050dc0 con 0x7f5e301510f0 2023-10-09T06:31:59.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.224+0000 7f5e37bd8700 1 -- 172.21.15.31:0/1755595232 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e3004c3c0 con 0x7f5e301510f0 2023-10-09T06:31:59.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.225+0000 7f5e2dffb700 1 -- 172.21.15.31:0/1755595232 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f5e20018020 con 0x7f5e301510f0 2023-10-09T06:31:59.225 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:31:59.225 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/3503727793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3503727793},{"type":"v1","addr":"172.21.15.158:6837","nonce":3503727793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2366061673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2366061673},{"type":"v1","addr":"172.21.15.158:6836","nonce":2366061673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3405107978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3405107978},{"type":"v1","addr":"172.21.15.31:6834","nonce":3405107978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:31:50.242464+0000","modified":"2023-10-09T06:31:53.876299+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8079":{"gid":8079,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4124393323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4124393323},{"type":"v1","addr":"172.21.15.31:6835","nonce":4124393323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T06:31:59.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.227+0000 7f5e37bd8700 1 -- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5e1c066f30 msgr2=0x7f5e1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:59.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.227+0000 7f5e37bd8700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5e1c066f30 0x7f5e1c0693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5e280093f0 tx=0x7f5e28016000 comp rx=0 tx=0).stop 2023-10-09T06:31:59.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.227+0000 7f5e37bd8700 1 -- 172.21.15.31:0/1755595232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e301510f0 msgr2=0x7f5e301560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:59.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.227+0000 7f5e37bd8700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e301510f0 0x7f5e301560e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000cc90 tx=0x7f5e20007d20 comp rx=0 tx=0).stop 2023-10-09T06:31:59.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.227+0000 7f5e37bd8700 1 -- 172.21.15.31:0/1755595232 shutdown_connections 2023-10-09T06:31:59.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.227+0000 7f5e37bd8700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5e1c066f30 0x7f5e1c0693e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.227+0000 7f5e37bd8700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5e30070700 0x7f5e30150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.227+0000 7f5e37bd8700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e301510f0 0x7f5e301560e0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.227+0000 7f5e37bd8700 1 --2- 172.21.15.31:0/1755595232 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5e300c9af0 0x7f5e300b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.227+0000 7f5e37bd8700 1 -- 172.21.15.31:0/1755595232 >> 172.21.15.31:0/1755595232 conn(0x7f5e300ca4f0 msgr2=0x7f5e300cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.227+0000 7f5e37bd8700 1 -- 172.21.15.31:0/1755595232 shutdown_connections 2023-10-09T06:31:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.227+0000 7f5e37bd8700 1 -- 172.21.15.31:0/1755595232 wait complete. 2023-10-09T06:31:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 89 2023-10-09T06:31:59.239 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-09T06:31:59.377 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":8079,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.4963484909999991,"mdsmap_epoch":89,"osdmap_epoch":185,"osdmap_epoch_barrier":185,"uptime":13.590369322999999} 2023-10-09T06:31:59.440 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 8079, "mdsmap_epoch": 89, "osdmap_epoch": 185, "osdmap_epoch_barrier": 185, "rank_uptime": 8.496348491, "state": "up:active", "uptime": 13.590369323, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:31:59.440 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-09T06:31:59.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.564+0000 7f5fa5c05700 1 Processor -- start 2023-10-09T06:31:59.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.564+0000 7f5fa5c05700 1 -- start start 2023-10-09T06:31:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.565+0000 7f5fa5c05700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fa00b3c40 0x7f5fa00b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.565+0000 7f5fa5c05700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5fa015cf40 0x7f5fa015d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.565+0000 7f5fa5c05700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa00b4660 con 0x7f5fa00b4010 2023-10-09T06:31:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.565+0000 7f5fa5c05700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa00b4940 con 0x7f5fa015cf40 2023-10-09T06:31:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.565+0000 7f5fa5c05700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa00b4c20 con 0x7f5fa00b3c40 2023-10-09T06:31:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.565+0000 7f5f9ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5fa00b4010 0x7f5fa00b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37944/0 (socket says 172.21.15.31:37944) 2023-10-09T06:31:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.565+0000 7f5f9ffff700 1 -- 172.21.15.31:0/3219857844 learned_addr learned my addr 172.21.15.31:0/3219857844 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:31:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.565+0000 7f5fa5404700 1 --2- 172.21.15.31:0/3219857844 >> v2:172.21.15.31:3300/0 conn(0x7f5fa015cf40 0x7f5fa015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.565+0000 7f5fa4c03700 1 --2- 172.21.15.31:0/3219857844 >> v2:172.21.15.158:3300/0 conn(0x7f5fa00b3c40 0x7f5fa00b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.565+0000 7f5f9f7fe700 1 -- 172.21.15.31:0/3219857844 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655430494 0 0) 0x7f5fa00b4660 con 0x7f5fa00b4010 2023-10-09T06:31:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.565+0000 7f5f9f7fe700 1 -- 172.21.15.31:0/3219857844 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f88003570 con 0x7f5fa00b4010 2023-10-09T06:31:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.566+0000 7f5fa5404700 1 -- 172.21.15.31:0/3219857844 >> v2:172.21.15.158:3300/0 conn(0x7f5fa00b3c40 msgr2=0x7f5fa00b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:31:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.566+0000 7f5fa5404700 1 --2- 172.21.15.31:0/3219857844 >> v2:172.21.15.158:3300/0 conn(0x7f5fa00b3c40 0x7f5fa00b66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.566+0000 7f5fa5404700 1 -- 172.21.15.31:0/3219857844 >> v1:172.21.15.31:6789/0 conn(0x7f5fa00b4010 legacy=0x7f5fa00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:59.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.566+0000 7f5fa5404700 1 -- 172.21.15.31:0/3219857844 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa00b4f00 con 0x7f5fa015cf40 2023-10-09T06:31:59.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.566+0000 7f5fa4c03700 1 --2- 172.21.15.31:0/3219857844 >> v2:172.21.15.158:3300/0 conn(0x7f5fa00b3c40 0x7f5fa00b66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:31:59.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.566+0000 7f5fa5404700 1 --2- 172.21.15.31:0/3219857844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fa015cf40 0x7f5fa015d380 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0071590 tx=0x7f5f98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4401a5287ffec390 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:59.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.566+0000 7f5f9f7fe700 1 -- 172.21.15.31:0/3219857844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9800e070 con 0x7f5fa015cf40 2023-10-09T06:31:59.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.566+0000 7f5f9f7fe700 1 -- 172.21.15.31:0/3219857844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9800bab0 con 0x7f5fa015cf40 2023-10-09T06:31:59.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.566+0000 7f5f9f7fe700 1 -- 172.21.15.31:0/3219857844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9800be70 con 0x7f5fa015cf40 2023-10-09T06:31:59.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.566+0000 7f5fa5c05700 1 -- 172.21.15.31:0/3219857844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fa015cf40 msgr2=0x7f5fa015d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:59.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.566+0000 7f5fa5c05700 1 --2- 172.21.15.31:0/3219857844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fa015cf40 0x7f5fa015d380 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0071590 tx=0x7f5f98009780 comp rx=0 tx=0).stop 2023-10-09T06:31:59.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.567+0000 7f5fa5c05700 1 -- 172.21.15.31:0/3219857844 shutdown_connections 2023-10-09T06:31:59.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.567+0000 7f5fa5c05700 1 --2- 172.21.15.31:0/3219857844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fa015cf40 0x7f5fa015d380 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.567+0000 7f5fa5c05700 1 --2- 172.21.15.31:0/3219857844 >> v2:172.21.15.158:3300/0 conn(0x7f5fa00b3c40 0x7f5fa00b66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.567+0000 7f5fa5c05700 1 -- 172.21.15.31:0/3219857844 >> 172.21.15.31:0/3219857844 conn(0x7f5fa0067e40 msgr2=0x7f5fa00d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:59.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.567+0000 7f5fa5c05700 1 -- 172.21.15.31:0/3219857844 shutdown_connections 2023-10-09T06:31:59.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.567+0000 7f5fa5c05700 1 -- 172.21.15.31:0/3219857844 wait complete. 2023-10-09T06:31:59.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.568+0000 7f5fa5c05700 1 Processor -- start 2023-10-09T06:31:59.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.568+0000 7f5fa5c05700 1 -- start start 2023-10-09T06:31:59.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5fa5c05700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fa00b3c40 0x7f5fa00af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:59.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5fa5c05700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fa00b4010 0x7f5fa015f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5fa5c05700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fa015cf40 0x7f5fa016a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5fa5c05700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa015e860 con 0x7f5fa00b4010 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5fa5c05700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa016aa80 con 0x7f5fa00b3c40 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5fa5c05700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa015eae0 con 0x7f5fa015cf40 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5f9ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fa00b4010 0x7f5fa015f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5f9ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fa00b4010 0x7f5fa015f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42946/0 (socket says 172.21.15.31:42946) 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5f9ffff700 1 -- 172.21.15.31:0/2847920855 learned_addr learned my addr 172.21.15.31:0/2847920855 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5fa4c03700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fa00b3c40 0x7f5fa00af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5fa5404700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fa015cf40 0x7f5fa016a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5f9ffff700 1 -- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fa015cf40 msgr2=0x7f5fa016a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5f9ffff700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fa015cf40 0x7f5fa016a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5f9ffff700 1 -- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fa00b3c40 msgr2=0x7f5fa00af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5f9ffff700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fa00b3c40 0x7f5fa00af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5f9ffff700 1 -- 172.21.15.31:0/2847920855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f90009420 con 0x7f5fa00b4010 2023-10-09T06:31:59.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5f9ffff700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fa00b4010 0x7f5fa015f8a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400c7c0 tx=0x7f5f94007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:59.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5f9cff9700 1 -- 172.21.15.31:0/2847920855 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f94005cd0 con 0x7f5fa00b4010 2023-10-09T06:31:59.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5f9cff9700 1 -- 172.21.15.31:0/2847920855 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f94005e30 con 0x7f5fa00b4010 2023-10-09T06:31:59.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5fa5c05700 1 -- 172.21.15.31:0/2847920855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f98009a20 con 0x7f5fa00b4010 2023-10-09T06:31:59.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5f9cff9700 1 -- 172.21.15.31:0/2847920855 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f94007320 con 0x7f5fa00b4010 2023-10-09T06:31:59.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.569+0000 7f5fa5c05700 1 -- 172.21.15.31:0/2847920855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa015f0a0 con 0x7f5fa00b4010 2023-10-09T06:31:59.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.570+0000 7f5fa5c05700 1 -- 172.21.15.31:0/2847920855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa008ab60 con 0x7f5fa00b4010 2023-10-09T06:31:59.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.571+0000 7f5f9cff9700 1 -- 172.21.15.31:0/2847920855 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f94007690 con 0x7f5fa00b4010 2023-10-09T06:31:59.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.571+0000 7f5f9cff9700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5f8c066f30 0x7f5f8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:31:59.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.571+0000 7f5f9cff9700 1 -- 172.21.15.31:0/2847920855 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f94083bc0 con 0x7f5fa00b4010 2023-10-09T06:31:59.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.571+0000 7f5fa4c03700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5f8c066f30 0x7f5f8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:31:59.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.572+0000 7f5fa4c03700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5f8c066f30 0x7f5f8c0693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0158950 tx=0x7f5f900091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:31:59.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.575+0000 7f5f9cff9700 1 -- 172.21.15.31:0/2847920855 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f94050e30 con 0x7f5fa00b4010 2023-10-09T06:31:59.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.770+0000 7f5fa5c05700 1 -- 172.21.15.31:0/2847920855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f5fa006ac80 con 0x7f5fa00b4010 2023-10-09T06:31:59.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.906+0000 7f5f9cff9700 1 -- 172.21.15.31:0/2847920855 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v186) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5f94017070 con 0x7f5fa00b4010 2023-10-09T06:31:59.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.908+0000 7f5fa5c05700 1 -- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5f8c066f30 msgr2=0x7f5f8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:59.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.908+0000 7f5fa5c05700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5f8c066f30 0x7f5f8c0693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0158950 tx=0x7f5f900091a0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.908+0000 7f5fa5c05700 1 -- 172.21.15.31:0/2847920855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fa00b4010 msgr2=0x7f5fa015f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:31:59.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.908+0000 7f5fa5c05700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fa00b4010 0x7f5fa015f8a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400c7c0 tx=0x7f5f94007e00 comp rx=0 tx=0).stop 2023-10-09T06:31:59.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.908+0000 7f5fa5c05700 1 -- 172.21.15.31:0/2847920855 shutdown_connections 2023-10-09T06:31:59.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.908+0000 7f5fa5c05700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5f8c066f30 0x7f5f8c0693e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.908+0000 7f5fa5c05700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f5fa015cf40 0x7f5fa016a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.908+0000 7f5fa5c05700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fa00b3c40 0x7f5fa00af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.908+0000 7f5fa5c05700 1 --2- 172.21.15.31:0/2847920855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fa00b4010 0x7f5fa015f8a0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:31:59.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.908+0000 7f5fa5c05700 1 -- 172.21.15.31:0/2847920855 >> 172.21.15.31:0/2847920855 conn(0x7f5fa0067e40 msgr2=0x7f5fa0158d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:31:59.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.908+0000 7f5fa5c05700 1 -- 172.21.15.31:0/2847920855 shutdown_connections 2023-10-09T06:31:59.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:31:59.908+0000 7f5fa5c05700 1 -- 172.21.15.31:0/2847920855 wait complete. 2023-10-09T06:31:59.910 INFO:teuthology.orchestra.run.smithi031.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-09T06:31:59.920 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T06:32:00.056 INFO:teuthology.orchestra.run.smithi031.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T06:32:00.057 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T06:32:00.057 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-09T06:32:00.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:32:00.057 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-09T06:32:00.167 INFO:teuthology.orchestra.run.smithi031.stderr:16+0 records in 2023-10-09T06:32:00.167 INFO:teuthology.orchestra.run.smithi031.stderr:16+0 records out 2023-10-09T06:32:00.167 INFO:teuthology.orchestra.run.smithi031.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0922727 s, 182 MB/s 2023-10-09T06:32:00.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:32:00.168 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-09T06:32:00.278 INFO:teuthology.orchestra.run.smithi031.stderr:17+0 records in 2023-10-09T06:32:00.278 INFO:teuthology.orchestra.run.smithi031.stderr:17+0 records out 2023-10-09T06:32:00.278 INFO:teuthology.orchestra.run.smithi031.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0932534 s, 191 MB/s 2023-10-09T06:32:00.279 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-09T06:32:00.279 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:32:00.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.400+0000 7fd491be3700 1 Processor -- start 2023-10-09T06:32:00.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.400+0000 7fd491be3700 1 -- start start 2023-10-09T06:32:00.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.400+0000 7fd491be3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c157870 0x7fd48c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:00.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.400+0000 7fd491be3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c15cbb0 con 0x7fd48c15a620 2023-10-09T06:32:00.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.400+0000 7fd491be3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c15bfa0 con 0x7fd48c157c40 2023-10-09T06:32:00.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.400+0000 7fd491be3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c15c280 con 0x7fd48c157870 2023-10-09T06:32:00.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48affd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd48c15a620 0x7fd48c15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53896/0 (socket says 172.21.15.31:53896) 2023-10-09T06:32:00.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48affd700 1 -- 172.21.15.31:0/3036453022 learned_addr learned my addr 172.21.15.31:0/3036453022 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:00.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48b7fe700 1 --2- 172.21.15.31:0/3036453022 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c157870 0x7fd48c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:00.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260425509 0 0) 0x7fd48c15cbb0 con 0x7fd48c15a620 2023-10-09T06:32:00.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd474003570 con 0x7fd48c15a620 2023-10-09T06:32:00.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567027577 0 0) 0x7fd48c15bfa0 con 0x7fd48c157c40 2023-10-09T06:32:00.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd48c15cbb0 con 0x7fd48c157c40 2023-10-09T06:32:00.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1397637909 0 0) 0x7fd474003570 con 0x7fd48c15a620 2023-10-09T06:32:00.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c157870 msgr2=0x7fd48c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:00.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 --2- 172.21.15.31:0/3036453022 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c157870 0x7fd48c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:00.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 >> v1:172.21.15.158:6789/0 conn(0x7fd48c157c40 legacy=0x7fd48c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:00.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c15c560 con 0x7fd48c15a620 2023-10-09T06:32:00.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fd480001470 con 0x7fd48c15a620 2023-10-09T06:32:00.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 >> v1:172.21.15.31:6789/0 conn(0x7fd48c15a620 legacy=0x7fd48c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:00.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 --2- 172.21.15.31:0/3036453022 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c157870 0x7fd474003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:00.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 --2- 172.21.15.31:0/3036453022 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4740041d0 0x7fd474004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:00.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 --2- 172.21.15.31:0/3036453022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd474004d50 0x7fd4740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:00.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c15c280 con 0x7fd474004d50 2023-10-09T06:32:00.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47400bbf0 con 0x7fd4740041d0 2023-10-09T06:32:00.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47400bdb0 con 0x7fd48c157870 2023-10-09T06:32:00.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48bfff700 1 --2- 172.21.15.31:0/3036453022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd474004d50 0x7fd4740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:00.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48b7fe700 1 --2- 172.21.15.31:0/3036453022 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c157870 0x7fd474003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:00.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.401+0000 7fd48affd700 1 --2- 172.21.15.31:0/3036453022 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4740041d0 0x7fd474004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:00.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.402+0000 7fd48bfff700 1 -- 172.21.15.31:0/3036453022 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c157870 msgr2=0x7fd474003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:00.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.402+0000 7fd48bfff700 1 --2- 172.21.15.31:0/3036453022 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c157870 0x7fd474003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:00.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.402+0000 7fd48bfff700 1 -- 172.21.15.31:0/3036453022 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4740041d0 msgr2=0x7fd474004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:00.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.402+0000 7fd48bfff700 1 --2- 172.21.15.31:0/3036453022 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd4740041d0 0x7fd474004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:00.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.402+0000 7fd48bfff700 1 -- 172.21.15.31:0/3036453022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd474003570 con 0x7fd474004d50 2023-10-09T06:32:00.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.402+0000 7fd48bfff700 1 --2- 172.21.15.31:0/3036453022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd474004d50 0x7fd4740051c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fd484002120 tx=0x7fd4840017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47132ce35bb7389 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:00.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.402+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484001ab0 con 0x7fd474004d50 2023-10-09T06:32:00.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.402+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48400c980 con 0x7fd474004d50 2023-10-09T06:32:00.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.402+0000 7fd48a7fc700 1 -- 172.21.15.31:0/3036453022 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48400cd20 con 0x7fd474004d50 2023-10-09T06:32:00.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.402+0000 7fd491be3700 1 -- 172.21.15.31:0/3036453022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd474004d50 msgr2=0x7fd4740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:00.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.402+0000 7fd491be3700 1 --2- 172.21.15.31:0/3036453022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd474004d50 0x7fd4740051c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fd484002120 tx=0x7fd4840017a0 comp rx=0 tx=0).stop 2023-10-09T06:32:00.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.402+0000 7fd48bfff700 1 -- 172.21.15.31:0/3036453022 reap_dead start 2023-10-09T06:32:00.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.403+0000 7fd491be3700 1 -- 172.21.15.31:0/3036453022 shutdown_connections 2023-10-09T06:32:00.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.403+0000 7fd491be3700 1 -- 172.21.15.31:0/3036453022 >> 172.21.15.31:0/3036453022 conn(0x7fd48c068ce0 msgr2=0x7fd48c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:00.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.403+0000 7fd491be3700 1 -- 172.21.15.31:0/3036453022 shutdown_connections 2023-10-09T06:32:00.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.403+0000 7fd491be3700 1 -- 172.21.15.31:0/3036453022 wait complete. 2023-10-09T06:32:00.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.404+0000 7fd491be3700 1 Processor -- start 2023-10-09T06:32:00.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.404+0000 7fd491be3700 1 -- start start 2023-10-09T06:32:00.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.404+0000 7fd491be3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd48c14cd20 0x7fd48c153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:00.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.404+0000 7fd491be3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd48c150930 0x7fd48c14fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:00.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.404+0000 7fd491be3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c14ff80 0x7fd48c0b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:00.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd491be3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c14ea30 con 0x7fd48c14cd20 2023-10-09T06:32:00.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd491be3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c14f5b0 con 0x7fd48c150930 2023-10-09T06:32:00.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd491be3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c14d0f0 con 0x7fd48c14ff80 2023-10-09T06:32:00.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd48b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd48c14cd20 0x7fd48c153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:00.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd48b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd48c14cd20 0x7fd48c153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40892/0 (socket says 172.21.15.31:40892) 2023-10-09T06:32:00.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd48b7fe700 1 -- 172.21.15.31:0/1041015005 learned_addr learned my addr 172.21.15.31:0/1041015005 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:00.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd48affd700 1 --2- 172.21.15.31:0/1041015005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd48c150930 0x7fd48c14fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:00.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd48b7fe700 1 -- 172.21.15.31:0/1041015005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c14ff80 msgr2=0x7fd48c0b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:00.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd48b7fe700 1 --2- 172.21.15.31:0/1041015005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c14ff80 0x7fd48c0b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:00.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd48b7fe700 1 -- 172.21.15.31:0/1041015005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd48c150930 msgr2=0x7fd48c14fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:00.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd48b7fe700 1 --2- 172.21.15.31:0/1041015005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd48c150930 0x7fd48c14fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:00.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd48b7fe700 1 -- 172.21.15.31:0/1041015005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c14ec80 con 0x7fd48c14cd20 2023-10-09T06:32:00.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd48b7fe700 1 --2- 172.21.15.31:0/1041015005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd48c14cd20 0x7fd48c153f00 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fd47c011b10 tx=0x7fd47c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:00.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd4737fe700 1 -- 172.21.15.31:0/1041015005 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00f9f0 con 0x7fd48c14cd20 2023-10-09T06:32:00.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd4737fe700 1 -- 172.21.15.31:0/1041015005 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c00fb50 con 0x7fd48c14cd20 2023-10-09T06:32:00.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd491be3700 1 -- 172.21.15.31:0/1041015005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48c14ef60 con 0x7fd48c14cd20 2023-10-09T06:32:00.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd4737fe700 1 -- 172.21.15.31:0/1041015005 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00fed0 con 0x7fd48c14cd20 2023-10-09T06:32:00.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.405+0000 7fd491be3700 1 -- 172.21.15.31:0/1041015005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c154440 con 0x7fd48c14cd20 2023-10-09T06:32:00.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.406+0000 7fd491be3700 1 -- 172.21.15.31:0/1041015005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48c14f890 con 0x7fd48c14cd20 2023-10-09T06:32:00.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.407+0000 7fd4737fe700 1 -- 172.21.15.31:0/1041015005 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd47c014650 con 0x7fd48c14cd20 2023-10-09T06:32:00.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.407+0000 7fd4737fe700 1 --2- 172.21.15.31:0/1041015005 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd478066f30 0x7fd4780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:00.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.407+0000 7fd4737fe700 1 -- 172.21.15.31:0/1041015005 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd47c018030 con 0x7fd48c14cd20 2023-10-09T06:32:00.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.407+0000 7fd48affd700 1 --2- 172.21.15.31:0/1041015005 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd478066f30 0x7fd4780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:00.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.408+0000 7fd48affd700 1 --2- 172.21.15.31:0/1041015005 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd478066f30 0x7fd4780693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd4800015a0 tx=0x7fd480009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:00.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.411+0000 7fd4737fe700 1 -- 172.21.15.31:0/1041015005 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd47c052260 con 0x7fd48c14cd20 2023-10-09T06:32:00.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.605+0000 7fd491be3700 1 -- 172.21.15.31:0/1041015005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd48c04c3c0 con 0x7fd48c14cd20 2023-10-09T06:32:00.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.606+0000 7fd4737fe700 1 -- 172.21.15.31:0/1041015005 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v186) v1 ==== 81+0+32282 (secure 0 0 0) 0x7fd47c022090 con 0x7fd48c14cd20 2023-10-09T06:32:00.606 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:00.607 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:00.607 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 186, 2023-10-09T06:32:00.607 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:32:00.607 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:32:00.607 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:31:59.902922+0000", 2023-10-09T06:32:00.607 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:32:00.607 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:32:00.608 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:32:00.608 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:32:00.608 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:32:00.608 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:32:00.608 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:32:00.608 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:32:00.608 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:32:00.608 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:00.608 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:32:00.609 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:32:00.609 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:32:00.609 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:32:00.609 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:32:00.609 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 23, 2023-10-09T06:32:00.610 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:32:00.610 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:32:00.610 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:32:00.610 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:32:00.610 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:32:00.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.610 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:32:00.611 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:32:00.611 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:32:00.611 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:00.611 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:00.611 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:00.611 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:00.611 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:00.612 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:00.612 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:00.612 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:00.612 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:00.612 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:00.613 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:00.613 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:00.613 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:32:00.613 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:32:00.613 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:32:00.613 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:32:00.613 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:32:00.613 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:00.613 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:00.614 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:00.614 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:00.614 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:00.614 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:00.614 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:00.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.614 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:32:00.614 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:00.614 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:00.615 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:00.615 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:00.615 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:00.615 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:00.615 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:00.615 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:00.615 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:00.615 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:00.615 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:00.615 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:00.616 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:00.616 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:00.616 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:00.616 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:00.616 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:00.616 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:00.616 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:00.616 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:00.616 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:00.617 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:00.617 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:00.617 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:00.617 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:00.617 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:00.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.617 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:00.617 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:00.617 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:00.618 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:00.618 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:00.618 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:00.618 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:00.618 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:00.618 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:00.618 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:00.618 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:00.619 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:00.619 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:32:00.619 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:32:00.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.619 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:00.619 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:32:00.619 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.620 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 22, 2023-10-09T06:32:00.620 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:32:00.620 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:48.664093+0000", 2023-10-09T06:32:00.620 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:00.620 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:00.620 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:00.620 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:00.620 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:00.620 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:00.621 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:00.621 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:00.621 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:00.621 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:00.621 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:00.621 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:00.622 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:32:00.622 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:32:00.622 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:32:00.622 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:32:00.622 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:32:00.622 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:00.622 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:00.622 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:00.622 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "184", 2023-10-09T06:32:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:00.624 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:00.624 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:00.624 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:00.624 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:00.624 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:00.624 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:00.624 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:00.624 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:00.624 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:00.624 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:00.625 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:00.625 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:00.625 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:00.625 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:00.625 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:00.625 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:00.625 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:00.625 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:00.625 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:00.625 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:00.626 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:00.626 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:00.626 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:00.626 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:00.626 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:00.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.626 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:00.626 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:00.626 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:00.627 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:00.627 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:00.627 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:00.627 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:00.627 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:00.627 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:00.627 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:00.627 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:00.628 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:00.628 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:32:00.628 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:32:00.628 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:32:00.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.628 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:00.628 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:00.629 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:32:00.629 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.629 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.629 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 23, 2023-10-09T06:32:00.629 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:32:00.630 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:49.212701+0000", 2023-10-09T06:32:00.630 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:00.630 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:00.630 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:00.630 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:00.630 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:00.630 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:00.631 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:00.631 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:00.631 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:00.631 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:00.631 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:00.631 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:00.631 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:32:00.632 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:32:00.632 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:32:00.632 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:32:00.632 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:32:00.632 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:00.633 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:00.633 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:00.633 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:00.633 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:00.633 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:00.633 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:00.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.634 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "186", 2023-10-09T06:32:00.634 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:00.635 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:00.635 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:00.635 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:00.635 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:00.635 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:00.635 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:00.635 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:00.636 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:00.636 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:32:00.636 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:00.636 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:00.636 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:00.636 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:00.636 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:00.636 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:00.636 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:00.637 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:00.637 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:00.637 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:00.637 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:00.637 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:00.637 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:00.637 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:00.637 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:00.638 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:00.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.638 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:00.638 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:00.638 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:00.638 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:00.638 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:00.638 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:00.638 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:00.639 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:00.639 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:00.639 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:00.639 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:00.639 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:00.639 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:32:00.639 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:32:00.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.639 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:00.640 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:00.640 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:32:00.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.640 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:00.640 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:32:00.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:00.641 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:00.641 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:00.641 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:00.641 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:00.641 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:00.642 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:00.642 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:00.642 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:00.642 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:00.642 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:00.642 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:00.642 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:00.642 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.643 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.643 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:32:00.643 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:00.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.643 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.643 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:32:00.643 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:00.643 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.644 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.644 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:00.644 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.644 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.644 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:32:00.644 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:00.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.645 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.645 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:32:00.645 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:00.645 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.645 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.645 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:00.645 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.645 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.646 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:32:00.646 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:00.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.646 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.646 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:32:00.646 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:00.646 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.646 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.647 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:00.647 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.647 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.647 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:32:00.647 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:00.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.647 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.648 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:32:00.648 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:00.648 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.648 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.648 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:32:00.648 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:32:00.648 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:32:00.648 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:32:00.648 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:00.649 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:00.649 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:00.649 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.649 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:00.649 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:00.649 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:00.649 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:00.649 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:00.650 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:00.650 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:00.650 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:00.650 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:00.650 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:00.650 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:00.650 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:00.650 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:00.650 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.651 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.651 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:32:00.651 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:00.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.651 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.651 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:32:00.651 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:00.651 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.652 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.652 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:00.652 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.652 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.652 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:32:00.652 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:00.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.653 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.653 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:32:00.653 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:00.653 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.653 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.653 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:00.653 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.653 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.654 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:32:00.654 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:00.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.654 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.654 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:32:00.655 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:00.655 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.655 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.655 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:00.655 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.655 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.655 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:32:00.655 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:00.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.656 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.656 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:32:00.656 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:00.656 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.656 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.657 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:32:00.657 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:32:00.657 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:32:00.657 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:32:00.657 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:00.657 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:00.657 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:00.658 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.658 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:00.658 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:00.658 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:00.658 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:00.659 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:00.659 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:00.659 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:00.659 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:00.659 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:00.659 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:00.659 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:00.659 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:00.660 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:00.660 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.660 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.660 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:32:00.660 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:00.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.661 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.661 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:32:00.661 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:00.661 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.661 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.661 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:00.661 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.662 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.662 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:32:00.662 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:00.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.662 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.663 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:32:00.663 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:00.663 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.663 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.663 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:00.663 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.664 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.664 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:32:00.664 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:00.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.664 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.665 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:32:00.665 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:00.665 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.665 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.665 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:00.666 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.666 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.666 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:32:00.667 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:00.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.667 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.667 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:32:00.667 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:00.667 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.667 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.668 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:32:00.668 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:32:00.668 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:32:00.668 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:32:00.668 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:00.668 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:00.668 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:00.668 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.669 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:00.669 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:00.669 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:00.669 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:00.669 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:00.669 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:00.669 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:00.669 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:00.670 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:00.670 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:00.670 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:00.670 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:00.670 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:00.670 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.670 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.670 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:32:00.670 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:00.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.671 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.671 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:32:00.671 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:00.671 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.671 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.671 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:00.671 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.672 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.672 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:32:00.672 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:00.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.672 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.672 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:32:00.672 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:00.673 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.673 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.673 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:00.673 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.673 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.673 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:32:00.674 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:00.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.674 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.674 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:32:00.674 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:00.674 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.674 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.675 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:00.675 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.675 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.675 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:32:00.675 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:00.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.676 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.676 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.676 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:32:00.676 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:00.676 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.676 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.676 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:32:00.676 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:32:00.676 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:32:00.677 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:32:00.677 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:00.677 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:00.677 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:00.677 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.677 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:00.677 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:00.678 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:00.678 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:00.678 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:00.678 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:00.678 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:00.678 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:00.678 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:00.678 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:00.678 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:00.678 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:00.679 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:00.679 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.679 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.679 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:32:00.679 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:00.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.679 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.679 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:32:00.680 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:00.680 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.680 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.680 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:00.680 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.680 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.680 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:32:00.681 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:00.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.681 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.681 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:32:00.681 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:00.681 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.681 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.681 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:00.682 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.682 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.682 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:32:00.682 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:00.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.682 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.682 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:32:00.683 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:00.683 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.683 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.683 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:00.683 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.683 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.683 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:32:00.683 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:00.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.684 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.684 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:32:00.684 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:00.684 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.684 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.684 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:32:00.685 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:32:00.685 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:32:00.685 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:32:00.685 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:00.685 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:00.685 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:00.685 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.686 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:00.686 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:00.686 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:00.686 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:00.686 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:00.686 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:00.686 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:00.686 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:00.686 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:00.686 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:00.687 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:00.687 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:00.687 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:00.687 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.687 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.688 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:32:00.688 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:00.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.688 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.688 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:32:00.688 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:00.688 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.688 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.689 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:00.689 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.689 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.689 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:32:00.689 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:00.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.690 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.690 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:32:00.690 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:00.690 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.690 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.690 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:00.690 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.691 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.691 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:32:00.691 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:00.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.691 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.691 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:32:00.691 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:00.692 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.692 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.692 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:00.692 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.693 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.693 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:32:00.693 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:00.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.693 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.693 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:32:00.693 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:00.694 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.694 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.695 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:32:00.695 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:32:00.695 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:32:00.695 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:32:00.695 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:00.696 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:00.696 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:00.696 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.696 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:00.696 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:00.696 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:00.696 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:00.696 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:00.697 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:00.697 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:00.697 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:00.697 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:00.697 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:00.697 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:00.697 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:00.697 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:00.697 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.698 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.698 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:32:00.698 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:00.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.698 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.698 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:32:00.698 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:00.699 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.699 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.699 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:00.699 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.700 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.700 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:32:00.700 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:00.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.701 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.701 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:32:00.701 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:00.701 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.701 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.702 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:00.702 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.702 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.702 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:32:00.702 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:00.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.702 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.703 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:32:00.703 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:00.703 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.703 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.703 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:00.703 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.703 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.703 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:32:00.704 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:00.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.704 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.704 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:32:00.704 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:00.704 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.704 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.704 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:32:00.705 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:32:00.705 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:32:00.705 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:32:00.705 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:00.705 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:00.705 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:00.705 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.706 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:00.706 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:00.706 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:00.706 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:00.706 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:00.706 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:00.706 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:00.706 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:00.706 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:00.706 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:00.707 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:00.707 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:00.707 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:00.707 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.707 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.707 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:32:00.707 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:00.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.708 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.708 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:32:00.708 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:00.708 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.708 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.708 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:00.709 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.709 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.709 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:32:00.709 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:00.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.709 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.710 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:32:00.710 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:00.710 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.710 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.710 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:00.710 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.710 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.710 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.710 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:32:00.711 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:00.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.711 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.711 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:32:00.711 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:00.711 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.712 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.712 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:00.712 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:00.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.712 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:00.712 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:32:00.712 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:00.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.713 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:00.713 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:32:00.713 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:00.713 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.713 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.713 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:32:00.713 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:32:00.713 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:32:00.713 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:32:00.714 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:00.714 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:00.714 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:00.714 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:00.714 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.714 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:00.714 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:32:00.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.714 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:00.714 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:00.715 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:00.715 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:00.715 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:00.715 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:00.715 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:32:00.715 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:00.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.715 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:00.715 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:00.716 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:00.716 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:00.716 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:00.716 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:00.716 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:32:00.716 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:00.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.716 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:00.716 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:00.717 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:00.717 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:00.717 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:00.717 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:00.717 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:32:00.717 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:00.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.717 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:00.717 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:00.718 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:00.718 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:00.718 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:00.718 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:00.718 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:32:00.718 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:00.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.718 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:00.718 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:00.719 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:00.719 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:00.719 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:00.719 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:00.719 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:32:00.719 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:00.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.719 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:00.719 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:00.720 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:00.720 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:00.720 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:00.720 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:00.720 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:32:00.720 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:00.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.720 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:00.721 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:00.721 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:00.721 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:00.721 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:00.721 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:00.721 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:32:00.721 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:00.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:00.721 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:00.722 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:00.722 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:00.722 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:00.722 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:00.722 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:00.722 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:32:00.723 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:00.723 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.723 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:00.723 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:32:00.723 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:32:00.723 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:32:00.723 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:32:00.723 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:32:00.723 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:32:00.724 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:32:00.724 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:32:00.724 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:32:00.724 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:32:00.724 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:32:00.724 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:32:00.724 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:32:00.724 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:00.725 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:32:00.725 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:32:00.725 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:32:00.725 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:32:00.725 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:32:00.725 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:32:00.725 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:32:00.725 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:32:00.726 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:32:00.726 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:32:00.726 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:32:00.726 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:00.726 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:00.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.608+0000 7fd491be3700 1 -- 172.21.15.31:0/1041015005 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd478066f30 msgr2=0x7fd4780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:00.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.608+0000 7fd491be3700 1 --2- 172.21.15.31:0/1041015005 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd478066f30 0x7fd4780693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd4800015a0 tx=0x7fd480009040 comp rx=0 tx=0).stop 2023-10-09T06:32:00.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.608+0000 7fd491be3700 1 -- 172.21.15.31:0/1041015005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd48c14cd20 msgr2=0x7fd48c153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:00.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.608+0000 7fd491be3700 1 --2- 172.21.15.31:0/1041015005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd48c14cd20 0x7fd48c153f00 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fd47c011b10 tx=0x7fd47c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:00.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.608+0000 7fd491be3700 1 -- 172.21.15.31:0/1041015005 shutdown_connections 2023-10-09T06:32:00.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.608+0000 7fd491be3700 1 --2- 172.21.15.31:0/1041015005 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd478066f30 0x7fd4780693e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:00.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.608+0000 7fd491be3700 1 --2- 172.21.15.31:0/1041015005 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd48c14ff80 0x7fd48c0b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:00.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.608+0000 7fd491be3700 1 --2- 172.21.15.31:0/1041015005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd48c14cd20 0x7fd48c153f00 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:00.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.608+0000 7fd491be3700 1 --2- 172.21.15.31:0/1041015005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd48c150930 0x7fd48c14fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:00.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.608+0000 7fd491be3700 1 -- 172.21.15.31:0/1041015005 >> 172.21.15.31:0/1041015005 conn(0x7fd48c068ce0 msgr2=0x7fd48c14d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:00.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.608+0000 7fd491be3700 1 -- 172.21.15.31:0/1041015005 shutdown_connections 2023-10-09T06:32:00.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:00.608+0000 7fd491be3700 1 -- 172.21.15.31:0/1041015005 wait complete. 2023-10-09T06:32:00.730 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:32:05.731 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:32:05.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.866+0000 7fcf099bb700 1 Processor -- start 2023-10-09T06:32:05.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.866+0000 7fcf099bb700 1 -- start start 2023-10-09T06:32:05.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.867+0000 7fcf099bb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf04156860 0x7fcf040cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:05.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.867+0000 7fcf099bb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcf04156c30 0x7fcf040cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:05.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.867+0000 7fcf099bb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf040ab590 con 0x7fcf040a9d30 2023-10-09T06:32:05.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.867+0000 7fcf099bb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf04063df0 con 0x7fcf04156c30 2023-10-09T06:32:05.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.867+0000 7fcf099bb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0406fb20 con 0x7fcf04156860 2023-10-09T06:32:05.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf03fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcf04156c30 0x7fcf040cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:05.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf089b9700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf04156860 0x7fcf040cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:05.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf091ba700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fcf040a9d30 0x7fcf040aa170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:57658/0 (socket says 172.21.15.31:57658) 2023-10-09T06:32:05.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf091ba700 1 -- 172.21.15.31:0/1904965453 learned_addr learned my addr 172.21.15.31:0/1904965453 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:05.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf037fe700 1 -- 172.21.15.31:0/1904965453 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262446967 0 0) 0x7fcf040ab590 con 0x7fcf040a9d30 2023-10-09T06:32:05.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf037fe700 1 -- 172.21.15.31:0/1904965453 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceec003570 con 0x7fcf040a9d30 2023-10-09T06:32:05.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf089b9700 1 -- 172.21.15.31:0/1904965453 >> v2:172.21.15.158:3300/0 conn(0x7fcf04156c30 msgr2=0x7fcf040cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:05.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf089b9700 1 --2- 172.21.15.31:0/1904965453 >> v2:172.21.15.158:3300/0 conn(0x7fcf04156c30 0x7fcf040cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:05.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf089b9700 1 -- 172.21.15.31:0/1904965453 >> v1:172.21.15.158:6789/0 conn(0x7fcf040a9d30 legacy=0x7fcf040aa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:05.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf089b9700 1 -- 172.21.15.31:0/1904965453 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf040aa980 con 0x7fcf04156860 2023-10-09T06:32:05.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf03fff700 1 --2- 172.21.15.31:0/1904965453 >> v2:172.21.15.158:3300/0 conn(0x7fcf04156c30 0x7fcf040cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:32:05.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf089b9700 1 --2- 172.21.15.31:0/1904965453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf04156860 0x7fcf040cbd50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009e60 tx=0x7fcefc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a567f40201ec456f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:05.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf037fe700 1 -- 172.21.15.31:0/1904965453 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc00e070 con 0x7fcf04156860 2023-10-09T06:32:05.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf037fe700 1 -- 172.21.15.31:0/1904965453 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc00bab0 con 0x7fcf04156860 2023-10-09T06:32:05.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.868+0000 7fcf037fe700 1 -- 172.21.15.31:0/1904965453 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc00be70 con 0x7fcf04156860 2023-10-09T06:32:05.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.869+0000 7fcf099bb700 1 -- 172.21.15.31:0/1904965453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf04156860 msgr2=0x7fcf040cbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:05.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.869+0000 7fcf099bb700 1 --2- 172.21.15.31:0/1904965453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf04156860 0x7fcf040cbd50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009e60 tx=0x7fcefc009780 comp rx=0 tx=0).stop 2023-10-09T06:32:05.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.869+0000 7fcf099bb700 1 -- 172.21.15.31:0/1904965453 shutdown_connections 2023-10-09T06:32:05.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.869+0000 7fcf099bb700 1 --2- 172.21.15.31:0/1904965453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf04156860 0x7fcf040cbd50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:05.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.869+0000 7fcf099bb700 1 --2- 172.21.15.31:0/1904965453 >> v2:172.21.15.158:3300/0 conn(0x7fcf04156c30 0x7fcf040cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:05.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.869+0000 7fcf099bb700 1 -- 172.21.15.31:0/1904965453 >> 172.21.15.31:0/1904965453 conn(0x7fcf040cd070 msgr2=0x7fcf040cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:05.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.869+0000 7fcf099bb700 1 -- 172.21.15.31:0/1904965453 shutdown_connections 2023-10-09T06:32:05.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.869+0000 7fcf099bb700 1 -- 172.21.15.31:0/1904965453 wait complete. 2023-10-09T06:32:05.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.870+0000 7fcf099bb700 1 Processor -- start 2023-10-09T06:32:05.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.870+0000 7fcf099bb700 1 -- start start 2023-10-09T06:32:05.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.871+0000 7fcf099bb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf040a9d30 0x7fcf04157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:05.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.871+0000 7fcf099bb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf04156860 0x7fcf0414cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:05.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.871+0000 7fcf099bb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf04156c30 0x7fcf040b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:05.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.871+0000 7fcf099bb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0416e260 con 0x7fcf04156860 2023-10-09T06:32:05.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.871+0000 7fcf099bb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf040c8a00 con 0x7fcf04156c30 2023-10-09T06:32:05.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.871+0000 7fcf099bb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0409a450 con 0x7fcf040a9d30 2023-10-09T06:32:05.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.871+0000 7fcf03fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf04156860 0x7fcf0414cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:05.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.871+0000 7fcf03fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf04156860 0x7fcf0414cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40896/0 (socket says 172.21.15.31:40896) 2023-10-09T06:32:05.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.871+0000 7fcf03fff700 1 -- 172.21.15.31:0/705274883 learned_addr learned my addr 172.21.15.31:0/705274883 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:05.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.871+0000 7fcf089b9700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf040a9d30 0x7fcf04157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:05.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.871+0000 7fcf091ba700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf04156c30 0x7fcf040b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:05.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.872+0000 7fcf089b9700 1 -- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf04156c30 msgr2=0x7fcf040b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:05.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.872+0000 7fcf089b9700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf04156c30 0x7fcf040b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:05.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.872+0000 7fcf089b9700 1 -- 172.21.15.31:0/705274883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf04156860 msgr2=0x7fcf0414cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:05.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.872+0000 7fcf089b9700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf04156860 0x7fcf0414cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:05.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.872+0000 7fcf089b9700 1 -- 172.21.15.31:0/705274883 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8009420 con 0x7fcf040a9d30 2023-10-09T06:32:05.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.872+0000 7fcf089b9700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf040a9d30 0x7fcf04157100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcefc016000 tx=0x7fcefc019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:05.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.872+0000 7fcf00ff9700 1 -- 172.21.15.31:0/705274883 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc012ba0 con 0x7fcf040a9d30 2023-10-09T06:32:05.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.872+0000 7fcf00ff9700 1 -- 172.21.15.31:0/705274883 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc012d20 con 0x7fcf040a9d30 2023-10-09T06:32:05.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.872+0000 7fcf099bb700 1 -- 172.21.15.31:0/705274883 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc009a20 con 0x7fcf040a9d30 2023-10-09T06:32:05.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.872+0000 7fcf00ff9700 1 -- 172.21.15.31:0/705274883 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0276c0 con 0x7fcf040a9d30 2023-10-09T06:32:05.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.872+0000 7fcf099bb700 1 -- 172.21.15.31:0/705274883 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf040c8cc0 con 0x7fcf040a9d30 2023-10-09T06:32:05.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.873+0000 7fcf099bb700 1 -- 172.21.15.31:0/705274883 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf040c91e0 con 0x7fcf040a9d30 2023-10-09T06:32:05.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.874+0000 7fcf00ff9700 1 -- 172.21.15.31:0/705274883 <== mon.2 v2:172.21.15.158:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcefc024070 con 0x7fcf040a9d30 2023-10-09T06:32:05.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.874+0000 7fcf00ff9700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcef0066f30 0x7fcef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:05.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.874+0000 7fcf00ff9700 1 -- 172.21.15.31:0/705274883 <== mon.2 v2:172.21.15.158:3301/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcefc086930 con 0x7fcf040a9d30 2023-10-09T06:32:05.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.874+0000 7fcf03fff700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcef0066f30 0x7fcef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:05.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.875+0000 7fcf03fff700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcef0066f30 0x7fcef00693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcf0406e060 tx=0x7fcef80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:05.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:05.879+0000 7fcf00ff9700 1 -- 172.21.15.31:0/705274883 <== mon.2 v2:172.21.15.158:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcefc053ba0 con 0x7fcf040a9d30 2023-10-09T06:32:06.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.076+0000 7fcf099bb700 1 -- 172.21.15.31:0/705274883 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcf040aac60 con 0x7fcf040a9d30 2023-10-09T06:32:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.077+0000 7fcf00ff9700 1 -- 172.21.15.31:0/705274883 <== mon.2 v2:172.21.15.158:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v186) v1 ==== 81+0+32282 (secure 0 0 0) 0x7fcefc0571c0 con 0x7fcf040a9d30 2023-10-09T06:32:06.077 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:06.078 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 186, 2023-10-09T06:32:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:32:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:32:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:31:59.902922+0000", 2023-10-09T06:32:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:32:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:32:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:32:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:32:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:32:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:32:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:32:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:32:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:32:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:32:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:32:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:32:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:32:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:32:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 23, 2023-10-09T06:32:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:32:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:32:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:32:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:32:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:32:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:32:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:32:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:32:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:32:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:32:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:32:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:32:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:32:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:32:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:32:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:32:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:32:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 22, 2023-10-09T06:32:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:32:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:48.664093+0000", 2023-10-09T06:32:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:32:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:32:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:32:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:32:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:32:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "184", 2023-10-09T06:32:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:32:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:32:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:32:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:32:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 23, 2023-10-09T06:32:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:32:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:49.212701+0000", 2023-10-09T06:32:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:32:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:32:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:32:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:32:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:32:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "186", 2023-10-09T06:32:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:32:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:32:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:32:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:32:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:32:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:32:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:32:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:32:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:32:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:32:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:32:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:32:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:32:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:32:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:32:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:32:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:32:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:32:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:32:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:32:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:32:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:32:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:32:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:32:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:32:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:32:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:32:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:32:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:32:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:32:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:32:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:32:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:32:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:32:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:32:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:32:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:32:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:32:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:32:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:32:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:32:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:32:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:32:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:32:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:32:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:32:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:32:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:32:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:32:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:32:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:32:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:32:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:32:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:32:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:32:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:32:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:32:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:32:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:32:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:32:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:32:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:32:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:32:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:32:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:32:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:32:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:32:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:32:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:32:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:32:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:32:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:32:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:32:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:32:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:32:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:32:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:32:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:32:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:32:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:32:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:32:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:32:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:32:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:32:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:32:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:32:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:32:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:32:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:32:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:32:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:32:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:32:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:32:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:32:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:32:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:32:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:32:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:32:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:32:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:32:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:32:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:32:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:32:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:32:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:32:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:32:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:32:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:32:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:32:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:32:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:32:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:32:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:32:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:32:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:32:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:32:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:32:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:32:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:32:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:32:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:32:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:32:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:32:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:32:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:32:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:32:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:32:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:32:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:32:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:32:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:32:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:32:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:32:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:32:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:06.168 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:06.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.080+0000 7fcf099bb700 1 -- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcef0066f30 msgr2=0x7fcef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:06.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.080+0000 7fcf099bb700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcef0066f30 0x7fcef00693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcf0406e060 tx=0x7fcef80091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.080+0000 7fcf099bb700 1 -- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf040a9d30 msgr2=0x7fcf04157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.080+0000 7fcf099bb700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf040a9d30 0x7fcf04157100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcefc016000 tx=0x7fcefc019000 comp rx=0 tx=0).stop 2023-10-09T06:32:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.080+0000 7fcf099bb700 1 -- 172.21.15.31:0/705274883 shutdown_connections 2023-10-09T06:32:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.080+0000 7fcf099bb700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcef0066f30 0x7fcef00693e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.080+0000 7fcf099bb700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf040a9d30 0x7fcf04157100 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.080+0000 7fcf099bb700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf04156c30 0x7fcf040b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.080+0000 7fcf099bb700 1 --2- 172.21.15.31:0/705274883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf04156860 0x7fcf0414cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.080+0000 7fcf099bb700 1 -- 172.21.15.31:0/705274883 >> 172.21.15.31:0/705274883 conn(0x7fcf040cd070 msgr2=0x7fcf040af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.080+0000 7fcf099bb700 1 -- 172.21.15.31:0/705274883 shutdown_connections 2023-10-09T06:32:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:06.080+0000 7fcf099bb700 1 -- 172.21.15.31:0/705274883 wait complete. 2023-10-09T06:32:06.171 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:32:11.172 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:32:11.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.305+0000 7fe7b4937700 1 Processor -- start 2023-10-09T06:32:11.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.305+0000 7fe7b4937700 1 -- start start 2023-10-09T06:32:11.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7b4937700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7b00b0890 0x7fe7b00cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:11.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7b4937700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe7b0067d70 0x7fe7b0159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:11.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7b4937700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b00cb370 con 0x7fe7b00cbd40 2023-10-09T06:32:11.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7b4937700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b00b0c60 con 0x7fe7b0067d70 2023-10-09T06:32:11.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7b4937700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b006a1e0 con 0x7fe7b00b0890 2023-10-09T06:32:11.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7aed9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe7b0067d70 0x7fe7b0159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:11.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7ae59c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7b00b0890 0x7fe7b00cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:11.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7add9b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fe7b00cbd40 0x7fe7b0067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:36320/0 (socket says 172.21.15.31:36320) 2023-10-09T06:32:11.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7aed9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe7b0067d70 0x7fe7b0159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:40038/0 (socket says 172.21.15.31:40038) 2023-10-09T06:32:11.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7add9b700 1 -- 172.21.15.31:0/384159584 learned_addr learned my addr 172.21.15.31:0/384159584 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:11.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7ae59c700 1 --2- 172.21.15.31:0/384159584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7b00b0890 0x7fe7b00cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3301/0 says I am v2:172.21.15.31:48468/0 (socket says 172.21.15.31:48468) 2023-10-09T06:32:11.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7aed9d700 1 -- 172.21.15.31:0/384159584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7b00b0890 msgr2=0x7fe7b00cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:11.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7aed9d700 1 --2- 172.21.15.31:0/384159584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7b00b0890 0x7fe7b00cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7aed9d700 1 -- 172.21.15.31:0/384159584 >> v1:172.21.15.158:6789/0 conn(0x7fe7b00cbd40 legacy=0x7fe7b0067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:11.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7aed9d700 1 -- 172.21.15.31:0/384159584 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b006cb80 con 0x7fe7b0067d70 2023-10-09T06:32:11.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.306+0000 7fe7ae59c700 1 --2- 172.21.15.31:0/384159584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7b00b0890 0x7fe7b00cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:32:11.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.307+0000 7fe7aed9d700 1 --2- 172.21.15.31:0/384159584 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7b0067d70 0x7fe7b0159790 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00098e0 tx=0x7fe7a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b27c1f051bc34ab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:11.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.307+0000 7fe7ad59a700 1 -- 172.21.15.31:0/384159584 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000b640 con 0x7fe7b0067d70 2023-10-09T06:32:11.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.307+0000 7fe7ad59a700 1 -- 172.21.15.31:0/384159584 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a000b7a0 con 0x7fe7b0067d70 2023-10-09T06:32:11.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.307+0000 7fe7ad59a700 1 -- 172.21.15.31:0/384159584 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000bb40 con 0x7fe7b0067d70 2023-10-09T06:32:11.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.307+0000 7fe7b4937700 1 -- 172.21.15.31:0/384159584 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7b0067d70 msgr2=0x7fe7b0159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:11.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.307+0000 7fe7b4937700 1 --2- 172.21.15.31:0/384159584 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7b0067d70 0x7fe7b0159790 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00098e0 tx=0x7fe7a00091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.308+0000 7fe7b4937700 1 -- 172.21.15.31:0/384159584 shutdown_connections 2023-10-09T06:32:11.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.308+0000 7fe7b4937700 1 --2- 172.21.15.31:0/384159584 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7b0067d70 0x7fe7b0159790 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.308+0000 7fe7b4937700 1 --2- 172.21.15.31:0/384159584 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7b00b0890 0x7fe7b00cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.308+0000 7fe7b4937700 1 -- 172.21.15.31:0/384159584 >> 172.21.15.31:0/384159584 conn(0x7fe7b006fe50 msgr2=0x7fe7b0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:11.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.308+0000 7fe7b4937700 1 -- 172.21.15.31:0/384159584 shutdown_connections 2023-10-09T06:32:11.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.308+0000 7fe7b4937700 1 -- 172.21.15.31:0/384159584 wait complete. 2023-10-09T06:32:11.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.309+0000 7fe7b4937700 1 Processor -- start 2023-10-09T06:32:11.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.309+0000 7fe7b4937700 1 -- start start 2023-10-09T06:32:11.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.309+0000 7fe7b4937700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7b0067d70 0x7fe7b00aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:11.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.309+0000 7fe7b4937700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7b00b0890 0x7fe7b00c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:11.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.309+0000 7fe7b4937700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b00cbd40 0x7fe7b015a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:11.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.309+0000 7fe7b4937700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00c34b0 con 0x7fe7b00cbd40 2023-10-09T06:32:11.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.309+0000 7fe7b4937700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00c43b0 con 0x7fe7b00b0890 2023-10-09T06:32:11.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.309+0000 7fe7b4937700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00aadc0 con 0x7fe7b0067d70 2023-10-09T06:32:11.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7aed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b00cbd40 0x7fe7b015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:11.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7ae59c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7b0067d70 0x7fe7b00aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:11.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7aed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b00cbd40 0x7fe7b015a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37760/0 (socket says 172.21.15.31:37760) 2023-10-09T06:32:11.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7aed9d700 1 -- 172.21.15.31:0/1426262911 learned_addr learned my addr 172.21.15.31:0/1426262911 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7add9b700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7b00b0890 0x7fe7b00c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7aed9d700 1 -- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7b0067d70 msgr2=0x7fe7b00aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7aed9d700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7b0067d70 0x7fe7b00aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7aed9d700 1 -- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7b00b0890 msgr2=0x7fe7b00c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7aed9d700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7b00b0890 0x7fe7b00c2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7aed9d700 1 -- 172.21.15.31:0/1426262911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a8009a20 con 0x7fe7b00cbd40 2023-10-09T06:32:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7ae59c700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7b0067d70 0x7fe7b00aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:32:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7aed9d700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b00cbd40 0x7fe7b015a7e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fe7b006ab60 tx=0x7fe7a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7a67fc700 1 -- 172.21.15.31:0/1426262911 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0011420 con 0x7fe7b00cbd40 2023-10-09T06:32:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7a67fc700 1 -- 172.21.15.31:0/1426262911 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a0011580 con 0x7fe7b00cbd40 2023-10-09T06:32:11.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7b4937700 1 -- 172.21.15.31:0/1426262911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a0009420 con 0x7fe7b00cbd40 2023-10-09T06:32:11.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7a67fc700 1 -- 172.21.15.31:0/1426262911 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0011940 con 0x7fe7b00cbd40 2023-10-09T06:32:11.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.310+0000 7fe7b4937700 1 -- 172.21.15.31:0/1426262911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b00c31d0 con 0x7fe7b00cbd40 2023-10-09T06:32:11.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.311+0000 7fe7b4937700 1 -- 172.21.15.31:0/1426262911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b00c4560 con 0x7fe7b00cbd40 2023-10-09T06:32:11.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.312+0000 7fe7a67fc700 1 -- 172.21.15.31:0/1426262911 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7a0011cb0 con 0x7fe7b00cbd40 2023-10-09T06:32:11.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.312+0000 7fe7a67fc700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe790066f30 0x7fe7900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:11.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.312+0000 7fe7a67fc700 1 -- 172.21.15.31:0/1426262911 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7a0085f70 con 0x7fe7b00cbd40 2023-10-09T06:32:11.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.312+0000 7fe7a67fc700 1 -- 172.21.15.31:0/1426262911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7fe79006ea50 con 0x7fe7b00cbd40 2023-10-09T06:32:11.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.312+0000 7fe7ae59c700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe790066f30 0x7fe7900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:11.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.313+0000 7fe7ae59c700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe790066f30 0x7fe7900693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800eae0 tx=0x7fe7a800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:11.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.316+0000 7fe7a67fc700 1 -- 172.21.15.31:0/1426262911 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7a00b75a0 con 0x7fe7b00cbd40 2023-10-09T06:32:11.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.511+0000 7fe7b4937700 1 -- 172.21.15.31:0/1426262911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe7b004c3c0 con 0x7fe7b00cbd40 2023-10-09T06:32:11.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.512+0000 7fe7a67fc700 1 -- 172.21.15.31:0/1426262911 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) v1 ==== 81+0+32301 (secure 0 0 0) 0x7fe7a0015070 con 0x7fe7b00cbd40 2023-10-09T06:32:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:11.513 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 187, 2023-10-09T06:32:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:32:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:32:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:32:06.802905+0000", 2023-10-09T06:32:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:32:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:32:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:32:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:32:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:32:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:32:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:32:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:32:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:32:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:32:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:32:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:32:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:32:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:32:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 23, 2023-10-09T06:32:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:32:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:32:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:32:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:32:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:32:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:32:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:32:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:32:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:32:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:32:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:32:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:32:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:32:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:32:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:32:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:32:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:32:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 22, 2023-10-09T06:32:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:32:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:48.664093+0000", 2023-10-09T06:32:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:32:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:32:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:32:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:32:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:32:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "184", 2023-10-09T06:32:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:32:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:32:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:32:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:32:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 23, 2023-10-09T06:32:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:32:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:49.212701+0000", 2023-10-09T06:32:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1027, 2023-10-09T06:32:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T06:32:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:32:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:32:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:32:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:32:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:32:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "187", 2023-10-09T06:32:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:32:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:32:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:32:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:32:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:32:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:32:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:32:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:32:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:32:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:32:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:32:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:32:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:32:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:32:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:32:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:32:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:32:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:32:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:32:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:32:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:32:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:32:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:32:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:32:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:32:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:32:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:32:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:32:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:32:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:32:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:32:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:32:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:32:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:32:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:32:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:32:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:32:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:32:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:32:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:32:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:32:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:32:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:32:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:32:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:32:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:32:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:32:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:32:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:32:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:32:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:32:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:32:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:32:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:32:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:32:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:32:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:32:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:32:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:32:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:32:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:32:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:32:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:32:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:32:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:32:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:32:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:32:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:32:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:32:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:32:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:32:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:32:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:32:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:32:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:32:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:32:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:32:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:32:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:32:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:32:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:32:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:32:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:32:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:32:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:32:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:32:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:32:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:32:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:32:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:11.594 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:32:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.595 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:32:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:32:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:11.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:32:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.597 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:32:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:32:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:11.598 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:32:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:32:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.599 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:32:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:32:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:32:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:32:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:11.600 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:32:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:32:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:11.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:32:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:11.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:32:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:32:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.604 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:32:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:32:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:32:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:32:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:32:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:32:11.608 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:32:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:32:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:32:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:32:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:32:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:32:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:32:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:32:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:32:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:32:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:32:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:32:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:32:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:32:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:32:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:32:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:32:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:32:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:32:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:32:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:32:11.610 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:32:11.611 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:11.611 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:11.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.514+0000 7fe7b4937700 1 -- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe790066f30 msgr2=0x7fe7900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:11.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.514+0000 7fe7b4937700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe790066f30 0x7fe7900693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800eae0 tx=0x7fe7a800b040 comp rx=0 tx=0).stop 2023-10-09T06:32:11.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.514+0000 7fe7b4937700 1 -- 172.21.15.31:0/1426262911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b00cbd40 msgr2=0x7fe7b015a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.514+0000 7fe7b4937700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b00cbd40 0x7fe7b015a7e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fe7b006ab60 tx=0x7fe7a0017000 comp rx=0 tx=0).stop 2023-10-09T06:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.514+0000 7fe7b4937700 1 -- 172.21.15.31:0/1426262911 shutdown_connections 2023-10-09T06:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.514+0000 7fe7b4937700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe790066f30 0x7fe7900693e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.514+0000 7fe7b4937700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe7b0067d70 0x7fe7b00aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.514+0000 7fe7b4937700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b00cbd40 0x7fe7b015a7e0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.514+0000 7fe7b4937700 1 --2- 172.21.15.31:0/1426262911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7b00b0890 0x7fe7b00c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.514+0000 7fe7b4937700 1 -- 172.21.15.31:0/1426262911 >> 172.21.15.31:0/1426262911 conn(0x7fe7b006fe50 msgr2=0x7fe7b00afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.514+0000 7fe7b4937700 1 -- 172.21.15.31:0/1426262911 shutdown_connections 2023-10-09T06:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.514+0000 7fe7b4937700 1 -- 172.21.15.31:0/1426262911 wait complete. 2023-10-09T06:32:11.614 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-09T06:32:11.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:32:11.614 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-09T06:32:11.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:32:11.865 INFO:teuthology.orchestra.run.smithi031.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-09T06:32:11.865 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records in 2023-10-09T06:32:11.866 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records out 2023-10-09T06:32:11.866 INFO:teuthology.orchestra.run.smithi031.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.232033 s, 226 MB/s 2023-10-09T06:32:11.866 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:32:11.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.985+0000 7f9815002700 1 Processor -- start 2023-10-09T06:32:11.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.985+0000 7f9815002700 1 -- start start 2023-10-09T06:32:11.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.985+0000 7f9815002700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f981006a0e0 0x7f981006a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:11.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.985+0000 7f9815002700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f981006e0b0 0x7f981006e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:11.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.985+0000 7f9815002700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981006aa90 con 0x7f98101569a0 2023-10-09T06:32:11.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.985+0000 7f9815002700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981006efe0 con 0x7f981006e0b0 2023-10-09T06:32:11.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.985+0000 7f9815002700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981006ea50 con 0x7f981006a0e0 2023-10-09T06:32:11.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980f59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f981006e0b0 0x7f981006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:11.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980ed9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f98101569a0 0x7f98100c8ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37700/0 (socket says 172.21.15.31:37700) 2023-10-09T06:32:11.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980ed9d700 1 -- 172.21.15.31:0/1164089573 learned_addr learned my addr 172.21.15.31:0/1164089573 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:11.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980e59c700 1 --2- 172.21.15.31:0/1164089573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f981006a0e0 0x7f981006a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:11.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980dd9b700 1 -- 172.21.15.31:0/1164089573 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223073708 0 0) 0x7f981006aa90 con 0x7f98101569a0 2023-10-09T06:32:11.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980dd9b700 1 -- 172.21.15.31:0/1164089573 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f8003570 con 0x7f98101569a0 2023-10-09T06:32:11.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980f59e700 1 -- 172.21.15.31:0/1164089573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f981006a0e0 msgr2=0x7f981006a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:11.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980f59e700 1 --2- 172.21.15.31:0/1164089573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f981006a0e0 0x7f981006a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980f59e700 1 -- 172.21.15.31:0/1164089573 >> v1:172.21.15.31:6789/0 conn(0x7f98101569a0 legacy=0x7f98100c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:11.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980f59e700 1 -- 172.21.15.31:0/1164089573 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981006ed00 con 0x7f981006e0b0 2023-10-09T06:32:11.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980f59e700 1 --2- 172.21.15.31:0/1164089573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f981006e0b0 0x7f981006e510 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f98080098e0 tx=0x7f98080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e31cc0e35e6d62 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:11.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980dd9b700 1 -- 172.21.15.31:0/1164089573 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800b640 con 0x7f981006e0b0 2023-10-09T06:32:11.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980dd9b700 1 -- 172.21.15.31:0/1164089573 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980800b7a0 con 0x7f981006e0b0 2023-10-09T06:32:11.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.986+0000 7f980dd9b700 1 -- 172.21.15.31:0/1164089573 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800bb40 con 0x7f981006e0b0 2023-10-09T06:32:11.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.987+0000 7f9815002700 1 -- 172.21.15.31:0/1164089573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f981006e0b0 msgr2=0x7f981006e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:11.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.987+0000 7f9815002700 1 --2- 172.21.15.31:0/1164089573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f981006e0b0 0x7f981006e510 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f98080098e0 tx=0x7f98080091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.987+0000 7f9815002700 1 -- 172.21.15.31:0/1164089573 shutdown_connections 2023-10-09T06:32:11.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.987+0000 7f9815002700 1 --2- 172.21.15.31:0/1164089573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f981006e0b0 0x7f981006e510 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.987+0000 7f9815002700 1 --2- 172.21.15.31:0/1164089573 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f981006a0e0 0x7f981006a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.987+0000 7f9815002700 1 -- 172.21.15.31:0/1164089573 >> 172.21.15.31:0/1164089573 conn(0x7f98100cd8d0 msgr2=0x7f98100cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:11.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.987+0000 7f9815002700 1 -- 172.21.15.31:0/1164089573 shutdown_connections 2023-10-09T06:32:11.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.987+0000 7f9815002700 1 -- 172.21.15.31:0/1164089573 wait complete. 2023-10-09T06:32:11.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.988+0000 7f9815002700 1 Processor -- start 2023-10-09T06:32:11.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.988+0000 7f9815002700 1 -- start start 2023-10-09T06:32:11.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f9815002700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f981006a0e0 0x7f981015b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:11.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f9815002700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f981006e0b0 0x7f98100c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:11.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f9815002700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98101569a0 0x7f98100c0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:11.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f9815002700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98100c8030 con 0x7f981006a0e0 2023-10-09T06:32:11.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f9815002700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981015ccf0 con 0x7f981006e0b0 2023-10-09T06:32:11.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f9815002700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98100c0da0 con 0x7f98101569a0 2023-10-09T06:32:11.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f980ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f981006a0e0 0x7f981015b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:11.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f980ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f981006a0e0 0x7f981015b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37782/0 (socket says 172.21.15.31:37782) 2023-10-09T06:32:11.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f980ed9d700 1 -- 172.21.15.31:0/675363070 learned_addr learned my addr 172.21.15.31:0/675363070 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:11.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f980ed9d700 1 -- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98101569a0 msgr2=0x7f98100c0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:11.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f980f59e700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98101569a0 0x7f98100c0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:11.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f980e59c700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f981006e0b0 0x7f98100c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:11.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f980ed9d700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98101569a0 0x7f98100c0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f980ed9d700 1 -- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f981006e0b0 msgr2=0x7f98100c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f980ed9d700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f981006e0b0 0x7f98100c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f980ed9d700 1 -- 172.21.15.31:0/675363070 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9808009420 con 0x7f981006a0e0 2023-10-09T06:32:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f980f59e700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98101569a0 0x7f98100c0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.989+0000 7f980e59c700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f981006e0b0 0x7f98100c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.990+0000 7f980ed9d700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f981006a0e0 0x7f981015b9e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f980000cd30 tx=0x7f9800001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.990+0000 7f97f6ffd700 1 -- 172.21.15.31:0/675363070 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980000ab70 con 0x7f981006a0e0 2023-10-09T06:32:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.990+0000 7f97f6ffd700 1 -- 172.21.15.31:0/675363070 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980000acf0 con 0x7f981006a0e0 2023-10-09T06:32:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.990+0000 7f9815002700 1 -- 172.21.15.31:0/675363070 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981015c0e0 con 0x7f981006a0e0 2023-10-09T06:32:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.990+0000 7f97f6ffd700 1 -- 172.21.15.31:0/675363070 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800007340 con 0x7f981006a0e0 2023-10-09T06:32:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.990+0000 7f9815002700 1 -- 172.21.15.31:0/675363070 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981015c6a0 con 0x7f981006a0e0 2023-10-09T06:32:11.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.991+0000 7f9815002700 1 -- 172.21.15.31:0/675363070 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98101576d0 con 0x7f981006a0e0 2023-10-09T06:32:11.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.991+0000 7f97f6ffd700 1 -- 172.21.15.31:0/675363070 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9800007730 con 0x7f981006a0e0 2023-10-09T06:32:11.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.991+0000 7f97f6ffd700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f97fc066f30 0x7f97fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:11.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.992+0000 7f97f6ffd700 1 -- 172.21.15.31:0/675363070 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f98000849f0 con 0x7f981006a0e0 2023-10-09T06:32:11.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.992+0000 7f980e59c700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f97fc066f30 0x7f97fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:11.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.992+0000 7f97f6ffd700 1 -- 172.21.15.31:0/675363070 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7f97fc06ea50 con 0x7f981006a0e0 2023-10-09T06:32:11.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.992+0000 7f980e59c700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f97fc066f30 0x7f97fc0693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f98100c47a0 tx=0x7f9804008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:11.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:11.996+0000 7f97f6ffd700 1 -- 172.21.15.31:0/675363070 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9800051ce0 con 0x7f981006a0e0 2023-10-09T06:32:12.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.189+0000 7f9815002700 1 -- 172.21.15.31:0/675363070 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f981004bb80 con 0x7f981006a0e0 2023-10-09T06:32:12.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.190+0000 7f97f6ffd700 1 -- 172.21.15.31:0/675363070 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f980000ae60 con 0x7f981006a0e0 2023-10-09T06:32:12.191 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:12.191 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:12.192 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 187, 2023-10-09T06:32:12.192 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:32:12.192 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:32:12.192 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:32:06.802905+0000", 2023-10-09T06:32:12.192 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:32:12.192 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:32:12.192 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:32:12.193 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:32:12.193 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:32:12.193 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:32:12.193 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:32:12.193 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:32:12.193 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:32:12.194 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:12.194 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:32:12.194 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:32:12.194 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:32:12.194 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:32:12.195 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:32:12.195 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 23, 2023-10-09T06:32:12.195 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:32:12.195 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:32:12.195 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:32:12.195 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:32:12.195 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:32:12.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.196 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:32:12.196 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:32:12.196 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:32:12.196 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:12.196 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:12.196 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:12.197 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:12.197 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:12.197 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:12.197 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:12.197 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:12.197 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:12.198 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:12.198 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:12.198 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:12.198 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:32:12.198 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:32:12.199 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:32:12.199 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:32:12.199 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:32:12.199 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:12.199 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:12.199 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:12.199 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:12.199 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:12.200 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:12.200 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:12.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.200 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:32:12.200 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:12.200 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:12.200 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:12.201 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:12.201 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:12.201 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:12.201 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:12.201 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:12.201 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:12.201 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:12.201 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:12.201 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:12.201 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:12.201 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:12.201 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:12.202 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:12.202 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:12.202 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:12.202 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:12.202 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:12.202 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:12.202 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:12.202 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:12.202 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:12.203 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:12.203 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:12.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.203 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:12.203 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:12.203 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:12.203 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:12.203 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:12.203 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:12.203 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:12.203 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:12.204 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:12.204 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:12.204 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:12.204 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:12.204 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:32:12.204 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:32:12.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.204 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:12.204 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:32:12.204 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.205 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 22, 2023-10-09T06:32:12.205 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:32:12.205 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:48.664093+0000", 2023-10-09T06:32:12.205 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:12.205 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:12.205 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:12.205 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:12.205 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:12.205 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:12.205 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:12.205 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:12.205 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:12.206 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:12.206 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:12.206 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:12.206 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:32:12.209 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:32:12.209 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:32:12.209 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:32:12.210 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:32:12.210 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:12.210 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:12.210 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:12.210 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:12.210 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:12.210 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:12.211 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:12.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.211 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "184", 2023-10-09T06:32:12.211 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:12.211 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:12.212 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:12.212 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:12.212 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:12.212 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:12.212 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:12.212 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:12.212 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:12.212 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:12.213 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:12.213 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:12.213 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:12.213 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:12.213 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:12.213 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:12.213 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:12.214 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:12.214 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:12.214 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:12.214 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:12.214 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:12.214 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:12.214 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:12.215 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:12.215 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:12.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.215 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:12.216 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:12.216 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:12.217 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:12.217 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:12.217 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:12.217 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:12.217 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:12.217 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:12.218 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:12.218 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:12.218 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:12.218 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:32:12.218 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:32:12.218 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:32:12.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.218 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:12.218 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:12.218 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:32:12.218 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.219 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.219 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 23, 2023-10-09T06:32:12.219 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:32:12.219 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:49.212701+0000", 2023-10-09T06:32:12.219 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1027, 2023-10-09T06:32:12.219 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T06:32:12.219 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:12.219 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:12.220 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:12.220 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:12.220 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:12.220 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:12.220 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:12.220 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:12.220 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:12.220 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:12.220 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:32:12.220 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:32:12.220 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:32:12.221 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:32:12.221 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:32:12.221 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:12.222 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:12.222 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:12.222 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:12.222 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:12.222 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:12.223 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:12.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.223 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "187", 2023-10-09T06:32:12.223 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:12.223 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:12.223 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:12.223 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:12.223 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:12.223 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:12.223 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:12.223 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:12.223 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:12.224 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:32:12.224 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:12.224 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:12.224 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:12.224 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:12.224 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:12.224 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:12.224 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:12.224 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:12.224 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:12.224 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:12.224 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:12.225 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:12.225 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:12.225 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:12.225 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:12.225 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:12.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.225 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:12.225 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:12.225 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:12.225 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:12.225 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:12.226 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:12.226 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:12.226 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:12.226 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:12.226 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:12.226 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:12.226 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:12.226 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:32:12.226 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:32:12.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.226 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:12.227 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:12.227 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:32:12.227 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.227 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.227 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.227 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:12.227 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:32:12.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.227 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:12.227 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:12.227 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:12.227 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:12.228 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:12.228 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:12.228 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:12.228 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:12.228 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:12.228 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:12.228 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:12.228 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:12.228 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:12.228 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.228 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.229 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:32:12.229 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:12.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.229 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.229 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:32:12.229 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:12.229 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.229 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.229 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:12.229 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.230 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.230 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:32:12.230 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:12.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.230 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.230 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:32:12.230 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:12.230 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.230 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.231 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:12.231 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.231 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.231 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:32:12.231 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:12.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.231 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.231 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:32:12.231 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:12.231 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.232 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.232 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:12.232 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.232 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.232 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:32:12.232 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:12.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.232 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.232 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:32:12.233 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:12.233 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.233 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.233 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:32:12.233 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:32:12.233 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:32:12.233 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:32:12.233 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:12.233 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:12.233 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:12.233 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.234 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:12.234 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:12.234 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:12.234 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:12.234 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:12.234 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:12.234 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:12.234 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:12.234 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:12.235 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:12.235 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:12.235 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:12.235 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:12.235 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.235 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.235 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:32:12.235 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:12.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.235 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.235 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:32:12.236 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:12.236 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.236 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.236 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:12.236 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.236 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.236 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:32:12.236 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:12.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.237 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.237 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:32:12.237 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:12.237 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.237 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.237 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:12.237 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.237 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.237 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:32:12.237 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:12.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.238 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.238 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:32:12.238 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:12.238 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.238 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.239 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:12.239 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.239 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.239 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:32:12.239 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:12.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.239 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.239 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:32:12.239 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:12.240 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.240 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.240 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:32:12.240 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:32:12.240 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:32:12.240 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:32:12.240 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:12.240 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:12.240 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:12.240 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.241 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:12.241 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:12.241 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:12.241 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:12.241 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:12.241 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:12.241 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:12.241 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:12.241 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:12.241 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:12.241 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:12.241 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:12.242 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:12.242 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.242 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.242 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:32:12.242 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:12.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.242 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.242 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:32:12.242 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:12.243 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.243 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.243 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:12.243 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.243 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.243 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:32:12.243 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:12.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.243 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.244 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:32:12.244 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:12.244 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.244 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.244 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:12.244 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.244 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.244 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:32:12.244 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:12.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.245 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.245 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:32:12.245 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:12.245 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.245 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.245 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:12.245 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.245 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.245 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:32:12.245 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:12.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.246 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.246 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:32:12.246 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:12.246 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.246 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.246 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:32:12.246 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:32:12.246 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:32:12.247 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:32:12.247 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:12.247 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:12.247 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:12.247 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.247 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:12.247 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:12.247 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:12.247 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:12.247 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:12.248 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:12.248 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:12.248 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:12.248 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:12.248 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:12.248 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:12.248 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:12.248 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:12.248 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.248 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.248 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:32:12.248 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:12.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.249 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:32:12.249 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:12.249 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.249 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.249 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:12.249 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.250 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:32:12.250 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:12.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.250 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.250 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:32:12.250 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:12.250 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.250 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.250 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:12.250 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.251 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.251 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:32:12.251 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:12.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.251 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.251 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:32:12.251 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:12.251 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.251 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.252 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:12.252 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.252 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.252 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:32:12.252 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:12.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.252 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.252 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:32:12.252 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:12.252 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.252 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.253 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:32:12.253 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:32:12.253 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:32:12.253 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:32:12.253 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:12.253 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:12.253 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:12.253 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.253 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:12.254 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:12.254 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:12.254 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:12.254 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:12.254 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:12.254 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:12.254 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:12.254 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:12.254 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:12.254 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:12.254 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:12.254 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:12.255 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.255 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.255 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:32:12.255 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:12.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.255 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.255 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:32:12.255 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:12.255 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.255 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.256 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:12.256 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.256 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.256 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:32:12.256 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:12.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.256 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.256 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:32:12.256 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:12.257 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.257 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.257 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:12.257 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.257 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.257 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:32:12.257 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:12.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.257 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.257 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:32:12.258 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:12.258 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.258 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.258 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:12.258 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.258 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.258 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:32:12.258 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:12.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.259 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.259 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:32:12.259 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:12.259 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.259 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.259 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:32:12.259 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:32:12.259 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:32:12.259 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:32:12.259 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:12.259 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:12.260 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:12.260 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.260 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:12.260 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:12.260 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:12.260 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:12.260 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:12.260 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:12.260 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:12.260 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:12.261 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:12.261 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:12.261 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:12.261 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:12.261 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:12.261 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.261 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.261 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:32:12.261 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:12.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.262 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.262 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:32:12.262 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:12.262 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.262 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.262 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:12.262 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.262 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.262 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:32:12.262 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:12.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.263 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.263 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:32:12.263 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:12.263 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.263 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.263 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:12.263 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.263 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.264 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:32:12.264 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:12.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.265 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.265 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:32:12.265 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:12.265 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.265 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.265 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:12.265 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.266 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.266 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:32:12.266 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:12.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.266 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.266 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:32:12.266 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:12.266 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.266 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.267 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:32:12.267 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:32:12.267 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:32:12.267 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:32:12.267 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:12.267 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:12.267 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:12.267 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.267 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:12.267 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:12.267 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:12.268 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:12.268 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:12.268 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:12.268 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:12.268 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:12.268 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:12.268 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:12.268 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:12.268 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:12.268 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:12.268 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.269 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.269 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:32:12.269 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:12.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.269 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.269 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:32:12.269 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:12.269 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.269 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.269 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:12.270 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.270 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.270 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:32:12.270 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:12.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.270 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.270 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:32:12.270 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:12.270 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.271 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.271 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:12.271 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.271 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.271 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:32:12.271 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:12.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.271 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.271 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:32:12.271 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:12.272 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.272 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.272 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:12.272 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.272 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.272 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:32:12.272 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:12.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.272 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.273 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:32:12.273 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:12.273 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.273 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.273 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:32:12.273 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:32:12.273 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:32:12.273 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:32:12.273 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:12.273 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:12.273 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:12.274 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.274 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:12.274 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:12.274 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:12.274 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:12.274 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:12.274 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:12.274 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:12.274 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:12.274 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:12.275 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:12.275 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:12.275 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:12.275 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:12.275 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.275 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.275 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:32:12.275 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:12.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.275 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.276 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:32:12.276 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:12.276 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.276 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.276 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:12.276 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.276 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.276 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:32:12.276 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:12.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.277 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.277 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:32:12.277 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:12.277 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.277 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.277 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:12.277 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.277 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.277 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:32:12.278 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:12.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.278 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.278 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:32:12.278 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:12.278 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.278 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.278 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:12.278 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:12.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.279 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:12.279 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:32:12.279 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:12.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.279 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:12.279 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:32:12.279 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:12.279 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.279 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.279 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:32:12.279 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:32:12.280 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:32:12.280 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:32:12.280 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:12.280 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:12.280 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:12.280 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:12.280 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.280 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:12.280 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:32:12.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.280 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:12.280 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:12.281 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:12.281 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:12.281 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:12.281 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:12.281 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:32:12.281 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:12.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.281 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:12.281 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:12.281 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:12.281 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:12.282 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:12.282 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:12.282 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:32:12.282 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:12.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.282 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:12.282 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:12.282 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:12.282 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:12.282 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:12.282 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:12.283 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:32:12.283 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:12.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.283 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:12.283 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:12.283 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:12.283 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:12.283 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:12.283 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:12.283 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:32:12.284 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:12.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.284 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:12.284 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:12.284 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:12.284 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:12.284 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:12.284 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:12.284 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:32:12.284 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:12.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.285 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:12.285 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:12.285 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:12.285 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:12.285 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:12.285 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:12.285 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:32:12.285 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:12.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.285 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:12.286 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:12.286 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:12.286 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:12.286 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:12.286 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:12.286 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:32:12.286 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:12.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:12.286 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:12.286 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:12.287 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:12.287 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:12.287 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:12.287 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:12.287 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:32:12.287 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:12.287 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.287 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:12.287 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:32:12.287 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:32:12.287 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:32:12.287 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:32:12.288 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:32:12.288 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:32:12.288 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:32:12.288 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:32:12.288 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:32:12.288 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:32:12.288 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:32:12.288 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:32:12.288 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:32:12.288 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:12.289 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:32:12.289 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:32:12.289 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:32:12.289 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:32:12.289 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:32:12.289 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:32:12.289 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:32:12.289 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:32:12.289 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:32:12.289 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:32:12.289 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:32:12.289 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:12.290 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:12.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.193+0000 7f9815002700 1 -- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f97fc066f30 msgr2=0x7f97fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:12.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.193+0000 7f9815002700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f97fc066f30 0x7f97fc0693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f98100c47a0 tx=0x7f9804008040 comp rx=0 tx=0).stop 2023-10-09T06:32:12.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.193+0000 7f9815002700 1 -- 172.21.15.31:0/675363070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f981006a0e0 msgr2=0x7f981015b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:12.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.193+0000 7f9815002700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f981006a0e0 0x7f981015b9e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f980000cd30 tx=0x7f9800001b10 comp rx=0 tx=0).stop 2023-10-09T06:32:12.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.193+0000 7f9815002700 1 -- 172.21.15.31:0/675363070 shutdown_connections 2023-10-09T06:32:12.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.193+0000 7f9815002700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f97fc066f30 0x7f97fc0693e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.193+0000 7f9815002700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f98101569a0 0x7f98100c0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.193+0000 7f9815002700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f981006a0e0 0x7f981015b9e0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.193+0000 7f9815002700 1 --2- 172.21.15.31:0/675363070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f981006e0b0 0x7f98100c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.193+0000 7f9815002700 1 -- 172.21.15.31:0/675363070 >> 172.21.15.31:0/675363070 conn(0x7f98100cd8d0 msgr2=0x7f9810155da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:12.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.193+0000 7f9815002700 1 -- 172.21.15.31:0/675363070 shutdown_connections 2023-10-09T06:32:12.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.193+0000 7f9815002700 1 -- 172.21.15.31:0/675363070 wait complete. 2023-10-09T06:32:12.293 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:32:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.411+0000 7fbbbdde3700 1 Processor -- start 2023-10-09T06:32:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.411+0000 7fbbbdde3700 1 -- start start 2023-10-09T06:32:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbbdde3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbbb80cfe20 0x7fbbb80ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbbdde3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb80c5d80 con 0x7fbbb80d1c30 2023-10-09T06:32:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbbdde3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb80c6060 con 0x7fbbb815a2b0 2023-10-09T06:32:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbbdde3700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb8068470 con 0x7fbbb80cfe20 2023-10-09T06:32:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbb6ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbbb80d1c30 0x7fbbb80cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37716/0 (socket says 172.21.15.31:37716) 2023-10-09T06:32:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbb6ffd700 1 -- 172.21.15.31:0/1448726655 learned_addr learned my addr 172.21.15.31:0/1448726655 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbb7fff700 1 --2- 172.21.15.31:0/1448726655 >> v2:172.21.15.158:3300/0 conn(0x7fbbb80cfe20 0x7fbbb80ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815822021 0 0) 0x7fbbb80c5d80 con 0x7fbbb80d1c30 2023-10-09T06:32:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba0003570 con 0x7fbbb80d1c30 2023-10-09T06:32:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387108963 0 0) 0x7fbbb80c6060 con 0x7fbbb815a2b0 2023-10-09T06:32:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb80c5d80 con 0x7fbbb815a2b0 2023-10-09T06:32:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2077447279 0 0) 0x7fbba0003570 con 0x7fbbb80d1c30 2023-10-09T06:32:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 >> v2:172.21.15.158:3300/0 conn(0x7fbbb80cfe20 msgr2=0x7fbbb80ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbb67fc700 1 --2- 172.21.15.31:0/1448726655 >> v2:172.21.15.158:3300/0 conn(0x7fbbb80cfe20 0x7fbbb80ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 >> v1:172.21.15.158:6789/0 conn(0x7fbbb815a2b0 legacy=0x7fbbb80b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb80c6340 con 0x7fbbb80d1c30 2023-10-09T06:32:12.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.412+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fbbac001470 con 0x7fbbb80d1c30 2023-10-09T06:32:12.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb7fff700 1 --2- 172.21.15.31:0/1448726655 >> v2:172.21.15.158:3300/0 conn(0x7fbbb80cfe20 0x7fbbb80ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:32:12.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 >> v1:172.21.15.31:6789/0 conn(0x7fbbb80d1c30 legacy=0x7fbbb80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:12.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb67fc700 1 --2- 172.21.15.31:0/1448726655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbba0003c40 0x7fbba0004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:12.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb67fc700 1 --2- 172.21.15.31:0/1448726655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbba0004810 0x7fbba0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:12.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb67fc700 1 --2- 172.21.15.31:0/1448726655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba0005210 0x7fbba000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:12.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8068470 con 0x7fbba0005210 2023-10-09T06:32:12.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba000c130 con 0x7fbba0004810 2023-10-09T06:32:12.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba000c2c0 con 0x7fbba0003c40 2023-10-09T06:32:12.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb7fff700 1 --2- 172.21.15.31:0/1448726655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba0005210 0x7fbba000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:12.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb6ffd700 1 --2- 172.21.15.31:0/1448726655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbba0004810 0x7fbba0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:12.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb77fe700 1 --2- 172.21.15.31:0/1448726655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbba0003c40 0x7fbba0004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:12.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb7fff700 1 -- 172.21.15.31:0/1448726655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbba0003c40 msgr2=0x7fbba0004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:12.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb7fff700 1 --2- 172.21.15.31:0/1448726655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbba0003c40 0x7fbba0004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb7fff700 1 -- 172.21.15.31:0/1448726655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbba0004810 msgr2=0x7fbba0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:12.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb7fff700 1 --2- 172.21.15.31:0/1448726655 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbba0004810 0x7fbba0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb7fff700 1 -- 172.21.15.31:0/1448726655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba0003570 con 0x7fbba0005210 2023-10-09T06:32:12.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb77fe700 1 --2- 172.21.15.31:0/1448726655 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbba0003c40 0x7fbba0004030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:12.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb7fff700 1 -- 172.21.15.31:0/1448726655 reap_dead start 2023-10-09T06:32:12.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb7fff700 1 --2- 172.21.15.31:0/1448726655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba0005210 0x7fbba000ba60 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000e3c0 tx=0x7fbbb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18078339ca52f711 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:12.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0009c50 con 0x7fbba0005210 2023-10-09T06:32:12.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb000f040 con 0x7fbba0005210 2023-10-09T06:32:12.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.413+0000 7fbbb67fc700 1 -- 172.21.15.31:0/1448726655 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb000eec0 con 0x7fbba0005210 2023-10-09T06:32:12.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.414+0000 7fbbbdde3700 1 -- 172.21.15.31:0/1448726655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba0005210 msgr2=0x7fbba000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:12.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.414+0000 7fbbbdde3700 1 --2- 172.21.15.31:0/1448726655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba0005210 0x7fbba000ba60 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000e3c0 tx=0x7fbbb000b040 comp rx=0 tx=0).stop 2023-10-09T06:32:12.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.414+0000 7fbbbdde3700 1 -- 172.21.15.31:0/1448726655 shutdown_connections 2023-10-09T06:32:12.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.414+0000 7fbbbdde3700 1 --2- 172.21.15.31:0/1448726655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba0005210 0x7fbba000ba60 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.414+0000 7fbbbdde3700 1 -- 172.21.15.31:0/1448726655 >> 172.21.15.31:0/1448726655 conn(0x7fbbb8067e40 msgr2=0x7fbbb80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:12.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.414+0000 7fbbbdde3700 1 -- 172.21.15.31:0/1448726655 shutdown_connections 2023-10-09T06:32:12.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.414+0000 7fbbbdde3700 1 -- 172.21.15.31:0/1448726655 wait complete. 2023-10-09T06:32:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.415+0000 7fbbbdde3700 1 Processor -- start 2023-10-09T06:32:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.415+0000 7fbbbdde3700 1 -- start start 2023-10-09T06:32:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbbdde3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbba0005210 0x7fbbb81555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbbdde3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbb80cda30 0x7fbbb80cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbbdde3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbb815b040 0x7fbbb815b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbbdde3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb815c4f0 con 0x7fbbb815b040 2023-10-09T06:32:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbbdde3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80ce3e0 con 0x7fbba0005210 2023-10-09T06:32:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbbdde3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb815ba20 con 0x7fbbb80cda30 2023-10-09T06:32:12.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbb7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbb815b040 0x7fbbb815b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:12.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbb7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbb815b040 0x7fbbb815b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37800/0 (socket says 172.21.15.31:37800) 2023-10-09T06:32:12.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbb7fff700 1 -- 172.21.15.31:0/2985379834 learned_addr learned my addr 172.21.15.31:0/2985379834 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:12.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbb6ffd700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbb80cda30 0x7fbbb80cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:12.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbb77fe700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbba0005210 0x7fbbb81555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:12.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbb7fff700 1 -- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbb80cda30 msgr2=0x7fbbb80cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:12.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbb7fff700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbb80cda30 0x7fbbb80cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbb7fff700 1 -- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbba0005210 msgr2=0x7fbbb81555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:12.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbb7fff700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbba0005210 0x7fbbb81555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbb7fff700 1 -- 172.21.15.31:0/2985379834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb8155b30 con 0x7fbbb815b040 2023-10-09T06:32:12.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbbb7fff700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbb815b040 0x7fbbb815b4e0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000e9b0 tx=0x7fbbb001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:12.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.416+0000 7fbb9f7fe700 1 -- 172.21.15.31:0/2985379834 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb001d630 con 0x7fbbb815b040 2023-10-09T06:32:12.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.417+0000 7fbb9f7fe700 1 -- 172.21.15.31:0/2985379834 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb001d790 con 0x7fbbb815b040 2023-10-09T06:32:12.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.417+0000 7fbbbdde3700 1 -- 172.21.15.31:0/2985379834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb8155ff0 con 0x7fbbb815b040 2023-10-09T06:32:12.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.417+0000 7fbb9f7fe700 1 -- 172.21.15.31:0/2985379834 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb001db50 con 0x7fbbb815b040 2023-10-09T06:32:12.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.417+0000 7fbbbdde3700 1 -- 172.21.15.31:0/2985379834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb815bf30 con 0x7fbbb815b040 2023-10-09T06:32:12.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.417+0000 7fbbbdde3700 1 -- 172.21.15.31:0/2985379834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb804c3c0 con 0x7fbbb815b040 2023-10-09T06:32:12.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.418+0000 7fbb9f7fe700 1 -- 172.21.15.31:0/2985379834 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbb0003020 con 0x7fbbb815b040 2023-10-09T06:32:12.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.418+0000 7fbb9f7fe700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbba4066f30 0x7fbba40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:12.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.418+0000 7fbb9f7fe700 1 -- 172.21.15.31:0/2985379834 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbb0085ec0 con 0x7fbbb815b040 2023-10-09T06:32:12.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.419+0000 7fbbb77fe700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbba4066f30 0x7fbba40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:12.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.419+0000 7fbb9f7fe700 1 -- 172.21.15.31:0/2985379834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7fbba406ea50 con 0x7fbbb815b040 2023-10-09T06:32:12.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.419+0000 7fbbb77fe700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbba4066f30 0x7fbba40693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbba8007fd0 tx=0x7fbba8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:12.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.423+0000 7fbb9f7fe700 1 -- 172.21.15.31:0/2985379834 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbb00531e0 con 0x7fbbb815b040 2023-10-09T06:32:12.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.659+0000 7fbbbdde3700 1 -- 172.21.15.31:0/2985379834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbb815a090 con 0x7fbbb815b040 2023-10-09T06:32:12.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.660+0000 7fbb9f7fe700 1 -- 172.21.15.31:0/2985379834 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fbbb0056800 con 0x7fbbb815b040 2023-10-09T06:32:12.660 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:12.660 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/3503727793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3503727793},{"type":"v1","addr":"172.21.15.158:6837","nonce":3503727793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2366061673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2366061673},{"type":"v1","addr":"172.21.15.158:6836","nonce":2366061673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3405107978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3405107978},{"type":"v1","addr":"172.21.15.31:6834","nonce":3405107978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:31:50.242464+0000","modified":"2023-10-09T06:31:53.876299+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8079":{"gid":8079,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4124393323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4124393323},{"type":"v1","addr":"172.21.15.31:6835","nonce":4124393323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T06:32:12.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.662+0000 7fbbbdde3700 1 -- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbba4066f30 msgr2=0x7fbba40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.662+0000 7fbbbdde3700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbba4066f30 0x7fbba40693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbba8007fd0 tx=0x7fbba8009040 comp rx=0 tx=0).stop 2023-10-09T06:32:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.662+0000 7fbbbdde3700 1 -- 172.21.15.31:0/2985379834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbb815b040 msgr2=0x7fbbb815b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.662+0000 7fbbbdde3700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbb815b040 0x7fbbb815b4e0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000e9b0 tx=0x7fbbb001a000 comp rx=0 tx=0).stop 2023-10-09T06:32:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.662+0000 7fbbbdde3700 1 -- 172.21.15.31:0/2985379834 shutdown_connections 2023-10-09T06:32:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.662+0000 7fbbbdde3700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbba4066f30 0x7fbba40693e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.662+0000 7fbbbdde3700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbb815b040 0x7fbbb815b4e0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.662+0000 7fbbbdde3700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbba0005210 0x7fbbb81555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.662+0000 7fbbbdde3700 1 --2- 172.21.15.31:0/2985379834 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbb80cda30 0x7fbbb80cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.662+0000 7fbbbdde3700 1 -- 172.21.15.31:0/2985379834 >> 172.21.15.31:0/2985379834 conn(0x7fbbb8067e40 msgr2=0x7fbbb806a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.662+0000 7fbbbdde3700 1 -- 172.21.15.31:0/2985379834 shutdown_connections 2023-10-09T06:32:12.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:12.662+0000 7fbbbdde3700 1 -- 172.21.15.31:0/2985379834 wait complete. 2023-10-09T06:32:12.664 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 89 2023-10-09T06:32:12.674 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-09T06:32:12.811 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":8079,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":21.931568556999999,"mdsmap_epoch":89,"osdmap_epoch":187,"osdmap_epoch_barrier":187,"uptime":27.025590045000001} 2023-10-09T06:32:12.812 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 8079, "mdsmap_epoch": 89, "osdmap_epoch": 187, "osdmap_epoch_barrier": 187, "rank_uptime": 21.931568557, "state": "up:active", "uptime": 27.025590045, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:32:12.812 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T06:32:12.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:32:12.812 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-09T06:32:12.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:32:12.830 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-09T06:32:12.892 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:32:13.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.050+0000 7fd071b4b700 1 Processor -- start 2023-10-09T06:32:13.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.050+0000 7fd071b4b700 1 -- start start 2023-10-09T06:32:13.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.051+0000 7fd071b4b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd06c15a2b0 0x7fd06c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:13.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.051+0000 7fd071b4b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06c0c5d80 con 0x7fd06c0cfe20 2023-10-09T06:32:13.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.051+0000 7fd071b4b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06c0c6060 con 0x7fd06c0d1c30 2023-10-09T06:32:13.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.051+0000 7fd071b4b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06c068470 con 0x7fd06c15a2b0 2023-10-09T06:32:13.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.051+0000 7fd06b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd06c15a2b0 0x7fd06c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:13.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.051+0000 7fd06bfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd06c0cfe20 0x7fd06c0c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37732/0 (socket says 172.21.15.31:37732) 2023-10-09T06:32:13.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.051+0000 7fd06bfff700 1 -- 172.21.15.31:0/4257714221 learned_addr learned my addr 172.21.15.31:0/4257714221 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.051+0000 7fd06b7fe700 1 -- 172.21.15.31:0/4257714221 >> v1:172.21.15.158:6789/0 conn(0x7fd06c0d1c30 legacy=0x7fd06c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.051+0000 7fd06b7fe700 1 -- 172.21.15.31:0/4257714221 >> v1:172.21.15.31:6789/0 conn(0x7fd06c0cfe20 legacy=0x7fd06c0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.051+0000 7fd06b7fe700 1 -- 172.21.15.31:0/4257714221 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c0c6340 con 0x7fd06c15a2b0 2023-10-09T06:32:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.051+0000 7fd06b7fe700 1 --2- 172.21.15.31:0/4257714221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06c15a2b0 0x7fd06c0b3da0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0098d0 tx=0x7fd05c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29d92c543aa41ff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.051+0000 7fd06a7fc700 1 -- 172.21.15.31:0/4257714221 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c009e70 con 0x7fd06c15a2b0 2023-10-09T06:32:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.051+0000 7fd06a7fc700 1 -- 172.21.15.31:0/4257714221 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c005c10 con 0x7fd06c15a2b0 2023-10-09T06:32:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.052+0000 7fd06a7fc700 1 -- 172.21.15.31:0/4257714221 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00b650 con 0x7fd06c15a2b0 2023-10-09T06:32:13.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.052+0000 7fd071b4b700 1 -- 172.21.15.31:0/4257714221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06c15a2b0 msgr2=0x7fd06c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:13.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.052+0000 7fd071b4b700 1 --2- 172.21.15.31:0/4257714221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06c15a2b0 0x7fd06c0b3da0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0098d0 tx=0x7fd05c009120 comp rx=0 tx=0).stop 2023-10-09T06:32:13.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.052+0000 7fd071b4b700 1 -- 172.21.15.31:0/4257714221 shutdown_connections 2023-10-09T06:32:13.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.052+0000 7fd071b4b700 1 --2- 172.21.15.31:0/4257714221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06c15a2b0 0x7fd06c0b3da0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:13.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.052+0000 7fd071b4b700 1 -- 172.21.15.31:0/4257714221 >> 172.21.15.31:0/4257714221 conn(0x7fd06c067e40 msgr2=0x7fd06c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:13.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.052+0000 7fd071b4b700 1 -- 172.21.15.31:0/4257714221 shutdown_connections 2023-10-09T06:32:13.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.052+0000 7fd071b4b700 1 -- 172.21.15.31:0/4257714221 wait complete. 2023-10-09T06:32:13.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.053+0000 7fd071b4b700 1 Processor -- start 2023-10-09T06:32:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.053+0000 7fd071b4b700 1 -- start start 2023-10-09T06:32:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd071b4b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd06c0cfe20 0x7fd06c16ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd071b4b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06c0d1c30 0x7fd06c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd071b4b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd06c15abc0 0x7fd06c15d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd071b4b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c155630 con 0x7fd06c0d1c30 2023-10-09T06:32:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd071b4b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c15cd90 con 0x7fd06c15abc0 2023-10-09T06:32:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd071b4b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c16b240 con 0x7fd06c0cfe20 2023-10-09T06:32:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd06affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06c0d1c30 0x7fd06c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd06affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06c0d1c30 0x7fd06c15a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37818/0 (socket says 172.21.15.31:37818) 2023-10-09T06:32:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd06affd700 1 -- 172.21.15.31:0/3186527840 learned_addr learned my addr 172.21.15.31:0/3186527840 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd06bfff700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd06c15abc0 0x7fd06c15d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd06b7fe700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd06c0cfe20 0x7fd06c16ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:13.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd06affd700 1 -- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd06c0cfe20 msgr2=0x7fd06c16ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:13.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd06affd700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd06c0cfe20 0x7fd06c16ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:13.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd06affd700 1 -- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd06c15abc0 msgr2=0x7fd06c15d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:13.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.054+0000 7fd06affd700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd06c15abc0 0x7fd06c15d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:13.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.055+0000 7fd06affd700 1 -- 172.21.15.31:0/3186527840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c0093c0 con 0x7fd06c0d1c30 2023-10-09T06:32:13.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.055+0000 7fd06b7fe700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd06c0cfe20 0x7fd06c16ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:13.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.055+0000 7fd06affd700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06c0d1c30 0x7fd06c15a680 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fd06000c590 tx=0x7fd060007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:13.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.055+0000 7fd0537fe700 1 -- 172.21.15.31:0/3186527840 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060011590 con 0x7fd06c0d1c30 2023-10-09T06:32:13.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.055+0000 7fd0537fe700 1 -- 172.21.15.31:0/3186527840 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd060011710 con 0x7fd06c0d1c30 2023-10-09T06:32:13.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.055+0000 7fd071b4b700 1 -- 172.21.15.31:0/3186527840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06c15b060 con 0x7fd06c0d1c30 2023-10-09T06:32:13.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.055+0000 7fd0537fe700 1 -- 172.21.15.31:0/3186527840 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060011ad0 con 0x7fd06c0d1c30 2023-10-09T06:32:13.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.055+0000 7fd071b4b700 1 -- 172.21.15.31:0/3186527840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06c15b620 con 0x7fd06c0d1c30 2023-10-09T06:32:13.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.056+0000 7fd071b4b700 1 -- 172.21.15.31:0/3186527840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06c15d240 con 0x7fd06c0d1c30 2023-10-09T06:32:13.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.056+0000 7fd0537fe700 1 -- 172.21.15.31:0/3186527840 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd06001b3b0 con 0x7fd06c0d1c30 2023-10-09T06:32:13.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.057+0000 7fd0537fe700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd058066f30 0x7fd0580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:13.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.057+0000 7fd0537fe700 1 -- 172.21.15.31:0/3186527840 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd0600838b0 con 0x7fd06c0d1c30 2023-10-09T06:32:13.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.057+0000 7fd0537fe700 1 -- 172.21.15.31:0/3186527840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7fd05806ea50 con 0x7fd06c0d1c30 2023-10-09T06:32:13.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.057+0000 7fd06b7fe700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd058066f30 0x7fd0580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:13.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.058+0000 7fd06b7fe700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd058066f30 0x7fd0580693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd06c071280 tx=0x7fd05c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:13.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.061+0000 7fd0537fe700 1 -- 172.21.15.31:0/3186527840 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd060017070 con 0x7fd06c0d1c30 2023-10-09T06:32:13.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.256+0000 7fd071b4b700 1 -- 172.21.15.31:0/3186527840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd06c04c3c0 con 0x7fd06c0d1c30 2023-10-09T06:32:13.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.256+0000 7fd0537fe700 1 -- 172.21.15.31:0/3186527840 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) v1 ==== 81+0+32301 (secure 0 0 0) 0x7fd06c15d240 con 0x7fd06c0d1c30 2023-10-09T06:32:13.257 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:13.258 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:13.258 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 187, 2023-10-09T06:32:13.258 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:32:13.258 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:32:13.258 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:32:06.802905+0000", 2023-10-09T06:32:13.258 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:32:13.258 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:32:13.258 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:32:13.258 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:32:13.258 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:32:13.259 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:32:13.259 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:32:13.259 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:32:13.259 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:32:13.259 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:13.259 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:32:13.259 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:32:13.259 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:32:13.259 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:32:13.259 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:32:13.260 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 23, 2023-10-09T06:32:13.260 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:32:13.260 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:32:13.260 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:32:13.260 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:32:13.260 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:32:13.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.260 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:32:13.260 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:32:13.260 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:32:13.261 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:13.261 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:13.261 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:13.261 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:13.261 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:13.261 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:13.261 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:13.261 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:13.261 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:13.261 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:13.261 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:13.261 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:13.262 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:32:13.262 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:32:13.262 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:32:13.262 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:32:13.262 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:32:13.262 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:13.262 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:13.262 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:13.262 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:13.262 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:13.262 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:13.263 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:13.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.263 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:32:13.263 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:13.263 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:13.263 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:13.263 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:13.263 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:13.263 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:13.263 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:13.263 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:13.263 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:13.264 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:13.264 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:13.264 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:13.264 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:13.264 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:13.264 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:13.264 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:13.264 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:13.264 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:13.264 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:13.264 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:13.264 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:13.265 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:13.265 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:13.265 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:13.265 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:13.265 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:13.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.265 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:13.265 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:13.265 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:13.265 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:13.265 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:13.265 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:13.266 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:13.266 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:13.266 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:13.266 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:13.266 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:13.266 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:13.266 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:32:13.266 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:32:13.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.267 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:13.267 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:32:13.267 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.267 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 22, 2023-10-09T06:32:13.268 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:32:13.268 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:48.664093+0000", 2023-10-09T06:32:13.268 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:13.268 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:13.268 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:13.268 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:13.269 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:13.269 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:13.269 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:13.269 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:13.269 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:13.269 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:13.270 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:13.270 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:13.270 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:32:13.270 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:32:13.270 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:32:13.270 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:32:13.271 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:32:13.271 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:13.271 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:13.271 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:13.271 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:13.271 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:13.272 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:13.272 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:13.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.272 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "184", 2023-10-09T06:32:13.272 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:13.272 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:13.272 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:13.273 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:13.273 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:13.273 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:13.273 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:13.273 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:13.273 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:13.274 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:13.274 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:13.274 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:13.274 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:13.274 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:13.275 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:13.275 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:13.275 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:13.275 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:13.275 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:13.275 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:13.276 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:13.276 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:13.276 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:13.276 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:13.276 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:13.276 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:13.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.276 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:13.276 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:13.276 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:13.277 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:13.277 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:13.277 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:13.277 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:13.277 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:13.277 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:13.277 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:13.277 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:13.277 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:13.277 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:32:13.277 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:32:13.278 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:32:13.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.278 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:13.278 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:13.278 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:32:13.278 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.278 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.278 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 23, 2023-10-09T06:32:13.278 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:32:13.279 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:49.212701+0000", 2023-10-09T06:32:13.279 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1027, 2023-10-09T06:32:13.279 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T06:32:13.279 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:13.279 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:13.279 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:13.279 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:13.279 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:13.279 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:13.280 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:13.280 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:13.280 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:13.280 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:13.280 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:32:13.280 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:32:13.280 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:32:13.280 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:32:13.280 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:32:13.280 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:13.280 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:13.281 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:13.281 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:13.281 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:13.281 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:13.281 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:13.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.281 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "187", 2023-10-09T06:32:13.281 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:13.281 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:13.281 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:13.281 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:13.281 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:13.282 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:13.282 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:13.282 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:13.282 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:13.282 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:32:13.282 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:13.282 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:13.282 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:13.282 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:13.282 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:13.282 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:13.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:13.284 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:32:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:32:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:32:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:32:13.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:13.286 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:32:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:32:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.287 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.288 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:13.288 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.288 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.291 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:32:13.291 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:13.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.292 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.292 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:32:13.292 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:13.292 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.292 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.292 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:13.292 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.292 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.293 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:32:13.293 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:13.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.293 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.293 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:32:13.293 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:13.293 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.293 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.293 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:13.294 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.294 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.294 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:32:13.294 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:13.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.294 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.294 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:32:13.294 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:13.295 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.295 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.295 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:32:13.295 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:32:13.295 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:32:13.295 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:32:13.295 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:13.295 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:13.295 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:13.295 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.296 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:13.296 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:13.296 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:13.296 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:13.296 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:13.296 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:13.296 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:13.296 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:13.296 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:13.296 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:13.297 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:13.297 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:13.297 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:13.297 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.297 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.297 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:32:13.297 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:13.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.297 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.297 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:32:13.298 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:13.298 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.298 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.298 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:13.298 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.298 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.298 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:32:13.298 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:13.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.299 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.299 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:32:13.299 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:13.299 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.299 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.299 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:13.299 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.299 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.299 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:32:13.300 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:13.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.300 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.300 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:32:13.300 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:13.300 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.300 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.300 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:13.300 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.301 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.301 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:32:13.301 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:13.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.301 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.301 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:32:13.301 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:13.301 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.301 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.301 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:32:13.302 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:32:13.302 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:32:13.302 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:32:13.302 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:13.302 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:13.302 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:13.302 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.303 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:13.303 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:13.303 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:13.303 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:13.303 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:13.303 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:13.303 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:13.303 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:13.303 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:13.303 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:13.304 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:13.304 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:13.304 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:13.304 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.304 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.304 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:32:13.304 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:13.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.304 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.305 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:32:13.305 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:13.305 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.305 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.305 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:13.305 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.305 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.305 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:32:13.305 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:13.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.306 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.306 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:32:13.306 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:13.306 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.306 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.306 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:13.306 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.307 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.307 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:32:13.307 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:13.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.307 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.307 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:32:13.307 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:13.307 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.307 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.308 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:13.308 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.308 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.308 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:32:13.308 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:13.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.308 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.308 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:32:13.308 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:13.309 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.309 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.309 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:32:13.309 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:32:13.309 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:32:13.309 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:32:13.309 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:13.309 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:13.310 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:13.310 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.310 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:13.310 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:13.310 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:13.310 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:13.310 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:13.310 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:13.310 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:13.311 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:13.311 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:13.311 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:13.311 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:13.311 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:13.311 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:13.311 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.311 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.311 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:32:13.311 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:13.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.312 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.312 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:32:13.312 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:13.312 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.312 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.312 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:13.312 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.312 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.313 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:32:13.313 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:13.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.313 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.313 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:32:13.313 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:13.313 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.313 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.313 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:13.313 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.314 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.314 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:32:13.314 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:13.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.314 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.314 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:32:13.314 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:13.314 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.315 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.315 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:13.315 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.316 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.316 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:32:13.316 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:13.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.316 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.316 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:32:13.316 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:13.316 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.316 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.317 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:32:13.317 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:32:13.317 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:32:13.317 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:32:13.317 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:13.317 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:13.317 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:13.317 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.318 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:13.318 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:13.318 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:13.318 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:13.318 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:13.318 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:13.318 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:13.318 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:13.318 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:13.318 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:13.318 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:13.319 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:13.319 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:13.319 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.319 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.319 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:32:13.320 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:13.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.320 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.320 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:32:13.320 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:13.320 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.321 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.321 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:13.321 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.321 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.322 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:32:13.322 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:13.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.322 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.322 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:32:13.323 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:13.323 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.323 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.323 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:13.323 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.324 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.324 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:32:13.324 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:13.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.325 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.325 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:32:13.325 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:13.325 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.325 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.326 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:13.326 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.326 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.326 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:32:13.327 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:13.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.327 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.327 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:32:13.327 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:13.328 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.328 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.328 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:32:13.328 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:32:13.329 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:32:13.329 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:32:13.329 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:13.329 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:13.329 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:13.329 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.330 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:13.330 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:13.330 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:13.330 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:13.330 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:13.331 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:13.331 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:13.331 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:13.331 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:13.331 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:13.332 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:13.332 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:13.332 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:13.332 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.332 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.333 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:32:13.333 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:13.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.333 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.333 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:32:13.334 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:13.334 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.334 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.334 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:13.335 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.335 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.335 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:32:13.335 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:13.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.336 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.336 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:32:13.336 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:13.336 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.336 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.337 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:13.337 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.337 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.337 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:32:13.338 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:13.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.338 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.338 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:32:13.339 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:13.339 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.339 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.339 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:13.339 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.340 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.340 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:32:13.340 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:13.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.341 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.341 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:32:13.341 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:13.341 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.341 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.342 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:32:13.342 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:32:13.342 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:32:13.342 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:32:13.342 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:13.343 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:13.343 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:13.343 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.344 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:13.344 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:13.344 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:13.344 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:13.344 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:13.344 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:13.345 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:13.345 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:13.345 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:13.345 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:13.345 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:13.345 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:13.346 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:13.346 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.346 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.346 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:32:13.347 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:13.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.347 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.347 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:32:13.348 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:13.348 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.348 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.348 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:13.348 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.349 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.349 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:32:13.349 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:13.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.350 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.350 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:32:13.350 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:13.350 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.350 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.350 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:13.350 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.351 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.351 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:32:13.351 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:13.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.351 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.351 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:32:13.351 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:13.351 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.352 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.352 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:13.352 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.352 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.352 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:32:13.353 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:13.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.353 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.353 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:32:13.353 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:13.353 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.354 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.354 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:32:13.354 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:32:13.354 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:32:13.355 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:32:13.355 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:13.355 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:13.355 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:13.355 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.356 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:13.356 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:13.356 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:13.356 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:13.357 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:13.357 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:13.357 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:13.357 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:13.357 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:13.357 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:13.358 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:13.358 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:13.358 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:13.358 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.358 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.359 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:32:13.359 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:13.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.359 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.359 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:32:13.360 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:13.360 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.360 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.360 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:13.361 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.361 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.361 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:32:13.361 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:13.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.361 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.361 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:32:13.361 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:13.361 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.362 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.362 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:13.362 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.362 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.362 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:32:13.362 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:13.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.362 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.363 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:32:13.363 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:13.363 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.363 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.363 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:13.363 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:13.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.363 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:13.363 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:32:13.363 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:13.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.364 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:13.364 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:32:13.364 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:13.364 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.364 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.365 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:32:13.365 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:32:13.365 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:32:13.365 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:32:13.365 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:13.365 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:13.366 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:13.366 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:13.366 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.366 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:13.366 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:32:13.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.367 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:13.367 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:13.367 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:13.367 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:13.367 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:13.367 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:13.368 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:32:13.368 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:13.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.368 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:13.368 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:13.369 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:13.369 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:13.369 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:13.369 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:13.369 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:32:13.369 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:13.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.370 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:13.370 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:13.370 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:13.370 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:13.371 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:13.371 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:13.371 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:32:13.371 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:13.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.371 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:13.371 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:13.372 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:13.372 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:13.372 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:13.372 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:13.372 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:32:13.372 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:13.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.372 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:13.372 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:13.372 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:13.372 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:13.373 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:13.373 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:13.373 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:32:13.373 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:13.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.373 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:13.373 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:13.373 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:13.373 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:13.373 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:13.374 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:13.374 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:32:13.374 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:13.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.374 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:13.375 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:13.375 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:13.376 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:13.376 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:13.376 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:13.376 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:32:13.376 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:13.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:13.376 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:13.376 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:13.376 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:13.376 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:13.377 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:13.377 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:13.377 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:32:13.377 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:13.377 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.377 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:13.377 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:32:13.377 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:32:13.378 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:32:13.378 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:32:13.378 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:32:13.378 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:32:13.378 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:32:13.378 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:32:13.378 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:32:13.378 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:32:13.378 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:32:13.378 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:32:13.379 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:32:13.379 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:13.379 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:32:13.379 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:32:13.379 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:32:13.379 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:32:13.379 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:32:13.379 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:32:13.379 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:32:13.380 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:32:13.380 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:32:13.380 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:32:13.380 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:32:13.380 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:13.380 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:13.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.259+0000 7fd071b4b700 1 -- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd058066f30 msgr2=0x7fd0580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:13.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.259+0000 7fd071b4b700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd058066f30 0x7fd0580693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd06c071280 tx=0x7fd05c016000 comp rx=0 tx=0).stop 2023-10-09T06:32:13.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.259+0000 7fd071b4b700 1 -- 172.21.15.31:0/3186527840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06c0d1c30 msgr2=0x7fd06c15a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:13.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.259+0000 7fd071b4b700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06c0d1c30 0x7fd06c15a680 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fd06000c590 tx=0x7fd060007f50 comp rx=0 tx=0).stop 2023-10-09T06:32:13.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.259+0000 7fd071b4b700 1 -- 172.21.15.31:0/3186527840 shutdown_connections 2023-10-09T06:32:13.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.259+0000 7fd071b4b700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd058066f30 0x7fd0580693e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:13.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.259+0000 7fd071b4b700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd06c0cfe20 0x7fd06c16ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:13.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.259+0000 7fd071b4b700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd06c15abc0 0x7fd06c15d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:13.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.259+0000 7fd071b4b700 1 --2- 172.21.15.31:0/3186527840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06c0d1c30 0x7fd06c15a680 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:13.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.259+0000 7fd071b4b700 1 -- 172.21.15.31:0/3186527840 >> 172.21.15.31:0/3186527840 conn(0x7fd06c067e40 msgr2=0x7fd06c0c7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:13.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.259+0000 7fd071b4b700 1 -- 172.21.15.31:0/3186527840 shutdown_connections 2023-10-09T06:32:13.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:13.259+0000 7fd071b4b700 1 -- 172.21.15.31:0/3186527840 wait complete. 2023-10-09T06:32:13.383 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:32:18.384 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:32:18.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.515+0000 7f0aeea68700 1 Processor -- start 2023-10-09T06:32:18.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.515+0000 7f0aeea68700 1 -- start start 2023-10-09T06:32:18.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.515+0000 7f0aeea68700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ae80abae0 0x7f0ae80c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:18.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.515+0000 7f0aeea68700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0ae80abeb0 0x7f0ae80c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:18.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.515+0000 7f0aeea68700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae80c9cb0 con 0x7f0ae80c8400 2023-10-09T06:32:18.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.515+0000 7f0aeea68700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae80c90a0 con 0x7f0ae80abae0 2023-10-09T06:32:18.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.515+0000 7f0aeea68700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae80c9380 con 0x7f0ae80abeb0 2023-10-09T06:32:18.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.516+0000 7f0aed005700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0ae80c8400 0x7f0ae80c8840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37736/0 (socket says 172.21.15.31:37736) 2023-10-09T06:32:18.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.516+0000 7f0aed005700 1 -- 172.21.15.31:0/356074912 learned_addr learned my addr 172.21.15.31:0/356074912 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:18.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.516+0000 7f0aec804700 1 --2- 172.21.15.31:0/356074912 >> v2:172.21.15.31:3300/0 conn(0x7f0ae80abae0 0x7f0ae80c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:18.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.516+0000 7f0ae7fff700 1 --2- 172.21.15.31:0/356074912 >> v2:172.21.15.158:3300/0 conn(0x7f0ae80abeb0 0x7f0ae80c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:18.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.516+0000 7f0ae77fe700 1 -- 172.21.15.31:0/356074912 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249216302 0 0) 0x7f0ae80c9cb0 con 0x7f0ae80c8400 2023-10-09T06:32:18.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.516+0000 7f0ae77fe700 1 -- 172.21.15.31:0/356074912 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad4003570 con 0x7f0ae80c8400 2023-10-09T06:32:18.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.516+0000 7f0aec804700 1 -- 172.21.15.31:0/356074912 >> v2:172.21.15.158:3300/0 conn(0x7f0ae80abeb0 msgr2=0x7f0ae80c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:18.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.516+0000 7f0aec804700 1 --2- 172.21.15.31:0/356074912 >> v2:172.21.15.158:3300/0 conn(0x7f0ae80abeb0 0x7f0ae80c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:18.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.516+0000 7f0aec804700 1 -- 172.21.15.31:0/356074912 >> v1:172.21.15.31:6789/0 conn(0x7f0ae80c8400 legacy=0x7f0ae80c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:18.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.516+0000 7f0aec804700 1 -- 172.21.15.31:0/356074912 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80c9660 con 0x7f0ae80abae0 2023-10-09T06:32:18.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.516+0000 7f0aec804700 1 --2- 172.21.15.31:0/356074912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae80abae0 0x7f0ae80c6eb0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80ca160 tx=0x7f0ad00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f70ee5dc0b0c2d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:18.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.516+0000 7f0ae77fe700 1 -- 172.21.15.31:0/356074912 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0011630 con 0x7f0ae80abae0 2023-10-09T06:32:18.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.517+0000 7f0ae77fe700 1 -- 172.21.15.31:0/356074912 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad0011790 con 0x7f0ae80abae0 2023-10-09T06:32:18.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.517+0000 7f0ae77fe700 1 -- 172.21.15.31:0/356074912 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0011b30 con 0x7f0ae80abae0 2023-10-09T06:32:18.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.517+0000 7f0aeea68700 1 -- 172.21.15.31:0/356074912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae80abae0 msgr2=0x7f0ae80c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:18.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.517+0000 7f0aeea68700 1 --2- 172.21.15.31:0/356074912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae80abae0 0x7f0ae80c6eb0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80ca160 tx=0x7f0ad00091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:18.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.517+0000 7f0aeea68700 1 -- 172.21.15.31:0/356074912 shutdown_connections 2023-10-09T06:32:18.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.517+0000 7f0aeea68700 1 --2- 172.21.15.31:0/356074912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae80abae0 0x7f0ae80c6eb0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:18.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.517+0000 7f0aeea68700 1 --2- 172.21.15.31:0/356074912 >> v2:172.21.15.158:3300/0 conn(0x7f0ae80abeb0 0x7f0ae80c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:18.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.517+0000 7f0aeea68700 1 -- 172.21.15.31:0/356074912 >> 172.21.15.31:0/356074912 conn(0x7f0ae8067660 msgr2=0x7f0ae8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:18.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.517+0000 7f0aeea68700 1 -- 172.21.15.31:0/356074912 shutdown_connections 2023-10-09T06:32:18.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.517+0000 7f0aeea68700 1 -- 172.21.15.31:0/356074912 wait complete. 2023-10-09T06:32:18.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.518+0000 7f0aeea68700 1 Processor -- start 2023-10-09T06:32:18.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.519+0000 7f0aeea68700 1 -- start start 2023-10-09T06:32:18.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.519+0000 7f0aeea68700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ae80abae0 0x7f0ae80ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:18.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.519+0000 7f0aeea68700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ae80abeb0 0x7f0ae80aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:18.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.519+0000 7f0aeea68700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae80c8400 0x7f0ae80aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:18.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.519+0000 7f0aeea68700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae815aa70 con 0x7f0ae80c8400 2023-10-09T06:32:18.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.519+0000 7f0aeea68700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80cb3b0 con 0x7f0ae80abae0 2023-10-09T06:32:18.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.519+0000 7f0aeea68700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80cb690 con 0x7f0ae80abeb0 2023-10-09T06:32:18.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.519+0000 7f0aed005700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae80c8400 0x7f0ae80aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:18.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.519+0000 7f0aed005700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae80c8400 0x7f0ae80aadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37836/0 (socket says 172.21.15.31:37836) 2023-10-09T06:32:18.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.519+0000 7f0aed005700 1 -- 172.21.15.31:0/2257595630 learned_addr learned my addr 172.21.15.31:0/2257595630 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:18.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0ae7fff700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ae80abeb0 0x7f0ae80aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:18.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0aec804700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ae80abae0 0x7f0ae80ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:18.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0aed005700 1 -- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ae80abeb0 msgr2=0x7f0ae80aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:18.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0aed005700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ae80abeb0 0x7f0ae80aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:18.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0aed005700 1 -- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ae80abae0 msgr2=0x7f0ae80ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:18.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0aed005700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ae80abae0 0x7f0ae80ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0aed005700 1 -- 172.21.15.31:0/2257595630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad0009420 con 0x7f0ae80c8400 2023-10-09T06:32:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0ae7fff700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ae80abeb0 0x7f0ae80aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0aed005700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae80c8400 0x7f0ae80aadc0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00010e0 tx=0x7f0ae0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0ae4ff9700 1 -- 172.21.15.31:0/2257595630 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0005c00 con 0x7f0ae80c8400 2023-10-09T06:32:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0ae4ff9700 1 -- 172.21.15.31:0/2257595630 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0005d60 con 0x7f0ae80c8400 2023-10-09T06:32:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0aeea68700 1 -- 172.21.15.31:0/2257595630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae80cb970 con 0x7f0ae80c8400 2023-10-09T06:32:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0ae4ff9700 1 -- 172.21.15.31:0/2257595630 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00072e0 con 0x7f0ae80c8400 2023-10-09T06:32:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.520+0000 7f0aeea68700 1 -- 172.21.15.31:0/2257595630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae80b0950 con 0x7f0ae80c8400 2023-10-09T06:32:18.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.521+0000 7f0aeea68700 1 -- 172.21.15.31:0/2257595630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae815abe0 con 0x7f0ae80c8400 2023-10-09T06:32:18.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.522+0000 7f0ae4ff9700 1 -- 172.21.15.31:0/2257595630 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ae0007690 con 0x7f0ae80c8400 2023-10-09T06:32:18.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.522+0000 7f0ae4ff9700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0ac8066f30 0x7f0ac80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:18.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.522+0000 7f0ae4ff9700 1 -- 172.21.15.31:0/2257595630 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ae0083a20 con 0x7f0ae80c8400 2023-10-09T06:32:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.522+0000 7f0ae4ff9700 1 -- 172.21.15.31:0/2257595630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7f0ac806ea50 con 0x7f0ae80c8400 2023-10-09T06:32:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.522+0000 7f0aec804700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0ac8066f30 0x7f0ac80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.523+0000 7f0aec804700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0ac8066f30 0x7f0ac80693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00093f0 tx=0x7f0ad0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:18.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.526+0000 7f0ae4ff9700 1 -- 172.21.15.31:0/2257595630 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ae0017060 con 0x7f0ae80c8400 2023-10-09T06:32:18.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.723+0000 7f0aeea68700 1 -- 172.21.15.31:0/2257595630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0ae804c3c0 con 0x7f0ae80c8400 2023-10-09T06:32:18.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.724+0000 7f0ae4ff9700 1 -- 172.21.15.31:0/2257595630 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f0ae0050d40 con 0x7f0ae80c8400 2023-10-09T06:32:18.725 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:18.725 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 187, 2023-10-09T06:32:18.725 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:32:18.726 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:32:18.726 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:32:06.802905+0000", 2023-10-09T06:32:18.726 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:32:18.726 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:32:18.726 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:32:18.726 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:32:18.726 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:32:18.726 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:32:18.726 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:32:18.727 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:32:18.727 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:32:18.727 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:18.727 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:32:18.727 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:32:18.727 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:32:18.727 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:32:18.727 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:32:18.727 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 23, 2023-10-09T06:32:18.727 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:32:18.728 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:32:18.728 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:32:18.728 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:32:18.728 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:32:18.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.728 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:32:18.728 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:32:18.728 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:32:18.728 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:18.728 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:18.729 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:18.729 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:18.729 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:18.729 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:18.729 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:18.729 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:18.729 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:18.729 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:18.729 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:18.730 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:18.730 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:32:18.730 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:32:18.730 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:32:18.730 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:32:18.730 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:32:18.730 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:18.730 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:18.730 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:18.730 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:18.731 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:18.731 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:18.731 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:18.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.731 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:32:18.731 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:18.731 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:18.731 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:18.731 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:18.731 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:18.732 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:18.732 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:18.732 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:18.732 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:18.732 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:18.732 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:18.732 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:18.732 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:18.732 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:18.732 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:18.733 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:18.733 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:18.733 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:18.733 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:18.733 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:18.733 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:18.733 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:18.733 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:18.734 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:18.734 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:18.734 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:18.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.734 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:18.734 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:18.734 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:18.734 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:18.734 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:18.735 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:18.735 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:18.735 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:18.735 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:18.735 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:18.735 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:18.735 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:18.735 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:32:18.735 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:32:18.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.736 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:18.736 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:32:18.736 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.736 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 22, 2023-10-09T06:32:18.736 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:32:18.736 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:48.664093+0000", 2023-10-09T06:32:18.736 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:18.737 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:18.737 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:18.737 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:18.737 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:18.737 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:18.737 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:18.737 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:18.737 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:18.737 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:18.737 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:18.738 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:18.738 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:32:18.738 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:32:18.738 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:32:18.738 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:32:18.738 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:32:18.738 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:18.738 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:18.738 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:18.738 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:18.739 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:18.739 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:18.739 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:18.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.739 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "184", 2023-10-09T06:32:18.739 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:18.739 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:18.739 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:18.739 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:18.739 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:18.740 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:18.740 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:18.740 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:18.740 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:18.740 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:18.740 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:18.740 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:18.740 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:18.740 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:18.740 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:18.743 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:18.743 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:18.743 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:18.743 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:18.743 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:18.743 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:32:18.743 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:32:18.743 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:32:18.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.743 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:18.744 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:18.744 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:32:18.744 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.744 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.744 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 23, 2023-10-09T06:32:18.744 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:32:18.744 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:49.212701+0000", 2023-10-09T06:32:18.744 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1027, 2023-10-09T06:32:18.745 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T06:32:18.745 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:18.745 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:18.745 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:18.745 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:18.745 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:18.745 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:18.745 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:18.745 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:18.745 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:18.746 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:18.746 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:32:18.746 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:32:18.746 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:32:18.746 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:32:18.746 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:32:18.746 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:18.746 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:18.746 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:18.746 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:18.747 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:18.747 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:18.747 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:18.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.747 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "187", 2023-10-09T06:32:18.747 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:18.747 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:18.747 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:18.747 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:18.747 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:18.747 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:18.748 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:18.748 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:18.748 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:18.748 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:32:18.748 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:18.748 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:18.748 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:18.748 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:18.748 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:18.749 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:18.749 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:18.749 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:18.749 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:18.749 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:18.749 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:18.749 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:18.749 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:18.749 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:18.749 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:18.750 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:18.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.750 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:18.750 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:18.750 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:18.750 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:18.750 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:18.750 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:18.750 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:18.751 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:18.751 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:18.751 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:18.751 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:18.751 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:18.751 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:32:18.751 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:32:18.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.751 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:18.751 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:18.751 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:32:18.752 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.752 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.752 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.752 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:18.752 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:32:18.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.752 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:18.752 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:18.752 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:18.752 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:18.753 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:18.753 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:18.753 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:18.753 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:18.753 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:18.753 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:18.753 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:18.753 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:18.753 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:18.753 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.754 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.754 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:32:18.754 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:18.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.754 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.754 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:32:18.755 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:18.755 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.755 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.755 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:18.755 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.755 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.756 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:32:18.756 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:18.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.756 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.756 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:32:18.756 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:18.756 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.756 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.757 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:18.757 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.757 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.757 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:32:18.757 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:18.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.758 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.758 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:32:18.758 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:18.758 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.758 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.758 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:18.758 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.759 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.759 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:32:18.759 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:18.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.759 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.759 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:32:18.759 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:18.760 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.760 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.760 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:32:18.760 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:32:18.760 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:32:18.760 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:32:18.760 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:18.760 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:18.760 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:18.761 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.761 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:18.761 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:18.761 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:18.761 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:18.761 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:18.761 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:18.761 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:18.762 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:18.762 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:18.762 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:18.762 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:18.762 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:18.762 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:18.762 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.762 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.763 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:32:18.763 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:18.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.763 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.763 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:32:18.763 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:18.763 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.763 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.764 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:18.764 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.764 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.764 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:32:18.764 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:18.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.764 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.765 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:32:18.765 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:18.765 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.765 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.765 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:18.765 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.765 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.765 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:32:18.766 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:18.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.766 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.766 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:32:18.766 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:18.766 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.766 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.767 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:18.767 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.767 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.767 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:32:18.767 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:18.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.767 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.768 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:32:18.768 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:18.768 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.768 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.768 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:32:18.768 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:32:18.768 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:32:18.768 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:32:18.768 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:18.769 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:18.769 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:18.769 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.769 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:18.769 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:18.769 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:18.769 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:18.770 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:18.770 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:18.770 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:18.770 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:18.770 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:18.770 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:18.770 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:18.770 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:18.770 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:18.770 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.771 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.771 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:32:18.771 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:18.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.771 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.771 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:32:18.771 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:18.772 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.772 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.772 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:18.772 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.772 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.772 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:32:18.772 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:18.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.773 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.773 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:32:18.773 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:18.773 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.773 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.773 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:18.773 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.774 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.774 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:32:18.774 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:18.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.774 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.774 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:32:18.774 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:18.774 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.774 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.775 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:18.775 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.775 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.775 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:32:18.775 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:18.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.775 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.776 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:32:18.776 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:18.776 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.776 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.776 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:32:18.776 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:32:18.776 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:32:18.777 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:32:18.777 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:18.777 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:18.777 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:18.777 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.777 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:18.777 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:18.777 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:18.778 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:18.778 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:18.778 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:18.778 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:18.778 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:18.778 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:18.778 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:18.778 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:18.778 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:18.779 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:18.779 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.779 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.779 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:32:18.779 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:18.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.779 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.779 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:32:18.780 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:18.780 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.780 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.780 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:18.780 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.780 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.780 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:32:18.781 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:18.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.781 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.781 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:32:18.781 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:18.781 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.781 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.781 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:18.782 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.782 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.782 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:32:18.782 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:18.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.782 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.782 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:32:18.783 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:18.783 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.783 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.783 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:18.783 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.783 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.783 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:32:18.783 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:18.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.784 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.784 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:32:18.784 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:18.784 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.784 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.784 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:32:18.785 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:32:18.785 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:32:18.785 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:32:18.785 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:18.785 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:18.785 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:18.785 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.785 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:18.786 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:18.786 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:18.786 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:18.786 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:18.786 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:18.786 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:18.786 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:18.786 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:18.786 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:18.787 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:18.787 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:18.787 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:18.787 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.787 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.787 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:32:18.787 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:18.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.788 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.788 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:32:18.788 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:18.788 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.788 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.788 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:18.788 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.789 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.789 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:32:18.789 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:18.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.789 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.789 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:32:18.789 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:18.789 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.789 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.790 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:18.790 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.790 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.790 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.790 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:32:18.790 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:18.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.790 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.791 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.791 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:32:18.791 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:18.791 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.791 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.791 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:18.791 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.791 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.792 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:32:18.792 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:18.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.792 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.792 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.792 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:32:18.792 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:18.792 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.792 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.793 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:32:18.793 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:32:18.793 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:32:18.793 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:32:18.793 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:18.793 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:18.793 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:18.793 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.794 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.794 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:18.794 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:18.794 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:18.794 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:18.794 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:18.794 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:18.794 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:18.794 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:18.795 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:18.795 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:18.795 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:18.795 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:18.795 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:18.795 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.795 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.795 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:32:18.795 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:18.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.796 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.796 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:32:18.796 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:18.796 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.796 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.796 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:18.797 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.797 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.797 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:32:18.797 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:18.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.797 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.798 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:32:18.798 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:18.798 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.798 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.798 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:18.798 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.799 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.799 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:32:18.799 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:18.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.799 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.799 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:32:18.799 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:18.799 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.800 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.800 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:18.800 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.800 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.800 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:32:18.800 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:18.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.801 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.801 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.801 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:32:18.801 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:18.801 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.801 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.801 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:32:18.801 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:32:18.801 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:32:18.802 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:32:18.802 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:18.802 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:18.802 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:18.802 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.802 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.802 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:18.802 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:18.803 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:18.803 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:18.803 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:18.803 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:18.803 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:18.803 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:18.803 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:18.803 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:18.803 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:18.804 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:18.804 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:18.804 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.804 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.804 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:32:18.804 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:18.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.805 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.805 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:32:18.805 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:18.805 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.805 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.805 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:18.805 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.806 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.806 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:32:18.806 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:18.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.806 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.807 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:32:18.807 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:18.807 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.807 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.807 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:18.807 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.808 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.808 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:32:18.808 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:18.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.808 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.808 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:32:18.808 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:18.808 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.808 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.809 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:18.809 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.809 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.809 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:32:18.809 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:18.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.810 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.810 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:32:18.810 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:18.810 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.810 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.810 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:32:18.810 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:32:18.810 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:32:18.811 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:32:18.811 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:18.811 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:18.811 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:18.811 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.811 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:18.811 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:18.812 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:18.812 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:18.812 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:18.812 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:18.812 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:18.812 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:18.812 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:18.812 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:18.812 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:18.812 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:18.813 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:18.813 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.813 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.813 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:32:18.813 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:18.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.814 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.814 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:32:18.814 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:18.814 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.814 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.814 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:18.814 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.815 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.815 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:32:18.815 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:18.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.815 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.815 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:32:18.815 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:18.815 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.815 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.816 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:18.816 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.816 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.816 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:32:18.816 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:18.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.817 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.817 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:32:18.817 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:18.817 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.817 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.817 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:18.817 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:18.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.817 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:18.818 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:32:18.818 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:18.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.818 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:18.818 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:32:18.818 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:18.818 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.818 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.819 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:32:18.819 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:32:18.819 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:32:18.819 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:32:18.819 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:18.819 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:18.819 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:18.819 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:18.820 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.820 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:18.820 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:32:18.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.821 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:18.821 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:18.821 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:18.821 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:18.821 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:18.821 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:18.821 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:32:18.822 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:18.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.822 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:18.822 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:18.822 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:18.822 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:18.822 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:18.822 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:18.822 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:32:18.823 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:18.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.823 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:18.823 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:18.823 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:18.823 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:18.823 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:18.823 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:18.824 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:32:18.824 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:18.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.824 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:18.824 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:18.824 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:18.824 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:18.824 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:18.824 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:18.825 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:32:18.825 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:18.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.825 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:18.825 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:18.825 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:18.825 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:18.825 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:18.826 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:18.826 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:32:18.826 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:18.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.826 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:18.826 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:18.826 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:18.826 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:18.826 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:18.827 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:18.827 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:32:18.827 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:18.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.827 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:18.827 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:18.827 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:18.827 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:18.828 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:18.828 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:18.828 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:32:18.828 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:18.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:18.828 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:18.828 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:18.828 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:18.828 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:18.829 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:18.829 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:18.829 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:32:18.829 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:18.829 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.829 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:18.829 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:32:18.829 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:32:18.829 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:32:18.829 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:32:18.830 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:32:18.830 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:32:18.830 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:32:18.830 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:32:18.830 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:32:18.830 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:32:18.830 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:32:18.830 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:32:18.830 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:32:18.830 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:18.831 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:32:18.831 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:32:18.831 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:32:18.831 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:32:18.831 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:32:18.831 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:32:18.831 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:32:18.831 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:32:18.831 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:32:18.832 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:32:18.832 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:32:18.832 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:18.832 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:18.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.726+0000 7f0aeea68700 1 -- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0ac8066f30 msgr2=0x7f0ac80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:18.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.726+0000 7f0aeea68700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0ac8066f30 0x7f0ac80693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00093f0 tx=0x7f0ad0017000 comp rx=0 tx=0).stop 2023-10-09T06:32:18.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.726+0000 7f0aeea68700 1 -- 172.21.15.31:0/2257595630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae80c8400 msgr2=0x7f0ae80aadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:18.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.726+0000 7f0aeea68700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae80c8400 0x7f0ae80aadc0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00010e0 tx=0x7f0ae0007dd0 comp rx=0 tx=0).stop 2023-10-09T06:32:18.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.726+0000 7f0aeea68700 1 -- 172.21.15.31:0/2257595630 shutdown_connections 2023-10-09T06:32:18.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.726+0000 7f0aeea68700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0ac8066f30 0x7f0ac80693e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:18.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.726+0000 7f0aeea68700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae80c8400 0x7f0ae80aadc0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:18.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.726+0000 7f0aeea68700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ae80abae0 0x7f0ae80ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:18.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.726+0000 7f0aeea68700 1 --2- 172.21.15.31:0/2257595630 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0ae80abeb0 0x7f0ae80aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:18.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.726+0000 7f0aeea68700 1 -- 172.21.15.31:0/2257595630 >> 172.21.15.31:0/2257595630 conn(0x7f0ae8067660 msgr2=0x7f0ae80c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:18.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.726+0000 7f0aeea68700 1 -- 172.21.15.31:0/2257595630 shutdown_connections 2023-10-09T06:32:18.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:18.726+0000 7f0aeea68700 1 -- 172.21.15.31:0/2257595630 wait complete. 2023-10-09T06:32:18.835 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:32:23.836 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:32:23.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.967+0000 7f963be2e700 1 Processor -- start 2023-10-09T06:32:23.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.967+0000 7f963be2e700 1 -- start start 2023-10-09T06:32:23.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.968+0000 7f963be2e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f963406c630 0x7f9634067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:23.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.968+0000 7f963be2e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9634067ba0 0x7f9634159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:23.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.968+0000 7f963be2e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96340cb370 con 0x7f96340b0890 2023-10-09T06:32:23.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.968+0000 7f963be2e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9634067fe0 con 0x7f963406c630 2023-10-09T06:32:23.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.968+0000 7f963be2e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96340b0c60 con 0x7f9634067ba0 2023-10-09T06:32:23.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f963a3cb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9634067ba0 0x7f9634159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:23.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f96393c9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f963406c630 0x7f9634067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:23.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f9639bca700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f96340b0890 0x7f96340cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:42800/0 (socket says 172.21.15.31:42800) 2023-10-09T06:32:23.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f9639bca700 1 -- 172.21.15.31:0/1667095365 learned_addr learned my addr 172.21.15.31:0/1667095365 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:23.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f96393c9700 1 -- 172.21.15.31:0/1667095365 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9634067ba0 msgr2=0x7f9634159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:23.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f96393c9700 1 --2- 172.21.15.31:0/1667095365 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9634067ba0 0x7f9634159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:23.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f96393c9700 1 -- 172.21.15.31:0/1667095365 >> v1:172.21.15.158:6789/0 conn(0x7f96340b0890 legacy=0x7f96340cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:23.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f96393c9700 1 -- 172.21.15.31:0/1667095365 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963406a1e0 con 0x7f963406c630 2023-10-09T06:32:23.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f9638bc8700 1 -- 172.21.15.31:0/1667095365 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320796952 0 0) 0x7f96340cb370 con 0x7f96340b0890 2023-10-09T06:32:23.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f963a3cb700 1 --2- 172.21.15.31:0/1667095365 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9634067ba0 0x7f9634159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:32:23.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f96393c9700 1 --2- 172.21.15.31:0/1667095365 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f963406c630 0x7f9634067660 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f96280098e0 tx=0x7f96280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43be7a828dc17d4f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:23.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f9638bc8700 1 -- 172.21.15.31:0/1667095365 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800b640 con 0x7f963406c630 2023-10-09T06:32:23.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f9638bc8700 1 -- 172.21.15.31:0/1667095365 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962800b7a0 con 0x7f963406c630 2023-10-09T06:32:23.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.969+0000 7f9638bc8700 1 -- 172.21.15.31:0/1667095365 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800bb40 con 0x7f963406c630 2023-10-09T06:32:23.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.970+0000 7f963be2e700 1 -- 172.21.15.31:0/1667095365 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f963406c630 msgr2=0x7f9634067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:23.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.970+0000 7f963be2e700 1 --2- 172.21.15.31:0/1667095365 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f963406c630 0x7f9634067660 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f96280098e0 tx=0x7f96280091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:23.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.970+0000 7f963be2e700 1 -- 172.21.15.31:0/1667095365 shutdown_connections 2023-10-09T06:32:23.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.970+0000 7f963be2e700 1 --2- 172.21.15.31:0/1667095365 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9634067ba0 0x7f9634159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:23.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.970+0000 7f963be2e700 1 --2- 172.21.15.31:0/1667095365 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f963406c630 0x7f9634067660 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:23.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.970+0000 7f963be2e700 1 -- 172.21.15.31:0/1667095365 >> 172.21.15.31:0/1667095365 conn(0x7f963406fe50 msgr2=0x7f9634069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:23.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.970+0000 7f963be2e700 1 -- 172.21.15.31:0/1667095365 shutdown_connections 2023-10-09T06:32:23.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.970+0000 7f963be2e700 1 -- 172.21.15.31:0/1667095365 wait complete. 2023-10-09T06:32:23.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.971+0000 7f963be2e700 1 Processor -- start 2023-10-09T06:32:23.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.971+0000 7f963be2e700 1 -- start start 2023-10-09T06:32:23.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.972+0000 7f963be2e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9634067ba0 0x7f963416e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:23.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.972+0000 7f963be2e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f963406c630 0x7f96340b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:23.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.972+0000 7f963be2e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96340b0890 0x7f963415b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:23.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.972+0000 7f963be2e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963415b6e0 con 0x7f963406c630 2023-10-09T06:32:23.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.972+0000 7f963be2e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963416e300 con 0x7f96340b0890 2023-10-09T06:32:23.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.972+0000 7f963be2e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963416b250 con 0x7f9634067ba0 2023-10-09T06:32:23.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.972+0000 7f96393c9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f963406c630 0x7f96340b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:23.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.972+0000 7f96393c9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f963406c630 0x7f96340b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39982/0 (socket says 172.21.15.31:39982) 2023-10-09T06:32:23.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.972+0000 7f96393c9700 1 -- 172.21.15.31:0/2290488214 learned_addr learned my addr 172.21.15.31:0/2290488214 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:23.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.972+0000 7f9639bca700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9634067ba0 0x7f963416e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:23.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.972+0000 7f963a3cb700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96340b0890 0x7f963415b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:23.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.973+0000 7f96393c9700 1 -- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9634067ba0 msgr2=0x7f963416e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:23.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.973+0000 7f96393c9700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9634067ba0 0x7f963416e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:23.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.973+0000 7f96393c9700 1 -- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96340b0890 msgr2=0x7f963415b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:23.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.973+0000 7f96393c9700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96340b0890 0x7f963415b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:23.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.973+0000 7f96393c9700 1 -- 172.21.15.31:0/2290488214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9624009a20 con 0x7f963406c630 2023-10-09T06:32:23.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.973+0000 7f9639bca700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9634067ba0 0x7f963416e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:23.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.973+0000 7f96393c9700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f963406c630 0x7f96340b3920 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f9628009f80 tx=0x7f9628017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:23.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.973+0000 7f9631ffb700 1 -- 172.21.15.31:0/2290488214 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800bb20 con 0x7f963406c630 2023-10-09T06:32:23.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.973+0000 7f9631ffb700 1 -- 172.21.15.31:0/2290488214 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9628011420 con 0x7f963406c630 2023-10-09T06:32:23.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.973+0000 7f963be2e700 1 -- 172.21.15.31:0/2290488214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9628009420 con 0x7f963406c630 2023-10-09T06:32:23.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.973+0000 7f9631ffb700 1 -- 172.21.15.31:0/2290488214 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628011800 con 0x7f963406c630 2023-10-09T06:32:23.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.973+0000 7f963be2e700 1 -- 172.21.15.31:0/2290488214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963416dcb0 con 0x7f963406c630 2023-10-09T06:32:23.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.974+0000 7f963be2e700 1 -- 172.21.15.31:0/2290488214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963404c3c0 con 0x7f963406c630 2023-10-09T06:32:23.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.975+0000 7f9631ffb700 1 -- 172.21.15.31:0/2290488214 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9628011c30 con 0x7f963406c630 2023-10-09T06:32:23.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.975+0000 7f9631ffb700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9620066f30 0x7f96200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:23.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.975+0000 7f9631ffb700 1 -- 172.21.15.31:0/2290488214 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9628085fb0 con 0x7f963406c630 2023-10-09T06:32:23.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.975+0000 7f9631ffb700 1 -- 172.21.15.31:0/2290488214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7f962006ea50 con 0x7f963406c630 2023-10-09T06:32:23.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.975+0000 7f9639bca700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9620066f30 0x7f96200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:23.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.976+0000 7f9639bca700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9620066f30 0x7f96200693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f962c000c00 tx=0x7f962c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:23.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:23.979+0000 7f9631ffb700 1 -- 172.21.15.31:0/2290488214 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96280532e0 con 0x7f963406c630 2023-10-09T06:32:24.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.175+0000 7f963be2e700 1 -- 172.21.15.31:0/2290488214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f963416e440 con 0x7f963406c630 2023-10-09T06:32:24.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.176+0000 7f9631ffb700 1 -- 172.21.15.31:0/2290488214 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f9628015020 con 0x7f963406c630 2023-10-09T06:32:24.177 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:24.177 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:24.177 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 187, 2023-10-09T06:32:24.178 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:32:24.178 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:32:24.178 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:32:06.802905+0000", 2023-10-09T06:32:24.178 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:32:24.178 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:32:24.178 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:32:24.178 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:32:24.178 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:32:24.178 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:32:24.178 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:32:24.178 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:32:24.179 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:32:24.179 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:24.179 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:32:24.179 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:32:24.179 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:32:24.179 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:32:24.179 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:32:24.179 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 23, 2023-10-09T06:32:24.179 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:32:24.179 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:32:24.179 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:32:24.179 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:32:24.179 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:32:24.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.180 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:32:24.180 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:32:24.180 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:32:24.180 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:24.180 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:24.180 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:24.180 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:24.180 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:24.180 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:24.180 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:24.180 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:24.181 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:24.181 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:24.181 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:24.181 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:24.181 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:32:24.181 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:32:24.181 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:32:24.181 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:32:24.181 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:32:24.181 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:24.181 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:24.181 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:24.182 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:24.182 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:24.182 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:24.182 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:24.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.182 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:32:24.182 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:24.182 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:24.182 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:24.182 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:24.182 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:24.182 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:24.183 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:24.183 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:24.183 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:24.183 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:24.183 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:24.183 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:24.183 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:24.183 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:24.183 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:24.183 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:24.183 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:24.184 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:24.184 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:24.184 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:24.184 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:24.184 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:24.184 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:24.184 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:24.184 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:24.184 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:24.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.184 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:24.184 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:24.185 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:24.185 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:24.185 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:24.185 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:24.185 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:24.185 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:24.185 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:24.185 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:24.185 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:24.185 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:24.185 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:32:24.185 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:32:24.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.186 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:24.186 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:32:24.186 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.186 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 22, 2023-10-09T06:32:24.186 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:32:24.186 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:48.664093+0000", 2023-10-09T06:32:24.186 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:24.186 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:24.186 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:24.187 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:24.187 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:24.187 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:24.187 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:24.187 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:24.187 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:24.187 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:24.187 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:24.187 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:24.187 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:32:24.187 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:32:24.187 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:32:24.188 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:32:24.188 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:32:24.188 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:24.188 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:24.188 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:24.188 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:24.188 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:24.188 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:24.188 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:24.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.188 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "184", 2023-10-09T06:32:24.188 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:24.188 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:24.189 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:24.189 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:24.189 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:24.189 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:24.189 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:24.189 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:24.189 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:24.189 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:24.189 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:24.189 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:24.189 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:24.189 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:24.190 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:24.190 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:24.190 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:24.190 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:24.190 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:24.190 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:24.190 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:24.190 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:24.190 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:24.190 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:24.190 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:24.191 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:24.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.191 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:24.191 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:24.191 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:24.191 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:24.191 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:24.191 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:24.191 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:24.191 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:24.191 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:24.191 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:24.192 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:24.192 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:24.192 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:32:24.192 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:32:24.192 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:32:24.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.192 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:24.192 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:24.192 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:32:24.192 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.192 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.193 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 23, 2023-10-09T06:32:24.193 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:32:24.193 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:49.212701+0000", 2023-10-09T06:32:24.193 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1027, 2023-10-09T06:32:24.193 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T06:32:24.193 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:24.193 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:24.193 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:24.193 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:24.193 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:24.193 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:24.194 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:24.194 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:24.194 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:24.194 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:24.194 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:32:24.194 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:32:24.194 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:32:24.194 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:32:24.194 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:32:24.194 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:24.194 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:24.194 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:24.195 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:24.195 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:24.195 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:24.195 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:24.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.195 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "187", 2023-10-09T06:32:24.195 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:24.195 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:24.195 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:24.195 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:24.195 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:24.195 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:24.196 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:24.196 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:24.196 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:24.196 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:32:24.196 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:24.196 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:24.196 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:24.196 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:24.196 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:24.196 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:24.196 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:24.196 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:24.197 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:24.197 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:24.197 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:24.197 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:24.197 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:24.197 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:24.197 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:24.197 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:24.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.197 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:24.197 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:24.197 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:24.198 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:24.198 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:24.198 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:24.198 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:24.198 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:24.198 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:24.198 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:24.198 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:24.198 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:24.198 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:32:24.198 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:32:24.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.198 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:24.199 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:24.199 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:32:24.199 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.199 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.199 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.199 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:24.199 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:32:24.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.199 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:24.199 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:24.199 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:24.199 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:24.200 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:24.200 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:24.200 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:24.200 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:24.200 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:24.200 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:24.200 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:24.200 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:24.200 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:24.200 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.200 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.201 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:32:24.201 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:24.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.201 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.201 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:32:24.201 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:24.201 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.201 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.201 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:24.201 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.202 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.202 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:32:24.202 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:24.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.202 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.202 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:32:24.202 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:24.202 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.202 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.202 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:24.203 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.203 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.203 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:32:24.203 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:24.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.203 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.203 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:32:24.203 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:24.203 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.203 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.204 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:24.204 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.204 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.204 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:32:24.204 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:24.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.204 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.204 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:32:24.204 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:24.204 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.205 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.205 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:32:24.205 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:32:24.205 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:32:24.205 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:32:24.205 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:24.205 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:24.205 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:24.205 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.206 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:24.206 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:24.206 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:24.206 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:24.206 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:24.206 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:24.206 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:24.206 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:24.206 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:24.206 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:24.206 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:24.206 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:24.207 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:24.207 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.207 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.207 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:32:24.207 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:24.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.207 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.207 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:32:24.207 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:24.207 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.207 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.208 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:24.208 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.208 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.208 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:32:24.208 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:24.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.208 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.208 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:32:24.208 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:32:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:32:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:32:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:32:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:32:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:32:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:32:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:32:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:32:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:32:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:32:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:32:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:32:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:24.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.216 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.216 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:32:24.216 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:24.216 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.216 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.216 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:24.216 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.216 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.217 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:32:24.217 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:24.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.217 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.217 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:32:24.217 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:24.217 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.217 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.217 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:32:24.217 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:32:24.217 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:32:24.218 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:32:24.218 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:24.218 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:24.218 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:24.218 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.218 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:24.218 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:24.218 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:24.218 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:24.218 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:24.219 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:24.219 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:24.219 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:24.219 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:24.219 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:24.219 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:24.219 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:24.219 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:24.219 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.219 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.219 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:32:24.220 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:24.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.220 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.220 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:32:24.220 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:24.220 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.220 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.220 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:24.220 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.221 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.221 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:32:24.221 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:24.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.221 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.221 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:32:24.221 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:24.221 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.221 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.221 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:24.222 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.222 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.222 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:32:24.222 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:24.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.222 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.222 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:32:24.222 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:24.222 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.222 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.223 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:24.223 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.223 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.223 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:32:24.223 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:24.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.223 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.223 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:32:24.223 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:24.223 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.224 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.224 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:32:24.224 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:32:24.224 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:32:24.224 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:32:24.224 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:24.224 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:24.224 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:24.224 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.225 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:24.225 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:24.225 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:24.225 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:24.225 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:24.225 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:24.225 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:24.225 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:24.225 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:24.225 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:24.225 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:24.225 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:24.226 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:24.226 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.226 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.226 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:32:24.226 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:24.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.226 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.226 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:32:24.226 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:24.226 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.227 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.227 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:24.227 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.227 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.227 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:32:24.227 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:24.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.227 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.227 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:32:24.227 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:24.228 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.228 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.228 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:24.228 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.228 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.228 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:32:24.228 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:24.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.228 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.229 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:32:24.229 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:24.229 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.229 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.229 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:24.229 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.229 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.229 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:32:24.229 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:24.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.230 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.230 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:32:24.230 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:24.230 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.230 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.230 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:32:24.230 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:32:24.230 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:32:24.230 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:32:24.230 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:24.230 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:24.231 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:24.231 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.231 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:24.231 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:24.231 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:24.231 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:24.231 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:24.231 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:24.231 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:24.231 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:24.232 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:24.232 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:24.232 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:24.232 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:24.232 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:24.232 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.232 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.232 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:32:24.232 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:24.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.232 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.233 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:32:24.233 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:24.233 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.233 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.233 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:24.233 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.233 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.233 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:32:24.233 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:24.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.234 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.234 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:32:24.234 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:24.234 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.234 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.234 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:24.234 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.234 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.234 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:32:24.235 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:24.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.235 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.235 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:32:24.235 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:24.235 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.235 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.235 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:24.235 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.236 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.236 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:32:24.236 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:24.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.236 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.236 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:32:24.236 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:24.236 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.236 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.236 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:32:24.237 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:32:24.237 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:32:24.237 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:32:24.237 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:24.237 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:24.237 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:24.237 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.237 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:24.237 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:24.237 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:24.238 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:24.238 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:24.238 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:24.238 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:24.238 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:24.238 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:24.238 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:24.238 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:24.238 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:24.238 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:24.238 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.239 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.239 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:32:24.239 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:24.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.239 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.239 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:32:24.239 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:24.239 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.239 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.239 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:24.239 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.240 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.240 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:32:24.240 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:24.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.240 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.240 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:32:24.240 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:24.240 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.240 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.241 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:24.241 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.241 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.241 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:32:24.241 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:24.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.241 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.241 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:32:24.241 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:24.241 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.242 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.242 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:24.242 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.242 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.242 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:32:24.243 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:24.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.243 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.243 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:32:24.243 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:24.244 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.244 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.244 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:32:24.244 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:32:24.244 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:32:24.245 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:32:24.245 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:24.245 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:24.245 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:24.245 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.246 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:24.246 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:24.246 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:24.246 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:24.247 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:24.247 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:24.247 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:24.247 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:24.247 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:24.247 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:24.248 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:24.248 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:24.248 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:24.248 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.249 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:32:24.249 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:24.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.250 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:32:24.250 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:24.250 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.250 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.250 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:24.251 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.251 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.251 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:32:24.251 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:24.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.252 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.252 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:32:24.252 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:24.252 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.253 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.253 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:24.253 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.253 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.254 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:32:24.254 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:24.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.254 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.254 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:32:24.254 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:24.254 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.255 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.255 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:24.255 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:24.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.255 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:24.255 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:32:24.255 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:24.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.256 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:24.256 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:32:24.256 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:24.256 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.256 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.257 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:32:24.257 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:32:24.257 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:32:24.257 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:32:24.257 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:24.257 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:24.258 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:24.258 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:24.258 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.258 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:24.258 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:32:24.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.258 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:24.258 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:24.258 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:24.258 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:24.259 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:24.259 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:24.259 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:32:24.259 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:24.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.259 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:24.259 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:24.259 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:24.259 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:24.259 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:24.259 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:24.260 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:32:24.260 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:24.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.260 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:24.260 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:24.260 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:24.260 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:24.260 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:24.260 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:24.260 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:32:24.260 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:24.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:32:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:24.262 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:24.262 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:24.262 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:24.262 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:24.262 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:24.262 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:32:24.262 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:24.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.262 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:24.262 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:24.263 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:24.263 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:24.263 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:24.263 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:24.263 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:32:24.263 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:24.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.263 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:24.263 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:24.263 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:24.263 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:24.264 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:24.264 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:24.264 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:32:24.264 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:24.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:24.264 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:24.264 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:24.264 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:24.264 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:24.264 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:24.264 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:24.265 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:32:24.265 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:24.265 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.265 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:24.265 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:32:24.265 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:32:24.265 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:32:24.265 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:32:24.265 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:32:24.265 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:32:24.265 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:32:24.265 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:32:24.266 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:32:24.266 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:32:24.266 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:32:24.266 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:32:24.266 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:32:24.266 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:24.266 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:32:24.266 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:32:24.266 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:32:24.266 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:32:24.267 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:32:24.267 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:32:24.267 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:32:24.267 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:32:24.267 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:32:24.267 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:32:24.267 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:32:24.267 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:24.267 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.178+0000 7f963be2e700 1 -- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9620066f30 msgr2=0x7f96200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.178+0000 7f963be2e700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9620066f30 0x7f96200693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f962c000c00 tx=0x7f962c009040 comp rx=0 tx=0).stop 2023-10-09T06:32:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.178+0000 7f963be2e700 1 -- 172.21.15.31:0/2290488214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f963406c630 msgr2=0x7f96340b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.178+0000 7f963be2e700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f963406c630 0x7f96340b3920 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f9628009f80 tx=0x7f9628017000 comp rx=0 tx=0).stop 2023-10-09T06:32:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.179+0000 7f963be2e700 1 -- 172.21.15.31:0/2290488214 shutdown_connections 2023-10-09T06:32:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.179+0000 7f963be2e700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9620066f30 0x7f96200693e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.179+0000 7f963be2e700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9634067ba0 0x7f963416e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.179+0000 7f963be2e700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96340b0890 0x7f963415b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.179+0000 7f963be2e700 1 --2- 172.21.15.31:0/2290488214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f963406c630 0x7f96340b3920 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.179+0000 7f963be2e700 1 -- 172.21.15.31:0/2290488214 >> 172.21.15.31:0/2290488214 conn(0x7f963406fe50 msgr2=0x7f963415d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.179+0000 7f963be2e700 1 -- 172.21.15.31:0/2290488214 shutdown_connections 2023-10-09T06:32:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:24.179+0000 7f963be2e700 1 -- 172.21.15.31:0/2290488214 wait complete. 2023-10-09T06:32:24.272 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T06:32:27.276 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:32:27.279 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:32:29.273 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:32:29.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.405+0000 7f82bc610700 1 Processor -- start 2023-10-09T06:32:29.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.406+0000 7f82bc610700 1 -- start start 2023-10-09T06:32:29.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.406+0000 7f82bc610700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82b4159e60 0x7f82b40b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:29.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.406+0000 7f82bc610700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f82b40cffa0 0x7f82b406a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:29.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82bc610700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f82b415a230 0x7f82b406abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:29.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82bc610700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b4069d70 con 0x7f82b415a230 2023-10-09T06:32:29.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82bc610700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b40b3d40 con 0x7f82b40cffa0 2023-10-09T06:32:29.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82bc610700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b40b4300 con 0x7f82b4159e60 2023-10-09T06:32:29.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82babad700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f82b415a230 0x7f82b406abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:29.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82babad700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f82b415a230 0x7f82b406abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39990/0 (socket says 172.21.15.31:39990) 2023-10-09T06:32:29.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82babad700 1 -- 172.21.15.31:0/3989147457 learned_addr learned my addr 172.21.15.31:0/3989147457 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:29.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82b9bab700 1 --2- 172.21.15.31:0/3989147457 >> v2:172.21.15.158:3300/0 conn(0x7f82b40cffa0 0x7f82b406a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:29.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82ba3ac700 1 --2- 172.21.15.31:0/3989147457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82b4159e60 0x7f82b40b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:29.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82babad700 1 -- 172.21.15.31:0/3989147457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82b4159e60 msgr2=0x7f82b40b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:29.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82babad700 1 --2- 172.21.15.31:0/3989147457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82b4159e60 0x7f82b40b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82babad700 1 -- 172.21.15.31:0/3989147457 >> v2:172.21.15.158:3300/0 conn(0x7f82b40cffa0 msgr2=0x7f82b406a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:29.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82babad700 1 --2- 172.21.15.31:0/3989147457 >> v2:172.21.15.158:3300/0 conn(0x7f82b40cffa0 0x7f82b406a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82babad700 1 -- 172.21.15.31:0/3989147457 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b40d0480 con 0x7f82b415a230 2023-10-09T06:32:29.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82b9bab700 1 --2- 172.21.15.31:0/3989147457 >> v2:172.21.15.158:3300/0 conn(0x7f82b40cffa0 0x7f82b406a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:29.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82ba3ac700 1 --2- 172.21.15.31:0/3989147457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82b4159e60 0x7f82b40b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:29.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82babad700 1 --2- 172.21.15.31:0/3989147457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82b415a230 0x7f82b406abe0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f82b4089760 tx=0x7f82a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216f47c09be2e4bd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:29.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82b93aa700 1 -- 172.21.15.31:0/3989147457 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a400e070 con 0x7f82b415a230 2023-10-09T06:32:29.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.407+0000 7f82b93aa700 1 -- 172.21.15.31:0/3989147457 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a400ba50 con 0x7f82b415a230 2023-10-09T06:32:29.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.408+0000 7f82b93aa700 1 -- 172.21.15.31:0/3989147457 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a40092e0 con 0x7f82b415a230 2023-10-09T06:32:29.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.408+0000 7f82bc610700 1 -- 172.21.15.31:0/3989147457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82b415a230 msgr2=0x7f82b406abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:29.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.408+0000 7f82bc610700 1 --2- 172.21.15.31:0/3989147457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82b415a230 0x7f82b406abe0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f82b4089760 tx=0x7f82a4009840 comp rx=0 tx=0).stop 2023-10-09T06:32:29.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.408+0000 7f82bc610700 1 -- 172.21.15.31:0/3989147457 shutdown_connections 2023-10-09T06:32:29.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.408+0000 7f82bc610700 1 --2- 172.21.15.31:0/3989147457 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82b4159e60 0x7f82b40b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.408+0000 7f82bc610700 1 --2- 172.21.15.31:0/3989147457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82b415a230 0x7f82b406abe0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.408+0000 7f82bc610700 1 --2- 172.21.15.31:0/3989147457 >> v2:172.21.15.158:3300/0 conn(0x7f82b40cffa0 0x7f82b406a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.408+0000 7f82bc610700 1 -- 172.21.15.31:0/3989147457 >> 172.21.15.31:0/3989147457 conn(0x7f82b40d1a50 msgr2=0x7f82b4068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:29.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.408+0000 7f82bc610700 1 -- 172.21.15.31:0/3989147457 shutdown_connections 2023-10-09T06:32:29.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.408+0000 7f82bc610700 1 -- 172.21.15.31:0/3989147457 wait complete. 2023-10-09T06:32:29.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.409+0000 7f82bc610700 1 Processor -- start 2023-10-09T06:32:29.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.409+0000 7f82bc610700 1 -- start start 2023-10-09T06:32:29.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82bc610700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82b40cffa0 0x7f82b416a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:29.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82bc610700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82b4159e60 0x7f82b416d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:29.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82bc610700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82b415a230 0x7f82b4158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:29.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82bc610700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b415b5d0 con 0x7f82b4159e60 2023-10-09T06:32:29.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82bc610700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b415b870 con 0x7f82b40cffa0 2023-10-09T06:32:29.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82bc610700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b415bb50 con 0x7f82b415a230 2023-10-09T06:32:29.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82b9bab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82b4159e60 0x7f82b416d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:29.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82b9bab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82b4159e60 0x7f82b416d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40006/0 (socket says 172.21.15.31:40006) 2023-10-09T06:32:29.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82b9bab700 1 -- 172.21.15.31:0/3189313613 learned_addr learned my addr 172.21.15.31:0/3189313613 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:29.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82ba3ac700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82b40cffa0 0x7f82b416a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:29.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82babad700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82b415a230 0x7f82b4158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:29.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82b9bab700 1 -- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82b415a230 msgr2=0x7f82b4158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:29.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82b9bab700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82b415a230 0x7f82b4158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82b9bab700 1 -- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82b40cffa0 msgr2=0x7f82b416a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:29.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82b9bab700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82b40cffa0 0x7f82b416a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82b9bab700 1 -- 172.21.15.31:0/3189313613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a4009ae0 con 0x7f82b4159e60 2023-10-09T06:32:29.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.410+0000 7f82babad700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82b415a230 0x7f82b4158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:29.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.411+0000 7f82b9bab700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82b4159e60 0x7f82b416d130 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f82a800c880 tx=0x7f82a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:29.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.411+0000 7f82b27fc700 1 -- 172.21.15.31:0/3189313613 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8011600 con 0x7f82b4159e60 2023-10-09T06:32:29.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.411+0000 7f82b27fc700 1 -- 172.21.15.31:0/3189313613 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a8011760 con 0x7f82b4159e60 2023-10-09T06:32:29.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.411+0000 7f82bc610700 1 -- 172.21.15.31:0/3189313613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b415be30 con 0x7f82b4159e60 2023-10-09T06:32:29.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.411+0000 7f82b27fc700 1 -- 172.21.15.31:0/3189313613 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8011ae0 con 0x7f82b4159e60 2023-10-09T06:32:29.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.411+0000 7f82bc610700 1 -- 172.21.15.31:0/3189313613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b415c3f0 con 0x7f82b4159e60 2023-10-09T06:32:29.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.412+0000 7f82bc610700 1 -- 172.21.15.31:0/3189313613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b40d0dc0 con 0x7f82b4159e60 2023-10-09T06:32:29.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.412+0000 7f82b27fc700 1 -- 172.21.15.31:0/3189313613 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82a8010350 con 0x7f82b4159e60 2023-10-09T06:32:29.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.413+0000 7f82b27fc700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f82a0066f30 0x7f82a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:29.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.413+0000 7f82b27fc700 1 -- 172.21.15.31:0/3189313613 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82a8084540 con 0x7f82b4159e60 2023-10-09T06:32:29.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.413+0000 7f82ba3ac700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f82a0066f30 0x7f82a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:29.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.413+0000 7f82ba3ac700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f82a0066f30 0x7f82a00693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00ac00 tx=0x7f82ac006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:29.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.417+0000 7f82b27fc700 1 -- 172.21.15.31:0/3189313613 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82a80517b0 con 0x7f82b4159e60 2023-10-09T06:32:29.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.610+0000 7f82bc610700 1 -- 172.21.15.31:0/3189313613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f82b415c5e0 con 0x7f82b4159e60 2023-10-09T06:32:29.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.611+0000 7f82b27fc700 1 -- 172.21.15.31:0/3189313613 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f82a8054dd0 con 0x7f82b4159e60 2023-10-09T06:32:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:29.612 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 188, 2023-10-09T06:32:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:32:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:32:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:32:26.806922+0000", 2023-10-09T06:32:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:32:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:32:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:32:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:32:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:32:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:32:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:32:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:32:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:32:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:32:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:32:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:32:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:32:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:32:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 23, 2023-10-09T06:32:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:32:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:32:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:32:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:32:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:32:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:32:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:32:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:32:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:32:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:32:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:32:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:32:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:32:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:29.617 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:29.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.617 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:32:29.617 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:29.617 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:29.617 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:29.617 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:29.617 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:29.617 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:29.617 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:29.617 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:29.617 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:29.618 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:29.618 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:29.618 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:29.618 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:29.618 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:29.618 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:29.618 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:29.618 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:29.618 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:29.618 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:29.618 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:29.618 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:29.619 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:29.619 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:29.619 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:29.619 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:29.619 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:29.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.619 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:29.619 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:29.619 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:29.619 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:29.619 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:29.620 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:29.620 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:29.620 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:29.620 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:29.620 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:29.620 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:29.620 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:29.620 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:32:29.620 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:32:29.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.620 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:29.621 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:32:29.621 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.621 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 22, 2023-10-09T06:32:29.621 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:32:29.621 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:48.664093+0000", 2023-10-09T06:32:29.621 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:29.621 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:29.621 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:29.621 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:29.622 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:29.622 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:29.622 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:29.622 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:29.622 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:29.622 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:29.622 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:29.622 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:29.622 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:32:29.622 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:32:29.623 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:32:29.623 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:32:29.623 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:32:29.623 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:29.623 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:29.623 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:29.623 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:29.623 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:29.623 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:29.623 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:29.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "184", 2023-10-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.628 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 23, 2023-10-09T06:32:29.628 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:32:29.628 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:49.212701+0000", 2023-10-09T06:32:29.628 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:29.628 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:29.628 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:29.628 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:29.628 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:29.628 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:29.628 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:29.628 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:29.629 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:29.629 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:29.629 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:29.629 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:29.629 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:32:29.629 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:32:29.629 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:32:29.629 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:32:29.629 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:32:29.629 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:29.629 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:29.629 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:29.630 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:29.630 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:29.630 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:29.630 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:29.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.630 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "188", 2023-10-09T06:32:29.630 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:29.630 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:29.630 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:29.630 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:29.630 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:29.630 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:29.631 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:29.631 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:29.631 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:29.631 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:32:29.631 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:29.631 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:29.631 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:29.631 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:29.631 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:29.631 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:29.631 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:29.631 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:29.632 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:29.632 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:29.632 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:29.632 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:29.632 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:29.632 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:29.632 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:29.632 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:29.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.632 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:29.632 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:29.632 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:29.633 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:29.633 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:29.633 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:29.633 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:29.633 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:29.633 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:29.633 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:29.633 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:29.633 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:29.633 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:32:29.633 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:32:29.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.634 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:29.634 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:29.634 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:32:29.634 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.634 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.634 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.634 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:29.634 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:32:29.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.634 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:29.634 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:29.634 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:29.635 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:29.635 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:29.635 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:29.635 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:29.635 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:29.635 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:29.635 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:29.635 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:29.635 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:29.635 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:29.635 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.636 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.636 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:32:29.636 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:29.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.636 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.636 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:32:29.636 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:29.636 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.636 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.636 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:29.636 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.637 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.637 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:32:29.637 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:29.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.637 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.637 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:32:29.637 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:29.637 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.637 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.638 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:29.638 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.638 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.638 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:32:29.638 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:29.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.638 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.638 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:32:29.638 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:29.639 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.639 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.639 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:29.639 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.639 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.639 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:32:29.639 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:29.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.639 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.640 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:32:29.640 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:29.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.640 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.640 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:32:29.640 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:32:29.640 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:32:29.640 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:32:29.640 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:29.640 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:29.640 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:29.641 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:29.642 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:29.642 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:29.642 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:29.642 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.642 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.642 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:32:29.642 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:29.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.642 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.642 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:32:29.643 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:29.643 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.643 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.643 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:29.643 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.643 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.643 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:32:29.643 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:29.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.644 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.644 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:32:29.644 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:29.644 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.644 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.644 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:29.644 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.644 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.644 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:32:29.644 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:29.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.645 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.645 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:32:29.645 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:29.645 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.645 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.645 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:29.645 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.645 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.645 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:32:29.646 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:29.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.646 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.646 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:32:29.646 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:29.646 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.646 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.646 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:32:29.646 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:32:29.647 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:32:29.647 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:32:29.647 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:29.647 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:29.647 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:29.647 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.647 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:29.647 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:29.647 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:29.647 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:29.648 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:29.648 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:29.648 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:29.648 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:29.648 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:29.648 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:29.648 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:29.648 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:29.648 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:29.648 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.648 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.649 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:32:29.649 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:29.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.649 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.649 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:32:29.649 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:29.649 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.649 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.649 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:29.649 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.650 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.650 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:32:29.650 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:29.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.650 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.650 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:32:29.650 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:29.650 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.650 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.651 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:29.651 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.651 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.651 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:32:29.651 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:29.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.651 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.651 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:32:29.651 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:29.651 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.651 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.652 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:29.652 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.652 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.652 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:32:29.652 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:29.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.652 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.652 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:32:29.652 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:29.653 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.653 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.653 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:32:29.653 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:32:29.653 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:32:29.653 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:32:29.653 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:29.653 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:29.653 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:29.653 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.654 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:29.654 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:29.654 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:29.654 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:29.654 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:29.654 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:29.654 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:29.654 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:29.654 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:29.654 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:29.654 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:29.655 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:29.655 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:29.655 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.655 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.655 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:32:29.655 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:29.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.655 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.655 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:32:29.655 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:29.656 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.656 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.656 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:29.656 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.656 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.656 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:32:29.656 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:29.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.656 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.657 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:32:29.657 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:29.657 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.657 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.657 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:29.657 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.657 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.657 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:32:29.657 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:29.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.658 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.658 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:32:29.658 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:29.658 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.658 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.658 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:29.658 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.658 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.659 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:32:29.659 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:29.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.659 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.659 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:32:29.659 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:29.659 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.659 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.659 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:32:29.659 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:32:29.660 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:32:29.660 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:32:29.660 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:29.660 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:29.660 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:29.660 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.660 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:29.660 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:29.660 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:29.661 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:29.661 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:29.661 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:29.661 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:29.661 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:29.661 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:29.661 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:29.661 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:29.661 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:29.661 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:29.661 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.662 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.662 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:32:29.662 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:29.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.662 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.662 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:32:29.662 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:29.662 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.662 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.662 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:29.663 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.663 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.663 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:32:29.663 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:29.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.663 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.663 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:32:29.663 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:29.663 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.663 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.664 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:29.664 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.664 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.664 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:32:29.664 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:29.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.664 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.664 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:32:29.664 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:29.665 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.665 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.665 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:29.665 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.665 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.665 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:32:29.665 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:29.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.665 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.666 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:32:29.666 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:29.666 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.666 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.666 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:32:29.666 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:32:29.666 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:32:29.666 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:32:29.666 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:29.666 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:29.667 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:29.667 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.667 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:29.667 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:29.667 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:29.667 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:29.667 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:29.667 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:29.667 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:29.668 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:29.668 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:29.668 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:29.668 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:29.668 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:29.668 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:29.668 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.668 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.668 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:32:29.668 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:29.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.669 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.669 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:32:29.669 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:29.669 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.669 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.669 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:29.669 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.669 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.670 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:32:29.670 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:29.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.670 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.670 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:32:29.670 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:29.670 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.670 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.670 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:29.670 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.671 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.671 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:32:29.671 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:29.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.671 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.671 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:32:29.671 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:29.671 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.671 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.672 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:29.672 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.672 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.672 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:32:29.672 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:29.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.672 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.672 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:32:29.672 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:29.672 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.673 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.673 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:32:29.673 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:32:29.673 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:32:29.673 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:32:29.673 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:29.673 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:29.673 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:29.673 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.673 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:29.674 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:29.674 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:29.674 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:29.674 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:29.674 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:29.674 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:29.674 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:29.674 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:29.674 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:29.674 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:29.675 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:29.675 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:29.675 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.675 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.675 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:32:29.675 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:29.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.675 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.676 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:32:29.676 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:29.676 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.676 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.676 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:29.676 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.676 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.676 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.676 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:32:29.676 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:29.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.677 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.677 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:32:29.677 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:29.677 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.677 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.677 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:29.677 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.677 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.677 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:32:29.678 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:29.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.678 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.678 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:32:29.678 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:29.678 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.678 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.678 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:29.678 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.679 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.679 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:32:29.679 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:29.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.679 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.679 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:32:29.679 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:29.679 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.679 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.680 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:32:29.680 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:32:29.680 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:32:29.680 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:32:29.680 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:29.680 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:29.680 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:29.680 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.680 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:29.680 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:29.681 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:29.681 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:29.681 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:29.681 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:29.681 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:29.681 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:29.681 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:29.681 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:29.681 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:29.681 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:29.682 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:29.682 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.682 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.682 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:32:29.682 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:29.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.682 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.682 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:32:29.682 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:29.683 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.683 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.683 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:29.683 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.683 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.683 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:32:29.683 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:29.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.683 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.684 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:32:29.684 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:29.684 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.684 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.684 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:29.684 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.684 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.684 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:32:29.684 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:29.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.685 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.685 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:32:29.685 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:29.685 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.685 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.685 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:29.685 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:29.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.685 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:29.685 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:32:29.686 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:29.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.686 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:29.686 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:32:29.686 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:29.686 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.686 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.686 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:32:29.686 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:32:29.686 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:32:29.687 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:32:29.687 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:29.687 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:29.687 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:29.687 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:29.687 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.687 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:29.687 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:32:29.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.687 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:29.687 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:29.687 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:29.688 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:29.688 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:29.688 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:29.688 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:32:29.688 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:29.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.688 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:29.688 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:29.688 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:29.688 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:29.688 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:29.689 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:29.689 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:32:29.689 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:29.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.689 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:29.689 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:29.689 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:29.689 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:29.689 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:29.689 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:29.689 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:32:29.690 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:29.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.690 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:29.690 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:29.690 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:29.690 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:29.690 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:29.690 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:29.690 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:32:29.690 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:29.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.691 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:29.691 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:29.691 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:29.691 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:29.691 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:29.691 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:29.691 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:32:29.691 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:29.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.692 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:29.693 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:29.693 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:29.693 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:29.693 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:29.693 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:29.693 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:32:29.693 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:29.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.694 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:29.694 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:29.694 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:29.694 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:29.694 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:29.694 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:29.694 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:32:29.694 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:29.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:29.695 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:29.695 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:29.695 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:29.695 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:29.695 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:29.695 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:29.695 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:32:29.695 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:29.695 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.695 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:29.695 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:32:29.695 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:32:29.696 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:32:29.696 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:32:29.696 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:32:29.696 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:32:29.696 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:32:29.696 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:32:29.696 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:32:29.696 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:32:29.696 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:32:29.696 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:32:29.696 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:32:29.696 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:29.697 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:32:29.697 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:32:29.697 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:32:29.697 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:32:29.697 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:32:29.697 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:32:29.697 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:32:29.697 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:32:29.697 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:32:29.698 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:32:29.698 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:32:29.698 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:29.698 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:29.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.613+0000 7f82bc610700 1 -- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f82a0066f30 msgr2=0x7f82a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:29.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.613+0000 7f82bc610700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f82a0066f30 0x7f82a00693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00ac00 tx=0x7f82ac006f90 comp rx=0 tx=0).stop 2023-10-09T06:32:29.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.613+0000 7f82bc610700 1 -- 172.21.15.31:0/3189313613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82b4159e60 msgr2=0x7f82b416d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:29.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.613+0000 7f82bc610700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82b4159e60 0x7f82b416d130 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f82a800c880 tx=0x7f82a8008040 comp rx=0 tx=0).stop 2023-10-09T06:32:29.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.613+0000 7f82bc610700 1 -- 172.21.15.31:0/3189313613 shutdown_connections 2023-10-09T06:32:29.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.613+0000 7f82bc610700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f82a0066f30 0x7f82a00693e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.613+0000 7f82bc610700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f82b415a230 0x7f82b4158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.613+0000 7f82bc610700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82b40cffa0 0x7f82b416a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.613+0000 7f82bc610700 1 --2- 172.21.15.31:0/3189313613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82b4159e60 0x7f82b416d130 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.613+0000 7f82bc610700 1 -- 172.21.15.31:0/3189313613 >> 172.21.15.31:0/3189313613 conn(0x7f82b40d1a50 msgr2=0x7f82b4155780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:29.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.613+0000 7f82bc610700 1 -- 172.21.15.31:0/3189313613 shutdown_connections 2023-10-09T06:32:29.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.613+0000 7f82bc610700 1 -- 172.21.15.31:0/3189313613 wait complete. 2023-10-09T06:32:29.701 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-10-09T06:32:29.701 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T06:32:29.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.820+0000 7fec614ff700 1 Processor -- start 2023-10-09T06:32:29.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.820+0000 7fec614ff700 1 -- start start 2023-10-09T06:32:29.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec614ff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec5c157870 0x7fec5c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:29.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec614ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec5c157c40 0x7fec5c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:29.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec614ff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c15cbb0 con 0x7fec5c15a620 2023-10-09T06:32:29.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec614ff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c15bfa0 con 0x7fec5c157870 2023-10-09T06:32:29.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec614ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c15c280 con 0x7fec5c157c40 2023-10-09T06:32:29.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec5affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec5c157870 0x7fec5c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:29.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec5affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec5c157870 0x7fec5c15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44042/0 (socket says 172.21.15.31:44042) 2023-10-09T06:32:29.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec5affd700 1 -- 172.21.15.31:0/2315502610 learned_addr learned my addr 172.21.15.31:0/2315502610 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:29.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec5affd700 1 -- 172.21.15.31:0/2315502610 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec5c157c40 msgr2=0x7fec5c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:29.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec5affd700 1 --2- 172.21.15.31:0/2315502610 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec5c157c40 0x7fec5c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec5affd700 1 -- 172.21.15.31:0/2315502610 >> v1:172.21.15.158:6789/0 conn(0x7fec5c15a620 legacy=0x7fec5c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:29.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec5affd700 1 -- 172.21.15.31:0/2315502610 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c15c560 con 0x7fec5c157870 2023-10-09T06:32:29.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec5affd700 1 --2- 172.21.15.31:0/2315502610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c157870 0x7fec5c15b6a0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fec540099b0 tx=0x7fec54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d8455d54044014 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:29.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec59ffb700 1 -- 172.21.15.31:0/2315502610 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400b820 con 0x7fec5c157870 2023-10-09T06:32:29.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec59ffb700 1 -- 172.21.15.31:0/2315502610 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5400b980 con 0x7fec5c157870 2023-10-09T06:32:29.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.821+0000 7fec59ffb700 1 -- 172.21.15.31:0/2315502610 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400bd20 con 0x7fec5c157870 2023-10-09T06:32:29.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.822+0000 7fec614ff700 1 -- 172.21.15.31:0/2315502610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c157870 msgr2=0x7fec5c15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:29.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.822+0000 7fec614ff700 1 --2- 172.21.15.31:0/2315502610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c157870 0x7fec5c15b6a0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fec540099b0 tx=0x7fec54009250 comp rx=0 tx=0).stop 2023-10-09T06:32:29.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.822+0000 7fec614ff700 1 -- 172.21.15.31:0/2315502610 shutdown_connections 2023-10-09T06:32:29.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.822+0000 7fec614ff700 1 --2- 172.21.15.31:0/2315502610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c157870 0x7fec5c15b6a0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.822+0000 7fec614ff700 1 --2- 172.21.15.31:0/2315502610 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec5c157c40 0x7fec5c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.822+0000 7fec614ff700 1 -- 172.21.15.31:0/2315502610 >> 172.21.15.31:0/2315502610 conn(0x7fec5c068ce0 msgr2=0x7fec5c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:29.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.822+0000 7fec614ff700 1 -- 172.21.15.31:0/2315502610 shutdown_connections 2023-10-09T06:32:29.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.822+0000 7fec614ff700 1 -- 172.21.15.31:0/2315502610 wait complete. 2023-10-09T06:32:29.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.823+0000 7fec614ff700 1 Processor -- start 2023-10-09T06:32:29.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.823+0000 7fec614ff700 1 -- start start 2023-10-09T06:32:29.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec614ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c157870 0x7fec5c160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:29.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec614ff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec5c157c40 0x7fec5c15e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:29.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec614ff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c15a620 0x7fec5c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:29.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec614ff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c13f270 con 0x7fec5c15a620 2023-10-09T06:32:29.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec614ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0b1860 con 0x7fec5c157870 2023-10-09T06:32:29.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec614ff700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0b1560 con 0x7fec5c157c40 2023-10-09T06:32:29.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec5b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c15a620 0x7fec5c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:29.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec5b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c15a620 0x7fec5c0b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44044/0 (socket says 172.21.15.31:44044) 2023-10-09T06:32:29.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec5b7fe700 1 -- 172.21.15.31:0/2493829216 learned_addr learned my addr 172.21.15.31:0/2493829216 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:29.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec5affd700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c157870 0x7fec5c160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:29.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec5a7fc700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec5c157c40 0x7fec5c15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:29.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec5b7fe700 1 -- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec5c157c40 msgr2=0x7fec5c15e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:29.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec5b7fe700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec5c157c40 0x7fec5c15e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec5b7fe700 1 -- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c157870 msgr2=0x7fec5c160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:29.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec5b7fe700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c157870 0x7fec5c160910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:29.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec5b7fe700 1 -- 172.21.15.31:0/2493829216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec540094f0 con 0x7fec5c15a620 2023-10-09T06:32:29.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.824+0000 7fec5a7fc700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec5c157c40 0x7fec5c15e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:29.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.825+0000 7fec5b7fe700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c15a620 0x7fec5c0b1cf0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00bb90 tx=0x7fec4c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:29.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.825+0000 7fec52ffd700 1 -- 172.21.15.31:0/2493829216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00c8c0 con 0x7fec5c15a620 2023-10-09T06:32:29.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.825+0000 7fec52ffd700 1 -- 172.21.15.31:0/2493829216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c00ca40 con 0x7fec5c15a620 2023-10-09T06:32:29.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.825+0000 7fec614ff700 1 -- 172.21.15.31:0/2493829216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c1506a0 con 0x7fec5c15a620 2023-10-09T06:32:29.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.825+0000 7fec52ffd700 1 -- 172.21.15.31:0/2493829216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00ce00 con 0x7fec5c15a620 2023-10-09T06:32:29.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.825+0000 7fec614ff700 1 -- 172.21.15.31:0/2493829216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c14dbd0 con 0x7fec5c15a620 2023-10-09T06:32:29.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.826+0000 7fec614ff700 1 -- 172.21.15.31:0/2493829216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c04c3c0 con 0x7fec5c15a620 2023-10-09T06:32:29.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.826+0000 7fec52ffd700 1 -- 172.21.15.31:0/2493829216 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec4c014620 con 0x7fec5c15a620 2023-10-09T06:32:29.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.827+0000 7fec52ffd700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fec3c066f30 0x7fec3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:29.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.827+0000 7fec52ffd700 1 -- 172.21.15.31:0/2493829216 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fec4c0844a0 con 0x7fec5c15a620 2023-10-09T06:32:29.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.827+0000 7fec5affd700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fec3c066f30 0x7fec3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:29.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.827+0000 7fec5affd700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fec3c066f30 0x7fec3c0693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fec540099b0 tx=0x7fec54016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:29.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:29.831+0000 7fec52ffd700 1 -- 172.21.15.31:0/2493829216 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec4c04c5a0 con 0x7fec5c15a620 2023-10-09T06:32:30.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.025+0000 7fec614ff700 1 -- 172.21.15.31:0/2493829216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fec5c15c840 con 0x7fec5c15a620 2023-10-09T06:32:30.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.025+0000 7fec52ffd700 1 -- 172.21.15.31:0/2493829216 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) v1 ==== 81+0+32282 (secure 0 0 0) 0x7fec4c051710 con 0x7fec5c15a620 2023-10-09T06:32:30.026 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:30.027 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 188, 2023-10-09T06:32:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", 2023-10-09T06:32:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2023-10-09T06:20:36.913973+0000", 2023-10-09T06:32:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2023-10-09T06:32:26.806922+0000", 2023-10-09T06:32:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2023-10-09T06:20:42.314439+0000", 2023-10-09T06:32:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2023-10-09T06:20:39.305553+0000", 2023-10-09T06:32:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T06:32:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2023-10-09T06:32:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2023-10-09T06:32:30.027 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2023-10-09T06:32:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2023-10-09T06:32:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2023-10-09T06:32:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2023-10-09T06:32:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 4, 2023-10-09T06:32:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T06:32:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T06:32:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T06:32:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2023-10-09T06:32:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 23, 2023-10-09T06:32:30.028 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 8, 2023-10-09T06:32:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "luminous", 2023-10-09T06:32:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2023-10-09T06:32:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "quincy", 2023-10-09T06:32:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2023-10-09T06:32:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2023-10-09T06:32:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2023-10-09T06:32:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:20:42.563520+0000", 2023-10-09T06:32:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:30.029 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2023-10-09T06:32:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2023-10-09T06:32:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2023-10-09T06:32:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2023-10-09T06:32:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2023-10-09T06:32:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "109", 2023-10-09T06:32:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:30.031 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:30.032 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:30.033 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:30.034 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_max": 32, 2023-10-09T06:32:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2023-10-09T06:32:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {} 2023-10-09T06:32:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.035 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 22, 2023-10-09T06:32:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2023-10-09T06:32:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:48.664093+0000", 2023-10-09T06:32:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:30.036 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2023-10-09T06:32:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2023-10-09T06:32:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2023-10-09T06:32:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2023-10-09T06:32:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2023-10-09T06:32:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:30.037 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "184", 2023-10-09T06:32:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:30.038 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2023-10-09T06:32:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:30.039 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:30.040 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2023-10-09T06:32:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2023-10-09T06:32:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2023-10-09T06:32:30.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2023-10-09T06:32:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 23, 2023-10-09T06:32:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2023-10-09T06:32:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2023-10-09T06:31:49.212701+0000", 2023-10-09T06:32:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2023-10-09T06:32:30.042 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2023-10-09T06:32:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2023-10-09T06:32:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2023-10-09T06:32:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2023-10-09T06:32:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2023-10-09T06:32:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2023-10-09T06:32:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2023-10-09T06:32:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T06:32:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T06:32:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2023-10-09T06:32:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2023-10-09T06:32:30.043 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2023-10-09T06:32:30.044 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2023-10-09T06:32:30.044 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2023-10-09T06:32:30.044 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2023-10-09T06:32:30.044 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2023-10-09T06:32:30.044 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2023-10-09T06:32:30.044 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2023-10-09T06:32:30.044 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2023-10-09T06:32:30.044 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2023-10-09T06:32:30.044 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2023-10-09T06:32:30.044 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2023-10-09T06:32:30.044 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2023-10-09T06:32:30.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.044 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "188", 2023-10-09T06:32:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2023-10-09T06:32:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T06:32:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T06:32:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2023-10-09T06:32:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2023-10-09T06:32:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2023-10-09T06:32:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2023-10-09T06:32:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2023-10-09T06:32:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2023-10-09T06:32:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 33554432, 2023-10-09T06:32:30.045 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2023-10-09T06:32:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2023-10-09T06:32:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2023-10-09T06:32:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2023-10-09T06:32:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2023-10-09T06:32:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2023-10-09T06:32:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2023-10-09T06:32:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2023-10-09T06:32:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T06:32:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T06:32:30.046 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T06:32:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2023-10-09T06:32:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2023-10-09T06:32:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2023-10-09T06:32:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2023-10-09T06:32:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2023-10-09T06:32:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2023-10-09T06:32:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2023-10-09T06:32:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2023-10-09T06:32:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2023-10-09T06:32:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2023-10-09T06:32:30.047 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T06:32:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2023-10-09T06:32:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2023-10-09T06:32:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2023-10-09T06:32:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2023-10-09T06:32:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2023-10-09T06:32:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2023-10-09T06:32:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2023-10-09T06:32:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T06:32:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2023-10-09T06:32:30.048 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2023-10-09T06:32:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2023-10-09T06:32:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2023-10-09T06:32:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:30.049 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.050 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2023-10-09T06:32:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2023-10-09T06:32:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:30.051 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2023-10-09T06:32:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2023-10-09T06:32:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2023-10-09T06:32:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2023-10-09T06:32:30.053 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2023-10-09T06:32:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.054 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2023-10-09T06:32:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86352 2023-10-09T06:32:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6801/86352", 2023-10-09T06:32:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6803/86352", 2023-10-09T06:32:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/86352", 2023-10-09T06:32:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6805/86352", 2023-10-09T06:32:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:30.055 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:30.056 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6816", 2023-10-09T06:32:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2023-10-09T06:32:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2023-10-09T06:32:30.058 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6820", 2023-10-09T06:32:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.059 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6826", 2023-10-09T06:32:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6827", 2023-10-09T06:32:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:30.060 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6822", 2023-10-09T06:32:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6824", 2023-10-09T06:32:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86369 2023-10-09T06:32:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6817/86369", 2023-10-09T06:32:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6820/86369", 2023-10-09T06:32:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6827/86369", 2023-10-09T06:32:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6824/86369", 2023-10-09T06:32:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:30.062 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2023-10-09T06:32:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6821", 2023-10-09T06:32:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.064 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6823", 2023-10-09T06:32:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6825", 2023-10-09T06:32:30.065 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6830", 2023-10-09T06:32:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.066 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6831", 2023-10-09T06:32:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6828", 2023-10-09T06:32:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:30.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6829", 2023-10-09T06:32:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86376 2023-10-09T06:32:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6821/86376", 2023-10-09T06:32:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6825/86376", 2023-10-09T06:32:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6831/86376", 2023-10-09T06:32:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6829/86376", 2023-10-09T06:32:30.068 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:30.069 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2023-10-09T06:32:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2023-10-09T06:32:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.071 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2023-10-09T06:32:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2023-10-09T06:32:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2023-10-09T06:32:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2023-10-09T06:32:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2023-10-09T06:32:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2023-10-09T06:32:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86353 2023-10-09T06:32:30.074 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6809/86353", 2023-10-09T06:32:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6811/86353", 2023-10-09T06:32:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/86353", 2023-10-09T06:32:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6813/86353", 2023-10-09T06:32:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:30.076 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6816", 2023-10-09T06:32:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.077 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6817", 2023-10-09T06:32:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6818", 2023-10-09T06:32:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:30.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6819", 2023-10-09T06:32:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6822", 2023-10-09T06:32:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6823", 2023-10-09T06:32:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:30.080 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6820", 2023-10-09T06:32:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6821", 2023-10-09T06:32:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86569 2023-10-09T06:32:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6817/86569", 2023-10-09T06:32:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6819/86569", 2023-10-09T06:32:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6823/86569", 2023-10-09T06:32:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6821/86569", 2023-10-09T06:32:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:30.082 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:30.083 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6802", 2023-10-09T06:32:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6804", 2023-10-09T06:32:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.084 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6806", 2023-10-09T06:32:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.085 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6808", 2023-10-09T06:32:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6813", 2023-10-09T06:32:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6815", 2023-10-09T06:32:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6810", 2023-10-09T06:32:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6811", 2023-10-09T06:32:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86547 2023-10-09T06:32:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6804/86547", 2023-10-09T06:32:30.088 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6808/86547", 2023-10-09T06:32:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6815/86547", 2023-10-09T06:32:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6811/86547", 2023-10-09T06:32:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:30.089 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6800", 2023-10-09T06:32:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6801", 2023-10-09T06:32:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6803", 2023-10-09T06:32:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6805", 2023-10-09T06:32:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:30.092 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6812", 2023-10-09T06:32:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.093 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6814", 2023-10-09T06:32:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6807", 2023-10-09T06:32:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:30.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6809", 2023-10-09T06:32:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86548 2023-10-09T06:32:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6801/86548", 2023-10-09T06:32:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6805/86548", 2023-10-09T06:32:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6814/86548", 2023-10-09T06:32:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6809/86548", 2023-10-09T06:32:30.095 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T06:32:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2023-10-09T06:32:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2023-10-09T06:32:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2023-10-09T06:32:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2023-10-09T06:32:30.096 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 0, 2023-10-09T06:32:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 0, 2023-10-09T06:32:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 13, 2023-10-09T06:32:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 183, 2023-10-09T06:32:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 0, 2023-10-09T06:32:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2023-10-09T06:32:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2023-10-09T06:32:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6824", 2023-10-09T06:32:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6825", 2023-10-09T06:32:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2023-10-09T06:32:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.099 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.101 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6826", 2023-10-09T06:32:30.101 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:30.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.101 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.101 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6827", 2023-10-09T06:32:30.101 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:30.102 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.102 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.102 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2023-10-09T06:32:30.102 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.102 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.102 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6830", 2023-10-09T06:32:30.102 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:30.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.103 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.103 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6831", 2023-10-09T06:32:30.103 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:30.103 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.103 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.103 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2023-10-09T06:32:30.103 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2023-10-09T06:32:30.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.103 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2023-10-09T06:32:30.103 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6828", 2023-10-09T06:32:30.104 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:30.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.104 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-10-09T06:32:30.104 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.158:6829", 2023-10-09T06:32:30.104 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 86602 2023-10-09T06:32:30.104 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.104 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.104 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.158:6825/86602", 2023-10-09T06:32:30.104 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.158:6827/86602", 2023-10-09T06:32:30.104 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.158:6831/86602", 2023-10-09T06:32:30.105 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.158:6829/86602", 2023-10-09T06:32:30.105 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2023-10-09T06:32:30.105 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2023-10-09T06:32:30.105 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2023-10-09T06:32:30.105 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-10-09T06:32:30.105 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.105 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:30.105 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2023-10-09T06:32:30.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.105 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2023-10-09T06:32:30.105 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:30.106 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:30.106 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:30.106 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:30.106 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:30.106 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.402933+0000", 2023-10-09T06:32:30.106 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:30.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.106 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2023-10-09T06:32:30.106 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:30.107 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:30.107 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:30.107 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:30.107 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:30.107 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.455786+0000", 2023-10-09T06:32:30.107 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:30.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.107 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2023-10-09T06:32:30.107 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:30.107 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:30.108 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:30.108 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:30.108 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:30.108 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.471692+0000", 2023-10-09T06:32:30.108 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:30.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.108 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2023-10-09T06:32:30.108 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:30.108 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:30.109 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:30.109 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:30.109 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:30.109 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.461669+0000", 2023-10-09T06:32:30.109 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:30.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.109 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 4, 2023-10-09T06:32:30.109 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:30.109 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:30.110 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:30.110 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:30.110 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:30.110 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.407900+0000", 2023-10-09T06:32:30.110 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:30.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.110 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 5, 2023-10-09T06:32:30.110 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:30.110 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:30.111 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:30.111 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:30.111 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:30.111 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.385092+0000", 2023-10-09T06:32:30.111 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:30.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.111 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 6, 2023-10-09T06:32:30.111 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:30.111 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:30.111 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:30.112 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:30.112 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:30.112 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.404732+0000", 2023-10-09T06:32:30.112 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:30.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-10-09T06:32:30.112 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 7, 2023-10-09T06:32:30.112 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2023-10-09T06:32:30.112 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2023-10-09T06:32:30.112 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2023-10-09T06:32:30.112 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2023-10-09T06:32:30.113 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2023-10-09T06:32:30.113 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2023-10-09T06:20:40.424694+0000", 2023-10-09T06:32:30.113 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2023-10-09T06:32:30.113 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.113 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-10-09T06:32:30.113 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2023-10-09T06:32:30.113 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2023-10-09T06:32:30.113 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2023-10-09T06:32:30.113 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2023-10-09T06:32:30.113 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": {}, 2023-10-09T06:32:30.113 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2023-10-09T06:32:30.113 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2023-10-09T06:32:30.114 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2023-10-09T06:32:30.114 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2023-10-09T06:32:30.114 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2023-10-09T06:32:30.114 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2023-10-09T06:32:30.114 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2023-10-09T06:32:30.114 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2023-10-09T06:32:30.114 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-10-09T06:32:30.114 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2023-10-09T06:32:30.114 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2023-10-09T06:32:30.114 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2023-10-09T06:32:30.115 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2023-10-09T06:32:30.115 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2023-10-09T06:32:30.115 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2023-10-09T06:32:30.115 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2023-10-09T06:32:30.115 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2023-10-09T06:32:30.115 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2023-10-09T06:32:30.115 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2023-10-09T06:32:30.115 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2023-10-09T06:32:30.115 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-10-09T06:32:30.115 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:30.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.027+0000 7fec614ff700 1 -- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fec3c066f30 msgr2=0x7fec3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:30.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.027+0000 7fec614ff700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fec3c066f30 0x7fec3c0693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fec540099b0 tx=0x7fec54016000 comp rx=0 tx=0).stop 2023-10-09T06:32:30.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.027+0000 7fec614ff700 1 -- 172.21.15.31:0/2493829216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c15a620 msgr2=0x7fec5c0b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:30.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.027+0000 7fec614ff700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c15a620 0x7fec5c0b1cf0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00bb90 tx=0x7fec4c009810 comp rx=0 tx=0).stop 2023-10-09T06:32:30.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.027+0000 7fec614ff700 1 -- 172.21.15.31:0/2493829216 shutdown_connections 2023-10-09T06:32:30.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.027+0000 7fec614ff700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fec3c066f30 0x7fec3c0693e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:30.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.027+0000 7fec614ff700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c15a620 0x7fec5c0b1cf0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:30.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.027+0000 7fec614ff700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec5c157870 0x7fec5c160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:30.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.027+0000 7fec614ff700 1 --2- 172.21.15.31:0/2493829216 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fec5c157c40 0x7fec5c15e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:30.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.028+0000 7fec614ff700 1 -- 172.21.15.31:0/2493829216 >> 172.21.15.31:0/2493829216 conn(0x7fec5c068ce0 msgr2=0x7fec5c15d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:30.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.028+0000 7fec614ff700 1 -- 172.21.15.31:0/2493829216 shutdown_connections 2023-10-09T06:32:30.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.028+0000 7fec614ff700 1 -- 172.21.15.31:0/2493829216 wait complete. 2023-10-09T06:32:30.119 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:32:30.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.237+0000 7f1630a26700 1 Processor -- start 2023-10-09T06:32:30.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.237+0000 7f1630a26700 1 -- start start 2023-10-09T06:32:30.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f1630a26700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f162c159f10 0x7f162c0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:30.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f1630a26700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c15a730 con 0x7f162c15a2e0 2023-10-09T06:32:30.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f1630a26700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c0ae320 con 0x7f162c0cc410 2023-10-09T06:32:30.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f1630a26700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c0ad710 con 0x7f162c159f10 2023-10-09T06:32:30.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f162a59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f162c15a2e0 0x7f162c0cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32854/0 (socket says 172.21.15.31:32854) 2023-10-09T06:32:30.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f162a59c700 1 -- 172.21.15.31:0/3624007237 learned_addr learned my addr 172.21.15.31:0/3624007237 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:30.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f162ad9d700 1 --2- 172.21.15.31:0/3624007237 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f162c159f10 0x7f162c0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:30.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f1629d9b700 1 -- 172.21.15.31:0/3624007237 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454115527 0 0) 0x7f1614001110 con 0x7f162c15a2e0 2023-10-09T06:32:30.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f1629d9b700 1 -- 172.21.15.31:0/3624007237 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1618003570 con 0x7f162c15a2e0 2023-10-09T06:32:30.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f1629d9b700 1 -- 172.21.15.31:0/3624007237 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31958570 0 0) 0x7f162c0ae320 con 0x7f162c0cc410 2023-10-09T06:32:30.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f1629d9b700 1 -- 172.21.15.31:0/3624007237 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1614001110 con 0x7f162c0cc410 2023-10-09T06:32:30.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f1629d9b700 1 -- 172.21.15.31:0/3624007237 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2894620493 0 0) 0x7f1618003570 con 0x7f162c15a2e0 2023-10-09T06:32:30.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f162ad9d700 1 -- 172.21.15.31:0/3624007237 >> v1:172.21.15.158:6789/0 conn(0x7f162c0cc410 legacy=0x7f162c0cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:30.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f162ad9d700 1 -- 172.21.15.31:0/3624007237 >> v1:172.21.15.31:6789/0 conn(0x7f162c15a2e0 legacy=0x7f162c0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:30.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.238+0000 7f162ad9d700 1 -- 172.21.15.31:0/3624007237 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0ad9f0 con 0x7f162c159f10 2023-10-09T06:32:30.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.239+0000 7f162ad9d700 1 --2- 172.21.15.31:0/3624007237 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f162c159f10 0x7f162c0c59e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1624009910 tx=0x7f16240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b08354223a1e11c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:30.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.239+0000 7f1629d9b700 1 -- 172.21.15.31:0/3624007237 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614001600 con 0x7f162c159f10 2023-10-09T06:32:30.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.239+0000 7f1629d9b700 1 -- 172.21.15.31:0/3624007237 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1624011420 con 0x7f162c159f10 2023-10-09T06:32:30.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.239+0000 7f1629d9b700 1 -- 172.21.15.31:0/3624007237 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16240117c0 con 0x7f162c159f10 2023-10-09T06:32:30.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.239+0000 7f1630a26700 1 -- 172.21.15.31:0/3624007237 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f162c159f10 msgr2=0x7f162c0c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:30.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.239+0000 7f1630a26700 1 --2- 172.21.15.31:0/3624007237 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f162c159f10 0x7f162c0c59e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1624009910 tx=0x7f16240091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:30.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.239+0000 7f1630a26700 1 -- 172.21.15.31:0/3624007237 shutdown_connections 2023-10-09T06:32:30.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.239+0000 7f1630a26700 1 --2- 172.21.15.31:0/3624007237 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f162c159f10 0x7f162c0c59e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:30.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.239+0000 7f1630a26700 1 -- 172.21.15.31:0/3624007237 >> 172.21.15.31:0/3624007237 conn(0x7f162c067e40 msgr2=0x7f162c0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:30.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.239+0000 7f1630a26700 1 -- 172.21.15.31:0/3624007237 shutdown_connections 2023-10-09T06:32:30.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.239+0000 7f1630a26700 1 -- 172.21.15.31:0/3624007237 wait complete. 2023-10-09T06:32:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.241+0000 7f1630a26700 1 Processor -- start 2023-10-09T06:32:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.241+0000 7f1630a26700 1 -- start start 2023-10-09T06:32:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.241+0000 7f1630a26700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f162c0cc410 0x7f162c1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.241+0000 7f1630a26700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f162c159f10 0x7f162c0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.241+0000 7f1630a26700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f162c15a2e0 0x7f162c0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.241+0000 7f1630a26700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c0c9090 con 0x7f162c159f10 2023-10-09T06:32:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.241+0000 7f1630a26700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c0c87a0 con 0x7f162c0cc410 2023-10-09T06:32:30.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.241+0000 7f1630a26700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c0c8a40 con 0x7f162c15a2e0 2023-10-09T06:32:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f162a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f162c159f10 0x7f162c0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f162a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f162c159f10 0x7f162c0b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44048/0 (socket says 172.21.15.31:44048) 2023-10-09T06:32:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f162a59c700 1 -- 172.21.15.31:0/1944921329 learned_addr learned my addr 172.21.15.31:0/1944921329 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f162ad9d700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f162c0cc410 0x7f162c1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f162b59e700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f162c15a2e0 0x7f162c0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f162a59c700 1 -- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f162c15a2e0 msgr2=0x7f162c0b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:30.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f162a59c700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f162c15a2e0 0x7f162c0b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:30.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f162a59c700 1 -- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f162c0cc410 msgr2=0x7f162c1558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:30.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f162a59c700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f162c0cc410 0x7f162c1558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:30.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f162a59c700 1 -- 172.21.15.31:0/1944921329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624009420 con 0x7f162c159f10 2023-10-09T06:32:30.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f162a59c700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f162c159f10 0x7f162c0b39e0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f161400cb60 tx=0x7f1614001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:30.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f1622ffd700 1 -- 172.21.15.31:0/1944921329 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614007e10 con 0x7f162c159f10 2023-10-09T06:32:30.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f1622ffd700 1 -- 172.21.15.31:0/1944921329 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1614007360 con 0x7f162c159f10 2023-10-09T06:32:30.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f1622ffd700 1 -- 172.21.15.31:0/1944921329 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614004830 con 0x7f162c159f10 2023-10-09T06:32:30.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f1630a26700 1 -- 172.21.15.31:0/1944921329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c0c8d20 con 0x7f162c159f10 2023-10-09T06:32:30.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.242+0000 7f1630a26700 1 -- 172.21.15.31:0/1944921329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c0ca700 con 0x7f162c159f10 2023-10-09T06:32:30.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.243+0000 7f1630a26700 1 -- 172.21.15.31:0/1944921329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c0c9240 con 0x7f162c159f10 2023-10-09T06:32:30.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.244+0000 7f1622ffd700 1 -- 172.21.15.31:0/1944921329 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1614004c60 con 0x7f162c159f10 2023-10-09T06:32:30.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.244+0000 7f1622ffd700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f160c066f30 0x7f160c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:30.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.244+0000 7f1622ffd700 1 -- 172.21.15.31:0/1944921329 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1614083c50 con 0x7f162c159f10 2023-10-09T06:32:30.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.244+0000 7f162ad9d700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f160c066f30 0x7f160c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:30.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.245+0000 7f162ad9d700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f160c066f30 0x7f160c0693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f16240030c0 tx=0x7f1624016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:30.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.248+0000 7f1622ffd700 1 -- 172.21.15.31:0/1944921329 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f162c0c9240 con 0x7f162c159f10 2023-10-09T06:32:30.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.484+0000 7f1630a26700 1 -- 172.21.15.31:0/1944921329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f162c15a730 con 0x7f162c159f10 2023-10-09T06:32:30.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.485+0000 7f1622ffd700 1 -- 172.21.15.31:0/1944921329 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f162c15a730 con 0x7f162c159f10 2023-10-09T06:32:30.485 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:30.486 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/3503727793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3503727793},{"type":"v1","addr":"172.21.15.158:6837","nonce":3503727793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2366061673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2366061673},{"type":"v1","addr":"172.21.15.158:6836","nonce":2366061673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3405107978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3405107978},{"type":"v1","addr":"172.21.15.31:6834","nonce":3405107978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:31:50.242464+0000","modified":"2023-10-09T06:31:53.876299+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8079":{"gid":8079,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4124393323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4124393323},{"type":"v1","addr":"172.21.15.31:6835","nonce":4124393323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T06:32:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.487+0000 7f1630a26700 1 -- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f160c066f30 msgr2=0x7f160c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.487+0000 7f1630a26700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f160c066f30 0x7f160c0693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f16240030c0 tx=0x7f1624016000 comp rx=0 tx=0).stop 2023-10-09T06:32:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.487+0000 7f1630a26700 1 -- 172.21.15.31:0/1944921329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f162c159f10 msgr2=0x7f162c0b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.487+0000 7f1630a26700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f162c159f10 0x7f162c0b39e0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f161400cb60 tx=0x7f1614001ba0 comp rx=0 tx=0).stop 2023-10-09T06:32:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.487+0000 7f1630a26700 1 -- 172.21.15.31:0/1944921329 shutdown_connections 2023-10-09T06:32:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.487+0000 7f1630a26700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f160c066f30 0x7f160c0693e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.487+0000 7f1630a26700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f162c15a2e0 0x7f162c0b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.487+0000 7f1630a26700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f162c0cc410 0x7f162c1558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.487+0000 7f1630a26700 1 --2- 172.21.15.31:0/1944921329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f162c159f10 0x7f162c0b39e0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:30.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.487+0000 7f1630a26700 1 -- 172.21.15.31:0/1944921329 >> 172.21.15.31:0/1944921329 conn(0x7f162c067e40 msgr2=0x7f162c1580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:30.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.487+0000 7f1630a26700 1 -- 172.21.15.31:0/1944921329 shutdown_connections 2023-10-09T06:32:30.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:30.487+0000 7f1630a26700 1 -- 172.21.15.31:0/1944921329 wait complete. 2023-10-09T06:32:30.489 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 89 2023-10-09T06:32:30.500 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-09T06:32:30.638 INFO:teuthology.orchestra.run.smithi031.stdout:{"cluster_fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","whoami":0,"id":8079,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":39.757324113999999,"mdsmap_epoch":89,"osdmap_epoch":188,"osdmap_epoch_barrier":187,"uptime":44.851346020999998} 2023-10-09T06:32:30.643 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "e30ef3ca-dd5e-445c-bd11-d2bec76d42c9", "fs_name": "cephfs", "id": 8079, "mdsmap_epoch": 89, "osdmap_epoch": 188, "osdmap_epoch_barrier": 187, "rank_uptime": 39.757324114, "state": "up:active", "uptime": 44.851346021, "want_state": "up:active", "whoami": 0 } 2023-10-09T06:32:30.644 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T06:32:30.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:32:30.644 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-09T06:32:30.938 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records in 2023-10-09T06:32:30.939 INFO:teuthology.orchestra.run.smithi031.stderr:50+0 records out 2023-10-09T06:32:30.939 INFO:teuthology.orchestra.run.smithi031.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.270723 s, 194 MB/s 2023-10-09T06:32:30.939 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:32:30.939 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:32:30.986 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:32:31.043 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:32:31.043 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:32:31.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:32:31.043 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:32:31.111 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:32:31.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:31.111 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:32:31.130 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T06:32:31.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:32:31.130 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T06:32:31.170 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:32:31.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:31.171 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T06:32:31.231 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:32:31.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.353+0000 7fcc30258700 1 Processor -- start 2023-10-09T06:32:31.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.354+0000 7fcc30258700 1 -- start start 2023-10-09T06:32:31.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.354+0000 7fcc30258700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcc28159cf0 0x7fcc2815e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:31.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.354+0000 7fcc30258700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcc280cf1c0 0x7fcc28068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:31.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.354+0000 7fcc30258700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc280cca20 con 0x7fcc2815a0c0 2023-10-09T06:32:31.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc30258700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2815ea40 con 0x7fcc28159cf0 2023-10-09T06:32:31.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc30258700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc28067660 con 0x7fcc280cf1c0 2023-10-09T06:32:31.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc2dff4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcc28159cf0 0x7fcc2815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:31.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc2d7f3700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcc2815a0c0 0x7fcc280ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32856/0 (socket says 172.21.15.31:32856) 2023-10-09T06:32:31.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc2d7f3700 1 -- 172.21.15.31:0/24122507 learned_addr learned my addr 172.21.15.31:0/24122507 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:31.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc2e7f5700 1 --2- 172.21.15.31:0/24122507 >> v2:172.21.15.158:3300/0 conn(0x7fcc280cf1c0 0x7fcc28068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:31.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc2dff4700 1 -- 172.21.15.31:0/24122507 >> v2:172.21.15.158:3300/0 conn(0x7fcc280cf1c0 msgr2=0x7fcc28068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:31.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc2dff4700 1 --2- 172.21.15.31:0/24122507 >> v2:172.21.15.158:3300/0 conn(0x7fcc280cf1c0 0x7fcc28068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc2dff4700 1 -- 172.21.15.31:0/24122507 >> v1:172.21.15.31:6789/0 conn(0x7fcc2815a0c0 legacy=0x7fcc280ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:31.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc2dff4700 1 -- 172.21.15.31:0/24122507 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc28067f00 con 0x7fcc28159cf0 2023-10-09T06:32:31.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc2cff2700 1 -- 172.21.15.31:0/24122507 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495863564 0 0) 0x7fcc280cca20 con 0x7fcc2815a0c0 2023-10-09T06:32:31.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc2dff4700 1 --2- 172.21.15.31:0/24122507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc28159cf0 0x7fcc2815e500 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fcc280cc5d0 tx=0x7fcc18009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27eb1ec6dae3825 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:31.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc2cff2700 1 -- 172.21.15.31:0/24122507 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1800e070 con 0x7fcc28159cf0 2023-10-09T06:32:31.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc2cff2700 1 -- 172.21.15.31:0/24122507 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1800bc30 con 0x7fcc28159cf0 2023-10-09T06:32:31.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.355+0000 7fcc2cff2700 1 -- 172.21.15.31:0/24122507 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18012430 con 0x7fcc28159cf0 2023-10-09T06:32:31.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.356+0000 7fcc30258700 1 -- 172.21.15.31:0/24122507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc28159cf0 msgr2=0x7fcc2815e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:31.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.356+0000 7fcc30258700 1 --2- 172.21.15.31:0/24122507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc28159cf0 0x7fcc2815e500 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fcc280cc5d0 tx=0x7fcc18009780 comp rx=0 tx=0).stop 2023-10-09T06:32:31.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.356+0000 7fcc30258700 1 -- 172.21.15.31:0/24122507 shutdown_connections 2023-10-09T06:32:31.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.356+0000 7fcc30258700 1 --2- 172.21.15.31:0/24122507 >> v2:172.21.15.158:3300/0 conn(0x7fcc280cf1c0 0x7fcc28068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.356+0000 7fcc30258700 1 --2- 172.21.15.31:0/24122507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc28159cf0 0x7fcc2815e500 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.356+0000 7fcc30258700 1 -- 172.21.15.31:0/24122507 >> 172.21.15.31:0/24122507 conn(0x7fcc2806c6e0 msgr2=0x7fcc28069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:31.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.356+0000 7fcc30258700 1 -- 172.21.15.31:0/24122507 shutdown_connections 2023-10-09T06:32:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.356+0000 7fcc30258700 1 -- 172.21.15.31:0/24122507 wait complete. 2023-10-09T06:32:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.357+0000 7fcc30258700 1 Processor -- start 2023-10-09T06:32:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.357+0000 7fcc30258700 1 -- start start 2023-10-09T06:32:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc30258700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc280cf1c0 0x7fcc281554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc30258700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc28159cf0 0x7fcc280ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc30258700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc2815a0c0 0x7fcc280ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc30258700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280c8590 con 0x7fcc280cf1c0 2023-10-09T06:32:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc30258700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280c7980 con 0x7fcc28159cf0 2023-10-09T06:32:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc30258700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280c7c60 con 0x7fcc2815a0c0 2023-10-09T06:32:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc2dff4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc280cf1c0 0x7fcc281554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc2dff4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc280cf1c0 0x7fcc281554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44072/0 (socket says 172.21.15.31:44072) 2023-10-09T06:32:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc2dff4700 1 -- 172.21.15.31:0/1923845427 learned_addr learned my addr 172.21.15.31:0/1923845427 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc2d7f3700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc28159cf0 0x7fcc280ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc2e7f5700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc2815a0c0 0x7fcc280ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc2dff4700 1 -- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc2815a0c0 msgr2=0x7fcc280ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc2dff4700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc2815a0c0 0x7fcc280ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc2dff4700 1 -- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc28159cf0 msgr2=0x7fcc280ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc2dff4700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc28159cf0 0x7fcc280ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc2dff4700 1 -- 172.21.15.31:0/1923845427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18009a20 con 0x7fcc280cf1c0 2023-10-09T06:32:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc2d7f3700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc28159cf0 0x7fcc280ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.358+0000 7fcc2e7f5700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc2815a0c0 0x7fcc280ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.359+0000 7fcc2dff4700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc280cf1c0 0x7fcc281554c0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fcc180097c0 tx=0x7fcc18019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.359+0000 7fcc25ffb700 1 -- 172.21.15.31:0/1923845427 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18027470 con 0x7fcc280cf1c0 2023-10-09T06:32:31.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.359+0000 7fcc25ffb700 1 -- 172.21.15.31:0/1923845427 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc180275f0 con 0x7fcc280cf1c0 2023-10-09T06:32:31.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.359+0000 7fcc30258700 1 -- 172.21.15.31:0/1923845427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc280c7f40 con 0x7fcc280cf1c0 2023-10-09T06:32:31.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.359+0000 7fcc25ffb700 1 -- 172.21.15.31:0/1923845427 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc180279b0 con 0x7fcc280cf1c0 2023-10-09T06:32:31.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.359+0000 7fcc30258700 1 -- 172.21.15.31:0/1923845427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc280c8a20 con 0x7fcc280cf1c0 2023-10-09T06:32:31.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.360+0000 7fcc30258700 1 -- 172.21.15.31:0/1923845427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2804c3c0 con 0x7fcc280cf1c0 2023-10-09T06:32:31.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.360+0000 7fcc25ffb700 1 -- 172.21.15.31:0/1923845427 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc18024070 con 0x7fcc280cf1c0 2023-10-09T06:32:31.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.361+0000 7fcc25ffb700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc14066f30 0x7fcc140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:31.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.361+0000 7fcc25ffb700 1 -- 172.21.15.31:0/1923845427 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc18086cd0 con 0x7fcc280cf1c0 2023-10-09T06:32:31.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.361+0000 7fcc2d7f3700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc14066f30 0x7fcc140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:31.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.361+0000 7fcc2d7f3700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc14066f30 0x7fcc140693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcc280cae70 tx=0x7fcc1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:31.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.365+0000 7fcc25ffb700 1 -- 172.21.15.31:0/1923845427 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc18053ea0 con 0x7fcc280cf1c0 2023-10-09T06:32:31.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.601+0000 7fcc30258700 1 -- 172.21.15.31:0/1923845427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc280c8870 con 0x7fcc280cf1c0 2023-10-09T06:32:31.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.601+0000 7fcc25ffb700 1 -- 172.21.15.31:0/1923845427 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fcc1802c020 con 0x7fcc280cf1c0 2023-10-09T06:32:31.602 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:31.602 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/3503727793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3503727793},{"type":"v1","addr":"172.21.15.158:6837","nonce":3503727793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2366061673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2366061673},{"type":"v1","addr":"172.21.15.158:6836","nonce":2366061673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3405107978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3405107978},{"type":"v1","addr":"172.21.15.31:6834","nonce":3405107978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:31:50.242464+0000","modified":"2023-10-09T06:31:53.876299+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8079":{"gid":8079,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4124393323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4124393323},{"type":"v1","addr":"172.21.15.31:6835","nonce":4124393323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T06:32:31.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.603+0000 7fcc30258700 1 -- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc14066f30 msgr2=0x7fcc140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:31.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.603+0000 7fcc30258700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc14066f30 0x7fcc140693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcc280cae70 tx=0x7fcc1c009040 comp rx=0 tx=0).stop 2023-10-09T06:32:31.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.603+0000 7fcc30258700 1 -- 172.21.15.31:0/1923845427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc280cf1c0 msgr2=0x7fcc281554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:31.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.603+0000 7fcc30258700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc280cf1c0 0x7fcc281554c0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fcc180097c0 tx=0x7fcc18019000 comp rx=0 tx=0).stop 2023-10-09T06:32:31.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.603+0000 7fcc30258700 1 -- 172.21.15.31:0/1923845427 shutdown_connections 2023-10-09T06:32:31.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.603+0000 7fcc30258700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcc14066f30 0x7fcc140693e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.603+0000 7fcc30258700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcc2815a0c0 0x7fcc280ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.603+0000 7fcc30258700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc280cf1c0 0x7fcc281554c0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.603+0000 7fcc30258700 1 --2- 172.21.15.31:0/1923845427 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc28159cf0 0x7fcc280ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.603+0000 7fcc30258700 1 -- 172.21.15.31:0/1923845427 >> 172.21.15.31:0/1923845427 conn(0x7fcc2806c6e0 msgr2=0x7fcc280c3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:31.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.603+0000 7fcc30258700 1 -- 172.21.15.31:0/1923845427 shutdown_connections 2023-10-09T06:32:31.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.603+0000 7fcc30258700 1 -- 172.21.15.31:0/1923845427 wait complete. 2023-10-09T06:32:31.606 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 89 2023-10-09T06:32:31.616 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:32:31.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.737+0000 7f50601fe700 1 Processor -- start 2023-10-09T06:32:31.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.738+0000 7f50601fe700 1 -- start start 2023-10-09T06:32:31.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.738+0000 7f50601fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f50580d1c30 0x7f50580ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:31.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.738+0000 7f50601fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f505815a680 0x7f50580cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:31.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.738+0000 7f50601fe700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50580c5d80 con 0x7f505815a2b0 2023-10-09T06:32:31.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.738+0000 7f50601fe700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5058068470 con 0x7f505815a680 2023-10-09T06:32:31.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.738+0000 7f50601fe700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50580c6060 con 0x7f50580d1c30 2023-10-09T06:32:31.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505e79b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f505815a680 0x7f50580cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:31.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505e79b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f505815a680 0x7f50580cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44076/0 (socket says 172.21.15.31:44076) 2023-10-09T06:32:31.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505df9a700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f505815a2b0 0x7f50580b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32862/0 (socket says 172.21.15.31:32862) 2023-10-09T06:32:31.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505e79b700 1 -- 172.21.15.31:0/3140301488 learned_addr learned my addr 172.21.15.31:0/3140301488 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:31.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505d799700 1 --2- 172.21.15.31:0/3140301488 >> v2:172.21.15.158:3300/0 conn(0x7f50580d1c30 0x7f50580ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:31.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505e79b700 1 -- 172.21.15.31:0/3140301488 >> v2:172.21.15.158:3300/0 conn(0x7f50580d1c30 msgr2=0x7f50580ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:31.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505e79b700 1 --2- 172.21.15.31:0/3140301488 >> v2:172.21.15.158:3300/0 conn(0x7f50580d1c30 0x7f50580ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505e79b700 1 -- 172.21.15.31:0/3140301488 >> v1:172.21.15.31:6789/0 conn(0x7f505815a2b0 legacy=0x7f50580b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:31.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505e79b700 1 -- 172.21.15.31:0/3140301488 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50580c6340 con 0x7f505815a680 2023-10-09T06:32:31.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505cf98700 1 -- 172.21.15.31:0/3140301488 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732187402 0 0) 0x7f50580c5d80 con 0x7f505815a2b0 2023-10-09T06:32:31.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505d799700 1 --2- 172.21.15.31:0/3140301488 >> v2:172.21.15.158:3300/0 conn(0x7f50580d1c30 0x7f50580ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:31.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505e79b700 1 --2- 172.21.15.31:0/3140301488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505815a680 0x7f50580cf710 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f5058089190 tx=0x7f5048009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b9e34d6f0daf20 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:31.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505cf98700 1 -- 172.21.15.31:0/3140301488 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504800e070 con 0x7f505815a680 2023-10-09T06:32:31.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505cf98700 1 -- 172.21.15.31:0/3140301488 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504800ba50 con 0x7f505815a680 2023-10-09T06:32:31.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.739+0000 7f505cf98700 1 -- 172.21.15.31:0/3140301488 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480092e0 con 0x7f505815a680 2023-10-09T06:32:31.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.740+0000 7f50601fe700 1 -- 172.21.15.31:0/3140301488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505815a680 msgr2=0x7f50580cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:31.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.740+0000 7f50601fe700 1 --2- 172.21.15.31:0/3140301488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505815a680 0x7f50580cf710 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f5058089190 tx=0x7f5048009840 comp rx=0 tx=0).stop 2023-10-09T06:32:31.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.740+0000 7f50601fe700 1 -- 172.21.15.31:0/3140301488 shutdown_connections 2023-10-09T06:32:31.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.740+0000 7f50601fe700 1 --2- 172.21.15.31:0/3140301488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505815a680 0x7f50580cf710 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.740+0000 7f50601fe700 1 --2- 172.21.15.31:0/3140301488 >> v2:172.21.15.158:3300/0 conn(0x7f50580d1c30 0x7f50580ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.740+0000 7f50601fe700 1 -- 172.21.15.31:0/3140301488 >> 172.21.15.31:0/3140301488 conn(0x7f5058067e40 msgr2=0x7f50580d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:31.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.740+0000 7f50601fe700 1 -- 172.21.15.31:0/3140301488 shutdown_connections 2023-10-09T06:32:31.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.740+0000 7f50601fe700 1 -- 172.21.15.31:0/3140301488 wait complete. 2023-10-09T06:32:31.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.741+0000 7f50601fe700 1 Processor -- start 2023-10-09T06:32:31.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.741+0000 7f50601fe700 1 -- start start 2023-10-09T06:32:31.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f50601fe700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50580d1c30 0x7f50580c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:31.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f50601fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f505815a2b0 0x7f50580ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:31.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f50601fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505815a680 0x7f5058169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:31.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f50601fe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505815acb0 con 0x7f505815a680 2023-10-09T06:32:31.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f50601fe700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505816a2f0 con 0x7f505815a2b0 2023-10-09T06:32:31.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f50601fe700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505816a5b0 con 0x7f50580d1c30 2023-10-09T06:32:31.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f505e79b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505815a680 0x7f5058169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:31.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f505e79b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505815a680 0x7f5058169db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44078/0 (socket says 172.21.15.31:44078) 2023-10-09T06:32:31.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f505e79b700 1 -- 172.21.15.31:0/635016148 learned_addr learned my addr 172.21.15.31:0/635016148 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:31.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f505d799700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f505815a2b0 0x7f50580ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:31.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f505df9a700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50580d1c30 0x7f50580c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:31.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f505e79b700 1 -- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50580d1c30 msgr2=0x7f50580c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:31.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f505e79b700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50580d1c30 0x7f50580c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f505e79b700 1 -- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f505815a2b0 msgr2=0x7f50580ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:31.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f505e79b700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f505815a2b0 0x7f50580ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f505e79b700 1 -- 172.21.15.31:0/635016148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048009ae0 con 0x7f505815a680 2023-10-09T06:32:31.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f505e79b700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505815a680 0x7f5058169db0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f5048009ab0 tx=0x7f5048018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:31.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f5055ffb700 1 -- 172.21.15.31:0/635016148 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048008e80 con 0x7f505815a680 2023-10-09T06:32:31.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f5055ffb700 1 -- 172.21.15.31:0/635016148 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504800be60 con 0x7f505815a680 2023-10-09T06:32:31.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f5055ffb700 1 -- 172.21.15.31:0/635016148 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048025690 con 0x7f505815a680 2023-10-09T06:32:31.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.742+0000 7f50601fe700 1 -- 172.21.15.31:0/635016148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505816a890 con 0x7f505815a680 2023-10-09T06:32:31.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.743+0000 7f50601fe700 1 -- 172.21.15.31:0/635016148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5058157710 con 0x7f505815a680 2023-10-09T06:32:31.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.744+0000 7f50601fe700 1 -- 172.21.15.31:0/635016148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505804c3c0 con 0x7f505815a680 2023-10-09T06:32:31.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.744+0000 7f5055ffb700 1 -- 172.21.15.31:0/635016148 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5048003040 con 0x7f505815a680 2023-10-09T06:32:31.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.744+0000 7f5055ffb700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5044066f30 0x7f50440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:31.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.745+0000 7f5055ffb700 1 -- 172.21.15.31:0/635016148 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5048085b80 con 0x7f505815a680 2023-10-09T06:32:31.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.745+0000 7f505df9a700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5044066f30 0x7f50440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:31.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.745+0000 7f505df9a700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5044066f30 0x7f50440693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f505809b610 tx=0x7f5050009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:31.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.749+0000 7f5055ffb700 1 -- 172.21.15.31:0/635016148 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5048052ea0 con 0x7f505815a680 2023-10-09T06:32:31.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.944+0000 7f50601fe700 1 -- 172.21.15.31:0/635016148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f505815aa80 con 0x7f505815a680 2023-10-09T06:32:31.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.945+0000 7f5055ffb700 1 -- 172.21.15.31:0/635016148 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f50480564c0 con 0x7f505815a680 2023-10-09T06:32:31.945 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:31.946 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":188,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:32:26.806922+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:31:48.664093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T06:31:49.212701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:32:31.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.947+0000 7f50601fe700 1 -- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5044066f30 msgr2=0x7f50440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:31.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.947+0000 7f50601fe700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5044066f30 0x7f50440693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f505809b610 tx=0x7f5050009040 comp rx=0 tx=0).stop 2023-10-09T06:32:31.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.947+0000 7f50601fe700 1 -- 172.21.15.31:0/635016148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505815a680 msgr2=0x7f5058169db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.947+0000 7f50601fe700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505815a680 0x7f5058169db0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f5048009ab0 tx=0x7f5048018000 comp rx=0 tx=0).stop 2023-10-09T06:32:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.947+0000 7f50601fe700 1 -- 172.21.15.31:0/635016148 shutdown_connections 2023-10-09T06:32:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.947+0000 7f50601fe700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5044066f30 0x7f50440693e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.947+0000 7f50601fe700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50580d1c30 0x7f50580c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.947+0000 7f50601fe700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505815a680 0x7f5058169db0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.947+0000 7f50601fe700 1 --2- 172.21.15.31:0/635016148 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f505815a2b0 0x7f50580ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.947+0000 7f50601fe700 1 -- 172.21.15.31:0/635016148 >> 172.21.15.31:0/635016148 conn(0x7f5058067e40 msgr2=0x7f50580ccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.947+0000 7f50601fe700 1 -- 172.21.15.31:0/635016148 shutdown_connections 2023-10-09T06:32:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:31.947+0000 7f50601fe700 1 -- 172.21.15.31:0/635016148 wait complete. 2023-10-09T06:32:31.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:20:42.563520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:31:48.664093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:31:49.212701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '188', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:32:31.959 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:32:32.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.081+0000 7f1b8f3ae700 1 Processor -- start 2023-10-09T06:32:32.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.081+0000 7f1b8f3ae700 1 -- start start 2023-10-09T06:32:32.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8f3ae700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1b88159e60 0x7f1b8815e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8f3ae700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1b8815a230 0x7f1b880690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8f3ae700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b880695f0 0x7f1b880af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8f3ae700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b880d1cf0 con 0x7f1b8815a230 2023-10-09T06:32:32.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8f3ae700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b88069a70 con 0x7f1b88159e60 2023-10-09T06:32:32.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8f3ae700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8815ea90 con 0x7f1b880695f0 2023-10-09T06:32:32.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8c949700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1b8815a230 0x7f1b880690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8c949700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1b8815a230 0x7f1b880690b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44086/0 (socket says 172.21.15.31:44086) 2023-10-09T06:32:32.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8c949700 1 -- 172.21.15.31:0/2346803518 learned_addr learned my addr 172.21.15.31:0/2346803518 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:32.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8d94b700 1 --2- 172.21.15.31:0/2346803518 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b880695f0 0x7f1b880af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8d14a700 1 --2- 172.21.15.31:0/2346803518 >> v2:172.21.15.158:3300/0 conn(0x7f1b88159e60 0x7f1b8815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8c949700 1 -- 172.21.15.31:0/2346803518 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b880695f0 msgr2=0x7f1b880af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:32.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8c949700 1 --2- 172.21.15.31:0/2346803518 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b880695f0 0x7f1b880af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8c949700 1 -- 172.21.15.31:0/2346803518 >> v2:172.21.15.158:3300/0 conn(0x7f1b88159e60 msgr2=0x7f1b8815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:32.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8c949700 1 --2- 172.21.15.31:0/2346803518 >> v2:172.21.15.158:3300/0 conn(0x7f1b88159e60 0x7f1b8815e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8c949700 1 -- 172.21.15.31:0/2346803518 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b880b3100 con 0x7f1b8815a230 2023-10-09T06:32:32.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b8c949700 1 --2- 172.21.15.31:0/2346803518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b8815a230 0x7f1b880690b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1b880cdf30 tx=0x7f1b78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a095ae4505f0dd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:32.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.082+0000 7f1b7ffff700 1 -- 172.21.15.31:0/2346803518 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7800b640 con 0x7f1b8815a230 2023-10-09T06:32:32.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.083+0000 7f1b7ffff700 1 -- 172.21.15.31:0/2346803518 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7800b7a0 con 0x7f1b8815a230 2023-10-09T06:32:32.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.083+0000 7f1b7ffff700 1 -- 172.21.15.31:0/2346803518 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7800bb40 con 0x7f1b8815a230 2023-10-09T06:32:32.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.083+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/2346803518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b8815a230 msgr2=0x7f1b880690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.083+0000 7f1b8f3ae700 1 --2- 172.21.15.31:0/2346803518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b8815a230 0x7f1b880690b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1b880cdf30 tx=0x7f1b78009250 comp rx=0 tx=0).stop 2023-10-09T06:32:32.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.083+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/2346803518 shutdown_connections 2023-10-09T06:32:32.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.083+0000 7f1b8f3ae700 1 --2- 172.21.15.31:0/2346803518 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b880695f0 0x7f1b880af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.083+0000 7f1b8f3ae700 1 --2- 172.21.15.31:0/2346803518 >> v2:172.21.15.158:3300/0 conn(0x7f1b88159e60 0x7f1b8815e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.083+0000 7f1b8f3ae700 1 --2- 172.21.15.31:0/2346803518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b8815a230 0x7f1b880690b0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.083+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/2346803518 >> 172.21.15.31:0/2346803518 conn(0x7f1b88070700 msgr2=0x7f1b88070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:32.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.083+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/2346803518 shutdown_connections 2023-10-09T06:32:32.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.083+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/2346803518 wait complete. 2023-10-09T06:32:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.084+0000 7f1b8f3ae700 1 Processor -- start 2023-10-09T06:32:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.084+0000 7f1b8f3ae700 1 -- start start 2023-10-09T06:32:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8f3ae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b880695f0 0x7f1b8816d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8f3ae700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b88159e60 0x7f1b8815dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8f3ae700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b8815a230 0x7f1b8815ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8f3ae700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8816b070 con 0x7f1b880695f0 2023-10-09T06:32:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8f3ae700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8816a460 con 0x7f1b88159e60 2023-10-09T06:32:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8f3ae700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8816a740 con 0x7f1b8815a230 2023-10-09T06:32:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8d14a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b880695f0 0x7f1b8816d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8d14a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b880695f0 0x7f1b8816d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44102/0 (socket says 172.21.15.31:44102) 2023-10-09T06:32:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8d14a700 1 -- 172.21.15.31:0/1698174749 learned_addr learned my addr 172.21.15.31:0/1698174749 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8c949700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b88159e60 0x7f1b8815dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8d94b700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b8815a230 0x7f1b8815ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8d14a700 1 -- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b8815a230 msgr2=0x7f1b8815ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8d14a700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b8815a230 0x7f1b8815ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8d14a700 1 -- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b88159e60 msgr2=0x7f1b8815dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8d14a700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b88159e60 0x7f1b8815dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.085+0000 7f1b8d14a700 1 -- 172.21.15.31:0/1698174749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b780094f0 con 0x7f1b880695f0 2023-10-09T06:32:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.086+0000 7f1b8d94b700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b8815a230 0x7f1b8815ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.086+0000 7f1b8d14a700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b880695f0 0x7f1b8816d320 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400ec80 tx=0x7f1b840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.086+0000 7f1b7d7fa700 1 -- 172.21.15.31:0/1698174749 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8400c850 con 0x7f1b880695f0 2023-10-09T06:32:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.086+0000 7f1b7d7fa700 1 -- 172.21.15.31:0/1698174749 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8400c9b0 con 0x7f1b880695f0 2023-10-09T06:32:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.086+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/1698174749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8816aa20 con 0x7f1b880695f0 2023-10-09T06:32:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.086+0000 7f1b7d7fa700 1 -- 172.21.15.31:0/1698174749 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8400cd50 con 0x7f1b880695f0 2023-10-09T06:32:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.086+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/1698174749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8815d080 con 0x7f1b880695f0 2023-10-09T06:32:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.087+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/1698174749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8804c3c0 con 0x7f1b880695f0 2023-10-09T06:32:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.087+0000 7f1b7d7fa700 1 -- 172.21.15.31:0/1698174749 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b84013680 con 0x7f1b880695f0 2023-10-09T06:32:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.088+0000 7f1b7d7fa700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1b6c066f30 0x7f1b6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.088+0000 7f1b7d7fa700 1 -- 172.21.15.31:0/1698174749 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b840847f0 con 0x7f1b880695f0 2023-10-09T06:32:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.088+0000 7f1b8c949700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1b6c066f30 0x7f1b6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.088+0000 7f1b8c949700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1b6c066f30 0x7f1b6c0693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1b880cdf30 tx=0x7f1b78017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:32.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.092+0000 7f1b7d7fa700 1 -- 172.21.15.31:0/1698174749 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b84051a60 con 0x7f1b880695f0 2023-10-09T06:32:32.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.281+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/1698174749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b880cca70 con 0x7f1b880695f0 2023-10-09T06:32:32.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.282+0000 7f1b7d7fa700 1 -- 172.21.15.31:0/1698174749 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v188) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b84055080 con 0x7f1b880695f0 2023-10-09T06:32:32.283 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-10-09T06:32:32.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.284+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1b6c066f30 msgr2=0x7f1b6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.284+0000 7f1b8f3ae700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1b6c066f30 0x7f1b6c0693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1b880cdf30 tx=0x7f1b78017000 comp rx=0 tx=0).stop 2023-10-09T06:32:32.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.284+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/1698174749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b880695f0 msgr2=0x7f1b8816d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.284+0000 7f1b8f3ae700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b880695f0 0x7f1b8816d320 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400ec80 tx=0x7f1b840091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.284+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/1698174749 shutdown_connections 2023-10-09T06:32:32.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.284+0000 7f1b8f3ae700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1b6c066f30 0x7f1b6c0693e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.284+0000 7f1b8f3ae700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1b8815a230 0x7f1b8815ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.284+0000 7f1b8f3ae700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b880695f0 0x7f1b8816d320 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.284+0000 7f1b8f3ae700 1 --2- 172.21.15.31:0/1698174749 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b88159e60 0x7f1b8815dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.284+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/1698174749 >> 172.21.15.31:0/1698174749 conn(0x7f1b88070700 msgr2=0x7f1b88159260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:32.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.284+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/1698174749 shutdown_connections 2023-10-09T06:32:32.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.284+0000 7f1b8f3ae700 1 -- 172.21.15.31:0/1698174749 wait complete. 2023-10-09T06:32:32.296 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:32:32.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.418+0000 7f097b1e4700 1 Processor -- start 2023-10-09T06:32:32.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.418+0000 7f097b1e4700 1 -- start start 2023-10-09T06:32:32.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f097b1e4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f09740cc6b0 0x7f097406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f097b1e4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f097406f890 0x7f09740aba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f097b1e4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097406e5e0 con 0x7f09740cc2e0 2023-10-09T06:32:32.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f097b1e4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097406efb0 con 0x7f09740cc6b0 2023-10-09T06:32:32.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f097b1e4700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097406d9d0 con 0x7f097406f890 2023-10-09T06:32:32.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f0973fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f09740cc6b0 0x7f097406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f0973fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f09740cc6b0 0x7f097406ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44104/0 (socket says 172.21.15.31:44104) 2023-10-09T06:32:32.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f0973fff700 1 -- 172.21.15.31:0/1061257409 learned_addr learned my addr 172.21.15.31:0/1061257409 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:32.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f0978f80700 1 --1- 172.21.15.31:0/1061257409 >> v1:172.21.15.31:6789/0 conn(0x7f09740cc2e0 0x7f097406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32874/0 (socket says 172.21.15.31:32874) 2023-10-09T06:32:32.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f0979781700 1 --2- 172.21.15.31:0/1061257409 >> v2:172.21.15.158:3300/0 conn(0x7f097406f890 0x7f09740aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f0973fff700 1 -- 172.21.15.31:0/1061257409 >> v2:172.21.15.158:3300/0 conn(0x7f097406f890 msgr2=0x7f09740aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:32.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f0973fff700 1 --2- 172.21.15.31:0/1061257409 >> v2:172.21.15.158:3300/0 conn(0x7f097406f890 0x7f09740aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f0973fff700 1 -- 172.21.15.31:0/1061257409 >> v1:172.21.15.31:6789/0 conn(0x7f09740cc2e0 legacy=0x7f097406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f0973fff700 1 -- 172.21.15.31:0/1061257409 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097406dcb0 con 0x7f09740cc6b0 2023-10-09T06:32:32.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f0973fff700 1 --2- 172.21.15.31:0/1061257409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09740cc6b0 0x7f097406ea70 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f0974063e90 tx=0x7f0964009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c726fea685b10c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:32.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f09737fe700 1 -- 172.21.15.31:0/1061257409 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964009e70 con 0x7f09740cc6b0 2023-10-09T06:32:32.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f09737fe700 1 -- 172.21.15.31:0/1061257409 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096400b760 con 0x7f09740cc6b0 2023-10-09T06:32:32.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.419+0000 7f09737fe700 1 -- 172.21.15.31:0/1061257409 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096400bb00 con 0x7f09740cc6b0 2023-10-09T06:32:32.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.420+0000 7f097b1e4700 1 -- 172.21.15.31:0/1061257409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09740cc6b0 msgr2=0x7f097406ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.420+0000 7f097b1e4700 1 --2- 172.21.15.31:0/1061257409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09740cc6b0 0x7f097406ea70 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f0974063e90 tx=0x7f0964009250 comp rx=0 tx=0).stop 2023-10-09T06:32:32.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.420+0000 7f097b1e4700 1 -- 172.21.15.31:0/1061257409 shutdown_connections 2023-10-09T06:32:32.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.420+0000 7f097b1e4700 1 --2- 172.21.15.31:0/1061257409 >> v2:172.21.15.158:3300/0 conn(0x7f097406f890 0x7f09740aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.420+0000 7f097b1e4700 1 --2- 172.21.15.31:0/1061257409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09740cc6b0 0x7f097406ea70 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.420+0000 7f097b1e4700 1 -- 172.21.15.31:0/1061257409 >> 172.21.15.31:0/1061257409 conn(0x7f0974068170 msgr2=0x7f09740cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:32.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.420+0000 7f097b1e4700 1 -- 172.21.15.31:0/1061257409 shutdown_connections 2023-10-09T06:32:32.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.420+0000 7f097b1e4700 1 -- 172.21.15.31:0/1061257409 wait complete. 2023-10-09T06:32:32.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.421+0000 7f097b1e4700 1 Processor -- start 2023-10-09T06:32:32.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.421+0000 7f097b1e4700 1 -- start start 2023-10-09T06:32:32.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f097b1e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f097406f890 0x7f0974169e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f097b1e4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09740cc2e0 0x7f0974156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f097b1e4700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09740cc6b0 0x7f0974156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f097b1e4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09740c9440 con 0x7f097406f890 2023-10-09T06:32:32.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f097b1e4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0974098890 con 0x7f09740cc2e0 2023-10-09T06:32:32.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f097b1e4700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0974156da0 con 0x7f09740cc6b0 2023-10-09T06:32:32.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f0978f80700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f097406f890 0x7f0974169e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f0978f80700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f097406f890 0x7f0974169e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44110/0 (socket says 172.21.15.31:44110) 2023-10-09T06:32:32.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f0978f80700 1 -- 172.21.15.31:0/3610531071 learned_addr learned my addr 172.21.15.31:0/3610531071 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:32.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f0978f80700 1 -- 172.21.15.31:0/3610531071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09740cc6b0 msgr2=0x7f0974156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f0978f80700 1 --2- 172.21.15.31:0/3610531071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09740cc6b0 0x7f0974156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f0978f80700 1 -- 172.21.15.31:0/3610531071 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09740cc2e0 msgr2=0x7f0974156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f0978f80700 1 --2- 172.21.15.31:0/3610531071 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09740cc2e0 0x7f0974156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.422+0000 7f0978f80700 1 -- 172.21.15.31:0/3610531071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09640094f0 con 0x7f097406f890 2023-10-09T06:32:32.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.423+0000 7f0978f80700 1 --2- 172.21.15.31:0/3610531071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f097406f890 0x7f0974169e90 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f096c00cf40 tx=0x7f096c001ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:32.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.423+0000 7f0970ff9700 1 -- 172.21.15.31:0/3610531071 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c005df0 con 0x7f097406f890 2023-10-09T06:32:32.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.423+0000 7f0970ff9700 1 -- 172.21.15.31:0/3610531071 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c00aaa0 con 0x7f097406f890 2023-10-09T06:32:32.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.423+0000 7f097b1e4700 1 -- 172.21.15.31:0/3610531071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09740c9160 con 0x7f097406f890 2023-10-09T06:32:32.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.423+0000 7f0970ff9700 1 -- 172.21.15.31:0/3610531071 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c00ae60 con 0x7f097406f890 2023-10-09T06:32:32.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.423+0000 7f097b1e4700 1 -- 172.21.15.31:0/3610531071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0974098520 con 0x7f097406f890 2023-10-09T06:32:32.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.424+0000 7f097b1e4700 1 -- 172.21.15.31:0/3610531071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097404c3c0 con 0x7f097406f890 2023-10-09T06:32:32.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.424+0000 7f0970ff9700 1 -- 172.21.15.31:0/3610531071 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f096c007300 con 0x7f097406f890 2023-10-09T06:32:32.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.424+0000 7f0970ff9700 1 --2- 172.21.15.31:0/3610531071 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0954066f30 0x7f09540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.425+0000 7f0970ff9700 1 -- 172.21.15.31:0/3610531071 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f096c0848b0 con 0x7f097406f890 2023-10-09T06:32:32.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.425+0000 7f0973fff700 1 --2- 172.21.15.31:0/3610531071 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0954066f30 0x7f09540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.425+0000 7f0973fff700 1 --2- 172.21.15.31:0/3610531071 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0954066f30 0x7f09540693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0974063e90 tx=0x7f0964016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:32.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.429+0000 7f0970ff9700 1 -- 172.21.15.31:0/3610531071 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f096c051ba0 con 0x7f097406f890 2023-10-09T06:32:32.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.623+0000 7f097b1e4700 1 -- 172.21.15.31:0/3610531071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f097406df90 con 0x7f097406f890 2023-10-09T06:32:32.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.623+0000 7f0970ff9700 1 -- 172.21.15.31:0/3610531071 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v188) v1 ==== 104+0+11 (secure 0 0 0) 0x7f096c0551c0 con 0x7f097406f890 2023-10-09T06:32:32.624 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-10-09T06:32:32.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.625+0000 7f097b1e4700 1 -- 172.21.15.31:0/3610531071 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0954066f30 msgr2=0x7f09540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.625+0000 7f097b1e4700 1 --2- 172.21.15.31:0/3610531071 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0954066f30 0x7f09540693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0974063e90 tx=0x7f0964016000 comp rx=0 tx=0).stop 2023-10-09T06:32:32.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.625+0000 7f097b1e4700 1 -- 172.21.15.31:0/3610531071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f097406f890 msgr2=0x7f0974169e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.625+0000 7f097b1e4700 1 --2- 172.21.15.31:0/3610531071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f097406f890 0x7f0974169e90 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f096c00cf40 tx=0x7f096c001ce0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.625+0000 7f097b1e4700 1 -- 172.21.15.31:0/3610531071 shutdown_connections 2023-10-09T06:32:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.625+0000 7f097b1e4700 1 --2- 172.21.15.31:0/3610531071 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0954066f30 0x7f09540693e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.625+0000 7f097b1e4700 1 --2- 172.21.15.31:0/3610531071 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f09740cc6b0 0x7f0974156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.625+0000 7f097b1e4700 1 --2- 172.21.15.31:0/3610531071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f097406f890 0x7f0974169e90 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.625+0000 7f097b1e4700 1 --2- 172.21.15.31:0/3610531071 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09740cc2e0 0x7f0974156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.625+0000 7f097b1e4700 1 -- 172.21.15.31:0/3610531071 >> 172.21.15.31:0/3610531071 conn(0x7f0974068170 msgr2=0x7f0974150710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.626+0000 7f097b1e4700 1 -- 172.21.15.31:0/3610531071 shutdown_connections 2023-10-09T06:32:32.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.626+0000 7f097b1e4700 1 -- 172.21.15.31:0/3610531071 wait complete. 2023-10-09T06:32:32.638 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:32:32.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.759+0000 7ffa8a2aa700 1 Processor -- start 2023-10-09T06:32:32.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.759+0000 7ffa8a2aa700 1 -- start start 2023-10-09T06:32:32.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.760+0000 7ffa8a2aa700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ffa8415a300 0x7ffa8415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.760+0000 7ffa8a2aa700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa840cc760 con 0x7ffa8415cec0 2023-10-09T06:32:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.760+0000 7ffa8a2aa700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8415b460 con 0x7ffa8415ac10 2023-10-09T06:32:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.760+0000 7ffa8a2aa700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa8415ba20 con 0x7ffa8415a300 2023-10-09T06:32:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.760+0000 7ffa89aa9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ffa8415cec0 0x7ffa841638c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32884/0 (socket says 172.21.15.31:32884) 2023-10-09T06:32:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.760+0000 7ffa89aa9700 1 -- 172.21.15.31:0/1824483956 learned_addr learned my addr 172.21.15.31:0/1824483956 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.760+0000 7ffa892a8700 1 --2- 172.21.15.31:0/1824483956 >> v2:172.21.15.158:3300/0 conn(0x7ffa8415a300 0x7ffa8415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.760+0000 7ffa83fff700 1 -- 172.21.15.31:0/1824483956 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926418763 0 0) 0x7ffa840cc760 con 0x7ffa8415cec0 2023-10-09T06:32:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.760+0000 7ffa83fff700 1 -- 172.21.15.31:0/1824483956 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa6c003570 con 0x7ffa8415cec0 2023-10-09T06:32:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.761+0000 7ffa892a8700 1 -- 172.21.15.31:0/1824483956 >> v1:172.21.15.158:6789/0 conn(0x7ffa8415ac10 legacy=0x7ffa840cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.761+0000 7ffa892a8700 1 -- 172.21.15.31:0/1824483956 >> v1:172.21.15.31:6789/0 conn(0x7ffa8415cec0 legacy=0x7ffa841638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.761+0000 7ffa892a8700 1 -- 172.21.15.31:0/1824483956 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa840cc1a0 con 0x7ffa8415a300 2023-10-09T06:32:32.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.761+0000 7ffa892a8700 1 --2- 172.21.15.31:0/1824483956 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa8415a300 0x7ffa8415a6d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009eb0 tx=0x7ffa7c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25450e249c336d94 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:32.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.761+0000 7ffa83fff700 1 -- 172.21.15.31:0/1824483956 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00e070 con 0x7ffa8415a300 2023-10-09T06:32:32.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.761+0000 7ffa83fff700 1 -- 172.21.15.31:0/1824483956 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c00bc30 con 0x7ffa8415a300 2023-10-09T06:32:32.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.761+0000 7ffa83fff700 1 -- 172.21.15.31:0/1824483956 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c012430 con 0x7ffa8415a300 2023-10-09T06:32:32.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.761+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/1824483956 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa8415a300 msgr2=0x7ffa8415a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.761+0000 7ffa8a2aa700 1 --2- 172.21.15.31:0/1824483956 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa8415a300 0x7ffa8415a6d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009eb0 tx=0x7ffa7c009780 comp rx=0 tx=0).stop 2023-10-09T06:32:32.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.761+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/1824483956 shutdown_connections 2023-10-09T06:32:32.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.761+0000 7ffa8a2aa700 1 --2- 172.21.15.31:0/1824483956 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa8415a300 0x7ffa8415a6d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.761+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/1824483956 >> 172.21.15.31:0/1824483956 conn(0x7ffa84099f50 msgr2=0x7ffa84067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:32.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.762+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/1824483956 shutdown_connections 2023-10-09T06:32:32.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.762+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/1824483956 wait complete. 2023-10-09T06:32:32.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.763+0000 7ffa8a2aa700 1 Processor -- start 2023-10-09T06:32:32.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.763+0000 7ffa8a2aa700 1 -- start start 2023-10-09T06:32:32.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.763+0000 7ffa8a2aa700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa8415a300 0x7ffa840c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa8a2aa700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa8415ac10 0x7ffa8414fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa8a2aa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa8415cec0 0x7ffa840c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa8a2aa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840c9a30 con 0x7ffa8415cec0 2023-10-09T06:32:32.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa8a2aa700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840c8e20 con 0x7ffa8415ac10 2023-10-09T06:32:32.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa8a2aa700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840c9100 con 0x7ffa8415a300 2023-10-09T06:32:32.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa89aa9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa8415cec0 0x7ffa840c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa89aa9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa8415cec0 0x7ffa840c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44126/0 (socket says 172.21.15.31:44126) 2023-10-09T06:32:32.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa89aa9700 1 -- 172.21.15.31:0/3987867699 learned_addr learned my addr 172.21.15.31:0/3987867699 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:32.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa88aa7700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa8415ac10 0x7ffa8414fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa892a8700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa8415a300 0x7ffa840c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa89aa9700 1 -- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa8415a300 msgr2=0x7ffa840c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa89aa9700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa8415a300 0x7ffa840c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa89aa9700 1 -- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa8415ac10 msgr2=0x7ffa8414fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa89aa9700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa8415ac10 0x7ffa8414fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa89aa9700 1 -- 172.21.15.31:0/3987867699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c009a20 con 0x7ffa8415cec0 2023-10-09T06:32:32.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa89aa9700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa8415cec0 0x7ffa840c5050 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7ffa740010e0 tx=0x7ffa74007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:32.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa817fa700 1 -- 172.21.15.31:0/3987867699 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74005c00 con 0x7ffa8415cec0 2023-10-09T06:32:32.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa817fa700 1 -- 172.21.15.31:0/3987867699 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa74005d60 con 0x7ffa8415cec0 2023-10-09T06:32:32.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/3987867699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa840c93e0 con 0x7ffa8415cec0 2023-10-09T06:32:32.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa817fa700 1 -- 172.21.15.31:0/3987867699 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa740072e0 con 0x7ffa8415cec0 2023-10-09T06:32:32.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.764+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/3987867699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa840c8a80 con 0x7ffa8415cec0 2023-10-09T06:32:32.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.765+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/3987867699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa840c9be0 con 0x7ffa8415cec0 2023-10-09T06:32:32.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.766+0000 7ffa817fa700 1 -- 172.21.15.31:0/3987867699 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa7401b3b0 con 0x7ffa8415cec0 2023-10-09T06:32:32.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.766+0000 7ffa817fa700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffa70066f30 0x7ffa700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:32.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.766+0000 7ffa817fa700 1 -- 172.21.15.31:0/3987867699 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa74083830 con 0x7ffa8415cec0 2023-10-09T06:32:32.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.766+0000 7ffa892a8700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffa70066f30 0x7ffa700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:32.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.767+0000 7ffa892a8700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffa70066f30 0x7ffa700693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009eb0 tx=0x7ffa7c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:32.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.770+0000 7ffa817fa700 1 -- 172.21.15.31:0/3987867699 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa7404b5a0 con 0x7ffa8415cec0 2023-10-09T06:32:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.963+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/3987867699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa8406ada0 con 0x7ffa8415cec0 2023-10-09T06:32:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.964+0000 7ffa817fa700 1 -- 172.21.15.31:0/3987867699 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v188) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa74017070 con 0x7ffa8415cec0 2023-10-09T06:32:32.964 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-10-09T06:32:32.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.965+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffa70066f30 msgr2=0x7ffa700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.965+0000 7ffa8a2aa700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffa70066f30 0x7ffa700693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009eb0 tx=0x7ffa7c019000 comp rx=0 tx=0).stop 2023-10-09T06:32:32.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.965+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/3987867699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa8415cec0 msgr2=0x7ffa840c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:32.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.965+0000 7ffa8a2aa700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa8415cec0 0x7ffa840c5050 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7ffa740010e0 tx=0x7ffa74007dd0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.965+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/3987867699 shutdown_connections 2023-10-09T06:32:32.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.965+0000 7ffa8a2aa700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ffa70066f30 0x7ffa700693e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.965+0000 7ffa8a2aa700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ffa8415a300 0x7ffa840c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.965+0000 7ffa8a2aa700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa8415cec0 0x7ffa840c5050 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.965+0000 7ffa8a2aa700 1 --2- 172.21.15.31:0/3987867699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa8415ac10 0x7ffa8414fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:32.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.965+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/3987867699 >> 172.21.15.31:0/3987867699 conn(0x7ffa84099f50 msgr2=0x7ffa84067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:32.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.965+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/3987867699 shutdown_connections 2023-10-09T06:32:32.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:32.965+0000 7ffa8a2aa700 1 -- 172.21.15.31:0/3987867699 wait complete. 2023-10-09T06:32:32.978 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:32:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.096+0000 7f1c67f5d700 1 Processor -- start 2023-10-09T06:32:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.097+0000 7f1c67f5d700 1 -- start start 2023-10-09T06:32:33.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.097+0000 7f1c67f5d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1c60143a00 0x7f1c6006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.097+0000 7f1c67f5d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1c6006aa20 0x7f1c600b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.097+0000 7f1c67f5d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6006ae60 con 0x7f1c60143630 2023-10-09T06:32:33.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.097+0000 7f1c67f5d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c600b3380 con 0x7f1c60143a00 2023-10-09T06:32:33.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.097+0000 7f1c67f5d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600b3b70 con 0x7f1c6006aa20 2023-10-09T06:32:33.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.098+0000 7f1c654f8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1c60143a00 0x7f1c6006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.098+0000 7f1c654f8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1c60143a00 0x7f1c6006a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44142/0 (socket says 172.21.15.31:44142) 2023-10-09T06:32:33.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.098+0000 7f1c654f8700 1 -- 172.21.15.31:0/2999974464 learned_addr learned my addr 172.21.15.31:0/2999974464 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:33.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.098+0000 7f1c664fa700 1 --2- 172.21.15.31:0/2999974464 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1c6006aa20 0x7f1c600b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.098+0000 7f1c654f8700 1 -- 172.21.15.31:0/2999974464 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1c6006aa20 msgr2=0x7f1c600b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:33.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.098+0000 7f1c654f8700 1 --2- 172.21.15.31:0/2999974464 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1c6006aa20 0x7f1c600b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.098+0000 7f1c654f8700 1 -- 172.21.15.31:0/2999974464 >> v1:172.21.15.158:6789/0 conn(0x7f1c60143630 legacy=0x7f1c600cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.098+0000 7f1c654f8700 1 -- 172.21.15.31:0/2999974464 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600b3e50 con 0x7f1c60143a00 2023-10-09T06:32:33.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.098+0000 7f1c664fa700 1 --2- 172.21.15.31:0/2999974464 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1c6006aa20 0x7f1c600b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:33.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.098+0000 7f1c654f8700 1 --2- 172.21.15.31:0/2999974464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c60143a00 0x7f1c6006a4e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f1c540099b0 tx=0x7f1c54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507e3ef15eb51f79 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:33.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.098+0000 7f1c64cf7700 1 -- 172.21.15.31:0/2999974464 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400b860 con 0x7f1c60143a00 2023-10-09T06:32:33.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.098+0000 7f1c64cf7700 1 -- 172.21.15.31:0/2999974464 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5400b9c0 con 0x7f1c60143a00 2023-10-09T06:32:33.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.098+0000 7f1c64cf7700 1 -- 172.21.15.31:0/2999974464 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400bd60 con 0x7f1c60143a00 2023-10-09T06:32:33.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.099+0000 7f1c67f5d700 1 -- 172.21.15.31:0/2999974464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c60143a00 msgr2=0x7f1c6006a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.099+0000 7f1c67f5d700 1 --2- 172.21.15.31:0/2999974464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c60143a00 0x7f1c6006a4e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f1c540099b0 tx=0x7f1c54009250 comp rx=0 tx=0).stop 2023-10-09T06:32:33.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.099+0000 7f1c67f5d700 1 -- 172.21.15.31:0/2999974464 shutdown_connections 2023-10-09T06:32:33.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.099+0000 7f1c67f5d700 1 --2- 172.21.15.31:0/2999974464 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1c6006aa20 0x7f1c600b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.099+0000 7f1c67f5d700 1 --2- 172.21.15.31:0/2999974464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c60143a00 0x7f1c6006a4e0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.099+0000 7f1c67f5d700 1 -- 172.21.15.31:0/2999974464 >> 172.21.15.31:0/2999974464 conn(0x7f1c60069760 msgr2=0x7f1c600b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:33.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.099+0000 7f1c67f5d700 1 -- 172.21.15.31:0/2999974464 shutdown_connections 2023-10-09T06:32:33.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.099+0000 7f1c67f5d700 1 -- 172.21.15.31:0/2999974464 wait complete. 2023-10-09T06:32:33.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.100+0000 7f1c67f5d700 1 Processor -- start 2023-10-09T06:32:33.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.100+0000 7f1c67f5d700 1 -- start start 2023-10-09T06:32:33.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c67f5d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1c6006aa20 0x7f1c6016a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c67f5d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c60143630 0x7f1c600c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c67f5d700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1c60143a00 0x7f1c60142340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c67f5d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6015e280 con 0x7f1c60143630 2023-10-09T06:32:33.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c67f5d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c60157de0 con 0x7f1c6006aa20 2023-10-09T06:32:33.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c67f5d700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c60158030 con 0x7f1c60143a00 2023-10-09T06:32:33.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c654f8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c60143630 0x7f1c600c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c654f8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c60143630 0x7f1c600c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44158/0 (socket says 172.21.15.31:44158) 2023-10-09T06:32:33.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c654f8700 1 -- 172.21.15.31:0/816748688 learned_addr learned my addr 172.21.15.31:0/816748688 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:33.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c664fa700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1c60143a00 0x7f1c60142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c65cf9700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1c6006aa20 0x7f1c6016a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c654f8700 1 -- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1c60143a00 msgr2=0x7f1c60142340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c654f8700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1c60143a00 0x7f1c60142340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c654f8700 1 -- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1c6006aa20 msgr2=0x7f1c6016a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c654f8700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1c6006aa20 0x7f1c6016a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c654f8700 1 -- 172.21.15.31:0/816748688 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c540094f0 con 0x7f1c60143630 2023-10-09T06:32:33.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c664fa700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1c60143a00 0x7f1c60142340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:33.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c65cf9700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1c6006aa20 0x7f1c6016a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:33.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c654f8700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c60143630 0x7f1c600c6c20 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009290 tx=0x7f1c54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:33.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c5dffb700 1 -- 172.21.15.31:0/816748688 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54026480 con 0x7f1c60143630 2023-10-09T06:32:33.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c5dffb700 1 -- 172.21.15.31:0/816748688 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5401f070 con 0x7f1c60143630 2023-10-09T06:32:33.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c67f5d700 1 -- 172.21.15.31:0/816748688 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c60158310 con 0x7f1c60143630 2023-10-09T06:32:33.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.101+0000 7f1c5dffb700 1 -- 172.21.15.31:0/816748688 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54026830 con 0x7f1c60143630 2023-10-09T06:32:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.102+0000 7f1c67f5d700 1 -- 172.21.15.31:0/816748688 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c601586a0 con 0x7f1c60143630 2023-10-09T06:32:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.103+0000 7f1c67f5d700 1 -- 172.21.15.31:0/816748688 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c60158b10 con 0x7f1c60143630 2023-10-09T06:32:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.103+0000 7f1c5dffb700 1 -- 172.21.15.31:0/816748688 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c54026ba0 con 0x7f1c60143630 2023-10-09T06:32:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.103+0000 7f1c5dffb700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1c4c066f30 0x7f1c4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.103+0000 7f1c5dffb700 1 -- 172.21.15.31:0/816748688 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c54021070 con 0x7f1c60143630 2023-10-09T06:32:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.104+0000 7f1c65cf9700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1c4c066f30 0x7f1c4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.104+0000 7f1c65cf9700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1c4c066f30 0x7f1c4c0693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1c58007fd0 tx=0x7f1c58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:33.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.108+0000 7f1c5dffb700 1 -- 172.21.15.31:0/816748688 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c60158b10 con 0x7f1c60143630 2023-10-09T06:32:33.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.344+0000 7f1c67f5d700 1 -- 172.21.15.31:0/816748688 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c60158b10 con 0x7f1c60143630 2023-10-09T06:32:33.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.344+0000 7f1c5dffb700 1 -- 172.21.15.31:0/816748688 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f1c60158b10 con 0x7f1c60143630 2023-10-09T06:32:33.345 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:33.345 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/3503727793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3503727793},{"type":"v1","addr":"172.21.15.158:6837","nonce":3503727793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2366061673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2366061673},{"type":"v1","addr":"172.21.15.158:6836","nonce":2366061673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3405107978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3405107978},{"type":"v1","addr":"172.21.15.31:6834","nonce":3405107978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:31:50.242464+0000","modified":"2023-10-09T06:31:53.876299+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8079":{"gid":8079,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4124393323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4124393323},{"type":"v1","addr":"172.21.15.31:6835","nonce":4124393323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T06:32:33.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.346+0000 7f1c67f5d700 1 -- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1c4c066f30 msgr2=0x7f1c4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.346+0000 7f1c67f5d700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1c4c066f30 0x7f1c4c0693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1c58007fd0 tx=0x7f1c58009040 comp rx=0 tx=0).stop 2023-10-09T06:32:33.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.346+0000 7f1c67f5d700 1 -- 172.21.15.31:0/816748688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c60143630 msgr2=0x7f1c600c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.346+0000 7f1c67f5d700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c60143630 0x7f1c600c6c20 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009290 tx=0x7f1c54017000 comp rx=0 tx=0).stop 2023-10-09T06:32:33.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.346+0000 7f1c67f5d700 1 -- 172.21.15.31:0/816748688 shutdown_connections 2023-10-09T06:32:33.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.346+0000 7f1c67f5d700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f1c4c066f30 0x7f1c4c0693e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.346+0000 7f1c67f5d700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f1c60143a00 0x7f1c60142340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.346+0000 7f1c67f5d700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1c6006aa20 0x7f1c6016a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.346+0000 7f1c67f5d700 1 --2- 172.21.15.31:0/816748688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c60143630 0x7f1c600c6c20 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.346+0000 7f1c67f5d700 1 -- 172.21.15.31:0/816748688 >> 172.21.15.31:0/816748688 conn(0x7f1c60069760 msgr2=0x7f1c600b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:33.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.346+0000 7f1c67f5d700 1 -- 172.21.15.31:0/816748688 shutdown_connections 2023-10-09T06:32:33.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.346+0000 7f1c67f5d700 1 -- 172.21.15.31:0/816748688 wait complete. 2023-10-09T06:32:33.349 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 89 2023-10-09T06:32:33.359 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:32:33.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.477+0000 7f3d72930700 1 Processor -- start 2023-10-09T06:32:33.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.477+0000 7f3d72930700 1 -- start start 2023-10-09T06:32:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.478+0000 7f3d72930700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c15a620 0x7f3d6c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.478+0000 7f3d72930700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c15cbb0 con 0x7f3d6c157870 2023-10-09T06:32:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.478+0000 7f3d72930700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c15bfa0 con 0x7f3d6c15d580 2023-10-09T06:32:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.478+0000 7f3d72930700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c15bdb0 con 0x7f3d6c15a620 2023-10-09T06:32:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.478+0000 7f3d6bfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3d6c157870 0x7f3d6c15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32890/0 (socket says 172.21.15.31:32890) 2023-10-09T06:32:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.478+0000 7f3d6bfff700 1 -- 172.21.15.31:0/387591354 learned_addr learned my addr 172.21.15.31:0/387591354 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.478+0000 7f3d6b7fe700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c15a620 0x7f3d6c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.478+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848368575 0 0) 0x7f3d6c15cbb0 con 0x7f3d6c157870 2023-10-09T06:32:33.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d54003570 con 0x7f3d6c157870 2023-10-09T06:32:33.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48792881 0 0) 0x7f3d6c15bfa0 con 0x7f3d6c15d580 2023-10-09T06:32:33.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d6c15cbb0 con 0x7f3d6c15d580 2023-10-09T06:32:33.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 425784625 0 0) 0x7f3d54003570 con 0x7f3d6c157870 2023-10-09T06:32:33.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c15a620 msgr2=0x7f3d6c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:33.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c15a620 0x7f3d6c15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 >> v1:172.21.15.158:6789/0 conn(0x7f3d6c15d580 legacy=0x7f3d6c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c15c280 con 0x7f3d6c157870 2023-10-09T06:32:33.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f3d5c001470 con 0x7f3d6c157870 2023-10-09T06:32:33.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 >> v1:172.21.15.31:6789/0 conn(0x7f3d6c157870 legacy=0x7f3d6c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c15a620 0x7f3d54003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d540041d0 0x7f3d54004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d54004d50 0x7f3d540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5400bbf0 con 0x7f3d54004d50 2023-10-09T06:32:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5400bd30 con 0x7f3d540041d0 2023-10-09T06:32:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5400bef0 con 0x7f3d6c15a620 2023-10-09T06:32:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d70ecd700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d54004d50 0x7f3d540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6bfff700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c15a620 0x7f3d54003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6b7fe700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d540041d0 0x7f3d54004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d70ecd700 1 -- 172.21.15.31:0/387591354 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c15a620 msgr2=0x7f3d54003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d70ecd700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c15a620 0x7f3d54003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d70ecd700 1 -- 172.21.15.31:0/387591354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d540041d0 msgr2=0x7f3d54004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d70ecd700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d540041d0 0x7f3d54004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d70ecd700 1 -- 172.21.15.31:0/387591354 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d54003570 con 0x7f3d54004d50 2023-10-09T06:32:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6bfff700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c15a620 0x7f3d54003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d6b7fe700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d540041d0 0x7f3d54004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.479+0000 7f3d70ecd700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d54004d50 0x7f3d540051c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f3d640020f0 tx=0x7f3d640017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef58000d377a7266 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.480+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6400c8b0 con 0x7f3d54004d50 2023-10-09T06:32:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.480+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6400ca10 con 0x7f3d54004d50 2023-10-09T06:32:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.480+0000 7f3d6affd700 1 -- 172.21.15.31:0/387591354 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6400cdb0 con 0x7f3d54004d50 2023-10-09T06:32:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.480+0000 7f3d72930700 1 -- 172.21.15.31:0/387591354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d54004d50 msgr2=0x7f3d540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.480+0000 7f3d72930700 1 --2- 172.21.15.31:0/387591354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d54004d50 0x7f3d540051c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f3d640020f0 tx=0x7f3d640017a0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.480+0000 7f3d70ecd700 1 -- 172.21.15.31:0/387591354 reap_dead start 2023-10-09T06:32:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.480+0000 7f3d72930700 1 -- 172.21.15.31:0/387591354 shutdown_connections 2023-10-09T06:32:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.480+0000 7f3d72930700 1 -- 172.21.15.31:0/387591354 >> 172.21.15.31:0/387591354 conn(0x7f3d6c068ce0 msgr2=0x7f3d6c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.480+0000 7f3d72930700 1 -- 172.21.15.31:0/387591354 shutdown_connections 2023-10-09T06:32:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.480+0000 7f3d72930700 1 -- 172.21.15.31:0/387591354 wait complete. 2023-10-09T06:32:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.481+0000 7f3d72930700 1 Processor -- start 2023-10-09T06:32:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.481+0000 7f3d72930700 1 -- start start 2023-10-09T06:32:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.482+0000 7f3d72930700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d54004d50 0x7f3d6c15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.482+0000 7f3d72930700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c0b0610 0x7f3d6c14a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.482+0000 7f3d72930700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d6c152f50 0x7f3d6c1533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.482+0000 7f3d72930700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c153930 con 0x7f3d6c152f50 2023-10-09T06:32:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.482+0000 7f3d72930700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c150610 con 0x7f3d54004d50 2023-10-09T06:32:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.482+0000 7f3d72930700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c14ae80 con 0x7f3d6c0b0610 2023-10-09T06:32:33.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.482+0000 7f3d70ecd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d6c152f50 0x7f3d6c1533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.482+0000 7f3d70ecd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d6c152f50 0x7f3d6c1533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44164/0 (socket says 172.21.15.31:44164) 2023-10-09T06:32:33.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.482+0000 7f3d70ecd700 1 -- 172.21.15.31:0/2969228769 learned_addr learned my addr 172.21.15.31:0/2969228769 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:33.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.482+0000 7f3d6bfff700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d54004d50 0x7f3d6c15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.482+0000 7f3d6b7fe700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c0b0610 0x7f3d6c14a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.483+0000 7f3d70ecd700 1 -- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c0b0610 msgr2=0x7f3d6c14a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.483+0000 7f3d70ecd700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c0b0610 0x7f3d6c14a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.483+0000 7f3d70ecd700 1 -- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d54004d50 msgr2=0x7f3d6c15f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.483+0000 7f3d70ecd700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d54004d50 0x7f3d6c15f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.483+0000 7f3d70ecd700 1 -- 172.21.15.31:0/2969228769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c0b0a80 con 0x7f3d6c152f50 2023-10-09T06:32:33.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.483+0000 7f3d70ecd700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d6c152f50 0x7f3d6c1533f0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f3d540057f0 tx=0x7f3d64016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.483+0000 7f3d53fff700 1 -- 172.21.15.31:0/2969228769 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6400c8b0 con 0x7f3d6c152f50 2023-10-09T06:32:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.483+0000 7f3d53fff700 1 -- 172.21.15.31:0/2969228769 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6400c6d0 con 0x7f3d6c152f50 2023-10-09T06:32:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.483+0000 7f3d53fff700 1 -- 172.21.15.31:0/2969228769 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64012cf0 con 0x7f3d6c152f50 2023-10-09T06:32:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.483+0000 7f3d72930700 1 -- 172.21.15.31:0/2969228769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c0b0d40 con 0x7f3d6c152f50 2023-10-09T06:32:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.483+0000 7f3d72930700 1 -- 172.21.15.31:0/2969228769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c0b1300 con 0x7f3d6c152f50 2023-10-09T06:32:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.484+0000 7f3d72930700 1 -- 172.21.15.31:0/2969228769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c04c3c0 con 0x7f3d6c152f50 2023-10-09T06:32:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.484+0000 7f3d53fff700 1 -- 172.21.15.31:0/2969228769 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d64025020 con 0x7f3d6c152f50 2023-10-09T06:32:33.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.485+0000 7f3d53fff700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3d58066f30 0x7f3d580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.485+0000 7f3d53fff700 1 -- 172.21.15.31:0/2969228769 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d640866c0 con 0x7f3d6c152f50 2023-10-09T06:32:33.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.485+0000 7f3d6bfff700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3d58066f30 0x7f3d580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.486+0000 7f3d6bfff700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3d58066f30 0x7f3d580693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c000ff0 tx=0x7f3d5c007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:33.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.489+0000 7f3d53fff700 1 -- 172.21.15.31:0/2969228769 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d64053930 con 0x7f3d6c152f50 2023-10-09T06:32:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.683+0000 7f3d72930700 1 -- 172.21.15.31:0/2969228769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d6c15c560 con 0x7f3d6c152f50 2023-10-09T06:32:33.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.683+0000 7f3d53fff700 1 -- 172.21.15.31:0/2969228769 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f3d6402d090 con 0x7f3d6c152f50 2023-10-09T06:32:33.684 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:33.684 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":188,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:32:26.806922+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:31:48.664093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T06:31:49.212701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:32:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.685+0000 7f3d72930700 1 -- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3d58066f30 msgr2=0x7f3d580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.685+0000 7f3d72930700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3d58066f30 0x7f3d580693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c000ff0 tx=0x7f3d5c007040 comp rx=0 tx=0).stop 2023-10-09T06:32:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.685+0000 7f3d72930700 1 -- 172.21.15.31:0/2969228769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d6c152f50 msgr2=0x7f3d6c1533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.685+0000 7f3d72930700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d6c152f50 0x7f3d6c1533f0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f3d540057f0 tx=0x7f3d64016000 comp rx=0 tx=0).stop 2023-10-09T06:32:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.685+0000 7f3d72930700 1 -- 172.21.15.31:0/2969228769 shutdown_connections 2023-10-09T06:32:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.685+0000 7f3d72930700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f3d58066f30 0x7f3d580693e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.685+0000 7f3d72930700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d6c152f50 0x7f3d6c1533f0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.685+0000 7f3d72930700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3d54004d50 0x7f3d6c15f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.685+0000 7f3d72930700 1 --2- 172.21.15.31:0/2969228769 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f3d6c0b0610 0x7f3d6c14a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.685+0000 7f3d72930700 1 -- 172.21.15.31:0/2969228769 >> 172.21.15.31:0/2969228769 conn(0x7f3d6c068ce0 msgr2=0x7f3d6c15b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.685+0000 7f3d72930700 1 -- 172.21.15.31:0/2969228769 shutdown_connections 2023-10-09T06:32:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.685+0000 7f3d72930700 1 -- 172.21.15.31:0/2969228769 wait complete. 2023-10-09T06:32:33.698 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:32:33.699 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:32:33.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.816+0000 7ff3ae541700 1 Processor -- start 2023-10-09T06:32:33.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.816+0000 7ff3ae541700 1 -- start start 2023-10-09T06:32:33.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.817+0000 7ff3ae541700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3a8159e10 0x7ff3a80b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.817+0000 7ff3ae541700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3a80cde50 0x7ff3a80b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.817+0000 7ff3ae541700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a815db80 con 0x7ff3a815a1e0 2023-10-09T06:32:33.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.817+0000 7ff3ae541700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a815e800 con 0x7ff3a8159e10 2023-10-09T06:32:33.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.817+0000 7ff3ae541700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a815de60 con 0x7ff3a80cde50 2023-10-09T06:32:33.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.817+0000 7ff3a7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3a8159e10 0x7ff3a80b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.817+0000 7ff3a7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3a8159e10 0x7ff3a80b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44176/0 (socket says 172.21.15.31:44176) 2023-10-09T06:32:33.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.817+0000 7ff3a7fff700 1 -- 172.21.15.31:0/2423454312 learned_addr learned my addr 172.21.15.31:0/2423454312 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:33.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.817+0000 7ff3acade700 1 --2- 172.21.15.31:0/2423454312 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3a80cde50 0x7ff3a80b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.818+0000 7ff3a7fff700 1 -- 172.21.15.31:0/2423454312 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3a80cde50 msgr2=0x7ff3a80b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:33.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.818+0000 7ff3a7fff700 1 --2- 172.21.15.31:0/2423454312 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3a80cde50 0x7ff3a80b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.818+0000 7ff3a7fff700 1 -- 172.21.15.31:0/2423454312 >> v1:172.21.15.158:6789/0 conn(0x7ff3a815a1e0 legacy=0x7ff3a80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.818+0000 7ff3a7fff700 1 -- 172.21.15.31:0/2423454312 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a815e140 con 0x7ff3a8159e10 2023-10-09T06:32:33.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.818+0000 7ff3a7fff700 1 --2- 172.21.15.31:0/2423454312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a8159e10 0x7ff3a80b2d20 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7ff3980099b0 tx=0x7ff398009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be173ee2d8055c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:33.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.818+0000 7ff3a6ffd700 1 -- 172.21.15.31:0/2423454312 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39800b860 con 0x7ff3a8159e10 2023-10-09T06:32:33.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.818+0000 7ff3a6ffd700 1 -- 172.21.15.31:0/2423454312 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39800b9c0 con 0x7ff3a8159e10 2023-10-09T06:32:33.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.818+0000 7ff3a6ffd700 1 -- 172.21.15.31:0/2423454312 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39800bd60 con 0x7ff3a8159e10 2023-10-09T06:32:33.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.818+0000 7ff3ae541700 1 -- 172.21.15.31:0/2423454312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a8159e10 msgr2=0x7ff3a80b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.818+0000 7ff3ae541700 1 --2- 172.21.15.31:0/2423454312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a8159e10 0x7ff3a80b2d20 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7ff3980099b0 tx=0x7ff398009250 comp rx=0 tx=0).stop 2023-10-09T06:32:33.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.818+0000 7ff3ae541700 1 -- 172.21.15.31:0/2423454312 shutdown_connections 2023-10-09T06:32:33.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.818+0000 7ff3ae541700 1 --2- 172.21.15.31:0/2423454312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a8159e10 0x7ff3a80b2d20 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.819+0000 7ff3ae541700 1 --2- 172.21.15.31:0/2423454312 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3a80cde50 0x7ff3a80b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.819+0000 7ff3ae541700 1 -- 172.21.15.31:0/2423454312 >> 172.21.15.31:0/2423454312 conn(0x7ff3a8067660 msgr2=0x7ff3a8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:33.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.819+0000 7ff3ae541700 1 -- 172.21.15.31:0/2423454312 shutdown_connections 2023-10-09T06:32:33.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.819+0000 7ff3ae541700 1 -- 172.21.15.31:0/2423454312 wait complete. 2023-10-09T06:32:33.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.820+0000 7ff3ae541700 1 Processor -- start 2023-10-09T06:32:33.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.820+0000 7ff3ae541700 1 -- start start 2023-10-09T06:32:33.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.820+0000 7ff3ae541700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a80cde50 0x7ff3a8158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3ae541700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3a8159e10 0x7ff3a816a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3ae541700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3a815a1e0 0x7ff3a80c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3ae541700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a816ba50 con 0x7ff3a80cde50 2023-10-09T06:32:33.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3ae541700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a816adc0 con 0x7ff3a8159e10 2023-10-09T06:32:33.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3ae541700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a816b0a0 con 0x7ff3a815a1e0 2023-10-09T06:32:33.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3a7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a80cde50 0x7ff3a8158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3a7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a80cde50 0x7ff3a8158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44188/0 (socket says 172.21.15.31:44188) 2023-10-09T06:32:33.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3a7fff700 1 -- 172.21.15.31:0/3440796645 learned_addr learned my addr 172.21.15.31:0/3440796645 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:33.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3a77fe700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3a8159e10 0x7ff3a816a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3acade700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3a815a1e0 0x7ff3a80c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3a7fff700 1 -- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3a815a1e0 msgr2=0x7ff3a80c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3a7fff700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3a815a1e0 0x7ff3a80c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3a7fff700 1 -- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3a8159e10 msgr2=0x7ff3a816a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:33.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3a7fff700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3a8159e10 0x7ff3a816a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:33.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3a7fff700 1 -- 172.21.15.31:0/3440796645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3980094f0 con 0x7ff3a80cde50 2023-10-09T06:32:33.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3a7fff700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a80cde50 0x7ff3a8158560 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8089c80 tx=0x7ff398017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:33.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff38ffff700 1 -- 172.21.15.31:0/3440796645 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398024440 con 0x7ff3a80cde50 2023-10-09T06:32:33.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff38ffff700 1 -- 172.21.15.31:0/3440796645 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3980245a0 con 0x7ff3a80cde50 2023-10-09T06:32:33.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3ae541700 1 -- 172.21.15.31:0/3440796645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a816b6e0 con 0x7ff3a80cde50 2023-10-09T06:32:33.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff38ffff700 1 -- 172.21.15.31:0/3440796645 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398024960 con 0x7ff3a80cde50 2023-10-09T06:32:33.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.821+0000 7ff3ae541700 1 -- 172.21.15.31:0/3440796645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a8158aa0 con 0x7ff3a80cde50 2023-10-09T06:32:33.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.822+0000 7ff3ae541700 1 -- 172.21.15.31:0/3440796645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a804c3c0 con 0x7ff3a80cde50 2023-10-09T06:32:33.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.823+0000 7ff38ffff700 1 -- 172.21.15.31:0/3440796645 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff39801a420 con 0x7ff3a80cde50 2023-10-09T06:32:33.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.823+0000 7ff38ffff700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff394066f30 0x7ff3940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:33.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.823+0000 7ff38ffff700 1 -- 172.21.15.31:0/3440796645 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff3980863e0 con 0x7ff3a80cde50 2023-10-09T06:32:33.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.823+0000 7ff3a77fe700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff394066f30 0x7ff3940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:33.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.824+0000 7ff3a77fe700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff394066f30 0x7ff3940693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8159360 tx=0x7ff39c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:33.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:33.828+0000 7ff38ffff700 1 -- 172.21.15.31:0/3440796645 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff398053650 con 0x7ff3a80cde50 2023-10-09T06:32:34.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.065+0000 7ff3ae541700 1 -- 172.21.15.31:0/3440796645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3a816b870 con 0x7ff3a80cde50 2023-10-09T06:32:34.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.066+0000 7ff38ffff700 1 -- 172.21.15.31:0/3440796645 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4607 (secure 0 0 0) 0x7ff398056c70 con 0x7ff3a80cde50 2023-10-09T06:32:34.067 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:34.067 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/3503727793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3503727793},{"type":"v1","addr":"172.21.15.158:6837","nonce":3503727793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2366061673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2366061673},{"type":"v1","addr":"172.21.15.158:6836","nonce":2366061673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3405107978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3405107978},{"type":"v1","addr":"172.21.15.31:6834","nonce":3405107978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:31:50.242464+0000","modified":"2023-10-09T06:31:53.876299+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8079":{"gid":8079,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4124393323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4124393323},{"type":"v1","addr":"172.21.15.31:6835","nonce":4124393323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T06:32:34.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.068+0000 7ff3ae541700 1 -- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff394066f30 msgr2=0x7ff3940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.068+0000 7ff3ae541700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff394066f30 0x7ff3940693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8159360 tx=0x7ff39c009040 comp rx=0 tx=0).stop 2023-10-09T06:32:34.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.068+0000 7ff3ae541700 1 -- 172.21.15.31:0/3440796645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a80cde50 msgr2=0x7ff3a8158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.068+0000 7ff3ae541700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a80cde50 0x7ff3a8158560 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8089c80 tx=0x7ff398017000 comp rx=0 tx=0).stop 2023-10-09T06:32:34.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.068+0000 7ff3ae541700 1 -- 172.21.15.31:0/3440796645 shutdown_connections 2023-10-09T06:32:34.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.068+0000 7ff3ae541700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff394066f30 0x7ff3940693e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.068+0000 7ff3ae541700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff3a815a1e0 0x7ff3a80c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.068+0000 7ff3ae541700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a80cde50 0x7ff3a8158560 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.068+0000 7ff3ae541700 1 --2- 172.21.15.31:0/3440796645 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3a8159e10 0x7ff3a816a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.068+0000 7ff3ae541700 1 -- 172.21.15.31:0/3440796645 >> 172.21.15.31:0/3440796645 conn(0x7ff3a8067660 msgr2=0x7ff3a80cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:34.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.068+0000 7ff3ae541700 1 -- 172.21.15.31:0/3440796645 shutdown_connections 2023-10-09T06:32:34.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.068+0000 7ff3ae541700 1 -- 172.21.15.31:0/3440796645 wait complete. 2023-10-09T06:32:34.070 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 89 2023-10-09T06:32:34.081 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:32:34.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.199+0000 7fcd8ea2a700 1 Processor -- start 2023-10-09T06:32:34.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.199+0000 7fcd8ea2a700 1 -- start start 2023-10-09T06:32:34.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.200+0000 7fcd8ea2a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcd8815a1e0 0x7fcd880cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.200+0000 7fcd8ea2a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8815db80 con 0x7fcd880b3430 2023-10-09T06:32:34.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.200+0000 7fcd8ea2a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8815de60 con 0x7fcd88159e10 2023-10-09T06:32:34.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.200+0000 7fcd8ea2a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8815e800 con 0x7fcd8815a1e0 2023-10-09T06:32:34.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.200+0000 7fcd8cfc7700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcd880b3430 0x7fcd880cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32892/0 (socket says 172.21.15.31:32892) 2023-10-09T06:32:34.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.200+0000 7fcd8cfc7700 1 -- 172.21.15.31:0/3565018832 learned_addr learned my addr 172.21.15.31:0/3565018832 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:34.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.200+0000 7fcd877fe700 1 --2- 172.21.15.31:0/3565018832 >> v2:172.21.15.158:3300/0 conn(0x7fcd8815a1e0 0x7fcd880cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724519436 0 0) 0x7fcd8815db80 con 0x7fcd880b3430 2023-10-09T06:32:34.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd74003570 con 0x7fcd880b3430 2023-10-09T06:32:34.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492341874 0 0) 0x7fcd8815de60 con 0x7fcd88159e10 2023-10-09T06:32:34.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd8815db80 con 0x7fcd88159e10 2023-10-09T06:32:34.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1865506543 0 0) 0x7fcd74003570 con 0x7fcd880b3430 2023-10-09T06:32:34.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 >> v2:172.21.15.158:3300/0 conn(0x7fcd8815a1e0 msgr2=0x7fcd880cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:34.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 --2- 172.21.15.31:0/3565018832 >> v2:172.21.15.158:3300/0 conn(0x7fcd8815a1e0 0x7fcd880cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 >> v1:172.21.15.158:6789/0 conn(0x7fcd88159e10 legacy=0x7fcd880b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8815e140 con 0x7fcd880b3430 2023-10-09T06:32:34.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fcd800017f0 con 0x7fcd880b3430 2023-10-09T06:32:34.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 >> v1:172.21.15.31:6789/0 conn(0x7fcd880b3430 legacy=0x7fcd880cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 --2- 172.21.15.31:0/3565018832 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd74003bf0 0x7fcd74003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 --2- 172.21.15.31:0/3565018832 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd74004810 0x7fcd74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 --2- 172.21.15.31:0/3565018832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd740051c0 0x7fcd7400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8815e800 con 0x7fcd740051c0 2023-10-09T06:32:34.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7400c160 con 0x7fcd74003bf0 2023-10-09T06:32:34.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7400c320 con 0x7fcd74004810 2023-10-09T06:32:34.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd8cfc7700 1 --2- 172.21.15.31:0/3565018832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd740051c0 0x7fcd7400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd87fff700 1 --2- 172.21.15.31:0/3565018832 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd74003bf0 0x7fcd74003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd877fe700 1 --2- 172.21.15.31:0/3565018832 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd74004810 0x7fcd74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd8cfc7700 1 -- 172.21.15.31:0/3565018832 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd74004810 msgr2=0x7fcd74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:34.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd8cfc7700 1 --2- 172.21.15.31:0/3565018832 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd74004810 0x7fcd74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd8cfc7700 1 -- 172.21.15.31:0/3565018832 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd74003bf0 msgr2=0x7fcd74003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:34.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd8cfc7700 1 --2- 172.21.15.31:0/3565018832 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd74003bf0 0x7fcd74003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.201+0000 7fcd8cfc7700 1 -- 172.21.15.31:0/3565018832 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd74003570 con 0x7fcd740051c0 2023-10-09T06:32:34.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.202+0000 7fcd8cfc7700 1 -- 172.21.15.31:0/3565018832 reap_dead start 2023-10-09T06:32:34.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.202+0000 7fcd8cfc7700 1 --2- 172.21.15.31:0/3565018832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd740051c0 0x7fcd7400ba60 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000a8a0 tx=0x7fcd80002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8046fae366e8fdbd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:34.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.202+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd800070d0 con 0x7fcd740051c0 2023-10-09T06:32:34.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.202+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd80007230 con 0x7fcd740051c0 2023-10-09T06:32:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.202+0000 7fcd86ffd700 1 -- 172.21.15.31:0/3565018832 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd800075d0 con 0x7fcd740051c0 2023-10-09T06:32:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.202+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3565018832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd740051c0 msgr2=0x7fcd7400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.202+0000 7fcd8ea2a700 1 --2- 172.21.15.31:0/3565018832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd740051c0 0x7fcd7400ba60 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000a8a0 tx=0x7fcd80002190 comp rx=0 tx=0).stop 2023-10-09T06:32:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.202+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3565018832 shutdown_connections 2023-10-09T06:32:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.202+0000 7fcd8ea2a700 1 --2- 172.21.15.31:0/3565018832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd740051c0 0x7fcd7400ba60 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.202+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3565018832 >> 172.21.15.31:0/3565018832 conn(0x7fcd88067660 msgr2=0x7fcd88067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.202+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3565018832 shutdown_connections 2023-10-09T06:32:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.202+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3565018832 wait complete. 2023-10-09T06:32:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.203+0000 7fcd8ea2a700 1 Processor -- start 2023-10-09T06:32:34.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.204+0000 7fcd8ea2a700 1 -- start start 2023-10-09T06:32:34.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.204+0000 7fcd8ea2a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd740051c0 0x7fcd880c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.204+0000 7fcd8ea2a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd88155cc0 0x7fcd880d1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.204+0000 7fcd8ea2a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd880c6570 0x7fcd880c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.204+0000 7fcd8ea2a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd880c6f50 con 0x7fcd88155cc0 2023-10-09T06:32:34.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.204+0000 7fcd8ea2a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd88156130 con 0x7fcd880c6570 2023-10-09T06:32:34.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.204+0000 7fcd8ea2a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd880d16c0 con 0x7fcd740051c0 2023-10-09T06:32:34.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.204+0000 7fcd877fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd88155cc0 0x7fcd880d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.204+0000 7fcd877fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd88155cc0 0x7fcd880d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44196/0 (socket says 172.21.15.31:44196) 2023-10-09T06:32:34.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd877fe700 1 -- 172.21.15.31:0/3974221714 learned_addr learned my addr 172.21.15.31:0/3974221714 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:34.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd87fff700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd740051c0 0x7fcd880c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd8cfc7700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd880c6570 0x7fcd880c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd877fe700 1 -- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd740051c0 msgr2=0x7fcd880c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd877fe700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd740051c0 0x7fcd880c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd877fe700 1 -- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd880c6570 msgr2=0x7fcd880c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd877fe700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd880c6570 0x7fcd880c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd877fe700 1 -- 172.21.15.31:0/3974221714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd880c57a0 con 0x7fcd88155cc0 2023-10-09T06:32:34.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd877fe700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd88155cc0 0x7fcd880d1180 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fcd78011a60 tx=0x7fcd780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:34.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd7ffff700 1 -- 172.21.15.31:0/3974221714 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78011ea0 con 0x7fcd88155cc0 2023-10-09T06:32:34.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd7ffff700 1 -- 172.21.15.31:0/3974221714 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7800f940 con 0x7fcd88155cc0 2023-10-09T06:32:34.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3974221714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd880c5a80 con 0x7fcd88155cc0 2023-10-09T06:32:34.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd7ffff700 1 -- 172.21.15.31:0/3974221714 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7800fcc0 con 0x7fcd88155cc0 2023-10-09T06:32:34.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.205+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3974221714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd880ceb50 con 0x7fcd88155cc0 2023-10-09T06:32:34.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.206+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3974221714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8804c3c0 con 0x7fcd88155cc0 2023-10-09T06:32:34.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.207+0000 7fcd7ffff700 1 -- 172.21.15.31:0/3974221714 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd78014650 con 0x7fcd88155cc0 2023-10-09T06:32:34.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.207+0000 7fcd7ffff700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd68066f30 0x7fcd680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.207+0000 7fcd7ffff700 1 -- 172.21.15.31:0/3974221714 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd78018030 con 0x7fcd88155cc0 2023-10-09T06:32:34.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.207+0000 7fcd87fff700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd68066f30 0x7fcd680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.208+0000 7fcd87fff700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd68066f30 0x7fcd680693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcd880b0f50 tx=0x7fcd70007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:34.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.211+0000 7fcd7ffff700 1 -- 172.21.15.31:0/3974221714 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd7808b080 con 0x7fcd88155cc0 2023-10-09T06:32:34.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.451+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3974221714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd8815e420 con 0x7fcd88155cc0 2023-10-09T06:32:34.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.452+0000 7fcd7ffff700 1 -- 172.21.15.31:0/3974221714 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fcd78022090 con 0x7fcd88155cc0 2023-10-09T06:32:34.453 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:34.453 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/3503727793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3503727793},{"type":"v1","addr":"172.21.15.158:6837","nonce":3503727793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2366061673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2366061673},{"type":"v1","addr":"172.21.15.158:6836","nonce":2366061673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3405107978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3405107978},{"type":"v1","addr":"172.21.15.31:6834","nonce":3405107978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:31:50.242464+0000","modified":"2023-10-09T06:31:53.876299+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8079":{"gid":8079,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4124393323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4124393323},{"type":"v1","addr":"172.21.15.31:6835","nonce":4124393323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T06:32:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.454+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd68066f30 msgr2=0x7fcd680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.454+0000 7fcd8ea2a700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd68066f30 0x7fcd680693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcd880b0f50 tx=0x7fcd70007d30 comp rx=0 tx=0).stop 2023-10-09T06:32:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.454+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3974221714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd88155cc0 msgr2=0x7fcd880d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.454+0000 7fcd8ea2a700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd88155cc0 0x7fcd880d1180 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fcd78011a60 tx=0x7fcd780091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.454+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3974221714 shutdown_connections 2023-10-09T06:32:34.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.454+0000 7fcd8ea2a700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcd68066f30 0x7fcd680693e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.454+0000 7fcd8ea2a700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcd740051c0 0x7fcd880c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.454+0000 7fcd8ea2a700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcd880c6570 0x7fcd880c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.454+0000 7fcd8ea2a700 1 --2- 172.21.15.31:0/3974221714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd88155cc0 0x7fcd880d1180 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.454+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3974221714 >> 172.21.15.31:0/3974221714 conn(0x7fcd88067660 msgr2=0x7fcd8815a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:34.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.454+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3974221714 shutdown_connections 2023-10-09T06:32:34.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.454+0000 7fcd8ea2a700 1 -- 172.21.15.31:0/3974221714 wait complete. 2023-10-09T06:32:34.456 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 89 2023-10-09T06:32:34.467 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:32:34.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.584+0000 7f7f1fb72700 1 Processor -- start 2023-10-09T06:32:34.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.584+0000 7f7f1fb72700 1 -- start start 2023-10-09T06:32:34.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.585+0000 7f7f1fb72700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7f180b0890 0x7f7f180cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.585+0000 7f7f1fb72700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7f180cbd40 0x7f7f18067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.585+0000 7f7f1fb72700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f180cb370 con 0x7f7f1806c630 2023-10-09T06:32:34.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.585+0000 7f7f1fb72700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f180b0c60 con 0x7f7f180cbd40 2023-10-09T06:32:34.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.585+0000 7f7f1fb72700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1806a1e0 con 0x7f7f180b0890 2023-10-09T06:32:34.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.585+0000 7f7f1d10d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7f180cbd40 0x7f7f18067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.585+0000 7f7f1e10f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7f1806c630 0x7f7f1815dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32908/0 (socket says 172.21.15.31:32908) 2023-10-09T06:32:34.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.585+0000 7f7f1e10f700 1 -- 172.21.15.31:0/2669678177 learned_addr learned my addr 172.21.15.31:0/2669678177 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:34.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.586+0000 7f7f1d90e700 1 --2- 172.21.15.31:0/2669678177 >> v2:172.21.15.158:3300/0 conn(0x7f7f180b0890 0x7f7f180cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.586+0000 7f7f1d10d700 1 -- 172.21.15.31:0/2669678177 >> v2:172.21.15.158:3300/0 conn(0x7f7f180b0890 msgr2=0x7f7f180cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:34.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.586+0000 7f7f1d10d700 1 --2- 172.21.15.31:0/2669678177 >> v2:172.21.15.158:3300/0 conn(0x7f7f180b0890 0x7f7f180cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.586+0000 7f7f1d10d700 1 -- 172.21.15.31:0/2669678177 >> v1:172.21.15.31:6789/0 conn(0x7f7f1806c630 legacy=0x7f7f1815dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.586+0000 7f7f1d10d700 1 -- 172.21.15.31:0/2669678177 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1806cb80 con 0x7f7f180cbd40 2023-10-09T06:32:34.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.586+0000 7f7f1c90c700 1 -- 172.21.15.31:0/2669678177 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461170492 0 0) 0x7f7f180cb370 con 0x7f7f1806c630 2023-10-09T06:32:34.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.586+0000 7f7f1d90e700 1 --2- 172.21.15.31:0/2669678177 >> v2:172.21.15.158:3300/0 conn(0x7f7f180b0890 0x7f7f180cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:34.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.586+0000 7f7f1d10d700 1 --2- 172.21.15.31:0/2669678177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f180cbd40 0x7f7f18067660 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f7f1806aae0 tx=0x7f7f0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2abeadd7f1ff25 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:34.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.586+0000 7f7f1c90c700 1 -- 172.21.15.31:0/2669678177 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c00b6b0 con 0x7f7f180cbd40 2023-10-09T06:32:34.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.586+0000 7f7f1c90c700 1 -- 172.21.15.31:0/2669678177 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c00b810 con 0x7f7f180cbd40 2023-10-09T06:32:34.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.586+0000 7f7f1c90c700 1 -- 172.21.15.31:0/2669678177 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c00bbb0 con 0x7f7f180cbd40 2023-10-09T06:32:34.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.586+0000 7f7f1fb72700 1 -- 172.21.15.31:0/2669678177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f180cbd40 msgr2=0x7f7f18067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.586+0000 7f7f1fb72700 1 --2- 172.21.15.31:0/2669678177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f180cbd40 0x7f7f18067660 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f7f1806aae0 tx=0x7f7f0c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.587+0000 7f7f1fb72700 1 -- 172.21.15.31:0/2669678177 shutdown_connections 2023-10-09T06:32:34.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.587+0000 7f7f1fb72700 1 --2- 172.21.15.31:0/2669678177 >> v2:172.21.15.158:3300/0 conn(0x7f7f180b0890 0x7f7f180cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.587+0000 7f7f1fb72700 1 --2- 172.21.15.31:0/2669678177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f180cbd40 0x7f7f18067660 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.587+0000 7f7f1fb72700 1 -- 172.21.15.31:0/2669678177 >> 172.21.15.31:0/2669678177 conn(0x7f7f1806fe50 msgr2=0x7f7f18069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:34.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.587+0000 7f7f1fb72700 1 -- 172.21.15.31:0/2669678177 shutdown_connections 2023-10-09T06:32:34.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.587+0000 7f7f1fb72700 1 -- 172.21.15.31:0/2669678177 wait complete. 2023-10-09T06:32:34.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.588+0000 7f7f1fb72700 1 Processor -- start 2023-10-09T06:32:34.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.588+0000 7f7f1fb72700 1 -- start start 2023-10-09T06:32:34.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.588+0000 7f7f1fb72700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f1806c630 0x7f7f1815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.588+0000 7f7f1fb72700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f180b0890 0x7f7f180ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.588+0000 7f7f1fb72700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f180cbd40 0x7f7f1815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.588+0000 7f7f1fb72700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1815ec30 con 0x7f7f180cbd40 2023-10-09T06:32:34.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.588+0000 7f7f1fb72700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1815f990 con 0x7f7f180b0890 2023-10-09T06:32:34.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.588+0000 7f7f1fb72700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1815e670 con 0x7f7f1806c630 2023-10-09T06:32:34.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.588+0000 7f7f1e10f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f180cbd40 0x7f7f1815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f1e10f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f180cbd40 0x7f7f1815dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44214/0 (socket says 172.21.15.31:44214) 2023-10-09T06:32:34.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f1e10f700 1 -- 172.21.15.31:0/3292265796 learned_addr learned my addr 172.21.15.31:0/3292265796 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:34.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f1d10d700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f180b0890 0x7f7f180ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f1d90e700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f1806c630 0x7f7f1815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f1e10f700 1 -- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f1806c630 msgr2=0x7f7f1815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f1e10f700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f1806c630 0x7f7f1815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f1e10f700 1 -- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f180b0890 msgr2=0x7f7f180ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f1e10f700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f180b0890 0x7f7f180ab950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f1e10f700 1 -- 172.21.15.31:0/3292265796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c009420 con 0x7f7f180cbd40 2023-10-09T06:32:34.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f1e10f700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f180cbd40 0x7f7f1815dbb0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800cbf0 tx=0x7f7f080019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:34.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f15ffb700 1 -- 172.21.15.31:0/3292265796 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800a8b0 con 0x7f7f180cbd40 2023-10-09T06:32:34.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f15ffb700 1 -- 172.21.15.31:0/3292265796 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0800aa10 con 0x7f7f180cbd40 2023-10-09T06:32:34.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f1fb72700 1 -- 172.21.15.31:0/3292265796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1815e950 con 0x7f7f180cbd40 2023-10-09T06:32:34.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f15ffb700 1 -- 172.21.15.31:0/3292265796 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800add0 con 0x7f7f180cbd40 2023-10-09T06:32:34.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.589+0000 7f7f1fb72700 1 -- 172.21.15.31:0/3292265796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f180c2a00 con 0x7f7f180cbd40 2023-10-09T06:32:34.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.590+0000 7f7f1fb72700 1 -- 172.21.15.31:0/3292265796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f180c2580 con 0x7f7f180cbd40 2023-10-09T06:32:34.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.591+0000 7f7f15ffb700 1 -- 172.21.15.31:0/3292265796 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f08007300 con 0x7f7f180cbd40 2023-10-09T06:32:34.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.591+0000 7f7f15ffb700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7f04066f30 0x7f7f040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.591+0000 7f7f15ffb700 1 -- 172.21.15.31:0/3292265796 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f080847b0 con 0x7f7f180cbd40 2023-10-09T06:32:34.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.591+0000 7f7f1d90e700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7f04066f30 0x7f7f040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.592+0000 7f7f1d90e700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7f04066f30 0x7f7f040693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000adc0 tx=0x7f7f10006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:34.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.595+0000 7f7f15ffb700 1 -- 172.21.15.31:0/3292265796 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f180c2580 con 0x7f7f180cbd40 2023-10-09T06:32:34.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.787+0000 7f7f1fb72700 1 -- 172.21.15.31:0/3292265796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f180c2580 con 0x7f7f180cbd40 2023-10-09T06:32:34.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.788+0000 7f7f15ffb700 1 -- 172.21.15.31:0/3292265796 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f7f180c2580 con 0x7f7f180cbd40 2023-10-09T06:32:34.789 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:34.789 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":188,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:32:26.806922+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:31:48.664093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T06:31:49.212701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:32:34.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.790+0000 7f7f1fb72700 1 -- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7f04066f30 msgr2=0x7f7f040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.790+0000 7f7f1fb72700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7f04066f30 0x7f7f040693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000adc0 tx=0x7f7f10006f90 comp rx=0 tx=0).stop 2023-10-09T06:32:34.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.790+0000 7f7f1fb72700 1 -- 172.21.15.31:0/3292265796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f180cbd40 msgr2=0x7f7f1815dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.790+0000 7f7f1fb72700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f180cbd40 0x7f7f1815dbb0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800cbf0 tx=0x7f7f080019b0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.790+0000 7f7f1fb72700 1 -- 172.21.15.31:0/3292265796 shutdown_connections 2023-10-09T06:32:34.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.790+0000 7f7f1fb72700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f7f04066f30 0x7f7f040693e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.790+0000 7f7f1fb72700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f7f1806c630 0x7f7f1815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.790+0000 7f7f1fb72700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f180cbd40 0x7f7f1815dbb0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.790+0000 7f7f1fb72700 1 --2- 172.21.15.31:0/3292265796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7f180b0890 0x7f7f180ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.790+0000 7f7f1fb72700 1 -- 172.21.15.31:0/3292265796 >> 172.21.15.31:0/3292265796 conn(0x7f7f1806fe50 msgr2=0x7f7f18068700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:34.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.790+0000 7f7f1fb72700 1 -- 172.21.15.31:0/3292265796 shutdown_connections 2023-10-09T06:32:34.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.790+0000 7f7f1fb72700 1 -- 172.21.15.31:0/3292265796 wait complete. 2023-10-09T06:32:34.803 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:32:34.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.922+0000 7f699a1a0700 1 Processor -- start 2023-10-09T06:32:34.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.922+0000 7f699a1a0700 1 -- start start 2023-10-09T06:32:34.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.923+0000 7f699a1a0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6994159fb0 0x7f69940cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.923+0000 7f699a1a0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699415e9b0 con 0x7f69940cd4e0 2023-10-09T06:32:34.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.923+0000 7f699a1a0700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699415dda0 con 0x7f6994159be0 2023-10-09T06:32:34.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.923+0000 7f699a1a0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699415e080 con 0x7f6994159fb0 2023-10-09T06:32:34.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.923+0000 7f699899d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6994159fb0 0x7f69940cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.923+0000 7f699999f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f69940cd4e0 0x7f69940b0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32918/0 (socket says 172.21.15.31:32918) 2023-10-09T06:32:34.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.923+0000 7f699999f700 1 -- 172.21.15.31:0/3275741694 learned_addr learned my addr 172.21.15.31:0/3275741694 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:34.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.924+0000 7f699899d700 1 -- 172.21.15.31:0/3275741694 >> v1:172.21.15.158:6789/0 conn(0x7f6994159be0 legacy=0x7f69940b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:34.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.924+0000 7f699899d700 1 -- 172.21.15.31:0/3275741694 >> v1:172.21.15.31:6789/0 conn(0x7f69940cd4e0 legacy=0x7f69940b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.924+0000 7f6993fff700 1 -- 172.21.15.31:0/3275741694 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289716538 0 0) 0x7f699415e9b0 con 0x7f69940cd4e0 2023-10-09T06:32:34.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.924+0000 7f699899d700 1 -- 172.21.15.31:0/3275741694 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699415e360 con 0x7f6994159fb0 2023-10-09T06:32:34.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.924+0000 7f699899d700 1 --2- 172.21.15.31:0/3275741694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6994159fb0 0x7f69940cb670 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f69880098e0 tx=0x7f69880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e555d2bd392ec2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:34.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.924+0000 7f6993fff700 1 -- 172.21.15.31:0/3275741694 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6988009e80 con 0x7f6994159fb0 2023-10-09T06:32:34.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.924+0000 7f6993fff700 1 -- 172.21.15.31:0/3275741694 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698800b820 con 0x7f6994159fb0 2023-10-09T06:32:34.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.924+0000 7f6993fff700 1 -- 172.21.15.31:0/3275741694 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698800bba0 con 0x7f6994159fb0 2023-10-09T06:32:34.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.925+0000 7f699a1a0700 1 -- 172.21.15.31:0/3275741694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6994159fb0 msgr2=0x7f69940cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.925+0000 7f699a1a0700 1 --2- 172.21.15.31:0/3275741694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6994159fb0 0x7f69940cb670 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f69880098e0 tx=0x7f69880091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.925+0000 7f699a1a0700 1 -- 172.21.15.31:0/3275741694 shutdown_connections 2023-10-09T06:32:34.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.925+0000 7f699a1a0700 1 --2- 172.21.15.31:0/3275741694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6994159fb0 0x7f69940cb670 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.925+0000 7f699a1a0700 1 -- 172.21.15.31:0/3275741694 >> 172.21.15.31:0/3275741694 conn(0x7f6994067660 msgr2=0x7f6994067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:34.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.925+0000 7f699a1a0700 1 -- 172.21.15.31:0/3275741694 shutdown_connections 2023-10-09T06:32:34.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.925+0000 7f699a1a0700 1 -- 172.21.15.31:0/3275741694 wait complete. 2023-10-09T06:32:34.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.926+0000 7f699a1a0700 1 Processor -- start 2023-10-09T06:32:34.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.926+0000 7f699a1a0700 1 -- start start 2023-10-09T06:32:34.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699a1a0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69940cd4e0 0x7f69940cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699a1a0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6994159be0 0x7f69941550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699a1a0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6994159fb0 0x7f69940c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699a1a0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69940d1500 con 0x7f6994159fb0 2023-10-09T06:32:34.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699a1a0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6994155630 con 0x7f69940cd4e0 2023-10-09T06:32:34.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699a1a0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6994156c00 con 0x7f6994159be0 2023-10-09T06:32:34.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699999f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6994159fb0 0x7f69940c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699999f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6994159fb0 0x7f69940c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44228/0 (socket says 172.21.15.31:44228) 2023-10-09T06:32:34.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699999f700 1 -- 172.21.15.31:0/3888911214 learned_addr learned my addr 172.21.15.31:0/3888911214 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:34.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699899d700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6994159be0 0x7f69941550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699919e700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69940cd4e0 0x7f69940cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699999f700 1 -- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6994159be0 msgr2=0x7f69941550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699999f700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6994159be0 0x7f69941550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699999f700 1 -- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69940cd4e0 msgr2=0x7f69940cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:34.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699999f700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69940cd4e0 0x7f69940cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:34.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699999f700 1 -- 172.21.15.31:0/3888911214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6988009420 con 0x7f6994159fb0 2023-10-09T06:32:34.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699919e700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69940cd4e0 0x7f69940cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:34.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f699999f700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6994159fb0 0x7f69940c6000 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f698400cbf0 tx=0x7f69840019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:34.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.927+0000 7f69917fa700 1 -- 172.21.15.31:0/3888911214 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698400a910 con 0x7f6994159fb0 2023-10-09T06:32:34.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.928+0000 7f69917fa700 1 -- 172.21.15.31:0/3888911214 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698400aa90 con 0x7f6994159fb0 2023-10-09T06:32:34.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.928+0000 7f699a1a0700 1 -- 172.21.15.31:0/3888911214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69940ceeb0 con 0x7f6994159fb0 2023-10-09T06:32:34.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.928+0000 7f69917fa700 1 -- 172.21.15.31:0/3888911214 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698400ae50 con 0x7f6994159fb0 2023-10-09T06:32:34.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.928+0000 7f699a1a0700 1 -- 172.21.15.31:0/3888911214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69940cf470 con 0x7f6994159fb0 2023-10-09T06:32:34.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.928+0000 7f699a1a0700 1 -- 172.21.15.31:0/3888911214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699406b730 con 0x7f6994159fb0 2023-10-09T06:32:34.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.929+0000 7f69917fa700 1 -- 172.21.15.31:0/3888911214 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6984007300 con 0x7f6994159fb0 2023-10-09T06:32:34.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.929+0000 7f69917fa700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6980066f30 0x7f69800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:34.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.930+0000 7f69917fa700 1 -- 172.21.15.31:0/3888911214 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6984084820 con 0x7f6994159fb0 2023-10-09T06:32:34.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.930+0000 7f699919e700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6980066f30 0x7f69800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:34.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.930+0000 7f699919e700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6980066f30 0x7f69800693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f69940d19b0 tx=0x7f698c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:34.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:34.934+0000 7f69917fa700 1 -- 172.21.15.31:0/3888911214 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6984051b10 con 0x7f6994159fb0 2023-10-09T06:32:35.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.174+0000 7f699a1a0700 1 -- 172.21.15.31:0/3888911214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f69940b5d90 con 0x7f6994159fb0 2023-10-09T06:32:35.175 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-10-09T06:32:35.174+0000 7fc5e82b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:32:35.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.179+0000 7f69917fa700 1 -- 172.21.15.31:0/3888911214 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6984055130 con 0x7f6994159fb0 2023-10-09T06:32:35.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.182+0000 7f699a1a0700 1 -- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6980066f30 msgr2=0x7f69800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:35.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.182+0000 7f699a1a0700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6980066f30 0x7f69800693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f69940d19b0 tx=0x7f698c008040 comp rx=0 tx=0).stop 2023-10-09T06:32:35.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.182+0000 7f699a1a0700 1 -- 172.21.15.31:0/3888911214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6994159fb0 msgr2=0x7f69940c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:35.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.182+0000 7f699a1a0700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6994159fb0 0x7f69940c6000 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f698400cbf0 tx=0x7f69840019b0 comp rx=0 tx=0).stop 2023-10-09T06:32:35.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.182+0000 7f699a1a0700 1 -- 172.21.15.31:0/3888911214 shutdown_connections 2023-10-09T06:32:35.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.182+0000 7f699a1a0700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6980066f30 0x7f69800693e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:35.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.182+0000 7f699a1a0700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6994159fb0 0x7f69940c6000 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.182+0000 7f699a1a0700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69940cd4e0 0x7f69940cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.182+0000 7f699a1a0700 1 --2- 172.21.15.31:0/3888911214 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f6994159be0 0x7f69941550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.182+0000 7f699a1a0700 1 -- 172.21.15.31:0/3888911214 >> 172.21.15.31:0/3888911214 conn(0x7f6994067660 msgr2=0x7f69940b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.182+0000 7f699a1a0700 1 -- 172.21.15.31:0/3888911214 shutdown_connections 2023-10-09T06:32:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.182+0000 7f699a1a0700 1 -- 172.21.15.31:0/3888911214 wait complete. 2023-10-09T06:32:35.184 INFO:tasks.ceph.mds.a.smithi031.stderr: -7996> 2023-10-09T06:31:56.172+0000 7f9ecc506700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:32:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:32:35.195 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:32:35.213 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-10-09T06:32:35.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.318+0000 7f979ed9a700 1 Processor -- start 2023-10-09T06:32:35.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.318+0000 7f979ed9a700 1 -- start start 2023-10-09T06:32:35.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f979ed9a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f97980cbf10 0x7f979815e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:35.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f979ed9a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97980c9390 0x7f979815a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:35.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f979ed9a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97980cae70 con 0x7f97980678b0 2023-10-09T06:32:35.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f979ed9a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97980cb150 con 0x7f97980cbf10 2023-10-09T06:32:35.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f979ed9a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97980cb430 con 0x7f97980c9390 2023-10-09T06:32:35.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f979cb36700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f97980678b0 0x7f979815db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32932/0 (socket says 172.21.15.31:32932) 2023-10-09T06:32:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f979cb36700 1 -- 172.21.15.31:0/2739514811 learned_addr learned my addr 172.21.15.31:0/2739514811 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f9797fff700 1 --2- 172.21.15.31:0/2739514811 >> v2:172.21.15.158:3300/0 conn(0x7f97980cbf10 0x7f979815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f979d337700 1 --2- 172.21.15.31:0/2739514811 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97980c9390 0x7f979815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f97977fe700 1 -- 172.21.15.31:0/2739514811 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693359101 0 0) 0x7f97980cae70 con 0x7f97980678b0 2023-10-09T06:32:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f97977fe700 1 -- 172.21.15.31:0/2739514811 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9784003570 con 0x7f97980678b0 2023-10-09T06:32:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f9797fff700 1 -- 172.21.15.31:0/2739514811 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97980c9390 msgr2=0x7f979815a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f9797fff700 1 --2- 172.21.15.31:0/2739514811 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97980c9390 0x7f979815a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f9797fff700 1 -- 172.21.15.31:0/2739514811 >> v1:172.21.15.31:6789/0 conn(0x7f97980678b0 legacy=0x7f979815db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f97977fe700 1 -- 172.21.15.31:0/2739514811 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2434515552 0 0) 0x7f9784003570 con 0x7f97980678b0 2023-10-09T06:32:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f9797fff700 1 -- 172.21.15.31:0/2739514811 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97980cb710 con 0x7f97980cbf10 2023-10-09T06:32:35.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.319+0000 7f9797fff700 1 --2- 172.21.15.31:0/2739514811 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97980cbf10 0x7f979815e290 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9788009e60 tx=0x7f9788009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aba499cf584c61bc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.320+0000 7f97977fe700 1 -- 172.21.15.31:0/2739514811 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978800e070 con 0x7f97980cbf10 2023-10-09T06:32:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.320+0000 7f97977fe700 1 -- 172.21.15.31:0/2739514811 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978800bab0 con 0x7f97980cbf10 2023-10-09T06:32:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.320+0000 7f97977fe700 1 -- 172.21.15.31:0/2739514811 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978800be70 con 0x7f97980cbf10 2023-10-09T06:32:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.320+0000 7f979ed9a700 1 -- 172.21.15.31:0/2739514811 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97980cbf10 msgr2=0x7f979815e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.320+0000 7f979ed9a700 1 --2- 172.21.15.31:0/2739514811 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97980cbf10 0x7f979815e290 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9788009e60 tx=0x7f9788009780 comp rx=0 tx=0).stop 2023-10-09T06:32:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.320+0000 7f979ed9a700 1 -- 172.21.15.31:0/2739514811 shutdown_connections 2023-10-09T06:32:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.320+0000 7f979ed9a700 1 --2- 172.21.15.31:0/2739514811 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97980c9390 0x7f979815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.320+0000 7f979ed9a700 1 --2- 172.21.15.31:0/2739514811 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97980cbf10 0x7f979815e290 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.320+0000 7f979ed9a700 1 -- 172.21.15.31:0/2739514811 >> 172.21.15.31:0/2739514811 conn(0x7f9798069870 msgr2=0x7f9798069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.320+0000 7f979ed9a700 1 -- 172.21.15.31:0/2739514811 shutdown_connections 2023-10-09T06:32:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.320+0000 7f979ed9a700 1 -- 172.21.15.31:0/2739514811 wait complete. 2023-10-09T06:32:35.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.321+0000 7f979ed9a700 1 Processor -- start 2023-10-09T06:32:35.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.322+0000 7f979ed9a700 1 -- start start 2023-10-09T06:32:35.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.322+0000 7f979ed9a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97980678b0 0x7f979816aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:35.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.322+0000 7f979ed9a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97980c9390 0x7f9798155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:35.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.322+0000 7f979ed9a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97980cbf10 0x7f9798154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:35.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.322+0000 7f979ed9a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979816aa40 con 0x7f97980cbf10 2023-10-09T06:32:35.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.322+0000 7f979ed9a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97981561b0 con 0x7f97980c9390 2023-10-09T06:32:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.322+0000 7f979ed9a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9798154f10 con 0x7f97980678b0 2023-10-09T06:32:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.322+0000 7f979d337700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97980cbf10 0x7f9798154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.322+0000 7f979d337700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97980cbf10 0x7f9798154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44264/0 (socket says 172.21.15.31:44264) 2023-10-09T06:32:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.322+0000 7f979d337700 1 -- 172.21.15.31:0/4107083767 learned_addr learned my addr 172.21.15.31:0/4107083767 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.322+0000 7f9797fff700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97980c9390 0x7f9798155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.322+0000 7f979cb36700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97980678b0 0x7f979816aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.323+0000 7f979d337700 1 -- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97980678b0 msgr2=0x7f979816aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.323+0000 7f979d337700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97980678b0 0x7f979816aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.323+0000 7f979d337700 1 -- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97980c9390 msgr2=0x7f9798155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.323+0000 7f979d337700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97980c9390 0x7f9798155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:35.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.323+0000 7f979d337700 1 -- 172.21.15.31:0/4107083767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9788009a20 con 0x7f97980cbf10 2023-10-09T06:32:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.323+0000 7f979d337700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97980cbf10 0x7f9798154630 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f978000ea50 tx=0x7f97800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.323+0000 7f9794ff9700 1 -- 172.21.15.31:0/4107083767 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978000ee90 con 0x7f97980cbf10 2023-10-09T06:32:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.323+0000 7f9794ff9700 1 -- 172.21.15.31:0/4107083767 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978000c850 con 0x7f97980cbf10 2023-10-09T06:32:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.323+0000 7f979ed9a700 1 -- 172.21.15.31:0/4107083767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97981551f0 con 0x7f97980cbf10 2023-10-09T06:32:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.323+0000 7f9794ff9700 1 -- 172.21.15.31:0/4107083767 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978000cc10 con 0x7f97980cbf10 2023-10-09T06:32:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.323+0000 7f979ed9a700 1 -- 172.21.15.31:0/4107083767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979816a330 con 0x7f97980cbf10 2023-10-09T06:32:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.324+0000 7f979ed9a700 1 -- 172.21.15.31:0/4107083767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9798150ec0 con 0x7f97980cbf10 2023-10-09T06:32:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.325+0000 7f9794ff9700 1 -- 172.21.15.31:0/4107083767 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9780013470 con 0x7f97980cbf10 2023-10-09T06:32:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.325+0000 7f9794ff9700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9778066f30 0x7f97780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.325+0000 7f9794ff9700 1 -- 172.21.15.31:0/4107083767 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f9780084740 con 0x7f97980cbf10 2023-10-09T06:32:35.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.325+0000 7f979cb36700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9778066f30 0x7f97780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:35.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.326+0000 7f979cb36700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9778066f30 0x7f97780693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9790007b10 tx=0x7f9790007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:35.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.329+0000 7f9794ff9700 1 -- 172.21.15.31:0/4107083767 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9780051960 con 0x7f97980cbf10 2023-10-09T06:32:35.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:35.568+0000 7f979ed9a700 1 -- 172.21.15.31:0/4107083767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f979804c3c0 con 0x7f97980cbf10 2023-10-09T06:32:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.178+0000 7f9794ff9700 1 -- 172.21.15.31:0/4107083767 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v91) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9780054f80 con 0x7f97980cbf10 2023-10-09T06:32:36.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.181+0000 7f979ed9a700 1 -- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9778066f30 msgr2=0x7f97780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.181+0000 7f979ed9a700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9778066f30 0x7f97780693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9790007b10 tx=0x7f9790007d30 comp rx=0 tx=0).stop 2023-10-09T06:32:36.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.181+0000 7f979ed9a700 1 -- 172.21.15.31:0/4107083767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97980cbf10 msgr2=0x7f9798154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.181+0000 7f979ed9a700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97980cbf10 0x7f9798154630 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f978000ea50 tx=0x7f97800091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.181+0000 7f979ed9a700 1 -- 172.21.15.31:0/4107083767 shutdown_connections 2023-10-09T06:32:36.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.181+0000 7f979ed9a700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9778066f30 0x7f97780693e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.181+0000 7f979ed9a700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f97980678b0 0x7f979816aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.181+0000 7f979ed9a700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97980cbf10 0x7f9798154630 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.181+0000 7f979ed9a700 1 --2- 172.21.15.31:0/4107083767 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97980c9390 0x7f9798155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.181+0000 7f979ed9a700 1 -- 172.21.15.31:0/4107083767 >> 172.21.15.31:0/4107083767 conn(0x7f9798069870 msgr2=0x7f97981507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:36.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.181+0000 7f979ed9a700 1 -- 172.21.15.31:0/4107083767 shutdown_connections 2023-10-09T06:32:36.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.181+0000 7f979ed9a700 1 -- 172.21.15.31:0/4107083767 wait complete. 2023-10-09T06:32:36.196 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:32:36.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.363+0000 7ff4bd391700 1 Processor -- start 2023-10-09T06:32:36.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.363+0000 7ff4bd391700 1 -- start start 2023-10-09T06:32:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.364+0000 7ff4bd391700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff4b8156c00 0x7ff4b806a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.364+0000 7ff4bd391700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b806dfd0 con 0x7ff4b80a9de0 2023-10-09T06:32:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.364+0000 7ff4bd391700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b806e2b0 con 0x7ff4b8156830 2023-10-09T06:32:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.364+0000 7ff4bd391700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b806e590 con 0x7ff4b8156c00 2023-10-09T06:32:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.364+0000 7ff4bcb90700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff4b80a9de0 0x7ff4b80c8710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32938/0 (socket says 172.21.15.31:32938) 2023-10-09T06:32:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.364+0000 7ff4bcb90700 1 -- 172.21.15.31:0/1816511922 learned_addr learned my addr 172.21.15.31:0/1816511922 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.364+0000 7ff4b77fe700 1 --2- 172.21.15.31:0/1816511922 >> v2:172.21.15.158:3300/0 conn(0x7ff4b8156c00 0x7ff4b806a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.364+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475907918 0 0) 0x7ff4b806dfd0 con 0x7ff4b80a9de0 2023-10-09T06:32:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.364+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a0003570 con 0x7ff4b80a9de0 2023-10-09T06:32:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2159367540 0 0) 0x7ff4a0003570 con 0x7ff4b80a9de0 2023-10-09T06:32:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 >> v2:172.21.15.158:3300/0 conn(0x7ff4b8156c00 msgr2=0x7ff4b806a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b6ffd700 1 --2- 172.21.15.31:0/1816511922 >> v2:172.21.15.158:3300/0 conn(0x7ff4b8156c00 0x7ff4b806a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 >> v1:172.21.15.158:6789/0 conn(0x7ff4b8156830 legacy=0x7ff4b806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b806e870 con 0x7ff4b80a9de0 2023-10-09T06:32:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7ff4b00017f0 con 0x7ff4b80a9de0 2023-10-09T06:32:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b77fe700 1 --2- 172.21.15.31:0/1816511922 >> v2:172.21.15.158:3300/0 conn(0x7ff4b8156c00 0x7ff4b806a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:32:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 >> v1:172.21.15.31:6789/0 conn(0x7ff4b80a9de0 legacy=0x7ff4b80c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b6ffd700 1 --2- 172.21.15.31:0/1816511922 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4a0003a60 0x7ff4a0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b6ffd700 1 --2- 172.21.15.31:0/1816511922 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4a0004810 0x7ff4a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b6ffd700 1 --2- 172.21.15.31:0/1816511922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4a00051c0 0x7ff4a000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b806e590 con 0x7ff4a00051c0 2023-10-09T06:32:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a000c050 con 0x7ff4a0003a60 2023-10-09T06:32:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a000c210 con 0x7ff4a0004810 2023-10-09T06:32:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4bcb90700 1 --2- 172.21.15.31:0/1816511922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4a00051c0 0x7ff4a000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b7fff700 1 --2- 172.21.15.31:0/1816511922 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4a0003a60 0x7ff4a0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4b77fe700 1 --2- 172.21.15.31:0/1816511922 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4a0004810 0x7ff4a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4bcb90700 1 -- 172.21.15.31:0/1816511922 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4a0004810 msgr2=0x7ff4a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4bcb90700 1 --2- 172.21.15.31:0/1816511922 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4a0004810 0x7ff4a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4bcb90700 1 -- 172.21.15.31:0/1816511922 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4a0003a60 msgr2=0x7ff4a0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4bcb90700 1 --2- 172.21.15.31:0/1816511922 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4a0003a60 0x7ff4a0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4bcb90700 1 -- 172.21.15.31:0/1816511922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a0003570 con 0x7ff4a00051c0 2023-10-09T06:32:36.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4bcb90700 1 -- 172.21.15.31:0/1816511922 reap_dead start 2023-10-09T06:32:36.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.365+0000 7ff4bcb90700 1 --2- 172.21.15.31:0/1816511922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4a00051c0 0x7ff4a000ba60 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000a950 tx=0x7ff4b00021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c604c313af802e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:36.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.366+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00070d0 con 0x7ff4a00051c0 2023-10-09T06:32:36.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.366+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b0007270 con 0x7ff4a00051c0 2023-10-09T06:32:36.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.366+0000 7ff4b6ffd700 1 -- 172.21.15.31:0/1816511922 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0007630 con 0x7ff4a00051c0 2023-10-09T06:32:36.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.366+0000 7ff4bd391700 1 -- 172.21.15.31:0/1816511922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4a00051c0 msgr2=0x7ff4a000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.366+0000 7ff4bd391700 1 --2- 172.21.15.31:0/1816511922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4a00051c0 0x7ff4a000ba60 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000a950 tx=0x7ff4b00021f0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.366+0000 7ff4bd391700 1 -- 172.21.15.31:0/1816511922 shutdown_connections 2023-10-09T06:32:36.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.366+0000 7ff4bd391700 1 --2- 172.21.15.31:0/1816511922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4a00051c0 0x7ff4a000ba60 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.366+0000 7ff4bd391700 1 -- 172.21.15.31:0/1816511922 >> 172.21.15.31:0/1816511922 conn(0x7ff4b80cd060 msgr2=0x7ff4b80cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:36.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.366+0000 7ff4bd391700 1 -- 172.21.15.31:0/1816511922 shutdown_connections 2023-10-09T06:32:36.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.366+0000 7ff4bd391700 1 -- 172.21.15.31:0/1816511922 wait complete. 2023-10-09T06:32:36.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.367+0000 7ff4bd391700 1 Processor -- start 2023-10-09T06:32:36.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.367+0000 7ff4bd391700 1 -- start start 2023-10-09T06:32:36.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bd391700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4a00051c0 0x7ff4b816d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bd391700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b814ee90 0x7ff4b80c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bd391700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8158c00 0x7ff4b8159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bd391700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80c8470 con 0x7ff4b8158c00 2023-10-09T06:32:36.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bd391700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b816e6f0 con 0x7ff4a00051c0 2023-10-09T06:32:36.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bd391700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8158770 con 0x7ff4b814ee90 2023-10-09T06:32:36.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bcb90700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8158c00 0x7ff4b8159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bcb90700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8158c00 0x7ff4b8159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44288/0 (socket says 172.21.15.31:44288) 2023-10-09T06:32:36.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bcb90700 1 -- 172.21.15.31:0/1203228941 learned_addr learned my addr 172.21.15.31:0/1203228941 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:36.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4b7fff700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4a00051c0 0x7ff4b816d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4b77fe700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b814ee90 0x7ff4b80c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bcb90700 1 -- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b814ee90 msgr2=0x7ff4b80c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bcb90700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b814ee90 0x7ff4b80c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bcb90700 1 -- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4a00051c0 msgr2=0x7ff4b816d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bcb90700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4a00051c0 0x7ff4b816d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.368+0000 7ff4bcb90700 1 -- 172.21.15.31:0/1203228941 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b816de50 con 0x7ff4b8158c00 2023-10-09T06:32:36.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.369+0000 7ff4bcb90700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8158c00 0x7ff4b8159070 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0000f80 tx=0x7ff4b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:36.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.369+0000 7ff49ffff700 1 -- 172.21.15.31:0/1203228941 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00075f0 con 0x7ff4b8158c00 2023-10-09T06:32:36.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.369+0000 7ff49ffff700 1 -- 172.21.15.31:0/1203228941 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b0001250 con 0x7ff4b8158c00 2023-10-09T06:32:36.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.369+0000 7ff4bd391700 1 -- 172.21.15.31:0/1203228941 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b816e130 con 0x7ff4b8158c00 2023-10-09T06:32:36.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.369+0000 7ff49ffff700 1 -- 172.21.15.31:0/1203228941 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b001d670 con 0x7ff4b8158c00 2023-10-09T06:32:36.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.369+0000 7ff4bd391700 1 -- 172.21.15.31:0/1203228941 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b816a160 con 0x7ff4b8158c00 2023-10-09T06:32:36.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.370+0000 7ff4bd391700 1 -- 172.21.15.31:0/1203228941 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b806cdc0 con 0x7ff4b8158c00 2023-10-09T06:32:36.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.370+0000 7ff49ffff700 1 -- 172.21.15.31:0/1203228941 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4b001d9e0 con 0x7ff4b8158c00 2023-10-09T06:32:36.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.370+0000 7ff49ffff700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4a4066f30 0x7ff4a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.371+0000 7ff49ffff700 1 -- 172.21.15.31:0/1203228941 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5791+0+0 (secure 0 0 0) 0x7ff4b00867c0 con 0x7ff4b8158c00 2023-10-09T06:32:36.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.371+0000 7ff4b7fff700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4a4066f30 0x7ff4a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.371+0000 7ff4b7fff700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4a4066f30 0x7ff4a40693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8003c00 tx=0x7ff4a8007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:36.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.375+0000 7ff49ffff700 1 -- 172.21.15.31:0/1203228941 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4b0053940 con 0x7ff4b8158c00 2023-10-09T06:32:36.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.569+0000 7ff4bd391700 1 -- 172.21.15.31:0/1203228941 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff4b806cdc0 con 0x7ff4b8158c00 2023-10-09T06:32:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.811+0000 7ff49ffff700 1 -- 172.21.15.31:0/1203228941 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v190) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff4b0056f60 con 0x7ff4b8158c00 2023-10-09T06:32:36.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.814+0000 7ff4bd391700 1 -- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4a4066f30 msgr2=0x7ff4a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.814+0000 7ff4bd391700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4a4066f30 0x7ff4a40693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8003c00 tx=0x7ff4a8007d10 comp rx=0 tx=0).stop 2023-10-09T06:32:36.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.814+0000 7ff4bd391700 1 -- 172.21.15.31:0/1203228941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8158c00 msgr2=0x7ff4b8159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.814+0000 7ff4bd391700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8158c00 0x7ff4b8159070 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0000f80 tx=0x7ff4b0016000 comp rx=0 tx=0).stop 2023-10-09T06:32:36.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.814+0000 7ff4bd391700 1 -- 172.21.15.31:0/1203228941 shutdown_connections 2023-10-09T06:32:36.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.814+0000 7ff4bd391700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff4a4066f30 0x7ff4a40693e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.814+0000 7ff4bd391700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4b8158c00 0x7ff4b8159070 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.814+0000 7ff4bd391700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4a00051c0 0x7ff4b816d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.814+0000 7ff4bd391700 1 --2- 172.21.15.31:0/1203228941 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff4b814ee90 0x7ff4b80c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.814+0000 7ff4bd391700 1 -- 172.21.15.31:0/1203228941 >> 172.21.15.31:0/1203228941 conn(0x7ff4b80cd060 msgr2=0x7ff4b814fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.814+0000 7ff4bd391700 1 -- 172.21.15.31:0/1203228941 shutdown_connections 2023-10-09T06:32:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.814+0000 7ff4bd391700 1 -- 172.21.15.31:0/1203228941 wait complete. 2023-10-09T06:32:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:32:36.827 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:32:36.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.952+0000 7f464cdfd700 1 Processor -- start 2023-10-09T06:32:36.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.952+0000 7f464cdfd700 1 -- start start 2023-10-09T06:32:36.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.953+0000 7f464cdfd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4648159e50 0x7f46480b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.953+0000 7f464cdfd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46480b0d60 con 0x7f4648068cb0 2023-10-09T06:32:36.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.953+0000 7f464cdfd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46480d15b0 con 0x7f46480b3370 2023-10-09T06:32:36.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.953+0000 7f464cdfd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46480d1890 con 0x7f4648159e50 2023-10-09T06:32:36.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f4646d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4648068cb0 0x7f46480cb310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32954/0 (socket says 172.21.15.31:32954) 2023-10-09T06:32:36.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f4646d9d700 1 -- 172.21.15.31:0/1753464671 learned_addr learned my addr 172.21.15.31:0/1753464671 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464659c700 1 --2- 172.21.15.31:0/1753464671 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4648159e50 0x7f46480b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219679339 0 0) 0x7f46480b0d60 con 0x7f4648068cb0 2023-10-09T06:32:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4634003570 con 0x7f4648068cb0 2023-10-09T06:32:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3027128365 0 0) 0x7f4634003570 con 0x7f4648068cb0 2023-10-09T06:32:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4648159e50 msgr2=0x7f46480b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 --2- 172.21.15.31:0/1753464671 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4648159e50 0x7f46480b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 >> v1:172.21.15.158:6789/0 conn(0x7f46480b3370 legacy=0x7f46480b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46480b09f0 con 0x7f4648068cb0 2023-10-09T06:32:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f4638001470 con 0x7f4648068cb0 2023-10-09T06:32:36.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 >> v1:172.21.15.31:6789/0 conn(0x7f4648068cb0 legacy=0x7f46480cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 --2- 172.21.15.31:0/1753464671 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4634003a90 0x7f4634003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 --2- 172.21.15.31:0/1753464671 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4648159e50 0x7f4634004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 --2- 172.21.15.31:0/1753464671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4634004d50 0x7f46340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46480d1890 con 0x7f4634004d50 2023-10-09T06:32:36.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463400bb70 con 0x7f4634003a90 2023-10-09T06:32:36.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463400bd30 con 0x7f4648159e50 2023-10-09T06:32:36.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f4646d9d700 1 --2- 172.21.15.31:0/1753464671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4634004d50 0x7f46340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f464659c700 1 --2- 172.21.15.31:0/1753464671 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4634003a90 0x7f4634003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.954+0000 7f4645d9b700 1 --2- 172.21.15.31:0/1753464671 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4648159e50 0x7f4634004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.955+0000 7f4646d9d700 1 -- 172.21.15.31:0/1753464671 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4648159e50 msgr2=0x7f4634004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:36.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.955+0000 7f4646d9d700 1 --2- 172.21.15.31:0/1753464671 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4648159e50 0x7f4634004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.955+0000 7f4646d9d700 1 -- 172.21.15.31:0/1753464671 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4634003a90 msgr2=0x7f4634003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:36.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.955+0000 7f4646d9d700 1 --2- 172.21.15.31:0/1753464671 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4634003a90 0x7f4634003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.955+0000 7f4646d9d700 1 -- 172.21.15.31:0/1753464671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4634003570 con 0x7f4634004d50 2023-10-09T06:32:36.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.955+0000 7f4646d9d700 1 --2- 172.21.15.31:0/1753464671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4634004d50 0x7f46340051c0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f463800c390 tx=0x7f46480b0cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61738f76cdd2c7f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:36.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.955+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463800cc60 con 0x7f4634004d50 2023-10-09T06:32:36.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.955+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463800cdc0 con 0x7f4634004d50 2023-10-09T06:32:36.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.955+0000 7f464559a700 1 -- 172.21.15.31:0/1753464671 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4638005b70 con 0x7f4634004d50 2023-10-09T06:32:36.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.955+0000 7f464cdfd700 1 -- 172.21.15.31:0/1753464671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4634004d50 msgr2=0x7f46340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.955+0000 7f464cdfd700 1 --2- 172.21.15.31:0/1753464671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4634004d50 0x7f46340051c0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f463800c390 tx=0x7f46480b0cd0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.955+0000 7f4646d9d700 1 -- 172.21.15.31:0/1753464671 reap_dead start 2023-10-09T06:32:36.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.956+0000 7f464cdfd700 1 -- 172.21.15.31:0/1753464671 shutdown_connections 2023-10-09T06:32:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.956+0000 7f464cdfd700 1 -- 172.21.15.31:0/1753464671 >> 172.21.15.31:0/1753464671 conn(0x7f4648068130 msgr2=0x7f46480d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.956+0000 7f464cdfd700 1 -- 172.21.15.31:0/1753464671 shutdown_connections 2023-10-09T06:32:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.956+0000 7f464cdfd700 1 -- 172.21.15.31:0/1753464671 wait complete. 2023-10-09T06:32:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.957+0000 7f464cdfd700 1 Processor -- start 2023-10-09T06:32:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.957+0000 7f464cdfd700 1 -- start start 2023-10-09T06:32:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.957+0000 7f464cdfd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4634004d50 0x7f46480c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.957+0000 7f464cdfd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46480cae10 0x7f46480cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.957+0000 7f464cdfd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46480cb7c0 0x7f464816a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.957+0000 7f464cdfd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46480c92e0 con 0x7f46480cb7c0 2023-10-09T06:32:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.957+0000 7f464cdfd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46480cbc40 con 0x7f4634004d50 2023-10-09T06:32:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.957+0000 7f464cdfd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46480c86d0 con 0x7f46480cae10 2023-10-09T06:32:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.957+0000 7f4646d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46480cb7c0 0x7f464816a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f4646d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46480cb7c0 0x7f464816a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44306/0 (socket says 172.21.15.31:44306) 2023-10-09T06:32:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f4646d9d700 1 -- 172.21.15.31:0/857545382 learned_addr learned my addr 172.21.15.31:0/857545382 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f4645d9b700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46480cae10 0x7f46480cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f464659c700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4634004d50 0x7f46480c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f4646d9d700 1 -- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46480cae10 msgr2=0x7f46480cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f4646d9d700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46480cae10 0x7f46480cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f4646d9d700 1 -- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4634004d50 msgr2=0x7f46480c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f4646d9d700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4634004d50 0x7f46480c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f4646d9d700 1 -- 172.21.15.31:0/857545382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46480c89b0 con 0x7f46480cb7c0 2023-10-09T06:32:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f4646d9d700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46480cb7c0 0x7f464816a390 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f463400bb40 tx=0x7f4638015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f463e7fc700 1 -- 172.21.15.31:0/857545382 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463800cc60 con 0x7f46480cb7c0 2023-10-09T06:32:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f463e7fc700 1 -- 172.21.15.31:0/857545382 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46380072e0 con 0x7f46480cb7c0 2023-10-09T06:32:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f464cdfd700 1 -- 172.21.15.31:0/857545382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46480c8c90 con 0x7f46480cb7c0 2023-10-09T06:32:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f463e7fc700 1 -- 172.21.15.31:0/857545382 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4638007680 con 0x7f46480cb7c0 2023-10-09T06:32:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.958+0000 7f464cdfd700 1 -- 172.21.15.31:0/857545382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4648158c00 con 0x7f46480cb7c0 2023-10-09T06:32:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.959+0000 7f464cdfd700 1 -- 172.21.15.31:0/857545382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4648071390 con 0x7f46480cb7c0 2023-10-09T06:32:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.960+0000 7f463e7fc700 1 -- 172.21.15.31:0/857545382 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4638019030 con 0x7f46480cb7c0 2023-10-09T06:32:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.960+0000 7f463e7fc700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4628066f30 0x7f46280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.960+0000 7f463e7fc700 1 -- 172.21.15.31:0/857545382 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f4638084cd0 con 0x7f46480cb7c0 2023-10-09T06:32:36.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.960+0000 7f464659c700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4628066f30 0x7f46280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:36.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.960+0000 7f463e7fc700 1 -- 172.21.15.31:0/857545382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=191}) v3 -- 0x7f462806dcf0 con 0x7f46480cb7c0 2023-10-09T06:32:36.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.961+0000 7f464659c700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4628066f30 0x7f46280693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f46400094d0 tx=0x7f464000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:36.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:36.964+0000 7f463e7fc700 1 -- 172.21.15.31:0/857545382 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4638017060 con 0x7f46480cb7c0 2023-10-09T06:32:37.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:37.160+0000 7f464cdfd700 1 -- 172.21.15.31:0/857545382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f46480c9490 con 0x7f46480cb7c0 2023-10-09T06:32:38.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.000+0000 7f463e7fc700 1 -- 172.21.15.31:0/857545382 <== mon.0 v2:172.21.15.31:3300/0 7 ==== osd_map(191..191 src has 1..191) v4 ==== 288+0+0 (secure 0 0 0) 0x7f4638056460 con 0x7f46480cb7c0 2023-10-09T06:32:38.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.000+0000 7f463e7fc700 1 -- 172.21.15.31:0/857545382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=192}) v3 -- 0x7f462806ca80 con 0x7f46480cb7c0 2023-10-09T06:32:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.004+0000 7f463e7fc700 1 -- 172.21.15.31:0/857545382 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v191) v1 ==== 169+0+0 (secure 0 0 0) 0x7f46480c9490 con 0x7f46480cb7c0 2023-10-09T06:32:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.011+0000 7f464cdfd700 1 -- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4628066f30 msgr2=0x7f46280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.011+0000 7f464cdfd700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4628066f30 0x7f46280693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f46400094d0 tx=0x7f464000b040 comp rx=0 tx=0).stop 2023-10-09T06:32:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.011+0000 7f464cdfd700 1 -- 172.21.15.31:0/857545382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46480cb7c0 msgr2=0x7f464816a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:38.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.011+0000 7f464cdfd700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46480cb7c0 0x7f464816a390 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f463400bb40 tx=0x7f4638015000 comp rx=0 tx=0).stop 2023-10-09T06:32:38.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.011+0000 7f464cdfd700 1 -- 172.21.15.31:0/857545382 shutdown_connections 2023-10-09T06:32:38.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.011+0000 7f464cdfd700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4628066f30 0x7f46280693e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.011+0000 7f464cdfd700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46480cb7c0 0x7f464816a390 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.011+0000 7f464cdfd700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4634004d50 0x7f46480c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.011+0000 7f464cdfd700 1 --2- 172.21.15.31:0/857545382 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f46480cae10 0x7f46480cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.011+0000 7f464cdfd700 1 -- 172.21.15.31:0/857545382 >> 172.21.15.31:0/857545382 conn(0x7f4648068130 msgr2=0x7f46480b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:38.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.014+0000 7f464cdfd700 1 -- 172.21.15.31:0/857545382 shutdown_connections 2023-10-09T06:32:38.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.015+0000 7f464cdfd700 1 -- 172.21.15.31:0/857545382 wait complete. 2023-10-09T06:32:38.017 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2023-10-09T06:32:38.031 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:32:38.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.156+0000 7fb6b5b5f700 1 Processor -- start 2023-10-09T06:32:38.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.156+0000 7fb6b5b5f700 1 -- start start 2023-10-09T06:32:38.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6b5b5f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb6b015cec0 0x7fb6b00cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:38.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6b5b5f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6b015ade0 0x7fb6b00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:38.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6b5b5f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b00cc760 con 0x7fb6b015a300 2023-10-09T06:32:38.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6b5b5f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b015b460 con 0x7fb6b015ade0 2023-10-09T06:32:38.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6b5b5f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b015ba20 con 0x7fb6b015cec0 2023-10-09T06:32:38.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6b535e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6b015ade0 0x7fb6b00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:38.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6b535e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6b015ade0 0x7fb6b00cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44310/0 (socket says 172.21.15.31:44310) 2023-10-09T06:32:38.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6b535e700 1 -- 172.21.15.31:0/2488029393 learned_addr learned my addr 172.21.15.31:0/2488029393 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:38.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6b535e700 1 -- 172.21.15.31:0/2488029393 >> v2:172.21.15.158:3300/0 conn(0x7fb6b015cec0 msgr2=0x7fb6b00cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6affff700 1 --2- 172.21.15.31:0/2488029393 >> v2:172.21.15.158:3300/0 conn(0x7fb6b015cec0 0x7fb6b00cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6b535e700 1 --2- 172.21.15.31:0/2488029393 >> v2:172.21.15.158:3300/0 conn(0x7fb6b015cec0 0x7fb6b00cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6b535e700 1 -- 172.21.15.31:0/2488029393 >> v1:172.21.15.158:6789/0 conn(0x7fb6b015a300 legacy=0x7fb6b015a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6b535e700 1 -- 172.21.15.31:0/2488029393 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b00cc1a0 con 0x7fb6b015ade0 2023-10-09T06:32:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.157+0000 7fb6affff700 1 --2- 172.21.15.31:0/2488029393 >> v2:172.21.15.158:3300/0 conn(0x7fb6b015cec0 0x7fb6b00cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.158+0000 7fb6b535e700 1 --2- 172.21.15.31:0/2488029393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b015ade0 0x7fb6b00cb970 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb6b015b410 tx=0x7fb698009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3bf1971ff4bbef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.158+0000 7fb6af7fe700 1 -- 172.21.15.31:0/2488029393 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69800b820 con 0x7fb6b015ade0 2023-10-09T06:32:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.158+0000 7fb6af7fe700 1 -- 172.21.15.31:0/2488029393 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69800b980 con 0x7fb6b015ade0 2023-10-09T06:32:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.158+0000 7fb6af7fe700 1 -- 172.21.15.31:0/2488029393 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69800bd20 con 0x7fb6b015ade0 2023-10-09T06:32:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.158+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/2488029393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b015ade0 msgr2=0x7fb6b00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.158+0000 7fb6b5b5f700 1 --2- 172.21.15.31:0/2488029393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b015ade0 0x7fb6b00cb970 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb6b015b410 tx=0x7fb698009250 comp rx=0 tx=0).stop 2023-10-09T06:32:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.158+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/2488029393 shutdown_connections 2023-10-09T06:32:38.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.158+0000 7fb6b5b5f700 1 --2- 172.21.15.31:0/2488029393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b015ade0 0x7fb6b00cb970 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.158+0000 7fb6b5b5f700 1 --2- 172.21.15.31:0/2488029393 >> v2:172.21.15.158:3300/0 conn(0x7fb6b015cec0 0x7fb6b00cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.158+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/2488029393 >> 172.21.15.31:0/2488029393 conn(0x7fb6b0099f50 msgr2=0x7fb6b0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:38.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.158+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/2488029393 shutdown_connections 2023-10-09T06:32:38.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.158+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/2488029393 wait complete. 2023-10-09T06:32:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.159+0000 7fb6b5b5f700 1 Processor -- start 2023-10-09T06:32:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.160+0000 7fb6b5b5f700 1 -- start start 2023-10-09T06:32:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.160+0000 7fb6b5b5f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6b015a300 0x7fb6b00b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.160+0000 7fb6b5b5f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b015ade0 0x7fb6b00b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.160+0000 7fb6b5b5f700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb6b015cec0 0x7fb6b00c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.160+0000 7fb6b5b5f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00b1600 con 0x7fb6b015ade0 2023-10-09T06:32:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.160+0000 7fb6b5b5f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00b5430 con 0x7fb6b015a300 2023-10-09T06:32:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.160+0000 7fb6b5b5f700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00b5660 con 0x7fb6b015cec0 2023-10-09T06:32:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6affff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b015ade0 0x7fb6b00b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6affff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b015ade0 0x7fb6b00b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44318/0 (socket says 172.21.15.31:44318) 2023-10-09T06:32:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6affff700 1 -- 172.21.15.31:0/179605601 learned_addr learned my addr 172.21.15.31:0/179605601 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6b4b5d700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6b015a300 0x7fb6b00b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6b535e700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb6b015cec0 0x7fb6b00c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6affff700 1 -- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb6b015cec0 msgr2=0x7fb6b00c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6affff700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb6b015cec0 0x7fb6b00c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6affff700 1 -- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6b015a300 msgr2=0x7fb6b00b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6affff700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6b015a300 0x7fb6b00b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6affff700 1 -- 172.21.15.31:0/179605601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6980094f0 con 0x7fb6b015ade0 2023-10-09T06:32:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6affff700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b015ade0 0x7fb6b00b4ef0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000a430 tx=0x7fb6a0007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6acff9700 1 -- 172.21.15.31:0/179605601 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0015440 con 0x7fb6b015ade0 2023-10-09T06:32:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6acff9700 1 -- 172.21.15.31:0/179605601 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a00155a0 con 0x7fb6b015ade0 2023-10-09T06:32:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/179605601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b00b5940 con 0x7fb6b015ade0 2023-10-09T06:32:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6acff9700 1 -- 172.21.15.31:0/179605601 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0015960 con 0x7fb6b015ade0 2023-10-09T06:32:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.161+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/179605601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b00b5f00 con 0x7fb6b015ade0 2023-10-09T06:32:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.162+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/179605601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b006ada0 con 0x7fb6b015ade0 2023-10-09T06:32:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.163+0000 7fb6acff9700 1 -- 172.21.15.31:0/179605601 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6a0015cd0 con 0x7fb6b015ade0 2023-10-09T06:32:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.163+0000 7fb6acff9700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb690066f30 0x7fb6900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.163+0000 7fb6acff9700 1 -- 172.21.15.31:0/179605601 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb6a00848c0 con 0x7fb6b015ade0 2023-10-09T06:32:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.163+0000 7fb6b4b5d700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb690066f30 0x7fb6900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.164+0000 7fb6b4b5d700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb690066f30 0x7fb6900693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8006fd0 tx=0x7fb6a8009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.168+0000 7fb6acff9700 1 -- 172.21.15.31:0/179605601 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6a004e5a0 con 0x7fb6b015ade0 2023-10-09T06:32:38.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.365+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/179605601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb6b00cc480 con 0x7fb6b015ade0 2023-10-09T06:32:38.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.368+0000 7fb6acff9700 1 -- 172.21.15.31:0/179605601 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb6a0051ee0 con 0x7fb6b015ade0 2023-10-09T06:32:38.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.370+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb690066f30 msgr2=0x7fb6900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:38.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.370+0000 7fb6b5b5f700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb690066f30 0x7fb6900693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8006fd0 tx=0x7fb6a8009060 comp rx=0 tx=0).stop 2023-10-09T06:32:38.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.370+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/179605601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b015ade0 msgr2=0x7fb6b00b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:38.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.370+0000 7fb6b5b5f700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b015ade0 0x7fb6b00b4ef0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000a430 tx=0x7fb6a0007910 comp rx=0 tx=0).stop 2023-10-09T06:32:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.370+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/179605601 shutdown_connections 2023-10-09T06:32:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.370+0000 7fb6b5b5f700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fb690066f30 0x7fb6900693e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.370+0000 7fb6b5b5f700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fb6b015cec0 0x7fb6b00c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.370+0000 7fb6b5b5f700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6b015a300 0x7fb6b00b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.370+0000 7fb6b5b5f700 1 --2- 172.21.15.31:0/179605601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b015ade0 0x7fb6b00b4ef0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.370+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/179605601 >> 172.21.15.31:0/179605601 conn(0x7fb6b0099f50 msgr2=0x7fb6b00d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.370+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/179605601 shutdown_connections 2023-10-09T06:32:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.370+0000 7fb6b5b5f700 1 -- 172.21.15.31:0/179605601 wait complete. 2023-10-09T06:32:38.383 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-09T06:32:38.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.501+0000 7fd63381c700 1 Processor -- start 2023-10-09T06:32:38.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.502+0000 7fd63381c700 1 -- start start 2023-10-09T06:32:38.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.502+0000 7fd63381c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd62c1510f0 0x7fd62c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:38.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd63381c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd62c0c9af0 0x7fd62c15dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:38.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd63381c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62c15e280 con 0x7fd62c070700 2023-10-09T06:32:38.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd63381c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c0ca0b0 con 0x7fd62c1510f0 2023-10-09T06:32:38.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd63381c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c068a10 con 0x7fd62c0c9af0 2023-10-09T06:32:38.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd6315b8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd62c1510f0 0x7fd62c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:38.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd6315b8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd62c1510f0 0x7fd62c06ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44330/0 (socket says 172.21.15.31:44330) 2023-10-09T06:32:38.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd6315b8700 1 -- 172.21.15.31:0/4245292758 learned_addr learned my addr 172.21.15.31:0/4245292758 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:38.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd630db7700 1 --2- 172.21.15.31:0/4245292758 >> v2:172.21.15.158:3300/0 conn(0x7fd62c0c9af0 0x7fd62c15dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:38.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd6315b8700 1 -- 172.21.15.31:0/4245292758 >> v2:172.21.15.158:3300/0 conn(0x7fd62c0c9af0 msgr2=0x7fd62c15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:38.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd6315b8700 1 --2- 172.21.15.31:0/4245292758 >> v2:172.21.15.158:3300/0 conn(0x7fd62c0c9af0 0x7fd62c15dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd6315b8700 1 -- 172.21.15.31:0/4245292758 >> v1:172.21.15.158:6789/0 conn(0x7fd62c070700 legacy=0x7fd62c070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:38.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd6315b8700 1 -- 172.21.15.31:0/4245292758 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c068cf0 con 0x7fd62c1510f0 2023-10-09T06:32:38.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd6315b8700 1 --2- 172.21.15.31:0/4245292758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c1510f0 0x7fd62c06ecc0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fd62c069b20 tx=0x7fd624009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a363be8747a637 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:38.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd62bfff700 1 -- 172.21.15.31:0/4245292758 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624009e70 con 0x7fd62c1510f0 2023-10-09T06:32:38.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd62bfff700 1 -- 172.21.15.31:0/4245292758 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62400b860 con 0x7fd62c1510f0 2023-10-09T06:32:38.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.503+0000 7fd62bfff700 1 -- 172.21.15.31:0/4245292758 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400bc00 con 0x7fd62c1510f0 2023-10-09T06:32:38.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.504+0000 7fd63381c700 1 -- 172.21.15.31:0/4245292758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c1510f0 msgr2=0x7fd62c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:38.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.504+0000 7fd63381c700 1 --2- 172.21.15.31:0/4245292758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c1510f0 0x7fd62c06ecc0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fd62c069b20 tx=0x7fd624009250 comp rx=0 tx=0).stop 2023-10-09T06:32:38.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.504+0000 7fd63381c700 1 -- 172.21.15.31:0/4245292758 shutdown_connections 2023-10-09T06:32:38.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.504+0000 7fd63381c700 1 --2- 172.21.15.31:0/4245292758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c1510f0 0x7fd62c06ecc0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.504+0000 7fd63381c700 1 --2- 172.21.15.31:0/4245292758 >> v2:172.21.15.158:3300/0 conn(0x7fd62c0c9af0 0x7fd62c15dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.504+0000 7fd63381c700 1 -- 172.21.15.31:0/4245292758 >> 172.21.15.31:0/4245292758 conn(0x7fd62c0ca4f0 msgr2=0x7fd62c0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:38.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.504+0000 7fd63381c700 1 -- 172.21.15.31:0/4245292758 shutdown_connections 2023-10-09T06:32:38.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.504+0000 7fd63381c700 1 -- 172.21.15.31:0/4245292758 wait complete. 2023-10-09T06:32:38.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.505+0000 7fd63381c700 1 Processor -- start 2023-10-09T06:32:38.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.505+0000 7fd63381c700 1 -- start start 2023-10-09T06:32:38.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd63381c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd62c070700 0x7fd62c1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:38.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd63381c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd62c0c9af0 0x7fd62c14fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:38.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd63381c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c1510f0 0x7fd62c0c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:38.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd63381c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c159560 con 0x7fd62c1510f0 2023-10-09T06:32:38.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd63381c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c4bd0 con 0x7fd62c0c9af0 2023-10-09T06:32:38.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd63381c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c4e40 con 0x7fd62c070700 2023-10-09T06:32:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd631db9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c1510f0 0x7fd62c0c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd631db9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c1510f0 0x7fd62c0c7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44332/0 (socket says 172.21.15.31:44332) 2023-10-09T06:32:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd631db9700 1 -- 172.21.15.31:0/627799246 learned_addr learned my addr 172.21.15.31:0/627799246 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd630db7700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd62c0c9af0 0x7fd62c14fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd6315b8700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd62c070700 0x7fd62c1514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd631db9700 1 -- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd62c070700 msgr2=0x7fd62c1514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd631db9700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd62c070700 0x7fd62c1514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd631db9700 1 -- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd62c0c9af0 msgr2=0x7fd62c14fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd631db9700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd62c0c9af0 0x7fd62c14fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.506+0000 7fd631db9700 1 -- 172.21.15.31:0/627799246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6240094f0 con 0x7fd62c1510f0 2023-10-09T06:32:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.507+0000 7fd631db9700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c1510f0 0x7fd62c0c7340 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00c910 tx=0x7fd61c0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:38.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.507+0000 7fd6297fa700 1 -- 172.21.15.31:0/627799246 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c012630 con 0x7fd62c1510f0 2023-10-09T06:32:38.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.507+0000 7fd6297fa700 1 -- 172.21.15.31:0/627799246 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c012790 con 0x7fd62c1510f0 2023-10-09T06:32:38.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.507+0000 7fd63381c700 1 -- 172.21.15.31:0/627799246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62c0c5120 con 0x7fd62c1510f0 2023-10-09T06:32:38.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.507+0000 7fd6297fa700 1 -- 172.21.15.31:0/627799246 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c012b50 con 0x7fd62c1510f0 2023-10-09T06:32:38.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.507+0000 7fd63381c700 1 -- 172.21.15.31:0/627799246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c150230 con 0x7fd62c1510f0 2023-10-09T06:32:38.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.508+0000 7fd63381c700 1 -- 172.21.15.31:0/627799246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62c159330 con 0x7fd62c1510f0 2023-10-09T06:32:38.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.508+0000 7fd6297fa700 1 -- 172.21.15.31:0/627799246 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd61c01b450 con 0x7fd62c1510f0 2023-10-09T06:32:38.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.509+0000 7fd6297fa700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd618066f30 0x7fd6180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:38.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.509+0000 7fd6297fa700 1 -- 172.21.15.31:0/627799246 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd61c084450 con 0x7fd62c1510f0 2023-10-09T06:32:38.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.509+0000 7fd6315b8700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd618066f30 0x7fd6180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:38.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.509+0000 7fd6315b8700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd618066f30 0x7fd6180693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd62c069b20 tx=0x7fd624017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:38.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.513+0000 7fd6297fa700 1 -- 172.21.15.31:0/627799246 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd62c159330 con 0x7fd62c1510f0 2023-10-09T06:32:38.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:38.788+0000 7fd63381c700 1 -- 172.21.15.31:0/627799246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7fd62c159330 con 0x7fd62c1510f0 2023-10-09T06:32:39.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.014+0000 7fd6297fa700 1 -- 172.21.15.31:0/627799246 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v550) v1 ==== 135+0+0 (secure 0 0 0) 0x7fd62c159330 con 0x7fd62c1510f0 2023-10-09T06:32:39.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.016+0000 7fd63381c700 1 -- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd618066f30 msgr2=0x7fd6180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:39.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.016+0000 7fd63381c700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd618066f30 0x7fd6180693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd62c069b20 tx=0x7fd624017000 comp rx=0 tx=0).stop 2023-10-09T06:32:39.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.016+0000 7fd63381c700 1 -- 172.21.15.31:0/627799246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c1510f0 msgr2=0x7fd62c0c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:39.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.016+0000 7fd63381c700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c1510f0 0x7fd62c0c7340 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00c910 tx=0x7fd61c0016f0 comp rx=0 tx=0).stop 2023-10-09T06:32:39.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.016+0000 7fd63381c700 1 -- 172.21.15.31:0/627799246 shutdown_connections 2023-10-09T06:32:39.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.016+0000 7fd63381c700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd618066f30 0x7fd6180693e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:39.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.016+0000 7fd63381c700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd62c070700 0x7fd62c1514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:39.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.016+0000 7fd63381c700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c1510f0 0x7fd62c0c7340 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:39.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.016+0000 7fd63381c700 1 --2- 172.21.15.31:0/627799246 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd62c0c9af0 0x7fd62c14fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:39.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.016+0000 7fd63381c700 1 -- 172.21.15.31:0/627799246 >> 172.21.15.31:0/627799246 conn(0x7fd62c0ca4f0 msgr2=0x7fd62c070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:39.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.016+0000 7fd63381c700 1 -- 172.21.15.31:0/627799246 shutdown_connections 2023-10-09T06:32:39.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.016+0000 7fd63381c700 1 -- 172.21.15.31:0/627799246 wait complete. 2023-10-09T06:32:39.029 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-09T06:32:39.030 INFO:tasks.cephfs_test_runner: 2023-10-09T06:32:39.030 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-09T06:32:39.030 INFO:tasks.cephfs_test_runner:Ran 10 tests in 672.605s 2023-10-09T06:32:39.030 INFO:tasks.cephfs_test_runner: 2023-10-09T06:32:39.030 INFO:tasks.cephfs_test_runner:OK 2023-10-09T06:32:39.030 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-09T06:32:39.040 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-09T06:32:39.055 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-09T06:32:39.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:39.055 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:32:39.070 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:32:39.071 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:32:39.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:39.071 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:32:39.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:39.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:32:39.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:39.233 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2023-10-09T06:32:39.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:39.328 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-10-09T06:32:39.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:39.343 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2023-10-09T06:32:39.412 INFO:teuthology.orchestra.run.smithi031.stderr:Cannot find device "ceph-brx" 2023-10-09T06:32:39.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:32:39.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:39.413 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:32:39.431 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T06:32:39.431 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T06:32:39.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:39.431 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T06:32:39.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:39.510 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:32:39.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:39.591 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-10-09T06:32:39.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:39.697 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-09T06:32:39.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:32:39.712 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-10-09T06:32:39.780 INFO:teuthology.orchestra.run.smithi158.stderr:Cannot find device "ceph-brx" 2023-10-09T06:32:39.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:32:39.782 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-09T06:32:39.790 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-09T06:32:39.791 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:32:39.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.912+0000 7fe2e862a700 1 Processor -- start 2023-10-09T06:32:39.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.912+0000 7fe2e862a700 1 -- start start 2023-10-09T06:32:39.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.913+0000 7fe2e862a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2e0069de0 0x7fe2e015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:39.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.913+0000 7fe2e862a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e0069060 con 0x7fe2e00c9560 2023-10-09T06:32:39.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.913+0000 7fe2e862a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e0069300 con 0x7fe2e0158160 2023-10-09T06:32:39.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.913+0000 7fe2e862a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00695e0 con 0x7fe2e0069de0 2023-10-09T06:32:39.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.913+0000 7fe2e63c6700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe2e00c9560 0x7fe2e0157a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60804/0 (socket says 172.21.15.31:60804) 2023-10-09T06:32:39.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e63c6700 1 -- 172.21.15.31:0/3040341350 learned_addr learned my addr 172.21.15.31:0/3040341350 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:39.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e5bc5700 1 --2- 172.21.15.31:0/3040341350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2e0069de0 0x7fe2e015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:39.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753171046 0 0) 0x7fe2e0069060 con 0x7fe2e00c9560 2023-10-09T06:32:39.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c8003570 con 0x7fe2e00c9560 2023-10-09T06:32:39.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1777527397 0 0) 0x7fe2c8003570 con 0x7fe2e00c9560 2023-10-09T06:32:39.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2e0069de0 msgr2=0x7fe2e015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:39.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 --2- 172.21.15.31:0/3040341350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2e0069de0 0x7fe2e015bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:39.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 >> v1:172.21.15.158:6789/0 conn(0x7fe2e0158160 legacy=0x7fe2e015c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:39.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e00698c0 con 0x7fe2e00c9560 2023-10-09T06:32:39.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fe2d8001470 con 0x7fe2e00c9560 2023-10-09T06:32:39.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 >> v1:172.21.15.31:6789/0 conn(0x7fe2e00c9560 legacy=0x7fe2e0157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:39.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 --2- 172.21.15.31:0/3040341350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2e0069de0 0x7fe2c8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:39.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 --2- 172.21.15.31:0/3040341350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2c8004010 0x7fe2c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:39.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 --2- 172.21.15.31:0/3040341350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2c8004d50 0x7fe2c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:39.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00695e0 con 0x7fe2c8004010 2023-10-09T06:32:39.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c800bbf0 con 0x7fe2c8004d50 2023-10-09T06:32:39.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c800bdb0 con 0x7fe2e0069de0 2023-10-09T06:32:39.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e5bc5700 1 --2- 172.21.15.31:0/3040341350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2c8004010 0x7fe2c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:39.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e63c6700 1 --2- 172.21.15.31:0/3040341350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2e0069de0 0x7fe2c8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:39.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.914+0000 7fe2e6bc7700 1 --2- 172.21.15.31:0/3040341350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2c8004d50 0x7fe2c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:39.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.915+0000 7fe2e5bc5700 1 -- 172.21.15.31:0/3040341350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2e0069de0 msgr2=0x7fe2c8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:39.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.915+0000 7fe2e5bc5700 1 --2- 172.21.15.31:0/3040341350 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2e0069de0 0x7fe2c8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:39.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.915+0000 7fe2e5bc5700 1 -- 172.21.15.31:0/3040341350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2c8004d50 msgr2=0x7fe2c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:39.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.915+0000 7fe2e5bc5700 1 --2- 172.21.15.31:0/3040341350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2c8004d50 0x7fe2c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:39.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.915+0000 7fe2e5bc5700 1 -- 172.21.15.31:0/3040341350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c8003570 con 0x7fe2c8004010 2023-10-09T06:32:39.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.915+0000 7fe2e5bc5700 1 --2- 172.21.15.31:0/3040341350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2c8004010 0x7fe2c8004810 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4006f00 tx=0x7fe2d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7a613c91247c03 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:39.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.915+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400e710 con 0x7fe2c8004010 2023-10-09T06:32:39.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.915+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d400e870 con 0x7fe2c8004010 2023-10-09T06:32:39.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.915+0000 7fe2e53c4700 1 -- 172.21.15.31:0/3040341350 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400ec30 con 0x7fe2c8004010 2023-10-09T06:32:39.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.915+0000 7fe2e862a700 1 -- 172.21.15.31:0/3040341350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2c8004010 msgr2=0x7fe2c8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:39.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.915+0000 7fe2e862a700 1 --2- 172.21.15.31:0/3040341350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2c8004010 0x7fe2c8004810 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4006f00 tx=0x7fe2d40091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.916+0000 7fe2e6bc7700 1 -- 172.21.15.31:0/3040341350 reap_dead start 2023-10-09T06:32:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.916+0000 7fe2e862a700 1 -- 172.21.15.31:0/3040341350 shutdown_connections 2023-10-09T06:32:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.916+0000 7fe2e862a700 1 -- 172.21.15.31:0/3040341350 >> 172.21.15.31:0/3040341350 conn(0x7fe2e0067660 msgr2=0x7fe2e0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.916+0000 7fe2e862a700 1 -- 172.21.15.31:0/3040341350 shutdown_connections 2023-10-09T06:32:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.916+0000 7fe2e862a700 1 -- 172.21.15.31:0/3040341350 wait complete. 2023-10-09T06:32:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.917+0000 7fe2e862a700 1 Processor -- start 2023-10-09T06:32:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.917+0000 7fe2e862a700 1 -- start start 2023-10-09T06:32:39.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e862a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2c8004010 0x7fe2e0168e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e862a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2e014a120 0x7fe2e00b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e862a700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2e00b1c10 0x7fe2e015ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e862a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e0169340 con 0x7fe2e014a120 2023-10-09T06:32:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e862a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e0168970 con 0x7fe2c8004010 2023-10-09T06:32:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e862a700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e0168380 con 0x7fe2e00b1c10 2023-10-09T06:32:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e5bc5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2e014a120 0x7fe2e00b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e5bc5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2e014a120 0x7fe2e00b16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58280/0 (socket says 172.21.15.31:58280) 2023-10-09T06:32:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e5bc5700 1 -- 172.21.15.31:0/3628205713 learned_addr learned my addr 172.21.15.31:0/3628205713 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e63c6700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2c8004010 0x7fe2e0168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e6bc7700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2e00b1c10 0x7fe2e015ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:39.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e5bc5700 1 -- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2e00b1c10 msgr2=0x7fe2e015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:39.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e5bc5700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2e00b1c10 0x7fe2e015ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:39.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e5bc5700 1 -- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2c8004010 msgr2=0x7fe2e0168e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:39.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e5bc5700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2c8004010 0x7fe2e0168e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:39.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e5bc5700 1 -- 172.21.15.31:0/3628205713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e00c2d70 con 0x7fe2e014a120 2023-10-09T06:32:39.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e5bc5700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2e014a120 0x7fe2e00b16d0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80057d0 tx=0x7fe2d401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:39.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2de7fc700 1 -- 172.21.15.31:0/3628205713 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4022070 con 0x7fe2e014a120 2023-10-09T06:32:39.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2de7fc700 1 -- 172.21.15.31:0/3628205713 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d400e9e0 con 0x7fe2e014a120 2023-10-09T06:32:39.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e862a700 1 -- 172.21.15.31:0/3628205713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e00c3050 con 0x7fe2e014a120 2023-10-09T06:32:39.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2de7fc700 1 -- 172.21.15.31:0/3628205713 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d401c450 con 0x7fe2e014a120 2023-10-09T06:32:39.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.918+0000 7fe2e862a700 1 -- 172.21.15.31:0/3628205713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e00c2a00 con 0x7fe2e014a120 2023-10-09T06:32:39.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.919+0000 7fe2e862a700 1 -- 172.21.15.31:0/3628205713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e004c3c0 con 0x7fe2e014a120 2023-10-09T06:32:39.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.920+0000 7fe2de7fc700 1 -- 172.21.15.31:0/3628205713 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2d401c860 con 0x7fe2e014a120 2023-10-09T06:32:39.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.920+0000 7fe2de7fc700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe2cc066f30 0x7fe2cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:39.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.920+0000 7fe2de7fc700 1 -- 172.21.15.31:0/3628205713 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe2d4085940 con 0x7fe2e014a120 2023-10-09T06:32:39.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.920+0000 7fe2e63c6700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe2cc066f30 0x7fe2cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:39.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.921+0000 7fe2e63c6700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe2cc066f30 0x7fe2cc0693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8001120 tx=0x7fe2d8001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:39.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:39.925+0000 7fe2de7fc700 1 -- 172.21.15.31:0/3628205713 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2d4052f70 con 0x7fe2e014a120 2023-10-09T06:32:40.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.118+0000 7fe2e862a700 1 -- 172.21.15.31:0/3628205713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2e00b24f0 con 0x7fe2e014a120 2023-10-09T06:32:40.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.118+0000 7fe2de7fc700 1 -- 172.21.15.31:0/3628205713 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+12274 (secure 0 0 0) 0x7fe2d402b090 con 0x7fe2e014a120 2023-10-09T06:32:40.119 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:40.119 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":191,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:32:37.999240+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6835/4124393323":"2023-10-10T06:32:35.175626+0000","172.21.15.31:6833/4124393323":"2023-10-10T06:32:35.175626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:32:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.120+0000 7fe2e862a700 1 -- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe2cc066f30 msgr2=0x7fe2cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.120+0000 7fe2e862a700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe2cc066f30 0x7fe2cc0693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8001120 tx=0x7fe2d8001e50 comp rx=0 tx=0).stop 2023-10-09T06:32:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.120+0000 7fe2e862a700 1 -- 172.21.15.31:0/3628205713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2e014a120 msgr2=0x7fe2e00b16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.120+0000 7fe2e862a700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2e014a120 0x7fe2e00b16d0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80057d0 tx=0x7fe2d401a000 comp rx=0 tx=0).stop 2023-10-09T06:32:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.120+0000 7fe2e862a700 1 -- 172.21.15.31:0/3628205713 shutdown_connections 2023-10-09T06:32:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.120+0000 7fe2e862a700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fe2cc066f30 0x7fe2cc0693e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.120+0000 7fe2e862a700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fe2e00b1c10 0x7fe2e015ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.120+0000 7fe2e862a700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe2c8004010 0x7fe2e0168e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.120+0000 7fe2e862a700 1 --2- 172.21.15.31:0/3628205713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2e014a120 0x7fe2e00b16d0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.120+0000 7fe2e862a700 1 -- 172.21.15.31:0/3628205713 >> 172.21.15.31:0/3628205713 conn(0x7fe2e0067660 msgr2=0x7fe2e0155f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.120+0000 7fe2e862a700 1 -- 172.21.15.31:0/3628205713 shutdown_connections 2023-10-09T06:32:40.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.120+0000 7fe2e862a700 1 -- 172.21.15.31:0/3628205713 wait complete. 2023-10-09T06:32:40.133 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-09T06:32:40.133 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:32:40.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.251+0000 7fc488803700 1 Processor -- start 2023-10-09T06:32:40.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.251+0000 7fc488803700 1 -- start start 2023-10-09T06:32:40.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.252+0000 7fc488803700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4840cd6e0 0x7fc4840cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.252+0000 7fc488803700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc48415cbd0 0x7fc48415d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.252+0000 7fc488803700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4840cb7c0 con 0x7fc4840cdab0 2023-10-09T06:32:40.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.252+0000 7fc488803700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48415e850 con 0x7fc4840cd6e0 2023-10-09T06:32:40.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.252+0000 7fc488803700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4840cd030 con 0x7fc48415cbd0 2023-10-09T06:32:40.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.252+0000 7fc4837fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4840cd6e0 0x7fc4840cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.252+0000 7fc4837fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4840cd6e0 0x7fc4840cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58284/0 (socket says 172.21.15.31:58284) 2023-10-09T06:32:40.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.252+0000 7fc4837fe700 1 -- 172.21.15.31:0/4106466397 learned_addr learned my addr 172.21.15.31:0/4106466397 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:40.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.252+0000 7fc483fff700 1 --2- 172.21.15.31:0/4106466397 >> v2:172.21.15.158:3300/0 conn(0x7fc48415cbd0 0x7fc48415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.252+0000 7fc4837fe700 1 -- 172.21.15.31:0/4106466397 >> v2:172.21.15.158:3300/0 conn(0x7fc48415cbd0 msgr2=0x7fc48415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:40.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc4837fe700 1 --2- 172.21.15.31:0/4106466397 >> v2:172.21.15.158:3300/0 conn(0x7fc48415cbd0 0x7fc48415d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc4837fe700 1 -- 172.21.15.31:0/4106466397 >> v1:172.21.15.158:6789/0 conn(0x7fc4840cdab0 legacy=0x7fc48415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:40.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc4837fe700 1 -- 172.21.15.31:0/4106466397 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48415e290 con 0x7fc4840cd6e0 2023-10-09T06:32:40.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc4837fe700 1 --2- 172.21.15.31:0/4106466397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4840cd6e0 0x7fc4840cbc50 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fc4840cb730 tx=0x7fc474009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36873464f2e58f6d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:40.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc4827fc700 1 -- 172.21.15.31:0/4106466397 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47400b860 con 0x7fc4840cd6e0 2023-10-09T06:32:40.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc4827fc700 1 -- 172.21.15.31:0/4106466397 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47400b9c0 con 0x7fc4840cd6e0 2023-10-09T06:32:40.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc4827fc700 1 -- 172.21.15.31:0/4106466397 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47400bd60 con 0x7fc4840cd6e0 2023-10-09T06:32:40.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc488803700 1 -- 172.21.15.31:0/4106466397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4840cd6e0 msgr2=0x7fc4840cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc488803700 1 --2- 172.21.15.31:0/4106466397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4840cd6e0 0x7fc4840cbc50 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fc4840cb730 tx=0x7fc474009250 comp rx=0 tx=0).stop 2023-10-09T06:32:40.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc488803700 1 -- 172.21.15.31:0/4106466397 shutdown_connections 2023-10-09T06:32:40.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc488803700 1 --2- 172.21.15.31:0/4106466397 >> v2:172.21.15.158:3300/0 conn(0x7fc48415cbd0 0x7fc48415d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc488803700 1 --2- 172.21.15.31:0/4106466397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4840cd6e0 0x7fc4840cbc50 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc488803700 1 -- 172.21.15.31:0/4106466397 >> 172.21.15.31:0/4106466397 conn(0x7fc484067660 msgr2=0x7fc484067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:40.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.253+0000 7fc488803700 1 -- 172.21.15.31:0/4106466397 shutdown_connections 2023-10-09T06:32:40.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.254+0000 7fc488803700 1 -- 172.21.15.31:0/4106466397 wait complete. 2023-10-09T06:32:40.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.255+0000 7fc488803700 1 Processor -- start 2023-10-09T06:32:40.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.255+0000 7fc488803700 1 -- start start 2023-10-09T06:32:40.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.255+0000 7fc488803700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc4840cd6e0 0x7fc4840c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.255+0000 7fc488803700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4840cdab0 0x7fc4840b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc488803700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48415cbd0 0x7fc4840b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc488803700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840c91a0 con 0x7fc48415cbd0 2023-10-09T06:32:40.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc488803700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840c8590 con 0x7fc4840cd6e0 2023-10-09T06:32:40.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc488803700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840c8870 con 0x7fc4840cdab0 2023-10-09T06:32:40.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc483fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48415cbd0 0x7fc4840b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc483fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48415cbd0 0x7fc4840b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58286/0 (socket says 172.21.15.31:58286) 2023-10-09T06:32:40.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc483fff700 1 -- 172.21.15.31:0/2418546525 learned_addr learned my addr 172.21.15.31:0/2418546525 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:40.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc4837fe700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc4840cd6e0 0x7fc4840c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc482ffd700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4840cdab0 0x7fc4840b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc483fff700 1 -- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4840cdab0 msgr2=0x7fc4840b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc483fff700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4840cdab0 0x7fc4840b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc483fff700 1 -- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc4840cd6e0 msgr2=0x7fc4840c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc483fff700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc4840cd6e0 0x7fc4840c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc483fff700 1 -- 172.21.15.31:0/2418546525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4740094f0 con 0x7fc48415cbd0 2023-10-09T06:32:40.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc483fff700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48415cbd0 0x7fc4840b2780 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fc47c007f20 tx=0x7fc47c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:40.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc46b7fe700 1 -- 172.21.15.31:0/2418546525 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c00eb90 con 0x7fc48415cbd0 2023-10-09T06:32:40.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc46b7fe700 1 -- 172.21.15.31:0/2418546525 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c00ed10 con 0x7fc48415cbd0 2023-10-09T06:32:40.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc488803700 1 -- 172.21.15.31:0/2418546525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4840c8b50 con 0x7fc48415cbd0 2023-10-09T06:32:40.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc46b7fe700 1 -- 172.21.15.31:0/2418546525 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c014670 con 0x7fc48415cbd0 2023-10-09T06:32:40.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.256+0000 7fc488803700 1 -- 172.21.15.31:0/2418546525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4840c8260 con 0x7fc48415cbd0 2023-10-09T06:32:40.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.257+0000 7fc488803700 1 -- 172.21.15.31:0/2418546525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4840c9350 con 0x7fc48415cbd0 2023-10-09T06:32:40.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.258+0000 7fc46b7fe700 1 -- 172.21.15.31:0/2418546525 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc47c0149e0 con 0x7fc48415cbd0 2023-10-09T06:32:40.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.258+0000 7fc46b7fe700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc470066f30 0x7fc4700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.258+0000 7fc46b7fe700 1 -- 172.21.15.31:0/2418546525 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc47c0847e0 con 0x7fc48415cbd0 2023-10-09T06:32:40.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.258+0000 7fc4837fe700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc470066f30 0x7fc4700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.259+0000 7fc4837fe700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc470066f30 0x7fc4700693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc4840cb730 tx=0x7fc474017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:40.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.262+0000 7fc46b7fe700 1 -- 172.21.15.31:0/2418546525 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4840c9350 con 0x7fc48415cbd0 2023-10-09T06:32:40.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.451+0000 7fc488803700 1 -- 172.21.15.31:0/2418546525 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4840c92e0 con 0x7fc470066f30 2023-10-09T06:32:40.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.454+0000 7fc46b7fe700 1 -- 172.21.15.31:0/2418546525 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49943 (secure 0 0 0) 0x7fc4840c92e0 con 0x7fc470066f30 2023-10-09T06:32:40.455 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:40.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.456+0000 7fc488803700 1 -- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc470066f30 msgr2=0x7fc4700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.456+0000 7fc488803700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc470066f30 0x7fc4700693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc4840cb730 tx=0x7fc474017000 comp rx=0 tx=0).stop 2023-10-09T06:32:40.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.456+0000 7fc488803700 1 -- 172.21.15.31:0/2418546525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48415cbd0 msgr2=0x7fc4840b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.456+0000 7fc488803700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48415cbd0 0x7fc4840b2780 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fc47c007f20 tx=0x7fc47c009860 comp rx=0 tx=0).stop 2023-10-09T06:32:40.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.456+0000 7fc488803700 1 -- 172.21.15.31:0/2418546525 shutdown_connections 2023-10-09T06:32:40.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.456+0000 7fc488803700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fc470066f30 0x7fc4700693e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.456+0000 7fc488803700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48415cbd0 0x7fc4840b2780 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.456+0000 7fc488803700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc4840cd6e0 0x7fc4840c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.456+0000 7fc488803700 1 --2- 172.21.15.31:0/2418546525 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fc4840cdab0 0x7fc4840b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.456+0000 7fc488803700 1 -- 172.21.15.31:0/2418546525 >> 172.21.15.31:0/2418546525 conn(0x7fc484067660 msgr2=0x7fc48415bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:40.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.456+0000 7fc488803700 1 -- 172.21.15.31:0/2418546525 shutdown_connections 2023-10-09T06:32:40.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.456+0000 7fc488803700 1 -- 172.21.15.31:0/2418546525 wait complete. 2023-10-09T06:32:40.458 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:32:40.469 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2023-10-09T06:32:38.688134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":64825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1497674,"statfs":{"total":1600000000,"available":1533618283,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-44025,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-100,"num_write_kb":-33861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001456"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":312,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-09T06:32:36.937686+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:32:36.937686+0000","last_peered":"2023-10-09T06:32:36.937686+0000","last_clean":"2023-10-09T06:32:36.937686+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:32:36.937686+0000","last_undegraded":"2023-10-09T06:32:36.937686+0000","last_fullsized":"2023-10-09T06:32:36.937686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185500,"statfs":{"total":200000000,"available":189952260,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.52700000000000002},"min":{"1min":0.36399999999999999,"5min":0.34200000000000003,"15min":0.28999999999999998},"max":{"1min":0.71399999999999997,"5min":0.81299999999999994,"15min":1.5469999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.35199999999999998,"5min":0.29299999999999998,"15min":0.28100000000000003},"max":{"1min":0.73299999999999998,"5min":0.78700000000000003,"15min":3.6970000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55800000000000005,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.311,"15min":0.29899999999999999},"max":{"1min":0.69199999999999995,"5min":0.80400000000000005,"15min":0.88100000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.26800000000000002},"max":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":1.4870000000000001},"last":0.48499999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.45800000000000002,"5min":0.435,"15min":0.34300000000000003},"max":{"1min":0.78200000000000003,"5min":0.79900000000000004,"15min":2.6139999999999999},"last":0.62},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.56499999999999995},"min":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.78700000000000003,"15min":2.6019999999999999},"last":0.64600000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.318},"max":{"1min":0.67100000000000004,"5min":0.78600000000000003,"15min":7.4729999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":7.8390000000000004},"last":0.57799999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.23799999999999999},"max":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.872},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.307,"15min":0.25600000000000001},"max":{"1min":0.70999999999999996,"5min":0.76900000000000002,"15min":0.86099999999999999},"last":0.41299999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.255},"max":{"1min":0.69499999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.75600000000000001,"15min":0.98699999999999999},"last":0.55400000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.35499999999999998},"max":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.93999999999999995},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29199999999999998},"max":{"1min":0.755,"5min":0.79900000000000004,"15min":0.91400000000000003},"last":0.45100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19475,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175836,"statfs":{"total":200000000,"available":180056868,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55900000000000005,"15min":0.64500000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.26900000000000002},"max":{"1min":0.76200000000000001,"5min":0.76700000000000002,"15min":7.0960000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.371,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.79800000000000004,"15min":1.133},"last":0.29699999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.83299999999999996,"5min":0.84399999999999997,"15min":1.155},"last":0.434},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.317},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":1.1459999999999999},"last":0.42299999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":0.63700000000000001,"5min":0.746,"15min":1.2290000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.66500000000000004},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.308},"max":{"1min":0.81699999999999995,"5min":0.86599999999999999,"15min":7.1299999999999999},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.34499999999999997},"max":{"1min":0.68400000000000005,"5min":0.83499999999999996,"15min":1.337},"last":0.371},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.80100000000000005,"15min":1.206},"last":0.48199999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.46500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28000000000000003},"max":{"1min":0.67400000000000004,"5min":0.749,"15min":0.75900000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68100000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46899999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":0.54600000000000004,"5min":0.71999999999999997,"15min":0.80000000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68600000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48999999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.72899999999999998,"5min":0.81100000000000005,"15min":0.81299999999999994},"last":0.502},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.77900000000000003,"15min":0.82399999999999995},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.219},"max":{"1min":0.441,"5min":0.58999999999999997,"15min":0.64000000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.38100000000000001,"15min":0.35899999999999999},"min":{"1min":0.27600000000000002,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.55900000000000005,"5min":0.61499999999999999,"15min":0.93300000000000005},"last":0.23000000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36299999999999999,"15min":0.35299999999999998},"min":{"1min":0.247,"5min":0.218,"15min":0.218},"max":{"1min":0.50600000000000001,"5min":0.71399999999999997,"15min":0.82299999999999995},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42699999999999999,"15min":0.40400000000000003},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.247},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.70899999999999996},"last":0.34999999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47699999999999998,"15min":0.443},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.29199999999999998},"max":{"1min":0.64300000000000002,"5min":0.751,"15min":0.751},"last":0.432},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.437},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.90500000000000003},"last":0.32200000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.315},"max":{"1min":0.90000000000000002,"5min":0.95699999999999996,"15min":1.097},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.70499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81699999999999995,"5min":0.97699999999999998,"15min":5.5270000000000001},"last":0.46300000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65700000000000003,"15min":0.64000000000000001},"min":{"1min":0.53800000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.0069999999999999,"5min":1.0669999999999999,"15min":1.125},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.65600000000000003},"min":{"1min":0.51900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":1,"15min":1.4219999999999999},"last":0.42099999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66100000000000003,"15min":0.64000000000000001},"min":{"1min":0.55600000000000005,"5min":0.45500000000000002,"15min":0.39300000000000002},"max":{"1min":0.96399999999999997,"5min":1.0029999999999999,"15min":1.0629999999999999},"last":0.498},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":0.94799999999999995,"15min":1.49},"last":0.45500000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65300000000000002},"min":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":1.016,"15min":1.016},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.51200000000000001,"5min":0.44700000000000001,"15min":0.41599999999999998},"max":{"1min":0.91600000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.442}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185500,"statfs":{"total":200000000,"available":189952260,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.20599999999999999},"max":{"1min":0.56499999999999995,"5min":0.71599999999999997,"15min":1.226},"last":0.439},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.20599999999999999},"max":{"1min":0.68300000000000005,"5min":0.82999999999999996,"15min":1.131},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.67300000000000004},"min":{"1min":0.32500000000000001,"5min":0.28299999999999997,"15min":0.25800000000000001},"max":{"1min":0.629,"5min":0.63600000000000001,"15min":12.929},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.441},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.59399999999999997,"5min":0.751,"15min":1.1599999999999999},"last":0.48799999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.35299999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71699999999999997,"5min":0.78100000000000003,"15min":1.1859999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.36099999999999999,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":1.3089999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.44400000000000001,"5min":0.40799999999999997,"15min":0.36599999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.748},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.335},"last":0.72699999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65100000000000002,"15min":0.626},"min":{"1min":0.437,"5min":0.40100000000000002,"15min":0.35499999999999998},"max":{"1min":0.95399999999999996,"5min":1.016,"15min":1.0580000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64300000000000002,"15min":0.61799999999999999},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.317},"max":{"1min":0.877,"5min":0.98599999999999999,"15min":0.999},"last":0.80400000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63300000000000001,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.92200000000000004,"5min":1.05,"15min":1.05},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.67200000000000004},"min":{"1min":0.50800000000000001,"5min":0.41499999999999998,"15min":0.374},"max":{"1min":1.0209999999999999,"5min":1.032,"15min":1.2849999999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70299999999999996,"15min":0.67800000000000005},"min":{"1min":0.497,"5min":0.43099999999999999,"15min":0.40400000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.262},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.66900000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":1.0660000000000001,"15min":1.103},"last":0.72299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173783,"statfs":{"total":200000000,"available":177954163,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35499999999999998,"15min":0.59499999999999997},"min":{"1min":0.22900000000000001,"5min":0.20699999999999999,"15min":0.19800000000000001},"max":{"1min":0.55200000000000005,"5min":0.65000000000000002,"15min":14.981999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38400000000000001,"15min":0.51400000000000001},"min":{"1min":0.26300000000000001,"5min":0.252,"15min":0.22},"max":{"1min":0.58699999999999997,"5min":0.63900000000000001,"15min":9.1600000000000001},"last":0.33400000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.372,"15min":0.48799999999999999},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.222},"max":{"1min":0.53000000000000003,"5min":0.59199999999999997,"15min":8.4930000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41699999999999998,"15min":0.55400000000000005},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.254},"max":{"1min":0.63800000000000001,"5min":0.67800000000000005,"15min":9.0239999999999991},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45500000000000002,"15min":0.56499999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":8.5190000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.67300000000000004},"min":{"1min":0.35499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.622,"5min":0.748,"15min":15.007999999999999},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.64000000000000001,"15min":0.86599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":14.917999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.65000000000000002,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.40899999999999997},"max":{"1min":0.89800000000000002,"5min":0.90400000000000003,"15min":8.9930000000000003},"last":0.55800000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.76000000000000001},"min":{"1min":0.41199999999999998,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.84699999999999998,"5min":0.94599999999999995,"15min":8.9610000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66500000000000004,"15min":0.77300000000000002},"min":{"1min":0.48499999999999999,"5min":0.45100000000000001,"15min":0.35099999999999998},"max":{"1min":0.85999999999999999,"5min":1.03,"15min":8.3919999999999995},"last":0.58999999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.75900000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.39900000000000002},"max":{"1min":0.82699999999999996,"5min":0.97299999999999998,"15min":8.4339999999999993},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67300000000000004,"15min":0.88100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.374},"max":{"1min":0.88200000000000001,"5min":0.99099999999999999,"15min":14.954000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.751},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36199999999999999},"max":{"1min":0.80100000000000005,"5min":0.90600000000000003,"15min":8.9160000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.76600000000000001},"min":{"1min":0.435,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":0.91400000000000003,"5min":0.91700000000000004,"15min":8.4640000000000004},"last":0.64500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38200000000000001,"15min":0.35399999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":0.48099999999999998,"5min":0.56100000000000005,"15min":0.66800000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.45400000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.38400000000000001,"15min":0.35099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.215},"max":{"1min":0.497,"5min":0.60699999999999998,"15min":0.623},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.43099999999999999,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23699999999999999},"max":{"1min":0.49299999999999999,"5min":0.66600000000000004,"15min":0.68899999999999995},"last":0.32100000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42199999999999999,"15min":0.38800000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.252},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.497,"15min":0.45700000000000002},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.28399999999999997},"max":{"1min":0.63700000000000001,"5min":0.71799999999999997,"15min":0.75700000000000001},"last":0.502}]},{"osd":4,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89100000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65500000000000003,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.33400000000000002},"max":{"1min":0.877,"5min":1.073,"15min":1.073},"last":0.57799999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67900000000000005,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.33600000000000002},"max":{"1min":0.81499999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69199999999999995,"15min":0.64600000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":1.097,"15min":1.097},"last":0.76000000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.66900000000000004,"15min":0.61699999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.69099999999999995,"15min":0.64000000000000001},"min":{"1min":0.441,"5min":0.434,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67500000000000004,"15min":0.628},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.83599999999999997,"5min":1.139,"15min":1.139},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.69699999999999995,"15min":0.64400000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":1.026,"15min":1.026},"last":0.77600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.318},"max":{"1min":0.66100000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.254},"max":{"1min":0.73899999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55100000000000005,"15min":0.625},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.752,"5min":0.754,"15min":4.3250000000000002},"last":0.443}]},{"osd":2,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.622},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.73799999999999999,"5min":0.77900000000000003,"15min":4.7320000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55800000000000005,"15min":0.79500000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.32600000000000001},"max":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":11.715},"last":0.37}]},{"osd":3,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57399999999999995,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76300000000000001,"5min":0.77700000000000002,"15min":0.79100000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.39000000000000001},"max":{"1min":0.77300000000000002,"5min":0.81499999999999995,"15min":0.85599999999999998},"last":0.64900000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.503},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47099999999999997,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.82799999999999996},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48199999999999998,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.63200000000000001,"5min":0.80400000000000005,"15min":0.86699999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52300000000000002,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.64400000000000002,"5min":0.74299999999999999,"15min":0.84999999999999998},"last":0.56200000000000006}]},{"osd":7,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.39100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72399999999999998,"5min":0.81599999999999995,"15min":0.879},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.376,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.81299999999999994,"15min":0.88600000000000001},"last":0.61299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.82899999999999996,"15min":1.0289999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73099999999999998,"5min":0.77200000000000002,"15min":0.81899999999999995},"last":0.55700000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.82299999999999995,"15min":1.093},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57099999999999995,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.85499999999999998},"last":0.51000000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70499999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.433},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.36699999999999999,"15min":0.36299999999999999},"max":{"1min":0.75700000000000001,"5min":0.79800000000000004,"15min":0.89300000000000002},"last":0.52700000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59999999999999998,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98699999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.071},"last":0.54200000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45600000000000002,"15min":0.48299999999999998},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.84399999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46500000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.51200000000000001},"min":{"1min":0.34499999999999997,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.0680000000000001},"last":0.498},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.42499999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.88,"5min":0.88,"15min":1.0920000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.317,"15min":0.30399999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.91900000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.0269999999999999},"last":0.58299999999999996}]}]}],"pool_statfs":[]}} 2023-10-09T06:32:40.470 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:32:40.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.588+0000 7f11ebb54700 1 Processor -- start 2023-10-09T06:32:40.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.588+0000 7f11ebb54700 1 -- start start 2023-10-09T06:32:40.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.589+0000 7f11ebb54700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f11e40b1220 0x7f11e40c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.589+0000 7f11ebb54700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f11e40cb4f0 0x7f11e40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.589+0000 7f11ebb54700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e415de60 con 0x7f11e40b0e50 2023-10-09T06:32:40.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.589+0000 7f11ebb54700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e40cbeb0 con 0x7f11e40cb4f0 2023-10-09T06:32:40.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.589+0000 7f11ebb54700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e415e140 con 0x7f11e40b1220 2023-10-09T06:32:40.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.589+0000 7f11ea0f1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f11e40cb4f0 0x7f11e40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.589+0000 7f11ea0f1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f11e40cb4f0 0x7f11e40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58296/0 (socket says 172.21.15.31:58296) 2023-10-09T06:32:40.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.589+0000 7f11ea0f1700 1 -- 172.21.15.31:0/2412629713 learned_addr learned my addr 172.21.15.31:0/2412629713 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:40.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.590+0000 7f11e90ef700 1 --2- 172.21.15.31:0/2412629713 >> v2:172.21.15.158:3300/0 conn(0x7f11e40b1220 0x7f11e40c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.590+0000 7f11ea0f1700 1 -- 172.21.15.31:0/2412629713 >> v2:172.21.15.158:3300/0 conn(0x7f11e40b1220 msgr2=0x7f11e40c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:40.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.590+0000 7f11ea0f1700 1 --2- 172.21.15.31:0/2412629713 >> v2:172.21.15.158:3300/0 conn(0x7f11e40b1220 0x7f11e40c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.590+0000 7f11ea0f1700 1 -- 172.21.15.31:0/2412629713 >> v1:172.21.15.158:6789/0 conn(0x7f11e40b0e50 legacy=0x7f11e406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.590+0000 7f11ea0f1700 1 -- 172.21.15.31:0/2412629713 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e415e420 con 0x7f11e40cb4f0 2023-10-09T06:32:40.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.590+0000 7f11ea0f1700 1 --2- 172.21.15.31:0/2412629713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40cb4f0 0x7f11e40cb970 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f11e406cd30 tx=0x7f11d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1942241ca599a2f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:40.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.590+0000 7f11e88ee700 1 -- 172.21.15.31:0/2412629713 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d400e070 con 0x7f11e40cb4f0 2023-10-09T06:32:40.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.590+0000 7f11e88ee700 1 -- 172.21.15.31:0/2412629713 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d400ba50 con 0x7f11e40cb4f0 2023-10-09T06:32:40.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.590+0000 7f11e88ee700 1 -- 172.21.15.31:0/2412629713 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40092e0 con 0x7f11e40cb4f0 2023-10-09T06:32:40.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.591+0000 7f11ebb54700 1 -- 172.21.15.31:0/2412629713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40cb4f0 msgr2=0x7f11e40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.591+0000 7f11ebb54700 1 --2- 172.21.15.31:0/2412629713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40cb4f0 0x7f11e40cb970 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f11e406cd30 tx=0x7f11d4009840 comp rx=0 tx=0).stop 2023-10-09T06:32:40.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.591+0000 7f11ebb54700 1 -- 172.21.15.31:0/2412629713 shutdown_connections 2023-10-09T06:32:40.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.591+0000 7f11ebb54700 1 --2- 172.21.15.31:0/2412629713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40cb4f0 0x7f11e40cb970 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.591+0000 7f11ebb54700 1 --2- 172.21.15.31:0/2412629713 >> v2:172.21.15.158:3300/0 conn(0x7f11e40b1220 0x7f11e40c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.591+0000 7f11ebb54700 1 -- 172.21.15.31:0/2412629713 >> 172.21.15.31:0/2412629713 conn(0x7f11e4069870 msgr2=0x7f11e4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:40.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.591+0000 7f11ebb54700 1 -- 172.21.15.31:0/2412629713 shutdown_connections 2023-10-09T06:32:40.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.591+0000 7f11ebb54700 1 -- 172.21.15.31:0/2412629713 wait complete. 2023-10-09T06:32:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.592+0000 7f11ebb54700 1 Processor -- start 2023-10-09T06:32:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.592+0000 7f11ebb54700 1 -- start start 2023-10-09T06:32:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.592+0000 7f11ebb54700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f11e40b0e50 0x7f11e416a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.592+0000 7f11ebb54700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40b1220 0x7f11e415d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.592+0000 7f11ebb54700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11e40cb4f0 0x7f11e4145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.592+0000 7f11ebb54700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e40b2940 con 0x7f11e40b1220 2023-10-09T06:32:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.592+0000 7f11ebb54700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e416ab70 con 0x7f11e40cb4f0 2023-10-09T06:32:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.592+0000 7f11ebb54700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e416ae50 con 0x7f11e40b0e50 2023-10-09T06:32:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e90ef700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40b1220 0x7f11e415d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e90ef700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40b1220 0x7f11e415d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58308/0 (socket says 172.21.15.31:58308) 2023-10-09T06:32:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e90ef700 1 -- 172.21.15.31:0/2876421833 learned_addr learned my addr 172.21.15.31:0/2876421833 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11ea0f1700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11e40cb4f0 0x7f11e4145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e98f0700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f11e40b0e50 0x7f11e416a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e90ef700 1 -- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f11e40b0e50 msgr2=0x7f11e416a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e90ef700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f11e40b0e50 0x7f11e416a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e90ef700 1 -- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11e40cb4f0 msgr2=0x7f11e4145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e90ef700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11e40cb4f0 0x7f11e4145050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e90ef700 1 -- 172.21.15.31:0/2876421833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d4009ae0 con 0x7f11e40b1220 2023-10-09T06:32:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e98f0700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f11e40b0e50 0x7f11e416a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:40.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e90ef700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40b1220 0x7f11e415d0a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f11d800d890 tx=0x7f11d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:40.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e1ffb700 1 -- 172.21.15.31:0/2876421833 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d80125f0 con 0x7f11e40b1220 2023-10-09T06:32:40.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e1ffb700 1 -- 172.21.15.31:0/2876421833 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d8012770 con 0x7f11e40b1220 2023-10-09T06:32:40.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11ebb54700 1 -- 172.21.15.31:0/2876421833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e416b130 con 0x7f11e40b1220 2023-10-09T06:32:40.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11e1ffb700 1 -- 172.21.15.31:0/2876421833 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8012b30 con 0x7f11e40b1220 2023-10-09T06:32:40.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.593+0000 7f11ebb54700 1 -- 172.21.15.31:0/2876421833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e415f160 con 0x7f11e40b1220 2023-10-09T06:32:40.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.594+0000 7f11ebb54700 1 -- 172.21.15.31:0/2876421833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e416a8e0 con 0x7f11e40b1220 2023-10-09T06:32:40.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.595+0000 7f11e1ffb700 1 -- 172.21.15.31:0/2876421833 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11d801e460 con 0x7f11e40b1220 2023-10-09T06:32:40.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.595+0000 7f11e1ffb700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f11d0066f30 0x7f11d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.595+0000 7f11e1ffb700 1 -- 172.21.15.31:0/2876421833 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f11d80848c0 con 0x7f11e40b1220 2023-10-09T06:32:40.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.595+0000 7f11e98f0700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f11d0066f30 0x7f11d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.596+0000 7f11e98f0700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f11d0066f30 0x7f11d00693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f11dc001840 tx=0x7f11dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:40.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.599+0000 7f11e1ffb700 1 -- 172.21.15.31:0/2876421833 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11d8051e30 con 0x7f11e40b1220 2023-10-09T06:32:40.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.787+0000 7f11ebb54700 1 -- 172.21.15.31:0/2876421833 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11e404c3c0 con 0x7f11d0066f30 2023-10-09T06:32:40.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.790+0000 7f11e1ffb700 1 -- 172.21.15.31:0/2876421833 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49946 (secure 0 0 0) 0x7f11e404c3c0 con 0x7f11d0066f30 2023-10-09T06:32:40.791 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.792+0000 7f11ebb54700 1 -- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f11d0066f30 msgr2=0x7f11d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.792+0000 7f11ebb54700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f11d0066f30 0x7f11d00693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f11dc001840 tx=0x7f11dc009040 comp rx=0 tx=0).stop 2023-10-09T06:32:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.792+0000 7f11ebb54700 1 -- 172.21.15.31:0/2876421833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40b1220 msgr2=0x7f11e415d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.792+0000 7f11ebb54700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40b1220 0x7f11e415d0a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f11d800d890 tx=0x7f11d8008040 comp rx=0 tx=0).stop 2023-10-09T06:32:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.792+0000 7f11ebb54700 1 -- 172.21.15.31:0/2876421833 shutdown_connections 2023-10-09T06:32:40.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.792+0000 7f11ebb54700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f11d0066f30 0x7f11d00693e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.792+0000 7f11ebb54700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f11e40b0e50 0x7f11e416a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.792+0000 7f11ebb54700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11e40cb4f0 0x7f11e4145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.792+0000 7f11ebb54700 1 --2- 172.21.15.31:0/2876421833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11e40b1220 0x7f11e415d0a0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.792+0000 7f11ebb54700 1 -- 172.21.15.31:0/2876421833 >> 172.21.15.31:0/2876421833 conn(0x7f11e4069870 msgr2=0x7f11e40ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:40.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.792+0000 7f11ebb54700 1 -- 172.21.15.31:0/2876421833 shutdown_connections 2023-10-09T06:32:40.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.792+0000 7f11ebb54700 1 -- 172.21.15.31:0/2876421833 wait complete. 2023-10-09T06:32:40.794 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:32:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2023-10-09T06:32:40.688562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":64825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1497674,"statfs":{"total":1600000000,"available":1533618283,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489239,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001457"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":312,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-09T06:32:36.937686+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:32:36.937686+0000","last_peered":"2023-10-09T06:32:36.937686+0000","last_clean":"2023-10-09T06:32:36.937686+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:32:36.937686+0000","last_undegraded":"2023-10-09T06:32:36.937686+0000","last_fullsized":"2023-10-09T06:32:36.937686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185500,"statfs":{"total":200000000,"available":189952260,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.52700000000000002},"min":{"1min":0.36399999999999999,"5min":0.34200000000000003,"15min":0.28999999999999998},"max":{"1min":0.71399999999999997,"5min":0.81299999999999994,"15min":1.5469999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.35199999999999998,"5min":0.29299999999999998,"15min":0.28100000000000003},"max":{"1min":0.73299999999999998,"5min":0.78700000000000003,"15min":3.6970000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55800000000000005,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.311,"15min":0.29899999999999999},"max":{"1min":0.69199999999999995,"5min":0.80400000000000005,"15min":0.88100000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.26800000000000002},"max":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":1.4870000000000001},"last":0.48499999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.45800000000000002,"5min":0.435,"15min":0.34300000000000003},"max":{"1min":0.78200000000000003,"5min":0.79900000000000004,"15min":2.6139999999999999},"last":0.62},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.56499999999999995},"min":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.78700000000000003,"15min":2.6019999999999999},"last":0.64600000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.318},"max":{"1min":0.67100000000000004,"5min":0.78600000000000003,"15min":7.4729999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":7.8390000000000004},"last":0.57799999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.23799999999999999},"max":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.872},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.307,"15min":0.25600000000000001},"max":{"1min":0.70999999999999996,"5min":0.76900000000000002,"15min":0.86099999999999999},"last":0.41299999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.255},"max":{"1min":0.69499999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.75600000000000001,"15min":0.98699999999999999},"last":0.55400000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.35499999999999998},"max":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.93999999999999995},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29199999999999998},"max":{"1min":0.755,"5min":0.79900000000000004,"15min":0.91400000000000003},"last":0.45100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19475,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175836,"statfs":{"total":200000000,"available":180056868,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55900000000000005,"15min":0.64500000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.26900000000000002},"max":{"1min":0.76200000000000001,"5min":0.76700000000000002,"15min":7.0960000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.371,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.79800000000000004,"15min":1.133},"last":0.29699999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.83299999999999996,"5min":0.84399999999999997,"15min":1.155},"last":0.434},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.317},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":1.1459999999999999},"last":0.42299999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":0.63700000000000001,"5min":0.746,"15min":1.2290000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.66500000000000004},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.308},"max":{"1min":0.81699999999999995,"5min":0.86599999999999999,"15min":7.1299999999999999},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.34499999999999997},"max":{"1min":0.68400000000000005,"5min":0.83499999999999996,"15min":1.337},"last":0.371},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.80100000000000005,"15min":1.206},"last":0.48199999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.46500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28000000000000003},"max":{"1min":0.67400000000000004,"5min":0.749,"15min":0.75900000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68100000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46899999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":0.54600000000000004,"5min":0.71999999999999997,"15min":0.80000000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68600000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48999999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.72899999999999998,"5min":0.81100000000000005,"15min":0.81299999999999994},"last":0.502},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.77900000000000003,"15min":0.82399999999999995},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.219},"max":{"1min":0.441,"5min":0.58999999999999997,"15min":0.64000000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.38100000000000001,"15min":0.35899999999999999},"min":{"1min":0.27600000000000002,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.55900000000000005,"5min":0.61499999999999999,"15min":0.93300000000000005},"last":0.23000000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36299999999999999,"15min":0.35299999999999998},"min":{"1min":0.247,"5min":0.218,"15min":0.218},"max":{"1min":0.50600000000000001,"5min":0.71399999999999997,"15min":0.82299999999999995},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42699999999999999,"15min":0.40400000000000003},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.247},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.70899999999999996},"last":0.34999999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47699999999999998,"15min":0.443},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.29199999999999998},"max":{"1min":0.64300000000000002,"5min":0.751,"15min":0.751},"last":0.432},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.437},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.90500000000000003},"last":0.32200000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.315},"max":{"1min":0.90000000000000002,"5min":0.95699999999999996,"15min":1.097},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.70499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81699999999999995,"5min":0.97699999999999998,"15min":5.5270000000000001},"last":0.46300000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65700000000000003,"15min":0.64000000000000001},"min":{"1min":0.53800000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.0069999999999999,"5min":1.0669999999999999,"15min":1.125},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.65600000000000003},"min":{"1min":0.51900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":1,"15min":1.4219999999999999},"last":0.42099999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66100000000000003,"15min":0.64000000000000001},"min":{"1min":0.55600000000000005,"5min":0.45500000000000002,"15min":0.39300000000000002},"max":{"1min":0.96399999999999997,"5min":1.0029999999999999,"15min":1.0629999999999999},"last":0.498},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":0.94799999999999995,"15min":1.49},"last":0.45500000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65300000000000002},"min":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":1.016,"15min":1.016},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.51200000000000001,"5min":0.44700000000000001,"15min":0.41599999999999998},"max":{"1min":0.91600000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.442}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185500,"statfs":{"total":200000000,"available":189952260,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.20599999999999999},"max":{"1min":0.56499999999999995,"5min":0.71599999999999997,"15min":1.226},"last":0.439},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.20599999999999999},"max":{"1min":0.68300000000000005,"5min":0.82999999999999996,"15min":1.131},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.67300000000000004},"min":{"1min":0.32500000000000001,"5min":0.28299999999999997,"15min":0.25800000000000001},"max":{"1min":0.629,"5min":0.63600000000000001,"15min":12.929},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.441},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.59399999999999997,"5min":0.751,"15min":1.1599999999999999},"last":0.48799999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.35299999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71699999999999997,"5min":0.78100000000000003,"15min":1.1859999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.36099999999999999,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":1.3089999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.44400000000000001,"5min":0.40799999999999997,"15min":0.36599999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.748},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.335},"last":0.72699999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65100000000000002,"15min":0.626},"min":{"1min":0.437,"5min":0.40100000000000002,"15min":0.35499999999999998},"max":{"1min":0.95399999999999996,"5min":1.016,"15min":1.0580000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64300000000000002,"15min":0.61799999999999999},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.317},"max":{"1min":0.877,"5min":0.98599999999999999,"15min":0.999},"last":0.80400000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63300000000000001,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.92200000000000004,"5min":1.05,"15min":1.05},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.67200000000000004},"min":{"1min":0.50800000000000001,"5min":0.41499999999999998,"15min":0.374},"max":{"1min":1.0209999999999999,"5min":1.032,"15min":1.2849999999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70299999999999996,"15min":0.67800000000000005},"min":{"1min":0.497,"5min":0.43099999999999999,"15min":0.40400000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.262},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.66900000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":1.0660000000000001,"15min":1.103},"last":0.72299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173783,"statfs":{"total":200000000,"available":177954163,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35499999999999998,"15min":0.59499999999999997},"min":{"1min":0.22900000000000001,"5min":0.20699999999999999,"15min":0.19800000000000001},"max":{"1min":0.55200000000000005,"5min":0.65000000000000002,"15min":14.981999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38400000000000001,"15min":0.51400000000000001},"min":{"1min":0.26300000000000001,"5min":0.252,"15min":0.22},"max":{"1min":0.58699999999999997,"5min":0.63900000000000001,"15min":9.1600000000000001},"last":0.33400000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.372,"15min":0.48799999999999999},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.222},"max":{"1min":0.53000000000000003,"5min":0.59199999999999997,"15min":8.4930000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41699999999999998,"15min":0.55400000000000005},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.254},"max":{"1min":0.63800000000000001,"5min":0.67800000000000005,"15min":9.0239999999999991},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45500000000000002,"15min":0.56499999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":8.5190000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.67300000000000004},"min":{"1min":0.35499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.622,"5min":0.748,"15min":15.007999999999999},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.64000000000000001,"15min":0.86599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":14.917999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.65000000000000002,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.40899999999999997},"max":{"1min":0.89800000000000002,"5min":0.90400000000000003,"15min":8.9930000000000003},"last":0.55800000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.76000000000000001},"min":{"1min":0.41199999999999998,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.84699999999999998,"5min":0.94599999999999995,"15min":8.9610000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66500000000000004,"15min":0.77300000000000002},"min":{"1min":0.48499999999999999,"5min":0.45100000000000001,"15min":0.35099999999999998},"max":{"1min":0.85999999999999999,"5min":1.03,"15min":8.3919999999999995},"last":0.58999999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.75900000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.39900000000000002},"max":{"1min":0.82699999999999996,"5min":0.97299999999999998,"15min":8.4339999999999993},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67300000000000004,"15min":0.88100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.374},"max":{"1min":0.88200000000000001,"5min":0.99099999999999999,"15min":14.954000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.751},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36199999999999999},"max":{"1min":0.80100000000000005,"5min":0.90600000000000003,"15min":8.9160000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.76600000000000001},"min":{"1min":0.435,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":0.91400000000000003,"5min":0.91700000000000004,"15min":8.4640000000000004},"last":0.64500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38200000000000001,"15min":0.35399999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":0.48099999999999998,"5min":0.56100000000000005,"15min":0.66800000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.45400000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.38400000000000001,"15min":0.35099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.215},"max":{"1min":0.497,"5min":0.60699999999999998,"15min":0.623},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.43099999999999999,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23699999999999999},"max":{"1min":0.49299999999999999,"5min":0.66600000000000004,"15min":0.68899999999999995},"last":0.32100000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42199999999999999,"15min":0.38800000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.252},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.497,"15min":0.45700000000000002},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.28399999999999997},"max":{"1min":0.63700000000000001,"5min":0.71799999999999997,"15min":0.75700000000000001},"last":0.502}]},{"osd":4,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89100000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65500000000000003,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.33400000000000002},"max":{"1min":0.877,"5min":1.073,"15min":1.073},"last":0.57799999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67900000000000005,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.33600000000000002},"max":{"1min":0.81499999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69199999999999995,"15min":0.64600000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":1.097,"15min":1.097},"last":0.76000000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.66900000000000004,"15min":0.61699999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.69099999999999995,"15min":0.64000000000000001},"min":{"1min":0.441,"5min":0.434,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67500000000000004,"15min":0.628},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.83599999999999997,"5min":1.139,"15min":1.139},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.69699999999999995,"15min":0.64400000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":1.026,"15min":1.026},"last":0.77600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.318},"max":{"1min":0.66100000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.254},"max":{"1min":0.73899999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55100000000000005,"15min":0.625},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.752,"5min":0.754,"15min":4.3250000000000002},"last":0.443}]},{"osd":2,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.622},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.73799999999999999,"5min":0.77900000000000003,"15min":4.7320000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55800000000000005,"15min":0.79500000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.32600000000000001},"max":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":11.715},"last":0.37}]},{"osd":3,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57399999999999995,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76300000000000001,"5min":0.77700000000000002,"15min":0.79100000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.39000000000000001},"max":{"1min":0.77300000000000002,"5min":0.81499999999999995,"15min":0.85599999999999998},"last":0.64900000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.503},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47099999999999997,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.82799999999999996},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48199999999999998,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.63200000000000001,"5min":0.80400000000000005,"15min":0.86699999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52300000000000002,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.64400000000000002,"5min":0.74299999999999999,"15min":0.84999999999999998},"last":0.56200000000000006}]},{"osd":7,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.39100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72399999999999998,"5min":0.81599999999999995,"15min":0.879},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.376,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.81299999999999994,"15min":0.88600000000000001},"last":0.61299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.82899999999999996,"15min":1.0289999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73099999999999998,"5min":0.77200000000000002,"15min":0.81899999999999995},"last":0.55700000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.82299999999999995,"15min":1.093},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57099999999999995,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.85499999999999998},"last":0.51000000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70499999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.433},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.36699999999999999,"15min":0.36299999999999999},"max":{"1min":0.75700000000000001,"5min":0.79800000000000004,"15min":0.89300000000000002},"last":0.52700000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59999999999999998,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98699999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.071},"last":0.54200000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45600000000000002,"15min":0.48299999999999998},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.84399999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46500000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.51200000000000001},"min":{"1min":0.34499999999999997,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.0680000000000001},"last":0.498},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.42499999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.88,"5min":0.88,"15min":1.0920000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.317,"15min":0.30399999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.91900000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.0269999999999999},"last":0.58299999999999996}]}]}],"pool_statfs":[]}} 2023-10-09T06:32:40.808 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-09T06:32:40.808 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:32:40.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.926+0000 7f4adc5b1700 1 Processor -- start 2023-10-09T06:32:40.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.926+0000 7f4adc5b1700 1 -- start start 2023-10-09T06:32:40.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.926+0000 7f4adc5b1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ad40abae0 0x7f4ad40c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.926+0000 7f4adc5b1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ad40abeb0 0x7f4ad40c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.926+0000 7f4adc5b1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ad40c8400 0x7f4ad40c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.926+0000 7f4adc5b1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad40c9cb0 con 0x7f4ad40abae0 2023-10-09T06:32:40.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.926+0000 7f4adc5b1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad40c90a0 con 0x7f4ad40abeb0 2023-10-09T06:32:40.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.926+0000 7f4adc5b1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40c9380 con 0x7f4ad40c8400 2023-10-09T06:32:40.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ada34d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ad40abae0 0x7f4ad40c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ada34d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ad40abae0 0x7f4ad40c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58324/0 (socket says 172.21.15.31:58324) 2023-10-09T06:32:40.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ada34d700 1 -- 172.21.15.31:0/1341822080 learned_addr learned my addr 172.21.15.31:0/1341822080 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:40.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4adab4e700 1 --2- 172.21.15.31:0/1341822080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ad40c8400 0x7f4ad40c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ad9b4c700 1 --2- 172.21.15.31:0/1341822080 >> v2:172.21.15.158:3300/0 conn(0x7f4ad40abeb0 0x7f4ad40c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ada34d700 1 -- 172.21.15.31:0/1341822080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ad40c8400 msgr2=0x7f4ad40c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ada34d700 1 --2- 172.21.15.31:0/1341822080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ad40c8400 0x7f4ad40c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ada34d700 1 -- 172.21.15.31:0/1341822080 >> v2:172.21.15.158:3300/0 conn(0x7f4ad40abeb0 msgr2=0x7f4ad40c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ada34d700 1 --2- 172.21.15.31:0/1341822080 >> v2:172.21.15.158:3300/0 conn(0x7f4ad40abeb0 0x7f4ad40c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ada34d700 1 -- 172.21.15.31:0/1341822080 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad40c9660 con 0x7f4ad40abae0 2023-10-09T06:32:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ad9b4c700 1 --2- 172.21.15.31:0/1341822080 >> v2:172.21.15.158:3300/0 conn(0x7f4ad40abeb0 0x7f4ad40c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ada34d700 1 --2- 172.21.15.31:0/1341822080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ad40abae0 0x7f4ad40c6eb0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40ca160 tx=0x7f4acc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83794c0412f8578f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ad934b700 1 -- 172.21.15.31:0/1341822080 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc00b860 con 0x7f4ad40abae0 2023-10-09T06:32:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ad934b700 1 -- 172.21.15.31:0/1341822080 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc00b9c0 con 0x7f4ad40abae0 2023-10-09T06:32:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.927+0000 7f4ad934b700 1 -- 172.21.15.31:0/1341822080 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc00bd60 con 0x7f4ad40abae0 2023-10-09T06:32:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.928+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1341822080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ad40abae0 msgr2=0x7f4ad40c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.928+0000 7f4adc5b1700 1 --2- 172.21.15.31:0/1341822080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ad40abae0 0x7f4ad40c6eb0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40ca160 tx=0x7f4acc009250 comp rx=0 tx=0).stop 2023-10-09T06:32:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.928+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1341822080 shutdown_connections 2023-10-09T06:32:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.928+0000 7f4adc5b1700 1 --2- 172.21.15.31:0/1341822080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ad40c8400 0x7f4ad40c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.928+0000 7f4adc5b1700 1 --2- 172.21.15.31:0/1341822080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ad40abae0 0x7f4ad40c6eb0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.928+0000 7f4adc5b1700 1 --2- 172.21.15.31:0/1341822080 >> v2:172.21.15.158:3300/0 conn(0x7f4ad40abeb0 0x7f4ad40c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.928+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1341822080 >> 172.21.15.31:0/1341822080 conn(0x7f4ad4067660 msgr2=0x7f4ad4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.928+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1341822080 shutdown_connections 2023-10-09T06:32:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.928+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1341822080 wait complete. 2023-10-09T06:32:40.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.929+0000 7f4adc5b1700 1 Processor -- start 2023-10-09T06:32:40.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.929+0000 7f4adc5b1700 1 -- start start 2023-10-09T06:32:40.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4adc5b1700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ad40abae0 0x7f4ad4145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4adc5b1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ad40abeb0 0x7f4ad4168cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4adc5b1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ad40c8400 0x7f4ad40c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4adc5b1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4145760 con 0x7f4ad40abeb0 2023-10-09T06:32:40.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4adc5b1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad416bf10 con 0x7f4ad40c8400 2023-10-09T06:32:40.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4adc5b1700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40c1e10 con 0x7f4ad40abae0 2023-10-09T06:32:40.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4ad9b4c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ad40abeb0 0x7f4ad4168cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4ad9b4c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ad40abeb0 0x7f4ad4168cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58330/0 (socket says 172.21.15.31:58330) 2023-10-09T06:32:40.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4ad9b4c700 1 -- 172.21.15.31:0/1999049715 learned_addr learned my addr 172.21.15.31:0/1999049715 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:40.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4ada34d700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ad40abae0 0x7f4ad4145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4ad9b4c700 1 -- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ad40abae0 msgr2=0x7f4ad4145220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4ad9b4c700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ad40abae0 0x7f4ad4145220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4ad9b4c700 1 -- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ad40c8400 msgr2=0x7f4ad40c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:40.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4adab4e700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ad40c8400 0x7f4ad40c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4ad9b4c700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ad40c8400 0x7f4ad40c28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:40.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4ad9b4c700 1 -- 172.21.15.31:0/1999049715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc0094f0 con 0x7f4ad40abeb0 2023-10-09T06:32:40.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4ada34d700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ad40abae0 0x7f4ad4145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:40.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4adab4e700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ad40c8400 0x7f4ad40c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:40.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4ad9b4c700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ad40abeb0 0x7f4ad4168cf0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c880 tx=0x7f4ac8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:40.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4ad27fc700 1 -- 172.21.15.31:0/1999049715 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8011600 con 0x7f4ad40abeb0 2023-10-09T06:32:40.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.930+0000 7f4ad27fc700 1 -- 172.21.15.31:0/1999049715 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac8011760 con 0x7f4ad40abeb0 2023-10-09T06:32:40.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.931+0000 7f4ad27fc700 1 -- 172.21.15.31:0/1999049715 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8011b00 con 0x7f4ad40abeb0 2023-10-09T06:32:40.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.931+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1999049715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad40c20f0 con 0x7f4ad40abeb0 2023-10-09T06:32:40.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.931+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1999049715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad40c1b20 con 0x7f4ad40abeb0 2023-10-09T06:32:40.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.931+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1999049715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad40c2740 con 0x7f4ad40abeb0 2023-10-09T06:32:40.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.932+0000 7f4ad27fc700 1 -- 172.21.15.31:0/1999049715 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ac800a3e0 con 0x7f4ad40abeb0 2023-10-09T06:32:40.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.932+0000 7f4ad27fc700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ac0066f30 0x7f4ac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:40.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.932+0000 7f4ad27fc700 1 -- 172.21.15.31:0/1999049715 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4ac8083fe0 con 0x7f4ad40abeb0 2023-10-09T06:32:40.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.932+0000 7f4ada34d700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ac0066f30 0x7f4ac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:40.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.933+0000 7f4ada34d700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ac0066f30 0x7f4ac00693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40ca160 tx=0x7f4acc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:40.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:40.936+0000 7f4ad27fc700 1 -- 172.21.15.31:0/1999049715 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ac8051550 con 0x7f4ad40abeb0 2023-10-09T06:32:41.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.128+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1999049715 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ad404c3c0 con 0x7f4ac0066f30 2023-10-09T06:32:41.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.131+0000 7f4ad27fc700 1 -- 172.21.15.31:0/1999049715 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49946 (secure 0 0 0) 0x7f4ad404c3c0 con 0x7f4ac0066f30 2023-10-09T06:32:41.132 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:41.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.133+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ac0066f30 msgr2=0x7f4ac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.133+0000 7f4adc5b1700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ac0066f30 0x7f4ac00693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40ca160 tx=0x7f4acc017000 comp rx=0 tx=0).stop 2023-10-09T06:32:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.133+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1999049715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ad40abeb0 msgr2=0x7f4ad4168cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.133+0000 7f4adc5b1700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ad40abeb0 0x7f4ad4168cf0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c880 tx=0x7f4ac8008040 comp rx=0 tx=0).stop 2023-10-09T06:32:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.133+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1999049715 shutdown_connections 2023-10-09T06:32:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.133+0000 7f4adc5b1700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f4ac0066f30 0x7f4ac00693e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.133+0000 7f4adc5b1700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f4ad40abae0 0x7f4ad4145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.133+0000 7f4adc5b1700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ad40c8400 0x7f4ad40c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.133+0000 7f4adc5b1700 1 --2- 172.21.15.31:0/1999049715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ad40abeb0 0x7f4ad4168cf0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.133+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1999049715 >> 172.21.15.31:0/1999049715 conn(0x7f4ad4067660 msgr2=0x7f4ad406d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:41.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.133+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1999049715 shutdown_connections 2023-10-09T06:32:41.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.133+0000 7f4adc5b1700 1 -- 172.21.15.31:0/1999049715 wait complete. 2023-10-09T06:32:41.136 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:32:41.146 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2023-10-09T06:32:40.688562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":64825,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1497674,"statfs":{"total":1600000000,"available":1533618283,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489239,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001457"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":312,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-09T06:32:36.937686+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:32:36.937686+0000","last_peered":"2023-10-09T06:32:36.937686+0000","last_clean":"2023-10-09T06:32:36.937686+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:32:36.937686+0000","last_undegraded":"2023-10-09T06:32:36.937686+0000","last_fullsized":"2023-10-09T06:32:36.937686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185500,"statfs":{"total":200000000,"available":189952260,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.52700000000000002},"min":{"1min":0.36399999999999999,"5min":0.34200000000000003,"15min":0.28999999999999998},"max":{"1min":0.71399999999999997,"5min":0.81299999999999994,"15min":1.5469999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.35199999999999998,"5min":0.29299999999999998,"15min":0.28100000000000003},"max":{"1min":0.73299999999999998,"5min":0.78700000000000003,"15min":3.6970000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55800000000000005,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.311,"15min":0.29899999999999999},"max":{"1min":0.69199999999999995,"5min":0.80400000000000005,"15min":0.88100000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.26800000000000002},"max":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":1.4870000000000001},"last":0.48499999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.45800000000000002,"5min":0.435,"15min":0.34300000000000003},"max":{"1min":0.78200000000000003,"5min":0.79900000000000004,"15min":2.6139999999999999},"last":0.62},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.56499999999999995},"min":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.78700000000000003,"15min":2.6019999999999999},"last":0.64600000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.318},"max":{"1min":0.67100000000000004,"5min":0.78600000000000003,"15min":7.4729999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":7.8390000000000004},"last":0.57799999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.23799999999999999},"max":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.872},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.307,"15min":0.25600000000000001},"max":{"1min":0.70999999999999996,"5min":0.76900000000000002,"15min":0.86099999999999999},"last":0.41299999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.255},"max":{"1min":0.69499999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.75600000000000001,"15min":0.98699999999999999},"last":0.55400000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.35499999999999998},"max":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.93999999999999995},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29199999999999998},"max":{"1min":0.755,"5min":0.79900000000000004,"15min":0.91400000000000003},"last":0.45100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19475,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175836,"statfs":{"total":200000000,"available":180056868,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55900000000000005,"15min":0.64500000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.26900000000000002},"max":{"1min":0.76200000000000001,"5min":0.76700000000000002,"15min":7.0960000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.371,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.79800000000000004,"15min":1.133},"last":0.29699999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.83299999999999996,"5min":0.84399999999999997,"15min":1.155},"last":0.434},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.317},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":1.1459999999999999},"last":0.42299999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":0.63700000000000001,"5min":0.746,"15min":1.2290000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.66500000000000004},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.308},"max":{"1min":0.81699999999999995,"5min":0.86599999999999999,"15min":7.1299999999999999},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.34499999999999997},"max":{"1min":0.68400000000000005,"5min":0.83499999999999996,"15min":1.337},"last":0.371},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.80100000000000005,"15min":1.206},"last":0.48199999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.46500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28000000000000003},"max":{"1min":0.67400000000000004,"5min":0.749,"15min":0.75900000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68100000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46899999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":0.54600000000000004,"5min":0.71999999999999997,"15min":0.80000000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68600000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48999999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.72899999999999998,"5min":0.81100000000000005,"15min":0.81299999999999994},"last":0.502},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.77900000000000003,"15min":0.82399999999999995},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.219},"max":{"1min":0.441,"5min":0.58999999999999997,"15min":0.64000000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.38100000000000001,"15min":0.35899999999999999},"min":{"1min":0.27600000000000002,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.55900000000000005,"5min":0.61499999999999999,"15min":0.93300000000000005},"last":0.23000000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36299999999999999,"15min":0.35299999999999998},"min":{"1min":0.247,"5min":0.218,"15min":0.218},"max":{"1min":0.50600000000000001,"5min":0.71399999999999997,"15min":0.82299999999999995},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42699999999999999,"15min":0.40400000000000003},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.247},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.70899999999999996},"last":0.34999999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47699999999999998,"15min":0.443},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.29199999999999998},"max":{"1min":0.64300000000000002,"5min":0.751,"15min":0.751},"last":0.432},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.437},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.90500000000000003},"last":0.32200000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.315},"max":{"1min":0.90000000000000002,"5min":0.95699999999999996,"15min":1.097},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.70499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81699999999999995,"5min":0.97699999999999998,"15min":5.5270000000000001},"last":0.46300000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65700000000000003,"15min":0.64000000000000001},"min":{"1min":0.53800000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.0069999999999999,"5min":1.0669999999999999,"15min":1.125},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.65600000000000003},"min":{"1min":0.51900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":1,"15min":1.4219999999999999},"last":0.42099999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66100000000000003,"15min":0.64000000000000001},"min":{"1min":0.55600000000000005,"5min":0.45500000000000002,"15min":0.39300000000000002},"max":{"1min":0.96399999999999997,"5min":1.0029999999999999,"15min":1.0629999999999999},"last":0.498},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":0.94799999999999995,"15min":1.49},"last":0.45500000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65300000000000002},"min":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":1.016,"15min":1.016},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.51200000000000001,"5min":0.44700000000000001,"15min":0.41599999999999998},"max":{"1min":0.91600000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.442}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185500,"statfs":{"total":200000000,"available":189952260,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.20599999999999999},"max":{"1min":0.56499999999999995,"5min":0.71599999999999997,"15min":1.226},"last":0.439},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.20599999999999999},"max":{"1min":0.68300000000000005,"5min":0.82999999999999996,"15min":1.131},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.67300000000000004},"min":{"1min":0.32500000000000001,"5min":0.28299999999999997,"15min":0.25800000000000001},"max":{"1min":0.629,"5min":0.63600000000000001,"15min":12.929},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.441},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.59399999999999997,"5min":0.751,"15min":1.1599999999999999},"last":0.48799999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.35299999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71699999999999997,"5min":0.78100000000000003,"15min":1.1859999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.36099999999999999,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":1.3089999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.44400000000000001,"5min":0.40799999999999997,"15min":0.36599999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.748},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.335},"last":0.72699999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65100000000000002,"15min":0.626},"min":{"1min":0.437,"5min":0.40100000000000002,"15min":0.35499999999999998},"max":{"1min":0.95399999999999996,"5min":1.016,"15min":1.0580000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64300000000000002,"15min":0.61799999999999999},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.317},"max":{"1min":0.877,"5min":0.98599999999999999,"15min":0.999},"last":0.80400000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63300000000000001,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.92200000000000004,"5min":1.05,"15min":1.05},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.67200000000000004},"min":{"1min":0.50800000000000001,"5min":0.41499999999999998,"15min":0.374},"max":{"1min":1.0209999999999999,"5min":1.032,"15min":1.2849999999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70299999999999996,"15min":0.67800000000000005},"min":{"1min":0.497,"5min":0.43099999999999999,"15min":0.40400000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.262},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.66900000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":1.0660000000000001,"15min":1.103},"last":0.72299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173783,"statfs":{"total":200000000,"available":177954163,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35499999999999998,"15min":0.59499999999999997},"min":{"1min":0.22900000000000001,"5min":0.20699999999999999,"15min":0.19800000000000001},"max":{"1min":0.55200000000000005,"5min":0.65000000000000002,"15min":14.981999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38400000000000001,"15min":0.51400000000000001},"min":{"1min":0.26300000000000001,"5min":0.252,"15min":0.22},"max":{"1min":0.58699999999999997,"5min":0.63900000000000001,"15min":9.1600000000000001},"last":0.33400000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.372,"15min":0.48799999999999999},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.222},"max":{"1min":0.53000000000000003,"5min":0.59199999999999997,"15min":8.4930000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41699999999999998,"15min":0.55400000000000005},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.254},"max":{"1min":0.63800000000000001,"5min":0.67800000000000005,"15min":9.0239999999999991},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45500000000000002,"15min":0.56499999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":8.5190000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.67300000000000004},"min":{"1min":0.35499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.622,"5min":0.748,"15min":15.007999999999999},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.64000000000000001,"15min":0.86599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":14.917999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.65000000000000002,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.40899999999999997},"max":{"1min":0.89800000000000002,"5min":0.90400000000000003,"15min":8.9930000000000003},"last":0.55800000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.76000000000000001},"min":{"1min":0.41199999999999998,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.84699999999999998,"5min":0.94599999999999995,"15min":8.9610000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66500000000000004,"15min":0.77300000000000002},"min":{"1min":0.48499999999999999,"5min":0.45100000000000001,"15min":0.35099999999999998},"max":{"1min":0.85999999999999999,"5min":1.03,"15min":8.3919999999999995},"last":0.58999999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.75900000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.39900000000000002},"max":{"1min":0.82699999999999996,"5min":0.97299999999999998,"15min":8.4339999999999993},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67300000000000004,"15min":0.88100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.374},"max":{"1min":0.88200000000000001,"5min":0.99099999999999999,"15min":14.954000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.751},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36199999999999999},"max":{"1min":0.80100000000000005,"5min":0.90600000000000003,"15min":8.9160000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.76600000000000001},"min":{"1min":0.435,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":0.91400000000000003,"5min":0.91700000000000004,"15min":8.4640000000000004},"last":0.64500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38200000000000001,"15min":0.35399999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":0.48099999999999998,"5min":0.56100000000000005,"15min":0.66800000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.45400000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.38400000000000001,"15min":0.35099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.215},"max":{"1min":0.497,"5min":0.60699999999999998,"15min":0.623},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.43099999999999999,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23699999999999999},"max":{"1min":0.49299999999999999,"5min":0.66600000000000004,"15min":0.68899999999999995},"last":0.32100000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42199999999999999,"15min":0.38800000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.252},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.497,"15min":0.45700000000000002},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.28399999999999997},"max":{"1min":0.63700000000000001,"5min":0.71799999999999997,"15min":0.75700000000000001},"last":0.502}]},{"osd":4,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89100000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65500000000000003,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.33400000000000002},"max":{"1min":0.877,"5min":1.073,"15min":1.073},"last":0.57799999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67900000000000005,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.33600000000000002},"max":{"1min":0.81499999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69199999999999995,"15min":0.64600000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":1.097,"15min":1.097},"last":0.76000000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.66900000000000004,"15min":0.61699999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.69099999999999995,"15min":0.64000000000000001},"min":{"1min":0.441,"5min":0.434,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67500000000000004,"15min":0.628},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.83599999999999997,"5min":1.139,"15min":1.139},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.69699999999999995,"15min":0.64400000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":1.026,"15min":1.026},"last":0.77600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.318},"max":{"1min":0.66100000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.254},"max":{"1min":0.73899999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55100000000000005,"15min":0.625},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.752,"5min":0.754,"15min":4.3250000000000002},"last":0.443}]},{"osd":2,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.622},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.73799999999999999,"5min":0.77900000000000003,"15min":4.7320000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55800000000000005,"15min":0.79500000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.32600000000000001},"max":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":11.715},"last":0.37}]},{"osd":3,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57399999999999995,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76300000000000001,"5min":0.77700000000000002,"15min":0.79100000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.39000000000000001},"max":{"1min":0.77300000000000002,"5min":0.81499999999999995,"15min":0.85599999999999998},"last":0.64900000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.503},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47099999999999997,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.82799999999999996},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48199999999999998,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.63200000000000001,"5min":0.80400000000000005,"15min":0.86699999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52300000000000002,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.64400000000000002,"5min":0.74299999999999999,"15min":0.84999999999999998},"last":0.56200000000000006}]},{"osd":7,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.39100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72399999999999998,"5min":0.81599999999999995,"15min":0.879},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.376,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.81299999999999994,"15min":0.88600000000000001},"last":0.61299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.82899999999999996,"15min":1.0289999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73099999999999998,"5min":0.77200000000000002,"15min":0.81899999999999995},"last":0.55700000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.82299999999999995,"15min":1.093},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57099999999999995,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.85499999999999998},"last":0.51000000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70499999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.433},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.36699999999999999,"15min":0.36299999999999999},"max":{"1min":0.75700000000000001,"5min":0.79800000000000004,"15min":0.89300000000000002},"last":0.52700000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59999999999999998,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98699999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.071},"last":0.54200000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45600000000000002,"15min":0.48299999999999998},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.84399999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46500000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.51200000000000001},"min":{"1min":0.34499999999999997,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.0680000000000001},"last":0.498},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.42499999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.88,"5min":0.88,"15min":1.0920000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.317,"15min":0.30399999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.91900000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.0269999999999999},"last":0.58299999999999996}]}]}],"pool_statfs":[]}} 2023-10-09T06:32:41.148 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:32:41.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.266+0000 7f0c7dd32700 1 Processor -- start 2023-10-09T06:32:41.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.266+0000 7f0c7dd32700 1 -- start start 2023-10-09T06:32:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.267+0000 7f0c7dd32700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0c7815a1e0 0x7f0c780cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.267+0000 7f0c7dd32700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c780b3430 0x7f0c780cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.267+0000 7f0c7dd32700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7815db80 con 0x7f0c78159e10 2023-10-09T06:32:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.267+0000 7f0c7dd32700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7815e800 con 0x7f0c7815a1e0 2023-10-09T06:32:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.267+0000 7f0c7dd32700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7815de60 con 0x7f0c780b3430 2023-10-09T06:32:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.267+0000 7f0c77fff700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c780b3430 0x7f0c780cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.267+0000 7f0c76ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0c7815a1e0 0x7f0c780cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.267+0000 7f0c777fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f0c78159e10 0x7f0c780b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:38246/0 (socket says 172.21.15.31:38246) 2023-10-09T06:32:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.267+0000 7f0c777fe700 1 -- 172.21.15.31:0/4203581882 learned_addr learned my addr 172.21.15.31:0/4203581882 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.268+0000 7f0c767fc700 1 -- 172.21.15.31:0/4203581882 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745708179 0 0) 0x7f0c7815db80 con 0x7f0c78159e10 2023-10-09T06:32:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.268+0000 7f0c767fc700 1 -- 172.21.15.31:0/4203581882 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c60003570 con 0x7f0c78159e10 2023-10-09T06:32:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.268+0000 7f0c77fff700 1 -- 172.21.15.31:0/4203581882 >> v2:172.21.15.158:3300/0 conn(0x7f0c7815a1e0 msgr2=0x7f0c780cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.268+0000 7f0c77fff700 1 --2- 172.21.15.31:0/4203581882 >> v2:172.21.15.158:3300/0 conn(0x7f0c7815a1e0 0x7f0c780cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.268+0000 7f0c77fff700 1 -- 172.21.15.31:0/4203581882 >> v1:172.21.15.158:6789/0 conn(0x7f0c78159e10 legacy=0x7f0c780b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.268+0000 7f0c77fff700 1 -- 172.21.15.31:0/4203581882 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7815e140 con 0x7f0c780b3430 2023-10-09T06:32:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.268+0000 7f0c76ffd700 1 --2- 172.21.15.31:0/4203581882 >> v2:172.21.15.158:3300/0 conn(0x7f0c7815a1e0 0x7f0c780cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:32:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.268+0000 7f0c77fff700 1 --2- 172.21.15.31:0/4203581882 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c780b3430 0x7f0c780cdc80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009e60 tx=0x7f0c70009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbe40c46823981a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.268+0000 7f0c767fc700 1 -- 172.21.15.31:0/4203581882 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7000e070 con 0x7f0c780b3430 2023-10-09T06:32:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.268+0000 7f0c767fc700 1 -- 172.21.15.31:0/4203581882 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7000bab0 con 0x7f0c780b3430 2023-10-09T06:32:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.268+0000 7f0c767fc700 1 -- 172.21.15.31:0/4203581882 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7000be30 con 0x7f0c780b3430 2023-10-09T06:32:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.269+0000 7f0c7dd32700 1 -- 172.21.15.31:0/4203581882 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c780b3430 msgr2=0x7f0c780cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.269+0000 7f0c7dd32700 1 --2- 172.21.15.31:0/4203581882 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c780b3430 0x7f0c780cdc80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009e60 tx=0x7f0c70009780 comp rx=0 tx=0).stop 2023-10-09T06:32:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.269+0000 7f0c7dd32700 1 -- 172.21.15.31:0/4203581882 shutdown_connections 2023-10-09T06:32:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.269+0000 7f0c7dd32700 1 --2- 172.21.15.31:0/4203581882 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c780b3430 0x7f0c780cdc80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.269+0000 7f0c7dd32700 1 --2- 172.21.15.31:0/4203581882 >> v2:172.21.15.158:3300/0 conn(0x7f0c7815a1e0 0x7f0c780cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.269+0000 7f0c7dd32700 1 -- 172.21.15.31:0/4203581882 >> 172.21.15.31:0/4203581882 conn(0x7f0c78067660 msgr2=0x7f0c78067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.269+0000 7f0c7dd32700 1 -- 172.21.15.31:0/4203581882 shutdown_connections 2023-10-09T06:32:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.269+0000 7f0c7dd32700 1 -- 172.21.15.31:0/4203581882 wait complete. 2023-10-09T06:32:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.270+0000 7f0c7dd32700 1 Processor -- start 2023-10-09T06:32:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.270+0000 7f0c7dd32700 1 -- start start 2023-10-09T06:32:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c7dd32700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c780b3430 0x7f0c78157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c7dd32700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c78159e10 0x7f0c780c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c7dd32700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c7815a1e0 0x7f0c780c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c7dd32700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780c6180 con 0x7f0c78159e10 2023-10-09T06:32:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c7dd32700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780c5570 con 0x7f0c7815a1e0 2023-10-09T06:32:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c7dd32700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780c5850 con 0x7f0c780b3430 2023-10-09T06:32:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c76ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c78159e10 0x7f0c780c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c76ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c78159e10 0x7f0c780c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58338/0 (socket says 172.21.15.31:58338) 2023-10-09T06:32:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c76ffd700 1 -- 172.21.15.31:0/498493213 learned_addr learned my addr 172.21.15.31:0/498493213 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c777fe700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c780b3430 0x7f0c78157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c77fff700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c7815a1e0 0x7f0c780c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c76ffd700 1 -- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c780b3430 msgr2=0x7f0c78157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c76ffd700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c780b3430 0x7f0c78157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c76ffd700 1 -- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c7815a1e0 msgr2=0x7f0c780c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c76ffd700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c7815a1e0 0x7f0c780c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c76ffd700 1 -- 172.21.15.31:0/498493213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c009420 con 0x7f0c78159e10 2023-10-09T06:32:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c77fff700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c7815a1e0 0x7f0c780c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.271+0000 7f0c777fe700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c780b3430 0x7f0c78157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.272+0000 7f0c76ffd700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c78159e10 0x7f0c780c9840 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00ec50 tx=0x7f0c6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.272+0000 7f0c5f7fe700 1 -- 172.21.15.31:0/498493213 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00c9d0 con 0x7f0c78159e10 2023-10-09T06:32:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.272+0000 7f0c7dd32700 1 -- 172.21.15.31:0/498493213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c70009a20 con 0x7f0c78159e10 2023-10-09T06:32:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.272+0000 7f0c5f7fe700 1 -- 172.21.15.31:0/498493213 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c00cb30 con 0x7f0c78159e10 2023-10-09T06:32:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.272+0000 7f0c5f7fe700 1 -- 172.21.15.31:0/498493213 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c013470 con 0x7f0c78159e10 2023-10-09T06:32:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.272+0000 7f0c7dd32700 1 -- 172.21.15.31:0/498493213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c780c5e10 con 0x7f0c78159e10 2023-10-09T06:32:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.273+0000 7f0c7dd32700 1 -- 172.21.15.31:0/498493213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c780cee30 con 0x7f0c78159e10 2023-10-09T06:32:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.273+0000 7f0c5f7fe700 1 -- 172.21.15.31:0/498493213 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c6c013820 con 0x7f0c78159e10 2023-10-09T06:32:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.273+0000 7f0c5f7fe700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0c64066f30 0x7f0c640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.274+0000 7f0c5f7fe700 1 -- 172.21.15.31:0/498493213 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0c6c0843c0 con 0x7f0c78159e10 2023-10-09T06:32:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.274+0000 7f0c777fe700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0c64066f30 0x7f0c640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.274+0000 7f0c777fe700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0c64066f30 0x7f0c640693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0c680058d0 tx=0x7f0c68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:41.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.278+0000 7f0c5f7fe700 1 -- 172.21.15.31:0/498493213 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c6c051930 con 0x7f0c78159e10 2023-10-09T06:32:41.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.471+0000 7f0c7dd32700 1 -- 172.21.15.31:0/498493213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c7804c3c0 con 0x7f0c78159e10 2023-10-09T06:32:41.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.472+0000 7f0c5f7fe700 1 -- 172.21.15.31:0/498493213 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+12274 (secure 0 0 0) 0x7f0c6c054f50 con 0x7f0c78159e10 2023-10-09T06:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":191,"fsid":"e30ef3ca-dd5e-445c-bd11-d2bec76d42c9","created":"2023-10-09T06:20:36.913973+0000","modified":"2023-10-09T06:32:37.999240+0000","last_up_change":"2023-10-09T06:20:42.314439+0000","last_in_change":"2023-10-09T06:20:39.305553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:20:42.563520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":86352},{"type":"v1","addr":"172.21.15.31:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":86352},{"type":"v1","addr":"172.21.15.31:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":86352},{"type":"v1","addr":"172.21.15.31:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":86352},{"type":"v1","addr":"172.21.15.31:6805","nonce":86352}]},"public_addr":"172.21.15.31:6801/86352","cluster_addr":"172.21.15.31:6803/86352","heartbeat_back_addr":"172.21.15.31:6807/86352","heartbeat_front_addr":"172.21.15.31:6805/86352","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":86369},{"type":"v1","addr":"172.21.15.31:6817","nonce":86369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":86369},{"type":"v1","addr":"172.21.15.31:6820","nonce":86369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":86369},{"type":"v1","addr":"172.21.15.31:6827","nonce":86369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":86369},{"type":"v1","addr":"172.21.15.31:6824","nonce":86369}]},"public_addr":"172.21.15.31:6817/86369","cluster_addr":"172.21.15.31:6820/86369","heartbeat_back_addr":"172.21.15.31:6827/86369","heartbeat_front_addr":"172.21.15.31:6824/86369","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":86376},{"type":"v1","addr":"172.21.15.31:6821","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":86376},{"type":"v1","addr":"172.21.15.31:6825","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":86376},{"type":"v1","addr":"172.21.15.31:6831","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":86376},{"type":"v1","addr":"172.21.15.31:6829","nonce":86376}]},"public_addr":"172.21.15.31:6821/86376","cluster_addr":"172.21.15.31:6825/86376","heartbeat_back_addr":"172.21.15.31:6831/86376","heartbeat_front_addr":"172.21.15.31:6829/86376","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":86353},{"type":"v1","addr":"172.21.15.31:6809","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":86353},{"type":"v1","addr":"172.21.15.31:6811","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":86353},{"type":"v1","addr":"172.21.15.31:6815","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":86353},{"type":"v1","addr":"172.21.15.31:6813","nonce":86353}]},"public_addr":"172.21.15.31:6809/86353","cluster_addr":"172.21.15.31:6811/86353","heartbeat_back_addr":"172.21.15.31:6815/86353","heartbeat_front_addr":"172.21.15.31:6813/86353","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":86569},{"type":"v1","addr":"172.21.15.158:6817","nonce":86569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":86569},{"type":"v1","addr":"172.21.15.158:6819","nonce":86569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":86569},{"type":"v1","addr":"172.21.15.158:6823","nonce":86569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":86569},{"type":"v1","addr":"172.21.15.158:6821","nonce":86569}]},"public_addr":"172.21.15.158:6817/86569","cluster_addr":"172.21.15.158:6819/86569","heartbeat_back_addr":"172.21.15.158:6823/86569","heartbeat_front_addr":"172.21.15.158:6821/86569","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":86547},{"type":"v1","addr":"172.21.15.158:6804","nonce":86547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":86547},{"type":"v1","addr":"172.21.15.158:6808","nonce":86547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6813","nonce":86547},{"type":"v1","addr":"172.21.15.158:6815","nonce":86547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":86547},{"type":"v1","addr":"172.21.15.158:6811","nonce":86547}]},"public_addr":"172.21.15.158:6804/86547","cluster_addr":"172.21.15.158:6808/86547","heartbeat_back_addr":"172.21.15.158:6815/86547","heartbeat_front_addr":"172.21.15.158:6811/86547","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":86548},{"type":"v1","addr":"172.21.15.158:6801","nonce":86548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6803","nonce":86548},{"type":"v1","addr":"172.21.15.158:6805","nonce":86548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":86548},{"type":"v1","addr":"172.21.15.158:6814","nonce":86548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6807","nonce":86548},{"type":"v1","addr":"172.21.15.158:6809","nonce":86548}]},"public_addr":"172.21.15.158:6801/86548","cluster_addr":"172.21.15.158:6805/86548","heartbeat_back_addr":"172.21.15.158:6814/86548","heartbeat_front_addr":"172.21.15.158:6809/86548","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":86602},{"type":"v1","addr":"172.21.15.158:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":86602},{"type":"v1","addr":"172.21.15.158:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":86602},{"type":"v1","addr":"172.21.15.158:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":86602},{"type":"v1","addr":"172.21.15.158:6829","nonce":86602}]},"public_addr":"172.21.15.158:6825/86602","cluster_addr":"172.21.15.158:6827/86602","heartbeat_back_addr":"172.21.15.158:6831/86602","heartbeat_front_addr":"172.21.15.158:6829/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.402933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.455786+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.471692+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.461669+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.407900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.385092+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.404732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:20:40.424694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6835/4124393323":"2023-10-10T06:32:35.175626+0000","172.21.15.31:6833/4124393323":"2023-10-10T06:32:35.175626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:32:41.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.474+0000 7f0c7dd32700 1 -- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0c64066f30 msgr2=0x7f0c640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:41.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.474+0000 7f0c7dd32700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0c64066f30 0x7f0c640693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0c680058d0 tx=0x7f0c68009040 comp rx=0 tx=0).stop 2023-10-09T06:32:41.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.474+0000 7f0c7dd32700 1 -- 172.21.15.31:0/498493213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c78159e10 msgr2=0x7f0c780c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:41.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.474+0000 7f0c7dd32700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c78159e10 0x7f0c780c9840 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00ec50 tx=0x7f0c6c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.474+0000 7f0c7dd32700 1 -- 172.21.15.31:0/498493213 shutdown_connections 2023-10-09T06:32:41.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.474+0000 7f0c7dd32700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0c64066f30 0x7f0c640693e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.474+0000 7f0c7dd32700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0c780b3430 0x7f0c78157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.474+0000 7f0c7dd32700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c7815a1e0 0x7f0c780c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.474+0000 7f0c7dd32700 1 --2- 172.21.15.31:0/498493213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c78159e10 0x7f0c780c9840 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:41.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.474+0000 7f0c7dd32700 1 -- 172.21.15.31:0/498493213 >> 172.21.15.31:0/498493213 conn(0x7f0c78067660 msgr2=0x7f0c780b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:41.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.474+0000 7f0c7dd32700 1 -- 172.21.15.31:0/498493213 shutdown_connections 2023-10-09T06:32:41.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:41.474+0000 7f0c7dd32700 1 -- 172.21.15.31:0/498493213 wait complete. 2023-10-09T06:32:42.487 INFO:tasks.ceph:Scrubbing osd.0 2023-10-09T06:32:42.488 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-09T06:32:42.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.620+0000 7f053adeb700 1 Processor -- start 2023-10-09T06:32:42.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.620+0000 7f053adeb700 1 -- start start 2023-10-09T06:32:42.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.620+0000 7f053adeb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0534159e50 0x7f05340b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.620+0000 7f053adeb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05340b3370 0x7f05340b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.620+0000 7f053adeb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f05340b1730 0x7f0534068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.620+0000 7f053adeb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05340b0d60 con 0x7f05340b3370 2023-10-09T06:32:42.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.620+0000 7f053adeb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05340d15b0 con 0x7f05340b1730 2023-10-09T06:32:42.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.620+0000 7f053adeb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05340d1890 con 0x7f0534159e50 2023-10-09T06:32:42.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f0533fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05340b3370 0x7f05340b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f0533fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05340b3370 0x7f05340b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58350/0 (socket says 172.21.15.31:58350) 2023-10-09T06:32:42.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f0533fff700 1 -- 172.21.15.31:0/1017277764 learned_addr learned my addr 172.21.15.31:0/1017277764 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:42.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f0539388700 1 --2- 172.21.15.31:0/1017277764 >> v2:172.21.15.158:3300/0 conn(0x7f05340b1730 0x7f0534068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f0538b87700 1 --2- 172.21.15.31:0/1017277764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0534159e50 0x7f05340b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f0533fff700 1 -- 172.21.15.31:0/1017277764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0534159e50 msgr2=0x7f05340b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:42.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f0533fff700 1 --2- 172.21.15.31:0/1017277764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0534159e50 0x7f05340b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f0533fff700 1 -- 172.21.15.31:0/1017277764 >> v2:172.21.15.158:3300/0 conn(0x7f05340b1730 msgr2=0x7f0534068cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:42.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f0533fff700 1 --2- 172.21.15.31:0/1017277764 >> v2:172.21.15.158:3300/0 conn(0x7f05340b1730 0x7f0534068cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f0533fff700 1 -- 172.21.15.31:0/1017277764 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05340b09f0 con 0x7f05340b3370 2023-10-09T06:32:42.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f0539388700 1 --2- 172.21.15.31:0/1017277764 >> v2:172.21.15.158:3300/0 conn(0x7f05340b1730 0x7f0534068cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:42.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f0538b87700 1 --2- 172.21.15.31:0/1017277764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0534159e50 0x7f05340b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:42.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f0533fff700 1 --2- 172.21.15.31:0/1017277764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05340b3370 0x7f05340b11f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f0534089f20 tx=0x7f0524009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d8bfbf24c8e28b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:42.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f05337fe700 1 -- 172.21.15.31:0/1017277764 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052400b860 con 0x7f05340b3370 2023-10-09T06:32:42.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f05337fe700 1 -- 172.21.15.31:0/1017277764 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052400b9c0 con 0x7f05340b3370 2023-10-09T06:32:42.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.621+0000 7f05337fe700 1 -- 172.21.15.31:0/1017277764 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052400bd60 con 0x7f05340b3370 2023-10-09T06:32:42.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.622+0000 7f053adeb700 1 -- 172.21.15.31:0/1017277764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05340b3370 msgr2=0x7f05340b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:42.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.622+0000 7f053adeb700 1 --2- 172.21.15.31:0/1017277764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05340b3370 0x7f05340b11f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f0534089f20 tx=0x7f0524009250 comp rx=0 tx=0).stop 2023-10-09T06:32:42.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.622+0000 7f053adeb700 1 -- 172.21.15.31:0/1017277764 shutdown_connections 2023-10-09T06:32:42.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.622+0000 7f053adeb700 1 --2- 172.21.15.31:0/1017277764 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0534159e50 0x7f05340b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.622+0000 7f053adeb700 1 --2- 172.21.15.31:0/1017277764 >> v2:172.21.15.158:3300/0 conn(0x7f05340b1730 0x7f0534068cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.622+0000 7f053adeb700 1 --2- 172.21.15.31:0/1017277764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05340b3370 0x7f05340b11f0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.622+0000 7f053adeb700 1 -- 172.21.15.31:0/1017277764 >> 172.21.15.31:0/1017277764 conn(0x7f0534068130 msgr2=0x7f05340d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:42.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.622+0000 7f053adeb700 1 -- 172.21.15.31:0/1017277764 shutdown_connections 2023-10-09T06:32:42.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.622+0000 7f053adeb700 1 -- 172.21.15.31:0/1017277764 wait complete. 2023-10-09T06:32:42.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.623+0000 7f053adeb700 1 Processor -- start 2023-10-09T06:32:42.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.623+0000 7f053adeb700 1 -- start start 2023-10-09T06:32:42.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f053adeb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05340b1730 0x7f05340c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f053adeb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05340b3370 0x7f05340c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f053adeb700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0534159e50 0x7f05340cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f053adeb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05340a7930 con 0x7f05340b3370 2023-10-09T06:32:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f053adeb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05340c7d80 con 0x7f05340b1730 2023-10-09T06:32:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f053adeb700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05340c8be0 con 0x7f0534159e50 2023-10-09T06:32:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f0533fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05340b3370 0x7f05340c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f0533fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05340b3370 0x7f05340c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58362/0 (socket says 172.21.15.31:58362) 2023-10-09T06:32:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f0533fff700 1 -- 172.21.15.31:0/108637910 learned_addr learned my addr 172.21.15.31:0/108637910 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f0533fff700 1 -- 172.21.15.31:0/108637910 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0534159e50 msgr2=0x7f05340cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f0539388700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0534159e50 0x7f05340cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f0538b87700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05340b1730 0x7f05340c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f0533fff700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0534159e50 0x7f05340cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f0533fff700 1 -- 172.21.15.31:0/108637910 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05340b1730 msgr2=0x7f05340c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f0533fff700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05340b1730 0x7f05340c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f0533fff700 1 -- 172.21.15.31:0/108637910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05240094f0 con 0x7f05340b3370 2023-10-09T06:32:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.624+0000 7f0539388700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0534159e50 0x7f05340cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.625+0000 7f0538b87700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05340b1730 0x7f05340c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.625+0000 7f0533fff700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05340b3370 0x7f05340c9070 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f05240090b0 tx=0x7f0524017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.625+0000 7f0530ff9700 1 -- 172.21.15.31:0/108637910 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524026480 con 0x7f05340b3370 2023-10-09T06:32:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.625+0000 7f0530ff9700 1 -- 172.21.15.31:0/108637910 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052401f070 con 0x7f05340b3370 2023-10-09T06:32:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.625+0000 7f053adeb700 1 -- 172.21.15.31:0/108637910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05340c7fd0 con 0x7f05340b3370 2023-10-09T06:32:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.625+0000 7f0530ff9700 1 -- 172.21.15.31:0/108637910 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524026830 con 0x7f05340b3370 2023-10-09T06:32:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.625+0000 7f053adeb700 1 -- 172.21.15.31:0/108637910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05340c8590 con 0x7f05340b3370 2023-10-09T06:32:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.626+0000 7f053adeb700 1 -- 172.21.15.31:0/108637910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f053404c3c0 con 0x7f05340b3370 2023-10-09T06:32:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.626+0000 7f0530ff9700 1 -- 172.21.15.31:0/108637910 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0524026ba0 con 0x7f05340b3370 2023-10-09T06:32:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.626+0000 7f0530ff9700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0514066f30 0x7f05140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.627+0000 7f0530ff9700 1 -- 172.21.15.31:0/108637910 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0524021070 con 0x7f05340b3370 2023-10-09T06:32:42.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.627+0000 7f0530ff9700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] conn(0x7f051406cd80 0x7f051406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.627+0000 7f0530ff9700 1 -- 172.21.15.31:0/108637910 --> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f051406f860 con 0x7f051406cd80 2023-10-09T06:32:42.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.627+0000 7f0530ff9700 1 -- 172.21.15.31:0/108637910 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0524088580 con 0x7f05340b3370 2023-10-09T06:32:42.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.627+0000 7f0538b87700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0514066f30 0x7f05140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.627+0000 7f0539388700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] conn(0x7f051406cd80 0x7f051406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.627+0000 7f0539388700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] conn(0x7f051406cd80 0x7f051406f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:42.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.627+0000 7f0538b87700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0514066f30 0x7f05140693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f052c0094d0 tx=0x7f052c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:42.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.628+0000 7f0530ff9700 1 -- 172.21.15.31:0/108637910 <== osd.0 v2:172.21.15.31:6800/86352 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f051406f860 con 0x7f051406cd80 2023-10-09T06:32:42.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.641+0000 7f053adeb700 1 -- 172.21.15.31:0/108637910 --> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f05340b1510 con 0x7f051406cd80 2023-10-09T06:32:42.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.641+0000 7f0530ff9700 1 -- 172.21.15.31:0/108637910 <== osd.0 v2:172.21.15.31:6800/86352 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f05340b1510 con 0x7f051406cd80 2023-10-09T06:32:42.642 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:42.642 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T06:32:42.642 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:42.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.641+0000 7f053adeb700 1 -- 172.21.15.31:0/108637910 >> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] conn(0x7f051406cd80 msgr2=0x7f051406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:42.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.641+0000 7f053adeb700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.31:6800/86352,v1:172.21.15.31:6801/86352] conn(0x7f051406cd80 0x7f051406f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.641+0000 7f053adeb700 1 -- 172.21.15.31:0/108637910 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0514066f30 msgr2=0x7f05140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:42.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.641+0000 7f053adeb700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0514066f30 0x7f05140693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f052c0094d0 tx=0x7f052c00b040 comp rx=0 tx=0).stop 2023-10-09T06:32:42.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.641+0000 7f053adeb700 1 -- 172.21.15.31:0/108637910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05340b3370 msgr2=0x7f05340c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:42.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.641+0000 7f053adeb700 1 --2- 172.21.15.31:0/108637910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05340b3370 0x7f05340c9070 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f05240090b0 tx=0x7f0524017000 comp rx=0 tx=0).stop 2023-10-09T06:32:42.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.641+0000 7f0539388700 1 -- 172.21.15.31:0/108637910 reap_dead start 2023-10-09T06:32:42.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.641+0000 7f053adeb700 1 -- 172.21.15.31:0/108637910 shutdown_connections 2023-10-09T06:32:42.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.641+0000 7f053adeb700 1 -- 172.21.15.31:0/108637910 >> 172.21.15.31:0/108637910 conn(0x7f0534068130 msgr2=0x7f05340b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:42.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.641+0000 7f053adeb700 1 -- 172.21.15.31:0/108637910 shutdown_connections 2023-10-09T06:32:42.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.641+0000 7f053adeb700 1 -- 172.21.15.31:0/108637910 wait complete. 2023-10-09T06:32:42.654 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-09T06:32:42.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.774+0000 7f34ea197700 1 Processor -- start 2023-10-09T06:32:42.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.774+0000 7f34ea197700 1 -- start start 2023-10-09T06:32:42.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.775+0000 7f34ea197700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34e40d0160 0x7f34e40af750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.775+0000 7f34ea197700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e415d8d0 con 0x7f34e40d15c0 2023-10-09T06:32:42.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.775+0000 7f34ea197700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e415e170 con 0x7f34e415e600 2023-10-09T06:32:42.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.775+0000 7f34ea197700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40b00c0 con 0x7f34e40d0160 2023-10-09T06:32:42.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.775+0000 7f34e8994700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f34e40d15c0 0x7f34e40cba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60820/0 (socket says 172.21.15.31:60820) 2023-10-09T06:32:42.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.775+0000 7f34e8994700 1 -- 172.21.15.31:0/1767317875 learned_addr learned my addr 172.21.15.31:0/1767317875 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:42.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.775+0000 7f34e9195700 1 --2- 172.21.15.31:0/1767317875 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34e40d0160 0x7f34e40af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.775+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497831137 0 0) 0x7f34e415d8d0 con 0x7f34e40d15c0 2023-10-09T06:32:42.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d0003570 con 0x7f34e40d15c0 2023-10-09T06:32:42.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1711579180 0 0) 0x7f34d0003570 con 0x7f34e40d15c0 2023-10-09T06:32:42.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34e40d0160 msgr2=0x7f34e40af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:42.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 --2- 172.21.15.31:0/1767317875 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34e40d0160 0x7f34e40af750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 >> v1:172.21.15.158:6789/0 conn(0x7f34e415e600 legacy=0x7f34e415a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:42.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e415db20 con 0x7f34e40d15c0 2023-10-09T06:32:42.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f34d4001470 con 0x7f34e40d15c0 2023-10-09T06:32:42.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 >> v1:172.21.15.31:6789/0 conn(0x7f34e40d15c0 legacy=0x7f34e40cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:42.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 --2- 172.21.15.31:0/1767317875 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34e40d0160 0x7f34d0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 --2- 172.21.15.31:0/1767317875 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34d0004010 0x7f34d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 --2- 172.21.15.31:0/1767317875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34d0004d50 0x7f34d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40b00c0 con 0x7f34d0004d50 2023-10-09T06:32:42.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d000bbf0 con 0x7f34d0004010 2023-10-09T06:32:42.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d000bdb0 con 0x7f34e40d0160 2023-10-09T06:32:42.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34e9996700 1 --2- 172.21.15.31:0/1767317875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34d0004d50 0x7f34d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34e9195700 1 --2- 172.21.15.31:0/1767317875 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34e40d0160 0x7f34d0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34e8994700 1 --2- 172.21.15.31:0/1767317875 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34d0004010 0x7f34d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34e9996700 1 -- 172.21.15.31:0/1767317875 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34e40d0160 msgr2=0x7f34d0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:42.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34e9996700 1 --2- 172.21.15.31:0/1767317875 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34e40d0160 0x7f34d0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34e9996700 1 -- 172.21.15.31:0/1767317875 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34d0004010 msgr2=0x7f34d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:42.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34e9996700 1 --2- 172.21.15.31:0/1767317875 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34d0004010 0x7f34d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34e9996700 1 -- 172.21.15.31:0/1767317875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d0003570 con 0x7f34d0004d50 2023-10-09T06:32:42.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.776+0000 7f34e9996700 1 --2- 172.21.15.31:0/1767317875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34d0004d50 0x7f34d00051c0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f34e40d0b90 tx=0x7f34dc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5eb18cf43dd9d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:42.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.777+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc001950 con 0x7f34d0004d50 2023-10-09T06:32:42.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.777+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc004030 con 0x7f34d0004d50 2023-10-09T06:32:42.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.777+0000 7f34dbfff700 1 -- 172.21.15.31:0/1767317875 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc00cad0 con 0x7f34d0004d50 2023-10-09T06:32:42.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.777+0000 7f34ea197700 1 -- 172.21.15.31:0/1767317875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34d0004d50 msgr2=0x7f34d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:42.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.777+0000 7f34ea197700 1 --2- 172.21.15.31:0/1767317875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34d0004d50 0x7f34d00051c0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f34e40d0b90 tx=0x7f34dc001640 comp rx=0 tx=0).stop 2023-10-09T06:32:42.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.777+0000 7f34e9996700 1 -- 172.21.15.31:0/1767317875 reap_dead start 2023-10-09T06:32:42.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.777+0000 7f34ea197700 1 -- 172.21.15.31:0/1767317875 shutdown_connections 2023-10-09T06:32:42.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.777+0000 7f34ea197700 1 -- 172.21.15.31:0/1767317875 >> 172.21.15.31:0/1767317875 conn(0x7f34e40695d0 msgr2=0x7f34e40d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:42.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.777+0000 7f34ea197700 1 -- 172.21.15.31:0/1767317875 shutdown_connections 2023-10-09T06:32:42.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.777+0000 7f34ea197700 1 -- 172.21.15.31:0/1767317875 wait complete. 2023-10-09T06:32:42.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.778+0000 7f34ea197700 1 Processor -- start 2023-10-09T06:32:42.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.778+0000 7f34ea197700 1 -- start start 2023-10-09T06:32:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.779+0000 7f34ea197700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34d0004d50 0x7f34e415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.779+0000 7f34ea197700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e415ceb0 0x7f34e40b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.779+0000 7f34ea197700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34e40b39d0 0x7f34e40b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.779+0000 7f34ea197700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e415be10 con 0x7f34e415ceb0 2023-10-09T06:32:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.779+0000 7f34ea197700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e415c0f0 con 0x7f34d0004d50 2023-10-09T06:32:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.779+0000 7f34ea197700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e415c3d0 con 0x7f34e40b39d0 2023-10-09T06:32:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.779+0000 7f34e8994700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e415ceb0 0x7f34e40b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.779+0000 7f34e8994700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e415ceb0 0x7f34e40b3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58378/0 (socket says 172.21.15.31:58378) 2023-10-09T06:32:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.779+0000 7f34e8994700 1 -- 172.21.15.31:0/1679207553 learned_addr learned my addr 172.21.15.31:0/1679207553 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.779+0000 7f34e9195700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34d0004d50 0x7f34e415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.779+0000 7f34e9996700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34e40b39d0 0x7f34e40b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.780+0000 7f34e8994700 1 -- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34e40b39d0 msgr2=0x7f34e40b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:42.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.780+0000 7f34e8994700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34e40b39d0 0x7f34e40b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.780+0000 7f34e8994700 1 -- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34d0004d50 msgr2=0x7f34e415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:42.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.780+0000 7f34e8994700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34d0004d50 0x7f34e415b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.780+0000 7f34e8994700 1 -- 172.21.15.31:0/1679207553 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e415c6b0 con 0x7f34e415ceb0 2023-10-09T06:32:42.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.780+0000 7f34e8994700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e415ceb0 0x7f34e40b3fc0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f34d40010e0 tx=0x7f34d4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:42.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.780+0000 7f34d97fa700 1 -- 172.21.15.31:0/1679207553 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4011660 con 0x7f34e415ceb0 2023-10-09T06:32:42.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.780+0000 7f34d97fa700 1 -- 172.21.15.31:0/1679207553 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d40117e0 con 0x7f34e415ceb0 2023-10-09T06:32:42.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.780+0000 7f34ea197700 1 -- 172.21.15.31:0/1679207553 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e415c990 con 0x7f34e415ceb0 2023-10-09T06:32:42.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.780+0000 7f34d97fa700 1 -- 172.21.15.31:0/1679207553 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4011ba0 con 0x7f34e415ceb0 2023-10-09T06:32:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.780+0000 7f34ea197700 1 -- 172.21.15.31:0/1679207553 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e40cae20 con 0x7f34e415ceb0 2023-10-09T06:32:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.781+0000 7f34ea197700 1 -- 172.21.15.31:0/1679207553 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e415cbd0 con 0x7f34e415ceb0 2023-10-09T06:32:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.781+0000 7f34d97fa700 1 -- 172.21.15.31:0/1679207553 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34d401d460 con 0x7f34e415ceb0 2023-10-09T06:32:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.782+0000 7f34d97fa700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34c8066f30 0x7f34c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.782+0000 7f34d97fa700 1 -- 172.21.15.31:0/1679207553 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f34d4084310 con 0x7f34e415ceb0 2023-10-09T06:32:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.782+0000 7f34e9195700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34c8066f30 0x7f34c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.783+0000 7f34e9195700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34c8066f30 0x7f34c80693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f34e0006f00 tx=0x7f34e00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.786+0000 7f34d97fa700 1 -- 172.21.15.31:0/1679207553 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34e415cbd0 con 0x7f34e415ceb0 2023-10-09T06:32:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.980+0000 7f34ea197700 1 -- 172.21.15.31:0/1679207553 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f34e415cbd0 con 0x7f34c8066f30 2023-10-09T06:32:42.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.981+0000 7f34d97fa700 1 -- 172.21.15.31:0/1679207553 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f34e415cbd0 con 0x7f34c8066f30 2023-10-09T06:32:42.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.983+0000 7f34ea197700 1 -- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34c8066f30 msgr2=0x7f34c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:42.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.983+0000 7f34ea197700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34c8066f30 0x7f34c80693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f34e0006f00 tx=0x7f34e00091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.983+0000 7f34ea197700 1 -- 172.21.15.31:0/1679207553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e415ceb0 msgr2=0x7f34e40b3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:42.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.983+0000 7f34ea197700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e415ceb0 0x7f34e40b3fc0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f34d40010e0 tx=0x7f34d4001e50 comp rx=0 tx=0).stop 2023-10-09T06:32:42.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.983+0000 7f34ea197700 1 -- 172.21.15.31:0/1679207553 shutdown_connections 2023-10-09T06:32:42.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.983+0000 7f34ea197700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f34c8066f30 0x7f34c80693e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.983+0000 7f34ea197700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f34e40b39d0 0x7f34e40b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.983+0000 7f34ea197700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34d0004d50 0x7f34e415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.983+0000 7f34ea197700 1 --2- 172.21.15.31:0/1679207553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e415ceb0 0x7f34e40b3fc0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.983+0000 7f34ea197700 1 -- 172.21.15.31:0/1679207553 >> 172.21.15.31:0/1679207553 conn(0x7f34e40695d0 msgr2=0x7f34e40c68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.983+0000 7f34ea197700 1 -- 172.21.15.31:0/1679207553 shutdown_connections 2023-10-09T06:32:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:42.983+0000 7f34ea197700 1 -- 172.21.15.31:0/1679207553 wait complete. 2023-10-09T06:32:42.985 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 0 to deep-scrub 2023-10-09T06:32:42.996 INFO:tasks.ceph:Scrubbing osd.1 2023-10-09T06:32:42.996 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-09T06:32:43.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.120+0000 7f2e97127700 1 Processor -- start 2023-10-09T06:32:43.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.120+0000 7f2e97127700 1 -- start start 2023-10-09T06:32:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.121+0000 7f2e97127700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e900cc940 0x7f2e900ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.121+0000 7f2e97127700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e900ce810 0x7f2e900cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.121+0000 7f2e97127700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e900cbb80 con 0x7f2e9015d240 2023-10-09T06:32:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.121+0000 7f2e97127700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e900cbe60 con 0x7f2e900cc940 2023-10-09T06:32:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.121+0000 7f2e97127700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e900cc140 con 0x7f2e900ce810 2023-10-09T06:32:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.121+0000 7f2e95924700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e900cc940 0x7f2e900ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.121+0000 7f2e96125700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2e9015d240 0x7f2e900b3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60830/0 (socket says 172.21.15.31:60830) 2023-10-09T06:32:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.121+0000 7f2e96125700 1 -- 172.21.15.31:0/4087096331 learned_addr learned my addr 172.21.15.31:0/4087096331 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.121+0000 7f2e95924700 1 -- 172.21.15.31:0/4087096331 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e900ce810 msgr2=0x7f2e900cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.121+0000 7f2e96926700 1 --2- 172.21.15.31:0/4087096331 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e900ce810 0x7f2e900cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e95924700 1 --2- 172.21.15.31:0/4087096331 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e900ce810 0x7f2e900cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e95123700 1 -- 172.21.15.31:0/4087096331 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816937315 0 0) 0x7f2e900cbb80 con 0x7f2e9015d240 2023-10-09T06:32:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e95924700 1 -- 172.21.15.31:0/4087096331 >> v1:172.21.15.31:6789/0 conn(0x7f2e9015d240 legacy=0x7f2e900b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e95924700 1 -- 172.21.15.31:0/4087096331 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e900cc420 con 0x7f2e900cc940 2023-10-09T06:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e96926700 1 --2- 172.21.15.31:0/4087096331 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e900ce810 0x7f2e900cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e95924700 1 --2- 172.21.15.31:0/4087096331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e900cc940 0x7f2e900ccde0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f2e840098e0 tx=0x7f2e840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5237e8395fffe80e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e95123700 1 -- 172.21.15.31:0/4087096331 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84009e80 con 0x7f2e900cc940 2023-10-09T06:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e95123700 1 -- 172.21.15.31:0/4087096331 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8400b860 con 0x7f2e900cc940 2023-10-09T06:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e95123700 1 -- 172.21.15.31:0/4087096331 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400bbe0 con 0x7f2e900cc940 2023-10-09T06:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e97127700 1 -- 172.21.15.31:0/4087096331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e900cc940 msgr2=0x7f2e900ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e97127700 1 --2- 172.21.15.31:0/4087096331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e900cc940 0x7f2e900ccde0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f2e840098e0 tx=0x7f2e840091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e97127700 1 -- 172.21.15.31:0/4087096331 shutdown_connections 2023-10-09T06:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e97127700 1 --2- 172.21.15.31:0/4087096331 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e900ce810 0x7f2e900cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e97127700 1 --2- 172.21.15.31:0/4087096331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e900cc940 0x7f2e900ccde0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.122+0000 7f2e97127700 1 -- 172.21.15.31:0/4087096331 >> 172.21.15.31:0/4087096331 conn(0x7f2e90067e40 msgr2=0x7f2e900d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.123+0000 7f2e97127700 1 -- 172.21.15.31:0/4087096331 shutdown_connections 2023-10-09T06:32:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.123+0000 7f2e97127700 1 -- 172.21.15.31:0/4087096331 wait complete. 2023-10-09T06:32:43.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.124+0000 7f2e97127700 1 Processor -- start 2023-10-09T06:32:43.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.124+0000 7f2e97127700 1 -- start start 2023-10-09T06:32:43.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.124+0000 7f2e97127700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e900cc940 0x7f2e9009a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.124+0000 7f2e97127700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e900ce810 0x7f2e9009ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.124+0000 7f2e97127700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9015d240 0x7f2e90158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.124+0000 7f2e97127700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9009bc50 con 0x7f2e9015d240 2023-10-09T06:32:43.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.124+0000 7f2e97127700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9009b040 con 0x7f2e900cc940 2023-10-09T06:32:43.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.124+0000 7f2e97127700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9009b320 con 0x7f2e900ce810 2023-10-09T06:32:43.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.124+0000 7f2e96926700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9015d240 0x7f2e90158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.124+0000 7f2e96926700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9015d240 0x7f2e90158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58396/0 (socket says 172.21.15.31:58396) 2023-10-09T06:32:43.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.124+0000 7f2e96926700 1 -- 172.21.15.31:0/1585177769 learned_addr learned my addr 172.21.15.31:0/1585177769 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:43.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.125+0000 7f2e96125700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e900cc940 0x7f2e9009a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.125+0000 7f2e95924700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e900ce810 0x7f2e9009ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.125+0000 7f2e96926700 1 -- 172.21.15.31:0/1585177769 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e900ce810 msgr2=0x7f2e9009ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.125+0000 7f2e96926700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2e900ce810 0x7f2e9009ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.125+0000 7f2e96926700 1 -- 172.21.15.31:0/1585177769 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e900cc940 msgr2=0x7f2e9009a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.125+0000 7f2e96926700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e900cc940 0x7f2e9009a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.125+0000 7f2e96926700 1 -- 172.21.15.31:0/1585177769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84009420 con 0x7f2e9015d240 2023-10-09T06:32:43.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.125+0000 7f2e96926700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9015d240 0x7f2e90158f00 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000cef0 tx=0x7f2e80007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.125+0000 7f2e8e7fc700 1 -- 172.21.15.31:0/1585177769 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8000ad20 con 0x7f2e9015d240 2023-10-09T06:32:43.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.125+0000 7f2e8e7fc700 1 -- 172.21.15.31:0/1585177769 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e80016420 con 0x7f2e9015d240 2023-10-09T06:32:43.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.125+0000 7f2e97127700 1 -- 172.21.15.31:0/1585177769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9009b600 con 0x7f2e9015d240 2023-10-09T06:32:43.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.125+0000 7f2e8e7fc700 1 -- 172.21.15.31:0/1585177769 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8000aea0 con 0x7f2e9015d240 2023-10-09T06:32:43.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.125+0000 7f2e97127700 1 -- 172.21.15.31:0/1585177769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9009ad50 con 0x7f2e9015d240 2023-10-09T06:32:43.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.126+0000 7f2e97127700 1 -- 172.21.15.31:0/1585177769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e9006ac60 con 0x7f2e9015d240 2023-10-09T06:32:43.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.127+0000 7f2e8e7fc700 1 -- 172.21.15.31:0/1585177769 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e80016a70 con 0x7f2e9015d240 2023-10-09T06:32:43.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.127+0000 7f2e8e7fc700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2e7c066f30 0x7f2e7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.127+0000 7f2e8e7fc700 1 -- 172.21.15.31:0/1585177769 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2e80012070 con 0x7f2e9015d240 2023-10-09T06:32:43.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.127+0000 7f2e8e7fc700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] conn(0x7f2e7c06cd80 0x7f2e7c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.127+0000 7f2e8e7fc700 1 -- 172.21.15.31:0/1585177769 --> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e7c06f860 con 0x7f2e7c06cd80 2023-10-09T06:32:43.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.127+0000 7f2e8e7fc700 1 -- 172.21.15.31:0/1585177769 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e800857c0 con 0x7f2e9015d240 2023-10-09T06:32:43.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.127+0000 7f2e95924700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] conn(0x7f2e7c06cd80 0x7f2e7c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.127+0000 7f2e96125700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2e7c066f30 0x7f2e7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.128+0000 7f2e95924700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] conn(0x7f2e7c06cd80 0x7f2e7c06f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.128+0000 7f2e96125700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2e7c066f30 0x7f2e7c0693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2e880029c0 tx=0x7f2e88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.128+0000 7f2e8e7fc700 1 -- 172.21.15.31:0/1585177769 <== osd.1 v2:172.21.15.31:6816/86369 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f2e7c06f860 con 0x7f2e7c06cd80 2023-10-09T06:32:43.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.141+0000 7f2e97127700 1 -- 172.21.15.31:0/1585177769 --> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2e900cfdd0 con 0x7f2e7c06cd80 2023-10-09T06:32:43.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.141+0000 7f2e8e7fc700 1 -- 172.21.15.31:0/1585177769 <== osd.1 v2:172.21.15.31:6816/86369 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f2e900cfdd0 con 0x7f2e7c06cd80 2023-10-09T06:32:43.142 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:43.142 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T06:32:43.142 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:43.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.141+0000 7f2e97127700 1 -- 172.21.15.31:0/1585177769 >> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] conn(0x7f2e7c06cd80 msgr2=0x7f2e7c06f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.141+0000 7f2e97127700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.31:6816/86369,v1:172.21.15.31:6817/86369] conn(0x7f2e7c06cd80 0x7f2e7c06f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.142+0000 7f2e97127700 1 -- 172.21.15.31:0/1585177769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2e7c066f30 msgr2=0x7f2e7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.142+0000 7f2e97127700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2e7c066f30 0x7f2e7c0693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2e880029c0 tx=0x7f2e88009040 comp rx=0 tx=0).stop 2023-10-09T06:32:43.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.142+0000 7f2e97127700 1 -- 172.21.15.31:0/1585177769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9015d240 msgr2=0x7f2e90158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.142+0000 7f2e97127700 1 --2- 172.21.15.31:0/1585177769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9015d240 0x7f2e90158f00 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000cef0 tx=0x7f2e80007860 comp rx=0 tx=0).stop 2023-10-09T06:32:43.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.142+0000 7f2e96926700 1 -- 172.21.15.31:0/1585177769 reap_dead start 2023-10-09T06:32:43.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.142+0000 7f2e97127700 1 -- 172.21.15.31:0/1585177769 shutdown_connections 2023-10-09T06:32:43.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.142+0000 7f2e97127700 1 -- 172.21.15.31:0/1585177769 >> 172.21.15.31:0/1585177769 conn(0x7f2e90067e40 msgr2=0x7f2e900b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:43.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.142+0000 7f2e97127700 1 -- 172.21.15.31:0/1585177769 shutdown_connections 2023-10-09T06:32:43.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.142+0000 7f2e97127700 1 -- 172.21.15.31:0/1585177769 wait complete. 2023-10-09T06:32:43.154 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-09T06:32:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.273+0000 7f9ed155e700 1 Processor -- start 2023-10-09T06:32:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.273+0000 7f9ed155e700 1 -- start start 2023-10-09T06:32:43.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.274+0000 7f9ed155e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9ecc15a170 0x7f9ecc068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.274+0000 7f9ed155e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc0694a0 con 0x7f9ecc159da0 2023-10-09T06:32:43.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.274+0000 7f9ed155e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc15ea70 con 0x7f9ecc069040 2023-10-09T06:32:43.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.274+0000 7f9ed155e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ecc0b34b0 con 0x7f9ecc15a170 2023-10-09T06:32:43.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.274+0000 7f9ecbfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9ecc159da0 0x7f9ecc0b2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60834/0 (socket says 172.21.15.31:60834) 2023-10-09T06:32:43.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.274+0000 7f9ecbfff700 1 -- 172.21.15.31:0/1061615004 learned_addr learned my addr 172.21.15.31:0/1061615004 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:43.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.274+0000 7f9ecb7fe700 1 --2- 172.21.15.31:0/1061615004 >> v2:172.21.15.158:3300/0 conn(0x7f9ecc15a170 0x7f9ecc068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.274+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361027783 0 0) 0x7f9eb4001110 con 0x7f9ecc159da0 2023-10-09T06:32:43.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.274+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb8003570 con 0x7f9ecc159da0 2023-10-09T06:32:43.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3140732833 0 0) 0x7f9eb8003570 con 0x7f9ecc159da0 2023-10-09T06:32:43.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 >> v2:172.21.15.158:3300/0 conn(0x7f9ecc15a170 msgr2=0x7f9ecc068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:43.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 --2- 172.21.15.31:0/1061615004 >> v2:172.21.15.158:3300/0 conn(0x7f9ecc15a170 0x7f9ecc068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 >> v1:172.21.15.158:6789/0 conn(0x7f9ecc069040 legacy=0x7f9ecc0af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0b3990 con 0x7f9ecc159da0 2023-10-09T06:32:43.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f9eb4001600 con 0x7f9ecc159da0 2023-10-09T06:32:43.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 >> v1:172.21.15.31:6789/0 conn(0x7f9ecc159da0 legacy=0x7f9ecc0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 --2- 172.21.15.31:0/1061615004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9eb8003a60 0x7f9eb8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 --2- 172.21.15.31:0/1061615004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9eb8004810 0x7f9eb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 --2- 172.21.15.31:0/1061615004 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9eb80052e0 0x7f9eb800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0b34b0 con 0x7f9eb8003a60 2023-10-09T06:32:43.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb800c2a0 con 0x7f9eb8004810 2023-10-09T06:32:43.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb800c460 con 0x7f9eb80052e0 2023-10-09T06:32:43.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecbfff700 1 --2- 172.21.15.31:0/1061615004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9eb8003a60 0x7f9eb8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecb7fe700 1 --2- 172.21.15.31:0/1061615004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9eb8004810 0x7f9eb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ed0d5d700 1 --2- 172.21.15.31:0/1061615004 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9eb80052e0 0x7f9eb800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecbfff700 1 -- 172.21.15.31:0/1061615004 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9eb80052e0 msgr2=0x7f9eb800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:43.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecbfff700 1 --2- 172.21.15.31:0/1061615004 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9eb80052e0 0x7f9eb800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecbfff700 1 -- 172.21.15.31:0/1061615004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9eb8004810 msgr2=0x7f9eb8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:43.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecbfff700 1 --2- 172.21.15.31:0/1061615004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9eb8004810 0x7f9eb8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecbfff700 1 -- 172.21.15.31:0/1061615004 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb8003570 con 0x7f9eb8003a60 2023-10-09T06:32:43.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecb7fe700 1 --2- 172.21.15.31:0/1061615004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9eb8004810 0x7f9eb8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:43.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ed0d5d700 1 -- 172.21.15.31:0/1061615004 reap_dead start 2023-10-09T06:32:43.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecbfff700 1 --2- 172.21.15.31:0/1061615004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9eb8003a60 0x7f9eb8003e70 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400c5c0 tx=0x7f9eb4007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad24da8c687fd0e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb400cdc0 con 0x7f9eb8003a60 2023-10-09T06:32:43.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb4005920 con 0x7f9eb8003a60 2023-10-09T06:32:43.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.275+0000 7f9ecaffd700 1 -- 172.21.15.31:0/1061615004 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4005ce0 con 0x7f9eb8003a60 2023-10-09T06:32:43.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.276+0000 7f9ed155e700 1 -- 172.21.15.31:0/1061615004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9eb8003a60 msgr2=0x7f9eb8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.276+0000 7f9ed155e700 1 --2- 172.21.15.31:0/1061615004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9eb8003a60 0x7f9eb8003e70 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400c5c0 tx=0x7f9eb4007a50 comp rx=0 tx=0).stop 2023-10-09T06:32:43.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.276+0000 7f9ed155e700 1 -- 172.21.15.31:0/1061615004 shutdown_connections 2023-10-09T06:32:43.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.276+0000 7f9ed155e700 1 --2- 172.21.15.31:0/1061615004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9eb8003a60 0x7f9eb8003e70 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.276+0000 7f9ed155e700 1 -- 172.21.15.31:0/1061615004 >> 172.21.15.31:0/1061615004 conn(0x7f9ecc0d0bc0 msgr2=0x7f9ecc0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:43.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.276+0000 7f9ed155e700 1 -- 172.21.15.31:0/1061615004 shutdown_connections 2023-10-09T06:32:43.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.276+0000 7f9ed155e700 1 -- 172.21.15.31:0/1061615004 wait complete. 2023-10-09T06:32:43.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.277+0000 7f9ed155e700 1 Processor -- start 2023-10-09T06:32:43.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.277+0000 7f9ed155e700 1 -- start start 2023-10-09T06:32:43.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ed155e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9eb8003a60 0x7f9ecc0afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ed155e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ecc0c56b0 0x7f9ecc15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ed155e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ecc0c6be0 0x7f9ecc0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ed155e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0b0090 con 0x7f9ecc0c56b0 2023-10-09T06:32:43.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ed155e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0c5b40 con 0x7f9ecc0c6be0 2023-10-09T06:32:43.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ed155e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0c5e20 con 0x7f9eb8003a60 2023-10-09T06:32:43.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ecb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ecc0c56b0 0x7f9ecc15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ecb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ecc0c56b0 0x7f9ecc15cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58414/0 (socket says 172.21.15.31:58414) 2023-10-09T06:32:43.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ecb7fe700 1 -- 172.21.15.31:0/786998819 learned_addr learned my addr 172.21.15.31:0/786998819 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:43.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ecbfff700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9eb8003a60 0x7f9ecc0afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ed0d5d700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ecc0c6be0 0x7f9ecc0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ecb7fe700 1 -- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9eb8003a60 msgr2=0x7f9ecc0afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ecb7fe700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9eb8003a60 0x7f9ecc0afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ecb7fe700 1 -- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ecc0c6be0 msgr2=0x7f9ecc0c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ecb7fe700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ecc0c6be0 0x7f9ecc0c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ecb7fe700 1 -- 172.21.15.31:0/786998819 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0c6100 con 0x7f9ecc0c56b0 2023-10-09T06:32:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ecbfff700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9eb8003a60 0x7f9ecc0afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ed0d5d700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ecc0c6be0 0x7f9ecc0c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.278+0000 7f9ecb7fe700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ecc0c56b0 0x7f9ecc15cf00 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0118e0 tx=0x7f9ebc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.279+0000 7f9ec3fff700 1 -- 172.21.15.31:0/786998819 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc011e80 con 0x7f9ecc0c56b0 2023-10-09T06:32:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.279+0000 7f9ec3fff700 1 -- 172.21.15.31:0/786998819 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc00f8e0 con 0x7f9ecc0c56b0 2023-10-09T06:32:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.279+0000 7f9ed155e700 1 -- 172.21.15.31:0/786998819 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc0c63e0 con 0x7f9ecc0c56b0 2023-10-09T06:32:43.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.279+0000 7f9ec3fff700 1 -- 172.21.15.31:0/786998819 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc00fc80 con 0x7f9ecc0c56b0 2023-10-09T06:32:43.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.279+0000 7f9ed155e700 1 -- 172.21.15.31:0/786998819 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc1584c0 con 0x7f9ecc0c56b0 2023-10-09T06:32:43.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.280+0000 7f9ed155e700 1 -- 172.21.15.31:0/786998819 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc089480 con 0x7f9ecc0c56b0 2023-10-09T06:32:43.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.280+0000 7f9ec3fff700 1 -- 172.21.15.31:0/786998819 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ebc015460 con 0x7f9ecc0c56b0 2023-10-09T06:32:43.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.280+0000 7f9ec3fff700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9eac066f30 0x7f9eac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.281+0000 7f9ec3fff700 1 -- 172.21.15.31:0/786998819 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9ebc084a30 con 0x7f9ecc0c56b0 2023-10-09T06:32:43.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.281+0000 7f9ecbfff700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9eac066f30 0x7f9eac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.281+0000 7f9ecbfff700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9eac066f30 0x7f9eac0693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc158160 tx=0x7f9eb4015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.285+0000 7f9ec3fff700 1 -- 172.21.15.31:0/786998819 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ebc052000 con 0x7f9ecc0c56b0 2023-10-09T06:32:43.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.477+0000 7f9ed155e700 1 -- 172.21.15.31:0/786998819 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ecc0b0b70 con 0x7f9eac066f30 2023-10-09T06:32:43.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.477+0000 7f9ec3fff700 1 -- 172.21.15.31:0/786998819 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9ecc0b0b70 con 0x7f9eac066f30 2023-10-09T06:32:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.479+0000 7f9ed155e700 1 -- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9eac066f30 msgr2=0x7f9eac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.479+0000 7f9ed155e700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9eac066f30 0x7f9eac0693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc158160 tx=0x7f9eb4015000 comp rx=0 tx=0).stop 2023-10-09T06:32:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.479+0000 7f9ed155e700 1 -- 172.21.15.31:0/786998819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ecc0c56b0 msgr2=0x7f9ecc15cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.479+0000 7f9ed155e700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ecc0c56b0 0x7f9ecc15cf00 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0118e0 tx=0x7f9ebc008040 comp rx=0 tx=0).stop 2023-10-09T06:32:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.480+0000 7f9ed155e700 1 -- 172.21.15.31:0/786998819 shutdown_connections 2023-10-09T06:32:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.480+0000 7f9ed155e700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9eac066f30 0x7f9eac0693e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.480+0000 7f9ed155e700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f9eb8003a60 0x7f9ecc0afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.480+0000 7f9ed155e700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ecc0c6be0 0x7f9ecc0c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.480+0000 7f9ed155e700 1 --2- 172.21.15.31:0/786998819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ecc0c56b0 0x7f9ecc15cf00 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.480+0000 7f9ed155e700 1 -- 172.21.15.31:0/786998819 >> 172.21.15.31:0/786998819 conn(0x7f9ecc0d0bc0 msgr2=0x7f9ecc0cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.480+0000 7f9ed155e700 1 -- 172.21.15.31:0/786998819 shutdown_connections 2023-10-09T06:32:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.480+0000 7f9ed155e700 1 -- 172.21.15.31:0/786998819 wait complete. 2023-10-09T06:32:43.482 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 1 to deep-scrub 2023-10-09T06:32:43.493 INFO:tasks.ceph:Scrubbing osd.2 2023-10-09T06:32:43.493 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-09T06:32:43.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.616+0000 7f0d6175b700 1 Processor -- start 2023-10-09T06:32:43.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.616+0000 7f0d6175b700 1 -- start start 2023-10-09T06:32:43.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.616+0000 7f0d6175b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0d5c0b11f0 0x7f0d5c0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.616+0000 7f0d6175b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c0b0d60 con 0x7f0d5c159e50 2023-10-09T06:32:43.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.616+0000 7f0d6175b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c0b3540 con 0x7f0d5c068cb0 2023-10-09T06:32:43.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.616+0000 7f0d6175b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c0d15b0 con 0x7f0d5c0b11f0 2023-10-09T06:32:43.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d5affd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0d5c159e50 0x7f0d5c0b2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60840/0 (socket says 172.21.15.31:60840) 2023-10-09T06:32:43.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d5affd700 1 -- 172.21.15.31:0/239524306 learned_addr learned my addr 172.21.15.31:0/239524306 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:43.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d5a7fc700 1 --2- 172.21.15.31:0/239524306 >> v2:172.21.15.158:3300/0 conn(0x7f0d5c0b11f0 0x7f0d5c0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376228530 0 0) 0x7f0d5c0b0d60 con 0x7f0d5c159e50 2023-10-09T06:32:43.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d44003570 con 0x7f0d5c159e50 2023-10-09T06:32:43.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099157179 0 0) 0x7f0d5c0b3540 con 0x7f0d5c068cb0 2023-10-09T06:32:43.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d5c0b0d60 con 0x7f0d5c068cb0 2023-10-09T06:32:43.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1959380626 0 0) 0x7f0d44003570 con 0x7f0d5c159e50 2023-10-09T06:32:43.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 >> v2:172.21.15.158:3300/0 conn(0x7f0d5c0b11f0 msgr2=0x7f0d5c0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:43.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 --2- 172.21.15.31:0/239524306 >> v2:172.21.15.158:3300/0 conn(0x7f0d5c0b11f0 0x7f0d5c0b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 >> v1:172.21.15.158:6789/0 conn(0x7f0d5c068cb0 legacy=0x7f0d5c0690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c0d1890 con 0x7f0d5c159e50 2023-10-09T06:32:43.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f0d4c001470 con 0x7f0d5c159e50 2023-10-09T06:32:43.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 >> v1:172.21.15.31:6789/0 conn(0x7f0d5c159e50 legacy=0x7f0d5c0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 --2- 172.21.15.31:0/239524306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d44003bf0 0x7f0d44003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 --2- 172.21.15.31:0/239524306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d44004810 0x7f0d44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 --2- 172.21.15.31:0/239524306 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d440051c0 0x7f0d4400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0d15b0 con 0x7f0d44003bf0 2023-10-09T06:32:43.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4400c160 con 0x7f0d44004810 2023-10-09T06:32:43.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4400c320 con 0x7f0d440051c0 2023-10-09T06:32:43.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d5affd700 1 --2- 172.21.15.31:0/239524306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d44003bf0 0x7f0d44003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d5a7fc700 1 --2- 172.21.15.31:0/239524306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d44004810 0x7f0d44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.617+0000 7f0d5b7fe700 1 --2- 172.21.15.31:0/239524306 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d440051c0 0x7f0d4400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d5affd700 1 -- 172.21.15.31:0/239524306 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d440051c0 msgr2=0x7f0d4400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:43.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d5affd700 1 --2- 172.21.15.31:0/239524306 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d440051c0 0x7f0d4400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d5affd700 1 -- 172.21.15.31:0/239524306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d44004810 msgr2=0x7f0d44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:43.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d5affd700 1 --2- 172.21.15.31:0/239524306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d44004810 0x7f0d44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d5affd700 1 -- 172.21.15.31:0/239524306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44003570 con 0x7f0d44003bf0 2023-10-09T06:32:43.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d5b7fe700 1 -- 172.21.15.31:0/239524306 reap_dead start 2023-10-09T06:32:43.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d5affd700 1 --2- 172.21.15.31:0/239524306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d44003bf0 0x7f0d44003fe0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c2a0 tx=0x7f0d4c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea561ec3ced249c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00cbd0 con 0x7f0d44003bf0 2023-10-09T06:32:43.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c00cd30 con 0x7f0d44003bf0 2023-10-09T06:32:43.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d59ffb700 1 -- 172.21.15.31:0/239524306 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00cea0 con 0x7f0d44003bf0 2023-10-09T06:32:43.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d6175b700 1 -- 172.21.15.31:0/239524306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d44003bf0 msgr2=0x7f0d44003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d6175b700 1 --2- 172.21.15.31:0/239524306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d44003bf0 0x7f0d44003fe0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c2a0 tx=0x7f0d4c001e10 comp rx=0 tx=0).stop 2023-10-09T06:32:43.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d6175b700 1 -- 172.21.15.31:0/239524306 shutdown_connections 2023-10-09T06:32:43.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d6175b700 1 --2- 172.21.15.31:0/239524306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d44003bf0 0x7f0d44003fe0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d6175b700 1 -- 172.21.15.31:0/239524306 >> 172.21.15.31:0/239524306 conn(0x7f0d5c068130 msgr2=0x7f0d5c0d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:43.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d6175b700 1 -- 172.21.15.31:0/239524306 shutdown_connections 2023-10-09T06:32:43.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.618+0000 7f0d6175b700 1 -- 172.21.15.31:0/239524306 wait complete. 2023-10-09T06:32:43.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.620+0000 7f0d6175b700 1 Processor -- start 2023-10-09T06:32:43.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.620+0000 7f0d6175b700 1 -- start start 2023-10-09T06:32:43.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.620+0000 7f0d6175b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d44003bf0 0x7f0d5c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.620+0000 7f0d6175b700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d5c15f9c0 0x7f0d5c0ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.620+0000 7f0d6175b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d5c147d70 0x7f0d5c1481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.620+0000 7f0d6175b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c15e580 con 0x7f0d5c147d70 2023-10-09T06:32:43.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.620+0000 7f0d6175b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c148720 con 0x7f0d44003bf0 2023-10-09T06:32:43.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.620+0000 7f0d6175b700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0c8460 con 0x7f0d5c15f9c0 2023-10-09T06:32:43.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d5b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d5c147d70 0x7f0d5c1481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d5b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d5c147d70 0x7f0d5c1481e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58434/0 (socket says 172.21.15.31:58434) 2023-10-09T06:32:43.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d5b7fe700 1 -- 172.21.15.31:0/3405485040 learned_addr learned my addr 172.21.15.31:0/3405485040 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:43.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d5a7fc700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d5c15f9c0 0x7f0d5c0ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d5affd700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d44003bf0 0x7f0d5c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d5b7fe700 1 -- 172.21.15.31:0/3405485040 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d5c15f9c0 msgr2=0x7f0d5c0ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d5b7fe700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f0d5c15f9c0 0x7f0d5c0ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d5b7fe700 1 -- 172.21.15.31:0/3405485040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d44003bf0 msgr2=0x7f0d5c15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d5b7fe700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d44003bf0 0x7f0d5c15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d5b7fe700 1 -- 172.21.15.31:0/3405485040 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c15dce0 con 0x7f0d5c147d70 2023-10-09T06:32:43.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d5b7fe700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d5c147d70 0x7f0d5c1481e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0777e0 tx=0x7f0d54009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d42ffd700 1 -- 172.21.15.31:0/3405485040 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540032e0 con 0x7f0d5c147d70 2023-10-09T06:32:43.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d42ffd700 1 -- 172.21.15.31:0/3405485040 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d54003460 con 0x7f0d5c147d70 2023-10-09T06:32:43.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d6175b700 1 -- 172.21.15.31:0/3405485040 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c15dfc0 con 0x7f0d5c147d70 2023-10-09T06:32:43.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d42ffd700 1 -- 172.21.15.31:0/3405485040 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54001970 con 0x7f0d5c147d70 2023-10-09T06:32:43.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.621+0000 7f0d6175b700 1 -- 172.21.15.31:0/3405485040 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c15d970 con 0x7f0d5c147d70 2023-10-09T06:32:43.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.622+0000 7f0d6175b700 1 -- 172.21.15.31:0/3405485040 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d5c0c8230 con 0x7f0d5c147d70 2023-10-09T06:32:43.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.623+0000 7f0d42ffd700 1 -- 172.21.15.31:0/3405485040 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d54001d20 con 0x7f0d5c147d70 2023-10-09T06:32:43.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.623+0000 7f0d42ffd700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d48066f30 0x7f0d480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.623+0000 7f0d42ffd700 1 -- 172.21.15.31:0/3405485040 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0d54084280 con 0x7f0d5c147d70 2023-10-09T06:32:43.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.623+0000 7f0d42ffd700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] conn(0x7f0d4806cd80 0x7f0d4806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.623+0000 7f0d42ffd700 1 -- 172.21.15.31:0/3405485040 --> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d4806f860 con 0x7f0d4806cd80 2023-10-09T06:32:43.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.623+0000 7f0d42ffd700 1 -- 172.21.15.31:0/3405485040 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d540868c0 con 0x7f0d5c147d70 2023-10-09T06:32:43.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.623+0000 7f0d5affd700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d48066f30 0x7f0d480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.623+0000 7f0d5a7fc700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] conn(0x7f0d4806cd80 0x7f0d4806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.624+0000 7f0d5a7fc700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] conn(0x7f0d4806cd80 0x7f0d4806f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.624+0000 7f0d5affd700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d48066f30 0x7f0d480693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c001ed0 tx=0x7f0d4c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.624+0000 7f0d42ffd700 1 -- 172.21.15.31:0/3405485040 <== osd.2 v2:172.21.15.31:6819/86376 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f0d4806f860 con 0x7f0d4806cd80 2023-10-09T06:32:43.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.637+0000 7f0d6175b700 1 -- 172.21.15.31:0/3405485040 --> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0d5c04c3c0 con 0x7f0d4806cd80 2023-10-09T06:32:43.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.637+0000 7f0d42ffd700 1 -- 172.21.15.31:0/3405485040 <== osd.2 v2:172.21.15.31:6819/86376 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f0d5c04c3c0 con 0x7f0d4806cd80 2023-10-09T06:32:43.638 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:43.638 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T06:32:43.638 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:43.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.637+0000 7f0d6175b700 1 -- 172.21.15.31:0/3405485040 >> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] conn(0x7f0d4806cd80 msgr2=0x7f0d4806f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.637+0000 7f0d6175b700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.31:6819/86376,v1:172.21.15.31:6821/86376] conn(0x7f0d4806cd80 0x7f0d4806f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.638+0000 7f0d6175b700 1 -- 172.21.15.31:0/3405485040 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d48066f30 msgr2=0x7f0d480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.638+0000 7f0d6175b700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f0d48066f30 0x7f0d480693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c001ed0 tx=0x7f0d4c015000 comp rx=0 tx=0).stop 2023-10-09T06:32:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.638+0000 7f0d6175b700 1 -- 172.21.15.31:0/3405485040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d5c147d70 msgr2=0x7f0d5c1481e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.638+0000 7f0d6175b700 1 --2- 172.21.15.31:0/3405485040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d5c147d70 0x7f0d5c1481e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0777e0 tx=0x7f0d54009040 comp rx=0 tx=0).stop 2023-10-09T06:32:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.638+0000 7f0d5b7fe700 1 -- 172.21.15.31:0/3405485040 reap_dead start 2023-10-09T06:32:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.638+0000 7f0d6175b700 1 -- 172.21.15.31:0/3405485040 shutdown_connections 2023-10-09T06:32:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.638+0000 7f0d6175b700 1 -- 172.21.15.31:0/3405485040 >> 172.21.15.31:0/3405485040 conn(0x7f0d5c068130 msgr2=0x7f0d5c1591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.638+0000 7f0d6175b700 1 -- 172.21.15.31:0/3405485040 shutdown_connections 2023-10-09T06:32:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.638+0000 7f0d6175b700 1 -- 172.21.15.31:0/3405485040 wait complete. 2023-10-09T06:32:43.650 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-09T06:32:43.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.769+0000 7efed9327700 1 Processor -- start 2023-10-09T06:32:43.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.769+0000 7efed9327700 1 -- start start 2023-10-09T06:32:43.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.770+0000 7efed9327700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efed406a4d0 0x7efed40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.770+0000 7efed9327700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efed4159fe0 0x7efed40afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.770+0000 7efed9327700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed40cef50 con 0x7efed406a8a0 2023-10-09T06:32:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.770+0000 7efed9327700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed40d1600 con 0x7efed4159fe0 2023-10-09T06:32:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.770+0000 7efed9327700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed40b0900 con 0x7efed406a4d0 2023-10-09T06:32:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.770+0000 7efed27fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efed406a8a0 0x7efed41598d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60842/0 (socket says 172.21.15.31:60842) 2023-10-09T06:32:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.770+0000 7efed27fc700 1 -- 172.21.15.31:0/2750687172 learned_addr learned my addr 172.21.15.31:0/2750687172 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.770+0000 7efed2ffd700 1 --2- 172.21.15.31:0/2750687172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efed406a4d0 0x7efed40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.770+0000 7efed37fe700 1 --2- 172.21.15.31:0/2750687172 >> v2:172.21.15.158:3300/0 conn(0x7efed4159fe0 0x7efed40afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.770+0000 7efed1ffb700 1 -- 172.21.15.31:0/2750687172 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500422783 0 0) 0x7efed40cef50 con 0x7efed406a8a0 2023-10-09T06:32:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.770+0000 7efed1ffb700 1 -- 172.21.15.31:0/2750687172 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec0003570 con 0x7efed406a8a0 2023-10-09T06:32:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.771+0000 7efed2ffd700 1 -- 172.21.15.31:0/2750687172 >> v2:172.21.15.158:3300/0 conn(0x7efed4159fe0 msgr2=0x7efed40afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.771+0000 7efed2ffd700 1 --2- 172.21.15.31:0/2750687172 >> v2:172.21.15.158:3300/0 conn(0x7efed4159fe0 0x7efed40afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.771+0000 7efed2ffd700 1 -- 172.21.15.31:0/2750687172 >> v1:172.21.15.31:6789/0 conn(0x7efed406a8a0 legacy=0x7efed41598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.771+0000 7efed2ffd700 1 -- 172.21.15.31:0/2750687172 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed40b0310 con 0x7efed406a4d0 2023-10-09T06:32:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.771+0000 7efed2ffd700 1 --2- 172.21.15.31:0/2750687172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efed406a4d0 0x7efed40af730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efecc0098e0 tx=0x7efecc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c270e40af956e41e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.771+0000 7efed1ffb700 1 -- 172.21.15.31:0/2750687172 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc011630 con 0x7efed406a4d0 2023-10-09T06:32:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.771+0000 7efed1ffb700 1 -- 172.21.15.31:0/2750687172 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc011790 con 0x7efed406a4d0 2023-10-09T06:32:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.771+0000 7efed1ffb700 1 -- 172.21.15.31:0/2750687172 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc011b30 con 0x7efed406a4d0 2023-10-09T06:32:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.771+0000 7efed9327700 1 -- 172.21.15.31:0/2750687172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efed406a4d0 msgr2=0x7efed40af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.771+0000 7efed9327700 1 --2- 172.21.15.31:0/2750687172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efed406a4d0 0x7efed40af730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efecc0098e0 tx=0x7efecc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.772+0000 7efed9327700 1 -- 172.21.15.31:0/2750687172 shutdown_connections 2023-10-09T06:32:43.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.772+0000 7efed9327700 1 --2- 172.21.15.31:0/2750687172 >> v2:172.21.15.158:3300/0 conn(0x7efed4159fe0 0x7efed40afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.772+0000 7efed9327700 1 --2- 172.21.15.31:0/2750687172 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efed406a4d0 0x7efed40af730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.772+0000 7efed9327700 1 -- 172.21.15.31:0/2750687172 >> 172.21.15.31:0/2750687172 conn(0x7efed40695e0 msgr2=0x7efed40d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:43.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.772+0000 7efed9327700 1 -- 172.21.15.31:0/2750687172 shutdown_connections 2023-10-09T06:32:43.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.772+0000 7efed9327700 1 -- 172.21.15.31:0/2750687172 wait complete. 2023-10-09T06:32:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.773+0000 7efed9327700 1 Processor -- start 2023-10-09T06:32:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.773+0000 7efed9327700 1 -- start start 2023-10-09T06:32:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed9327700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efed406a4d0 0x7efed4155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed9327700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efed406a8a0 0x7efed415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed9327700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efed4159fe0 0x7efed40b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed9327700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed4155880 con 0x7efed4159fe0 2023-10-09T06:32:43.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed9327700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed40c8fd0 con 0x7efed406a8a0 2023-10-09T06:32:43.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed9327700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed40c92b0 con 0x7efed406a4d0 2023-10-09T06:32:43.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efed4159fe0 0x7efed40b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efed4159fe0 0x7efed40b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58450/0 (socket says 172.21.15.31:58450) 2023-10-09T06:32:43.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed37fe700 1 -- 172.21.15.31:0/1266991343 learned_addr learned my addr 172.21.15.31:0/1266991343 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:43.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed2ffd700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efed406a4d0 0x7efed4155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed27fc700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efed406a8a0 0x7efed415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed37fe700 1 -- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efed406a4d0 msgr2=0x7efed4155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed37fe700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efed406a4d0 0x7efed4155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed37fe700 1 -- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efed406a8a0 msgr2=0x7efed415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed37fe700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efed406a8a0 0x7efed415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed37fe700 1 -- 172.21.15.31:0/1266991343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc009420 con 0x7efed4159fe0 2023-10-09T06:32:43.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed27fc700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efed406a8a0 0x7efed415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:43.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed37fe700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efed4159fe0 0x7efed40b1bf0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7efec4009df0 tx=0x7efec400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efecaffd700 1 -- 172.21.15.31:0/1266991343 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec400cb50 con 0x7efed4159fe0 2023-10-09T06:32:43.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efecaffd700 1 -- 172.21.15.31:0/1266991343 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec400f040 con 0x7efed4159fe0 2023-10-09T06:32:43.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed9327700 1 -- 172.21.15.31:0/1266991343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed40c9590 con 0x7efed4159fe0 2023-10-09T06:32:43.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efecaffd700 1 -- 172.21.15.31:0/1266991343 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4014480 con 0x7efed4159fe0 2023-10-09T06:32:43.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.774+0000 7efed9327700 1 -- 172.21.15.31:0/1266991343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed40c9b50 con 0x7efed4159fe0 2023-10-09T06:32:43.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.775+0000 7efed9327700 1 -- 172.21.15.31:0/1266991343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed40c9d70 con 0x7efed4159fe0 2023-10-09T06:32:43.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.776+0000 7efecaffd700 1 -- 172.21.15.31:0/1266991343 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efec4014830 con 0x7efed4159fe0 2023-10-09T06:32:43.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.776+0000 7efecaffd700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efeb4066f30 0x7efeb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:43.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.776+0000 7efecaffd700 1 -- 172.21.15.31:0/1266991343 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efec4084b40 con 0x7efed4159fe0 2023-10-09T06:32:43.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.776+0000 7efed2ffd700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efeb4066f30 0x7efeb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:43.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.777+0000 7efed2ffd700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efeb4066f30 0x7efeb40693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7efecc0091e0 tx=0x7efecc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:43.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.780+0000 7efecaffd700 1 -- 172.21.15.31:0/1266991343 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efec40520b0 con 0x7efed4159fe0 2023-10-09T06:32:43.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.978+0000 7efed9327700 1 -- 172.21.15.31:0/1266991343 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7efed415bf30 con 0x7efeb4066f30 2023-10-09T06:32:43.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.979+0000 7efecaffd700 1 -- 172.21.15.31:0/1266991343 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efed415bf30 con 0x7efeb4066f30 2023-10-09T06:32:43.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.980+0000 7efed9327700 1 -- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efeb4066f30 msgr2=0x7efeb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.980+0000 7efed9327700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efeb4066f30 0x7efeb40693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7efecc0091e0 tx=0x7efecc017000 comp rx=0 tx=0).stop 2023-10-09T06:32:43.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.980+0000 7efed9327700 1 -- 172.21.15.31:0/1266991343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efed4159fe0 msgr2=0x7efed40b1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.980+0000 7efed9327700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efed4159fe0 0x7efed40b1bf0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7efec4009df0 tx=0x7efec400b040 comp rx=0 tx=0).stop 2023-10-09T06:32:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.980+0000 7efed9327700 1 -- 172.21.15.31:0/1266991343 shutdown_connections 2023-10-09T06:32:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.980+0000 7efed9327700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7efeb4066f30 0x7efeb40693e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.980+0000 7efed9327700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7efed406a4d0 0x7efed4155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.980+0000 7efed9327700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efed4159fe0 0x7efed40b1bf0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.980+0000 7efed9327700 1 --2- 172.21.15.31:0/1266991343 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efed406a8a0 0x7efed415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.980+0000 7efed9327700 1 -- 172.21.15.31:0/1266991343 >> 172.21.15.31:0/1266991343 conn(0x7efed40695e0 msgr2=0x7efed40c6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:43.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.980+0000 7efed9327700 1 -- 172.21.15.31:0/1266991343 shutdown_connections 2023-10-09T06:32:43.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:43.980+0000 7efed9327700 1 -- 172.21.15.31:0/1266991343 wait complete. 2023-10-09T06:32:43.983 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 2 to deep-scrub 2023-10-09T06:32:43.993 INFO:tasks.ceph:Scrubbing osd.3 2023-10-09T06:32:43.993 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-09T06:32:44.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.115+0000 7fcf147df700 1 Processor -- start 2023-10-09T06:32:44.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.115+0000 7fcf147df700 1 -- start start 2023-10-09T06:32:44.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.116+0000 7fcf147df700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf0c159e50 0x7fcf0c0b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.116+0000 7fcf147df700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcf0c0b3370 0x7fcf0c0b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.116+0000 7fcf147df700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0c0b0d60 con 0x7fcf0c0b1730 2023-10-09T06:32:44.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.116+0000 7fcf147df700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c0d15b0 con 0x7fcf0c159e50 2023-10-09T06:32:44.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.116+0000 7fcf147df700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c0d1890 con 0x7fcf0c0b3370 2023-10-09T06:32:44.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.116+0000 7fcf1257b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf0c159e50 0x7fcf0c0b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.116+0000 7fcf1257b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf0c159e50 0x7fcf0c0b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58454/0 (socket says 172.21.15.31:58454) 2023-10-09T06:32:44.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.116+0000 7fcf1257b700 1 -- 172.21.15.31:0/2178573607 learned_addr learned my addr 172.21.15.31:0/2178573607 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:44.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.117+0000 7fcf11d7a700 1 --2- 172.21.15.31:0/2178573607 >> v2:172.21.15.158:3300/0 conn(0x7fcf0c0b3370 0x7fcf0c0b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.117+0000 7fcf1257b700 1 -- 172.21.15.31:0/2178573607 >> v2:172.21.15.158:3300/0 conn(0x7fcf0c0b3370 msgr2=0x7fcf0c0b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:44.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.117+0000 7fcf1257b700 1 --2- 172.21.15.31:0/2178573607 >> v2:172.21.15.158:3300/0 conn(0x7fcf0c0b3370 0x7fcf0c0b11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.117+0000 7fcf1257b700 1 -- 172.21.15.31:0/2178573607 >> v1:172.21.15.158:6789/0 conn(0x7fcf0c0b1730 legacy=0x7fcf0c068cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.117+0000 7fcf1257b700 1 -- 172.21.15.31:0/2178573607 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c0b09f0 con 0x7fcf0c159e50 2023-10-09T06:32:44.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.117+0000 7fcf1257b700 1 --2- 172.21.15.31:0/2178573607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf0c159e50 0x7fcf0c0b2e30 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0cb2a0 tx=0x7fcf04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3fa86749941168 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.117+0000 7fcf11579700 1 -- 172.21.15.31:0/2178573607 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04009e70 con 0x7fcf0c159e50 2023-10-09T06:32:44.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.117+0000 7fcf11579700 1 -- 172.21.15.31:0/2178573607 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0400b860 con 0x7fcf0c159e50 2023-10-09T06:32:44.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.117+0000 7fcf11579700 1 -- 172.21.15.31:0/2178573607 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0400bc00 con 0x7fcf0c159e50 2023-10-09T06:32:44.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.118+0000 7fcf147df700 1 -- 172.21.15.31:0/2178573607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf0c159e50 msgr2=0x7fcf0c0b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.118+0000 7fcf147df700 1 --2- 172.21.15.31:0/2178573607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf0c159e50 0x7fcf0c0b2e30 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0cb2a0 tx=0x7fcf04009250 comp rx=0 tx=0).stop 2023-10-09T06:32:44.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.118+0000 7fcf147df700 1 -- 172.21.15.31:0/2178573607 shutdown_connections 2023-10-09T06:32:44.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.118+0000 7fcf147df700 1 --2- 172.21.15.31:0/2178573607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf0c159e50 0x7fcf0c0b2e30 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.118+0000 7fcf147df700 1 --2- 172.21.15.31:0/2178573607 >> v2:172.21.15.158:3300/0 conn(0x7fcf0c0b3370 0x7fcf0c0b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.118+0000 7fcf147df700 1 -- 172.21.15.31:0/2178573607 >> 172.21.15.31:0/2178573607 conn(0x7fcf0c068130 msgr2=0x7fcf0c0d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:44.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.118+0000 7fcf147df700 1 -- 172.21.15.31:0/2178573607 shutdown_connections 2023-10-09T06:32:44.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.118+0000 7fcf147df700 1 -- 172.21.15.31:0/2178573607 wait complete. 2023-10-09T06:32:44.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.119+0000 7fcf147df700 1 Processor -- start 2023-10-09T06:32:44.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.119+0000 7fcf147df700 1 -- start start 2023-10-09T06:32:44.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf147df700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf0c0b1730 0x7fcf0c15da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf147df700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf0c0b3370 0x7fcf0c157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf147df700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf0c159e50 0x7fcf0c1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf147df700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c0c7820 con 0x7fcf0c159e50 2023-10-09T06:32:44.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf147df700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c16b470 con 0x7fcf0c0b3370 2023-10-09T06:32:44.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf147df700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c16b190 con 0x7fcf0c0b1730 2023-10-09T06:32:44.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf12d7c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf0c159e50 0x7fcf0c1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf12d7c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf0c159e50 0x7fcf0c1581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58464/0 (socket says 172.21.15.31:58464) 2023-10-09T06:32:44.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf12d7c700 1 -- 172.21.15.31:0/3574177693 learned_addr learned my addr 172.21.15.31:0/3574177693 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:44.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf11d7a700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf0c0b3370 0x7fcf0c157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf1257b700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf0c0b1730 0x7fcf0c15da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf12d7c700 1 -- 172.21.15.31:0/3574177693 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf0c0b1730 msgr2=0x7fcf0c15da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf12d7c700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf0c0b1730 0x7fcf0c15da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf12d7c700 1 -- 172.21.15.31:0/3574177693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf0c0b3370 msgr2=0x7fcf0c157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf12d7c700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf0c0b3370 0x7fcf0c157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf12d7c700 1 -- 172.21.15.31:0/3574177693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf040094f0 con 0x7fcf0c159e50 2023-10-09T06:32:44.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf1257b700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fcf0c0b1730 0x7fcf0c15da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:44.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf12d7c700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf0c159e50 0x7fcf0c1581b0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00c8e0 tx=0x7fcefc001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf0a7fc700 1 -- 172.21.15.31:0/3574177693 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc012630 con 0x7fcf0c159e50 2023-10-09T06:32:44.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf0a7fc700 1 -- 172.21.15.31:0/3574177693 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc012790 con 0x7fcf0c159e50 2023-10-09T06:32:44.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf147df700 1 -- 172.21.15.31:0/3574177693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c16dc70 con 0x7fcf0c159e50 2023-10-09T06:32:44.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.120+0000 7fcf0a7fc700 1 -- 172.21.15.31:0/3574177693 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc012b50 con 0x7fcf0c159e50 2023-10-09T06:32:44.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.121+0000 7fcf147df700 1 -- 172.21.15.31:0/3574177693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0c16e230 con 0x7fcf0c159e50 2023-10-09T06:32:44.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.121+0000 7fcf147df700 1 -- 172.21.15.31:0/3574177693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf0c04c3c0 con 0x7fcf0c159e50 2023-10-09T06:32:44.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.122+0000 7fcf0a7fc700 1 -- 172.21.15.31:0/3574177693 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcefc024430 con 0x7fcf0c159e50 2023-10-09T06:32:44.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.122+0000 7fcf0a7fc700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcef8066f30 0x7fcef80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.122+0000 7fcf0a7fc700 1 -- 172.21.15.31:0/3574177693 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcefc084d20 con 0x7fcf0c159e50 2023-10-09T06:32:44.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.122+0000 7fcf0a7fc700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] conn(0x7fcef806cd80 0x7fcef806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.122+0000 7fcf0a7fc700 1 -- 172.21.15.31:0/3574177693 --> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcef806f860 con 0x7fcef806cd80 2023-10-09T06:32:44.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.122+0000 7fcf0a7fc700 1 -- 172.21.15.31:0/3574177693 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcefc085010 con 0x7fcf0c159e50 2023-10-09T06:32:44.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.122+0000 7fcf1257b700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcef8066f30 0x7fcef80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.123+0000 7fcf11d7a700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] conn(0x7fcef806cd80 0x7fcef806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.123+0000 7fcf11d7a700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] conn(0x7fcef806cd80 0x7fcef806f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.123+0000 7fcf1257b700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcef8066f30 0x7fcef80693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0cb2a0 tx=0x7fcf04017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.123+0000 7fcf0a7fc700 1 -- 172.21.15.31:0/3574177693 <== osd.3 v2:172.21.15.31:6808/86353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fcef806f860 con 0x7fcef806cd80 2023-10-09T06:32:44.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.136+0000 7fcf147df700 1 -- 172.21.15.31:0/3574177693 --> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcf0c063ac0 con 0x7fcef806cd80 2023-10-09T06:32:44.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.136+0000 7fcf0a7fc700 1 -- 172.21.15.31:0/3574177693 <== osd.3 v2:172.21.15.31:6808/86353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7fcf0c063ac0 con 0x7fcef806cd80 2023-10-09T06:32:44.137 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T06:32:44.137 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:44.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.137+0000 7fcf147df700 1 -- 172.21.15.31:0/3574177693 >> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] conn(0x7fcef806cd80 msgr2=0x7fcef806f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.137+0000 7fcf147df700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.31:6808/86353,v1:172.21.15.31:6809/86353] conn(0x7fcef806cd80 0x7fcef806f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.137+0000 7fcf147df700 1 -- 172.21.15.31:0/3574177693 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcef8066f30 msgr2=0x7fcef80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.137+0000 7fcf147df700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fcef8066f30 0x7fcef80693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0cb2a0 tx=0x7fcf04017000 comp rx=0 tx=0).stop 2023-10-09T06:32:44.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.137+0000 7fcf147df700 1 -- 172.21.15.31:0/3574177693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf0c159e50 msgr2=0x7fcf0c1581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.137+0000 7fcf147df700 1 --2- 172.21.15.31:0/3574177693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf0c159e50 0x7fcf0c1581b0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00c8e0 tx=0x7fcefc001710 comp rx=0 tx=0).stop 2023-10-09T06:32:44.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.137+0000 7fcf12d7c700 1 -- 172.21.15.31:0/3574177693 reap_dead start 2023-10-09T06:32:44.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.137+0000 7fcf147df700 1 -- 172.21.15.31:0/3574177693 shutdown_connections 2023-10-09T06:32:44.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.137+0000 7fcf147df700 1 -- 172.21.15.31:0/3574177693 >> 172.21.15.31:0/3574177693 conn(0x7fcf0c068130 msgr2=0x7fcf0c0cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:44.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.137+0000 7fcf147df700 1 -- 172.21.15.31:0/3574177693 shutdown_connections 2023-10-09T06:32:44.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.137+0000 7fcf147df700 1 -- 172.21.15.31:0/3574177693 wait complete. 2023-10-09T06:32:44.149 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-09T06:32:44.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.268+0000 7f68de875700 1 Processor -- start 2023-10-09T06:32:44.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.268+0000 7f68de875700 1 -- start start 2023-10-09T06:32:44.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.269+0000 7f68de875700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68d81575f0 0x7f68d80cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.269+0000 7f68de875700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f68d81579c0 0x7f68d815ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.269+0000 7f68de875700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d80d0540 con 0x7f68d80d0a50 2023-10-09T06:32:44.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.269+0000 7f68de875700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d80697b0 con 0x7f68d81575f0 2023-10-09T06:32:44.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.269+0000 7f68de875700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d815b240 con 0x7f68d81579c0 2023-10-09T06:32:44.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.269+0000 7f68dd873700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68d81575f0 0x7f68d80cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.269+0000 7f68de074700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f68d80d0a50 0x7f68d80d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60852/0 (socket says 172.21.15.31:60852) 2023-10-09T06:32:44.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.269+0000 7f68de074700 1 -- 172.21.15.31:0/4212798790 learned_addr learned my addr 172.21.15.31:0/4212798790 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:44.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.269+0000 7f68dd072700 1 --2- 172.21.15.31:0/4212798790 >> v2:172.21.15.158:3300/0 conn(0x7f68d81579c0 0x7f68d815ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.269+0000 7f68dd873700 1 -- 172.21.15.31:0/4212798790 >> v2:172.21.15.158:3300/0 conn(0x7f68d81579c0 msgr2=0x7f68d815ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:44.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.269+0000 7f68dd873700 1 --2- 172.21.15.31:0/4212798790 >> v2:172.21.15.158:3300/0 conn(0x7f68d81579c0 0x7f68d815ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68dd873700 1 -- 172.21.15.31:0/4212798790 >> v1:172.21.15.31:6789/0 conn(0x7f68d80d0a50 legacy=0x7f68d80d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.269+0000 7f68dc871700 1 -- 172.21.15.31:0/4212798790 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919696352 0 0) 0x7f68d80d0540 con 0x7f68d80d0a50 2023-10-09T06:32:44.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68dd873700 1 -- 172.21.15.31:0/4212798790 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d80cf930 con 0x7f68d81575f0 2023-10-09T06:32:44.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68dd873700 1 --2- 172.21.15.31:0/4212798790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d81575f0 0x7f68d80cf270 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f68d80cf030 tx=0x7f68d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8ce9989249499 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68dc871700 1 -- 172.21.15.31:0/4212798790 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0011630 con 0x7f68d81575f0 2023-10-09T06:32:44.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68dc871700 1 -- 172.21.15.31:0/4212798790 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d0011790 con 0x7f68d81575f0 2023-10-09T06:32:44.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68dc871700 1 -- 172.21.15.31:0/4212798790 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0011b30 con 0x7f68d81575f0 2023-10-09T06:32:44.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68de875700 1 -- 172.21.15.31:0/4212798790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d81575f0 msgr2=0x7f68d80cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68de875700 1 --2- 172.21.15.31:0/4212798790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d81575f0 0x7f68d80cf270 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f68d80cf030 tx=0x7f68d00091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68de875700 1 -- 172.21.15.31:0/4212798790 shutdown_connections 2023-10-09T06:32:44.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68de875700 1 --2- 172.21.15.31:0/4212798790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d81575f0 0x7f68d80cf270 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68de875700 1 --2- 172.21.15.31:0/4212798790 >> v2:172.21.15.158:3300/0 conn(0x7f68d81579c0 0x7f68d815ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68de875700 1 -- 172.21.15.31:0/4212798790 >> 172.21.15.31:0/4212798790 conn(0x7f68d8068130 msgr2=0x7f68d8068ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:44.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68de875700 1 -- 172.21.15.31:0/4212798790 shutdown_connections 2023-10-09T06:32:44.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.270+0000 7f68de875700 1 -- 172.21.15.31:0/4212798790 wait complete. 2023-10-09T06:32:44.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.271+0000 7f68de875700 1 Processor -- start 2023-10-09T06:32:44.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.272+0000 7f68de875700 1 -- start start 2023-10-09T06:32:44.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.272+0000 7f68de875700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d80d0a50 0x7f68d813c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.272+0000 7f68de875700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68d81575f0 0x7f68d8150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.272+0000 7f68de875700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68d81579c0 0x7f68d8153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.272+0000 7f68de875700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d814fb70 con 0x7f68d80d0a50 2023-10-09T06:32:44.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.272+0000 7f68de875700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d816b0d0 con 0x7f68d81575f0 2023-10-09T06:32:44.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.272+0000 7f68de875700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d814f520 con 0x7f68d81579c0 2023-10-09T06:32:44.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.272+0000 7f68dd873700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d80d0a50 0x7f68d813c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.272+0000 7f68dd873700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d80d0a50 0x7f68d813c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58494/0 (socket says 172.21.15.31:58494) 2023-10-09T06:32:44.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.272+0000 7f68dd873700 1 -- 172.21.15.31:0/34259989 learned_addr learned my addr 172.21.15.31:0/34259989 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:44.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.272+0000 7f68dd072700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68d81575f0 0x7f68d8150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.272+0000 7f68de074700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68d81579c0 0x7f68d8153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.273+0000 7f68dd873700 1 -- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68d81579c0 msgr2=0x7f68d8153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.273+0000 7f68dd873700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68d81579c0 0x7f68d8153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.273+0000 7f68dd873700 1 -- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68d81575f0 msgr2=0x7f68d8150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.273+0000 7f68dd873700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68d81575f0 0x7f68d8150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.273+0000 7f68dd873700 1 -- 172.21.15.31:0/34259989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d0009420 con 0x7f68d80d0a50 2023-10-09T06:32:44.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.273+0000 7f68dd873700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d80d0a50 0x7f68d813c650 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f68d8064200 tx=0x7f68d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.273+0000 7f68d5ffb700 1 -- 172.21.15.31:0/34259989 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0000d10 con 0x7f68d80d0a50 2023-10-09T06:32:44.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.273+0000 7f68d5ffb700 1 -- 172.21.15.31:0/34259989 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d0011b10 con 0x7f68d80d0a50 2023-10-09T06:32:44.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.273+0000 7f68d5ffb700 1 -- 172.21.15.31:0/34259989 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0025640 con 0x7f68d80d0a50 2023-10-09T06:32:44.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.273+0000 7f68de875700 1 -- 172.21.15.31:0/34259989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d814f800 con 0x7f68d80d0a50 2023-10-09T06:32:44.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.273+0000 7f68de875700 1 -- 172.21.15.31:0/34259989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d8150540 con 0x7f68d80d0a50 2023-10-09T06:32:44.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.274+0000 7f68de875700 1 -- 172.21.15.31:0/34259989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d814fe50 con 0x7f68d80d0a50 2023-10-09T06:32:44.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.275+0000 7f68d5ffb700 1 -- 172.21.15.31:0/34259989 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68d0025a30 con 0x7f68d80d0a50 2023-10-09T06:32:44.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.275+0000 7f68d5ffb700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68c4066f30 0x7f68c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.275+0000 7f68d5ffb700 1 -- 172.21.15.31:0/34259989 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f68d0085a60 con 0x7f68d80d0a50 2023-10-09T06:32:44.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.275+0000 7f68dd072700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68c4066f30 0x7f68c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.276+0000 7f68dd072700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68c4066f30 0x7f68c40693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f68d8154f50 tx=0x7f68cc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.280+0000 7f68d5ffb700 1 -- 172.21.15.31:0/34259989 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68d0052fd0 con 0x7f68d80d0a50 2023-10-09T06:32:44.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.471+0000 7f68de875700 1 -- 172.21.15.31:0/34259989 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f68d814fcb0 con 0x7f68c4066f30 2023-10-09T06:32:44.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.471+0000 7f68d5ffb700 1 -- 172.21.15.31:0/34259989 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f68cc009e50 con 0x7f68c4066f30 2023-10-09T06:32:44.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.473+0000 7f68de875700 1 -- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68c4066f30 msgr2=0x7f68c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.473+0000 7f68de875700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68c4066f30 0x7f68c40693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f68d8154f50 tx=0x7f68cc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.473+0000 7f68de875700 1 -- 172.21.15.31:0/34259989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d80d0a50 msgr2=0x7f68d813c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.473+0000 7f68de875700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d80d0a50 0x7f68d813c650 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f68d8064200 tx=0x7f68d0017000 comp rx=0 tx=0).stop 2023-10-09T06:32:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.473+0000 7f68de875700 1 -- 172.21.15.31:0/34259989 shutdown_connections 2023-10-09T06:32:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.473+0000 7f68de875700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f68c4066f30 0x7f68c40693e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.473+0000 7f68de875700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f68d81579c0 0x7f68d8153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.473+0000 7f68de875700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68d80d0a50 0x7f68d813c650 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.473+0000 7f68de875700 1 --2- 172.21.15.31:0/34259989 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f68d81575f0 0x7f68d8150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.473+0000 7f68de875700 1 -- 172.21.15.31:0/34259989 >> 172.21.15.31:0/34259989 conn(0x7f68d8068130 msgr2=0x7f68d8155320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.473+0000 7f68de875700 1 -- 172.21.15.31:0/34259989 shutdown_connections 2023-10-09T06:32:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.473+0000 7f68de875700 1 -- 172.21.15.31:0/34259989 wait complete. 2023-10-09T06:32:44.476 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 3 to deep-scrub 2023-10-09T06:32:44.486 INFO:tasks.ceph:Scrubbing osd.4 2023-10-09T06:32:44.486 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-09T06:32:44.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.608+0000 7f68646ce700 1 Processor -- start 2023-10-09T06:32:44.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.608+0000 7f68646ce700 1 -- start start 2023-10-09T06:32:44.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.609+0000 7f68646ce700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f685c157960 0x7f685c15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.609+0000 7f68646ce700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c0cfda0 con 0x7f685c0cd7d0 2023-10-09T06:32:44.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.609+0000 7f68646ce700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c0ce050 con 0x7f685c06a5c0 2023-10-09T06:32:44.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.609+0000 7f68646ce700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0d0940 con 0x7f685c157960 2023-10-09T06:32:44.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861c69700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f685c0cd7d0 0x7f685c0d0230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60856/0 (socket says 172.21.15.31:60856) 2023-10-09T06:32:44.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861c69700 1 -- 172.21.15.31:0/2716359398 learned_addr learned my addr 172.21.15.31:0/2716359398 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:44.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f686246a700 1 --2- 172.21.15.31:0/2716359398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f685c157960 0x7f685c15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513681331 0 0) 0x7f685c0cfda0 con 0x7f685c0cd7d0 2023-10-09T06:32:44.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6848003570 con 0x7f685c0cd7d0 2023-10-09T06:32:44.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1928018040 0 0) 0x7f6848003570 con 0x7f685c0cd7d0 2023-10-09T06:32:44.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f685c157960 msgr2=0x7f685c15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:44.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 --2- 172.21.15.31:0/2716359398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f685c157960 0x7f685c15ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 >> v1:172.21.15.158:6789/0 conn(0x7f685c06a5c0 legacy=0x7f685c15b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c0cf4b0 con 0x7f685c0cd7d0 2023-10-09T06:32:44.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f684c001470 con 0x7f685c0cd7d0 2023-10-09T06:32:44.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 >> v1:172.21.15.31:6789/0 conn(0x7f685c0cd7d0 legacy=0x7f685c0d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 --2- 172.21.15.31:0/2716359398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6848003a90 0x7f6848003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 --2- 172.21.15.31:0/2716359398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f685c157960 0x7f6848004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 --2- 172.21.15.31:0/2716359398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6848004d50 0x7f68480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0d0940 con 0x7f6848003a90 2023-10-09T06:32:44.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684800bbf0 con 0x7f6848004d50 2023-10-09T06:32:44.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684800bd80 con 0x7f685c157960 2023-10-09T06:32:44.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f686246a700 1 --2- 172.21.15.31:0/2716359398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6848003a90 0x7f6848003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6861c69700 1 --2- 172.21.15.31:0/2716359398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f685c157960 0x7f6848004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.610+0000 7f6862c6b700 1 --2- 172.21.15.31:0/2716359398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6848004d50 0x7f68480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.611+0000 7f686246a700 1 -- 172.21.15.31:0/2716359398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f685c157960 msgr2=0x7f6848004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:44.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.611+0000 7f686246a700 1 --2- 172.21.15.31:0/2716359398 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f685c157960 0x7f6848004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.611+0000 7f686246a700 1 -- 172.21.15.31:0/2716359398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6848004d50 msgr2=0x7f68480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:44.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.611+0000 7f686246a700 1 --2- 172.21.15.31:0/2716359398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6848004d50 0x7f68480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.611+0000 7f686246a700 1 -- 172.21.15.31:0/2716359398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6848003570 con 0x7f6848003a90 2023-10-09T06:32:44.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.611+0000 7f6862c6b700 1 --2- 172.21.15.31:0/2716359398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6848004d50 0x7f68480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:44.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.611+0000 7f686246a700 1 --2- 172.21.15.31:0/2716359398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6848003a90 0x7f6848003ea0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f6858009c00 tx=0x7f68580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5eb66e42bb5c569 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.611+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685800e710 con 0x7f6848003a90 2023-10-09T06:32:44.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.611+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685800e870 con 0x7f6848003a90 2023-10-09T06:32:44.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.611+0000 7f6861468700 1 -- 172.21.15.31:0/2716359398 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685800ec30 con 0x7f6848003a90 2023-10-09T06:32:44.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.611+0000 7f68646ce700 1 -- 172.21.15.31:0/2716359398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6848003a90 msgr2=0x7f6848003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.611+0000 7f68646ce700 1 --2- 172.21.15.31:0/2716359398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6848003a90 0x7f6848003ea0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f6858009c00 tx=0x7f68580091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.611+0000 7f6862c6b700 1 -- 172.21.15.31:0/2716359398 reap_dead start 2023-10-09T06:32:44.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.612+0000 7f68646ce700 1 -- 172.21.15.31:0/2716359398 shutdown_connections 2023-10-09T06:32:44.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.612+0000 7f68646ce700 1 -- 172.21.15.31:0/2716359398 >> 172.21.15.31:0/2716359398 conn(0x7f685c0d18a0 msgr2=0x7f685c0b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:44.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.612+0000 7f68646ce700 1 -- 172.21.15.31:0/2716359398 shutdown_connections 2023-10-09T06:32:44.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.612+0000 7f68646ce700 1 -- 172.21.15.31:0/2716359398 wait complete. 2023-10-09T06:32:44.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.613+0000 7f68646ce700 1 Processor -- start 2023-10-09T06:32:44.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.613+0000 7f68646ce700 1 -- start start 2023-10-09T06:32:44.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.613+0000 7f68646ce700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6848003a90 0x7f685c16b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.613+0000 7f68646ce700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f685c16b350 0x7f685c154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.613+0000 7f68646ce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f685c15e640 0x7f685c0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.613+0000 7f68646ce700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c16bd50 con 0x7f685c15e640 2023-10-09T06:32:44.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.613+0000 7f68646ce700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c15f7a0 con 0x7f6848003a90 2023-10-09T06:32:44.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.613+0000 7f68646ce700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0c64d0 con 0x7f685c16b350 2023-10-09T06:32:44.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.613+0000 7f6862c6b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f685c15e640 0x7f685c0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.613+0000 7f6862c6b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f685c15e640 0x7f685c0b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58500/0 (socket says 172.21.15.31:58500) 2023-10-09T06:32:44.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.613+0000 7f6862c6b700 1 -- 172.21.15.31:0/1694829886 learned_addr learned my addr 172.21.15.31:0/1694829886 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:44.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f6861c69700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f685c16b350 0x7f685c154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f686246a700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6848003a90 0x7f685c16b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f6862c6b700 1 -- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f685c16b350 msgr2=0x7f685c154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f6862c6b700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f685c16b350 0x7f685c154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f6862c6b700 1 -- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6848003a90 msgr2=0x7f685c16b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f6862c6b700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6848003a90 0x7f685c16b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f6862c6b700 1 -- 172.21.15.31:0/1694829886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c15ef00 con 0x7f685c15e640 2023-10-09T06:32:44.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f686246a700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6848003a90 0x7f685c16b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:44.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f6862c6b700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f685c15e640 0x7f685c0b1e60 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f685c06a2e0 tx=0x7f6854009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f68527fc700 1 -- 172.21.15.31:0/1694829886 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854018070 con 0x7f685c15e640 2023-10-09T06:32:44.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f68527fc700 1 -- 172.21.15.31:0/1694829886 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6854006ba0 con 0x7f685c15e640 2023-10-09T06:32:44.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f68527fc700 1 -- 172.21.15.31:0/1694829886 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854012590 con 0x7f685c15e640 2023-10-09T06:32:44.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f68646ce700 1 -- 172.21.15.31:0/1694829886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685c15f1e0 con 0x7f685c15e640 2023-10-09T06:32:44.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.614+0000 7f68646ce700 1 -- 172.21.15.31:0/1694829886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c154f90 con 0x7f685c15e640 2023-10-09T06:32:44.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.615+0000 7f68646ce700 1 -- 172.21.15.31:0/1694829886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f685c0cee00 con 0x7f685c15e640 2023-10-09T06:32:44.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.615+0000 7f68527fc700 1 -- 172.21.15.31:0/1694829886 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6854003030 con 0x7f685c15e640 2023-10-09T06:32:44.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.616+0000 7f68527fc700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6840066f30 0x7f68400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.616+0000 7f68527fc700 1 -- 172.21.15.31:0/1694829886 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6854083c30 con 0x7f685c15e640 2023-10-09T06:32:44.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.616+0000 7f68527fc700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] conn(0x7f684006cd80 0x7f684006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.616+0000 7f686246a700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6840066f30 0x7f68400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.616+0000 7f68527fc700 1 -- 172.21.15.31:0/1694829886 --> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f684006f860 con 0x7f684006cd80 2023-10-09T06:32:44.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.616+0000 7f68527fc700 1 -- 172.21.15.31:0/1694829886 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6854086270 con 0x7f685c15e640 2023-10-09T06:32:44.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.616+0000 7f6861c69700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] conn(0x7f684006cd80 0x7f684006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.617+0000 7f686246a700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6840066f30 0x7f68400693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f68580091e0 tx=0x7f685801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.617+0000 7f6861c69700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] conn(0x7f684006cd80 0x7f684006f190 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.617+0000 7f68527fc700 1 -- 172.21.15.31:0/1694829886 <== osd.4 v2:172.21.15.158:6816/86569 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f684006f860 con 0x7f684006cd80 2023-10-09T06:32:44.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.630+0000 7f68646ce700 1 -- 172.21.15.31:0/1694829886 --> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f685c04c3c0 con 0x7f684006cd80 2023-10-09T06:32:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.631+0000 7f68527fc700 1 -- 172.21.15.31:0/1694829886 <== osd.4 v2:172.21.15.158:6816/86569 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f685c04c3c0 con 0x7f684006cd80 2023-10-09T06:32:44.631 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T06:32:44.632 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:44.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.631+0000 7f68646ce700 1 -- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] conn(0x7f684006cd80 msgr2=0x7f684006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.631+0000 7f68646ce700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:6816/86569,v1:172.21.15.158:6817/86569] conn(0x7f684006cd80 0x7f684006f190 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.631+0000 7f68646ce700 1 -- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6840066f30 msgr2=0x7f68400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.631+0000 7f68646ce700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f6840066f30 0x7f68400693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f68580091e0 tx=0x7f685801a000 comp rx=0 tx=0).stop 2023-10-09T06:32:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.631+0000 7f68646ce700 1 -- 172.21.15.31:0/1694829886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f685c15e640 msgr2=0x7f685c0b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.631+0000 7f68646ce700 1 --2- 172.21.15.31:0/1694829886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f685c15e640 0x7f685c0b1e60 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f685c06a2e0 tx=0x7f6854009040 comp rx=0 tx=0).stop 2023-10-09T06:32:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.631+0000 7f6862c6b700 1 -- 172.21.15.31:0/1694829886 reap_dead start 2023-10-09T06:32:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.631+0000 7f68646ce700 1 -- 172.21.15.31:0/1694829886 shutdown_connections 2023-10-09T06:32:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.631+0000 7f68646ce700 1 -- 172.21.15.31:0/1694829886 >> 172.21.15.31:0/1694829886 conn(0x7f685c0d18a0 msgr2=0x7f685c156900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.631+0000 7f68646ce700 1 -- 172.21.15.31:0/1694829886 shutdown_connections 2023-10-09T06:32:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.631+0000 7f68646ce700 1 -- 172.21.15.31:0/1694829886 wait complete. 2023-10-09T06:32:44.643 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-09T06:32:44.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.763+0000 7fbbd3228700 1 Processor -- start 2023-10-09T06:32:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.763+0000 7fbbd3228700 1 -- start start 2023-10-09T06:32:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.763+0000 7fbbd3228700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbcc157c40 0x7fbbcc158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.763+0000 7fbbd3228700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbcc15cbb0 con 0x7fbbcc15a620 2023-10-09T06:32:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.763+0000 7fbbd3228700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbcc15bfa0 con 0x7fbbcc157870 2023-10-09T06:32:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.763+0000 7fbbd3228700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc15bdb0 con 0x7fbbcc157c40 2023-10-09T06:32:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.764+0000 7fbbcbfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbbcc15a620 0x7fbbcc15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60870/0 (socket says 172.21.15.31:60870) 2023-10-09T06:32:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.764+0000 7fbbcbfff700 1 -- 172.21.15.31:0/1572470068 learned_addr learned my addr 172.21.15.31:0/1572470068 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.764+0000 7fbbd17c5700 1 --2- 172.21.15.31:0/1572470068 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbcc157c40 0x7fbbcc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.764+0000 7fbbcb7fe700 1 -- 172.21.15.31:0/1572470068 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333700506 0 0) 0x7fbbcc15cbb0 con 0x7fbbcc15a620 2023-10-09T06:32:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.764+0000 7fbbcb7fe700 1 -- 172.21.15.31:0/1572470068 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb8003570 con 0x7fbbcc15a620 2023-10-09T06:32:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.764+0000 7fbbcb7fe700 1 -- 172.21.15.31:0/1572470068 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195501325 0 0) 0x7fbbcc15bfa0 con 0x7fbbcc157870 2023-10-09T06:32:44.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.764+0000 7fbbcb7fe700 1 -- 172.21.15.31:0/1572470068 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbcc15cbb0 con 0x7fbbcc157870 2023-10-09T06:32:44.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.764+0000 7fbbcb7fe700 1 -- 172.21.15.31:0/1572470068 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3045865035 0 0) 0x7fbbb8003570 con 0x7fbbcc15a620 2023-10-09T06:32:44.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.764+0000 7fbbd17c5700 1 -- 172.21.15.31:0/1572470068 >> v1:172.21.15.158:6789/0 conn(0x7fbbcc157870 legacy=0x7fbbcc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.764+0000 7fbbd17c5700 1 -- 172.21.15.31:0/1572470068 >> v1:172.21.15.31:6789/0 conn(0x7fbbcc15a620 legacy=0x7fbbcc15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.764+0000 7fbbd17c5700 1 -- 172.21.15.31:0/1572470068 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc15c280 con 0x7fbbcc157c40 2023-10-09T06:32:44.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.764+0000 7fbbd17c5700 1 --2- 172.21.15.31:0/1572470068 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbcc157c40 0x7fbbcc158110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009910 tx=0x7fbbb40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e18b8b7b1ab9fc0b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.765+0000 7fbbcb7fe700 1 -- 172.21.15.31:0/1572470068 <== mon.2 v2:172.21.15.158:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc0017f0 con 0x7fbbcc157c40 2023-10-09T06:32:44.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.765+0000 7fbbcb7fe700 1 -- 172.21.15.31:0/1572470068 <== mon.2 v2:172.21.15.158:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb4011420 con 0x7fbbcc157c40 2023-10-09T06:32:44.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.765+0000 7fbbcb7fe700 1 -- 172.21.15.31:0/1572470068 <== mon.2 v2:172.21.15.158:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40117c0 con 0x7fbbcc157c40 2023-10-09T06:32:44.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.765+0000 7fbbd3228700 1 -- 172.21.15.31:0/1572470068 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbcc157c40 msgr2=0x7fbbcc158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.765+0000 7fbbd3228700 1 --2- 172.21.15.31:0/1572470068 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbcc157c40 0x7fbbcc158110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009910 tx=0x7fbbb40091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.765+0000 7fbbd3228700 1 -- 172.21.15.31:0/1572470068 shutdown_connections 2023-10-09T06:32:44.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.765+0000 7fbbd3228700 1 --2- 172.21.15.31:0/1572470068 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbcc157c40 0x7fbbcc158110 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.765+0000 7fbbd3228700 1 -- 172.21.15.31:0/1572470068 >> 172.21.15.31:0/1572470068 conn(0x7fbbcc068ce0 msgr2=0x7fbbcc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:44.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.765+0000 7fbbd3228700 1 -- 172.21.15.31:0/1572470068 shutdown_connections 2023-10-09T06:32:44.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.765+0000 7fbbd3228700 1 -- 172.21.15.31:0/1572470068 wait complete. 2023-10-09T06:32:44.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.766+0000 7fbbd3228700 1 Processor -- start 2023-10-09T06:32:44.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.766+0000 7fbbd3228700 1 -- start start 2023-10-09T06:32:44.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.767+0000 7fbbd3228700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbcc157870 0x7fbbcc13f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.767+0000 7fbbd3228700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbbcc157c40 0x7fbbcc150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.767+0000 7fbbd3228700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbcc15a620 0x7fbbcc151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.767+0000 7fbbd3228700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc13fdc0 con 0x7fbbcc157870 2023-10-09T06:32:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.767+0000 7fbbd3228700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc16a3b0 con 0x7fbbcc157c40 2023-10-09T06:32:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.767+0000 7fbbd3228700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc14f600 con 0x7fbbcc15a620 2023-10-09T06:32:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.767+0000 7fbbd0fc4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbcc157870 0x7fbbcc13f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.767+0000 7fbbd0fc4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbcc157870 0x7fbbcc13f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58504/0 (socket says 172.21.15.31:58504) 2023-10-09T06:32:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.767+0000 7fbbd0fc4700 1 -- 172.21.15.31:0/3998561219 learned_addr learned my addr 172.21.15.31:0/3998561219 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.767+0000 7fbbcbfff700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbbcc157c40 0x7fbbcc150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.767+0000 7fbbd17c5700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbcc15a620 0x7fbbcc151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.768+0000 7fbbd0fc4700 1 -- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbcc15a620 msgr2=0x7fbbcc151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.768+0000 7fbbd0fc4700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbcc15a620 0x7fbbcc151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.768+0000 7fbbd0fc4700 1 -- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbbcc157c40 msgr2=0x7fbbcc150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.768+0000 7fbbd0fc4700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbbcc157c40 0x7fbbcc150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.768+0000 7fbbd0fc4700 1 -- 172.21.15.31:0/3998561219 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb4009420 con 0x7fbbcc157870 2023-10-09T06:32:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.768+0000 7fbbd17c5700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbcc15a620 0x7fbbcc151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.768+0000 7fbbcbfff700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbbcc157c40 0x7fbbcc150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.768+0000 7fbbd0fc4700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbcc157870 0x7fbbcc13f880 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400c790 tx=0x7fbbc4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.768+0000 7fbbc8ff9700 1 -- 172.21.15.31:0/3998561219 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4010510 con 0x7fbbcc157870 2023-10-09T06:32:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.768+0000 7fbbc8ff9700 1 -- 172.21.15.31:0/3998561219 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc4010670 con 0x7fbbcc157870 2023-10-09T06:32:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.768+0000 7fbbd3228700 1 -- 172.21.15.31:0/3998561219 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbcc0b3370 con 0x7fbbcc157870 2023-10-09T06:32:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.768+0000 7fbbc8ff9700 1 -- 172.21.15.31:0/3998561219 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4010a10 con 0x7fbbcc157870 2023-10-09T06:32:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.768+0000 7fbbd3228700 1 -- 172.21.15.31:0/3998561219 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbcc14efb0 con 0x7fbbcc157870 2023-10-09T06:32:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.769+0000 7fbbd3228700 1 -- 172.21.15.31:0/3998561219 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbcc04c3c0 con 0x7fbbcc157870 2023-10-09T06:32:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.769+0000 7fbbc8ff9700 1 -- 172.21.15.31:0/3998561219 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbc401b400 con 0x7fbbcc157870 2023-10-09T06:32:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.770+0000 7fbbc8ff9700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.770+0000 7fbbc8ff9700 1 -- 172.21.15.31:0/3998561219 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbbc4083f60 con 0x7fbbcc157870 2023-10-09T06:32:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.770+0000 7fbbcbfff700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.771+0000 7fbbcbfff700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbbac066f30 0x7fbbac0693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc001920 tx=0x7fbbbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.774+0000 7fbbc8ff9700 1 -- 172.21.15.31:0/3998561219 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbc40514d0 con 0x7fbbcc157870 2023-10-09T06:32:44.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.965+0000 7fbbd3228700 1 -- 172.21.15.31:0/3998561219 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbcc15c560 con 0x7fbbac066f30 2023-10-09T06:32:44.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.965+0000 7fbbc8ff9700 1 -- 172.21.15.31:0/3998561219 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbbcc15c560 con 0x7fbbac066f30 2023-10-09T06:32:44.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.967+0000 7fbbd3228700 1 -- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbbac066f30 msgr2=0x7fbbac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.967+0000 7fbbd3228700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbbac066f30 0x7fbbac0693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc001920 tx=0x7fbbbc009040 comp rx=0 tx=0).stop 2023-10-09T06:32:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.967+0000 7fbbd3228700 1 -- 172.21.15.31:0/3998561219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbcc157870 msgr2=0x7fbbcc13f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.967+0000 7fbbd3228700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbcc157870 0x7fbbcc13f880 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400c790 tx=0x7fbbc4007e10 comp rx=0 tx=0).stop 2023-10-09T06:32:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.967+0000 7fbbd3228700 1 -- 172.21.15.31:0/3998561219 shutdown_connections 2023-10-09T06:32:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.967+0000 7fbbd3228700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.967+0000 7fbbd3228700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fbbcc15a620 0x7fbbcc151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.967+0000 7fbbd3228700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbcc157870 0x7fbbcc13f880 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.967+0000 7fbbd3228700 1 --2- 172.21.15.31:0/3998561219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbbcc157c40 0x7fbbcc150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.967+0000 7fbbd3228700 1 -- 172.21.15.31:0/3998561219 >> 172.21.15.31:0/3998561219 conn(0x7fbbcc068ce0 msgr2=0x7fbbcc0b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.967+0000 7fbbd3228700 1 -- 172.21.15.31:0/3998561219 shutdown_connections 2023-10-09T06:32:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:44.967+0000 7fbbd3228700 1 -- 172.21.15.31:0/3998561219 wait complete. 2023-10-09T06:32:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 4 to deep-scrub 2023-10-09T06:32:44.980 INFO:tasks.ceph:Scrubbing osd.5 2023-10-09T06:32:44.980 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-09T06:32:45.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.105+0000 7f8ea98b3700 1 Processor -- start 2023-10-09T06:32:45.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.105+0000 7f8ea98b3700 1 -- start start 2023-10-09T06:32:45.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.105+0000 7f8ea98b3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ea4159de0 0x7f8ea40b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.105+0000 7f8ea98b3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8ea406a650 0x7f8ea406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.105+0000 7f8ea98b3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea415eb10 con 0x7f8ea415a1b0 2023-10-09T06:32:45.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.105+0000 7f8ea98b3700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea40b3790 con 0x7f8ea406a650 2023-10-09T06:32:45.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.105+0000 7f8ea98b3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea406b010 con 0x7f8ea4159de0 2023-10-09T06:32:45.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.106+0000 7f8ea37fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8ea406a650 0x7f8ea406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.106+0000 7f8ea2ffd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ea4159de0 0x7f8ea40b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.106+0000 7f8ea37fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8ea406a650 0x7f8ea406aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.31:56996/0 (socket says 172.21.15.31:56996) 2023-10-09T06:32:45.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.106+0000 7f8ea37fe700 1 -- 172.21.15.31:0/3807098866 learned_addr learned my addr 172.21.15.31:0/3807098866 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:45.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.106+0000 7f8ea27fc700 1 --1- 172.21.15.31:0/3807098866 >> v1:172.21.15.158:6789/0 conn(0x7f8ea415a1b0 0x7f8ea40b2d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.31:38318/0 (socket says 172.21.15.31:38318) 2023-10-09T06:32:45.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.106+0000 7f8ea37fe700 1 -- 172.21.15.31:0/3807098866 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ea4159de0 msgr2=0x7f8ea40b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:45.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.106+0000 7f8ea37fe700 1 --2- 172.21.15.31:0/3807098866 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ea4159de0 0x7f8ea40b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.106+0000 7f8ea37fe700 1 -- 172.21.15.31:0/3807098866 >> v1:172.21.15.158:6789/0 conn(0x7f8ea415a1b0 legacy=0x7f8ea40b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.106+0000 7f8ea37fe700 1 -- 172.21.15.31:0/3807098866 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea415e680 con 0x7f8ea406a650 2023-10-09T06:32:45.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.106+0000 7f8ea37fe700 1 --2- 172.21.15.31:0/3807098866 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ea406a650 0x7f8ea406aad0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009f20 tx=0x7f8e94009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93fd4ab16472cf27 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.107+0000 7f8ea1ffb700 1 -- 172.21.15.31:0/3807098866 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400e070 con 0x7f8ea406a650 2023-10-09T06:32:45.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.107+0000 7f8ea1ffb700 1 -- 172.21.15.31:0/3807098866 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9400b9d0 con 0x7f8ea406a650 2023-10-09T06:32:45.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.107+0000 7f8ea1ffb700 1 -- 172.21.15.31:0/3807098866 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e940092e0 con 0x7f8ea406a650 2023-10-09T06:32:45.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.107+0000 7f8ea98b3700 1 -- 172.21.15.31:0/3807098866 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ea406a650 msgr2=0x7f8ea406aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.107+0000 7f8ea98b3700 1 --2- 172.21.15.31:0/3807098866 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ea406a650 0x7f8ea406aad0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009f20 tx=0x7f8e94009840 comp rx=0 tx=0).stop 2023-10-09T06:32:45.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.107+0000 7f8ea98b3700 1 -- 172.21.15.31:0/3807098866 shutdown_connections 2023-10-09T06:32:45.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.107+0000 7f8ea98b3700 1 --2- 172.21.15.31:0/3807098866 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ea406a650 0x7f8ea406aad0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.107+0000 7f8ea98b3700 1 --2- 172.21.15.31:0/3807098866 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ea4159de0 0x7f8ea40b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.107+0000 7f8ea98b3700 1 -- 172.21.15.31:0/3807098866 >> 172.21.15.31:0/3807098866 conn(0x7f8ea4068d60 msgr2=0x7f8ea4069160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:45.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.107+0000 7f8ea98b3700 1 -- 172.21.15.31:0/3807098866 shutdown_connections 2023-10-09T06:32:45.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.107+0000 7f8ea98b3700 1 -- 172.21.15.31:0/3807098866 wait complete. 2023-10-09T06:32:45.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.108+0000 7f8ea98b3700 1 Processor -- start 2023-10-09T06:32:45.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.108+0000 7f8ea98b3700 1 -- start start 2023-10-09T06:32:45.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.109+0000 7f8ea98b3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ea406a650 0x7f8ea40c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.109+0000 7f8ea98b3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea4159de0 0x7f8ea41569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.109+0000 7f8ea98b3700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ea415a1b0 0x7f8ea40ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.109+0000 7f8ea98b3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea416e050 con 0x7f8ea4159de0 2023-10-09T06:32:45.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.109+0000 7f8ea98b3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea416da40 con 0x7f8ea406a650 2023-10-09T06:32:45.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.109+0000 7f8ea98b3700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40c71d0 con 0x7f8ea415a1b0 2023-10-09T06:32:45.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.109+0000 7f8ea27fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea4159de0 0x7f8ea41569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.109+0000 7f8ea27fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea4159de0 0x7f8ea41569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58506/0 (socket says 172.21.15.31:58506) 2023-10-09T06:32:45.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.109+0000 7f8ea27fc700 1 -- 172.21.15.31:0/2014760142 learned_addr learned my addr 172.21.15.31:0/2014760142 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:45.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.109+0000 7f8ea37fe700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ea415a1b0 0x7f8ea40ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.109+0000 7f8ea2ffd700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ea406a650 0x7f8ea40c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.110+0000 7f8ea27fc700 1 -- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ea415a1b0 msgr2=0x7f8ea40ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.110+0000 7f8ea27fc700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f8ea415a1b0 0x7f8ea40ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.110+0000 7f8ea27fc700 1 -- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ea406a650 msgr2=0x7f8ea40c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.110+0000 7f8ea27fc700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ea406a650 0x7f8ea40c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.110+0000 7f8ea27fc700 1 -- 172.21.15.31:0/2014760142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e94009ae0 con 0x7f8ea4159de0 2023-10-09T06:32:45.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.110+0000 7f8ea27fc700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea4159de0 0x7f8ea41569c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00c7c0 tx=0x7f8e8c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.110+0000 7f8e9affd700 1 -- 172.21.15.31:0/2014760142 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c005a70 con 0x7f8ea4159de0 2023-10-09T06:32:45.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.110+0000 7f8e9affd700 1 -- 172.21.15.31:0/2014760142 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c005bd0 con 0x7f8ea4159de0 2023-10-09T06:32:45.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.110+0000 7f8e9affd700 1 -- 172.21.15.31:0/2014760142 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0070d0 con 0x7f8ea4159de0 2023-10-09T06:32:45.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.110+0000 7f8ea98b3700 1 -- 172.21.15.31:0/2014760142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea40c74b0 con 0x7f8ea4159de0 2023-10-09T06:32:45.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.110+0000 7f8ea98b3700 1 -- 172.21.15.31:0/2014760142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea4156f00 con 0x7f8ea4159de0 2023-10-09T06:32:45.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.111+0000 7f8ea98b3700 1 -- 172.21.15.31:0/2014760142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ea404c3c0 con 0x7f8ea4159de0 2023-10-09T06:32:45.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.111+0000 7f8e9affd700 1 -- 172.21.15.31:0/2014760142 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e8c007480 con 0x7f8ea4159de0 2023-10-09T06:32:45.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.112+0000 7f8e9affd700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e84066f30 0x7f8e840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.112+0000 7f8e9affd700 1 -- 172.21.15.31:0/2014760142 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8e8c083550 con 0x7f8ea4159de0 2023-10-09T06:32:45.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.112+0000 7f8e9affd700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] conn(0x7f8e8406cd80 0x7f8e8406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.112+0000 7f8e9affd700 1 -- 172.21.15.31:0/2014760142 --> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e8406f860 con 0x7f8e8406cd80 2023-10-09T06:32:45.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.112+0000 7f8e9affd700 1 -- 172.21.15.31:0/2014760142 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e8c085b30 con 0x7f8ea4159de0 2023-10-09T06:32:45.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.112+0000 7f8ea2ffd700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e84066f30 0x7f8e840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.112+0000 7f8ea37fe700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] conn(0x7f8e8406cd80 0x7f8e8406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.113+0000 7f8ea2ffd700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e84066f30 0x7f8e840693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009db0 tx=0x7f8e9c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.113+0000 7f8ea37fe700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] conn(0x7f8e8406cd80 0x7f8e8406f190 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.113+0000 7f8e9affd700 1 -- 172.21.15.31:0/2014760142 <== osd.5 v2:172.21.15.158:6802/86547 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f8e8406f860 con 0x7f8e8406cd80 2023-10-09T06:32:45.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.126+0000 7f8ea98b3700 1 -- 172.21.15.31:0/2014760142 --> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8ea415eb10 con 0x7f8e8406cd80 2023-10-09T06:32:45.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.127+0000 7f8e9affd700 1 -- 172.21.15.31:0/2014760142 <== osd.5 v2:172.21.15.158:6802/86547 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f8ea415eb10 con 0x7f8e8406cd80 2023-10-09T06:32:45.127 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T06:32:45.128 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.127+0000 7f8ea98b3700 1 -- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] conn(0x7f8e8406cd80 msgr2=0x7f8e8406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.127+0000 7f8ea98b3700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:6802/86547,v1:172.21.15.158:6804/86547] conn(0x7f8e8406cd80 0x7f8e8406f190 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.127+0000 7f8ea98b3700 1 -- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e84066f30 msgr2=0x7f8e840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.127+0000 7f8ea98b3700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f8e84066f30 0x7f8e840693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009db0 tx=0x7f8e9c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.127+0000 7f8ea98b3700 1 -- 172.21.15.31:0/2014760142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea4159de0 msgr2=0x7f8ea41569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.127+0000 7f8ea98b3700 1 --2- 172.21.15.31:0/2014760142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea4159de0 0x7f8ea41569c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00c7c0 tx=0x7f8e8c007f70 comp rx=0 tx=0).stop 2023-10-09T06:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.127+0000 7f8ea37fe700 1 -- 172.21.15.31:0/2014760142 reap_dead start 2023-10-09T06:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.127+0000 7f8ea98b3700 1 -- 172.21.15.31:0/2014760142 shutdown_connections 2023-10-09T06:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.127+0000 7f8ea98b3700 1 -- 172.21.15.31:0/2014760142 >> 172.21.15.31:0/2014760142 conn(0x7f8ea4068d60 msgr2=0x7f8ea4157fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.127+0000 7f8ea98b3700 1 -- 172.21.15.31:0/2014760142 shutdown_connections 2023-10-09T06:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.127+0000 7f8ea98b3700 1 -- 172.21.15.31:0/2014760142 wait complete. 2023-10-09T06:32:45.139 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-09T06:32:45.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.258+0000 7f71115f0700 1 Processor -- start 2023-10-09T06:32:45.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.258+0000 7f71115f0700 1 -- start start 2023-10-09T06:32:45.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.259+0000 7f71115f0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f710c157870 0x7f710c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.259+0000 7f71115f0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f710c157c40 0x7f710c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.259+0000 7f71115f0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710c15cbb0 con 0x7f710c15a620 2023-10-09T06:32:45.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.259+0000 7f71115f0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710c15bfa0 con 0x7f710c157870 2023-10-09T06:32:45.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.259+0000 7f71115f0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710c15c280 con 0x7f710c157c40 2023-10-09T06:32:45.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.259+0000 7f710a7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f710c15a620 0x7f710c15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60886/0 (socket says 172.21.15.31:60886) 2023-10-09T06:32:45.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.259+0000 7f710a7fc700 1 -- 172.21.15.31:0/1239706127 learned_addr learned my addr 172.21.15.31:0/1239706127 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:45.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.259+0000 7f710affd700 1 --2- 172.21.15.31:0/1239706127 >> v2:172.21.15.158:3300/0 conn(0x7f710c157870 0x7f710c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.259+0000 7f710b7fe700 1 --2- 172.21.15.31:0/1239706127 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f710c157c40 0x7f710c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.259+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215976013 0 0) 0x7f710c15cbb0 con 0x7f710c15a620 2023-10-09T06:32:45.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.259+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f8003570 con 0x7f710c15a620 2023-10-09T06:32:45.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1873990635 0 0) 0x7f70f8003570 con 0x7f710c15a620 2023-10-09T06:32:45.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f710c157c40 msgr2=0x7f710c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:45.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 --2- 172.21.15.31:0/1239706127 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f710c157c40 0x7f710c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 >> v2:172.21.15.158:3300/0 conn(0x7f710c157870 msgr2=0x7f710c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:45.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 --2- 172.21.15.31:0/1239706127 >> v2:172.21.15.158:3300/0 conn(0x7f710c157870 0x7f710c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c15c560 con 0x7f710c15a620 2023-10-09T06:32:45.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f70f4001470 con 0x7f710c15a620 2023-10-09T06:32:45.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 >> v1:172.21.15.31:6789/0 conn(0x7f710c15a620 legacy=0x7f710c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 --2- 172.21.15.31:0/1239706127 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f710c157c40 0x7f70f8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 --2- 172.21.15.31:0/1239706127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70f8003fe0 0x7f70f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 --2- 172.21.15.31:0/1239706127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f8004d50 0x7f70f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c15bfa0 con 0x7f70f8004d50 2023-10-09T06:32:45.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c15c280 con 0x7f70f8003fe0 2023-10-09T06:32:45.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f800ba90 con 0x7f710c157c40 2023-10-09T06:32:45.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f710b7fe700 1 --2- 172.21.15.31:0/1239706127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f8004d50 0x7f70f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f710a7fc700 1 --2- 172.21.15.31:0/1239706127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70f8003fe0 0x7f70f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f710affd700 1 --2- 172.21.15.31:0/1239706127 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f710c157c40 0x7f70f8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f710b7fe700 1 -- 172.21.15.31:0/1239706127 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f710c157c40 msgr2=0x7f70f8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:45.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f710b7fe700 1 --2- 172.21.15.31:0/1239706127 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f710c157c40 0x7f70f8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f710b7fe700 1 -- 172.21.15.31:0/1239706127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70f8003fe0 msgr2=0x7f70f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:45.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f710b7fe700 1 --2- 172.21.15.31:0/1239706127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70f8003fe0 0x7f70f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f710b7fe700 1 -- 172.21.15.31:0/1239706127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f8003570 con 0x7f70f8004d50 2023-10-09T06:32:45.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.260+0000 7f710b7fe700 1 --2- 172.21.15.31:0/1239706127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f8004d50 0x7f70f80051c0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f710c1580c0 tx=0x7f710400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18ca18369500fe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.261+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710400ea30 con 0x7f70f8004d50 2023-10-09T06:32:45.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.261+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710400f040 con 0x7f70f8004d50 2023-10-09T06:32:45.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.261+0000 7f7109ffb700 1 -- 172.21.15.31:0/1239706127 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710400ede0 con 0x7f70f8004d50 2023-10-09T06:32:45.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.261+0000 7f71115f0700 1 -- 172.21.15.31:0/1239706127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f8004d50 msgr2=0x7f70f80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.261+0000 7f71115f0700 1 --2- 172.21.15.31:0/1239706127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f8004d50 0x7f70f80051c0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f710c1580c0 tx=0x7f710400b040 comp rx=0 tx=0).stop 2023-10-09T06:32:45.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.261+0000 7f710b7fe700 1 -- 172.21.15.31:0/1239706127 reap_dead start 2023-10-09T06:32:45.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.261+0000 7f71115f0700 1 -- 172.21.15.31:0/1239706127 shutdown_connections 2023-10-09T06:32:45.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.261+0000 7f71115f0700 1 -- 172.21.15.31:0/1239706127 >> 172.21.15.31:0/1239706127 conn(0x7f710c068ce0 msgr2=0x7f710c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:45.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.261+0000 7f71115f0700 1 -- 172.21.15.31:0/1239706127 shutdown_connections 2023-10-09T06:32:45.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.261+0000 7f71115f0700 1 -- 172.21.15.31:0/1239706127 wait complete. 2023-10-09T06:32:45.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.262+0000 7f71115f0700 1 Processor -- start 2023-10-09T06:32:45.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.262+0000 7f71115f0700 1 -- start start 2023-10-09T06:32:45.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.263+0000 7f71115f0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f8004d50 0x7f710c1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.263+0000 7f71115f0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f710c14ceb0 0x7f710c1504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.263+0000 7f71115f0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f710c1509f0 0x7f710c14d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.263+0000 7f71115f0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c153210 con 0x7f70f8004d50 2023-10-09T06:32:45.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.263+0000 7f71115f0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c152600 con 0x7f710c14ceb0 2023-10-09T06:32:45.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.263+0000 7f71115f0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710c1528e0 con 0x7f710c1509f0 2023-10-09T06:32:45.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.263+0000 7f710affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f8004d50 0x7f710c1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.263+0000 7f710affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f8004d50 0x7f710c1536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58536/0 (socket says 172.21.15.31:58536) 2023-10-09T06:32:45.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.263+0000 7f710affd700 1 -- 172.21.15.31:0/397095390 learned_addr learned my addr 172.21.15.31:0/397095390 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:45.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.263+0000 7f710a7fc700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f710c14ceb0 0x7f710c1504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.263+0000 7f710b7fe700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f710c1509f0 0x7f710c14d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.264+0000 7f710affd700 1 -- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f710c1509f0 msgr2=0x7f710c14d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.264+0000 7f710affd700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f710c1509f0 0x7f710c14d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.264+0000 7f710affd700 1 -- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f710c14ceb0 msgr2=0x7f710c1504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.264+0000 7f710affd700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f710c14ceb0 0x7f710c1504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.264+0000 7f710affd700 1 -- 172.21.15.31:0/397095390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c152bc0 con 0x7f70f8004d50 2023-10-09T06:32:45.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.264+0000 7f710affd700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f8004d50 0x7f710c1536a0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f70fc006ac0 tx=0x7f70fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.264+0000 7f7102ffd700 1 -- 172.21.15.31:0/397095390 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc011ec0 con 0x7f70f8004d50 2023-10-09T06:32:45.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.264+0000 7f7102ffd700 1 -- 172.21.15.31:0/397095390 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc00f940 con 0x7f70f8004d50 2023-10-09T06:32:45.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.264+0000 7f7102ffd700 1 -- 172.21.15.31:0/397095390 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc00fcc0 con 0x7f70f8004d50 2023-10-09T06:32:45.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.264+0000 7f71115f0700 1 -- 172.21.15.31:0/397095390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710c152ea0 con 0x7f70f8004d50 2023-10-09T06:32:45.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.264+0000 7f71115f0700 1 -- 172.21.15.31:0/397095390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710c152160 con 0x7f70f8004d50 2023-10-09T06:32:45.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.265+0000 7f71115f0700 1 -- 172.21.15.31:0/397095390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710c04c3c0 con 0x7f70f8004d50 2023-10-09T06:32:45.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.265+0000 7f7102ffd700 1 -- 172.21.15.31:0/397095390 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70fc014650 con 0x7f70f8004d50 2023-10-09T06:32:45.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.266+0000 7f7102ffd700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f70ec066f30 0x7f70ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.266+0000 7f7102ffd700 1 -- 172.21.15.31:0/397095390 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f70fc018030 con 0x7f70f8004d50 2023-10-09T06:32:45.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.266+0000 7f710a7fc700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f70ec066f30 0x7f70ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.266+0000 7f710a7fc700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f70ec066f30 0x7f70ec0693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f70f4000e50 tx=0x7f70f4001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.270+0000 7f7102ffd700 1 -- 172.21.15.31:0/397095390 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70fc052100 con 0x7f70f8004d50 2023-10-09T06:32:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.462+0000 7f71115f0700 1 -- 172.21.15.31:0/397095390 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f710c153350 con 0x7f70ec066f30 2023-10-09T06:32:45.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.462+0000 7f7102ffd700 1 -- 172.21.15.31:0/397095390 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f70f4004db0 con 0x7f70ec066f30 2023-10-09T06:32:45.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.464+0000 7f71115f0700 1 -- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f70ec066f30 msgr2=0x7f70ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.464+0000 7f71115f0700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f70ec066f30 0x7f70ec0693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f70f4000e50 tx=0x7f70f4001e90 comp rx=0 tx=0).stop 2023-10-09T06:32:45.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.464+0000 7f71115f0700 1 -- 172.21.15.31:0/397095390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f8004d50 msgr2=0x7f710c1536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.464+0000 7f71115f0700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f8004d50 0x7f710c1536a0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f70fc006ac0 tx=0x7f70fc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.464+0000 7f71115f0700 1 -- 172.21.15.31:0/397095390 shutdown_connections 2023-10-09T06:32:45.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.464+0000 7f71115f0700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f70ec066f30 0x7f70ec0693e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.464+0000 7f71115f0700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f710c1509f0 0x7f710c14d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.464+0000 7f71115f0700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f8004d50 0x7f710c1536a0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.464+0000 7f71115f0700 1 --2- 172.21.15.31:0/397095390 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f710c14ceb0 0x7f710c1504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.464+0000 7f71115f0700 1 -- 172.21.15.31:0/397095390 >> 172.21.15.31:0/397095390 conn(0x7f710c068ce0 msgr2=0x7f710c0b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:45.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.464+0000 7f71115f0700 1 -- 172.21.15.31:0/397095390 shutdown_connections 2023-10-09T06:32:45.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.464+0000 7f71115f0700 1 -- 172.21.15.31:0/397095390 wait complete. 2023-10-09T06:32:45.467 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 5 to deep-scrub 2023-10-09T06:32:45.477 INFO:tasks.ceph:Scrubbing osd.6 2023-10-09T06:32:45.477 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-09T06:32:45.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.598+0000 7ff60bbdd700 1 Processor -- start 2023-10-09T06:32:45.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.599+0000 7ff60bbdd700 1 -- start start 2023-10-09T06:32:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.599+0000 7ff60bbdd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff604157b10 0x7ff60415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.599+0000 7ff60bbdd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff60415aee0 0x7ff604067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff60bbdd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6040cf350 con 0x7ff604067ba0 2023-10-09T06:32:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff60bbdd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60415e9e0 con 0x7ff60415aee0 2023-10-09T06:32:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff60bbdd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff604157ee0 con 0x7ff604157b10 2023-10-09T06:32:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff609178700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff60415aee0 0x7ff604067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff609178700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff60415aee0 0x7ff604067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58546/0 (socket says 172.21.15.31:58546) 2023-10-09T06:32:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff609178700 1 -- 172.21.15.31:0/1340780916 learned_addr learned my addr 172.21.15.31:0/1340780916 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff60a17a700 1 --1- 172.21.15.31:0/1340780916 >> v1:172.21.15.31:6789/0 conn(0x7ff604067ba0 0x7ff60406a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60890/0 (socket says 172.21.15.31:60890) 2023-10-09T06:32:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff609979700 1 --2- 172.21.15.31:0/1340780916 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff604157b10 0x7ff60415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff609178700 1 -- 172.21.15.31:0/1340780916 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff604157b10 msgr2=0x7ff60415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff609178700 1 --2- 172.21.15.31:0/1340780916 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff604157b10 0x7ff60415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff609178700 1 -- 172.21.15.31:0/1340780916 >> v1:172.21.15.31:6789/0 conn(0x7ff604067ba0 legacy=0x7ff60406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff609178700 1 -- 172.21.15.31:0/1340780916 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604067fe0 con 0x7ff60415aee0 2023-10-09T06:32:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff608977700 1 -- 172.21.15.31:0/1340780916 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050122879 0 0) 0x7ff6040cf350 con 0x7ff604067ba0 2023-10-09T06:32:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff609178700 1 --2- 172.21.15.31:0/1340780916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff60415aee0 0x7ff604067660 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40099e0 tx=0x7ff5f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59410bba15cef3ea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff608977700 1 -- 172.21.15.31:0/1340780916 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f400b820 con 0x7ff60415aee0 2023-10-09T06:32:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff608977700 1 -- 172.21.15.31:0/1340780916 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f400b980 con 0x7ff60415aee0 2023-10-09T06:32:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.600+0000 7ff608977700 1 -- 172.21.15.31:0/1340780916 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f400bd20 con 0x7ff60415aee0 2023-10-09T06:32:45.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.601+0000 7ff60bbdd700 1 -- 172.21.15.31:0/1340780916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff60415aee0 msgr2=0x7ff604067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.601+0000 7ff60bbdd700 1 --2- 172.21.15.31:0/1340780916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff60415aee0 0x7ff604067660 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40099e0 tx=0x7ff5f4009250 comp rx=0 tx=0).stop 2023-10-09T06:32:45.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.601+0000 7ff60bbdd700 1 -- 172.21.15.31:0/1340780916 shutdown_connections 2023-10-09T06:32:45.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.601+0000 7ff60bbdd700 1 --2- 172.21.15.31:0/1340780916 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff604157b10 0x7ff60415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.601+0000 7ff60bbdd700 1 --2- 172.21.15.31:0/1340780916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff60415aee0 0x7ff604067660 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.601+0000 7ff60bbdd700 1 -- 172.21.15.31:0/1340780916 >> 172.21.15.31:0/1340780916 conn(0x7ff6040d0de0 msgr2=0x7ff6040d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:45.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.601+0000 7ff60bbdd700 1 -- 172.21.15.31:0/1340780916 shutdown_connections 2023-10-09T06:32:45.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.601+0000 7ff60bbdd700 1 -- 172.21.15.31:0/1340780916 wait complete. 2023-10-09T06:32:45.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.602+0000 7ff60bbdd700 1 Processor -- start 2023-10-09T06:32:45.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.602+0000 7ff60bbdd700 1 -- start start 2023-10-09T06:32:45.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff60bbdd700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff604067ba0 0x7ff604154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff60bbdd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604157b10 0x7ff6040b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff60bbdd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff60415aee0 0x7ff6040b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff60bbdd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040b3680 con 0x7ff604157b10 2023-10-09T06:32:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff60bbdd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040b1b20 con 0x7ff60415aee0 2023-10-09T06:32:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff60bbdd700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040c81c0 con 0x7ff604067ba0 2023-10-09T06:32:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff609178700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604157b10 0x7ff6040b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff609178700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604157b10 0x7ff6040b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58556/0 (socket says 172.21.15.31:58556) 2023-10-09T06:32:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff609178700 1 -- 172.21.15.31:0/2634283577 learned_addr learned my addr 172.21.15.31:0/2634283577 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff609979700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff604067ba0 0x7ff604154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff609178700 1 -- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff604067ba0 msgr2=0x7ff604154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff609178700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff604067ba0 0x7ff604154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff60a17a700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff60415aee0 0x7ff6040b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff609178700 1 -- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff60415aee0 msgr2=0x7ff6040b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff609178700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff60415aee0 0x7ff6040b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff609178700 1 -- 172.21.15.31:0/2634283577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f40094f0 con 0x7ff604157b10 2023-10-09T06:32:45.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.603+0000 7ff609178700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604157b10 0x7ff6040b0bc0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4006fd0 tx=0x7ff5f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.604+0000 7ff5f9ffb700 1 -- 172.21.15.31:0/2634283577 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4011e70 con 0x7ff604157b10 2023-10-09T06:32:45.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.604+0000 7ff5f9ffb700 1 -- 172.21.15.31:0/2634283577 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f4026450 con 0x7ff604157b10 2023-10-09T06:32:45.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.604+0000 7ff5f9ffb700 1 -- 172.21.15.31:0/2634283577 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4026810 con 0x7ff604157b10 2023-10-09T06:32:45.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.604+0000 7ff60bbdd700 1 -- 172.21.15.31:0/2634283577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6040c7e90 con 0x7ff604157b10 2023-10-09T06:32:45.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.604+0000 7ff60bbdd700 1 -- 172.21.15.31:0/2634283577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6040b1560 con 0x7ff604157b10 2023-10-09T06:32:45.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.605+0000 7ff60bbdd700 1 -- 172.21.15.31:0/2634283577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff60404c3c0 con 0x7ff604157b10 2023-10-09T06:32:45.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.605+0000 7ff5f9ffb700 1 -- 172.21.15.31:0/2634283577 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5f401a420 con 0x7ff604157b10 2023-10-09T06:32:45.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.605+0000 7ff5f9ffb700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff5e8066f60 0x7ff5e8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.606+0000 7ff5f9ffb700 1 -- 172.21.15.31:0/2634283577 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff5f4085eb0 con 0x7ff604157b10 2023-10-09T06:32:45.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.606+0000 7ff5f9ffb700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] conn(0x7ff5e806cdb0 0x7ff5e806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.606+0000 7ff5f9ffb700 1 -- 172.21.15.31:0/2634283577 --> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5e806f890 con 0x7ff5e806cdb0 2023-10-09T06:32:45.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.606+0000 7ff5f9ffb700 1 -- 172.21.15.31:0/2634283577 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5f4088410 con 0x7ff604157b10 2023-10-09T06:32:45.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.606+0000 7ff609979700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff5e8066f60 0x7ff5e8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.606+0000 7ff60a17a700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] conn(0x7ff5e806cdb0 0x7ff5e806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.606+0000 7ff609979700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff5e8066f60 0x7ff5e8069410 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff600006fd0 tx=0x7ff600008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.606+0000 7ff60a17a700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] conn(0x7ff5e806cdb0 0x7ff5e806f1c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.607+0000 7ff5f9ffb700 1 -- 172.21.15.31:0/2634283577 <== osd.6 v2:172.21.15.158:6800/86548 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7ff5e806f890 con 0x7ff5e806cdb0 2023-10-09T06:32:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.620+0000 7ff60bbdd700 1 -- 172.21.15.31:0/2634283577 --> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff6040cd430 con 0x7ff5e806cdb0 2023-10-09T06:32:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.620+0000 7ff5f9ffb700 1 -- 172.21.15.31:0/2634283577 <== osd.6 v2:172.21.15.158:6800/86548 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7ff6040cd430 con 0x7ff5e806cdb0 2023-10-09T06:32:45.621 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:45.621 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T06:32:45.621 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:45.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.621+0000 7ff60bbdd700 1 -- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] conn(0x7ff5e806cdb0 msgr2=0x7ff5e806f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.621+0000 7ff60bbdd700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:6800/86548,v1:172.21.15.158:6801/86548] conn(0x7ff5e806cdb0 0x7ff5e806f1c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.621+0000 7ff60bbdd700 1 -- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff5e8066f60 msgr2=0x7ff5e8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.621+0000 7ff60bbdd700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff5e8066f60 0x7ff5e8069410 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff600006fd0 tx=0x7ff600008040 comp rx=0 tx=0).stop 2023-10-09T06:32:45.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.621+0000 7ff60bbdd700 1 -- 172.21.15.31:0/2634283577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604157b10 msgr2=0x7ff6040b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.621+0000 7ff60bbdd700 1 --2- 172.21.15.31:0/2634283577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604157b10 0x7ff6040b0bc0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4006fd0 tx=0x7ff5f4017000 comp rx=0 tx=0).stop 2023-10-09T06:32:45.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.621+0000 7ff60a17a700 1 -- 172.21.15.31:0/2634283577 reap_dead start 2023-10-09T06:32:45.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.621+0000 7ff60bbdd700 1 -- 172.21.15.31:0/2634283577 shutdown_connections 2023-10-09T06:32:45.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.621+0000 7ff60bbdd700 1 -- 172.21.15.31:0/2634283577 >> 172.21.15.31:0/2634283577 conn(0x7ff6040d0de0 msgr2=0x7ff604156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:45.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.621+0000 7ff60bbdd700 1 -- 172.21.15.31:0/2634283577 shutdown_connections 2023-10-09T06:32:45.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.621+0000 7ff60bbdd700 1 -- 172.21.15.31:0/2634283577 wait complete. 2023-10-09T06:32:45.633 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-09T06:32:45.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.753+0000 7fd05d80e700 1 Processor -- start 2023-10-09T06:32:45.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.753+0000 7fd05d80e700 1 -- start start 2023-10-09T06:32:45.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.753+0000 7fd05d80e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd05815a2b0 0x7fd0580b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd05d80e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0580d1c30 0x7fd0580cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd05d80e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd05815a680 0x7fd0580cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd05d80e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd058068470 con 0x7fd05815a680 2023-10-09T06:32:45.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd05d80e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0580c5d80 con 0x7fd05815a2b0 2023-10-09T06:32:45.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd05d80e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580c6060 con 0x7fd0580d1c30 2023-10-09T06:32:45.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd0577fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd05815a680 0x7fd0580cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd0577fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd05815a680 0x7fd0580cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58564/0 (socket says 172.21.15.31:58564) 2023-10-09T06:32:45.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd0577fe700 1 -- 172.21.15.31:0/3480419845 learned_addr learned my addr 172.21.15.31:0/3480419845 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:45.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd056ffd700 1 --2- 172.21.15.31:0/3480419845 >> v2:172.21.15.158:3300/0 conn(0x7fd05815a2b0 0x7fd0580b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd0567fc700 1 --2- 172.21.15.31:0/3480419845 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0580d1c30 0x7fd0580cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd0577fe700 1 -- 172.21.15.31:0/3480419845 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0580d1c30 msgr2=0x7fd0580cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:45.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd0577fe700 1 --2- 172.21.15.31:0/3480419845 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0580d1c30 0x7fd0580cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd0577fe700 1 -- 172.21.15.31:0/3480419845 >> v2:172.21.15.158:3300/0 conn(0x7fd05815a2b0 msgr2=0x7fd0580b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:45.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd0577fe700 1 --2- 172.21.15.31:0/3480419845 >> v2:172.21.15.158:3300/0 conn(0x7fd05815a2b0 0x7fd0580b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd0577fe700 1 -- 172.21.15.31:0/3480419845 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580c6340 con 0x7fd05815a680 2023-10-09T06:32:45.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd0577fe700 1 --2- 172.21.15.31:0/3480419845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05815a680 0x7fd0580cfc50 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fd058089220 tx=0x7fd050009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3ddce725ee1b28 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd055ffb700 1 -- 172.21.15.31:0/3480419845 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05000e070 con 0x7fd05815a680 2023-10-09T06:32:45.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd055ffb700 1 -- 172.21.15.31:0/3480419845 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05000b970 con 0x7fd05815a680 2023-10-09T06:32:45.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.754+0000 7fd055ffb700 1 -- 172.21.15.31:0/3480419845 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0500092e0 con 0x7fd05815a680 2023-10-09T06:32:45.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.755+0000 7fd05d80e700 1 -- 172.21.15.31:0/3480419845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05815a680 msgr2=0x7fd0580cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.755+0000 7fd05d80e700 1 --2- 172.21.15.31:0/3480419845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05815a680 0x7fd0580cfc50 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fd058089220 tx=0x7fd050009840 comp rx=0 tx=0).stop 2023-10-09T06:32:45.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.755+0000 7fd05d80e700 1 -- 172.21.15.31:0/3480419845 shutdown_connections 2023-10-09T06:32:45.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.755+0000 7fd05d80e700 1 --2- 172.21.15.31:0/3480419845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05815a680 0x7fd0580cfc50 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.755+0000 7fd05d80e700 1 --2- 172.21.15.31:0/3480419845 >> v2:172.21.15.158:3300/0 conn(0x7fd05815a2b0 0x7fd0580b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.755+0000 7fd05d80e700 1 --2- 172.21.15.31:0/3480419845 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0580d1c30 0x7fd0580cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.755+0000 7fd05d80e700 1 -- 172.21.15.31:0/3480419845 >> 172.21.15.31:0/3480419845 conn(0x7fd058067e40 msgr2=0x7fd0580d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:45.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.755+0000 7fd05d80e700 1 -- 172.21.15.31:0/3480419845 shutdown_connections 2023-10-09T06:32:45.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.755+0000 7fd05d80e700 1 -- 172.21.15.31:0/3480419845 wait complete. 2023-10-09T06:32:45.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.756+0000 7fd05d80e700 1 Processor -- start 2023-10-09T06:32:45.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.756+0000 7fd05d80e700 1 -- start start 2023-10-09T06:32:45.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd05d80e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0580d1c30 0x7fd05815d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd05d80e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd05815a2b0 0x7fd0580c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd05d80e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05815a680 0x7fd0580c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd05d80e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580c9480 con 0x7fd05815a680 2023-10-09T06:32:45.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd05d80e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580c85d0 con 0x7fd05815a2b0 2023-10-09T06:32:45.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd05d80e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580c8870 con 0x7fd0580d1c30 2023-10-09T06:32:45.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd0577fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05815a680 0x7fd0580c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd0577fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05815a680 0x7fd0580c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58578/0 (socket says 172.21.15.31:58578) 2023-10-09T06:32:45.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd0577fe700 1 -- 172.21.15.31:0/2192865943 learned_addr learned my addr 172.21.15.31:0/2192865943 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:45.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd0567fc700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd05815a2b0 0x7fd0580c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd056ffd700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0580d1c30 0x7fd05815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd0577fe700 1 -- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0580d1c30 msgr2=0x7fd05815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd0577fe700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0580d1c30 0x7fd05815d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd0577fe700 1 -- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd05815a2b0 msgr2=0x7fd0580c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd0577fe700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd05815a2b0 0x7fd0580c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.757+0000 7fd0577fe700 1 -- 172.21.15.31:0/2192865943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd050009ae0 con 0x7fd05815a680 2023-10-09T06:32:45.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.758+0000 7fd0577fe700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05815a680 0x7fd0580c9910 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fd058089120 tx=0x7fd050018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.758+0000 7fd04effd700 1 -- 172.21.15.31:0/2192865943 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050008ad0 con 0x7fd05815a680 2023-10-09T06:32:45.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.758+0000 7fd04effd700 1 -- 172.21.15.31:0/2192865943 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd050008c50 con 0x7fd05815a680 2023-10-09T06:32:45.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.758+0000 7fd05d80e700 1 -- 172.21.15.31:0/2192865943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0580c8b50 con 0x7fd05815a680 2023-10-09T06:32:45.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.758+0000 7fd04effd700 1 -- 172.21.15.31:0/2192865943 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05001c410 con 0x7fd05815a680 2023-10-09T06:32:45.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.758+0000 7fd05d80e700 1 -- 172.21.15.31:0/2192865943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0580c9110 con 0x7fd05815a680 2023-10-09T06:32:45.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.759+0000 7fd05d80e700 1 -- 172.21.15.31:0/2192865943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0580c9630 con 0x7fd05815a680 2023-10-09T06:32:45.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.759+0000 7fd04effd700 1 -- 172.21.15.31:0/2192865943 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd050003040 con 0x7fd05815a680 2023-10-09T06:32:45.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.760+0000 7fd04effd700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd038066f30 0x7fd0380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:45.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.760+0000 7fd04effd700 1 -- 172.21.15.31:0/2192865943 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd050085820 con 0x7fd05815a680 2023-10-09T06:32:45.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.760+0000 7fd056ffd700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd038066f30 0x7fd0380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:45.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.761+0000 7fd056ffd700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd038066f30 0x7fd0380693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd048009d00 tx=0x7fd048009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:45.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.764+0000 7fd04effd700 1 -- 172.21.15.31:0/2192865943 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0580c9630 con 0x7fd05815a680 2023-10-09T06:32:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.957+0000 7fd05d80e700 1 -- 172.21.15.31:0/2192865943 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fd05804c3c0 con 0x7fd038066f30 2023-10-09T06:32:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.957+0000 7fd04effd700 1 -- 172.21.15.31:0/2192865943 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd05804c3c0 con 0x7fd038066f30 2023-10-09T06:32:45.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.959+0000 7fd05d80e700 1 -- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd038066f30 msgr2=0x7fd0380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.959+0000 7fd05d80e700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd038066f30 0x7fd0380693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd048009d00 tx=0x7fd048009120 comp rx=0 tx=0).stop 2023-10-09T06:32:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.959+0000 7fd05d80e700 1 -- 172.21.15.31:0/2192865943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05815a680 msgr2=0x7fd0580c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.959+0000 7fd05d80e700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05815a680 0x7fd0580c9910 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fd058089120 tx=0x7fd050018000 comp rx=0 tx=0).stop 2023-10-09T06:32:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.959+0000 7fd05d80e700 1 -- 172.21.15.31:0/2192865943 shutdown_connections 2023-10-09T06:32:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.959+0000 7fd05d80e700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fd038066f30 0x7fd0380693e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.959+0000 7fd05d80e700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fd0580d1c30 0x7fd05815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.959+0000 7fd05d80e700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05815a680 0x7fd0580c9910 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.959+0000 7fd05d80e700 1 --2- 172.21.15.31:0/2192865943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd05815a2b0 0x7fd0580c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.959+0000 7fd05d80e700 1 -- 172.21.15.31:0/2192865943 >> 172.21.15.31:0/2192865943 conn(0x7fd058067e40 msgr2=0x7fd0580b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.959+0000 7fd05d80e700 1 -- 172.21.15.31:0/2192865943 shutdown_connections 2023-10-09T06:32:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:45.960+0000 7fd05d80e700 1 -- 172.21.15.31:0/2192865943 wait complete. 2023-10-09T06:32:45.962 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 6 to deep-scrub 2023-10-09T06:32:45.972 INFO:tasks.ceph:Scrubbing osd.7 2023-10-09T06:32:45.972 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-09T06:32:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.095+0000 7ff338eed700 1 Processor -- start 2023-10-09T06:32:46.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.095+0000 7ff338eed700 1 -- start start 2023-10-09T06:32:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff338eed700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff334070950 0x7ff33406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff338eed700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff33415bf60 0x7ff334141050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff338eed700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33415c760 con 0x7ff334070d20 2023-10-09T06:32:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff338eed700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3340cafa0 con 0x7ff334070950 2023-10-09T06:32:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff338eed700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33415c480 con 0x7ff33415bf60 2023-10-09T06:32:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff33259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff334070950 0x7ff33406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff331d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff334070d20 0x7ff33415b850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60892/0 (socket says 172.21.15.31:60892) 2023-10-09T06:32:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff331d9b700 1 -- 172.21.15.31:0/2684232804 learned_addr learned my addr 172.21.15.31:0/2684232804 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff33259c700 1 -- 172.21.15.31:0/2684232804 >> v2:172.21.15.158:3300/0 conn(0x7ff33415bf60 msgr2=0x7ff334141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff332d9d700 1 --2- 172.21.15.31:0/2684232804 >> v2:172.21.15.158:3300/0 conn(0x7ff33415bf60 0x7ff334141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff33159a700 1 -- 172.21.15.31:0/2684232804 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239440366 0 0) 0x7ff33415c760 con 0x7ff334070d20 2023-10-09T06:32:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff33259c700 1 --2- 172.21.15.31:0/2684232804 >> v2:172.21.15.158:3300/0 conn(0x7ff33415bf60 0x7ff334141050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff33259c700 1 -- 172.21.15.31:0/2684232804 >> v1:172.21.15.31:6789/0 conn(0x7ff334070d20 legacy=0x7ff33415b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff33259c700 1 -- 172.21.15.31:0/2684232804 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33406e300 con 0x7ff334070950 2023-10-09T06:32:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.096+0000 7ff33259c700 1 --2- 172.21.15.31:0/2684232804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff334070950 0x7ff33406ede0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7ff3340b3d20 tx=0x7ff32c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66efaa6be57e390d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.097+0000 7ff33159a700 1 -- 172.21.15.31:0/2684232804 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00b6b0 con 0x7ff334070950 2023-10-09T06:32:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.097+0000 7ff33159a700 1 -- 172.21.15.31:0/2684232804 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c00b810 con 0x7ff334070950 2023-10-09T06:32:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.097+0000 7ff33159a700 1 -- 172.21.15.31:0/2684232804 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00bbb0 con 0x7ff334070950 2023-10-09T06:32:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.097+0000 7ff338eed700 1 -- 172.21.15.31:0/2684232804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff334070950 msgr2=0x7ff33406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.097+0000 7ff338eed700 1 --2- 172.21.15.31:0/2684232804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff334070950 0x7ff33406ede0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7ff3340b3d20 tx=0x7ff32c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.097+0000 7ff338eed700 1 -- 172.21.15.31:0/2684232804 shutdown_connections 2023-10-09T06:32:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.097+0000 7ff338eed700 1 --2- 172.21.15.31:0/2684232804 >> v2:172.21.15.158:3300/0 conn(0x7ff33415bf60 0x7ff334141050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.097+0000 7ff338eed700 1 --2- 172.21.15.31:0/2684232804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff334070950 0x7ff33406ede0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.097+0000 7ff338eed700 1 -- 172.21.15.31:0/2684232804 >> 172.21.15.31:0/2684232804 conn(0x7ff3340ce570 msgr2=0x7ff3340ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.097+0000 7ff338eed700 1 -- 172.21.15.31:0/2684232804 shutdown_connections 2023-10-09T06:32:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.097+0000 7ff338eed700 1 -- 172.21.15.31:0/2684232804 wait complete. 2023-10-09T06:32:46.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.098+0000 7ff338eed700 1 Processor -- start 2023-10-09T06:32:46.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.098+0000 7ff338eed700 1 -- start start 2023-10-09T06:32:46.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.099+0000 7ff338eed700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff334070950 0x7ff33415b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.099+0000 7ff338eed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff334070d20 0x7ff3341582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.099+0000 7ff338eed700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff33415bf60 0x7ff33416b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.099+0000 7ff338eed700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff334159680 con 0x7ff334070d20 2023-10-09T06:32:46.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.099+0000 7ff338eed700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3341587f0 con 0x7ff33415bf60 2023-10-09T06:32:46.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.099+0000 7ff338eed700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff334158a70 con 0x7ff334070950 2023-10-09T06:32:46.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.099+0000 7ff331d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff334070d20 0x7ff3341582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.099+0000 7ff331d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff334070d20 0x7ff3341582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58604/0 (socket says 172.21.15.31:58604) 2023-10-09T06:32:46.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.099+0000 7ff331d9b700 1 -- 172.21.15.31:0/3105436401 learned_addr learned my addr 172.21.15.31:0/3105436401 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:46.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.099+0000 7ff332d9d700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff33415bf60 0x7ff33416b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.099+0000 7ff331d9b700 1 -- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff334070950 msgr2=0x7ff33415b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.099+0000 7ff33259c700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff334070950 0x7ff33415b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.099+0000 7ff331d9b700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7ff334070950 0x7ff33415b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.100+0000 7ff331d9b700 1 -- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff33415bf60 msgr2=0x7ff33416b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.100+0000 7ff331d9b700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff33415bf60 0x7ff33416b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.100+0000 7ff331d9b700 1 -- 172.21.15.31:0/3105436401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c009420 con 0x7ff334070d20 2023-10-09T06:32:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.100+0000 7ff332d9d700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff33415bf60 0x7ff33416b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.100+0000 7ff331d9b700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff334070d20 0x7ff3341582b0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00c7e0 tx=0x7ff31c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.100+0000 7ff32a7fc700 1 -- 172.21.15.31:0/3105436401 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c005b30 con 0x7ff334070d20 2023-10-09T06:32:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.100+0000 7ff32a7fc700 1 -- 172.21.15.31:0/3105436401 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c005c90 con 0x7ff334070d20 2023-10-09T06:32:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.100+0000 7ff338eed700 1 -- 172.21.15.31:0/3105436401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff334158d50 con 0x7ff334070d20 2023-10-09T06:32:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.100+0000 7ff32a7fc700 1 -- 172.21.15.31:0/3105436401 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c007300 con 0x7ff334070d20 2023-10-09T06:32:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.100+0000 7ff338eed700 1 -- 172.21.15.31:0/3105436401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff334159310 con 0x7ff334070d20 2023-10-09T06:32:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.101+0000 7ff338eed700 1 -- 172.21.15.31:0/3105436401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff33404c3c0 con 0x7ff334070d20 2023-10-09T06:32:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.101+0000 7ff32a7fc700 1 -- 172.21.15.31:0/3105436401 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff31c01b400 con 0x7ff334070d20 2023-10-09T06:32:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.102+0000 7ff32a7fc700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff314066f30 0x7ff3140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.102+0000 7ff32a7fc700 1 -- 172.21.15.31:0/3105436401 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff31c083df0 con 0x7ff334070d20 2023-10-09T06:32:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.102+0000 7ff32a7fc700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] conn(0x7ff31406cd80 0x7ff31406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.102+0000 7ff32a7fc700 1 -- 172.21.15.31:0/3105436401 --> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff31406f860 con 0x7ff31406cd80 2023-10-09T06:32:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.102+0000 7ff32a7fc700 1 -- 172.21.15.31:0/3105436401 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff31c086350 con 0x7ff334070d20 2023-10-09T06:32:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.102+0000 7ff33259c700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff314066f30 0x7ff3140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.102+0000 7ff332d9d700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] conn(0x7ff31406cd80 0x7ff31406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.102+0000 7ff33259c700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff314066f30 0x7ff3140693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff32c003080 tx=0x7ff32c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.103+0000 7ff332d9d700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] conn(0x7ff31406cd80 0x7ff31406f190 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:46.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.103+0000 7ff32a7fc700 1 -- 172.21.15.31:0/3105436401 <== osd.7 v2:172.21.15.158:6824/86602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7ff31406f860 con 0x7ff31406cd80 2023-10-09T06:32:46.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.116+0000 7ff338eed700 1 -- 172.21.15.31:0/3105436401 --> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff33406e5e0 con 0x7ff31406cd80 2023-10-09T06:32:46.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.116+0000 7ff32a7fc700 1 -- 172.21.15.31:0/3105436401 <== osd.7 v2:172.21.15.158:6824/86602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7ff33406e5e0 con 0x7ff31406cd80 2023-10-09T06:32:46.117 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-10-09T06:32:46.117 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T06:32:46.117 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-10-09T06:32:46.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.117+0000 7ff338eed700 1 -- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] conn(0x7ff31406cd80 msgr2=0x7ff31406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.117+0000 7ff338eed700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:6824/86602,v1:172.21.15.158:6825/86602] conn(0x7ff31406cd80 0x7ff31406f190 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.117+0000 7ff338eed700 1 -- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff314066f30 msgr2=0x7ff3140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.117+0000 7ff338eed700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7ff314066f30 0x7ff3140693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff32c003080 tx=0x7ff32c017000 comp rx=0 tx=0).stop 2023-10-09T06:32:46.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.117+0000 7ff338eed700 1 -- 172.21.15.31:0/3105436401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff334070d20 msgr2=0x7ff3341582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.117+0000 7ff338eed700 1 --2- 172.21.15.31:0/3105436401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff334070d20 0x7ff3341582b0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00c7e0 tx=0x7ff31c007df0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.117+0000 7ff332d9d700 1 -- 172.21.15.31:0/3105436401 reap_dead start 2023-10-09T06:32:46.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.117+0000 7ff338eed700 1 -- 172.21.15.31:0/3105436401 shutdown_connections 2023-10-09T06:32:46.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.117+0000 7ff338eed700 1 -- 172.21.15.31:0/3105436401 >> 172.21.15.31:0/3105436401 conn(0x7ff3340ce570 msgr2=0x7ff33406eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:46.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.117+0000 7ff338eed700 1 -- 172.21.15.31:0/3105436401 shutdown_connections 2023-10-09T06:32:46.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.117+0000 7ff338eed700 1 -- 172.21.15.31:0/3105436401 wait complete. 2023-10-09T06:32:46.129 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-09T06:32:46.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.248+0000 7f9442085700 1 Processor -- start 2023-10-09T06:32:46.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.248+0000 7f9442085700 1 -- start start 2023-10-09T06:32:46.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.248+0000 7f9442085700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f943c1510f0 0x7f943c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.248+0000 7f9442085700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f943c0c9af0 0x7f943c15dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f9442085700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943c15e280 con 0x7f943c070700 2023-10-09T06:32:46.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f9442085700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c0ca0b0 con 0x7f943c1510f0 2023-10-09T06:32:46.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f9442085700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c068a10 con 0x7f943c0c9af0 2023-10-09T06:32:46.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f943c1510f0 0x7f943c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943bfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f943c070700 0x7f943c070b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60904/0 (socket says 172.21.15.31:60904) 2023-10-09T06:32:46.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943bfff700 1 -- 172.21.15.31:0/3019987706 learned_addr learned my addr 172.21.15.31:0/3019987706 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:46.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943b7fe700 1 --2- 172.21.15.31:0/3019987706 >> v2:172.21.15.31:3300/0 conn(0x7f943c1510f0 0x7f943c06ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58608/0 (socket says 172.21.15.31:58608) 2023-10-09T06:32:46.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943affd700 1 --2- 172.21.15.31:0/3019987706 >> v2:172.21.15.158:3300/0 conn(0x7f943c0c9af0 0x7f943c15dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943b7fe700 1 -- 172.21.15.31:0/3019987706 >> v2:172.21.15.158:3300/0 conn(0x7f943c0c9af0 msgr2=0x7f943c15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:46.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943b7fe700 1 --2- 172.21.15.31:0/3019987706 >> v2:172.21.15.158:3300/0 conn(0x7f943c0c9af0 0x7f943c15dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943b7fe700 1 -- 172.21.15.31:0/3019987706 >> v1:172.21.15.31:6789/0 conn(0x7f943c070700 legacy=0x7f943c070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943b7fe700 1 -- 172.21.15.31:0/3019987706 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c068cf0 con 0x7f943c1510f0 2023-10-09T06:32:46.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943a7fc700 1 -- 172.21.15.31:0/3019987706 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195811662 0 0) 0x7f943c15e280 con 0x7f943c070700 2023-10-09T06:32:46.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943affd700 1 --2- 172.21.15.31:0/3019987706 >> v2:172.21.15.158:3300/0 conn(0x7f943c0c9af0 0x7f943c15dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:32:46.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943b7fe700 1 --2- 172.21.15.31:0/3019987706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943c1510f0 0x7f943c06ecc0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f943c069b20 tx=0x7f942c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7c4ded55d2d6f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:46.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943a7fc700 1 -- 172.21.15.31:0/3019987706 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c00b6b0 con 0x7f943c1510f0 2023-10-09T06:32:46.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943a7fc700 1 -- 172.21.15.31:0/3019987706 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c00b810 con 0x7f943c1510f0 2023-10-09T06:32:46.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.249+0000 7f943a7fc700 1 -- 172.21.15.31:0/3019987706 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c00bbb0 con 0x7f943c1510f0 2023-10-09T06:32:46.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.250+0000 7f9442085700 1 -- 172.21.15.31:0/3019987706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943c1510f0 msgr2=0x7f943c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.250+0000 7f9442085700 1 --2- 172.21.15.31:0/3019987706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943c1510f0 0x7f943c06ecc0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f943c069b20 tx=0x7f942c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.250+0000 7f9442085700 1 -- 172.21.15.31:0/3019987706 shutdown_connections 2023-10-09T06:32:46.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.250+0000 7f9442085700 1 --2- 172.21.15.31:0/3019987706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943c1510f0 0x7f943c06ecc0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.250+0000 7f9442085700 1 --2- 172.21.15.31:0/3019987706 >> v2:172.21.15.158:3300/0 conn(0x7f943c0c9af0 0x7f943c15dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.250+0000 7f9442085700 1 -- 172.21.15.31:0/3019987706 >> 172.21.15.31:0/3019987706 conn(0x7f943c0ca4f0 msgr2=0x7f943c0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:46.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.250+0000 7f9442085700 1 -- 172.21.15.31:0/3019987706 shutdown_connections 2023-10-09T06:32:46.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.250+0000 7f9442085700 1 -- 172.21.15.31:0/3019987706 wait complete. 2023-10-09T06:32:46.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.251+0000 7f9442085700 1 Processor -- start 2023-10-09T06:32:46.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.251+0000 7f9442085700 1 -- start start 2023-10-09T06:32:46.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f9442085700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f943c070700 0x7f943c150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f9442085700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943c0c9af0 0x7f943c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f9442085700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f943c1510f0 0x7f943c15d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f9442085700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0c5fe0 con 0x7f943c0c9af0 2023-10-09T06:32:46.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f9442085700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0c62c0 con 0x7f943c070700 2023-10-09T06:32:46.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f9442085700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0c65a0 con 0x7f943c1510f0 2023-10-09T06:32:46.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f943affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943c0c9af0 0x7f943c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f943affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943c0c9af0 0x7f943c153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58620/0 (socket says 172.21.15.31:58620) 2023-10-09T06:32:46.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f943affd700 1 -- 172.21.15.31:0/2230580042 learned_addr learned my addr 172.21.15.31:0/2230580042 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:46.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f943b7fe700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f943c070700 0x7f943c150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f943bfff700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f943c1510f0 0x7f943c15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f943affd700 1 -- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f943c1510f0 msgr2=0x7f943c15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f943affd700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f943c1510f0 0x7f943c15d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f943affd700 1 -- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f943c070700 msgr2=0x7f943c150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f943affd700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f943c070700 0x7f943c150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.252+0000 7f943affd700 1 -- 172.21.15.31:0/2230580042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c009420 con 0x7f943c0c9af0 2023-10-09T06:32:46.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.253+0000 7f943affd700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943c0c9af0 0x7f943c153b40 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f943000e8d0 tx=0x7f9430008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:46.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.253+0000 7f94237fe700 1 -- 172.21.15.31:0/2230580042 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943000ee70 con 0x7f943c0c9af0 2023-10-09T06:32:46.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.253+0000 7f94237fe700 1 -- 172.21.15.31:0/2230580042 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943000c5e0 con 0x7f943c0c9af0 2023-10-09T06:32:46.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.253+0000 7f94237fe700 1 -- 172.21.15.31:0/2230580042 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943000c980 con 0x7f943c0c9af0 2023-10-09T06:32:46.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.253+0000 7f9442085700 1 -- 172.21.15.31:0/2230580042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c0c6880 con 0x7f943c0c9af0 2023-10-09T06:32:46.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.253+0000 7f9442085700 1 -- 172.21.15.31:0/2230580042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c150950 con 0x7f943c0c9af0 2023-10-09T06:32:46.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.254+0000 7f9442085700 1 -- 172.21.15.31:0/2230580042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943c04c3c0 con 0x7f943c0c9af0 2023-10-09T06:32:46.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.254+0000 7f94237fe700 1 -- 172.21.15.31:0/2230580042 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9430013410 con 0x7f943c0c9af0 2023-10-09T06:32:46.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.254+0000 7f94237fe700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9428066f30 0x7f94280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.255+0000 7f94237fe700 1 -- 172.21.15.31:0/2230580042 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9430084010 con 0x7f943c0c9af0 2023-10-09T06:32:46.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.255+0000 7f943b7fe700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9428066f30 0x7f94280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.255+0000 7f943b7fe700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9428066f30 0x7f94280693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f942c0093f0 tx=0x7f942c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:46.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.259+0000 7f94237fe700 1 -- 172.21.15.31:0/2230580042 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9430055010 con 0x7f943c0c9af0 2023-10-09T06:32:46.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.451+0000 7f9442085700 1 -- 172.21.15.31:0/2230580042 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f943c06b620 con 0x7f9428066f30 2023-10-09T06:32:46.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.451+0000 7f94237fe700 1 -- 172.21.15.31:0/2230580042 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f943c06b620 con 0x7f9428066f30 2023-10-09T06:32:46.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.453+0000 7f9442085700 1 -- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9428066f30 msgr2=0x7f94280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.453+0000 7f9442085700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9428066f30 0x7f94280693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f942c0093f0 tx=0x7f942c017000 comp rx=0 tx=0).stop 2023-10-09T06:32:46.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.453+0000 7f9442085700 1 -- 172.21.15.31:0/2230580042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943c0c9af0 msgr2=0x7f943c153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.453+0000 7f9442085700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943c0c9af0 0x7f943c153b40 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f943000e8d0 tx=0x7f9430008040 comp rx=0 tx=0).stop 2023-10-09T06:32:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.453+0000 7f9442085700 1 -- 172.21.15.31:0/2230580042 shutdown_connections 2023-10-09T06:32:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.453+0000 7f9442085700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f9428066f30 0x7f94280693e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.453+0000 7f9442085700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f943c1510f0 0x7f943c15d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.453+0000 7f9442085700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f943c070700 0x7f943c150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.453+0000 7f9442085700 1 --2- 172.21.15.31:0/2230580042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943c0c9af0 0x7f943c153b40 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.453+0000 7f9442085700 1 -- 172.21.15.31:0/2230580042 >> 172.21.15.31:0/2230580042 conn(0x7f943c0ca4f0 msgr2=0x7f943c0ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.453+0000 7f9442085700 1 -- 172.21.15.31:0/2230580042 shutdown_connections 2023-10-09T06:32:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.453+0000 7f9442085700 1 -- 172.21.15.31:0/2230580042 wait complete. 2023-10-09T06:32:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 7 to deep-scrub 2023-10-09T06:32:46.466 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:32:46.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.584+0000 7f2bb856c700 1 Processor -- start 2023-10-09T06:32:46.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.584+0000 7f2bb856c700 1 -- start start 2023-10-09T06:32:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.585+0000 7f2bb856c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2bb015a620 0x7f2bb015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.585+0000 7f2bb856c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2bb015d580 0x7f2bb0158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.585+0000 7f2bb856c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb015cbb0 con 0x7f2bb0157870 2023-10-09T06:32:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.585+0000 7f2bb856c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb015bdb0 con 0x7f2bb015a620 2023-10-09T06:32:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.585+0000 7f2bb856c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb015bfa0 con 0x7f2bb015d580 2023-10-09T06:32:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.585+0000 7f2bb5b07700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2bb015a620 0x7f2bb015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.585+0000 7f2bb6308700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2bb0157870 0x7f2bb015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60914/0 (socket says 172.21.15.31:60914) 2023-10-09T06:32:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.585+0000 7f2bb6308700 1 -- 172.21.15.31:0/899100361 learned_addr learned my addr 172.21.15.31:0/899100361 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:32:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.586+0000 7f2bb6b09700 1 --2- 172.21.15.31:0/899100361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2bb015d580 0x7f2bb0158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.586+0000 7f2bb5b07700 1 -- 172.21.15.31:0/899100361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2bb015d580 msgr2=0x7f2bb0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:32:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.586+0000 7f2bb5b07700 1 --2- 172.21.15.31:0/899100361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2bb015d580 0x7f2bb0158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.586+0000 7f2bb5b07700 1 -- 172.21.15.31:0/899100361 >> v1:172.21.15.31:6789/0 conn(0x7f2bb0157870 legacy=0x7f2bb015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.586+0000 7f2bb5b07700 1 -- 172.21.15.31:0/899100361 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb015c280 con 0x7f2bb015a620 2023-10-09T06:32:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.586+0000 7f2bb6b09700 1 --2- 172.21.15.31:0/899100361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2bb015d580 0x7f2bb0158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.586+0000 7f2bb5b07700 1 --2- 172.21.15.31:0/899100361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb015a620 0x7f2bb015d040 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40098e0 tx=0x7f2ba40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222f5d7a1e8719a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.586+0000 7f2bb5306700 1 -- 172.21.15.31:0/899100361 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4009e80 con 0x7f2bb015a620 2023-10-09T06:32:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.586+0000 7f2bb5306700 1 -- 172.21.15.31:0/899100361 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba400b860 con 0x7f2bb015a620 2023-10-09T06:32:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.586+0000 7f2bb5306700 1 -- 172.21.15.31:0/899100361 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba400bbe0 con 0x7f2bb015a620 2023-10-09T06:32:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.586+0000 7f2bb856c700 1 -- 172.21.15.31:0/899100361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb015a620 msgr2=0x7f2bb015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.586+0000 7f2bb856c700 1 --2- 172.21.15.31:0/899100361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb015a620 0x7f2bb015d040 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40098e0 tx=0x7f2ba40091a0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.587+0000 7f2bb856c700 1 -- 172.21.15.31:0/899100361 shutdown_connections 2023-10-09T06:32:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.587+0000 7f2bb856c700 1 --2- 172.21.15.31:0/899100361 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2bb015d580 0x7f2bb0158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.587+0000 7f2bb856c700 1 --2- 172.21.15.31:0/899100361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb015a620 0x7f2bb015d040 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.587+0000 7f2bb856c700 1 -- 172.21.15.31:0/899100361 >> 172.21.15.31:0/899100361 conn(0x7f2bb0068ce0 msgr2=0x7f2bb00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.587+0000 7f2bb856c700 1 -- 172.21.15.31:0/899100361 shutdown_connections 2023-10-09T06:32:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.587+0000 7f2bb856c700 1 -- 172.21.15.31:0/899100361 wait complete. 2023-10-09T06:32:46.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.588+0000 7f2bb856c700 1 Processor -- start 2023-10-09T06:32:46.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.588+0000 7f2bb856c700 1 -- start start 2023-10-09T06:32:46.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.588+0000 7f2bb856c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb0157870 0x7f2bb014ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.588+0000 7f2bb856c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2bb015a620 0x7f2bb014ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.588+0000 7f2bb856c700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2bb015d580 0x7f2bb01531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.588+0000 7f2bb856c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb014d900 con 0x7f2bb0157870 2023-10-09T06:32:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.588+0000 7f2bb856c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb014dbe0 con 0x7f2bb015a620 2023-10-09T06:32:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.588+0000 7f2bb856c700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb014dec0 con 0x7f2bb015d580 2023-10-09T06:32:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb6308700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb0157870 0x7f2bb014ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb6308700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb0157870 0x7f2bb014ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58648/0 (socket says 172.21.15.31:58648) 2023-10-09T06:32:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb6308700 1 -- 172.21.15.31:0/1438467080 learned_addr learned my addr 172.21.15.31:0/1438467080 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:32:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb6b09700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2bb015d580 0x7f2bb01531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb5b07700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2bb015a620 0x7f2bb014ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb6308700 1 -- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2bb015d580 msgr2=0x7f2bb01531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb6308700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2bb015d580 0x7f2bb01531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb6308700 1 -- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2bb015a620 msgr2=0x7f2bb014ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb6308700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2bb015a620 0x7f2bb014ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb6308700 1 -- 172.21.15.31:0/1438467080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4009420 con 0x7f2bb0157870 2023-10-09T06:32:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb5b07700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2bb015a620 0x7f2bb014ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:32:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb6308700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb0157870 0x7f2bb014ec80 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000cd30 tx=0x7f2ba0001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bae7fc700 1 -- 172.21.15.31:0/1438467080 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0004bb0 con 0x7f2bb0157870 2023-10-09T06:32:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bae7fc700 1 -- 172.21.15.31:0/1438467080 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba0004d10 con 0x7f2bb0157870 2023-10-09T06:32:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb856c700 1 -- 172.21.15.31:0/1438467080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb014e1a0 con 0x7f2bb0157870 2023-10-09T06:32:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bae7fc700 1 -- 172.21.15.31:0/1438467080 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000adc0 con 0x7f2bb0157870 2023-10-09T06:32:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.589+0000 7f2bb856c700 1 -- 172.21.15.31:0/1438467080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb014e760 con 0x7f2bb0157870 2023-10-09T06:32:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.590+0000 7f2bb856c700 1 -- 172.21.15.31:0/1438467080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb014e980 con 0x7f2bb0157870 2023-10-09T06:32:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.591+0000 7f2bae7fc700 1 -- 172.21.15.31:0/1438467080 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ba0007300 con 0x7f2bb0157870 2023-10-09T06:32:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.591+0000 7f2bae7fc700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2b9c066f30 0x7f2b9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:32:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.591+0000 7f2bae7fc700 1 -- 172.21.15.31:0/1438467080 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2ba0083c50 con 0x7f2bb0157870 2023-10-09T06:32:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.591+0000 7f2bb5b07700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2b9c066f30 0x7f2b9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:32:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.592+0000 7f2bb5b07700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2b9c066f30 0x7f2b9c0693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2bb015aa20 tx=0x7f2ba4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:32:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.595+0000 7f2bae7fc700 1 -- 172.21.15.31:0/1438467080 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ba0089020 con 0x7f2bb0157870 2023-10-09T06:32:46.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.785+0000 7f2bb856c700 1 -- 172.21.15.31:0/1438467080 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2bb004c3c0 con 0x7f2b9c066f30 2023-10-09T06:32:46.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.788+0000 7f2bae7fc700 1 -- 172.21.15.31:0/1438467080 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49940 (secure 0 0 0) 0x7f2bb004c3c0 con 0x7f2b9c066f30 2023-10-09T06:32:46.789 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:32:46.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.790+0000 7f2bb856c700 1 -- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2b9c066f30 msgr2=0x7f2b9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.790+0000 7f2bb856c700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2b9c066f30 0x7f2b9c0693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2bb015aa20 tx=0x7f2ba4017000 comp rx=0 tx=0).stop 2023-10-09T06:32:46.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.790+0000 7f2bb856c700 1 -- 172.21.15.31:0/1438467080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb0157870 msgr2=0x7f2bb014ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:32:46.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.790+0000 7f2bb856c700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb0157870 0x7f2bb014ec80 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000cd30 tx=0x7f2ba0001ad0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.790+0000 7f2bb856c700 1 -- 172.21.15.31:0/1438467080 shutdown_connections 2023-10-09T06:32:46.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.790+0000 7f2bb856c700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f2b9c066f30 0x7f2b9c0693e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.790+0000 7f2bb856c700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f2bb015d580 0x7f2bb01531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.790+0000 7f2bb856c700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb0157870 0x7f2bb014ec80 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.790+0000 7f2bb856c700 1 --2- 172.21.15.31:0/1438467080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2bb015a620 0x7f2bb014ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:32:46.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.790+0000 7f2bb856c700 1 -- 172.21.15.31:0/1438467080 >> 172.21.15.31:0/1438467080 conn(0x7f2bb0068ce0 msgr2=0x7f2bb0159470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:32:46.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.790+0000 7f2bb856c700 1 -- 172.21.15.31:0/1438467080 shutdown_connections 2023-10-09T06:32:46.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:32:46.790+0000 7f2bb856c700 1 -- 172.21.15.31:0/1438467080 wait complete. 2023-10-09T06:32:46.792 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:32:46.802 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":543,"stamp":"2023-10-09T06:32:46.689605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9546,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552953,"statfs":{"total":1600000000,"available":1590224728,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.878350"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":312,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-09T06:32:36.937686+0000","last_change":"2023-10-09T06:20:44.429176+0000","last_active":"2023-10-09T06:32:36.937686+0000","last_peered":"2023-10-09T06:32:36.937686+0000","last_clean":"2023-10-09T06:32:36.937686+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:32:36.937686+0000","last_undegraded":"2023-10-09T06:32:36.937686+0000","last_fullsized":"2023-10-09T06:32:36.937686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:20:43.322922+0000","last_clean_scrub_stamp":"2023-10-09T06:20:43.322922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.953634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335315,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.52700000000000002},"min":{"1min":0.36399999999999999,"5min":0.34200000000000003,"15min":0.28999999999999998},"max":{"1min":0.71399999999999997,"5min":0.81299999999999994,"15min":1.5469999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.35199999999999998,"5min":0.29299999999999998,"15min":0.28100000000000003},"max":{"1min":0.73299999999999998,"5min":0.78700000000000003,"15min":3.6970000000000001},"last":0.56699999999999995}]},{"osd":1,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55800000000000005,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.311,"15min":0.29899999999999999},"max":{"1min":0.69199999999999995,"5min":0.80400000000000005,"15min":0.88100000000000001},"last":0.621},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.26800000000000002},"max":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":1.4870000000000001},"last":0.5}]},{"osd":2,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.45800000000000002,"5min":0.435,"15min":0.34300000000000003},"max":{"1min":0.78200000000000003,"5min":0.79900000000000004,"15min":2.6139999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.56499999999999995},"min":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.78700000000000003,"15min":2.6019999999999999},"last":0.51900000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.318},"max":{"1min":0.67100000000000004,"5min":0.78600000000000003,"15min":7.4729999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":7.8390000000000004},"last":0.59599999999999997}]},{"osd":4,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.23799999999999999},"max":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.872},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.307,"15min":0.25600000000000001},"max":{"1min":0.70999999999999996,"5min":0.76900000000000002,"15min":0.86099999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.255},"max":{"1min":0.69499999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.75600000000000001,"15min":0.98699999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.35499999999999998},"max":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.93999999999999995},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29199999999999998},"max":{"1min":0.755,"5min":0.79900000000000004,"15min":0.91400000000000003},"last":0.65400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55900000000000005,"15min":0.64500000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.26900000000000002},"max":{"1min":0.76200000000000001,"5min":0.76700000000000002,"15min":7.0960000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.371,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.79800000000000004,"15min":1.133},"last":0.51200000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.83299999999999996,"5min":0.84399999999999997,"15min":1.155},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.317},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":1.1459999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":0.63700000000000001,"5min":0.746,"15min":1.2290000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.66500000000000004},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.308},"max":{"1min":0.81699999999999995,"5min":0.86599999999999999,"15min":7.1299999999999999},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.34499999999999997},"max":{"1min":0.68400000000000005,"5min":0.83499999999999996,"15min":1.337},"last":0.437},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.80100000000000005,"15min":1.206},"last":0.53000000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.46500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28000000000000003},"max":{"1min":0.67400000000000004,"5min":0.749,"15min":0.75900000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68100000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54300000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":0.54600000000000004,"5min":0.71999999999999997,"15min":0.80000000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68600000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55100000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.72899999999999998,"5min":0.81100000000000005,"15min":0.81299999999999994},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.77900000000000003,"15min":0.82399999999999995},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.219},"max":{"1min":0.441,"5min":0.58999999999999997,"15min":0.64000000000000001},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.38100000000000001,"15min":0.35899999999999999},"min":{"1min":0.27600000000000002,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.55900000000000005,"5min":0.61499999999999999,"15min":0.93300000000000005},"last":0.30599999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36299999999999999,"15min":0.35299999999999998},"min":{"1min":0.247,"5min":0.218,"15min":0.218},"max":{"1min":0.50600000000000001,"5min":0.71399999999999997,"15min":0.82299999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42699999999999999,"15min":0.40400000000000003},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.247},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.70899999999999996},"last":0.33500000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47699999999999998,"15min":0.443},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.29199999999999998},"max":{"1min":0.64300000000000002,"5min":0.751,"15min":0.751},"last":0.372},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.437},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.90500000000000003},"last":0.34799999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.315},"max":{"1min":0.90000000000000002,"5min":0.95699999999999996,"15min":1.097},"last":0.495},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.70499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81699999999999995,"5min":0.97699999999999998,"15min":5.5270000000000001},"last":0.41999999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65700000000000003,"15min":0.64000000000000001},"min":{"1min":0.53800000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.0069999999999999,"5min":1.0669999999999999,"15min":1.125},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.65600000000000003},"min":{"1min":0.51900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":1,"15min":1.4219999999999999},"last":0.44400000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66100000000000003,"15min":0.64000000000000001},"min":{"1min":0.55600000000000005,"5min":0.45500000000000002,"15min":0.39300000000000002},"max":{"1min":0.96399999999999997,"5min":1.0029999999999999,"15min":1.0629999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":0.94799999999999995,"15min":1.49},"last":0.53500000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65300000000000002},"min":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":1.016,"15min":1.016},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.51200000000000001,"5min":0.44700000000000001,"15min":0.41599999999999998},"max":{"1min":0.91600000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.46999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335315,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.20599999999999999},"max":{"1min":0.56499999999999995,"5min":0.71599999999999997,"15min":1.226},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.20599999999999999},"max":{"1min":0.68300000000000005,"5min":0.82999999999999996,"15min":1.131},"last":0.502}]},{"osd":2,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.67300000000000004},"min":{"1min":0.32500000000000001,"5min":0.28299999999999997,"15min":0.25800000000000001},"max":{"1min":0.629,"5min":0.63600000000000001,"15min":12.929},"last":0.437},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.441},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.59399999999999997,"5min":0.751,"15min":1.1599999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.35299999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71699999999999997,"5min":0.78100000000000003,"15min":1.1859999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.36099999999999999,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":1.3089999999999999},"last":0.62}]},{"osd":4,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.44400000000000001,"5min":0.40799999999999997,"15min":0.36599999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.335},"last":0.70999999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65100000000000002,"15min":0.626},"min":{"1min":0.437,"5min":0.40100000000000002,"15min":0.35499999999999998},"max":{"1min":0.95399999999999996,"5min":1.016,"15min":1.0580000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64300000000000002,"15min":0.61799999999999999},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.317},"max":{"1min":0.877,"5min":0.98599999999999999,"15min":0.999},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63300000000000001,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.92200000000000004,"5min":1.05,"15min":1.05},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.67200000000000004},"min":{"1min":0.50800000000000001,"5min":0.41499999999999998,"15min":0.374},"max":{"1min":1.0209999999999999,"5min":1.032,"15min":1.2849999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70299999999999996,"15min":0.67800000000000005},"min":{"1min":0.497,"5min":0.43099999999999999,"15min":0.40400000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.262},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.66900000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":1.0660000000000001,"15min":1.103},"last":0.77800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35499999999999998,"15min":0.59499999999999997},"min":{"1min":0.22900000000000001,"5min":0.20699999999999999,"15min":0.19800000000000001},"max":{"1min":0.55200000000000005,"5min":0.65000000000000002,"15min":14.981999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38400000000000001,"15min":0.51400000000000001},"min":{"1min":0.26300000000000001,"5min":0.252,"15min":0.22},"max":{"1min":0.58699999999999997,"5min":0.63900000000000001,"15min":9.1600000000000001},"last":0.38700000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.372,"15min":0.48799999999999999},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.222},"max":{"1min":0.53000000000000003,"5min":0.59199999999999997,"15min":8.4930000000000003},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41699999999999998,"15min":0.55400000000000005},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.254},"max":{"1min":0.63800000000000001,"5min":0.67800000000000005,"15min":9.0239999999999991},"last":0.46300000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45500000000000002,"15min":0.56499999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":8.5190000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.67300000000000004},"min":{"1min":0.35499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.622,"5min":0.748,"15min":15.007999999999999},"last":0.37}]},{"osd":4,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.64000000000000001,"15min":0.86599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":14.917999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.65000000000000002,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.40899999999999997},"max":{"1min":0.89800000000000002,"5min":0.90400000000000003,"15min":8.9930000000000003},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.76000000000000001},"min":{"1min":0.41199999999999998,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.84699999999999998,"5min":0.94599999999999995,"15min":8.9610000000000003},"last":0.505},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66500000000000004,"15min":0.77300000000000002},"min":{"1min":0.48499999999999999,"5min":0.45100000000000001,"15min":0.35099999999999998},"max":{"1min":0.85999999999999999,"5min":1.03,"15min":8.3919999999999995},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.75900000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.39900000000000002},"max":{"1min":0.82699999999999996,"5min":0.97299999999999998,"15min":8.4339999999999993},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67300000000000004,"15min":0.88100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.374},"max":{"1min":0.88200000000000001,"5min":0.99099999999999999,"15min":14.954000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.751},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36199999999999999},"max":{"1min":0.80100000000000005,"5min":0.90600000000000003,"15min":8.9160000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.76600000000000001},"min":{"1min":0.435,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":0.91400000000000003,"5min":0.91700000000000004,"15min":8.4640000000000004},"last":0.51800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38200000000000001,"15min":0.35399999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":0.48099999999999998,"5min":0.56100000000000005,"15min":0.66800000000000004},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.34000000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.38400000000000001,"15min":0.35099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.215},"max":{"1min":0.497,"5min":0.60699999999999998,"15min":0.623},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.43099999999999999,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23699999999999999},"max":{"1min":0.49299999999999999,"5min":0.66600000000000004,"15min":0.68899999999999995},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42199999999999999,"15min":0.38800000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.252},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.497,"15min":0.45700000000000002},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.28399999999999997},"max":{"1min":0.63700000000000001,"5min":0.71799999999999997,"15min":0.75700000000000001},"last":0.40999999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89100000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65500000000000003,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.33400000000000002},"max":{"1min":0.877,"5min":1.073,"15min":1.073},"last":0.56100000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67900000000000005,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.33600000000000002},"max":{"1min":0.81499999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69199999999999995,"15min":0.64600000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":1.097,"15min":1.097},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.66900000000000004,"15min":0.61699999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.69099999999999995,"15min":0.64000000000000001},"min":{"1min":0.441,"5min":0.434,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.49099999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67500000000000004,"15min":0.628},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.83599999999999997,"5min":1.139,"15min":1.139},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.69699999999999995,"15min":0.64400000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":1.026,"15min":1.026},"last":0.55200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.442},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.318},"max":{"1min":0.66100000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.65500000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.254},"max":{"1min":0.73899999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55100000000000005,"15min":0.625},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.752,"5min":0.754,"15min":4.3250000000000002},"last":0.51200000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.622},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.73799999999999999,"5min":0.77900000000000003,"15min":4.7320000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55800000000000005,"15min":0.79500000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.32600000000000001},"max":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":11.715},"last":0.57899999999999996}]},{"osd":3,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57399999999999995,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76300000000000001,"5min":0.77700000000000002,"15min":0.79100000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.39000000000000001},"max":{"1min":0.77300000000000002,"5min":0.81499999999999995,"15min":0.85599999999999998},"last":0.59699999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47099999999999997,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.82799999999999996},"last":0.61199999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48199999999999998,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.63200000000000001,"5min":0.80400000000000005,"15min":0.86699999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52300000000000002,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.64400000000000002,"5min":0.74299999999999999,"15min":0.84999999999999998},"last":0.67900000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.39100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72399999999999998,"5min":0.81599999999999995,"15min":0.879},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.376,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.81299999999999994,"15min":0.88600000000000001},"last":0.626}]}]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.82899999999999996,"15min":1.0289999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73099999999999998,"5min":0.77200000000000002,"15min":0.81899999999999995},"last":0.36499999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.82299999999999995,"15min":1.093},"last":0.502},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57099999999999995,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.85499999999999998},"last":0.40899999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70499999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.36699999999999999,"15min":0.36299999999999999},"max":{"1min":0.75700000000000001,"5min":0.79800000000000004,"15min":0.89300000000000002},"last":0.54500000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59999999999999998,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98699999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.071},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45600000000000002,"15min":0.48299999999999998},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.84399999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.48999999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.51200000000000001},"min":{"1min":0.34499999999999997,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.0680000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.42499999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.88,"5min":0.88,"15min":1.0920000000000001},"last":0.57999999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.317,"15min":0.30399999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.91900000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.0269999999999999},"last":0.44800000000000001}]}]}],"pool_statfs":[]}} 2023-10-09T06:32:46.839 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-09T06:20:43.322922+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=9, tm_hour=6, tm_min=20, tm_sec=43, tm_wday=0, tm_yday=282, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=9, tm_hour=6, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=282, tm_isdst=0) 2023-10-09T06:32:46.839 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-09T06:32:57.406 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:32:57.410 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:33:06.840 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:33:06.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.973+0000 7fa53eca0700 1 Processor -- start 2023-10-09T06:33:06.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.973+0000 7fa53eca0700 1 -- start start 2023-10-09T06:33:06.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa53eca0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa538159e10 0x7fa5380b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:06.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa53eca0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53815db80 con 0x7fa53815a1e0 2023-10-09T06:33:06.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa53eca0700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53815de60 con 0x7fa5380cde50 2023-10-09T06:33:06.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa53eca0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53815e800 con 0x7fa538159e10 2023-10-09T06:33:06.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa537fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa53815a1e0 0x7fa5380cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37630/0 (socket says 172.21.15.31:37630) 2023-10-09T06:33:06.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa537fff700 1 -- 172.21.15.31:0/1954212453 learned_addr learned my addr 172.21.15.31:0/1954212453 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:33:06.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa53ca3c700 1 --2- 172.21.15.31:0/1954212453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa538159e10 0x7fa5380b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:06.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490741127 0 0) 0x7fa53815db80 con 0x7fa53815a1e0 2023-10-09T06:33:06.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa528003570 con 0x7fa53815a1e0 2023-10-09T06:33:06.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2978744279 0 0) 0x7fa528003570 con 0x7fa53815a1e0 2023-10-09T06:33:06.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa538159e10 msgr2=0x7fa5380b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:33:06.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa5377fe700 1 --2- 172.21.15.31:0/1954212453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa538159e10 0x7fa5380b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:06.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 >> v1:172.21.15.158:6789/0 conn(0x7fa5380cde50 legacy=0x7fa5380cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:06.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53815e140 con 0x7fa53815a1e0 2023-10-09T06:33:06.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.974+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7fa524001490 con 0x7fa53815a1e0 2023-10-09T06:33:06.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 >> v1:172.21.15.31:6789/0 conn(0x7fa53815a1e0 legacy=0x7fa5380cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:06.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa5377fe700 1 --2- 172.21.15.31:0/1954212453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa528003a90 0x7fa528003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:06.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa5377fe700 1 --2- 172.21.15.31:0/1954212453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa528004810 0x7fa528004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:06.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa5377fe700 1 --2- 172.21.15.31:0/1954212453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa538159e10 0x7fa5280051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:06.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53815e800 con 0x7fa528003a90 2023-10-09T06:33:06.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52800bb60 con 0x7fa528004810 2023-10-09T06:33:06.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52800bd20 con 0x7fa538159e10 2023-10-09T06:33:06.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa53ca3c700 1 --2- 172.21.15.31:0/1954212453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa528003a90 0x7fa528003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:06.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa537fff700 1 --2- 172.21.15.31:0/1954212453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa528004810 0x7fa528004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:06.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa53d23d700 1 --2- 172.21.15.31:0/1954212453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa538159e10 0x7fa5280051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:06.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa53ca3c700 1 -- 172.21.15.31:0/1954212453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa538159e10 msgr2=0x7fa5280051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:33:06.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa53ca3c700 1 --2- 172.21.15.31:0/1954212453 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa538159e10 0x7fa5280051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:06.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa53ca3c700 1 -- 172.21.15.31:0/1954212453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa528004810 msgr2=0x7fa528004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:33:06.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa53ca3c700 1 --2- 172.21.15.31:0/1954212453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa528004810 0x7fa528004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:06.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa53ca3c700 1 -- 172.21.15.31:0/1954212453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa528003570 con 0x7fa528003a90 2023-10-09T06:33:06.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa537fff700 1 --2- 172.21.15.31:0/1954212453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa528004810 0x7fa528004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:33:06.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa53ca3c700 1 --2- 172.21.15.31:0/1954212453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa528003a90 0x7fa528003ea0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009c00 tx=0x7fa52c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8e284655b77ba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:33:06.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00e710 con 0x7fa528003a90 2023-10-09T06:33:06.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c00e870 con 0x7fa528003a90 2023-10-09T06:33:06.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.975+0000 7fa5377fe700 1 -- 172.21.15.31:0/1954212453 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00ec30 con 0x7fa528003a90 2023-10-09T06:33:06.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.976+0000 7fa53eca0700 1 -- 172.21.15.31:0/1954212453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa528003a90 msgr2=0x7fa528003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:06.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.976+0000 7fa53eca0700 1 --2- 172.21.15.31:0/1954212453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa528003a90 0x7fa528003ea0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009c00 tx=0x7fa52c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:33:06.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.976+0000 7fa53d23d700 1 -- 172.21.15.31:0/1954212453 reap_dead start 2023-10-09T06:33:06.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.976+0000 7fa53eca0700 1 -- 172.21.15.31:0/1954212453 shutdown_connections 2023-10-09T06:33:06.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.976+0000 7fa53eca0700 1 -- 172.21.15.31:0/1954212453 >> 172.21.15.31:0/1954212453 conn(0x7fa538067660 msgr2=0x7fa538067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:33:06.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.976+0000 7fa53eca0700 1 -- 172.21.15.31:0/1954212453 shutdown_connections 2023-10-09T06:33:06.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.976+0000 7fa53eca0700 1 -- 172.21.15.31:0/1954212453 wait complete. 2023-10-09T06:33:06.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.977+0000 7fa53eca0700 1 Processor -- start 2023-10-09T06:33:06.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.977+0000 7fa53eca0700 1 -- start start 2023-10-09T06:33:06.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53eca0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa528003a90 0x7fa5380c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:06.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53eca0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5380cf840 0x7fa5380c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:06.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53eca0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa538156890 0x7fa5380c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:06.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53eca0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5380ca890 con 0x7fa538156890 2023-10-09T06:33:06.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53eca0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5380c5d00 con 0x7fa528003a90 2023-10-09T06:33:06.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53eca0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5380c6280 con 0x7fa5380cf840 2023-10-09T06:33:06.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53d23d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa538156890 0x7fa5380c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:06.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53d23d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa538156890 0x7fa5380c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45286/0 (socket says 172.21.15.31:45286) 2023-10-09T06:33:06.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53d23d700 1 -- 172.21.15.31:0/3978280877 learned_addr learned my addr 172.21.15.31:0/3978280877 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:33:06.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa537fff700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5380cf840 0x7fa5380c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:06.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53ca3c700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa528003a90 0x7fa5380c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:06.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53d23d700 1 -- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5380cf840 msgr2=0x7fa5380c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:06.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53d23d700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5380cf840 0x7fa5380c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:06.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53d23d700 1 -- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa528003a90 msgr2=0x7fa5380c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53d23d700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa528003a90 0x7fa5380c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.978+0000 7fa53d23d700 1 -- 172.21.15.31:0/3978280877 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5380cb060 con 0x7fa538156890 2023-10-09T06:33:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.979+0000 7fa53d23d700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa538156890 0x7fa5380c8d00 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fa530007fd0 tx=0x7fa530009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:33:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.979+0000 7fa534ff9700 1 -- 172.21.15.31:0/3978280877 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5300032e0 con 0x7fa538156890 2023-10-09T06:33:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.979+0000 7fa534ff9700 1 -- 172.21.15.31:0/3978280877 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa530001580 con 0x7fa538156890 2023-10-09T06:33:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.979+0000 7fa534ff9700 1 -- 172.21.15.31:0/3978280877 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530003440 con 0x7fa538156890 2023-10-09T06:33:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.979+0000 7fa53eca0700 1 -- 172.21.15.31:0/3978280877 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5380caaa0 con 0x7fa538156890 2023-10-09T06:33:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.979+0000 7fa53eca0700 1 -- 172.21.15.31:0/3978280877 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5380c5f10 con 0x7fa538156890 2023-10-09T06:33:06.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.980+0000 7fa53eca0700 1 -- 172.21.15.31:0/3978280877 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5380c60d0 con 0x7fa538156890 2023-10-09T06:33:06.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.980+0000 7fa534ff9700 1 -- 172.21.15.31:0/3978280877 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa530001b50 con 0x7fa538156890 2023-10-09T06:33:06.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.981+0000 7fa534ff9700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa51c066f30 0x7fa51c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:06.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.981+0000 7fa534ff9700 1 -- 172.21.15.31:0/3978280877 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa530083790 con 0x7fa538156890 2023-10-09T06:33:06.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.981+0000 7fa53ca3c700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa51c066f30 0x7fa51c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:06.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.981+0000 7fa53ca3c700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa51c066f30 0x7fa51c0693e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009ad0 tx=0x7fa52c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:33:06.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:06.985+0000 7fa534ff9700 1 -- 172.21.15.31:0/3978280877 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa530050d00 con 0x7fa538156890 2023-10-09T06:33:07.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.175+0000 7fa53eca0700 1 -- 172.21.15.31:0/3978280877 --> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa53804c3c0 con 0x7fa51c066f30 2023-10-09T06:33:07.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.178+0000 7fa534ff9700 1 -- 172.21.15.31:0/3978280877 <== mgr.4100 v2:172.21.15.158:6832/85962 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49752 (secure 0 0 0) 0x7fa53804c3c0 con 0x7fa51c066f30 2023-10-09T06:33:07.178 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:33:07.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.180+0000 7fa53eca0700 1 -- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa51c066f30 msgr2=0x7fa51c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.180+0000 7fa53eca0700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa51c066f30 0x7fa51c0693e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009ad0 tx=0x7fa52c01a000 comp rx=0 tx=0).stop 2023-10-09T06:33:07.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.180+0000 7fa53eca0700 1 -- 172.21.15.31:0/3978280877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa538156890 msgr2=0x7fa5380c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.180+0000 7fa53eca0700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa538156890 0x7fa5380c8d00 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fa530007fd0 tx=0x7fa530009040 comp rx=0 tx=0).stop 2023-10-09T06:33:07.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.180+0000 7fa53eca0700 1 -- 172.21.15.31:0/3978280877 shutdown_connections 2023-10-09T06:33:07.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.180+0000 7fa53eca0700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fa51c066f30 0x7fa51c0693e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.180+0000 7fa53eca0700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa538156890 0x7fa5380c8d00 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.180+0000 7fa53eca0700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa528003a90 0x7fa5380c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.180+0000 7fa53eca0700 1 --2- 172.21.15.31:0/3978280877 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7fa5380cf840 0x7fa5380c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.180+0000 7fa53eca0700 1 -- 172.21.15.31:0/3978280877 >> 172.21.15.31:0/3978280877 conn(0x7fa538067660 msgr2=0x7fa5380b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:33:07.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.180+0000 7fa53eca0700 1 -- 172.21.15.31:0/3978280877 shutdown_connections 2023-10-09T06:33:07.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.180+0000 7fa53eca0700 1 -- 172.21.15.31:0/3978280877 wait complete. 2023-10-09T06:33:07.182 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-10-09T06:33:07.192 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":553,"stamp":"2023-10-09T06:33:06.693995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9546,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552953,"statfs":{"total":1600000000,"available":1590224728,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002528"},"pg_stats":[{"pgid":"1.0","version":"191'119","reported_seq":325,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-10-09T06:32:51.865319+0000","last_change":"2023-10-09T06:32:51.865291+0000","last_active":"2023-10-09T06:32:51.865319+0000","last_peered":"2023-10-09T06:32:51.865319+0000","last_clean":"2023-10-09T06:32:51.865319+0000","last_became_active":"2023-10-09T06:20:44.428540+0000","last_became_peered":"2023-10-09T06:20:44.428540+0000","last_unstale":"2023-10-09T06:32:51.865319+0000","last_undegraded":"2023-10-09T06:32:51.865319+0000","last_fullsized":"2023-10-09T06:32:51.865319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"191'119","last_scrub_stamp":"2023-10-09T06:32:51.865230+0000","last_deep_scrub":"191'119","last_deep_scrub_stamp":"2023-10-09T06:32:51.865230+0000","last_clean_scrub_stamp":"2023-10-09T06:32:51.865230+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:41.849484+0000","scrub_duration":0.003144277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335315,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.52700000000000002},"min":{"1min":0.36399999999999999,"5min":0.34200000000000003,"15min":0.28999999999999998},"max":{"1min":0.71399999999999997,"5min":0.81299999999999994,"15min":1.5469999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.35199999999999998,"5min":0.29299999999999998,"15min":0.28100000000000003},"max":{"1min":0.73299999999999998,"5min":0.78700000000000003,"15min":3.6970000000000001},"last":0.627}]},{"osd":1,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55800000000000005,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.311,"15min":0.29899999999999999},"max":{"1min":0.69199999999999995,"5min":0.80400000000000005,"15min":0.88100000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.26800000000000002},"max":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":1.4870000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.45800000000000002,"5min":0.435,"15min":0.34300000000000003},"max":{"1min":0.78200000000000003,"5min":0.79900000000000004,"15min":2.6139999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.56499999999999995},"min":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.78700000000000003,"15min":2.6019999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.318},"max":{"1min":0.67100000000000004,"5min":0.78600000000000003,"15min":7.4729999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":7.8390000000000004},"last":0.52300000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.23799999999999999},"max":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.872},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.307,"15min":0.25600000000000001},"max":{"1min":0.70999999999999996,"5min":0.76900000000000002,"15min":0.86099999999999999},"last":0.378}]},{"osd":5,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.255},"max":{"1min":0.69499999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.75600000000000001,"15min":0.98699999999999999},"last":0.54300000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.35499999999999998},"max":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.93999999999999995},"last":0.498},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29199999999999998},"max":{"1min":0.755,"5min":0.79900000000000004,"15min":0.91400000000000003},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55300000000000005,"15min":0.624},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.26900000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":7.0960000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55400000000000005,"15min":0.54400000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70699999999999996,"5min":0.79800000000000004,"15min":1.133},"last":0.501}]},{"osd":1,"last update":"Mon Oct 9 06:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.40600000000000003,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.78800000000000003,"5min":0.84399999999999997,"15min":1.155},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60299999999999998,"15min":0.58799999999999997},"min":{"1min":0.42299999999999999,"5min":0.36899999999999999,"15min":0.317},"max":{"1min":0.76600000000000001,"5min":0.84599999999999997,"15min":1.1459999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.2290000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57399999999999995,"15min":0.64500000000000002},"min":{"1min":0.40300000000000002,"5min":0.375,"15min":0.308},"max":{"1min":0.74199999999999999,"5min":0.86599999999999999,"15min":7.1299999999999999},"last":0.63}]},{"osd":3,"last update":"Mon Oct 9 06:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.34499999999999997},"max":{"1min":0.74099999999999999,"5min":0.83499999999999996,"15min":1.337},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.36499999999999999},"max":{"1min":0.754,"5min":0.80100000000000005,"15min":1.206},"last":0.48999999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28000000000000003},"max":{"1min":0.65900000000000003,"5min":0.69399999999999995,"15min":0.75900000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.502,"15min":0.502},"min":{"1min":0.40600000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68500000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42099999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47399999999999998,"15min":0.47599999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61499999999999999,"5min":0.70499999999999996,"15min":0.80000000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.80700000000000005,"15min":0.82499999999999996},"last":0.46500000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.315},"max":{"1min":0.71699999999999997,"5min":0.72899999999999998,"15min":0.81299999999999994},"last":0.374},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.31900000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.82399999999999995},"last":0.40699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.219},"max":{"1min":0.441,"5min":0.58999999999999997,"15min":0.64000000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.38100000000000001,"15min":0.35899999999999999},"min":{"1min":0.27600000000000002,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.55900000000000005,"5min":0.61499999999999999,"15min":0.93300000000000005},"last":0.48299999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36299999999999999,"15min":0.35299999999999998},"min":{"1min":0.247,"5min":0.218,"15min":0.218},"max":{"1min":0.50600000000000001,"5min":0.71399999999999997,"15min":0.82299999999999995},"last":0.443},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42699999999999999,"15min":0.40400000000000003},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.247},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.70899999999999996},"last":0.59899999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47699999999999998,"15min":0.443},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.29199999999999998},"max":{"1min":0.64300000000000002,"5min":0.751,"15min":0.751},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.437},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.90500000000000003},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.315},"max":{"1min":0.90000000000000002,"5min":0.95699999999999996,"15min":1.097},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.70499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81699999999999995,"5min":0.97699999999999998,"15min":5.5270000000000001},"last":0.73699999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65700000000000003,"15min":0.64000000000000001},"min":{"1min":0.53800000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.0069999999999999,"5min":1.0669999999999999,"15min":1.125},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.65600000000000003},"min":{"1min":0.51900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":1,"15min":1.4219999999999999},"last":0.76300000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66100000000000003,"15min":0.64000000000000001},"min":{"1min":0.55600000000000005,"5min":0.45500000000000002,"15min":0.39300000000000002},"max":{"1min":0.96399999999999997,"5min":1.0029999999999999,"15min":1.0629999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":0.94799999999999995,"15min":1.49},"last":0.79500000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65300000000000002},"min":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":1.016,"15min":1.016},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.51200000000000001,"5min":0.44700000000000001,"15min":0.41599999999999998},"max":{"1min":0.91600000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.85699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335315,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.20599999999999999},"max":{"1min":0.56499999999999995,"5min":0.71599999999999997,"15min":1.226},"last":0.44},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.20599999999999999},"max":{"1min":0.68300000000000005,"5min":0.82999999999999996,"15min":1.131},"last":0.51300000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.67300000000000004},"min":{"1min":0.32500000000000001,"5min":0.28299999999999997,"15min":0.25800000000000001},"max":{"1min":0.629,"5min":0.63600000000000001,"15min":12.929},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.441},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.59399999999999997,"5min":0.751,"15min":1.1599999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.35299999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71699999999999997,"5min":0.78100000000000003,"15min":1.1859999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.36099999999999999,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":1.3089999999999999},"last":0.57699999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.44400000000000001,"5min":0.40799999999999997,"15min":0.36599999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.335},"last":0.80100000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65100000000000002,"15min":0.626},"min":{"1min":0.437,"5min":0.40100000000000002,"15min":0.35499999999999998},"max":{"1min":0.95399999999999996,"5min":1.016,"15min":1.0580000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64300000000000002,"15min":0.61799999999999999},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.317},"max":{"1min":0.877,"5min":0.98599999999999999,"15min":0.999},"last":1.012}]},{"osd":6,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63300000000000001,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.92200000000000004,"5min":1.05,"15min":1.05},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.67200000000000004},"min":{"1min":0.50800000000000001,"5min":0.41499999999999998,"15min":0.374},"max":{"1min":1.0209999999999999,"5min":1.032,"15min":1.2849999999999999},"last":0.86099999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70299999999999996,"15min":0.67800000000000005},"min":{"1min":0.497,"5min":0.43099999999999999,"15min":0.40400000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.262},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.66900000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":1.0660000000000001,"15min":1.103},"last":0.876}]}]},{"osd":2,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36299999999999999,"15min":0.54800000000000004},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.19800000000000001},"max":{"1min":0.64800000000000002,"5min":0.65000000000000002,"15min":14.981999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38400000000000001,"15min":0.48799999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.22},"max":{"1min":0.57899999999999996,"5min":0.63900000000000001,"15min":9.1600000000000001},"last":0.504}]},{"osd":1,"last update":"Mon Oct 9 06:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.373,"15min":0.46400000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.222},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":8.4930000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.42599999999999999,"15min":0.53100000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.624,"5min":0.67800000000000005,"15min":9.0239999999999991},"last":0.59299999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46100000000000002,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.60899999999999999,"5min":0.69399999999999995,"15min":8.5190000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45700000000000002,"15min":0.628},"min":{"1min":0.317,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70199999999999996,"5min":0.748,"15min":15.007999999999999},"last":0.67200000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.82199999999999995},"min":{"1min":0.49199999999999999,"5min":0.39700000000000002,"15min":0.33000000000000002},"max":{"1min":0.90900000000000003,"5min":0.91900000000000004,"15min":14.917999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65500000000000003,"15min":0.752},"min":{"1min":0.46500000000000002,"5min":0.45700000000000002,"15min":0.40899999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":8.9930000000000003},"last":0.69899999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63600000000000001,"15min":0.73599999999999999},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.80600000000000005,"5min":0.84699999999999998,"15min":8.9610000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.752},"min":{"1min":0.48199999999999998,"5min":0.45200000000000001,"15min":0.35099999999999998},"max":{"1min":0.95499999999999996,"5min":0.96499999999999997,"15min":8.3919999999999995},"last":0.88100000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.65500000000000003,"15min":0.73799999999999999},"min":{"1min":0.45600000000000002,"5min":0.441,"15min":0.39900000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":8.4339999999999993},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.83899999999999997},"min":{"1min":0.52000000000000002,"5min":0.44500000000000001,"15min":0.374},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":14.954000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.72899999999999998},"min":{"1min":0.498,"5min":0.40899999999999997,"15min":0.36199999999999999},"max":{"1min":0.995,"5min":0.995,"15min":8.9160000000000004},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66400000000000003,"15min":0.746},"min":{"1min":0.40899999999999997,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":8.4640000000000004},"last":0.96399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38200000000000001,"15min":0.35399999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":0.48099999999999998,"5min":0.56100000000000005,"15min":0.66800000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.433}]},{"osd":1,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.38400000000000001,"15min":0.35099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.215},"max":{"1min":0.497,"5min":0.60699999999999998,"15min":0.623},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.43099999999999999,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23699999999999999},"max":{"1min":0.49299999999999999,"5min":0.66600000000000004,"15min":0.68899999999999995},"last":0.376}]},{"osd":2,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42199999999999999,"15min":0.38800000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.252},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.497,"15min":0.45700000000000002},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.28399999999999997},"max":{"1min":0.63700000000000001,"5min":0.71799999999999997,"15min":0.75700000000000001},"last":0.52600000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89100000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65500000000000003,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.33400000000000002},"max":{"1min":0.877,"5min":1.073,"15min":1.073},"last":0.874}]},{"osd":5,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67900000000000005,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.33600000000000002},"max":{"1min":0.81499999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69199999999999995,"15min":0.64600000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":1.097,"15min":1.097},"last":0.88700000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.66900000000000004,"15min":0.61699999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.69099999999999995,"15min":0.64000000000000001},"min":{"1min":0.441,"5min":0.434,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.90500000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67500000000000004,"15min":0.628},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.83599999999999997,"5min":1.139,"15min":1.139},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.69699999999999995,"15min":0.64400000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":1.026,"15min":1.026},"last":0.77500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.52000000000000002},"min":{"1min":0.40799999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72199999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.39700000000000002,"5min":0.32800000000000001,"15min":0.318},"max":{"1min":0.74099999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:32:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.53300000000000003},"min":{"1min":0.38900000000000001,"5min":0.34300000000000003,"15min":0.254},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.61399999999999999},"min":{"1min":0.37,"5min":0.311,"15min":0.311},"max":{"1min":0.748,"5min":0.754,"15min":4.3250000000000002},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:32:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56899999999999995,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.75800000000000001,"5min":0.77900000000000003,"15min":4.7320000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.749},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.32600000000000001},"max":{"1min":0.71299999999999997,"5min":0.80600000000000005,"15min":11.715},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:32:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.55600000000000005},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.34899999999999998},"max":{"1min":0.752,"5min":0.77700000000000002,"15min":0.79100000000000004},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.627,"15min":0.61099999999999999},"min":{"1min":0.44800000000000001,"5min":0.434,"15min":0.39000000000000001},"max":{"1min":0.78900000000000003,"5min":0.81499999999999995,"15min":0.85599999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:32:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.48199999999999998},"min":{"1min":0.31,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.71399999999999997,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.48099999999999998,"15min":0.5},"min":{"1min":0.33000000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.69699999999999995,"5min":0.71299999999999997,"15min":0.82799999999999996},"last":0.48399999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:32:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.34200000000000003,"5min":0.33400000000000002,"15min":0.28299999999999997},"max":{"1min":0.753,"5min":0.80400000000000005,"15min":0.86699999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.433,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.84999999999999998},"last":0.47299999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:32:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39000000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73799999999999999,"5min":0.747,"15min":0.879},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.81299999999999994,"15min":0.88600000000000001},"last":0.61899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.82899999999999996,"15min":1.0289999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73099999999999998,"5min":0.77200000000000002,"15min":0.81899999999999995},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.82299999999999995,"15min":1.093},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57099999999999995,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.85499999999999998},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70499999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.36699999999999999,"15min":0.36299999999999999},"max":{"1min":0.75700000000000001,"5min":0.79800000000000004,"15min":0.89300000000000002},"last":0.46300000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59999999999999998,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98699999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.071},"last":0.41499999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45600000000000002,"15min":0.48299999999999998},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.84399999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.44}]},{"osd":6,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.51200000000000001},"min":{"1min":0.34499999999999997,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.0680000000000001},"last":0.37},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.42499999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.88,"5min":0.88,"15min":1.0920000000000001},"last":0.51400000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.317,"15min":0.30399999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.91900000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.0269999999999999},"last":0.47799999999999998}]}]}],"pool_statfs":[]}} 2023-10-09T06:33:07.195 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-09T06:33:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.314+0000 7f502bac0700 1 Processor -- start 2023-10-09T06:33:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.314+0000 7f502bac0700 1 -- start start 2023-10-09T06:33:07.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502bac0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f502415a230 0x7f502415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502bac0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502415ea90 con 0x7f5024159e60 2023-10-09T06:33:07.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502bac0700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50240b3100 con 0x7f50240697c0 2023-10-09T06:33:07.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502bac0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50240d1cf0 con 0x7f502415a230 2023-10-09T06:33:07.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502985c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5024159e60 0x7f50240690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37634/0 (socket says 172.21.15.31:37634) 2023-10-09T06:33:07.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502985c700 1 -- 172.21.15.31:0/840020987 learned_addr learned my addr 172.21.15.31:0/840020987 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-09T06:33:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502a05d700 1 --2- 172.21.15.31:0/840020987 >> v2:172.21.15.158:3300/0 conn(0x7f502415a230 0x7f502415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609090172 0 0) 0x7f502415ea90 con 0x7f5024159e60 2023-10-09T06:33:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f500c003570 con 0x7f5024159e60 2023-10-09T06:33:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 979522594 0 0) 0x7f500c003570 con 0x7f5024159e60 2023-10-09T06:33:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 >> v2:172.21.15.158:3300/0 conn(0x7f502415a230 msgr2=0x7f502415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:33:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 --2- 172.21.15.31:0/840020987 >> v2:172.21.15.158:3300/0 conn(0x7f502415a230 0x7f502415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 >> v1:172.21.15.158:6789/0 conn(0x7f50240697c0 legacy=0x7f50240af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50240d10e0 con 0x7f5024159e60 2023-10-09T06:33:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2689923221 0 0) 0x7f501c001470 con 0x7f5024159e60 2023-10-09T06:33:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 >> v1:172.21.15.31:6789/0 conn(0x7f5024159e60 legacy=0x7f50240690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 --2- 172.21.15.31:0/840020987 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f500c003a60 0x7f500c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 --2- 172.21.15.31:0/840020987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f500c004810 0x7f500c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 --2- 172.21.15.31:0/840020987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500c0051c0 0x7f500c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240d1cf0 con 0x7f500c0051c0 2023-10-09T06:33:07.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c00c0d0 con 0x7f500c004810 2023-10-09T06:33:07.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.315+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c00c290 con 0x7f500c003a60 2023-10-09T06:33:07.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.316+0000 7f502a05d700 1 --2- 172.21.15.31:0/840020987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500c0051c0 0x7f500c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.316+0000 7f502985c700 1 --2- 172.21.15.31:0/840020987 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f500c003a60 0x7f500c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.316+0000 7f502905b700 1 --2- 172.21.15.31:0/840020987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f500c004810 0x7f500c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.316+0000 7f502a05d700 1 -- 172.21.15.31:0/840020987 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f500c003a60 msgr2=0x7f500c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:33:07.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.316+0000 7f502a05d700 1 --2- 172.21.15.31:0/840020987 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f500c003a60 0x7f500c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.316+0000 7f502a05d700 1 -- 172.21.15.31:0/840020987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f500c004810 msgr2=0x7f500c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:33:07.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.316+0000 7f502a05d700 1 --2- 172.21.15.31:0/840020987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f500c004810 0x7f500c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.316+0000 7f502a05d700 1 -- 172.21.15.31:0/840020987 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c003570 con 0x7f500c0051c0 2023-10-09T06:33:07.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.316+0000 7f502a05d700 1 -- 172.21.15.31:0/840020987 reap_dead start 2023-10-09T06:33:07.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.316+0000 7f502a05d700 1 --2- 172.21.15.31:0/840020987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500c0051c0 0x7f500c00ba60 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f501400e210 tx=0x7f501400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b47e2a50bfaec4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:33:07.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.316+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501400eac0 con 0x7f500c0051c0 2023-10-09T06:33:07.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.316+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501400f040 con 0x7f500c0051c0 2023-10-09T06:33:07.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.316+0000 7f502885a700 1 -- 172.21.15.31:0/840020987 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501400ee70 con 0x7f500c0051c0 2023-10-09T06:33:07.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.317+0000 7f502bac0700 1 -- 172.21.15.31:0/840020987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500c0051c0 msgr2=0x7f500c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.317+0000 7f502bac0700 1 --2- 172.21.15.31:0/840020987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500c0051c0 0x7f500c00ba60 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f501400e210 tx=0x7f501400b040 comp rx=0 tx=0).stop 2023-10-09T06:33:07.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.317+0000 7f502bac0700 1 -- 172.21.15.31:0/840020987 shutdown_connections 2023-10-09T06:33:07.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.317+0000 7f502bac0700 1 --2- 172.21.15.31:0/840020987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500c0051c0 0x7f500c00ba60 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.317+0000 7f502bac0700 1 -- 172.21.15.31:0/840020987 >> 172.21.15.31:0/840020987 conn(0x7f5024070700 msgr2=0x7f5024070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:33:07.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.317+0000 7f502bac0700 1 -- 172.21.15.31:0/840020987 shutdown_connections 2023-10-09T06:33:07.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.317+0000 7f502bac0700 1 -- 172.21.15.31:0/840020987 wait complete. 2023-10-09T06:33:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.318+0000 7f502bac0700 1 Processor -- start 2023-10-09T06:33:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.318+0000 7f502bac0700 1 -- start start 2023-10-09T06:33:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502bac0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f500c0051c0 0x7f50240c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502bac0700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50240c72b0 0x7f502414b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502bac0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50240c9790 0x7f50240b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502bac0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240c9300 con 0x7f50240c9790 2023-10-09T06:33:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502bac0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240c86f0 con 0x7f500c0051c0 2023-10-09T06:33:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502bac0700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50240c89d0 con 0x7f50240c72b0 2023-10-09T06:33:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502a05d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50240c9790 0x7f50240b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502a05d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50240c9790 0x7f50240b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45292/0 (socket says 172.21.15.31:45292) 2023-10-09T06:33:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502a05d700 1 -- 172.21.15.31:0/2145535643 learned_addr learned my addr 172.21.15.31:0/2145535643 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:33:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502985c700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f500c0051c0 0x7f50240c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502905b700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50240c72b0 0x7f502414b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502a05d700 1 -- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50240c72b0 msgr2=0x7f502414b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502a05d700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50240c72b0 0x7f502414b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502a05d700 1 -- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f500c0051c0 msgr2=0x7f50240c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502a05d700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f500c0051c0 0x7f50240c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502a05d700 1 -- 172.21.15.31:0/2145535643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50240c8cb0 con 0x7f50240c9790 2023-10-09T06:33:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502a05d700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50240c9790 0x7f50240b0760 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f50240b6e50 tx=0x7f5014019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:33:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f5021ffb700 1 -- 172.21.15.31:0/2145535643 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501401d650 con 0x7f50240c9790 2023-10-09T06:33:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f5021ffb700 1 -- 172.21.15.31:0/2145535643 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501401d7b0 con 0x7f50240c9790 2023-10-09T06:33:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f502bac0700 1 -- 172.21.15.31:0/2145535643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50240c8f90 con 0x7f50240c9790 2023-10-09T06:33:07.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.319+0000 7f5021ffb700 1 -- 172.21.15.31:0/2145535643 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501401dbb0 con 0x7f50240c9790 2023-10-09T06:33:07.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.320+0000 7f502bac0700 1 -- 172.21.15.31:0/2145535643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50240c84a0 con 0x7f50240c9790 2023-10-09T06:33:07.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.321+0000 7f502bac0700 1 -- 172.21.15.31:0/2145535643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50240c94b0 con 0x7f50240c9790 2023-10-09T06:33:07.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.321+0000 7f5021ffb700 1 -- 172.21.15.31:0/2145535643 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5014003020 con 0x7f50240c9790 2023-10-09T06:33:07.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.322+0000 7f5021ffb700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5010066f30 0x7f50100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.322+0000 7f5021ffb700 1 -- 172.21.15.31:0/2145535643 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5014085d20 con 0x7f50240c9790 2023-10-09T06:33:07.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.322+0000 7f502985c700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5010066f30 0x7f50100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.322+0000 7f502985c700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5010066f30 0x7f50100693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f501c007f50 tx=0x7f501c001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:33:07.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.326+0000 7f5021ffb700 1 -- 172.21.15.31:0/2145535643 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50240c94b0 con 0x7f50240c9790 2023-10-09T06:33:07.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.518+0000 7f502bac0700 1 -- 172.21.15.31:0/2145535643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f502404c3c0 con 0x7f50240c9790 2023-10-09T06:33:07.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.522+0000 7f5021ffb700 1 -- 172.21.15.31:0/2145535643 <== mon.0 v2:172.21.15.31:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f50140532b0 con 0x7f50240c9790 2023-10-09T06:33:07.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.522+0000 7f5021ffb700 1 -- 172.21.15.31:0/2145535643 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5014056d40 con 0x7f50240c9790 2023-10-09T06:33:07.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.525+0000 7f502bac0700 1 -- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5010066f30 msgr2=0x7f50100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.525+0000 7f502bac0700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5010066f30 0x7f50100693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f501c007f50 tx=0x7f501c001e50 comp rx=0 tx=0).stop 2023-10-09T06:33:07.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.525+0000 7f502bac0700 1 -- 172.21.15.31:0/2145535643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50240c9790 msgr2=0x7f50240b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.525+0000 7f502bac0700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50240c9790 0x7f50240b0760 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f50240b6e50 tx=0x7f5014019000 comp rx=0 tx=0).stop 2023-10-09T06:33:07.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.525+0000 7f502bac0700 1 -- 172.21.15.31:0/2145535643 shutdown_connections 2023-10-09T06:33:07.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.525+0000 7f502bac0700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7f5010066f30 0x7f50100693e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.525+0000 7f502bac0700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50240c9790 0x7f50240b0760 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.525+0000 7f502bac0700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f500c0051c0 0x7f50240c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.525+0000 7f502bac0700 1 --2- 172.21.15.31:0/2145535643 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7f50240c72b0 0x7f502414b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.525+0000 7f502bac0700 1 -- 172.21.15.31:0/2145535643 >> 172.21.15.31:0/2145535643 conn(0x7f5024070700 msgr2=0x7f5024070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:33:07.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.525+0000 7f502bac0700 1 -- 172.21.15.31:0/2145535643 shutdown_connections 2023-10-09T06:33:07.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.525+0000 7f502bac0700 1 -- 172.21.15.31:0/2145535643 wait complete. 2023-10-09T06:33:07.536 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:33:07.537 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:33:07.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.656+0000 7feaa826e700 1 Processor -- start 2023-10-09T06:33:07.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.656+0000 7feaa826e700 1 -- start start 2023-10-09T06:33:07.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.657+0000 7feaa826e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7feaa0159e10 0x7feaa00b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.657+0000 7feaa826e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feaa00cde50 0x7feaa00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.657+0000 7feaa826e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa015db80 con 0x7feaa015a1e0 2023-10-09T06:33:07.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.657+0000 7feaa826e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa015e800 con 0x7feaa00cde50 2023-10-09T06:33:07.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.657+0000 7feaa826e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa015de60 con 0x7feaa0159e10 2023-10-09T06:33:07.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.657+0000 7feaa680b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feaa00cde50 0x7feaa00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.657+0000 7feaa680b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feaa00cde50 0x7feaa00b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45308/0 (socket says 172.21.15.31:45308) 2023-10-09T06:33:07.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.657+0000 7feaa680b700 1 -- 172.21.15.31:0/1436512160 learned_addr learned my addr 172.21.15.31:0/1436512160 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:33:07.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.658+0000 7feaa600a700 1 --2- 172.21.15.31:0/1436512160 >> v2:172.21.15.158:3300/0 conn(0x7feaa0159e10 0x7feaa00b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.658+0000 7feaa680b700 1 -- 172.21.15.31:0/1436512160 >> v2:172.21.15.158:3300/0 conn(0x7feaa0159e10 msgr2=0x7feaa00b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:33:07.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.658+0000 7feaa680b700 1 --2- 172.21.15.31:0/1436512160 >> v2:172.21.15.158:3300/0 conn(0x7feaa0159e10 0x7feaa00b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.658+0000 7feaa680b700 1 -- 172.21.15.31:0/1436512160 >> v1:172.21.15.158:6789/0 conn(0x7feaa015a1e0 legacy=0x7feaa00cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:33:07.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.658+0000 7feaa680b700 1 -- 172.21.15.31:0/1436512160 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa015e140 con 0x7feaa00cde50 2023-10-09T06:33:07.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.658+0000 7feaa680b700 1 --2- 172.21.15.31:0/1436512160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa00cde50 0x7feaa00b3260 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7feaa0068a60 tx=0x7fea90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35dbfbea23804a2f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:33:07.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.658+0000 7feaa5008700 1 -- 172.21.15.31:0/1436512160 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000e070 con 0x7feaa00cde50 2023-10-09T06:33:07.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.658+0000 7feaa5008700 1 -- 172.21.15.31:0/1436512160 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fea9000ba10 con 0x7feaa00cde50 2023-10-09T06:33:07.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.658+0000 7feaa5008700 1 -- 172.21.15.31:0/1436512160 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea900092e0 con 0x7feaa00cde50 2023-10-09T06:33:07.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.658+0000 7feaa826e700 1 -- 172.21.15.31:0/1436512160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa00cde50 msgr2=0x7feaa00b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.658+0000 7feaa826e700 1 --2- 172.21.15.31:0/1436512160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa00cde50 0x7feaa00b3260 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7feaa0068a60 tx=0x7fea90009840 comp rx=0 tx=0).stop 2023-10-09T06:33:07.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.659+0000 7feaa826e700 1 -- 172.21.15.31:0/1436512160 shutdown_connections 2023-10-09T06:33:07.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.659+0000 7feaa826e700 1 --2- 172.21.15.31:0/1436512160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa00cde50 0x7feaa00b3260 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.659+0000 7feaa826e700 1 --2- 172.21.15.31:0/1436512160 >> v2:172.21.15.158:3300/0 conn(0x7feaa0159e10 0x7feaa00b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.659+0000 7feaa826e700 1 -- 172.21.15.31:0/1436512160 >> 172.21.15.31:0/1436512160 conn(0x7feaa0067660 msgr2=0x7feaa0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:33:07.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.659+0000 7feaa826e700 1 -- 172.21.15.31:0/1436512160 shutdown_connections 2023-10-09T06:33:07.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.659+0000 7feaa826e700 1 -- 172.21.15.31:0/1436512160 wait complete. 2023-10-09T06:33:07.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.660+0000 7feaa826e700 1 Processor -- start 2023-10-09T06:33:07.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.660+0000 7feaa826e700 1 -- start start 2023-10-09T06:33:07.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.660+0000 7feaa826e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa00cde50 0x7feaa00c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.660+0000 7feaa826e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feaa0159e10 0x7feaa00ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.660+0000 7feaa826e700 1 --2- >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feaa015a1e0 0x7feaa014a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.660+0000 7feaa826e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa016b250 con 0x7feaa00cde50 2023-10-09T06:33:07.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.660+0000 7feaa826e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa016a5d0 con 0x7feaa0159e10 2023-10-09T06:33:07.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.660+0000 7feaa826e700 1 -- --> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa016a8b0 con 0x7feaa015a1e0 2023-10-09T06:33:07.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa600a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa00cde50 0x7feaa00c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa600a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa00cde50 0x7feaa00c6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45310/0 (socket says 172.21.15.31:45310) 2023-10-09T06:33:07.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa600a700 1 -- 172.21.15.31:0/2635106665 learned_addr learned my addr 172.21.15.31:0/2635106665 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-09T06:33:07.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa5809700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feaa0159e10 0x7feaa00ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa680b700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feaa015a1e0 0x7feaa014a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa600a700 1 -- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feaa015a1e0 msgr2=0x7feaa014a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa600a700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feaa015a1e0 0x7feaa014a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa600a700 1 -- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feaa0159e10 msgr2=0x7feaa00ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa600a700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feaa0159e10 0x7feaa00ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa600a700 1 -- 172.21.15.31:0/2635106665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea90009ae0 con 0x7feaa00cde50 2023-10-09T06:33:07.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa5809700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feaa0159e10 0x7feaa00ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:33:07.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa600a700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa00cde50 0x7feaa00c6020 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fea9800d890 tx=0x7fea98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:33:07.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7fea9e7fc700 1 -- 172.21.15.31:0/2635106665 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9800b600 con 0x7feaa00cde50 2023-10-09T06:33:07.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7fea9e7fc700 1 -- 172.21.15.31:0/2635106665 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fea9800b760 con 0x7feaa00cde50 2023-10-09T06:33:07.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7fea9e7fc700 1 -- 172.21.15.31:0/2635106665 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9800bb00 con 0x7feaa00cde50 2023-10-09T06:33:07.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa826e700 1 -- 172.21.15.31:0/2635106665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa016ab90 con 0x7feaa00cde50 2023-10-09T06:33:07.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.661+0000 7feaa826e700 1 -- 172.21.15.31:0/2635106665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa00cedb0 con 0x7feaa00cde50 2023-10-09T06:33:07.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.662+0000 7feaa826e700 1 -- 172.21.15.31:0/2635106665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa004c3c0 con 0x7feaa00cde50 2023-10-09T06:33:07.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.662+0000 7fea9e7fc700 1 -- 172.21.15.31:0/2635106665 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea9801e460 con 0x7feaa00cde50 2023-10-09T06:33:07.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.663+0000 7fea9e7fc700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea8c066f30 0x7fea8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:33:07.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.663+0000 7fea9e7fc700 1 -- 172.21.15.31:0/2635106665 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fea98084900 con 0x7feaa00cde50 2023-10-09T06:33:07.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.663+0000 7feaa5809700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea8c066f30 0x7fea8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:33:07.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.663+0000 7feaa5809700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea8c066f30 0x7fea8c0693e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fea94007fd0 tx=0x7fea94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:33:07.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.667+0000 7fea9e7fc700 1 -- 172.21.15.31:0/2635106665 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea98051ef0 con 0x7feaa00cde50 2023-10-09T06:33:07.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.903+0000 7feaa826e700 1 -- 172.21.15.31:0/2635106665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feaa015e420 con 0x7feaa00cde50 2023-10-09T06:33:07.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.904+0000 7fea9e7fc700 1 -- 172.21.15.31:0/2635106665 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fea98055510 con 0x7feaa00cde50 2023-10-09T06:33:07.904 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-09T06:33:07.904 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":91,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/3503727793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3503727793},{"type":"v1","addr":"172.21.15.158:6837","nonce":3503727793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2366061673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2366061673},{"type":"v1","addr":"172.21.15.158:6836","nonce":2366061673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3405107978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3405107978},{"type":"v1","addr":"172.21.15.31:6834","nonce":3405107978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":8400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/705974571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":705974571},{"type":"v1","addr":"172.21.15.31:6835","nonce":705974571}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91}],"filesystems":[]} 2023-10-09T06:33:07.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.905+0000 7feaa826e700 1 -- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea8c066f30 msgr2=0x7fea8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.905+0000 7feaa826e700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea8c066f30 0x7fea8c0693e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fea94007fd0 tx=0x7fea94009040 comp rx=0 tx=0).stop 2023-10-09T06:33:07.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.905+0000 7feaa826e700 1 -- 172.21.15.31:0/2635106665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa00cde50 msgr2=0x7feaa00c6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:33:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.905+0000 7feaa826e700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa00cde50 0x7feaa00c6020 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fea9800d890 tx=0x7fea98008040 comp rx=0 tx=0).stop 2023-10-09T06:33:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.905+0000 7feaa826e700 1 -- 172.21.15.31:0/2635106665 shutdown_connections 2023-10-09T06:33:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.905+0000 7feaa826e700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:6832/85962,v1:172.21.15.158:6833/85962] conn(0x7fea8c066f30 0x7fea8c0693e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.905+0000 7feaa826e700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:3301/0,v1:172.21.15.158:6790/0] conn(0x7feaa015a1e0 0x7feaa014a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.905+0000 7feaa826e700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa00cde50 0x7feaa00c6020 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.905+0000 7feaa826e700 1 --2- 172.21.15.31:0/2635106665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feaa0159e10 0x7feaa00ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:33:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.905+0000 7feaa826e700 1 -- 172.21.15.31:0/2635106665 >> 172.21.15.31:0/2635106665 conn(0x7feaa0067660 msgr2=0x7feaa00b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:33:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.905+0000 7feaa826e700 1 -- 172.21.15.31:0/2635106665 shutdown_connections 2023-10-09T06:33:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-09T06:33:07.905+0000 7feaa826e700 1 -- 172.21.15.31:0/2635106665 wait complete. 2023-10-09T06:33:07.908 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 91 2023-10-09T06:33:07.918 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-09T06:33:07.918 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-09T06:33:07.919 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:33:07.919 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:07.927 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:33:07.927 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:33:07.927 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:07.975 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:33:07.976 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:33:07.976 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:07.986 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:33:07.987 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:33:07.987 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.038 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:33:08.038 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-09T06:33:08.039 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-09T06:33:08.039 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.058 INFO:tasks.ceph.osd.0:Stopped 2023-10-09T06:33:08.059 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-09T06:33:08.059 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.123 INFO:tasks.ceph.osd.1:Stopped 2023-10-09T06:33:08.123 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-09T06:33:08.123 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.190 INFO:tasks.ceph.osd.2:Stopped 2023-10-09T06:33:08.190 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-09T06:33:08.190 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.249 INFO:tasks.ceph.osd.3:Stopped 2023-10-09T06:33:08.250 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-09T06:33:08.250 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.273 INFO:tasks.ceph.osd.4:Stopped 2023-10-09T06:33:08.273 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-09T06:33:08.274 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.332 INFO:tasks.ceph.osd.5:Stopped 2023-10-09T06:33:08.333 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-09T06:33:08.333 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.395 INFO:tasks.ceph.osd.6:Stopped 2023-10-09T06:33:08.396 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-09T06:33:08.396 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.457 INFO:tasks.ceph.osd.7:Stopped 2023-10-09T06:33:08.457 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-09T06:33:08.458 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-09T06:33:08.458 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.481 INFO:tasks.ceph.mgr.y:Stopped 2023-10-09T06:33:08.481 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-09T06:33:08.481 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.523 INFO:tasks.ceph.mgr.x:Stopped 2023-10-09T06:33:08.523 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-09T06:33:08.523 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-09T06:33:08.523 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.534 INFO:tasks.ceph.mon.a:Stopped 2023-10-09T06:33:08.534 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-09T06:33:08.535 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.574 INFO:tasks.ceph.mon.b:Stopped 2023-10-09T06:33:08.574 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-09T06:33:08.574 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:33:08.625 INFO:tasks.ceph.mon.c:Stopped 2023-10-09T06:33:08.625 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-09T06:33:08.625 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-09T06:33:08.658 INFO:teuthology.orchestra.run.smithi031.stdout:1696832441.3288944 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 222697.888416 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.3. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-09T06:33:08.658 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-09T06:33:08.658 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-09T06:33:08.730 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-09T06:33:08.801 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-09T06:33:08.873 INFO:teuthology.orchestra.run.smithi031.stdout:1696832441.3288944 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 222697.888416 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.3. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-09T06:33:08.873 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:33:08.874 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-09T06:33:09.102 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:33:09.103 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-09T06:33:09.237 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:33:09.237 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-09T06:33:09.305 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:33:09.306 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-09T06:33:09.392 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:33:09.392 DEBUG:teuthology.orchestra.run.smithi158:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-09T06:33:09.571 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:33:09.571 DEBUG:teuthology.orchestra.run.smithi158:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-09T06:33:09.648 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:33:09.648 DEBUG:teuthology.orchestra.run.smithi158:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-09T06:33:09.720 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:33:09.720 DEBUG:teuthology.orchestra.run.smithi158:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-09T06:33:09.785 INFO:tasks.ceph:Archiving mon data... 2023-10-09T06:33:09.787 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375/data/mon.a.tgz 2023-10-09T06:33:09.787 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2023-10-09T06:33:09.802 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.BtrbfhzRcU 2023-10-09T06:33:09.802 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.BtrbfhzRcU 2023-10-09T06:33:09.956 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.BtrbfhzRcU 2023-10-09T06:33:10.039 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.BtrbfhzRcU is 376KB 2023-10-09T06:33:10.106 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.BtrbfhzRcU 2023-10-09T06:33:10.120 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375/data/mon.b.tgz 2023-10-09T06:33:10.121 DEBUG:teuthology.orchestra.run.smithi158:> mktemp 2023-10-09T06:33:10.135 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.Qo5qBJrfCx 2023-10-09T06:33:10.135 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Qo5qBJrfCx 2023-10-09T06:33:10.282 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.Qo5qBJrfCx 2023-10-09T06:33:10.364 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.Qo5qBJrfCx is 382KB 2023-10-09T06:33:10.461 DEBUG:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.Qo5qBJrfCx 2023-10-09T06:33:10.475 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375/data/mon.c.tgz 2023-10-09T06:33:10.476 DEBUG:teuthology.orchestra.run.smithi158:> mktemp 2023-10-09T06:33:10.530 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.ULYfTKm7Bq 2023-10-09T06:33:10.530 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ULYfTKm7Bq 2023-10-09T06:33:10.662 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.ULYfTKm7Bq 2023-10-09T06:33:10.743 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.ULYfTKm7Bq is 383KB 2023-10-09T06:33:10.840 DEBUG:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.ULYfTKm7Bq 2023-10-09T06:33:10.854 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-09T06:33:10.854 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-09T06:33:10.856 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-09T06:33:10.918 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-09T06:33:10.918 DEBUG:teuthology.orchestra.run.smithi031:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-09T06:33:10.926 DEBUG:teuthology.orchestra.run.smithi158:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-09T06:33:10.953 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-09T06:33:10.983 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-09T06:33:10.989 INFO:tasks.ceph:Archiving crash dumps... 2023-10-09T06:33:10.991 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375/remote/smithi031/crash 2023-10-09T06:33:10.991 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-09T06:33:11.027 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375/remote/smithi158/crash 2023-10-09T06:33:11.028 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-09T06:33:11.052 INFO:tasks.ceph:Shutting down logrotate 2023-10-09T06:33:11.053 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:33:11.075 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:33:11.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-09T06:33:11.173 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-09T06:33:11.197 INFO:tasks.ceph:Compressing logs... 2023-10-09T06:33:11.197 DEBUG:teuthology.orchestra.run.smithi031:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-09T06:33:11.216 DEBUG:teuthology.orchestra.run.smithi158:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-09T06:33:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99371.log 2023-10-09T06:33:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110418.log 2023-10-09T06:33:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114414.log 2023-10-09T06:33:11.241 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99371.log: /var/log/ceph/ceph-client.admin.110418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88350.log 2023-10-09T06:33:11.277 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86450.log 2023-10-09T06:33:11.278 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90803.log 2023-10-09T06:33:11.278 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86408.log 2023-10-09T06:33:11.278 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.86450.log: /var/log/ceph/ceph-client.1.90803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89587.log 2023-10-09T06:33:11.278 INFO:teuthology.orchestra.run.smithi158.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86450.log.gz 2023-10-09T06:33:11.278 INFO:teuthology.orchestra.run.smithi158.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90803.log.gz 2023-10-09T06:33:11.279 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.86408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.87838.log 2023-10-09T06:33:11.281 INFO:teuthology.orchestra.run.smithi158.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86408.log.gz 2023-10-09T06:33:11.281 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.89587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92155.log 2023-10-09T06:33:11.281 INFO:teuthology.orchestra.run.smithi158.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89587.log.gz 2023-10-09T06:33:11.281 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.3.87838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90438.log 2023-10-09T06:33:11.281 INFO:teuthology.orchestra.run.smithi158.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.87838.log.gz 2023-10-09T06:33:11.282 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.92155.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-09T06:33:11.282 INFO:teuthology.orchestra.run.smithi158.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92155.log.gz 2023-10-09T06:33:11.282 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.90438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86321.log 2023-10-09T06:33:11.282 INFO:teuthology.orchestra.run.smithi158.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90438.log.gz 2023-10-09T06:33:11.282 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90442.log 2023-10-09T06:33:11.282 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.86321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89158.log 2023-10-09T06:33:11.282 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.90442.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86321.log.gz 2023-10-09T06:33:11.282 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91202.log 2023-10-09T06:33:11.282 INFO:teuthology.orchestra.run.smithi158.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90442.log.gz 2023-10-09T06:33:11.282 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.89158.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-09T06:33:11.283 INFO:teuthology.orchestra.run.smithi158.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89158.log.gz 2023-10-09T06:33:11.283 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.91202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86279.log 2023-10-09T06:33:11.283 INFO:teuthology.orchestra.run.smithi158.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91202.log.gz 2023-10-09T06:33:11.283 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-09T06:33:11.283 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.86279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88686.log 2023-10-09T06:33:11.283 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph.audit.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86279.log.gz 2023-10-09T06:33:11.283 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-09T06:33:11.283 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-09T06:33:11.283 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.88686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88686.log.gz 2023-10-09T06:33:11.283 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-09T06:33:11.283 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86365.log 2023-10-09T06:33:11.284 INFO:teuthology.orchestra.run.smithi158.stderr: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-09T06:33:11.284 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.86365.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86365.log.gz 2023-10-09T06:33:11.284 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91707.log 2023-10-09T06:33:11.284 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88690.log 2023-10-09T06:33:11.284 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.91707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91707.log.gz 2023-10-09T06:33:11.284 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-09T06:33:11.284 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.88690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88690.log.gz 2023-10-09T06:33:11.284 INFO:teuthology.orchestra.run.smithi158.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-09T06:33:11.284 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86195.log 2023-10-09T06:33:11.284 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86155.log 2023-10-09T06:33:11.284 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.86195.log: /var/log/ceph/ceph-client.admin.86155.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86195.log.gz 2023-10-09T06:33:11.285 INFO:teuthology.orchestra.run.smithi158.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86155.log.gz 2023-10-09T06:33:11.285 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88254.log 2023-10-09T06:33:11.285 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92159.log 2023-10-09T06:33:11.285 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.88254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90807.log 2023-10-09T06:33:11.285 INFO:teuthology.orchestra.run.smithi158.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88254.log.gz 2023-10-09T06:33:11.285 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.92159.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-09T06:33:11.285 INFO:teuthology.orchestra.run.smithi158.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92159.log.gz 2023-10-09T06:33:11.285 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.90807.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-09T06:33:11.285 INFO:teuthology.orchestra.run.smithi158.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90807.log.gz 2023-10-09T06:33:11.285 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89154.log 2023-10-09T06:33:11.286 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.1.89154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89154.log.gz 2023-10-09T06:33:11.287 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-09T06:33:11.287 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89987.log 2023-10-09T06:33:11.305 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.89987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89987.log.gz 2023-10-09T06:33:11.305 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91206.log 2023-10-09T06:33:11.318 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.91206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91206.log.gz 2023-10-09T06:33:11.318 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.87842.log 2023-10-09T06:33:11.330 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.3.87842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.87842.log.gz 2023-10-09T06:33:11.337 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89991.log 2023-10-09T06:33:11.350 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.89991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89991.log.gz 2023-10-09T06:33:11.356 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89591.log 2023-10-09T06:33:11.356 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.89591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89591.log.gz 2023-10-09T06:33:11.356 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-09T06:33:11.369 INFO:teuthology.orchestra.run.smithi158.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-09T06:33:11.382 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87472.log 2023-10-09T06:33:11.382 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.87472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87472.log.gz 2023-10-09T06:33:11.383 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86236.log 2023-10-09T06:33:11.396 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.86236.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86236.log.gz 2023-10-09T06:33:11.396 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91703.log 2023-10-09T06:33:11.407 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99371.log.gz 2023-10-09T06:33:11.407 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110418.log.gz 2023-10-09T06:33:11.407 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90904.log 2023-10-09T06:33:11.408 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88350.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114414.log.gz 2023-10-09T06:33:11.408 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106855.log 2023-10-09T06:33:11.408 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88350.log.gz 2023-10-09T06:33:11.408 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.90904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114456.log 2023-10-09T06:33:11.408 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8%/var/log/ceph/ceph-client.admin.106855.log: -- replaced with /var/log/ceph/ceph-client.admin.90904.log.gz 2023-10-09T06:33:11.408 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98489.log 2023-10-09T06:33:11.408 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114456.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106855.log.gz 2023-10-09T06:33:11.408 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90820.log 2023-10-09T06:33:11.408 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114456.log.gz 2023-10-09T06:33:11.408 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.98489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107521.log 2023-10-09T06:33:11.408 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.90820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96914.log 2023-10-09T06:33:11.408 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90820.log.gz 2023-10-09T06:33:11.409 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110918.log 2023-10-09T06:33:11.409 INFO:teuthology.orchestra.run.smithi031.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.98489.log.gz 2023-10-09T06:33:11.409 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107521.log.gz 2023-10-09T06:33:11.409 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95219.log 2023-10-09T06:33:11.409 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91030.log 2023-10-09T06:33:11.409 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96914.log.gz 2023-10-09T06:33:11.409 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110918.log.gz 2023-10-09T06:33:11.409 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112445.log 2023-10-09T06:33:11.409 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95219.log.gz 2023-10-09T06:33:11.409 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118172.log 2023-10-09T06:33:11.409 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91030.log.gz 2023-10-09T06:33:11.409 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102033.log 2023-10-09T06:33:11.410 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112445.log: /var/log/ceph/ceph-client.admin.118172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87109.log 2023-10-09T06:33:11.410 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112445.log.gz 2023-10-09T06:33:11.410 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102033.log: gzip 88.3%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.118172.log.gz 2023-10-09T06:33:11.410 INFO:teuthology.orchestra.run.smithi031.stderr:-- /var/log/ceph/ceph-client.admin.106939.log 2023-10-09T06:33:11.410 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87109.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102033.log.gz 2023-10-09T06:33:11.410 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117681.log 2023-10-09T06:33:11.410 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.106939.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.87109.log.gz 2023-10-09T06:33:11.410 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94809.log 2023-10-09T06:33:11.410 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117681.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106939.log.gz 2023-10-09T06:33:11.410 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87424.log 2023-10-09T06:33:11.410 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94809.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117681.log.gz 2023-10-09T06:33:11.411 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116462.log 2023-10-09T06:33:11.411 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94809.log.gz 2023-10-09T06:33:11.411 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111439.log 2023-10-09T06:33:11.411 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87424.log.gz 2023-10-09T06:33:11.411 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114876.log 2023-10-09T06:33:11.411 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116462.log.gz 2023-10-09T06:33:11.411 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115742.log 2023-10-09T06:33:11.411 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101762.log 2023-10-09T06:33:11.411 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111439.log.gz 2023-10-09T06:33:11.411 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115742.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.114876.log.gz 2023-10-09T06:33:11.411 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92875.log 2023-10-09T06:33:11.411 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115742.log.gz 2023-10-09T06:33:11.412 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96376.log 2023-10-09T06:33:11.412 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100359.log 2023-10-09T06:33:11.412 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101762.log.gz 2023-10-09T06:33:11.412 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96376.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92875.log.gz 2023-10-09T06:33:11.412 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102700.log 2023-10-09T06:33:11.412 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96376.log.gz 2023-10-09T06:33:11.412 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107107.log 2023-10-09T06:33:11.412 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 /var/log/ceph/ceph-client.admin.102700.log: --verbose -- /var/log/ceph/ceph-client.admin.108431.log 2023-10-09T06:33:11.412 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100359.log.gz 2023-10-09T06:33:11.412 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107107.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102700.log.gz 2023-10-09T06:33:11.412 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118088.log 2023-10-09T06:33:11.412 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107107.log.gz 2023-10-09T06:33:11.413 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113310.log 2023-10-09T06:33:11.413 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115952.log 2023-10-09T06:33:11.413 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108431.log.gz 2023-10-09T06:33:11.413 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118088.log.gz 2023-10-09T06:33:11.413 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91871.log 2023-10-09T06:33:11.413 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113310.log.gz 2023-10-09T06:33:11.413 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97522.log 2023-10-09T06:33:11.413 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.115952.log.gz 2023-10-09T06:33:11.413 INFO:teuthology.orchestra.run.smithi031.stderr:gzip /var/log/ceph/ceph-client.admin.91871.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.102360.log 2023-10-09T06:33:11.413 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102402.log 2023-10-09T06:33:11.413 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91871.log.gz 2023-10-09T06:33:11.413 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87466.log 2023-10-09T06:33:11.414 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97522.log.gz 2023-10-09T06:33:11.414 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102402.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102360.log.gz 2023-10-09T06:33:11.414 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88894.log 2023-10-09T06:33:11.414 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87466.log: gzip -5 88.9%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.102402.log.gz/var/log/ceph/ceph-client.admin.103661.log 2023-10-09T06:33:11.414 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-10-09T06:33:11.414 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88894.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.87466.log.gz-5 2023-10-09T06:33:11.414 INFO:teuthology.orchestra.run.smithi031.stderr:--verbose -- /var/log/ceph/ceph-client.admin.117327.log 2023-10-09T06:33:11.414 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.88894.log.gz 2023-10-09T06:33:11.414 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.103661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95349.log 2023-10-09T06:33:11.414 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103661.log.gz 2023-10-09T06:33:11.414 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104223.log 2023-10-09T06:33:11.414 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1%/var/log/ceph/ceph-client.admin.95349.log: -- replaced with /var/log/ceph/ceph-client.admin.117327.log.gz 2023-10-09T06:33:11.415 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117369.log 2023-10-09T06:33:11.415 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95349.log.gz 2023-10-09T06:33:11.415 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107479.log 2023-10-09T06:33:11.415 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117369.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104223.log.gz 2023-10-09T06:33:11.415 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-09T06:33:11.415 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117369.log.gz 2023-10-09T06:33:11.415 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115826.log 2023-10-09T06:33:11.415 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.a.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107479.log.gz 2023-10-09T06:33:11.415 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100309.log 2023-10-09T06:33:11.415 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117243.log 2023-10-09T06:33:11.415 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100309.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.115826.log.gz 2023-10-09T06:33:11.415 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105261.log 2023-10-09T06:33:11.416 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100309.log.gz 2023-10-09T06:33:11.416 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112151.log 2023-10-09T06:33:11.416 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116102.log 2023-10-09T06:33:11.416 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117243.log.gz 2023-10-09T06:33:11.416 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105261.log.gz 2023-10-09T06:33:11.416 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95601.log 2023-10-09T06:33:11.416 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112151.log.gz 2023-10-09T06:33:11.416 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113096.log 2023-10-09T06:33:11.416 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95601.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116102.log.gz 2023-10-09T06:33:11.416 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115392.log 2023-10-09T06:33:11.416 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95601.log.gz 2023-10-09T06:33:11.416 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103287.log 2023-10-09T06:33:11.417 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113096.log.gz 2023-10-09T06:33:11.417 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102095.log 2023-10-09T06:33:11.417 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.103287.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115392.log.gz 2023-10-09T06:33:11.417 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110746.log 2023-10-09T06:33:11.417 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102095.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.103287.log.gz 2023-10-09T06:33:11.417 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92117.log 2023-10-09T06:33:11.417 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102095.log.gz 2023-10-09T06:33:11.417 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104828.log 2023-10-09T06:33:11.417 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92117.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110746.log.gz 2023-10-09T06:33:11.417 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106476.log 2023-10-09T06:33:11.417 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92117.log.gz 2023-10-09T06:33:11.417 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89104.log 2023-10-09T06:33:11.418 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104828.log.gz 2023-10-09T06:33:11.418 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.106476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94515.log 2023-10-09T06:33:11.418 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.89104.log: gzip 88.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.106476.log.gz--verbose 2023-10-09T06:33:11.418 INFO:teuthology.orchestra.run.smithi031.stderr:-- /var/log/ceph/ceph-client.admin.96165.log 2023-10-09T06:33:11.418 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94515.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89104.log.gz 2023-10-09T06:33:11.418 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88016.log 2023-10-09T06:33:11.418 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94515.log.gz 2023-10-09T06:33:11.418 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117724.log 2023-10-09T06:33:11.418 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88016.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96165.log.gzgzip 2023-10-09T06:33:11.418 INFO:teuthology.orchestra.run.smithi031.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.94389.log 2023-10-09T06:33:11.418 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117724.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88016.log.gz 2023-10-09T06:33:11.419 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99245.log 2023-10-09T06:33:11.419 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117724.log.gz 2023-10-09T06:33:11.419 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95559.log 2023-10-09T06:33:11.419 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99245.log: 88.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.94389.log.gz--verbose 2023-10-09T06:33:11.419 INFO:teuthology.orchestra.run.smithi031.stderr:-- /var/log/ceph/ceph-client.admin.113180.log 2023-10-09T06:33:11.419 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95559.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99245.log.gz 2023-10-09T06:33:11.419 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99077.log 2023-10-09T06:33:11.419 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95559.log.gz 2023-10-09T06:33:11.419 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102318.log 2023-10-09T06:33:11.419 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99077.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113180.log.gz 2023-10-09T06:33:11.419 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96078.log 2023-10-09T06:33:11.419 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102318.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99077.log.gz 2023-10-09T06:33:11.420 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108966.log 2023-10-09T06:33:11.420 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102318.log.gz 2023-10-09T06:33:11.420 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.96078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115044.log 2023-10-09T06:33:11.420 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96078.log.gz 2023-10-09T06:33:11.420 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98237.log 2023-10-09T06:33:11.420 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.108966.log.gz 2023-10-09T06:33:11.420 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104534.log 2023-10-09T06:33:11.420 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.98237.log: gzip -5 --verbose 88.8%-- /var/log/ceph/ceph-client.admin.118760.log -- replaced with /var/log/ceph/ceph-client.admin.115044.log.gz 2023-10-09T06:33:11.420 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-10-09T06:33:11.420 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104534.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98237.log.gz 2023-10-09T06:33:11.420 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110042.log 2023-10-09T06:33:11.420 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104534.log.gz 2023-10-09T06:33:11.421 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112193.log 2023-10-09T06:33:11.421 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110042.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118760.log.gz 2023-10-09T06:33:11.421 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92749.log 2023-10-09T06:33:11.421 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112193.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110042.log.gz 2023-10-09T06:33:11.421 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87239.log 2023-10-09T06:33:11.421 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112193.log.gz 2023-10-09T06:33:11.421 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113789.log 2023-10-09T06:33:11.421 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87239.log: gzip 89.5%-5 -- replaced with /var/log/ceph/ceph-client.admin.92749.log.gz--verbose 2023-10-09T06:33:11.421 INFO:teuthology.orchestra.run.smithi031.stderr:-- /var/log/ceph/ceph-client.admin.89398.log 2023-10-09T06:33:11.421 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113789.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87239.log.gz 2023-10-09T06:33:11.421 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104744.log 2023-10-09T06:33:11.421 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.89398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101468.log 2023-10-09T06:33:11.422 INFO:teuthology.orchestra.run.smithi031.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.113789.log.gz 2023-10-09T06:33:11.422 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89398.log.gz 2023-10-09T06:33:11.422 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108904.log 2023-10-09T06:33:11.422 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114540.log 2023-10-09T06:33:11.422 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101468.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104744.log.gz 2023-10-09T06:33:11.422 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89188.log 2023-10-09T06:33:11.422 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101468.log.gz 2023-10-09T06:33:11.422 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114540.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108904.log.gz 2023-10-09T06:33:11.422 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104265.log 2023-10-09T06:33:11.422 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.89188.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114540.log.gz 2023-10-09T06:33:11.422 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101342.log 2023-10-09T06:33:11.423 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89188.log.gz 2023-10-09T06:33:11.423 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111740.log 2023-10-09T06:33:11.423 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104265.log.gz 2023-10-09T06:33:11.423 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92917.log 2023-10-09T06:33:11.423 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.111740.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101342.log.gz 2023-10-09T06:33:11.423 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.0.111740.log.gz/var/log/ceph/ceph-client.0.103480.log 2023-10-09T06:33:11.423 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-10-09T06:33:11.423 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114708.log 2023-10-09T06:33:11.423 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92917.log.gz 2023-10-09T06:33:11.423 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.103480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92619.log 2023-10-09T06:33:11.423 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103480.log.gz 2023-10-09T06:33:11.423 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91158.log 2023-10-09T06:33:11.424 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.114708.log.gz 2023-10-09T06:33:11.424 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118718.log 2023-10-09T06:33:11.424 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91158.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92619.log.gz 2023-10-09T06:33:11.424 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106209.log 2023-10-09T06:33:11.424 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118718.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91158.log.gz 2023-10-09T06:33:11.424 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117766.log 2023-10-09T06:33:11.424 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.106209.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118718.log.gz 2023-10-09T06:33:11.424 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117537.log 2023-10-09T06:33:11.424 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106209.log.gz 2023-10-09T06:33:11.424 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107065.log 2023-10-09T06:33:11.424 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95727.log 88.9% 2023-10-09T06:33:11.424 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.117766.log.gz 2023-10-09T06:33:11.425 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107065.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117537.log.gz 2023-10-09T06:33:11.425 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113663.log 2023-10-09T06:33:11.425 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107065.log.gz 2023-10-09T06:33:11.425 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93169.log 2023-10-09T06:33:11.425 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113663.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95727.log.gz 2023-10-09T06:33:11.425 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87025.log 2023-10-09T06:33:11.425 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0%/var/log/ceph/ceph-client.admin.93169.log: -- replaced with /var/log/ceph/ceph-client.admin.113663.log.gz 2023-10-09T06:33:11.425 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110145.log 2023-10-09T06:33:11.425 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97460.log 2023-10-09T06:33:11.425 INFO:teuthology.orchestra.run.smithi031.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93169.log.gz 2023-10-09T06:33:11.425 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110145.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.87025.log.gz 2023-10-09T06:33:11.426 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92959.log 2023-10-09T06:33:11.426 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96082.log 2023-10-09T06:33:11.426 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97460.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110145.log.gz 2023-10-09T06:33:11.426 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92493.log 2023-10-09T06:33:11.426 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97460.log.gz 2023-10-09T06:33:11.426 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.96082.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92959.log.gz 2023-10-09T06:33:11.426 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106897.log 2023-10-09T06:33:11.426 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96082.log.gz 2023-10-09T06:33:11.426 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107668.log 2023-10-09T06:33:11.426 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92493.log.gz 2023-10-09T06:33:11.426 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.106897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100756.log 2023-10-09T06:33:11.427 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106897.log.gz 2023-10-09T06:33:11.427 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90778.log 2023-10-09T06:33:11.427 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90736.log 2023-10-09T06:33:11.427 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107668.log.gz 2023-10-09T06:33:11.427 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100756.log.gz 2023-10-09T06:33:11.427 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.90778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112403.log 2023-10-09T06:33:11.427 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90778.log.gz 2023-10-09T06:33:11.427 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.90736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105525.log 2023-10-09T06:33:11.427 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112403.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90736.log.gz 2023-10-09T06:33:11.427 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107955.log 2023-10-09T06:33:11.427 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112403.log.gz 2023-10-09T06:33:11.427 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115434.log 2023-10-09T06:33:11.428 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105525.log.gz 2023-10-09T06:33:11.428 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110187.log 2023-10-09T06:33:11.428 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115434.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107955.log.gz 2023-10-09T06:33:11.428 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111145.log 2023-10-09T06:33:11.428 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110187.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115434.log.gz 2023-10-09T06:33:11.428 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89062.log 2023-10-09T06:33:11.428 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110187.log.gz 2023-10-09T06:33:11.428 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93900.log 2023-10-09T06:33:11.428 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.89062.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111145.log.gz 2023-10-09T06:33:11.428 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95091.log 2023-10-09T06:33:11.428 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.93900.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.89062.log.gz 2023-10-09T06:33:11.428 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98748.log 2023-10-09T06:33:11.429 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93900.log.gz 2023-10-09T06:33:11.429 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107191.log 2023-10-09T06:33:11.429 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.98748.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95091.log.gz 2023-10-09T06:33:11.429 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94871.log 2023-10-09T06:33:11.429 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.98748.log.gz 2023-10-09T06:33:11.429 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107023.log 2023-10-09T06:33:11.429 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94871.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107191.log.gz 2023-10-09T06:33:11.429 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95133.log 2023-10-09T06:33:11.429 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107023.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94871.log.gz 2023-10-09T06:33:11.429 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112739.log 2023-10-09T06:33:11.429 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95133.log: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.107023.log.gz-5 2023-10-09T06:33:11.430 INFO:teuthology.orchestra.run.smithi031.stderr:--verbose -- /var/log/ceph/ceph-client.admin.100053.log 2023-10-09T06:33:11.430 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95133.log.gz 2023-10-09T06:33:11.430 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87153.log 2023-10-09T06:33:11.430 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112739.log.gz 2023-10-09T06:33:11.430 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110578.log 2023-10-09T06:33:11.430 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87153.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100053.log.gz 2023-10-09T06:33:11.430 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109790.log 2023-10-09T06:33:11.430 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110578.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.87153.log.gz 2023-10-09T06:33:11.430 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106167.log 2023-10-09T06:33:11.430 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110578.log.gz 2023-10-09T06:33:11.430 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104702.log 2023-10-09T06:33:11.431 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.106167.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109790.log.gz 2023-10-09T06:33:11.431 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114177.log 2023-10-09T06:33:11.431 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104702.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106167.log.gz 2023-10-09T06:33:11.431 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94725.log 2023-10-09T06:33:11.431 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104702.log.gz 2023-10-09T06:33:11.431 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100443.log 2023-10-09T06:33:11.431 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94725.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114177.log.gz 2023-10-09T06:33:11.431 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87592.log 2023-10-09T06:33:11.431 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100443.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.94725.log.gz 2023-10-09T06:33:11.431 INFO:teuthology.orchestra.run.smithi031.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.99726.log 2023-10-09T06:33:11.431 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100443.log.gz 2023-10-09T06:33:11.432 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104181.log 2023-10-09T06:33:11.432 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99726.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87592.log.gz 2023-10-09T06:33:11.432 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111061.log 2023-10-09T06:33:11.432 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99726.log.gz 2023-10-09T06:33:11.432 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91116.log 2023-10-09T06:33:11.432 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104181.log.gz 2023-10-09T06:33:11.432 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108623.log 2023-10-09T06:33:11.432 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91116.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111061.log.gz 2023-10-09T06:33:11.432 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93085.log 2023-10-09T06:33:11.432 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91116.log.gz 2023-10-09T06:33:11.432 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107352.log 2023-10-09T06:33:11.432 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108623.log.gz 2023-10-09T06:33:11.432 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 /var/log/ceph/ceph-client.admin.93085.log: --verbose -- /var/log/ceph/ceph-client.admin.112361.log 2023-10-09T06:33:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107352.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-09T06:33:11.433 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93085.log.gz 2023-10-09T06:33:11.433 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107352.log.gz 2023-10-09T06:33:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115784.log 2023-10-09T06:33:11.433 INFO:teuthology.orchestra.run.smithi031.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.112361.log.gz 2023-10-09T06:33:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112277.log 2023-10-09T06:33:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107250.log 2023-10-09T06:33:11.433 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115784.log.gz 2023-10-09T06:33:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86983.log 2023-10-09T06:33:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96318.log 2023-10-09T06:33:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107250.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112277.log.gz 2023-10-09T06:33:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.86983.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107250.log.gz 2023-10-09T06:33:11.434 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100137.log 2023-10-09T06:33:11.434 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106981.log 2023-10-09T06:33:11.434 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96318.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86983.log.gz 2023-10-09T06:33:11.434 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100137.log: gzip -5 --verbose 88.1%-- /var/log/ceph/ceph-client.admin.114666.log -- replaced with /var/log/ceph/ceph-client.admin.96318.log.gz 2023-10-09T06:33:11.434 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-10-09T06:33:11.434 INFO:teuthology.orchestra.run.smithi031.stderr: 85.3%gzip -5 -- replaced with /var/log/ceph/ceph.log.gz--verbose 2023-10-09T06:33:11.434 INFO:teuthology.orchestra.run.smithi031.stderr:-- /var/log/ceph/ceph-client.admin.111869.log 2023-10-09T06:33:11.434 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.106981.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.100137.log.gz 2023-10-09T06:33:11.434 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114666.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.106981.log.gz 2023-10-09T06:33:11.434 INFO:teuthology.orchestra.run.smithi031.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.95819.log 2023-10-09T06:33:11.434 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114666.log.gz 2023-10-09T06:33:11.435 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109110.log 2023-10-09T06:33:11.435 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95819.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111869.log.gz 2023-10-09T06:33:11.435 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95885.log 2023-10-09T06:33:11.435 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96830.log 2023-10-09T06:33:11.435 INFO:teuthology.orchestra.run.smithi031.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.95819.log.gz 2023-10-09T06:33:11.435 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95885.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109110.log.gz 2023-10-09T06:33:11.435 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94179.log 2023-10-09T06:33:11.435 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95885.log.gz 2023-10-09T06:33:11.435 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118634.log 2023-10-09T06:33:11.435 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94179.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96830.log.gz 2023-10-09T06:33:11.435 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86898.log 2023-10-09T06:33:11.435 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94179.log.gz 2023-10-09T06:33:11.436 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92833.log 2023-10-09T06:33:11.436 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1%/var/log/ceph/ceph-client.admin.86898.log: -- replaced with /var/log/ceph/ceph-client.admin.118634.log.gz 2023-10-09T06:33:11.436 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87718.log 2023-10-09T06:33:11.436 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92833.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86898.log.gz 2023-10-09T06:33:11.436 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111744.log 2023-10-09T06:33:11.436 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92833.log.gz 2023-10-09T06:33:11.436 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96872.log 2023-10-09T06:33:11.436 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.111744.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87718.log.gz 2023-10-09T06:33:11.436 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105053.log 2023-10-09T06:33:11.436 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.111744.log.gz 2023-10-09T06:33:11.436 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90518.log 2023-10-09T06:33:11.436 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87281.log 2023-10-09T06:33:11.437 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96872.log.gz 2023-10-09T06:33:11.437 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.90518.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.105053.log.gz-5 2023-10-09T06:33:11.437 INFO:teuthology.orchestra.run.smithi031.stderr:--verbose -- /var/log/ceph/ceph-client.admin.116834.log 2023-10-09T06:33:11.437 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87281.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.90518.log.gz 2023-10-09T06:33:11.437 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99455.log 2023-10-09T06:33:11.437 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116834.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87281.log.gz 2023-10-09T06:33:11.437 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100179.log 2023-10-09T06:33:11.437 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116834.log.gz 2023-10-09T06:33:11.437 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99830.log 2023-10-09T06:33:11.437 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90568.log 2023-10-09T06:33:11.437 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99455.log.gz 2023-10-09T06:33:11.437 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99830.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100179.log.gz 2023-10-09T06:33:11.438 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103179.log 2023-10-09T06:33:11.438 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99830.log.gz 2023-10-09T06:33:11.438 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.90568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92241.log 2023-10-09T06:33:11.438 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.103179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113621.log 88.3% 2023-10-09T06:33:11.438 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90568.log.gz 2023-10-09T06:33:11.438 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92241.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103179.log.gz 2023-10-09T06:33:11.438 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95305.log 2023-10-09T06:33:11.438 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92241.log.gz 2023-10-09T06:33:11.438 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114582.log 2023-10-09T06:33:11.438 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95305.log: gzip -5 87.8%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.113621.log.gz/var/log/ceph/ceph-client.admin.117621.log 2023-10-09T06:33:11.438 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-10-09T06:33:11.439 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95305.log.gz 2023-10-09T06:33:11.439 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111355.log 2023-10-09T06:33:11.439 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114582.log.gz 2023-10-09T06:33:11.439 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102994.log 2023-10-09T06:33:11.439 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111355.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117621.log.gz 2023-10-09T06:33:11.439 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116876.log 2023-10-09T06:33:11.439 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111355.log.gz 2023-10-09T06:33:11.439 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88015.log 2023-10-09T06:33:11.439 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116876.log: gzip -5 88.9%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.102994.log.gz/var/log/ceph/ceph-client.admin.110662.log 2023-10-09T06:33:11.439 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-10-09T06:33:11.439 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116876.log.gz 2023-10-09T06:33:11.439 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101907.log 2023-10-09T06:33:11.440 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101949.log 2023-10-09T06:33:11.440 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88015.log.gz 2023-10-09T06:33:11.440 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110662.log.gz 2023-10-09T06:33:11.440 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103137.log 2023-10-09T06:33:11.440 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101907.log.gz 2023-10-09T06:33:11.440 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100714.log 2023-10-09T06:33:11.440 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.103137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110229.log 2023-10-09T06:33:11.440 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101949.log.gz 2023-10-09T06:33:11.440 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103137.log.gz 2023-10-09T06:33:11.440 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93473.log 2023-10-09T06:33:11.441 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100714.log.gz 2023-10-09T06:33:11.441 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109489.log 2023-10-09T06:33:11.441 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.93473.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110229.log.gz 2023-10-09T06:33:11.441 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117411.log 2023-10-09T06:33:11.441 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93473.log.gz 2023-10-09T06:33:11.441 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118886.log 2023-10-09T06:33:11.441 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109489.log.gz 2023-10-09T06:33:11.441 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111785.log 2023-10-09T06:33:11.441 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108473.log 2023-10-09T06:33:11.441 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117411.log.gz 2023-10-09T06:33:11.442 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118886.log.gz 2023-10-09T06:33:11.442 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111397.log 2023-10-09T06:33:11.442 INFO:teuthology.orchestra.run.smithi031.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.111785.log.gz 2023-10-09T06:33:11.442 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100864.log 2023-10-09T06:33:11.442 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111397.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108473.log.gz 2023-10-09T06:33:11.442 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101144.log 2023-10-09T06:33:11.442 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111397.log.gz 2023-10-09T06:33:11.442 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88019.log 2023-10-09T06:33:11.442 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100864.log.gz 2023-10-09T06:33:11.442 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105135.log 2023-10-09T06:33:11.442 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88019.log: gzip -5 --verbose -- 88.2%/var/log/ceph/ceph-client.admin.114135.log 2023-10-09T06:33:11.443 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101144.log.gz 2023-10-09T06:33:11.443 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88019.log.gz 2023-10-09T06:33:11.443 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88018.log 2023-10-09T06:33:11.443 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.105135.log.gz 2023-10-09T06:33:11.443 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118046.log 2023-10-09T06:33:11.443 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88018.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114135.log.gz 2023-10-09T06:33:11.443 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91217.log 2023-10-09T06:33:11.443 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88018.log.gz 2023-10-09T06:33:11.443 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90065.log 2023-10-09T06:33:11.443 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118046.log.gz 2023-10-09T06:33:11.444 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96634.log 2023-10-09T06:33:11.444 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.90065.log: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.91217.log.gz--verbose 2023-10-09T06:33:11.444 INFO:teuthology.orchestra.run.smithi031.stderr:-- /var/log/ceph/ceph-client.admin.113222.log 2023-10-09T06:33:11.444 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.90065.log.gz 2023-10-09T06:33:11.444 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114624.log 2023-10-09T06:33:11.444 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113222.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96634.log.gz 2023-10-09T06:33:11.444 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104786.log 2023-10-09T06:33:11.444 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113222.log.gz 2023-10-09T06:33:11.444 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87197.log 2023-10-09T06:33:11.444 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104786.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114624.log.gzgzip 2023-10-09T06:33:11.444 INFO:teuthology.orchestra.run.smithi031.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.118004.log 2023-10-09T06:33:11.444 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104786.log.gz 2023-10-09T06:33:11.445 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115148.log 2023-10-09T06:33:11.445 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.87197.log.gz 2023-10-09T06:33:11.445 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100672.log 2023-10-09T06:33:11.445 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97887.log 2023-10-09T06:33:11.445 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118004.log.gz 2023-10-09T06:33:11.445 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100672.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115148.log.gz 2023-10-09T06:33:11.445 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115350.log 2023-10-09T06:33:11.445 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100672.log.gz 2023-10-09T06:33:11.445 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92039.log 2023-10-09T06:33:11.445 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92663.log 2023-10-09T06:33:11.446 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97887.log.gz 2023-10-09T06:33:11.446 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92039.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115350.log.gz 2023-10-09T06:33:11.446 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96123.log 2023-10-09T06:33:11.446 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92039.log.gz 2023-10-09T06:33:11.446 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98279.log 2023-10-09T06:33:11.446 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118214.log 2023-10-09T06:33:11.446 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92663.log.gz 2023-10-09T06:33:11.446 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.98279.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96123.log.gz 2023-10-09T06:33:11.446 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89658.log 2023-10-09T06:33:11.446 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98279.log.gz 2023-10-09T06:33:11.446 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118214.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-09T06:33:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.89658.log: gzip 89.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.118214.log.gz--verbose 2023-10-09T06:33:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:-- /var/log/ceph/ceph-client.admin.111002.log 2023-10-09T06:33:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.audit.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.89658.log.gz 2023-10-09T06:33:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115868.log 2023-10-09T06:33:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118676.log 2023-10-09T06:33:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115868.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111002.log.gz 2023-10-09T06:33:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87760.log 2023-10-09T06:33:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99329.log 2023-10-09T06:33:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118676.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115868.log.gz 2023-10-09T06:33:11.447 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113352.log 2023-10-09T06:33:11.447 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118676.log.gz 2023-10-09T06:33:11.448 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87760.log.gz 2023-10-09T06:33:11.448 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101822.log 2023-10-09T06:33:11.448 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99329.log: /var/log/ceph/ceph-client.admin.113352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101510.log 2023-10-09T06:33:11.448 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99329.log.gz 2023-10-09T06:33:11.448 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101822.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113352.log.gz 2023-10-09T06:33:11.448 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94137.log 2023-10-09T06:33:11.448 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101822.log.gz 2023-10-09T06:33:11.448 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89146.log 2023-10-09T06:33:11.448 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-09T06:33:11.449 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107437.log 2023-10-09T06:33:11.449 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94137.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101510.log.gz 2023-10-09T06:33:11.449 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.89146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92283.log 2023-10-09T06:33:11.449 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94137.log.gz 2023-10-09T06:33:11.449 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.89146.log.gz 2023-10-09T06:33:11.449 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105821.log 2023-10-09T06:33:11.449 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92283.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107437.log.gz 2023-10-09T06:33:11.449 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108862.log 2023-10-09T06:33:11.449 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92283.log.gz 2023-10-09T06:33:11.449 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93043.log 2023-10-09T06:33:11.449 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108862.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.105821.log.gz-5 2023-10-09T06:33:11.450 INFO:teuthology.orchestra.run.smithi031.stderr:--verbose -- /var/log/ceph/ceph-client.admin.107292.log 2023-10-09T06:33:11.450 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108862.log.gz 2023-10-09T06:33:11.450 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.93043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116698.log 2023-10-09T06:33:11.450 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93043.log.gz 2023-10-09T06:33:11.450 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100798.log 2023-10-09T06:33:11.450 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116698.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107292.log.gz 2023-10-09T06:33:11.450 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104366.log 2023-10-09T06:33:11.450 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116698.log.gz 2023-10-09T06:33:11.450 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93557.log 2023-10-09T06:33:11.451 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96418.log 2023-10-09T06:33:11.451 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.93557.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104366.log.gz 2023-10-09T06:33:11.451 INFO:teuthology.orchestra.run.smithi031.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.100798.log.gz 2023-10-09T06:33:11.451 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118987.log 2023-10-09T06:33:11.451 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93557.log.gz 2023-10-09T06:33:11.451 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110355.log 2023-10-09T06:33:11.451 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118987.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96418.log.gz 2023-10-09T06:33:11.451 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115698.log 2023-10-09T06:33:11.451 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91787.log 2023-10-09T06:33:11.451 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118987.log.gz 2023-10-09T06:33:11.451 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110355.log.gz 2023-10-09T06:33:11.452 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117495.log 2023-10-09T06:33:11.452 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115698.log.gz 2023-10-09T06:33:11.452 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90946.log 2023-10-09T06:33:11.452 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117495.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91787.log.gz 2023-10-09T06:33:11.452 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99161.log 2023-10-09T06:33:11.452 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117495.log.gz 2023-10-09T06:33:11.452 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.90946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115226.log 2023-10-09T06:33:11.452 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99161.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90946.log.gz 2023-10-09T06:33:11.452 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105303.log 2023-10-09T06:33:11.452 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99161.log.gz 2023-10-09T06:33:11.452 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102742.log 2023-10-09T06:33:11.453 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115226.log.gz 2023-10-09T06:33:11.453 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96676.log 2023-10-09T06:33:11.453 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88342.log 2023-10-09T06:33:11.453 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105303.log.gz 2023-10-09T06:33:11.453 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96676.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102742.log.gz 2023-10-09T06:33:11.453 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94933.log 2023-10-09T06:33:11.453 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96676.log.gz 2023-10-09T06:33:11.453 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93432.log 2023-10-09T06:33:11.453 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91363.log 2023-10-09T06:33:11.453 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88342.log.gz 2023-10-09T06:33:11.453 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.93432.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94933.log.gz 2023-10-09T06:33:11.454 INFO:teuthology.orchestra.run.smithi031.stderr:gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.0.93432.log.gz-- 2023-10-09T06:33:11.454 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.119029.log 2023-10-09T06:33:11.454 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88012.log 2023-10-09T06:33:11.454 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.119029.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91363.log.gz 2023-10-09T06:33:11.454 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92199.log 2023-10-09T06:33:11.454 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119029.log.gz 2023-10-09T06:33:11.454 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102158.log 2023-10-09T06:33:11.454 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88012.log.gz 2023-10-09T06:33:11.454 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92199.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-09T06:33:11.454 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102158.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92199.log.gz 2023-10-09T06:33:11.454 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95433.log 2023-10-09T06:33:11.454 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102158.log.gz 2023-10-09T06:33:11.455 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89440.log 2023-10-09T06:33:11.455 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109622.log 2023-10-09T06:33:11.455 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.89440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107871.log 2023-10-09T06:33:11.455 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95433.log.gz 2023-10-09T06:33:11.455 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89440.log.gz 2023-10-09T06:33:11.455 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91829.log 2023-10-09T06:33:11.455 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109622.log.gz 2023-10-09T06:33:11.455 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99684.log 2023-10-09T06:33:11.455 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107871.log: /var/log/ceph/ceph-client.admin.91829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99768.log 2023-10-09T06:33:11.455 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107871.log.gz 2023-10-09T06:33:11.455 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99684.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91829.log.gz 2023-10-09T06:33:11.456 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111313.log 2023-10-09T06:33:11.456 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87067.log 2023-10-09T06:33:11.456 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99768.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99684.log.gz 2023-10-09T06:33:11.456 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99893.log 2023-10-09T06:33:11.456 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99768.log.gz 2023-10-09T06:33:11.456 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88338.log 2023-10-09T06:33:11.456 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111313.log.gz 2023-10-09T06:33:11.456 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87067.log: /var/log/ceph/ceph-client.admin.99893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91535.log 2023-10-09T06:33:11.456 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87067.log.gz 2023-10-09T06:33:11.456 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1%/var/log/ceph/ceph-client.admin.88338.log: -- replaced with /var/log/ceph/ceph-client.admin.99893.log.gz 2023-10-09T06:33:11.456 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110000.log 2023-10-09T06:33:11.457 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88338.log.gz 2023-10-09T06:33:11.457 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105569.log 2023-10-09T06:33:11.457 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110834.log 2023-10-09T06:33:11.457 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91535.log.gz 2023-10-09T06:33:11.457 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110000.log: /var/log/ceph/ceph-client.admin.105569.log: gzip -5 --verbose 88.1%-- /var/log/ceph/ceph-client.admin.89356.log -- replaced with /var/log/ceph/ceph-client.admin.110000.log.gz 2023-10-09T06:33:11.457 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-10-09T06:33:11.457 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105569.log.gz 2023-10-09T06:33:11.457 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113266.log 2023-10-09T06:33:11.457 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.89356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103985.log 2023-10-09T06:33:11.457 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110834.log.gz 2023-10-09T06:33:11.457 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113266.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.89356.log.gz 2023-10-09T06:33:11.458 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112781.log 2023-10-09T06:33:11.458 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113266.log.gz 2023-10-09T06:33:11.458 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.103985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103525.log 2023-10-09T06:33:11.458 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96998.log 2023-10-09T06:33:11.458 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103985.log.gz 2023-10-09T06:33:11.458 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112781.log: /var/log/ceph/ceph-client.admin.103525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93235.log 2023-10-09T06:33:11.458 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112781.log.gz 2023-10-09T06:33:11.458 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103525.log.gz 2023-10-09T06:33:11.458 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95685.log 2023-10-09T06:33:11.458 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96998.log: /var/log/ceph/ceph-client.admin.93235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109958.log 2023-10-09T06:33:11.458 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96998.log.gz 2023-10-09T06:33:11.459 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95685.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93235.log.gz 2023-10-09T06:33:11.459 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104408.log 2023-10-09T06:33:11.459 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95685.log.gz 2023-10-09T06:33:11.459 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115614.log 2023-10-09T06:33:11.459 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90862.log 2023-10-09T06:33:11.459 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104408.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109958.log.gz 2023-10-09T06:33:11.459 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91259.log 2023-10-09T06:33:11.459 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104408.log.gz 2023-10-09T06:33:11.459 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115614.log.gz 2023-10-09T06:33:11.459 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102952.log 2023-10-09T06:33:11.459 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.90862.log: /var/log/ceph/ceph-client.admin.91259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97250.log 2023-10-09T06:33:11.459 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90862.log.gz 2023-10-09T06:33:11.460 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102952.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91259.log.gz 2023-10-09T06:33:11.460 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109447.log 2023-10-09T06:33:11.460 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102952.log.gz 2023-10-09T06:33:11.460 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99287.log 2023-10-09T06:33:11.460 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114372.log 2023-10-09T06:33:11.460 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109447.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97250.log.gz 2023-10-09T06:33:11.460 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91913.log 2023-10-09T06:33:11.460 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109447.log.gz 2023-10-09T06:33:11.460 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99287.log.gz 2023-10-09T06:33:11.460 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106597.log 2023-10-09T06:33:11.460 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114372.log: /var/log/ceph/ceph-client.admin.91913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98195.log 2023-10-09T06:33:11.461 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114372.log.gz 2023-10-09T06:33:11.461 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.106597.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91913.log.gz 2023-10-09T06:33:11.461 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114052.log 2023-10-09T06:33:11.461 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106597.log.gz 2023-10-09T06:33:11.461 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.98195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91301.log 2023-10-09T06:33:11.461 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112655.log 2023-10-09T06:33:11.461 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.114052.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98195.log.gz 2023-10-09T06:33:11.461 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114052.log.gz 2023-10-09T06:33:11.461 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117201.log 2023-10-09T06:33:11.461 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91301.log.gz 2023-10-09T06:33:11.461 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104660.log 2023-10-09T06:33:11.461 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110496.log 2023-10-09T06:33:11.462 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112655.log.gz 2023-10-09T06:33:11.462 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104660.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117201.log.gz 2023-10-09T06:33:11.462 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94767.log 2023-10-09T06:33:11.462 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104660.log.gz 2023-10-09T06:33:11.462 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101865.log 2023-10-09T06:33:11.462 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94683.log 2023-10-09T06:33:11.462 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94767.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110496.log.gz 2023-10-09T06:33:11.462 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98405.log 2023-10-09T06:33:11.462 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94767.log.gz 2023-10-09T06:33:11.462 INFO:teuthology.orchestra.run.smithi031.stderr:gzip 88.9%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.101865.log.gz-- 2023-10-09T06:33:11.462 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113537.log 2023-10-09T06:33:11.462 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94683.log: /var/log/ceph/ceph-client.admin.98405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117850.log 2023-10-09T06:33:11.463 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94683.log.gz 2023-10-09T06:33:11.463 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113537.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98405.log.gz 2023-10-09T06:33:11.463 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103095.log 2023-10-09T06:33:11.463 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113537.log.gz 2023-10-09T06:33:11.463 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86351.log 2023-10-09T06:33:11.463 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88688.log 2023-10-09T06:33:11.463 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.103095.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117850.log.gz 2023-10-09T06:33:11.463 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.86351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104618.log 2023-10-09T06:33:11.463 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103095.log.gz 2023-10-09T06:33:11.463 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86351.log.gz 2023-10-09T06:33:11.463 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100571.log 2023-10-09T06:33:11.463 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88688.log: /var/log/ceph/ceph-client.admin.104618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115910.log 2023-10-09T06:33:11.464 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.88688.log.gz 2023-10-09T06:33:11.464 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100571.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104618.log.gz 2023-10-09T06:33:11.464 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98835.log 2023-10-09T06:33:11.464 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100571.log.gz 2023-10-09T06:33:11.464 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92791.log 2023-10-09T06:33:11.464 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114093.log 2023-10-09T06:33:11.464 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.98835.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115910.log.gz 2023-10-09T06:33:11.464 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92791.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98835.log.gz 2023-10-09T06:33:11.464 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118340.log 2023-10-09T06:33:11.464 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92791.log.gz 2023-10-09T06:33:11.464 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113855.log 2023-10-09T06:33:11.465 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113747.log 2023-10-09T06:33:11.465 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114093.log.gz 2023-10-09T06:33:11.465 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92535.log 2023-10-09T06:33:11.465 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118340.log.gz 2023-10-09T06:33:11.465 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113855.log.gz 2023-10-09T06:33:11.465 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87802.log 2023-10-09T06:33:11.465 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113747.log.gz 2023-10-09T06:33:11.465 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96550.log 2023-10-09T06:33:11.465 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92535.log: /var/log/ceph/ceph-client.admin.87802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96956.log 2023-10-09T06:33:11.465 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92535.log.gz 2023-10-09T06:33:11.465 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96550.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87802.log.gz 2023-10-09T06:33:11.465 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86682.log 2023-10-09T06:33:11.466 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118508.log 2023-10-09T06:33:11.466 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96956.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96550.log.gz 2023-10-09T06:33:11.466 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.86682.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96956.log.gz 2023-10-09T06:33:11.466 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111229.log 2023-10-09T06:33:11.466 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.86682.log.gz 2023-10-09T06:33:11.466 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109916.log 2023-10-09T06:33:11.466 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118508.log: /var/log/ceph/ceph-client.admin.111229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92325.log 2023-10-09T06:33:11.466 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118508.log.gz 2023-10-09T06:33:11.466 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109916.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111229.log.gz 2023-10-09T06:33:11.466 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108515.log 2023-10-09T06:33:11.466 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109916.log.gz 2023-10-09T06:33:11.466 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93779.log 2023-10-09T06:33:11.467 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92325.log.gz 2023-10-09T06:33:11.467 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107913.log 2023-10-09T06:33:11.467 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108515.log: /var/log/ceph/ceph-client.admin.93779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89524.log 2023-10-09T06:33:11.467 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108515.log.gz 2023-10-09T06:33:11.467 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107913.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93779.log.gz 2023-10-09T06:33:11.467 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101061.log 2023-10-09T06:33:11.467 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114834.log 2023-10-09T06:33:11.467 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.89524.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107913.log.gz 2023-10-09T06:33:11.467 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.101061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114498.log 2023-10-09T06:33:11.467 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101061.log.gz 2023-10-09T06:33:11.467 INFO:teuthology.orchestra.run.smithi031.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.89524.log.gz 2023-10-09T06:33:11.467 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101720.log 2023-10-09T06:33:11.468 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111827.log 2023-10-09T06:33:11.468 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114498.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114834.log.gz 2023-10-09T06:33:11.468 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101720.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114498.log.gz 2023-10-09T06:33:11.468 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112487.log 2023-10-09T06:33:11.468 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92577.log 2023-10-09T06:33:11.468 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101720.log.gz 2023-10-09T06:33:11.468 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111827.log.gz 2023-10-09T06:33:11.468 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115086.log 2023-10-09T06:33:11.468 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88978.log 2023-10-09T06:33:11.468 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92577.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.112487.log.gz 2023-10-09T06:33:11.468 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115086.log: gzip -5 88.7%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.92577.log.gz 2023-10-09T06:33:11.468 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.86856.log 2023-10-09T06:33:11.469 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88351.log 2023-10-09T06:33:11.469 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88978.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115086.log.gz 2023-10-09T06:33:11.469 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.86856.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88978.log.gz 2023-10-09T06:33:11.469 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117069.log 2023-10-09T06:33:11.469 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100221.log 2023-10-09T06:33:11.469 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88351.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86856.log.gz 2023-10-09T06:33:11.469 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117069.log: gzip -5 --verbose 87.7%-- /var/log/ceph/ceph-client.admin.97803.log -- replaced with /var/log/ceph/ceph-client.admin.88351.log.gz 2023-10-09T06:33:11.469 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-10-09T06:33:11.469 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102444.log 2023-10-09T06:33:11.469 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100221.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117069.log.gz 2023-10-09T06:33:11.469 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97803.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100221.log.gz 2023-10-09T06:33:11.469 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108816.log 2023-10-09T06:33:11.470 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108305.log 2023-10-09T06:33:11.470 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102444.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97803.log.gz 2023-10-09T06:33:11.470 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.108816.log: gzip -5 --verbose -- 88.7%/var/log/ceph/ceph-client.admin.88681.log 2023-10-09T06:33:11.470 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102444.log.gz 2023-10-09T06:33:11.470 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.108816.log.gz 2023-10-09T06:33:11.470 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108305.log: /var/log/ceph/ceph-client.admin.100401.log 2023-10-09T06:33:11.470 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108305.log.gz 2023-10-09T06:33:11.470 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106392.log 2023-10-09T06:33:11.470 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103935.log 2023-10-09T06:33:11.470 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100401.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88681.log.gz 2023-10-09T06:33:11.470 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.106392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86775.log 2023-10-09T06:33:11.471 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100401.log.gz 2023-10-09T06:33:11.471 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97761.log 2023-10-09T06:33:11.471 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.103935.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106392.log.gz 2023-10-09T06:33:11.471 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.86775.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103935.log.gz 2023-10-09T06:33:11.471 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103567.log 2023-10-09T06:33:11.471 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116358.log 2023-10-09T06:33:11.471 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97761.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86775.log.gz 2023-10-09T06:33:11.471 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.103567.log: gzip -5 --verbose 88.7%-- /var/log/ceph/ceph-client.admin.107563.log -- replaced with /var/log/ceph/ceph-client.admin.97761.log.gz 2023-10-09T06:33:11.471 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-10-09T06:33:11.471 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116358.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103567.log.gz 2023-10-09T06:33:11.471 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110620.log 2023-10-09T06:33:11.471 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107563.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.116358.log.gz 2023-10-09T06:33:11.472 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.116316.log 2023-10-09T06:33:11.472 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114048.log 2023-10-09T06:33:11.472 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110620.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107563.log.gz 2023-10-09T06:33:11.472 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.116316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89020.log 2023-10-09T06:33:11.472 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110620.log.gz 2023-10-09T06:33:11.472 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.0.116316.log.gz 2023-10-09T06:33:11.472 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.114048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89314.log 2023-10-09T06:33:11.472 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114048.log.gz 2023-10-09T06:33:11.472 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.89020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106271.log 2023-10-09T06:33:11.472 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.89314.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89020.log.gz 2023-10-09T06:33:11.472 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108263.log 2023-10-09T06:33:11.472 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89314.log.gz 2023-10-09T06:33:11.473 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.106271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90610.log 2023-10-09T06:33:11.473 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106271.log.gz 2023-10-09T06:33:11.473 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95517.log 2023-10-09T06:33:11.473 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.90473.log 2023-10-09T06:33:11.473 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.90610.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108263.log.gz 2023-10-09T06:33:11.473 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95517.log: 89.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.90610.log.gz--verbose 2023-10-09T06:33:11.473 INFO:teuthology.orchestra.run.smithi031.stderr:-- /var/log/ceph/ceph-client.admin.88352.log 2023-10-09T06:33:11.473 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116640.log 2023-10-09T06:33:11.473 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.2.90473.log: 0.0% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95517.log.gz -- replaced with /var/log/ceph/ceph-client.2.90473.log.gz 2023-10-09T06:33:11.473 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-10-09T06:33:11.473 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97973.log 2023-10-09T06:33:11.473 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88352.log.gz 2023-10-09T06:33:11.474 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102486.log 2023-10-09T06:33:11.474 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97973.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116640.log.gz 2023-10-09T06:33:11.474 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93678.log 2023-10-09T06:33:11.474 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101991.log 2023-10-09T06:33:11.474 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102486.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97973.log.gz 2023-10-09T06:33:11.474 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.93678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94221.log 87.6% 2023-10-09T06:33:11.474 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102486.log.gz 2023-10-09T06:33:11.474 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104912.log 2023-10-09T06:33:11.474 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101991.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93678.log.gz 2023-10-09T06:33:11.474 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105347.log 2023-10-09T06:33:11.474 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101991.log.gz 2023-10-09T06:33:11.475 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97292.log 2023-10-09T06:33:11.475 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104912.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94221.log.gz 2023-10-09T06:33:11.475 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91577.log 2023-10-09T06:33:11.475 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104912.log.gz 2023-10-09T06:33:11.475 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118802.log 2023-10-09T06:33:11.475 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97292.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105347.log.gz 2023-10-09T06:33:11.475 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91577.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.97292.log.gz-5 2023-10-09T06:33:11.475 INFO:teuthology.orchestra.run.smithi031.stderr:--verbose -- /var/log/ceph/ceph-client.admin.98321.log 2023-10-09T06:33:11.475 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112972.log 2023-10-09T06:33:11.475 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118802.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91577.log.gz 2023-10-09T06:33:11.475 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.98321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107395.log 2023-10-09T06:33:11.475 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118802.log.gz 2023-10-09T06:33:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97208.log 2023-10-09T06:33:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112972.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98321.log.gz 2023-10-09T06:33:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107395.log: gzip 89.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.112972.log.gz--verbose 2023-10-09T06:33:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:-- /var/log/ceph/ceph-client.admin.94305.log 2023-10-09T06:33:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94599.log 2023-10-09T06:33:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97208.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107395.log.gz 2023-10-09T06:33:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94305.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97208.log.gz 2023-10-09T06:33:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109874.log 2023-10-09T06:33:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87323.log 2023-10-09T06:33:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94599.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94305.log.gz 2023-10-09T06:33:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109874.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94599.log.gz 2023-10-09T06:33:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-09T06:33:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101636.log 2023-10-09T06:33:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87323.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109874.log.gz 2023-10-09T06:33:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91703.log 2023-10-09T06:33:11.477 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87323.log.gz 2023-10-09T06:33:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101102.log 2023-10-09T06:33:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101636.log: /var/log/ceph/ceph-client.admin.91703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92451.log 2023-10-09T06:33:11.477 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101636.log.gz 2023-10-09T06:33:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101102.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-09T06:33:11.477 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91703.log.gz 2023-10-09T06:33:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92451.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.101102.log.gz-5 2023-10-09T06:33:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:--verbose -- /var/log/ceph/ceph-client.admin.88008.log 2023-10-09T06:33:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98363.log 2023-10-09T06:33:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.1.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.92451.log.gz 2023-10-09T06:33:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110960.log 2023-10-09T06:33:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.98363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103703.log 2023-10-09T06:33:11.478 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88008.log.gz 2023-10-09T06:33:11.478 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98363.log.gz 2023-10-09T06:33:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105483.log 2023-10-09T06:33:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:gzip /var/log/ceph/ceph-client.admin.103703.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.98067.log 2023-10-09T06:33:11.478 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110960.log.gz 2023-10-09T06:33:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105483.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103703.log.gz 2023-10-09T06:33:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87382.log 2023-10-09T06:33:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.98067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91997.log 2023-10-09T06:33:11.479 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105483.log.gz 2023-10-09T06:33:11.479 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98067.log.gz 2023-10-09T06:33:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97719.log 2023-10-09T06:33:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113705.log 2023-10-09T06:33:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91997.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87382.log.gz 2023-10-09T06:33:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97719.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.91997.log.gz 2023-10-09T06:33:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110271.log 2023-10-09T06:33:11.479 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97719.log.gz 2023-10-09T06:33:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113705.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113705.log.gz 2023-10-09T06:33:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110271.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110271.log.gz 2023-10-09T06:33:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95391.log 2023-10-09T06:33:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102616.log 2023-10-09T06:33:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102530.log 2023-10-09T06:33:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104450.log 2023-10-09T06:33:11.480 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95391.log.gz 2023-10-09T06:33:11.480 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102616.log.gz 2023-10-09T06:33:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102530.log: /var/log/ceph/ceph-client.admin.104450.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102530.log.gz 2023-10-09T06:33:11.480 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104450.log.gz 2023-10-09T06:33:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102574.log 2023-10-09T06:33:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104492.log 2023-10-09T06:33:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98017.log 2023-10-09T06:33:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109706.log 2023-10-09T06:33:11.480 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102574.log.gz 2023-10-09T06:33:11.480 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104492.log.gz 2023-10-09T06:33:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.98017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112823.log 2023-10-09T06:33:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88936.log 2023-10-09T06:33:11.481 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98017.log.gz 2023-10-09T06:33:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99600.log 2023-10-09T06:33:11.481 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109706.log.gz 2023-10-09T06:33:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106122.log 2023-10-09T06:33:11.481 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112823.log.gz 2023-10-09T06:33:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99600.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88936.log.gz 2023-10-09T06:33:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88014.log 2023-10-09T06:33:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.106122.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99600.log.gz 2023-10-09T06:33:11.481 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106122.log.gz 2023-10-09T06:33:11.482 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97845.log 2023-10-09T06:33:11.482 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88014.log.gz 2023-10-09T06:33:11.482 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87676.log 2023-10-09T06:33:11.482 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91955.log 2023-10-09T06:33:11.482 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87676.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-09T06:33:11.482 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97845.log.gz 2023-10-09T06:33:11.482 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87676.log.gz 2023-10-09T06:33:11.482 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97124.log 2023-10-09T06:33:11.482 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 /var/log/ceph/ceph-mon.a.log: --verbose -- /var/log/ceph/ceph-client.0.106126.log 2023-10-09T06:33:11.482 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91955.log.gz 2023-10-09T06:33:11.482 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88687.log 2023-10-09T06:33:11.482 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.106126.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97124.log.gz 2023-10-09T06:33:11.483 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106126.log.gz 2023-10-09T06:33:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88687.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88687.log.gz 2023-10-09T06:33:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86941.log 2023-10-09T06:33:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113579.log 2023-10-09T06:33:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.86941.log: /var/log/ceph/ceph-client.admin.113579.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86941.log.gz 2023-10-09T06:33:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112894.log 2023-10-09T06:33:11.483 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113579.log.gz 2023-10-09T06:33:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116036.log 2023-10-09T06:33:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105863.log 2023-10-09T06:33:11.483 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112894.log.gz 2023-10-09T06:33:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116036.log: /var/log/ceph/ceph-client.admin.105863.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.116036.log.gz 2023-10-09T06:33:11.484 INFO:teuthology.orchestra.run.smithi031.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.105863.log.gz 2023-10-09T06:33:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99642.log 2023-10-09T06:33:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101057.log 2023-10-09T06:33:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86082.log 2023-10-09T06:33:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.101057.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99642.log.gz 2023-10-09T06:33:11.484 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101057.log.gz 2023-10-09T06:33:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.86082.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86082.log.gz 2023-10-09T06:33:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115656.log 2023-10-09T06:33:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91661.log 2023-10-09T06:33:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88346.log 2023-10-09T06:33:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91661.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115656.log.gz 2023-10-09T06:33:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88346.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91661.log.gz 2023-10-09T06:33:11.485 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88346.log.gz 2023-10-09T06:33:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118550.log 2023-10-09T06:33:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103893.log 2023-10-09T06:33:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93127.log 2023-10-09T06:33:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.103893.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118550.log.gz 2023-10-09T06:33:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.93127.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103893.log.gz 2023-10-09T06:33:11.485 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93127.log.gz 2023-10-09T06:33:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103036.log 2023-10-09T06:33:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96788.log 2023-10-09T06:33:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.103036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105779.log 2023-10-09T06:33:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96788.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103036.log.gz 2023-10-09T06:33:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105779.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96788.log.gz 2023-10-09T06:33:11.486 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105779.log.gz 2023-10-09T06:33:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88686.log 2023-10-09T06:33:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105611.log 2023-10-09T06:33:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115994.log 2023-10-09T06:33:11.486 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88686.log.gz 2023-10-09T06:33:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105611.log: /var/log/ceph/ceph-client.admin.115994.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105611.log.gz 2023-10-09T06:33:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89272.log 2023-10-09T06:33:11.486 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.115994.log.gz 2023-10-09T06:33:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108085.log 2023-10-09T06:33:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111187.log 2023-10-09T06:33:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.89272.log: /var/log/ceph/ceph-client.admin.108085.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89272.log.gz 2023-10-09T06:33:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111187.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108085.log.gz 2023-10-09T06:33:11.486 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.111187.log.gz 2023-10-09T06:33:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108389.log 2023-10-09T06:33:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87634.log 2023-10-09T06:33:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116985.log 2023-10-09T06:33:11.487 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2%/var/log/ceph/ceph-client.admin.87634.log: -- replaced with /var/log/ceph/ceph-client.admin.108389.log.gz 2023-10-09T06:33:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116985.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87634.log.gz 2023-10-09T06:33:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:gzip 89.5%-5 -- replaced with /var/log/ceph/ceph-client.admin.116985.log.gz--verbose 2023-10-09T06:33:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:-- /var/log/ceph/ceph-client.admin.115002.log 2023-10-09T06:33:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116556.log 2023-10-09T06:33:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88353.log 2023-10-09T06:33:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116556.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115002.log.gz 2023-10-09T06:33:11.487 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88353.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116556.log.gz 2023-10-09T06:33:11.487 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88353.log.gz 2023-10-09T06:33:11.488 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88558.log 2023-10-09T06:33:11.488 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88013.log 2023-10-09T06:33:11.489 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92367.log 2023-10-09T06:33:11.489 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88013.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88558.log.gz 2023-10-09T06:33:11.489 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92367.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88013.log.gz 2023-10-09T06:33:11.489 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92367.log.gz 2023-10-09T06:33:11.490 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114750.log 2023-10-09T06:33:11.490 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91745.log 2023-10-09T06:33:11.490 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116598.log 2023-10-09T06:33:11.490 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91745.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114750.log.gz 2023-10-09T06:33:11.490 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116598.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91745.log.gz 2023-10-09T06:33:11.490 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116598.log.gz 2023-10-09T06:33:11.490 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.116312.log 2023-10-09T06:33:11.490 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106434.log 2023-10-09T06:33:11.490 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.116312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101426.log 2023-10-09T06:33:11.490 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.116312.log.gz 2023-10-09T06:33:11.490 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.106434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101594.log 2023-10-09T06:33:11.491 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101426.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106434.log.gz 2023-10-09T06:33:11.491 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101594.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101426.log.gz 2023-10-09T06:33:11.491 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108219.log 2023-10-09T06:33:11.491 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101594.log.gz 2023-10-09T06:33:11.491 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113394.log 2023-10-09T06:33:11.491 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102868.log 2023-10-09T06:33:11.491 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113394.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108219.log.gz 2023-10-09T06:33:11.491 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102868.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113394.log.gz 2023-10-09T06:33:11.491 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102868.log.gz 2023-10-09T06:33:11.491 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96259.log 2023-10-09T06:33:11.491 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109832.log 2023-10-09T06:33:11.491 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98151.log 2023-10-09T06:33:11.492 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109832.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96259.log.gz 2023-10-09T06:33:11.492 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.98151.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109832.log.gz 2023-10-09T06:33:11.492 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98151.log.gz 2023-10-09T06:33:11.492 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99203.log 2023-10-09T06:33:11.492 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91619.log 2023-10-09T06:33:11.492 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105391.log 2023-10-09T06:33:11.492 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99203.log.gz 2023-10-09T06:33:11.492 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91619.log: /var/log/ceph/ceph-client.admin.105391.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91619.log.gz 2023-10-09T06:33:11.492 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105391.log.gz 2023-10-09T06:33:11.492 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116740.log 2023-10-09T06:33:11.492 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99119.log 2023-10-09T06:33:11.492 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101552.log 2023-10-09T06:33:11.493 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99119.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116740.log.gz 2023-10-09T06:33:11.493 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101552.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99119.log.gz 2023-10-09T06:33:11.493 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101552.log.gz 2023-10-09T06:33:11.493 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88690.log 2023-10-09T06:33:11.493 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.90477.log 2023-10-09T06:33:11.493 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97929.log 2023-10-09T06:33:11.493 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88690.log.gz 2023-10-09T06:33:11.493 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.2.90477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.90477.log.gz 2023-10-09T06:33:11.493 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97929.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97929.log.gz 2023-10-09T06:33:11.493 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110102.log 2023-10-09T06:33:11.493 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112571.log 2023-10-09T06:33:11.494 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102236.log 2023-10-09T06:33:11.494 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112571.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110102.log.gz 2023-10-09T06:33:11.494 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102236.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112571.log.gz 2023-10-09T06:33:11.494 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102236.log.gz 2023-10-09T06:33:11.494 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116400.log 2023-10-09T06:33:11.494 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110790.log 2023-10-09T06:33:11.494 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114918.log 2023-10-09T06:33:11.494 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116400.log.gz 2023-10-09T06:33:11.494 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110790.log: /var/log/ceph/ceph-client.admin.114918.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.110790.log.gz 2023-10-09T06:33:11.494 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114918.log.gz 2023-10-09T06:33:11.494 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109664.log 2023-10-09T06:33:11.494 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112109.log 2023-10-09T06:33:11.495 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118947.log 2023-10-09T06:33:11.495 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109664.log.gz 2023-10-09T06:33:11.495 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112109.log: /var/log/ceph/ceph-client.admin.118947.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112109.log.gz 2023-10-09T06:33:11.495 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118947.log.gz 2023-10-09T06:33:11.495 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102826.log 2023-10-09T06:33:11.495 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101678.log 2023-10-09T06:33:11.495 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102826.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102826.log.gz 2023-10-09T06:33:11.495 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.101678.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101678.log.gz 2023-10-09T06:33:11.495 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100529.log 2023-10-09T06:33:11.495 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97584.log 2023-10-09T06:33:11.495 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100529.log: /var/log/ceph/ceph-client.admin.97584.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100529.log.gz 2023-10-09T06:33:11.495 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97584.log.gz 2023-10-09T06:33:11.496 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99971.log 2023-10-09T06:33:11.496 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118382.log 2023-10-09T06:33:11.496 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107149.log 2023-10-09T06:33:11.496 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99971.log.gz 2023-10-09T06:33:11.496 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118382.log: /var/log/ceph/ceph-client.admin.107149.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118382.log.gz 2023-10-09T06:33:11.496 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107149.log.gz 2023-10-09T06:33:11.496 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92409.log 2023-10-09T06:33:11.496 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87508.log 2023-10-09T06:33:11.496 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109748.log 2023-10-09T06:33:11.496 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.87508.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92409.log.gz 2023-10-09T06:33:11.496 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117453.log 2023-10-09T06:33:11.496 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109748.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87508.log.gz 2023-10-09T06:33:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114792.log 2023-10-09T06:33:11.497 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109748.log.gz 2023-10-09T06:33:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113495.log 2023-10-09T06:33:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114792.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.117453.log.gz 2023-10-09T06:33:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113495.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114792.log.gz 2023-10-09T06:33:11.497 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113495.log.gz 2023-10-09T06:33:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112529.log 2023-10-09T06:33:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117579.log 2023-10-09T06:33:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104870.log 2023-10-09T06:33:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117579.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112529.log.gz 2023-10-09T06:33:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104870.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117579.log.gz 2023-10-09T06:33:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.84632.log 2023-10-09T06:33:11.498 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104870.log.gz 2023-10-09T06:33:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99557.log 2023-10-09T06:33:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.tmp-client.admin.84632.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-09T06:33:11.498 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.84632.log.gz 2023-10-09T06:33:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95175.log 2023-10-09T06:33:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.0.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99557.log.gz 2023-10-09T06:33:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95175.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95175.log.gz 2023-10-09T06:33:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94641.log 2023-10-09T06:33:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112697.log 2023-10-09T06:33:11.500 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.91703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91703.log.gz 2023-10-09T06:33:11.500 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87480.log 2023-10-09T06:33:11.500 INFO:teuthology.orchestra.run.smithi158.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-09T06:33:11.500 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.87480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87480.log.gz 2023-10-09T06:33:11.500 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88258.log 2023-10-09T06:33:11.500 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.1.88258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88258.log.gz 2023-10-09T06:33:11.504 INFO:teuthology.orchestra.run.smithi158.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-09T06:33:11.523 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94641.log: /var/log/ceph/ceph-client.admin.112697.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94641.log.gz 2023-10-09T06:33:11.523 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112697.log.gz 2023-10-09T06:33:11.524 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107605.log 2023-10-09T06:33:11.524 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96508.log 2023-10-09T06:33:11.524 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107605.log: /var/log/ceph/ceph-client.admin.96508.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107605.log.gz 2023-10-09T06:33:11.524 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96508.log.gz 2023-10-09T06:33:11.524 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92707.log 2023-10-09T06:33:11.524 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105695.log 2023-10-09T06:33:11.524 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.92707.log: /var/log/ceph/ceph-client.admin.105695.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92707.log.gz 2023-10-09T06:33:11.524 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105695.log.gz 2023-10-09T06:33:11.524 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102658.log 2023-10-09T06:33:11.524 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94473.log 2023-10-09T06:33:11.524 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102658.log: /var/log/ceph/ceph-client.admin.94473.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102658.log.gz 2023-10-09T06:33:11.525 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94473.log.gz 2023-10-09T06:33:11.525 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95769.log 2023-10-09T06:33:11.525 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112235.log 2023-10-09T06:33:11.525 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95769.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95769.log.gz 2023-10-09T06:33:11.525 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112235.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112235.log.gz 2023-10-09T06:33:11.525 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97040.log 2023-10-09T06:33:11.525 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118844.log 2023-10-09T06:33:11.525 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97040.log: /var/log/ceph/ceph-client.admin.118844.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97040.log.gz 2023-10-09T06:33:11.525 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118844.log.gz 2023-10-09T06:33:11.525 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104069.log 2023-10-09T06:33:11.525 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97418.log 2023-10-09T06:33:11.526 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104069.log: /var/log/ceph/ceph-client.admin.97418.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104069.log.gz 2023-10-09T06:33:11.526 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97418.log.gz 2023-10-09T06:33:11.526 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90988.log 2023-10-09T06:33:11.526 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86601.log 2023-10-09T06:33:11.526 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.90988.log: /var/log/ceph/ceph-client.admin.86601.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.90988.log.gz 2023-10-09T06:33:11.526 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86601.log.gz 2023-10-09T06:33:11.526 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104027.log 2023-10-09T06:33:11.526 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93515.log 2023-10-09T06:33:11.526 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104027.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104027.log.gz/var/log/ceph/ceph-client.admin.93515.log: 2023-10-09T06:33:11.526 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.93515.log.gz 2023-10-09T06:33:11.526 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91072.log 2023-10-09T06:33:11.527 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89482.log 2023-10-09T06:33:11.527 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91072.log: /var/log/ceph/ceph-client.admin.89482.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91072.log.gz 2023-10-09T06:33:11.527 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.89482.log.gz 2023-10-09T06:33:11.527 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94557.log 2023-10-09T06:33:11.527 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101384.log 2023-10-09T06:33:11.527 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94557.log: /var/log/ceph/ceph-client.admin.101384.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94557.log.gz 2023-10-09T06:33:11.527 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101384.log.gz 2023-10-09T06:33:11.527 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109169.log 2023-10-09T06:33:11.527 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117027.log 2023-10-09T06:33:11.527 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109169.log: /var/log/ceph/ceph-client.admin.117027.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109169.log.gz 2023-10-09T06:33:11.527 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117027.log.gz 2023-10-09T06:33:11.528 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108177.log 2023-10-09T06:33:11.528 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87550.log 2023-10-09T06:33:11.528 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108177.log: /var/log/ceph/ceph-client.admin.87550.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.108177.log.gz 2023-10-09T06:33:11.528 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.87550.log.gz 2023-10-09T06:33:11.528 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95643.log 2023-10-09T06:33:11.528 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109405.log 2023-10-09T06:33:11.528 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95643.log: /var/log/ceph/ceph-client.admin.109405.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95643.log.gz 2023-10-09T06:33:11.528 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109405.log.gz 2023-10-09T06:33:11.528 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115564.log 2023-10-09T06:33:11.528 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98555.log 2023-10-09T06:33:11.528 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115564.log: /var/log/ceph/ceph-client.admin.98555.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115564.log.gz 2023-10-09T06:33:11.529 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98555.log.gz 2023-10-09T06:33:11.529 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88691.log 2023-10-09T06:33:11.529 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87844.log 2023-10-09T06:33:11.529 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88691.log: /var/log/ceph/ceph-client.admin.87844.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88691.log.gz 2023-10-09T06:33:11.529 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.87844.log.gz 2023-10-09T06:33:11.529 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96592.log 2023-10-09T06:33:11.529 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112319.log 2023-10-09T06:33:11.529 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.96592.log: /var/log/ceph/ceph-client.admin.112319.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96592.log.gz 2023-10-09T06:33:11.529 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112319.log.gz 2023-10-09T06:33:11.530 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99497.log 2023-10-09T06:33:11.530 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100613.log 2023-10-09T06:33:11.530 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99497.log: /var/log/ceph/ceph-client.admin.100613.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99497.log.gz 2023-10-09T06:33:11.530 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100613.log.gz 2023-10-09T06:33:11.530 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108347.log 2023-10-09T06:33:11.530 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115308.log 2023-10-09T06:33:11.530 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108347.log: /var/log/ceph/ceph-client.admin.115308.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108347.log.gz 2023-10-09T06:33:11.530 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115308.log.gz 2023-10-09T06:33:11.530 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118130.log 2023-10-09T06:33:11.530 INFO:teuthology.orchestra.run.smithi031.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-09T06:33:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118130.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.118130.log.gz 2023-10-09T06:33:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104576.log 2023-10-09T06:33:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-09T06:33:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98447.log 2023-10-09T06:33:11.531 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104576.log.gz 2023-10-09T06:33:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.98447.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98447.log.gz 2023-10-09T06:33:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105653.log 2023-10-09T06:33:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93720.log 2023-10-09T06:33:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105653.log: /var/log/ceph/ceph-client.admin.93720.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105653.log.gz 2023-10-09T06:33:11.531 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93720.log.gz 2023-10-09T06:33:11.532 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115476.log 2023-10-09T06:33:11.532 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89230.log 2023-10-09T06:33:11.532 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115476.log: /var/log/ceph/ceph-client.admin.89230.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115476.log.gz 2023-10-09T06:33:11.532 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89230.log.gz 2023-10-09T06:33:11.532 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111547.log 2023-10-09T06:33:11.532 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111547.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111547.log.gz 2023-10-09T06:33:11.532 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94347.log 2023-10-09T06:33:11.532 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97376.log 2023-10-09T06:33:11.532 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94347.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94347.log.gz 2023-10-09T06:33:11.532 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98109.log 2023-10-09T06:33:11.532 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97376.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97376.log.gz 2023-10-09T06:33:11.533 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112613.log 2023-10-09T06:33:11.533 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.98109.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98109.log.gz 2023-10-09T06:33:11.533 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105929.log 2023-10-09T06:33:11.533 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.112613.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112613.log.gz 2023-10-09T06:33:11.533 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103761.log 2023-10-09T06:33:11.533 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105929.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105929.log.gz 2023-10-09T06:33:11.533 INFO:teuthology.orchestra.run.smithi031.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-09T06:33:11.533 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115520.log 2023-10-09T06:33:11.533 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.103761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97334.log 2023-10-09T06:33:11.533 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103761.log.gz 2023-10-09T06:33:11.533 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.115520.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115520.log.gz 2023-10-09T06:33:11.533 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108557.log 2023-10-09T06:33:11.533 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111271.log 2023-10-09T06:33:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108557.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97334.log.gz 2023-10-09T06:33:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111271.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111271.log.gz 2023-10-09T06:33:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105219.log 2023-10-09T06:33:11.534 INFO:teuthology.orchestra.run.smithi031.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.108557.log.gz 2023-10-09T06:33:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117808.log 2023-10-09T06:33:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118592.log 2023-10-09T06:33:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117808.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105219.log.gz 2023-10-09T06:33:11.534 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117808.log.gz 2023-10-09T06:33:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118592.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118592.log.gz 2023-10-09T06:33:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99413.log 2023-10-09T06:33:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103221.log 2023-10-09T06:33:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.99413.log: /var/log/ceph/ceph-client.admin.103221.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99413.log.gz 2023-10-09T06:33:11.535 INFO:teuthology.orchestra.run.smithi031.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.103221.log.gz 2023-10-09T06:33:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109227.log 2023-10-09T06:33:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95475.log 2023-10-09T06:33:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103803.log 2023-10-09T06:33:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95475.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109227.log.gz 2023-10-09T06:33:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.103803.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95475.log.gz 2023-10-09T06:33:11.535 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103803.log.gz 2023-10-09T06:33:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90694.log 2023-10-09T06:33:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103484.log 2023-10-09T06:33:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.90694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118424.log 2023-10-09T06:33:11.535 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90694.log.gz 2023-10-09T06:33:11.536 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.103484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103484.log.gz 2023-10-09T06:33:11.536 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98793.log 2023-10-09T06:33:11.536 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95011.log 2023-10-09T06:33:11.536 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118424.log.gz 2023-10-09T06:33:11.536 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.98793.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.98793.log.gz 2023-10-09T06:33:11.536 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114960.log 2023-10-09T06:33:11.536 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90652.log 2023-10-09T06:33:11.536 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95011.log.gz 2023-10-09T06:33:11.536 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.114960.log: /var/log/ceph/ceph-client.admin.90652.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114960.log.gz 2023-10-09T06:33:11.536 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.90652.log.gz 2023-10-09T06:33:11.536 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90114.log 2023-10-09T06:33:11.536 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109269.log 2023-10-09T06:33:11.537 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.90114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100095.log 2023-10-09T06:33:11.537 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5%/var/log/ceph/ceph-client.admin.109269.log: -- replaced with /var/log/ceph/ceph-client.admin.90114.log.gz 2023-10-09T06:33:11.537 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93428.log 2023-10-09T06:33:11.537 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100095.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109269.log.gz 2023-10-09T06:33:11.537 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100095.log.gz 2023-10-09T06:33:11.537 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118256.log 2023-10-09T06:33:11.537 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.93428.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.0.93428.log.gz/var/log/ceph/ceph-client.0.108820.log 2023-10-09T06:33:11.537 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-10-09T06:33:11.537 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100265.log 2023-10-09T06:33:11.537 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118256.log: /var/log/ceph/ceph-client.0.108820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.108820.log.gz 2023-10-09T06:33:11.537 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118256.log.gz 2023-10-09T06:33:11.537 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97082.log 2023-10-09T06:33:11.538 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.100265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110876.log 2023-10-09T06:33:11.538 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97082.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100265.log.gz 2023-10-09T06:33:11.538 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110876.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97082.log.gz 2023-10-09T06:33:11.538 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91493.log 2023-10-09T06:33:11.538 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.110876.log.gz 2023-10-09T06:33:11.538 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102910.log 2023-10-09T06:33:11.538 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.91493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111481.log 2023-10-09T06:33:11.538 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91493.log.gz 2023-10-09T06:33:11.538 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113138.log 2023-10-09T06:33:11.538 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102910.log.gz 2023-10-09T06:33:11.538 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.111481.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.111481.log.gz 2023-10-09T06:33:11.539 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107746.log 2023-10-09T06:33:11.539 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108135.log 2023-10-09T06:33:11.539 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113138.log.gz 2023-10-09T06:33:11.539 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107746.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107746.log.gz 2023-10-09T06:33:11.539 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111103.log 2023-10-09T06:33:11.539 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113436.log 2023-10-09T06:33:11.539 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3%/var/log/ceph/ceph-client.admin.111103.log: -- replaced with /var/log/ceph/ceph-client.admin.108135.log.gz 2023-10-09T06:33:11.539 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113436.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111103.log.gz 2023-10-09T06:33:11.539 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113436.log.gz 2023-10-09T06:33:11.539 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104307.log 2023-10-09T06:33:11.539 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108041.log 2023-10-09T06:33:11.539 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.104307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100487.log 2023-10-09T06:33:11.539 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104307.log.gz 2023-10-09T06:33:11.540 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.108041.log: /var/log/ceph/ceph-client.admin.100487.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108041.log.gz 2023-10-09T06:33:11.540 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100487.log.gz 2023-10-09T06:33:11.540 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110704.log 2023-10-09T06:33:11.540 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107997.log 2023-10-09T06:33:11.540 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.110704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94431.log 2023-10-09T06:33:11.540 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110704.log.gz 2023-10-09T06:33:11.540 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107829.log 2023-10-09T06:33:11.540 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94431.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107997.log.gz 2023-10-09T06:33:11.540 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118298.log 2023-10-09T06:33:11.540 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94431.log.gz 2023-10-09T06:33:11.540 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.107829.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107829.log.gz 2023-10-09T06:33:11.541 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118298.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118298.log.gz 2023-10-09T06:33:11.541 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94263.log 2023-10-09T06:33:11.541 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105177.log 2023-10-09T06:33:11.541 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105737.log 2023-10-09T06:33:11.541 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.94263.log: /var/log/ceph/ceph-client.admin.105177.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94263.log.gz 2023-10-09T06:33:11.541 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105737.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.105177.log.gz 2023-10-09T06:33:11.541 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105737.log.gz 2023-10-09T06:33:11.541 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118466.log 2023-10-09T06:33:11.541 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88689.log 2023-10-09T06:33:11.541 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.118466.log: /var/log/ceph/ceph-client.admin.88689.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118466.log.gz 2023-10-09T06:33:11.541 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88689.log.gz 2023-10-09T06:33:11.541 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95261.log 2023-10-09T06:33:11.542 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102784.log 2023-10-09T06:33:11.542 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.95261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98752.log 2023-10-09T06:33:11.542 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.102784.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95261.log.gz 2023-10-09T06:33:11.542 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.98752.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102784.log.gz 2023-10-09T06:33:11.542 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.98752.log.gz 2023-10-09T06:33:11.542 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116926.log 2023-10-09T06:33:11.542 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113054.log 2023-10-09T06:33:11.542 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.116926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93001.log 2023-10-09T06:33:11.542 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.113054.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116926.log.gz 2023-10-09T06:33:11.542 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.93001.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113054.log.gz 2023-10-09T06:33:11.542 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93001.log.gz 2023-10-09T06:33:11.542 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-09T06:33:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105441.log 2023-10-09T06:33:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110313.log 2023-10-09T06:33:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.105441.log: /var/log/ceph/ceph-client.admin.110313.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105441.log.gz 2023-10-09T06:33:11.543 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110313.log.gz 2023-10-09T06:33:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88355.log 2023-10-09T06:33:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109060.log 2023-10-09T06:33:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88355.log: /var/log/ceph/ceph-client.admin.109060.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88355.log.gz 2023-10-09T06:33:11.543 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109060.log.gz 2023-10-09T06:33:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109363.log 2023-10-09T06:33:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104975.log 2023-10-09T06:33:11.543 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.109363.log: /var/log/ceph/ceph-client.admin.104975.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109363.log.gz 2023-10-09T06:33:11.544 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104975.log.gz 2023-10-09T06:33:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90073.log 2023-10-09T06:33:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97166.log 2023-10-09T06:33:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.90073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.90073.log.gz 2023-10-09T06:33:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.97166.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97166.log.gz 2023-10-09T06:33:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117285.log 2023-10-09T06:33:11.544 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.117285.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.117285.log.gz 2023-10-09T06:33:11.544 INFO:teuthology.orchestra.run.smithi031.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-09T06:33:11.573 INFO:teuthology.orchestra.run.smithi158.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-09T06:33:11.824 INFO:teuthology.orchestra.run.smithi158.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-09T06:33:11.988 INFO:teuthology.orchestra.run.smithi158.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-09T06:33:12.046 INFO:teuthology.orchestra.run.smithi158.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-09T06:33:12.072 INFO:teuthology.orchestra.run.smithi158.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-09T06:33:12.091 INFO:teuthology.orchestra.run.smithi031.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-09T06:33:12.109 INFO:teuthology.orchestra.run.smithi158.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-09T06:33:12.110 INFO:teuthology.orchestra.run.smithi158.stderr: 2023-10-09T06:33:12.110 INFO:teuthology.orchestra.run.smithi158.stderr:real 0m0.859s 2023-10-09T06:33:12.110 INFO:teuthology.orchestra.run.smithi158.stderr:user 0m4.239s 2023-10-09T06:33:12.110 INFO:teuthology.orchestra.run.smithi158.stderr:sys 0m0.178s 2023-10-09T06:33:12.156 INFO:teuthology.orchestra.run.smithi031.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-09T06:33:12.165 INFO:teuthology.orchestra.run.smithi031.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-09T06:33:12.337 INFO:teuthology.orchestra.run.smithi031.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-09T06:33:12.374 INFO:teuthology.orchestra.run.smithi031.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-09T06:33:12.375 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-10-09T06:33:12.376 INFO:teuthology.orchestra.run.smithi031.stderr:real 0m1.148s 2023-10-09T06:33:12.376 INFO:teuthology.orchestra.run.smithi031.stderr:user 0m4.698s 2023-10-09T06:33:12.376 INFO:teuthology.orchestra.run.smithi031.stderr:sys 0m0.501s 2023-10-09T06:33:12.377 INFO:tasks.ceph:Archiving logs... 2023-10-09T06:33:12.377 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375/remote/smithi031/log 2023-10-09T06:33:12.378 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-09T06:33:13.513 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375/remote/smithi158/log 2023-10-09T06:33:13.514 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-09T06:33:14.102 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-09T06:33:14.114 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-09T06:33:14.114 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-09T06:33:14.117 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-09T06:33:14.190 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-09T06:33:14.198 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-09T06:33:14.199 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T06:33:14.201 DEBUG:teuthology.orchestra.run.smithi158:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T06:33:14.215 INFO:teuthology.orchestra.run.smithi031.stderr:bash: ntpq: command not found 2023-10-09T06:33:14.216 INFO:teuthology.orchestra.run.smithi158.stderr:bash: ntpq: command not found 2023-10-09T06:33:14.219 INFO:teuthology.orchestra.run.smithi031.stdout:210 Number of sources = 4 2023-10-09T06:33:14.219 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T06:33:14.219 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2023-10-09T06:33:14.219 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 44 -710us[ -701us] +/- 74ms 2023-10-09T06:33:14.219 INFO:teuthology.orchestra.run.smithi031.stdout:^* hv02.front.sepia.ceph.com 3 6 377 43 +242us[ +251us] +/- 57ms 2023-10-09T06:33:14.219 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +386us[ +394us] +/- 70ms 2023-10-09T06:33:14.220 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:33:14.220 INFO:teuthology.orchestra.run.smithi158.stdout:210 Number of sources = 4 2023-10-09T06:33:14.220 INFO:teuthology.orchestra.run.smithi158.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T06:33:14.220 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================== 2023-10-09T06:33:14.221 INFO:teuthology.orchestra.run.smithi158.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 44 -713us[ -708us] +/- 74ms 2023-10-09T06:33:14.221 INFO:teuthology.orchestra.run.smithi158.stdout:^* hv02.front.sepia.ceph.com 3 6 377 44 +232us[ +237us] +/- 57ms 2023-10-09T06:33:14.222 INFO:teuthology.orchestra.run.smithi158.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +357us[ +362us] +/- 70ms 2023-10-09T06:33:14.222 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:33:14.223 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-09T06:33:14.232 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-09T06:33:14.232 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-09T06:33:14.249 DEBUG:teuthology.orchestra.run.smithi031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-09T06:33:14.386 DEBUG:teuthology.orchestra.run.smithi158:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-09T06:33:14.483 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T06:33:14.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:33:14.517 DEBUG:teuthology.orchestra.run.smithi158:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T06:33:14.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:33:14.547 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-09T06:33:14.558 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-09T06:33:14.644 INFO:teuthology.task.internal:Duration was 1387.686257 seconds 2023-10-09T06:33:14.644 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-09T06:33:14.659 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-09T06:33:14.659 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-09T06:33:14.662 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-09T06:33:14.705 INFO:teuthology.orchestra.run.smithi158.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T06:33:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T06:33:15.173 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-09T06:33:15.173 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2023-10-09T06:33:15.173 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-09T06:33:15.195 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi158.front.sepia.ceph.com 2023-10-09T06:33:15.196 DEBUG:teuthology.orchestra.run.smithi158:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-09T06:33:15.215 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-09T06:33:15.215 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-09T06:33:15.238 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-09T06:33:15.294 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-09T06:33:15.294 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-09T06:33:15.297 DEBUG:teuthology.orchestra.run.smithi158:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-09T06:33:15.411 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-09T06:33:15.421 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-09T06:33:15.422 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-09T06:33:15.447 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-09T06:33:15.472 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-09T06:33:15.482 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-09T06:33:15.490 DEBUG:teuthology.orchestra.run.smithi158:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-09T06:33:15.512 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2023-10-09T06:33:15.536 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = core 2023-10-09T06:33:15.549 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-09T06:33:15.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:33:15.581 DEBUG:teuthology.orchestra.run.smithi158:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-09T06:33:15.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:33:15.603 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-09T06:33:15.613 INFO:teuthology.task.internal:Transferring archived files... 2023-10-09T06:33:15.613 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375/remote/smithi031 2023-10-09T06:33:15.614 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-09T06:33:15.659 DEBUG:teuthology.misc:Transferring archived files from smithi158:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375/remote/smithi158 2023-10-09T06:33:15.660 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-09T06:33:15.695 INFO:teuthology.task.internal:Removing archive directory... 2023-10-09T06:33:15.695 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-09T06:33:15.697 DEBUG:teuthology.orchestra.run.smithi158:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-09T06:33:15.744 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-09T06:33:15.755 INFO:teuthology.task.internal:Not uploading archives. 2023-10-09T06:33:15.755 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-09T06:33:15.769 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-09T06:33:15.769 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-09T06:33:15.771 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-09T06:33:15.784 INFO:teuthology.orchestra.run.smithi031.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 9 06:33 /home/ubuntu/cephtest 2023-10-09T06:33:15.798 INFO:teuthology.orchestra.run.smithi158.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 9 06:33 /home/ubuntu/cephtest 2023-10-09T06:33:15.800 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-09T06:33:15.810 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-09T06:33:15.839 INFO:teuthology.nuke:Checking targets against current locks 2023-10-09T06:33:15.865 DEBUG:teuthology.nuke:shortname: smithi031 2023-10-09T06:33:15.865 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T06:33:15.887 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 06:02:05.255947', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLRVEBuuJ0RS8zz7zUdHUzUyE4iRsUi8Q7TmoPhC/I+TVBoPFh9toqiAnTZ8slMoPqgsB5hXgx0Es0rVLn5ZbU8='} 2023-10-09T06:33:15.890 DEBUG:teuthology.nuke:shortname: smithi158 2023-10-09T06:33:15.890 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T06:33:15.911 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418375', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 06:02:05.257331', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLn7tkOtY9ygveFVe4QbRCNfjDA5rUZ2yFg1618DNqnkk5IleuNdVsjJgMw7gayzjYXz9/+xc9CfCsQUg6YiIrk='} 2023-10-09T06:33:15.932 INFO:teuthology.orchestra.console.smithi031:Power off 2023-10-09T06:33:15.932 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T06:33:15.955 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-10-09T06:33:15.955 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:33:15.971 INFO:teuthology.orchestra.console.smithi158:Power off 2023-10-09T06:33:15.971 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T06:33:15.979 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-09T06:33:15.991 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-10-09T06:33:15.991 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:33:16.015 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-09T06:33:19.981 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:33:20.017 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:33:20.091 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-09T06:33:20.126 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-09T06:33:24.094 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:33:24.127 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:33:24.204 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-09T06:33:24.237 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-09T06:33:24.305 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-10-09T06:33:24.338 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-10-09T06:33:24.443 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1387.6862571239471 failure_reason: '"1696832441.3288944 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 222697.888416 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.3. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_vshankar@teuthology success: false 2023-10-09T06:33:24.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:33:24.519 INFO:teuthology.run:FAIL